2024-08-19T00:41:39.847 INFO:root:teuthology version: 1.2.0 2024-08-19T00:41:39.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-19T00:41:39.977 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860086 branch: squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7860086' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/reef ' name: teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 1664 sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 sleep_before_teardown: 0 subset: 36/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 78215f5a1cf5eaf321d506a66539942e12851f34 targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNswlDUVbyFHIT8bgk7lJWwRk0QkZ2R584BZd8Mtjdmo4eF9fEnDq1YA2B7CC1pRIKoyIPLT8Rle7573SAAF8jU= smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKpWOjKd1z331QvDZ2CS7g6PxFCinYelAmtk4o6ehZk46GQoYPrs0N7Puoxbxa86D880tijR3yORxAMUX5rc4gw= tasks: - install: branch: reef exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:reef roleless: true - print: '**** done end installing reef cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-18_21:24:02 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-08-19T00:41:39.977 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa; will attempt to use it 2024-08-19T00:41:39.978 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks 2024-08-19T00:41:39.978 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-19T00:41:39.979 INFO:teuthology.task.internal:Checking packages... 2024-08-19T00:41:40.004 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'de09dd018de4baddfa6ca4d43bc8fb784cf75833' 2024-08-19T00:41:40.004 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-19T00:41:40.004 INFO:teuthology.packaging:ref: None 2024-08-19T00:41:40.004 INFO:teuthology.packaging:tag: None 2024-08-19T00:41:40.004 INFO:teuthology.packaging:branch: squid 2024-08-19T00:41:40.004 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:41:40.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-08-19T00:41:40.204 INFO:teuthology.task.internal:Found packages for ceph version 19.1.0-1386.g78215f5a 2024-08-19T00:41:40.205 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-19T00:41:40.212 INFO:teuthology.task.internal:no buildpackages task found 2024-08-19T00:41:40.212 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-19T00:41:40.219 INFO:teuthology.task.internal:Saving configuration 2024-08-19T00:41:40.238 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-19T00:41:40.256 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-19T00:41:40.281 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860086', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-19 00:36:40.214389', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNswlDUVbyFHIT8bgk7lJWwRk0QkZ2R584BZd8Mtjdmo4eF9fEnDq1YA2B7CC1pRIKoyIPLT8Rle7573SAAF8jU='} 2024-08-19T00:41:40.301 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860086', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-19 00:36:40.216393', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKpWOjKd1z331QvDZ2CS7g6PxFCinYelAmtk4o6ehZk46GQoYPrs0N7Puoxbxa86D880tijR3yORxAMUX5rc4gw='} 2024-08-19T00:41:40.301 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-19T00:41:40.307 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-08-19T00:41:40.308 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-08-19T00:41:40.308 INFO:teuthology.run_tasks:Running task console_log... 2024-08-19T00:41:40.373 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd068bfbbe0>, signals=[15]) 2024-08-19T00:41:40.373 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-19T00:41:40.380 INFO:teuthology.task.internal:Opening connections... 2024-08-19T00:41:40.380 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:41:40.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:41:40.462 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-08-19T00:41:40.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:41:40.536 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-19T00:41:40.542 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-08-19T00:41:40.560 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-08-19T00:41:40.561 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-08-19T00:41:40.617 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-08-19T00:41:40.618 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-08-19T00:41:40.618 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-08-19T00:41:40.618 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-08-19T00:41:40.618 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-08-19T00:41:40.618 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-08-19T00:41:40.618 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-19T00:41:40.618 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-08-19T00:41:40.618 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-08-19T00:41:40.618 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-19T00:41:40.618 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-08-19T00:41:40.619 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-19T00:41:40.619 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-19T00:41:40.619 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-19T00:41:40.619 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-08-19T00:41:40.643 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-08-19T00:41:40.662 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-08-19T00:41:40.662 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-08-19T00:41:40.720 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-08-19T00:41:40.720 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-08-19T00:41:40.720 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-08-19T00:41:40.720 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-08-19T00:41:40.720 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-08-19T00:41:40.720 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-08-19T00:41:40.721 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-19T00:41:40.721 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-08-19T00:41:40.721 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-08-19T00:41:40.721 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-19T00:41:40.721 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-08-19T00:41:40.721 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-19T00:41:40.721 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-19T00:41:40.721 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-19T00:41:40.721 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-08-19T00:41:40.743 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-19T00:41:40.752 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-19T00:41:40.810 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-19T00:41:40.810 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-08-19T00:41:40.814 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-08-19T00:41:40.831 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-19T00:41:40.968 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-19T00:41:40.969 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-08-19T00:41:40.971 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-08-19T00:41:40.998 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-19T00:41:41.055 INFO:teuthology.run_tasks:Running task kernel... 2024-08-19T00:41:41.069 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-08-19T00:41:41.069 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-08-19T00:41:41.069 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-19T00:41:41.070 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-19T00:41:41.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:41:41.087 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-08-19T00:41:41.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:41:41.088 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-08-19T00:41:41.145 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-480.el9.x86_64 2024-08-19T00:41:41.145 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.14.0-480.el9.x86_64 2024-08-19T00:41:41.145 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum install -y kernel 2024-08-19T00:41:41.146 INFO:teuthology.orchestra.run.smithi086.stdout:5.14.0-480.el9.x86_64 2024-08-19T00:41:41.146 INFO:teuthology.task.kernel:Running kernel on smithi086: 5.14.0-480.el9.x86_64 2024-08-19T00:41:41.146 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum install -y kernel 2024-08-19T00:41:43.865 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.2 MB 00:00 2024-08-19T00:41:44.249 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.2 MB 00:01 2024-08-19T00:41:45.782 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-08-19T00:41:46.208 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-08-19T00:41:50.183 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.6 MB 00:00 2024-08-19T00:41:51.834 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 18 kB 00:00 2024-08-19T00:41:52.609 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.6 MB 00:02 2024-08-19T00:41:54.082 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 11 MB/s | 22 MB 00:02 2024-08-19T00:41:54.268 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 18 kB 00:00 2024-08-19T00:41:55.488 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 20 MB/s | 22 MB 00:01 2024-08-19T00:41:59.752 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-19T00:42:00.853 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-08-19T00:42:01.758 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-19T00:42:01.759 INFO:teuthology.orchestra.run.smithi017.stdout:Package kernel-5.14.0-480.el9.x86_64 is already installed. 2024-08-19T00:42:01.832 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:42:01.833 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-08-19T00:42:01.833 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:42:01.929 DEBUG:teuthology.orchestra.run.smithi017:> echo no | sudo yum reinstall kernel || true 2024-08-19T00:42:02.455 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:03 ago on Mon 19 Aug 2024 12:41:59 AM UTC. 2024-08-19T00:42:02.594 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:42:02.607 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:42:02.607 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-08-19T00:42:02.607 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:42:02.607 INFO:teuthology.orchestra.run.smithi017.stdout:Reinstalling: 2024-08-19T00:42:02.607 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-19T00:42:02.607 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:42:02.607 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:42:02.607 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:42:02.607 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:42:02.607 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 1.5 M 2024-08-19T00:42:02.608 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 0 2024-08-19T00:42:02.608 INFO:teuthology.orchestra.run.smithi017.stderr:Operation aborted. 2024-08-19T00:42:02.660 INFO:teuthology.orchestra.run.smithi017.stdout:Is this ok [y/N]: 2024-08-19T00:42:02.660 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum reinstall -y kernel || true 2024-08-19T00:42:02.793 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-19T00:42:02.793 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-5.14.0-480.el9.x86_64 is already installed. 2024-08-19T00:42:02.872 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:42:02.873 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-08-19T00:42:02.873 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:42:02.989 DEBUG:teuthology.orchestra.run.smithi086:> echo no | sudo yum reinstall kernel || true 2024-08-19T00:42:03.192 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:04 ago on Mon 19 Aug 2024 12:41:59 AM UTC. 2024-08-19T00:42:03.319 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:42:03.320 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:42:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-08-19T00:42:03.320 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:42:03.320 INFO:teuthology.orchestra.run.smithi017.stdout:Reinstalling: 2024-08-19T00:42:03.320 INFO:teuthology.orchestra.run.smithi017.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-19T00:42:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:42:03.321 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:42:03.321 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:42:03.321 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:42:03.321 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 1.5 M 2024-08-19T00:42:03.321 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 0 2024-08-19T00:42:03.321 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:42:03.505 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:03 ago on Mon 19 Aug 2024 12:42:00 AM UTC. 2024-08-19T00:42:03.657 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:42:03.661 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:42:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2024-08-19T00:42:03.661 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:42:03.661 INFO:teuthology.orchestra.run.smithi086.stdout:Reinstalling: 2024-08-19T00:42:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-19T00:42:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:42:03.661 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:42:03.661 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:42:03.661 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:42:03.662 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 1.5 M 2024-08-19T00:42:03.662 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 0 2024-08-19T00:42:03.662 INFO:teuthology.orchestra.run.smithi086.stderr:Operation aborted. 2024-08-19T00:42:03.727 INFO:teuthology.orchestra.run.smithi086.stdout:Is this ok [y/N]: 2024-08-19T00:42:03.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum reinstall -y kernel || true 2024-08-19T00:42:03.821 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-480.el9.x86_64.rpm 3.8 MB/s | 1.5 MB 00:00 2024-08-19T00:42:03.821 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:42:03.821 INFO:teuthology.orchestra.run.smithi017.stdout:Total 3.0 MB/s | 1.5 MB 00:00 2024-08-19T00:42:03.856 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:42:04.112 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:42:04.112 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:42:04.138 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:42:04.138 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:42:04.242 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:04 ago on Mon 19 Aug 2024 12:42:00 AM UTC. 2024-08-19T00:42:04.295 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:42:04.362 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:42:04.363 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:42:04.363 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2024-08-19T00:42:04.363 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:42:04.363 INFO:teuthology.orchestra.run.smithi086.stdout:Reinstalling: 2024-08-19T00:42:04.364 INFO:teuthology.orchestra.run.smithi086.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-19T00:42:04.364 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:42:04.364 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:42:04.364 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:42:04.364 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:42:04.364 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 1.5 M 2024-08-19T00:42:04.364 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 0 2024-08-19T00:42:04.364 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:42:04.389 INFO:teuthology.orchestra.run.smithi017.stdout: Reinstalling : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-19T00:42:04.389 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T00:42:04.664 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-5.14.0-480.el9.x86_64.rpm 7.5 MB/s | 1.5 MB 00:00 2024-08-19T00:42:04.664 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:42:04.664 INFO:teuthology.orchestra.run.smithi086.stdout:Total 5.0 MB/s | 1.5 MB 00:00 2024-08-19T00:42:04.702 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:42:04.945 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:42:04.945 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:42:04.970 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:42:04.970 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:42:05.074 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T00:42:05.074 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-19T00:42:05.110 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:42:05.216 INFO:teuthology.orchestra.run.smithi086.stdout: Reinstalling : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-19T00:42:05.216 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T00:42:05.814 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T00:42:05.814 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:42:05.814 INFO:teuthology.orchestra.run.smithi017.stdout:Reinstalled: 2024-08-19T00:42:05.814 INFO:teuthology.orchestra.run.smithi017.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-19T00:42:05.815 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:42:05.815 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:42:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T00:42:05.930 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/2 2024-08-19T00:42:06.027 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q kernel | sort -rV | head -n 1 2024-08-19T00:42:06.082 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-19T00:42:06.083 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-19T00:42:06.083 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-19T00:42:06.083 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-08-19T00:42:06.084 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-19T00:42:06.112 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-08-19T00:42:06.146 DEBUG:teuthology.parallel:result is None 2024-08-19T00:42:06.634 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 2/2 2024-08-19T00:42:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:42:06.635 INFO:teuthology.orchestra.run.smithi086.stdout:Reinstalled: 2024-08-19T00:42:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-19T00:42:06.635 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:42:06.635 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:42:06.836 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel | sort -rV | head -n 1 2024-08-19T00:42:06.892 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-19T00:42:06.892 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-19T00:42:06.892 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-08-19T00:42:06.893 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-08-19T00:42:06.893 DEBUG:teuthology.orchestra.run.smithi086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-08-19T00:42:06.922 INFO:teuthology.orchestra.run.smithi086.stdout:ttyS1 2024-08-19T00:42:06.947 DEBUG:teuthology.parallel:result is None 2024-08-19T00:42:06.947 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-19T00:42:06.953 INFO:teuthology.task.internal:Creating test directory... 2024-08-19T00:42:06.953 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-19T00:42:06.956 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-19T00:42:07.003 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-19T00:42:07.009 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-19T00:42:07.096 INFO:teuthology.task.internal:Creating archive directory... 2024-08-19T00:42:07.097 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-19T00:42:07.099 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-19T00:42:07.127 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-19T00:42:07.133 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-19T00:42:07.133 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-19T00:42:07.166 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-19T00:42:07.204 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T00:42:07.215 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T00:42:07.235 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T00:42:07.245 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-19T00:42:07.246 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-19T00:42:07.254 INFO:teuthology.task.internal:Configuring sudo... 2024-08-19T00:42:07.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-19T00:42:07.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-19T00:42:07.285 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-19T00:42:07.317 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-19T00:42:07.317 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-19T00:42:07.328 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-19T00:42:07.343 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T00:42:07.425 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T00:42:07.473 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T00:42:07.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T00:42:07.598 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:42:07.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-19T00:42:07.664 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T00:42:07.705 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-19T00:42:07.751 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T00:42:07.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-19T00:42:07.875 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:42:07.875 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-19T00:42:07.940 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-08-19T00:42:07.942 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-08-19T00:42:07.980 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T00:42:08.036 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T00:42:08.481 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-19T00:42:08.490 INFO:teuthology.task.internal:Starting timer... 2024-08-19T00:42:08.490 INFO:teuthology.run_tasks:Running task pcp... 2024-08-19T00:42:08.501 INFO:teuthology.run_tasks:Running task selinux... 2024-08-19T00:42:08.508 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-08-19T00:42:08.509 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-08-19T00:42:08.571 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-08-19T00:42:08.573 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2024-08-19T00:42:08.629 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2024-08-19T00:42:08.630 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-19T00:42:08.631 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-08-19T00:42:08.659 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-08-19T00:42:08.659 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2024-08-19T00:42:08.679 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2024-08-19T00:42:08.679 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi086.front.sepia.ceph.com': 'permissive'} 2024-08-19T00:42:08.679 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-19T00:42:08.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:42:08.727 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-19T00:42:08.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:42:08.754 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-19T00:42:08.754 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-08-19T00:42:08.796 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2024-08-19T00:42:08.832 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-19T00:42:08.842 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-19T00:42:08.854 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-19T00:42:08.855 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi086.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-19T00:43:50.605 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com')] 2024-08-19T00:43:50.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-08-19T00:43:50.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:43:50.687 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-08-19T00:43:50.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-08-19T00:43:50.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-08-19T00:43:50.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-19T00:43:50.844 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-08-19T00:43:50.925 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-08-19T00:43:50.926 INFO:teuthology.run_tasks:Running task clock... 2024-08-19T00:43:50.936 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-19T00:43:50.936 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-19T00:43:50.936 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:43:50.938 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-19T00:43:50.939 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T00:43:50.966 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-19T00:43:50.981 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-19T00:43:50.993 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-19T00:43:51.005 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-08-19T00:43:51.007 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-19T00:43:51.016 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-08-19T00:43:51.030 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-19T00:43:51.031 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2024-08-19T00:43:51.042 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2024-08-19T00:43:51.044 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-19T00:43:51.056 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-19T00:43:51.070 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-19T00:43:51.109 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:43:51.112 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:43:51.122 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-08-19T00:43:51.126 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T00:43:51.126 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-08-19T00:43:51.126 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:43:51.126 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:43:51.126 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:43:51.126 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T00:43:51.127 INFO:teuthology.run_tasks:Running task install... 2024-08-19T00:43:51.135 DEBUG:teuthology.task.install:project ceph 2024-08-19T00:43:51.135 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'}} 2024-08-19T00:43:51.135 DEBUG:teuthology.task.install:config {'branch': 'reef', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'} 2024-08-19T00:43:51.135 INFO:teuthology.task.install:Using flavor: default 2024-08-19T00:43:51.140 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-19T00:43:51.140 INFO:teuthology.task.install:extra packages: [] 2024-08-19T00:43:51.141 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-19T00:43:51.141 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-19T00:43:51.141 INFO:teuthology.packaging:ref: None 2024-08-19T00:43:51.141 INFO:teuthology.packaging:tag: None 2024-08-19T00:43:51.141 INFO:teuthology.packaging:branch: reef 2024-08-19T00:43:51.141 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:43:51.141 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-08-19T00:43:51.143 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'reef', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'tag': None, 'wait_for_package': False} 2024-08-19T00:43:51.143 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-19T00:43:51.143 INFO:teuthology.packaging:ref: None 2024-08-19T00:43:51.143 INFO:teuthology.packaging:tag: None 2024-08-19T00:43:51.143 INFO:teuthology.packaging:branch: reef 2024-08-19T00:43:51.144 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:43:51.144 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-08-19T00:43:51.405 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/flavors/default/ 2024-08-19T00:43:51.405 INFO:teuthology.task.install.rpm:Package version is 18.2.4-721.gbaa926de 2024-08-19T00:43:51.438 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/flavors/default/ 2024-08-19T00:43:51.438 INFO:teuthology.task.install.rpm:Package version is 18.2.4-721.gbaa926de 2024-08-19T00:43:51.515 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-19T00:43:51.516 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:43:51.516 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-19T00:43:51.543 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-08-19T00:43:51.543 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-19T00:43:51.543 INFO:teuthology.packaging:ref: None 2024-08-19T00:43:51.543 INFO:teuthology.packaging:tag: None 2024-08-19T00:43:51.543 INFO:teuthology.packaging:branch: reef 2024-08-19T00:43:51.543 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:43:51.543 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-19T00:43:51.545 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-19T00:43:51.545 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:43:51.546 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-19T00:43:51.572 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-08-19T00:43:51.572 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-19T00:43:51.572 INFO:teuthology.packaging:ref: None 2024-08-19T00:43:51.572 INFO:teuthology.packaging:tag: None 2024-08-19T00:43:51.572 INFO:teuthology.packaging:branch: reef 2024-08-19T00:43:51.572 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:43:51.573 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-19T00:43:51.610 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-19T00:43:51.638 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-19T00:43:51.685 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-19T00:43:51.714 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-19T00:43:51.750 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-08-19T00:43:51.751 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-08-19T00:43:51.779 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2024-08-19T00:43:51.780 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2024-08-19T00:43:51.983 INFO:teuthology.orchestra.run.smithi017.stdout:45 files removed 2024-08-19T00:43:52.004 INFO:teuthology.orchestra.run.smithi086.stdout:45 files removed 2024-08-19T00:43:52.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw 2024-08-19T00:43:52.030 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw 2024-08-19T00:43:52.582 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 265 kB/s | 77 kB 00:00 2024-08-19T00:43:52.587 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 272 kB/s | 77 kB 00:00 2024-08-19T00:43:52.887 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 44 kB/s | 11 kB 00:00 2024-08-19T00:43:52.891 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-08-19T00:43:53.158 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-08-19T00:43:53.163 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-08-19T00:43:54.925 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-08-19T00:43:55.005 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-08-19T00:43:57.098 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-08-19T00:43:58.109 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-08-19T00:44:02.098 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.6 MB 00:01 2024-08-19T00:44:02.718 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.6 MB 00:00 2024-08-19T00:44:03.608 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 18 kB 00:00 2024-08-19T00:44:04.261 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 66 kB/s | 18 kB 00:00 2024-08-19T00:44:04.695 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 23 MB/s | 22 MB 00:00 2024-08-19T00:44:05.709 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 17 MB/s | 22 MB 00:01 2024-08-19T00:44:10.177 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-08-19T00:44:11.238 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 48 kB/s | 1.7 kB 00:00 2024-08-19T00:44:12.394 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:44:12.396 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:12.396 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-08-19T00:44:12.396 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:12.396 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:44:12.396 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:18.2.4-721.gbaa926de.el9 ceph 7.7 M 2024-08-19T00:44:12.396 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:18.2.4-721.gbaa926de.el9 ceph 3.3 M 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:18.2.4-721.gbaa926de.el9 ceph 3.0 M 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:18.2.4-721.gbaa926de.el9 ceph 5.1 M 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:18.2.4-721.gbaa926de.el9 ceph 18 M 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:18.2.4-721.gbaa926de.el9 ceph 25 k 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-19T00:44:12.397 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:18.2.4-721.gbaa926de.el9 ceph 711 k 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:18.2.4-721.gbaa926de.el9 ceph 477 k 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:18.2.4-721.gbaa926de.el9 ceph 4.5 M 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:18.2.4-721.gbaa926de.el9 ceph 45 k 2024-08-19T00:44:12.398 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:18.2.4-721.gbaa926de.el9 ceph 129 k 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:18.2.4-721.gbaa926de.el9 ceph 188 k 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:18.2.4-721.gbaa926de.el9 ceph 371 k 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:18.2.4-721.gbaa926de.el9 ceph 348 k 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:18.2.4-721.gbaa926de.el9 ceph 116 k 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout:Install 28 Packages 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 2 Packages 2024-08-19T00:44:12.399 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:12.400 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 53 M 2024-08-19T00:44:12.400 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:44:13.462 INFO:teuthology.orchestra.run.smithi086.stdout:(1/30): ceph-common-18.2.4-721.gbaa926de.el9.x8 18 MB/s | 18 MB 00:01 2024-08-19T00:44:13.542 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:44:13.543 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:44:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-08-19T00:44:13.543 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:44:13.543 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:44:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:18.2.4-721.gbaa926de.el9 ceph 7.7 M 2024-08-19T00:44:13.543 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-08-19T00:44:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:18.2.4-721.gbaa926de.el9 ceph 3.3 M 2024-08-19T00:44:13.543 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:18.2.4-721.gbaa926de.el9 ceph 3.0 M 2024-08-19T00:44:13.543 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:18.2.4-721.gbaa926de.el9 ceph 5.1 M 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:18.2.4-721.gbaa926de.el9 ceph 18 M 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:18.2.4-721.gbaa926de.el9 ceph 25 k 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:18.2.4-721.gbaa926de.el9 ceph 711 k 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-19T00:44:13.544 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:18.2.4-721.gbaa926de.el9 ceph 477 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:18.2.4-721.gbaa926de.el9 ceph 4.5 M 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:18.2.4-721.gbaa926de.el9 ceph 45 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:18.2.4-721.gbaa926de.el9 ceph 129 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:18.2.4-721.gbaa926de.el9 ceph 188 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:18.2.4-721.gbaa926de.el9 ceph 371 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:18.2.4-721.gbaa926de.el9 ceph 348 k 2024-08-19T00:44:13.545 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:18.2.4-721.gbaa926de.el9 ceph 116 k 2024-08-19T00:44:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-19T00:44:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-19T00:44:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:13.546 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:44:13.546 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:44:13.546 INFO:teuthology.orchestra.run.smithi017.stdout:Install 28 Packages 2024-08-19T00:44:13.546 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 2 Packages 2024-08-19T00:44:13.546 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:13.547 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 53 M 2024-08-19T00:44:13.547 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:44:14.095 INFO:teuthology.orchestra.run.smithi086.stdout:(2/30): ceph-radosgw-18.2.4-721.gbaa926de.el9.x 4.7 MB/s | 7.7 MB 00:01 2024-08-19T00:44:14.171 INFO:teuthology.orchestra.run.smithi086.stdout:(3/30): ceph-selinux-18.2.4-721.gbaa926de.el9.x 35 kB/s | 25 kB 00:00 2024-08-19T00:44:14.271 INFO:teuthology.orchestra.run.smithi086.stdout:(4/30): libcephfs2-18.2.4-721.gbaa926de.el9.x86 4.0 MB/s | 711 kB 00:00 2024-08-19T00:44:14.289 INFO:teuthology.orchestra.run.smithi017.stdout:(1/30): ceph-base-18.2.4-721.gbaa926de.el9.x86_ 11 MB/s | 5.1 MB 00:00 2024-08-19T00:44:14.338 INFO:teuthology.orchestra.run.smithi086.stdout:(5/30): libradosstriper1-18.2.4-721.gbaa926de.e 2.8 MB/s | 477 kB 00:00 2024-08-19T00:44:14.364 INFO:teuthology.orchestra.run.smithi017.stdout:(2/30): ceph-selinux-18.2.4-721.gbaa926de.el9.x 336 kB/s | 25 kB 00:00 2024-08-19T00:44:14.456 INFO:teuthology.orchestra.run.smithi017.stdout:(3/30): libcephfs2-18.2.4-721.gbaa926de.el9.x86 7.6 MB/s | 711 kB 00:00 2024-08-19T00:44:14.548 INFO:teuthology.orchestra.run.smithi017.stdout:(4/30): libradosstriper1-18.2.4-721.gbaa926de.e 5.1 MB/s | 477 kB 00:00 2024-08-19T00:44:14.681 INFO:teuthology.orchestra.run.smithi017.stdout:(5/30): ceph-radosgw-18.2.4-721.gbaa926de.el9.x 9.2 MB/s | 7.7 MB 00:00 2024-08-19T00:44:14.873 INFO:teuthology.orchestra.run.smithi017.stdout:(6/30): ceph-common-18.2.4-721.gbaa926de.el9.x8 18 MB/s | 18 MB 00:01 2024-08-19T00:44:15.107 INFO:teuthology.orchestra.run.smithi017.stdout:(7/30): python3-ceph-argparse-18.2.4-721.gbaa92 106 kB/s | 45 kB 00:00 2024-08-19T00:44:15.113 INFO:teuthology.orchestra.run.smithi086.stdout:(6/30): python3-ceph-argparse-18.2.4-721.gbaa92 58 kB/s | 45 kB 00:00 2024-08-19T00:44:15.132 INFO:teuthology.orchestra.run.smithi017.stdout:(8/30): python3-ceph-common-18.2.4-721.gbaa926d 500 kB/s | 129 kB 00:00 2024-08-19T00:44:15.157 INFO:teuthology.orchestra.run.smithi017.stdout:(9/30): python3-cephfs-18.2.4-721.gbaa926de.el9 3.7 MB/s | 188 kB 00:00 2024-08-19T00:44:15.180 INFO:teuthology.orchestra.run.smithi086.stdout:(7/30): ceph-base-18.2.4-721.gbaa926de.el9.x86_ 1.9 MB/s | 5.1 MB 00:02 2024-08-19T00:44:15.233 INFO:teuthology.orchestra.run.smithi017.stdout:(10/30): librgw2-18.2.4-721.gbaa926de.el9.x86_6 6.5 MB/s | 4.5 MB 00:00 2024-08-19T00:44:15.239 INFO:teuthology.orchestra.run.smithi086.stdout:(8/30): librgw2-18.2.4-721.gbaa926de.el9.x86_64 4.6 MB/s | 4.5 MB 00:00 2024-08-19T00:44:15.258 INFO:teuthology.orchestra.run.smithi017.stdout:(11/30): python3-rados-18.2.4-721.gbaa926de.el9 2.9 MB/s | 371 kB 00:00 2024-08-19T00:44:15.280 INFO:teuthology.orchestra.run.smithi086.stdout:(9/30): python3-ceph-common-18.2.4-721.gbaa926d 773 kB/s | 129 kB 00:00 2024-08-19T00:44:15.315 INFO:teuthology.orchestra.run.smithi086.stdout:(10/30): python3-cephfs-18.2.4-721.gbaa926de.el 1.4 MB/s | 188 kB 00:00 2024-08-19T00:44:15.315 INFO:teuthology.orchestra.run.smithi017.stdout:(12/30): python3-rbd-18.2.4-721.gbaa926de.el9.x 2.2 MB/s | 348 kB 00:00 2024-08-19T00:44:15.340 INFO:teuthology.orchestra.run.smithi086.stdout:(11/30): python3-rados-18.2.4-721.gbaa926de.el9 3.6 MB/s | 371 kB 00:00 2024-08-19T00:44:15.342 INFO:teuthology.orchestra.run.smithi017.stdout:(13/30): python3-rgw-18.2.4-721.gbaa926de.el9.x 1.0 MB/s | 116 kB 00:00 2024-08-19T00:44:15.373 INFO:teuthology.orchestra.run.smithi086.stdout:(12/30): python3-rgw-18.2.4-721.gbaa926de.el9.x 1.9 MB/s | 116 kB 00:00 2024-08-19T00:44:15.398 INFO:teuthology.orchestra.run.smithi086.stdout:(13/30): python3-rbd-18.2.4-721.gbaa926de.el9.x 2.9 MB/s | 348 kB 00:00 2024-08-19T00:44:15.515 INFO:teuthology.orchestra.run.smithi086.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 610 kB/s | 107 kB 00:00 2024-08-19T00:44:15.534 INFO:teuthology.orchestra.run.smithi086.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 339 kB/s | 45 kB 00:00 2024-08-19T00:44:15.557 INFO:teuthology.orchestra.run.smithi086.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 872 kB/s | 160 kB 00:00 2024-08-19T00:44:15.608 INFO:teuthology.orchestra.run.smithi086.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 845 kB/s | 42 kB 00:00 2024-08-19T00:44:15.650 INFO:teuthology.orchestra.run.smithi086.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-08-19T00:44:15.675 INFO:teuthology.orchestra.run.smithi086.stdout:(19/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-08-19T00:44:15.676 INFO:teuthology.orchestra.run.smithi017.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 136 kB/s | 45 kB 00:00 2024-08-19T00:44:15.717 INFO:teuthology.orchestra.run.smithi086.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.0 MB/s | 111 kB 00:00 2024-08-19T00:44:15.743 INFO:teuthology.orchestra.run.smithi086.stdout:(21/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.2 MB/s | 26 kB 00:00 2024-08-19T00:44:15.759 INFO:teuthology.orchestra.run.smithi017.stdout:(15/30): boost-program-options-1.75.0-8.el9.x86 213 kB/s | 107 kB 00:00 2024-08-19T00:44:15.768 INFO:teuthology.orchestra.run.smithi086.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-19T00:44:15.784 INFO:teuthology.orchestra.run.smithi017.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 341 kB/s | 160 kB 00:00 2024-08-19T00:44:15.793 INFO:teuthology.orchestra.run.smithi086.stdout:(23/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.1 MB/s | 309 kB 00:00 2024-08-19T00:44:15.818 INFO:teuthology.orchestra.run.smithi086.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-19T00:44:15.843 INFO:teuthology.orchestra.run.smithi086.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 7.6 MB/s | 192 kB 00:00 2024-08-19T00:44:15.886 INFO:teuthology.orchestra.run.smithi086.stdout:(26/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-08-19T00:44:15.936 INFO:teuthology.orchestra.run.smithi086.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-19T00:44:16.019 INFO:teuthology.orchestra.run.smithi086.stdout:(28/30): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-08-19T00:44:16.126 INFO:teuthology.orchestra.run.smithi017.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 124 kB/s | 42 kB 00:00 2024-08-19T00:44:16.168 INFO:teuthology.orchestra.run.smithi017.stdout:(18/30): fmt-8.1.1-5.el9.x86_64.rpm 2.6 MB/s | 111 kB 00:00 2024-08-19T00:44:16.193 INFO:teuthology.orchestra.run.smithi017.stdout:(19/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 12 MB/s | 309 kB 00:00 2024-08-19T00:44:16.252 INFO:teuthology.orchestra.run.smithi017.stdout:(20/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 594 kB/s | 292 kB 00:00 2024-08-19T00:44:16.327 INFO:teuthology.orchestra.run.smithi017.stdout:(21/30): libarrow-9.0.0-11.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2024-08-19T00:44:16.361 INFO:teuthology.orchestra.run.smithi017.stdout:(22/30): librdkafka-1.6.1-102.el9.x86_64.rpm 967 kB/s | 662 kB 00:00 2024-08-19T00:44:16.386 INFO:teuthology.orchestra.run.smithi017.stdout:(23/30): libarrow-doc-9.0.0-11.el9.noarch.rpm 194 kB/s | 26 kB 00:00 2024-08-19T00:44:16.420 INFO:teuthology.orchestra.run.smithi017.stdout:(24/30): liboath-2.6.7-2.el9.x86_64.rpm 539 kB/s | 49 kB 00:00 2024-08-19T00:44:16.453 INFO:teuthology.orchestra.run.smithi017.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 6.0 MB/s | 192 kB 00:00 2024-08-19T00:44:16.479 INFO:teuthology.orchestra.run.smithi017.stdout:(26/30): libunwind-1.6.2-1.el9.x86_64.rpm 575 kB/s | 67 kB 00:00 2024-08-19T00:44:16.512 INFO:teuthology.orchestra.run.smithi017.stdout:(27/30): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.9 MB/s | 839 kB 00:00 2024-08-19T00:44:16.554 INFO:teuthology.orchestra.run.smithi017.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-19T00:44:16.670 INFO:teuthology.orchestra.run.smithi086.stdout:(29/30): librbd1-18.2.4-721.gbaa926de.el9.x86_6 4.1 MB/s | 3.0 MB 00:00 2024-08-19T00:44:16.728 INFO:teuthology.orchestra.run.smithi086.stdout:(30/30): librados2-18.2.4-721.gbaa926de.el9.x86 3.9 MB/s | 3.3 MB 00:00 2024-08-19T00:44:16.733 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:44:16.733 INFO:teuthology.orchestra.run.smithi086.stdout:Total 12 MB/s | 53 MB 00:04 2024-08-19T00:44:16.746 INFO:teuthology.orchestra.run.smithi017.stdout:(29/30): librados2-18.2.4-721.gbaa926de.el9.x86 12 MB/s | 3.3 MB 00:00 2024-08-19T00:44:16.810 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:44:16.813 INFO:teuthology.orchestra.run.smithi017.stdout:(30/30): librbd1-18.2.4-721.gbaa926de.el9.x86_6 10 MB/s | 3.0 MB 00:00 2024-08-19T00:44:16.817 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:44:16.818 INFO:teuthology.orchestra.run.smithi017.stdout:Total 16 MB/s | 53 MB 00:03 2024-08-19T00:44:16.846 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:44:16.846 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:44:16.890 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:44:16.929 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:44:16.929 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:44:17.270 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:44:17.270 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:44:17.373 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:44:17.373 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:44:18.624 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:44:18.741 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-08-19T00:44:18.763 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:44:18.783 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-08-19T00:44:18.832 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-08-19T00:44:18.847 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-08-19T00:44:18.884 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-08-19T00:44:18.934 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-08-19T00:44:19.192 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-08-19T00:44:19.257 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:18.2.4-721.gbaa926de.el9.x86_64 5/32 2024-08-19T00:44:19.332 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-08-19T00:44:19.352 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:18.2.4-721.gbaa926de.el9.x86_64 5/32 2024-08-19T00:44:19.394 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:18.2.4-721.gbaa926de.el9.x86_64 5/32 2024-08-19T00:44:19.433 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:18.2.4-721.gbaa926de.el9.x86_64 6/32 2024-08-19T00:44:19.467 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:18.2.4-721.gbaa926de.el9.x86_64 7/32 2024-08-19T00:44:19.490 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:18.2.4-721.gbaa926de.el9.x86_64 5/32 2024-08-19T00:44:19.529 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:18.2.4-721.gbaa926de.el9.x86_64 7/32 2024-08-19T00:44:19.558 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-08-19T00:44:19.581 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:18.2.4-721.gbaa926de.el9.x86_64 6/32 2024-08-19T00:44:19.604 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:18.2.4-721.gbaa926de.el9.x 9/32 2024-08-19T00:44:19.612 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:18.2.4-721.gbaa926de.el9.x86_64 7/32 2024-08-19T00:44:19.668 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:18.2.4-721.gbaa926de.el9.x86_64 10/32 2024-08-19T00:44:19.674 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:18.2.4-721.gbaa926de.el9.x86_64 7/32 2024-08-19T00:44:19.695 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:18.2.4-721.gbaa926de.el9.x86_64 11/32 2024-08-19T00:44:19.704 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-08-19T00:44:19.743 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:18.2.4-721.gbaa926de.el9.x86_64 11/32 2024-08-19T00:44:19.750 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:18.2.4-721.gbaa926de.el9.x 9/32 2024-08-19T00:44:19.815 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:18.2.4-721.gbaa926de.el9.x86_64 10/32 2024-08-19T00:44:19.839 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:18.2.4-721.gbaa926de.el9.x86_64 11/32 2024-08-19T00:44:19.850 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-08-19T00:44:19.884 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-08-19T00:44:19.904 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:18.2.4-721.gbaa926de.el9.x86_64 11/32 2024-08-19T00:44:19.924 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-08-19T00:44:19.950 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-08-19T00:44:19.977 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-08-19T00:44:20.013 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-08-19T00:44:20.014 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-08-19T00:44:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 13/32 2024-08-19T00:44:20.046 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-08-19T00:44:20.086 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-08-19T00:44:20.111 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-08-19T00:44:20.138 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 16/32 2024-08-19T00:44:20.183 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-08-19T00:44:20.215 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-08-19T00:44:20.343 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-08-19T00:44:20.384 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:18.2.4-721.gbaa926de.el9.x86_64 20/32 2024-08-19T00:44:20.479 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:18.2.4-721.gbaa926de.el9.x86_64 20/32 2024-08-19T00:44:20.505 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:18.2.4-721.gbaa926de.el9.x86_64 21/32 2024-08-19T00:44:20.530 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-08-19T00:44:20.549 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-08-19T00:44:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:18.2.4-721.gbaa926de.el9.x86_64 20/32 2024-08-19T00:44:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:18.2.4-721.gbaa926de.el9.x86_64 20/32 2024-08-19T00:44:20.691 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:18.2.4-721.gbaa926de.el9.x86_64 21/32 2024-08-19T00:44:20.727 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-08-19T00:44:21.145 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-08-19T00:44:21.146 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 23/32 2024-08-19T00:44:21.169 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:18.2.4-721.gbaa926de.el9.x86_64 24/32 2024-08-19T00:44:21.172 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:18.2.4-721.gbaa926de.el9.x86_64 24/32 2024-08-19T00:44:21.225 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:18.2.4-721.gbaa926de.el9.x86_64 24/32 2024-08-19T00:44:21.245 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:18.2.4-721.gbaa926de.el9.x86_64 24/32 2024-08-19T00:44:21.301 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:18.2.4-721.gbaa926de.el9.x86_64 25/32 2024-08-19T00:44:21.323 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:18.2.4-721.gbaa926de.el9.x86_64 25/32 2024-08-19T00:44:21.330 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:18.2.4-721.gbaa926de.el9.x86 26/32 2024-08-19T00:44:21.358 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:18.2.4-721.gbaa926de.el9.x86 26/32 2024-08-19T00:44:23.523 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 27/32 2024-08-19T00:44:23.561 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 27/32 2024-08-19T00:44:23.583 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 27/32 2024-08-19T00:44:23.621 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 27/32 2024-08-19T00:44:24.079 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 27/32 2024-08-19T00:44:24.130 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:18.2.4-721.gbaa926de.el9.x86_64 28/32 2024-08-19T00:44:24.168 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 27/32 2024-08-19T00:44:24.207 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:18.2.4-721.gbaa926de.el9.x86_64 28/32 2024-08-19T00:44:24.228 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:18.2.4-721.gbaa926de.el9.x86_64 28/32 2024-08-19T00:44:24.228 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-19T00:44:24.228 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-19T00:44:24.228 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:24.259 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:18.2.4-721.gbaa926de.el9.x86_64 29/32 2024-08-19T00:44:24.301 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:18.2.4-721.gbaa926de.el9.x86_64 28/32 2024-08-19T00:44:24.301 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-19T00:44:24.301 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-19T00:44:24.301 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:24.333 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:18.2.4-721.gbaa926de.el9.x86_64 29/32 2024-08-19T00:44:33.940 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:18.2.4-721.gbaa926de.el9.x86_64 29/32 2024-08-19T00:44:33.941 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2024-08-19T00:44:33.941 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2024-08-19T00:44:33.941 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2024-08-19T00:44:33.941 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2024-08-19T00:44:33.941 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2024-08-19T00:44:33.941 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /root 2024-08-19T00:44:33.941 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2024-08-19T00:44:33.941 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:34.186 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:18.2.4-721.gbaa926de.el9.x86_64 29/32 2024-08-19T00:44:34.186 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-08-19T00:44:34.186 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-08-19T00:44:34.186 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-08-19T00:44:34.186 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-08-19T00:44:34.186 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-08-19T00:44:34.186 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-08-19T00:44:34.186 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-08-19T00:44:34.187 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:34.699 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:18.2.4-721.gbaa926de.el9.x86_64 30/32 2024-08-19T00:44:34.724 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-721.gbaa926de.el9.x86_64 30/32 2024-08-19T00:44:34.725 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:44:34.725 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-19T00:44:34.725 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:44:34.725 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:44:34.725 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:34.726 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-08-19T00:44:34.811 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-08-19T00:44:34.811 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-08-19T00:44:34.948 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:18.2.4-721.gbaa926de.el9.x86_64 30/32 2024-08-19T00:44:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-721.gbaa926de.el9.x86_64 30/32 2024-08-19T00:44:34.980 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:44:34.980 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-19T00:44:34.980 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:44:34.980 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-19T00:44:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-08-19T00:44:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-08-19T00:44:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-08-19T00:44:36.005 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-08-19T00:44:36.005 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:18.2.4-721.gbaa926de.el9.x86_64 1/32 2024-08-19T00:44:36.005 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 2/32 2024-08-19T00:44:36.005 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:18.2.4-721.gbaa926de.el9.x86_64 3/32 2024-08-19T00:44:36.005 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:18.2.4-721.gbaa926de.el9.x86_64 4/32 2024-08-19T00:44:36.005 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:18.2.4-721.gbaa926de.el9.x86_64 5/32 2024-08-19T00:44:36.005 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:18.2.4-721.gbaa926de.el9.x86_64 6/32 2024-08-19T00:44:36.005 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:18.2.4-721.gbaa926de.el9.x86_64 7/32 2024-08-19T00:44:36.005 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:18.2.4-721.gbaa926de.el9.x 8/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:18.2.4-721.gbaa926de.el9.x86 9/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:18.2.4-721.gbaa926de.el9.x86_64 10/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:18.2.4-721.gbaa926de.el9.x86_64 11/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:18.2.4-721.gbaa926de.el9.x86_64 12/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:18.2.4-721.gbaa926de.el9.x86_64 13/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-08-19T00:44:36.006 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-08-19T00:44:36.007 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-08-19T00:44:36.007 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-08-19T00:44:36.007 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-08-19T00:44:36.007 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-08-19T00:44:36.007 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-08-19T00:44:36.007 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-08-19T00:44:36.007 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-08-19T00:44:36.007 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:18.2.4-721.gbaa926de.el9.x86_64 29/32 2024-08-19T00:44:36.007 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-08-19T00:44:36.007 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:18.2.4-721.gbaa926de.el9.x86_64 31/32 2024-08-19T00:44:36.212 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-08-19T00:44:36.212 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:18.2.4-721.gbaa926de.el9.x86_64 1/32 2024-08-19T00:44:36.212 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 2/32 2024-08-19T00:44:36.212 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:18.2.4-721.gbaa926de.el9.x86_64 3/32 2024-08-19T00:44:36.212 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:18.2.4-721.gbaa926de.el9.x86_64 4/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:18.2.4-721.gbaa926de.el9.x86_64 5/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:18.2.4-721.gbaa926de.el9.x86_64 6/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:18.2.4-721.gbaa926de.el9.x86_64 7/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:18.2.4-721.gbaa926de.el9.x 8/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:18.2.4-721.gbaa926de.el9.x86 9/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:18.2.4-721.gbaa926de.el9.x86_64 10/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:18.2.4-721.gbaa926de.el9.x86_64 11/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:18.2.4-721.gbaa926de.el9.x86_64 12/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:18.2.4-721.gbaa926de.el9.x86_64 13/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-08-19T00:44:36.213 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 22/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 23/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 26/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:18.2.4-721.gbaa926de.el9.x86_64 29/32 2024-08-19T00:44:36.214 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-08-19T00:44:36.215 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:18.2.4-721.gbaa926de.el9.x86_64 31/32 2024-08-19T00:44:36.801 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-08-19T00:44:36.801 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:36.801 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2024-08-19T00:44:36.801 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.801 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: fmt-8.1.1-5.el9.x86_64 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-19T00:44:36.802 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.803 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.804 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.804 INFO:teuthology.orchestra.run.smithi086.stdout: re2-1:20211101-3.el9.x86_64 2024-08-19T00:44:36.804 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-19T00:44:36.804 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:36.804 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:44:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-08-19T00:44:36.902 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:36.902 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-08-19T00:44:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.903 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:44:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-19T00:44:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: fmt-8.1.1-5.el9.x86_64 2024-08-19T00:44:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-19T00:44:36.903 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-19T00:44:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-19T00:44:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-19T00:44:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-19T00:44:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-19T00:44:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-19T00:44:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-19T00:44:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-19T00:44:36.904 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-19T00:44:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-19T00:44:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-3.el9.x86_64 2024-08-19T00:44:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-19T00:44:36.905 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:36.905 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:44:37.099 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-test 2024-08-19T00:44:37.172 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-test 2024-08-19T00:44:37.655 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:27 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:44:37.731 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:26 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:44:37.785 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:44:37.786 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:37.786 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-08-19T00:44:37.786 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:37.786 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:44:37.786 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:18.2.4-721.gbaa926de.el9 ceph 40 M 2024-08-19T00:44:37.786 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-08-19T00:44:37.786 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:18.2.4-721.gbaa926de.el9 ceph 166 k 2024-08-19T00:44:37.786 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-19T00:44:37.786 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-19T00:44:37.786 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:37.787 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:44:37.787 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:37.787 INFO:teuthology.orchestra.run.smithi086.stdout:Install 4 Packages 2024-08-19T00:44:37.787 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:37.787 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 40 M 2024-08-19T00:44:37.787 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 163 M 2024-08-19T00:44:37.788 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:44:37.867 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:44:37.868 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:44:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-08-19T00:44:37.868 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:44:37.868 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:44:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:18.2.4-721.gbaa926de.el9 ceph 40 M 2024-08-19T00:44:37.868 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-08-19T00:44:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:18.2.4-721.gbaa926de.el9 ceph 166 k 2024-08-19T00:44:37.868 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-19T00:44:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-19T00:44:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:37.869 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:44:37.869 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:44:37.869 INFO:teuthology.orchestra.run.smithi017.stdout:Install 4 Packages 2024-08-19T00:44:37.869 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:37.869 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 40 M 2024-08-19T00:44:37.870 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 163 M 2024-08-19T00:44:37.870 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:44:38.161 INFO:teuthology.orchestra.run.smithi017.stdout:(1/4): libcephsqlite-18.2.4-721.gbaa926de.el9.x 693 kB/s | 166 kB 00:00 2024-08-19T00:44:38.288 INFO:teuthology.orchestra.run.smithi086.stdout:(1/4): libcephsqlite-18.2.4-721.gbaa926de.el9.x 347 kB/s | 166 kB 00:00 2024-08-19T00:44:38.514 INFO:teuthology.orchestra.run.smithi017.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 513 kB/s | 304 kB 00:00 2024-08-19T00:44:38.548 INFO:teuthology.orchestra.run.smithi017.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 164 kB/s | 64 kB 00:00 2024-08-19T00:44:38.599 INFO:teuthology.orchestra.run.smithi086.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 385 kB/s | 304 kB 00:00 2024-08-19T00:44:38.953 INFO:teuthology.orchestra.run.smithi086.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 96 kB/s | 64 kB 00:00 2024-08-19T00:44:39.681 INFO:teuthology.orchestra.run.smithi086.stdout:(4/4): ceph-test-18.2.4-721.gbaa926de.el9.x86_6 21 MB/s | 40 MB 00:01 2024-08-19T00:44:39.684 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:44:39.684 INFO:teuthology.orchestra.run.smithi086.stdout:Total 21 MB/s | 40 MB 00:01 2024-08-19T00:44:39.711 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:44:39.730 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:44:39.730 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:44:39.856 INFO:teuthology.orchestra.run.smithi017.stdout:(4/4): ceph-test-18.2.4-721.gbaa926de.el9.x86_6 21 MB/s | 40 MB 00:01 2024-08-19T00:44:39.858 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:44:39.858 INFO:teuthology.orchestra.run.smithi017.stdout:Total 20 MB/s | 40 MB 00:01 2024-08-19T00:44:39.886 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:44:39.906 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:44:39.907 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:44:40.045 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:44:40.045 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:44:40.237 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:44:40.237 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:44:40.520 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:44:40.590 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-08-19T00:44:40.639 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-08-19T00:44:40.667 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:18.2.4-721.gbaa926de.el9.x86_64 3/4 2024-08-19T00:44:40.729 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:44:40.808 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-08-19T00:44:40.873 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-08-19T00:44:40.899 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:18.2.4-721.gbaa926de.el9.x86_64 3/4 2024-08-19T00:44:44.294 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:18.2.4-721.gbaa926de.el9.x86_64 3/4 2024-08-19T00:44:44.362 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:18.2.4-721.gbaa926de.el9.x86_64 4/4 2024-08-19T00:44:44.747 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:18.2.4-721.gbaa926de.el9.x86_64 3/4 2024-08-19T00:44:44.824 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:18.2.4-721.gbaa926de.el9.x86_64 4/4 2024-08-19T00:44:46.352 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-test-2:18.2.4-721.gbaa926de.el9.x86_64 4/4 2024-08-19T00:44:46.352 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:18.2.4-721.gbaa926de.el9.x86_64 1/4 2024-08-19T00:44:46.352 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:18.2.4-721.gbaa926de.el9.x86_64 2/4 2024-08-19T00:44:46.352 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-08-19T00:44:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-08-19T00:44:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:46.662 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:44:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:46.662 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-19T00:44:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-19T00:44:46.663 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:46.663 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:44:46.882 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-test-2:18.2.4-721.gbaa926de.el9.x86_64 4/4 2024-08-19T00:44:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:18.2.4-721.gbaa926de.el9.x86_64 1/4 2024-08-19T00:44:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:18.2.4-721.gbaa926de.el9.x86_64 2/4 2024-08-19T00:44:46.883 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-08-19T00:44:46.916 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph 2024-08-19T00:44:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-08-19T00:44:47.199 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:47.200 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:44:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-19T00:44:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-19T00:44:47.200 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:47.200 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:44:47.451 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:37 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:44:47.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph 2024-08-19T00:44:47.591 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:44:47.594 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:47.594 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-08-19T00:44:47.594 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:47.594 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:44:47.594 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:18.2.4-721.gbaa926de.el9 ceph 6.5 k 2024-08-19T00:44:47.594 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-08-19T00:44:47.594 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:18.2.4-721.gbaa926de.el9 ceph 2.1 M 2024-08-19T00:44:47.595 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:18.2.4-721.gbaa926de.el9 ceph 1.5 M 2024-08-19T00:44:47.595 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 246 k 2024-08-19T00:44:47.595 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:18.2.4-721.gbaa926de.el9 ceph 4.7 M 2024-08-19T00:44:47.595 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:18.2.4-721.gbaa926de.el9 ceph 17 M 2024-08-19T00:44:47.595 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-19T00:44:47.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-19T00:44:47.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-19T00:44:47.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-19T00:44:47.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-19T00:44:47.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-19T00:44:47.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-19T00:44:47.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-19T00:44:47.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-19T00:44:47.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-19T00:44:47.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-19T00:44:47.596 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-19T00:44:47.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-19T00:44:47.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-19T00:44:47.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-19T00:44:47.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-19T00:44:47.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-19T00:44:47.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-19T00:44:47.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-19T00:44:47.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-19T00:44:47.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-19T00:44:47.597 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-19T00:44:47.598 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-19T00:44:47.598 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-19T00:44:47.598 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-19T00:44:47.598 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-19T00:44:47.598 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-19T00:44:47.598 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:47.598 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:44:47.598 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:47.598 INFO:teuthology.orchestra.run.smithi086.stdout:Install 33 Packages 2024-08-19T00:44:47.599 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:47.599 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 29 M 2024-08-19T00:44:47.600 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 104 M 2024-08-19T00:44:47.600 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:44:48.039 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:37 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:44:48.058 INFO:teuthology.orchestra.run.smithi086.stdout:(1/33): ceph-18.2.4-721.gbaa926de.el9.x86_64.rp 46 kB/s | 6.5 kB 00:00 2024-08-19T00:44:48.172 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:44:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:44:48.174 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:18.2.4-721.gbaa926de.el9 ceph 6.5 k 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:18.2.4-721.gbaa926de.el9 ceph 2.1 M 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:18.2.4-721.gbaa926de.el9 ceph 1.5 M 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 246 k 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:18.2.4-721.gbaa926de.el9 ceph 4.7 M 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:18.2.4-721.gbaa926de.el9 ceph 17 M 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-19T00:44:48.175 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-19T00:44:48.176 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout:Install 33 Packages 2024-08-19T00:44:48.177 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:48.178 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 29 M 2024-08-19T00:44:48.178 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 104 M 2024-08-19T00:44:48.178 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:44:48.250 INFO:teuthology.orchestra.run.smithi086.stdout:(2/33): ceph-mds-18.2.4-721.gbaa926de.el9.x86_6 6.3 MB/s | 2.1 MB 00:00 2024-08-19T00:44:48.284 INFO:teuthology.orchestra.run.smithi086.stdout:(3/33): ceph-mgr-18.2.4-721.gbaa926de.el9.x86_6 4.0 MB/s | 1.5 MB 00:00 2024-08-19T00:44:48.401 INFO:teuthology.orchestra.run.smithi086.stdout:(4/33): ceph-mgr-modules-core-18.2.4-721.gbaa92 2.1 MB/s | 246 kB 00:00 2024-08-19T00:44:48.476 INFO:teuthology.orchestra.run.smithi086.stdout:(5/33): ceph-mon-18.2.4-721.gbaa926de.el9.x86_6 11 MB/s | 4.7 MB 00:00 2024-08-19T00:44:48.582 INFO:teuthology.orchestra.run.smithi017.stdout:(1/33): ceph-18.2.4-721.gbaa926de.el9.x86_64.rp 46 kB/s | 6.5 kB 00:00 2024-08-19T00:44:48.652 INFO:teuthology.orchestra.run.smithi086.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-08-19T00:44:48.710 INFO:teuthology.orchestra.run.smithi086.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-19T00:44:48.757 INFO:teuthology.orchestra.run.smithi017.stdout:(2/33): ceph-mgr-18.2.4-721.gbaa926de.el9.x86_6 4.6 MB/s | 1.5 MB 00:00 2024-08-19T00:44:48.777 INFO:teuthology.orchestra.run.smithi086.stdout:(8/33): python3-cryptography-36.0.1-4.el9.x86_6 4.1 MB/s | 1.2 MB 00:00 2024-08-19T00:44:48.802 INFO:teuthology.orchestra.run.smithi086.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 1.4 MB/s | 135 kB 00:00 2024-08-19T00:44:48.807 INFO:teuthology.orchestra.run.smithi017.stdout:(3/33): ceph-mds-18.2.4-721.gbaa926de.el9.x86_6 5.7 MB/s | 2.1 MB 00:00 2024-08-19T00:44:48.836 INFO:teuthology.orchestra.run.smithi086.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 2.1 MB/s | 125 kB 00:00 2024-08-19T00:44:48.861 INFO:teuthology.orchestra.run.smithi086.stdout:(11/33): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-08-19T00:44:48.882 INFO:teuthology.orchestra.run.smithi017.stdout:(4/33): ceph-mgr-modules-core-18.2.4-721.gbaa92 3.2 MB/s | 246 kB 00:00 2024-08-19T00:44:48.945 INFO:teuthology.orchestra.run.smithi086.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 417 kB/s | 35 kB 00:00 2024-08-19T00:44:48.970 INFO:teuthology.orchestra.run.smithi086.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-08-19T00:44:48.991 INFO:teuthology.orchestra.run.smithi017.stdout:(5/33): ceph-mon-18.2.4-721.gbaa926de.el9.x86_6 11 MB/s | 4.7 MB 00:00 2024-08-19T00:44:49.003 INFO:teuthology.orchestra.run.smithi086.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-08-19T00:44:49.029 INFO:teuthology.orchestra.run.smithi086.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-08-19T00:44:49.071 INFO:teuthology.orchestra.run.smithi086.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 649 kB/s | 43 kB 00:00 2024-08-19T00:44:49.083 INFO:teuthology.orchestra.run.smithi017.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-08-19T00:44:49.104 INFO:teuthology.orchestra.run.smithi086.stdout:(17/33): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-08-19T00:44:49.130 INFO:teuthology.orchestra.run.smithi086.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-08-19T00:44:49.155 INFO:teuthology.orchestra.run.smithi086.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2024-08-19T00:44:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:(7/33): python3-cryptography-36.0.1-4.el9.x86_6 6.7 MB/s | 1.2 MB 00:00 2024-08-19T00:44:49.180 INFO:teuthology.orchestra.run.smithi086.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-08-19T00:44:49.192 INFO:teuthology.orchestra.run.smithi017.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 982 kB/s | 106 kB 00:00 2024-08-19T00:44:49.205 INFO:teuthology.orchestra.run.smithi086.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-08-19T00:44:49.230 INFO:teuthology.orchestra.run.smithi086.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-08-19T00:44:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-08-19T00:44:49.256 INFO:teuthology.orchestra.run.smithi086.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-08-19T00:44:49.281 INFO:teuthology.orchestra.run.smithi086.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-08-19T00:44:49.284 INFO:teuthology.orchestra.run.smithi017.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.3 MB/s | 125 kB 00:00 2024-08-19T00:44:49.306 INFO:teuthology.orchestra.run.smithi086.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-08-19T00:44:49.318 INFO:teuthology.orchestra.run.smithi017.stdout:(11/33): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-08-19T00:44:49.332 INFO:teuthology.orchestra.run.smithi086.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 654 kB/s | 16 kB 00:00 2024-08-19T00:44:49.357 INFO:teuthology.orchestra.run.smithi086.stdout:(27/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-08-19T00:44:49.382 INFO:teuthology.orchestra.run.smithi086.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-08-19T00:44:49.416 INFO:teuthology.orchestra.run.smithi086.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 611 kB/s | 36 kB 00:00 2024-08-19T00:44:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:(12/33): python3-markupsafe-1.1.1-12.el9.x86_64 321 kB/s | 35 kB 00:00 2024-08-19T00:44:49.441 INFO:teuthology.orchestra.run.smithi086.stdout:(30/33): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-08-19T00:44:49.452 INFO:teuthology.orchestra.run.smithi017.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-08-19T00:44:49.467 INFO:teuthology.orchestra.run.smithi086.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 797 kB/s | 20 kB 00:00 2024-08-19T00:44:49.492 INFO:teuthology.orchestra.run.smithi086.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-08-19T00:44:49.619 INFO:teuthology.orchestra.run.smithi017.stdout:(14/33): ceph-osd-18.2.4-721.gbaa926de.el9.x86_ 19 MB/s | 17 MB 00:00 2024-08-19T00:44:49.644 INFO:teuthology.orchestra.run.smithi017.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 235 kB/s | 51 kB 00:00 2024-08-19T00:44:49.669 INFO:teuthology.orchestra.run.smithi017.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 192 kB/s | 42 kB 00:00 2024-08-19T00:44:49.692 INFO:teuthology.orchestra.run.smithi086.stdout:(33/33): ceph-osd-18.2.4-721.gbaa926de.el9.x86_ 11 MB/s | 17 MB 00:01 2024-08-19T00:44:49.696 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:44:49.696 INFO:teuthology.orchestra.run.smithi086.stdout:Total 14 MB/s | 29 MB 00:02 2024-08-19T00:44:49.719 INFO:teuthology.orchestra.run.smithi017.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 434 kB/s | 43 kB 00:00 2024-08-19T00:44:49.745 INFO:teuthology.orchestra.run.smithi017.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 464 kB/s | 11 kB 00:00 2024-08-19T00:44:49.770 INFO:teuthology.orchestra.run.smithi017.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 709 kB/s | 18 kB 00:00 2024-08-19T00:44:49.795 INFO:teuthology.orchestra.run.smithi017.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-08-19T00:44:49.812 INFO:teuthology.orchestra.run.smithi017.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 554 kB/s | 23 kB 00:00 2024-08-19T00:44:49.818 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:44:49.829 INFO:teuthology.orchestra.run.smithi017.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 580 kB/s | 19 kB 00:00 2024-08-19T00:44:49.846 INFO:teuthology.orchestra.run.smithi017.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 588 kB/s | 20 kB 00:00 2024-08-19T00:44:49.856 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:44:49.856 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:44:49.863 INFO:teuthology.orchestra.run.smithi017.stdout:(24/33): python3-logutils-0.3.5-21.el9.noarch.r 1.3 MB/s | 46 kB 00:00 2024-08-19T00:44:49.888 INFO:teuthology.orchestra.run.smithi017.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-08-19T00:44:49.914 INFO:teuthology.orchestra.run.smithi017.stdout:(26/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-08-19T00:44:49.930 INFO:teuthology.orchestra.run.smithi017.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 395 kB/s | 16 kB 00:00 2024-08-19T00:44:49.947 INFO:teuthology.orchestra.run.smithi017.stdout:(28/33): python3-tempora-5.0.0-2.el9.noarch.rpm 2.1 MB/s | 36 kB 00:00 2024-08-19T00:44:49.972 INFO:teuthology.orchestra.run.smithi017.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-08-19T00:44:49.998 INFO:teuthology.orchestra.run.smithi017.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-08-19T00:44:50.023 INFO:teuthology.orchestra.run.smithi017.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 804 kB/s | 20 kB 00:00 2024-08-19T00:44:50.048 INFO:teuthology.orchestra.run.smithi017.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-19T00:44:50.073 INFO:teuthology.orchestra.run.smithi017.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-08-19T00:44:50.078 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:44:50.078 INFO:teuthology.orchestra.run.smithi017.stdout:Total 15 MB/s | 29 MB 00:01 2024-08-19T00:44:50.135 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:44:50.136 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:44:50.200 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:44:50.240 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:44:50.241 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:44:50.535 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:44:50.536 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:44:51.362 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:44:51.428 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-08-19T00:44:51.460 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-08-19T00:44:51.493 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-08-19T00:44:51.585 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-08-19T00:44:51.655 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-08-19T00:44:51.696 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-08-19T00:44:51.739 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-08-19T00:44:51.769 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-08-19T00:44:51.804 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-08-19T00:44:51.837 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-08-19T00:44:51.878 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-08-19T00:44:51.921 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-08-19T00:44:51.955 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-08-19T00:44:51.967 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:44:51.993 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-08-19T00:44:52.026 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-08-19T00:44:52.067 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-08-19T00:44:52.068 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-08-19T00:44:52.109 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-08-19T00:44:52.205 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-08-19T00:44:52.206 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-08-19T00:44:52.285 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-08-19T00:44:52.355 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-08-19T00:44:52.393 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-08-19T00:44:52.397 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-08-19T00:44:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-08-19T00:44:52.450 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-08-19T00:44:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-08-19T00:44:52.506 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-08-19T00:44:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-08-19T00:44:52.555 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-08-19T00:44:52.585 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-08-19T00:44:52.626 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-08-19T00:44:52.670 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-08-19T00:44:52.692 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-08-19T00:44:52.703 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-08-19T00:44:52.734 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-08-19T00:44:52.747 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-08-19T00:44:52.810 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-08-19T00:44:52.816 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-08-19T00:44:52.905 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-08-19T00:44:52.955 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-08-19T00:44:52.959 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-08-19T00:44:53.048 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-08-19T00:44:53.070 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-08-19T00:44:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 18/33 2024-08-19T00:44:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-08-19T00:44:53.200 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-08-19T00:44:53.221 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-721.gbaa926de.el9.n 28/33 2024-08-19T00:44:53.257 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:18.2.4-721.gbaa926de.el9.x86_64 29/33 2024-08-19T00:44:53.263 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-08-19T00:44:53.282 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:18.2.4-721.gbaa926de.el9.x86_64 29/33 2024-08-19T00:44:53.282 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:44:53.282 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-19T00:44:53.282 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:44:53.282 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:44:53.282 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:53.455 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-08-19T00:44:53.512 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-08-19T00:44:53.592 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-08-19T00:44:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-08-19T00:44:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-08-19T00:44:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-08-19T00:44:54.009 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-721.gbaa926de.el9.n 28/33 2024-08-19T00:44:54.038 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:18.2.4-721.gbaa926de.el9.x86_64 29/33 2024-08-19T00:44:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:18.2.4-721.gbaa926de.el9.x86_64 29/33 2024-08-19T00:44:54.063 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:44:54.063 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-19T00:44:54.063 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:44:54.063 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-19T00:44:54.063 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:54.750 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:18.2.4-721.gbaa926de.el9.x86_64 30/33 2024-08-19T00:44:54.778 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:18.2.4-721.gbaa926de.el9.x86_64 30/33 2024-08-19T00:44:54.778 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:44:54.778 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-19T00:44:54.779 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:44:54.779 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:44:54.779 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:55.218 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:18.2.4-721.gbaa926de.el9.x86_64 31/33 2024-08-19T00:44:55.241 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:18.2.4-721.gbaa926de.el9.x86_64 31/33 2024-08-19T00:44:55.241 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:44:55.241 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-19T00:44:55.242 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:44:55.242 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:44:55.242 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:55.451 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:18.2.4-721.gbaa926de.el9.x86_64 32/33 2024-08-19T00:44:55.475 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:18.2.4-721.gbaa926de.el9.x86_64 32/33 2024-08-19T00:44:55.475 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:44:55.475 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-19T00:44:55.475 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:44:55.476 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:44:55.476 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:55.538 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:18.2.4-721.gbaa926de.el9.x86_64 33/33 2024-08-19T00:44:55.548 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:18.2.4-721.gbaa926de.el9.x86_64 30/33 2024-08-19T00:44:55.576 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:18.2.4-721.gbaa926de.el9.x86_64 30/33 2024-08-19T00:44:55.577 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:44:55.577 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-19T00:44:55.577 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:44:55.577 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-19T00:44:55.577 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:56.040 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:18.2.4-721.gbaa926de.el9.x86_64 31/33 2024-08-19T00:44:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:18.2.4-721.gbaa926de.el9.x86_64 31/33 2024-08-19T00:44:56.064 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:44:56.064 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-19T00:44:56.064 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:44:56.064 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-19T00:44:56.064 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:56.274 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:18.2.4-721.gbaa926de.el9.x86_64 32/33 2024-08-19T00:44:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:18.2.4-721.gbaa926de.el9.x86_64 32/33 2024-08-19T00:44:56.298 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:44:56.298 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-19T00:44:56.298 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:44:56.298 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-19T00:44:56.298 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:56.363 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:18.2.4-721.gbaa926de.el9.x86_64 33/33 2024-08-19T00:44:57.242 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-2:18.2.4-721.gbaa926de.el9.x86_64 33/33 2024-08-19T00:44:57.242 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:18.2.4-721.gbaa926de.el9.x86_64 1/33 2024-08-19T00:44:57.242 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:18.2.4-721.gbaa926de.el9.x86_64 2/33 2024-08-19T00:44:57.243 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:18.2.4-721.gbaa926de.el9.x86_64 3/33 2024-08-19T00:44:57.243 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:18.2.4-721.gbaa926de.el9.x86_64 4/33 2024-08-19T00:44:57.243 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:18.2.4-721.gbaa926de.el9.x86_64 5/33 2024-08-19T00:44:57.243 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-721.gbaa926de.el9.n 6/33 2024-08-19T00:44:57.243 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-08-19T00:44:57.243 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-08-19T00:44:57.243 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-08-19T00:44:57.243 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-08-19T00:44:57.244 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-08-19T00:44:57.244 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-08-19T00:44:57.244 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-08-19T00:44:57.244 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-08-19T00:44:57.244 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-08-19T00:44:57.244 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-08-19T00:44:57.244 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-08-19T00:44:57.244 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-08-19T00:44:57.245 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-08-19T00:44:57.245 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-08-19T00:44:57.245 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-08-19T00:44:57.245 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-08-19T00:44:57.245 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-08-19T00:44:57.245 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-08-19T00:44:57.245 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-08-19T00:44:57.246 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-08-19T00:44:57.246 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-08-19T00:44:57.246 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-08-19T00:44:57.246 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-08-19T00:44:57.246 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-08-19T00:44:57.246 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-08-19T00:44:57.246 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-08-19T00:44:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-08-19T00:44:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:58.072 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:44:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:58.072 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-19T00:44:58.073 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply-3.11-14.el9.noarch 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-19T00:44:58.074 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-19T00:44:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-19T00:44:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-19T00:44:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-19T00:44:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-19T00:44:58.075 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:58.075 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:44:58.085 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-2:18.2.4-721.gbaa926de.el9.x86_64 33/33 2024-08-19T00:44:58.085 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:18.2.4-721.gbaa926de.el9.x86_64 1/33 2024-08-19T00:44:58.085 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:18.2.4-721.gbaa926de.el9.x86_64 2/33 2024-08-19T00:44:58.086 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:18.2.4-721.gbaa926de.el9.x86_64 3/33 2024-08-19T00:44:58.086 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:18.2.4-721.gbaa926de.el9.x86_64 4/33 2024-08-19T00:44:58.086 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:18.2.4-721.gbaa926de.el9.x86_64 5/33 2024-08-19T00:44:58.086 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-721.gbaa926de.el9.n 6/33 2024-08-19T00:44:58.086 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-08-19T00:44:58.086 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-08-19T00:44:58.086 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-08-19T00:44:58.086 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-08-19T00:44:58.086 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-08-19T00:44:58.086 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/33 2024-08-19T00:44:58.086 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-08-19T00:44:58.087 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-08-19T00:44:58.087 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-08-19T00:44:58.087 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-08-19T00:44:58.087 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-08-19T00:44:58.087 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-08-19T00:44:58.087 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-08-19T00:44:58.087 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-08-19T00:44:58.087 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-08-19T00:44:58.087 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-08-19T00:44:58.087 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-08-19T00:44:58.087 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-08-19T00:44:58.088 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-08-19T00:44:58.088 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-08-19T00:44:58.088 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-08-19T00:44:58.088 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-08-19T00:44:58.088 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-08-19T00:44:58.088 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-08-19T00:44:58.088 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-08-19T00:44:58.088 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-08-19T00:44:58.403 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-base 2024-08-19T00:44:58.943 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-19T00:44:58.944 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-19T00:44:58.945 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-19T00:44:58.946 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-19T00:44:58.946 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-19T00:44:58.946 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-19T00:44:58.946 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-19T00:44:58.946 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-19T00:44:58.946 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-19T00:44:58.946 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-19T00:44:58.946 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-19T00:44:58.946 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-19T00:44:58.946 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:44:58.946 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:44:58.947 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:48 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:44:59.029 INFO:teuthology.orchestra.run.smithi086.stdout:Package ceph-base-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:44:59.071 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:44:59.072 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-08-19T00:44:59.072 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:44:59.142 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install cephadm 2024-08-19T00:44:59.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-base 2024-08-19T00:44:59.670 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:49 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:44:59.792 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:44:59.793 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:59.793 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-08-19T00:44:59.793 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:59.793 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:44:59.794 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 224 k 2024-08-19T00:44:59.794 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:59.794 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:44:59.794 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:44:59.794 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-08-19T00:44:59.794 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:44:59.794 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 224 k 2024-08-19T00:44:59.794 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 216 k 2024-08-19T00:44:59.794 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:44:59.846 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:48 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:44:59.932 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-base-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:44:59.975 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:44:59.976 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-08-19T00:44:59.976 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:00.033 INFO:teuthology.orchestra.run.smithi086.stdout:cephadm-18.2.4-721.gbaa926de.el9.noarch.rpm 942 kB/s | 224 kB 00:00 2024-08-19T00:45:00.033 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:00.033 INFO:teuthology.orchestra.run.smithi086.stdout:Total 936 kB/s | 224 kB 00:00 2024-08-19T00:45:00.034 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:00.038 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:00.039 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:00.039 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install cephadm 2024-08-19T00:45:00.042 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:00.042 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:00.108 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:00.570 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:18.2.4-721.gbaa926de.el9.noarch 1/1 2024-08-19T00:45:00.578 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:49 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:00.651 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:18.2.4-721.gbaa926de.el9.noarch 1/1 2024-08-19T00:45:00.709 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:00.709 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:00.709 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-08-19T00:45:00.710 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:00.710 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:00.710 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 224 k 2024-08-19T00:45:00.710 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:00.710 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:00.710 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:00.710 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-08-19T00:45:00.710 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:00.710 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 224 k 2024-08-19T00:45:00.710 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 216 k 2024-08-19T00:45:00.710 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:00.939 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm-18.2.4-721.gbaa926de.el9.noarch.rpm 985 kB/s | 224 kB 00:00 2024-08-19T00:45:00.939 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:00.939 INFO:teuthology.orchestra.run.smithi017.stdout:Total 978 kB/s | 224 kB 00:00 2024-08-19T00:45:00.939 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:00.945 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:00.945 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:00.948 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:00.948 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:00.986 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:18.2.4-721.gbaa926de.el9.noarch 1/1 2024-08-19T00:45:01.019 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:01.234 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:18.2.4-721.gbaa926de.el9.noarch 1/1 2024-08-19T00:45:01.234 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:01.234 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:01.234 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:01.234 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:01.235 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:01.434 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:18.2.4-721.gbaa926de.el9.noarch 1/1 2024-08-19T00:45:01.474 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-immutable-object-cache 2024-08-19T00:45:01.519 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:18.2.4-721.gbaa926de.el9.noarch 1/1 2024-08-19T00:45:01.845 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:18.2.4-721.gbaa926de.el9.noarch 1/1 2024-08-19T00:45:02.022 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:52 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:18.2.4-721.gbaa926de.el9.noarch 1/1 2024-08-19T00:45:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:02.082 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:02.083 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:02.152 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:02.153 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repo Size 2024-08-19T00:45:02.153 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:02.153 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:45:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-721.gbaa926de.el9 ceph 143 k 2024-08-19T00:45:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:02.153 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:45:02.153 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:02.153 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-08-19T00:45:02.153 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:02.153 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 143 k 2024-08-19T00:45:02.154 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 395 k 2024-08-19T00:45:02.154 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:45:02.283 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-immutable-object-cache 2024-08-19T00:45:02.363 INFO:teuthology.orchestra.run.smithi086.stdout:ceph-immutable-object-cache-18.2.4-721.gbaa926d 684 kB/s | 143 kB 00:00 2024-08-19T00:45:02.363 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:02.364 INFO:teuthology.orchestra.run.smithi086.stdout:Total 678 kB/s | 143 kB 00:00 2024-08-19T00:45:02.364 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:02.371 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:02.371 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:02.428 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:02.428 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:02.580 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:02.639 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-721.gbaa926de.e 1/1 2024-08-19T00:45:02.663 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-721.gbaa926de.e 1/1 2024-08-19T00:45:02.663 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:45:02.663 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-19T00:45:02.663 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:02.834 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:51 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:02.965 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:02.966 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:02.966 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-08-19T00:45:02.966 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:02.967 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-721.gbaa926de.el9 ceph 143 k 2024-08-19T00:45:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:02.967 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:02.967 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:02.967 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-08-19T00:45:02.967 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:02.967 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 143 k 2024-08-19T00:45:02.967 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 395 k 2024-08-19T00:45:02.967 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:03.169 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-immutable-object-cache-18.2.4-721.gbaa926d 707 kB/s | 143 kB 00:00 2024-08-19T00:45:03.170 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:03.170 INFO:teuthology.orchestra.run.smithi017.stdout:Total 702 kB/s | 143 kB 00:00 2024-08-19T00:45:03.170 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:03.178 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:03.178 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:03.237 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:03.237 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:03.385 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:03.462 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-721.gbaa926de.e 1/1 2024-08-19T00:45:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-721.gbaa926de.e 1/1 2024-08-19T00:45:03.487 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:45:03.487 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-19T00:45:03.487 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:03.599 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-721.gbaa926de.e 1/1 2024-08-19T00:45:03.599 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:03.600 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:03.600 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:03.600 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:03.600 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:03.839 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-mgr 2024-08-19T00:45:04.333 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-721.gbaa926de.e 1/1 2024-08-19T00:45:04.333 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:04.333 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:04.333 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:04.334 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:04.334 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:04.400 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:54 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:04.487 INFO:teuthology.orchestra.run.smithi086.stdout:Package ceph-mgr-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:04.528 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:04.529 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-08-19T00:45:04.529 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:04.539 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr 2024-08-19T00:45:04.606 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-mgr-dashboard 2024-08-19T00:45:05.093 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:54 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:05.142 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:55 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:05.180 INFO:teuthology.orchestra.run.smithi017.stdout:Package ceph-mgr-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:05.224 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:05.225 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-08-19T00:45:05.225 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:05.268 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:05.269 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:05.269 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-08-19T00:45:05.269 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:05.269 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:45:05.269 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 3.5 M 2024-08-19T00:45:05.269 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-08-19T00:45:05.270 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 24 k 2024-08-19T00:45:05.270 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 16 k 2024-08-19T00:45:05.270 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-19T00:45:05.270 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-19T00:45:05.270 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:05.270 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:45:05.270 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:05.270 INFO:teuthology.orchestra.run.smithi086.stdout:Install 5 Packages 2024-08-19T00:45:05.270 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:05.271 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 3.8 M 2024-08-19T00:45:05.271 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 87 M 2024-08-19T00:45:05.271 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:45:05.297 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-dashboard 2024-08-19T00:45:05.500 INFO:teuthology.orchestra.run.smithi086.stdout:(1/5): ceph-grafana-dashboards-18.2.4-721.gbaa9 148 kB/s | 24 kB 00:00 2024-08-19T00:45:05.542 INFO:teuthology.orchestra.run.smithi086.stdout:(2/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 738 kB/s | 31 kB 00:00 2024-08-19T00:45:05.567 INFO:teuthology.orchestra.run.smithi086.stdout:(3/5): ceph-prometheus-alerts-18.2.4-721.gbaa92 71 kB/s | 16 kB 00:00 2024-08-19T00:45:05.592 INFO:teuthology.orchestra.run.smithi086.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-08-19T00:45:05.751 INFO:teuthology.orchestra.run.smithi086.stdout:(5/5): ceph-mgr-dashboard-18.2.4-721.gbaa926de. 8.5 MB/s | 3.5 MB 00:00 2024-08-19T00:45:05.754 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:05.755 INFO:teuthology.orchestra.run.smithi086.stdout:Total 7.8 MB/s | 3.8 MB 00:00 2024-08-19T00:45:05.755 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:05.762 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:05.762 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:05.821 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:05.821 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:05.840 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:54 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:05.971 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:05.972 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:05.972 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-08-19T00:45:05.972 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:05.972 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:05.972 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 3.5 M 2024-08-19T00:45:05.973 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-08-19T00:45:05.973 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 24 k 2024-08-19T00:45:05.973 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 16 k 2024-08-19T00:45:05.973 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-19T00:45:05.973 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-19T00:45:05.973 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:05.973 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:05.973 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:05.973 INFO:teuthology.orchestra.run.smithi017.stdout:Install 5 Packages 2024-08-19T00:45:05.973 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:05.974 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 3.8 M 2024-08-19T00:45:05.974 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 87 M 2024-08-19T00:45:05.974 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:06.078 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:06.149 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-08-19T00:45:06.181 INFO:teuthology.orchestra.run.smithi017.stdout:(1/5): ceph-grafana-dashboards-18.2.4-721.gbaa9 165 kB/s | 24 kB 00:00 2024-08-19T00:45:06.189 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-08-19T00:45:06.198 INFO:teuthology.orchestra.run.smithi017.stdout:(2/5): ceph-prometheus-alerts-18.2.4-721.gbaa92 100 kB/s | 16 kB 00:00 2024-08-19T00:45:06.218 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-721.gbaa926de.el9.no 3/5 2024-08-19T00:45:06.232 INFO:teuthology.orchestra.run.smithi017.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 614 kB/s | 31 kB 00:00 2024-08-19T00:45:06.257 INFO:teuthology.orchestra.run.smithi017.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 3.2 MB/s | 188 kB 00:00 2024-08-19T00:45:06.407 INFO:teuthology.orchestra.run.smithi017.stdout:(5/5): ceph-mgr-dashboard-18.2.4-721.gbaa926de. 9.4 MB/s | 3.5 MB 00:00 2024-08-19T00:45:06.411 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:06.411 INFO:teuthology.orchestra.run.smithi017.stdout:Total 8.6 MB/s | 3.8 MB 00:00 2024-08-19T00:45:06.411 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:06.418 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:06.418 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:06.480 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:06.480 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:06.798 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-08-19T00:45:06.837 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-08-19T00:45:06.874 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-721.gbaa926de.el9.no 3/5 2024-08-19T00:45:07.260 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-721.gbaa926de.el9.n 4/5 2024-08-19T00:45:07.296 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-721.gbaa926de.el9.noarch 5/5 2024-08-19T00:45:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-721.gbaa926de.el9.n 4/5 2024-08-19T00:45:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-721.gbaa926de.el9.noarch 5/5 2024-08-19T00:45:08.288 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-721.gbaa926de.el9.noarch 5/5 2024-08-19T00:45:08.288 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-721.gbaa926de.el9.n 1/5 2024-08-19T00:45:08.288 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-721.gbaa926de.el9.noarch 2/5 2024-08-19T00:45:08.288 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-721.gbaa926de.el9.no 3/5 2024-08-19T00:45:08.288 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-08-19T00:45:08.549 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-08-19T00:45:08.549 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:08.549 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:08.549 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:08.549 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:08.550 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:08.550 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-19T00:45:08.550 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-19T00:45:08.550 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:08.550 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:08.799 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-mgr-diskprediction-local 2024-08-19T00:45:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-721.gbaa926de.el9.noarch 5/5 2024-08-19T00:45:09.148 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-721.gbaa926de.el9.n 1/5 2024-08-19T00:45:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-721.gbaa926de.el9.noarch 2/5 2024-08-19T00:45:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-721.gbaa926de.el9.no 3/5 2024-08-19T00:45:09.149 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-08-19T00:45:09.331 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:00:59 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-08-19T00:45:09.397 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:09.398 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-19T00:45:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-19T00:45:09.398 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:09.398 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:09.457 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:09.458 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-08-19T00:45:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-08-19T00:45:09.458 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-08-19T00:45:09.458 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:45:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 7.4 M 2024-08-19T00:45:09.458 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-08-19T00:45:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-19T00:45:09.458 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================== 2024-08-19T00:45:09.459 INFO:teuthology.orchestra.run.smithi086.stdout:Install 12 Packages 2024-08-19T00:45:09.460 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:09.460 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 38 M 2024-08-19T00:45:09.460 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 209 M 2024-08-19T00:45:09.460 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:45:09.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-diskprediction-local 2024-08-19T00:45:09.725 INFO:teuthology.orchestra.run.smithi086.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-08-19T00:45:09.767 INFO:teuthology.orchestra.run.smithi086.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.6 MB/s | 803 kB 00:00 2024-08-19T00:45:09.850 INFO:teuthology.orchestra.run.smithi086.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-08-19T00:45:09.901 INFO:teuthology.orchestra.run.smithi086.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-08-19T00:45:09.959 INFO:teuthology.orchestra.run.smithi086.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 605 kB/s | 35 kB 00:00 2024-08-19T00:45:10.051 INFO:teuthology.orchestra.run.smithi086.stdout:(6/12): ceph-mgr-diskprediction-local-18.2.4-72 15 MB/s | 7.4 MB 00:00 2024-08-19T00:45:10.155 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:00:59 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:10.226 INFO:teuthology.orchestra.run.smithi086.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.5 MB/s | 3.0 MB 00:00 2024-08-19T00:45:10.289 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:10.290 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-08-19T00:45:10.290 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-08-19T00:45:10.290 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 7.4 M 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.19-4.el9 appstream 244 k 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-19T00:45:10.291 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-19T00:45:10.292 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-19T00:45:10.292 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:10.292 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:10.292 INFO:teuthology.orchestra.run.smithi017.stdout:====================================================================================== 2024-08-19T00:45:10.292 INFO:teuthology.orchestra.run.smithi017.stdout:Install 12 Packages 2024-08-19T00:45:10.292 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:10.292 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 38 M 2024-08-19T00:45:10.293 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 209 M 2024-08-19T00:45:10.293 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:10.327 INFO:teuthology.orchestra.run.smithi086.stdout:(8/12): python3-devel-3.9.19-4.el9.x86_64.rpm 889 kB/s | 244 kB 00:00 2024-08-19T00:45:10.385 INFO:teuthology.orchestra.run.smithi086.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2024-08-19T00:45:10.410 INFO:teuthology.orchestra.run.smithi086.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.9 MB/s | 250 kB 00:00 2024-08-19T00:45:10.544 INFO:teuthology.orchestra.run.smithi086.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-08-19T00:45:10.722 INFO:teuthology.orchestra.run.smithi017.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-08-19T00:45:10.756 INFO:teuthology.orchestra.run.smithi017.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 4.8 MB/s | 803 kB 00:00 2024-08-19T00:45:10.848 INFO:teuthology.orchestra.run.smithi017.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-08-19T00:45:10.898 INFO:teuthology.orchestra.run.smithi017.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-08-19T00:45:10.948 INFO:teuthology.orchestra.run.smithi017.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-08-19T00:45:11.011 INFO:teuthology.orchestra.run.smithi086.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-08-19T00:45:11.012 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:11.012 INFO:teuthology.orchestra.run.smithi086.stdout:Total 24 MB/s | 38 MB 00:01 2024-08-19T00:45:11.074 INFO:teuthology.orchestra.run.smithi017.stdout:(6/12): ceph-mgr-diskprediction-local-18.2.4-72 15 MB/s | 7.4 MB 00:00 2024-08-19T00:45:11.216 INFO:teuthology.orchestra.run.smithi017.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.5 MB/s | 3.0 MB 00:00 2024-08-19T00:45:11.316 INFO:teuthology.orchestra.run.smithi017.stdout:(8/12): python3-devel-3.9.19-4.el9.x86_64.rpm 1.0 MB/s | 244 kB 00:00 2024-08-19T00:45:11.368 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:11.374 INFO:teuthology.orchestra.run.smithi017.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2024-08-19T00:45:11.393 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:11.394 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:11.400 INFO:teuthology.orchestra.run.smithi017.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.9 MB/s | 250 kB 00:00 2024-08-19T00:45:11.525 INFO:teuthology.orchestra.run.smithi017.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-08-19T00:45:11.800 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:11.800 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:11.983 INFO:teuthology.orchestra.run.smithi017.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-08-19T00:45:11.984 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:11.985 INFO:teuthology.orchestra.run.smithi017.stdout:Total 22 MB/s | 38 MB 00:01 2024-08-19T00:45:12.344 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:12.371 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:12.371 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:12.556 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:12.624 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-08-19T00:45:12.659 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-08-19T00:45:12.766 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-08-19T00:45:12.801 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:12.801 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:12.877 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 4/12 2024-08-19T00:45:13.053 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-08-19T00:45:13.084 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-08-19T00:45:13.160 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-08-19T00:45:13.583 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:13.639 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-08-19T00:45:13.690 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-08-19T00:45:13.793 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-08-19T00:45:13.799 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-08-19T00:45:13.833 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.19-4.el9.x86_64 4/12 2024-08-19T00:45:13.921 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-08-19T00:45:14.018 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-08-19T00:45:14.048 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-08-19T00:45:14.127 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-08-19T00:45:14.798 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-08-19T00:45:14.924 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-08-19T00:45:15.122 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-08-19T00:45:16.159 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-08-19T00:45:16.200 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-721.gbaa926 12/12 2024-08-19T00:45:16.204 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-08-19T00:45:17.272 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-08-19T00:45:17.323 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-721.gbaa926 12/12 2024-08-19T00:45:18.557 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-721.gbaa926 12/12 2024-08-19T00:45:18.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-721.gbaa926 1/12 2024-08-19T00:45:18.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-08-19T00:45:18.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-08-19T00:45:18.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-08-19T00:45:18.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-08-19T00:45:18.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-08-19T00:45:18.557 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-08-19T00:45:18.558 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-08-19T00:45:18.558 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 9/12 2024-08-19T00:45:18.558 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-08-19T00:45:18.558 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-08-19T00:45:18.958 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-19T00:45:18.959 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-19T00:45:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-19T00:45:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-19T00:45:18.960 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:18.960 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:19.335 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-mgr-rook 2024-08-19T00:45:19.803 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-721.gbaa926 12/12 2024-08-19T00:45:19.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-721.gbaa926 1/12 2024-08-19T00:45:19.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-08-19T00:45:19.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-08-19T00:45:19.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-08-19T00:45:19.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-08-19T00:45:19.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-08-19T00:45:19.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-08-19T00:45:19.803 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-08-19T00:45:19.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.19-4.el9.x86_64 9/12 2024-08-19T00:45:19.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-08-19T00:45:19.804 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-08-19T00:45:19.881 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:09 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:20.006 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:20.007 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:20.008 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-08-19T00:45:20.008 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:20.008 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:45:20.008 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 49 k 2024-08-19T00:45:20.008 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-08-19T00:45:20.008 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-19T00:45:20.009 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-19T00:45:20.009 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-19T00:45:20.009 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-19T00:45:20.009 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-19T00:45:20.009 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-19T00:45:20.009 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-19T00:45:20.009 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-19T00:45:20.009 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-19T00:45:20.009 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-19T00:45:20.009 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-19T00:45:20.010 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-19T00:45:20.010 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:20.010 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:45:20.010 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:20.010 INFO:teuthology.orchestra.run.smithi086.stdout:Install 13 Packages 2024-08-19T00:45:20.010 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:20.011 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 2.2 M 2024-08-19T00:45:20.011 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 26 M 2024-08-19T00:45:20.011 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:45:20.200 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-08-19T00:45:20.200 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:20.200 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:20.200 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:20.200 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-19T00:45:20.200 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-19T00:45:20.200 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-19T00:45:20.200 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-19T00:45:20.200 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-19T00:45:20.200 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-19T00:45:20.200 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-19T00:45:20.201 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.19-4.el9.x86_64 2024-08-19T00:45:20.201 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-19T00:45:20.201 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-19T00:45:20.201 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-19T00:45:20.201 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:20.201 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:20.374 INFO:teuthology.orchestra.run.smithi086.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 225 kB/s | 26 kB 00:00 2024-08-19T00:45:20.399 INFO:teuthology.orchestra.run.smithi086.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 138 kB/s | 19 kB 00:00 2024-08-19T00:45:20.433 INFO:teuthology.orchestra.run.smithi086.stdout:(3/13): ceph-mgr-rook-18.2.4-721.gbaa926de.el9. 285 kB/s | 49 kB 00:00 2024-08-19T00:45:20.517 INFO:teuthology.orchestra.run.smithi086.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-08-19T00:45:20.550 INFO:teuthology.orchestra.run.smithi086.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-08-19T00:45:20.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-rook 2024-08-19T00:45:20.575 INFO:teuthology.orchestra.run.smithi086.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 917 kB/s | 54 kB 00:00 2024-08-19T00:45:20.618 INFO:teuthology.orchestra.run.smithi086.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-08-19T00:45:20.643 INFO:teuthology.orchestra.run.smithi086.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-08-19T00:45:20.659 INFO:teuthology.orchestra.run.smithi086.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 168 kB/s | 14 kB 00:00 2024-08-19T00:45:20.685 INFO:teuthology.orchestra.run.smithi086.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 3.1 MB/s | 59 kB 00:00 2024-08-19T00:45:20.710 INFO:teuthology.orchestra.run.smithi086.stdout:(11/13): python3-google-auth-2.33.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-08-19T00:45:20.735 INFO:teuthology.orchestra.run.smithi086.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-08-19T00:45:20.769 INFO:teuthology.orchestra.run.smithi086.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-08-19T00:45:20.771 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:20.771 INFO:teuthology.orchestra.run.smithi086.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-08-19T00:45:20.835 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:20.850 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:20.851 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:20.934 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:20.934 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:21.114 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:10 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:21.247 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:21.248 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-08-19T00:45:21.248 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:21.248 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 49 k 2024-08-19T00:45:21.248 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-08-19T00:45:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-19T00:45:21.248 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-19T00:45:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-19T00:45:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-19T00:45:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-19T00:45:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-19T00:45:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-19T00:45:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-19T00:45:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-19T00:45:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-19T00:45:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-19T00:45:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-19T00:45:21.249 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:21.250 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:21.250 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:21.250 INFO:teuthology.orchestra.run.smithi017.stdout:Install 13 Packages 2024-08-19T00:45:21.250 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:21.250 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 2.2 M 2024-08-19T00:45:21.251 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 26 M 2024-08-19T00:45:21.251 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:21.432 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:21.605 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-08-19T00:45:21.638 INFO:teuthology.orchestra.run.smithi017.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 188 kB/s | 19 kB 00:00 2024-08-19T00:45:21.661 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-08-19T00:45:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:(2/13): ceph-mgr-rook-18.2.4-721.gbaa926de.el9. 307 kB/s | 49 kB 00:00 2024-08-19T00:45:21.716 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-08-19T00:45:21.722 INFO:teuthology.orchestra.run.smithi017.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 138 kB/s | 26 kB 00:00 2024-08-19T00:45:21.746 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-08-19T00:45:21.747 INFO:teuthology.orchestra.run.smithi017.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-08-19T00:45:21.787 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-08-19T00:45:21.814 INFO:teuthology.orchestra.run.smithi017.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 803 kB/s | 54 kB 00:00 2024-08-19T00:45:21.840 INFO:teuthology.orchestra.run.smithi017.stdout:(6/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-08-19T00:45:21.865 INFO:teuthology.orchestra.run.smithi017.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.9 MB/s | 279 kB 00:00 2024-08-19T00:45:21.888 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-08-19T00:45:21.907 INFO:teuthology.orchestra.run.smithi017.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 349 kB/s | 32 kB 00:00 2024-08-19T00:45:21.932 INFO:teuthology.orchestra.run.smithi017.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 153 kB/s | 14 kB 00:00 2024-08-19T00:45:21.957 INFO:teuthology.orchestra.run.smithi017.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-19T00:45:21.983 INFO:teuthology.orchestra.run.smithi017.stdout:(11/13): python3-google-auth-2.33.0-1.el9.noarc 2.1 MB/s | 220 kB 00:00 2024-08-19T00:45:21.991 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 7/13 2024-08-19T00:45:22.008 INFO:teuthology.orchestra.run.smithi017.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-08-19T00:45:22.039 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-08-19T00:45:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-08-19T00:45:22.044 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:22.044 INFO:teuthology.orchestra.run.smithi017.stdout:Total 2.8 MB/s | 2.2 MB 00:00 2024-08-19T00:45:22.109 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:22.124 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:22.124 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:22.214 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:22.216 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:22.720 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:22.755 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-08-19T00:45:22.802 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-08-19T00:45:22.836 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-08-19T00:45:22.884 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-08-19T00:45:22.896 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-08-19T00:45:22.906 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:18.2.4-721.gbaa926de.el9.noarch 13/13 2024-08-19T00:45:22.944 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-08-19T00:45:23.008 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-08-19T00:45:23.044 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-08-19T00:45:23.086 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-08-19T00:45:23.191 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-08-19T00:45:23.303 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 7/13 2024-08-19T00:45:23.354 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-08-19T00:45:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-721.gbaa926de.el9.noarch 13/13 2024-08-19T00:45:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:18.2.4-721.gbaa926de.el9.noarch 1/13 2024-08-19T00:45:23.673 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-08-19T00:45:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-08-19T00:45:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-08-19T00:45:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-08-19T00:45:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-08-19T00:45:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-08-19T00:45:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-08-19T00:45:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-08-19T00:45:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 10/13 2024-08-19T00:45:23.674 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-08-19T00:45:23.675 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-08-19T00:45:24.001 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-08-19T00:45:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:24.002 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-19T00:45:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-19T00:45:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-19T00:45:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-19T00:45:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-19T00:45:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-19T00:45:24.002 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-19T00:45:24.003 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-19T00:45:24.003 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-19T00:45:24.003 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-19T00:45:24.003 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-19T00:45:24.003 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-19T00:45:24.003 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:24.003 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:24.128 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-08-19T00:45:24.184 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-08-19T00:45:24.218 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-08-19T00:45:24.267 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-08-19T00:45:24.280 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-mgr-cephadm 2024-08-19T00:45:24.295 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:18.2.4-721.gbaa926de.el9.noarch 13/13 2024-08-19T00:45:24.826 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:14 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:24.953 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:24.954 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:24.954 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-08-19T00:45:24.954 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:24.954 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:45:24.954 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 139 k 2024-08-19T00:45:24.954 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-08-19T00:45:24.954 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-19T00:45:24.954 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-19T00:45:24.955 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-19T00:45:24.955 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-19T00:45:24.955 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-19T00:45:24.955 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:24.955 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:45:24.955 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:24.955 INFO:teuthology.orchestra.run.smithi086.stdout:Install 6 Packages 2024-08-19T00:45:24.955 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:24.956 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 7.0 M 2024-08-19T00:45:24.956 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 33 M 2024-08-19T00:45:24.956 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:45:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-721.gbaa926de.el9.noarch 13/13 2024-08-19T00:45:25.103 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:18.2.4-721.gbaa926de.el9.noarch 1/13 2024-08-19T00:45:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-08-19T00:45:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-08-19T00:45:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-08-19T00:45:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-08-19T00:45:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-08-19T00:45:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-08-19T00:45:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-08-19T00:45:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-08-19T00:45:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 10/13 2024-08-19T00:45:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-08-19T00:45:25.104 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-08-19T00:45:25.229 INFO:teuthology.orchestra.run.smithi086.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-08-19T00:45:25.288 INFO:teuthology.orchestra.run.smithi086.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-08-19T00:45:25.313 INFO:teuthology.orchestra.run.smithi086.stdout:(3/6): ceph-mgr-cephadm-18.2.4-721.gbaa926de.el 614 kB/s | 139 kB 00:00 2024-08-19T00:45:25.338 INFO:teuthology.orchestra.run.smithi086.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-08-19T00:45:25.380 INFO:teuthology.orchestra.run.smithi086.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-08-19T00:45:25.432 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-19T00:45:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-19T00:45:25.434 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-19T00:45:25.434 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:25.434 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:25.530 INFO:teuthology.orchestra.run.smithi086.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-08-19T00:45:25.533 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:25.533 INFO:teuthology.orchestra.run.smithi086.stdout:Total 12 MB/s | 7.0 MB 00:00 2024-08-19T00:45:25.603 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:25.614 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:25.614 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:25.674 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-mgr-cephadm 2024-08-19T00:45:25.712 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:25.712 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:26.018 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:26.198 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-08-19T00:45:26.237 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:15 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:26.249 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-08-19T00:45:26.369 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:26.370 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:26.370 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-08-19T00:45:26.370 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:26.370 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:26.370 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:18.2.4-721.gbaa926de.el9 ceph-noarch 139 k 2024-08-19T00:45:26.370 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-08-19T00:45:26.371 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-19T00:45:26.371 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-19T00:45:26.371 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-19T00:45:26.371 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-19T00:45:26.371 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-19T00:45:26.371 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:26.371 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:26.371 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:26.371 INFO:teuthology.orchestra.run.smithi017.stdout:Install 6 Packages 2024-08-19T00:45:26.371 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:26.372 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 7.0 M 2024-08-19T00:45:26.372 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 33 M 2024-08-19T00:45:26.372 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:26.778 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-08-19T00:45:26.861 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-08-19T00:45:26.923 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-08-19T00:45:26.953 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-721.gbaa926de.el9.noarch 6/6 2024-08-19T00:45:26.994 INFO:teuthology.orchestra.run.smithi017.stdout:(1/6): ceph-mgr-cephadm-18.2.4-721.gbaa926de.el 650 kB/s | 139 kB 00:00 2024-08-19T00:45:27.019 INFO:teuthology.orchestra.run.smithi017.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-08-19T00:45:27.069 INFO:teuthology.orchestra.run.smithi017.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 7.1 MB/s | 548 kB 00:00 2024-08-19T00:45:27.094 INFO:teuthology.orchestra.run.smithi017.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 767 kB/s | 58 kB 00:00 2024-08-19T00:45:27.119 INFO:teuthology.orchestra.run.smithi017.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-08-19T00:45:27.253 INFO:teuthology.orchestra.run.smithi017.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-08-19T00:45:27.255 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:27.255 INFO:teuthology.orchestra.run.smithi017.stdout:Total 7.9 MB/s | 7.0 MB 00:00 2024-08-19T00:45:27.328 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:27.340 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:27.340 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:27.441 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:27.696 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-721.gbaa926de.el9.noarch 6/6 2024-08-19T00:45:27.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-721.gbaa926de.el9.noarch 1/6 2024-08-19T00:45:27.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-08-19T00:45:27.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-08-19T00:45:27.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-08-19T00:45:27.697 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-08-19T00:45:27.748 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:27.925 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-08-19T00:45:27.963 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-08-19T00:45:27.963 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:27.963 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:27.963 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:27.963 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-19T00:45:27.963 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-19T00:45:27.963 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-19T00:45:27.963 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-19T00:45:27.963 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-19T00:45:27.963 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:27.963 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:27.972 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-08-19T00:45:28.229 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-fuse 2024-08-19T00:45:28.522 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-08-19T00:45:28.601 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-08-19T00:45:28.671 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-08-19T00:45:28.702 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-721.gbaa926de.el9.noarch 6/6 2024-08-19T00:45:28.763 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:18 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:28.891 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:28.892 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:28.892 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-08-19T00:45:28.892 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:28.892 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:45:28.892 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:18.2.4-721.gbaa926de.el9 ceph 852 k 2024-08-19T00:45:28.892 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-08-19T00:45:28.893 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-19T00:45:28.893 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:28.893 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:45:28.893 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:28.893 INFO:teuthology.orchestra.run.smithi086.stdout:Install 2 Packages 2024-08-19T00:45:28.893 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:28.893 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 932 k 2024-08-19T00:45:28.894 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 2.7 M 2024-08-19T00:45:28.894 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:45:29.397 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-721.gbaa926de.el9.noarch 6/6 2024-08-19T00:45:29.397 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-721.gbaa926de.el9.noarch 1/6 2024-08-19T00:45:29.397 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-08-19T00:45:29.397 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-08-19T00:45:29.397 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-08-19T00:45:29.397 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-08-19T00:45:29.426 INFO:teuthology.orchestra.run.smithi086.stdout:(1/2): ceph-fuse-18.2.4-721.gbaa926de.el9.x86_6 2.9 MB/s | 852 kB 00:00 2024-08-19T00:45:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-08-19T00:45:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:29.664 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:18.2.4-721.gbaa926de.el9.noarch 2024-08-19T00:45:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-19T00:45:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-19T00:45:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-19T00:45:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-19T00:45:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-19T00:45:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:29.664 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:29.782 INFO:teuthology.orchestra.run.smithi086.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 125 kB/s | 80 kB 00:00 2024-08-19T00:45:29.783 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:29.784 INFO:teuthology.orchestra.run.smithi086.stdout:Total 1.0 MB/s | 932 kB 00:00 2024-08-19T00:45:29.797 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:29.822 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:29.822 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:29.878 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-fuse 2024-08-19T00:45:29.904 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:29.904 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:30.083 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:30.223 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-08-19T00:45:30.304 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 2/2 2024-08-19T00:45:30.426 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:19 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:30.559 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:30.559 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:30.559 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-08-19T00:45:30.559 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:30.559 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:30.559 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:18.2.4-721.gbaa926de.el9 ceph 852 k 2024-08-19T00:45:30.559 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-08-19T00:45:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-19T00:45:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:30.560 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:30.560 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:30.560 INFO:teuthology.orchestra.run.smithi017.stdout:Install 2 Packages 2024-08-19T00:45:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:30.560 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 932 k 2024-08-19T00:45:30.561 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 2.7 M 2024-08-19T00:45:30.561 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 2/2 2024-08-19T00:45:30.888 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 1/2 2024-08-19T00:45:30.931 INFO:teuthology.orchestra.run.smithi017.stdout:(1/2): ceph-fuse-18.2.4-721.gbaa926de.el9.x86_6 3.1 MB/s | 852 kB 00:00 2024-08-19T00:45:31.122 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-08-19T00:45:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:31.123 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-08-19T00:45:31.123 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:31.123 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:31.315 INFO:teuthology.orchestra.run.smithi017.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 122 kB/s | 80 kB 00:00 2024-08-19T00:45:31.316 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:31.316 INFO:teuthology.orchestra.run.smithi017.stdout:Total 1.2 MB/s | 932 kB 00:00 2024-08-19T00:45:31.329 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:31.353 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:31.353 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:31.392 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install librados-devel 2024-08-19T00:45:31.438 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:31.438 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:31.626 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:31.767 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-08-19T00:45:31.832 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 2/2 2024-08-19T00:45:31.946 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:21 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:32.078 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:32.079 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:32.079 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repo Size 2024-08-19T00:45:32.079 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:32.079 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:45:32.079 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:18.2.4-721.gbaa926de.el9 ceph 127 k 2024-08-19T00:45:32.079 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:32.079 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:45:32.079 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:32.079 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-08-19T00:45:32.079 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:32.079 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 127 k 2024-08-19T00:45:32.080 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 456 k 2024-08-19T00:45:32.080 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:45:32.286 INFO:teuthology.orchestra.run.smithi086.stdout:librados-devel-18.2.4-721.gbaa926de.el9.x86_64. 614 kB/s | 127 kB 00:00 2024-08-19T00:45:32.287 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:32.287 INFO:teuthology.orchestra.run.smithi086.stdout:Total 609 kB/s | 127 kB 00:00 2024-08-19T00:45:32.287 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:32.293 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:32.293 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:32.358 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:32.358 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:32.485 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 2/2 2024-08-19T00:45:32.485 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 1/2 2024-08-19T00:45:32.511 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:32.640 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:32.763 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-08-19T00:45:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:32.764 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-08-19T00:45:32.764 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:32.764 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:33.052 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:33.053 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librados-devel 2024-08-19T00:45:33.306 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:33.307 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:33.307 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:33.307 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:33.307 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:33.307 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:33.539 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install libcephfs2 2024-08-19T00:45:33.609 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:22 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:33.742 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-08-19T00:45:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:18.2.4-721.gbaa926de.el9 ceph 127 k 2024-08-19T00:45:33.743 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:33.743 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-08-19T00:45:33.744 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 127 k 2024-08-19T00:45:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 456 k 2024-08-19T00:45:33.744 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:33.930 INFO:teuthology.orchestra.run.smithi017.stdout:librados-devel-18.2.4-721.gbaa926de.el9.x86_64. 693 kB/s | 127 kB 00:00 2024-08-19T00:45:33.930 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:33.930 INFO:teuthology.orchestra.run.smithi017.stdout:Total 686 kB/s | 127 kB 00:00 2024-08-19T00:45:33.930 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:34.001 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:34.002 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:34.095 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:24 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:34.158 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:34.180 INFO:teuthology.orchestra.run.smithi086.stdout:Package libcephfs2-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:34.224 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:34.225 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-08-19T00:45:34.225 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:34.259 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:34.316 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install libcephfs-devel 2024-08-19T00:45:34.672 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:34.892 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:24 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:34.946 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:34.946 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:34.947 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:34.947 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:35.018 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:35.019 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repo Size 2024-08-19T00:45:35.019 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:35.019 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:45:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:18.2.4-721.gbaa926de.el9 ceph 31 k 2024-08-19T00:45:35.019 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:35.019 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:45:35.019 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:35.019 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-08-19T00:45:35.020 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:35.020 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 31 k 2024-08-19T00:45:35.020 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 139 k 2024-08-19T00:45:35.020 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:45:35.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs2 2024-08-19T00:45:35.181 INFO:teuthology.orchestra.run.smithi086.stdout:libcephfs-devel-18.2.4-721.gbaa926de.el9.x86_64 193 kB/s | 31 kB 00:00 2024-08-19T00:45:35.181 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:35.181 INFO:teuthology.orchestra.run.smithi086.stdout:Total 192 kB/s | 31 kB 00:00 2024-08-19T00:45:35.182 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:35.185 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:35.185 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:35.188 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:35.188 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:35.265 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:35.370 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:35.733 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:24 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:35.754 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:35.820 INFO:teuthology.orchestra.run.smithi017.stdout:Package libcephfs2-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-08-19T00:45:35.866 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:35.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install libcephfs-devel 2024-08-19T00:45:35.980 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:35.980 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:35.980 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:35.980 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:35.980 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:35.980 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:36.174 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install librados2 2024-08-19T00:45:36.487 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:25 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:36.619 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:36.620 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:36.620 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-08-19T00:45:36.620 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:36.620 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:36.620 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:18.2.4-721.gbaa926de.el9 ceph 31 k 2024-08-19T00:45:36.620 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:36.620 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:36.620 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:36.620 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-08-19T00:45:36.621 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:36.621 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 31 k 2024-08-19T00:45:36.621 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 139 k 2024-08-19T00:45:36.621 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:36.703 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:26 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:36.780 INFO:teuthology.orchestra.run.smithi017.stdout:libcephfs-devel-18.2.4-721.gbaa926de.el9.x86_64 194 kB/s | 31 kB 00:00 2024-08-19T00:45:36.781 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:36.781 INFO:teuthology.orchestra.run.smithi017.stdout:Total 193 kB/s | 31 kB 00:00 2024-08-19T00:45:36.781 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:36.785 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:36.785 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:36.786 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:36.788 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:36.789 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:36.829 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:36.830 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-08-19T00:45:36.830 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:36.878 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:36.904 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install librbd1 2024-08-19T00:45:36.979 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:37.331 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:37.446 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:27 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:37.530 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:37.552 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:37.553 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:37.553 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:37.553 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:37.573 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:37.574 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-08-19T00:45:37.574 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:37.645 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-rados 2024-08-19T00:45:37.737 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librados2 2024-08-19T00:45:38.175 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:28 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:38.259 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-rados-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:38.281 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:27 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:38.302 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-08-19T00:45:38.303 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:38.368 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:38.379 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-rgw 2024-08-19T00:45:38.412 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:38.414 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-08-19T00:45:38.414 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:38.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install librbd1 2024-08-19T00:45:38.915 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:28 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:39.000 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-rgw-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:39.028 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:28 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:39.043 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:39.044 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-08-19T00:45:39.044 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:39.116 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:39.120 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-cephfs 2024-08-19T00:45:39.161 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:39.162 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-08-19T00:45:39.162 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:39.234 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rados 2024-08-19T00:45:39.662 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:29 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:39.746 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-cephfs-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:39.785 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:28 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:39.788 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:39.789 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-08-19T00:45:39.789 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:39.858 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install python3-rbd 2024-08-19T00:45:39.872 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rados-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:39.917 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:39.918 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-08-19T00:45:39.918 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:39.992 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rgw 2024-08-19T00:45:40.397 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:30 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:40.480 INFO:teuthology.orchestra.run.smithi086.stdout:Package python3-rbd-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:40.522 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:40.523 INFO:teuthology.orchestra.run.smithi086.stdout:Nothing to do. 2024-08-19T00:45:40.523 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:40.541 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:29 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:40.595 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install rbd-fuse 2024-08-19T00:45:40.628 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rgw-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:40.673 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:40.674 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-08-19T00:45:40.674 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:40.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-cephfs 2024-08-19T00:45:41.129 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:31 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:41.256 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:41.257 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:41.257 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2024-08-19T00:45:41.257 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:41.258 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:45:41.258 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:18.2.4-721.gbaa926de.el9 ceph 87 k 2024-08-19T00:45:41.258 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:41.258 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:45:41.258 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:41.258 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-08-19T00:45:41.258 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:41.258 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 87 k 2024-08-19T00:45:41.258 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 227 k 2024-08-19T00:45:41.258 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:45:41.301 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:30 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:41.388 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-cephfs-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:41.432 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:41.433 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-08-19T00:45:41.433 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:41.477 INFO:teuthology.orchestra.run.smithi086.stdout:rbd-fuse-18.2.4-721.gbaa926de.el9.x86_64.rpm 396 kB/s | 87 kB 00:00 2024-08-19T00:45:41.478 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:41.478 INFO:teuthology.orchestra.run.smithi086.stdout:Total 393 kB/s | 87 kB 00:00 2024-08-19T00:45:41.478 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:41.485 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:41.486 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:41.497 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install python3-rbd 2024-08-19T00:45:41.548 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:41.548 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:41.701 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:41.798 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:42.045 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:31 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:42.132 INFO:teuthology.orchestra.run.smithi017.stdout:Package python3-rbd-2:18.2.4-721.gbaa926de.el9.x86_64 is already installed. 2024-08-19T00:45:42.164 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:42.177 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:42.178 INFO:teuthology.orchestra.run.smithi017.stdout:Nothing to do. 2024-08-19T00:45:42.178 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:42.247 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-fuse 2024-08-19T00:45:42.445 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:42.445 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:42.445 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:42.445 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:42.445 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:42.445 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:42.681 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install rbd-mirror 2024-08-19T00:45:42.795 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:31 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:42.927 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:42.928 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-08-19T00:45:42.928 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:42.928 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:18.2.4-721.gbaa926de.el9 ceph 87 k 2024-08-19T00:45:42.928 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:42.928 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:42.928 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:42.929 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-08-19T00:45:42.929 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:42.929 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 87 k 2024-08-19T00:45:42.929 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 227 k 2024-08-19T00:45:42.929 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:43.116 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-fuse-18.2.4-721.gbaa926de.el9.x86_64.rpm 462 kB/s | 87 kB 00:00 2024-08-19T00:45:43.117 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:43.117 INFO:teuthology.orchestra.run.smithi017.stdout:Total 459 kB/s | 87 kB 00:00 2024-08-19T00:45:43.117 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:43.125 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:43.125 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:43.190 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:43.190 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:43.228 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:33 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:43.350 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:43.358 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:43.359 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:43.359 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repo Size 2024-08-19T00:45:43.359 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:43.359 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:45:43.359 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:18.2.4-721.gbaa926de.el9 ceph 3.0 M 2024-08-19T00:45:43.359 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:43.359 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:45:43.359 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:43.359 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-08-19T00:45:43.359 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:43.359 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 3.0 M 2024-08-19T00:45:43.360 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 12 M 2024-08-19T00:45:43.360 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:45:43.464 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:43.689 INFO:teuthology.orchestra.run.smithi086.stdout:rbd-mirror-18.2.4-721.gbaa926de.el9.x86_64.rpm 9.1 MB/s | 3.0 MB 00:00 2024-08-19T00:45:43.689 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:43.690 INFO:teuthology.orchestra.run.smithi086.stdout:Total 9.0 MB/s | 3.0 MB 00:00 2024-08-19T00:45:43.690 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:43.699 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:43.699 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:43.778 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:43.779 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:44.035 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:44.036 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:44.193 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:44.256 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:44.261 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-mirror 2024-08-19T00:45:44.280 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:45:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-19T00:45:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:45:44.281 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:45:44.281 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:44.810 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:33 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:44.942 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:44.943 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:44.943 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repo Size 2024-08-19T00:45:44.943 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:44.943 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:44.943 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:18.2.4-721.gbaa926de.el9 ceph 3.0 M 2024-08-19T00:45:44.943 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:44.943 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:44.943 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:44.943 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-08-19T00:45:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:44.944 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 3.0 M 2024-08-19T00:45:44.944 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 12 M 2024-08-19T00:45:44.944 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:45.261 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-mirror-18.2.4-721.gbaa926de.el9.x86_64.rpm 9.4 MB/s | 3.0 MB 00:00 2024-08-19T00:45:45.262 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:45.262 INFO:teuthology.orchestra.run.smithi017.stdout:Total 9.4 MB/s | 3.0 MB 00:00 2024-08-19T00:45:45.262 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:45.272 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:45.272 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:45.355 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:45.355 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:45.382 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:45.382 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:45.382 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:45.675 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install rbd-nbd 2024-08-19T00:45:45.789 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:45.862 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:45.886 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:45.887 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-19T00:45:45.887 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-19T00:45:45.887 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:45:45.887 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-19T00:45:45.887 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:46.213 INFO:teuthology.orchestra.run.smithi086.stdout:Last metadata expiration check: 0:01:36 ago on Mon 19 Aug 2024 12:44:10 AM UTC. 2024-08-19T00:45:46.343 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-08-19T00:45:46.343 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:46.343 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2024-08-19T00:45:46.344 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:46.344 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-08-19T00:45:46.344 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:18.2.4-721.gbaa926de.el9 ceph 172 k 2024-08-19T00:45:46.344 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:46.344 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-08-19T00:45:46.344 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-08-19T00:45:46.344 INFO:teuthology.orchestra.run.smithi086.stdout:Install 1 Package 2024-08-19T00:45:46.344 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:46.345 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 172 k 2024-08-19T00:45:46.345 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 494 k 2024-08-19T00:45:46.345 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-08-19T00:45:46.550 INFO:teuthology.orchestra.run.smithi086.stdout:rbd-nbd-18.2.4-721.gbaa926de.el9.x86_64.rpm 837 kB/s | 172 kB 00:00 2024-08-19T00:45:46.551 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:46.551 INFO:teuthology.orchestra.run.smithi086.stdout:Total 832 kB/s | 172 kB 00:00 2024-08-19T00:45:46.551 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-08-19T00:45:46.559 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-08-19T00:45:46.559 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-08-19T00:45:46.622 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-08-19T00:45:46.623 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-08-19T00:45:46.777 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-08-19T00:45:46.879 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:47.044 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:47.044 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:47.044 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:47.302 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-nbd-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:47.328 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install rbd-nbd 2024-08-19T00:45:47.561 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:47.561 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:47.562 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-08-19T00:45:47.562 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:47.562 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:45:47.562 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-08-19T00:45:47.804 DEBUG:teuthology.parallel:result is None 2024-08-19T00:45:47.882 INFO:teuthology.orchestra.run.smithi017.stdout:Last metadata expiration check: 0:01:36 ago on Mon 19 Aug 2024 12:44:11 AM UTC. 2024-08-19T00:45:48.013 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-08-19T00:45:48.014 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: Package Architecture Version Repository Size 2024-08-19T00:45:48.014 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:48.014 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-08-19T00:45:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:18.2.4-721.gbaa926de.el9 ceph 172 k 2024-08-19T00:45:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:48.014 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-08-19T00:45:48.014 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-08-19T00:45:48.014 INFO:teuthology.orchestra.run.smithi017.stdout:Install 1 Package 2024-08-19T00:45:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:48.015 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 172 k 2024-08-19T00:45:48.015 INFO:teuthology.orchestra.run.smithi017.stdout:Installed size: 494 k 2024-08-19T00:45:48.015 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-08-19T00:45:48.223 INFO:teuthology.orchestra.run.smithi017.stdout:rbd-nbd-18.2.4-721.gbaa926de.el9.x86_64.rpm 830 kB/s | 172 kB 00:00 2024-08-19T00:45:48.223 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:45:48.223 INFO:teuthology.orchestra.run.smithi017.stdout:Total 824 kB/s | 172 kB 00:00 2024-08-19T00:45:48.224 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-08-19T00:45:48.232 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-08-19T00:45:48.232 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-08-19T00:45:48.297 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-08-19T00:45:48.297 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-08-19T00:45:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-08-19T00:45:48.545 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:48.948 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-nbd-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:49.200 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:18.2.4-721.gbaa926de.el9.x86_64 1/1 2024-08-19T00:45:49.200 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-08-19T00:45:49.200 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:18.2.4-721.gbaa926de.el9.x86_64 2024-08-19T00:45:49.201 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:45:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-08-19T00:45:49.443 DEBUG:teuthology.parallel:result is None 2024-08-19T00:45:49.444 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-19T00:45:49.444 INFO:teuthology.packaging:ref: None 2024-08-19T00:45:49.444 INFO:teuthology.packaging:tag: None 2024-08-19T00:45:49.444 INFO:teuthology.packaging:branch: reef 2024-08-19T00:45:49.444 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:45:49.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-08-19T00:45:49.744 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-19T00:45:49.765 INFO:teuthology.orchestra.run.smithi017.stdout:18.2.4-721.gbaa926de.el9 2024-08-19T00:45:49.765 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-721.gbaa926de.el9 2024-08-19T00:45:49.765 INFO:teuthology.task.install:The correct ceph version 18.2.4-721.gbaa926de is installed. 2024-08-19T00:45:49.767 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-19T00:45:49.767 INFO:teuthology.packaging:ref: None 2024-08-19T00:45:49.767 INFO:teuthology.packaging:tag: None 2024-08-19T00:45:49.767 INFO:teuthology.packaging:branch: reef 2024-08-19T00:45:49.768 INFO:teuthology.packaging:sha1: de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:45:49.768 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=reef 2024-08-19T00:45:50.056 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-19T00:45:50.082 INFO:teuthology.orchestra.run.smithi086.stdout:18.2.4-721.gbaa926de.el9 2024-08-19T00:45:50.082 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-721.gbaa926de.el9 2024-08-19T00:45:50.083 INFO:teuthology.task.install:The correct ceph version 18.2.4-721.gbaa926de is installed. 2024-08-19T00:45:50.084 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-19T00:45:50.085 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:45:50.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-19T00:45:50.112 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:45:50.112 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-19T00:45:50.152 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-19T00:45:50.152 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:45:50.152 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-08-19T00:45:50.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-19T00:45:50.243 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:45:50.243 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-08-19T00:45:50.272 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-19T00:45:50.340 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-19T00:45:50.340 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:45:50.340 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-19T00:45:50.365 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-19T00:45:50.430 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:45:50.431 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-19T00:45:50.459 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-19T00:45:50.527 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-19T00:45:50.527 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:45:50.527 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-08-19T00:45:50.551 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-19T00:45:50.616 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:45:50.616 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-08-19T00:45:50.643 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-19T00:45:50.710 INFO:teuthology.run_tasks:Running task print... 2024-08-19T00:45:50.719 INFO:teuthology.task.print:**** done install task... 2024-08-19T00:45:50.720 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-19T00:45:50.885 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:reef', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833'} 2024-08-19T00:45:50.886 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:reef 2024-08-19T00:45:50.886 INFO:tasks.cephadm:Cluster fsid is 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:45:50.886 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-19T00:45:50.886 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-08-19T00:45:50.887 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi017': '172.21.15.17', 'mon.smithi086': '172.21.15.86'} 2024-08-19T00:45:50.887 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-19T00:45:50.887 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname $(hostname -s) 2024-08-19T00:45:50.912 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname $(hostname -s) 2024-08-19T00:45:50.940 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-08-19T00:45:50.940 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:45:51.084 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'de09dd018de4baddfa6ca4d43bc8fb784cf75833', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/55869/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.0-1382-gde09dd01', 'node_name': '172.21.5.40+adami10', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.0-1382.gde09dd01'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-18 16:22:46.893995', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/de09dd018de4baddfa6ca4d43bc8fb784cf75833/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-19T00:45:51.365 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref reef, sha1 baa926deef3d9e81dd31b10a4ae9969a5fbce5ae from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-08-19T00:45:51.366 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/x86_64/flavors/default/cephadm 2024-08-19T00:45:51.366 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/x86_64/flavors/default/cephadm 2024-08-19T00:45:51.366 DEBUG:teuthology.orchestra.run.smithi017:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-19T00:45:51.690 INFO:teuthology.orchestra.run.smithi017.stdout:-rw-r--r--. 1 ubuntu ubuntu 215597 Aug 19 00:45 /home/ubuntu/cephtest/cephadm 2024-08-19T00:45:51.690 DEBUG:teuthology.orchestra.run.smithi086:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/reef/baa926deef3d9e81dd31b10a4ae9969a5fbce5ae/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-19T00:45:52.051 INFO:teuthology.orchestra.run.smithi086.stdout:-rw-r--r--. 1 ubuntu ubuntu 215597 Aug 19 00:45 /home/ubuntu/cephtest/cephadm 2024-08-19T00:45:52.051 DEBUG:teuthology.orchestra.run.smithi017:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-19T00:45:52.071 DEBUG:teuthology.orchestra.run.smithi086:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-19T00:45:52.101 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:reef on all hosts... 2024-08-19T00:45:52.102 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-08-19T00:45:52.113 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef pull 2024-08-19T00:45:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-08-19T00:45:53.671 INFO:teuthology.orchestra.run.smithi086.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-08-19T00:46:20.479 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-08-19T00:46:20.479 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)", 2024-08-19T00:46:20.480 INFO:teuthology.orchestra.run.smithi086.stdout: "image_id": "e6c292a6bc95052ae76ae95cd2b7b1c7a0b2acacdb91703f8c5dad19d13cea1b", 2024-08-19T00:46:20.480 INFO:teuthology.orchestra.run.smithi086.stdout: "repo_digests": [ 2024-08-19T00:46:20.480 INFO:teuthology.orchestra.run.smithi086.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282" 2024-08-19T00:46:20.480 INFO:teuthology.orchestra.run.smithi086.stdout: ] 2024-08-19T00:46:20.480 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-08-19T00:46:21.509 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:46:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)", 2024-08-19T00:46:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "image_id": "e6c292a6bc95052ae76ae95cd2b7b1c7a0b2acacdb91703f8c5dad19d13cea1b", 2024-08-19T00:46:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "repo_digests": [ 2024-08-19T00:46:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282" 2024-08-19T00:46:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-08-19T00:46:21.510 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:46:21.531 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph 2024-08-19T00:46:21.588 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph 2024-08-19T00:46:21.622 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /etc/ceph 2024-08-19T00:46:21.648 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /etc/ceph 2024-08-19T00:46:21.692 INFO:tasks.cephadm:Writing seed config... 2024-08-19T00:46:21.694 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-08-19T00:46:21.694 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-08-19T00:46:21.694 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-08-19T00:46:21.694 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-08-19T00:46:21.694 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-08-19T00:46:21.695 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-19T00:46:21.695 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-19T00:46:21.695 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-08-19T00:46:21.695 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-08-19T00:46:21.695 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-19T00:46:21.695 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-19T00:46:21.695 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-08-19T00:46:21.695 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-19T00:46:21.696 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-19T00:46:21.696 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-19T00:46:21.696 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-19T00:46:21.696 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-19T00:46:21.696 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [client] debug client = 20 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-08-19T00:46:21.697 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-08-19T00:46:21.698 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-08-19T00:46:21.698 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-08-19T00:46:21.698 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-08-19T00:46:21.698 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-08-19T00:46:21.698 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-19T00:46:21.698 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-19T00:46:21.698 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-19T00:46:21.698 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-19T00:46:21.698 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-19T00:46:21.698 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-19T00:46:21.698 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-19T00:46:21.699 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-08-19T00:46:21.699 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-08-19T00:46:21.699 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:46:21.699 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-19T00:46:21.716 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 61e0bb80-5dc4-11ef-bccf-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-08-19T00:46:21.716 DEBUG:teuthology.orchestra.run.smithi017:mon.smithi017> sudo journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi017.service 2024-08-19T00:46:21.758 INFO:tasks.cephadm:Bootstrapping... 2024-08-19T00:46:21.758 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef -v bootstrap --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.17 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:46:21.916 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-08-19T00:46:21.916 INFO:teuthology.orchestra.run.smithi017.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:reef', '-v', 'bootstrap', '--fsid', '61e0bb80-5dc4-11ef-bccf-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.17', '--skip-admin-label'] 2024-08-19T00:46:21.941 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.1.2 2024-08-19T00:46:21.942 INFO:teuthology.orchestra.run.smithi017.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-19T00:46:21.942 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying podman|docker is present... 2024-08-19T00:46:21.965 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.1.2 2024-08-19T00:46:21.965 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying lvm2 is present... 2024-08-19T00:46:21.965 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying time synchronization is in place... 2024-08-19T00:46:21.972 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-19T00:46:21.973 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-19T00:46:21.979 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-19T00:46:21.979 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-08-19T00:46:21.985 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-08-19T00:46:21.992 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-08-19T00:46:21.992 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-08-19T00:46:21.992 INFO:teuthology.orchestra.run.smithi017.stdout:Repeating the final host check... 2024-08-19T00:46:22.015 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout 5.1.2 2024-08-19T00:46:22.015 INFO:teuthology.orchestra.run.smithi017.stdout:podman (/bin/podman) version 5.1.2 is present 2024-08-19T00:46:22.015 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl is present 2024-08-19T00:46:22.015 INFO:teuthology.orchestra.run.smithi017.stdout:lvcreate is present 2024-08-19T00:46:22.021 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-19T00:46:22.022 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-19T00:46:22.027 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-19T00:46:22.028 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-08-19T00:46:22.034 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout enabled 2024-08-19T00:46:22.040 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout active 2024-08-19T00:46:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:Unit chronyd.service is enabled and running 2024-08-19T00:46:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:Host looks OK 2024-08-19T00:46:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:Cluster fsid: 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:46:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:Acquiring lock 139973734398512 on /run/cephadm/61e0bb80-5dc4-11ef-bccf-c7b262605968.lock 2024-08-19T00:46:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:Lock 139973734398512 acquired on /run/cephadm/61e0bb80-5dc4-11ef-bccf-c7b262605968.lock 2024-08-19T00:46:22.041 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 3300 ... 2024-08-19T00:46:22.042 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying IP 172.21.15.17 port 6789 ... 2024-08-19T00:46:22.042 INFO:teuthology.orchestra.run.smithi017.stdout:Base mon IP(s) is [172.21.15.17:3300, 172.21.15.17:6789], mon addrv is [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-08-19T00:46:22.045 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.17 metric 100 2024-08-19T00:46:22.045 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.17 metric 100 2024-08-19T00:46:22.047 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-19T00:46:22.047 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-08-19T00:46:22.047 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-08-19T00:46:22.050 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-19T00:46:22.050 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-19T00:46:22.050 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-19T00:46:22.050 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-19T00:46:22.050 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout inet6 fe80::4d04:c3b0:ac84:c55b/64 scope link noprefixroute 2024-08-19T00:46:22.050 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-19T00:46:22.051 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-08-19T00:46:22.051 INFO:teuthology.orchestra.run.smithi017.stdout:Mon IP `172.21.15.17` is in CIDR network `172.21.0.0/20` 2024-08-19T00:46:22.051 INFO:teuthology.orchestra.run.smithi017.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-19T00:46:22.051 INFO:teuthology.orchestra.run.smithi017.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-19T00:46:22.052 INFO:teuthology.orchestra.run.smithi017.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:reef... 2024-08-19T00:46:22.529 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stdout e6c292a6bc95052ae76ae95cd2b7b1c7a0b2acacdb91703f8c5dad19d13cea1b 2024-08-19T00:46:22.529 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:reef... 2024-08-19T00:46:22.529 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Getting image source signatures 2024-08-19T00:46:22.529 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:88ceb397420d1ccfabd2f90c4bd09ee4d51a4f85ea7e8259e1b1e579856e954e 2024-08-19T00:46:22.529 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-19T00:46:22.529 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Copying config sha256:e6c292a6bc95052ae76ae95cd2b7b1c7a0b2acacdb91703f8c5dad19d13cea1b 2024-08-19T00:46:22.529 INFO:teuthology.orchestra.run.smithi017.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-19T00:46:23.517 INFO:teuthology.orchestra.run.smithi017.stdout:ceph: stdout ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable) 2024-08-19T00:46:23.517 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph version: ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable) 2024-08-19T00:46:23.517 INFO:teuthology.orchestra.run.smithi017.stdout:Extracting ceph user uid/gid from container image... 2024-08-19T00:46:24.356 INFO:teuthology.orchestra.run.smithi017.stdout:stat: stdout 167 167 2024-08-19T00:46:24.356 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial keys... 2024-08-19T00:46:25.236 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQDglcJmrAARJxAA6Fve1FTQP8HFQpDiWhxE4A== 2024-08-19T00:46:26.241 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQDhlcJmftZCIhAAmDChckVNu8lfzw8g8WCinw== 2024-08-19T00:46:27.023 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph-authtool: stdout AQDilcJm3gwqHhAAd5ITy5k7Pyhsw8tiHekEPg== 2024-08-19T00:46:27.023 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial monmap... 2024-08-19T00:46:27.870 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-19T00:46:27.870 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-08-19T00:46:27.870 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:46:27.870 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-19T00:46:27.870 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool for smithi017 [v2:172.21.15.17:3300,v1:172.21.15.17:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-19T00:46:27.871 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = pacific 2024-08-19T00:46:27.871 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: set fsid to 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:46:27.871 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-19T00:46:27.871 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:46:27.871 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mon... 2024-08-19T00:46:28.711 INFO:teuthology.orchestra.run.smithi017.stdout:create mon.smithi017 on 2024-08-19T00:46:28.913 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-19T00:46:29.056 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-19T00:46:29.227 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968.target. 2024-08-19T00:46:29.227 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968.target. 2024-08-19T00:46:29.444 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi017 2024-08-19T00:46:29.444 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi017.service: Unit ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi017.service not loaded. 2024-08-19T00:46:29.608 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968.target.wants/ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi017.service → /etc/systemd/system/ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@.service. 2024-08-19T00:46:30.122 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:30 smithi017 ceph-mon[16257]: mon.smithi017 is new leader, mons smithi017 in quorum (ranks 0) 2024-08-19T00:46:30.122 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:30 smithi017 bash[16238]: 283fee457c11fceb8de8132e38629de6e76a2edc600f5f873a605114ca51a6d4 2024-08-19T00:46:30.135 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-19T00:46:30.135 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-08-19T00:46:30.142 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-19T00:46:30.142 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-08-19T00:46:30.142 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-08-19T00:46:30.142 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-08-19T00:46:30.142 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon to start... 2024-08-19T00:46:30.142 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mon... 2024-08-19T00:46:30.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:30 smithi017 systemd[1]: Started Ceph mon.smithi017 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T00:46:31.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:31 smithi017 ceph-mon[16257]: mon.smithi017 is new leader, mons smithi017 in quorum (ranks 0) 2024-08-19T00:46:31.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:31 smithi017 ceph-mon[16257]: monmap e1: 1 mons at {smithi017=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-08-19T00:46:31.177 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:31 smithi017 ceph-mon[16257]: fsmap 2024-08-19T00:46:31.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:31 smithi017 ceph-mon[16257]: osdmap e1: 0 total, 0 up, 0 in 2024-08-19T00:46:31.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:31 smithi017 ceph-mon[16257]: mgrmap e1: no daemons active 2024-08-19T00:46:31.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:31 smithi017 ceph-mon[16257]: from='client.? 172.21.15.17:0/1806683099' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-08-19T00:46:31.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout cluster: 2024-08-19T00:46:31.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout id: 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:46:31.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-19T00:46:31.185 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout services: 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi017 (age 0.520829s) 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:31.186 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout data: 2024-08-19T00:46:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-19T00:46:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-19T00:46:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-19T00:46:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout pgs: 2024-08-19T00:46:31.187 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.524+0000 7f028ac0b640 1 Processor -- start 2024-08-19T00:46:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.524+0000 7f028ac0b640 1 -- start start 2024-08-19T00:46:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.525+0000 7f028ac0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f02841048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.525+0000 7f028ac0b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0284104eb0 con 0x7f02841044e0 2024-08-19T00:46:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.525+0000 7f02889a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f02841048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.188 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.525+0000 7f02889a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f02841048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56780/0 (socket says 172.21.15.17:56780) 2024-08-19T00:46:31.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.525+0000 7f02889a7640 1 -- 172.21.15.17:0/1020484540 learned_addr learned my addr 172.21.15.17:0/1020484540 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:31.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.525+0000 7f02889a7640 1 -- 172.21.15.17:0/1020484540 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02841056e0 con 0x7f02841044e0 2024-08-19T00:46:31.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.527+0000 7f02889a7640 1 --2- 172.21.15.17:0/1020484540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f02841048e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f027c009e80 tx=0x7f027c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cae1ce4a34b6ce server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.527+0000 7f02837fe640 1 -- 172.21.15.17:0/1020484540 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f027c031400 con 0x7f02841044e0 2024-08-19T00:46:31.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.527+0000 7f02837fe640 1 -- 172.21.15.17:0/1020484540 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c02d050 con 0x7f02841044e0 2024-08-19T00:46:31.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.527+0000 7f02837fe640 1 -- 172.21.15.17:0/1020484540 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f027c0316d0 con 0x7f02841044e0 2024-08-19T00:46:31.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.528+0000 7f028ac0b640 1 -- 172.21.15.17:0/1020484540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 msgr2=0x7f02841048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.528+0000 7f028ac0b640 1 --2- 172.21.15.17:0/1020484540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f02841048e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f027c009e80 tx=0x7f027c02a7a0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.528+0000 7f028ac0b640 1 -- 172.21.15.17:0/1020484540 shutdown_connections 2024-08-19T00:46:31.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.528+0000 7f028ac0b640 1 --2- 172.21.15.17:0/1020484540 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f02841048e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.189 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.528+0000 7f028ac0b640 1 -- 172.21.15.17:0/1020484540 >> 172.21.15.17:0/1020484540 conn(0x7f02840ffc50 msgr2=0x7f02841020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:31.190 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.528+0000 7f028ac0b640 1 -- 172.21.15.17:0/1020484540 shutdown_connections 2024-08-19T00:46:31.190 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.528+0000 7f028ac0b640 1 -- 172.21.15.17:0/1020484540 wait complete. 2024-08-19T00:46:31.190 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.528+0000 7f028ac0b640 1 Processor -- start 2024-08-19T00:46:31.190 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f028ac0b640 1 -- start start 2024-08-19T00:46:31.190 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f028ac0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f028418d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:31.190 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f028ac0b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028418d5e0 con 0x7f02841044e0 2024-08-19T00:46:31.190 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f02889a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f028418d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:31.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f02889a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f028418d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56782/0 (socket says 172.21.15.17:56782) 2024-08-19T00:46:31.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f02889a7640 1 -- 172.21.15.17:0/1806683099 learned_addr learned my addr 172.21.15.17:0/1806683099 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:31.195 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f02889a7640 1 -- 172.21.15.17:0/1806683099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c009b30 con 0x7f02841044e0 2024-08-19T00:46:31.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f02889a7640 1 --2- 172.21.15.17:0/1806683099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f028418d0a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f027c02acc0 tx=0x7f027c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:31.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f0281ffb640 1 -- 172.21.15.17:0/1806683099 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f027c03b7d0 con 0x7f02841044e0 2024-08-19T00:46:31.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f0281ffb640 1 -- 172.21.15.17:0/1806683099 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c03b930 con 0x7f02841044e0 2024-08-19T00:46:31.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f0281ffb640 1 -- 172.21.15.17:0/1806683099 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f027c03bc30 con 0x7f02841044e0 2024-08-19T00:46:31.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.529+0000 7f028ac0b640 1 -- 172.21.15.17:0/1806683099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028418b7d0 con 0x7f02841044e0 2024-08-19T00:46:31.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.530+0000 7f028ac0b640 1 -- 172.21.15.17:0/1806683099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028418bc70 con 0x7f02841044e0 2024-08-19T00:46:31.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.530+0000 7f0281ffb640 1 -- 172.21.15.17:0/1806683099 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f027c038040 con 0x7f02841044e0 2024-08-19T00:46:31.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.530+0000 7f0281ffb640 1 -- 172.21.15.17:0/1806683099 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f027c03a3d0 con 0x7f02841044e0 2024-08-19T00:46:31.196 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.531+0000 7f028ac0b640 1 -- 172.21.15.17:0/1806683099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0284106290 con 0x7f02841044e0 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.533+0000 7f0281ffb640 1 -- 172.21.15.17:0/1806683099 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f027c04b060 con 0x7f02841044e0 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.594+0000 7f028ac0b640 1 -- 172.21.15.17:0/1806683099 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f0284105cb0 con 0x7f02841044e0 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.594+0000 7f0281ffb640 1 -- 172.21.15.17:0/1806683099 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f027c042070 con 0x7f02841044e0 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.595+0000 7f028ac0b640 1 -- 172.21.15.17:0/1806683099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 msgr2=0x7f028418d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.595+0000 7f028ac0b640 1 --2- 172.21.15.17:0/1806683099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f028418d0a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f027c02acc0 tx=0x7f027c004a40 comp rx=0 tx=0).stop 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.595+0000 7f028ac0b640 1 -- 172.21.15.17:0/1806683099 shutdown_connections 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.595+0000 7f028ac0b640 1 --2- 172.21.15.17:0/1806683099 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02841044e0 0x7f028418d0a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.595+0000 7f028ac0b640 1 -- 172.21.15.17:0/1806683099 >> 172.21.15.17:0/1806683099 conn(0x7f02840ffc50 msgr2=0x7f02840798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.595+0000 7f028ac0b640 1 -- 172.21.15.17:0/1806683099 shutdown_connections 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:30.595+0000 7f028ac0b640 1 -- 172.21.15.17:0/1806683099 wait complete. 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:mon is available 2024-08-19T00:46:31.197 INFO:teuthology.orchestra.run.smithi017.stdout:Assimilating anything we can from ceph.conf... 2024-08-19T00:46:32.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:32 smithi017 ceph-mon[16257]: from='client.? 172.21.15.17:0/38485925' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-19T00:46:32.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:32 smithi017 ceph-mon[16257]: from='client.? 172.21.15.17:0/38485925' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-19T00:46:32.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:32.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-08-19T00:46:32.227 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.17:3300,v1:172.21.15.17:6789] 2024-08-19T00:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-19T00:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-19T00:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-19T00:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-19T00:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-19T00:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-19T00:46:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-08-19T00:46:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-19T00:46:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-19T00:46:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-19T00:46:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-19T00:46:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-19T00:46:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.556+0000 7f09ee044640 1 Processor -- start 2024-08-19T00:46:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.556+0000 7f09ee044640 1 -- start start 2024-08-19T00:46:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.556+0000 7f09ee044640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e807a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.556+0000 7f09ee044640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e807a900 con 0x7f09e807bed0 2024-08-19T00:46:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.556+0000 7f09e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e807a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.556+0000 7f09e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e807a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56796/0 (socket says 172.21.15.17:56796) 2024-08-19T00:46:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.556+0000 7f09e77fe640 1 -- 172.21.15.17:0/1894756042 learned_addr learned my addr 172.21.15.17:0/1894756042 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.556+0000 7f09e77fe640 1 -- 172.21.15.17:0/1894756042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e807aa40 con 0x7f09e807bed0 2024-08-19T00:46:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.557+0000 7f09e77fe640 1 --2- 172.21.15.17:0/1894756042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e807a330 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009820 tx=0x7f09d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfc7673fb984c00 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.557+0000 7f09e67fc640 1 -- 172.21.15.17:0/1894756042 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09d802ad40 con 0x7f09e807bed0 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.557+0000 7f09e67fc640 1 -- 172.21.15.17:0/1894756042 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d8032440 con 0x7f09e807bed0 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.557+0000 7f09e67fc640 1 -- 172.21.15.17:0/1894756042 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09d802aea0 con 0x7f09e807bed0 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.558+0000 7f09ee044640 1 -- 172.21.15.17:0/1894756042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 msgr2=0x7f09e807a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.558+0000 7f09ee044640 1 --2- 172.21.15.17:0/1894756042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e807a330 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f09d8009820 tx=0x7f09d802a270 comp rx=0 tx=0).stop 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.558+0000 7f09ee044640 1 -- 172.21.15.17:0/1894756042 shutdown_connections 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.558+0000 7f09ee044640 1 --2- 172.21.15.17:0/1894756042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e807a330 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.558+0000 7f09ee044640 1 -- 172.21.15.17:0/1894756042 >> 172.21.15.17:0/1894756042 conn(0x7f09e8100d80 msgr2=0x7f09e81031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.558+0000 7f09ee044640 1 -- 172.21.15.17:0/1894756042 shutdown_connections 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.558+0000 7f09ee044640 1 -- 172.21.15.17:0/1894756042 wait complete. 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09ee044640 1 Processor -- start 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09ee044640 1 -- start start 2024-08-19T00:46:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09ee044640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e819ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09ee044640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e819b280 con 0x7f09e807bed0 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e819ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e819ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56800/0 (socket says 172.21.15.17:56800) 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09e77fe640 1 -- 172.21.15.17:0/38485925 learned_addr learned my addr 172.21.15.17:0/38485925 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09e77fe640 1 -- 172.21.15.17:0/38485925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d80094d0 con 0x7f09e807bed0 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09e77fe640 1 --2- 172.21.15.17:0/38485925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e819ad40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f09d80090b0 tx=0x7f09d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09e4ff9640 1 -- 172.21.15.17:0/38485925 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09d80308d0 con 0x7f09e807bed0 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09e4ff9640 1 -- 172.21.15.17:0/38485925 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d8030a30 con 0x7f09e807bed0 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.559+0000 7f09ee044640 1 -- 172.21.15.17:0/38485925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e819b480 con 0x7f09e807bed0 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.560+0000 7f09e4ff9640 1 -- 172.21.15.17:0/38485925 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09d8030d30 con 0x7f09e807bed0 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.560+0000 7f09ee044640 1 -- 172.21.15.17:0/38485925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e819b920 con 0x7f09e807bed0 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.560+0000 7f09e4ff9640 1 -- 172.21.15.17:0/38485925 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f09d8039040 con 0x7f09e807bed0 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.560+0000 7f09e4ff9640 1 -- 172.21.15.17:0/38485925 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f09d803b8c0 con 0x7f09e807bed0 2024-08-19T00:46:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.561+0000 7f09ee044640 1 -- 172.21.15.17:0/38485925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e8194ac0 con 0x7f09e807bed0 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.563+0000 7f09e4ff9640 1 -- 172.21.15.17:0/38485925 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f09d8037070 con 0x7f09e807bed0 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.621+0000 7f09ee044640 1 -- 172.21.15.17:0/38485925 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f09e807adb0 con 0x7f09e807bed0 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.624+0000 7f09e4ff9640 1 -- 172.21.15.17:0/38485925 <== mon.0 v2:172.21.15.17:3300/0 7 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f09d8046d50 con 0x7f09e807bed0 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.624+0000 7f09e4ff9640 1 -- 172.21.15.17:0/38485925 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f09d8045de0 con 0x7f09e807bed0 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.625+0000 7f09ee044640 1 -- 172.21.15.17:0/38485925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 msgr2=0x7f09e819ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.625+0000 7f09ee044640 1 --2- 172.21.15.17:0/38485925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e819ad40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f09d80090b0 tx=0x7f09d80046c0 comp rx=0 tx=0).stop 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.625+0000 7f09ee044640 1 -- 172.21.15.17:0/38485925 shutdown_connections 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.625+0000 7f09ee044640 1 --2- 172.21.15.17:0/38485925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09e807bed0 0x7f09e819ad40 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.625+0000 7f09ee044640 1 -- 172.21.15.17:0/38485925 >> 172.21.15.17:0/38485925 conn(0x7f09e8100d80 msgr2=0x7f09e8101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.626+0000 7f09ee044640 1 -- 172.21.15.17:0/38485925 shutdown_connections 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:31.626+0000 7f09ee044640 1 -- 172.21.15.17:0/38485925 wait complete. 2024-08-19T00:46:32.233 INFO:teuthology.orchestra.run.smithi017.stdout:Generating new minimal ceph.conf... 2024-08-19T00:46:33.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:33 smithi017 ceph-mon[16257]: from='client.? 172.21.15.17:0/433358202' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:46:33.206 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.597+0000 7f7ccfb96640 1 Processor -- start 2024-08-19T00:46:33.206 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.597+0000 7f7ccfb96640 1 -- start start 2024-08-19T00:46:33.206 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.598+0000 7f7ccfb96640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc8108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.206 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.598+0000 7f7ccfb96640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8079ea0 con 0x7f7cc8106050 2024-08-19T00:46:33.206 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.598+0000 7f7ccd932640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc8108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.206 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.598+0000 7f7ccd932640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc8108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56816/0 (socket says 172.21.15.17:56816) 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.598+0000 7f7ccd932640 1 -- 172.21.15.17:0/1599557964 learned_addr learned my addr 172.21.15.17:0/1599557964 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.598+0000 7f7ccd932640 1 -- 172.21.15.17:0/1599557964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc8108980 con 0x7f7cc8106050 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.599+0000 7f7ccd932640 1 --2- 172.21.15.17:0/1599557964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc8108440 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4009820 tx=0x7f7cc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8616d384f0d88888 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.599+0000 7f7ccc930640 1 -- 172.21.15.17:0/1599557964 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7cc402ad40 con 0x7f7cc8106050 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.599+0000 7f7ccc930640 1 -- 172.21.15.17:0/1599557964 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f7cc40328c0 con 0x7f7cc8106050 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.599+0000 7f7ccc930640 1 -- 172.21.15.17:0/1599557964 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7cc40307f0 con 0x7f7cc8106050 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.600+0000 7f7ccfb96640 1 -- 172.21.15.17:0/1599557964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 msgr2=0x7f7cc8108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.600+0000 7f7ccfb96640 1 --2- 172.21.15.17:0/1599557964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc8108440 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4009820 tx=0x7f7cc402a270 comp rx=0 tx=0).stop 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.600+0000 7f7ccfb96640 1 -- 172.21.15.17:0/1599557964 shutdown_connections 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.600+0000 7f7ccfb96640 1 --2- 172.21.15.17:0/1599557964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc8108440 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.600+0000 7f7ccfb96640 1 -- 172.21.15.17:0/1599557964 >> 172.21.15.17:0/1599557964 conn(0x7f7cc80ffc50 msgr2=0x7f7cc81020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.600+0000 7f7ccfb96640 1 -- 172.21.15.17:0/1599557964 shutdown_connections 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.600+0000 7f7ccfb96640 1 -- 172.21.15.17:0/1599557964 wait complete. 2024-08-19T00:46:33.207 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.600+0000 7f7ccfb96640 1 Processor -- start 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.600+0000 7f7ccfb96640 1 -- start start 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7ccfb96640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc81992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7ccfb96640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc81997f0 con 0x7f7cc8106050 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7ccd932640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc81992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7ccd932640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc81992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56830/0 (socket says 172.21.15.17:56830) 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7ccd932640 1 -- 172.21.15.17:0/433358202 learned_addr learned my addr 172.21.15.17:0/433358202 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7ccd932640 1 -- 172.21.15.17:0/433358202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc40094d0 con 0x7f7cc8106050 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7ccd932640 1 --2- 172.21.15.17:0/433358202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc81992b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4030d30 tx=0x7f7cc4030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7cbeffd640 1 -- 172.21.15.17:0/433358202 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7cc4032c40 con 0x7f7cc8106050 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7cbeffd640 1 -- 172.21.15.17:0/433358202 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f7cc4032da0 con 0x7f7cc8106050 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7cbeffd640 1 -- 172.21.15.17:0/433358202 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7cc403c660 con 0x7f7cc8106050 2024-08-19T00:46:33.208 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7ccfb96640 1 -- 172.21.15.17:0/433358202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc81999f0 con 0x7f7cc8106050 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.601+0000 7f7ccfb96640 1 -- 172.21.15.17:0/433358202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc8199e10 con 0x7f7cc8106050 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.602+0000 7f7cbeffd640 1 -- 172.21.15.17:0/433358202 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7cc403cac0 con 0x7f7cc8106050 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.602+0000 7f7cbeffd640 1 -- 172.21.15.17:0/433358202 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7cc4047e30 con 0x7f7cc8106050 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.602+0000 7f7ccfb96640 1 -- 172.21.15.17:0/433358202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc8109700 con 0x7f7cc8106050 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.605+0000 7f7cbeffd640 1 -- 172.21.15.17:0/433358202 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7cc4037070 con 0x7f7cc8106050 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.663+0000 7f7ccfb96640 1 -- 172.21.15.17:0/433358202 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f7cc819ca20 con 0x7f7cc8106050 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.663+0000 7f7cbeffd640 1 -- 172.21.15.17:0/433358202 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f7cc403db00 con 0x7f7cc8106050 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.664+0000 7f7ccfb96640 1 -- 172.21.15.17:0/433358202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 msgr2=0x7f7cc81992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.664+0000 7f7ccfb96640 1 --2- 172.21.15.17:0/433358202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc81992b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4030d30 tx=0x7f7cc4030d60 comp rx=0 tx=0).stop 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.664+0000 7f7ccfb96640 1 -- 172.21.15.17:0/433358202 shutdown_connections 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.664+0000 7f7ccfb96640 1 --2- 172.21.15.17:0/433358202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7cc8106050 0x7f7cc81992b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.664+0000 7f7ccfb96640 1 -- 172.21.15.17:0/433358202 >> 172.21.15.17:0/433358202 conn(0x7f7cc80ffc50 msgr2=0x7f7cc8100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.664+0000 7f7ccfb96640 1 -- 172.21.15.17:0/433358202 shutdown_connections 2024-08-19T00:46:33.209 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:32.664+0000 7f7ccfb96640 1 -- 172.21.15.17:0/433358202 wait complete. 2024-08-19T00:46:33.210 INFO:teuthology.orchestra.run.smithi017.stdout:Restarting the monitor... 2024-08-19T00:46:33.495 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:33 smithi017 systemd[1]: Stopping Ceph mon.smithi017 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T00:46:33.802 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:33 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[16253]: 2024-08-19T00:46:33.492+0000 7f9c61a4f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi017 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:46:33.802 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:33 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[16253]: 2024-08-19T00:46:33.492+0000 7f9c61a4f640 -1 mon.smithi017@0(leader) e1 *** Got Signal Terminated *** 2024-08-19T00:46:33.802 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:33 smithi017 podman[16501]: 2024-08-19 00:46:33.513331399 +0000 UTC m=+0.124701803 container died 283fee457c11fceb8de8132e38629de6e76a2edc600f5f873a605114ca51a6d4 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=reef-baa926d, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-19T00:46:33.802 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:33 smithi017 podman[16501]: 2024-08-19 00:46:33.800506501 +0000 UTC m=+0.411876895 container cleanup 283fee457c11fceb8de8132e38629de6e76a2edc600f5f873a605114ca51a6d4 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=reef-baa926d) 2024-08-19T00:46:34.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:33 smithi017 bash[16501]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017 2024-08-19T00:46:34.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 podman[16515]: 2024-08-19 00:46:34.017946035 +0000 UTC m=+0.504179734 container remove 283fee457c11fceb8de8132e38629de6e76a2edc600f5f873a605114ca51a6d4 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=reef-baa926d, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-08-19T00:46:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi017.service: Deactivated successfully. 2024-08-19T00:46:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 systemd[1]: Stopped Ceph mon.smithi017 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T00:46:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 systemd[1]: Starting Ceph mon.smithi017 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T00:46:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 podman[16608]: 2024-08-19 00:46:34.360522328 +0000 UTC m=+0.105291208 container create 771bc6b905a5d69765e968377e6695a275b67261a0a28e56a5c57d357f6a4f90 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, RELEASE=reef-baa926d, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T00:46:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 podman[16608]: 2024-08-19 00:46:34.272629695 +0000 UTC m=+0.017398596 image pull e6c292a6bc95052ae76ae95cd2b7b1c7a0b2acacdb91703f8c5dad19d13cea1b quay.ceph.io/ceph-ci/ceph:reef 2024-08-19T00:46:34.643 INFO:teuthology.orchestra.run.smithi017.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-19T00:46:34.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 podman[16608]: 2024-08-19 00:46:34.554644549 +0000 UTC m=+0.299413441 container init 771bc6b905a5d69765e968377e6695a275b67261a0a28e56a5c57d357f6a4f90 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=reef-baa926d, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-19T00:46:34.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 podman[16608]: 2024-08-19 00:46:34.557799414 +0000 UTC m=+0.302568294 container start 771bc6b905a5d69765e968377e6695a275b67261a0a28e56a5c57d357f6a4f90 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=reef-baa926d, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T00:46:34.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: set uid:gid to 167:167 (ceph:ceph) 2024-08-19T00:46:34.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable), process ceph-mon, pid 2 2024-08-19T00:46:34.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: pidfile_write: ignore empty --pid-file 2024-08-19T00:46:34.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: load: jerasure load: lrc 2024-08-19T00:46:34.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: RocksDB version: 7.9.2 2024-08-19T00:46:34.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Git sha 0 2024-08-19T00:46:34.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Compile date 2024-08-18 15:07:10 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: DB SUMMARY 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: DB Session ID: BMAM2IBNNSTZ0Y32V88E 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: CURRENT file: CURRENT 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: IDENTITY file: IDENTITY 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi017/store.db dir, Total Num: 1, files: 000008.sst 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi017/store.db: 000009.log size: 98967 ; 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.error_if_exists: 0 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.create_if_missing: 0 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.paranoid_checks: 1 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-19T00:46:34.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.env: 0x55ec6ea87bc0 2024-08-19T00:46:34.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.fs: PosixFileSystem 2024-08-19T00:46:34.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.info_log: 0x55ec707c0dc0 2024-08-19T00:46:34.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_file_opening_threads: 16 2024-08-19T00:46:34.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.statistics: (nil) 2024-08-19T00:46:34.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.use_fsync: 0 2024-08-19T00:46:34.760 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_log_file_size: 0 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.keep_log_file_num: 1000 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.recycle_log_file_num: 0 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.allow_fallocate: 1 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.allow_mmap_reads: 0 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.allow_mmap_writes: 0 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.use_direct_reads: 0 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.create_missing_column_families: 0 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.db_log_dir: 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.wal_dir: 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-19T00:46:34.761 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.advise_random_on_open: 1 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.db_write_buffer_size: 0 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.write_buffer_manager: 0x55ec70790140 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.rate_limiter: (nil) 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-19T00:46:34.762 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.wal_recovery_mode: 2 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.enable_thread_tracking: 0 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.enable_pipelined_write: 0 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.unordered_write: 0 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.row_cache: None 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.wal_filter: None 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.allow_ingest_behind: 0 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.two_write_queues: 0 2024-08-19T00:46:34.763 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.manual_wal_flush: 0 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.wal_compression: 0 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.atomic_flush: 0 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.log_readahead_size: 0 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.best_efforts_recovery: 0 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.allow_data_in_errors: 0 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.db_host_id: __hostname__ 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-19T00:46:34.764 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_background_jobs: 2 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_background_compactions: -1 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_subcompactions: 1 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_total_wal_size: 0 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_open_files: -1 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bytes_per_sync: 0 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-19T00:46:34.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-19T00:46:34.766 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_readahead_size: 0 2024-08-19T00:46:34.766 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_background_flushes: -1 2024-08-19T00:46:34.766 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Compression algorithms supported: 2024-08-19T00:46:34.766 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: kZSTD supported: 0 2024-08-19T00:46:34.766 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: kXpressCompression supported: 0 2024-08-19T00:46:34.766 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: kBZip2Compression supported: 0 2024-08-19T00:46:34.766 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-19T00:46:34.766 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: kLZ4Compression supported: 1 2024-08-19T00:46:34.766 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: kZlibCompression supported: 1 2024-08-19T00:46:34.766 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: kLZ4HCCompression supported: 1 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: kSnappyCompression supported: 1 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi017/store.db/MANIFEST-000010 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.merge_operator: 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_filter: None 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_filter_factory: None 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.sst_partitioner_factory: None 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ec707c0a60) 2024-08-19T00:46:34.767 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: cache_index_and_filter_blocks: 1 2024-08-19T00:46:34.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-19T00:46:34.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-19T00:46:34.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: pin_top_level_index_and_filter: 1 2024-08-19T00:46:34.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_type: 0 2024-08-19T00:46:34.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: data_block_index_type: 0 2024-08-19T00:46:34.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_shortening: 1 2024-08-19T00:46:34.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-19T00:46:34.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: checksum: 4 2024-08-19T00:46:34.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: no_block_cache: 0 2024-08-19T00:46:34.768 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache: 0x55ec707b5350 2024-08-19T00:46:34.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_name: BinnedLRUCache 2024-08-19T00:46:34.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_options: 2024-08-19T00:46:34.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: capacity : 536870912 2024-08-19T00:46:34.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: num_shard_bits : 4 2024-08-19T00:46:34.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: strict_capacity_limit : 0 2024-08-19T00:46:34.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: high_pri_pool_ratio: 0.000 2024-08-19T00:46:34.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_compressed: (nil) 2024-08-19T00:46:34.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: persistent_cache: (nil) 2024-08-19T00:46:34.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_size: 4096 2024-08-19T00:46:34.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_size_deviation: 10 2024-08-19T00:46:34.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_restart_interval: 16 2024-08-19T00:46:34.770 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_block_restart_interval: 1 2024-08-19T00:46:34.770 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: metadata_block_size: 4096 2024-08-19T00:46:34.770 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: partition_filters: 0 2024-08-19T00:46:34.770 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: use_delta_encoding: 1 2024-08-19T00:46:34.770 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: filter_policy: bloomfilter 2024-08-19T00:46:34.770 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: whole_key_filtering: 1 2024-08-19T00:46:34.770 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: verify_compression: 0 2024-08-19T00:46:34.770 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: read_amp_bytes_per_bit: 0 2024-08-19T00:46:34.770 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: format_version: 5 2024-08-19T00:46:34.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: enable_index_compression: 1 2024-08-19T00:46:34.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_align: 0 2024-08-19T00:46:34.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: max_auto_readahead_size: 262144 2024-08-19T00:46:34.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: prepopulate_block_cache: 0 2024-08-19T00:46:34.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: initial_auto_readahead_size: 8192 2024-08-19T00:46:34.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: num_file_reads_for_auto_readahead: 2 2024-08-19T00:46:34.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.write_buffer_size: 33554432 2024-08-19T00:46:34.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_write_buffer_number: 2 2024-08-19T00:46:34.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compression: NoCompression 2024-08-19T00:46:34.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bottommost_compression: Disabled 2024-08-19T00:46:34.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.prefix_extractor: nullptr 2024-08-19T00:46:34.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-19T00:46:34.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.num_levels: 7 2024-08-19T00:46:34.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-19T00:46:34.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-19T00:46:34.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-19T00:46:34.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-19T00:46:34.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-19T00:46:34.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-19T00:46:34.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-19T00:46:34.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-19T00:46:34.772 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-19T00:46:34.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-19T00:46:34.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-19T00:46:34.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-19T00:46:34.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-19T00:46:34.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compression_opts.level: 32767 2024-08-19T00:46:34.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compression_opts.strategy: 0 2024-08-19T00:46:34.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-19T00:46:34.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-19T00:46:34.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-19T00:46:34.773 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compression_opts.enabled: false 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.target_file_size_base: 67108864 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-19T00:46:34.774 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.arena_block_size: 1048576 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.disable_auto_compactions: 0 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-19T00:46:34.775 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.table_properties_collectors: 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.inplace_update_support: 0 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.bloom_locality: 0 2024-08-19T00:46:34.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.max_successive_merges: 0 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.paranoid_file_checks: 0 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.force_consistency_checks: 1 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.report_bg_io_stats: 0 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.ttl: 2592000 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.enable_blob_files: false 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.min_blob_size: 0 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.blob_file_size: 268435456 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-19T00:46:34.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.blob_file_starting_level: 0 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi017/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f8d645fe-211f-41fd-90f2-c2226d7c2f21 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724028394583458, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724028394584975, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94213, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 316, "table_properties": {"data_size": 92219, "index_size": 276, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13701, "raw_average_key_size": 49, "raw_value_size": 84727, "raw_average_value_size": 308, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724028394, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f8d645fe-211f-41fd-90f2-c2226d7c2f21", "db_session_id": "BMAM2IBNNSTZ0Y32V88E", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724028394585102, "job": 1, "event": "recovery_finished"} 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi017/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-19T00:46:34.778 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ec707dee00 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: DB pointer 0x55ec708d2000 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** DB Stats ** 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:46:34.779 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** Compaction Stats [default] ** 2024-08-19T00:46:34.780 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-19T00:46:34.780 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-19T00:46:34.780 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: L0 2/0 93.88 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-19T00:46:34.780 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Sum 2/0 93.88 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-19T00:46:34.780 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-19T00:46:34.780 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:46:34.780 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** Compaction Stats [default] ** 2024-08-19T00:46:34.781 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-19T00:46:34.781 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-19T00:46:34.781 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 96.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-19T00:46:34.781 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:46:34.781 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-19T00:46:34.781 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:46:34.781 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-19T00:46:34.781 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-19T00:46:34.781 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-19T00:46:34.781 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-19T00:46:34.782 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-19T00:46:34.782 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-19T00:46:34.782 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative compaction: 0.00 GB write, 19.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-19T00:46:34.782 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval compaction: 0.00 GB write, 19.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-19T00:46:34.782 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-19T00:46:34.782 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Block cache BinnedLRUCache@0x55ec707b5350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2024-08-19T00:46:34.782 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-08-19T00:46:34.782 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:46:34.782 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-19T00:46:34.782 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: starting mon.smithi017 rank 0 at public addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] at bind addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi017 fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: mon.smithi017@-1(???) e1 preinit fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: mon.smithi017@-1(???).mds e1 new map 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: mon.smithi017@-1(???).mds e1 print_map 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: e1 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: legacy client fscid: -1 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: No filesystems configured 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: mon.smithi017@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: mon.smithi017@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: mon.smithi017@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: mon.smithi017@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-19T00:46:34.783 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: mon.smithi017@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-19T00:46:34.784 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 bash[16608]: 771bc6b905a5d69765e968377e6695a275b67261a0a28e56a5c57d357f6a4f90 2024-08-19T00:46:34.784 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 systemd[1]: Started Ceph mon.smithi017 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T00:46:34.784 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: mon.smithi017 is new leader, mons smithi017 in quorum (ranks 0) 2024-08-19T00:46:34.784 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: monmap e1: 1 mons at {smithi017=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-08-19T00:46:34.784 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: fsmap 2024-08-19T00:46:34.784 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: osdmap e1: 0 total, 0 up, 0 in 2024-08-19T00:46:34.784 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:34 smithi017 ceph-mon[16627]: mgrmap e1: no daemons active 2024-08-19T00:46:35.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.072+0000 7fe09da13640 1 Processor -- start 2024-08-19T00:46:35.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.072+0000 7fe09da13640 1 -- start start 2024-08-19T00:46:35.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.072+0000 7fe09da13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09807a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.072+0000 7fe09da13640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09807a8c0 con 0x7fe09807be90 2024-08-19T00:46:35.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.072+0000 7fe096ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09807a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.072+0000 7fe096ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09807a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56834/0 (socket says 172.21.15.17:56834) 2024-08-19T00:46:35.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.072+0000 7fe096ffd640 1 -- 172.21.15.17:0/3490512011 learned_addr learned my addr 172.21.15.17:0/3490512011 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:35.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.073+0000 7fe096ffd640 1 -- 172.21.15.17:0/3490512011 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09807aa00 con 0x7fe09807be90 2024-08-19T00:46:35.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.075+0000 7fe096ffd640 1 --2- 172.21.15.17:0/3490512011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09807a2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe088009820 tx=0x7fe08802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ff0cf1fd5d657f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.720 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.075+0000 7fe095ffb640 1 -- 172.21.15.17:0/3490512011 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe08802ad40 con 0x7fe09807be90 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.075+0000 7fe095ffb640 1 -- 172.21.15.17:0/3490512011 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe0880328c0 con 0x7fe09807be90 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.075+0000 7fe095ffb640 1 -- 172.21.15.17:0/3490512011 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0880307f0 con 0x7fe09807be90 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.075+0000 7fe09da13640 1 -- 172.21.15.17:0/3490512011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 msgr2=0x7fe09807a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.075+0000 7fe09da13640 1 --2- 172.21.15.17:0/3490512011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09807a2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe088009820 tx=0x7fe08802a270 comp rx=0 tx=0).stop 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.076+0000 7fe09da13640 1 -- 172.21.15.17:0/3490512011 shutdown_connections 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.076+0000 7fe09da13640 1 --2- 172.21.15.17:0/3490512011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09807a2f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.076+0000 7fe09da13640 1 -- 172.21.15.17:0/3490512011 >> 172.21.15.17:0/3490512011 conn(0x7fe098100d70 msgr2=0x7fe098103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.076+0000 7fe09da13640 1 -- 172.21.15.17:0/3490512011 shutdown_connections 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.076+0000 7fe09da13640 1 -- 172.21.15.17:0/3490512011 wait complete. 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.076+0000 7fe09da13640 1 Processor -- start 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.076+0000 7fe09da13640 1 -- start start 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe09da13640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09819b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:35.721 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe09da13640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09819ba00 con 0x7fe09807be90 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe096ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09819b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe096ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09819b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56850/0 (socket says 172.21.15.17:56850) 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe096ffd640 1 -- 172.21.15.17:0/3275115631 learned_addr learned my addr 172.21.15.17:0/3275115631 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe096ffd640 1 -- 172.21.15.17:0/3275115631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0880094d0 con 0x7fe09807be90 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe096ffd640 1 --2- 172.21.15.17:0/3275115631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09819b4c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe088030d30 tx=0x7fe088030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe09ca11640 1 -- 172.21.15.17:0/3275115631 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe088032c40 con 0x7fe09807be90 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe09ca11640 1 -- 172.21.15.17:0/3275115631 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe088032da0 con 0x7fe09807be90 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe09da13640 1 -- 172.21.15.17:0/3275115631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09819bc00 con 0x7fe09807be90 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe09ca11640 1 -- 172.21.15.17:0/3275115631 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe08803c660 con 0x7fe09807be90 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.077+0000 7fe09da13640 1 -- 172.21.15.17:0/3275115631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09819c020 con 0x7fe09807be90 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.078+0000 7fe09ca11640 1 -- 172.21.15.17:0/3275115631 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fe08803cbd0 con 0x7fe09807be90 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.078+0000 7fe09ca11640 1 -- 172.21.15.17:0/3275115631 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe0880463c0 con 0x7fe09807be90 2024-08-19T00:46:35.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.078+0000 7fe09da13640 1 -- 172.21.15.17:0/3275115631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09810b920 con 0x7fe09807be90 2024-08-19T00:46:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.081+0000 7fe09ca11640 1 -- 172.21.15.17:0/3275115631 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fe088037070 con 0x7fe09807be90 2024-08-19T00:46:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.139+0000 7fe09da13640 1 -- 172.21.15.17:0/3275115631 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fe09819e980 con 0x7fe09807be90 2024-08-19T00:46:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.141+0000 7fe09ca11640 1 -- 172.21.15.17:0/3275115631 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe09819e980 con 0x7fe09807be90 2024-08-19T00:46:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.142+0000 7fe09da13640 1 -- 172.21.15.17:0/3275115631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 msgr2=0x7fe09819b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.142+0000 7fe09da13640 1 --2- 172.21.15.17:0/3275115631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09819b4c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe088030d30 tx=0x7fe088030d60 comp rx=0 tx=0).stop 2024-08-19T00:46:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.142+0000 7fe09da13640 1 -- 172.21.15.17:0/3275115631 shutdown_connections 2024-08-19T00:46:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.142+0000 7fe09da13640 1 --2- 172.21.15.17:0/3275115631 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe09807be90 0x7fe09819b4c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.142+0000 7fe09da13640 1 -- 172.21.15.17:0/3275115631 >> 172.21.15.17:0/3275115631 conn(0x7fe098100d70 msgr2=0x7fe098101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.142+0000 7fe09da13640 1 -- 172.21.15.17:0/3275115631 shutdown_connections 2024-08-19T00:46:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:35.142+0000 7fe09da13640 1 -- 172.21.15.17:0/3275115631 wait complete. 2024-08-19T00:46:35.723 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-19T00:46:35.745 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:46:35.745 INFO:teuthology.orchestra.run.smithi017.stdout:Creating mgr... 2024-08-19T00:46:35.746 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-19T00:46:35.746 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-19T00:46:35.746 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying port 0.0.0.0:8443 ... 2024-08-19T00:46:36.000 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mgr.smithi017.hfpawi 2024-08-19T00:46:36.000 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Failed to reset failed state of unit ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mgr.smithi017.hfpawi.service: Unit ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mgr.smithi017.hfpawi.service not loaded. 2024-08-19T00:46:36.143 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968.target.wants/ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mgr.smithi017.hfpawi.service → /etc/systemd/system/ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@.service. 2024-08-19T00:46:36.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:36 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3275115631' entity='client.admin' 2024-08-19T00:46:36.655 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-19T00:46:36.655 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-08-19T00:46:36.663 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-19T00:46:36.663 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-08-19T00:46:36.663 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-08-19T00:46:36.663 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to enable service . firewalld.service is not available 2024-08-19T00:46:36.671 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-19T00:46:36.671 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-08-19T00:46:36.679 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-19T00:46:36.679 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-08-19T00:46:36.679 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-08-19T00:46:36.679 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-08-19T00:46:36.679 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr to start... 2024-08-19T00:46:36.679 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr... 2024-08-19T00:46:37.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:37 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3417478523' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-19T00:46:37.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:37.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:46:37.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "61e0bb80-5dc4-11ef-bccf-c7b262605968", 2024-08-19T00:46:37.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-08-19T00:46:37.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-19T00:46:37.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-19T00:46:37.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-19T00:46:37.694 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "smithi017" 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:37.695 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-19T00:46:37.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:37.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-19T00:46:37.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-19T00:46:37.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-19T00:46:37.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-19T00:46:37.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-19T00:46:37.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-19T00:46:37.703 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:37.704 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:37.705 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-19T00:46:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-08-19T00:46:30.076008+0000", 2024-08-19T00:46:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:46:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-19T00:46:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:46:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.105+0000 7f520f860640 1 Processor -- start 2024-08-19T00:46:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.105+0000 7f520f860640 1 -- start start 2024-08-19T00:46:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.105+0000 7f520f860640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f52081048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.706 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.105+0000 7f520f860640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5208104eb0 con 0x7f52081044e0 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.106+0000 7f520d5fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f52081048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.106+0000 7f520d5fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f52081048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58216/0 (socket says 172.21.15.17:58216) 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.106+0000 7f520d5fc640 1 -- 172.21.15.17:0/1877351160 learned_addr learned my addr 172.21.15.17:0/1877351160 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.106+0000 7f520d5fc640 1 -- 172.21.15.17:0/1877351160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52081056e0 con 0x7f52081044e0 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.107+0000 7f520d5fc640 1 --2- 172.21.15.17:0/1877351160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f52081048e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009820 tx=0x7f51f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85165628e6c13f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.107+0000 7f51fffff640 1 -- 172.21.15.17:0/1877351160 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51f802ad40 con 0x7f52081044e0 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.107+0000 7f51fffff640 1 -- 172.21.15.17:0/1877351160 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f51f80328c0 con 0x7f52081044e0 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.107+0000 7f51fffff640 1 -- 172.21.15.17:0/1877351160 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51f80307f0 con 0x7f52081044e0 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.108+0000 7f520f860640 1 -- 172.21.15.17:0/1877351160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 msgr2=0x7f52081048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.108+0000 7f520f860640 1 --2- 172.21.15.17:0/1877351160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f52081048e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009820 tx=0x7f51f802a270 comp rx=0 tx=0).stop 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.108+0000 7f520f860640 1 -- 172.21.15.17:0/1877351160 shutdown_connections 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.108+0000 7f520f860640 1 --2- 172.21.15.17:0/1877351160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f52081048e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.108+0000 7f520f860640 1 -- 172.21.15.17:0/1877351160 >> 172.21.15.17:0/1877351160 conn(0x7f52080ffc50 msgr2=0x7f52081020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:37.707 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.108+0000 7f520f860640 1 -- 172.21.15.17:0/1877351160 shutdown_connections 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.108+0000 7f520f860640 1 -- 172.21.15.17:0/1877351160 wait complete. 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.109+0000 7f520f860640 1 Processor -- start 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.109+0000 7f520f860640 1 -- start start 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.109+0000 7f520f860640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f5208199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.109+0000 7f520f860640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52081998a0 con 0x7f52081044e0 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.109+0000 7f520d5fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f5208199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.109+0000 7f520d5fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f5208199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58224/0 (socket says 172.21.15.17:58224) 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.109+0000 7f520d5fc640 1 -- 172.21.15.17:0/3417478523 learned_addr learned my addr 172.21.15.17:0/3417478523 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.109+0000 7f520d5fc640 1 -- 172.21.15.17:0/3417478523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f80094d0 con 0x7f52081044e0 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.109+0000 7f520d5fc640 1 --2- 172.21.15.17:0/3417478523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f5208199360 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f51f8030d30 tx=0x7f51f8030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.110+0000 7f51fe7fc640 1 -- 172.21.15.17:0/3417478523 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51f8032c40 con 0x7f52081044e0 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.110+0000 7f51fe7fc640 1 -- 172.21.15.17:0/3417478523 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f51f8032da0 con 0x7f52081044e0 2024-08-19T00:46:37.708 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.110+0000 7f520f860640 1 -- 172.21.15.17:0/3417478523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5208199aa0 con 0x7f52081044e0 2024-08-19T00:46:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.110+0000 7f51fe7fc640 1 -- 172.21.15.17:0/3417478523 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51f803c570 con 0x7f52081044e0 2024-08-19T00:46:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.110+0000 7f520f860640 1 -- 172.21.15.17:0/3417478523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5208199ec0 con 0x7f52081044e0 2024-08-19T00:46:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.110+0000 7f51fe7fc640 1 -- 172.21.15.17:0/3417478523 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f51f803cae0 con 0x7f52081044e0 2024-08-19T00:46:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.110+0000 7f51fe7fc640 1 -- 172.21.15.17:0/3417478523 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f51f8047e00 con 0x7f52081044e0 2024-08-19T00:46:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.111+0000 7f520f860640 1 -- 172.21.15.17:0/3417478523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52081048e0 con 0x7f52081044e0 2024-08-19T00:46:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.113+0000 7f51fe7fc640 1 -- 172.21.15.17:0/3417478523 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f51f8037070 con 0x7f52081044e0 2024-08-19T00:46:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.174+0000 7f520f860640 1 -- 172.21.15.17:0/3417478523 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5208193530 con 0x7f52081044e0 2024-08-19T00:46:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.174+0000 7f51fe7fc640 1 -- 172.21.15.17:0/3417478523 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f51f803da90 con 0x7f52081044e0 2024-08-19T00:46:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.175+0000 7f520f860640 1 -- 172.21.15.17:0/3417478523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 msgr2=0x7f5208199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:37.709 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.175+0000 7f520f860640 1 --2- 172.21.15.17:0/3417478523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f5208199360 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f51f8030d30 tx=0x7f51f8030d60 comp rx=0 tx=0).stop 2024-08-19T00:46:37.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.175+0000 7f520f860640 1 -- 172.21.15.17:0/3417478523 shutdown_connections 2024-08-19T00:46:37.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.176+0000 7f520f860640 1 --2- 172.21.15.17:0/3417478523 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52081044e0 0x7f5208199360 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:37.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.176+0000 7f520f860640 1 -- 172.21.15.17:0/3417478523 >> 172.21.15.17:0/3417478523 conn(0x7f52080ffc50 msgr2=0x7f5208100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:37.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.176+0000 7f520f860640 1 -- 172.21.15.17:0/3417478523 shutdown_connections 2024-08-19T00:46:37.710 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:37.176+0000 7f520f860640 1 -- 172.21.15.17:0/3417478523 wait complete. 2024-08-19T00:46:37.710 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (1/15)... 2024-08-19T00:46:40.337 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:40 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/424098916' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-19T00:46:40.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:40.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:46:40.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "61e0bb80-5dc4-11ef-bccf-c7b262605968", 2024-08-19T00:46:40.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-08-19T00:46:40.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-19T00:46:40.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-19T00:46:40.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "smithi017" 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-19T00:46:40.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:40.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-19T00:46:40.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:40.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-19T00:46:40.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-19T00:46:40.719 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-19T00:46:40.727 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-19T00:46:40.728 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-08-19T00:46:30.076008+0000", 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.082+0000 7f843f426640 1 Processor -- start 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.082+0000 7f843f426640 1 -- start start 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.082+0000 7f843f426640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f84381042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.729 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.082+0000 7f843f426640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8438079e00 con 0x7f8438103ee0 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.082+0000 7f843d1c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f84381042e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.082+0000 7f843d1c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f84381042e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58238/0 (socket says 172.21.15.17:58238) 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.082+0000 7f843d1c2640 1 -- 172.21.15.17:0/4055886075 learned_addr learned my addr 172.21.15.17:0/4055886075 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.083+0000 7f843d1c2640 1 -- 172.21.15.17:0/4055886075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8438079f40 con 0x7f8438103ee0 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.083+0000 7f843d1c2640 1 --2- 172.21.15.17:0/4055886075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f84381042e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8434009820 tx=0x7f843402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802be80c0471867c server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.084+0000 7f842ffff640 1 -- 172.21.15.17:0/4055886075 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f843402ad40 con 0x7f8438103ee0 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.084+0000 7f842ffff640 1 -- 172.21.15.17:0/4055886075 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f84340328c0 con 0x7f8438103ee0 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.084+0000 7f842ffff640 1 -- 172.21.15.17:0/4055886075 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f84340307f0 con 0x7f8438103ee0 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.084+0000 7f843f426640 1 -- 172.21.15.17:0/4055886075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 msgr2=0x7f84381042e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.084+0000 7f843f426640 1 --2- 172.21.15.17:0/4055886075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f84381042e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8434009820 tx=0x7f843402a270 comp rx=0 tx=0).stop 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.084+0000 7f843f426640 1 -- 172.21.15.17:0/4055886075 shutdown_connections 2024-08-19T00:46:40.730 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.084+0000 7f843f426640 1 --2- 172.21.15.17:0/4055886075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f84381042e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.084+0000 7f843f426640 1 -- 172.21.15.17:0/4055886075 >> 172.21.15.17:0/4055886075 conn(0x7f84380ffc50 msgr2=0x7f84381020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.084+0000 7f843f426640 1 -- 172.21.15.17:0/4055886075 shutdown_connections 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.084+0000 7f843f426640 1 -- 172.21.15.17:0/4055886075 wait complete. 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.085+0000 7f843f426640 1 Processor -- start 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.085+0000 7f843f426640 1 -- start start 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.085+0000 7f843f426640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f843819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.085+0000 7f843f426640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843819b9d0 con 0x7f8438103ee0 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.085+0000 7f843d1c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f843819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.085+0000 7f843d1c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f843819b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58250/0 (socket says 172.21.15.17:58250) 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.085+0000 7f843d1c2640 1 -- 172.21.15.17:0/424098916 learned_addr learned my addr 172.21.15.17:0/424098916 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.085+0000 7f843d1c2640 1 -- 172.21.15.17:0/424098916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84340094d0 con 0x7f8438103ee0 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.086+0000 7f843d1c2640 1 --2- 172.21.15.17:0/424098916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f843819b490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8434009940 tx=0x7f8434032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.086+0000 7f842e7fc640 1 -- 172.21.15.17:0/424098916 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8434041070 con 0x7f8438103ee0 2024-08-19T00:46:40.731 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.086+0000 7f842e7fc640 1 -- 172.21.15.17:0/424098916 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f8434030cc0 con 0x7f8438103ee0 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.086+0000 7f842e7fc640 1 -- 172.21.15.17:0/424098916 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f843403c620 con 0x7f8438103ee0 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.086+0000 7f843f426640 1 -- 172.21.15.17:0/424098916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843819bbd0 con 0x7f8438103ee0 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.086+0000 7f843f426640 1 -- 172.21.15.17:0/424098916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843819bff0 con 0x7f8438103ee0 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.086+0000 7f842e7fc640 1 -- 172.21.15.17:0/424098916 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f843403ca80 con 0x7f8438103ee0 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.086+0000 7f842e7fc640 1 -- 172.21.15.17:0/424098916 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8434046db0 con 0x7f8438103ee0 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.087+0000 7f843f426640 1 -- 172.21.15.17:0/424098916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84381054e0 con 0x7f8438103ee0 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.089+0000 7f842e7fc640 1 -- 172.21.15.17:0/424098916 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f8434037070 con 0x7f8438103ee0 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.150+0000 7f843f426640 1 -- 172.21.15.17:0/424098916 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8438194b30 con 0x7f8438103ee0 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.150+0000 7f842e7fc640 1 -- 172.21.15.17:0/424098916 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f8434030e30 con 0x7f8438103ee0 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.151+0000 7f843f426640 1 -- 172.21.15.17:0/424098916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 msgr2=0x7f843819b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.151+0000 7f843f426640 1 --2- 172.21.15.17:0/424098916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f843819b490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8434009940 tx=0x7f8434032c60 comp rx=0 tx=0).stop 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.151+0000 7f843f426640 1 -- 172.21.15.17:0/424098916 shutdown_connections 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.151+0000 7f843f426640 1 --2- 172.21.15.17:0/424098916 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8438103ee0 0x7f843819b490 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:40.732 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.151+0000 7f843f426640 1 -- 172.21.15.17:0/424098916 >> 172.21.15.17:0/424098916 conn(0x7f84380ffc50 msgr2=0x7f843818fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:40.733 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.151+0000 7f843f426640 1 -- 172.21.15.17:0/424098916 shutdown_connections 2024-08-19T00:46:40.733 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:40.151+0000 7f843f426640 1 -- 172.21.15.17:0/424098916 wait complete. 2024-08-19T00:46:40.733 INFO:teuthology.orchestra.run.smithi017.stdout:mgr not available, waiting (2/15)... 2024-08-19T00:46:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: Activating manager daemon smithi017.hfpawi 2024-08-19T00:46:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: mgrmap e2: smithi017.hfpawi(active, starting, since 0.00279843s) 2024-08-19T00:46:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: from='mgr.14100 172.21.15.17:0/1372578756' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:46:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: from='mgr.14100 172.21.15.17:0/1372578756' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:46:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: from='mgr.14100 172.21.15.17:0/1372578756' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:46:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: from='mgr.14100 172.21.15.17:0/1372578756' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:46:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: from='mgr.14100 172.21.15.17:0/1372578756' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi017.hfpawi", "id": "smithi017.hfpawi"}]: dispatch 2024-08-19T00:46:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: Manager daemon smithi017.hfpawi is now available 2024-08-19T00:46:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: from='mgr.14100 172.21.15.17:0/1372578756' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:46:41.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: from='mgr.14100 172.21.15.17:0/1372578756' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/trash_purge_schedule"}]: dispatch 2024-08-19T00:46:41.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: from='mgr.14100 172.21.15.17:0/1372578756' entity='mgr.smithi017.hfpawi' 2024-08-19T00:46:41.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: from='mgr.14100 172.21.15.17:0/1372578756' entity='mgr.smithi017.hfpawi' 2024-08-19T00:46:41.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:41 smithi017 ceph-mon[16627]: from='mgr.14100 172.21.15.17:0/1372578756' entity='mgr.smithi017.hfpawi' 2024-08-19T00:46:43.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:43 smithi017 ceph-mon[16627]: mgrmap e3: smithi017.hfpawi(active, since 1.00698s) 2024-08-19T00:46:43.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:43 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3836731341' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-19T00:46:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:44 smithi017 ceph-mon[16627]: mgrmap e4: smithi017.hfpawi(active, since 2s) 2024-08-19T00:46:49.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:49.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:46:49.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsid": "61e0bb80-5dc4-11ef-bccf-c7b262605968", 2024-08-19T00:46:49.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "health": { 2024-08-19T00:46:49.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-19T00:46:49.124 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-19T00:46:49.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-19T00:46:49.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:49.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-19T00:46:49.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-19T00:46:49.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 0 2024-08-19T00:46:49.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:46:49.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-19T00:46:49.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "smithi017" 2024-08-19T00:46:49.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:46:49.125 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-19T00:46:49.126 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:49.127 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "restful" 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ], 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:49.128 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "modified": "2024-08-19T00:46:30.076008+0000", 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout }, 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.122+0000 7ff18ef8c640 1 Processor -- start 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.122+0000 7ff18ef8c640 1 -- start start 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.123+0000 7ff18ef8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff1881048e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.123+0000 7ff18ef8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff188104eb0 con 0x7ff1881044e0 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.123+0000 7ff18cd28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff1881048e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.123+0000 7ff18cd28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff1881048e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58334/0 (socket says 172.21.15.17:58334) 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.123+0000 7ff18cd28640 1 -- 172.21.15.17:0/810241308 learned_addr learned my addr 172.21.15.17:0/810241308 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:49.129 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.123+0000 7ff18cd28640 1 -- 172.21.15.17:0/810241308 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1881056e0 con 0x7ff1881044e0 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.124+0000 7ff18cd28640 1 --2- 172.21.15.17:0/810241308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff1881048e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009820 tx=0x7ff17c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d7bfc9978529e server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.124+0000 7ff1877fe640 1 -- 172.21.15.17:0/810241308 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff17c02ad40 con 0x7ff1881044e0 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.124+0000 7ff1877fe640 1 -- 172.21.15.17:0/810241308 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ff17c0328c0 con 0x7ff1881044e0 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.124+0000 7ff1877fe640 1 -- 172.21.15.17:0/810241308 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff17c0307f0 con 0x7ff1881044e0 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.125+0000 7ff18ef8c640 1 -- 172.21.15.17:0/810241308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 msgr2=0x7ff1881048e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.125+0000 7ff18ef8c640 1 --2- 172.21.15.17:0/810241308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff1881048e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009820 tx=0x7ff17c02a270 comp rx=0 tx=0).stop 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.125+0000 7ff18ef8c640 1 -- 172.21.15.17:0/810241308 shutdown_connections 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.125+0000 7ff18ef8c640 1 --2- 172.21.15.17:0/810241308 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff1881048e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.125+0000 7ff18ef8c640 1 -- 172.21.15.17:0/810241308 >> 172.21.15.17:0/810241308 conn(0x7ff1880ffc50 msgr2=0x7ff1881020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.125+0000 7ff18ef8c640 1 -- 172.21.15.17:0/810241308 shutdown_connections 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.125+0000 7ff18ef8c640 1 -- 172.21.15.17:0/810241308 wait complete. 2024-08-19T00:46:49.130 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.125+0000 7ff18ef8c640 1 Processor -- start 2024-08-19T00:46:49.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.126+0000 7ff18ef8c640 1 -- start start 2024-08-19T00:46:49.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.126+0000 7ff18ef8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff18818f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.126+0000 7ff18ef8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18818fb80 con 0x7ff1881044e0 2024-08-19T00:46:49.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.126+0000 7ff18cd28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff18818f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.126+0000 7ff18cd28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff18818f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58346/0 (socket says 172.21.15.17:58346) 2024-08-19T00:46:49.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.126+0000 7ff18cd28640 1 -- 172.21.15.17:0/3836731341 learned_addr learned my addr 172.21.15.17:0/3836731341 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:49.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.126+0000 7ff18cd28640 1 -- 172.21.15.17:0/3836731341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c0094d0 con 0x7ff1881044e0 2024-08-19T00:46:49.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.126+0000 7ff18cd28640 1 --2- 172.21.15.17:0/3836731341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff18818f640 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff17c030d30 tx=0x7ff17c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:49.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.127+0000 7ff185ffb640 1 -- 172.21.15.17:0/3836731341 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff17c032c40 con 0x7ff1881044e0 2024-08-19T00:46:49.131 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.127+0000 7ff185ffb640 1 -- 172.21.15.17:0/3836731341 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ff17c032da0 con 0x7ff1881044e0 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.127+0000 7ff18ef8c640 1 -- 172.21.15.17:0/3836731341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18818ddc0 con 0x7ff1881044e0 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.127+0000 7ff185ffb640 1 -- 172.21.15.17:0/3836731341 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff17c03c570 con 0x7ff1881044e0 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.127+0000 7ff18ef8c640 1 -- 172.21.15.17:0/3836731341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18818e1e0 con 0x7ff1881044e0 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.128+0000 7ff185ffb640 1 -- 172.21.15.17:0/3836731341 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 3) v1 ==== 45439+0+0 (secure 0 0 0) 0x7ff17c03c7e0 con 0x7ff1881044e0 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.128+0000 7ff185ffb640 1 --2- 172.21.15.17:0/3836731341 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff178038530 0x7ff17803a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.128+0000 7ff185ffb640 1 -- 172.21.15.17:0/3836731341 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff17c06b750 con 0x7ff1881044e0 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.128+0000 7ff187fff640 1 --2- 172.21.15.17:0/3836731341 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff178038530 0x7ff17803a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.128+0000 7ff18ef8c640 1 -- 172.21.15.17:0/3836731341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1881048e0 con 0x7ff1881044e0 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.129+0000 7ff187fff640 1 --2- 172.21.15.17:0/3836731341 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff178038530 0x7ff17803a9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff1740098c0 tx=0x7ff174006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.133+0000 7ff185ffb640 1 -- 172.21.15.17:0/3836731341 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff17c047460 con 0x7ff1881044e0 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.370+0000 7ff18ef8c640 1 -- 172.21.15.17:0/3836731341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff188193040 con 0x7ff1881044e0 2024-08-19T00:46:49.132 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.370+0000 7ff185ffb640 1 -- 172.21.15.17:0/3836731341 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1245 (secure 0 0 0) 0x7ff17c03b340 con 0x7ff1881044e0 2024-08-19T00:46:49.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.372+0000 7ff18ef8c640 1 -- 172.21.15.17:0/3836731341 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff178038530 msgr2=0x7ff17803a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.372+0000 7ff18ef8c640 1 --2- 172.21.15.17:0/3836731341 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff178038530 0x7ff17803a9f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff1740098c0 tx=0x7ff174006db0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.372+0000 7ff18ef8c640 1 -- 172.21.15.17:0/3836731341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 msgr2=0x7ff18818f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:49.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.372+0000 7ff18ef8c640 1 --2- 172.21.15.17:0/3836731341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff18818f640 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff17c030d30 tx=0x7ff17c030d60 comp rx=0 tx=0).stop 2024-08-19T00:46:49.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.372+0000 7ff18ef8c640 1 -- 172.21.15.17:0/3836731341 shutdown_connections 2024-08-19T00:46:49.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.372+0000 7ff18ef8c640 1 --2- 172.21.15.17:0/3836731341 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff178038530 0x7ff17803a9f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.372+0000 7ff18ef8c640 1 --2- 172.21.15.17:0/3836731341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff1881044e0 0x7ff18818f640 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:49.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.372+0000 7ff18ef8c640 1 -- 172.21.15.17:0/3836731341 >> 172.21.15.17:0/3836731341 conn(0x7ff1880ffc50 msgr2=0x7ff188100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:49.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.372+0000 7ff18ef8c640 1 -- 172.21.15.17:0/3836731341 shutdown_connections 2024-08-19T00:46:49.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:43.372+0000 7ff18ef8c640 1 -- 172.21.15.17:0/3836731341 wait complete. 2024-08-19T00:46:49.133 INFO:teuthology.orchestra.run.smithi017.stdout:mgr is available 2024-08-19T00:46:52.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:52 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/616749568' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-19T00:46:53.841 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:53.841 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [global] 2024-08-19T00:46:53.841 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout fsid = 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:46:53.842 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-19T00:46:53.842 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-19T00:46:53.842 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-19T00:46:53.842 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-19T00:46:53.842 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:53.842 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-19T00:46:53.842 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout [osd] 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.970+0000 7fe5b1e57640 1 Processor -- start 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.970+0000 7fe5b1e57640 1 -- start start 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.970+0000 7fe5b1e57640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.970+0000 7fe5b1e57640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac105fa0 con 0x7fe5ac1055d0 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.970+0000 7fe5ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.970+0000 7fe5ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45194/0 (socket says 172.21.15.17:45194) 2024-08-19T00:46:53.843 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.970+0000 7fe5ab7fe640 1 -- 172.21.15.17:0/3777531404 learned_addr learned my addr 172.21.15.17:0/3777531404 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.971+0000 7fe5ab7fe640 1 -- 172.21.15.17:0/3777531404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac1067d0 con 0x7fe5ac1055d0 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.971+0000 7fe5ab7fe640 1 --2- 172.21.15.17:0/3777531404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1059d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009820 tx=0x7fe59c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba04fe0c5390118 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.972+0000 7fe5aa7fc640 1 -- 172.21.15.17:0/3777531404 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe59c02ad40 con 0x7fe5ac1055d0 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.972+0000 7fe5aa7fc640 1 -- 172.21.15.17:0/3777531404 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe59c0328c0 con 0x7fe5ac1055d0 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.972+0000 7fe5aa7fc640 1 -- 172.21.15.17:0/3777531404 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe59c0307f0 con 0x7fe5ac1055d0 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.972+0000 7fe5b1e57640 1 -- 172.21.15.17:0/3777531404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 msgr2=0x7fe5ac1059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.972+0000 7fe5b1e57640 1 --2- 172.21.15.17:0/3777531404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1059d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009820 tx=0x7fe59c02a270 comp rx=0 tx=0).stop 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.972+0000 7fe5b1e57640 1 -- 172.21.15.17:0/3777531404 shutdown_connections 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.972+0000 7fe5b1e57640 1 --2- 172.21.15.17:0/3777531404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1059d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.972+0000 7fe5b1e57640 1 -- 172.21.15.17:0/3777531404 >> 172.21.15.17:0/3777531404 conn(0x7fe5ac100d80 msgr2=0x7fe5ac1031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.972+0000 7fe5b1e57640 1 -- 172.21.15.17:0/3777531404 shutdown_connections 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.972+0000 7fe5b1e57640 1 -- 172.21.15.17:0/3777531404 wait complete. 2024-08-19T00:46:53.844 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.973+0000 7fe5b1e57640 1 Processor -- start 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.973+0000 7fe5b1e57640 1 -- start start 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.973+0000 7fe5b1e57640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.973+0000 7fe5b1e57640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac199820 con 0x7fe5ac1055d0 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.973+0000 7fe5ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.973+0000 7fe5ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45206/0 (socket says 172.21.15.17:45206) 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.973+0000 7fe5ab7fe640 1 -- 172.21.15.17:0/616749568 learned_addr learned my addr 172.21.15.17:0/616749568 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.974+0000 7fe5ab7fe640 1 -- 172.21.15.17:0/616749568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c0094d0 con 0x7fe5ac1055d0 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.974+0000 7fe5ab7fe640 1 --2- 172.21.15.17:0/616749568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1992e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe59c030d30 tx=0x7fe59c030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.974+0000 7fe5a8ff9640 1 -- 172.21.15.17:0/616749568 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe59c032c40 con 0x7fe5ac1055d0 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.974+0000 7fe5a8ff9640 1 -- 172.21.15.17:0/616749568 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fe59c032da0 con 0x7fe5ac1055d0 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.974+0000 7fe5b1e57640 1 -- 172.21.15.17:0/616749568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac199a20 con 0x7fe5ac1055d0 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.974+0000 7fe5a8ff9640 1 -- 172.21.15.17:0/616749568 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe59c03c570 con 0x7fe5ac1055d0 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.974+0000 7fe5b1e57640 1 -- 172.21.15.17:0/616749568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac199e40 con 0x7fe5ac1055d0 2024-08-19T00:46:53.845 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.975+0000 7fe5a8ff9640 1 -- 172.21.15.17:0/616749568 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7fe59c03d480 con 0x7fe5ac1055d0 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.975+0000 7fe5a8ff9640 1 --2- 172.21.15.17:0/616749568 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7fe594038650 0x7fe59403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.975+0000 7fe5a8ff9640 1 -- 172.21.15.17:0/616749568 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe59c06b910 con 0x7fe5ac1055d0 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.975+0000 7fe5b1e57640 1 -- 172.21.15.17:0/616749568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ac1059d0 con 0x7fe5ac1055d0 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.975+0000 7fe5aaffd640 1 --2- 172.21.15.17:0/616749568 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7fe594038650 0x7fe59403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.976+0000 7fe5aaffd640 1 --2- 172.21.15.17:0/616749568 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7fe594038650 0x7fe59403ab10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00098c0 tx=0x7fe5a0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:51.980+0000 7fe5a8ff9640 1 -- 172.21.15.17:0/616749568 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe59c03c7e0 con 0x7fe5ac1055d0 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.152+0000 7fe5b1e57640 1 -- 172.21.15.17:0/616749568 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe5ac19c7a0 con 0x7fe5ac1055d0 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.153+0000 7fe5a8ff9640 1 -- 172.21.15.17:0/616749568 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fe59c06a020 con 0x7fe5ac1055d0 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.156+0000 7fe5b1e57640 1 -- 172.21.15.17:0/616749568 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7fe594038650 msgr2=0x7fe59403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.156+0000 7fe5b1e57640 1 --2- 172.21.15.17:0/616749568 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7fe594038650 0x7fe59403ab10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00098c0 tx=0x7fe5a0006db0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.156+0000 7fe5b1e57640 1 -- 172.21.15.17:0/616749568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 msgr2=0x7fe5ac1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.156+0000 7fe5b1e57640 1 --2- 172.21.15.17:0/616749568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1992e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe59c030d30 tx=0x7fe59c030d60 comp rx=0 tx=0).stop 2024-08-19T00:46:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.156+0000 7fe5b1e57640 1 -- 172.21.15.17:0/616749568 shutdown_connections 2024-08-19T00:46:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.156+0000 7fe5b1e57640 1 --2- 172.21.15.17:0/616749568 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7fe594038650 0x7fe59403ab10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.156+0000 7fe5b1e57640 1 --2- 172.21.15.17:0/616749568 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5ac1055d0 0x7fe5ac1992e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.156+0000 7fe5b1e57640 1 -- 172.21.15.17:0/616749568 >> 172.21.15.17:0/616749568 conn(0x7fe5ac100d80 msgr2=0x7fe5ac1018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.156+0000 7fe5b1e57640 1 -- 172.21.15.17:0/616749568 shutdown_connections 2024-08-19T00:46:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:52.156+0000 7fe5b1e57640 1 -- 172.21.15.17:0/616749568 wait complete. 2024-08-19T00:46:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling cephadm module... 2024-08-19T00:46:54.814 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:54 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3221653338' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-08-19T00:46:55.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.240+0000 7ff675fb3640 1 Processor -- start 2024-08-19T00:46:55.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.240+0000 7ff675fb3640 1 -- start start 2024-08-19T00:46:55.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.240+0000 7ff675fb3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:55.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.240+0000 7ff675fb3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff670105f90 con 0x7ff6701055c0 2024-08-19T00:46:55.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.240+0000 7ff66f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.241+0000 7ff66f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45214/0 (socket says 172.21.15.17:45214) 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.241+0000 7ff66f7fe640 1 -- 172.21.15.17:0/2535488111 learned_addr learned my addr 172.21.15.17:0/2535488111 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.241+0000 7ff66f7fe640 1 -- 172.21.15.17:0/2535488111 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6701067c0 con 0x7ff6701055c0 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.241+0000 7ff66f7fe640 1 --2- 172.21.15.17:0/2535488111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701059c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff660009820 tx=0x7ff66002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62e93117ebb3f9f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.242+0000 7ff66e7fc640 1 -- 172.21.15.17:0/2535488111 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff66002ad40 con 0x7ff6701055c0 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.242+0000 7ff66e7fc640 1 -- 172.21.15.17:0/2535488111 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ff6600328c0 con 0x7ff6701055c0 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.242+0000 7ff66e7fc640 1 -- 172.21.15.17:0/2535488111 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6600307f0 con 0x7ff6701055c0 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.242+0000 7ff675fb3640 1 -- 172.21.15.17:0/2535488111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 msgr2=0x7ff6701059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.242+0000 7ff675fb3640 1 --2- 172.21.15.17:0/2535488111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701059c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff660009820 tx=0x7ff66002a270 comp rx=0 tx=0).stop 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.242+0000 7ff675fb3640 1 -- 172.21.15.17:0/2535488111 shutdown_connections 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.242+0000 7ff675fb3640 1 --2- 172.21.15.17:0/2535488111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701059c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:55.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.242+0000 7ff675fb3640 1 -- 172.21.15.17:0/2535488111 >> 172.21.15.17:0/2535488111 conn(0x7ff670100d70 msgr2=0x7ff670103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.242+0000 7ff675fb3640 1 -- 172.21.15.17:0/2535488111 shutdown_connections 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.242+0000 7ff675fb3640 1 -- 172.21.15.17:0/2535488111 wait complete. 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.243+0000 7ff675fb3640 1 Processor -- start 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.243+0000 7ff675fb3640 1 -- start start 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.243+0000 7ff675fb3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.243+0000 7ff675fb3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6701997f0 con 0x7ff6701055c0 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.244+0000 7ff66f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.244+0000 7ff66f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45220/0 (socket says 172.21.15.17:45220) 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.244+0000 7ff66f7fe640 1 -- 172.21.15.17:0/3221653338 learned_addr learned my addr 172.21.15.17:0/3221653338 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.244+0000 7ff66f7fe640 1 -- 172.21.15.17:0/3221653338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600094d0 con 0x7ff6701055c0 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.244+0000 7ff66f7fe640 1 --2- 172.21.15.17:0/3221653338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701992b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff660030d30 tx=0x7ff660030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.244+0000 7ff66cff9640 1 -- 172.21.15.17:0/3221653338 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff660032c40 con 0x7ff6701055c0 2024-08-19T00:46:55.139 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.244+0000 7ff66cff9640 1 -- 172.21.15.17:0/3221653338 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ff660032da0 con 0x7ff6701055c0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.244+0000 7ff66cff9640 1 -- 172.21.15.17:0/3221653338 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff66003c570 con 0x7ff6701055c0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.244+0000 7ff675fb3640 1 -- 172.21.15.17:0/3221653338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6701999f0 con 0x7ff6701055c0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.244+0000 7ff675fb3640 1 -- 172.21.15.17:0/3221653338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff670199e10 con 0x7ff6701055c0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.245+0000 7ff66cff9640 1 -- 172.21.15.17:0/3221653338 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 45545+0+0 (secure 0 0 0) 0x7ff66003c7e0 con 0x7ff6701055c0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.245+0000 7ff675fb3640 1 -- 172.21.15.17:0/3221653338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6701099f0 con 0x7ff6701055c0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.245+0000 7ff66cff9640 1 --2- 172.21.15.17:0/3221653338 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff658038650 0x7ff65803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.245+0000 7ff66cff9640 1 -- 172.21.15.17:0/3221653338 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff66006b980 con 0x7ff6701055c0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.245+0000 7ff66effd640 1 --2- 172.21.15.17:0/3221653338 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff658038650 0x7ff65803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.246+0000 7ff66effd640 1 --2- 172.21.15.17:0/3221653338 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff658038650 0x7ff65803ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff6640098c0 tx=0x7ff664006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.250+0000 7ff66cff9640 1 -- 172.21.15.17:0/3221653338 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff66003ca90 con 0x7ff6701055c0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.466+0000 7ff675fb3640 1 -- 172.21.15.17:0/3221653338 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7ff67019c770 con 0x7ff6701055c0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.519+0000 7ff66cff9640 1 -- 172.21.15.17:0/3221653338 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7ff66003da90 con 0x7ff6701055c0 2024-08-19T00:46:55.140 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.521+0000 7ff66cff9640 1 -- 172.21.15.17:0/3221653338 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7ff66006b6e0 con 0x7ff6701055c0 2024-08-19T00:46:55.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.524+0000 7ff675fb3640 1 -- 172.21.15.17:0/3221653338 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff658038650 msgr2=0x7ff65803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:55.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.524+0000 7ff675fb3640 1 --2- 172.21.15.17:0/3221653338 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff658038650 0x7ff65803ab10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff6640098c0 tx=0x7ff664006db0 comp rx=0 tx=0).stop 2024-08-19T00:46:55.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.524+0000 7ff675fb3640 1 -- 172.21.15.17:0/3221653338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 msgr2=0x7ff6701992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:55.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.524+0000 7ff675fb3640 1 --2- 172.21.15.17:0/3221653338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701992b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff660030d30 tx=0x7ff660030d60 comp rx=0 tx=0).stop 2024-08-19T00:46:55.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.524+0000 7ff675fb3640 1 -- 172.21.15.17:0/3221653338 shutdown_connections 2024-08-19T00:46:55.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.524+0000 7ff675fb3640 1 --2- 172.21.15.17:0/3221653338 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7ff658038650 0x7ff65803ab10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:55.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.524+0000 7ff675fb3640 1 --2- 172.21.15.17:0/3221653338 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6701055c0 0x7ff6701992b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:55.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.524+0000 7ff675fb3640 1 -- 172.21.15.17:0/3221653338 >> 172.21.15.17:0/3221653338 conn(0x7ff670100d70 msgr2=0x7ff670101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:55.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.524+0000 7ff675fb3640 1 -- 172.21.15.17:0/3221653338 shutdown_connections 2024-08-19T00:46:55.141 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:54.524+0000 7ff675fb3640 1 -- 172.21.15.17:0/3221653338 wait complete. 2024-08-19T00:46:55.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:55 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3221653338' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-19T00:46:55.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:55 smithi017 ceph-mon[16627]: mgrmap e5: smithi017.hfpawi(active, since 12s) 2024-08-19T00:46:56.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:46:56.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-19T00:46:56.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-19T00:46:56.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "smithi017.hfpawi", 2024-08-19T00:46:56.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-19T00:46:56.461 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.609+0000 7f3611253640 1 Processor -- start 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.609+0000 7f3611253640 1 -- start start 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.609+0000 7f3611253640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.609+0000 7f3611253640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c079e20 con 0x7f360c1060d0 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.610+0000 7f360ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.610+0000 7f360ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1084c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45246/0 (socket says 172.21.15.17:45246) 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.610+0000 7f360ad9d640 1 -- 172.21.15.17:0/103412954 learned_addr learned my addr 172.21.15.17:0/103412954 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.610+0000 7f360ad9d640 1 -- 172.21.15.17:0/103412954 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c108a00 con 0x7f360c1060d0 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.611+0000 7f360ad9d640 1 --2- 172.21.15.17:0/103412954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1084c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009820 tx=0x7f35fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f008ee1ff48bdd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.611+0000 7f3609d9b640 1 -- 172.21.15.17:0/103412954 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35fc02ad40 con 0x7f360c1060d0 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.611+0000 7f3609d9b640 1 -- 172.21.15.17:0/103412954 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f35fc0328c0 con 0x7f360c1060d0 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.611+0000 7f3609d9b640 1 -- 172.21.15.17:0/103412954 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35fc0307f0 con 0x7f360c1060d0 2024-08-19T00:46:56.462 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.612+0000 7f3611253640 1 -- 172.21.15.17:0/103412954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 msgr2=0x7f360c1084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.612+0000 7f3611253640 1 --2- 172.21.15.17:0/103412954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1084c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f35fc009820 tx=0x7f35fc02a270 comp rx=0 tx=0).stop 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.612+0000 7f3611253640 1 -- 172.21.15.17:0/103412954 shutdown_connections 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.612+0000 7f3611253640 1 --2- 172.21.15.17:0/103412954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1084c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.612+0000 7f3611253640 1 -- 172.21.15.17:0/103412954 >> 172.21.15.17:0/103412954 conn(0x7f360c0ffc50 msgr2=0x7f360c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.612+0000 7f3611253640 1 -- 172.21.15.17:0/103412954 shutdown_connections 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.612+0000 7f3611253640 1 -- 172.21.15.17:0/103412954 wait complete. 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.613+0000 7f3611253640 1 Processor -- start 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.613+0000 7f3611253640 1 -- start start 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.614+0000 7f3611253640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.614+0000 7f3611253640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360c1997f0 con 0x7f360c1060d0 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.614+0000 7f360ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.614+0000 7f360ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45262/0 (socket says 172.21.15.17:45262) 2024-08-19T00:46:56.463 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.614+0000 7f360ad9d640 1 -- 172.21.15.17:0/1046982806 learned_addr learned my addr 172.21.15.17:0/1046982806 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.614+0000 7f360ad9d640 1 -- 172.21.15.17:0/1046982806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0094d0 con 0x7f360c1060d0 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.614+0000 7f360ad9d640 1 --2- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1992b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f35fc030d30 tx=0x7f35fc030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.615+0000 7f35f3fff640 1 -- 172.21.15.17:0/1046982806 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35fc032c40 con 0x7f360c1060d0 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.615+0000 7f3611253640 1 -- 172.21.15.17:0/1046982806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360c1999f0 con 0x7f360c1060d0 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.615+0000 7f3611253640 1 -- 172.21.15.17:0/1046982806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f360c199e10 con 0x7f360c1060d0 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.615+0000 7f35f3fff640 1 -- 172.21.15.17:0/1046982806 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f35fc032da0 con 0x7f360c1060d0 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.615+0000 7f35f3fff640 1 -- 172.21.15.17:0/1046982806 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35fc03c660 con 0x7f360c1060d0 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.616+0000 7f35f3fff640 1 -- 172.21.15.17:0/1046982806 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f35fc03c8c0 con 0x7f360c1060d0 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.616+0000 7f3611253640 1 -- 172.21.15.17:0/1046982806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360c109720 con 0x7f360c1060d0 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.616+0000 7f35f3fff640 1 --2- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f35f40386a0 0x7f35f403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.616+0000 7f35f3fff640 1 -- 172.21.15.17:0/1046982806 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f35fc06b730 con 0x7f360c1060d0 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.616+0000 7f360a59c640 1 -- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f35f40386a0 msgr2=0x7f35f403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2987236592 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.616+0000 7f360a59c640 1 --2- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f35f40386a0 0x7f35f403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:46:56.464 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.621+0000 7f35f3fff640 1 -- 172.21.15.17:0/1046982806 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f35fc0313a0 con 0x7f360c1060d0 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.817+0000 7f360a59c640 1 -- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f35f40386a0 msgr2=0x7f35f403ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2987236592 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.817+0000 7f360a59c640 1 --2- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f35f40386a0 0x7f35f403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.839+0000 7f3611253640 1 -- 172.21.15.17:0/1046982806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f360c19c770 con 0x7f360c1060d0 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.839+0000 7f35f3fff640 1 -- 172.21.15.17:0/1046982806 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f35fc03bb30 con 0x7f360c1060d0 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.841+0000 7f3611253640 1 -- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f35f40386a0 msgr2=0x7f35f403ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.841+0000 7f3611253640 1 --2- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f35f40386a0 0x7f35f403ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.841+0000 7f3611253640 1 -- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 msgr2=0x7f360c1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.841+0000 7f3611253640 1 --2- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1992b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f35fc030d30 tx=0x7f35fc030d60 comp rx=0 tx=0).stop 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.841+0000 7f3611253640 1 -- 172.21.15.17:0/1046982806 shutdown_connections 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.841+0000 7f3611253640 1 --2- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f35f40386a0 0x7f35f403ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.841+0000 7f3611253640 1 --2- 172.21.15.17:0/1046982806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f360c1060d0 0x7f360c1992b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.841+0000 7f3611253640 1 -- 172.21.15.17:0/1046982806 >> 172.21.15.17:0/1046982806 conn(0x7f360c0ffc50 msgr2=0x7f360c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.841+0000 7f3611253640 1 -- 172.21.15.17:0/1046982806 shutdown_connections 2024-08-19T00:46:56.465 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:55.841+0000 7f3611253640 1 -- 172.21.15.17:0/1046982806 wait complete. 2024-08-19T00:46:56.466 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-08-19T00:46:56.466 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 5... 2024-08-19T00:46:56.607 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:56 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1046982806' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-19T00:46:59.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: Active manager daemon smithi017.hfpawi restarted 2024-08-19T00:46:59.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: Activating manager daemon smithi017.hfpawi 2024-08-19T00:46:59.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: osdmap e2: 0 total, 0 up, 0 in 2024-08-19T00:46:59.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: mgrmap e6: smithi017.hfpawi(active, starting, since 0.00330869s) 2024-08-19T00:46:59.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:46:59.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi017.hfpawi", "id": "smithi017.hfpawi"}]: dispatch 2024-08-19T00:46:59.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:46:59.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:46:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:46:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: Manager daemon smithi017.hfpawi is now available 2024-08-19T00:46:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:46:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:46:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:46:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:46:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:46:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:46:59 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/trash_purge_schedule"}]: dispatch 2024-08-19T00:47:00.815 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:00 smithi017 ceph-mon[16627]: Found migration_current of "None". Setting to last migration. 2024-08-19T00:47:00.816 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:00 smithi017 ceph-mon[16627]: mgrmap e7: smithi017.hfpawi(active, since 1.00516s) 2024-08-19T00:47:01.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:47:01.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-19T00:47:01.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-19T00:47:01.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:47:01.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.916+0000 7f7086620640 1 Processor -- start 2024-08-19T00:47:01.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.916+0000 7f7086620640 1 -- start start 2024-08-19T00:47:01.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.916+0000 7f7086620640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f7080108430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:01.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.916+0000 7f7086620640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7080079ea0 con 0x7f7080106040 2024-08-19T00:47:01.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.916+0000 7f707ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f7080108430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.916+0000 7f707ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f7080108430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47002/0 (socket says 172.21.15.17:47002) 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.916+0000 7f707ffff640 1 -- 172.21.15.17:0/1904890884 learned_addr learned my addr 172.21.15.17:0/1904890884 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.917+0000 7f707ffff640 1 -- 172.21.15.17:0/1904890884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7080108970 con 0x7f7080106040 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.917+0000 7f707ffff640 1 --2- 172.21.15.17:0/1904890884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f7080108430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7070009820 tx=0x7f707002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642ba5ce4a78068a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.917+0000 7f707effd640 1 -- 172.21.15.17:0/1904890884 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f707002ad40 con 0x7f7080106040 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.917+0000 7f707effd640 1 -- 172.21.15.17:0/1904890884 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f70700328c0 con 0x7f7080106040 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.917+0000 7f707effd640 1 -- 172.21.15.17:0/1904890884 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70700307f0 con 0x7f7080106040 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.918+0000 7f7086620640 1 -- 172.21.15.17:0/1904890884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 msgr2=0x7f7080108430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.918+0000 7f7086620640 1 --2- 172.21.15.17:0/1904890884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f7080108430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7070009820 tx=0x7f707002a270 comp rx=0 tx=0).stop 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.918+0000 7f7086620640 1 -- 172.21.15.17:0/1904890884 shutdown_connections 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.918+0000 7f7086620640 1 --2- 172.21.15.17:0/1904890884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f7080108430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.918+0000 7f7086620640 1 -- 172.21.15.17:0/1904890884 >> 172.21.15.17:0/1904890884 conn(0x7f70800ffcc0 msgr2=0x7f70801020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:01.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.918+0000 7f7086620640 1 -- 172.21.15.17:0/1904890884 shutdown_connections 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.918+0000 7f7086620640 1 -- 172.21.15.17:0/1904890884 wait complete. 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.919+0000 7f7086620640 1 Processor -- start 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.919+0000 7f7086620640 1 -- start start 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.919+0000 7f7086620640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f70801992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.919+0000 7f7086620640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7080199810 con 0x7f7080106040 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.919+0000 7f707ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f70801992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.919+0000 7f707ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f70801992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47018/0 (socket says 172.21.15.17:47018) 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.919+0000 7f707ffff640 1 -- 172.21.15.17:0/1899203839 learned_addr learned my addr 172.21.15.17:0/1899203839 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.920+0000 7f707ffff640 1 -- 172.21.15.17:0/1899203839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70700094d0 con 0x7f7080106040 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.920+0000 7f707ffff640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f70801992d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7070009940 tx=0x7f7070032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.920+0000 7f707d7fa640 1 -- 172.21.15.17:0/1899203839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7070041070 con 0x7f7080106040 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.920+0000 7f707d7fa640 1 -- 172.21.15.17:0/1899203839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f7070030cc0 con 0x7f7080106040 2024-08-19T00:47:01.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.920+0000 7f7086620640 1 -- 172.21.15.17:0/1899203839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7080199a10 con 0x7f7080106040 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.920+0000 7f707d7fa640 1 -- 172.21.15.17:0/1899203839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f707003c620 con 0x7f7080106040 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.920+0000 7f7086620640 1 -- 172.21.15.17:0/1899203839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7080199e30 con 0x7f7080106040 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.921+0000 7f707d7fa640 1 -- 172.21.15.17:0/1899203839 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f707003c780 con 0x7f7080106040 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.921+0000 7f707d7fa640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 0x7f706803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.921+0000 7f7086620640 1 -- 172.21.15.17:0/1899203839 --> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7080106420 con 0x7f70680386a0 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.921+0000 7f707d7fa640 1 -- 172.21.15.17:0/1899203839 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f707006c610 con 0x7f7080106040 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.921+0000 7f707f7fe640 1 -- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 msgr2=0x7f706803ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2987236592 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:56.921+0000 7f707f7fe640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 0x7f706803ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:57.122+0000 7f707f7fe640 1 -- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 msgr2=0x7f706803ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2987236592 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:57.122+0000 7f707f7fe640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 0x7f706803ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:57.523+0000 7f707f7fe640 1 -- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 msgr2=0x7f706803ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2987236592 2024-08-19T00:47:01.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:57.523+0000 7f707f7fe640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 0x7f706803ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:58.324+0000 7f707f7fe640 1 -- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 msgr2=0x7f706803ab60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2987236592 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:58.324+0000 7f707f7fe640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 0x7f706803ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:59.497+0000 7f707d7fa640 1 -- 172.21.15.17:0/1899203839 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 6) v1 ==== 45323+0+0 (secure 0 0 0) 0x7f707003db00 con 0x7f7080106040 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:59.497+0000 7f707d7fa640 1 -- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 msgr2=0x7f706803ab60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:46:59.497+0000 7f707d7fa640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 0x7f706803ab60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.498+0000 7f707d7fa640 1 -- 172.21.15.17:0/1899203839 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 7) v1 ==== 45450+0+0 (secure 0 0 0) 0x7f7070045bb0 con 0x7f7080106040 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.498+0000 7f707d7fa640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f706803be20 0x7f706803e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.498+0000 7f707d7fa640 1 -- 172.21.15.17:0/1899203839 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7080106420 con 0x7f706803be20 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.498+0000 7f707f7fe640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f706803be20 0x7f706803e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.499+0000 7f707f7fe640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f706803be20 0x7f706803e210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7074003980 tx=0x7f70740092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.500+0000 7f707d7fa640 1 -- 172.21.15.17:0/1899203839 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f7080106420 con 0x7f706803be20 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.505+0000 7f7086620640 1 -- 172.21.15.17:0/1899203839 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f70801096f0 con 0x7f706803be20 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f707d7fa640 1 -- 172.21.15.17:0/1899203839 <== mgr.14118 v2:172.21.15.17:6800/2005365781 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f70801096f0 con 0x7f706803be20 2024-08-19T00:47:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f7086620640 1 -- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f706803be20 msgr2=0x7f706803e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f7086620640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f706803be20 0x7f706803e210 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7074003980 tx=0x7f70740092b0 comp rx=0 tx=0).stop 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f7086620640 1 -- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 msgr2=0x7f70801992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f7086620640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f70801992d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7070009940 tx=0x7f7070032c60 comp rx=0 tx=0).stop 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f7086620640 1 -- 172.21.15.17:0/1899203839 shutdown_connections 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f7086620640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f706803be20 0x7f706803e210 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f7086620640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:6800/2987236592,v1:172.21.15.17:6801/2987236592] conn(0x7f70680386a0 0x7f706803ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f7086620640 1 --2- 172.21.15.17:0/1899203839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7080106040 0x7f70801992d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f7086620640 1 -- 172.21.15.17:0/1899203839 >> 172.21.15.17:0/1899203839 conn(0x7f70800ffcc0 msgr2=0x7f70801008e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f7086620640 1 -- 172.21.15.17:0/1899203839 shutdown_connections 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:00.506+0000 7f7086620640 1 -- 172.21.15.17:0/1899203839 wait complete. 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 5 is available 2024-08-19T00:47:01.093 INFO:teuthology.orchestra.run.smithi017.stdout:Setting orchestrator backend to cephadm... 2024-08-19T00:47:01.677 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:01 smithi017 ceph-mon[16627]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-19T00:47:01.677 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:01 smithi017 ceph-mon[16627]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-19T00:47:01.677 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:01 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:01.678 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:01 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:02.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.462+0000 7f014b34b640 1 Processor -- start 2024-08-19T00:47:02.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.462+0000 7f014b34b640 1 -- start start 2024-08-19T00:47:02.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.463+0000 7f014b34b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f0144108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:02.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.463+0000 7f014b34b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0144079e60 con 0x7f0144106090 2024-08-19T00:47:02.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.463+0000 7f01490e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f0144108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:02.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.463+0000 7f01490e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f0144108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47088/0 (socket says 172.21.15.17:47088) 2024-08-19T00:47:02.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.463+0000 7f01490e7640 1 -- 172.21.15.17:0/681466880 learned_addr learned my addr 172.21.15.17:0/681466880 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:02.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.463+0000 7f01490e7640 1 -- 172.21.15.17:0/681466880 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01441089c0 con 0x7f0144106090 2024-08-19T00:47:02.167 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.464+0000 7f01490e7640 1 --2- 172.21.15.17:0/681466880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f0144108480 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0140009820 tx=0x7f014002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8cd05ee55839be server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.464+0000 7f013bfff640 1 -- 172.21.15.17:0/681466880 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f014002ad40 con 0x7f0144106090 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.464+0000 7f013bfff640 1 -- 172.21.15.17:0/681466880 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f01400328c0 con 0x7f0144106090 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.464+0000 7f013bfff640 1 -- 172.21.15.17:0/681466880 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f01400307f0 con 0x7f0144106090 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.465+0000 7f014b34b640 1 -- 172.21.15.17:0/681466880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 msgr2=0x7f0144108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.465+0000 7f014b34b640 1 --2- 172.21.15.17:0/681466880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f0144108480 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0140009820 tx=0x7f014002a270 comp rx=0 tx=0).stop 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.465+0000 7f014b34b640 1 -- 172.21.15.17:0/681466880 shutdown_connections 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.465+0000 7f014b34b640 1 --2- 172.21.15.17:0/681466880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f0144108480 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.465+0000 7f014b34b640 1 -- 172.21.15.17:0/681466880 >> 172.21.15.17:0/681466880 conn(0x7f01440ffc50 msgr2=0x7f01441020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.465+0000 7f014b34b640 1 -- 172.21.15.17:0/681466880 shutdown_connections 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.465+0000 7f014b34b640 1 -- 172.21.15.17:0/681466880 wait complete. 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.466+0000 7f014b34b640 1 Processor -- start 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.466+0000 7f014b34b640 1 -- start start 2024-08-19T00:47:02.168 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.466+0000 7f014b34b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f01441992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.466+0000 7f014b34b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0144199800 con 0x7f0144106090 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.466+0000 7f01490e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f01441992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.466+0000 7f01490e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f01441992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47102/0 (socket says 172.21.15.17:47102) 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.466+0000 7f01490e7640 1 -- 172.21.15.17:0/249076980 learned_addr learned my addr 172.21.15.17:0/249076980 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.466+0000 7f01490e7640 1 -- 172.21.15.17:0/249076980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400094d0 con 0x7f0144106090 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.466+0000 7f01490e7640 1 --2- 172.21.15.17:0/249076980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f01441992c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0140030d30 tx=0x7f0140030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.466+0000 7f013a7fc640 1 -- 172.21.15.17:0/249076980 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0140032c40 con 0x7f0144106090 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.467+0000 7f014b34b640 1 -- 172.21.15.17:0/249076980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0144199a00 con 0x7f0144106090 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.467+0000 7f013a7fc640 1 -- 172.21.15.17:0/249076980 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f0140032da0 con 0x7f0144106090 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.467+0000 7f013a7fc640 1 -- 172.21.15.17:0/249076980 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f014003c660 con 0x7f0144106090 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.467+0000 7f014b34b640 1 -- 172.21.15.17:0/249076980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0144199e20 con 0x7f0144106090 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.468+0000 7f014b34b640 1 -- 172.21.15.17:0/249076980 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0144109710 con 0x7f0144106090 2024-08-19T00:47:02.169 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.468+0000 7f013a7fc640 1 -- 172.21.15.17:0/249076980 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 7) v1 ==== 45450+0+0 (secure 0 0 0) 0x7f014003db00 con 0x7f0144106090 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.468+0000 7f013a7fc640 1 --2- 172.21.15.17:0/249076980 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f0130038530 0x7f013003a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.468+0000 7f013a7fc640 1 -- 172.21.15.17:0/249076980 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f014006b5c0 con 0x7f0144106090 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.468+0000 7f01488e6640 1 --2- 172.21.15.17:0/249076980 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f0130038530 0x7f013003a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.469+0000 7f01488e6640 1 --2- 172.21.15.17:0/249076980 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f0130038530 0x7f013003a9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01340098c0 tx=0x7f0134006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.473+0000 7f013a7fc640 1 -- 172.21.15.17:0/249076980 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f0140045b50 con 0x7f0144106090 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.675+0000 7f014b34b640 1 -- 172.21.15.17:0/249076980 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f0144100f80 con 0x7f0130038530 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.683+0000 7f013a7fc640 1 -- 172.21.15.17:0/249076980 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0144100f80 con 0x7f0130038530 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.685+0000 7f014b34b640 1 -- 172.21.15.17:0/249076980 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f0130038530 msgr2=0x7f013003a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.685+0000 7f014b34b640 1 --2- 172.21.15.17:0/249076980 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f0130038530 0x7f013003a9f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01340098c0 tx=0x7f0134006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.685+0000 7f014b34b640 1 -- 172.21.15.17:0/249076980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 msgr2=0x7f01441992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.685+0000 7f014b34b640 1 --2- 172.21.15.17:0/249076980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f01441992c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0140030d30 tx=0x7f0140030d60 comp rx=0 tx=0).stop 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.685+0000 7f014b34b640 1 -- 172.21.15.17:0/249076980 shutdown_connections 2024-08-19T00:47:02.170 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.685+0000 7f014b34b640 1 --2- 172.21.15.17:0/249076980 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f0130038530 0x7f013003a9f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:02.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.685+0000 7f014b34b640 1 --2- 172.21.15.17:0/249076980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0144106090 0x7f01441992c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:02.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.685+0000 7f014b34b640 1 -- 172.21.15.17:0/249076980 >> 172.21.15.17:0/249076980 conn(0x7f01440ffc50 msgr2=0x7f0144100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:02.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.685+0000 7f014b34b640 1 -- 172.21.15.17:0/249076980 shutdown_connections 2024-08-19T00:47:02.171 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:01.686+0000 7f014b34b640 1 -- 172.21.15.17:0/249076980 wait complete. 2024-08-19T00:47:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:02 smithi017 ceph-mon[16627]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:02.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:02 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:02.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:02 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:47:02.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:02 smithi017 ceph-mon[16627]: mgrmap e8: smithi017.hfpawi(active, since 2s) 2024-08-19T00:47:02.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:02 smithi017 ceph-mon[16627]: [19/Aug/2024:00:47:01] ENGINE Bus STARTING 2024-08-19T00:47:02.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:02 smithi017 ceph-mon[16627]: [19/Aug/2024:00:47:01] ENGINE Serving on http://172.21.15.17:8765 2024-08-19T00:47:02.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:02 smithi017 ceph-mon[16627]: [19/Aug/2024:00:47:02] ENGINE Serving on https://172.21.15.17:7150 2024-08-19T00:47:02.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:02 smithi017 ceph-mon[16627]: [19/Aug/2024:00:47:02] ENGINE Bus STARTED 2024-08-19T00:47:02.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:02 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:47:02.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:02 smithi017 ceph-mon[16627]: [19/Aug/2024:00:47:02] ENGINE Error in HTTPServer.serve 2024-08-19T00:47:02.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Traceback (most recent call last): 2024-08-19T00:47:02.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:47:02.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:47:02.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:47:02.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._run(expiration_interval) 2024-08-19T00:47:02.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:47:02.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:47:02.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:47:02.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:47:02.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:47:02.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s = self.context.wrap_socket( 2024-08-19T00:47:02.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:47:02.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: return self.sslsocket_class._create( 2024-08-19T00:47:02.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:47:02.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self.do_handshake() 2024-08-19T00:47:02.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:47:02.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._sslobj.do_handshake() 2024-08-19T00:47:02.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.546+0000 7ffb0f79e640 1 Processor -- start 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.546+0000 7ffb0f79e640 1 -- start start 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.546+0000 7ffb0f79e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb081042c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.546+0000 7ffb0f79e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08079e20 con 0x7ffb08103ec0 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.547+0000 7ffb0d53a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb081042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.547+0000 7ffb0d53a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb081042c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47104/0 (socket says 172.21.15.17:47104) 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.547+0000 7ffb0d53a640 1 -- 172.21.15.17:0/3514731138 learned_addr learned my addr 172.21.15.17:0/3514731138 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.547+0000 7ffb0d53a640 1 -- 172.21.15.17:0/3514731138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08104800 con 0x7ffb08103ec0 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.548+0000 7ffb0d53a640 1 --2- 172.21.15.17:0/3514731138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb081042c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009820 tx=0x7ffb0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e04463d7d56385 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.548+0000 7ffafffff640 1 -- 172.21.15.17:0/3514731138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb0402ad40 con 0x7ffb08103ec0 2024-08-19T00:47:03.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.548+0000 7ffafffff640 1 -- 172.21.15.17:0/3514731138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ffb040328c0 con 0x7ffb08103ec0 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.548+0000 7ffafffff640 1 -- 172.21.15.17:0/3514731138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb040307f0 con 0x7ffb08103ec0 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.548+0000 7ffb0f79e640 1 -- 172.21.15.17:0/3514731138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 msgr2=0x7ffb081042c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.548+0000 7ffb0f79e640 1 --2- 172.21.15.17:0/3514731138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb081042c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009820 tx=0x7ffb0402a270 comp rx=0 tx=0).stop 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.548+0000 7ffb0f79e640 1 -- 172.21.15.17:0/3514731138 shutdown_connections 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.548+0000 7ffb0f79e640 1 --2- 172.21.15.17:0/3514731138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb081042c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.548+0000 7ffb0f79e640 1 -- 172.21.15.17:0/3514731138 >> 172.21.15.17:0/3514731138 conn(0x7ffb080ffc50 msgr2=0x7ffb081020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.549+0000 7ffb0f79e640 1 -- 172.21.15.17:0/3514731138 shutdown_connections 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.549+0000 7ffb0f79e640 1 -- 172.21.15.17:0/3514731138 wait complete. 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.549+0000 7ffb0f79e640 1 Processor -- start 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.549+0000 7ffb0f79e640 1 -- start start 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.549+0000 7ffb0f79e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb0819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.549+0000 7ffb0f79e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0819b9e0 con 0x7ffb08103ec0 2024-08-19T00:47:03.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.549+0000 7ffb0d53a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb0819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.549+0000 7ffb0d53a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb0819b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47110/0 (socket says 172.21.15.17:47110) 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.549+0000 7ffb0d53a640 1 -- 172.21.15.17:0/2961232380 learned_addr learned my addr 172.21.15.17:0/2961232380 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.550+0000 7ffb0d53a640 1 -- 172.21.15.17:0/2961232380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb040094d0 con 0x7ffb08103ec0 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.550+0000 7ffb0d53a640 1 --2- 172.21.15.17:0/2961232380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb0819b4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009940 tx=0x7ffb04032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.550+0000 7ffafe7fc640 1 -- 172.21.15.17:0/2961232380 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb04041070 con 0x7ffb08103ec0 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.550+0000 7ffafe7fc640 1 -- 172.21.15.17:0/2961232380 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ffb04030cc0 con 0x7ffb08103ec0 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.550+0000 7ffb0f79e640 1 -- 172.21.15.17:0/2961232380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0819bbe0 con 0x7ffb08103ec0 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.550+0000 7ffafe7fc640 1 -- 172.21.15.17:0/2961232380 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffb0403c620 con 0x7ffb08103ec0 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.550+0000 7ffb0f79e640 1 -- 172.21.15.17:0/2961232380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0819c000 con 0x7ffb08103ec0 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.551+0000 7ffafe7fc640 1 -- 172.21.15.17:0/2961232380 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7ffb0403c780 con 0x7ffb08103ec0 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.551+0000 7ffafe7fc640 1 --2- 172.21.15.17:0/2961232380 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ffaf40386a0 0x7ffaf403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.551+0000 7ffafe7fc640 1 -- 172.21.15.17:0/2961232380 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ffb0406b620 con 0x7ffb08103ec0 2024-08-19T00:47:03.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.551+0000 7ffb0f79e640 1 -- 172.21.15.17:0/2961232380 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb08105650 con 0x7ffb08103ec0 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.551+0000 7ffb0cd39640 1 --2- 172.21.15.17:0/2961232380 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ffaf40386a0 0x7ffaf403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.552+0000 7ffb0cd39640 1 --2- 172.21.15.17:0/2961232380 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ffaf40386a0 0x7ffaf403ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80098c0 tx=0x7ffaf8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.556+0000 7ffafe7fc640 1 -- 172.21.15.17:0/2961232380 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ffb04046410 con 0x7ffb08103ec0 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.728+0000 7ffb0f79e640 1 -- 172.21.15.17:0/2961232380 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb08193430 con 0x7ffaf40386a0 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.729+0000 7ffafe7fc640 1 -- 172.21.15.17:0/2961232380 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7ffb08193430 con 0x7ffaf40386a0 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.731+0000 7ffb0f79e640 1 -- 172.21.15.17:0/2961232380 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ffaf40386a0 msgr2=0x7ffaf403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.731+0000 7ffb0f79e640 1 --2- 172.21.15.17:0/2961232380 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ffaf40386a0 0x7ffaf403ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffaf80098c0 tx=0x7ffaf8006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.731+0000 7ffb0f79e640 1 -- 172.21.15.17:0/2961232380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 msgr2=0x7ffb0819b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.731+0000 7ffb0f79e640 1 --2- 172.21.15.17:0/2961232380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb0819b4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009940 tx=0x7ffb04032c60 comp rx=0 tx=0).stop 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.731+0000 7ffb0f79e640 1 -- 172.21.15.17:0/2961232380 shutdown_connections 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.731+0000 7ffb0f79e640 1 --2- 172.21.15.17:0/2961232380 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ffaf40386a0 0x7ffaf403ab60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.731+0000 7ffb0f79e640 1 --2- 172.21.15.17:0/2961232380 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb08103ec0 0x7ffb0819b4a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:03.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.731+0000 7ffb0f79e640 1 -- 172.21.15.17:0/2961232380 >> 172.21.15.17:0/2961232380 conn(0x7ffb080ffc50 msgr2=0x7ffb0818fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.731+0000 7ffb0f79e640 1 -- 172.21.15.17:0/2961232380 shutdown_connections 2024-08-19T00:47:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:02.731+0000 7ffb0f79e640 1 -- 172.21.15.17:0/2961232380 wait complete. 2024-08-19T00:47:03.269 INFO:teuthology.orchestra.run.smithi017.stdout:Generating ssh key... 2024-08-19T00:47:03.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:03 smithi017 ceph-mon[16627]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:04.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.694+0000 7f7c66395640 1 Processor -- start 2024-08-19T00:47:04.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.694+0000 7f7c66395640 1 -- start start 2024-08-19T00:47:04.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.694+0000 7f7c66395640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:04.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.694+0000 7f7c66395640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60079e60 con 0x7f7c60106090 2024-08-19T00:47:04.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.695+0000 7f7c5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:04.612 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.695+0000 7f7c5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47114/0 (socket says 172.21.15.17:47114) 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.695+0000 7f7c5ffff640 1 -- 172.21.15.17:0/2218144702 learned_addr learned my addr 172.21.15.17:0/2218144702 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.695+0000 7f7c5ffff640 1 -- 172.21.15.17:0/2218144702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c601089c0 con 0x7f7c60106090 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.695+0000 7f7c5ffff640 1 --2- 172.21.15.17:0/2218144702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60108480 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009820 tx=0x7f7c5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d338aacb0ddb126 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.696+0000 7f7c5effd640 1 -- 172.21.15.17:0/2218144702 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c5002ad40 con 0x7f7c60106090 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.696+0000 7f7c5effd640 1 -- 172.21.15.17:0/2218144702 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f7c500328c0 con 0x7f7c60106090 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.696+0000 7f7c5effd640 1 -- 172.21.15.17:0/2218144702 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c500307f0 con 0x7f7c60106090 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.696+0000 7f7c66395640 1 -- 172.21.15.17:0/2218144702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 msgr2=0x7f7c60108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.696+0000 7f7c66395640 1 --2- 172.21.15.17:0/2218144702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60108480 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009820 tx=0x7f7c5002a270 comp rx=0 tx=0).stop 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.696+0000 7f7c66395640 1 -- 172.21.15.17:0/2218144702 shutdown_connections 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.696+0000 7f7c66395640 1 --2- 172.21.15.17:0/2218144702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60108480 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.696+0000 7f7c66395640 1 -- 172.21.15.17:0/2218144702 >> 172.21.15.17:0/2218144702 conn(0x7f7c600ffc50 msgr2=0x7f7c601020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:04.613 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.696+0000 7f7c66395640 1 -- 172.21.15.17:0/2218144702 shutdown_connections 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.696+0000 7f7c66395640 1 -- 172.21.15.17:0/2218144702 wait complete. 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.697+0000 7f7c66395640 1 Processor -- start 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.697+0000 7f7c66395640 1 -- start start 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.697+0000 7f7c66395640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60105910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.697+0000 7f7c66395640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c60105e50 con 0x7f7c60106090 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.697+0000 7f7c5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60105910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.697+0000 7f7c5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60105910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47118/0 (socket says 172.21.15.17:47118) 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.697+0000 7f7c5ffff640 1 -- 172.21.15.17:0/1398959876 learned_addr learned my addr 172.21.15.17:0/1398959876 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.698+0000 7f7c5ffff640 1 -- 172.21.15.17:0/1398959876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c500094d0 con 0x7f7c60106090 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.698+0000 7f7c5ffff640 1 --2- 172.21.15.17:0/1398959876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60105910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c50030d30 tx=0x7f7c50030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.698+0000 7f7c5d7fa640 1 -- 172.21.15.17:0/1398959876 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c50032c40 con 0x7f7c60106090 2024-08-19T00:47:04.614 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.698+0000 7f7c5d7fa640 1 -- 172.21.15.17:0/1398959876 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f7c50032da0 con 0x7f7c60106090 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.698+0000 7f7c66395640 1 -- 172.21.15.17:0/1398959876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c60104040 con 0x7f7c60106090 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.698+0000 7f7c5d7fa640 1 -- 172.21.15.17:0/1398959876 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c5003c660 con 0x7f7c60106090 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.698+0000 7f7c66395640 1 -- 172.21.15.17:0/1398959876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c60104460 con 0x7f7c60106090 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.699+0000 7f7c5d7fa640 1 -- 172.21.15.17:0/1398959876 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f7c5003c8d0 con 0x7f7c60106090 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.699+0000 7f7c5d7fa640 1 --2- 172.21.15.17:0/1398959876 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7c48038650 0x7f7c4803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.699+0000 7f7c66395640 1 -- 172.21.15.17:0/1398959876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c60109710 con 0x7f7c60106090 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.699+0000 7f7c5d7fa640 1 -- 172.21.15.17:0/1398959876 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7c5006ba20 con 0x7f7c60106090 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.699+0000 7f7c5f7fe640 1 --2- 172.21.15.17:0/1398959876 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7c48038650 0x7f7c4803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.700+0000 7f7c5f7fe640 1 --2- 172.21.15.17:0/1398959876 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7c48038650 0x7f7c4803ab10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7c540098c0 tx=0x7f7c54006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.704+0000 7f7c5d7fa640 1 -- 172.21.15.17:0/1398959876 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f7c500313a0 con 0x7f7c60106090 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:03.875+0000 7f7c66395640 1 -- 172.21.15.17:0/1398959876 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c60104c50 con 0x7f7c48038650 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.019+0000 7f7c5d7fa640 1 -- 172.21.15.17:0/1398959876 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7c60104c50 con 0x7f7c48038650 2024-08-19T00:47:04.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.021+0000 7f7c66395640 1 -- 172.21.15.17:0/1398959876 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7c48038650 msgr2=0x7f7c4803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:04.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.021+0000 7f7c66395640 1 --2- 172.21.15.17:0/1398959876 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7c48038650 0x7f7c4803ab10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7c540098c0 tx=0x7f7c54006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:04.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.021+0000 7f7c66395640 1 -- 172.21.15.17:0/1398959876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 msgr2=0x7f7c60105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:04.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.021+0000 7f7c66395640 1 --2- 172.21.15.17:0/1398959876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60105910 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c50030d30 tx=0x7f7c50030d60 comp rx=0 tx=0).stop 2024-08-19T00:47:04.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.021+0000 7f7c66395640 1 -- 172.21.15.17:0/1398959876 shutdown_connections 2024-08-19T00:47:04.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.021+0000 7f7c66395640 1 --2- 172.21.15.17:0/1398959876 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7c48038650 0x7f7c4803ab10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:04.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.021+0000 7f7c66395640 1 --2- 172.21.15.17:0/1398959876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c60106090 0x7f7c60105910 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:04.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.021+0000 7f7c66395640 1 -- 172.21.15.17:0/1398959876 >> 172.21.15.17:0/1398959876 conn(0x7f7c600ffc50 msgr2=0x7f7c60100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:04.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.021+0000 7f7c66395640 1 -- 172.21.15.17:0/1398959876 shutdown_connections 2024-08-19T00:47:04.616 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.021+0000 7f7c66395640 1 -- 172.21.15.17:0/1398959876 wait complete. 2024-08-19T00:47:05.248 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:05 smithi017 ceph-mon[16627]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:05.248 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:05 smithi017 ceph-mon[16627]: Generating ssh key... 2024-08-19T00:47:05.248 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:05 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:05.248 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:05 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:05.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTqjGHL1DDAWJje+yGhTh3cU8Yb6KR9IEu3TJjepe9ma/spwj60dIGyqBOxZqjYKtuduwOxmCJYvE3C9vJPOhu6nksLjXt9R3QDDExqUT8peOzDgEknh+ml5lE/CsrM7Yi7lKTCOsJ1kO9wXgYOzGKQkCo33VQrzwMqfi3P8qGczRUAjbYTERRTfHrIBxd76nY61NyyBfsRtCxeb2Oqjswlub7p3eRSqWhxkHKccAJ3Ipgvz9e7QyL4keMQIgkcWklcMUt+pLmCu+gLeF8/Ju7s8dRGye9SY/VQDWlLO6EmN/EHQU88KRG942aO3uhQ/2tLY7YPkm5fyluJQIvAr+jC3rzBR7xwCSCnsI/ZTrdb6OMnQr8AWtFOMw08AYin8cu/GEmtZem+KSbdbW7PT1JCO/AxxEK4DCZN/DRUxOo0ZOollMSUXUa9U33irYDuoB4IyL/Q5dxv3x/KW0NFzhE7oCYIpecwpJbX8hA6vCDN0K1VS7RZmpXZhVkkmxLq4k= ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:47:05.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.993+0000 7f8f89440640 1 Processor -- start 2024-08-19T00:47:05.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.993+0000 7f8f89440640 1 -- start start 2024-08-19T00:47:05.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.994+0000 7f8f89440640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:05.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.994+0000 7f8f89440640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f84105fa0 con 0x7f8f841055d0 2024-08-19T00:47:05.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.994+0000 7f8f82ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:05.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.994+0000 7f8f82ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47134/0 (socket says 172.21.15.17:47134) 2024-08-19T00:47:05.886 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.994+0000 7f8f82ffd640 1 -- 172.21.15.17:0/3799043351 learned_addr learned my addr 172.21.15.17:0/3799043351 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.994+0000 7f8f82ffd640 1 -- 172.21.15.17:0/3799043351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f841067d0 con 0x7f8f841055d0 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.995+0000 7f8f82ffd640 1 --2- 172.21.15.17:0/3799043351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841059d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009820 tx=0x7f8f7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1246e37f8ee855c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.995+0000 7f8f827fc640 1 -- 172.21.15.17:0/3799043351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f7402ad40 con 0x7f8f841055d0 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.995+0000 7f8f827fc640 1 -- 172.21.15.17:0/3799043351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f8f740328c0 con 0x7f8f841055d0 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.995+0000 7f8f827fc640 1 -- 172.21.15.17:0/3799043351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f740307f0 con 0x7f8f841055d0 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.996+0000 7f8f89440640 1 -- 172.21.15.17:0/3799043351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 msgr2=0x7f8f841059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.996+0000 7f8f89440640 1 --2- 172.21.15.17:0/3799043351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841059d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009820 tx=0x7f8f7402a270 comp rx=0 tx=0).stop 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.996+0000 7f8f89440640 1 -- 172.21.15.17:0/3799043351 shutdown_connections 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.996+0000 7f8f89440640 1 --2- 172.21.15.17:0/3799043351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841059d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.996+0000 7f8f89440640 1 -- 172.21.15.17:0/3799043351 >> 172.21.15.17:0/3799043351 conn(0x7f8f84100d80 msgr2=0x7f8f841031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.996+0000 7f8f89440640 1 -- 172.21.15.17:0/3799043351 shutdown_connections 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.996+0000 7f8f89440640 1 -- 172.21.15.17:0/3799043351 wait complete. 2024-08-19T00:47:05.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.996+0000 7f8f89440640 1 Processor -- start 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.996+0000 7f8f89440640 1 -- start start 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f89440640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f89440640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f84199820 con 0x7f8f841055d0 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f82ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f82ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47142/0 (socket says 172.21.15.17:47142) 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f82ffd640 1 -- 172.21.15.17:0/1996797656 learned_addr learned my addr 172.21.15.17:0/1996797656 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f82ffd640 1 -- 172.21.15.17:0/1996797656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f740094d0 con 0x7f8f841055d0 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f82ffd640 1 --2- 172.21.15.17:0/1996797656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841992e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8f740303a0 tx=0x7f8f74032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f80ff9640 1 -- 172.21.15.17:0/1996797656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f74030cc0 con 0x7f8f841055d0 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f80ff9640 1 -- 172.21.15.17:0/1996797656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f8f74030e20 con 0x7f8f841055d0 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f89440640 1 -- 172.21.15.17:0/1996797656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f84199a20 con 0x7f8f841055d0 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f80ff9640 1 -- 172.21.15.17:0/1996797656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f7403c620 con 0x7f8f841055d0 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.997+0000 7f8f89440640 1 -- 172.21.15.17:0/1996797656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f84199e40 con 0x7f8f841055d0 2024-08-19T00:47:05.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.998+0000 7f8f80ff9640 1 -- 172.21.15.17:0/1996797656 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f8f7403d480 con 0x7f8f841055d0 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.998+0000 7f8f89440640 1 -- 172.21.15.17:0/1996797656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f841059d0 con 0x7f8f841055d0 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.998+0000 7f8f80ff9640 1 --2- 172.21.15.17:0/1996797656 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f700386a0 0x7f8f7003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.999+0000 7f8f80ff9640 1 -- 172.21.15.17:0/1996797656 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8f7406b990 con 0x7f8f841055d0 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.999+0000 7f8f7bfff640 1 --2- 172.21.15.17:0/1996797656 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f700386a0 0x7f8f7003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:04.999+0000 7f8f7bfff640 1 --2- 172.21.15.17:0/1996797656 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f700386a0 0x7f8f7003ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0098c0 tx=0x7f8f6c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.003+0000 7f8f80ff9640 1 -- 172.21.15.17:0/1996797656 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f8f740313a0 con 0x7f8f841055d0 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.176+0000 7f8f89440640 1 -- 172.21.15.17:0/1996797656 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f84101fc0 con 0x7f8f700386a0 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.176+0000 7f8f80ff9640 1 -- 172.21.15.17:0/1996797656 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f8f84101fc0 con 0x7f8f700386a0 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.179+0000 7f8f89440640 1 -- 172.21.15.17:0/1996797656 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f700386a0 msgr2=0x7f8f7003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.179+0000 7f8f89440640 1 --2- 172.21.15.17:0/1996797656 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f700386a0 0x7f8f7003ab60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c0098c0 tx=0x7f8f6c006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.179+0000 7f8f89440640 1 -- 172.21.15.17:0/1996797656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 msgr2=0x7f8f841992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.179+0000 7f8f89440640 1 --2- 172.21.15.17:0/1996797656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841992e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8f740303a0 tx=0x7f8f74032c60 comp rx=0 tx=0).stop 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.179+0000 7f8f89440640 1 -- 172.21.15.17:0/1996797656 shutdown_connections 2024-08-19T00:47:05.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.179+0000 7f8f89440640 1 --2- 172.21.15.17:0/1996797656 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f700386a0 0x7f8f7003ab60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.179+0000 7f8f89440640 1 --2- 172.21.15.17:0/1996797656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f841055d0 0x7f8f841992e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.179+0000 7f8f89440640 1 -- 172.21.15.17:0/1996797656 >> 172.21.15.17:0/1996797656 conn(0x7f8f84100d80 msgr2=0x7f8f841018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.179+0000 7f8f89440640 1 -- 172.21.15.17:0/1996797656 shutdown_connections 2024-08-19T00:47:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:05.179+0000 7f8f89440640 1 -- 172.21.15.17:0/1996797656 wait complete. 2024-08-19T00:47:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-19T00:47:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:Adding key to root@localhost authorized_keys... 2024-08-19T00:47:05.890 INFO:teuthology.orchestra.run.smithi017.stdout:Adding host smithi017... 2024-08-19T00:47:06.247 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:06 smithi017 ceph-mon[16627]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:07.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:07 smithi017 ceph-mon[16627]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:08.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:08 smithi017 ceph-mon[16627]: Deploying cephadm binary to smithi017 2024-08-19T00:47:10.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Added host 'smithi017' with addr '172.21.15.17' 2024-08-19T00:47:10.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.259+0000 7f8fa5be3640 1 Processor -- start 2024-08-19T00:47:10.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.259+0000 7f8fa5be3640 1 -- start start 2024-08-19T00:47:10.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.259+0000 7f8fa5be3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa007a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.370 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.259+0000 7f8fa5be3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa007a7f0 con 0x7f8fa007be50 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.259+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa007a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.259+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa007a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47156/0 (socket says 172.21.15.17:47156) 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.259+0000 7f8f9f7fe640 1 -- 172.21.15.17:0/1680297901 learned_addr learned my addr 172.21.15.17:0/1680297901 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.259+0000 7f8f9f7fe640 1 -- 172.21.15.17:0/1680297901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa007a930 con 0x7f8fa007be50 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.260+0000 7f8f9f7fe640 1 --2- 172.21.15.17:0/1680297901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa007a2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009820 tx=0x7f8f9002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55dbdee054d0bbc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.260+0000 7f8f9e7fc640 1 -- 172.21.15.17:0/1680297901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f9002ad40 con 0x7f8fa007be50 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.260+0000 7f8f9e7fc640 1 -- 172.21.15.17:0/1680297901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f8f900328c0 con 0x7f8fa007be50 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.260+0000 7f8f9e7fc640 1 -- 172.21.15.17:0/1680297901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f900307f0 con 0x7f8fa007be50 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.261+0000 7f8fa5be3640 1 -- 172.21.15.17:0/1680297901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 msgr2=0x7f8fa007a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.261+0000 7f8fa5be3640 1 --2- 172.21.15.17:0/1680297901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa007a2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f90009820 tx=0x7f8f9002a270 comp rx=0 tx=0).stop 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.261+0000 7f8fa5be3640 1 -- 172.21.15.17:0/1680297901 shutdown_connections 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.261+0000 7f8fa5be3640 1 --2- 172.21.15.17:0/1680297901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa007a2b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.261+0000 7f8fa5be3640 1 -- 172.21.15.17:0/1680297901 >> 172.21.15.17:0/1680297901 conn(0x7f8fa0100d70 msgr2=0x7f8fa0103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:10.371 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.261+0000 7f8fa5be3640 1 -- 172.21.15.17:0/1680297901 shutdown_connections 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.261+0000 7f8fa5be3640 1 -- 172.21.15.17:0/1680297901 wait complete. 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.262+0000 7f8fa5be3640 1 Processor -- start 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.262+0000 7f8fa5be3640 1 -- start start 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.262+0000 7f8fa5be3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa019b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.262+0000 7f8fa5be3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa019ba00 con 0x7f8fa007be50 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.262+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa019b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.262+0000 7f8f9f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa019b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47166/0 (socket says 172.21.15.17:47166) 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.262+0000 7f8f9f7fe640 1 -- 172.21.15.17:0/3391962863 learned_addr learned my addr 172.21.15.17:0/3391962863 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.262+0000 7f8f9f7fe640 1 -- 172.21.15.17:0/3391962863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f900094d0 con 0x7f8fa007be50 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.263+0000 7f8f9f7fe640 1 --2- 172.21.15.17:0/3391962863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa019b4c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8f90030d30 tx=0x7f8f90030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.263+0000 7f8f9cff9640 1 -- 172.21.15.17:0/3391962863 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f90032c40 con 0x7f8fa007be50 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.263+0000 7f8f9cff9640 1 -- 172.21.15.17:0/3391962863 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f8f90032da0 con 0x7f8fa007be50 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.263+0000 7f8f9cff9640 1 -- 172.21.15.17:0/3391962863 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f9003c660 con 0x7f8fa007be50 2024-08-19T00:47:10.372 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.263+0000 7f8fa5be3640 1 -- 172.21.15.17:0/3391962863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa019bc00 con 0x7f8fa007be50 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.263+0000 7f8fa5be3640 1 -- 172.21.15.17:0/3391962863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa019c020 con 0x7f8fa007be50 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.264+0000 7f8f9cff9640 1 -- 172.21.15.17:0/3391962863 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f8f9003db00 con 0x7f8fa007be50 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.264+0000 7f8fa5be3640 1 -- 172.21.15.17:0/3391962863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa010b900 con 0x7f8fa007be50 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.264+0000 7f8f9cff9640 1 --2- 172.21.15.17:0/3391962863 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f880386a0 0x7f8f8803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.264+0000 7f8f9cff9640 1 -- 172.21.15.17:0/3391962863 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8f9006b790 con 0x7f8fa007be50 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.264+0000 7f8f9effd640 1 --2- 172.21.15.17:0/3391962863 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f880386a0 0x7f8f8803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.264+0000 7f8f9effd640 1 --2- 172.21.15.17:0/3391962863 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f880386a0 0x7f8f8803ab60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8f940098c0 tx=0x7f8f94006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.269+0000 7f8f9cff9640 1 -- 172.21.15.17:0/3391962863 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f8f90045b50 con 0x7f8fa007be50 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:06.443+0000 7f8fa5be3640 1 -- 172.21.15.17:0/3391962863 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi017", "addr": "172.21.15.17", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fa0102050 con 0x7f8f880386a0 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:09.732+0000 7f8f9cff9640 1 -- 172.21.15.17:0/3391962863 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f8fa0102050 con 0x7f8f880386a0 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:09.735+0000 7f8fa5be3640 1 -- 172.21.15.17:0/3391962863 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f880386a0 msgr2=0x7f8f8803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:09.735+0000 7f8fa5be3640 1 --2- 172.21.15.17:0/3391962863 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f880386a0 0x7f8f8803ab60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8f940098c0 tx=0x7f8f94006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.373 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:09.735+0000 7f8fa5be3640 1 -- 172.21.15.17:0/3391962863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 msgr2=0x7f8fa019b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:10.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:09.735+0000 7f8fa5be3640 1 --2- 172.21.15.17:0/3391962863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa019b4c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8f90030d30 tx=0x7f8f90030d60 comp rx=0 tx=0).stop 2024-08-19T00:47:10.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:09.735+0000 7f8fa5be3640 1 -- 172.21.15.17:0/3391962863 shutdown_connections 2024-08-19T00:47:10.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:09.735+0000 7f8fa5be3640 1 --2- 172.21.15.17:0/3391962863 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f8f880386a0 0x7f8f8803ab60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:09.735+0000 7f8fa5be3640 1 --2- 172.21.15.17:0/3391962863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fa007be50 0x7f8fa019b4c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:10.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:09.735+0000 7f8fa5be3640 1 -- 172.21.15.17:0/3391962863 >> 172.21.15.17:0/3391962863 conn(0x7f8fa0100d70 msgr2=0x7f8fa0101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:10.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:09.736+0000 7f8fa5be3640 1 -- 172.21.15.17:0/3391962863 shutdown_connections 2024-08-19T00:47:10.374 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:09.736+0000 7f8fa5be3640 1 -- 172.21.15.17:0/3391962863 wait complete. 2024-08-19T00:47:10.374 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying mon service with default placement... 2024-08-19T00:47:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:10 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:10 smithi017 ceph-mon[16627]: Added host smithi017 2024-08-19T00:47:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:10 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:47:11.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-19T00:47:11.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.785+0000 7f1362810640 1 Processor -- start 2024-08-19T00:47:11.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.785+0000 7f1362810640 1 -- start start 2024-08-19T00:47:11.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.786+0000 7f1362810640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c108480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:11.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.786+0000 7f1362810640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c079e60 con 0x7f135c106090 2024-08-19T00:47:11.713 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.786+0000 7f135bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:11.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.786+0000 7f135bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36898/0 (socket says 172.21.15.17:36898) 2024-08-19T00:47:11.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.786+0000 7f135bfff640 1 -- 172.21.15.17:0/1691589981 learned_addr learned my addr 172.21.15.17:0/1691589981 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:11.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.786+0000 7f135bfff640 1 -- 172.21.15.17:0/1691589981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f135c1089c0 con 0x7f135c106090 2024-08-19T00:47:11.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.787+0000 7f135bfff640 1 --2- 172.21.15.17:0/1691589981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c108480 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f134c009820 tx=0x7f134c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2798d806aa6d9f server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:11.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.787+0000 7f135affd640 1 -- 172.21.15.17:0/1691589981 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f134c02ad40 con 0x7f135c106090 2024-08-19T00:47:11.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.787+0000 7f135affd640 1 -- 172.21.15.17:0/1691589981 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f134c0328c0 con 0x7f135c106090 2024-08-19T00:47:11.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.787+0000 7f135affd640 1 -- 172.21.15.17:0/1691589981 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f134c0307f0 con 0x7f135c106090 2024-08-19T00:47:11.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.788+0000 7f1362810640 1 -- 172.21.15.17:0/1691589981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 msgr2=0x7f135c108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:11.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.788+0000 7f1362810640 1 --2- 172.21.15.17:0/1691589981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c108480 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f134c009820 tx=0x7f134c02a270 comp rx=0 tx=0).stop 2024-08-19T00:47:11.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.788+0000 7f1362810640 1 -- 172.21.15.17:0/1691589981 shutdown_connections 2024-08-19T00:47:11.714 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.788+0000 7f1362810640 1 --2- 172.21.15.17:0/1691589981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c108480 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.788+0000 7f1362810640 1 -- 172.21.15.17:0/1691589981 >> 172.21.15.17:0/1691589981 conn(0x7f135c0ffc50 msgr2=0x7f135c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.788+0000 7f1362810640 1 -- 172.21.15.17:0/1691589981 shutdown_connections 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.788+0000 7f1362810640 1 -- 172.21.15.17:0/1691589981 wait complete. 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.788+0000 7f1362810640 1 Processor -- start 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.788+0000 7f1362810640 1 -- start start 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f1362810640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f1362810640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135c199800 con 0x7f135c106090 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f135bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f135bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c1992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36902/0 (socket says 172.21.15.17:36902) 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f135bfff640 1 -- 172.21.15.17:0/604120016 learned_addr learned my addr 172.21.15.17:0/604120016 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f135bfff640 1 -- 172.21.15.17:0/604120016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c0094d0 con 0x7f135c106090 2024-08-19T00:47:11.715 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f135bfff640 1 --2- 172.21.15.17:0/604120016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c1992c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f134c009940 tx=0x7f134c032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f13597fa640 1 -- 172.21.15.17:0/604120016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f134c041070 con 0x7f135c106090 2024-08-19T00:47:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f13597fa640 1 -- 172.21.15.17:0/604120016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7f134c030cc0 con 0x7f135c106090 2024-08-19T00:47:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f1362810640 1 -- 172.21.15.17:0/604120016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135c199a00 con 0x7f135c106090 2024-08-19T00:47:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f13597fa640 1 -- 172.21.15.17:0/604120016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f134c03c620 con 0x7f135c106090 2024-08-19T00:47:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.789+0000 7f1362810640 1 -- 172.21.15.17:0/604120016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135c199e20 con 0x7f135c106090 2024-08-19T00:47:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.790+0000 7f13597fa640 1 -- 172.21.15.17:0/604120016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f134c03c780 con 0x7f135c106090 2024-08-19T00:47:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.790+0000 7f13597fa640 1 --2- 172.21.15.17:0/604120016 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f13440386a0 0x7f134403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.790+0000 7f1362810640 1 -- 172.21.15.17:0/604120016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135c109710 con 0x7f135c106090 2024-08-19T00:47:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.790+0000 7f13597fa640 1 -- 172.21.15.17:0/604120016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f134c06b750 con 0x7f135c106090 2024-08-19T00:47:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.790+0000 7f135b7fe640 1 --2- 172.21.15.17:0/604120016 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f13440386a0 0x7f134403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:11.716 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.791+0000 7f135b7fe640 1 --2- 172.21.15.17:0/604120016 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f13440386a0 0x7f134403ab60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f13500098c0 tx=0x7f1350006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.795+0000 7f13597fa640 1 -- 172.21.15.17:0/604120016 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f134c046410 con 0x7f135c106090 2024-08-19T00:47:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.992+0000 7f1362810640 1 -- 172.21.15.17:0/604120016 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f135c100f40 con 0x7f13440386a0 2024-08-19T00:47:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.996+0000 7f13597fa640 1 -- 172.21.15.17:0/604120016 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f135c100f40 con 0x7f13440386a0 2024-08-19T00:47:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.998+0000 7f1362810640 1 -- 172.21.15.17:0/604120016 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f13440386a0 msgr2=0x7f134403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.998+0000 7f1362810640 1 --2- 172.21.15.17:0/604120016 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f13440386a0 0x7f134403ab60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f13500098c0 tx=0x7f1350006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.998+0000 7f1362810640 1 -- 172.21.15.17:0/604120016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 msgr2=0x7f135c1992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.998+0000 7f1362810640 1 --2- 172.21.15.17:0/604120016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c1992c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f134c009940 tx=0x7f134c032c60 comp rx=0 tx=0).stop 2024-08-19T00:47:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.998+0000 7f1362810640 1 -- 172.21.15.17:0/604120016 shutdown_connections 2024-08-19T00:47:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.998+0000 7f1362810640 1 --2- 172.21.15.17:0/604120016 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f13440386a0 0x7f134403ab60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:11.717 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.998+0000 7f1362810640 1 --2- 172.21.15.17:0/604120016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f135c106090 0x7f135c1992c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:11.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.998+0000 7f1362810640 1 -- 172.21.15.17:0/604120016 >> 172.21.15.17:0/604120016 conn(0x7f135c0ffc50 msgr2=0x7f135c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:11.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.998+0000 7f1362810640 1 -- 172.21.15.17:0/604120016 shutdown_connections 2024-08-19T00:47:11.718 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:10.998+0000 7f1362810640 1 -- 172.21.15.17:0/604120016 wait complete. 2024-08-19T00:47:11.718 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying mgr service with default placement... 2024-08-19T00:47:12.275 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:11 smithi017 ceph-mon[16627]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:12.275 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:11 smithi017 ceph-mon[16627]: Saving service mon spec with placement count:5 2024-08-19T00:47:12.275 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:11 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:12.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-19T00:47:12.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.112+0000 7ff8e49df640 1 Processor -- start 2024-08-19T00:47:12.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.112+0000 7ff8e49df640 1 -- start start 2024-08-19T00:47:12.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.112+0000 7ff8e49df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e007a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:12.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.112+0000 7ff8e49df640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e007a8a0 con 0x7ff8e007be70 2024-08-19T00:47:12.887 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.113+0000 7ff8de59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e007a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.113+0000 7ff8de59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e007a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36918/0 (socket says 172.21.15.17:36918) 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.113+0000 7ff8de59c640 1 -- 172.21.15.17:0/3808502958 learned_addr learned my addr 172.21.15.17:0/3808502958 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.113+0000 7ff8de59c640 1 -- 172.21.15.17:0/3808502958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e007a9e0 con 0x7ff8e007be70 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.114+0000 7ff8de59c640 1 --2- 172.21.15.17:0/3808502958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e007a2d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009e80 tx=0x7ff8d002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921fee5f94382789 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.114+0000 7ff8dd59a640 1 -- 172.21.15.17:0/3808502958 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8d0031400 con 0x7ff8e007be70 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.114+0000 7ff8dd59a640 1 -- 172.21.15.17:0/3808502958 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ff8d002d050 con 0x7ff8e007be70 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.114+0000 7ff8dd59a640 1 -- 172.21.15.17:0/3808502958 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8d0007910 con 0x7ff8e007be70 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.114+0000 7ff8e49df640 1 -- 172.21.15.17:0/3808502958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 msgr2=0x7ff8e007a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.114+0000 7ff8e49df640 1 --2- 172.21.15.17:0/3808502958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e007a2d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009e80 tx=0x7ff8d002a7a0 comp rx=0 tx=0).stop 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.114+0000 7ff8e49df640 1 -- 172.21.15.17:0/3808502958 shutdown_connections 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.114+0000 7ff8e49df640 1 --2- 172.21.15.17:0/3808502958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e007a2d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.114+0000 7ff8e49df640 1 -- 172.21.15.17:0/3808502958 >> 172.21.15.17:0/3808502958 conn(0x7ff8e0100d80 msgr2=0x7ff8e01031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:12.888 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.115+0000 7ff8e49df640 1 -- 172.21.15.17:0/3808502958 shutdown_connections 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.115+0000 7ff8e49df640 1 -- 172.21.15.17:0/3808502958 wait complete. 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.115+0000 7ff8e49df640 1 Processor -- start 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.115+0000 7ff8e49df640 1 -- start start 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.115+0000 7ff8e49df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e019b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.115+0000 7ff8e49df640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e019bab0 con 0x7ff8e007be70 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.116+0000 7ff8de59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e019b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.116+0000 7ff8de59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e019b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36928/0 (socket says 172.21.15.17:36928) 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.116+0000 7ff8de59c640 1 -- 172.21.15.17:0/2992542383 learned_addr learned my addr 172.21.15.17:0/2992542383 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.116+0000 7ff8de59c640 1 -- 172.21.15.17:0/2992542383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0009b30 con 0x7ff8e007be70 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.116+0000 7ff8de59c640 1 --2- 172.21.15.17:0/2992542383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e019b570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0031630 tx=0x7ff8d00075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.116+0000 7ff8cf7fe640 1 -- 172.21.15.17:0/2992542383 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8d0031b50 con 0x7ff8e007be70 2024-08-19T00:47:12.889 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.116+0000 7ff8cf7fe640 1 -- 172.21.15.17:0/2992542383 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7ff8d0031cb0 con 0x7ff8e007be70 2024-08-19T00:47:12.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.116+0000 7ff8e49df640 1 -- 172.21.15.17:0/2992542383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e019bcb0 con 0x7ff8e007be70 2024-08-19T00:47:12.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.116+0000 7ff8cf7fe640 1 -- 172.21.15.17:0/2992542383 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff8d003a6b0 con 0x7ff8e007be70 2024-08-19T00:47:12.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.116+0000 7ff8e49df640 1 -- 172.21.15.17:0/2992542383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e019c1b0 con 0x7ff8e007be70 2024-08-19T00:47:12.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.117+0000 7ff8cf7fe640 1 -- 172.21.15.17:0/2992542383 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7ff8d0038040 con 0x7ff8e007be70 2024-08-19T00:47:12.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.117+0000 7ff8cf7fe640 1 --2- 172.21.15.17:0/2992542383 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ff8c8038650 0x7ff8c803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:12.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.117+0000 7ff8cf7fe640 1 -- 172.21.15.17:0/2992542383 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff8d006b890 con 0x7ff8e007be70 2024-08-19T00:47:12.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.117+0000 7ff8e49df640 1 -- 172.21.15.17:0/2992542383 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e010b940 con 0x7ff8e007be70 2024-08-19T00:47:12.890 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.118+0000 7ff8ddd9b640 1 --2- 172.21.15.17:0/2992542383 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ff8c8038650 0x7ff8c803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.118+0000 7ff8ddd9b640 1 --2- 172.21.15.17:0/2992542383 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ff8c8038650 0x7ff8c803ab10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40098c0 tx=0x7ff8d4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.122+0000 7ff8cf7fe640 1 -- 172.21.15.17:0/2992542383 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff8d0040080 con 0x7ff8e007be70 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.306+0000 7ff8e49df640 1 -- 172.21.15.17:0/2992542383 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8e01020f0 con 0x7ff8c8038650 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.311+0000 7ff8cf7fe640 1 -- 172.21.15.17:0/2992542383 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff8e01020f0 con 0x7ff8c8038650 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.313+0000 7ff8e49df640 1 -- 172.21.15.17:0/2992542383 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ff8c8038650 msgr2=0x7ff8c803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.313+0000 7ff8e49df640 1 --2- 172.21.15.17:0/2992542383 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ff8c8038650 0x7ff8c803ab10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff8d40098c0 tx=0x7ff8d4006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.313+0000 7ff8e49df640 1 -- 172.21.15.17:0/2992542383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 msgr2=0x7ff8e019b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.313+0000 7ff8e49df640 1 --2- 172.21.15.17:0/2992542383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e019b570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0031630 tx=0x7ff8d00075c0 comp rx=0 tx=0).stop 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.313+0000 7ff8e49df640 1 -- 172.21.15.17:0/2992542383 shutdown_connections 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.313+0000 7ff8e49df640 1 --2- 172.21.15.17:0/2992542383 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7ff8c8038650 0x7ff8c803ab10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.313+0000 7ff8e49df640 1 --2- 172.21.15.17:0/2992542383 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8e007be70 0x7ff8e019b570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.313+0000 7ff8e49df640 1 -- 172.21.15.17:0/2992542383 >> 172.21.15.17:0/2992542383 conn(0x7ff8e0100d80 msgr2=0x7ff8e01019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:12.891 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.313+0000 7ff8e49df640 1 -- 172.21.15.17:0/2992542383 shutdown_connections 2024-08-19T00:47:12.892 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:12.313+0000 7ff8e49df640 1 -- 172.21.15.17:0/2992542383 wait complete. 2024-08-19T00:47:12.892 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying crash service with default placement... 2024-08-19T00:47:13.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:13 smithi017 ceph-mon[16627]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:13 smithi017 ceph-mon[16627]: Saving service mgr spec with placement count:2 2024-08-19T00:47:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:13 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-08-19T00:47:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.438+0000 7fa17a1e3640 1 Processor -- start 2024-08-19T00:47:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.438+0000 7fa17a1e3640 1 -- start start 2024-08-19T00:47:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.438+0000 7fa17a1e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa174103ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.438+0000 7fa17a1e3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1741042b0 con 0x7fa1741038e0 2024-08-19T00:47:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.438+0000 7fa1737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa174103ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.438+0000 7fa1737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa174103ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36934/0 (socket says 172.21.15.17:36934) 2024-08-19T00:47:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.438+0000 7fa1737fe640 1 -- 172.21.15.17:0/49762142 learned_addr learned my addr 172.21.15.17:0/49762142 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.439+0000 7fa1737fe640 1 -- 172.21.15.17:0/49762142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1741043f0 con 0x7fa1741038e0 2024-08-19T00:47:14.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.439+0000 7fa1737fe640 1 --2- 172.21.15.17:0/49762142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa174103ce0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa164009820 tx=0x7fa16402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d35805eb254a68 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.440+0000 7fa172ffd640 1 -- 172.21.15.17:0/49762142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa16402ad40 con 0x7fa1741038e0 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.440+0000 7fa172ffd640 1 -- 172.21.15.17:0/49762142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fa1640328c0 con 0x7fa1741038e0 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.440+0000 7fa172ffd640 1 -- 172.21.15.17:0/49762142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1640307f0 con 0x7fa1741038e0 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.440+0000 7fa17a1e3640 1 -- 172.21.15.17:0/49762142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 msgr2=0x7fa174103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.440+0000 7fa17a1e3640 1 --2- 172.21.15.17:0/49762142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa174103ce0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa164009820 tx=0x7fa16402a270 comp rx=0 tx=0).stop 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.440+0000 7fa17a1e3640 1 -- 172.21.15.17:0/49762142 shutdown_connections 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.440+0000 7fa17a1e3640 1 --2- 172.21.15.17:0/49762142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa174103ce0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.440+0000 7fa17a1e3640 1 -- 172.21.15.17:0/49762142 >> 172.21.15.17:0/49762142 conn(0x7fa1740ff410 msgr2=0x7fa174101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.440+0000 7fa17a1e3640 1 -- 172.21.15.17:0/49762142 shutdown_connections 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.440+0000 7fa17a1e3640 1 -- 172.21.15.17:0/49762142 wait complete. 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.441+0000 7fa17a1e3640 1 Processor -- start 2024-08-19T00:47:14.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.441+0000 7fa17a1e3640 1 -- start start 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.441+0000 7fa17a1e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa1741992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.441+0000 7fa17a1e3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa174199810 con 0x7fa1741038e0 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.441+0000 7fa1737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa1741992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.441+0000 7fa1737fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa1741992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36936/0 (socket says 172.21.15.17:36936) 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.441+0000 7fa1737fe640 1 -- 172.21.15.17:0/270898497 learned_addr learned my addr 172.21.15.17:0/270898497 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.442+0000 7fa1737fe640 1 -- 172.21.15.17:0/270898497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640094d0 con 0x7fa1741038e0 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.442+0000 7fa1737fe640 1 --2- 172.21.15.17:0/270898497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa1741992d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa164030d30 tx=0x7fa164030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.442+0000 7fa1717fa640 1 -- 172.21.15.17:0/270898497 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa164032c40 con 0x7fa1741038e0 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.442+0000 7fa1717fa640 1 -- 172.21.15.17:0/270898497 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1042+0+0 (secure 0 0 0) 0x7fa164032da0 con 0x7fa1741038e0 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.442+0000 7fa17a1e3640 1 -- 172.21.15.17:0/270898497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa174199a10 con 0x7fa1741038e0 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.442+0000 7fa1717fa640 1 -- 172.21.15.17:0/270898497 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa16403c660 con 0x7fa1741038e0 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.442+0000 7fa17a1e3640 1 -- 172.21.15.17:0/270898497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa174199e90 con 0x7fa1741038e0 2024-08-19T00:47:14.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.443+0000 7fa1717fa640 1 -- 172.21.15.17:0/270898497 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fa16403c7c0 con 0x7fa1741038e0 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.443+0000 7fa17a1e3640 1 -- 172.21.15.17:0/270898497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa174103ce0 con 0x7fa1741038e0 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.443+0000 7fa1717fa640 1 --2- 172.21.15.17:0/270898497 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fa1600386a0 0x7fa16003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.443+0000 7fa1717fa640 1 -- 172.21.15.17:0/270898497 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa16406b980 con 0x7fa1741038e0 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.443+0000 7fa16affd640 1 --2- 172.21.15.17:0/270898497 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fa1600386a0 0x7fa16003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.444+0000 7fa16affd640 1 --2- 172.21.15.17:0/270898497 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fa1600386a0 0x7fa16003ab60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa15c0098c0 tx=0x7fa15c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.448+0000 7fa1717fa640 1 -- 172.21.15.17:0/270898497 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fa16403bda0 con 0x7fa1741038e0 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.630+0000 7fa17a1e3640 1 -- 172.21.15.17:0/270898497 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1741006e0 con 0x7fa1600386a0 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.634+0000 7fa1717fa640 1 -- 172.21.15.17:0/270898497 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fa1741006e0 con 0x7fa1600386a0 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.636+0000 7fa17a1e3640 1 -- 172.21.15.17:0/270898497 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fa1600386a0 msgr2=0x7fa16003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.636+0000 7fa17a1e3640 1 --2- 172.21.15.17:0/270898497 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fa1600386a0 0x7fa16003ab60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa15c0098c0 tx=0x7fa15c006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.636+0000 7fa17a1e3640 1 -- 172.21.15.17:0/270898497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 msgr2=0x7fa1741992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.636+0000 7fa17a1e3640 1 --2- 172.21.15.17:0/270898497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa1741992d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa164030d30 tx=0x7fa164030d60 comp rx=0 tx=0).stop 2024-08-19T00:47:14.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.636+0000 7fa17a1e3640 1 -- 172.21.15.17:0/270898497 shutdown_connections 2024-08-19T00:47:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.636+0000 7fa17a1e3640 1 --2- 172.21.15.17:0/270898497 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fa1600386a0 0x7fa16003ab60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.636+0000 7fa17a1e3640 1 --2- 172.21.15.17:0/270898497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1741038e0 0x7fa1741992d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.636+0000 7fa17a1e3640 1 -- 172.21.15.17:0/270898497 >> 172.21.15.17:0/270898497 conn(0x7fa1740ff410 msgr2=0x7fa1740fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.636+0000 7fa17a1e3640 1 -- 172.21.15.17:0/270898497 shutdown_connections 2024-08-19T00:47:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:13.636+0000 7fa17a1e3640 1 -- 172.21.15.17:0/270898497 wait complete. 2024-08-19T00:47:14.609 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying ceph-exporter service with default placement... 2024-08-19T00:47:14.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:14 smithi017 ceph-mon[16627]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:14.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:14 smithi017 ceph-mon[16627]: Saving service crash spec with placement * 2024-08-19T00:47:14.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:14 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:14.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:14 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:14.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:14 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:16.516 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:16 smithi017 ceph-mon[16627]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:16.516 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:16 smithi017 ceph-mon[16627]: Saving service ceph-exporter spec with placement * 2024-08-19T00:47:16.516 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:16 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:16.516 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:16 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:16.523 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-08-19T00:47:16.523 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.995+0000 7f83ef8cc640 1 Processor -- start 2024-08-19T00:47:16.523 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.995+0000 7f83ef8cc640 1 -- start start 2024-08-19T00:47:16.523 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.995+0000 7f83ef8cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e8103cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.523 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.995+0000 7f83ef8cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8104290 con 0x7f83e81038c0 2024-08-19T00:47:16.523 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.996+0000 7f83ed668640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e8103cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.996+0000 7f83ed668640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e8103cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36942/0 (socket says 172.21.15.17:36942) 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.996+0000 7f83ed668640 1 -- 172.21.15.17:0/263932417 learned_addr learned my addr 172.21.15.17:0/263932417 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.996+0000 7f83ed668640 1 -- 172.21.15.17:0/263932417 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e81043d0 con 0x7f83e81038c0 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.997+0000 7f83ed668640 1 --2- 172.21.15.17:0/263932417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e8103cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009820 tx=0x7f83e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3031cd806a8edd61 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.997+0000 7f83dffff640 1 -- 172.21.15.17:0/263932417 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83e402ad40 con 0x7f83e81038c0 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.997+0000 7f83dffff640 1 -- 172.21.15.17:0/263932417 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83e4032900 con 0x7f83e81038c0 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.997+0000 7f83dffff640 1 -- 172.21.15.17:0/263932417 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83e4030860 con 0x7f83e81038c0 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.998+0000 7f83ef8cc640 1 -- 172.21.15.17:0/263932417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 msgr2=0x7f83e8103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.998+0000 7f83ef8cc640 1 --2- 172.21.15.17:0/263932417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e8103cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009820 tx=0x7f83e402a270 comp rx=0 tx=0).stop 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.998+0000 7f83ef8cc640 1 -- 172.21.15.17:0/263932417 shutdown_connections 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.998+0000 7f83ef8cc640 1 --2- 172.21.15.17:0/263932417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e8103cc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.998+0000 7f83ef8cc640 1 -- 172.21.15.17:0/263932417 >> 172.21.15.17:0/263932417 conn(0x7f83e80ff3f0 msgr2=0x7f83e8101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:16.524 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.998+0000 7f83ef8cc640 1 -- 172.21.15.17:0/263932417 shutdown_connections 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.998+0000 7f83ef8cc640 1 -- 172.21.15.17:0/263932417 wait complete. 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.999+0000 7f83ef8cc640 1 Processor -- start 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.999+0000 7f83ef8cc640 1 -- start start 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.999+0000 7f83ef8cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e819b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.999+0000 7f83ef8cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e819bad0 con 0x7f83e81038c0 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.999+0000 7f83ed668640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e819b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.999+0000 7f83ed668640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e819b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36944/0 (socket says 172.21.15.17:36944) 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:14.999+0000 7f83ed668640 1 -- 172.21.15.17:0/969303120 learned_addr learned my addr 172.21.15.17:0/969303120 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.000+0000 7f83ed668640 1 -- 172.21.15.17:0/969303120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e40094d0 con 0x7f83e81038c0 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.000+0000 7f83ed668640 1 --2- 172.21.15.17:0/969303120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e819b590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009940 tx=0x7f83e4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.000+0000 7f83de7fc640 1 -- 172.21.15.17:0/969303120 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83e4032c80 con 0x7f83e81038c0 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.000+0000 7f83ef8cc640 1 -- 172.21.15.17:0/969303120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e819bcd0 con 0x7f83e81038c0 2024-08-19T00:47:16.525 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.000+0000 7f83de7fc640 1 -- 172.21.15.17:0/969303120 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83e4032de0 con 0x7f83e81038c0 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.000+0000 7f83de7fc640 1 -- 172.21.15.17:0/969303120 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83e403a720 con 0x7f83e81038c0 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.000+0000 7f83ef8cc640 1 -- 172.21.15.17:0/969303120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e819c170 con 0x7f83e81038c0 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.001+0000 7f83de7fc640 1 -- 172.21.15.17:0/969303120 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f83e403a950 con 0x7f83e81038c0 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.001+0000 7f83ef8cc640 1 -- 172.21.15.17:0/969303120 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e8109ad0 con 0x7f83e81038c0 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.001+0000 7f83de7fc640 1 --2- 172.21.15.17:0/969303120 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f83d4038650 0x7f83d403ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.001+0000 7f83de7fc640 1 -- 172.21.15.17:0/969303120 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f83e406b8e0 con 0x7f83e81038c0 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.002+0000 7f83ece67640 1 --2- 172.21.15.17:0/969303120 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f83d4038650 0x7f83d403ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.002+0000 7f83ece67640 1 --2- 172.21.15.17:0/969303120 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f83d4038650 0x7f83d403ab10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f83d80098c0 tx=0x7f83d8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.006+0000 7f83de7fc640 1 -- 172.21.15.17:0/969303120 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f83e4039b20 con 0x7f83e81038c0 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.198+0000 7f83ef8cc640 1 -- 172.21.15.17:0/969303120 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f83e819eab0 con 0x7f83d4038650 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.202+0000 7f83de7fc640 1 -- 172.21.15.17:0/969303120 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f83e819eab0 con 0x7f83d4038650 2024-08-19T00:47:16.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.204+0000 7f83ef8cc640 1 -- 172.21.15.17:0/969303120 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f83d4038650 msgr2=0x7f83d403ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.204+0000 7f83ef8cc640 1 --2- 172.21.15.17:0/969303120 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f83d4038650 0x7f83d403ab10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f83d80098c0 tx=0x7f83d8006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.204+0000 7f83ef8cc640 1 -- 172.21.15.17:0/969303120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 msgr2=0x7f83e819b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:16.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.204+0000 7f83ef8cc640 1 --2- 172.21.15.17:0/969303120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e819b590 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f83e4009940 tx=0x7f83e4032670 comp rx=0 tx=0).stop 2024-08-19T00:47:16.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.204+0000 7f83ef8cc640 1 -- 172.21.15.17:0/969303120 shutdown_connections 2024-08-19T00:47:16.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.204+0000 7f83ef8cc640 1 --2- 172.21.15.17:0/969303120 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f83d4038650 0x7f83d403ab10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.204+0000 7f83ef8cc640 1 --2- 172.21.15.17:0/969303120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83e81038c0 0x7f83e819b590 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:16.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.204+0000 7f83ef8cc640 1 -- 172.21.15.17:0/969303120 >> 172.21.15.17:0/969303120 conn(0x7f83e80ff3f0 msgr2=0x7f83e80fffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:16.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.204+0000 7f83ef8cc640 1 -- 172.21.15.17:0/969303120 shutdown_connections 2024-08-19T00:47:16.527 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:15.204+0000 7f83ef8cc640 1 -- 172.21.15.17:0/969303120 wait complete. 2024-08-19T00:47:16.527 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying prometheus service with default placement... 2024-08-19T00:47:17.696 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-08-19T00:47:17.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.913+0000 7f4ea9da0640 1 Processor -- start 2024-08-19T00:47:17.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.913+0000 7f4ea9da0640 1 -- start start 2024-08-19T00:47:17.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.913+0000 7f4ea9da0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea407a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.913+0000 7f4ea9da0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea407a8a0 con 0x7f4ea407be70 2024-08-19T00:47:17.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.914+0000 7f4ea8d9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea407a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.914+0000 7f4ea8d9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea407a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58802/0 (socket says 172.21.15.17:58802) 2024-08-19T00:47:17.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.914+0000 7f4ea8d9e640 1 -- 172.21.15.17:0/2368593177 learned_addr learned my addr 172.21.15.17:0/2368593177 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:17.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.914+0000 7f4ea8d9e640 1 -- 172.21.15.17:0/2368593177 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea407a9e0 con 0x7f4ea407be70 2024-08-19T00:47:17.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.915+0000 7f4ea8d9e640 1 --2- 172.21.15.17:0/2368593177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea407a2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009820 tx=0x7f4e9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8d31b73744b73d server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:17.697 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.915+0000 7f4ea37fe640 1 -- 172.21.15.17:0/2368593177 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e9802ad40 con 0x7f4ea407be70 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.915+0000 7f4ea37fe640 1 -- 172.21.15.17:0/2368593177 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e98032900 con 0x7f4ea407be70 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.915+0000 7f4ea37fe640 1 -- 172.21.15.17:0/2368593177 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e98030860 con 0x7f4ea407be70 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.915+0000 7f4ea9da0640 1 -- 172.21.15.17:0/2368593177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 msgr2=0x7f4ea407a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.915+0000 7f4ea9da0640 1 --2- 172.21.15.17:0/2368593177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea407a2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e98009820 tx=0x7f4e9802a270 comp rx=0 tx=0).stop 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.915+0000 7f4ea9da0640 1 -- 172.21.15.17:0/2368593177 shutdown_connections 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.915+0000 7f4ea9da0640 1 --2- 172.21.15.17:0/2368593177 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea407a2d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.915+0000 7f4ea9da0640 1 -- 172.21.15.17:0/2368593177 >> 172.21.15.17:0/2368593177 conn(0x7f4ea4100c00 msgr2=0x7f4ea4103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.915+0000 7f4ea9da0640 1 -- 172.21.15.17:0/2368593177 shutdown_connections 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.915+0000 7f4ea9da0640 1 -- 172.21.15.17:0/2368593177 wait complete. 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.916+0000 7f4ea9da0640 1 Processor -- start 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.916+0000 7f4ea9da0640 1 -- start start 2024-08-19T00:47:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.916+0000 7f4ea9da0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea419b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.916+0000 7f4ea9da0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea419b840 con 0x7f4ea407be70 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.916+0000 7f4ea8d9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea419b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.916+0000 7f4ea8d9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea419b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58812/0 (socket says 172.21.15.17:58812) 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.916+0000 7f4ea8d9e640 1 -- 172.21.15.17:0/691409283 learned_addr learned my addr 172.21.15.17:0/691409283 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.916+0000 7f4ea8d9e640 1 -- 172.21.15.17:0/691409283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980094d0 con 0x7f4ea407be70 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.917+0000 7f4ea8d9e640 1 --2- 172.21.15.17:0/691409283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea419b300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e98032670 tx=0x7f4e980326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.917+0000 7f4ea1ffb640 1 -- 172.21.15.17:0/691409283 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e98032c80 con 0x7f4ea407be70 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.917+0000 7f4ea1ffb640 1 -- 172.21.15.17:0/691409283 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e98032de0 con 0x7f4ea407be70 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.917+0000 7f4ea1ffb640 1 -- 172.21.15.17:0/691409283 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4e9803a800 con 0x7f4ea407be70 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.917+0000 7f4ea9da0640 1 -- 172.21.15.17:0/691409283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea419ba40 con 0x7f4ea407be70 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.917+0000 7f4ea9da0640 1 -- 172.21.15.17:0/691409283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea419bee0 con 0x7f4ea407be70 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.918+0000 7f4ea1ffb640 1 -- 172.21.15.17:0/691409283 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f4e9803a960 con 0x7f4ea407be70 2024-08-19T00:47:17.699 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.918+0000 7f4ea9da0640 1 -- 172.21.15.17:0/691409283 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea410b7f0 con 0x7f4ea407be70 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.918+0000 7f4ea1ffb640 1 --2- 172.21.15.17:0/691409283 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f4e940386a0 0x7f4e9403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.918+0000 7f4ea1ffb640 1 -- 172.21.15.17:0/691409283 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4e9806b9c0 con 0x7f4ea407be70 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.918+0000 7f4ea3fff640 1 --2- 172.21.15.17:0/691409283 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f4e940386a0 0x7f4e9403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.919+0000 7f4ea3fff640 1 --2- 172.21.15.17:0/691409283 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f4e940386a0 0x7f4e9403ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4e900098c0 tx=0x7f4e90006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:16.923+0000 7f4ea1ffb640 1 -- 172.21.15.17:0/691409283 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f4e980319f0 con 0x7f4ea407be70 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.106+0000 7f4ea9da0640 1 -- 172.21.15.17:0/691409283 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ea4101e60 con 0x7f4e940386a0 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.111+0000 7f4ea1ffb640 1 -- 172.21.15.17:0/691409283 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f4ea4101e60 con 0x7f4e940386a0 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.113+0000 7f4ea9da0640 1 -- 172.21.15.17:0/691409283 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f4e940386a0 msgr2=0x7f4e9403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.113+0000 7f4ea9da0640 1 --2- 172.21.15.17:0/691409283 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f4e940386a0 0x7f4e9403ab60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4e900098c0 tx=0x7f4e90006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.113+0000 7f4ea9da0640 1 -- 172.21.15.17:0/691409283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 msgr2=0x7f4ea419b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.113+0000 7f4ea9da0640 1 --2- 172.21.15.17:0/691409283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea419b300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e98032670 tx=0x7f4e980326a0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.700 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.113+0000 7f4ea9da0640 1 -- 172.21.15.17:0/691409283 shutdown_connections 2024-08-19T00:47:17.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.113+0000 7f4ea9da0640 1 --2- 172.21.15.17:0/691409283 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f4e940386a0 0x7f4e9403ab60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.113+0000 7f4ea9da0640 1 --2- 172.21.15.17:0/691409283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ea407be70 0x7f4ea419b300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:17.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.113+0000 7f4ea9da0640 1 -- 172.21.15.17:0/691409283 >> 172.21.15.17:0/691409283 conn(0x7f4ea4100c00 msgr2=0x7f4ea4101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:17.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.113+0000 7f4ea9da0640 1 -- 172.21.15.17:0/691409283 shutdown_connections 2024-08-19T00:47:17.701 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:17.113+0000 7f4ea9da0640 1 -- 172.21.15.17:0/691409283 wait complete. 2024-08-19T00:47:17.701 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying grafana service with default placement... 2024-08-19T00:47:18.304 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:18 smithi017 ceph-mon[16627]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:18.305 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:18 smithi017 ceph-mon[16627]: Saving service prometheus spec with placement count:1 2024-08-19T00:47:18.305 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:18 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:18.895 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-08-19T00:47:18.895 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.104+0000 7f759242f640 1 Processor -- start 2024-08-19T00:47:18.895 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.104+0000 7f759242f640 1 -- start start 2024-08-19T00:47:18.895 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.104+0000 7f759242f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c1059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.895 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.104+0000 7f759242f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c105fa0 con 0x7f758c1055d0 2024-08-19T00:47:18.895 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.105+0000 7f758bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c1059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.895 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.105+0000 7f758bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c1059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58814/0 (socket says 172.21.15.17:58814) 2024-08-19T00:47:18.895 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.105+0000 7f758bfff640 1 -- 172.21.15.17:0/2858909815 learned_addr learned my addr 172.21.15.17:0/2858909815 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:18.895 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.105+0000 7f758bfff640 1 -- 172.21.15.17:0/2858909815 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c1067d0 con 0x7f758c1055d0 2024-08-19T00:47:18.895 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.105+0000 7f758bfff640 1 --2- 172.21.15.17:0/2858909815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c1059d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f757c009820 tx=0x7f757c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa68130223d39937 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.106+0000 7f758b7fe640 1 -- 172.21.15.17:0/2858909815 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f757c02ad40 con 0x7f758c1055d0 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.106+0000 7f758b7fe640 1 -- 172.21.15.17:0/2858909815 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f757c032900 con 0x7f758c1055d0 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.106+0000 7f758b7fe640 1 -- 172.21.15.17:0/2858909815 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f757c030860 con 0x7f758c1055d0 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.106+0000 7f759242f640 1 -- 172.21.15.17:0/2858909815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 msgr2=0x7f758c1059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.106+0000 7f759242f640 1 --2- 172.21.15.17:0/2858909815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c1059d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f757c009820 tx=0x7f757c02a270 comp rx=0 tx=0).stop 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.106+0000 7f759242f640 1 -- 172.21.15.17:0/2858909815 shutdown_connections 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.106+0000 7f759242f640 1 --2- 172.21.15.17:0/2858909815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c1059d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.106+0000 7f759242f640 1 -- 172.21.15.17:0/2858909815 >> 172.21.15.17:0/2858909815 conn(0x7f758c100d80 msgr2=0x7f758c1031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.106+0000 7f759242f640 1 -- 172.21.15.17:0/2858909815 shutdown_connections 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.106+0000 7f759242f640 1 -- 172.21.15.17:0/2858909815 wait complete. 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.107+0000 7f759242f640 1 Processor -- start 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.107+0000 7f759242f640 1 -- start start 2024-08-19T00:47:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.107+0000 7f759242f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.107+0000 7f759242f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c199850 con 0x7f758c1055d0 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.107+0000 7f758bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.107+0000 7f758bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58816/0 (socket says 172.21.15.17:58816) 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.107+0000 7f758bfff640 1 -- 172.21.15.17:0/1193008783 learned_addr learned my addr 172.21.15.17:0/1193008783 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.108+0000 7f758bfff640 1 -- 172.21.15.17:0/1193008783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c0094d0 con 0x7f758c1055d0 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.108+0000 7f758bfff640 1 --2- 172.21.15.17:0/1193008783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c199310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f757c0097f0 tx=0x7f757c030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.108+0000 7f7589ffb640 1 -- 172.21.15.17:0/1193008783 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f757c040070 con 0x7f758c1055d0 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.108+0000 7f7589ffb640 1 -- 172.21.15.17:0/1193008783 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f757c032dd0 con 0x7f758c1055d0 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.108+0000 7f759242f640 1 -- 172.21.15.17:0/1193008783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c199a50 con 0x7f758c1055d0 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.108+0000 7f7589ffb640 1 -- 172.21.15.17:0/1193008783 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f757c03a730 con 0x7f758c1055d0 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.108+0000 7f759242f640 1 -- 172.21.15.17:0/1193008783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758c199ef0 con 0x7f758c1055d0 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.109+0000 7f7589ffb640 1 -- 172.21.15.17:0/1193008783 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f757c03cc30 con 0x7f758c1055d0 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.109+0000 7f7589ffb640 1 --2- 172.21.15.17:0/1193008783 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7578038650 0x7f757803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:18.897 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.109+0000 7f7589ffb640 1 -- 172.21.15.17:0/1193008783 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f757c06b680 con 0x7f758c1055d0 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.109+0000 7f7583fff640 1 --2- 172.21.15.17:0/1193008783 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7578038650 0x7f757803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.109+0000 7f759242f640 1 -- 172.21.15.17:0/1193008783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758c1059d0 con 0x7f758c1055d0 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.110+0000 7f7583fff640 1 --2- 172.21.15.17:0/1193008783 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7578038650 0x7f757803ab10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f75740098c0 tx=0x7f7574006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.116+0000 7f7589ffb640 1 -- 172.21.15.17:0/1193008783 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f757c043920 con 0x7f758c1055d0 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.302+0000 7f759242f640 1 -- 172.21.15.17:0/1193008783 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f758c101fa0 con 0x7f7578038650 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.307+0000 7f7589ffb640 1 -- 172.21.15.17:0/1193008783 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f758c101fa0 con 0x7f7578038650 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.309+0000 7f759242f640 1 -- 172.21.15.17:0/1193008783 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7578038650 msgr2=0x7f757803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.309+0000 7f759242f640 1 --2- 172.21.15.17:0/1193008783 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7578038650 0x7f757803ab10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f75740098c0 tx=0x7f7574006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.309+0000 7f759242f640 1 -- 172.21.15.17:0/1193008783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 msgr2=0x7f758c199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.309+0000 7f759242f640 1 --2- 172.21.15.17:0/1193008783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c199310 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f757c0097f0 tx=0x7f757c030d50 comp rx=0 tx=0).stop 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.309+0000 7f759242f640 1 -- 172.21.15.17:0/1193008783 shutdown_connections 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.309+0000 7f759242f640 1 --2- 172.21.15.17:0/1193008783 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f7578038650 0x7f757803ab10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.898 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.309+0000 7f759242f640 1 --2- 172.21.15.17:0/1193008783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f758c1055d0 0x7f758c199310 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:18.899 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.309+0000 7f759242f640 1 -- 172.21.15.17:0/1193008783 >> 172.21.15.17:0/1193008783 conn(0x7f758c100d80 msgr2=0x7f758c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:18.899 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.309+0000 7f759242f640 1 -- 172.21.15.17:0/1193008783 shutdown_connections 2024-08-19T00:47:18.899 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:18.309+0000 7f759242f640 1 -- 172.21.15.17:0/1193008783 wait complete. 2024-08-19T00:47:18.899 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying node-exporter service with default placement... 2024-08-19T00:47:19.416 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:19 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:19.416 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:19 smithi017 ceph-mon[16627]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:19.416 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:19 smithi017 ceph-mon[16627]: Saving service grafana spec with placement count:1 2024-08-19T00:47:19.416 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:19 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:20.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-08-19T00:47:20.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.244+0000 7f2350065640 1 Processor -- start 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.244+0000 7f2350065640 1 -- start start 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.244+0000 7f2350065640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f23481059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.244+0000 7f2350065640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2348105fa0 con 0x7f23481055d0 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.245+0000 7f234de01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f23481059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.245+0000 7f234de01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f23481059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58822/0 (socket says 172.21.15.17:58822) 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.245+0000 7f234de01640 1 -- 172.21.15.17:0/3398079259 learned_addr learned my addr 172.21.15.17:0/3398079259 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.245+0000 7f234de01640 1 -- 172.21.15.17:0/3398079259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23481067d0 con 0x7f23481055d0 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.246+0000 7f234de01640 1 --2- 172.21.15.17:0/3398079259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f23481059d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2338009e80 tx=0x7f233802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73fadde6e61318fc server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.246+0000 7f234cdff640 1 -- 172.21.15.17:0/3398079259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2338031400 con 0x7f23481055d0 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.246+0000 7f234cdff640 1 -- 172.21.15.17:0/3398079259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f233802d050 con 0x7f23481055d0 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.246+0000 7f234cdff640 1 -- 172.21.15.17:0/3398079259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2338007930 con 0x7f23481055d0 2024-08-19T00:47:20.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.246+0000 7f2350065640 1 -- 172.21.15.17:0/3398079259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 msgr2=0x7f23481059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.246+0000 7f2350065640 1 --2- 172.21.15.17:0/3398079259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f23481059d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2338009e80 tx=0x7f233802a7a0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.246+0000 7f2350065640 1 -- 172.21.15.17:0/3398079259 shutdown_connections 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.246+0000 7f2350065640 1 --2- 172.21.15.17:0/3398079259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f23481059d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.246+0000 7f2350065640 1 -- 172.21.15.17:0/3398079259 >> 172.21.15.17:0/3398079259 conn(0x7f2348100d80 msgr2=0x7f23481031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.247+0000 7f2350065640 1 -- 172.21.15.17:0/3398079259 shutdown_connections 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.247+0000 7f2350065640 1 -- 172.21.15.17:0/3398079259 wait complete. 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.247+0000 7f2350065640 1 Processor -- start 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.247+0000 7f2350065640 1 -- start start 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.247+0000 7f2350065640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f2348199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.247+0000 7f2350065640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23481998d0 con 0x7f23481055d0 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.247+0000 7f234de01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f2348199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.248+0000 7f234de01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f2348199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58834/0 (socket says 172.21.15.17:58834) 2024-08-19T00:47:20.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.248+0000 7f234de01640 1 -- 172.21.15.17:0/2423258431 learned_addr learned my addr 172.21.15.17:0/2423258431 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.248+0000 7f234de01640 1 -- 172.21.15.17:0/2423258431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2338009b30 con 0x7f23481055d0 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.248+0000 7f234de01640 1 --2- 172.21.15.17:0/2423258431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f2348199390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f233802acc0 tx=0x7f23380319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.248+0000 7f2346ffd640 1 -- 172.21.15.17:0/2423258431 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f233803a550 con 0x7f23481055d0 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.248+0000 7f2346ffd640 1 -- 172.21.15.17:0/2423258431 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f233803ab70 con 0x7f23481055d0 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.248+0000 7f2350065640 1 -- 172.21.15.17:0/2423258431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2348199ad0 con 0x7f23481055d0 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.248+0000 7f2346ffd640 1 -- 172.21.15.17:0/2423258431 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2338039b20 con 0x7f23481055d0 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.248+0000 7f2350065640 1 -- 172.21.15.17:0/2423258431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2348199f70 con 0x7f23481055d0 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.249+0000 7f2346ffd640 1 -- 172.21.15.17:0/2423258431 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f2338038040 con 0x7f23481055d0 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.249+0000 7f2346ffd640 1 --2- 172.21.15.17:0/2423258431 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f2330038650 0x7f233003ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.249+0000 7f2346ffd640 1 -- 172.21.15.17:0/2423258431 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f233806b5e0 con 0x7f23481055d0 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.249+0000 7f234d600640 1 --2- 172.21.15.17:0/2423258431 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f2330038650 0x7f233003ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.249+0000 7f2350065640 1 -- 172.21.15.17:0/2423258431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2348105a50 con 0x7f23481055d0 2024-08-19T00:47:20.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.250+0000 7f234d600640 1 --2- 172.21.15.17:0/2423258431 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f2330038650 0x7f233003ab10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f233c0098c0 tx=0x7f233c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.254+0000 7f2346ffd640 1 -- 172.21.15.17:0/2423258431 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f2338041070 con 0x7f23481055d0 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.447+0000 7f2350065640 1 -- 172.21.15.17:0/2423258431 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f2348102040 con 0x7f2330038650 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.452+0000 7f2346ffd640 1 -- 172.21.15.17:0/2423258431 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f2348102040 con 0x7f2330038650 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.453+0000 7f2350065640 1 -- 172.21.15.17:0/2423258431 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f2330038650 msgr2=0x7f233003ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.453+0000 7f2350065640 1 --2- 172.21.15.17:0/2423258431 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f2330038650 0x7f233003ab10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f233c0098c0 tx=0x7f233c006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.454+0000 7f2350065640 1 -- 172.21.15.17:0/2423258431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 msgr2=0x7f2348199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.454+0000 7f2350065640 1 --2- 172.21.15.17:0/2423258431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f2348199390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f233802acc0 tx=0x7f23380319a0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.454+0000 7f2350065640 1 -- 172.21.15.17:0/2423258431 shutdown_connections 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.454+0000 7f2350065640 1 --2- 172.21.15.17:0/2423258431 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f2330038650 0x7f233003ab10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.454+0000 7f2350065640 1 --2- 172.21.15.17:0/2423258431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23481055d0 0x7f2348199390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.454+0000 7f2350065640 1 -- 172.21.15.17:0/2423258431 >> 172.21.15.17:0/2423258431 conn(0x7f2348100d80 msgr2=0x7f2348101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.454+0000 7f2350065640 1 -- 172.21.15.17:0/2423258431 shutdown_connections 2024-08-19T00:47:20.091 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:19.454+0000 7f2350065640 1 -- 172.21.15.17:0/2423258431 wait complete. 2024-08-19T00:47:20.092 INFO:teuthology.orchestra.run.smithi017.stdout:Deploying alertmanager service with default placement... 2024-08-19T00:47:20.758 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:20 smithi017 ceph-mon[16627]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:20.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:20 smithi017 ceph-mon[16627]: Saving service node-exporter spec with placement * 2024-08-19T00:47:20.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:20 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:20.759 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:20 smithi017 ceph-mon[16627]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:47:22.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-08-19T00:47:22.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.233+0000 7fb3949be640 1 Processor -- start 2024-08-19T00:47:22.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.233+0000 7fb3949be640 1 -- start start 2024-08-19T00:47:22.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.234+0000 7fb3949be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb3901059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:22.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.234+0000 7fb3949be640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb390105fa0 con 0x7fb3901055d0 2024-08-19T00:47:22.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.234+0000 7fb38e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb3901059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:22.002 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.234+0000 7fb38e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb3901059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58838/0 (socket says 172.21.15.17:58838) 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.234+0000 7fb38e59c640 1 -- 172.21.15.17:0/1392803095 learned_addr learned my addr 172.21.15.17:0/1392803095 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.234+0000 7fb38e59c640 1 -- 172.21.15.17:0/1392803095 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3901067d0 con 0x7fb3901055d0 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.235+0000 7fb38e59c640 1 --2- 172.21.15.17:0/1392803095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb3901059d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb380009e80 tx=0x7fb38002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b659733e7e5f1a server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.235+0000 7fb38d59a640 1 -- 172.21.15.17:0/1392803095 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb380031400 con 0x7fb3901055d0 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.235+0000 7fb38d59a640 1 -- 172.21.15.17:0/1392803095 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb38002d050 con 0x7fb3901055d0 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.235+0000 7fb38d59a640 1 -- 172.21.15.17:0/1392803095 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb380007930 con 0x7fb3901055d0 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.236+0000 7fb3949be640 1 -- 172.21.15.17:0/1392803095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 msgr2=0x7fb3901059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.236+0000 7fb3949be640 1 --2- 172.21.15.17:0/1392803095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb3901059d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb380009e80 tx=0x7fb38002a7a0 comp rx=0 tx=0).stop 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.236+0000 7fb3949be640 1 -- 172.21.15.17:0/1392803095 shutdown_connections 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.236+0000 7fb3949be640 1 --2- 172.21.15.17:0/1392803095 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb3901059d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.236+0000 7fb3949be640 1 -- 172.21.15.17:0/1392803095 >> 172.21.15.17:0/1392803095 conn(0x7fb390100d80 msgr2=0x7fb3901031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.236+0000 7fb3949be640 1 -- 172.21.15.17:0/1392803095 shutdown_connections 2024-08-19T00:47:22.003 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.236+0000 7fb3949be640 1 -- 172.21.15.17:0/1392803095 wait complete. 2024-08-19T00:47:22.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.237+0000 7fb3949be640 1 Processor -- start 2024-08-19T00:47:22.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.237+0000 7fb3949be640 1 -- start start 2024-08-19T00:47:22.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.237+0000 7fb3949be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb390199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:22.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.237+0000 7fb3949be640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3901998d0 con 0x7fb3901055d0 2024-08-19T00:47:22.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.237+0000 7fb38e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb390199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:22.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.237+0000 7fb38e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb390199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58844/0 (socket says 172.21.15.17:58844) 2024-08-19T00:47:22.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.237+0000 7fb38e59c640 1 -- 172.21.15.17:0/2281652452 learned_addr learned my addr 172.21.15.17:0/2281652452 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:22.004 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.237+0000 7fb38e59c640 1 -- 172.21.15.17:0/2281652452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380009b30 con 0x7fb3901055d0 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.238+0000 7fb38e59c640 1 --2- 172.21.15.17:0/2281652452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb390199390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb380009fa0 tx=0x7fb380031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.238+0000 7fb3877fe640 1 -- 172.21.15.17:0/2281652452 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb38003a400 con 0x7fb3901055d0 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.238+0000 7fb3877fe640 1 -- 172.21.15.17:0/2281652452 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb38003aa20 con 0x7fb3901055d0 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.238+0000 7fb3949be640 1 -- 172.21.15.17:0/2281652452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb390199ad0 con 0x7fb3901055d0 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.238+0000 7fb3877fe640 1 -- 172.21.15.17:0/2281652452 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb380039b90 con 0x7fb3901055d0 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.238+0000 7fb3949be640 1 -- 172.21.15.17:0/2281652452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb390199f70 con 0x7fb3901055d0 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.239+0000 7fb3877fe640 1 -- 172.21.15.17:0/2281652452 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fb380038040 con 0x7fb3901055d0 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.239+0000 7fb3949be640 1 -- 172.21.15.17:0/2281652452 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb390109a00 con 0x7fb3901055d0 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.239+0000 7fb3877fe640 1 --2- 172.21.15.17:0/2281652452 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fb37c0386a0 0x7fb37c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.239+0000 7fb3877fe640 1 -- 172.21.15.17:0/2281652452 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb38006b8a0 con 0x7fb3901055d0 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.239+0000 7fb38dd9b640 1 --2- 172.21.15.17:0/2281652452 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fb37c0386a0 0x7fb37c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:22.005 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.240+0000 7fb38dd9b640 1 --2- 172.21.15.17:0/2281652452 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fb37c0386a0 0x7fb37c03ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb3780098c0 tx=0x7fb378006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:22.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.244+0000 7fb3877fe640 1 -- 172.21.15.17:0/2281652452 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb380044770 con 0x7fb3901055d0 2024-08-19T00:47:22.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.427+0000 7fb3949be640 1 -- 172.21.15.17:0/2281652452 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fb390102040 con 0x7fb37c0386a0 2024-08-19T00:47:22.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.431+0000 7fb3877fe640 1 -- 172.21.15.17:0/2281652452 <== mgr.14118 v2:172.21.15.17:6800/2005365781 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fb390102040 con 0x7fb37c0386a0 2024-08-19T00:47:22.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.433+0000 7fb3949be640 1 -- 172.21.15.17:0/2281652452 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fb37c0386a0 msgr2=0x7fb37c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:22.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.433+0000 7fb3949be640 1 --2- 172.21.15.17:0/2281652452 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fb37c0386a0 0x7fb37c03ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb3780098c0 tx=0x7fb378006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:22.006 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.433+0000 7fb3949be640 1 -- 172.21.15.17:0/2281652452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 msgr2=0x7fb390199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:22.007 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.433+0000 7fb3949be640 1 --2- 172.21.15.17:0/2281652452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb390199390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb380009fa0 tx=0x7fb380031a10 comp rx=0 tx=0).stop 2024-08-19T00:47:22.007 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.433+0000 7fb3949be640 1 -- 172.21.15.17:0/2281652452 shutdown_connections 2024-08-19T00:47:22.007 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.433+0000 7fb3949be640 1 --2- 172.21.15.17:0/2281652452 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fb37c0386a0 0x7fb37c03ab60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:22.007 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.433+0000 7fb3949be640 1 --2- 172.21.15.17:0/2281652452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3901055d0 0x7fb390199390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:22.007 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.433+0000 7fb3949be640 1 -- 172.21.15.17:0/2281652452 >> 172.21.15.17:0/2281652452 conn(0x7fb390100d80 msgr2=0x7fb390101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:22.007 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.433+0000 7fb3949be640 1 -- 172.21.15.17:0/2281652452 shutdown_connections 2024-08-19T00:47:22.007 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:21.433+0000 7fb3949be640 1 -- 172.21.15.17:0/2281652452 wait complete. 2024-08-19T00:47:22.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:22 smithi017 ceph-mon[16627]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:22.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:22 smithi017 ceph-mon[16627]: Saving service alertmanager spec with placement count:1 2024-08-19T00:47:22.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:22 smithi017 ceph-mon[16627]: from='mgr.14118 172.21.15.17:0/1343503016' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:22.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:22 smithi017 ceph-mon[16627]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:47:23.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.405+0000 7fc18b465640 1 Processor -- start 2024-08-19T00:47:23.133 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.405+0000 7fc18b465640 1 -- start start 2024-08-19T00:47:23.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.405+0000 7fc18b465640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc1841059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:23.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.405+0000 7fc18b465640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc184105fa0 con 0x7fc1841055d0 2024-08-19T00:47:23.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.406+0000 7fc189201640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc1841059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:23.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.406+0000 7fc189201640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc1841059d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58852/0 (socket says 172.21.15.17:58852) 2024-08-19T00:47:23.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.406+0000 7fc189201640 1 -- 172.21.15.17:0/3544444767 learned_addr learned my addr 172.21.15.17:0/3544444767 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:23.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.406+0000 7fc189201640 1 -- 172.21.15.17:0/3544444767 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1841067d0 con 0x7fc1841055d0 2024-08-19T00:47:23.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.407+0000 7fc189201640 1 --2- 172.21.15.17:0/3544444767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc1841059d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc180009820 tx=0x7fc18002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c61d2938331e08 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:23.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.407+0000 7fc17bfff640 1 -- 172.21.15.17:0/3544444767 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc18002ad40 con 0x7fc1841055d0 2024-08-19T00:47:23.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.407+0000 7fc17bfff640 1 -- 172.21.15.17:0/3544444767 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc180032900 con 0x7fc1841055d0 2024-08-19T00:47:23.134 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.407+0000 7fc17bfff640 1 -- 172.21.15.17:0/3544444767 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc180030860 con 0x7fc1841055d0 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.408+0000 7fc18b465640 1 -- 172.21.15.17:0/3544444767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 msgr2=0x7fc1841059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.408+0000 7fc18b465640 1 --2- 172.21.15.17:0/3544444767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc1841059d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc180009820 tx=0x7fc18002a270 comp rx=0 tx=0).stop 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.408+0000 7fc18b465640 1 -- 172.21.15.17:0/3544444767 shutdown_connections 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.408+0000 7fc18b465640 1 --2- 172.21.15.17:0/3544444767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc1841059d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.408+0000 7fc18b465640 1 -- 172.21.15.17:0/3544444767 >> 172.21.15.17:0/3544444767 conn(0x7fc184100d80 msgr2=0x7fc1841031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.408+0000 7fc18b465640 1 -- 172.21.15.17:0/3544444767 shutdown_connections 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.408+0000 7fc18b465640 1 -- 172.21.15.17:0/3544444767 wait complete. 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.408+0000 7fc18b465640 1 Processor -- start 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.408+0000 7fc18b465640 1 -- start start 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.409+0000 7fc18b465640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc18407bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.409+0000 7fc18b465640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18407c0a0 con 0x7fc1841055d0 2024-08-19T00:47:23.135 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.409+0000 7fc189201640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc18407bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.409+0000 7fc189201640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc18407bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58862/0 (socket says 172.21.15.17:58862) 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.409+0000 7fc189201640 1 -- 172.21.15.17:0/3945903801 learned_addr learned my addr 172.21.15.17:0/3945903801 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.409+0000 7fc189201640 1 -- 172.21.15.17:0/3945903801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1800094d0 con 0x7fc1841055d0 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.409+0000 7fc189201640 1 --2- 172.21.15.17:0/3945903801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc18407bb60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1800097f0 tx=0x7fc180030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.409+0000 7fc17a7fc640 1 -- 172.21.15.17:0/3945903801 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc180040070 con 0x7fc1841055d0 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.409+0000 7fc17a7fc640 1 -- 172.21.15.17:0/3945903801 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc180032dd0 con 0x7fc1841055d0 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.409+0000 7fc18b465640 1 -- 172.21.15.17:0/3945903801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc18407a290 con 0x7fc1841055d0 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.410+0000 7fc17a7fc640 1 -- 172.21.15.17:0/3945903801 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc18003a730 con 0x7fc1841055d0 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.410+0000 7fc18b465640 1 -- 172.21.15.17:0/3945903801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18407a730 con 0x7fc1841055d0 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.410+0000 7fc17a7fc640 1 -- 172.21.15.17:0/3945903801 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fc18003c400 con 0x7fc1841055d0 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.411+0000 7fc17a7fc640 1 --2- 172.21.15.17:0/3945903801 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fc1700386a0 0x7fc17003ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.411+0000 7fc18b465640 1 -- 172.21.15.17:0/3945903801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1841059d0 con 0x7fc1841055d0 2024-08-19T00:47:23.136 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.411+0000 7fc17a7fc640 1 -- 172.21.15.17:0/3945903801 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc18006b610 con 0x7fc1841055d0 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.411+0000 7fc188a00640 1 --2- 172.21.15.17:0/3945903801 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fc1700386a0 0x7fc17003ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.411+0000 7fc188a00640 1 --2- 172.21.15.17:0/3945903801 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fc1700386a0 0x7fc17003ab60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc1740098c0 tx=0x7fc174006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.415+0000 7fc17a7fc640 1 -- 172.21.15.17:0/3945903801 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fc180043920 con 0x7fc1841055d0 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.586+0000 7fc18b465640 1 -- 172.21.15.17:0/3945903801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fc184109a00 con 0x7fc1841055d0 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.589+0000 7fc17a7fc640 1 -- 172.21.15.17:0/3945903801 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc180043920 con 0x7fc1841055d0 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.591+0000 7fc18b465640 1 -- 172.21.15.17:0/3945903801 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fc1700386a0 msgr2=0x7fc17003ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.591+0000 7fc18b465640 1 --2- 172.21.15.17:0/3945903801 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fc1700386a0 0x7fc17003ab60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc1740098c0 tx=0x7fc174006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.591+0000 7fc18b465640 1 -- 172.21.15.17:0/3945903801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 msgr2=0x7fc18407bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.591+0000 7fc18b465640 1 --2- 172.21.15.17:0/3945903801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc18407bb60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc1800097f0 tx=0x7fc180030d50 comp rx=0 tx=0).stop 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.591+0000 7fc18b465640 1 -- 172.21.15.17:0/3945903801 shutdown_connections 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.591+0000 7fc18b465640 1 --2- 172.21.15.17:0/3945903801 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fc1700386a0 0x7fc17003ab60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.591+0000 7fc18b465640 1 --2- 172.21.15.17:0/3945903801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1841055d0 0x7fc18407bb60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:23.137 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.591+0000 7fc18b465640 1 -- 172.21.15.17:0/3945903801 >> 172.21.15.17:0/3945903801 conn(0x7fc184100d80 msgr2=0x7fc184101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:23.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.592+0000 7fc18b465640 1 -- 172.21.15.17:0/3945903801 shutdown_connections 2024-08-19T00:47:23.138 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:22.592+0000 7fc18b465640 1 -- 172.21.15.17:0/3945903801 wait complete. 2024-08-19T00:47:23.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:23 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3945903801' entity='client.admin' 2024-08-19T00:47:23.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:23 smithi017 ceph-mon[16627]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:47:24.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.579+0000 7f94e4699640 1 Processor -- start 2024-08-19T00:47:24.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.579+0000 7f94e4699640 1 -- start start 2024-08-19T00:47:24.265 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.580+0000 7f94e4699640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc07a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:24.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.580+0000 7f94e4699640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc07a8e0 con 0x7f94dc07beb0 2024-08-19T00:47:24.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.580+0000 7f94e2435640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc07a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:24.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.580+0000 7f94e2435640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc07a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58864/0 (socket says 172.21.15.17:58864) 2024-08-19T00:47:24.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.580+0000 7f94e2435640 1 -- 172.21.15.17:0/2611244651 learned_addr learned my addr 172.21.15.17:0/2611244651 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:24.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.580+0000 7f94e2435640 1 -- 172.21.15.17:0/2611244651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc07aa20 con 0x7f94dc07beb0 2024-08-19T00:47:24.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.581+0000 7f94e2435640 1 --2- 172.21.15.17:0/2611244651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc07a310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009820 tx=0x7f94d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e869775e26955bb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:24.266 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.581+0000 7f94e1433640 1 -- 172.21.15.17:0/2611244651 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94d802ad40 con 0x7f94dc07beb0 2024-08-19T00:47:24.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.581+0000 7f94e1433640 1 -- 172.21.15.17:0/2611244651 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94d8032900 con 0x7f94dc07beb0 2024-08-19T00:47:24.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.581+0000 7f94e1433640 1 -- 172.21.15.17:0/2611244651 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94d8030860 con 0x7f94dc07beb0 2024-08-19T00:47:24.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.582+0000 7f94e4699640 1 -- 172.21.15.17:0/2611244651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 msgr2=0x7f94dc07a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:24.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.582+0000 7f94e4699640 1 --2- 172.21.15.17:0/2611244651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc07a310 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009820 tx=0x7f94d802a270 comp rx=0 tx=0).stop 2024-08-19T00:47:24.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.582+0000 7f94e4699640 1 -- 172.21.15.17:0/2611244651 shutdown_connections 2024-08-19T00:47:24.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.582+0000 7f94e4699640 1 --2- 172.21.15.17:0/2611244651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc07a310 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:24.267 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.582+0000 7f94e4699640 1 -- 172.21.15.17:0/2611244651 >> 172.21.15.17:0/2611244651 conn(0x7f94dc100d70 msgr2=0x7f94dc103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.582+0000 7f94e4699640 1 -- 172.21.15.17:0/2611244651 shutdown_connections 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.582+0000 7f94e4699640 1 -- 172.21.15.17:0/2611244651 wait complete. 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.583+0000 7f94e4699640 1 Processor -- start 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.583+0000 7f94e4699640 1 -- start start 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.583+0000 7f94e4699640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc19b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.583+0000 7f94e4699640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc19ba60 con 0x7f94dc07beb0 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.583+0000 7f94e2435640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc19b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.583+0000 7f94e2435640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc19b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58874/0 (socket says 172.21.15.17:58874) 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.583+0000 7f94e2435640 1 -- 172.21.15.17:0/2872692001 learned_addr learned my addr 172.21.15.17:0/2872692001 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.583+0000 7f94e2435640 1 -- 172.21.15.17:0/2872692001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80094d0 con 0x7f94dc07beb0 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.583+0000 7f94e2435640 1 --2- 172.21.15.17:0/2872692001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc19b520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94d80097f0 tx=0x7f94d8030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.583+0000 7f94d37fe640 1 -- 172.21.15.17:0/2872692001 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94d8040070 con 0x7f94dc07beb0 2024-08-19T00:47:24.268 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.584+0000 7f94d37fe640 1 -- 172.21.15.17:0/2872692001 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f94d8032dd0 con 0x7f94dc07beb0 2024-08-19T00:47:24.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.584+0000 7f94e4699640 1 -- 172.21.15.17:0/2872692001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94dc19bc60 con 0x7f94dc07beb0 2024-08-19T00:47:24.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.584+0000 7f94d37fe640 1 -- 172.21.15.17:0/2872692001 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94d803a730 con 0x7f94dc07beb0 2024-08-19T00:47:24.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.584+0000 7f94e4699640 1 -- 172.21.15.17:0/2872692001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc19c100 con 0x7f94dc07beb0 2024-08-19T00:47:24.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.584+0000 7f94d37fe640 1 -- 172.21.15.17:0/2872692001 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7f94d803cc30 con 0x7f94dc07beb0 2024-08-19T00:47:24.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.584+0000 7f94e4699640 1 -- 172.21.15.17:0/2872692001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc10b9c0 con 0x7f94dc07beb0 2024-08-19T00:47:24.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.585+0000 7f94d37fe640 1 --2- 172.21.15.17:0/2872692001 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f94c8038650 0x7f94c803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:24.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.585+0000 7f94d37fe640 1 -- 172.21.15.17:0/2872692001 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f94d806b6b0 con 0x7f94dc07beb0 2024-08-19T00:47:24.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.585+0000 7f94e1c34640 1 --2- 172.21.15.17:0/2872692001 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f94c8038650 0x7f94c803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:24.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.585+0000 7f94e1c34640 1 --2- 172.21.15.17:0/2872692001 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f94c8038650 0x7f94c803ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0098c0 tx=0x7f94cc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:24.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.589+0000 7f94d37fe640 1 -- 172.21.15.17:0/2872692001 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f94d8043920 con 0x7f94dc07beb0 2024-08-19T00:47:24.269 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.761+0000 7f94e4699640 1 -- 172.21.15.17:0/2872692001 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f94dc10bc00 con 0x7f94dc07beb0 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.764+0000 7f94d37fe640 1 -- 172.21.15.17:0/2872692001 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f94d8043920 con 0x7f94dc07beb0 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.766+0000 7f94e4699640 1 -- 172.21.15.17:0/2872692001 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f94c8038650 msgr2=0x7f94c803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.766+0000 7f94e4699640 1 --2- 172.21.15.17:0/2872692001 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f94c8038650 0x7f94c803ab10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0098c0 tx=0x7f94cc006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.766+0000 7f94e4699640 1 -- 172.21.15.17:0/2872692001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 msgr2=0x7f94dc19b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.766+0000 7f94e4699640 1 --2- 172.21.15.17:0/2872692001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc19b520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f94d80097f0 tx=0x7f94d8030d50 comp rx=0 tx=0).stop 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.766+0000 7f94e4699640 1 -- 172.21.15.17:0/2872692001 shutdown_connections 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.766+0000 7f94e4699640 1 --2- 172.21.15.17:0/2872692001 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f94c8038650 0x7f94c803ab10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.766+0000 7f94e4699640 1 --2- 172.21.15.17:0/2872692001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94dc07beb0 0x7f94dc19b520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.766+0000 7f94e4699640 1 -- 172.21.15.17:0/2872692001 >> 172.21.15.17:0/2872692001 conn(0x7f94dc100d70 msgr2=0x7f94dc101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.766+0000 7f94e4699640 1 -- 172.21.15.17:0/2872692001 shutdown_connections 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:23.766+0000 7f94e4699640 1 -- 172.21.15.17:0/2872692001 wait complete. 2024-08-19T00:47:24.270 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling the dashboard module... 2024-08-19T00:47:24.919 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:24 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2872692001' entity='client.admin' 2024-08-19T00:47:25.788 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:25 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1784278192' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-08-19T00:47:25.788 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:25 smithi017 ceph-mon[16627]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:47:26.355 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.691+0000 7fbc168a0640 1 Processor -- start 2024-08-19T00:47:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.691+0000 7fbc168a0640 1 -- start start 2024-08-19T00:47:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.691+0000 7fbc168a0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10103c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.691+0000 7fbc168a0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc10104260 con 0x7fbc10103890 2024-08-19T00:47:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.691+0000 7fbc0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.691+0000 7fbc0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58886/0 (socket says 172.21.15.17:58886) 2024-08-19T00:47:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.691+0000 7fbc0ffff640 1 -- 172.21.15.17:0/257801168 learned_addr learned my addr 172.21.15.17:0/257801168 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.691+0000 7fbc0ffff640 1 -- 172.21.15.17:0/257801168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc101043a0 con 0x7fbc10103890 2024-08-19T00:47:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.692+0000 7fbc0ffff640 1 --2- 172.21.15.17:0/257801168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10103c90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009820 tx=0x7fbc0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783f9bcb4f1deeea server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.692+0000 7fbc0effd640 1 -- 172.21.15.17:0/257801168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc0002ad40 con 0x7fbc10103890 2024-08-19T00:47:26.356 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.692+0000 7fbc0effd640 1 -- 172.21.15.17:0/257801168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc00032900 con 0x7fbc10103890 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.692+0000 7fbc0effd640 1 -- 172.21.15.17:0/257801168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc00030860 con 0x7fbc10103890 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.693+0000 7fbc168a0640 1 -- 172.21.15.17:0/257801168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 msgr2=0x7fbc10103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.693+0000 7fbc168a0640 1 --2- 172.21.15.17:0/257801168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10103c90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009820 tx=0x7fbc0002a270 comp rx=0 tx=0).stop 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.693+0000 7fbc168a0640 1 -- 172.21.15.17:0/257801168 shutdown_connections 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.693+0000 7fbc168a0640 1 --2- 172.21.15.17:0/257801168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10103c90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.693+0000 7fbc168a0640 1 -- 172.21.15.17:0/257801168 >> 172.21.15.17:0/257801168 conn(0x7fbc100ff420 msgr2=0x7fbc10101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.693+0000 7fbc168a0640 1 -- 172.21.15.17:0/257801168 shutdown_connections 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.693+0000 7fbc168a0640 1 -- 172.21.15.17:0/257801168 wait complete. 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.693+0000 7fbc168a0640 1 Processor -- start 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.693+0000 7fbc168a0640 1 -- start start 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.694+0000 7fbc168a0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:26.357 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.694+0000 7fbc168a0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc10199890 con 0x7fbc10103890 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.694+0000 7fbc0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.694+0000 7fbc0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58902/0 (socket says 172.21.15.17:58902) 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.694+0000 7fbc0ffff640 1 -- 172.21.15.17:0/1784278192 learned_addr learned my addr 172.21.15.17:0/1784278192 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.694+0000 7fbc0ffff640 1 -- 172.21.15.17:0/1784278192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc000094d0 con 0x7fbc10103890 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.694+0000 7fbc0ffff640 1 --2- 172.21.15.17:0/1784278192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10199350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009940 tx=0x7fbc00032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.694+0000 7fbc0d7fa640 1 -- 172.21.15.17:0/1784278192 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc00032c80 con 0x7fbc10103890 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.694+0000 7fbc0d7fa640 1 -- 172.21.15.17:0/1784278192 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc00032de0 con 0x7fbc10103890 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.694+0000 7fbc168a0640 1 -- 172.21.15.17:0/1784278192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc10199a90 con 0x7fbc10103890 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.695+0000 7fbc0d7fa640 1 -- 172.21.15.17:0/1784278192 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbc0003a720 con 0x7fbc10103890 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.695+0000 7fbc168a0640 1 -- 172.21.15.17:0/1784278192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc10199f30 con 0x7fbc10103890 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.695+0000 7fbc0d7fa640 1 -- 172.21.15.17:0/1784278192 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 8) v1 ==== 45556+0+0 (secure 0 0 0) 0x7fbc0003a950 con 0x7fbc10103890 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.696+0000 7fbc0d7fa640 1 --2- 172.21.15.17:0/1784278192 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fbbf8038650 0x7fbbf803ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:26.358 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.696+0000 7fbc168a0640 1 -- 172.21.15.17:0/1784278192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc10109aa0 con 0x7fbc10103890 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.696+0000 7fbc0d7fa640 1 -- 172.21.15.17:0/1784278192 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbc0006bae0 con 0x7fbc10103890 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.696+0000 7fbc0f7fe640 1 --2- 172.21.15.17:0/1784278192 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fbbf8038650 0x7fbbf803ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.696+0000 7fbc0f7fe640 1 --2- 172.21.15.17:0/1784278192 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fbbf8038650 0x7fbbf803ab10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbc040098c0 tx=0x7fbc04006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.700+0000 7fbc0d7fa640 1 -- 172.21.15.17:0/1784278192 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fbc00039d50 con 0x7fbc10103890 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:24.917+0000 7fbc168a0640 1 -- 172.21.15.17:0/1784278192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fbc1019c810 con 0x7fbc10103890 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.767+0000 7fbc0d7fa640 1 -- 172.21.15.17:0/1784278192 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fbc0003cc30 con 0x7fbc10103890 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.768+0000 7fbc0d7fa640 1 -- 172.21.15.17:0/1784278192 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fbc00039960 con 0x7fbc10103890 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.771+0000 7fbc168a0640 1 -- 172.21.15.17:0/1784278192 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fbbf8038650 msgr2=0x7fbbf803ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.771+0000 7fbc168a0640 1 --2- 172.21.15.17:0/1784278192 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fbbf8038650 0x7fbbf803ab10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbc040098c0 tx=0x7fbc04006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.771+0000 7fbc168a0640 1 -- 172.21.15.17:0/1784278192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 msgr2=0x7fbc10199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.771+0000 7fbc168a0640 1 --2- 172.21.15.17:0/1784278192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10199350 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009940 tx=0x7fbc00032670 comp rx=0 tx=0).stop 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.771+0000 7fbc168a0640 1 -- 172.21.15.17:0/1784278192 shutdown_connections 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.771+0000 7fbc168a0640 1 --2- 172.21.15.17:0/1784278192 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fbbf8038650 0x7fbbf803ab10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:26.359 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.771+0000 7fbc168a0640 1 --2- 172.21.15.17:0/1784278192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc10103890 0x7fbc10199350 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:26.360 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.771+0000 7fbc168a0640 1 -- 172.21.15.17:0/1784278192 >> 172.21.15.17:0/1784278192 conn(0x7fbc100ff420 msgr2=0x7fbc10100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:26.360 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.771+0000 7fbc168a0640 1 -- 172.21.15.17:0/1784278192 shutdown_connections 2024-08-19T00:47:26.360 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:25.771+0000 7fbc168a0640 1 -- 172.21.15.17:0/1784278192 wait complete. 2024-08-19T00:47:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:26 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1784278192' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-19T00:47:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:26 smithi017 ceph-mon[16627]: mgrmap e9: smithi017.hfpawi(active, since 26s) 2024-08-19T00:47:27.598 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:47:27.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-19T00:47:27.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-19T00:47:27.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "active_name": "smithi017.hfpawi", 2024-08-19T00:47:27.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-19T00:47:27.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:47:27.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.753+0000 7fe0d4ffc640 1 Processor -- start 2024-08-19T00:47:27.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.753+0000 7fe0d4ffc640 1 -- start start 2024-08-19T00:47:27.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.753+0000 7fe0d4ffc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.753+0000 7fe0d4ffc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d0079e20 con 0x7fe0d01060d0 2024-08-19T00:47:27.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.754+0000 7fe0ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.754+0000 7fe0ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01084c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58228/0 (socket says 172.21.15.17:58228) 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.754+0000 7fe0ce59c640 1 -- 172.21.15.17:0/1885883993 learned_addr learned my addr 172.21.15.17:0/1885883993 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.754+0000 7fe0ce59c640 1 -- 172.21.15.17:0/1885883993 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d0108a00 con 0x7fe0d01060d0 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.755+0000 7fe0ce59c640 1 --2- 172.21.15.17:0/1885883993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01084c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009820 tx=0x7fe0c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58764cb69b74f197 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.755+0000 7fe0cd59a640 1 -- 172.21.15.17:0/1885883993 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0c002ad40 con 0x7fe0d01060d0 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.755+0000 7fe0cd59a640 1 -- 172.21.15.17:0/1885883993 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0c0032900 con 0x7fe0d01060d0 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.755+0000 7fe0cd59a640 1 -- 172.21.15.17:0/1885883993 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0c0030860 con 0x7fe0d01060d0 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.756+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1885883993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 msgr2=0x7fe0d01084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.756+0000 7fe0d4ffc640 1 --2- 172.21.15.17:0/1885883993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01084c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009820 tx=0x7fe0c002a270 comp rx=0 tx=0).stop 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.756+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1885883993 shutdown_connections 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.756+0000 7fe0d4ffc640 1 --2- 172.21.15.17:0/1885883993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01084c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.756+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1885883993 >> 172.21.15.17:0/1885883993 conn(0x7fe0d00ffc50 msgr2=0x7fe0d01020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.606 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.756+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1885883993 shutdown_connections 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.756+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1885883993 wait complete. 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.756+0000 7fe0d4ffc640 1 Processor -- start 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.757+0000 7fe0d4ffc640 1 -- start start 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.757+0000 7fe0d4ffc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.757+0000 7fe0d4ffc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d0199830 con 0x7fe0d01060d0 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.757+0000 7fe0ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.757+0000 7fe0ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58230/0 (socket says 172.21.15.17:58230) 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.757+0000 7fe0ce59c640 1 -- 172.21.15.17:0/1509183440 learned_addr learned my addr 172.21.15.17:0/1509183440 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.757+0000 7fe0ce59c640 1 -- 172.21.15.17:0/1509183440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00094d0 con 0x7fe0d01060d0 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.757+0000 7fe0ce59c640 1 --2- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01992f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00097f0 tx=0x7fe0c0030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.757+0000 7fe0bf7fe640 1 -- 172.21.15.17:0/1509183440 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0c0040070 con 0x7fe0d01060d0 2024-08-19T00:47:27.607 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.757+0000 7fe0bf7fe640 1 -- 172.21.15.17:0/1509183440 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe0c0032dd0 con 0x7fe0d01060d0 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.757+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1509183440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d0199a30 con 0x7fe0d01060d0 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.758+0000 7fe0bf7fe640 1 -- 172.21.15.17:0/1509183440 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0c003a790 con 0x7fe0d01060d0 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.758+0000 7fe0bf7fe640 1 -- 172.21.15.17:0/1509183440 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fe0c003a970 con 0x7fe0d01060d0 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.758+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1509183440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d0199ed0 con 0x7fe0d01060d0 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.759+0000 7fe0bf7fe640 1 --2- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fe0b80386f0 0x7fe0b803abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.759+0000 7fe0bf7fe640 1 -- 172.21.15.17:0/1509183440 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe0c003cc70 con 0x7fe0d01060d0 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.759+0000 7fe0cdd9b640 1 -- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fe0b80386f0 msgr2=0x7fe0b803abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2005365781 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.759+0000 7fe0cdd9b640 1 --2- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fe0b80386f0 0x7fe0b803abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.759+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1509183440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d01097b0 con 0x7fe0d01060d0 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.768+0000 7fe0bf7fe640 1 -- 172.21.15.17:0/1509183440 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe0c003b360 con 0x7fe0d01060d0 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.960+0000 7fe0cdd9b640 1 -- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fe0b80386f0 msgr2=0x7fe0b803abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2005365781 2024-08-19T00:47:27.608 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.960+0000 7fe0cdd9b640 1 --2- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fe0b80386f0 0x7fe0b803abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.987+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1509183440 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fe0d019cb30 con 0x7fe0d01060d0 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.988+0000 7fe0bf7fe640 1 -- 172.21.15.17:0/1509183440 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fe0c0039b00 con 0x7fe0d01060d0 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.990+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fe0b80386f0 msgr2=0x7fe0b803abb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.990+0000 7fe0d4ffc640 1 --2- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fe0b80386f0 0x7fe0b803abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.990+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 msgr2=0x7fe0d01992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.990+0000 7fe0d4ffc640 1 --2- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01992f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe0c00097f0 tx=0x7fe0c0030d50 comp rx=0 tx=0).stop 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.990+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1509183440 shutdown_connections 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.990+0000 7fe0d4ffc640 1 --2- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7fe0b80386f0 0x7fe0b803abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.990+0000 7fe0d4ffc640 1 --2- 172.21.15.17:0/1509183440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0d01060d0 0x7fe0d01992f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.990+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1509183440 >> 172.21.15.17:0/1509183440 conn(0x7fe0d00ffc50 msgr2=0x7fe0d0100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.990+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1509183440 shutdown_connections 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:26.990+0000 7fe0d4ffc640 1 -- 172.21.15.17:0/1509183440 wait complete. 2024-08-19T00:47:27.609 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for the mgr to restart... 2024-08-19T00:47:27.610 INFO:teuthology.orchestra.run.smithi017.stdout:Waiting for mgr epoch 9... 2024-08-19T00:47:27.810 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:27 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1509183440' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-19T00:47:31.020 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: Active manager daemon smithi017.hfpawi restarted 2024-08-19T00:47:31.020 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: Activating manager daemon smithi017.hfpawi 2024-08-19T00:47:31.020 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: osdmap e3: 0 total, 0 up, 0 in 2024-08-19T00:47:31.020 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: mgrmap e10: smithi017.hfpawi(active, starting, since 0.0030026s) 2024-08-19T00:47:31.020 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:47:31.021 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi017.hfpawi", "id": "smithi017.hfpawi"}]: dispatch 2024-08-19T00:47:31.021 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:47:31.021 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:47:31.021 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:47:31.021 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: Manager daemon smithi017.hfpawi is now available 2024-08-19T00:47:31.021 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:47:31.021 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:47:31.021 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:30 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/trash_purge_schedule"}]: dispatch 2024-08-19T00:47:32.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout { 2024-08-19T00:47:32.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-19T00:47:32.599 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout } 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.018+0000 7f3112d36640 1 Processor -- start 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.019+0000 7f3112d36640 1 -- start start 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.019+0000 7f3112d36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c108440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.019+0000 7f3112d36640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c079ea0 con 0x7f310c106050 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.019+0000 7f3110ad2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.019+0000 7f3110ad2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c108440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58236/0 (socket says 172.21.15.17:58236) 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.019+0000 7f3110ad2640 1 -- 172.21.15.17:0/4250195047 learned_addr learned my addr 172.21.15.17:0/4250195047 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.019+0000 7f3110ad2640 1 -- 172.21.15.17:0/4250195047 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c108980 con 0x7f310c106050 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.020+0000 7f3110ad2640 1 --2- 172.21.15.17:0/4250195047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c108440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3100009820 tx=0x7f310002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100d1b6ed8d40d34 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.020+0000 7f310b7fe640 1 -- 172.21.15.17:0/4250195047 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f310002ad40 con 0x7f310c106050 2024-08-19T00:47:32.600 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.020+0000 7f310b7fe640 1 -- 172.21.15.17:0/4250195047 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3100032900 con 0x7f310c106050 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.020+0000 7f310b7fe640 1 -- 172.21.15.17:0/4250195047 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3100030860 con 0x7f310c106050 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.021+0000 7f3112d36640 1 -- 172.21.15.17:0/4250195047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 msgr2=0x7f310c108440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.021+0000 7f3112d36640 1 --2- 172.21.15.17:0/4250195047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c108440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3100009820 tx=0x7f310002a270 comp rx=0 tx=0).stop 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.021+0000 7f3112d36640 1 -- 172.21.15.17:0/4250195047 shutdown_connections 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.021+0000 7f3112d36640 1 --2- 172.21.15.17:0/4250195047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c108440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.021+0000 7f3112d36640 1 -- 172.21.15.17:0/4250195047 >> 172.21.15.17:0/4250195047 conn(0x7f310c0ffc50 msgr2=0x7f310c1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.021+0000 7f3112d36640 1 -- 172.21.15.17:0/4250195047 shutdown_connections 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.021+0000 7f3112d36640 1 -- 172.21.15.17:0/4250195047 wait complete. 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.021+0000 7f3112d36640 1 Processor -- start 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.021+0000 7f3112d36640 1 -- start start 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.022+0000 7f3112d36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.022+0000 7f3112d36640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c199830 con 0x7f310c106050 2024-08-19T00:47:32.601 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.022+0000 7f3110ad2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.022+0000 7f3110ad2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58244/0 (socket says 172.21.15.17:58244) 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.022+0000 7f3110ad2640 1 -- 172.21.15.17:0/3893184982 learned_addr learned my addr 172.21.15.17:0/3893184982 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.022+0000 7f3110ad2640 1 -- 172.21.15.17:0/3893184982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000094d0 con 0x7f310c106050 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.022+0000 7f3110ad2640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c1992f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31000097f0 tx=0x7f3100030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.022+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3100040070 con 0x7f310c106050 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.022+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3100032dd0 con 0x7f310c106050 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.022+0000 7f3112d36640 1 -- 172.21.15.17:0/3893184982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310c199a30 con 0x7f310c106050 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.022+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f310003a790 con 0x7f310c106050 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.023+0000 7f3112d36640 1 -- 172.21.15.17:0/3893184982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310c199ed0 con 0x7f310c106050 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.023+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 9) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f310003a8f0 con 0x7f310c106050 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.024+0000 7f3109ffb640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 0x7f30fc03abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:32.602 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.024+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 --> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30fc03b2c0 con 0x7f30fc0386f0 2024-08-19T00:47:32.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.024+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f310006c740 con 0x7f310c106050 2024-08-19T00:47:32.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.024+0000 7f310bfff640 1 -- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 msgr2=0x7f30fc03abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2005365781 2024-08-19T00:47:32.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.024+0000 7f310bfff640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 0x7f30fc03abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:47:32.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.225+0000 7f310bfff640 1 -- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 msgr2=0x7f30fc03abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2005365781 2024-08-19T00:47:32.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.225+0000 7f310bfff640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 0x7f30fc03abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:47:32.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.626+0000 7f310bfff640 1 -- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 msgr2=0x7f30fc03abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2005365781 2024-08-19T00:47:32.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:28.626+0000 7f310bfff640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 0x7f30fc03abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-19T00:47:32.603 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:29.427+0000 7f310bfff640 1 -- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 msgr2=0x7f30fc03abb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/2005365781 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:29.427+0000 7f310bfff640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 0x7f30fc03abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:30.752+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mgrmap(e 10) v1 ==== 45336+0+0 (secure 0 0 0) 0x7f310006b570 con 0x7f310c106050 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:30.752+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 msgr2=0x7f30fc03abb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:30.752+0000 7f3109ffb640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 0x7f30fc03abb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.753+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7f3100045410 con 0x7f310c106050 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.753+0000 7f3109ffb640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f30fc03bfe0 0x7f30fc03e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.754+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 --> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30fc03b2c0 con 0x7f30fc03bfe0 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.754+0000 7f310bfff640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f30fc03bfe0 0x7f30fc03e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.755+0000 7f310bfff640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f30fc03bfe0 0x7f30fc03e3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f30f8003980 tx=0x7f30f80092b0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.755+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 <== mgr.14162 v2:172.21.15.17:6800/1713288012 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f30fc03b2c0 con 0x7f30fc03bfe0 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.765+0000 7f3112d36640 1 -- 172.21.15.17:0/3893184982 --> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f310c109790 con 0x7f30fc03bfe0 2024-08-19T00:47:32.604 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.765+0000 7f3109ffb640 1 -- 172.21.15.17:0/3893184982 <== mgr.14162 v2:172.21.15.17:6800/1713288012 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f310c109790 con 0x7f30fc03bfe0 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.766+0000 7f3112d36640 1 -- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f30fc03bfe0 msgr2=0x7f30fc03e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.766+0000 7f3112d36640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f30fc03bfe0 0x7f30fc03e3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f30f8003980 tx=0x7f30f80092b0 comp rx=0 tx=0).stop 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.766+0000 7f3112d36640 1 -- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 msgr2=0x7f310c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.766+0000 7f3112d36640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c1992f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f31000097f0 tx=0x7f3100030d50 comp rx=0 tx=0).stop 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.766+0000 7f3112d36640 1 -- 172.21.15.17:0/3893184982 shutdown_connections 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.766+0000 7f3112d36640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f30fc03bfe0 0x7f30fc03e3d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.766+0000 7f3112d36640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:6800/2005365781,v1:172.21.15.17:6801/2005365781] conn(0x7f30fc0386f0 0x7f30fc03abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.766+0000 7f3112d36640 1 --2- 172.21.15.17:0/3893184982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f310c106050 0x7f310c1992f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.766+0000 7f3112d36640 1 -- 172.21.15.17:0/3893184982 >> 172.21.15.17:0/3893184982 conn(0x7f310c0ffc50 msgr2=0x7f310c100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.766+0000 7f3112d36640 1 -- 172.21.15.17:0/3893184982 shutdown_connections 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:31.766+0000 7f3112d36640 1 -- 172.21.15.17:0/3893184982 wait complete. 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:mgr epoch 9 is available 2024-08-19T00:47:32.605 INFO:teuthology.orchestra.run.smithi017.stdout:Generating a dashboard self-signed certificate... 2024-08-19T00:47:32.968 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:32 smithi017 ceph-mon[16627]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-19T00:47:32.968 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:32 smithi017 ceph-mon[16627]: mgrmap e11: smithi017.hfpawi(active, since 1.00555s) 2024-08-19T00:47:32.968 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:32 smithi017 ceph-mon[16627]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-19T00:47:32.968 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:32 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:33.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-08-19T00:47:33.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.046+0000 7fcfece40640 1 Processor -- start 2024-08-19T00:47:33.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.046+0000 7fcfece40640 1 -- start start 2024-08-19T00:47:33.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.046+0000 7fcfece40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8105a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:33.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.046+0000 7fcfece40640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8106010 con 0x7fcfe8105640 2024-08-19T00:47:33.930 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.046+0000 7fcfe659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8105a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.046+0000 7fcfe659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8105a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58320/0 (socket says 172.21.15.17:58320) 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.046+0000 7fcfe659c640 1 -- 172.21.15.17:0/3845965178 learned_addr learned my addr 172.21.15.17:0/3845965178 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.047+0000 7fcfe659c640 1 -- 172.21.15.17:0/3845965178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe81067a0 con 0x7fcfe8105640 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.047+0000 7fcfe659c640 1 --2- 172.21.15.17:0/3845965178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8105a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009820 tx=0x7fcfd802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9c5adf31b62753 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.048+0000 7fcfe5d9b640 1 -- 172.21.15.17:0/3845965178 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfd802ad40 con 0x7fcfe8105640 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.048+0000 7fcfe5d9b640 1 -- 172.21.15.17:0/3845965178 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfd8032900 con 0x7fcfe8105640 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.048+0000 7fcfe5d9b640 1 -- 172.21.15.17:0/3845965178 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfd8030860 con 0x7fcfe8105640 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.049+0000 7fcfece40640 1 -- 172.21.15.17:0/3845965178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 msgr2=0x7fcfe8105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.049+0000 7fcfece40640 1 --2- 172.21.15.17:0/3845965178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8105a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009820 tx=0x7fcfd802a270 comp rx=0 tx=0).stop 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.049+0000 7fcfece40640 1 -- 172.21.15.17:0/3845965178 shutdown_connections 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.049+0000 7fcfece40640 1 --2- 172.21.15.17:0/3845965178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8105a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.049+0000 7fcfece40640 1 -- 172.21.15.17:0/3845965178 >> 172.21.15.17:0/3845965178 conn(0x7fcfe8100dd0 msgr2=0x7fcfe8103210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:33.931 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.049+0000 7fcfece40640 1 -- 172.21.15.17:0/3845965178 shutdown_connections 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.049+0000 7fcfece40640 1 -- 172.21.15.17:0/3845965178 wait complete. 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.050+0000 7fcfece40640 1 Processor -- start 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.050+0000 7fcfece40640 1 -- start start 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.050+0000 7fcfece40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.050+0000 7fcfece40640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8199850 con 0x7fcfe8105640 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.050+0000 7fcfe659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.050+0000 7fcfe659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58336/0 (socket says 172.21.15.17:58336) 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.050+0000 7fcfe659c640 1 -- 172.21.15.17:0/442428985 learned_addr learned my addr 172.21.15.17:0/442428985 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.050+0000 7fcfe659c640 1 -- 172.21.15.17:0/442428985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80094d0 con 0x7fcfe8105640 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.051+0000 7fcfe659c640 1 --2- 172.21.15.17:0/442428985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8199310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009940 tx=0x7fcfd8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.051+0000 7fcfdf7fe640 1 -- 172.21.15.17:0/442428985 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfd8032c80 con 0x7fcfe8105640 2024-08-19T00:47:33.932 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.051+0000 7fcfdf7fe640 1 -- 172.21.15.17:0/442428985 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfd8032de0 con 0x7fcfe8105640 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.051+0000 7fcfece40640 1 -- 172.21.15.17:0/442428985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe8199a50 con 0x7fcfe8105640 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.051+0000 7fcfdf7fe640 1 -- 172.21.15.17:0/442428985 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcfd803a720 con 0x7fcfe8105640 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.051+0000 7fcfece40640 1 -- 172.21.15.17:0/442428985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe8199ef0 con 0x7fcfe8105640 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.052+0000 7fcfdf7fe640 1 -- 172.21.15.17:0/442428985 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 11) v1 ==== 45463+0+0 (secure 0 0 0) 0x7fcfd803a950 con 0x7fcfe8105640 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.052+0000 7fcfece40640 1 -- 172.21.15.17:0/442428985 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe81099d0 con 0x7fcfe8105640 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.052+0000 7fcfdf7fe640 1 --2- 172.21.15.17:0/442428985 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fcfd4038580 0x7fcfd403aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.052+0000 7fcfdf7fe640 1 -- 172.21.15.17:0/442428985 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcfd806b8c0 con 0x7fcfe8105640 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.052+0000 7fcfdffff640 1 --2- 172.21.15.17:0/442428985 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fcfd4038580 0x7fcfd403aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.052+0000 7fcfdffff640 1 --2- 172.21.15.17:0/442428985 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fcfd4038580 0x7fcfd403aa40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00098c0 tx=0x7fcfd0006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.057+0000 7fcfdf7fe640 1 -- 172.21.15.17:0/442428985 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fcfd8039d30 con 0x7fcfe8105640 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.155+0000 7fcfdf7fe640 1 -- 172.21.15.17:0/442428985 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fcfd803cc30 con 0x7fcfe8105640 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.247+0000 7fcfece40640 1 -- 172.21.15.17:0/442428985 --> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfe8102020 con 0x7fcfd4038580 2024-08-19T00:47:33.933 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.290+0000 7fcfdf7fe640 1 -- 172.21.15.17:0/442428985 <== mgr.14162 v2:172.21.15.17:6800/1713288012 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fcfe8102020 con 0x7fcfd4038580 2024-08-19T00:47:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.292+0000 7fcfece40640 1 -- 172.21.15.17:0/442428985 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fcfd4038580 msgr2=0x7fcfd403aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.292+0000 7fcfece40640 1 --2- 172.21.15.17:0/442428985 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fcfd4038580 0x7fcfd403aa40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00098c0 tx=0x7fcfd0006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.292+0000 7fcfece40640 1 -- 172.21.15.17:0/442428985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 msgr2=0x7fcfe8199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.292+0000 7fcfece40640 1 --2- 172.21.15.17:0/442428985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8199310 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009940 tx=0x7fcfd8032670 comp rx=0 tx=0).stop 2024-08-19T00:47:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.292+0000 7fcfece40640 1 -- 172.21.15.17:0/442428985 shutdown_connections 2024-08-19T00:47:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.292+0000 7fcfece40640 1 --2- 172.21.15.17:0/442428985 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fcfd4038580 0x7fcfd403aa40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.292+0000 7fcfece40640 1 --2- 172.21.15.17:0/442428985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcfe8105640 0x7fcfe8199310 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.292+0000 7fcfece40640 1 -- 172.21.15.17:0/442428985 >> 172.21.15.17:0/442428985 conn(0x7fcfe8100dd0 msgr2=0x7fcfe8101910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.292+0000 7fcfece40640 1 -- 172.21.15.17:0/442428985 shutdown_connections 2024-08-19T00:47:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:33.292+0000 7fcfece40640 1 -- 172.21.15.17:0/442428985 wait complete. 2024-08-19T00:47:33.934 INFO:teuthology.orchestra.run.smithi017.stdout:Creating initial admin user... 2024-08-19T00:47:34.051 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:33 smithi017 ceph-mon[16627]: [19/Aug/2024:00:47:32] ENGINE Bus STARTING 2024-08-19T00:47:34.051 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:33 smithi017 ceph-mon[16627]: [19/Aug/2024:00:47:32] ENGINE Serving on http://172.21.15.17:8765 2024-08-19T00:47:34.051 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:33 smithi017 ceph-mon[16627]: [19/Aug/2024:00:47:32] ENGINE Serving on https://172.21.15.17:7150 2024-08-19T00:47:34.051 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:33 smithi017 ceph-mon[16627]: [19/Aug/2024:00:47:32] ENGINE Bus STARTED 2024-08-19T00:47:34.051 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:33 smithi017 ceph-mon[16627]: [19/Aug/2024:00:47:32] ENGINE Error in HTTPServer.serve 2024-08-19T00:47:34.051 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Traceback (most recent call last): 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._run(expiration_interval) 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s = self.context.wrap_socket( 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:47:34.052 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: return self.sslsocket_class._create( 2024-08-19T00:47:34.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:47:34.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self.do_handshake() 2024-08-19T00:47:34.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:47:34.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._sslobj.do_handshake() 2024-08-19T00:47:34.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:47:34.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:33 smithi017 ceph-mon[16627]: mgrmap e12: smithi017.hfpawi(active, since 2s) 2024-08-19T00:47:34.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:33 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:34.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:33 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:34.053 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:33 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:34 smithi017 ceph-mon[16627]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:36.076 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:35 smithi017 ceph-mon[16627]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:36.076 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:35 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:36.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$ZOwylpxFTnJ4grZgKmNrSec3nwZ5lO3LiE0LdTv81ZYPhFQr296R.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1724028454, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-19T00:47:36.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.343+0000 7fc1fab0e640 1 Processor -- start 2024-08-19T00:47:36.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.343+0000 7fc1fab0e640 1 -- start start 2024-08-19T00:47:36.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.343+0000 7fc1fab0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f41084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.343+0000 7fc1fab0e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4079e20 con 0x7fc1f41060b0 2024-08-19T00:47:36.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.343+0000 7fc1f88aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f41084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.343+0000 7fc1f88aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f41084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58348/0 (socket says 172.21.15.17:58348) 2024-08-19T00:47:36.085 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.343+0000 7fc1f88aa640 1 -- 172.21.15.17:0/1264669301 learned_addr learned my addr 172.21.15.17:0/1264669301 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:36.086 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.344+0000 7fc1f88aa640 1 -- 172.21.15.17:0/1264669301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f41089e0 con 0x7fc1f41060b0 2024-08-19T00:47:36.086 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.344+0000 7fc1f88aa640 1 --2- 172.21.15.17:0/1264669301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f41084a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009820 tx=0x7fc1e802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89ad4c197a34efb server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:36.086 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.344+0000 7fc1f37fe640 1 -- 172.21.15.17:0/1264669301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1e802ad40 con 0x7fc1f41060b0 2024-08-19T00:47:36.086 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.344+0000 7fc1f37fe640 1 -- 172.21.15.17:0/1264669301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1e8032900 con 0x7fc1f41060b0 2024-08-19T00:47:36.086 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.345+0000 7fc1f37fe640 1 -- 172.21.15.17:0/1264669301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1e8030860 con 0x7fc1f41060b0 2024-08-19T00:47:36.086 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.345+0000 7fc1fab0e640 1 -- 172.21.15.17:0/1264669301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 msgr2=0x7fc1f41084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.086 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.345+0000 7fc1fab0e640 1 --2- 172.21.15.17:0/1264669301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f41084a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8009820 tx=0x7fc1e802a270 comp rx=0 tx=0).stop 2024-08-19T00:47:36.086 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.345+0000 7fc1fab0e640 1 -- 172.21.15.17:0/1264669301 shutdown_connections 2024-08-19T00:47:36.086 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.345+0000 7fc1fab0e640 1 --2- 172.21.15.17:0/1264669301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f41084a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.086 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.345+0000 7fc1fab0e640 1 -- 172.21.15.17:0/1264669301 >> 172.21.15.17:0/1264669301 conn(0x7fc1f40ffc10 msgr2=0x7fc1f4102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.345+0000 7fc1fab0e640 1 -- 172.21.15.17:0/1264669301 shutdown_connections 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.345+0000 7fc1fab0e640 1 -- 172.21.15.17:0/1264669301 wait complete. 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.346+0000 7fc1fab0e640 1 Processor -- start 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.346+0000 7fc1fab0e640 1 -- start start 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.346+0000 7fc1fab0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.346+0000 7fc1fab0e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f4199840 con 0x7fc1f41060b0 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.346+0000 7fc1f88aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.346+0000 7fc1f88aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f4199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58364/0 (socket says 172.21.15.17:58364) 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.346+0000 7fc1f88aa640 1 -- 172.21.15.17:0/206629243 learned_addr learned my addr 172.21.15.17:0/206629243 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.346+0000 7fc1f88aa640 1 -- 172.21.15.17:0/206629243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e80094d0 con 0x7fc1f41060b0 2024-08-19T00:47:36.087 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.346+0000 7fc1f88aa640 1 --2- 172.21.15.17:0/206629243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f4199300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8032670 tx=0x7fc1e80326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:36.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.347+0000 7fc1f1ffb640 1 -- 172.21.15.17:0/206629243 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1e8032c80 con 0x7fc1f41060b0 2024-08-19T00:47:36.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.347+0000 7fc1fab0e640 1 -- 172.21.15.17:0/206629243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f4199a40 con 0x7fc1f41060b0 2024-08-19T00:47:36.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.347+0000 7fc1f1ffb640 1 -- 172.21.15.17:0/206629243 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc1e8032de0 con 0x7fc1f41060b0 2024-08-19T00:47:36.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.347+0000 7fc1f1ffb640 1 -- 172.21.15.17:0/206629243 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc1e803a720 con 0x7fc1f41060b0 2024-08-19T00:47:36.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.347+0000 7fc1fab0e640 1 -- 172.21.15.17:0/206629243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f4199ee0 con 0x7fc1f41060b0 2024-08-19T00:47:36.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.348+0000 7fc1f1ffb640 1 -- 172.21.15.17:0/206629243 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fc1e803a9a0 con 0x7fc1f41060b0 2024-08-19T00:47:36.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.348+0000 7fc1fab0e640 1 -- 172.21.15.17:0/206629243 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f4109790 con 0x7fc1f41060b0 2024-08-19T00:47:36.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.348+0000 7fc1f1ffb640 1 --2- 172.21.15.17:0/206629243 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fc1e40386a0 0x7fc1e403ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:36.088 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.348+0000 7fc1f1ffb640 1 -- 172.21.15.17:0/206629243 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc1e806bbc0 con 0x7fc1f41060b0 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.348+0000 7fc1f3fff640 1 --2- 172.21.15.17:0/206629243 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fc1e40386a0 0x7fc1e403ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.348+0000 7fc1f3fff640 1 --2- 172.21.15.17:0/206629243 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fc1e40386a0 0x7fc1e403ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00098c0 tx=0x7fc1e0006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.353+0000 7fc1f1ffb640 1 -- 172.21.15.17:0/206629243 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fc1e8039d50 con 0x7fc1f41060b0 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.542+0000 7fc1fab0e640 1 -- 172.21.15.17:0/206629243 --> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fc1f4061900 con 0x7fc1e40386a0 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.791+0000 7fc1f1ffb640 1 -- 172.21.15.17:0/206629243 <== mgr.14162 v2:172.21.15.17:6800/1713288012 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fc1f4061900 con 0x7fc1e40386a0 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.793+0000 7fc1fab0e640 1 -- 172.21.15.17:0/206629243 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fc1e40386a0 msgr2=0x7fc1e403ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.793+0000 7fc1fab0e640 1 --2- 172.21.15.17:0/206629243 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fc1e40386a0 0x7fc1e403ab60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00098c0 tx=0x7fc1e0006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.793+0000 7fc1fab0e640 1 -- 172.21.15.17:0/206629243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 msgr2=0x7fc1f4199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.793+0000 7fc1fab0e640 1 --2- 172.21.15.17:0/206629243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f4199300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc1e8032670 tx=0x7fc1e80326a0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.793+0000 7fc1fab0e640 1 -- 172.21.15.17:0/206629243 shutdown_connections 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.793+0000 7fc1fab0e640 1 --2- 172.21.15.17:0/206629243 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fc1e40386a0 0x7fc1e403ab60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.089 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.793+0000 7fc1fab0e640 1 --2- 172.21.15.17:0/206629243 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1f41060b0 0x7fc1f4199300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:36.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.793+0000 7fc1fab0e640 1 -- 172.21.15.17:0/206629243 >> 172.21.15.17:0/206629243 conn(0x7fc1f40ffc10 msgr2=0x7fc1f4100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:36.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.793+0000 7fc1fab0e640 1 -- 172.21.15.17:0/206629243 shutdown_connections 2024-08-19T00:47:36.090 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:34.793+0000 7fc1fab0e640 1 -- 172.21.15.17:0/206629243 wait complete. 2024-08-19T00:47:36.090 INFO:teuthology.orchestra.run.smithi017.stdout:Fetching dashboard port number... 2024-08-19T00:47:36.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:36 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1395928316' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stdout 8443 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.488+0000 7f6388d71640 1 Processor -- start 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.489+0000 7f6388d71640 1 -- start start 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.489+0000 7f6388d71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f63841084b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.489+0000 7f6388d71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6384079e20 con 0x7f63841060c0 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.489+0000 7f638259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f63841084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.489+0000 7f638259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f63841084b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58380/0 (socket says 172.21.15.17:58380) 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.489+0000 7f638259c640 1 -- 172.21.15.17:0/4037299937 learned_addr learned my addr 172.21.15.17:0/4037299937 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.489+0000 7f638259c640 1 -- 172.21.15.17:0/4037299937 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63841089f0 con 0x7f63841060c0 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.490+0000 7f638259c640 1 --2- 172.21.15.17:0/4037299937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f63841084b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6374009820 tx=0x7f637402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297688732416f812 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.490+0000 7f638159a640 1 -- 172.21.15.17:0/4037299937 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f637402ad40 con 0x7f63841060c0 2024-08-19T00:47:37.199 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.490+0000 7f638159a640 1 -- 172.21.15.17:0/4037299937 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6374032900 con 0x7f63841060c0 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.490+0000 7f638159a640 1 -- 172.21.15.17:0/4037299937 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6374030860 con 0x7f63841060c0 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.491+0000 7f6388d71640 1 -- 172.21.15.17:0/4037299937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 msgr2=0x7f63841084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.491+0000 7f6388d71640 1 --2- 172.21.15.17:0/4037299937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f63841084b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6374009820 tx=0x7f637402a270 comp rx=0 tx=0).stop 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.491+0000 7f6388d71640 1 -- 172.21.15.17:0/4037299937 shutdown_connections 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.491+0000 7f6388d71640 1 --2- 172.21.15.17:0/4037299937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f63841084b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.491+0000 7f6388d71640 1 -- 172.21.15.17:0/4037299937 >> 172.21.15.17:0/4037299937 conn(0x7f63840ffcc0 msgr2=0x7f63841020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.491+0000 7f6388d71640 1 -- 172.21.15.17:0/4037299937 shutdown_connections 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.491+0000 7f6388d71640 1 -- 172.21.15.17:0/4037299937 wait complete. 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.492+0000 7f6388d71640 1 Processor -- start 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.492+0000 7f6388d71640 1 -- start start 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.492+0000 7f6388d71640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f6384199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.492+0000 7f6388d71640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6384199850 con 0x7f63841060c0 2024-08-19T00:47:37.200 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.492+0000 7f638259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f6384199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.492+0000 7f638259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f6384199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58396/0 (socket says 172.21.15.17:58396) 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.492+0000 7f638259c640 1 -- 172.21.15.17:0/1395928316 learned_addr learned my addr 172.21.15.17:0/1395928316 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.492+0000 7f638259c640 1 -- 172.21.15.17:0/1395928316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63740094d0 con 0x7f63841060c0 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.492+0000 7f638259c640 1 --2- 172.21.15.17:0/1395928316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f6384199310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6374032670 tx=0x7f63740326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.493+0000 7f63737fe640 1 -- 172.21.15.17:0/1395928316 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6374032c80 con 0x7f63841060c0 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.493+0000 7f63737fe640 1 -- 172.21.15.17:0/1395928316 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6374032de0 con 0x7f63841060c0 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.493+0000 7f6388d71640 1 -- 172.21.15.17:0/1395928316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6384199a50 con 0x7f63841060c0 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.493+0000 7f63737fe640 1 -- 172.21.15.17:0/1395928316 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f637403a720 con 0x7f63841060c0 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.493+0000 7f6388d71640 1 -- 172.21.15.17:0/1395928316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6384199ef0 con 0x7f63841060c0 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.494+0000 7f63737fe640 1 -- 172.21.15.17:0/1395928316 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 12) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f637403a9a0 con 0x7f63841060c0 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.494+0000 7f6388d71640 1 -- 172.21.15.17:0/1395928316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63841097a0 con 0x7f63841060c0 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.494+0000 7f63737fe640 1 --2- 172.21.15.17:0/1395928316 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f636c0386a0 0x7f636c03ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:37.201 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.494+0000 7f63737fe640 1 -- 172.21.15.17:0/1395928316 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f637406ba90 con 0x7f63841060c0 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.494+0000 7f6381d9b640 1 --2- 172.21.15.17:0/1395928316 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f636c0386a0 0x7f636c03ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.494+0000 7f6381d9b640 1 --2- 172.21.15.17:0/1395928316 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f636c0386a0 0x7f636c03ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63780098c0 tx=0x7f6378006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.498+0000 7f63737fe640 1 -- 172.21.15.17:0/1395928316 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f6374039d50 con 0x7f63841060c0 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.669+0000 7f6388d71640 1 -- 172.21.15.17:0/1395928316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f63841099e0 con 0x7f63841060c0 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.669+0000 7f63737fe640 1 -- 172.21.15.17:0/1395928316 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f6374044e90 con 0x7f63841060c0 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.671+0000 7f6388d71640 1 -- 172.21.15.17:0/1395928316 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f636c0386a0 msgr2=0x7f636c03ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.671+0000 7f6388d71640 1 --2- 172.21.15.17:0/1395928316 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f636c0386a0 0x7f636c03ab60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63780098c0 tx=0x7f6378006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.671+0000 7f6388d71640 1 -- 172.21.15.17:0/1395928316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 msgr2=0x7f6384199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.671+0000 7f6388d71640 1 --2- 172.21.15.17:0/1395928316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f6384199310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6374032670 tx=0x7f63740326a0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.671+0000 7f6388d71640 1 -- 172.21.15.17:0/1395928316 shutdown_connections 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.671+0000 7f6388d71640 1 --2- 172.21.15.17:0/1395928316 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f636c0386a0 0x7f636c03ab60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.671+0000 7f6388d71640 1 --2- 172.21.15.17:0/1395928316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63841060c0 0x7f6384199310 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:37.202 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.671+0000 7f6388d71640 1 -- 172.21.15.17:0/1395928316 >> 172.21.15.17:0/1395928316 conn(0x7f63840ffcc0 msgr2=0x7f63841008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:37.203 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.671+0000 7f6388d71640 1 -- 172.21.15.17:0/1395928316 shutdown_connections 2024-08-19T00:47:37.203 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:36.671+0000 7f6388d71640 1 -- 172.21.15.17:0/1395928316 wait complete. 2024-08-19T00:47:37.205 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-19T00:47:37.205 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout disabled 2024-08-19T00:47:37.212 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-19T00:47:37.213 INFO:teuthology.orchestra.run.smithi017.stdout:systemctl: stdout inactive 2024-08-19T00:47:37.213 INFO:teuthology.orchestra.run.smithi017.stdout:firewalld.service is not enabled 2024-08-19T00:47:37.213 INFO:teuthology.orchestra.run.smithi017.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-19T00:47:37.214 INFO:teuthology.orchestra.run.smithi017.stdout:Ceph Dashboard is now available at: 2024-08-19T00:47:37.214 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:47:37.214 INFO:teuthology.orchestra.run.smithi017.stdout: URL: https://smithi017:8443/ 2024-08-19T00:47:37.214 INFO:teuthology.orchestra.run.smithi017.stdout: User: admin 2024-08-19T00:47:37.214 INFO:teuthology.orchestra.run.smithi017.stdout: Password: fibmgowj0h 2024-08-19T00:47:37.214 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:47:37.215 INFO:teuthology.orchestra.run.smithi017.stdout:Saving cluster configuration to /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config directory 2024-08-19T00:47:37.215 INFO:teuthology.orchestra.run.smithi017.stdout:Enabling autotune for osd_memory_target 2024-08-19T00:47:37.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:37 smithi017 ceph-mon[16627]: mgrmap e13: smithi017.hfpawi(active, since 6s) 2024-08-19T00:47:38.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.588+0000 7ff00bf17640 1 Processor -- start 2024-08-19T00:47:38.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.588+0000 7ff00bf17640 1 -- start start 2024-08-19T00:47:38.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.589+0000 7ff00bf17640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004103c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.589+0000 7ff00bf17640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff004104260 con 0x7ff004103890 2024-08-19T00:47:38.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.589+0000 7ff009cb3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.298 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.589+0000 7ff009cb3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44102/0 (socket says 172.21.15.17:44102) 2024-08-19T00:47:38.299 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.589+0000 7ff009cb3640 1 -- 172.21.15.17:0/3769159860 learned_addr learned my addr 172.21.15.17:0/3769159860 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:38.299 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.589+0000 7ff009cb3640 1 -- 172.21.15.17:0/3769159860 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0041043a0 con 0x7ff004103890 2024-08-19T00:47:38.299 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.590+0000 7ff009cb3640 1 --2- 172.21.15.17:0/3769159860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004103c90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff000009820 tx=0x7ff00002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae50284f67cf1579 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.299 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.590+0000 7ff008cb1640 1 -- 172.21.15.17:0/3769159860 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff00002ad40 con 0x7ff004103890 2024-08-19T00:47:38.299 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.590+0000 7ff008cb1640 1 -- 172.21.15.17:0/3769159860 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff000032900 con 0x7ff004103890 2024-08-19T00:47:38.299 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.590+0000 7ff008cb1640 1 -- 172.21.15.17:0/3769159860 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff000030860 con 0x7ff004103890 2024-08-19T00:47:38.299 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.590+0000 7ff00bf17640 1 -- 172.21.15.17:0/3769159860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 msgr2=0x7ff004103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.299 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.590+0000 7ff00bf17640 1 --2- 172.21.15.17:0/3769159860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004103c90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff000009820 tx=0x7ff00002a270 comp rx=0 tx=0).stop 2024-08-19T00:47:38.300 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff00bf17640 1 -- 172.21.15.17:0/3769159860 shutdown_connections 2024-08-19T00:47:38.300 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff00bf17640 1 --2- 172.21.15.17:0/3769159860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004103c90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.300 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff00bf17640 1 -- 172.21.15.17:0/3769159860 >> 172.21.15.17:0/3769159860 conn(0x7ff0040ff420 msgr2=0x7ff004101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:38.300 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff00bf17640 1 -- 172.21.15.17:0/3769159860 shutdown_connections 2024-08-19T00:47:38.300 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff00bf17640 1 -- 172.21.15.17:0/3769159860 wait complete. 2024-08-19T00:47:38.300 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff00bf17640 1 Processor -- start 2024-08-19T00:47:38.300 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff00bf17640 1 -- start start 2024-08-19T00:47:38.300 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff00bf17640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff00bf17640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff004199890 con 0x7ff004103890 2024-08-19T00:47:38.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff009cb3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff009cb3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44108/0 (socket says 172.21.15.17:44108) 2024-08-19T00:47:38.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.591+0000 7ff009cb3640 1 -- 172.21.15.17:0/1951366192 learned_addr learned my addr 172.21.15.17:0/1951366192 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:38.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.592+0000 7ff009cb3640 1 -- 172.21.15.17:0/1951366192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0000094d0 con 0x7ff004103890 2024-08-19T00:47:38.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.592+0000 7ff009cb3640 1 --2- 172.21.15.17:0/1951366192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004199350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff000009940 tx=0x7ff000032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.592+0000 7feffaffd640 1 -- 172.21.15.17:0/1951366192 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff000032c80 con 0x7ff004103890 2024-08-19T00:47:38.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.592+0000 7feffaffd640 1 -- 172.21.15.17:0/1951366192 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff000032de0 con 0x7ff004103890 2024-08-19T00:47:38.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.592+0000 7ff00bf17640 1 -- 172.21.15.17:0/1951366192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff004199a90 con 0x7ff004103890 2024-08-19T00:47:38.301 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.592+0000 7feffaffd640 1 -- 172.21.15.17:0/1951366192 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff00003a720 con 0x7ff004103890 2024-08-19T00:47:38.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.592+0000 7ff00bf17640 1 -- 172.21.15.17:0/1951366192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff004199f30 con 0x7ff004103890 2024-08-19T00:47:38.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.593+0000 7ff00bf17640 1 -- 172.21.15.17:0/1951366192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff004109aa0 con 0x7ff004103890 2024-08-19T00:47:38.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.593+0000 7feffaffd640 1 -- 172.21.15.17:0/1951366192 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7ff00003cc30 con 0x7ff004103890 2024-08-19T00:47:38.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.593+0000 7feffaffd640 1 --2- 172.21.15.17:0/1951366192 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7feff0038790 0x7feff003ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:38.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.593+0000 7feffaffd640 1 -- 172.21.15.17:0/1951366192 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff00006bab0 con 0x7ff004103890 2024-08-19T00:47:38.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.594+0000 7ff0094b2640 1 --2- 172.21.15.17:0/1951366192 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7feff0038790 0x7feff003ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:38.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.594+0000 7ff0094b2640 1 --2- 172.21.15.17:0/1951366192 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7feff0038790 0x7feff003ac50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feff40098c0 tx=0x7feff4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:38.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.598+0000 7feffaffd640 1 -- 172.21.15.17:0/1951366192 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff000043310 con 0x7ff004103890 2024-08-19T00:47:38.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.770+0000 7ff00bf17640 1 -- 172.21.15.17:0/1951366192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff00419c810 con 0x7ff004103890 2024-08-19T00:47:38.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.770+0000 7feffaffd640 1 -- 172.21.15.17:0/1951366192 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff000031b90 con 0x7ff004103890 2024-08-19T00:47:38.302 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.772+0000 7ff00bf17640 1 -- 172.21.15.17:0/1951366192 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7feff0038790 msgr2=0x7feff003ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.772+0000 7ff00bf17640 1 --2- 172.21.15.17:0/1951366192 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7feff0038790 0x7feff003ac50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feff40098c0 tx=0x7feff4006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.772+0000 7ff00bf17640 1 -- 172.21.15.17:0/1951366192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 msgr2=0x7ff004199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:38.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.772+0000 7ff00bf17640 1 --2- 172.21.15.17:0/1951366192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004199350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff000009940 tx=0x7ff000032670 comp rx=0 tx=0).stop 2024-08-19T00:47:38.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.772+0000 7ff00bf17640 1 -- 172.21.15.17:0/1951366192 shutdown_connections 2024-08-19T00:47:38.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.772+0000 7ff00bf17640 1 --2- 172.21.15.17:0/1951366192 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7feff0038790 0x7feff003ac50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.772+0000 7ff00bf17640 1 --2- 172.21.15.17:0/1951366192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff004103890 0x7ff004199350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:38.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.772+0000 7ff00bf17640 1 -- 172.21.15.17:0/1951366192 >> 172.21.15.17:0/1951366192 conn(0x7ff0040ff420 msgr2=0x7ff004100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:38.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.772+0000 7ff00bf17640 1 -- 172.21.15.17:0/1951366192 shutdown_connections 2024-08-19T00:47:38.303 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:37.772+0000 7ff00bf17640 1 -- 172.21.15.17:0/1951366192 wait complete. 2024-08-19T00:47:39.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.689+0000 7f01958be640 1 Processor -- start 2024-08-19T00:47:39.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.689+0000 7f01958be640 1 -- start start 2024-08-19T00:47:39.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.689+0000 7f01958be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019007a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:39.529 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.689+0000 7f01958be640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019007a8c0 con 0x7f019007be90 2024-08-19T00:47:39.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.689+0000 7f018effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019007a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:39.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.689+0000 7f018effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019007a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44114/0 (socket says 172.21.15.17:44114) 2024-08-19T00:47:39.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.689+0000 7f018effd640 1 -- 172.21.15.17:0/195577343 learned_addr learned my addr 172.21.15.17:0/195577343 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:39.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.689+0000 7f018effd640 1 -- 172.21.15.17:0/195577343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019007aa00 con 0x7f019007be90 2024-08-19T00:47:39.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.690+0000 7f018effd640 1 --2- 172.21.15.17:0/195577343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019007a2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0180009820 tx=0x7f018002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed21daf2def2d90 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:39.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.690+0000 7f018e7fc640 1 -- 172.21.15.17:0/195577343 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f018002ad40 con 0x7f019007be90 2024-08-19T00:47:39.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.690+0000 7f018e7fc640 1 -- 172.21.15.17:0/195577343 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0180032900 con 0x7f019007be90 2024-08-19T00:47:39.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.690+0000 7f018e7fc640 1 -- 172.21.15.17:0/195577343 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0180030860 con 0x7f019007be90 2024-08-19T00:47:39.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.691+0000 7f01958be640 1 -- 172.21.15.17:0/195577343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 msgr2=0x7f019007a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:39.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.691+0000 7f01958be640 1 --2- 172.21.15.17:0/195577343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019007a2f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0180009820 tx=0x7f018002a270 comp rx=0 tx=0).stop 2024-08-19T00:47:39.530 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.691+0000 7f01958be640 1 -- 172.21.15.17:0/195577343 shutdown_connections 2024-08-19T00:47:39.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.691+0000 7f01958be640 1 --2- 172.21.15.17:0/195577343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019007a2f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.691+0000 7f01958be640 1 -- 172.21.15.17:0/195577343 >> 172.21.15.17:0/195577343 conn(0x7f0190100d70 msgr2=0x7f0190103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:39.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.691+0000 7f01958be640 1 -- 172.21.15.17:0/195577343 shutdown_connections 2024-08-19T00:47:39.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.691+0000 7f01958be640 1 -- 172.21.15.17:0/195577343 wait complete. 2024-08-19T00:47:39.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.691+0000 7f01958be640 1 Processor -- start 2024-08-19T00:47:39.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f01958be640 1 -- start start 2024-08-19T00:47:39.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f01958be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019019b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:39.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f01958be640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019019ba40 con 0x7f019007be90 2024-08-19T00:47:39.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f018effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019019b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:39.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f018effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019019b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44122/0 (socket says 172.21.15.17:44122) 2024-08-19T00:47:39.531 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f018effd640 1 -- 172.21.15.17:0/1488397329 learned_addr learned my addr 172.21.15.17:0/1488397329 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:39.532 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f018effd640 1 -- 172.21.15.17:0/1488397329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800094d0 con 0x7f019007be90 2024-08-19T00:47:39.532 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f018effd640 1 --2- 172.21.15.17:0/1488397329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019019b500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0180032670 tx=0x7f01800326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:39.532 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f01948bc640 1 -- 172.21.15.17:0/1488397329 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0180032c80 con 0x7f019007be90 2024-08-19T00:47:39.532 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f01948bc640 1 -- 172.21.15.17:0/1488397329 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0180032de0 con 0x7f019007be90 2024-08-19T00:47:39.532 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f01958be640 1 -- 172.21.15.17:0/1488397329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019019bc40 con 0x7f019007be90 2024-08-19T00:47:39.532 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f01948bc640 1 -- 172.21.15.17:0/1488397329 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f018003a720 con 0x7f019007be90 2024-08-19T00:47:39.532 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.692+0000 7f01958be640 1 -- 172.21.15.17:0/1488397329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019019c0e0 con 0x7f019007be90 2024-08-19T00:47:39.532 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.693+0000 7f01948bc640 1 -- 172.21.15.17:0/1488397329 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f018003a950 con 0x7f019007be90 2024-08-19T00:47:39.532 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.693+0000 7f01948bc640 1 --2- 172.21.15.17:0/1488397329 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f017c038790 0x7f017c03ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:39.532 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.693+0000 7f01948bc640 1 -- 172.21.15.17:0/1488397329 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f018006bb40 con 0x7f019007be90 2024-08-19T00:47:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.693+0000 7f0187fff640 1 --2- 172.21.15.17:0/1488397329 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f017c038790 0x7f017c03ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.693+0000 7f01958be640 1 -- 172.21.15.17:0/1488397329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019007a2f0 con 0x7f019007be90 2024-08-19T00:47:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.694+0000 7f0187fff640 1 --2- 172.21.15.17:0/1488397329 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f017c038790 0x7f017c03ac50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f01780098c0 tx=0x7f0178006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.698+0000 7f01948bc640 1 -- 172.21.15.17:0/1488397329 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f0180043310 con 0x7f019007be90 2024-08-19T00:47:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.967+0000 7f01958be640 1 -- 172.21.15.17:0/1488397329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f019010b9e0 con 0x7f019007be90 2024-08-19T00:47:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.970+0000 7f01948bc640 1 -- 172.21.15.17:0/1488397329 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f0180037ed0 con 0x7f019007be90 2024-08-19T00:47:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-19T00:47:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.971+0000 7f01958be640 1 -- 172.21.15.17:0/1488397329 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f017c038790 msgr2=0x7f017c03ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.971+0000 7f01958be640 1 --2- 172.21.15.17:0/1488397329 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f017c038790 0x7f017c03ac50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f01780098c0 tx=0x7f0178006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.972+0000 7f01958be640 1 -- 172.21.15.17:0/1488397329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 msgr2=0x7f019019b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:39.534 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.972+0000 7f01958be640 1 --2- 172.21.15.17:0/1488397329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019019b500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0180032670 tx=0x7f01800326a0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.534 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.972+0000 7f01958be640 1 -- 172.21.15.17:0/1488397329 shutdown_connections 2024-08-19T00:47:39.534 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.972+0000 7f01958be640 1 --2- 172.21.15.17:0/1488397329 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f017c038790 0x7f017c03ac50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.534 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.972+0000 7f01958be640 1 --2- 172.21.15.17:0/1488397329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f019007be90 0x7f019019b500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:39.534 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.972+0000 7f01958be640 1 -- 172.21.15.17:0/1488397329 >> 172.21.15.17:0/1488397329 conn(0x7f0190100d70 msgr2=0x7f0190101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:39.534 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.972+0000 7f01958be640 1 -- 172.21.15.17:0/1488397329 shutdown_connections 2024-08-19T00:47:39.534 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/ceph: stderr 2024-08-19T00:47:38.972+0000 7f01958be640 1 -- 172.21.15.17:0/1488397329 wait complete. 2024-08-19T00:47:39.534 INFO:teuthology.orchestra.run.smithi017.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-19T00:47:39.534 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout:Or, if you are only running a single cluster on this host: 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout: ceph telemetry on 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout:For more information see: 2024-08-19T00:47:39.535 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:47:39.536 INFO:teuthology.orchestra.run.smithi017.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-19T00:47:39.536 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:47:39.536 INFO:teuthology.orchestra.run.smithi017.stdout:Bootstrap complete. 2024-08-19T00:47:39.558 INFO:tasks.cephadm:Fetching config... 2024-08-19T00:47:39.562 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:47:39.562 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-19T00:47:39.614 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-19T00:47:39.615 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:47:39.615 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-19T00:47:39.669 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-19T00:47:39.670 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:47:39.670 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/keyring of=/dev/stdout 2024-08-19T00:47:39.735 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-19T00:47:39.735 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:47:39.735 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-19T00:47:39.790 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-19T00:47:39.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTqjGHL1DDAWJje+yGhTh3cU8Yb6KR9IEu3TJjepe9ma/spwj60dIGyqBOxZqjYKtuduwOxmCJYvE3C9vJPOhu6nksLjXt9R3QDDExqUT8peOzDgEknh+ml5lE/CsrM7Yi7lKTCOsJ1kO9wXgYOzGKQkCo33VQrzwMqfi3P8qGczRUAjbYTERRTfHrIBxd76nY61NyyBfsRtCxeb2Oqjswlub7p3eRSqWhxkHKccAJ3Ipgvz9e7QyL4keMQIgkcWklcMUt+pLmCu+gLeF8/Ju7s8dRGye9SY/VQDWlLO6EmN/EHQU88KRG942aO3uhQ/2tLY7YPkm5fyluJQIvAr+jC3rzBR7xwCSCnsI/ZTrdb6OMnQr8AWtFOMw08AYin8cu/GEmtZem+KSbdbW7PT1JCO/AxxEK4DCZN/DRUxOo0ZOollMSUXUa9U33irYDuoB4IyL/Q5dxv3x/KW0NFzhE7oCYIpecwpJbX8hA6vCDN0K1VS7RZmpXZhVkkmxLq4k= ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-19T00:47:39.866 INFO:teuthology.orchestra.run.smithi017.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTqjGHL1DDAWJje+yGhTh3cU8Yb6KR9IEu3TJjepe9ma/spwj60dIGyqBOxZqjYKtuduwOxmCJYvE3C9vJPOhu6nksLjXt9R3QDDExqUT8peOzDgEknh+ml5lE/CsrM7Yi7lKTCOsJ1kO9wXgYOzGKQkCo33VQrzwMqfi3P8qGczRUAjbYTERRTfHrIBxd76nY61NyyBfsRtCxeb2Oqjswlub7p3eRSqWhxkHKccAJ3Ipgvz9e7QyL4keMQIgkcWklcMUt+pLmCu+gLeF8/Ju7s8dRGye9SY/VQDWlLO6EmN/EHQU88KRG942aO3uhQ/2tLY7YPkm5fyluJQIvAr+jC3rzBR7xwCSCnsI/ZTrdb6OMnQr8AWtFOMw08AYin8cu/GEmtZem+KSbdbW7PT1JCO/AxxEK4DCZN/DRUxOo0ZOollMSUXUa9U33irYDuoB4IyL/Q5dxv3x/KW0NFzhE7oCYIpecwpJbX8hA6vCDN0K1VS7RZmpXZhVkkmxLq4k= ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:47:39.877 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTqjGHL1DDAWJje+yGhTh3cU8Yb6KR9IEu3TJjepe9ma/spwj60dIGyqBOxZqjYKtuduwOxmCJYvE3C9vJPOhu6nksLjXt9R3QDDExqUT8peOzDgEknh+ml5lE/CsrM7Yi7lKTCOsJ1kO9wXgYOzGKQkCo33VQrzwMqfi3P8qGczRUAjbYTERRTfHrIBxd76nY61NyyBfsRtCxeb2Oqjswlub7p3eRSqWhxkHKccAJ3Ipgvz9e7QyL4keMQIgkcWklcMUt+pLmCu+gLeF8/Ju7s8dRGye9SY/VQDWlLO6EmN/EHQU88KRG942aO3uhQ/2tLY7YPkm5fyluJQIvAr+jC3rzBR7xwCSCnsI/ZTrdb6OMnQr8AWtFOMw08AYin8cu/GEmtZem+KSbdbW7PT1JCO/AxxEK4DCZN/DRUxOo0ZOollMSUXUa9U33irYDuoB4IyL/Q5dxv3x/KW0NFzhE7oCYIpecwpJbX8hA6vCDN0K1VS7RZmpXZhVkkmxLq4k= ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-19T00:47:39.920 INFO:teuthology.orchestra.run.smithi086.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCTqjGHL1DDAWJje+yGhTh3cU8Yb6KR9IEu3TJjepe9ma/spwj60dIGyqBOxZqjYKtuduwOxmCJYvE3C9vJPOhu6nksLjXt9R3QDDExqUT8peOzDgEknh+ml5lE/CsrM7Yi7lKTCOsJ1kO9wXgYOzGKQkCo33VQrzwMqfi3P8qGczRUAjbYTERRTfHrIBxd76nY61NyyBfsRtCxeb2Oqjswlub7p3eRSqWhxkHKccAJ3Ipgvz9e7QyL4keMQIgkcWklcMUt+pLmCu+gLeF8/Ju7s8dRGye9SY/VQDWlLO6EmN/EHQU88KRG942aO3uhQ/2tLY7YPkm5fyluJQIvAr+jC3rzBR7xwCSCnsI/ZTrdb6OMnQr8AWtFOMw08AYin8cu/GEmtZem+KSbdbW7PT1JCO/AxxEK4DCZN/DRUxOo0ZOollMSUXUa9U33irYDuoB4IyL/Q5dxv3x/KW0NFzhE7oCYIpecwpJbX8hA6vCDN0K1VS7RZmpXZhVkkmxLq4k= ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:47:39.933 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-19T00:47:40.135 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:47:40.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:39 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1488397329' entity='client.admin' 2024-08-19T00:47:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.424+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2491494482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ac0ff7e0 msgr2=0x7fb8ac0ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.424+0000 7fb8b0e8f640 1 --2- 172.21.15.17:0/2491494482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ac0ff7e0 0x7fb8ac0ffbe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009880 tx=0x7fb89c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:47:42.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.424+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2491494482 shutdown_connections 2024-08-19T00:47:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.424+0000 7fb8b0e8f640 1 --2- 172.21.15.17:0/2491494482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ac0ff7e0 0x7fb8ac0ffbe0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.424+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2491494482 >> 172.21.15.17:0/2491494482 conn(0x7fb8ac0faf90 msgr2=0x7fb8ac0fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.424+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2491494482 shutdown_connections 2024-08-19T00:47:42.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.424+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2491494482 wait complete. 2024-08-19T00:47:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.425+0000 7fb8b0e8f640 1 Processor -- start 2024-08-19T00:47:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.425+0000 7fb8b0e8f640 1 -- start start 2024-08-19T00:47:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.425+0000 7fb8b0e8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ac0ff7e0 0x7fb8ac194cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.425+0000 7fb8b0e8f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac195200 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.425+0000 7fb8aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ac0ff7e0 0x7fb8ac194cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.425+0000 7fb8aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ac0ff7e0 0x7fb8ac194cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44132/0 (socket says 172.21.15.17:44132) 2024-08-19T00:47:42.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.425+0000 7fb8aa59c640 1 -- 172.21.15.17:0/2759785967 learned_addr learned my addr 172.21.15.17:0/2759785967 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.426+0000 7fb8aa59c640 1 -- 172.21.15.17:0/2759785967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c009560 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.426+0000 7fb8aa59c640 1 --2- 172.21.15.17:0/2759785967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ac0ff7e0 0x7fb8ac194cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb89c005610 tx=0x7fb89c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.426+0000 7fb8a37fe640 1 -- 172.21.15.17:0/2759785967 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb89c004b20 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.426+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2759785967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac195400 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.426+0000 7fb8a37fe640 1 -- 172.21.15.17:0/2759785967 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb89c004c80 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.426+0000 7fb8a37fe640 1 -- 172.21.15.17:0/2759785967 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb89c031a90 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.426+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2759785967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac1958a0 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.427+0000 7fb8a37fe640 1 -- 172.21.15.17:0/2759785967 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fb89c031d00 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.427+0000 7fb8a37fe640 1 --2- 172.21.15.17:0/2759785967 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb898038790 0x7fb89803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.427+0000 7fb8a37fe640 1 -- 172.21.15.17:0/2759785967 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb89c06c560 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.427+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2759785967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac0ffbe0 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.427+0000 7fb8a9d9b640 1 --2- 172.21.15.17:0/2759785967 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb898038790 0x7fb89803ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:42.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.428+0000 7fb8a9d9b640 1 --2- 172.21.15.17:0/2759785967 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb898038790 0x7fb89803ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb8940098c0 tx=0x7fb894006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:42.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.432+0000 7fb8a37fe640 1 -- 172.21.15.17:0/2759785967 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb89c035020 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.644+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2759785967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fb8ac18e610 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.647+0000 7fb8a37fe640 1 -- 172.21.15.17:0/2759785967 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb89c0035f0 con 0x7fb8ac0ff7e0 2024-08-19T00:47:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.649+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2759785967 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb898038790 msgr2=0x7fb89803ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.649+0000 7fb8b0e8f640 1 --2- 172.21.15.17:0/2759785967 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb898038790 0x7fb89803ac50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb8940098c0 tx=0x7fb894006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:42.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.649+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2759785967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ac0ff7e0 msgr2=0x7fb8ac194cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.649+0000 7fb8b0e8f640 1 --2- 172.21.15.17:0/2759785967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ac0ff7e0 0x7fb8ac194cc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb89c005610 tx=0x7fb89c005640 comp rx=0 tx=0).stop 2024-08-19T00:47:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.649+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2759785967 shutdown_connections 2024-08-19T00:47:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.649+0000 7fb8b0e8f640 1 --2- 172.21.15.17:0/2759785967 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb898038790 0x7fb89803ac50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.649+0000 7fb8b0e8f640 1 --2- 172.21.15.17:0/2759785967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8ac0ff7e0 0x7fb8ac194cc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.649+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2759785967 >> 172.21.15.17:0/2759785967 conn(0x7fb8ac0faf90 msgr2=0x7fb8ac0fb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.649+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2759785967 shutdown_connections 2024-08-19T00:47:42.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:42.649+0000 7fb8b0e8f640 1 -- 172.21.15.17:0/2759785967 wait complete. 2024-08-19T00:47:43.395 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-19T00:47:43.395 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-19T00:47:43.858 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:47:43.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:43 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2759785967' entity='client.admin' 2024-08-19T00:47:45.122 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:44 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:45.122 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:44 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:45.122 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:44 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:47:45.122 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:44 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:45.122 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:44 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T00:47:45.123 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:44 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-19T00:47:45.123 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:44 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:47:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.487+0000 7f17fca0a640 1 -- 172.21.15.17:0/1826831536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f80fe6d0 msgr2=0x7f17f80fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.487+0000 7f17fca0a640 1 --2- 172.21.15.17:0/1826831536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f80fe6d0 0x7f17f80fead0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009880 tx=0x7f17e802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.487+0000 7f17fca0a640 1 -- 172.21.15.17:0/1826831536 shutdown_connections 2024-08-19T00:47:45.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.487+0000 7f17fca0a640 1 --2- 172.21.15.17:0/1826831536 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f80fe6d0 0x7f17f80fead0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.487+0000 7f17fca0a640 1 -- 172.21.15.17:0/1826831536 >> 172.21.15.17:0/1826831536 conn(0x7f17f80f9e80 msgr2=0x7f17f80fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.487+0000 7f17fca0a640 1 -- 172.21.15.17:0/1826831536 shutdown_connections 2024-08-19T00:47:45.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.487+0000 7f17fca0a640 1 -- 172.21.15.17:0/1826831536 wait complete. 2024-08-19T00:47:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.488+0000 7f17fca0a640 1 Processor -- start 2024-08-19T00:47:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.488+0000 7f17fca0a640 1 -- start start 2024-08-19T00:47:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.488+0000 7f17fca0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f80fe6d0 0x7f17f8194d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.488+0000 7f17fca0a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f81952a0 con 0x7f17f80fe6d0 2024-08-19T00:47:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.488+0000 7f17f659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f80fe6d0 0x7f17f8194d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.488+0000 7f17f659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f80fe6d0 0x7f17f8194d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44148/0 (socket says 172.21.15.17:44148) 2024-08-19T00:47:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.488+0000 7f17f659c640 1 -- 172.21.15.17:0/2337560608 learned_addr learned my addr 172.21.15.17:0/2337560608 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:45.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.489+0000 7f17f659c640 1 -- 172.21.15.17:0/2337560608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e8009560 con 0x7f17f80fe6d0 2024-08-19T00:47:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.489+0000 7f17f659c640 1 --2- 172.21.15.17:0/2337560608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f80fe6d0 0x7f17f8194d60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009230 tx=0x7f17e80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.489+0000 7f17effff640 1 -- 172.21.15.17:0/2337560608 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17e8004aa0 con 0x7f17f80fe6d0 2024-08-19T00:47:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.489+0000 7f17fca0a640 1 -- 172.21.15.17:0/2337560608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f81954a0 con 0x7f17f80fe6d0 2024-08-19T00:47:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.489+0000 7f17effff640 1 -- 172.21.15.17:0/2337560608 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17e8004c00 con 0x7f17f80fe6d0 2024-08-19T00:47:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.489+0000 7f17effff640 1 -- 172.21.15.17:0/2337560608 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f17e8031a60 con 0x7f17f80fe6d0 2024-08-19T00:47:45.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.489+0000 7f17fca0a640 1 -- 172.21.15.17:0/2337560608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f8195940 con 0x7f17f80fe6d0 2024-08-19T00:47:45.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.490+0000 7f17effff640 1 -- 172.21.15.17:0/2337560608 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f17e8031bc0 con 0x7f17f80fe6d0 2024-08-19T00:47:45.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.490+0000 7f17fca0a640 1 -- 172.21.15.17:0/2337560608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f80fead0 con 0x7f17f80fe6d0 2024-08-19T00:47:45.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.490+0000 7f17effff640 1 --2- 172.21.15.17:0/2337560608 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f17e4038740 0x7f17e403ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:45.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.490+0000 7f17effff640 1 -- 172.21.15.17:0/2337560608 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f17e806c4c0 con 0x7f17f80fe6d0 2024-08-19T00:47:45.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.490+0000 7f17edd9b640 1 --2- 172.21.15.17:0/2337560608 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f17e4038740 0x7f17e403ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:45.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.491+0000 7f17edd9b640 1 --2- 172.21.15.17:0/2337560608 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f17e4038740 0x7f17e403ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f17e00098c0 tx=0x7f17e0006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:45.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.495+0000 7f17effff640 1 -- 172.21.15.17:0/2337560608 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f17e804d530 con 0x7f17f80fe6d0 2024-08-19T00:47:45.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.671+0000 7f17fca0a640 1 -- 172.21.15.17:0/2337560608 --> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f17f802c4e0 con 0x7f17e4038740 2024-08-19T00:47:45.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.675+0000 7f17effff640 1 -- 172.21.15.17:0/2337560608 <== mgr.14162 v2:172.21.15.17:6800/1713288012 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f17f802c4e0 con 0x7f17e4038740 2024-08-19T00:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.677+0000 7f17fca0a640 1 -- 172.21.15.17:0/2337560608 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f17e4038740 msgr2=0x7f17e403ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.677+0000 7f17fca0a640 1 --2- 172.21.15.17:0/2337560608 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f17e4038740 0x7f17e403ac00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f17e00098c0 tx=0x7f17e0006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.677+0000 7f17fca0a640 1 -- 172.21.15.17:0/2337560608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f80fe6d0 msgr2=0x7f17f8194d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.677+0000 7f17fca0a640 1 --2- 172.21.15.17:0/2337560608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f80fe6d0 0x7f17f8194d60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009230 tx=0x7f17e80056e0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.677+0000 7f17fca0a640 1 -- 172.21.15.17:0/2337560608 shutdown_connections 2024-08-19T00:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.677+0000 7f17fca0a640 1 --2- 172.21.15.17:0/2337560608 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f17e4038740 0x7f17e403ac00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.677+0000 7f17fca0a640 1 --2- 172.21.15.17:0/2337560608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17f80fe6d0 0x7f17f8194d60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.677+0000 7f17fca0a640 1 -- 172.21.15.17:0/2337560608 >> 172.21.15.17:0/2337560608 conn(0x7f17f80f9e80 msgr2=0x7f17f8067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:45.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.677+0000 7f17fca0a640 1 -- 172.21.15.17:0/2337560608 shutdown_connections 2024-08-19T00:47:45.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:45.677+0000 7f17fca0a640 1 -- 172.21.15.17:0/2337560608 wait complete. 2024-08-19T00:47:45.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:45 smithi017 ceph-mon[16627]: Deploying daemon ceph-exporter.smithi017 on smithi017 2024-08-19T00:47:45.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:45 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:46.426 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi086 2024-08-19T00:47:46.427 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:47:46.427 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/etc/ceph/ceph.conf 2024-08-19T00:47:46.446 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:47:46.446 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:47:46.505 INFO:tasks.cephadm:Adding host smithi086 to orchestrator... 2024-08-19T00:47:46.505 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph orch host add smithi086 2024-08-19T00:47:46.894 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:47:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:46 smithi017 ceph-mon[16627]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:48.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.822+0000 7f926d85f640 1 -- 172.21.15.17:0/307394886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92680ff800 msgr2=0x7f92680ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.822+0000 7f926d85f640 1 --2- 172.21.15.17:0/307394886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92680ff800 0x7f92680ffc00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9258009880 tx=0x7f925802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.822+0000 7f926d85f640 1 -- 172.21.15.17:0/307394886 shutdown_connections 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.822+0000 7f926d85f640 1 --2- 172.21.15.17:0/307394886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92680ff800 0x7f92680ffc00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.822+0000 7f926d85f640 1 -- 172.21.15.17:0/307394886 >> 172.21.15.17:0/307394886 conn(0x7f92680fafd0 msgr2=0x7f92680fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.822+0000 7f926d85f640 1 -- 172.21.15.17:0/307394886 shutdown_connections 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.822+0000 7f926d85f640 1 -- 172.21.15.17:0/307394886 wait complete. 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.822+0000 7f926d85f640 1 Processor -- start 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.823+0000 7f926d85f640 1 -- start start 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.823+0000 7f926d85f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92680ff800 0x7f9268074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.823+0000 7f926d85f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680746b0 con 0x7f92680ff800 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.823+0000 7f9266ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92680ff800 0x7f9268074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.823+0000 7f9266ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92680ff800 0x7f9268074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48774/0 (socket says 172.21.15.17:48774) 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.823+0000 7f9266ffd640 1 -- 172.21.15.17:0/2264019696 learned_addr learned my addr 172.21.15.17:0/2264019696 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.823+0000 7f9266ffd640 1 -- 172.21.15.17:0/2264019696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9258009560 con 0x7f92680ff800 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.823+0000 7f9266ffd640 1 --2- 172.21.15.17:0/2264019696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92680ff800 0x7f9268074170 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9258005610 tx=0x7f9258005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.823+0000 7f926c85d640 1 -- 172.21.15.17:0/2264019696 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9258004b20 con 0x7f92680ff800 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.823+0000 7f926c85d640 1 -- 172.21.15.17:0/2264019696 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9258004c80 con 0x7f92680ff800 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.823+0000 7f926d85f640 1 -- 172.21.15.17:0/2264019696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92680728a0 con 0x7f92680ff800 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.824+0000 7f926c85d640 1 -- 172.21.15.17:0/2264019696 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9258031a90 con 0x7f92680ff800 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.824+0000 7f926d85f640 1 -- 172.21.15.17:0/2264019696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9268072d40 con 0x7f92680ff800 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.824+0000 7f926c85d640 1 -- 172.21.15.17:0/2264019696 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f9258031d00 con 0x7f92680ff800 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.824+0000 7f926d85f640 1 -- 172.21.15.17:0/2264019696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9268105ff0 con 0x7f92680ff800 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.825+0000 7f926c85d640 1 --2- 172.21.15.17:0/2264019696 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f9250038790 0x7f925003ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:48.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.825+0000 7f926c85d640 1 -- 172.21.15.17:0/2264019696 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f925806c480 con 0x7f92680ff800 2024-08-19T00:47:48.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.825+0000 7f92667fc640 1 --2- 172.21.15.17:0/2264019696 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f9250038790 0x7f925003ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:48.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.825+0000 7f92667fc640 1 --2- 172.21.15.17:0/2264019696 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f9250038790 0x7f925003ac50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f925c0098c0 tx=0x7f925c006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:48.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:48.829+0000 7f926c85d640 1 -- 172.21.15.17:0/2264019696 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f925804ddb0 con 0x7f92680ff800 2024-08-19T00:47:49.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:49.010+0000 7f926d85f640 1 -- 172.21.15.17:0/2264019696 --> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi086", "target": ["mon-mgr", ""]}) v1 -- 0x7f926818e1b0 con 0x7f9250038790 2024-08-19T00:47:50.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:50 smithi017 ceph-mon[16627]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi086", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:47:50.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:50 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:50.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:50 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:50.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:50 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:50.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:50 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:50.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:50 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T00:47:50.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:50 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-08-19T00:47:50.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:50 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:47:50.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:50 smithi017 ceph-mon[16627]: Deploying daemon crash.smithi017 on smithi017 2024-08-19T00:47:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:51 smithi017 ceph-mon[16627]: Deploying cephadm binary to smithi086 2024-08-19T00:47:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:51 smithi017 ceph-mon[16627]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:47:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:51 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:52.330 INFO:teuthology.orchestra.run.smithi017.stdout:Added host 'smithi086' with addr '172.21.15.86' 2024-08-19T00:47:52.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:52.327+0000 7f926c85d640 1 -- 172.21.15.17:0/2264019696 <== mgr.14162 v2:172.21.15.17:6800/1713288012 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f926818e1b0 con 0x7f9250038790 2024-08-19T00:47:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:52.330+0000 7f926d85f640 1 -- 172.21.15.17:0/2264019696 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f9250038790 msgr2=0x7f925003ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:52.330+0000 7f926d85f640 1 --2- 172.21.15.17:0/2264019696 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f9250038790 0x7f925003ac50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f925c0098c0 tx=0x7f925c006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:52.330+0000 7f926d85f640 1 -- 172.21.15.17:0/2264019696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92680ff800 msgr2=0x7f9268074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:52.330+0000 7f926d85f640 1 --2- 172.21.15.17:0/2264019696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92680ff800 0x7f9268074170 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9258005610 tx=0x7f9258005640 comp rx=0 tx=0).stop 2024-08-19T00:47:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:52.330+0000 7f926d85f640 1 -- 172.21.15.17:0/2264019696 shutdown_connections 2024-08-19T00:47:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:52.330+0000 7f926d85f640 1 --2- 172.21.15.17:0/2264019696 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f9250038790 0x7f925003ac50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:52.330+0000 7f926d85f640 1 --2- 172.21.15.17:0/2264019696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92680ff800 0x7f9268074170 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:52.330+0000 7f926d85f640 1 -- 172.21.15.17:0/2264019696 >> 172.21.15.17:0/2264019696 conn(0x7f92680fafd0 msgr2=0x7f92680fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:52.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:52.330+0000 7f926d85f640 1 -- 172.21.15.17:0/2264019696 shutdown_connections 2024-08-19T00:47:52.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:52.330+0000 7f926d85f640 1 -- 172.21.15.17:0/2264019696 wait complete. 2024-08-19T00:47:52.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:52 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:52.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:52 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:52.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:52 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:52.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:52 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:52.890 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:52 smithi017 ceph-mon[16627]: Deploying daemon node-exporter.smithi017 on smithi017 2024-08-19T00:47:52.965 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-19T00:47:53.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:52 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:53.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:52 smithi017 ceph-mon[16627]: Added host smithi086 2024-08-19T00:47:53.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:52 smithi017 ceph-mon[16627]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:47:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:47:55.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.878+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3464067886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3b41002c0 msgr2=0x7fa3b41026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.878+0000 7fa3b99c7640 1 --2- 172.21.15.17:0/3464067886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3b41002c0 0x7fa3b41026b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009880 tx=0x7fa3a402a5d0 comp rx=0 tx=0).stop 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.878+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3464067886 shutdown_connections 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.878+0000 7fa3b99c7640 1 --2- 172.21.15.17:0/3464067886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3b41002c0 0x7fa3b41026b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.878+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3464067886 >> 172.21.15.17:0/3464067886 conn(0x7fa3b40f9e80 msgr2=0x7fa3b40fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.878+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3464067886 shutdown_connections 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.878+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3464067886 wait complete. 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.878+0000 7fa3b99c7640 1 Processor -- start 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.878+0000 7fa3b99c7640 1 -- start start 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b99c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3b41002c0 0x7fa3b4194d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b99c7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b4195240 con 0x7fa3b41002c0 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3b41002c0 0x7fa3b4194d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:55.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3b41002c0 0x7fa3b4194d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48822/0 (socket says 172.21.15.17:48822) 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b2ffd640 1 -- 172.21.15.17:0/3902536951 learned_addr learned my addr 172.21.15.17:0/3902536951 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b2ffd640 1 -- 172.21.15.17:0/3902536951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4009560 con 0x7fa3b41002c0 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b2ffd640 1 --2- 172.21.15.17:0/3902536951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3b41002c0 0x7fa3b4194d00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40099a0 tx=0x7fa3a40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b89c5640 1 -- 172.21.15.17:0/3902536951 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3a4004aa0 con 0x7fa3b41002c0 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b89c5640 1 -- 172.21.15.17:0/3902536951 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3a4004c00 con 0x7fa3b41002c0 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3902536951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b4195440 con 0x7fa3b41002c0 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b89c5640 1 -- 172.21.15.17:0/3902536951 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3a40319d0 con 0x7fa3b41002c0 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.879+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3902536951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b41958e0 con 0x7fa3b41002c0 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.880+0000 7fa3b89c5640 1 -- 172.21.15.17:0/3902536951 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fa3a4031c40 con 0x7fa3b41002c0 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.881+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3902536951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b41006a0 con 0x7fa3b41002c0 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.881+0000 7fa3b89c5640 1 --2- 172.21.15.17:0/3902536951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fa39c038740 0x7fa39c03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.881+0000 7fa3b89c5640 1 -- 172.21.15.17:0/3902536951 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa3a406c560 con 0x7fa3b41002c0 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.881+0000 7fa3b27fc640 1 --2- 172.21.15.17:0/3902536951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fa39c038740 0x7fa39c03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:55.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.881+0000 7fa3b27fc640 1 --2- 172.21.15.17:0/3902536951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fa39c038740 0x7fa39c03ac00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80098c0 tx=0x7fa3a8006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:55.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:55.885+0000 7fa3b89c5640 1 -- 172.21.15.17:0/3902536951 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fa3a403c890 con 0x7fa3b41002c0 2024-08-19T00:47:56.025 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:55 smithi017 ceph-mon[16627]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:47:56.025 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:55 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:56.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.065+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3902536951 --> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3b402c450 con 0x7fa39c038740 2024-08-19T00:47:56.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.066+0000 7fa3b89c5640 1 -- 172.21.15.17:0/3902536951 <== mgr.14162 v2:172.21.15.17:6800/1713288012 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7fa3b402c450 con 0x7fa39c038740 2024-08-19T00:47:56.068 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:47:56.068 INFO:teuthology.orchestra.run.smithi017.stdout:[{"addr": "172.21.15.17", "hostname": "smithi017", "labels": [], "status": ""}, {"addr": "172.21.15.86", "hostname": "smithi086", "labels": [], "status": ""}] 2024-08-19T00:47:56.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.068+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3902536951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fa39c038740 msgr2=0x7fa39c03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.068+0000 7fa3b99c7640 1 --2- 172.21.15.17:0/3902536951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fa39c038740 0x7fa39c03ac00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80098c0 tx=0x7fa3a8006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.068+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3902536951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3b41002c0 msgr2=0x7fa3b4194d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.068+0000 7fa3b99c7640 1 --2- 172.21.15.17:0/3902536951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3b41002c0 0x7fa3b4194d00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40099a0 tx=0x7fa3a40056e0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.068+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3902536951 shutdown_connections 2024-08-19T00:47:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.068+0000 7fa3b99c7640 1 --2- 172.21.15.17:0/3902536951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fa39c038740 0x7fa39c03ac00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.068+0000 7fa3b99c7640 1 --2- 172.21.15.17:0/3902536951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3b41002c0 0x7fa3b4194d00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.068+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3902536951 >> 172.21.15.17:0/3902536951 conn(0x7fa3b40f9e80 msgr2=0x7fa3b40fa900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.069+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3902536951 shutdown_connections 2024-08-19T00:47:56.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:56.069+0000 7fa3b99c7640 1 -- 172.21.15.17:0/3902536951 wait complete. 2024-08-19T00:47:56.916 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-19T00:47:56.916 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd crush tunables default 2024-08-19T00:47:57.253 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:47:57.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:57 smithi017 ceph-mon[16627]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:47:57.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:57 smithi017 ceph-mon[16627]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:47:57.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:57 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:57.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:57 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:57.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:57 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:57.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:57 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:47:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:58 smithi017 ceph-mon[16627]: Deploying daemon alertmanager.smithi017 on smithi017 2024-08-19T00:47:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.048+0000 7f01b0a9c640 1 -- 172.21.15.17:0/3757861349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01ac0ffc80 msgr2=0x7f01ac100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.048+0000 7f01b0a9c640 1 --2- 172.21.15.17:0/3757861349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01ac0ffc80 0x7f01ac100080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f019c009880 tx=0x7f019c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.048+0000 7f01b0a9c640 1 -- 172.21.15.17:0/3757861349 shutdown_connections 2024-08-19T00:47:59.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.048+0000 7f01b0a9c640 1 --2- 172.21.15.17:0/3757861349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01ac0ffc80 0x7f01ac100080 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.048+0000 7f01b0a9c640 1 -- 172.21.15.17:0/3757861349 >> 172.21.15.17:0/3757861349 conn(0x7f01ac0f9640 msgr2=0x7f01ac0fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.048+0000 7f01b0a9c640 1 -- 172.21.15.17:0/3757861349 shutdown_connections 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.048+0000 7f01b0a9c640 1 -- 172.21.15.17:0/3757861349 wait complete. 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.049+0000 7f01b0a9c640 1 Processor -- start 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.049+0000 7f01b0a9c640 1 -- start start 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.049+0000 7f01b0a9c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01ac0ffc80 0x7f01ac196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.049+0000 7f01b0a9c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac197430 con 0x7f01ac0ffc80 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.049+0000 7f01aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01ac0ffc80 0x7f01ac196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.049+0000 7f01aa59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01ac0ffc80 0x7f01ac196ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39620/0 (socket says 172.21.15.17:39620) 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.049+0000 7f01aa59c640 1 -- 172.21.15.17:0/2332532214 learned_addr learned my addr 172.21.15.17:0/2332532214 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.050+0000 7f01aa59c640 1 -- 172.21.15.17:0/2332532214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c009560 con 0x7f01ac0ffc80 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.050+0000 7f01aa59c640 1 --2- 172.21.15.17:0/2332532214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01ac0ffc80 0x7f01ac196ef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f019c005610 tx=0x7f019c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:59.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.050+0000 7f01a37fe640 1 -- 172.21.15.17:0/2332532214 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f019c004b20 con 0x7f01ac0ffc80 2024-08-19T00:47:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.050+0000 7f01a37fe640 1 -- 172.21.15.17:0/2332532214 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f019c004c80 con 0x7f01ac0ffc80 2024-08-19T00:47:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.050+0000 7f01b0a9c640 1 -- 172.21.15.17:0/2332532214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac197630 con 0x7f01ac0ffc80 2024-08-19T00:47:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.050+0000 7f01a37fe640 1 -- 172.21.15.17:0/2332532214 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f019c031a90 con 0x7f01ac0ffc80 2024-08-19T00:47:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.050+0000 7f01b0a9c640 1 -- 172.21.15.17:0/2332532214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac197ad0 con 0x7f01ac0ffc80 2024-08-19T00:47:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.051+0000 7f01a37fe640 1 -- 172.21.15.17:0/2332532214 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f019c031d50 con 0x7f01ac0ffc80 2024-08-19T00:47:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.051+0000 7f01b0a9c640 1 -- 172.21.15.17:0/2332532214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac100080 con 0x7f01ac0ffc80 2024-08-19T00:47:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.051+0000 7f01a37fe640 1 --2- 172.21.15.17:0/2332532214 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f0198038740 0x7f019803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:47:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.051+0000 7f01a37fe640 1 -- 172.21.15.17:0/2332532214 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f019c06c7a0 con 0x7f01ac0ffc80 2024-08-19T00:47:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.051+0000 7f01a3fff640 1 --2- 172.21.15.17:0/2332532214 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f0198038740 0x7f019803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:47:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.052+0000 7f01a3fff640 1 --2- 172.21.15.17:0/2332532214 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f0198038740 0x7f019803ac00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f01940098c0 tx=0x7f0194006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:47:59.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.056+0000 7f01a37fe640 1 -- 172.21.15.17:0/2332532214 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f019c04ddb0 con 0x7f01ac0ffc80 2024-08-19T00:47:59.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.233+0000 7f01b0a9c640 1 -- 172.21.15.17:0/2332532214 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f01ac19a570 con 0x7f01ac0ffc80 2024-08-19T00:47:59.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.816+0000 7f01a37fe640 1 -- 172.21.15.17:0/2332532214 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f019c035070 con 0x7f01ac0ffc80 2024-08-19T00:47:59.819 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-08-19T00:47:59.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.819+0000 7f01b0a9c640 1 -- 172.21.15.17:0/2332532214 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f0198038740 msgr2=0x7f019803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:59.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.819+0000 7f01b0a9c640 1 --2- 172.21.15.17:0/2332532214 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f0198038740 0x7f019803ac00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f01940098c0 tx=0x7f0194006db0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.819+0000 7f01b0a9c640 1 -- 172.21.15.17:0/2332532214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01ac0ffc80 msgr2=0x7f01ac196ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:47:59.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.819+0000 7f01b0a9c640 1 --2- 172.21.15.17:0/2332532214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01ac0ffc80 0x7f01ac196ef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f019c005610 tx=0x7f019c005640 comp rx=0 tx=0).stop 2024-08-19T00:47:59.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.819+0000 7f01b0a9c640 1 -- 172.21.15.17:0/2332532214 shutdown_connections 2024-08-19T00:47:59.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.819+0000 7f01b0a9c640 1 --2- 172.21.15.17:0/2332532214 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f0198038740 0x7f019803ac00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.819+0000 7f01b0a9c640 1 --2- 172.21.15.17:0/2332532214 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01ac0ffc80 0x7f01ac196ef0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:47:59.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.819+0000 7f01b0a9c640 1 -- 172.21.15.17:0/2332532214 >> 172.21.15.17:0/2332532214 conn(0x7f01ac0f9640 msgr2=0x7f01ac0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:47:59.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.819+0000 7f01b0a9c640 1 -- 172.21.15.17:0/2332532214 shutdown_connections 2024-08-19T00:47:59.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:47:59.819+0000 7f01b0a9c640 1 -- 172.21.15.17:0/2332532214 wait complete. 2024-08-19T00:48:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:59 smithi017 ceph-mon[16627]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:47:59 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2332532214' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-19T00:48:01.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:00 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2332532214' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-19T00:48:01.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:00 smithi017 ceph-mon[16627]: osdmap e4: 0 total, 0 up, 0 in 2024-08-19T00:48:01.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:00 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:01.337 INFO:tasks.cephadm:Adding mon.smithi017 on smithi017 2024-08-19T00:48:01.337 INFO:tasks.cephadm:Adding mon.smithi086 on smithi086 2024-08-19T00:48:01.337 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph orch apply mon '2;smithi017:172.21.15.17=smithi017;smithi086:172.21.15.86=smithi086' 2024-08-19T00:48:01.545 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:01.591 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:02.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:01 smithi017 ceph-mon[16627]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.126+0000 7f4f01971640 1 -- 172.21.15.86:0/3096770027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4efc0fe6f0 msgr2=0x7f4efc0feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.126+0000 7f4f01971640 1 --2- 172.21.15.86:0/3096770027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4efc0fe6f0 0x7f4efc0feaf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009880 tx=0x7f4eec02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.126+0000 7f4f01971640 1 -- 172.21.15.86:0/3096770027 shutdown_connections 2024-08-19T00:48:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.126+0000 7f4f01971640 1 --2- 172.21.15.86:0/3096770027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4efc0fe6f0 0x7f4efc0feaf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.126+0000 7f4f01971640 1 -- 172.21.15.86:0/3096770027 >> 172.21.15.86:0/3096770027 conn(0x7f4efc0f9e80 msgr2=0x7f4efc0fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.126+0000 7f4f01971640 1 -- 172.21.15.86:0/3096770027 shutdown_connections 2024-08-19T00:48:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.126+0000 7f4f01971640 1 -- 172.21.15.86:0/3096770027 wait complete. 2024-08-19T00:48:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.127+0000 7f4f01971640 1 Processor -- start 2024-08-19T00:48:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.127+0000 7f4f01971640 1 -- start start 2024-08-19T00:48:03.129 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.127+0000 7f4f01971640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4efc0fe6f0 0x7f4efc068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:03.130 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.127+0000 7f4f01971640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4efc068e80 con 0x7f4efc0fe6f0 2024-08-19T00:48:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.128+0000 7f4efaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4efc0fe6f0 0x7f4efc068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.128+0000 7f4efaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4efc0fe6f0 0x7f4efc068940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:52912/0 (socket says 172.21.15.86:52912) 2024-08-19T00:48:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.128+0000 7f4efaffd640 1 -- 172.21.15.86:0/3658449295 learned_addr learned my addr 172.21.15.86:0/3658449295 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.128+0000 7f4efaffd640 1 -- 172.21.15.86:0/3658449295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eec009560 con 0x7f4efc0fe6f0 2024-08-19T00:48:03.131 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.128+0000 7f4efaffd640 1 --2- 172.21.15.86:0/3658449295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4efc0fe6f0 0x7f4efc068940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4eec005610 tx=0x7f4eec005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.128+0000 7f4f0096f640 1 -- 172.21.15.86:0/3658449295 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4eec0049d0 con 0x7f4efc0fe6f0 2024-08-19T00:48:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.128+0000 7f4f01971640 1 -- 172.21.15.86:0/3658449295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc1979f0 con 0x7f4efc0fe6f0 2024-08-19T00:48:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.128+0000 7f4f0096f640 1 -- 172.21.15.86:0/3658449295 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4eec004b30 con 0x7f4efc0fe6f0 2024-08-19T00:48:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.128+0000 7f4f0096f640 1 -- 172.21.15.86:0/3658449295 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4eec0318e0 con 0x7f4efc0fe6f0 2024-08-19T00:48:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.129+0000 7f4f01971640 1 -- 172.21.15.86:0/3658449295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc197e90 con 0x7f4efc0fe6f0 2024-08-19T00:48:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.129+0000 7f4f0096f640 1 -- 172.21.15.86:0/3658449295 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f4eec031ba0 con 0x7f4efc0fe6f0 2024-08-19T00:48:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.129+0000 7f4f01971640 1 -- 172.21.15.86:0/3658449295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4efc0feaf0 con 0x7f4efc0fe6f0 2024-08-19T00:48:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.130+0000 7f4f0096f640 1 --2- 172.21.15.86:0/3658449295 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f4ee8038740 0x7f4ee803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.130+0000 7f4f0096f640 1 -- 172.21.15.86:0/3658449295 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4eec06c440 con 0x7f4efc0fe6f0 2024-08-19T00:48:03.132 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.130+0000 7f4efa7fc640 1 --2- 172.21.15.86:0/3658449295 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f4ee8038740 0x7f4ee803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:03.133 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.130+0000 7f4efa7fc640 1 --2- 172.21.15.86:0/3658449295 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f4ee8038740 0x7f4ee803ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40098c0 tx=0x7f4ee4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:03.136 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.135+0000 7f4f0096f640 1 -- 172.21.15.86:0/3658449295 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f4eec04d530 con 0x7f4efc0fe6f0 2024-08-19T00:48:03.306 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.305+0000 7f4f01971640 1 -- 172.21.15.86:0/3658449295 --> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi017:172.21.15.17=smithi017;smithi086:172.21.15.86=smithi086", "target": ["mon-mgr", ""]}) v1 -- 0x7f4efc02c4a0 con 0x7f4ee8038740 2024-08-19T00:48:03.313 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.311+0000 7f4f0096f640 1 -- 172.21.15.86:0/3658449295 <== mgr.14162 v2:172.21.15.17:6800/1713288012 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4efc02c4a0 con 0x7f4ee8038740 2024-08-19T00:48:03.313 INFO:teuthology.orchestra.run.smithi086.stdout:Scheduled mon update... 2024-08-19T00:48:03.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.313+0000 7f4f01971640 1 -- 172.21.15.86:0/3658449295 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f4ee8038740 msgr2=0x7f4ee803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:03.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.313+0000 7f4f01971640 1 --2- 172.21.15.86:0/3658449295 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f4ee8038740 0x7f4ee803ac00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40098c0 tx=0x7f4ee4006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:03.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.313+0000 7f4f01971640 1 -- 172.21.15.86:0/3658449295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4efc0fe6f0 msgr2=0x7f4efc068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:03.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.313+0000 7f4f01971640 1 --2- 172.21.15.86:0/3658449295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4efc0fe6f0 0x7f4efc068940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4eec005610 tx=0x7f4eec005640 comp rx=0 tx=0).stop 2024-08-19T00:48:03.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.313+0000 7f4f01971640 1 -- 172.21.15.86:0/3658449295 shutdown_connections 2024-08-19T00:48:03.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.313+0000 7f4f01971640 1 --2- 172.21.15.86:0/3658449295 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f4ee8038740 0x7f4ee803ac00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:03.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.313+0000 7f4f01971640 1 --2- 172.21.15.86:0/3658449295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4efc0fe6f0 0x7f4efc068940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:03.315 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.313+0000 7f4f01971640 1 -- 172.21.15.86:0/3658449295 >> 172.21.15.86:0/3658449295 conn(0x7f4efc0f9e80 msgr2=0x7f4efc0fa8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:03.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.313+0000 7f4f01971640 1 -- 172.21.15.86:0/3658449295 shutdown_connections 2024-08-19T00:48:03.316 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:03.313+0000 7f4f01971640 1 -- 172.21.15.86:0/3658449295 wait complete. 2024-08-19T00:48:03.909 DEBUG:teuthology.orchestra.run.smithi086:mon.smithi086> sudo journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi086.service 2024-08-19T00:48:03.911 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:03.911 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:04.016 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:03 smithi017 ceph-mon[16627]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:04.016 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:03 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:04.136 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:04.186 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:05.075 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:04 smithi017 ceph-mon[16627]: from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi017:172.21.15.17=smithi017;smithi086:172.21.15.86=smithi086", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:48:05.075 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:04 smithi017 ceph-mon[16627]: Saving service mon spec with placement smithi017:172.21.15.17=smithi017;smithi086:172.21.15.86=smithi086;count:2 2024-08-19T00:48:05.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.632+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/919715681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a00fe6e0 msgr2=0x7fb8a00feae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.632+0000 7fb8a7b9c640 1 --2- 172.21.15.86:0/919715681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a00fe6e0 0x7fb8a00feae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009880 tx=0x7fb89c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.632+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/919715681 shutdown_connections 2024-08-19T00:48:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.632+0000 7fb8a7b9c640 1 --2- 172.21.15.86:0/919715681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a00fe6e0 0x7fb8a00feae0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.632+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/919715681 >> 172.21.15.86:0/919715681 conn(0x7fb8a00f9e90 msgr2=0x7fb8a00fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.632+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/919715681 shutdown_connections 2024-08-19T00:48:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.632+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/919715681 wait complete. 2024-08-19T00:48:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.632+0000 7fb8a7b9c640 1 Processor -- start 2024-08-19T00:48:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.632+0000 7fb8a7b9c640 1 -- start start 2024-08-19T00:48:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.633+0000 7fb8a7b9c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a00fe6e0 0x7fb8a01045a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.633+0000 7fb8a7b9c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a0104ae0 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.633+0000 7fb8a5938640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a00fe6e0 0x7fb8a01045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.633+0000 7fb8a5938640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a00fe6e0 0x7fb8a01045a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:52928/0 (socket says 172.21.15.86:52928) 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.633+0000 7fb8a5938640 1 -- 172.21.15.86:0/3584969481 learned_addr learned my addr 172.21.15.86:0/3584969481 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.633+0000 7fb8a5938640 1 -- 172.21.15.86:0/3584969481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c009560 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.633+0000 7fb8a5938640 1 --2- 172.21.15.86:0/3584969481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a00fe6e0 0x7fb8a01045a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb89c005610 tx=0x7fb89c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.634+0000 7fb892ffd640 1 -- 172.21.15.86:0/3584969481 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb89c004b20 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.634+0000 7fb892ffd640 1 -- 172.21.15.86:0/3584969481 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb89c004c80 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.634+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/3584969481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a0102cd0 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.634+0000 7fb892ffd640 1 -- 172.21.15.86:0/3584969481 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb89c031a90 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.634+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/3584969481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a0103170 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.634+0000 7fb892ffd640 1 -- 172.21.15.86:0/3584969481 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fb89c031d50 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.635+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/3584969481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a0105fd0 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.635+0000 7fb892ffd640 1 --2- 172.21.15.86:0/3584969481 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb88c038740 0x7fb88c03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.635+0000 7fb892ffd640 1 -- 172.21.15.86:0/3584969481 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb89c06c580 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.635+0000 7fb8a5137640 1 --2- 172.21.15.86:0/3584969481 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb88c038740 0x7fb88c03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:05.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.635+0000 7fb8a5137640 1 --2- 172.21.15.86:0/3584969481 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb88c038740 0x7fb88c03ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb8940098c0 tx=0x7fb894006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:05.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.640+0000 7fb892ffd640 1 -- 172.21.15.86:0/3584969481 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb89c04d9a0 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.869+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/3584969481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb8a00feae0 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.869+0000 7fb892ffd640 1 -- 172.21.15.86:0/3584969481 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fb89c035030 con 0x7fb8a00fe6e0 2024-08-19T00:48:05.871 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:05.871 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:05.872 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.872+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/3584969481 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb88c038740 msgr2=0x7fb88c03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.872+0000 7fb8a7b9c640 1 --2- 172.21.15.86:0/3584969481 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb88c038740 0x7fb88c03ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb8940098c0 tx=0x7fb894006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.872+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/3584969481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a00fe6e0 msgr2=0x7fb8a01045a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.872+0000 7fb8a7b9c640 1 --2- 172.21.15.86:0/3584969481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a00fe6e0 0x7fb8a01045a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb89c005610 tx=0x7fb89c005640 comp rx=0 tx=0).stop 2024-08-19T00:48:05.873 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.872+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/3584969481 shutdown_connections 2024-08-19T00:48:05.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.872+0000 7fb8a7b9c640 1 --2- 172.21.15.86:0/3584969481 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fb88c038740 0x7fb88c03ac00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:05.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.872+0000 7fb8a7b9c640 1 --2- 172.21.15.86:0/3584969481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8a00fe6e0 0x7fb8a01045a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:05.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.872+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/3584969481 >> 172.21.15.86:0/3584969481 conn(0x7fb8a00f9e90 msgr2=0x7fb8a00fa870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:05.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.872+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/3584969481 shutdown_connections 2024-08-19T00:48:05.874 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:05.872+0000 7fb8a7b9c640 1 -- 172.21.15.86:0/3584969481 wait complete. 2024-08-19T00:48:06.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:05 smithi017 ceph-mon[16627]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:06 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/3584969481' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:06 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:06 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:06 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:06 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:06 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:06 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:06 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:07.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:06 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:07.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:06 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-19T00:48:07.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:06 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:07.445 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:07.446 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:07.647 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:07.693 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:07 smithi017 ceph-mon[16627]: Regenerating cephadm self-signed grafana TLS certificates 2024-08-19T00:48:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:07 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-08-19T00:48:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:07 smithi017 ceph-mon[16627]: Deploying daemon grafana.smithi017 on smithi017 2024-08-19T00:48:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:07 smithi017 ceph-mon[16627]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:09.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.067+0000 7fd5db5a7640 1 -- 172.21.15.86:0/3796771173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5d40fe670 msgr2=0x7fd5d40fea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:09.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.067+0000 7fd5db5a7640 1 --2- 172.21.15.86:0/3796771173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5d40fe670 0x7fd5d40fea70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009880 tx=0x7fd5d002a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.067+0000 7fd5db5a7640 1 -- 172.21.15.86:0/3796771173 shutdown_connections 2024-08-19T00:48:09.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.067+0000 7fd5db5a7640 1 --2- 172.21.15.86:0/3796771173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5d40fe670 0x7fd5d40fea70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.067+0000 7fd5db5a7640 1 -- 172.21.15.86:0/3796771173 >> 172.21.15.86:0/3796771173 conn(0x7fd5d40f9e00 msgr2=0x7fd5d40fc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:09.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.068+0000 7fd5db5a7640 1 -- 172.21.15.86:0/3796771173 shutdown_connections 2024-08-19T00:48:09.070 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.068+0000 7fd5db5a7640 1 -- 172.21.15.86:0/3796771173 wait complete. 2024-08-19T00:48:09.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.068+0000 7fd5db5a7640 1 Processor -- start 2024-08-19T00:48:09.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.068+0000 7fd5db5a7640 1 -- start start 2024-08-19T00:48:09.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.068+0000 7fd5db5a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5d40fe670 0x7fd5d4196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:09.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.068+0000 7fd5db5a7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d4197350 con 0x7fd5d40fe670 2024-08-19T00:48:09.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.069+0000 7fd5d9343640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5d40fe670 0x7fd5d4196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:09.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.069+0000 7fd5d9343640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5d40fe670 0x7fd5d4196e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:33876/0 (socket says 172.21.15.86:33876) 2024-08-19T00:48:09.071 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.069+0000 7fd5d9343640 1 -- 172.21.15.86:0/4152938431 learned_addr learned my addr 172.21.15.86:0/4152938431 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:09.072 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.069+0000 7fd5d9343640 1 -- 172.21.15.86:0/4152938431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0009560 con 0x7fd5d40fe670 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.069+0000 7fd5d9343640 1 --2- 172.21.15.86:0/4152938431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5d40fe670 0x7fd5d4196e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0005610 tx=0x7fd5d0005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.069+0000 7fd5c67fc640 1 -- 172.21.15.86:0/4152938431 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5d0004b20 con 0x7fd5d40fe670 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.069+0000 7fd5c67fc640 1 -- 172.21.15.86:0/4152938431 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5d0004c80 con 0x7fd5d40fe670 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.069+0000 7fd5db5a7640 1 -- 172.21.15.86:0/4152938431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d4197550 con 0x7fd5d40fe670 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.069+0000 7fd5c67fc640 1 -- 172.21.15.86:0/4152938431 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5d0031a90 con 0x7fd5d40fe670 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.069+0000 7fd5db5a7640 1 -- 172.21.15.86:0/4152938431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d41979f0 con 0x7fd5d40fe670 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.070+0000 7fd5c67fc640 1 -- 172.21.15.86:0/4152938431 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fd5d0031d50 con 0x7fd5d40fe670 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.070+0000 7fd5db5a7640 1 -- 172.21.15.86:0/4152938431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d40fea70 con 0x7fd5d40fe670 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.070+0000 7fd5c67fc640 1 --2- 172.21.15.86:0/4152938431 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd5c0038740 0x7fd5c003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.070+0000 7fd5c67fc640 1 -- 172.21.15.86:0/4152938431 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd5d006c690 con 0x7fd5d40fe670 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.071+0000 7fd5d8b42640 1 --2- 172.21.15.86:0/4152938431 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd5c0038740 0x7fd5c003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:09.073 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.071+0000 7fd5d8b42640 1 --2- 172.21.15.86:0/4152938431 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd5c0038740 0x7fd5c003ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80098c0 tx=0x7fd5c8006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:09.076 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.075+0000 7fd5c67fc640 1 -- 172.21.15.86:0/4152938431 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd5d004d530 con 0x7fd5d40fe670 2024-08-19T00:48:09.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.298+0000 7fd5db5a7640 1 -- 172.21.15.86:0/4152938431 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd5d402c3e0 con 0x7fd5d40fe670 2024-08-19T00:48:09.300 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.299+0000 7fd5c67fc640 1 -- 172.21.15.86:0/4152938431 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd5d0035030 con 0x7fd5d40fe670 2024-08-19T00:48:09.301 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:09.301 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:09.301 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:09.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.301+0000 7fd5db5a7640 1 -- 172.21.15.86:0/4152938431 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd5c0038740 msgr2=0x7fd5c003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:09.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.301+0000 7fd5db5a7640 1 --2- 172.21.15.86:0/4152938431 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd5c0038740 0x7fd5c003ac00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80098c0 tx=0x7fd5c8006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.301+0000 7fd5db5a7640 1 -- 172.21.15.86:0/4152938431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5d40fe670 msgr2=0x7fd5d4196e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:09.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.301+0000 7fd5db5a7640 1 --2- 172.21.15.86:0/4152938431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5d40fe670 0x7fd5d4196e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0005610 tx=0x7fd5d0005640 comp rx=0 tx=0).stop 2024-08-19T00:48:09.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.301+0000 7fd5db5a7640 1 -- 172.21.15.86:0/4152938431 shutdown_connections 2024-08-19T00:48:09.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.301+0000 7fd5db5a7640 1 --2- 172.21.15.86:0/4152938431 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd5c0038740 0x7fd5c003ac00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.301+0000 7fd5db5a7640 1 --2- 172.21.15.86:0/4152938431 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5d40fe670 0x7fd5d4196e10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:09.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.301+0000 7fd5db5a7640 1 -- 172.21.15.86:0/4152938431 >> 172.21.15.86:0/4152938431 conn(0x7fd5d40f9e00 msgr2=0x7fd5d40fc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:09.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.301+0000 7fd5db5a7640 1 -- 172.21.15.86:0/4152938431 shutdown_connections 2024-08-19T00:48:09.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:09.301+0000 7fd5db5a7640 1 -- 172.21.15.86:0/4152938431 wait complete. 2024-08-19T00:48:10.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:09 smithi017 ceph-mon[16627]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:10.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:09 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/4152938431' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:10.842 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:10.842 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:11.040 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:11.088 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:11 smithi017 ceph-mon[16627]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:11 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:12.574 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.566+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/708652304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9c0ff7d0 msgr2=0x7f7a9c0ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.566+0000 7f7aa0d2c640 1 --2- 172.21.15.86:0/708652304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9c0ff7d0 0x7f7a9c0ffbd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a94009880 tx=0x7f7a9402a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.566+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/708652304 shutdown_connections 2024-08-19T00:48:12.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.566+0000 7f7aa0d2c640 1 --2- 172.21.15.86:0/708652304 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9c0ff7d0 0x7f7a9c0ffbd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.566+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/708652304 >> 172.21.15.86:0/708652304 conn(0x7f7a9c0fafa0 msgr2=0x7f7a9c0fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:12.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.566+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/708652304 shutdown_connections 2024-08-19T00:48:12.575 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.566+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/708652304 wait complete. 2024-08-19T00:48:12.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.567+0000 7f7aa0d2c640 1 Processor -- start 2024-08-19T00:48:12.591 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.567+0000 7f7aa0d2c640 1 -- start start 2024-08-19T00:48:12.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.567+0000 7f7aa0d2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9c0ff7d0 0x7f7a9c074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.567+0000 7f7aa0d2c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c0746b0 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.567+0000 7f7a9a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9c0ff7d0 0x7f7a9c074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.567+0000 7f7a9a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9c0ff7d0 0x7f7a9c074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:33906/0 (socket says 172.21.15.86:33906) 2024-08-19T00:48:12.592 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.567+0000 7f7a9a59c640 1 -- 172.21.15.86:0/3624361278 learned_addr learned my addr 172.21.15.86:0/3624361278 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:12.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.568+0000 7f7a9a59c640 1 -- 172.21.15.86:0/3624361278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a94009560 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.593 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.568+0000 7f7a9a59c640 1 --2- 172.21.15.86:0/3624361278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9c0ff7d0 0x7f7a9c074170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a94005610 tx=0x7f7a94005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:12.594 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.568+0000 7f7a937fe640 1 -- 172.21.15.86:0/3624361278 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a94004b20 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.568+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/3624361278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9c0728a0 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.568+0000 7f7a937fe640 1 -- 172.21.15.86:0/3624361278 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a94004c80 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.803 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.568+0000 7f7a937fe640 1 -- 172.21.15.86:0/3624361278 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a94031a90 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.568+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/3624361278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9c072d40 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.804 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.569+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/3624361278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9c105fc0 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.569+0000 7f7a937fe640 1 -- 172.21.15.86:0/3624361278 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f7a94031d50 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.569+0000 7f7a937fe640 1 --2- 172.21.15.86:0/3624361278 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f7a88038740 0x7f7a8803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:12.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.569+0000 7f7a937fe640 1 -- 172.21.15.86:0/3624361278 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7a9406c5a0 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.570+0000 7f7a99d9b640 1 --2- 172.21.15.86:0/3624361278 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f7a88038740 0x7f7a8803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:12.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.570+0000 7f7a99d9b640 1 --2- 172.21.15.86:0/3624361278 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f7a88038740 0x7f7a8803ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7a840098c0 tx=0x7f7a84006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:12.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.575+0000 7f7a937fe640 1 -- 172.21.15.86:0/3624361278 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f7a9404d9a0 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.801+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/3624361278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7a9c0ffbd0 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.802+0000 7f7a937fe640 1 -- 172.21.15.86:0/3624361278 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f7a94035030 con 0x7f7a9c0ff7d0 2024-08-19T00:48:12.813 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:12.814 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:12.814 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:12.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.804+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/3624361278 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f7a88038740 msgr2=0x7f7a8803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.804+0000 7f7aa0d2c640 1 --2- 172.21.15.86:0/3624361278 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f7a88038740 0x7f7a8803ac00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7a840098c0 tx=0x7f7a84006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.804+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/3624361278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9c0ff7d0 msgr2=0x7f7a9c074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:12.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.804+0000 7f7aa0d2c640 1 --2- 172.21.15.86:0/3624361278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9c0ff7d0 0x7f7a9c074170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a94005610 tx=0x7f7a94005640 comp rx=0 tx=0).stop 2024-08-19T00:48:12.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.804+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/3624361278 shutdown_connections 2024-08-19T00:48:12.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.804+0000 7f7aa0d2c640 1 --2- 172.21.15.86:0/3624361278 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f7a88038740 0x7f7a8803ac00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.804+0000 7f7aa0d2c640 1 --2- 172.21.15.86:0/3624361278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a9c0ff7d0 0x7f7a9c074170 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:12.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.804+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/3624361278 >> 172.21.15.86:0/3624361278 conn(0x7f7a9c0fafa0 msgr2=0x7f7a9c0fb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:12.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.804+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/3624361278 shutdown_connections 2024-08-19T00:48:12.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:12.804+0000 7f7aa0d2c640 1 -- 172.21.15.86:0/3624361278 wait complete. 2024-08-19T00:48:14.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:13 smithi017 ceph-mon[16627]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:14.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:13 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/3624361278' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:14.371 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:14.372 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:14.575 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:14.621 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:16.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.018+0000 7f5dd8d50640 1 -- 172.21.15.86:0/457633307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd40ff7e0 msgr2=0x7f5dd40ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.018+0000 7f5dd8d50640 1 --2- 172.21.15.86:0/457633307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd40ff7e0 0x7f5dd40ffbe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009880 tx=0x7f5dc402a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.018+0000 7f5dd8d50640 1 -- 172.21.15.86:0/457633307 shutdown_connections 2024-08-19T00:48:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.018+0000 7f5dd8d50640 1 --2- 172.21.15.86:0/457633307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd40ff7e0 0x7f5dd40ffbe0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.018+0000 7f5dd8d50640 1 -- 172.21.15.86:0/457633307 >> 172.21.15.86:0/457633307 conn(0x7f5dd40faf70 msgr2=0x7f5dd40fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.018+0000 7f5dd8d50640 1 -- 172.21.15.86:0/457633307 shutdown_connections 2024-08-19T00:48:16.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.018+0000 7f5dd8d50640 1 -- 172.21.15.86:0/457633307 wait complete. 2024-08-19T00:48:16.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.019+0000 7f5dd8d50640 1 Processor -- start 2024-08-19T00:48:16.022 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.019+0000 7f5dd8d50640 1 -- start start 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.019+0000 7f5dd8d50640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd40ff7e0 0x7f5dd4074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.019+0000 7f5dd8d50640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40746b0 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.019+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd40ff7e0 0x7f5dd4074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.019+0000 7f5dd259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd40ff7e0 0x7f5dd4074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:33918/0 (socket says 172.21.15.86:33918) 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.019+0000 7f5dd259c640 1 -- 172.21.15.86:0/3494617825 learned_addr learned my addr 172.21.15.86:0/3494617825 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.019+0000 7f5dd259c640 1 -- 172.21.15.86:0/3494617825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc4009560 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.019+0000 7f5dd259c640 1 --2- 172.21.15.86:0/3494617825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd40ff7e0 0x7f5dd4074170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4005610 tx=0x7f5dc4005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.020+0000 7f5dc37fe640 1 -- 172.21.15.86:0/3494617825 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5dc4004b20 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.020+0000 7f5dd8d50640 1 -- 172.21.15.86:0/3494617825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd40728a0 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.020+0000 7f5dc37fe640 1 -- 172.21.15.86:0/3494617825 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5dc4004c80 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.020+0000 7f5dc37fe640 1 -- 172.21.15.86:0/3494617825 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5dc4031a90 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.020+0000 7f5dd8d50640 1 -- 172.21.15.86:0/3494617825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd4072d40 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.021+0000 7f5dc37fe640 1 -- 172.21.15.86:0/3494617825 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f5dc4031d50 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.021+0000 7f5dd8d50640 1 -- 172.21.15.86:0/3494617825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd4105fd0 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.021+0000 7f5dc37fe640 1 --2- 172.21.15.86:0/3494617825 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f5dbc038740 0x7f5dbc03ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:16.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.021+0000 7f5dc37fe640 1 -- 172.21.15.86:0/3494617825 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5dc406c580 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.021+0000 7f5dd1d9b640 1 --2- 172.21.15.86:0/3494617825 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f5dbc038740 0x7f5dbc03ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:16.024 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.021+0000 7f5dd1d9b640 1 --2- 172.21.15.86:0/3494617825 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f5dbc038740 0x7f5dbc03ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80098c0 tx=0x7f5dc8006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:16.027 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.026+0000 7f5dc37fe640 1 -- 172.21.15.86:0/3494617825 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f5dc404dce0 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.082 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:15 smithi017 ceph-mon[16627]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:16.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.249+0000 7f5dd8d50640 1 -- 172.21.15.86:0/3494617825 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5dd40ffbe0 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.249+0000 7f5dc37fe640 1 -- 172.21.15.86:0/3494617825 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f5dc4035070 con 0x7f5dd40ff7e0 2024-08-19T00:48:16.253 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:16.253 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:16.254 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.251+0000 7f5dd8d50640 1 -- 172.21.15.86:0/3494617825 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f5dbc038740 msgr2=0x7f5dbc03ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.251+0000 7f5dd8d50640 1 --2- 172.21.15.86:0/3494617825 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f5dbc038740 0x7f5dbc03ac00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5dc80098c0 tx=0x7f5dc8006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.251+0000 7f5dd8d50640 1 -- 172.21.15.86:0/3494617825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd40ff7e0 msgr2=0x7f5dd4074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.251+0000 7f5dd8d50640 1 --2- 172.21.15.86:0/3494617825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd40ff7e0 0x7f5dd4074170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4005610 tx=0x7f5dc4005640 comp rx=0 tx=0).stop 2024-08-19T00:48:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.251+0000 7f5dd8d50640 1 -- 172.21.15.86:0/3494617825 shutdown_connections 2024-08-19T00:48:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.251+0000 7f5dd8d50640 1 --2- 172.21.15.86:0/3494617825 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f5dbc038740 0x7f5dbc03ac00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.251+0000 7f5dd8d50640 1 --2- 172.21.15.86:0/3494617825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5dd40ff7e0 0x7f5dd4074170 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.251+0000 7f5dd8d50640 1 -- 172.21.15.86:0/3494617825 >> 172.21.15.86:0/3494617825 conn(0x7f5dd40faf70 msgr2=0x7f5dd40fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.252+0000 7f5dd8d50640 1 -- 172.21.15.86:0/3494617825 shutdown_connections 2024-08-19T00:48:16.255 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:16.252+0000 7f5dd8d50640 1 -- 172.21.15.86:0/3494617825 wait complete. 2024-08-19T00:48:16.864 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:16 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/3494617825' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:17.849 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:17.849 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:18.079 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:18.127 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:17 smithi017 ceph-mon[16627]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:19.468 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.461+0000 7f6bfe85c640 1 -- 172.21.15.86:0/3850773469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf80ff800 msgr2=0x7f6bf80ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.461+0000 7f6bfe85c640 1 --2- 172.21.15.86:0/3850773469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf80ff800 0x7f6bf80ffc00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009880 tx=0x7f6be802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.461+0000 7f6bfe85c640 1 -- 172.21.15.86:0/3850773469 shutdown_connections 2024-08-19T00:48:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.461+0000 7f6bfe85c640 1 --2- 172.21.15.86:0/3850773469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf80ff800 0x7f6bf80ffc00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.461+0000 7f6bfe85c640 1 -- 172.21.15.86:0/3850773469 >> 172.21.15.86:0/3850773469 conn(0x7f6bf80fafd0 msgr2=0x7f6bf80fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.461+0000 7f6bfe85c640 1 -- 172.21.15.86:0/3850773469 shutdown_connections 2024-08-19T00:48:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.461+0000 7f6bfe85c640 1 -- 172.21.15.86:0/3850773469 wait complete. 2024-08-19T00:48:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.462+0000 7f6bfe85c640 1 Processor -- start 2024-08-19T00:48:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.462+0000 7f6bfe85c640 1 -- start start 2024-08-19T00:48:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.462+0000 7f6bfe85c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf80ff800 0x7f6bf8194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.469 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.462+0000 7f6bfe85c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf81951f0 con 0x7f6bf80ff800 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.462+0000 7f6bf7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf80ff800 0x7f6bf8194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.462+0000 7f6bf7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf80ff800 0x7f6bf8194cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:46410/0 (socket says 172.21.15.86:46410) 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.462+0000 7f6bf7fff640 1 -- 172.21.15.86:0/403249276 learned_addr learned my addr 172.21.15.86:0/403249276 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.463+0000 7f6bf7fff640 1 -- 172.21.15.86:0/403249276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8009560 con 0x7f6bf80ff800 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.463+0000 7f6bf7fff640 1 --2- 172.21.15.86:0/403249276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf80ff800 0x7f6bf8194cb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6be8005610 tx=0x7f6be8005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.463+0000 7f6bf57fa640 1 -- 172.21.15.86:0/403249276 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6be8004b20 con 0x7f6bf80ff800 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.463+0000 7f6bf57fa640 1 -- 172.21.15.86:0/403249276 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6be8004c80 con 0x7f6bf80ff800 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.463+0000 7f6bfe85c640 1 -- 172.21.15.86:0/403249276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf81953f0 con 0x7f6bf80ff800 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.463+0000 7f6bf57fa640 1 -- 172.21.15.86:0/403249276 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6be8031a90 con 0x7f6bf80ff800 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.463+0000 7f6bfe85c640 1 -- 172.21.15.86:0/403249276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf8195890 con 0x7f6bf80ff800 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.464+0000 7f6bf57fa640 1 -- 172.21.15.86:0/403249276 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f6be8031d50 con 0x7f6bf80ff800 2024-08-19T00:48:19.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.464+0000 7f6bfe85c640 1 -- 172.21.15.86:0/403249276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf80ffc00 con 0x7f6bf80ff800 2024-08-19T00:48:19.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.464+0000 7f6bf57fa640 1 --2- 172.21.15.86:0/403249276 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f6be0038740 0x7f6be003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:19.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.464+0000 7f6bf57fa640 1 -- 172.21.15.86:0/403249276 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6be806c6a0 con 0x7f6bf80ff800 2024-08-19T00:48:19.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.464+0000 7f6bf77fe640 1 --2- 172.21.15.86:0/403249276 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f6be0038740 0x7f6be003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:19.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.465+0000 7f6bf77fe640 1 --2- 172.21.15.86:0/403249276 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f6be0038740 0x7f6be003ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0098c0 tx=0x7f6bec006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:19.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.469+0000 7f6bf57fa640 1 -- 172.21.15.86:0/403249276 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f6be803c930 con 0x7f6bf80ff800 2024-08-19T00:48:19.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:19 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:19.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:19 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:19.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:19 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:19.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:19 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:19.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:19 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:19.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:19 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:19.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:19 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:19.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:19 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:19.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:19 smithi017 ceph-mon[16627]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:19.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.692+0000 7f6bfe85c640 1 -- 172.21.15.86:0/403249276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6bf802c3e0 con 0x7f6bf80ff800 2024-08-19T00:48:19.693 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.692+0000 7f6bf57fa640 1 -- 172.21.15.86:0/403249276 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f6be8035030 con 0x7f6bf80ff800 2024-08-19T00:48:19.694 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:19.694 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:19.694 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:19.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.694+0000 7f6bfe85c640 1 -- 172.21.15.86:0/403249276 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f6be0038740 msgr2=0x7f6be003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.694+0000 7f6bfe85c640 1 --2- 172.21.15.86:0/403249276 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f6be0038740 0x7f6be003ac00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6bec0098c0 tx=0x7f6bec006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.694+0000 7f6bfe85c640 1 -- 172.21.15.86:0/403249276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf80ff800 msgr2=0x7f6bf8194cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:19.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.694+0000 7f6bfe85c640 1 --2- 172.21.15.86:0/403249276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf80ff800 0x7f6bf8194cb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6be8005610 tx=0x7f6be8005640 comp rx=0 tx=0).stop 2024-08-19T00:48:19.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.694+0000 7f6bfe85c640 1 -- 172.21.15.86:0/403249276 shutdown_connections 2024-08-19T00:48:19.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.694+0000 7f6bfe85c640 1 --2- 172.21.15.86:0/403249276 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f6be0038740 0x7f6be003ac00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.694+0000 7f6bfe85c640 1 --2- 172.21.15.86:0/403249276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf80ff800 0x7f6bf8194cb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:19.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.694+0000 7f6bfe85c640 1 -- 172.21.15.86:0/403249276 >> 172.21.15.86:0/403249276 conn(0x7f6bf80fafd0 msgr2=0x7f6bf80fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:19.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.694+0000 7f6bfe85c640 1 -- 172.21.15.86:0/403249276 shutdown_connections 2024-08-19T00:48:19.696 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:19.694+0000 7f6bfe85c640 1 -- 172.21.15.86:0/403249276 wait complete. 2024-08-19T00:48:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:20 smithi017 ceph-mon[16627]: Deploying daemon prometheus.smithi017 on smithi017 2024-08-19T00:48:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:20 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/403249276' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:21.287 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:21.287 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:21.487 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:21.544 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:22.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:21 smithi017 ceph-mon[16627]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:22.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:21 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:23.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.100+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/3571052723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad40ff7e0 msgr2=0x7f8ad40ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.100+0000 7f8ad8e3f640 1 --2- 172.21.15.86:0/3571052723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad40ff7e0 0x7f8ad40ffbe0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8abc009880 tx=0x7f8abc02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.100+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/3571052723 shutdown_connections 2024-08-19T00:48:23.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.100+0000 7f8ad8e3f640 1 --2- 172.21.15.86:0/3571052723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad40ff7e0 0x7f8ad40ffbe0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.104 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.100+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/3571052723 >> 172.21.15.86:0/3571052723 conn(0x7f8ad40faf90 msgr2=0x7f8ad40fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:23.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.100+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/3571052723 shutdown_connections 2024-08-19T00:48:23.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.100+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/3571052723 wait complete. 2024-08-19T00:48:23.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.101+0000 7f8ad8e3f640 1 Processor -- start 2024-08-19T00:48:23.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.101+0000 7f8ad8e3f640 1 -- start start 2024-08-19T00:48:23.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.101+0000 7f8ad8e3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad40ff7e0 0x7f8ad4194c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.101+0000 7f8ad8e3f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad41951a0 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.102+0000 7f8ad259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad40ff7e0 0x7f8ad4194c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.102+0000 7f8ad259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad40ff7e0 0x7f8ad4194c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:46424/0 (socket says 172.21.15.86:46424) 2024-08-19T00:48:23.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.102+0000 7f8ad259c640 1 -- 172.21.15.86:0/2483658707 learned_addr learned my addr 172.21.15.86:0/2483658707 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:23.105 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.102+0000 7f8ad259c640 1 -- 172.21.15.86:0/2483658707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc009560 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.102+0000 7f8ad259c640 1 --2- 172.21.15.86:0/2483658707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad40ff7e0 0x7f8ad4194c60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8abc005610 tx=0x7f8abc005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.102+0000 7f8acb7fe640 1 -- 172.21.15.86:0/2483658707 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8abc004b20 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.102+0000 7f8acb7fe640 1 -- 172.21.15.86:0/2483658707 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8abc004c80 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.102+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/2483658707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad41953a0 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.102+0000 7f8acb7fe640 1 -- 172.21.15.86:0/2483658707 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8abc031a90 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.102+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/2483658707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad4195840 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.103+0000 7f8acb7fe640 1 -- 172.21.15.86:0/2483658707 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7f8abc031d50 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.103+0000 7f8acb7fe640 1 --2- 172.21.15.86:0/2483658707 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f8ac0038740 0x7f8ac003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.103+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/2483658707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad40ffbe0 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.103+0000 7f8acb7fe640 1 -- 172.21.15.86:0/2483658707 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8abc06c6a0 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.103+0000 7f8ad1d9b640 1 --2- 172.21.15.86:0/2483658707 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f8ac0038740 0x7f8ac003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:23.107 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.104+0000 7f8ad1d9b640 1 --2- 172.21.15.86:0/2483658707 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f8ac0038740 0x7f8ac003ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40098c0 tx=0x7f8ac4006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:23.111 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.109+0000 7f8acb7fe640 1 -- 172.21.15.86:0/2483658707 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f8abc035020 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.331+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/2483658707 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8ad402c3e0 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.334 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.331+0000 7f8acb7fe640 1 -- 172.21.15.86:0/2483658707 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8abc04d530 con 0x7f8ad40ff7e0 2024-08-19T00:48:23.334 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:23.334 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:23.334 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.333+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/2483658707 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f8ac0038740 msgr2=0x7f8ac003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.333+0000 7f8ad8e3f640 1 --2- 172.21.15.86:0/2483658707 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f8ac0038740 0x7f8ac003ac00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40098c0 tx=0x7f8ac4006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.333+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/2483658707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad40ff7e0 msgr2=0x7f8ad4194c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.333+0000 7f8ad8e3f640 1 --2- 172.21.15.86:0/2483658707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad40ff7e0 0x7f8ad4194c60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8abc005610 tx=0x7f8abc005640 comp rx=0 tx=0).stop 2024-08-19T00:48:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.333+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/2483658707 shutdown_connections 2024-08-19T00:48:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.333+0000 7f8ad8e3f640 1 --2- 172.21.15.86:0/2483658707 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7f8ac0038740 0x7f8ac003ac00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.333+0000 7f8ad8e3f640 1 --2- 172.21.15.86:0/2483658707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ad40ff7e0 0x7f8ad4194c60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.333+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/2483658707 >> 172.21.15.86:0/2483658707 conn(0x7f8ad40faf90 msgr2=0x7f8ad40fb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.333+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/2483658707 shutdown_connections 2024-08-19T00:48:23.336 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:23.333+0000 7f8ad8e3f640 1 -- 172.21.15.86:0/2483658707 wait complete. 2024-08-19T00:48:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:23 smithi017 ceph-mon[16627]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:23 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/2483658707' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:24.858 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:24.859 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:25.058 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:25.104 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:25.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:25 smithi017 ceph-mon[16627]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:26.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.552+0000 7fac91d17640 1 -- 172.21.15.86:0/49904586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c0ff7c0 msgr2=0x7fac8c0ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.552+0000 7fac91d17640 1 --2- 172.21.15.86:0/49904586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c0ff7c0 0x7fac8c0ffbc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fac7c009880 tx=0x7fac7c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.553+0000 7fac91d17640 1 -- 172.21.15.86:0/49904586 shutdown_connections 2024-08-19T00:48:26.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.553+0000 7fac91d17640 1 --2- 172.21.15.86:0/49904586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c0ff7c0 0x7fac8c0ffbc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.553+0000 7fac91d17640 1 -- 172.21.15.86:0/49904586 >> 172.21.15.86:0/49904586 conn(0x7fac8c0faf30 msgr2=0x7fac8c0fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:26.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.553+0000 7fac91d17640 1 -- 172.21.15.86:0/49904586 shutdown_connections 2024-08-19T00:48:26.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.553+0000 7fac91d17640 1 -- 172.21.15.86:0/49904586 wait complete. 2024-08-19T00:48:26.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.553+0000 7fac91d17640 1 Processor -- start 2024-08-19T00:48:26.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.553+0000 7fac91d17640 1 -- start start 2024-08-19T00:48:26.559 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.553+0000 7fac91d17640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c0ff7c0 0x7fac8c194cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.554+0000 7fac91d17640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c195210 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.554+0000 7fac8b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c0ff7c0 0x7fac8c194cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.554+0000 7fac8b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c0ff7c0 0x7fac8c194cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:46438/0 (socket says 172.21.15.86:46438) 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.554+0000 7fac8b7fe640 1 -- 172.21.15.86:0/536672951 learned_addr learned my addr 172.21.15.86:0/536672951 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.554+0000 7fac8b7fe640 1 -- 172.21.15.86:0/536672951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c009560 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.554+0000 7fac8b7fe640 1 --2- 172.21.15.86:0/536672951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c0ff7c0 0x7fac8c194cd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005610 tx=0x7fac7c005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.555+0000 7fac897fa640 1 -- 172.21.15.86:0/536672951 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac7c004b20 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.555+0000 7fac91d17640 1 -- 172.21.15.86:0/536672951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c195410 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.555+0000 7fac91d17640 1 -- 172.21.15.86:0/536672951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c1958b0 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.555+0000 7fac897fa640 1 -- 172.21.15.86:0/536672951 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac7c004c80 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.555+0000 7fac897fa640 1 -- 172.21.15.86:0/536672951 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac7c0317b0 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.555+0000 7fac91d17640 1 -- 172.21.15.86:0/536672951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6c005280 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.556+0000 7fac897fa640 1 -- 172.21.15.86:0/536672951 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fac7c003c40 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.556+0000 7fac897fa640 1 --2- 172.21.15.86:0/536672951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fac78038740 0x7fac7803ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:26.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.556+0000 7fac897fa640 1 -- 172.21.15.86:0/536672951 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fac7c06c490 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.556+0000 7fac83fff640 1 --2- 172.21.15.86:0/536672951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fac78038740 0x7fac7803ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:26.561 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.557+0000 7fac83fff640 1 --2- 172.21.15.86:0/536672951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fac78038740 0x7fac7803ac00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fac740098c0 tx=0x7fac74006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:26.563 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.561+0000 7fac897fa640 1 -- 172.21.15.86:0/536672951 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fac7c043360 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.783+0000 7fac91d17640 1 -- 172.21.15.86:0/536672951 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fac6c0050f0 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.786 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.784+0000 7fac897fa640 1 -- 172.21.15.86:0/536672951 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fac7c035070 con 0x7fac8c0ff7c0 2024-08-19T00:48:26.787 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:26.787 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:26.787 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:26.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.786+0000 7fac91d17640 1 -- 172.21.15.86:0/536672951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fac78038740 msgr2=0x7fac7803ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.786+0000 7fac91d17640 1 --2- 172.21.15.86:0/536672951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fac78038740 0x7fac7803ac00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fac740098c0 tx=0x7fac74006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.786+0000 7fac91d17640 1 -- 172.21.15.86:0/536672951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c0ff7c0 msgr2=0x7fac8c194cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:26.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.786+0000 7fac91d17640 1 --2- 172.21.15.86:0/536672951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c0ff7c0 0x7fac8c194cd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac7c005610 tx=0x7fac7c005640 comp rx=0 tx=0).stop 2024-08-19T00:48:26.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.786+0000 7fac91d17640 1 -- 172.21.15.86:0/536672951 shutdown_connections 2024-08-19T00:48:26.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.786+0000 7fac91d17640 1 --2- 172.21.15.86:0/536672951 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fac78038740 0x7fac7803ac00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.786+0000 7fac91d17640 1 --2- 172.21.15.86:0/536672951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac8c0ff7c0 0x7fac8c194cd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:26.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.786+0000 7fac91d17640 1 -- 172.21.15.86:0/536672951 >> 172.21.15.86:0/536672951 conn(0x7fac8c0faf30 msgr2=0x7fac8c0fb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:26.789 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.786+0000 7fac91d17640 1 -- 172.21.15.86:0/536672951 shutdown_connections 2024-08-19T00:48:26.790 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:26.787+0000 7fac91d17640 1 -- 172.21.15.86:0/536672951 wait complete. 2024-08-19T00:48:27.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:26 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/536672951' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:28.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:27 smithi017 ceph-mon[16627]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:28.386 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:28.386 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:28.585 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:28.634 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:30.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.013+0000 7fe02f87e640 1 -- 172.21.15.86:0/1799282228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0280fe6d0 msgr2=0x7fe0280fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:30.016 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.013+0000 7fe02f87e640 1 --2- 172.21.15.86:0/1799282228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0280fe6d0 0x7fe0280fead0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe018009c20 tx=0x7fe01802aa90 comp rx=0 tx=0).stop 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.013+0000 7fe02f87e640 1 -- 172.21.15.86:0/1799282228 shutdown_connections 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.013+0000 7fe02f87e640 1 --2- 172.21.15.86:0/1799282228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0280fe6d0 0x7fe0280fead0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.013+0000 7fe02f87e640 1 -- 172.21.15.86:0/1799282228 >> 172.21.15.86:0/1799282228 conn(0x7fe0280f9e80 msgr2=0x7fe0280fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.013+0000 7fe02f87e640 1 -- 172.21.15.86:0/1799282228 shutdown_connections 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.013+0000 7fe02f87e640 1 -- 172.21.15.86:0/1799282228 wait complete. 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.014+0000 7fe02f87e640 1 Processor -- start 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.014+0000 7fe02f87e640 1 -- start start 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.014+0000 7fe02f87e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0280fe6d0 0x7fe028197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.014+0000 7fe02f87e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe028197540 con 0x7fe0280fe6d0 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.014+0000 7fe02d61a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0280fe6d0 0x7fe028197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.014+0000 7fe02d61a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0280fe6d0 0x7fe028197000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:35256/0 (socket says 172.21.15.86:35256) 2024-08-19T00:48:30.017 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.014+0000 7fe02d61a640 1 -- 172.21.15.86:0/207289285 learned_addr learned my addr 172.21.15.86:0/207289285 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:30.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.014+0000 7fe02d61a640 1 -- 172.21.15.86:0/207289285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe018009900 con 0x7fe0280fe6d0 2024-08-19T00:48:30.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.015+0000 7fe02d61a640 1 --2- 172.21.15.86:0/207289285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0280fe6d0 0x7fe028197000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe0180098d0 tx=0x7fe01802f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:30.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.015+0000 7fe0267fc640 1 -- 172.21.15.86:0/207289285 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe01803e070 con 0x7fe0280fe6d0 2024-08-19T00:48:30.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.015+0000 7fe02f87e640 1 -- 172.21.15.86:0/207289285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe028197740 con 0x7fe0280fe6d0 2024-08-19T00:48:30.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.015+0000 7fe0267fc640 1 -- 172.21.15.86:0/207289285 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe01802fbc0 con 0x7fe0280fe6d0 2024-08-19T00:48:30.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.015+0000 7fe0267fc640 1 -- 172.21.15.86:0/207289285 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe018004880 con 0x7fe0280fe6d0 2024-08-19T00:48:30.019 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.015+0000 7fe02f87e640 1 -- 172.21.15.86:0/207289285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe028197be0 con 0x7fe0280fe6d0 2024-08-19T00:48:30.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.016+0000 7fe0267fc640 1 -- 172.21.15.86:0/207289285 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 13) v1 ==== 45612+0+0 (secure 0 0 0) 0x7fe01800a040 con 0x7fe0280fe6d0 2024-08-19T00:48:30.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.016+0000 7fe02f87e640 1 -- 172.21.15.86:0/207289285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0280feb50 con 0x7fe0280fe6d0 2024-08-19T00:48:30.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.016+0000 7fe0267fc640 1 --2- 172.21.15.86:0/207289285 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fe010038740 0x7fe01003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:30.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.016+0000 7fe0267fc640 1 -- 172.21.15.86:0/207289285 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe01806c0e0 con 0x7fe0280fe6d0 2024-08-19T00:48:30.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.016+0000 7fe02ce19640 1 --2- 172.21.15.86:0/207289285 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fe010038740 0x7fe01003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:30.020 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.017+0000 7fe02ce19640 1 --2- 172.21.15.86:0/207289285 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fe010038740 0x7fe01003ac00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0098c0 tx=0x7fe01c006db0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:30.023 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.021+0000 7fe0267fc640 1 -- 172.21.15.86:0/207289285 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe018004140 con 0x7fe0280fe6d0 2024-08-19T00:48:30.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:29 smithi017 ceph-mon[16627]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:30.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:29 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:30.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:29 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:30.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:29 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:30.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:29 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-08-19T00:48:30.246 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.244+0000 7fe02f87e640 1 -- 172.21.15.86:0/207289285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe02802c3e0 con 0x7fe0280fe6d0 2024-08-19T00:48:30.251 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.244+0000 7fe0267fc640 1 -- 172.21.15.86:0/207289285 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe018033020 con 0x7fe0280fe6d0 2024-08-19T00:48:30.251 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:30.251 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.247+0000 7fe02f87e640 1 -- 172.21.15.86:0/207289285 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fe010038740 msgr2=0x7fe01003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.247+0000 7fe02f87e640 1 --2- 172.21.15.86:0/207289285 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fe010038740 0x7fe01003ac00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0098c0 tx=0x7fe01c006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.247+0000 7fe02f87e640 1 -- 172.21.15.86:0/207289285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0280fe6d0 msgr2=0x7fe028197000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.247+0000 7fe02f87e640 1 --2- 172.21.15.86:0/207289285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0280fe6d0 0x7fe028197000 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe0180098d0 tx=0x7fe01802f8a0 comp rx=0 tx=0).stop 2024-08-19T00:48:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.247+0000 7fe02f87e640 1 -- 172.21.15.86:0/207289285 shutdown_connections 2024-08-19T00:48:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.247+0000 7fe02f87e640 1 --2- 172.21.15.86:0/207289285 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fe010038740 0x7fe01003ac00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.247+0000 7fe02f87e640 1 --2- 172.21.15.86:0/207289285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe0280fe6d0 0x7fe028197000 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.247+0000 7fe02f87e640 1 -- 172.21.15.86:0/207289285 >> 172.21.15.86:0/207289285 conn(0x7fe0280f9e80 msgr2=0x7fe028067ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:30.252 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.247+0000 7fe02f87e640 1 -- 172.21.15.86:0/207289285 shutdown_connections 2024-08-19T00:48:30.253 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:30.247+0000 7fe02f87e640 1 -- 172.21.15.86:0/207289285 wait complete. 2024-08-19T00:48:30.844 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:30 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/207289285' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:30.844 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:30 smithi017 ceph-mon[16627]: from='mgr.14162 172.21.15.17:0/4228701040' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-08-19T00:48:30.844 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:30 smithi017 ceph-mon[16627]: mgrmap e14: smithi017.hfpawi(active, since 59s) 2024-08-19T00:48:31.828 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:31.829 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:32.029 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:32.076 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.473+0000 7fd323743640 1 -- 172.21.15.86:0/452877584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c0fdaa0 msgr2=0x7fd31c0fdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.473+0000 7fd323743640 1 --2- 172.21.15.86:0/452877584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c0fdaa0 0x7fd31c0fdea0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009880 tx=0x7fd30c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.473+0000 7fd323743640 1 -- 172.21.15.86:0/452877584 shutdown_connections 2024-08-19T00:48:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.473+0000 7fd323743640 1 --2- 172.21.15.86:0/452877584 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c0fdaa0 0x7fd31c0fdea0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.473+0000 7fd323743640 1 -- 172.21.15.86:0/452877584 >> 172.21.15.86:0/452877584 conn(0x7fd31c0f9610 msgr2=0x7fd31c0fba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.473+0000 7fd323743640 1 -- 172.21.15.86:0/452877584 shutdown_connections 2024-08-19T00:48:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.473+0000 7fd323743640 1 -- 172.21.15.86:0/452877584 wait complete. 2024-08-19T00:48:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.474+0000 7fd323743640 1 Processor -- start 2024-08-19T00:48:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.474+0000 7fd323743640 1 -- start start 2024-08-19T00:48:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.474+0000 7fd323743640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c0fdaa0 0x7fd31c19b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.478 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.474+0000 7fd323743640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c19b7c0 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.474+0000 7fd3214df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c0fdaa0 0x7fd31c19b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.474+0000 7fd3214df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c0fdaa0 0x7fd31c19b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:35272/0 (socket says 172.21.15.86:35272) 2024-08-19T00:48:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.474+0000 7fd3214df640 1 -- 172.21.15.86:0/2040880503 learned_addr learned my addr 172.21.15.86:0/2040880503 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.474+0000 7fd3214df640 1 -- 172.21.15.86:0/2040880503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c009560 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.475+0000 7fd3214df640 1 --2- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c0fdaa0 0x7fd31c19b280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd30c006010 tx=0x7fd30c005630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.475+0000 7fd3127fc640 1 -- 172.21.15.86:0/2040880503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd30c004aa0 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.475+0000 7fd323743640 1 -- 172.21.15.86:0/2040880503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c19b9c0 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.475+0000 7fd3127fc640 1 -- 172.21.15.86:0/2040880503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd30c004c00 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.475+0000 7fd323743640 1 -- 172.21.15.86:0/2040880503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c19be60 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.479 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.475+0000 7fd3127fc640 1 -- 172.21.15.86:0/2040880503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd30c031940 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.476+0000 7fd3127fc640 1 -- 172.21.15.86:0/2040880503 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 14) v1 ==== 45626+0+0 (secure 0 0 0) 0x7fd30c031ac0 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.476+0000 7fd323743640 1 -- 172.21.15.86:0/2040880503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c0fdea0 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.476+0000 7fd3127fc640 1 --2- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd308038790 0x7fd30803ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:33.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.476+0000 7fd3127fc640 1 -- 172.21.15.86:0/2040880503 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd30c06c860 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.476+0000 7fd320cde640 1 -- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd308038790 msgr2=0x7fd30803ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1713288012 2024-08-19T00:48:33.480 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.476+0000 7fd320cde640 1 --2- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd308038790 0x7fd30803ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:48:33.487 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.485+0000 7fd3127fc640 1 -- 172.21.15.86:0/2040880503 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd30c03ba20 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.677+0000 7fd320cde640 1 -- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd308038790 msgr2=0x7fd30803ac50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.17:6800/1713288012 2024-08-19T00:48:33.679 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.677+0000 7fd320cde640 1 --2- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd308038790 0x7fd30803ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-19T00:48:33.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.709+0000 7fd323743640 1 -- 172.21.15.86:0/2040880503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd31c02c3e0 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.712 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.710+0000 7fd3127fc640 1 -- 172.21.15.86:0/2040880503 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd30c035070 con 0x7fd31c0fdaa0 2024-08-19T00:48:33.712 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:33.713 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:33.713 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:33.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.711+0000 7fd323743640 1 -- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd308038790 msgr2=0x7fd30803ac50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:48:33.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.711+0000 7fd323743640 1 --2- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd308038790 0x7fd30803ac50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.714 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.711+0000 7fd323743640 1 -- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c0fdaa0 msgr2=0x7fd31c19b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:33.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.711+0000 7fd323743640 1 --2- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c0fdaa0 0x7fd31c19b280 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd30c006010 tx=0x7fd30c005630 comp rx=0 tx=0).stop 2024-08-19T00:48:33.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.712+0000 7fd323743640 1 -- 172.21.15.86:0/2040880503 shutdown_connections 2024-08-19T00:48:33.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.712+0000 7fd323743640 1 --2- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:6800/1713288012,v1:172.21.15.17:6801/1713288012] conn(0x7fd308038790 0x7fd30803ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.712+0000 7fd323743640 1 --2- 172.21.15.86:0/2040880503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd31c0fdaa0 0x7fd31c19b280 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:33.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.712+0000 7fd323743640 1 -- 172.21.15.86:0/2040880503 >> 172.21.15.86:0/2040880503 conn(0x7fd31c0f9610 msgr2=0x7fd31c0fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:33.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.712+0000 7fd323743640 1 -- 172.21.15.86:0/2040880503 shutdown_connections 2024-08-19T00:48:33.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:33.712+0000 7fd323743640 1 -- 172.21.15.86:0/2040880503 wait complete. 2024-08-19T00:48:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:33 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/2040880503' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:35.289 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:35.290 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:35.490 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:35.536 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:35.805 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: Active manager daemon smithi017.hfpawi restarted 2024-08-19T00:48:35.805 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: Activating manager daemon smithi017.hfpawi 2024-08-19T00:48:35.805 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: osdmap e5: 0 total, 0 up, 0 in 2024-08-19T00:48:35.805 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: mgrmap e15: smithi017.hfpawi(active, starting, since 0.00317012s) 2024-08-19T00:48:35.805 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:48:35.805 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi017.hfpawi", "id": "smithi017.hfpawi"}]: dispatch 2024-08-19T00:48:35.805 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:48:35.806 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:48:35.806 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:48:35.806 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: Manager daemon smithi017.hfpawi is now available 2024-08-19T00:48:35.806 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:48:35.806 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:35.806 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:48:36.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:48:36.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/trash_purge_schedule"}]: dispatch 2024-08-19T00:48:36.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:36.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:36 smithi017 ceph-mon[16627]: mgrmap e16: smithi017.hfpawi(active, since 1.00544s) 2024-08-19T00:48:37.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.051+0000 7f813836a640 1 -- 172.21.15.86:0/2715791535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81300fe0c0 msgr2=0x7f81300fe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:37.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.051+0000 7f813836a640 1 --2- 172.21.15.86:0/2715791535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81300fe0c0 0x7f81300fe4c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f812c009880 tx=0x7f812c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.051+0000 7f813836a640 1 -- 172.21.15.86:0/2715791535 shutdown_connections 2024-08-19T00:48:37.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.051+0000 7f813836a640 1 --2- 172.21.15.86:0/2715791535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81300fe0c0 0x7f81300fe4c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.051+0000 7f813836a640 1 -- 172.21.15.86:0/2715791535 >> 172.21.15.86:0/2715791535 conn(0x7f81300f9e90 msgr2=0x7f81300fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:37.060 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.051+0000 7f813836a640 1 -- 172.21.15.86:0/2715791535 shutdown_connections 2024-08-19T00:48:37.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.051+0000 7f813836a640 1 -- 172.21.15.86:0/2715791535 wait complete. 2024-08-19T00:48:37.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.051+0000 7f813836a640 1 Processor -- start 2024-08-19T00:48:37.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.051+0000 7f813836a640 1 -- start start 2024-08-19T00:48:37.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f813836a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81300fe0c0 0x7f8130196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:37.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f813836a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8130197450 con 0x7f81300fe0c0 2024-08-19T00:48:37.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f8136106640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81300fe0c0 0x7f8130196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:37.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f8136106640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81300fe0c0 0x7f8130196f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:35276/0 (socket says 172.21.15.86:35276) 2024-08-19T00:48:37.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f8136106640 1 -- 172.21.15.86:0/1135979345 learned_addr learned my addr 172.21.15.86:0/1135979345 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:37.061 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f8136106640 1 -- 172.21.15.86:0/1135979345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c009560 con 0x7f81300fe0c0 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f8136106640 1 --2- 172.21.15.86:0/1135979345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81300fe0c0 0x7f8130196f10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f812c006010 tx=0x7f812c005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f81277fe640 1 -- 172.21.15.86:0/1135979345 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f812c004aa0 con 0x7f81300fe0c0 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f81277fe640 1 -- 172.21.15.86:0/1135979345 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f812c004c00 con 0x7f81300fe0c0 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f813836a640 1 -- 172.21.15.86:0/1135979345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8130197650 con 0x7f81300fe0c0 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f81277fe640 1 -- 172.21.15.86:0/1135979345 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f812c031a80 con 0x7f81300fe0c0 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.052+0000 7f813836a640 1 -- 172.21.15.86:0/1135979345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8130197af0 con 0x7f81300fe0c0 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.053+0000 7f81277fe640 1 -- 172.21.15.86:0/1135979345 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 16) v1 ==== 45477+0+0 (secure 0 0 0) 0x7f812c031cb0 con 0x7f81300fe0c0 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.053+0000 7f813836a640 1 -- 172.21.15.86:0/1135979345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81300fe4c0 con 0x7f81300fe0c0 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.053+0000 7f81277fe640 1 --2- 172.21.15.86:0/1135979345 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f811c0385d0 0x7f811c03aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.054+0000 7f81277fe640 1 -- 172.21.15.86:0/1135979345 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f812c06c390 con 0x7f81300fe0c0 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.054+0000 7f8135905640 1 --2- 172.21.15.86:0/1135979345 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f811c0385d0 0x7f811c03aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:37.062 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.054+0000 7f8135905640 1 --2- 172.21.15.86:0/1135979345 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f811c0385d0 0x7f811c03aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f81200098c0 tx=0x7f8120006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:37.065 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.062+0000 7f81277fe640 1 -- 172.21.15.86:0/1135979345 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f812c04dd20 con 0x7f81300fe0c0 2024-08-19T00:48:37.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.298+0000 7f813836a640 1 -- 172.21.15.86:0/1135979345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8130190800 con 0x7f81300fe0c0 2024-08-19T00:48:37.301 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.298+0000 7f81277fe640 1 -- 172.21.15.86:0/1135979345 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f812c035070 con 0x7f81300fe0c0 2024-08-19T00:48:37.301 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:37.301 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:37.302 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.300+0000 7f813836a640 1 -- 172.21.15.86:0/1135979345 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f811c0385d0 msgr2=0x7f811c03aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.300+0000 7f813836a640 1 --2- 172.21.15.86:0/1135979345 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f811c0385d0 0x7f811c03aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f81200098c0 tx=0x7f8120006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.300+0000 7f813836a640 1 -- 172.21.15.86:0/1135979345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81300fe0c0 msgr2=0x7f8130196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.300+0000 7f813836a640 1 --2- 172.21.15.86:0/1135979345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81300fe0c0 0x7f8130196f10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f812c006010 tx=0x7f812c005610 comp rx=0 tx=0).stop 2024-08-19T00:48:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.300+0000 7f813836a640 1 -- 172.21.15.86:0/1135979345 shutdown_connections 2024-08-19T00:48:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.300+0000 7f813836a640 1 --2- 172.21.15.86:0/1135979345 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f811c0385d0 0x7f811c03aa90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.300+0000 7f813836a640 1 --2- 172.21.15.86:0/1135979345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f81300fe0c0 0x7f8130196f10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.300+0000 7f813836a640 1 -- 172.21.15.86:0/1135979345 >> 172.21.15.86:0/1135979345 conn(0x7f81300f9e90 msgr2=0x7f81300fa8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:37.303 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.300+0000 7f813836a640 1 -- 172.21.15.86:0/1135979345 shutdown_connections 2024-08-19T00:48:37.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:37.300+0000 7f813836a640 1 -- 172.21.15.86:0/1135979345 wait complete. 2024-08-19T00:48:38.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:38 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:38.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:38 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/1135979345' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:38.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:38 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:38.967 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:38.967 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:39.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:39 smithi017 ceph-mon[16627]: mgrmap e17: smithi017.hfpawi(active, since 2s) 2024-08-19T00:48:39.542 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:39.597 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:40.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:40 smithi017 ceph-mon[16627]: [19/Aug/2024:00:48:39] ENGINE Bus STARTING 2024-08-19T00:48:40.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:40 smithi017 ceph-mon[16627]: [19/Aug/2024:00:48:39] ENGINE Serving on http://172.21.15.17:8765 2024-08-19T00:48:41.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:41 smithi017 ceph-mon[16627]: [19/Aug/2024:00:48:39] ENGINE Serving on https://172.21.15.17:7150 2024-08-19T00:48:41.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:41 smithi017 ceph-mon[16627]: [19/Aug/2024:00:48:39] ENGINE Bus STARTED 2024-08-19T00:48:41.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:41 smithi017 ceph-mon[16627]: [19/Aug/2024:00:48:39] ENGINE Error in HTTPServer.serve 2024-08-19T00:48:41.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Traceback (most recent call last): 2024-08-19T00:48:41.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._run(expiration_interval) 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s = self.context.wrap_socket( 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: return self.sslsocket_class._create( 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:48:41.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self.do_handshake() 2024-08-19T00:48:41.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:48:41.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._sslobj.do_handshake() 2024-08-19T00:48:41.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:48:41.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:41 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:41.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:41 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:41.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:41 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:41.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:41 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:41.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:41 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi086", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:48:41.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.629+0000 7ff5455c6640 1 -- 172.21.15.86:0/668296923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5400fe6d0 msgr2=0x7ff5400fead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.629+0000 7ff5455c6640 1 --2- 172.21.15.86:0/668296923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5400fe6d0 0x7ff5400fead0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff538009880 tx=0x7ff53802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.629+0000 7ff5455c6640 1 -- 172.21.15.86:0/668296923 shutdown_connections 2024-08-19T00:48:41.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.629+0000 7ff5455c6640 1 --2- 172.21.15.86:0/668296923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5400fe6d0 0x7ff5400fead0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.629+0000 7ff5455c6640 1 -- 172.21.15.86:0/668296923 >> 172.21.15.86:0/668296923 conn(0x7ff5400f9e80 msgr2=0x7ff5400fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:41.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.629+0000 7ff5455c6640 1 -- 172.21.15.86:0/668296923 shutdown_connections 2024-08-19T00:48:41.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.629+0000 7ff5455c6640 1 -- 172.21.15.86:0/668296923 wait complete. 2024-08-19T00:48:41.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.630+0000 7ff5455c6640 1 Processor -- start 2024-08-19T00:48:41.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.630+0000 7ff5455c6640 1 -- start start 2024-08-19T00:48:41.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.630+0000 7ff5455c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5400fe6d0 0x7ff540068160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.630+0000 7ff5455c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff540197a80 con 0x7ff5400fe6d0 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.631+0000 7ff53effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5400fe6d0 0x7ff540068160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.631+0000 7ff53effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5400fe6d0 0x7ff540068160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:44254/0 (socket says 172.21.15.86:44254) 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.631+0000 7ff53effd640 1 -- 172.21.15.86:0/5358237 learned_addr learned my addr 172.21.15.86:0/5358237 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.631+0000 7ff53effd640 1 -- 172.21.15.86:0/5358237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff538009560 con 0x7ff5400fe6d0 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.631+0000 7ff53effd640 1 --2- 172.21.15.86:0/5358237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5400fe6d0 0x7ff540068160 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff538006010 tx=0x7ff5380055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.631+0000 7ff527fff640 1 -- 172.21.15.86:0/5358237 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff538004b60 con 0x7ff5400fe6d0 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.631+0000 7ff527fff640 1 -- 172.21.15.86:0/5358237 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff538004cc0 con 0x7ff5400fe6d0 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.631+0000 7ff5455c6640 1 -- 172.21.15.86:0/5358237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff540197bc0 con 0x7ff5400fe6d0 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.631+0000 7ff527fff640 1 -- 172.21.15.86:0/5358237 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff538031a20 con 0x7ff5400fe6d0 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.631+0000 7ff5455c6640 1 -- 172.21.15.86:0/5358237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff540197fa0 con 0x7ff5400fe6d0 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.632+0000 7ff527fff640 1 -- 172.21.15.86:0/5358237 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7ff538031ce0 con 0x7ff5400fe6d0 2024-08-19T00:48:41.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.632+0000 7ff5455c6640 1 -- 172.21.15.86:0/5358237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5400fead0 con 0x7ff5400fe6d0 2024-08-19T00:48:41.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.632+0000 7ff527fff640 1 --2- 172.21.15.86:0/5358237 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff528038830 0x7ff52803acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:41.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.632+0000 7ff527fff640 1 -- 172.21.15.86:0/5358237 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff53806c650 con 0x7ff5400fe6d0 2024-08-19T00:48:41.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.633+0000 7ff53e7fc640 1 --2- 172.21.15.86:0/5358237 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff528038830 0x7ff52803acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:41.639 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.633+0000 7ff53e7fc640 1 --2- 172.21.15.86:0/5358237 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff528038830 0x7ff52803acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5340098c0 tx=0x7ff534006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:41.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.637+0000 7ff527fff640 1 -- 172.21.15.86:0/5358237 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff53804d350 con 0x7ff5400fe6d0 2024-08-19T00:48:41.867 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.865+0000 7ff5455c6640 1 -- 172.21.15.86:0/5358237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff54018d500 con 0x7ff5400fe6d0 2024-08-19T00:48:41.868 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.865+0000 7ff527fff640 1 -- 172.21.15.86:0/5358237 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff538035070 con 0x7ff5400fe6d0 2024-08-19T00:48:41.868 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:41.868 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:41.868 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:41.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.868+0000 7ff5455c6640 1 -- 172.21.15.86:0/5358237 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff528038830 msgr2=0x7ff52803acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.868+0000 7ff5455c6640 1 --2- 172.21.15.86:0/5358237 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff528038830 0x7ff52803acf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff5340098c0 tx=0x7ff534006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.868+0000 7ff5455c6640 1 -- 172.21.15.86:0/5358237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5400fe6d0 msgr2=0x7ff540068160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:41.870 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.868+0000 7ff5455c6640 1 --2- 172.21.15.86:0/5358237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5400fe6d0 0x7ff540068160 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff538006010 tx=0x7ff5380055f0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.868+0000 7ff5455c6640 1 -- 172.21.15.86:0/5358237 shutdown_connections 2024-08-19T00:48:41.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.868+0000 7ff5455c6640 1 --2- 172.21.15.86:0/5358237 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff528038830 0x7ff52803acf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.868+0000 7ff5455c6640 1 --2- 172.21.15.86:0/5358237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5400fe6d0 0x7ff540068160 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:41.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.868+0000 7ff5455c6640 1 -- 172.21.15.86:0/5358237 >> 172.21.15.86:0/5358237 conn(0x7ff5400f9e80 msgr2=0x7ff5400fa900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:41.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.868+0000 7ff5455c6640 1 -- 172.21.15.86:0/5358237 shutdown_connections 2024-08-19T00:48:41.871 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:41.868+0000 7ff5455c6640 1 -- 172.21.15.86:0/5358237 wait complete. 2024-08-19T00:48:42.179 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:42 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/5358237' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:43.454 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:43.455 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:43.646 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:43.899 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-19T00:48:45.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd/host:smithi017", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:48:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:48:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:48:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:44 smithi017 ceph-mon[16627]: Updating smithi017:/etc/ceph/ceph.conf 2024-08-19T00:48:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:44 smithi017 ceph-mon[16627]: Updating smithi086:/etc/ceph/ceph.conf 2024-08-19T00:48:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:44 smithi017 ceph-mon[16627]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:48:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:44 smithi017 ceph-mon[16627]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:48:45.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.429+0000 7f52f4302640 1 -- 172.21.15.86:0/3134173183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec104670 msgr2=0x7f52ec104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.429+0000 7f52f4302640 1 --2- 172.21.15.86:0/3134173183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec104670 0x7f52ec104a50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009880 tx=0x7f52e802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.430+0000 7f52f4302640 1 -- 172.21.15.86:0/3134173183 shutdown_connections 2024-08-19T00:48:45.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.430+0000 7f52f4302640 1 --2- 172.21.15.86:0/3134173183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec104670 0x7f52ec104a50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.430+0000 7f52f4302640 1 -- 172.21.15.86:0/3134173183 >> 172.21.15.86:0/3134173183 conn(0x7f52ec0fa3b0 msgr2=0x7f52ec0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:45.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.430+0000 7f52f4302640 1 -- 172.21.15.86:0/3134173183 shutdown_connections 2024-08-19T00:48:45.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.430+0000 7f52f4302640 1 -- 172.21.15.86:0/3134173183 wait complete. 2024-08-19T00:48:45.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.430+0000 7f52f4302640 1 Processor -- start 2024-08-19T00:48:45.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.430+0000 7f52f4302640 1 -- start start 2024-08-19T00:48:45.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.430+0000 7f52f4302640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec104670 0x7f52ec100240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.433 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.430+0000 7f52f4302640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec102150 con 0x7f52ec104670 2024-08-19T00:48:45.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.431+0000 7f52f209e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec104670 0x7f52ec100240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.431+0000 7f52f209e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec104670 0x7f52ec100240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:44274/0 (socket says 172.21.15.86:44274) 2024-08-19T00:48:45.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.431+0000 7f52f209e640 1 -- 172.21.15.86:0/1900540738 learned_addr learned my addr 172.21.15.86:0/1900540738 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:45.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.431+0000 7f52f209e640 1 -- 172.21.15.86:0/1900540738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8009560 con 0x7f52ec104670 2024-08-19T00:48:45.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.431+0000 7f52f209e640 1 --2- 172.21.15.86:0/1900540738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec104670 0x7f52ec100240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009230 tx=0x7f52e80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:45.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.431+0000 7f52df7fe640 1 -- 172.21.15.86:0/1900540738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52e8004aa0 con 0x7f52ec104670 2024-08-19T00:48:45.435 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.431+0000 7f52f4302640 1 -- 172.21.15.86:0/1900540738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec100780 con 0x7f52ec104670 2024-08-19T00:48:45.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.431+0000 7f52df7fe640 1 -- 172.21.15.86:0/1900540738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f52e8004c00 con 0x7f52ec104670 2024-08-19T00:48:45.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.431+0000 7f52df7fe640 1 -- 172.21.15.86:0/1900540738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52e8031940 con 0x7f52ec104670 2024-08-19T00:48:45.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.431+0000 7f52f4302640 1 -- 172.21.15.86:0/1900540738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec100c00 con 0x7f52ec104670 2024-08-19T00:48:45.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.432+0000 7f52df7fe640 1 -- 172.21.15.86:0/1900540738 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f52e8031aa0 con 0x7f52ec104670 2024-08-19T00:48:45.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.432+0000 7f52f4302640 1 -- 172.21.15.86:0/1900540738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec0ffdb0 con 0x7f52ec104670 2024-08-19T00:48:45.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.433+0000 7f52df7fe640 1 --2- 172.21.15.86:0/1900540738 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f52d8038830 0x7f52d803acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:45.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.433+0000 7f52df7fe640 1 -- 172.21.15.86:0/1900540738 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f52e806c530 con 0x7f52ec104670 2024-08-19T00:48:45.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.433+0000 7f52f189d640 1 --2- 172.21.15.86:0/1900540738 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f52d8038830 0x7f52d803acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:45.436 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.433+0000 7f52f189d640 1 --2- 172.21.15.86:0/1900540738 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f52d8038830 0x7f52d803acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f52e00098c0 tx=0x7f52e0006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:45.440 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.439+0000 7f52df7fe640 1 -- 172.21.15.86:0/1900540738 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f52e8004d70 con 0x7f52ec104670 2024-08-19T00:48:45.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.682+0000 7f52f4302640 1 -- 172.21.15.86:0/1900540738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f52ec100ee0 con 0x7f52ec104670 2024-08-19T00:48:45.685 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.683+0000 7f52df7fe640 1 -- 172.21.15.86:0/1900540738 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f52e8035020 con 0x7f52ec104670 2024-08-19T00:48:45.685 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:45.686 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:45.686 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.685+0000 7f52f4302640 1 -- 172.21.15.86:0/1900540738 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f52d8038830 msgr2=0x7f52d803acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.685+0000 7f52f4302640 1 --2- 172.21.15.86:0/1900540738 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f52d8038830 0x7f52d803acf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f52e00098c0 tx=0x7f52e0006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.685+0000 7f52f4302640 1 -- 172.21.15.86:0/1900540738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec104670 msgr2=0x7f52ec100240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.685+0000 7f52f4302640 1 --2- 172.21.15.86:0/1900540738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec104670 0x7f52ec100240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52e8009230 tx=0x7f52e80056e0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.687 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.685+0000 7f52f4302640 1 -- 172.21.15.86:0/1900540738 shutdown_connections 2024-08-19T00:48:45.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.685+0000 7f52f4302640 1 --2- 172.21.15.86:0/1900540738 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f52d8038830 0x7f52d803acf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.685+0000 7f52f4302640 1 --2- 172.21.15.86:0/1900540738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52ec104670 0x7f52ec100240 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:45.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.685+0000 7f52f4302640 1 -- 172.21.15.86:0/1900540738 >> 172.21.15.86:0/1900540738 conn(0x7f52ec0fa3b0 msgr2=0x7f52ec0fbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:45.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.685+0000 7f52f4302640 1 -- 172.21.15.86:0/1900540738 shutdown_connections 2024-08-19T00:48:45.688 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:45.685+0000 7f52f4302640 1 -- 172.21.15.86:0/1900540738 wait complete. 2024-08-19T00:48:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:48:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:48:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:48:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:48:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:46.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:46.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T00:48:46.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-19T00:48:46.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:48:46.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: Deploying daemon ceph-exporter.smithi086 on smithi086 2024-08-19T00:48:46.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:46 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/1900540738' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:47.600 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:47.600 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:47.880 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:48:49.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.401+0000 7f9c713c7640 1 -- 172.21.15.86:0/3811453662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c105750 msgr2=0x7f9c6c105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.401+0000 7f9c713c7640 1 --2- 172.21.15.86:0/3811453662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c105750 0x7f9c6c105b30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009880 tx=0x7f9c5c02a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.401+0000 7f9c713c7640 1 -- 172.21.15.86:0/3811453662 shutdown_connections 2024-08-19T00:48:49.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.401+0000 7f9c713c7640 1 --2- 172.21.15.86:0/3811453662 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c105750 0x7f9c6c105b30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.401+0000 7f9c713c7640 1 -- 172.21.15.86:0/3811453662 >> 172.21.15.86:0/3811453662 conn(0x7f9c6c0fb850 msgr2=0x7f9c6c0fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:49.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.401+0000 7f9c713c7640 1 -- 172.21.15.86:0/3811453662 shutdown_connections 2024-08-19T00:48:49.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.401+0000 7f9c713c7640 1 -- 172.21.15.86:0/3811453662 wait complete. 2024-08-19T00:48:49.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.402+0000 7f9c713c7640 1 Processor -- start 2024-08-19T00:48:49.515 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.402+0000 7f9c713c7640 1 -- start start 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.402+0000 7f9c713c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c105750 0x7f9c6c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.402+0000 7f9c713c7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0746c0 con 0x7f9c6c105750 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.402+0000 7f9c6affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c105750 0x7f9c6c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.402+0000 7f9c6affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c105750 0x7f9c6c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:54906/0 (socket says 172.21.15.86:54906) 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.402+0000 7f9c6affd640 1 -- 172.21.15.86:0/4284854224 learned_addr learned my addr 172.21.15.86:0/4284854224 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.403+0000 7f9c6affd640 1 -- 172.21.15.86:0/4284854224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c009560 con 0x7f9c6c105750 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.403+0000 7f9c6affd640 1 --2- 172.21.15.86:0/4284854224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c105750 0x7f9c6c0727b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009230 tx=0x7f9c5c0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.403+0000 7f9c68ff9640 1 -- 172.21.15.86:0/4284854224 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c5c004aa0 con 0x7f9c6c105750 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.403+0000 7f9c68ff9640 1 -- 172.21.15.86:0/4284854224 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c5c004c00 con 0x7f9c6c105750 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.403+0000 7f9c713c7640 1 -- 172.21.15.86:0/4284854224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c072cf0 con 0x7f9c6c105750 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.403+0000 7f9c68ff9640 1 -- 172.21.15.86:0/4284854224 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c5c031940 con 0x7f9c6c105750 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.403+0000 7f9c713c7640 1 -- 172.21.15.86:0/4284854224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c073170 con 0x7f9c6c105750 2024-08-19T00:48:49.516 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.404+0000 7f9c68ff9640 1 -- 172.21.15.86:0/4284854224 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f9c5c031aa0 con 0x7f9c6c105750 2024-08-19T00:48:49.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.404+0000 7f9c68ff9640 1 --2- 172.21.15.86:0/4284854224 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9c58038880 0x7f9c5803ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:49.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.405+0000 7f9c68ff9640 1 -- 172.21.15.86:0/4284854224 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f9c5c06c620 con 0x7f9c6c105750 2024-08-19T00:48:49.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.405+0000 7f9c713c7640 1 -- 172.21.15.86:0/4284854224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c100e90 con 0x7f9c6c105750 2024-08-19T00:48:49.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.405+0000 7f9c627fc640 1 --2- 172.21.15.86:0/4284854224 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9c58038880 0x7f9c5803ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:49.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.405+0000 7f9c627fc640 1 --2- 172.21.15.86:0/4284854224 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9c58038880 0x7f9c5803ad40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c540098c0 tx=0x7f9c54006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:49.517 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.410+0000 7f9c68ff9640 1 -- 172.21.15.86:0/4284854224 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f9c5c035080 con 0x7f9c6c105750 2024-08-19T00:48:49.637 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.636+0000 7f9c713c7640 1 -- 172.21.15.86:0/4284854224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9c6c0733b0 con 0x7f9c6c105750 2024-08-19T00:48:49.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.636+0000 7f9c68ff9640 1 -- 172.21.15.86:0/4284854224 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f9c5c040020 con 0x7f9c6c105750 2024-08-19T00:48:49.638 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:49.638 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:49.638 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:49.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.638+0000 7f9c713c7640 1 -- 172.21.15.86:0/4284854224 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9c58038880 msgr2=0x7f9c5803ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.638+0000 7f9c713c7640 1 --2- 172.21.15.86:0/4284854224 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9c58038880 0x7f9c5803ad40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c540098c0 tx=0x7f9c54006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.638+0000 7f9c713c7640 1 -- 172.21.15.86:0/4284854224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c105750 msgr2=0x7f9c6c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:49.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.638+0000 7f9c713c7640 1 --2- 172.21.15.86:0/4284854224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c105750 0x7f9c6c0727b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c009230 tx=0x7f9c5c0056e0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.638+0000 7f9c713c7640 1 -- 172.21.15.86:0/4284854224 shutdown_connections 2024-08-19T00:48:49.640 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.638+0000 7f9c713c7640 1 --2- 172.21.15.86:0/4284854224 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9c58038880 0x7f9c5803ad40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.638+0000 7f9c713c7640 1 --2- 172.21.15.86:0/4284854224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9c6c105750 0x7f9c6c0727b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:49.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.638+0000 7f9c713c7640 1 -- 172.21.15.86:0/4284854224 >> 172.21.15.86:0/4284854224 conn(0x7f9c6c0fb850 msgr2=0x7f9c6c0fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:49.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.639+0000 7f9c713c7640 1 -- 172.21.15.86:0/4284854224 shutdown_connections 2024-08-19T00:48:49.641 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:49.639+0000 7f9c713c7640 1 -- 172.21.15.86:0/4284854224 wait complete. 2024-08-19T00:48:50.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:49 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/4284854224' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:51.241 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:51.241 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:51.434 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:48:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi086", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T00:48:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi086", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-08-19T00:48:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:48:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:51 smithi017 ceph-mon[16627]: Deploying daemon crash.smithi086 on smithi086 2024-08-19T00:48:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:48:53.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.493+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/1628259011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8104700 msgr2=0x7f7fb8104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.493+0000 7f7fbdaaf640 1 --2- 172.21.15.86:0/1628259011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8104700 0x7f7fb8104ae0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009880 tx=0x7f7fa802a5d0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.493+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/1628259011 shutdown_connections 2024-08-19T00:48:53.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.493+0000 7f7fbdaaf640 1 --2- 172.21.15.86:0/1628259011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8104700 0x7f7fb8104ae0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.493+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/1628259011 >> 172.21.15.86:0/1628259011 conn(0x7f7fb80fa440 msgr2=0x7f7fb80fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:53.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.493+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/1628259011 shutdown_connections 2024-08-19T00:48:53.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.493+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/1628259011 wait complete. 2024-08-19T00:48:53.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.493+0000 7f7fbdaaf640 1 Processor -- start 2024-08-19T00:48:53.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.493+0000 7f7fbdaaf640 1 -- start start 2024-08-19T00:48:53.496 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.494+0000 7f7fbdaaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8104700 0x7f7fb80fa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.494+0000 7f7fbdaaf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80fc800 con 0x7f7fb8104700 2024-08-19T00:48:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.494+0000 7f7fb77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8104700 0x7f7fb80fa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.494+0000 7f7fb77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8104700 0x7f7fb80fa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:54928/0 (socket says 172.21.15.86:54928) 2024-08-19T00:48:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.494+0000 7f7fb77fe640 1 -- 172.21.15.86:0/145101026 learned_addr learned my addr 172.21.15.86:0/145101026 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.494+0000 7f7fb77fe640 1 -- 172.21.15.86:0/145101026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8009560 con 0x7f7fb8104700 2024-08-19T00:48:53.497 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.494+0000 7f7fb77fe640 1 --2- 172.21.15.86:0/145101026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8104700 0x7f7fb80fa8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009230 tx=0x7f7fa80056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:53.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.495+0000 7f7fb57fa640 1 -- 172.21.15.86:0/145101026 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa8004aa0 con 0x7f7fb8104700 2024-08-19T00:48:53.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.495+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/145101026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb80fae30 con 0x7f7fb8104700 2024-08-19T00:48:53.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.495+0000 7f7fb57fa640 1 -- 172.21.15.86:0/145101026 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fa8004c00 con 0x7f7fb8104700 2024-08-19T00:48:53.498 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.495+0000 7f7fb57fa640 1 -- 172.21.15.86:0/145101026 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa8031940 con 0x7f7fb8104700 2024-08-19T00:48:53.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.495+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/145101026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb80fb2b0 con 0x7f7fb8104700 2024-08-19T00:48:53.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.496+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/145101026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb80ffe40 con 0x7f7fb8104700 2024-08-19T00:48:53.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.496+0000 7f7fb57fa640 1 -- 172.21.15.86:0/145101026 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f7fa8031aa0 con 0x7f7fb8104700 2024-08-19T00:48:53.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.496+0000 7f7fb57fa640 1 --2- 172.21.15.86:0/145101026 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f7fa4038830 0x7f7fa403acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:53.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.496+0000 7f7fb57fa640 1 -- 172.21.15.86:0/145101026 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f7fa806c590 con 0x7f7fb8104700 2024-08-19T00:48:53.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.496+0000 7f7faffff640 1 --2- 172.21.15.86:0/145101026 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f7fa4038830 0x7f7fa403acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:53.499 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.497+0000 7f7faffff640 1 --2- 172.21.15.86:0/145101026 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f7fa4038830 0x7f7fa403acf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00098c0 tx=0x7f7fa0006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:53.502 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.501+0000 7f7fb57fa640 1 -- 172.21.15.86:0/145101026 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f7fa8004d70 con 0x7f7fb8104700 2024-08-19T00:48:53.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.735+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/145101026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7fb80fb5b0 con 0x7f7fb8104700 2024-08-19T00:48:53.737 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.736+0000 7f7fb57fa640 1 -- 172.21.15.86:0/145101026 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f7fa8035300 con 0x7f7fb8104700 2024-08-19T00:48:53.737 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:53.738 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:53.738 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:53.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.738+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/145101026 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f7fa4038830 msgr2=0x7f7fa403acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.738+0000 7f7fbdaaf640 1 --2- 172.21.15.86:0/145101026 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f7fa4038830 0x7f7fa403acf0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00098c0 tx=0x7f7fa0006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.738+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/145101026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8104700 msgr2=0x7f7fb80fa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:53.739 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.738+0000 7f7fbdaaf640 1 --2- 172.21.15.86:0/145101026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8104700 0x7f7fb80fa8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009230 tx=0x7f7fa80056e0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.738+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/145101026 shutdown_connections 2024-08-19T00:48:53.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.738+0000 7f7fbdaaf640 1 --2- 172.21.15.86:0/145101026 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f7fa4038830 0x7f7fa403acf0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.738+0000 7f7fbdaaf640 1 --2- 172.21.15.86:0/145101026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fb8104700 0x7f7fb80fa8f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:53.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.738+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/145101026 >> 172.21.15.86:0/145101026 conn(0x7f7fb80fa440 msgr2=0x7f7fb8067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:53.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.738+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/145101026 shutdown_connections 2024-08-19T00:48:53.740 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:53.738+0000 7f7fbdaaf640 1 -- 172.21.15.86:0/145101026 wait complete. 2024-08-19T00:48:55.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:55.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:55.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:55.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:55.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:54 smithi017 ceph-mon[16627]: Deploying daemon node-exporter.smithi086 on smithi086 2024-08-19T00:48:55.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:54 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/145101026' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:55.357 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:55.357 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:48:55.556 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:48:56.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:56 smithi017 ceph-mon[16627]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:56.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:56 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:48:57.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.611+0000 7f15dc1af640 1 -- 172.21.15.86:0/2818686955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4100970 msgr2=0x7f15d4100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:57.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.611+0000 7f15dc1af640 1 --2- 172.21.15.86:0/2818686955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4100970 0x7f15d4100d50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009880 tx=0x7f15d002a670 comp rx=0 tx=0).stop 2024-08-19T00:48:57.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.611+0000 7f15dc1af640 1 -- 172.21.15.86:0/2818686955 shutdown_connections 2024-08-19T00:48:57.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.611+0000 7f15dc1af640 1 --2- 172.21.15.86:0/2818686955 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4100970 0x7f15d4100d50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:57.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.611+0000 7f15dc1af640 1 -- 172.21.15.86:0/2818686955 >> 172.21.15.86:0/2818686955 conn(0x7f15d4075490 msgr2=0x7f15d40fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:57.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.611+0000 7f15dc1af640 1 -- 172.21.15.86:0/2818686955 shutdown_connections 2024-08-19T00:48:57.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.611+0000 7f15dc1af640 1 -- 172.21.15.86:0/2818686955 wait complete. 2024-08-19T00:48:57.709 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.611+0000 7f15dc1af640 1 Processor -- start 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.611+0000 7f15dc1af640 1 -- start start 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.612+0000 7f15dc1af640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4100970 0x7f15d40fe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.612+0000 7f15dc1af640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d41004e0 con 0x7f15d4100970 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.612+0000 7f15d9f4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4100970 0x7f15d40fe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.612+0000 7f15d9f4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4100970 0x7f15d40fe5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:54948/0 (socket says 172.21.15.86:54948) 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.612+0000 7f15d9f4b640 1 -- 172.21.15.86:0/1572920665 learned_addr learned my addr 172.21.15.86:0/1572920665 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.612+0000 7f15d9f4b640 1 -- 172.21.15.86:0/1572920665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0009560 con 0x7f15d4100970 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.612+0000 7f15d9f4b640 1 --2- 172.21.15.86:0/1572920665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4100970 0x7f15d40fe5d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009230 tx=0x7f15d00056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.612+0000 7f15caffd640 1 -- 172.21.15.86:0/1572920665 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15d0004be0 con 0x7f15d4100970 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.612+0000 7f15dc1af640 1 -- 172.21.15.86:0/1572920665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d40feb10 con 0x7f15d4100970 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.613+0000 7f15caffd640 1 -- 172.21.15.86:0/1572920665 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15d0004d40 con 0x7f15d4100970 2024-08-19T00:48:57.710 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.613+0000 7f15caffd640 1 -- 172.21.15.86:0/1572920665 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15d0031a90 con 0x7f15d4100970 2024-08-19T00:48:57.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.613+0000 7f15dc1af640 1 -- 172.21.15.86:0/1572920665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d40fef30 con 0x7f15d4100970 2024-08-19T00:48:57.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.613+0000 7f15caffd640 1 -- 172.21.15.86:0/1572920665 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f15d0031cc0 con 0x7f15d4100970 2024-08-19T00:48:57.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.613+0000 7f15dc1af640 1 -- 172.21.15.86:0/1572920665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d4067f20 con 0x7f15d4100970 2024-08-19T00:48:57.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.614+0000 7f15caffd640 1 --2- 172.21.15.86:0/1572920665 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f15c0038830 0x7f15c003acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:48:57.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.614+0000 7f15caffd640 1 -- 172.21.15.86:0/1572920665 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f15d006c5f0 con 0x7f15d4100970 2024-08-19T00:48:57.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.614+0000 7f15d974a640 1 --2- 172.21.15.86:0/1572920665 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f15c0038830 0x7f15c003acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:48:57.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.614+0000 7f15d974a640 1 --2- 172.21.15.86:0/1572920665 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f15c0038830 0x7f15c003acf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f15c40098c0 tx=0x7f15c4006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:48:57.711 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.619+0000 7f15caffd640 1 -- 172.21.15.86:0/1572920665 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f15d004d760 con 0x7f15d4100970 2024-08-19T00:48:57.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.846+0000 7f15dc1af640 1 -- 172.21.15.86:0/1572920665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f15d40ff170 con 0x7f15d4100970 2024-08-19T00:48:57.848 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.847+0000 7f15caffd640 1 -- 172.21.15.86:0/1572920665 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f15d0035020 con 0x7f15d4100970 2024-08-19T00:48:57.849 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:48:57.849 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:48:57.849 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:48:57.850 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.849+0000 7f15dc1af640 1 -- 172.21.15.86:0/1572920665 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f15c0038830 msgr2=0x7f15c003acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:57.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.849+0000 7f15dc1af640 1 --2- 172.21.15.86:0/1572920665 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f15c0038830 0x7f15c003acf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f15c40098c0 tx=0x7f15c4006db0 comp rx=0 tx=0).stop 2024-08-19T00:48:57.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.849+0000 7f15dc1af640 1 -- 172.21.15.86:0/1572920665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4100970 msgr2=0x7f15d40fe5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:48:57.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.849+0000 7f15dc1af640 1 --2- 172.21.15.86:0/1572920665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4100970 0x7f15d40fe5d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009230 tx=0x7f15d00056e0 comp rx=0 tx=0).stop 2024-08-19T00:48:57.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.849+0000 7f15dc1af640 1 -- 172.21.15.86:0/1572920665 shutdown_connections 2024-08-19T00:48:57.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.849+0000 7f15dc1af640 1 --2- 172.21.15.86:0/1572920665 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f15c0038830 0x7f15c003acf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:57.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.849+0000 7f15dc1af640 1 --2- 172.21.15.86:0/1572920665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15d4100970 0x7f15d40fe5d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:48:57.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.849+0000 7f15dc1af640 1 -- 172.21.15.86:0/1572920665 >> 172.21.15.86:0/1572920665 conn(0x7f15d4075490 msgr2=0x7f15d4103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:48:57.851 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.849+0000 7f15dc1af640 1 -- 172.21.15.86:0/1572920665 shutdown_connections 2024-08-19T00:48:57.852 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:48:57.849+0000 7f15dc1af640 1 -- 172.21.15.86:0/1572920665 wait complete. 2024-08-19T00:48:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:58 smithi017 ceph-mon[16627]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:48:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:58 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/1572920665' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:48:59.660 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:48:59.660 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:49:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:59 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:59 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:59 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:59 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:59 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi086.uthxct", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:49:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:59 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi086.uthxct", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-19T00:49:00.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:59 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:49:00.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:59 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:00.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:59 smithi017 ceph-mon[16627]: Deploying daemon mgr.smithi086.uthxct on smithi086 2024-08-19T00:49:00.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:48:59 smithi017 ceph-mon[16627]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:00.417 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:49:01.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:01 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.370+0000 7f86ca17e640 1 -- 172.21.15.86:0/3913406425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c40fe4a0 msgr2=0x7f86c40fe880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.370+0000 7f86ca17e640 1 --2- 172.21.15.86:0/3913406425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c40fe4a0 0x7f86c40fe880 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009880 tx=0x7f86b402a5d0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.370+0000 7f86ca17e640 1 -- 172.21.15.86:0/3913406425 shutdown_connections 2024-08-19T00:49:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.370+0000 7f86ca17e640 1 --2- 172.21.15.86:0/3913406425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c40fe4a0 0x7f86c40fe880 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.370+0000 7f86ca17e640 1 -- 172.21.15.86:0/3913406425 >> 172.21.15.86:0/3913406425 conn(0x7f86c4075490 msgr2=0x7f86c40fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.370+0000 7f86ca17e640 1 -- 172.21.15.86:0/3913406425 shutdown_connections 2024-08-19T00:49:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.370+0000 7f86ca17e640 1 -- 172.21.15.86:0/3913406425 wait complete. 2024-08-19T00:49:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.371+0000 7f86ca17e640 1 Processor -- start 2024-08-19T00:49:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.371+0000 7f86ca17e640 1 -- start start 2024-08-19T00:49:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.372+0000 7f86ca17e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c40fe4a0 0x7f86c4197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:02.409 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.372+0000 7f86ca17e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c41978b0 con 0x7f86c40fe4a0 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.372+0000 7f86c37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c40fe4a0 0x7f86c4197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.372+0000 7f86c37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c40fe4a0 0x7f86c4197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:41560/0 (socket says 172.21.15.86:41560) 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.372+0000 7f86c37fe640 1 -- 172.21.15.86:0/281379402 learned_addr learned my addr 172.21.15.86:0/281379402 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.372+0000 7f86c37fe640 1 -- 172.21.15.86:0/281379402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b4009560 con 0x7f86c40fe4a0 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.372+0000 7f86c37fe640 1 --2- 172.21.15.86:0/281379402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c40fe4a0 0x7f86c4197370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009230 tx=0x7f86b40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.373+0000 7f86c0ff9640 1 -- 172.21.15.86:0/281379402 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86b4004aa0 con 0x7f86c40fe4a0 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.373+0000 7f86ca17e640 1 -- 172.21.15.86:0/281379402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c4197ab0 con 0x7f86c40fe4a0 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.373+0000 7f86c0ff9640 1 -- 172.21.15.86:0/281379402 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86b4004c00 con 0x7f86c40fe4a0 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.373+0000 7f86c0ff9640 1 -- 172.21.15.86:0/281379402 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86b4031940 con 0x7f86c40fe4a0 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.373+0000 7f86ca17e640 1 -- 172.21.15.86:0/281379402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c4197ed0 con 0x7f86c40fe4a0 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.374+0000 7f86ca17e640 1 -- 172.21.15.86:0/281379402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c4067f80 con 0x7f86c40fe4a0 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.374+0000 7f86c0ff9640 1 -- 172.21.15.86:0/281379402 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f86b4031b00 con 0x7f86c40fe4a0 2024-08-19T00:49:02.410 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.374+0000 7f86c0ff9640 1 --2- 172.21.15.86:0/281379402 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f86ac038830 0x7f86ac03acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.374+0000 7f86c0ff9640 1 -- 172.21.15.86:0/281379402 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f86b406c610 con 0x7f86c40fe4a0 2024-08-19T00:49:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.375+0000 7f86c2ffd640 1 --2- 172.21.15.86:0/281379402 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f86ac038830 0x7f86ac03acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.375+0000 7f86c2ffd640 1 --2- 172.21.15.86:0/281379402 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f86ac038830 0x7f86ac03acf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f86b80098c0 tx=0x7f86b8006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:02.411 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.379+0000 7f86c0ff9640 1 -- 172.21.15.86:0/281379402 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f86b403aaa0 con 0x7f86c40fe4a0 2024-08-19T00:49:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.632+0000 7f86ca17e640 1 -- 172.21.15.86:0/281379402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f86c410be10 con 0x7f86c40fe4a0 2024-08-19T00:49:02.634 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.633+0000 7f86c0ff9640 1 -- 172.21.15.86:0/281379402 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f86b4035020 con 0x7f86c40fe4a0 2024-08-19T00:49:02.635 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:49:02.635 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:49:02.635 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:49:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.636+0000 7f86ca17e640 1 -- 172.21.15.86:0/281379402 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f86ac038830 msgr2=0x7f86ac03acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.636+0000 7f86ca17e640 1 --2- 172.21.15.86:0/281379402 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f86ac038830 0x7f86ac03acf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f86b80098c0 tx=0x7f86b8006db0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.636+0000 7f86ca17e640 1 -- 172.21.15.86:0/281379402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c40fe4a0 msgr2=0x7f86c4197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.636+0000 7f86ca17e640 1 --2- 172.21.15.86:0/281379402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c40fe4a0 0x7f86c4197370 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009230 tx=0x7f86b40056e0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.636+0000 7f86ca17e640 1 -- 172.21.15.86:0/281379402 shutdown_connections 2024-08-19T00:49:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.636+0000 7f86ca17e640 1 --2- 172.21.15.86:0/281379402 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f86ac038830 0x7f86ac03acf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.636+0000 7f86ca17e640 1 --2- 172.21.15.86:0/281379402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86c40fe4a0 0x7f86c4197370 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.636+0000 7f86ca17e640 1 -- 172.21.15.86:0/281379402 >> 172.21.15.86:0/281379402 conn(0x7f86c4075490 msgr2=0x7f86c40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.636+0000 7f86ca17e640 1 -- 172.21.15.86:0/281379402 shutdown_connections 2024-08-19T00:49:02.638 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:02.636+0000 7f86ca17e640 1 -- 172.21.15.86:0/281379402 wait complete. 2024-08-19T00:49:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:02 smithi017 ceph-mon[16627]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:02 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:02 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:02 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:02 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:02 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:49:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:02 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:03.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:03 smithi017 ceph-mon[16627]: Deploying daemon mon.smithi086 on smithi086 2024-08-19T00:49:03.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:03 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/281379402' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:49:04.846 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:49:04.847 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:49:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:04 smithi017 ceph-mon[16627]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:05.391 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T00:49:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:05 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:49:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:05 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:06.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:06 smithi017 ceph-mon[16627]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:07.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.037+0000 7f426d7b4640 1 -- 172.21.15.86:0/2616999623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4268100a50 msgr2=0x7f4268100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:07.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.037+0000 7f426d7b4640 1 --2- 172.21.15.86:0/2616999623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4268100a50 0x7f4268100e30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4250009880 tx=0x7f425002a670 comp rx=0 tx=0).stop 2024-08-19T00:49:07.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.037+0000 7f426d7b4640 1 -- 172.21.15.86:0/2616999623 shutdown_connections 2024-08-19T00:49:07.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.037+0000 7f426d7b4640 1 --2- 172.21.15.86:0/2616999623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4268100a50 0x7f4268100e30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.037+0000 7f426d7b4640 1 -- 172.21.15.86:0/2616999623 >> 172.21.15.86:0/2616999623 conn(0x7f42680fa490 msgr2=0x7f42680fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:07.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.037+0000 7f426d7b4640 1 -- 172.21.15.86:0/2616999623 shutdown_connections 2024-08-19T00:49:07.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.037+0000 7f426d7b4640 1 -- 172.21.15.86:0/2616999623 wait complete. 2024-08-19T00:49:07.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.038+0000 7f426d7b4640 1 Processor -- start 2024-08-19T00:49:07.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.038+0000 7f426d7b4640 1 -- start start 2024-08-19T00:49:07.043 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.038+0000 7f426d7b4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4268100a50 0x7f42681951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.038+0000 7f426d7b4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4268195700 con 0x7f4268100a50 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.038+0000 7f4266ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4268100a50 0x7f42681951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.038+0000 7f4266ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4268100a50 0x7f42681951c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.86:41590/0 (socket says 172.21.15.86:41590) 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.038+0000 7f4266ffd640 1 -- 172.21.15.86:0/1739429207 learned_addr learned my addr 172.21.15.86:0/1739429207 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.039+0000 7f4266ffd640 1 -- 172.21.15.86:0/1739429207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4250009560 con 0x7f4268100a50 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.039+0000 7f4266ffd640 1 --2- 172.21.15.86:0/1739429207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4268100a50 0x7f42681951c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4250009230 tx=0x7f42500056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.039+0000 7f425ffff640 1 -- 172.21.15.86:0/1739429207 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4250004aa0 con 0x7f4268100a50 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.039+0000 7f426d7b4640 1 -- 172.21.15.86:0/1739429207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4268195900 con 0x7f4268100a50 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.039+0000 7f425ffff640 1 -- 172.21.15.86:0/1739429207 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4250004c00 con 0x7f4268100a50 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.039+0000 7f426d7b4640 1 -- 172.21.15.86:0/1739429207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4268195d20 con 0x7f4268100a50 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.039+0000 7f425ffff640 1 -- 172.21.15.86:0/1739429207 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4250031810 con 0x7f4268100a50 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.040+0000 7f425ffff640 1 -- 172.21.15.86:0/1739429207 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 17) v1 ==== 45669+0+0 (secure 0 0 0) 0x7f4250031970 con 0x7f4268100a50 2024-08-19T00:49:07.044 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.040+0000 7f426d7b4640 1 -- 172.21.15.86:0/1739429207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4268106970 con 0x7f4268100a50 2024-08-19T00:49:07.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.040+0000 7f425ffff640 1 --2- 172.21.15.86:0/1739429207 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4254038830 0x7f425403acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:07.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.040+0000 7f425ffff640 1 -- 172.21.15.86:0/1739429207 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f425006c920 con 0x7f4268100a50 2024-08-19T00:49:07.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.041+0000 7f42667fc640 1 --2- 172.21.15.86:0/1739429207 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4254038830 0x7f425403acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:07.045 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.041+0000 7f42667fc640 1 --2- 172.21.15.86:0/1739429207 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4254038830 0x7f425403acf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f42580098c0 tx=0x7f4258006db0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:07.046 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.045+0000 7f425ffff640 1 -- 172.21.15.86:0/1739429207 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f4250030580 con 0x7f4268100a50 2024-08-19T00:49:07.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.280+0000 7f426d7b4640 1 -- 172.21.15.86:0/1739429207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4268068ca0 con 0x7f4268100a50 2024-08-19T00:49:07.282 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.281+0000 7f425ffff640 1 -- 172.21.15.86:0/1739429207 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f4250035030 con 0x7f4268100a50 2024-08-19T00:49:07.283 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:49:07.283 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":1,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:46:27.325176Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-19T00:49:07.283 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 1 2024-08-19T00:49:07.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.283+0000 7f426d7b4640 1 -- 172.21.15.86:0/1739429207 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4254038830 msgr2=0x7f425403acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:07.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.283+0000 7f426d7b4640 1 --2- 172.21.15.86:0/1739429207 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4254038830 0x7f425403acf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f42580098c0 tx=0x7f4258006db0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.283+0000 7f426d7b4640 1 -- 172.21.15.86:0/1739429207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4268100a50 msgr2=0x7f42681951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:07.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.283+0000 7f426d7b4640 1 --2- 172.21.15.86:0/1739429207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4268100a50 0x7f42681951c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4250009230 tx=0x7f42500056e0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.283+0000 7f426d7b4640 1 -- 172.21.15.86:0/1739429207 shutdown_connections 2024-08-19T00:49:07.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.283+0000 7f426d7b4640 1 --2- 172.21.15.86:0/1739429207 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4254038830 0x7f425403acf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.283+0000 7f426d7b4640 1 --2- 172.21.15.86:0/1739429207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4268100a50 0x7f42681951c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:07.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.283+0000 7f426d7b4640 1 -- 172.21.15.86:0/1739429207 >> 172.21.15.86:0/1739429207 conn(0x7f42680fa490 msgr2=0x7f4268103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:07.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.283+0000 7f426d7b4640 1 -- 172.21.15.86:0/1739429207 shutdown_connections 2024-08-19T00:49:07.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:07.283+0000 7f426d7b4640 1 -- 172.21.15.86:0/1739429207 wait complete. 2024-08-19T00:49:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:07 smithi017 ceph-mon[16627]: Standby manager daemon smithi086.uthxct started 2024-08-19T00:49:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:07 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/2795625475' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/crt"}]: dispatch 2024-08-19T00:49:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:07 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/2795625475' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:49:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:07 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/2795625475' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/key"}]: dispatch 2024-08-19T00:49:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:07 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/2795625475' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:49:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:07 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/1739429207' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:49:09.102 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-08-19T00:49:09.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-19T00:49:09.307 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T00:49:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:49:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:49:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: mon.smithi017 calling monitor election 2024-08-19T00:49:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: mon.smithi086 calling monitor election 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: mon.smithi017 is new leader, mons smithi017,smithi086 in quorum (ranks 0,1) 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: monmap e2: 2 mons at {smithi017=[v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0],smithi086=[v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: fsmap 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: osdmap e5: 0 total, 0 up, 0 in 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: mgrmap e18: smithi017.hfpawi(active, since 37s), standbys: smithi086.uthxct 2024-08-19T00:49:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: overall HEALTH_OK 2024-08-19T00:49:12.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:12.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:12.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:12.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:12.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:13.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.808+0000 7f0dc52a5640 1 -- 172.21.15.86:0/3677519815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc0104790 msgr2=0x7f0dac005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:13.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.808+0000 7f0dc52a5640 1 --2- 172.21.15.86:0/3677519815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc0104790 0x7f0dac005580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0da8011c50 tx=0x7f0da802be50 comp rx=0 tx=0).stop 2024-08-19T00:49:13.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.808+0000 7f0dc52a5640 1 -- 172.21.15.86:0/3677519815 shutdown_connections 2024-08-19T00:49:13.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.808+0000 7f0dc52a5640 1 --2- 172.21.15.86:0/3677519815 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc0104790 0x7f0dac005580 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.808+0000 7f0dc52a5640 1 -- 172.21.15.86:0/3677519815 >> 172.21.15.86:0/3677519815 conn(0x7f0dc00fa490 msgr2=0x7f0dc00fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:13.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.808+0000 7f0dc52a5640 1 -- 172.21.15.86:0/3677519815 shutdown_connections 2024-08-19T00:49:13.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.808+0000 7f0dc52a5640 1 -- 172.21.15.86:0/3677519815 wait complete. 2024-08-19T00:49:13.812 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.809+0000 7f0dc52a5640 1 Processor -- start 2024-08-19T00:49:13.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.809+0000 7f0dc52a5640 1 -- start start 2024-08-19T00:49:13.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dc52a5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc0104790 0x7f0dc0194100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:13.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dc52a5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc0194640 0x7f0dc0198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:13.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dc52a5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc0194c40 con 0x7f0dc0194640 2024-08-19T00:49:13.813 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dc52a5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc0194db0 con 0x7f0dc0104790 2024-08-19T00:49:13.814 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbeffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc0104790 0x7f0dc0194100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbeffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc0104790 0x7f0dc0194100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:55912/0 (socket says 172.21.15.86:55912) 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbeffd640 1 -- 172.21.15.86:0/387585029 learned_addr learned my addr 172.21.15.86:0/387585029 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbeffd640 1 -- 172.21.15.86:0/387585029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc0104790 msgr2=0x7f0dc0194100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbeffd640 1 -- 172.21.15.86:0/387585029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc0104790 msgr2=0x7f0dc0194100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbeffd640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc0104790 0x7f0dc0194100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbe7fc640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc0194640 0x7f0dc0198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbeffd640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc0104790 0x7f0dc0194100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbe7fc640 1 -- 172.21.15.86:0/387585029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc0104790 msgr2=0x7f0dc0194100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbe7fc640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc0104790 0x7f0dc0194100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbe7fc640 1 -- 172.21.15.86:0/387585029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da8011930 con 0x7f0dc0194640 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.810+0000 7f0dbe7fc640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc0194640 0x7f0dc0198a40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b3d0 tx=0x7f0db000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:13.815 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.811+0000 7f0db7fff640 1 -- 172.21.15.86:0/387585029 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0db0011800 con 0x7f0dc0194640 2024-08-19T00:49:13.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.811+0000 7f0dc52a5640 1 -- 172.21.15.86:0/387585029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc0199040 con 0x7f0dc0194640 2024-08-19T00:49:13.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.811+0000 7f0db7fff640 1 -- 172.21.15.86:0/387585029 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0db0011e20 con 0x7f0dc0194640 2024-08-19T00:49:13.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.811+0000 7f0db7fff640 1 -- 172.21.15.86:0/387585029 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0db000f2e0 con 0x7f0dc0194640 2024-08-19T00:49:13.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.811+0000 7f0dc52a5640 1 -- 172.21.15.86:0/387585029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc0199590 con 0x7f0dc0194640 2024-08-19T00:49:13.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.812+0000 7f0dc52a5640 1 -- 172.21.15.86:0/387585029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc0103f60 con 0x7f0dc0194640 2024-08-19T00:49:13.816 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.812+0000 7f0db7fff640 1 -- 172.21.15.86:0/387585029 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f0db0010380 con 0x7f0dc0194640 2024-08-19T00:49:13.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.813+0000 7f0db7fff640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0da006ccd0 0x7f0da006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:13.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.813+0000 7f0db7fff640 1 -- 172.21.15.86:0/387585029 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f0db008ae30 con 0x7f0dc0194640 2024-08-19T00:49:13.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.813+0000 7f0dbeffd640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0da006ccd0 0x7f0da006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:13.817 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.814+0000 7f0dbeffd640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0da006ccd0 0x7f0da006f190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0da8005940 tx=0x7f0da80058b0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:13.820 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:13.818+0000 7f0db7fff640 1 -- 172.21.15.86:0/387585029 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f0db00562e0 con 0x7f0dc0194640 2024-08-19T00:49:14.054 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.051+0000 7f0dc52a5640 1 -- 172.21.15.86:0/387585029 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0dc018dfc0 con 0x7f0dc0194640 2024-08-19T00:49:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.052+0000 7f0db7fff640 1 -- 172.21.15.86:0/387585029 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1018 (secure 0 0 0) 0x7f0db008a5f0 con 0x7f0dc0194640 2024-08-19T00:49:14.055 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:49:14.055 INFO:teuthology.orchestra.run.smithi086.stdout:{"epoch":2,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","modified":"2024-08-19T00:49:07.613835Z","created":"2024-08-19T00:46:27.325176Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi017","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:3300","nonce":0},{"type":"v1","addr":"172.21.15.17:6789","nonce":0}]},"addr":"172.21.15.17:6789/0","public_addr":"172.21.15.17:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi086","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:3300","nonce":0},{"type":"v1","addr":"172.21.15.86:6789","nonce":0}]},"addr":"172.21.15.86:6789/0","public_addr":"172.21.15.86:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-19T00:49:14.055 INFO:teuthology.orchestra.run.smithi086.stderr:dumped monmap epoch 2 2024-08-19T00:49:14.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.054+0000 7f0dc52a5640 1 -- 172.21.15.86:0/387585029 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0da006ccd0 msgr2=0x7f0da006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:14.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.054+0000 7f0dc52a5640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0da006ccd0 0x7f0da006f190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0da8005940 tx=0x7f0da80058b0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.054+0000 7f0dc52a5640 1 -- 172.21.15.86:0/387585029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc0194640 msgr2=0x7f0dc0198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:14.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.054+0000 7f0dc52a5640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc0194640 0x7f0dc0198a40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0db000b3d0 tx=0x7f0db000b890 comp rx=0 tx=0).stop 2024-08-19T00:49:14.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.054+0000 7f0dc52a5640 1 -- 172.21.15.86:0/387585029 shutdown_connections 2024-08-19T00:49:14.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.054+0000 7f0dc52a5640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0da006ccd0 0x7f0da006f190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.054+0000 7f0dc52a5640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc0194640 0x7f0dc0198a40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.054+0000 7f0dc52a5640 1 --2- 172.21.15.86:0/387585029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc0104790 0x7f0dc0194100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:14.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.054+0000 7f0dc52a5640 1 -- 172.21.15.86:0/387585029 >> 172.21.15.86:0/387585029 conn(0x7f0dc00fa490 msgr2=0x7f0dc00fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:14.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.054+0000 7f0dc52a5640 1 -- 172.21.15.86:0/387585029 shutdown_connections 2024-08-19T00:49:14.057 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:49:14.054+0000 7f0dc52a5640 1 -- 172.21.15.86:0/387585029 wait complete. 2024-08-19T00:49:14.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:13 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:49:14.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:13 smithi017 ceph-mon[16627]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:14.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:13 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:49:14.798 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:14 smithi086 ceph-mon[24511]: from='client.? 172.21.15.86:0/387585029' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:49:14.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:14 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/387585029' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-19T00:49:15.103 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-19T00:49:15.103 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph config generate-minimal-conf 2024-08-19T00:49:15.331 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:49:16.493 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.494 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.494 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:16.494 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:49:16.494 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: Updating smithi017:/etc/ceph/ceph.conf 2024-08-19T00:49:16.494 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: Updating smithi086:/etc/ceph/ceph.conf 2024-08-19T00:49:16.494 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:49:16.494 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:49:16.494 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:16.494 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.495 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.495 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.495 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.495 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.495 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.495 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:49:16.495 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:49:16.495 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:16 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:16.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:16.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:49:16.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: Updating smithi017:/etc/ceph/ceph.conf 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: Updating smithi086:/etc/ceph/ceph.conf 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:49:16.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:16 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:17.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:17 smithi017 ceph-mon[16627]: Reconfiguring mon.smithi017 (unknown last config time)... 2024-08-19T00:49:17.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:17 smithi017 ceph-mon[16627]: Reconfiguring daemon mon.smithi017 on smithi017 2024-08-19T00:49:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:17 smithi086 ceph-mon[24511]: Reconfiguring mon.smithi017 (unknown last config time)... 2024-08-19T00:49:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:17 smithi086 ceph-mon[24511]: Reconfiguring daemon mon.smithi017 on smithi017 2024-08-19T00:49:18.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.073+0000 7fe1816a5640 1 -- 172.21.15.17:0/1627568168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe17c0ffda0 msgr2=0x7fe17c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.073+0000 7fe1816a5640 1 --2- 172.21.15.17:0/1627568168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe17c0ffda0 0x7fe17c100180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe174009c20 tx=0x7fe17402a970 comp rx=0 tx=0).stop 2024-08-19T00:49:18.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.073+0000 7fe1816a5640 1 -- 172.21.15.17:0/1627568168 shutdown_connections 2024-08-19T00:49:18.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.073+0000 7fe1816a5640 1 --2- 172.21.15.17:0/1627568168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe17c100750 0x7fe17c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.073+0000 7fe1816a5640 1 --2- 172.21.15.17:0/1627568168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe17c0ffda0 0x7fe17c100180 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.073+0000 7fe1816a5640 1 -- 172.21.15.17:0/1627568168 >> 172.21.15.17:0/1627568168 conn(0x7fe17c0fb840 msgr2=0x7fe17c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.073+0000 7fe1816a5640 1 -- 172.21.15.17:0/1627568168 shutdown_connections 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.073+0000 7fe1816a5640 1 -- 172.21.15.17:0/1627568168 wait complete. 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.074+0000 7fe1816a5640 1 Processor -- start 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.074+0000 7fe1816a5640 1 -- start start 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.074+0000 7fe1816a5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe17c0ffda0 0x7fe17c19d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.074+0000 7fe1816a5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe17c100750 0x7fe17c19ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.074+0000 7fe1816a5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c19e4d0 con 0x7fe17c100750 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.074+0000 7fe1816a5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c19e640 con 0x7fe17c0ffda0 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.074+0000 7fe17a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe17c100750 0x7fe17c19ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.074+0000 7fe17a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe17c100750 0x7fe17c19ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55682/0 (socket says 172.21.15.17:55682) 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.074+0000 7fe17a7fc640 1 -- 172.21.15.17:0/3097504730 learned_addr learned my addr 172.21.15.17:0/3097504730 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:49:18.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.074+0000 7fe17affd640 1 --2- 172.21.15.17:0/3097504730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe17c0ffda0 0x7fe17c19d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.075+0000 7fe17a7fc640 1 -- 172.21.15.17:0/3097504730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe17c0ffda0 msgr2=0x7fe17c19d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.075+0000 7fe17a7fc640 1 --2- 172.21.15.17:0/3097504730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe17c0ffda0 0x7fe17c19d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.075+0000 7fe17a7fc640 1 -- 172.21.15.17:0/3097504730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174009900 con 0x7fe17c100750 2024-08-19T00:49:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.075+0000 7fe17a7fc640 1 --2- 172.21.15.17:0/3097504730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe17c100750 0x7fe17c19ded0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe16400c8a0 tx=0x7fe16400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.075+0000 7fe173fff640 1 -- 172.21.15.17:0/3097504730 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe164007b80 con 0x7fe17c100750 2024-08-19T00:49:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.075+0000 7fe173fff640 1 -- 172.21.15.17:0/3097504730 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe164007ce0 con 0x7fe17c100750 2024-08-19T00:49:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.075+0000 7fe1816a5640 1 -- 172.21.15.17:0/3097504730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c197c80 con 0x7fe17c100750 2024-08-19T00:49:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.075+0000 7fe173fff640 1 -- 172.21.15.17:0/3097504730 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe164018810 con 0x7fe17c100750 2024-08-19T00:49:18.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.075+0000 7fe1816a5640 1 -- 172.21.15.17:0/3097504730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c1981d0 con 0x7fe17c100750 2024-08-19T00:49:18.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.076+0000 7fe1816a5640 1 -- 172.21.15.17:0/3097504730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c101280 con 0x7fe17c100750 2024-08-19T00:49:18.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.077+0000 7fe173fff640 1 -- 172.21.15.17:0/3097504730 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fe16400f450 con 0x7fe17c100750 2024-08-19T00:49:18.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.077+0000 7fe173fff640 1 --2- 172.21.15.17:0/3097504730 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe16806cbc0 0x7fe16806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:18.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.077+0000 7fe17affd640 1 --2- 172.21.15.17:0/3097504730 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe16806cbc0 0x7fe16806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:18.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.077+0000 7fe173fff640 1 -- 172.21.15.17:0/3097504730 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe16408b330 con 0x7fe17c100750 2024-08-19T00:49:18.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.078+0000 7fe17affd640 1 --2- 172.21.15.17:0/3097504730 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe16806cbc0 0x7fe16806f080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe174000f80 tx=0x7fe174009360 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:18.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.082+0000 7fe173fff640 1 -- 172.21.15.17:0/3097504730 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe1640567e0 con 0x7fe17c100750 2024-08-19T00:49:18.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.256+0000 7fe1816a5640 1 -- 172.21.15.17:0/3097504730 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe17c100180 con 0x7fe17c100750 2024-08-19T00:49:18.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.257+0000 7fe173fff640 1 -- 172.21.15.17:0/3097504730 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7fe16408aaf0 con 0x7fe17c100750 2024-08-19T00:49:18.259 INFO:teuthology.orchestra.run.smithi017.stdout:# minimal ceph.conf for 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:49:18.259 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-08-19T00:49:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:49:18.259 INFO:teuthology.orchestra.run.smithi017.stdout: mon_host = [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-08-19T00:49:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.258+0000 7fe1816a5640 1 -- 172.21.15.17:0/3097504730 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe16806cbc0 msgr2=0x7fe16806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.258+0000 7fe1816a5640 1 --2- 172.21.15.17:0/3097504730 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe16806cbc0 0x7fe16806f080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe174000f80 tx=0x7fe174009360 comp rx=0 tx=0).stop 2024-08-19T00:49:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.258+0000 7fe1816a5640 1 -- 172.21.15.17:0/3097504730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe17c100750 msgr2=0x7fe17c19ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.258+0000 7fe1816a5640 1 --2- 172.21.15.17:0/3097504730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe17c100750 0x7fe17c19ded0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe16400c8a0 tx=0x7fe16400cd60 comp rx=0 tx=0).stop 2024-08-19T00:49:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.259+0000 7fe1816a5640 1 -- 172.21.15.17:0/3097504730 shutdown_connections 2024-08-19T00:49:18.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.259+0000 7fe1816a5640 1 --2- 172.21.15.17:0/3097504730 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe16806cbc0 0x7fe16806f080 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.259+0000 7fe1816a5640 1 --2- 172.21.15.17:0/3097504730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe17c100750 0x7fe17c19ded0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.259+0000 7fe1816a5640 1 --2- 172.21.15.17:0/3097504730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe17c0ffda0 0x7fe17c19d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.259+0000 7fe1816a5640 1 -- 172.21.15.17:0/3097504730 >> 172.21.15.17:0/3097504730 conn(0x7fe17c0fb840 msgr2=0x7fe17c0fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.259+0000 7fe1816a5640 1 -- 172.21.15.17:0/3097504730 shutdown_connections 2024-08-19T00:49:18.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:18.259+0000 7fe1816a5640 1 -- 172.21.15.17:0/3097504730 wait complete. 2024-08-19T00:49:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:18 smithi017 ceph-mon[16627]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:18 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:18 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:18 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.hfpawi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:49:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:18 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:49:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:18 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:18 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3097504730' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:18 smithi086 ceph-mon[24511]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:18 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:18 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:18 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.hfpawi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:49:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:18 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:49:18.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:18 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:18.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:18 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3097504730' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:19.062 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-19T00:49:19.062 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:49:19.063 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.conf 2024-08-19T00:49:19.091 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:49:19.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:49:19.156 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:49:19.156 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.conf 2024-08-19T00:49:19.190 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:49:19.191 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:49:19.261 INFO:tasks.cephadm:Deploying OSDs... 2024-08-19T00:49:19.262 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:49:19.262 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-08-19T00:49:19.278 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-19T00:49:19.278 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-08-19T00:49:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-19T00:49:19.333 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:49:19.333 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 674 Links: 1 2024-08-19T00:49:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:49:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:49:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-08-19 00:48:28.867844999 +0000 2024-08-19T00:49:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-08-19 00:43:30.876420600 +0000 2024-08-19T00:49:19.334 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-08-19 00:43:30.876420600 +0000 2024-08-19T00:49:19.334 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-08-19 00:43:30.876420600 +0000 2024-08-19T00:49:19.334 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-19T00:49:19.397 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-08-19T00:49:19.397 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-08-19T00:49:19.397 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.9746e-05 s, 5.1 MB/s 2024-08-19T00:49:19.398 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-19T00:49:19.455 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-08-19T00:49:19.510 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-19T00:49:19.511 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:49:19.511 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 693 Links: 1 2024-08-19T00:49:19.511 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:49:19.511 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:49:19.511 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-08-19 00:48:28.867844999 +0000 2024-08-19T00:49:19.511 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-08-19 00:43:31.190427840 +0000 2024-08-19T00:49:19.511 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-08-19 00:43:31.190427840 +0000 2024-08-19T00:49:19.511 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-08-19 00:43:31.190427840 +0000 2024-08-19T00:49:19.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-19T00:49:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-08-19T00:49:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-08-19T00:49:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 9.8125e-05 s, 5.2 MB/s 2024-08-19T00:49:19.575 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-19T00:49:19.631 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-08-19T00:49:19.686 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 710 Links: 1 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-08-19 00:48:28.867844999 +0000 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-08-19 00:43:31.516435357 +0000 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-08-19 00:43:31.516435357 +0000 2024-08-19T00:49:19.687 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-08-19 00:43:31.516435357 +0000 2024-08-19T00:49:19.687 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-19T00:49:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-08-19T00:49:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-08-19T00:49:19.750 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 8.7232e-05 s, 5.9 MB/s 2024-08-19T00:49:19.751 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-19T00:49:19.807 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-08-19T00:49:19.862 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-19T00:49:19.862 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:49:19.862 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 731 Links: 1 2024-08-19T00:49:19.862 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:49:19.862 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:49:19.862 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-08-19 00:48:28.868844988 +0000 2024-08-19T00:49:19.862 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-08-19 00:43:31.837442758 +0000 2024-08-19T00:49:19.862 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-08-19 00:43:31.837442758 +0000 2024-08-19T00:49:19.862 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-08-19 00:43:31.837442758 +0000 2024-08-19T00:49:19.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-19T00:49:19.922 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:19 smithi017 ceph-mon[16627]: Reconfiguring mgr.smithi017.hfpawi (unknown last config time)... 2024-08-19T00:49:19.922 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:19 smithi017 ceph-mon[16627]: Reconfiguring daemon mgr.smithi017.hfpawi on smithi017 2024-08-19T00:49:19.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-08-19T00:49:19.924 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-08-19T00:49:19.924 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000103389 s, 5.0 MB/s 2024-08-19T00:49:19.925 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-19T00:49:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:19 smithi086 ceph-mon[24511]: Reconfiguring mgr.smithi017.hfpawi (unknown last config time)... 2024-08-19T00:49:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:19 smithi086 ceph-mon[24511]: Reconfiguring daemon mgr.smithi017.hfpawi on smithi017 2024-08-19T00:49:19.982 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:49:19.982 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-08-19T00:49:20.001 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-19T00:49:20.001 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-08-19T00:49:20.060 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-19T00:49:20.060 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:49:20.060 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-19T00:49:20.060 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:49:20.060 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:49:20.060 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-08-19 00:49:05.669059144 +0000 2024-08-19T00:49:20.060 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-08-19 00:43:30.889859442 +0000 2024-08-19T00:49:20.060 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-08-19 00:43:30.889859442 +0000 2024-08-19T00:49:20.060 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-08-19 00:43:30.889859442 +0000 2024-08-19T00:49:20.061 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-19T00:49:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-08-19T00:49:20.128 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-08-19T00:49:20.129 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000194814 s, 2.6 MB/s 2024-08-19T00:49:20.130 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-19T00:49:20.189 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-08-19T00:49:20.246 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-19T00:49:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:49:20.247 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-08-19T00:49:20.247 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:49:20.247 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:49:20.247 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-08-19 00:49:05.669059144 +0000 2024-08-19T00:49:20.247 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-08-19 00:43:31.218854654 +0000 2024-08-19T00:49:20.247 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-08-19 00:43:31.218854654 +0000 2024-08-19T00:49:20.247 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-08-19 00:43:31.218854654 +0000 2024-08-19T00:49:20.248 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-19T00:49:20.313 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-08-19T00:49:20.313 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-08-19T00:49:20.313 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000210818 s, 2.4 MB/s 2024-08-19T00:49:20.315 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-19T00:49:20.374 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-08-19T00:49:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-19T00:49:20.432 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:49:20.432 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-08-19T00:49:20.432 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:49:20.432 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:49:20.433 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-08-19 00:49:05.670059123 +0000 2024-08-19T00:49:20.433 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-08-19 00:43:31.543849924 +0000 2024-08-19T00:49:20.433 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-08-19 00:43:31.543849924 +0000 2024-08-19T00:49:20.433 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-08-19 00:43:31.543849924 +0000 2024-08-19T00:49:20.433 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-19T00:49:20.498 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-08-19T00:49:20.498 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-08-19T00:49:20.498 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000292706 s, 1.7 MB/s 2024-08-19T00:49:20.499 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-19T00:49:20.556 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-08-19T00:49:20.613 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-19T00:49:20.614 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-19T00:49:20.614 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-08-19T00:49:20.614 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:49:20.614 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-08-19T00:49:20.614 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-08-19 00:49:05.670059123 +0000 2024-08-19T00:49:20.614 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-08-19 00:43:31.861845296 +0000 2024-08-19T00:49:20.614 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-08-19 00:43:31.861845296 +0000 2024-08-19T00:49:20.614 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-08-19 00:43:31.861845296 +0000 2024-08-19T00:49:20.615 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-19T00:49:20.676 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:20 smithi086 ceph-mon[24511]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:20.677 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:20.677 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:20.677 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:20 smithi086 ceph-mon[24511]: Reconfiguring ceph-exporter.smithi017 (monmap changed)... 2024-08-19T00:49:20.677 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T00:49:20.677 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:20.677 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:20 smithi086 ceph-mon[24511]: Reconfiguring daemon ceph-exporter.smithi017 on smithi017 2024-08-19T00:49:20.677 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:49:20.678 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-08-19T00:49:20.678 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-08-19T00:49:20.679 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000321743 s, 1.6 MB/s 2024-08-19T00:49:20.680 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-19T00:49:20.737 INFO:tasks.cephadm:Deploying osd.0 on smithi017 with /dev/vg_nvme/lv_4... 2024-08-19T00:49:20.737 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-19T00:49:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:20 smithi017 ceph-mon[16627]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:20 smithi017 ceph-mon[16627]: Reconfiguring ceph-exporter.smithi017 (monmap changed)... 2024-08-19T00:49:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T00:49:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:20 smithi017 ceph-mon[16627]: Reconfiguring daemon ceph-exporter.smithi017 on smithi017 2024-08-19T00:49:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:49:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:49:22.474 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:22.474 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:22.474 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:22 smithi017 ceph-mon[16627]: Reconfiguring crash.smithi017 (monmap changed)... 2024-08-19T00:49:22.475 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T00:49:22.475 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:22.475 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:22 smithi017 ceph-mon[16627]: Reconfiguring daemon crash.smithi017 on smithi017 2024-08-19T00:49:22.475 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:22 smithi017 ceph-mon[16627]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:22.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:22.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:22.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:22 smithi086 ceph-mon[24511]: Reconfiguring crash.smithi017 (monmap changed)... 2024-08-19T00:49:22.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T00:49:22.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:22.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:22 smithi086 ceph-mon[24511]: Reconfiguring daemon crash.smithi017 on smithi017 2024-08-19T00:49:22.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:22 smithi086 ceph-mon[24511]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:24.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:24 smithi017 ceph-mon[16627]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:24.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:24 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:24.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:24 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:24.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:24 smithi017 ceph-mon[16627]: Reconfiguring alertmanager.smithi017 (dependencies changed)... 2024-08-19T00:49:24.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:24 smithi017 ceph-mon[16627]: Reconfiguring daemon alertmanager.smithi017 on smithi017 2024-08-19T00:49:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:49:24.927 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_4 2024-08-19T00:49:24.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:24 smithi086 ceph-mon[24511]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:24.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:24 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:24.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:24 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:24.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:24 smithi086 ceph-mon[24511]: Reconfiguring alertmanager.smithi017 (dependencies changed)... 2024-08-19T00:49:24.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:24 smithi086 ceph-mon[24511]: Reconfiguring daemon alertmanager.smithi017 on smithi017 2024-08-19T00:49:26.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:26 smithi017 ceph-mon[16627]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:26 smithi086 ceph-mon[24511]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:27.440 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:49:28.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:28 smithi017 ceph-mon[16627]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:28 smithi086 ceph-mon[24511]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:29.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.963+0000 7fde6efd8640 1 -- 172.21.15.17:0/135238059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde680fea80 msgr2=0x7fde680fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.963+0000 7fde6efd8640 1 --2- 172.21.15.17:0/135238059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde680fea80 0x7fde680fee80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fde58009880 tx=0x7fde5802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:49:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.963+0000 7fde6efd8640 1 -- 172.21.15.17:0/135238059 shutdown_connections 2024-08-19T00:49:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.963+0000 7fde6efd8640 1 --2- 172.21.15.17:0/135238059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde680ffc80 0x7fde68100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.963+0000 7fde6efd8640 1 --2- 172.21.15.17:0/135238059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde680fea80 0x7fde680fee80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.963+0000 7fde6efd8640 1 -- 172.21.15.17:0/135238059 >> 172.21.15.17:0/135238059 conn(0x7fde680fa230 msgr2=0x7fde680fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.963+0000 7fde6efd8640 1 -- 172.21.15.17:0/135238059 shutdown_connections 2024-08-19T00:49:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.963+0000 7fde6efd8640 1 -- 172.21.15.17:0/135238059 wait complete. 2024-08-19T00:49:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.964+0000 7fde6efd8640 1 Processor -- start 2024-08-19T00:49:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.964+0000 7fde6efd8640 1 -- start start 2024-08-19T00:49:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.964+0000 7fde6efd8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde680fea80 0x7fde68102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:29.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.964+0000 7fde6efd8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde680ffc80 0x7fde68101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.964+0000 7fde6efd8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde681015a0 con 0x7fde680ffc80 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.964+0000 7fde6efd8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde68101710 con 0x7fde680fea80 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.964+0000 7fde67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde680ffc80 0x7fde68101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.964+0000 7fde67fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde680ffc80 0x7fde68101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33304/0 (socket says 172.21.15.17:33304) 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.964+0000 7fde67fff640 1 -- 172.21.15.17:0/626010416 learned_addr learned my addr 172.21.15.17:0/626010416 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.964+0000 7fde6cd74640 1 --2- 172.21.15.17:0/626010416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde680fea80 0x7fde68102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.965+0000 7fde67fff640 1 -- 172.21.15.17:0/626010416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde680fea80 msgr2=0x7fde68102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.965+0000 7fde67fff640 1 --2- 172.21.15.17:0/626010416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde680fea80 0x7fde68102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.965+0000 7fde67fff640 1 -- 172.21.15.17:0/626010416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde58009560 con 0x7fde680ffc80 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.965+0000 7fde67fff640 1 --2- 172.21.15.17:0/626010416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde680ffc80 0x7fde68101060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00d6f0 tx=0x7fde5c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.965+0000 7fde65ffb640 1 -- 172.21.15.17:0/626010416 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde5c009a30 con 0x7fde680ffc80 2024-08-19T00:49:29.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.965+0000 7fde65ffb640 1 -- 172.21.15.17:0/626010416 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde5c0054e0 con 0x7fde680ffc80 2024-08-19T00:49:29.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.965+0000 7fde6efd8640 1 -- 172.21.15.17:0/626010416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde681019f0 con 0x7fde680ffc80 2024-08-19T00:49:29.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.965+0000 7fde65ffb640 1 -- 172.21.15.17:0/626010416 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde5c010460 con 0x7fde680ffc80 2024-08-19T00:49:29.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.965+0000 7fde6efd8640 1 -- 172.21.15.17:0/626010416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6819d6d0 con 0x7fde680ffc80 2024-08-19T00:49:29.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.966+0000 7fde6efd8640 1 -- 172.21.15.17:0/626010416 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde680fee80 con 0x7fde680ffc80 2024-08-19T00:49:29.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.967+0000 7fde65ffb640 1 -- 172.21.15.17:0/626010416 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fde5c009b90 con 0x7fde680ffc80 2024-08-19T00:49:29.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.967+0000 7fde65ffb640 1 --2- 172.21.15.17:0/626010416 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fde5006cbc0 0x7fde5006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:49:29.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.967+0000 7fde65ffb640 1 -- 172.21.15.17:0/626010416 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fde5c08ab40 con 0x7fde680ffc80 2024-08-19T00:49:29.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.967+0000 7fde6cd74640 1 --2- 172.21.15.17:0/626010416 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fde5006cbc0 0x7fde5006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:49:29.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.967+0000 7fde6cd74640 1 --2- 172.21.15.17:0/626010416 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fde5006cbc0 0x7fde5006f080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fde58006010 tx=0x7fde580314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:49:29.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:29.971+0000 7fde65ffb640 1 -- 172.21.15.17:0/626010416 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fde5c056120 con 0x7fde680ffc80 2024-08-19T00:49:30.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:30.187+0000 7fde6efd8640 1 -- 172.21.15.17:0/626010416 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fde68068c10 con 0x7fde5006cbc0 2024-08-19T00:49:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:30 smithi086 ceph-mon[24511]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:30 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:49:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:30 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:49:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:30 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:30.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:30 smithi017 ceph-mon[16627]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:30.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:30 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:49:30.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:30 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:49:30.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:30 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:31.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:31 smithi017 ceph-mon[16627]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:49:31.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:31 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:31.875 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:31 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:31 smithi086 ceph-mon[24511]: from='client.14252 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:49:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:31 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:31 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:32 smithi017 ceph-mon[16627]: Reconfiguring grafana.smithi017 (dependencies changed)... 2024-08-19T00:49:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:32 smithi017 ceph-mon[16627]: Reconfiguring daemon grafana.smithi017 on smithi017 2024-08-19T00:49:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:32 smithi017 ceph-mon[16627]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:32 smithi086 ceph-mon[24511]: Reconfiguring grafana.smithi017 (dependencies changed)... 2024-08-19T00:49:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:32 smithi086 ceph-mon[24511]: Reconfiguring daemon grafana.smithi017 on smithi017 2024-08-19T00:49:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:32 smithi086 ceph-mon[24511]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:34.757 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:34 smithi017 ceph-mon[16627]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:34 smithi086 ceph-mon[24511]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:35.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:49:35.745 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:49:36.720 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:36 smithi017 ceph-mon[16627]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:36.720 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:36.720 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:36 smithi086 ceph-mon[24511]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:36 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:36 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:37.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:37 smithi017 ceph-mon[16627]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-08-19T00:49:37.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:37 smithi017 ceph-mon[16627]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-08-19T00:49:37.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:37 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3555339480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fee1cedd-6d2d-4326-b9aa-70cf773cdd6b"}]: dispatch 2024-08-19T00:49:37.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:37 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3555339480' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fee1cedd-6d2d-4326-b9aa-70cf773cdd6b"}]': finished 2024-08-19T00:49:37.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:37 smithi017 ceph-mon[16627]: osdmap e6: 1 total, 0 up, 1 in 2024-08-19T00:49:37.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:37 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:49:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:37 smithi086 ceph-mon[24511]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-08-19T00:49:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:37 smithi086 ceph-mon[24511]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-08-19T00:49:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:37 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3555339480' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fee1cedd-6d2d-4326-b9aa-70cf773cdd6b"}]: dispatch 2024-08-19T00:49:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:37 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3555339480' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fee1cedd-6d2d-4326-b9aa-70cf773cdd6b"}]': finished 2024-08-19T00:49:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:37 smithi086 ceph-mon[24511]: osdmap e6: 1 total, 0 up, 1 in 2024-08-19T00:49:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:37 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:49:38.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:38 smithi017 ceph-mon[16627]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:38.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:38 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1150013072' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:49:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:38 smithi086 ceph-mon[24511]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:38 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/1150013072' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:49:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:40 smithi017 ceph-mon[16627]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:40 smithi086 ceph-mon[24511]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:42.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:42 smithi017 ceph-mon[16627]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:42 smithi086 ceph-mon[24511]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:44.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:44 smithi017 ceph-mon[16627]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:44 smithi086 ceph-mon[24511]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:46.765 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:46 smithi017 ceph-mon[16627]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:46.941 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:46 smithi086 ceph-mon[24511]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:47.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:47 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:47.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:47 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:47.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:47 smithi017 ceph-mon[16627]: Reconfiguring ceph-exporter.smithi086 (monmap changed)... 2024-08-19T00:49:47.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:47 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T00:49:47.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:47 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:47.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:47 smithi017 ceph-mon[16627]: Reconfiguring daemon ceph-exporter.smithi086 on smithi086 2024-08-19T00:49:47.813 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:47 smithi017 ceph-mon[16627]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:47.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:47 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:47.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:47 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:47.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:47 smithi086 ceph-mon[24511]: Reconfiguring ceph-exporter.smithi086 (monmap changed)... 2024-08-19T00:49:47.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:47 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T00:49:47.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:47 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:47.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:47 smithi086 ceph-mon[24511]: Reconfiguring daemon ceph-exporter.smithi086 on smithi086 2024-08-19T00:49:47.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:47 smithi086 ceph-mon[24511]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:48 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-19T00:49:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:48 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:48 smithi017 ceph-mon[16627]: Deploying daemon osd.0 on smithi017 2024-08-19T00:49:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:48 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:48 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:48 smithi017 ceph-mon[16627]: Reconfiguring crash.smithi086 (monmap changed)... 2024-08-19T00:49:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:48 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi086", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T00:49:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:48 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:48 smithi017 ceph-mon[16627]: Reconfiguring daemon crash.smithi086 on smithi086 2024-08-19T00:49:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:48 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-19T00:49:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:48 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:48 smithi086 ceph-mon[24511]: Deploying daemon osd.0 on smithi017 2024-08-19T00:49:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:48 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:48 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:48 smithi086 ceph-mon[24511]: Reconfiguring crash.smithi086 (monmap changed)... 2024-08-19T00:49:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:48 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi086", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T00:49:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:48 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:48 smithi086 ceph-mon[24511]: Reconfiguring daemon crash.smithi086 on smithi086 2024-08-19T00:49:50.565 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:50.565 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:50.565 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:50 smithi017 ceph-mon[16627]: Reconfiguring mgr.smithi086.uthxct (monmap changed)... 2024-08-19T00:49:50.565 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi086.uthxct", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:49:50.565 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:49:50.565 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:50.565 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:50 smithi017 ceph-mon[16627]: Reconfiguring daemon mgr.smithi086.uthxct on smithi086 2024-08-19T00:49:50.565 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:50 smithi017 ceph-mon[16627]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:50 smithi086 ceph-mon[24511]: Reconfiguring mgr.smithi086.uthxct (monmap changed)... 2024-08-19T00:49:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi086.uthxct", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:49:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:49:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:50 smithi086 ceph-mon[24511]: Reconfiguring daemon mgr.smithi086.uthxct on smithi086 2024-08-19T00:49:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:50 smithi086 ceph-mon[24511]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:51.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:51 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:49:51.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:51 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:51.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:51 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:51.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:51 smithi086 ceph-mon[24511]: Reconfiguring mon.smithi086 (monmap changed)... 2024-08-19T00:49:51.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:51 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:49:51.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:51 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:49:51.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:51 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:51.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:51 smithi086 ceph-mon[24511]: Reconfiguring daemon mon.smithi086 on smithi086 2024-08-19T00:49:51.520 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:49:51.520 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:51.520 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:51.520 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:51 smithi017 ceph-mon[16627]: Reconfiguring mon.smithi086 (monmap changed)... 2024-08-19T00:49:51.520 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:49:51.520 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:49:51.520 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:49:51.520 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:51 smithi017 ceph-mon[16627]: Reconfiguring daemon mon.smithi086 on smithi086 2024-08-19T00:49:52.393 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:52.393 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:52.393 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:52.394 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-19T00:49:52.394 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi017:9093"}]: dispatch 2024-08-19T00:49:52.394 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:52.394 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-19T00:49:52.394 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi017:3000"}]: dispatch 2024-08-19T00:49:52.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:52.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:49:52.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017:9095"}]: dispatch 2024-08-19T00:49:52.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:52.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:49:52.564 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:52.565 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:52.565 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:52.565 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-19T00:49:52.565 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi017:9093"}]: dispatch 2024-08-19T00:49:52.566 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:52.566 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-19T00:49:52.566 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi017:3000"}]: dispatch 2024-08-19T00:49:52.566 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:52.566 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:49:52.567 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017:9095"}]: dispatch 2024-08-19T00:49:52.567 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:52.567 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:49:53.426 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:53 smithi086 ceph-mon[24511]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-19T00:49:53.426 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:53 smithi086 ceph-mon[24511]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi017:9093"}]: dispatch 2024-08-19T00:49:53.426 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:53 smithi086 ceph-mon[24511]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-19T00:49:53.426 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:53 smithi086 ceph-mon[24511]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi017:3000"}]: dispatch 2024-08-19T00:49:53.426 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:53 smithi086 ceph-mon[24511]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:49:53.426 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:53 smithi086 ceph-mon[24511]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017:9095"}]: dispatch 2024-08-19T00:49:53.426 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:53 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:53.427 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:53 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:53.568 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:53 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-19T00:49:53.568 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:53 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi017:9093"}]: dispatch 2024-08-19T00:49:53.568 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:53 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-19T00:49:53.568 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:53 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi017:3000"}]: dispatch 2024-08-19T00:49:53.568 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:53 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:49:53.568 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:53 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017:9095"}]: dispatch 2024-08-19T00:49:53.569 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:53 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:53.569 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:53 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:54.843 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:54 smithi017 ceph-mon[16627]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:54.843 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:54.844 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:54 smithi086 ceph-mon[24511]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:56.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.494+0000 7fde65ffb640 1 -- 172.21.15.17:0/626010416 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fde68068c10 con 0x7fde5006cbc0 2024-08-19T00:49:56.497 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 0 on host 'smithi017' 2024-08-19T00:49:56.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.496+0000 7fde6efd8640 1 -- 172.21.15.17:0/626010416 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fde5006cbc0 msgr2=0x7fde5006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:56.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.496+0000 7fde6efd8640 1 --2- 172.21.15.17:0/626010416 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fde5006cbc0 0x7fde5006f080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fde58006010 tx=0x7fde580314e0 comp rx=0 tx=0).stop 2024-08-19T00:49:56.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.496+0000 7fde6efd8640 1 -- 172.21.15.17:0/626010416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde680ffc80 msgr2=0x7fde68101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:49:56.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.496+0000 7fde6efd8640 1 --2- 172.21.15.17:0/626010416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde680ffc80 0x7fde68101060 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00d6f0 tx=0x7fde5c00dbb0 comp rx=0 tx=0).stop 2024-08-19T00:49:56.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.496+0000 7fde6efd8640 1 -- 172.21.15.17:0/626010416 shutdown_connections 2024-08-19T00:49:56.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.496+0000 7fde6efd8640 1 --2- 172.21.15.17:0/626010416 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fde5006cbc0 0x7fde5006f080 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:56.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.496+0000 7fde6efd8640 1 --2- 172.21.15.17:0/626010416 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde680ffc80 0x7fde68101060 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:56.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.496+0000 7fde6efd8640 1 --2- 172.21.15.17:0/626010416 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde680fea80 0x7fde68102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:49:56.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.496+0000 7fde6efd8640 1 -- 172.21.15.17:0/626010416 >> 172.21.15.17:0/626010416 conn(0x7fde680fa230 msgr2=0x7fde68068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:49:56.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.496+0000 7fde6efd8640 1 -- 172.21.15.17:0/626010416 shutdown_connections 2024-08-19T00:49:56.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:49:56.496+0000 7fde6efd8640 1 -- 172.21.15.17:0/626010416 wait complete. 2024-08-19T00:49:56.846 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:56 smithi017 ceph-mon[16627]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:56.846 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:56 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:56.846 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:56 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:56.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:56 smithi086 ceph-mon[24511]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:56.951 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:56 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:56.951 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:56 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:49:57.135 DEBUG:teuthology.orchestra.run.smithi017:osd.0> sudo journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.0.service 2024-08-19T00:49:57.155 INFO:tasks.cephadm:Deploying osd.1 on smithi017 with /dev/vg_nvme/lv_3... 2024-08-19T00:49:57.155 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-19T00:49:57.557 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:49:57.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:57 smithi017 ceph-mon[16627]: from='osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-19T00:49:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:57 smithi086 ceph-mon[24511]: from='osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-19T00:49:58.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:58 smithi017 ceph-mon[16627]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:58.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:58 smithi017 ceph-mon[16627]: from='osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-19T00:49:58.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:58 smithi017 ceph-mon[16627]: osdmap e7: 1 total, 0 up, 1 in 2024-08-19T00:49:58.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:58 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:49:58.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:58 smithi017 ceph-mon[16627]: from='osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T00:49:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:58 smithi086 ceph-mon[24511]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:49:58.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:58 smithi086 ceph-mon[24511]: from='osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-19T00:49:58.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:58 smithi086 ceph-mon[24511]: osdmap e7: 1 total, 0 up, 1 in 2024-08-19T00:49:58.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:58 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:49:58.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:58 smithi086 ceph-mon[24511]: from='osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T00:49:59.372 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 00:49:59 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0[34735]: 2024-08-19T00:49:59.252+0000 7fbce7e29640 -1 osd.0 0 waiting for initial osdmap 2024-08-19T00:49:59.373 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 00:49:59 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0[34735]: 2024-08-19T00:49:59.255+0000 7fbce045c640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:49:59.679 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:59 smithi017 ceph-mon[16627]: from='osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-08-19T00:49:59.679 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:59 smithi017 ceph-mon[16627]: osdmap e8: 1 total, 0 up, 1 in 2024-08-19T00:49:59.680 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:59 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:49:59.680 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:59 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:49:59.680 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:49:59 smithi017 ceph-mon[16627]: from='osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898]' entity='osd.0' 2024-08-19T00:49:59.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:59 smithi086 ceph-mon[24511]: from='osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-08-19T00:49:59.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:59 smithi086 ceph-mon[24511]: osdmap e8: 1 total, 0 up, 1 in 2024-08-19T00:49:59.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:59 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:49:59.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:59 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:49:59.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:49:59 smithi086 ceph-mon[24511]: from='osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898]' entity='osd.0' 2024-08-19T00:50:00.659 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:00 smithi017 ceph-mon[16627]: purged_snaps scrub starts 2024-08-19T00:50:00.660 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:00 smithi017 ceph-mon[16627]: purged_snaps scrub ok 2024-08-19T00:50:00.660 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:00 smithi017 ceph-mon[16627]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:50:00.660 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:00 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:50:00.660 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:00 smithi017 ceph-mon[16627]: overall HEALTH_OK 2024-08-19T00:50:00.660 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:00 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:00.660 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:00 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:00.660 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:00 smithi017 ceph-mon[16627]: osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898] boot 2024-08-19T00:50:00.660 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:00 smithi017 ceph-mon[16627]: osdmap e9: 1 total, 1 up, 1 in 2024-08-19T00:50:00.660 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:00 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:50:00.662 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:50:00.681 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_3 2024-08-19T00:50:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:00 smithi086 ceph-mon[24511]: purged_snaps scrub starts 2024-08-19T00:50:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:00 smithi086 ceph-mon[24511]: purged_snaps scrub ok 2024-08-19T00:50:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:00 smithi086 ceph-mon[24511]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-19T00:50:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:00 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:50:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:00 smithi086 ceph-mon[24511]: overall HEALTH_OK 2024-08-19T00:50:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:00 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:00 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:00 smithi086 ceph-mon[24511]: osd.0 [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898] boot 2024-08-19T00:50:00.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:00 smithi086 ceph-mon[24511]: osdmap e9: 1 total, 1 up, 1 in 2024-08-19T00:50:00.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:00 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:50:01.348 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:50:02.814 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:02 smithi017 ceph-mon[16627]: pgmap v40: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:02.814 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:02 smithi017 ceph-mon[16627]: osdmap e10: 1 total, 1 up, 1 in 2024-08-19T00:50:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:02 smithi086 ceph-mon[24511]: pgmap v40: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:02 smithi086 ceph-mon[24511]: osdmap e10: 1 total, 1 up, 1 in 2024-08-19T00:50:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.333+0000 7fb9ee7df640 1 -- 172.21.15.17:0/1385266783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e80ffb90 msgr2=0x7fb9e80fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:50:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.333+0000 7fb9ee7df640 1 --2- 172.21.15.17:0/1385266783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e80ffb90 0x7fb9e80fff90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8009880 tx=0x7fb9d802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:50:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.333+0000 7fb9ee7df640 1 -- 172.21.15.17:0/1385266783 shutdown_connections 2024-08-19T00:50:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.333+0000 7fb9ee7df640 1 --2- 172.21.15.17:0/1385266783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e8100d90 0x7fb9e8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.333+0000 7fb9ee7df640 1 --2- 172.21.15.17:0/1385266783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e80ffb90 0x7fb9e80fff90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.333+0000 7fb9ee7df640 1 -- 172.21.15.17:0/1385266783 >> 172.21.15.17:0/1385266783 conn(0x7fb9e80fb320 msgr2=0x7fb9e80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:50:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.333+0000 7fb9ee7df640 1 -- 172.21.15.17:0/1385266783 shutdown_connections 2024-08-19T00:50:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.333+0000 7fb9ee7df640 1 -- 172.21.15.17:0/1385266783 wait complete. 2024-08-19T00:50:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9ee7df640 1 Processor -- start 2024-08-19T00:50:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9ee7df640 1 -- start start 2024-08-19T00:50:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9ee7df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e80ffb90 0x7fb9e8074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9ee7df640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e8100d90 0x7fb9e80728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9ee7df640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8072de0 con 0x7fb9e80ffb90 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9ee7df640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e8072f50 con 0x7fb9e8100d90 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e80ffb90 0x7fb9e8074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e80ffb90 0x7fb9e8074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47072/0 (socket says 172.21.15.17:47072) 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9e7fff640 1 -- 172.21.15.17:0/2923069376 learned_addr learned my addr 172.21.15.17:0/2923069376 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9e77fe640 1 --2- 172.21.15.17:0/2923069376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e8100d90 0x7fb9e80728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9e7fff640 1 -- 172.21.15.17:0/2923069376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e8100d90 msgr2=0x7fb9e80728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9e7fff640 1 --2- 172.21.15.17:0/2923069376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e8100d90 0x7fb9e80728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.334+0000 7fb9e7fff640 1 -- 172.21.15.17:0/2923069376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d8009560 con 0x7fb9e80ffb90 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.335+0000 7fb9e7fff640 1 --2- 172.21.15.17:0/2923069376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e80ffb90 0x7fb9e8074250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802a9c0 tx=0x7fb9d80054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:50:03.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.335+0000 7fb9e57fa640 1 -- 172.21.15.17:0/2923069376 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9d8004aa0 con 0x7fb9e80ffb90 2024-08-19T00:50:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.335+0000 7fb9e57fa640 1 -- 172.21.15.17:0/2923069376 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9d8004c00 con 0x7fb9e80ffb90 2024-08-19T00:50:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.335+0000 7fb9ee7df640 1 -- 172.21.15.17:0/2923069376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e80731d0 con 0x7fb9e80ffb90 2024-08-19T00:50:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.335+0000 7fb9e57fa640 1 -- 172.21.15.17:0/2923069376 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9d8003a80 con 0x7fb9e80ffb90 2024-08-19T00:50:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.335+0000 7fb9ee7df640 1 -- 172.21.15.17:0/2923069376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e819d6a0 con 0x7fb9e80ffb90 2024-08-19T00:50:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.336+0000 7fb9ee7df640 1 -- 172.21.15.17:0/2923069376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e80fff90 con 0x7fb9e80ffb90 2024-08-19T00:50:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.336+0000 7fb9e57fa640 1 -- 172.21.15.17:0/2923069376 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7fb9d8003d40 con 0x7fb9e80ffb90 2024-08-19T00:50:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.337+0000 7fb9e57fa640 1 --2- 172.21.15.17:0/2923069376 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb9d006cc20 0x7fb9d006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:50:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.337+0000 7fb9e77fe640 1 --2- 172.21.15.17:0/2923069376 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb9d006cc20 0x7fb9d006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:50:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.337+0000 7fb9e57fa640 1 -- 172.21.15.17:0/2923069376 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7fb9d80ac620 con 0x7fb9e80ffb90 2024-08-19T00:50:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.337+0000 7fb9e77fe640 1 --2- 172.21.15.17:0/2923069376 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb9d006cc20 0x7fb9d006f0e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc005fd0 tx=0x7fb9dc005850 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:50:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.341+0000 7fb9e57fa640 1 -- 172.21.15.17:0/2923069376 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb9d80777d0 con 0x7fb9e80ffb90 2024-08-19T00:50:03.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:03.525+0000 7fb9ee7df640 1 -- 172.21.15.17:0/2923069376 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9e80608f0 con 0x7fb9d006cc20 2024-08-19T00:50:03.908 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:03 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:50:03.908 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:03 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:50:03.908 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:03 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:03 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:50:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:03 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:50:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:03 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:04.918 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:04 smithi017 ceph-mon[16627]: pgmap v42: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:04.918 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:04 smithi017 ceph-mon[16627]: from='client.14270 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:50:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:04 smithi086 ceph-mon[24511]: pgmap v42: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:04 smithi086 ceph-mon[24511]: from='client.14270 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:50:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: Detected new or changed devices on smithi017 2024-08-19T00:50:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: Adjusting osd_memory_target on smithi017 to 11844M 2024-08-19T00:50:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:50:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:50:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: pgmap v43: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:06 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:50:06.345 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: Detected new or changed devices on smithi017 2024-08-19T00:50:06.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:06.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:06.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:06.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: Adjusting osd_memory_target on smithi017 to 11844M 2024-08-19T00:50:06.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:06.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:06.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:50:06.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:06.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:50:06.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: pgmap v43: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:06.346 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:06 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:50:07.349 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:07 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3375718715' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6e23eb70-4061-4131-9484-7804d3a81f80"}]: dispatch 2024-08-19T00:50:07.350 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:07 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3375718715' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6e23eb70-4061-4131-9484-7804d3a81f80"}]': finished 2024-08-19T00:50:07.350 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:07 smithi017 ceph-mon[16627]: osdmap e11: 2 total, 1 up, 2 in 2024-08-19T00:50:07.350 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:07 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:07.350 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:07 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:07.350 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:07 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:07 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3375718715' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6e23eb70-4061-4131-9484-7804d3a81f80"}]: dispatch 2024-08-19T00:50:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:07 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3375718715' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6e23eb70-4061-4131-9484-7804d3a81f80"}]': finished 2024-08-19T00:50:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:07 smithi086 ceph-mon[24511]: osdmap e11: 2 total, 1 up, 2 in 2024-08-19T00:50:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:07 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:07 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:07 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:08 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/179947306' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:50:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:08 smithi017 ceph-mon[16627]: pgmap v45: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:08.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:08 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/179947306' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:50:08.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:08 smithi086 ceph-mon[24511]: pgmap v45: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:10.738 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:10 smithi017 ceph-mon[16627]: pgmap v46: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:10.739 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:10 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:10.739 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:10 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:10.739 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:10 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:10.739 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:10 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:50:10.739 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:10 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:10 smithi086 ceph-mon[24511]: pgmap v46: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:10 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:10 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:10 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:10 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:50:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:10 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:12.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:12 smithi017 ceph-mon[16627]: pgmap v47: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:12 smithi086 ceph-mon[24511]: pgmap v47: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:13.855 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:13 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-19T00:50:13.855 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:13 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:13.926 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:13 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-19T00:50:13.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:13 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:14.811 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:14 smithi017 ceph-mon[16627]: Deploying daemon osd.1 on smithi017 2024-08-19T00:50:14.811 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:14 smithi017 ceph-mon[16627]: pgmap v48: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:14.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:14 smithi086 ceph-mon[24511]: Deploying daemon osd.1 on smithi017 2024-08-19T00:50:14.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:14 smithi086 ceph-mon[24511]: pgmap v48: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:16.895 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:16 smithi017 ceph-mon[16627]: pgmap v49: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:16 smithi086 ceph-mon[24511]: pgmap v49: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:18.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:18 smithi017 ceph-mon[16627]: pgmap v50: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:18.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:18 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:50:18.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:18 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:18.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:18 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:18.916 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:18 smithi086 ceph-mon[24511]: pgmap v50: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:18.916 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:18 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:50:18.916 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:18 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:18.916 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:18 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:20.791 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:20 smithi017 ceph-mon[16627]: pgmap v51: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:20.791 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:20.792 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:20.792 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:50:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:20 smithi086 ceph-mon[24511]: pgmap v51: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:50:21.885 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 1 on host 'smithi017' 2024-08-19T00:50:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.883+0000 7fb9e57fa640 1 -- 172.21.15.17:0/2923069376 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb9e80608f0 con 0x7fb9d006cc20 2024-08-19T00:50:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.886+0000 7fb9ee7df640 1 -- 172.21.15.17:0/2923069376 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb9d006cc20 msgr2=0x7fb9d006f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:50:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.886+0000 7fb9ee7df640 1 --2- 172.21.15.17:0/2923069376 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb9d006cc20 0x7fb9d006f0e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc005fd0 tx=0x7fb9dc005850 comp rx=0 tx=0).stop 2024-08-19T00:50:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.886+0000 7fb9ee7df640 1 -- 172.21.15.17:0/2923069376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e80ffb90 msgr2=0x7fb9e8074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:50:21.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.886+0000 7fb9ee7df640 1 --2- 172.21.15.17:0/2923069376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e80ffb90 0x7fb9e8074250 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb9d802a9c0 tx=0x7fb9d80054f0 comp rx=0 tx=0).stop 2024-08-19T00:50:21.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.887+0000 7fb9ee7df640 1 -- 172.21.15.17:0/2923069376 shutdown_connections 2024-08-19T00:50:21.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.887+0000 7fb9ee7df640 1 --2- 172.21.15.17:0/2923069376 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb9d006cc20 0x7fb9d006f0e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:21.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.887+0000 7fb9ee7df640 1 --2- 172.21.15.17:0/2923069376 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9e8100d90 0x7fb9e80728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:21.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.887+0000 7fb9ee7df640 1 --2- 172.21.15.17:0/2923069376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9e80ffb90 0x7fb9e8074250 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:21.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.887+0000 7fb9ee7df640 1 -- 172.21.15.17:0/2923069376 >> 172.21.15.17:0/2923069376 conn(0x7fb9e80fb320 msgr2=0x7fb9e8104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:50:21.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.887+0000 7fb9ee7df640 1 -- 172.21.15.17:0/2923069376 shutdown_connections 2024-08-19T00:50:21.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:21.887+0000 7fb9ee7df640 1 -- 172.21.15.17:0/2923069376 wait complete. 2024-08-19T00:50:22.486 DEBUG:teuthology.orchestra.run.smithi017:osd.1> sudo journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.1.service 2024-08-19T00:50:22.489 INFO:tasks.cephadm:Deploying osd.2 on smithi017 with /dev/vg_nvme/lv_2... 2024-08-19T00:50:22.490 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-19T00:50:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:50:22.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:22 smithi017 ceph-mon[16627]: pgmap v52: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:22.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:22.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:22.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:22 smithi017 ceph-mon[16627]: from='osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-19T00:50:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:22 smithi086 ceph-mon[24511]: pgmap v52: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:22 smithi086 ceph-mon[24511]: from='osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-19T00:50:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:23 smithi017 ceph-mon[16627]: from='osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-19T00:50:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:23 smithi017 ceph-mon[16627]: osdmap e12: 2 total, 1 up, 2 in 2024-08-19T00:50:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:23 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:23 smithi017 ceph-mon[16627]: from='osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T00:50:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:23 smithi017 ceph-mon[16627]: pgmap v54: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:24.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:23 smithi086 ceph-mon[24511]: from='osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-19T00:50:24.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:23 smithi086 ceph-mon[24511]: osdmap e12: 2 total, 1 up, 2 in 2024-08-19T00:50:24.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:23 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:24.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:23 smithi086 ceph-mon[24511]: from='osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T00:50:24.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:23 smithi086 ceph-mon[24511]: pgmap v54: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:24.892 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 00:50:24 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1[41984]: 2024-08-19T00:50:24.597+0000 7f4edb98c640 -1 osd.1 0 waiting for initial osdmap 2024-08-19T00:50:24.892 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 00:50:24 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1[41984]: 2024-08-19T00:50:24.604+0000 7f4ed3fbf640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:50:25.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:24 smithi017 ceph-mon[16627]: from='osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-08-19T00:50:25.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:24 smithi017 ceph-mon[16627]: osdmap e13: 2 total, 1 up, 2 in 2024-08-19T00:50:25.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:24 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:25.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:24 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:25.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:24 smithi017 ceph-mon[16627]: from='osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054]' entity='osd.1' 2024-08-19T00:50:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:24 smithi086 ceph-mon[24511]: from='osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-08-19T00:50:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:24 smithi086 ceph-mon[24511]: osdmap e13: 2 total, 1 up, 2 in 2024-08-19T00:50:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:24 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:24 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:24 smithi086 ceph-mon[24511]: from='osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054]' entity='osd.1' 2024-08-19T00:50:26.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:25 smithi017 ceph-mon[16627]: purged_snaps scrub starts 2024-08-19T00:50:26.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:25 smithi017 ceph-mon[16627]: purged_snaps scrub ok 2024-08-19T00:50:26.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:25 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:26.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:25 smithi017 ceph-mon[16627]: pgmap v56: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:26.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:25 smithi017 ceph-mon[16627]: osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054] boot 2024-08-19T00:50:26.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:25 smithi017 ceph-mon[16627]: osdmap e14: 2 total, 2 up, 2 in 2024-08-19T00:50:26.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:25 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:25 smithi086 ceph-mon[24511]: purged_snaps scrub starts 2024-08-19T00:50:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:25 smithi086 ceph-mon[24511]: purged_snaps scrub ok 2024-08-19T00:50:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:25 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:25 smithi086 ceph-mon[24511]: pgmap v56: 0 pgs: ; 0 B data, 34 MiB used, 89 GiB / 89 GiB avail 2024-08-19T00:50:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:25 smithi086 ceph-mon[24511]: osd.1 [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054] boot 2024-08-19T00:50:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:25 smithi086 ceph-mon[24511]: osdmap e14: 2 total, 2 up, 2 in 2024-08-19T00:50:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:25 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:50:26.844 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:50:26.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi017:vg_nvme/lv_2 2024-08-19T00:50:27.080 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:50:28.130 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:27 smithi017 ceph-mon[16627]: osdmap e15: 2 total, 2 up, 2 in 2024-08-19T00:50:28.130 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:27 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:28.130 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:27 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:28.130 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:27 smithi017 ceph-mon[16627]: pgmap v59: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:28.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:27 smithi086 ceph-mon[24511]: osdmap e15: 2 total, 2 up, 2 in 2024-08-19T00:50:28.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:27 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:28.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:27 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:28.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:27 smithi086 ceph-mon[24511]: pgmap v59: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.592+0000 7f7623d03640 1 -- 172.21.15.17:0/2662932882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f761c0fe210 msgr2=0x7f761c0fe610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:50:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.592+0000 7f7623d03640 1 --2- 172.21.15.17:0/2662932882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f761c0fe210 0x7f761c0fe610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f760c009c20 tx=0x7f760c02a970 comp rx=0 tx=0).stop 2024-08-19T00:50:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 -- 172.21.15.17:0/2662932882 shutdown_connections 2024-08-19T00:50:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 --2- 172.21.15.17:0/2662932882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f761c0ff410 0x7f761c0ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 --2- 172.21.15.17:0/2662932882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f761c0fe210 0x7f761c0fe610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 -- 172.21.15.17:0/2662932882 >> 172.21.15.17:0/2662932882 conn(0x7f761c0f99c0 msgr2=0x7f761c0fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 -- 172.21.15.17:0/2662932882 shutdown_connections 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 -- 172.21.15.17:0/2662932882 wait complete. 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 Processor -- start 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 -- start start 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f761c0fe210 0x7f761c193410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f761c0ff410 0x7f761c193950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c193f20 con 0x7f761c0ff410 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.593+0000 7f7623d03640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c194090 con 0x7f761c0fe210 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f762129e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f761c0ff410 0x7f761c193950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f762129e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f761c0ff410 0x7f761c193950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48638/0 (socket says 172.21.15.17:48638) 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f762129e640 1 -- 172.21.15.17:0/2095299481 learned_addr learned my addr 172.21.15.17:0/2095299481 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:50:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f762129e640 1 -- 172.21.15.17:0/2095299481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f761c0fe210 msgr2=0x7f761c193410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f762129e640 1 --2- 172.21.15.17:0/2095299481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f761c0fe210 0x7f761c193410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f762129e640 1 -- 172.21.15.17:0/2095299481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c009900 con 0x7f761c0ff410 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f762129e640 1 --2- 172.21.15.17:0/2095299481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f761c0ff410 0x7f761c193950 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f761000d720 tx=0x7f761000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f761affd640 1 -- 172.21.15.17:0/2095299481 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76100051f0 con 0x7f761c0ff410 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f7623d03640 1 -- 172.21.15.17:0/2095299481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761c198b30 con 0x7f761c0ff410 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f761affd640 1 -- 172.21.15.17:0/2095299481 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7610009ce0 con 0x7f761c0ff410 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f761affd640 1 -- 172.21.15.17:0/2095299481 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7610010460 con 0x7f761c0ff410 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.594+0000 7f7623d03640 1 -- 172.21.15.17:0/2095299481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761c199100 con 0x7f761c0ff410 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.595+0000 7f7623d03640 1 -- 172.21.15.17:0/2095299481 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761c106590 con 0x7f761c0ff410 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.596+0000 7f761affd640 1 -- 172.21.15.17:0/2095299481 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7f7610005350 con 0x7f761c0ff410 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.596+0000 7f761affd640 1 --2- 172.21.15.17:0/2095299481 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f760406ede0 0x7f76040712a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.596+0000 7f761affd640 1 -- 172.21.15.17:0/2095299481 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f761008b0b0 con 0x7f761c0ff410 2024-08-19T00:50:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.596+0000 7f7621a9f640 1 --2- 172.21.15.17:0/2095299481 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f760406ede0 0x7f76040712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:50:29.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.597+0000 7f7621a9f640 1 --2- 172.21.15.17:0/2095299481 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f760406ede0 0x7f76040712a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f760c006010 tx=0x7f760c004a80 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:50:29.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.601+0000 7f761affd640 1 -- 172.21.15.17:0/2095299481 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f7610056150 con 0x7f761c0ff410 2024-08-19T00:50:29.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:29.785+0000 7f7623d03640 1 -- 172.21.15.17:0/2095299481 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f761c1992f0 con 0x7f760406ede0 2024-08-19T00:50:30.626 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:30 smithi017 ceph-mon[16627]: pgmap v60: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:30.626 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:30 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:50:30.627 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:30 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:50:30.627 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:30 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:30 smithi086 ceph-mon[24511]: pgmap v60: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:30 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:50:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:30 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:50:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:30 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:31.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:31 smithi017 ceph-mon[16627]: from='client.14288 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:50:31.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:31 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:31.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:31 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:31.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:31 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:31.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:31 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:31.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:31 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:31.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:31 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:31.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:31 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:50:31.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:31 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:31.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:31 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:50:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:31 smithi086 ceph-mon[24511]: from='client.14288 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi017:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:50:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:31 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:31 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:31 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:31 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:31 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:31.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:31 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:31.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:31 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:50:31.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:31 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:31.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:31 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:50:32.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:32 smithi017 ceph-mon[16627]: Detected new or changed devices on smithi017 2024-08-19T00:50:32.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:32 smithi017 ceph-mon[16627]: Adjusting osd_memory_target on smithi017 to 5922M 2024-08-19T00:50:32.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:32 smithi017 ceph-mon[16627]: pgmap v61: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:32.798 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:32 smithi086 ceph-mon[24511]: Detected new or changed devices on smithi017 2024-08-19T00:50:32.798 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:32 smithi086 ceph-mon[24511]: Adjusting osd_memory_target on smithi017 to 5922M 2024-08-19T00:50:32.799 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:32 smithi086 ceph-mon[24511]: pgmap v61: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:33.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:33 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/22788974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1f317a9-f60e-4cac-b05d-0c6dcc872166"}]: dispatch 2024-08-19T00:50:33.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:33 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/22788974' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1f317a9-f60e-4cac-b05d-0c6dcc872166"}]': finished 2024-08-19T00:50:33.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:33 smithi017 ceph-mon[16627]: osdmap e16: 3 total, 2 up, 3 in 2024-08-19T00:50:33.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:33 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:33.809 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:33 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:33.809 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:33 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:33.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:33 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/22788974' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b1f317a9-f60e-4cac-b05d-0c6dcc872166"}]: dispatch 2024-08-19T00:50:33.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:33 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/22788974' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b1f317a9-f60e-4cac-b05d-0c6dcc872166"}]': finished 2024-08-19T00:50:33.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:33 smithi086 ceph-mon[24511]: osdmap e16: 3 total, 2 up, 3 in 2024-08-19T00:50:33.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:33 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:33.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:33 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:33.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:33 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:34.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:34 smithi017 ceph-mon[16627]: pgmap v63: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:34.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:34 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3833191131' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:50:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:34 smithi086 ceph-mon[24511]: pgmap v63: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:34 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3833191131' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:50:35.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:50:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:50:36.565 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:36 smithi017 ceph-mon[16627]: pgmap v64: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:36.565 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:36.566 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:36.566 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:36.566 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:50:36.566 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:36 smithi086 ceph-mon[24511]: pgmap v64: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:36 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:36 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:36 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:36 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:50:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:36 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:38.753 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:38 smithi017 ceph-mon[16627]: pgmap v65: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:38 smithi086 ceph-mon[24511]: pgmap v65: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:40.680 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:40 smithi017 ceph-mon[16627]: pgmap v66: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:40.680 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:40 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-19T00:50:40.680 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:40 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:40 smithi086 ceph-mon[24511]: pgmap v66: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:40 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-19T00:50:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:40 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:41.820 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:41 smithi017 ceph-mon[16627]: Deploying daemon osd.2 on smithi017 2024-08-19T00:50:41.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:41 smithi086 ceph-mon[24511]: Deploying daemon osd.2 on smithi017 2024-08-19T00:50:42.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:42 smithi086 ceph-mon[24511]: pgmap v67: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:42.864 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:42 smithi017 ceph-mon[16627]: pgmap v67: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:44.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:44 smithi017 ceph-mon[16627]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:44 smithi086 ceph-mon[24511]: pgmap v68: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:45.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:45 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:50:45.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:45 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:45.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:45 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:45.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:45 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:50:45.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:45 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:45.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:45 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:46.613 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:46 smithi017 ceph-mon[16627]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:46 smithi086 ceph-mon[24511]: pgmap v69: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:48.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.171+0000 7f761affd640 1 -- 172.21.15.17:0/2095299481 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f761c1992f0 con 0x7f760406ede0 2024-08-19T00:50:48.174 INFO:teuthology.orchestra.run.smithi017.stdout:Created osd(s) 2 on host 'smithi017' 2024-08-19T00:50:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.174+0000 7f7623d03640 1 -- 172.21.15.17:0/2095299481 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f760406ede0 msgr2=0x7f76040712a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:50:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.174+0000 7f7623d03640 1 --2- 172.21.15.17:0/2095299481 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f760406ede0 0x7f76040712a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f760c006010 tx=0x7f760c004a80 comp rx=0 tx=0).stop 2024-08-19T00:50:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.174+0000 7f7623d03640 1 -- 172.21.15.17:0/2095299481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f761c0ff410 msgr2=0x7f761c193950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:50:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.174+0000 7f7623d03640 1 --2- 172.21.15.17:0/2095299481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f761c0ff410 0x7f761c193950 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f761000d720 tx=0x7f761000dbe0 comp rx=0 tx=0).stop 2024-08-19T00:50:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.174+0000 7f7623d03640 1 -- 172.21.15.17:0/2095299481 shutdown_connections 2024-08-19T00:50:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.174+0000 7f7623d03640 1 --2- 172.21.15.17:0/2095299481 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f760406ede0 0x7f76040712a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.174+0000 7f7623d03640 1 --2- 172.21.15.17:0/2095299481 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f761c0ff410 0x7f761c193950 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.174+0000 7f7623d03640 1 --2- 172.21.15.17:0/2095299481 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f761c0fe210 0x7f761c193410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.174+0000 7f7623d03640 1 -- 172.21.15.17:0/2095299481 >> 172.21.15.17:0/2095299481 conn(0x7f761c0f99c0 msgr2=0x7f761c102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:50:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.174+0000 7f7623d03640 1 -- 172.21.15.17:0/2095299481 shutdown_connections 2024-08-19T00:50:48.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:50:48.174+0000 7f7623d03640 1 -- 172.21.15.17:0/2095299481 wait complete. 2024-08-19T00:50:48.749 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:48 smithi017 ceph-mon[16627]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:48.749 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:48 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:48.749 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:48 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:48.768 DEBUG:teuthology.orchestra.run.smithi017:osd.2> sudo journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.2.service 2024-08-19T00:50:48.770 INFO:tasks.cephadm:Deploying osd.3 on smithi086 with /dev/vg_nvme/lv_4... 2024-08-19T00:50:48.770 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-19T00:50:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:48 smithi086 ceph-mon[24511]: pgmap v70: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:48 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:48.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:48 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:48.983 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T00:50:49.075 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 00:50:48 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[49538]: 2024-08-19T00:50:48.919+0000 7f90e09a8640 -1 osd.2 0 log_to_monitors true 2024-08-19T00:50:49.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:49 smithi086 ceph-mon[24511]: from='osd.2 [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-19T00:50:49.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:49 smithi017 ceph-mon[16627]: from='osd.2 [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-19T00:50:50.933 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 00:50:50 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[49538]: 2024-08-19T00:50:50.583+0000 7f90dc106640 -1 osd.2 0 waiting for initial osdmap 2024-08-19T00:50:50.933 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 00:50:50 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[49538]: 2024-08-19T00:50:50.588+0000 7f90d8741640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:50:50.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:50 smithi017 ceph-mon[16627]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:50.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:50 smithi017 ceph-mon[16627]: from='osd.2 [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-19T00:50:50.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:50 smithi017 ceph-mon[16627]: osdmap e17: 3 total, 2 up, 3 in 2024-08-19T00:50:50.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:50.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:50 smithi017 ceph-mon[16627]: from='osd.2 [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T00:50:50.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:50:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:50 smithi086 ceph-mon[24511]: pgmap v71: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:50 smithi086 ceph-mon[24511]: from='osd.2 [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-19T00:50:50.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:50 smithi086 ceph-mon[24511]: osdmap e17: 3 total, 2 up, 3 in 2024-08-19T00:50:50.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:50.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:50 smithi086 ceph-mon[24511]: from='osd.2 [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T00:50:50.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:50:51.306 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:50:51.325 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_4 2024-08-19T00:50:51.523 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T00:50:51.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:51 smithi017 ceph-mon[16627]: from='osd.2 [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-08-19T00:50:51.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:51 smithi017 ceph-mon[16627]: osdmap e18: 3 total, 2 up, 3 in 2024-08-19T00:50:51.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:51.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:51 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:51.855 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:51 smithi086 ceph-mon[24511]: from='osd.2 [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]': finished 2024-08-19T00:50:51.855 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:51 smithi086 ceph-mon[24511]: osdmap e18: 3 total, 2 up, 3 in 2024-08-19T00:50:51.855 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:51 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:51.855 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:51 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:52 smithi017 ceph-mon[16627]: purged_snaps scrub starts 2024-08-19T00:50:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:52 smithi017 ceph-mon[16627]: purged_snaps scrub ok 2024-08-19T00:50:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:52 smithi017 ceph-mon[16627]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:52 smithi017 ceph-mon[16627]: osd.2 [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649] boot 2024-08-19T00:50:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:52 smithi017 ceph-mon[16627]: osdmap e19: 3 total, 3 up, 3 in 2024-08-19T00:50:52.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:52.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:52.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:52.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:52 smithi086 ceph-mon[24511]: purged_snaps scrub starts 2024-08-19T00:50:52.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:52 smithi086 ceph-mon[24511]: purged_snaps scrub ok 2024-08-19T00:50:52.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:52 smithi086 ceph-mon[24511]: pgmap v74: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-08-19T00:50:52.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:52.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:52 smithi086 ceph-mon[24511]: osd.2 [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649] boot 2024-08-19T00:50:52.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:52 smithi086 ceph-mon[24511]: osdmap e19: 3 total, 3 up, 3 in 2024-08-19T00:50:52.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:50:52.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:52.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:52.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.931+0000 7eff6bbee640 1 -- 172.21.15.86:0/299493130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff640feaf0 msgr2=0x7eff640feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:50:52.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.931+0000 7eff6bbee640 1 --2- 172.21.15.86:0/299493130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff640feaf0 0x7eff640feef0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7eff60009880 tx=0x7eff6002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:50:52.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.931+0000 7eff6bbee640 1 -- 172.21.15.86:0/299493130 shutdown_connections 2024-08-19T00:50:52.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.931+0000 7eff6bbee640 1 --2- 172.21.15.86:0/299493130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff640ffcf0 0x7eff64100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:52.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.931+0000 7eff6bbee640 1 --2- 172.21.15.86:0/299493130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff640feaf0 0x7eff640feef0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:52.953 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.931+0000 7eff6bbee640 1 -- 172.21.15.86:0/299493130 >> 172.21.15.86:0/299493130 conn(0x7eff640fa280 msgr2=0x7eff640fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:50:52.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.931+0000 7eff6bbee640 1 -- 172.21.15.86:0/299493130 shutdown_connections 2024-08-19T00:50:52.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.931+0000 7eff6bbee640 1 -- 172.21.15.86:0/299493130 wait complete. 2024-08-19T00:50:52.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff6bbee640 1 Processor -- start 2024-08-19T00:50:52.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff6bbee640 1 -- start start 2024-08-19T00:50:52.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff6bbee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff640feaf0 0x7eff640687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:50:52.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff6bbee640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff640ffcf0 0x7eff6419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:50:52.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff6bbee640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6419a9b0 con 0x7eff640feaf0 2024-08-19T00:50:52.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff6bbee640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6419ab20 con 0x7eff640ffcf0 2024-08-19T00:50:52.954 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff69189640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff640ffcf0 0x7eff6419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:50:52.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff69189640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff640ffcf0 0x7eff6419a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:44884/0 (socket says 172.21.15.86:44884) 2024-08-19T00:50:52.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff69189640 1 -- 172.21.15.86:0/452737578 learned_addr learned my addr 172.21.15.86:0/452737578 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:50:52.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff6998a640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff640feaf0 0x7eff640687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:50:52.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff69189640 1 -- 172.21.15.86:0/452737578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff640feaf0 msgr2=0x7eff640687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:50:52.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff69189640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff640feaf0 0x7eff640687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:50:52.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff69189640 1 -- 172.21.15.86:0/452737578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff60009560 con 0x7eff640ffcf0 2024-08-19T00:50:52.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff6998a640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff640feaf0 0x7eff640687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:50:52.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.932+0000 7eff69189640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff640ffcf0 0x7eff6419a3e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7eff5400c8f0 tx=0x7eff5400cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:50:52.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.933+0000 7eff5affd640 1 -- 172.21.15.86:0/452737578 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff54007b80 con 0x7eff640ffcf0 2024-08-19T00:50:52.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.933+0000 7eff6bbee640 1 -- 172.21.15.86:0/452737578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6419ae00 con 0x7eff640ffcf0 2024-08-19T00:50:52.955 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.933+0000 7eff5affd640 1 -- 172.21.15.86:0/452737578 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff540054e0 con 0x7eff640ffcf0 2024-08-19T00:50:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.933+0000 7eff5affd640 1 -- 172.21.15.86:0/452737578 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff5400f450 con 0x7eff640ffcf0 2024-08-19T00:50:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.933+0000 7eff6bbee640 1 -- 172.21.15.86:0/452737578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6419b320 con 0x7eff640ffcf0 2024-08-19T00:50:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.934+0000 7eff6bbee640 1 -- 172.21.15.86:0/452737578 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff640feef0 con 0x7eff640ffcf0 2024-08-19T00:50:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.934+0000 7eff5affd640 1 -- 172.21.15.86:0/452737578 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 18) v1 ==== 90794+0+0 (secure 0 0 0) 0x7eff54004f60 con 0x7eff640ffcf0 2024-08-19T00:50:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.935+0000 7eff5affd640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7eff5006cbc0 0x7eff5006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:50:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.935+0000 7eff5affd640 1 -- 172.21.15.86:0/452737578 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2846+0+0 (secure 0 0 0) 0x7eff5408b520 con 0x7eff640ffcf0 2024-08-19T00:50:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.935+0000 7eff6998a640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7eff5006cbc0 0x7eff5006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:50:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.936+0000 7eff6998a640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7eff5006cbc0 0x7eff5006f080 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff64068d10 tx=0x7eff60004040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:50:52.956 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:52.939+0000 7eff5affd640 1 -- 172.21.15.86:0/452737578 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7eff54056410 con 0x7eff640ffcf0 2024-08-19T00:50:53.115 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:53.112+0000 7eff6bbee640 1 -- 172.21.15.86:0/452737578 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7eff6402c540 con 0x7eff5006cbc0 2024-08-19T00:50:53.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:53 smithi017 ceph-mon[16627]: osdmap e20: 3 total, 3 up, 3 in 2024-08-19T00:50:53.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:53 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:50:53.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:53 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:50:53.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:53 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:53 smithi086 ceph-mon[24511]: osdmap e20: 3 total, 3 up, 3 in 2024-08-19T00:50:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:53 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:50:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:53 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:50:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:53 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:54.894 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:50:54.895 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: pgmap v77: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:50:54.895 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:50:54.895 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-19T00:50:54.895 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: osdmap e21: 3 total, 3 up, 3 in 2024-08-19T00:50:54.895 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:50:54.895 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:54.895 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:54.895 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:54.895 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:54.896 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:54.896 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:54.896 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:54.896 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:50:54.896 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:55.038 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: pgmap v77: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: osdmap e21: 3 total, 3 up, 3 in 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:50:55.039 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:50:55.040 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:55.290 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54321]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-19T00:50:55.291 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54321]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:50:55.291 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:50:55.291 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54321]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:50:55.835 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54342]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-19T00:50:55.836 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54342]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:50:55.836 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:50:55.836 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54342]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:50:56.117 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54358]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-19T00:50:56.117 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54358]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:50:56.117 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:50:56.117 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 00:50:55 smithi017 sudo[54358]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:50:56.117 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54440]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-19T00:50:56.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: Detected new or changed devices on smithi017 2024-08-19T00:50:56.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: Adjusting osd_memory_target on smithi017 to 3948M 2024-08-19T00:50:56.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-19T00:50:56.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: osdmap e22: 3 total, 3 up, 3 in 2024-08-19T00:50:56.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:50:56.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/3691403886' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ce99c8d-d9ed-410f-b31b-849ac4737f01"}]: dispatch 2024-08-19T00:50:56.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ce99c8d-d9ed-410f-b31b-849ac4737f01"}]: dispatch 2024-08-19T00:50:56.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ce99c8d-d9ed-410f-b31b-849ac4737f01"}]': finished 2024-08-19T00:50:56.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: osdmap e23: 4 total, 3 up, 4 in 2024-08-19T00:50:56.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:50:56.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:50:56.118 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:55 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:56.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: Detected new or changed devices on smithi017 2024-08-19T00:50:56.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: Adjusting osd_memory_target on smithi017 to 3948M 2024-08-19T00:50:56.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-19T00:50:56.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: osdmap e22: 3 total, 3 up, 3 in 2024-08-19T00:50:56.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:50:56.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: from='client.? 172.21.15.86:0/3691403886' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ce99c8d-d9ed-410f-b31b-849ac4737f01"}]: dispatch 2024-08-19T00:50:56.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4ce99c8d-d9ed-410f-b31b-849ac4737f01"}]: dispatch 2024-08-19T00:50:56.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4ce99c8d-d9ed-410f-b31b-849ac4737f01"}]': finished 2024-08-19T00:50:56.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: osdmap e23: 4 total, 3 up, 4 in 2024-08-19T00:50:56.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:50:56.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:50:56.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:55 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:56.380 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:50:56.377+0000 7eff5affd640 1 -- 172.21.15.86:0/452737578 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7eff54005210 con 0x7eff640ffcf0 2024-08-19T00:50:56.381 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54485]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-19T00:50:56.381 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54440]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:50:56.381 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:50:56.381 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54440]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:50:56.651 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54485]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:50:56.651 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:50:56.651 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54485]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:50:56.916 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54489]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-19T00:50:56.916 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54489]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:50:56.916 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:50:56.916 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54489]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:50:57.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54535]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-19T00:50:57.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54535]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:50:57.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:50:57.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:56 smithi017 sudo[54535]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:50:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:57 smithi017 sudo[54565]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-19T00:50:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:57 smithi017 sudo[54565]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:50:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:57 smithi017 sudo[54565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:50:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:57 smithi017 sudo[54565]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:50:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:57 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/2428124690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:50:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:57 smithi017 ceph-mon[16627]: mgrmap e19: smithi017.hfpawi(active, since 2m), standbys: smithi086.uthxct 2024-08-19T00:50:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:57 smithi017 ceph-mon[16627]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:50:57.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:57 smithi017 ceph-mon[16627]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:50:57.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 ceph-mon[24511]: from='client.? 172.21.15.86:0/2428124690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:50:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 ceph-mon[24511]: mgrmap e19: smithi017.hfpawi(active, since 2m), standbys: smithi086.uthxct 2024-08-19T00:50:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 ceph-mon[24511]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:50:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 ceph-mon[24511]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:50:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 sudo[28868]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-19T00:50:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 sudo[28868]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:50:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 sudo[28868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:50:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 sudo[28868]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:50:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 sudo[29057]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-19T00:50:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 sudo[29057]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-19T00:50:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 sudo[29057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-19T00:50:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:57 smithi086 sudo[29057]: pam_unix(sudo:session): session closed for user root 2024-08-19T00:50:58.540 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:58 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:50:58.540 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:58 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:50:58.540 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:58 smithi017 ceph-mon[16627]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:50:58.540 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:58 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:50:58.540 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:58 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:50:58.541 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:58 smithi017 ceph-mon[16627]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 97 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:50:58.541 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:58 smithi017 ceph-mon[16627]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:50:58.541 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:50:58 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:50:58.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:58 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:50:58.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:58 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:50:58.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:58 smithi086 ceph-mon[24511]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-19T00:50:58.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:58 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:50:58.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:58 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:50:58.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:58 smithi086 ceph-mon[24511]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 97 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:50:58.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:58 smithi086 ceph-mon[24511]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-19T00:50:58.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:50:58 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:00.377 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:00 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:00.377 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:00 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:00.377 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:00 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:00.377 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:00 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:51:00.378 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:00 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:00.378 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:00 smithi086 ceph-mon[24511]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:51:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:00 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:00 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:00 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:00 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:51:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:00 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:00 smithi017 ceph-mon[16627]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:51:02.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:02 smithi086 ceph-mon[24511]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-08-19T00:51:02.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:02 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-19T00:51:02.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:02 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:02 smithi017 ceph-mon[16627]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 196 KiB/s wr, 13 op/s 2024-08-19T00:51:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:02 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-19T00:51:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:02 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:03.890 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:03 smithi086 ceph-mon[24511]: Deploying daemon osd.3 on smithi086 2024-08-19T00:51:03.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:03 smithi017 ceph-mon[16627]: Deploying daemon osd.3 on smithi086 2024-08-19T00:51:04.845 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:04 smithi086 ceph-mon[24511]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-08-19T00:51:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:04 smithi017 ceph-mon[16627]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-08-19T00:51:05.810 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:05 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:51:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:05 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:51:06.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:06 smithi086 ceph-mon[24511]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-08-19T00:51:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:06 smithi017 ceph-mon[16627]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-08-19T00:51:07.852 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:07 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:51:07.852 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:07 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:07.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:07 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:07.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:07 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:51:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:07 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:07 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:08.856 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:08 smithi086 ceph-mon[24511]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-08-19T00:51:08.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:08 smithi017 ceph-mon[16627]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-08-19T00:51:10.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:10 smithi086 ceph-mon[24511]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-08-19T00:51:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:10 smithi017 ceph-mon[16627]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-08-19T00:51:10.957 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.955+0000 7eff5affd640 1 -- 172.21.15.86:0/452737578 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7eff6402c540 con 0x7eff5006cbc0 2024-08-19T00:51:10.957 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 3 on host 'smithi086' 2024-08-19T00:51:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.958+0000 7eff6bbee640 1 -- 172.21.15.86:0/452737578 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7eff5006cbc0 msgr2=0x7eff5006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:51:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.958+0000 7eff6bbee640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7eff5006cbc0 0x7eff5006f080 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7eff64068d10 tx=0x7eff60004040 comp rx=0 tx=0).stop 2024-08-19T00:51:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.958+0000 7eff6bbee640 1 -- 172.21.15.86:0/452737578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff640ffcf0 msgr2=0x7eff6419a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:51:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.958+0000 7eff6bbee640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff640ffcf0 0x7eff6419a3e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7eff5400c8f0 tx=0x7eff5400cdb0 comp rx=0 tx=0).stop 2024-08-19T00:51:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.958+0000 7eff6bbee640 1 -- 172.21.15.86:0/452737578 shutdown_connections 2024-08-19T00:51:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.958+0000 7eff6bbee640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7eff5006cbc0 0x7eff5006f080 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.958+0000 7eff6bbee640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7eff640ffcf0 0x7eff6419a3e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.958+0000 7eff6bbee640 1 --2- 172.21.15.86:0/452737578 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff640feaf0 0x7eff640687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:10.960 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.958+0000 7eff6bbee640 1 -- 172.21.15.86:0/452737578 >> 172.21.15.86:0/452737578 conn(0x7eff640fa280 msgr2=0x7eff64103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:51:10.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.958+0000 7eff6bbee640 1 -- 172.21.15.86:0/452737578 shutdown_connections 2024-08-19T00:51:10.961 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:10.958+0000 7eff6bbee640 1 -- 172.21.15.86:0/452737578 wait complete. 2024-08-19T00:51:11.620 DEBUG:teuthology.orchestra.run.smithi086:osd.3> sudo journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.3.service 2024-08-19T00:51:11.623 INFO:tasks.cephadm:Deploying osd.4 on smithi086 with /dev/vg_nvme/lv_3... 2024-08-19T00:51:11.623 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-19T00:51:11.865 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T00:51:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:11 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:11 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:11 smithi017 ceph-mon[16627]: from='osd.3 [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-19T00:51:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:11 smithi017 ceph-mon[16627]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-19T00:51:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:11 smithi017 ceph-mon[16627]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-08-19T00:51:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:11 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:11 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:12.274 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:11 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:12.274 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:11 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:12.274 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:11 smithi086 ceph-mon[24511]: from='osd.3 [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-19T00:51:12.274 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:11 smithi086 ceph-mon[24511]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-19T00:51:12.274 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:11 smithi086 ceph-mon[24511]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-08-19T00:51:12.274 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:11 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:12.274 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:11 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:13.174 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:12 smithi086 ceph-mon[24511]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-19T00:51:13.175 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:12 smithi086 ceph-mon[24511]: osdmap e24: 4 total, 3 up, 4 in 2024-08-19T00:51:13.175 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:12 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:51:13.175 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:12 smithi086 ceph-mon[24511]: from='osd.3 [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:51:13.175 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:12 smithi086 ceph-mon[24511]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:51:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:12 smithi017 ceph-mon[16627]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-19T00:51:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:12 smithi017 ceph-mon[16627]: osdmap e24: 4 total, 3 up, 4 in 2024-08-19T00:51:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:12 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:51:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:12 smithi017 ceph-mon[16627]: from='osd.3 [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:51:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:12 smithi017 ceph-mon[16627]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:51:14.069 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:13 smithi086 ceph-mon[24511]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-08-19T00:51:14.069 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:13 smithi086 ceph-mon[24511]: osdmap e25: 4 total, 3 up, 4 in 2024-08-19T00:51:14.070 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:13 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:51:14.070 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:13 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:51:14.070 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:13 smithi086 ceph-mon[24511]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:51:14.070 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:13 smithi086 ceph-mon[24511]: from='osd.3 ' entity='osd.3' 2024-08-19T00:51:14.070 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 00:51:13 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[30489]: 2024-08-19T00:51:13.809+0000 7fc3ea11d640 -1 osd.3 0 waiting for initial osdmap 2024-08-19T00:51:14.070 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 00:51:13 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[30489]: 2024-08-19T00:51:13.819+0000 7fc3e2750640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:51:14.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:13 smithi017 ceph-mon[16627]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-08-19T00:51:14.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:13 smithi017 ceph-mon[16627]: osdmap e25: 4 total, 3 up, 4 in 2024-08-19T00:51:14.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:13 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:51:14.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:13 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:51:14.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:13 smithi017 ceph-mon[16627]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 102 MiB used, 268 GiB / 268 GiB avail 2024-08-19T00:51:14.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:13 smithi017 ceph-mon[16627]: from='osd.3 ' entity='osd.3' 2024-08-19T00:51:15.067 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:51:15.087 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_3 2024-08-19T00:51:15.240 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:14 smithi086 ceph-mon[24511]: purged_snaps scrub starts 2024-08-19T00:51:15.240 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:14 smithi086 ceph-mon[24511]: purged_snaps scrub ok 2024-08-19T00:51:15.240 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:14 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:51:15.241 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:14 smithi086 ceph-mon[24511]: osd.3 [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183] boot 2024-08-19T00:51:15.241 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:14 smithi086 ceph-mon[24511]: osdmap e26: 4 total, 4 up, 4 in 2024-08-19T00:51:15.241 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:14 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:51:15.241 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:14 smithi086 ceph-mon[24511]: osdmap e27: 4 total, 4 up, 4 in 2024-08-19T00:51:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:14 smithi017 ceph-mon[16627]: purged_snaps scrub starts 2024-08-19T00:51:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:14 smithi017 ceph-mon[16627]: purged_snaps scrub ok 2024-08-19T00:51:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:14 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:51:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:14 smithi017 ceph-mon[16627]: osd.3 [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183] boot 2024-08-19T00:51:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:14 smithi017 ceph-mon[16627]: osdmap e26: 4 total, 4 up, 4 in 2024-08-19T00:51:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:14 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:51:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:14 smithi017 ceph-mon[16627]: osdmap e27: 4 total, 4 up, 4 in 2024-08-19T00:51:15.603 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T00:51:16.127 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:15 smithi086 ceph-mon[24511]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:16.127 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:15 smithi086 ceph-mon[24511]: osdmap e28: 4 total, 4 up, 4 in 2024-08-19T00:51:16.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:15 smithi017 ceph-mon[16627]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:16.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:15 smithi017 ceph-mon[16627]: osdmap e28: 4 total, 4 up, 4 in 2024-08-19T00:51:17.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.709+0000 7ffb4964e640 1 -- 172.21.15.86:0/4121913967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb44100720 msgr2=0x7ffb44102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:51:17.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.709+0000 7ffb4964e640 1 --2- 172.21.15.86:0/4121913967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb44100720 0x7ffb44102b10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffb34009880 tx=0x7ffb3402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:51:17.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.709+0000 7ffb4964e640 1 -- 172.21.15.86:0/4121913967 shutdown_connections 2024-08-19T00:51:17.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.709+0000 7ffb4964e640 1 --2- 172.21.15.86:0/4121913967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb44103050 0x7ffb44105440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:17.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.709+0000 7ffb4964e640 1 --2- 172.21.15.86:0/4121913967 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb44100720 0x7ffb44102b10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:17.729 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.709+0000 7ffb4964e640 1 -- 172.21.15.86:0/4121913967 >> 172.21.15.86:0/4121913967 conn(0x7ffb440fa280 msgr2=0x7ffb440fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:51:17.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.709+0000 7ffb4964e640 1 -- 172.21.15.86:0/4121913967 shutdown_connections 2024-08-19T00:51:17.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.709+0000 7ffb4964e640 1 -- 172.21.15.86:0/4121913967 wait complete. 2024-08-19T00:51:17.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.709+0000 7ffb4964e640 1 Processor -- start 2024-08-19T00:51:17.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb4964e640 1 -- start start 2024-08-19T00:51:17.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb4964e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb44100720 0x7ffb44195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:51:17.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb4964e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb44103050 0x7ffb44195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:51:17.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb4964e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb44196210 con 0x7ffb44100720 2024-08-19T00:51:17.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb4964e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb44196380 con 0x7ffb44103050 2024-08-19T00:51:17.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb3a7fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb44103050 0x7ffb44195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:51:17.730 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb3a7fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb44103050 0x7ffb44195c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:39508/0 (socket says 172.21.15.86:39508) 2024-08-19T00:51:17.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb3a7fc640 1 -- 172.21.15.86:0/3782068161 learned_addr learned my addr 172.21.15.86:0/3782068161 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:51:17.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb42ffd640 1 --2- 172.21.15.86:0/3782068161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb44100720 0x7ffb44195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:51:17.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb3a7fc640 1 -- 172.21.15.86:0/3782068161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb44100720 msgr2=0x7ffb44195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:51:17.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb3a7fc640 1 --2- 172.21.15.86:0/3782068161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb44100720 0x7ffb44195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:17.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb3a7fc640 1 -- 172.21.15.86:0/3782068161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb34009560 con 0x7ffb44103050 2024-08-19T00:51:17.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb3a7fc640 1 --2- 172.21.15.86:0/3782068161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb44103050 0x7ffb44195c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00b3d0 tx=0x7ffb2c00b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:51:17.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.710+0000 7ffb40ff9640 1 -- 172.21.15.86:0/3782068161 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb2c011800 con 0x7ffb44103050 2024-08-19T00:51:17.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.711+0000 7ffb40ff9640 1 -- 172.21.15.86:0/3782068161 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb2c011e20 con 0x7ffb44103050 2024-08-19T00:51:17.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.711+0000 7ffb4964e640 1 -- 172.21.15.86:0/3782068161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4419ae20 con 0x7ffb44103050 2024-08-19T00:51:17.731 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.711+0000 7ffb40ff9640 1 -- 172.21.15.86:0/3782068161 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb2c00f2e0 con 0x7ffb44103050 2024-08-19T00:51:17.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.711+0000 7ffb4964e640 1 -- 172.21.15.86:0/3782068161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4419b3c0 con 0x7ffb44103050 2024-08-19T00:51:17.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.712+0000 7ffb4964e640 1 -- 172.21.15.86:0/3782068161 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb44100b00 con 0x7ffb44103050 2024-08-19T00:51:17.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.712+0000 7ffb40ff9640 1 -- 172.21.15.86:0/3782068161 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffb2c010380 con 0x7ffb44103050 2024-08-19T00:51:17.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.712+0000 7ffb40ff9640 1 --2- 172.21.15.86:0/3782068161 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffb3006cc50 0x7ffb3006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:51:17.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.713+0000 7ffb40ff9640 1 -- 172.21.15.86:0/3782068161 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3774+0+0 (secure 0 0 0) 0x7ffb2c08b7b0 con 0x7ffb44103050 2024-08-19T00:51:17.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.713+0000 7ffb42ffd640 1 --2- 172.21.15.86:0/3782068161 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffb3006cc50 0x7ffb3006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:51:17.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.713+0000 7ffb42ffd640 1 --2- 172.21.15.86:0/3782068161 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffb3006cc50 0x7ffb3006f110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb34000c00 tx=0x7ffb340314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:51:17.732 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.717+0000 7ffb40ff9640 1 -- 172.21.15.86:0/3782068161 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ffb2c056220 con 0x7ffb44103050 2024-08-19T00:51:17.888 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:17.886+0000 7ffb4964e640 1 -- 172.21.15.86:0/3782068161 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb44103a30 con 0x7ffb3006cc50 2024-08-19T00:51:17.888 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: osdmap e29: 4 total, 4 up, 4 in 2024-08-19T00:51:17.888 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: Detected new or changed devices on smithi086 2024-08-19T00:51:17.888 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:17.888 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:17.888 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:51:17.888 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: Adjusting osd_memory_target on smithi086 to 14912M 2024-08-19T00:51:17.889 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:17.889 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:17.889 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:51:17.889 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:17.889 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:51:17.889 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:17.889 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:51:17.889 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:17.889 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:17 smithi086 ceph-mon[24511]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-19T00:51:17.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: osdmap e29: 4 total, 4 up, 4 in 2024-08-19T00:51:17.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: Detected new or changed devices on smithi086 2024-08-19T00:51:17.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:17.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:17.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:51:17.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: Adjusting osd_memory_target on smithi086 to 14912M 2024-08-19T00:51:17.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:17.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:17.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:51:17.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:17.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:51:17.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:17.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:51:17.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:17.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:17 smithi017 ceph-mon[16627]: pgmap v98: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-19T00:51:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:18 smithi017 ceph-mon[16627]: osdmap e30: 4 total, 4 up, 4 in 2024-08-19T00:51:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:18 smithi017 ceph-mon[16627]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:51:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:18 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:51:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:18 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:51:18.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:18 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:18 smithi086 ceph-mon[24511]: osdmap e30: 4 total, 4 up, 4 in 2024-08-19T00:51:18.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:18 smithi086 ceph-mon[24511]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:51:18.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:18 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:51:18.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:18 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:51:18.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:18 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:19 smithi086 ceph-mon[24511]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-08-19T00:51:19.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:19 smithi017 ceph-mon[16627]: pgmap v100: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-08-19T00:51:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:20 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/96813950' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2789f76-5f10-4980-b852-44a7971a51e1"}]: dispatch 2024-08-19T00:51:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:20 smithi017 ceph-mon[16627]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2789f76-5f10-4980-b852-44a7971a51e1"}]: dispatch 2024-08-19T00:51:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:20 smithi017 ceph-mon[16627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2789f76-5f10-4980-b852-44a7971a51e1"}]': finished 2024-08-19T00:51:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:20 smithi017 ceph-mon[16627]: osdmap e31: 5 total, 4 up, 5 in 2024-08-19T00:51:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:51:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:20 smithi086 ceph-mon[24511]: from='client.? 172.21.15.86:0/96813950' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2789f76-5f10-4980-b852-44a7971a51e1"}]: dispatch 2024-08-19T00:51:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:20 smithi086 ceph-mon[24511]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a2789f76-5f10-4980-b852-44a7971a51e1"}]: dispatch 2024-08-19T00:51:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:20 smithi086 ceph-mon[24511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a2789f76-5f10-4980-b852-44a7971a51e1"}]': finished 2024-08-19T00:51:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:20 smithi086 ceph-mon[24511]: osdmap e31: 5 total, 4 up, 5 in 2024-08-19T00:51:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:51:21.919 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:21 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/1525405099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:51:21.919 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:21 smithi017 ceph-mon[16627]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-08-19T00:51:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:21 smithi086 ceph-mon[24511]: from='client.? 172.21.15.86:0/1525405099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:51:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:21 smithi086 ceph-mon[24511]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-08-19T00:51:24.879 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:24 smithi086 ceph-mon[24511]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:24.886 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:24 smithi017 ceph-mon[16627]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:26.878 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:26 smithi086 ceph-mon[24511]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:26 smithi017 ceph-mon[16627]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:27.739 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:27 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-19T00:51:27.739 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:27 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:27.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:27 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-19T00:51:27.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:27 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:28.673 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:28 smithi086 ceph-mon[24511]: Deploying daemon osd.4 on smithi086 2024-08-19T00:51:28.673 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:28 smithi086 ceph-mon[24511]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:28 smithi017 ceph-mon[16627]: Deploying daemon osd.4 on smithi086 2024-08-19T00:51:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:28 smithi017 ceph-mon[16627]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:30.823 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:30 smithi086 ceph-mon[24511]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:30.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:30 smithi017 ceph-mon[16627]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:32.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:32 smithi086 ceph-mon[24511]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:32.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:32 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:51:32.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:32 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:32.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:32 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:32 smithi017 ceph-mon[16627]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:32 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:51:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:32 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:32 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:34.686 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:34 smithi086 ceph-mon[24511]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:34 smithi017 ceph-mon[16627]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:35.356 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.353+0000 7ffb40ff9640 1 -- 172.21.15.86:0/3782068161 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ffb44103a30 con 0x7ffb3006cc50 2024-08-19T00:51:35.356 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 4 on host 'smithi086' 2024-08-19T00:51:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.355+0000 7ffb4964e640 1 -- 172.21.15.86:0/3782068161 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffb3006cc50 msgr2=0x7ffb3006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:51:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.355+0000 7ffb4964e640 1 --2- 172.21.15.86:0/3782068161 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffb3006cc50 0x7ffb3006f110 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb34000c00 tx=0x7ffb340314e0 comp rx=0 tx=0).stop 2024-08-19T00:51:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.355+0000 7ffb4964e640 1 -- 172.21.15.86:0/3782068161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb44103050 msgr2=0x7ffb44195c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:51:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.355+0000 7ffb4964e640 1 --2- 172.21.15.86:0/3782068161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb44103050 0x7ffb44195c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00b3d0 tx=0x7ffb2c00b890 comp rx=0 tx=0).stop 2024-08-19T00:51:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.355+0000 7ffb4964e640 1 -- 172.21.15.86:0/3782068161 shutdown_connections 2024-08-19T00:51:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.355+0000 7ffb4964e640 1 --2- 172.21.15.86:0/3782068161 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffb3006cc50 0x7ffb3006f110 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.355+0000 7ffb4964e640 1 --2- 172.21.15.86:0/3782068161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb44103050 0x7ffb44195c40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.355+0000 7ffb4964e640 1 --2- 172.21.15.86:0/3782068161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb44100720 0x7ffb44195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:35.358 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.355+0000 7ffb4964e640 1 -- 172.21.15.86:0/3782068161 >> 172.21.15.86:0/3782068161 conn(0x7ffb440fa280 msgr2=0x7ffb440fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:51:35.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.355+0000 7ffb4964e640 1 -- 172.21.15.86:0/3782068161 shutdown_connections 2024-08-19T00:51:35.359 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:35.355+0000 7ffb4964e640 1 -- 172.21.15.86:0/3782068161 wait complete. 2024-08-19T00:51:36.301 DEBUG:teuthology.orchestra.run.smithi086:osd.4> sudo journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.4.service 2024-08-19T00:51:36.303 INFO:tasks.cephadm:Deploying osd.5 on smithi086 with /dev/vg_nvme/lv_2... 2024-08-19T00:51:36.304 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-19T00:51:36.549 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T00:51:36.672 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:36 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:36.672 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:36 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:36.672 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:36 smithi086 ceph-mon[24511]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:36.672 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:36 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:51:36.672 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:36 smithi086 ceph-mon[24511]: from='osd.4 [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T00:51:36.672 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:36 smithi086 ceph-mon[24511]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T00:51:36.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:36.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:36.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:36 smithi017 ceph-mon[16627]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:36.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:36 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:51:36.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:36 smithi017 ceph-mon[16627]: from='osd.4 [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T00:51:36.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:36 smithi017 ceph-mon[16627]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T00:51:37.627 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:37 smithi086 ceph-mon[24511]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-19T00:51:37.628 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:37 smithi086 ceph-mon[24511]: osdmap e32: 5 total, 4 up, 5 in 2024-08-19T00:51:37.628 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:37 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:37.628 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:37 smithi086 ceph-mon[24511]: from='osd.4 [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:51:37.628 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:37 smithi086 ceph-mon[24511]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:51:37.628 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:37 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:37.628 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:37 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:37.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:37 smithi017 ceph-mon[16627]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-19T00:51:37.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:37 smithi017 ceph-mon[16627]: osdmap e32: 5 total, 4 up, 5 in 2024-08-19T00:51:37.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:37 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:37.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:37 smithi017 ceph-mon[16627]: from='osd.4 [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:51:37.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:37 smithi017 ceph-mon[16627]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:51:37.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:37 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:37.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:37 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:38.439 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:38 smithi086 ceph-mon[24511]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-08-19T00:51:38.440 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:38 smithi086 ceph-mon[24511]: osdmap e33: 5 total, 4 up, 5 in 2024-08-19T00:51:38.440 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:38 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:38.440 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:38 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:38.440 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:38 smithi086 ceph-mon[24511]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:38.440 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:38 smithi086 ceph-mon[24511]: from='osd.4 ' entity='osd.4' 2024-08-19T00:51:38.440 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 00:51:38 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[37391]: 2024-08-19T00:51:38.171+0000 7fc9e1235640 -1 osd.4 0 waiting for initial osdmap 2024-08-19T00:51:38.440 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 00:51:38 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[37391]: 2024-08-19T00:51:38.183+0000 7fc9d802d640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:51:38.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:38 smithi017 ceph-mon[16627]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-08-19T00:51:38.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:38 smithi017 ceph-mon[16627]: osdmap e33: 5 total, 4 up, 5 in 2024-08-19T00:51:38.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:38 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:38.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:38 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:38.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:38 smithi017 ceph-mon[16627]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 132 MiB used, 357 GiB / 358 GiB avail 2024-08-19T00:51:38.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:38 smithi017 ceph-mon[16627]: from='osd.4 ' entity='osd.4' 2024-08-19T00:51:39.471 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:39 smithi086 ceph-mon[24511]: purged_snaps scrub starts 2024-08-19T00:51:39.471 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:39 smithi086 ceph-mon[24511]: purged_snaps scrub ok 2024-08-19T00:51:39.471 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:39 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:39.471 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:39 smithi086 ceph-mon[24511]: osd.4 [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562] boot 2024-08-19T00:51:39.471 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:39 smithi086 ceph-mon[24511]: osdmap e34: 5 total, 5 up, 5 in 2024-08-19T00:51:39.471 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:39 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:39.474 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-08-19T00:51:39.493 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi086:vg_nvme/lv_2 2024-08-19T00:51:39.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:39 smithi017 ceph-mon[16627]: purged_snaps scrub starts 2024-08-19T00:51:39.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:39 smithi017 ceph-mon[16627]: purged_snaps scrub ok 2024-08-19T00:51:39.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:39 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:39.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:39 smithi017 ceph-mon[16627]: osd.4 [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562] boot 2024-08-19T00:51:39.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:39 smithi017 ceph-mon[16627]: osdmap e34: 5 total, 5 up, 5 in 2024-08-19T00:51:39.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:39 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:51:40.398 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T00:51:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:40 smithi086 ceph-mon[24511]: osdmap e35: 5 total, 5 up, 5 in 2024-08-19T00:51:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:40 smithi086 ceph-mon[24511]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:40.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:40 smithi017 ceph-mon[16627]: osdmap e35: 5 total, 5 up, 5 in 2024-08-19T00:51:40.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:40 smithi017 ceph-mon[16627]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:42.598 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.594+0000 7f84162a6640 1 -- 172.21.15.86:0/3149347949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84100fea70 msgr2=0x7f84100fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:51:42.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.594+0000 7f84162a6640 1 --2- 172.21.15.86:0/3149347949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84100fea70 0x7f84100fee70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8400009880 tx=0x7f840002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:51:42.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.594+0000 7f84162a6640 1 -- 172.21.15.86:0/3149347949 shutdown_connections 2024-08-19T00:51:42.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.594+0000 7f84162a6640 1 --2- 172.21.15.86:0/3149347949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84100ffc70 0x7f84101000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:42.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.594+0000 7f84162a6640 1 --2- 172.21.15.86:0/3149347949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84100fea70 0x7f84100fee70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:42.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.594+0000 7f84162a6640 1 -- 172.21.15.86:0/3149347949 >> 172.21.15.86:0/3149347949 conn(0x7f84100fa200 msgr2=0x7f84100fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:51:42.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.594+0000 7f84162a6640 1 -- 172.21.15.86:0/3149347949 shutdown_connections 2024-08-19T00:51:42.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.594+0000 7f84162a6640 1 -- 172.21.15.86:0/3149347949 wait complete. 2024-08-19T00:51:42.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.595+0000 7f84162a6640 1 Processor -- start 2024-08-19T00:51:42.599 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.595+0000 7f84162a6640 1 -- start start 2024-08-19T00:51:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.595+0000 7f84162a6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84100fea70 0x7f84101955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:51:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.595+0000 7f84162a6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84100ffc70 0x7f8410195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:51:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.595+0000 7f84162a6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410196100 con 0x7f84100ffc70 2024-08-19T00:51:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.595+0000 7f84162a6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8410196270 con 0x7f84100fea70 2024-08-19T00:51:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.595+0000 7f840ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84100fea70 0x7f84101955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:51:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.595+0000 7f840ffff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84100fea70 0x7f84101955f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:41330/0 (socket says 172.21.15.86:41330) 2024-08-19T00:51:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.595+0000 7f840ffff640 1 -- 172.21.15.86:0/1473153995 learned_addr learned my addr 172.21.15.86:0/1473153995 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:51:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.595+0000 7f840f7fe640 1 --2- 172.21.15.86:0/1473153995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84100ffc70 0x7f8410195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:51:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.596+0000 7f840ffff640 1 -- 172.21.15.86:0/1473153995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84100ffc70 msgr2=0x7f8410195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:51:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.596+0000 7f840ffff640 1 --2- 172.21.15.86:0/1473153995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84100ffc70 0x7f8410195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:51:42.600 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.596+0000 7f840ffff640 1 -- 172.21.15.86:0/1473153995 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8400009560 con 0x7f84100fea70 2024-08-19T00:51:42.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.596+0000 7f840ffff640 1 --2- 172.21.15.86:0/1473153995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84100fea70 0x7f84101955f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f840002a9c0 tx=0x7f84000054f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:51:42.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.596+0000 7f840d7fa640 1 -- 172.21.15.86:0/1473153995 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8400004aa0 con 0x7f84100fea70 2024-08-19T00:51:42.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.596+0000 7f84162a6640 1 -- 172.21.15.86:0/1473153995 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841019acb0 con 0x7f84100fea70 2024-08-19T00:51:42.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.596+0000 7f840d7fa640 1 -- 172.21.15.86:0/1473153995 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8400004c00 con 0x7f84100fea70 2024-08-19T00:51:42.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.596+0000 7f840d7fa640 1 -- 172.21.15.86:0/1473153995 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8400003a50 con 0x7f84100fea70 2024-08-19T00:51:42.601 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.596+0000 7f84162a6640 1 -- 172.21.15.86:0/1473153995 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841019b1a0 con 0x7f84100fea70 2024-08-19T00:51:42.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.597+0000 7f84162a6640 1 -- 172.21.15.86:0/1473153995 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8410107680 con 0x7f84100fea70 2024-08-19T00:51:42.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.598+0000 7f840d7fa640 1 -- 172.21.15.86:0/1473153995 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8400003cd0 con 0x7f84100fea70 2024-08-19T00:51:42.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.598+0000 7f840d7fa640 1 --2- 172.21.15.86:0/1473153995 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f83f806cc50 0x7f83f806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:51:42.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.598+0000 7f840d7fa640 1 -- 172.21.15.86:0/1473153995 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f84000ace50 con 0x7f84100fea70 2024-08-19T00:51:42.602 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.598+0000 7f840f7fe640 1 --2- 172.21.15.86:0/1473153995 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f83f806cc50 0x7f83f806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:51:42.603 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.599+0000 7f840f7fe640 1 --2- 172.21.15.86:0/1473153995 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f83f806cc50 0x7f83f806f110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8410196b10 tx=0x7f840400b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:51:42.605 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.603+0000 7f840d7fa640 1 -- 172.21.15.86:0/1473153995 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f84000777c0 con 0x7f84100fea70 2024-08-19T00:51:42.657 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:42.657 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:42.657 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:42.657 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:51:42.657 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:51:42.657 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:42.658 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:42.658 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:51:42.658 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:42.658 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:51:42.658 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:42.658 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:51:42.658 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:42 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:42.788 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:51:42.785+0000 7f84162a6640 1 -- 172.21.15.86:0/1473153995 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f84100fc3d0 con 0x7f83f806cc50 2024-08-19T00:51:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:51:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:51:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:51:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:42.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:51:42.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:42.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:51:42.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:42 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:43.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:43 smithi086 ceph-mon[24511]: Detected new or changed devices on smithi086 2024-08-19T00:51:43.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:43 smithi086 ceph-mon[24511]: Adjusting osd_memory_target on smithi086 to 7456M 2024-08-19T00:51:43.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:43 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:51:43.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:43 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:51:43.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:43 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:43.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:43 smithi017 ceph-mon[16627]: Detected new or changed devices on smithi086 2024-08-19T00:51:43.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:43 smithi017 ceph-mon[16627]: Adjusting osd_memory_target on smithi086 to 7456M 2024-08-19T00:51:43.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:43 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-19T00:51:43.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:43 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-19T00:51:43.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:43 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:44.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:44 smithi086 ceph-mon[24511]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:51:44.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:44 smithi086 ceph-mon[24511]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:44 smithi017 ceph-mon[16627]: from='client.24187 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi086:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:51:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:44 smithi017 ceph-mon[16627]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:45.852 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:45 smithi086 ceph-mon[24511]: from='client.? 172.21.15.86:0/734623789' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afa3e4af-16cf-4533-8b85-24237f570833"}]: dispatch 2024-08-19T00:51:45.852 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:45 smithi086 ceph-mon[24511]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afa3e4af-16cf-4533-8b85-24237f570833"}]: dispatch 2024-08-19T00:51:45.852 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:45 smithi086 ceph-mon[24511]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "afa3e4af-16cf-4533-8b85-24237f570833"}]': finished 2024-08-19T00:51:45.852 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:45 smithi086 ceph-mon[24511]: osdmap e36: 6 total, 5 up, 6 in 2024-08-19T00:51:45.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:45 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:51:45.853 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:45 smithi086 ceph-mon[24511]: from='client.? 172.21.15.86:0/3113503172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:51:45.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:45 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/734623789' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afa3e4af-16cf-4533-8b85-24237f570833"}]: dispatch 2024-08-19T00:51:45.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:45 smithi017 ceph-mon[16627]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "afa3e4af-16cf-4533-8b85-24237f570833"}]: dispatch 2024-08-19T00:51:45.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:45 smithi017 ceph-mon[16627]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "afa3e4af-16cf-4533-8b85-24237f570833"}]': finished 2024-08-19T00:51:45.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:45 smithi017 ceph-mon[16627]: osdmap e36: 6 total, 5 up, 6 in 2024-08-19T00:51:45.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:45 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:51:45.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:45 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/3113503172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-19T00:51:46.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:46 smithi017 ceph-mon[16627]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:46 smithi086 ceph-mon[24511]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:48 smithi017 ceph-mon[16627]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:48 smithi086 ceph-mon[24511]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:50.699 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:50 smithi086 ceph-mon[24511]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:50.699 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:51:50.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:50 smithi017 ceph-mon[16627]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:50.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:51:52.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:52 smithi017 ceph-mon[16627]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:52.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-19T00:51:52.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:52 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:52.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:52 smithi086 ceph-mon[24511]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-19T00:51:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:52 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:51:53.664 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:53 smithi086 ceph-mon[24511]: Deploying daemon osd.5 on smithi086 2024-08-19T00:51:53.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:53 smithi017 ceph-mon[16627]: Deploying daemon osd.5 on smithi086 2024-08-19T00:51:54.834 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:54 smithi017 ceph-mon[16627]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:54.856 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:54 smithi086 ceph-mon[24511]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:56.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:56 smithi017 ceph-mon[16627]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:56.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:56 smithi086 ceph-mon[24511]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:57.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:57 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:51:57.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:57 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:57.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:57 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:57 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:51:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:57 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:57 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:51:58.673 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:51:58 smithi086 ceph-mon[24511]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:51:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:51:58 smithi017 ceph-mon[16627]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:52:00.470 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.468+0000 7f840d7fa640 1 -- 172.21.15.86:0/1473153995 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f84100fc3d0 con 0x7f83f806cc50 2024-08-19T00:52:00.470 INFO:teuthology.orchestra.run.smithi086.stdout:Created osd(s) 5 on host 'smithi086' 2024-08-19T00:52:00.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.470+0000 7f84162a6640 1 -- 172.21.15.86:0/1473153995 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f83f806cc50 msgr2=0x7f83f806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:00.471 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.470+0000 7f84162a6640 1 --2- 172.21.15.86:0/1473153995 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f83f806cc50 0x7f83f806f110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8410196b10 tx=0x7f840400b390 comp rx=0 tx=0).stop 2024-08-19T00:52:00.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.470+0000 7f84162a6640 1 -- 172.21.15.86:0/1473153995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84100fea70 msgr2=0x7f84101955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:00.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.470+0000 7f84162a6640 1 --2- 172.21.15.86:0/1473153995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84100fea70 0x7f84101955f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f840002a9c0 tx=0x7f84000054f0 comp rx=0 tx=0).stop 2024-08-19T00:52:00.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.470+0000 7f84162a6640 1 -- 172.21.15.86:0/1473153995 shutdown_connections 2024-08-19T00:52:00.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.470+0000 7f84162a6640 1 --2- 172.21.15.86:0/1473153995 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f83f806cc50 0x7f83f806f110 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:00.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.470+0000 7f84162a6640 1 --2- 172.21.15.86:0/1473153995 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84100ffc70 0x7f8410195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:00.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.470+0000 7f84162a6640 1 --2- 172.21.15.86:0/1473153995 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84100fea70 0x7f84101955f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:00.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.470+0000 7f84162a6640 1 -- 172.21.15.86:0/1473153995 >> 172.21.15.86:0/1473153995 conn(0x7f84100fa200 msgr2=0x7f84100fbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:00.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.470+0000 7f84162a6640 1 -- 172.21.15.86:0/1473153995 shutdown_connections 2024-08-19T00:52:00.472 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:00.470+0000 7f84162a6640 1 -- 172.21.15.86:0/1473153995 wait complete. 2024-08-19T00:52:00.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:00 smithi086 ceph-mon[24511]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:52:00.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:00 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:00.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:00 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:00 smithi017 ceph-mon[16627]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:52:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:00 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:00 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:01.149 DEBUG:teuthology.orchestra.run.smithi086:osd.5> sudo journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.5.service 2024-08-19T00:52:01.151 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-08-19T00:52:01.152 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-19T00:52:01.379 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:01.835 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:01 smithi017 ceph-mon[16627]: from='osd.5 [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T00:52:01.835 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:01 smithi017 ceph-mon[16627]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T00:52:01.835 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:01 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:01.835 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:01 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:01.923 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:01 smithi086 ceph-mon[24511]: from='osd.5 [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T00:52:01.923 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:01 smithi086 ceph-mon[24511]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T00:52:01.924 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:01 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:01.924 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:01 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:02.677 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:02 smithi017 ceph-mon[16627]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:52:02.678 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:02 smithi017 ceph-mon[16627]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-19T00:52:02.678 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:02 smithi017 ceph-mon[16627]: osdmap e37: 6 total, 5 up, 6 in 2024-08-19T00:52:02.678 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:02 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:52:02.678 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:02 smithi017 ceph-mon[16627]: from='osd.5 [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:52:02.678 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:02 smithi017 ceph-mon[16627]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:52:02.941 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:02 smithi086 ceph-mon[24511]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:52:02.941 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:02 smithi086 ceph-mon[24511]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-19T00:52:02.941 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:02 smithi086 ceph-mon[24511]: osdmap e37: 6 total, 5 up, 6 in 2024-08-19T00:52:02.941 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:02 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:52:02.941 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:02 smithi086 ceph-mon[24511]: from='osd.5 [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:52:02.941 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:02 smithi086 ceph-mon[24511]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T00:52:02.941 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 00:52:02 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[43880]: 2024-08-19T00:52:02.604+0000 7f6b698ca640 -1 osd.5 0 waiting for initial osdmap 2024-08-19T00:52:02.941 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 00:52:02 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[43880]: 2024-08-19T00:52:02.612+0000 7f6b646ca640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T00:52:03.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.070+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2424655793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a240744e0 msgr2=0x7f5a24072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.070+0000 7f5a28d8f640 1 --2- 172.21.15.17:0/2424655793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a240744e0 0x7f5a24072940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009880 tx=0x7f5a1402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.070+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2424655793 shutdown_connections 2024-08-19T00:52:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.070+0000 7f5a28d8f640 1 --2- 172.21.15.17:0/2424655793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a24072f10 0x7f5a24073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.070+0000 7f5a28d8f640 1 --2- 172.21.15.17:0/2424655793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a240744e0 0x7f5a24072940 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.070+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2424655793 >> 172.21.15.17:0/2424655793 conn(0x7f5a240fb310 msgr2=0x7f5a240fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.070+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2424655793 shutdown_connections 2024-08-19T00:52:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.070+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2424655793 wait complete. 2024-08-19T00:52:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.071+0000 7f5a28d8f640 1 Processor -- start 2024-08-19T00:52:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.071+0000 7f5a28d8f640 1 -- start start 2024-08-19T00:52:03.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.071+0000 7f5a28d8f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a24072f10 0x7f5a241977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.071+0000 7f5a28d8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a240744e0 0x7f5a24197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.071+0000 7f5a28d8f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a24198260 con 0x7f5a240744e0 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.071+0000 7f5a28d8f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a241983d0 con 0x7f5a24072f10 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a19d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a240744e0 0x7f5a24197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a19d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a240744e0 0x7f5a24197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39222/0 (socket says 172.21.15.17:39222) 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a19d9b640 1 -- 172.21.15.17:0/2990546080 learned_addr learned my addr 172.21.15.17:0/2990546080 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a2259c640 1 --2- 172.21.15.17:0/2990546080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a24072f10 0x7f5a241977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a19d9b640 1 -- 172.21.15.17:0/2990546080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a24072f10 msgr2=0x7f5a241977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a19d9b640 1 --2- 172.21.15.17:0/2990546080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a24072f10 0x7f5a241977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a19d9b640 1 -- 172.21.15.17:0/2990546080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a14009560 con 0x7f5a240744e0 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a19d9b640 1 --2- 172.21.15.17:0/2990546080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a240744e0 0x7f5a24197d20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00c8a0 tx=0x7f5a0c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a1bfff640 1 -- 172.21.15.17:0/2990546080 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0c007b80 con 0x7f5a240744e0 2024-08-19T00:52:03.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a1bfff640 1 -- 172.21.15.17:0/2990546080 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a0c007ce0 con 0x7f5a240744e0 2024-08-19T00:52:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2990546080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2419ceb0 con 0x7f5a240744e0 2024-08-19T00:52:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a1bfff640 1 -- 172.21.15.17:0/2990546080 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a0c018810 con 0x7f5a240744e0 2024-08-19T00:52:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.072+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2990546080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2419d400 con 0x7f5a240744e0 2024-08-19T00:52:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.073+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2990546080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2410a960 con 0x7f5a240744e0 2024-08-19T00:52:03.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.074+0000 7f5a1bfff640 1 -- 172.21.15.17:0/2990546080 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5a0c018a80 con 0x7f5a240744e0 2024-08-19T00:52:03.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.074+0000 7f5a1bfff640 1 --2- 172.21.15.17:0/2990546080 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f5a1006cc50 0x7f5a1006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:03.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.074+0000 7f5a1bfff640 1 -- 172.21.15.17:0/2990546080 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4358+0+0 (secure 0 0 0) 0x7f5a0c08c010 con 0x7f5a240744e0 2024-08-19T00:52:03.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.074+0000 7f5a2259c640 1 --2- 172.21.15.17:0/2990546080 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f5a1006cc50 0x7f5a1006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:03.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.075+0000 7f5a2259c640 1 --2- 172.21.15.17:0/2990546080 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f5a1006cc50 0x7f5a1006f110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009230 tx=0x7f5a14005b50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:03.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.079+0000 7f5a1bfff640 1 -- 172.21.15.17:0/2990546080 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f5a0c0568e0 con 0x7f5a240744e0 2024-08-19T00:52:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.250+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2990546080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f5a2410ab40 con 0x7f5a240744e0 2024-08-19T00:52:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.250+0000 7f5a1bfff640 1 -- 172.21.15.17:0/2990546080 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f5a0c059f00 con 0x7f5a240744e0 2024-08-19T00:52:03.252 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:52:03.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.252+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2990546080 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f5a1006cc50 msgr2=0x7f5a1006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:03.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.252+0000 7f5a28d8f640 1 --2- 172.21.15.17:0/2990546080 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f5a1006cc50 0x7f5a1006f110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5a14009230 tx=0x7f5a14005b50 comp rx=0 tx=0).stop 2024-08-19T00:52:03.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.252+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2990546080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a240744e0 msgr2=0x7f5a24197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:03.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.252+0000 7f5a28d8f640 1 --2- 172.21.15.17:0/2990546080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a240744e0 0x7f5a24197d20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c00c8a0 tx=0x7f5a0c00cd60 comp rx=0 tx=0).stop 2024-08-19T00:52:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.252+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2990546080 shutdown_connections 2024-08-19T00:52:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.252+0000 7f5a28d8f640 1 --2- 172.21.15.17:0/2990546080 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f5a1006cc50 0x7f5a1006f110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.252+0000 7f5a28d8f640 1 --2- 172.21.15.17:0/2990546080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a240744e0 0x7f5a24197d20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.252+0000 7f5a28d8f640 1 --2- 172.21.15.17:0/2990546080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5a24072f10 0x7f5a241977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.252+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2990546080 >> 172.21.15.17:0/2990546080 conn(0x7f5a240fb310 msgr2=0x7f5a24105960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.252+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2990546080 shutdown_connections 2024-08-19T00:52:03.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:03.252+0000 7f5a28d8f640 1 -- 172.21.15.17:0/2990546080 wait complete. 2024-08-19T00:52:03.796 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:03 smithi017 ceph-mon[16627]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-08-19T00:52:03.796 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:03 smithi017 ceph-mon[16627]: osdmap e38: 6 total, 5 up, 6 in 2024-08-19T00:52:03.796 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:03 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:52:03.796 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:03 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:52:03.796 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:03 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2990546080' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-19T00:52:03.818 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1724028698,"num_in_osds":6,"osd_in_since":1724028705,"num_remapped_pgs":0} 2024-08-19T00:52:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:03 smithi086 ceph-mon[24511]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]': finished 2024-08-19T00:52:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:03 smithi086 ceph-mon[24511]: osdmap e38: 6 total, 5 up, 6 in 2024-08-19T00:52:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:03 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:52:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:03 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:52:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:03 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/2990546080' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-19T00:52:04.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: purged_snaps scrub starts 2024-08-19T00:52:04.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: purged_snaps scrub ok 2024-08-19T00:52:04.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:52:04.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: osd.5 [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485] boot 2024-08-19T00:52:04.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: osdmap e39: 6 total, 6 up, 6 in 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:52:04.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:52:04.820 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-19T00:52:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: purged_snaps scrub starts 2024-08-19T00:52:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: purged_snaps scrub ok 2024-08-19T00:52:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-08-19T00:52:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: osd.5 [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485] boot 2024-08-19T00:52:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: osdmap e39: 6 total, 6 up, 6 in 2024-08-19T00:52:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:52:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:52:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:52:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:52:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:52:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:52:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:52:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:52:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:52:05.025 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:05.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:05 smithi017 ceph-mon[16627]: Detected new or changed devices on smithi086 2024-08-19T00:52:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:05 smithi017 ceph-mon[16627]: Adjusting osd_memory_target on smithi086 to 4970M 2024-08-19T00:52:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:05 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:05 smithi017 ceph-mon[16627]: osdmap e40: 6 total, 6 up, 6 in 2024-08-19T00:52:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:05 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:52:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:05 smithi086 ceph-mon[24511]: Detected new or changed devices on smithi086 2024-08-19T00:52:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:05 smithi086 ceph-mon[24511]: Adjusting osd_memory_target on smithi086 to 4970M 2024-08-19T00:52:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:05 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:52:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:05 smithi086 ceph-mon[24511]: osdmap e40: 6 total, 6 up, 6 in 2024-08-19T00:52:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:05 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:52:06.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.825+0000 7efeea99f640 1 -- 172.21.15.17:0/2329713708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee40fe8a0 msgr2=0x7efee40feca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:06.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.825+0000 7efeea99f640 1 --2- 172.21.15.17:0/2329713708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee40fe8a0 0x7efee40feca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efed4009c20 tx=0x7efed402a970 comp rx=0 tx=0).stop 2024-08-19T00:52:06.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.825+0000 7efeea99f640 1 -- 172.21.15.17:0/2329713708 shutdown_connections 2024-08-19T00:52:06.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.825+0000 7efeea99f640 1 --2- 172.21.15.17:0/2329713708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efee40ffaa0 0x7efee40fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:06.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.825+0000 7efeea99f640 1 --2- 172.21.15.17:0/2329713708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee40fe8a0 0x7efee40feca0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:06.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.825+0000 7efeea99f640 1 -- 172.21.15.17:0/2329713708 >> 172.21.15.17:0/2329713708 conn(0x7efee40fa010 msgr2=0x7efee40fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:06.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.825+0000 7efeea99f640 1 -- 172.21.15.17:0/2329713708 shutdown_connections 2024-08-19T00:52:06.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.825+0000 7efeea99f640 1 -- 172.21.15.17:0/2329713708 wait complete. 2024-08-19T00:52:06.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efeea99f640 1 Processor -- start 2024-08-19T00:52:06.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efeea99f640 1 -- start start 2024-08-19T00:52:06.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efeea99f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efee40fe8a0 0x7efee4068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:06.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efeea99f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee40ffaa0 0x7efee419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efeea99f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee4195f90 con 0x7efee40ffaa0 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efeea99f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee419caf0 con 0x7efee40fe8a0 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efee919c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee40ffaa0 0x7efee419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efee919c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee40ffaa0 0x7efee419c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46514/0 (socket says 172.21.15.17:46514) 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efee919c640 1 -- 172.21.15.17:0/3578326894 learned_addr learned my addr 172.21.15.17:0/3578326894 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efee999d640 1 --2- 172.21.15.17:0/3578326894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efee40fe8a0 0x7efee4068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efee919c640 1 -- 172.21.15.17:0/3578326894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efee40fe8a0 msgr2=0x7efee4068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efee919c640 1 --2- 172.21.15.17:0/3578326894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efee40fe8a0 0x7efee4068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.826+0000 7efee919c640 1 -- 172.21.15.17:0/3578326894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed4009900 con 0x7efee40ffaa0 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.827+0000 7efee919c640 1 --2- 172.21.15.17:0/3578326894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee40ffaa0 0x7efee419c5b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efed800c8a0 tx=0x7efed800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.827+0000 7efee2ffd640 1 -- 172.21.15.17:0/3578326894 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efed8007b70 con 0x7efee40ffaa0 2024-08-19T00:52:06.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.827+0000 7efee2ffd640 1 -- 172.21.15.17:0/3578326894 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efed8007cd0 con 0x7efee40ffaa0 2024-08-19T00:52:06.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.827+0000 7efee2ffd640 1 -- 172.21.15.17:0/3578326894 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efed8018840 con 0x7efee40ffaa0 2024-08-19T00:52:06.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.827+0000 7efeea99f640 1 -- 172.21.15.17:0/3578326894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee419ccf0 con 0x7efee40ffaa0 2024-08-19T00:52:06.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.827+0000 7efeea99f640 1 -- 172.21.15.17:0/3578326894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee419d2c0 con 0x7efee40ffaa0 2024-08-19T00:52:06.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.828+0000 7efeea99f640 1 -- 172.21.15.17:0/3578326894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee4107490 con 0x7efee40ffaa0 2024-08-19T00:52:06.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.828+0000 7efee2ffd640 1 -- 172.21.15.17:0/3578326894 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efed800f450 con 0x7efee40ffaa0 2024-08-19T00:52:06.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.829+0000 7efee2ffd640 1 --2- 172.21.15.17:0/3578326894 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efecc06cc50 0x7efecc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:06.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.829+0000 7efee2ffd640 1 -- 172.21.15.17:0/3578326894 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7efed808bf60 con 0x7efee40ffaa0 2024-08-19T00:52:06.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.829+0000 7efee999d640 1 --2- 172.21.15.17:0/3578326894 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efecc06cc50 0x7efecc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:06.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.829+0000 7efee999d640 1 --2- 172.21.15.17:0/3578326894 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efecc06cc50 0x7efecc06f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efed4000f80 tx=0x7efed403d040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:06.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:06.833+0000 7efee2ffd640 1 -- 172.21.15.17:0/3578326894 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7efed80bfde0 con 0x7efee40ffaa0 2024-08-19T00:52:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:06 smithi017 ceph-mon[16627]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:06 smithi086 ceph-mon[24511]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:07.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.009+0000 7efeea99f640 1 -- 172.21.15.17:0/3578326894 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7efee4107620 con 0x7efee40ffaa0 2024-08-19T00:52:07.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.009+0000 7efee2ffd640 1 -- 172.21.15.17:0/3578326894 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7efed80566f0 con 0x7efee40ffaa0 2024-08-19T00:52:07.011 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:52:07.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.011+0000 7efeea99f640 1 -- 172.21.15.17:0/3578326894 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efecc06cc50 msgr2=0x7efecc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:07.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.011+0000 7efeea99f640 1 --2- 172.21.15.17:0/3578326894 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efecc06cc50 0x7efecc06f110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efed4000f80 tx=0x7efed403d040 comp rx=0 tx=0).stop 2024-08-19T00:52:07.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.011+0000 7efeea99f640 1 -- 172.21.15.17:0/3578326894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee40ffaa0 msgr2=0x7efee419c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:07.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.011+0000 7efeea99f640 1 --2- 172.21.15.17:0/3578326894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee40ffaa0 0x7efee419c5b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efed800c8a0 tx=0x7efed800cd60 comp rx=0 tx=0).stop 2024-08-19T00:52:07.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.011+0000 7efeea99f640 1 -- 172.21.15.17:0/3578326894 shutdown_connections 2024-08-19T00:52:07.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.011+0000 7efeea99f640 1 --2- 172.21.15.17:0/3578326894 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efecc06cc50 0x7efecc06f110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:07.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.011+0000 7efeea99f640 1 --2- 172.21.15.17:0/3578326894 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efee40ffaa0 0x7efee419c5b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:07.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.011+0000 7efeea99f640 1 --2- 172.21.15.17:0/3578326894 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efee40fe8a0 0x7efee4068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:07.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.011+0000 7efeea99f640 1 -- 172.21.15.17:0/3578326894 >> 172.21.15.17:0/3578326894 conn(0x7efee40fa010 msgr2=0x7efee4102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:07.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.012+0000 7efeea99f640 1 -- 172.21.15.17:0/3578326894 shutdown_connections 2024-08-19T00:52:07.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:07.012+0000 7efeea99f640 1 -- 172.21.15.17:0/3578326894 wait complete. 2024-08-19T00:52:07.705 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1724028723,"num_in_osds":6,"osd_in_since":1724028705,"num_remapped_pgs":0} 2024-08-19T00:52:07.705 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:52:07.727 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:07 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3578326894' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-19T00:52:07.910 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:07.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:07 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3578326894' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-19T00:52:08.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:08 smithi017 ceph-mon[16627]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:08.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:08 smithi086 ceph-mon[24511]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:09.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.389+0000 7fe574a66640 1 -- 172.21.15.17:0/3711003836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe570101610 msgr2=0x7fe570109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:09.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.389+0000 7fe574a66640 1 --2- 172.21.15.17:0/3711003836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe570101610 0x7fe570109b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe5600098b0 tx=0x7fe56002a560 comp rx=0 tx=0).stop 2024-08-19T00:52:09.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.389+0000 7fe574a66640 1 -- 172.21.15.17:0/3711003836 shutdown_connections 2024-08-19T00:52:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.389+0000 7fe574a66640 1 --2- 172.21.15.17:0/3711003836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe570101610 0x7fe570109b00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.389+0000 7fe574a66640 1 --2- 172.21.15.17:0/3711003836 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe570100cf0 0x7fe5701010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.389+0000 7fe574a66640 1 -- 172.21.15.17:0/3711003836 >> 172.21.15.17:0/3711003836 conn(0x7fe5700758a0 msgr2=0x7fe5700fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.389+0000 7fe574a66640 1 -- 172.21.15.17:0/3711003836 shutdown_connections 2024-08-19T00:52:09.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.389+0000 7fe574a66640 1 -- 172.21.15.17:0/3711003836 wait complete. 2024-08-19T00:52:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.389+0000 7fe574a66640 1 Processor -- start 2024-08-19T00:52:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe574a66640 1 -- start start 2024-08-19T00:52:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe574a66640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe570100cf0 0x7fe57019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe574a66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe570101610 0x7fe57019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe574a66640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57019c410 con 0x7fe570101610 2024-08-19T00:52:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe574a66640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5701959a0 con 0x7fe570100cf0 2024-08-19T00:52:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe56dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe570101610 0x7fe57019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe56dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe570101610 0x7fe57019bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46518/0 (socket says 172.21.15.17:46518) 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe56dd9b640 1 -- 172.21.15.17:0/726871349 learned_addr learned my addr 172.21.15.17:0/726871349 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe56e59c640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe570100cf0 0x7fe57019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe56dd9b640 1 -- 172.21.15.17:0/726871349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe570100cf0 msgr2=0x7fe57019b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe56dd9b640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe570100cf0 0x7fe57019b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe56dd9b640 1 -- 172.21.15.17:0/726871349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe560009560 con 0x7fe570101610 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe56e59c640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe570100cf0 0x7fe57019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.390+0000 7fe56dd9b640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe570101610 0x7fe57019bdf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe560006010 tx=0x7fe5600055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.391+0000 7fe55f7fe640 1 -- 172.21.15.17:0/726871349 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe560004aa0 con 0x7fe570101610 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.391+0000 7fe55f7fe640 1 -- 172.21.15.17:0/726871349 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe560031470 con 0x7fe570101610 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.391+0000 7fe574a66640 1 -- 172.21.15.17:0/726871349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe570195c20 con 0x7fe570101610 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.391+0000 7fe55f7fe640 1 -- 172.21.15.17:0/726871349 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe560003940 con 0x7fe570101610 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.391+0000 7fe574a66640 1 -- 172.21.15.17:0/726871349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe570196110 con 0x7fe570101610 2024-08-19T00:52:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.392+0000 7fe574a66640 1 -- 172.21.15.17:0/726871349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5700684d0 con 0x7fe570101610 2024-08-19T00:52:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.392+0000 7fe55f7fe640 1 -- 172.21.15.17:0/726871349 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe560031b90 con 0x7fe570101610 2024-08-19T00:52:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.393+0000 7fe55f7fe640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe55806cc50 0x7fe55806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.393+0000 7fe56e59c640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe55806cc50 0x7fe55806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.393+0000 7fe55f7fe640 1 -- 172.21.15.17:0/726871349 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe5600ad030 con 0x7fe570101610 2024-08-19T00:52:09.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.393+0000 7fe56e59c640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe55806cc50 0x7fe55806f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe5640058c0 tx=0x7fe564005850 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:09.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.397+0000 7fe55f7fe640 1 -- 172.21.15.17:0/726871349 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe560077740 con 0x7fe570101610 2024-08-19T00:52:09.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.570+0000 7fe574a66640 1 -- 172.21.15.17:0/726871349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5701043a0 con 0x7fe570101610 2024-08-19T00:52:09.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.571+0000 7fe55f7fe640 1 -- 172.21.15.17:0/726871349 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11288 (secure 0 0 0) 0x7fe560004c00 con 0x7fe570101610 2024-08-19T00:52:09.573 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:52:09.573 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","created":"2024-08-19T00:46:30.075551+0000","modified":"2024-08-19T00:52:04.607386+0000","last_up_change":"2024-08-19T00:52:03.601810+0000","last_in_change":"2024-08-19T00:51:45.028792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:50:53.781001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fee1cedd-6d2d-4326-b9aa-70cf773cdd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6803","nonce":3585477898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6805","nonce":3585477898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6809","nonce":3585477898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6807","nonce":3585477898}]},"public_addr":"172.21.15.17:6803/3585477898","cluster_addr":"172.21.15.17:6805/3585477898","heartbeat_back_addr":"172.21.15.17:6809/3585477898","heartbeat_front_addr":"172.21.15.17:6807/3585477898","state":["exists","up"]},{"osd":1,"uuid":"6e23eb70-4061-4131-9484-7804d3a81f80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6811","nonce":2276907054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6813","nonce":2276907054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6817","nonce":2276907054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6815","nonce":2276907054}]},"public_addr":"172.21.15.17:6811/2276907054","cluster_addr":"172.21.15.17:6813/2276907054","heartbeat_back_addr":"172.21.15.17:6817/2276907054","heartbeat_front_addr":"172.21.15.17:6815/2276907054","state":["exists","up"]},{"osd":2,"uuid":"b1f317a9-f60e-4cac-b05d-0c6dcc872166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6819","nonce":306210649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6821","nonce":306210649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6825","nonce":306210649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6823","nonce":306210649}]},"public_addr":"172.21.15.17:6819/306210649","cluster_addr":"172.21.15.17:6821/306210649","heartbeat_back_addr":"172.21.15.17:6825/306210649","heartbeat_front_addr":"172.21.15.17:6823/306210649","state":["exists","up"]},{"osd":3,"uuid":"4ce99c8d-d9ed-410f-b31b-849ac4737f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6801","nonce":1485542183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6803","nonce":1485542183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6807","nonce":1485542183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6805","nonce":1485542183}]},"public_addr":"172.21.15.86:6801/1485542183","cluster_addr":"172.21.15.86:6803/1485542183","heartbeat_back_addr":"172.21.15.86:6807/1485542183","heartbeat_front_addr":"172.21.15.86:6805/1485542183","state":["exists","up"]},{"osd":4,"uuid":"a2789f76-5f10-4980-b852-44a7971a51e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6809","nonce":2303545562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6811","nonce":2303545562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6815","nonce":2303545562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6813","nonce":2303545562}]},"public_addr":"172.21.15.86:6809/2303545562","cluster_addr":"172.21.15.86:6811/2303545562","heartbeat_back_addr":"172.21.15.86:6815/2303545562","heartbeat_front_addr":"172.21.15.86:6813/2303545562","state":["exists","up"]},{"osd":5,"uuid":"afa3e4af-16cf-4533-8b85-24237f570833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6817","nonce":248380485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6819","nonce":248380485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6823","nonce":248380485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6821","nonce":248380485}]},"public_addr":"172.21.15.86:6817/248380485","cluster_addr":"172.21.15.86:6819/248380485","heartbeat_back_addr":"172.21.15.86:6823/248380485","heartbeat_front_addr":"172.21.15.86:6821/248380485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:49:57.652625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:50:23.236037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:50:49.920981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:51:12.291773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:51:36.876615+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:52:01.787036+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/106571410":"2024-08-20T00:48:35.469605+0000","172.21.15.17:0/443932275":"2024-08-20T00:48:35.469605+0000","172.21.15.17:0/3980256538":"2024-08-20T00:46:59.495730+0000","172.21.15.17:6801/2005365781":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/167484781":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/1048807387":"2024-08-20T00:46:59.495730+0000","172.21.15.17:6800/2005365781":"2024-08-20T00:47:30.750898+0000","172.21.15.17:6800/1713288012":"2024-08-20T00:48:35.469605+0000","172.21.15.17:6800/2987236592":"2024-08-20T00:46:59.495730+0000","172.21.15.17:6801/2987236592":"2024-08-20T00:46:59.495730+0000","172.21.15.17:0/2235697696":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/2535118500":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/3079909971":"2024-08-20T00:46:59.495730+0000","172.21.15.17:0/3754113597":"2024-08-20T00:48:35.469605+0000","172.21.15.17:6801/1713288012":"2024-08-20T00:48:35.469605+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:52:09.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.573+0000 7fe574a66640 1 -- 172.21.15.17:0/726871349 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe55806cc50 msgr2=0x7fe55806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:09.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.573+0000 7fe574a66640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe55806cc50 0x7fe55806f110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe5640058c0 tx=0x7fe564005850 comp rx=0 tx=0).stop 2024-08-19T00:52:09.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.573+0000 7fe574a66640 1 -- 172.21.15.17:0/726871349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe570101610 msgr2=0x7fe57019bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:09.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.573+0000 7fe574a66640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe570101610 0x7fe57019bdf0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe560006010 tx=0x7fe5600055a0 comp rx=0 tx=0).stop 2024-08-19T00:52:09.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.573+0000 7fe574a66640 1 -- 172.21.15.17:0/726871349 shutdown_connections 2024-08-19T00:52:09.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.573+0000 7fe574a66640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe55806cc50 0x7fe55806f110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:09.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.573+0000 7fe574a66640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe570101610 0x7fe57019bdf0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.573+0000 7fe574a66640 1 --2- 172.21.15.17:0/726871349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe570100cf0 0x7fe57019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.573+0000 7fe574a66640 1 -- 172.21.15.17:0/726871349 >> 172.21.15.17:0/726871349 conn(0x7fe5700758a0 msgr2=0x7fe570101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.573+0000 7fe574a66640 1 -- 172.21.15.17:0/726871349 shutdown_connections 2024-08-19T00:52:09.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:09.573+0000 7fe574a66640 1 -- 172.21.15.17:0/726871349 wait complete. 2024-08-19T00:52:09.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:09 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/726871349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:52:09.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:09 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/726871349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:52:10.290 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-19T00:50:53.781001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-19T00:52:10.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-19T00:52:10.545 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:10.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:10 smithi017 ceph-mon[16627]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:10 smithi086 ceph-mon[24511]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:11.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:11 smithi017 ceph-mon[16627]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:11.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:11 smithi086 ceph-mon[24511]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:12.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.123+0000 7efd8cd98640 1 -- 172.21.15.17:0/2848194168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880ffda0 msgr2=0x7efd88100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.123+0000 7efd8cd98640 1 --2- 172.21.15.17:0/2848194168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880ffda0 0x7efd88100180 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efd78009880 tx=0x7efd7802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.123+0000 7efd8cd98640 1 -- 172.21.15.17:0/2848194168 shutdown_connections 2024-08-19T00:52:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.123+0000 7efd8cd98640 1 --2- 172.21.15.17:0/2848194168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd88100750 0x7efd881047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.123+0000 7efd8cd98640 1 --2- 172.21.15.17:0/2848194168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880ffda0 0x7efd88100180 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.123+0000 7efd8cd98640 1 -- 172.21.15.17:0/2848194168 >> 172.21.15.17:0/2848194168 conn(0x7efd880fb840 msgr2=0x7efd880fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.123+0000 7efd8cd98640 1 -- 172.21.15.17:0/2848194168 shutdown_connections 2024-08-19T00:52:12.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.123+0000 7efd8cd98640 1 -- 172.21.15.17:0/2848194168 wait complete. 2024-08-19T00:52:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.124+0000 7efd8cd98640 1 Processor -- start 2024-08-19T00:52:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.124+0000 7efd8cd98640 1 -- start start 2024-08-19T00:52:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.124+0000 7efd8cd98640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd880ffda0 0x7efd8819b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.124+0000 7efd8cd98640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd88100750 0x7efd8819bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.124+0000 7efd8cd98640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8819c370 con 0x7efd88100750 2024-08-19T00:52:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.124+0000 7efd8cd98640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd88195950 con 0x7efd880ffda0 2024-08-19T00:52:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd85d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd88100750 0x7efd8819bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:12.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd85d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd88100750 0x7efd8819bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46538/0 (socket says 172.21.15.17:46538) 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd85d9b640 1 -- 172.21.15.17:0/4071563377 learned_addr learned my addr 172.21.15.17:0/4071563377 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd8659c640 1 --2- 172.21.15.17:0/4071563377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd880ffda0 0x7efd8819b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd85d9b640 1 -- 172.21.15.17:0/4071563377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd880ffda0 msgr2=0x7efd8819b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd85d9b640 1 --2- 172.21.15.17:0/4071563377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd880ffda0 0x7efd8819b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd85d9b640 1 -- 172.21.15.17:0/4071563377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78009560 con 0x7efd88100750 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd85d9b640 1 --2- 172.21.15.17:0/4071563377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd88100750 0x7efd8819bd50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00d8d0 tx=0x7efd7c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd777fe640 1 -- 172.21.15.17:0/4071563377 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7c00bea0 con 0x7efd88100750 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd777fe640 1 -- 172.21.15.17:0/4071563377 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd7c009c00 con 0x7efd88100750 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd8cd98640 1 -- 172.21.15.17:0/4071563377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd88195c30 con 0x7efd88100750 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd777fe640 1 -- 172.21.15.17:0/4071563377 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7c00f710 con 0x7efd88100750 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.125+0000 7efd8cd98640 1 -- 172.21.15.17:0/4071563377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd88196180 con 0x7efd88100750 2024-08-19T00:52:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.126+0000 7efd8cd98640 1 -- 172.21.15.17:0/4071563377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd88101280 con 0x7efd88100750 2024-08-19T00:52:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.127+0000 7efd777fe640 1 -- 172.21.15.17:0/4071563377 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efd7c010460 con 0x7efd88100750 2024-08-19T00:52:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.127+0000 7efd777fe640 1 --2- 172.21.15.17:0/4071563377 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc50 0x7efd7006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.127+0000 7efd777fe640 1 -- 172.21.15.17:0/4071563377 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7efd7c08bb90 con 0x7efd88100750 2024-08-19T00:52:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.127+0000 7efd8659c640 1 --2- 172.21.15.17:0/4071563377 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc50 0x7efd7006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:12.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.128+0000 7efd8659c640 1 --2- 172.21.15.17:0/4071563377 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc50 0x7efd7006f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd78000c00 tx=0x7efd78004040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:12.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.132+0000 7efd777fe640 1 -- 172.21.15.17:0/4071563377 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7efd7c056320 con 0x7efd88100750 2024-08-19T00:52:12.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.302+0000 7efd8cd98640 1 -- 172.21.15.17:0/4071563377 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efd881080b0 con 0x7efd88100750 2024-08-19T00:52:12.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.302+0000 7efd777fe640 1 -- 172.21.15.17:0/4071563377 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7efd7c059940 con 0x7efd88100750 2024-08-19T00:52:12.305 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-08-19T00:52:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.304+0000 7efd8cd98640 1 -- 172.21.15.17:0/4071563377 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc50 msgr2=0x7efd7006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.304+0000 7efd8cd98640 1 --2- 172.21.15.17:0/4071563377 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc50 0x7efd7006f110 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd78000c00 tx=0x7efd78004040 comp rx=0 tx=0).stop 2024-08-19T00:52:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.304+0000 7efd8cd98640 1 -- 172.21.15.17:0/4071563377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd88100750 msgr2=0x7efd8819bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.304+0000 7efd8cd98640 1 --2- 172.21.15.17:0/4071563377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd88100750 0x7efd8819bd50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00d8d0 tx=0x7efd7c00dd90 comp rx=0 tx=0).stop 2024-08-19T00:52:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.304+0000 7efd8cd98640 1 -- 172.21.15.17:0/4071563377 shutdown_connections 2024-08-19T00:52:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.304+0000 7efd8cd98640 1 --2- 172.21.15.17:0/4071563377 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc50 0x7efd7006f110 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.304+0000 7efd8cd98640 1 --2- 172.21.15.17:0/4071563377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd88100750 0x7efd8819bd50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.304+0000 7efd8cd98640 1 --2- 172.21.15.17:0/4071563377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd880ffda0 0x7efd8819b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.304+0000 7efd8cd98640 1 -- 172.21.15.17:0/4071563377 >> 172.21.15.17:0/4071563377 conn(0x7efd880fb840 msgr2=0x7efd880fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.305+0000 7efd8cd98640 1 -- 172.21.15.17:0/4071563377 shutdown_connections 2024-08-19T00:52:12.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:12.305+0000 7efd8cd98640 1 -- 172.21.15.17:0/4071563377 wait complete. 2024-08-19T00:52:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:12 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/4071563377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-19T00:52:12.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:12 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/4071563377' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-19T00:52:13.010 INFO:tasks.cephadm:Setting up client nodes... 2024-08-19T00:52:13.011 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-19T00:52:13.219 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:13 smithi017 ceph-mon[16627]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:13.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:13 smithi086 ceph-mon[24511]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:14.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 -- 172.21.15.17:0/1327780548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351c0ffc70 msgr2=0x7f351c1000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:14.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 --2- 172.21.15.17:0/1327780548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351c0ffc70 0x7f351c1000f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3508009880 tx=0x7f350802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 -- 172.21.15.17:0/1327780548 shutdown_connections 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 --2- 172.21.15.17:0/1327780548 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351c0ffc70 0x7f351c1000f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 --2- 172.21.15.17:0/1327780548 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f351c0fea70 0x7f351c0fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 -- 172.21.15.17:0/1327780548 >> 172.21.15.17:0/1327780548 conn(0x7f351c0fa200 msgr2=0x7f351c0fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 -- 172.21.15.17:0/1327780548 shutdown_connections 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 -- 172.21.15.17:0/1327780548 wait complete. 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 Processor -- start 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 -- start start 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351c0fea70 0x7f351c195600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f351c0ffc70 0x7f351c195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c196110 con 0x7f351c0fea70 2024-08-19T00:52:14.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.845+0000 7f3522ed0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c196280 con 0x7f351c0ffc70 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f3520c6c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351c0fea70 0x7f351c195600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f3520c6c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351c0fea70 0x7f351c195600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46556/0 (socket says 172.21.15.17:46556) 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f3520c6c640 1 -- 172.21.15.17:0/520133108 learned_addr learned my addr 172.21.15.17:0/520133108 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f351bfff640 1 --2- 172.21.15.17:0/520133108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f351c0ffc70 0x7f351c195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f3520c6c640 1 -- 172.21.15.17:0/520133108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f351c0ffc70 msgr2=0x7f351c195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f3520c6c640 1 --2- 172.21.15.17:0/520133108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f351c0ffc70 0x7f351c195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f3520c6c640 1 -- 172.21.15.17:0/520133108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3508009560 con 0x7f351c0fea70 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f3520c6c640 1 --2- 172.21.15.17:0/520133108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351c0fea70 0x7f351c195600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f351000e970 tx=0x7f351000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f3519ffb640 1 -- 172.21.15.17:0/520133108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3510009700 con 0x7f351c0fea70 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f3519ffb640 1 -- 172.21.15.17:0/520133108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f351000cc90 con 0x7f351c0fea70 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f3522ed0640 1 -- 172.21.15.17:0/520133108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c19ad20 con 0x7f351c0fea70 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.846+0000 7f3519ffb640 1 -- 172.21.15.17:0/520133108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3510010430 con 0x7f351c0fea70 2024-08-19T00:52:14.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.847+0000 7f3522ed0640 1 -- 172.21.15.17:0/520133108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c19b260 con 0x7f351c0fea70 2024-08-19T00:52:14.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.848+0000 7f3522ed0640 1 -- 172.21.15.17:0/520133108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351c107660 con 0x7f351c0fea70 2024-08-19T00:52:14.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.848+0000 7f3519ffb640 1 -- 172.21.15.17:0/520133108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3510003f90 con 0x7f351c0fea70 2024-08-19T00:52:14.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.848+0000 7f3519ffb640 1 --2- 172.21.15.17:0/520133108 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f350c06cc50 0x7f350c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:14.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.849+0000 7f3519ffb640 1 -- 172.21.15.17:0/520133108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3510014070 con 0x7f351c0fea70 2024-08-19T00:52:14.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.849+0000 7f351bfff640 1 --2- 172.21.15.17:0/520133108 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f350c06cc50 0x7f350c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:14.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.849+0000 7f351bfff640 1 --2- 172.21.15.17:0/520133108 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f350c06cc50 0x7f350c06f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3508000c00 tx=0x7f35080314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:14.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:14.853+0000 7f3519ffb640 1 -- 172.21.15.17:0/520133108 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f3510056b30 con 0x7f351c0fea70 2024-08-19T00:52:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.089+0000 7f3522ed0640 1 -- 172.21.15.17:0/520133108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f351c19b500 con 0x7f351c0fea70 2024-08-19T00:52:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.093+0000 7f3519ffb640 1 -- 172.21.15.17:0/520133108 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f351005a150 con 0x7f351c0fea70 2024-08-19T00:52:15.095 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-08-19T00:52:15.095 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA/l8Jm+yVuBRAAFZ9YKVu9xyvQ21YLh3+0ew== 2024-08-19T00:52:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.095+0000 7f3522ed0640 1 -- 172.21.15.17:0/520133108 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f350c06cc50 msgr2=0x7f350c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.095+0000 7f3522ed0640 1 --2- 172.21.15.17:0/520133108 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f350c06cc50 0x7f350c06f110 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3508000c00 tx=0x7f35080314e0 comp rx=0 tx=0).stop 2024-08-19T00:52:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.095+0000 7f3522ed0640 1 -- 172.21.15.17:0/520133108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351c0fea70 msgr2=0x7f351c195600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.095+0000 7f3522ed0640 1 --2- 172.21.15.17:0/520133108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351c0fea70 0x7f351c195600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f351000e970 tx=0x7f351000ee30 comp rx=0 tx=0).stop 2024-08-19T00:52:15.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.095+0000 7f3522ed0640 1 -- 172.21.15.17:0/520133108 shutdown_connections 2024-08-19T00:52:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.095+0000 7f3522ed0640 1 --2- 172.21.15.17:0/520133108 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f350c06cc50 0x7f350c06f110 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.095+0000 7f3522ed0640 1 --2- 172.21.15.17:0/520133108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f351c0ffc70 0x7f351c195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.095+0000 7f3522ed0640 1 --2- 172.21.15.17:0/520133108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f351c0fea70 0x7f351c195600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.095+0000 7f3522ed0640 1 -- 172.21.15.17:0/520133108 >> 172.21.15.17:0/520133108 conn(0x7f351c0fa200 msgr2=0x7f351c067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.095+0000 7f3522ed0640 1 -- 172.21.15.17:0/520133108 shutdown_connections 2024-08-19T00:52:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:15.095+0000 7f3522ed0640 1 -- 172.21.15.17:0/520133108 wait complete. 2024-08-19T00:52:15.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:15 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/520133108' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-19T00:52:15.397 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:15 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/520133108' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-19T00:52:15.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:15 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/520133108' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-19T00:52:15.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:15 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/520133108' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-19T00:52:15.848 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:52:15.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-19T00:52:15.849 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-19T00:52:15.889 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-19T00:52:16.105 INFO:teuthology.orchestra.run.smithi086.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T00:52:16.169 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:16 smithi086 ceph-mon[24511]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:16.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:16 smithi017 ceph-mon[16627]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.535+0000 7fb7209c6640 1 -- 172.21.15.86:0/2000788614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb71c0ff420 msgr2=0x7fb71c0ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.535+0000 7fb7209c6640 1 --2- 172.21.15.86:0/2000788614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb71c0ff420 0x7fb71c0ff8a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb710009880 tx=0x7fb71002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.535+0000 7fb7209c6640 1 -- 172.21.15.86:0/2000788614 shutdown_connections 2024-08-19T00:52:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.535+0000 7fb7209c6640 1 --2- 172.21.15.86:0/2000788614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb71c0ff420 0x7fb71c0ff8a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:17.540 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.535+0000 7fb7209c6640 1 --2- 172.21.15.86:0/2000788614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb71c0fe220 0x7fb71c0fe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.535+0000 7fb7209c6640 1 -- 172.21.15.86:0/2000788614 >> 172.21.15.86:0/2000788614 conn(0x7fb71c0f99b0 msgr2=0x7fb71c0fbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.535+0000 7fb7209c6640 1 -- 172.21.15.86:0/2000788614 shutdown_connections 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.536+0000 7fb7209c6640 1 -- 172.21.15.86:0/2000788614 wait complete. 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.536+0000 7fb7209c6640 1 Processor -- start 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.536+0000 7fb7209c6640 1 -- start start 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.536+0000 7fb7209c6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb71c0fe220 0x7fb71c0fbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.536+0000 7fb7209c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb71c0ff420 0x7fb71c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb7209c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c19aa30 con 0x7fb71c0ff420 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb7209c6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c19aba0 con 0x7fb71c0fe220 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb71a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb71c0fe220 0x7fb71c0fbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb71a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb71c0fe220 0x7fb71c0fbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.86:35398/0 (socket says 172.21.15.86:35398) 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb71a59c640 1 -- 172.21.15.86:0/1700789946 learned_addr learned my addr 172.21.15.86:0/1700789946 (peer_addr_for_me v2:172.21.15.86:0/0) 2024-08-19T00:52:17.541 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb719d9b640 1 --2- 172.21.15.86:0/1700789946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb71c0ff420 0x7fb71c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb71a59c640 1 -- 172.21.15.86:0/1700789946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb71c0ff420 msgr2=0x7fb71c19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb71a59c640 1 --2- 172.21.15.86:0/1700789946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb71c0ff420 0x7fb71c19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb71a59c640 1 -- 172.21.15.86:0/1700789946 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710009560 con 0x7fb71c0fe220 2024-08-19T00:52:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb71a59c640 1 --2- 172.21.15.86:0/1700789946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb71c0fe220 0x7fb71c0fbf90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00b3d0 tx=0x7fb70c00b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb70b7fe640 1 -- 172.21.15.86:0/1700789946 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb70c011800 con 0x7fb71c0fe220 2024-08-19T00:52:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb70b7fe640 1 -- 172.21.15.86:0/1700789946 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb70c011e20 con 0x7fb71c0fe220 2024-08-19T00:52:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb7209c6640 1 -- 172.21.15.86:0/1700789946 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c19ae80 con 0x7fb71c0fe220 2024-08-19T00:52:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb70b7fe640 1 -- 172.21.15.86:0/1700789946 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb70c00f510 con 0x7fb71c0fe220 2024-08-19T00:52:17.542 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.537+0000 7fb7209c6640 1 -- 172.21.15.86:0/1700789946 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c19b370 con 0x7fb71c0fe220 2024-08-19T00:52:17.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.538+0000 7fb7209c6640 1 -- 172.21.15.86:0/1700789946 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c18de40 con 0x7fb71c0fe220 2024-08-19T00:52:17.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.539+0000 7fb70b7fe640 1 -- 172.21.15.86:0/1700789946 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb70c010380 con 0x7fb71c0fe220 2024-08-19T00:52:17.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.539+0000 7fb70b7fe640 1 --2- 172.21.15.86:0/1700789946 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb70406cc50 0x7fb70406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:17.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.539+0000 7fb70b7fe640 1 -- 172.21.15.86:0/1700789946 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb70c08bb80 con 0x7fb71c0fe220 2024-08-19T00:52:17.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.540+0000 7fb719d9b640 1 --2- 172.21.15.86:0/1700789946 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb70406cc50 0x7fb70406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:17.544 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.540+0000 7fb719d9b640 1 --2- 172.21.15.86:0/1700789946 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb70406cc50 0x7fb70406f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb710000c00 tx=0x7fb7100314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:17.546 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.544+0000 7fb70b7fe640 1 -- 172.21.15.86:0/1700789946 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb70c056310 con 0x7fb71c0fe220 2024-08-19T00:52:17.769 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.767+0000 7fb7209c6640 1 -- 172.21.15.86:0/1700789946 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb71c106eb0 con 0x7fb71c0fe220 2024-08-19T00:52:17.774 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.772+0000 7fb70b7fe640 1 -- 172.21.15.86:0/1700789946 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb70c059930 con 0x7fb71c0fe220 2024-08-19T00:52:17.774 INFO:teuthology.orchestra.run.smithi086.stdout:[client.1] 2024-08-19T00:52:17.775 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQBBl8JmbQ/gLRAAkBJmkjo0vCXAFbZN1bauIw== 2024-08-19T00:52:17.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.774+0000 7fb7209c6640 1 -- 172.21.15.86:0/1700789946 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb70406cc50 msgr2=0x7fb70406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:17.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.774+0000 7fb7209c6640 1 --2- 172.21.15.86:0/1700789946 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb70406cc50 0x7fb70406f110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb710000c00 tx=0x7fb7100314e0 comp rx=0 tx=0).stop 2024-08-19T00:52:17.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.774+0000 7fb7209c6640 1 -- 172.21.15.86:0/1700789946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb71c0fe220 msgr2=0x7fb71c0fbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:17.776 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.774+0000 7fb7209c6640 1 --2- 172.21.15.86:0/1700789946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb71c0fe220 0x7fb71c0fbf90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00b3d0 tx=0x7fb70c00b890 comp rx=0 tx=0).stop 2024-08-19T00:52:17.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.774+0000 7fb7209c6640 1 -- 172.21.15.86:0/1700789946 shutdown_connections 2024-08-19T00:52:17.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.774+0000 7fb7209c6640 1 --2- 172.21.15.86:0/1700789946 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb70406cc50 0x7fb70406f110 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:17.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.774+0000 7fb7209c6640 1 --2- 172.21.15.86:0/1700789946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb71c0ff420 0x7fb71c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:17.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.774+0000 7fb7209c6640 1 --2- 172.21.15.86:0/1700789946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb71c0fe220 0x7fb71c0fbf90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:17.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.774+0000 7fb7209c6640 1 -- 172.21.15.86:0/1700789946 >> 172.21.15.86:0/1700789946 conn(0x7fb71c0f99b0 msgr2=0x7fb71c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:17.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.774+0000 7fb7209c6640 1 -- 172.21.15.86:0/1700789946 shutdown_connections 2024-08-19T00:52:17.777 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:52:17.774+0000 7fb7209c6640 1 -- 172.21.15.86:0/1700789946 wait complete. 2024-08-19T00:52:18.417 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:52:18.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-08-19T00:52:18.417 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-19T00:52:18.454 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-19T00:52:18.454 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-19T00:52:18.455 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph mgr dump --format=json 2024-08-19T00:52:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:18.796 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:18 smithi017 ceph-mon[16627]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:18.796 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:18 smithi017 ceph-mon[16627]: from='client.? 172.21.15.86:0/1700789946' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-19T00:52:18.796 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:18 smithi017 ceph-mon[16627]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-19T00:52:18.796 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:18 smithi017 ceph-mon[16627]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-19T00:52:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:18 smithi086 ceph-mon[24511]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:18 smithi086 ceph-mon[24511]: from='client.? 172.21.15.86:0/1700789946' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-19T00:52:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:18 smithi086 ceph-mon[24511]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-19T00:52:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:18 smithi086 ceph-mon[24511]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-19T00:52:20.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.295+0000 7ffa67320640 1 -- 172.21.15.17:0/2588768189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa60100d10 msgr2=0x7ffa601010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:20.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.295+0000 7ffa67320640 1 --2- 172.21.15.17:0/2588768189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa60100d10 0x7ffa601010f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0098b0 tx=0x7ffa5c02a560 comp rx=0 tx=0).stop 2024-08-19T00:52:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.295+0000 7ffa67320640 1 -- 172.21.15.17:0/2588768189 shutdown_connections 2024-08-19T00:52:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.295+0000 7ffa67320640 1 --2- 172.21.15.17:0/2588768189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa60101630 0x7ffa60109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.295+0000 7ffa67320640 1 --2- 172.21.15.17:0/2588768189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa60100d10 0x7ffa601010f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.295+0000 7ffa67320640 1 -- 172.21.15.17:0/2588768189 >> 172.21.15.17:0/2588768189 conn(0x7ffa600758a0 msgr2=0x7ffa600fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.295+0000 7ffa67320640 1 -- 172.21.15.17:0/2588768189 shutdown_connections 2024-08-19T00:52:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.295+0000 7ffa67320640 1 -- 172.21.15.17:0/2588768189 wait complete. 2024-08-19T00:52:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.295+0000 7ffa67320640 1 Processor -- start 2024-08-19T00:52:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa67320640 1 -- start start 2024-08-19T00:52:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa67320640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa60100d10 0x7ffa600fe970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa67320640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa60101630 0x7ffa600feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:20.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa67320640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600ff3f0 con 0x7ffa60101630 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa67320640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600ff530 con 0x7ffa60100d10 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa648bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa60101630 0x7ffa600feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa648bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa60101630 0x7ffa600feeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45628/0 (socket says 172.21.15.17:45628) 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa648bb640 1 -- 172.21.15.17:0/2204149373 learned_addr learned my addr 172.21.15.17:0/2204149373 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa650bc640 1 --2- 172.21.15.17:0/2204149373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa60100d10 0x7ffa600fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa648bb640 1 -- 172.21.15.17:0/2204149373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa60100d10 msgr2=0x7ffa600fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa648bb640 1 --2- 172.21.15.17:0/2204149373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa60100d10 0x7ffa600fe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa648bb640 1 -- 172.21.15.17:0/2204149373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c009560 con 0x7ffa60101630 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa648bb640 1 --2- 172.21.15.17:0/2204149373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa60101630 0x7ffa600feeb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000c8f0 tx=0x7ffa5000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa567fc640 1 -- 172.21.15.17:0/2204149373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa50007b80 con 0x7ffa60101630 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa67320640 1 -- 172.21.15.17:0/2204149373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa601a1dc0 con 0x7ffa60101630 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa567fc640 1 -- 172.21.15.17:0/2204149373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa500054e0 con 0x7ffa60101630 2024-08-19T00:52:20.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.296+0000 7ffa567fc640 1 -- 172.21.15.17:0/2204149373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa5000f450 con 0x7ffa60101630 2024-08-19T00:52:20.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.297+0000 7ffa67320640 1 -- 172.21.15.17:0/2204149373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa601a21d0 con 0x7ffa60101630 2024-08-19T00:52:20.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.297+0000 7ffa67320640 1 -- 172.21.15.17:0/2204149373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa600684b0 con 0x7ffa60101630 2024-08-19T00:52:20.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.298+0000 7ffa567fc640 1 -- 172.21.15.17:0/2204149373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffa50004f60 con 0x7ffa60101630 2024-08-19T00:52:20.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.298+0000 7ffa567fc640 1 --2- 172.21.15.17:0/2204149373 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffa4c06cc50 0x7ffa4c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:20.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.299+0000 7ffa567fc640 1 -- 172.21.15.17:0/2204149373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ffa5008bd70 con 0x7ffa60101630 2024-08-19T00:52:20.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.299+0000 7ffa650bc640 1 --2- 172.21.15.17:0/2204149373 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffa4c06cc50 0x7ffa4c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:20.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.299+0000 7ffa650bc640 1 --2- 172.21.15.17:0/2204149373 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffa4c06cc50 0x7ffa4c06f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009230 tx=0x7ffa5c005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:20.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.303+0000 7ffa567fc640 1 -- 172.21.15.17:0/2204149373 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ffa50056480 con 0x7ffa60101630 2024-08-19T00:52:20.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.523+0000 7ffa67320640 1 -- 172.21.15.17:0/2204149373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ffa601010f0 con 0x7ffa60101630 2024-08-19T00:52:20.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.526+0000 7ffa567fc640 1 -- 172.21.15.17:0/2204149373 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+174012 (secure 0 0 0) 0x7ffa50059aa0 con 0x7ffa60101630 2024-08-19T00:52:20.531 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:52:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.528+0000 7ffa67320640 1 -- 172.21.15.17:0/2204149373 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffa4c06cc50 msgr2=0x7ffa4c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.528+0000 7ffa67320640 1 --2- 172.21.15.17:0/2204149373 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffa4c06cc50 0x7ffa4c06f110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009230 tx=0x7ffa5c005a20 comp rx=0 tx=0).stop 2024-08-19T00:52:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.528+0000 7ffa67320640 1 -- 172.21.15.17:0/2204149373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa60101630 msgr2=0x7ffa600feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.528+0000 7ffa67320640 1 --2- 172.21.15.17:0/2204149373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa60101630 0x7ffa600feeb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000c8f0 tx=0x7ffa5000cdb0 comp rx=0 tx=0).stop 2024-08-19T00:52:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.529+0000 7ffa67320640 1 -- 172.21.15.17:0/2204149373 shutdown_connections 2024-08-19T00:52:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.529+0000 7ffa67320640 1 --2- 172.21.15.17:0/2204149373 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffa4c06cc50 0x7ffa4c06f110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.529+0000 7ffa67320640 1 --2- 172.21.15.17:0/2204149373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa60101630 0x7ffa600feeb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.529+0000 7ffa67320640 1 --2- 172.21.15.17:0/2204149373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa60100d10 0x7ffa600fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.529+0000 7ffa67320640 1 -- 172.21.15.17:0/2204149373 >> 172.21.15.17:0/2204149373 conn(0x7ffa600758a0 msgr2=0x7ffa60101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.529+0000 7ffa67320640 1 -- 172.21.15.17:0/2204149373 shutdown_connections 2024-08-19T00:52:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:20.529+0000 7ffa67320640 1 -- 172.21.15.17:0/2204149373 wait complete. 2024-08-19T00:52:20.828 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:20 smithi017 ceph-mon[16627]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:20.828 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:52:20.828 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:20 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2204149373' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-19T00:52:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:20 smithi086 ceph-mon[24511]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:52:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:20 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/2204149373' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-19T00:52:21.292 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":19,"flags":0,"active_gid":14213,"active_name":"smithi017.hfpawi","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":3703965574},{"type":"v1","addr":"172.21.15.17:6801","nonce":3703965574}]},"active_addr":"172.21.15.17:6801/3703965574","active_change":"2024-08-19T00:48:35.469727+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14236,"name":"smithi086.uthxct","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.17:8443/","prometheus":"http://172.21.15.17:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1418099011}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1647015034}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":861177328}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":1256622841}]}]} 2024-08-19T00:52:21.296 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-19T00:52:21.296 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-19T00:52:21.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:52:21.507 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:22.887 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:22 smithi017 ceph-mon[16627]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:22 smithi086 ceph-mon[24511]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.100+0000 7fc66910e640 1 -- 172.21.15.17:0/136643735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664104a30 msgr2=0x7fc664104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.100+0000 7fc66910e640 1 --2- 172.21.15.17:0/136643735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664104a30 0x7fc664104e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc654009880 tx=0x7fc65402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.100+0000 7fc66910e640 1 -- 172.21.15.17:0/136643735 shutdown_connections 2024-08-19T00:52:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.100+0000 7fc66910e640 1 --2- 172.21.15.17:0/136643735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6640fea30 0x7fc6640fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.100+0000 7fc66910e640 1 --2- 172.21.15.17:0/136643735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664104a30 0x7fc664104e10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.100+0000 7fc66910e640 1 -- 172.21.15.17:0/136643735 >> 172.21.15.17:0/136643735 conn(0x7fc6640fa730 msgr2=0x7fc6640fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.100+0000 7fc66910e640 1 -- 172.21.15.17:0/136643735 shutdown_connections 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.100+0000 7fc66910e640 1 -- 172.21.15.17:0/136643735 wait complete. 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.101+0000 7fc66910e640 1 Processor -- start 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.101+0000 7fc66910e640 1 -- start start 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.101+0000 7fc66910e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6640fea30 0x7fc664100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.101+0000 7fc66910e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664104a30 0x7fc664100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.101+0000 7fc66910e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664101080 con 0x7fc664104a30 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.101+0000 7fc66910e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641011c0 con 0x7fc6640fea30 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.101+0000 7fc66259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664104a30 0x7fc664100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:23.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.101+0000 7fc66259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664104a30 0x7fc664100b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45638/0 (socket says 172.21.15.17:45638) 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.101+0000 7fc66259c640 1 -- 172.21.15.17:0/1406606983 learned_addr learned my addr 172.21.15.17:0/1406606983 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.101+0000 7fc662d9d640 1 --2- 172.21.15.17:0/1406606983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6640fea30 0x7fc664100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.102+0000 7fc66259c640 1 -- 172.21.15.17:0/1406606983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6640fea30 msgr2=0x7fc664100600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.102+0000 7fc66259c640 1 --2- 172.21.15.17:0/1406606983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6640fea30 0x7fc664100600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.102+0000 7fc66259c640 1 -- 172.21.15.17:0/1406606983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc654009560 con 0x7fc664104a30 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.102+0000 7fc66259c640 1 --2- 172.21.15.17:0/1406606983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664104a30 0x7fc664100b40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc65800b420 tx=0x7fc65800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.102+0000 7fc64bfff640 1 -- 172.21.15.17:0/1406606983 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc658011800 con 0x7fc664104a30 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.102+0000 7fc64bfff640 1 -- 172.21.15.17:0/1406606983 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc658011e20 con 0x7fc664104a30 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.102+0000 7fc66910e640 1 -- 172.21.15.17:0/1406606983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6641a1dd0 con 0x7fc664104a30 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.102+0000 7fc64bfff640 1 -- 172.21.15.17:0/1406606983 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc65800f2e0 con 0x7fc664104a30 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.102+0000 7fc66910e640 1 -- 172.21.15.17:0/1406606983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6641a21e0 con 0x7fc664104a30 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.103+0000 7fc66910e640 1 -- 172.21.15.17:0/1406606983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc664100170 con 0x7fc664104a30 2024-08-19T00:52:23.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.104+0000 7fc64bfff640 1 -- 172.21.15.17:0/1406606983 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc658010380 con 0x7fc664104a30 2024-08-19T00:52:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.104+0000 7fc64bfff640 1 --2- 172.21.15.17:0/1406606983 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc64c06cc50 0x7fc64c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.104+0000 7fc64bfff640 1 -- 172.21.15.17:0/1406606983 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc65808b720 con 0x7fc664104a30 2024-08-19T00:52:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.104+0000 7fc662d9d640 1 --2- 172.21.15.17:0/1406606983 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc64c06cc50 0x7fc64c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.105+0000 7fc662d9d640 1 --2- 172.21.15.17:0/1406606983 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc64c06cc50 0x7fc64c06f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc654009230 tx=0x7fc6540058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:23.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.109+0000 7fc64bfff640 1 -- 172.21.15.17:0/1406606983 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fc658055eb0 con 0x7fc664104a30 2024-08-19T00:52:23.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.279+0000 7fc66910e640 1 -- 172.21.15.17:0/1406606983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6640fef10 con 0x7fc664104a30 2024-08-19T00:52:23.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.280+0000 7fc64bfff640 1 -- 172.21.15.17:0/1406606983 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11288 (secure 0 0 0) 0x7fc6580594d0 con 0x7fc664104a30 2024-08-19T00:52:23.282 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:52:23.282 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","created":"2024-08-19T00:46:30.075551+0000","modified":"2024-08-19T00:52:04.607386+0000","last_up_change":"2024-08-19T00:52:03.601810+0000","last_in_change":"2024-08-19T00:51:45.028792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:50:53.781001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fee1cedd-6d2d-4326-b9aa-70cf773cdd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6803","nonce":3585477898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6805","nonce":3585477898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6809","nonce":3585477898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6807","nonce":3585477898}]},"public_addr":"172.21.15.17:6803/3585477898","cluster_addr":"172.21.15.17:6805/3585477898","heartbeat_back_addr":"172.21.15.17:6809/3585477898","heartbeat_front_addr":"172.21.15.17:6807/3585477898","state":["exists","up"]},{"osd":1,"uuid":"6e23eb70-4061-4131-9484-7804d3a81f80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6811","nonce":2276907054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6813","nonce":2276907054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6817","nonce":2276907054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6815","nonce":2276907054}]},"public_addr":"172.21.15.17:6811/2276907054","cluster_addr":"172.21.15.17:6813/2276907054","heartbeat_back_addr":"172.21.15.17:6817/2276907054","heartbeat_front_addr":"172.21.15.17:6815/2276907054","state":["exists","up"]},{"osd":2,"uuid":"b1f317a9-f60e-4cac-b05d-0c6dcc872166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6819","nonce":306210649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6821","nonce":306210649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6825","nonce":306210649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6823","nonce":306210649}]},"public_addr":"172.21.15.17:6819/306210649","cluster_addr":"172.21.15.17:6821/306210649","heartbeat_back_addr":"172.21.15.17:6825/306210649","heartbeat_front_addr":"172.21.15.17:6823/306210649","state":["exists","up"]},{"osd":3,"uuid":"4ce99c8d-d9ed-410f-b31b-849ac4737f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6801","nonce":1485542183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6803","nonce":1485542183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6807","nonce":1485542183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6805","nonce":1485542183}]},"public_addr":"172.21.15.86:6801/1485542183","cluster_addr":"172.21.15.86:6803/1485542183","heartbeat_back_addr":"172.21.15.86:6807/1485542183","heartbeat_front_addr":"172.21.15.86:6805/1485542183","state":["exists","up"]},{"osd":4,"uuid":"a2789f76-5f10-4980-b852-44a7971a51e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6809","nonce":2303545562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6811","nonce":2303545562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6815","nonce":2303545562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6813","nonce":2303545562}]},"public_addr":"172.21.15.86:6809/2303545562","cluster_addr":"172.21.15.86:6811/2303545562","heartbeat_back_addr":"172.21.15.86:6815/2303545562","heartbeat_front_addr":"172.21.15.86:6813/2303545562","state":["exists","up"]},{"osd":5,"uuid":"afa3e4af-16cf-4533-8b85-24237f570833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6817","nonce":248380485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6819","nonce":248380485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6823","nonce":248380485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6821","nonce":248380485}]},"public_addr":"172.21.15.86:6817/248380485","cluster_addr":"172.21.15.86:6819/248380485","heartbeat_back_addr":"172.21.15.86:6823/248380485","heartbeat_front_addr":"172.21.15.86:6821/248380485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:49:57.652625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:50:23.236037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:50:49.920981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:51:12.291773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:51:36.876615+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:52:01.787036+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/106571410":"2024-08-20T00:48:35.469605+0000","172.21.15.17:0/443932275":"2024-08-20T00:48:35.469605+0000","172.21.15.17:0/3980256538":"2024-08-20T00:46:59.495730+0000","172.21.15.17:6801/2005365781":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/167484781":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/1048807387":"2024-08-20T00:46:59.495730+0000","172.21.15.17:6800/2005365781":"2024-08-20T00:47:30.750898+0000","172.21.15.17:6800/1713288012":"2024-08-20T00:48:35.469605+0000","172.21.15.17:6800/2987236592":"2024-08-20T00:46:59.495730+0000","172.21.15.17:6801/2987236592":"2024-08-20T00:46:59.495730+0000","172.21.15.17:0/2235697696":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/2535118500":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/3079909971":"2024-08-20T00:46:59.495730+0000","172.21.15.17:0/3754113597":"2024-08-20T00:48:35.469605+0000","172.21.15.17:6801/1713288012":"2024-08-20T00:48:35.469605+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:52:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.282+0000 7fc66910e640 1 -- 172.21.15.17:0/1406606983 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc64c06cc50 msgr2=0x7fc64c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.282+0000 7fc66910e640 1 --2- 172.21.15.17:0/1406606983 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc64c06cc50 0x7fc64c06f110 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc654009230 tx=0x7fc6540058d0 comp rx=0 tx=0).stop 2024-08-19T00:52:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.282+0000 7fc66910e640 1 -- 172.21.15.17:0/1406606983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664104a30 msgr2=0x7fc664100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.282+0000 7fc66910e640 1 --2- 172.21.15.17:0/1406606983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664104a30 0x7fc664100b40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc65800b420 tx=0x7fc65800b8e0 comp rx=0 tx=0).stop 2024-08-19T00:52:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.282+0000 7fc66910e640 1 -- 172.21.15.17:0/1406606983 shutdown_connections 2024-08-19T00:52:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.282+0000 7fc66910e640 1 --2- 172.21.15.17:0/1406606983 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc64c06cc50 0x7fc64c06f110 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:23.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.282+0000 7fc66910e640 1 --2- 172.21.15.17:0/1406606983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc664104a30 0x7fc664100b40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:23.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.282+0000 7fc66910e640 1 --2- 172.21.15.17:0/1406606983 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6640fea30 0x7fc664100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:23.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.282+0000 7fc66910e640 1 -- 172.21.15.17:0/1406606983 >> 172.21.15.17:0/1406606983 conn(0x7fc6640fa730 msgr2=0x7fc6640fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:23.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.282+0000 7fc66910e640 1 -- 172.21.15.17:0/1406606983 shutdown_connections 2024-08-19T00:52:23.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:23.282+0000 7fc66910e640 1 -- 172.21.15.17:0/1406606983 wait complete. 2024-08-19T00:52:23.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:23 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1406606983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:52:23.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:23 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/1406606983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:52:24.070 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-19T00:52:24.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-19T00:52:24.280 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:24.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:24 smithi017 ceph-mon[16627]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:24.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:24 smithi086 ceph-mon[24511]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:25.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.936+0000 7f9e16a8a640 1 -- 172.21.15.17:0/3438265396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe9f0 msgr2=0x7f9e100fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:25.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.936+0000 7f9e16a8a640 1 --2- 172.21.15.17:0/3438265396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe9f0 0x7f9e100fee50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009880 tx=0x7f9e0002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:25.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.936+0000 7f9e16a8a640 1 -- 172.21.15.17:0/3438265396 shutdown_connections 2024-08-19T00:52:25.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.936+0000 7f9e16a8a640 1 --2- 172.21.15.17:0/3438265396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe9f0 0x7f9e100fee50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:25.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.936+0000 7f9e16a8a640 1 --2- 172.21.15.17:0/3438265396 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e101049f0 0x7f9e10104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:25.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.936+0000 7f9e16a8a640 1 -- 172.21.15.17:0/3438265396 >> 172.21.15.17:0/3438265396 conn(0x7f9e100758a0 msgr2=0x7f9e100fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:25.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.936+0000 7f9e16a8a640 1 -- 172.21.15.17:0/3438265396 shutdown_connections 2024-08-19T00:52:25.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.936+0000 7f9e16a8a640 1 -- 172.21.15.17:0/3438265396 wait complete. 2024-08-19T00:52:25.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.937+0000 7f9e16a8a640 1 Processor -- start 2024-08-19T00:52:25.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.937+0000 7f9e16a8a640 1 -- start start 2024-08-19T00:52:25.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.937+0000 7f9e16a8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe9f0 0x7f9e10196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:25.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.937+0000 7f9e16a8a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e101049f0 0x7f9e10196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:25.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.937+0000 7f9e16a8a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10197450 con 0x7f9e100fe9f0 2024-08-19T00:52:25.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.937+0000 7f9e16a8a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e101975c0 con 0x7f9e101049f0 2024-08-19T00:52:25.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.937+0000 7f9e14826640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe9f0 0x7f9e10196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:25.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.937+0000 7f9e14826640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe9f0 0x7f9e10196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45652/0 (socket says 172.21.15.17:45652) 2024-08-19T00:52:25.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.937+0000 7f9e14826640 1 -- 172.21.15.17:0/578423961 learned_addr learned my addr 172.21.15.17:0/578423961 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:25.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.938+0000 7f9e0ffff640 1 --2- 172.21.15.17:0/578423961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e101049f0 0x7f9e10196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:25.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.938+0000 7f9e14826640 1 -- 172.21.15.17:0/578423961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e101049f0 msgr2=0x7f9e10196e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:25.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.938+0000 7f9e14826640 1 --2- 172.21.15.17:0/578423961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e101049f0 0x7f9e10196e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:25.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.938+0000 7f9e14826640 1 -- 172.21.15.17:0/578423961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00009560 con 0x7f9e100fe9f0 2024-08-19T00:52:25.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.938+0000 7f9e14826640 1 --2- 172.21.15.17:0/578423961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe9f0 0x7f9e10196940 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9df800d6f0 tx=0x7f9df800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:25.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.938+0000 7f9e0dffb640 1 -- 172.21.15.17:0/578423961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9df8009a30 con 0x7f9e100fe9f0 2024-08-19T00:52:25.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.938+0000 7f9e16a8a640 1 -- 172.21.15.17:0/578423961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1019f9b0 con 0x7f9e100fe9f0 2024-08-19T00:52:25.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.938+0000 7f9e0dffb640 1 -- 172.21.15.17:0/578423961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9df80054e0 con 0x7f9e100fe9f0 2024-08-19T00:52:25.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.938+0000 7f9e0dffb640 1 -- 172.21.15.17:0/578423961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9df8010460 con 0x7f9e100fe9f0 2024-08-19T00:52:25.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.938+0000 7f9e16a8a640 1 -- 172.21.15.17:0/578423961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1019fe20 con 0x7f9e100fe9f0 2024-08-19T00:52:25.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.939+0000 7f9e16a8a640 1 -- 172.21.15.17:0/578423961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e10100130 con 0x7f9e100fe9f0 2024-08-19T00:52:25.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.940+0000 7f9e0dffb640 1 -- 172.21.15.17:0/578423961 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9df8009b90 con 0x7f9e100fe9f0 2024-08-19T00:52:25.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.941+0000 7f9e0dffb640 1 --2- 172.21.15.17:0/578423961 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9dfc06cc50 0x7f9dfc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:25.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.941+0000 7f9e0dffb640 1 -- 172.21.15.17:0/578423961 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9df808b9f0 con 0x7f9e100fe9f0 2024-08-19T00:52:25.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.941+0000 7f9e0ffff640 1 --2- 172.21.15.17:0/578423961 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9dfc06cc50 0x7f9dfc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:25.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.941+0000 7f9e0ffff640 1 --2- 172.21.15.17:0/578423961 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9dfc06cc50 0x7f9dfc06f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009230 tx=0x7f9e000058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:25.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:25.945+0000 7f9e0dffb640 1 -- 172.21.15.17:0/578423961 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f9df808de60 con 0x7f9e100fe9f0 2024-08-19T00:52:26.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.119+0000 7f9e16a8a640 1 -- 172.21.15.17:0/578423961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e10068300 con 0x7f9e100fe9f0 2024-08-19T00:52:26.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.120+0000 7f9e0dffb640 1 -- 172.21.15.17:0/578423961 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11288 (secure 0 0 0) 0x7f9df8020090 con 0x7f9e100fe9f0 2024-08-19T00:52:26.123 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:52:26.123 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"fsid":"61e0bb80-5dc4-11ef-bccf-c7b262605968","created":"2024-08-19T00:46:30.075551+0000","modified":"2024-08-19T00:52:04.607386+0000","last_up_change":"2024-08-19T00:52:03.601810+0000","last_in_change":"2024-08-19T00:51:45.028792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-19T00:50:53.781001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fee1cedd-6d2d-4326-b9aa-70cf773cdd6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6803","nonce":3585477898}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6805","nonce":3585477898}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6809","nonce":3585477898}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":3585477898},{"type":"v1","addr":"172.21.15.17:6807","nonce":3585477898}]},"public_addr":"172.21.15.17:6803/3585477898","cluster_addr":"172.21.15.17:6805/3585477898","heartbeat_back_addr":"172.21.15.17:6809/3585477898","heartbeat_front_addr":"172.21.15.17:6807/3585477898","state":["exists","up"]},{"osd":1,"uuid":"6e23eb70-4061-4131-9484-7804d3a81f80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6811","nonce":2276907054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6813","nonce":2276907054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6817","nonce":2276907054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":2276907054},{"type":"v1","addr":"172.21.15.17:6815","nonce":2276907054}]},"public_addr":"172.21.15.17:6811/2276907054","cluster_addr":"172.21.15.17:6813/2276907054","heartbeat_back_addr":"172.21.15.17:6817/2276907054","heartbeat_front_addr":"172.21.15.17:6815/2276907054","state":["exists","up"]},{"osd":2,"uuid":"b1f317a9-f60e-4cac-b05d-0c6dcc872166","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6819","nonce":306210649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6821","nonce":306210649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6825","nonce":306210649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":306210649},{"type":"v1","addr":"172.21.15.17:6823","nonce":306210649}]},"public_addr":"172.21.15.17:6819/306210649","cluster_addr":"172.21.15.17:6821/306210649","heartbeat_back_addr":"172.21.15.17:6825/306210649","heartbeat_front_addr":"172.21.15.17:6823/306210649","state":["exists","up"]},{"osd":3,"uuid":"4ce99c8d-d9ed-410f-b31b-849ac4737f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6801","nonce":1485542183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6803","nonce":1485542183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6807","nonce":1485542183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1485542183},{"type":"v1","addr":"172.21.15.86:6805","nonce":1485542183}]},"public_addr":"172.21.15.86:6801/1485542183","cluster_addr":"172.21.15.86:6803/1485542183","heartbeat_back_addr":"172.21.15.86:6807/1485542183","heartbeat_front_addr":"172.21.15.86:6805/1485542183","state":["exists","up"]},{"osd":4,"uuid":"a2789f76-5f10-4980-b852-44a7971a51e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6809","nonce":2303545562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6811","nonce":2303545562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6815","nonce":2303545562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":2303545562},{"type":"v1","addr":"172.21.15.86:6813","nonce":2303545562}]},"public_addr":"172.21.15.86:6809/2303545562","cluster_addr":"172.21.15.86:6811/2303545562","heartbeat_back_addr":"172.21.15.86:6815/2303545562","heartbeat_front_addr":"172.21.15.86:6813/2303545562","state":["exists","up"]},{"osd":5,"uuid":"afa3e4af-16cf-4533-8b85-24237f570833","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6817","nonce":248380485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6819","nonce":248380485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6823","nonce":248380485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":248380485},{"type":"v1","addr":"172.21.15.86:6821","nonce":248380485}]},"public_addr":"172.21.15.86:6817/248380485","cluster_addr":"172.21.15.86:6819/248380485","heartbeat_back_addr":"172.21.15.86:6823/248380485","heartbeat_front_addr":"172.21.15.86:6821/248380485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:49:57.652625+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:50:23.236037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:50:49.920981+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:51:12.291773+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:51:36.876615+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-08-19T00:52:01.787036+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:0/106571410":"2024-08-20T00:48:35.469605+0000","172.21.15.17:0/443932275":"2024-08-20T00:48:35.469605+0000","172.21.15.17:0/3980256538":"2024-08-20T00:46:59.495730+0000","172.21.15.17:6801/2005365781":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/167484781":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/1048807387":"2024-08-20T00:46:59.495730+0000","172.21.15.17:6800/2005365781":"2024-08-20T00:47:30.750898+0000","172.21.15.17:6800/1713288012":"2024-08-20T00:48:35.469605+0000","172.21.15.17:6800/2987236592":"2024-08-20T00:46:59.495730+0000","172.21.15.17:6801/2987236592":"2024-08-20T00:46:59.495730+0000","172.21.15.17:0/2235697696":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/2535118500":"2024-08-20T00:47:30.750898+0000","172.21.15.17:0/3079909971":"2024-08-20T00:46:59.495730+0000","172.21.15.17:0/3754113597":"2024-08-20T00:48:35.469605+0000","172.21.15.17:6801/1713288012":"2024-08-20T00:48:35.469605+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-19T00:52:26.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.122+0000 7f9e16a8a640 1 -- 172.21.15.17:0/578423961 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9dfc06cc50 msgr2=0x7f9dfc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:26.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.122+0000 7f9e16a8a640 1 --2- 172.21.15.17:0/578423961 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9dfc06cc50 0x7f9dfc06f110 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009230 tx=0x7f9e000058d0 comp rx=0 tx=0).stop 2024-08-19T00:52:26.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.122+0000 7f9e16a8a640 1 -- 172.21.15.17:0/578423961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe9f0 msgr2=0x7f9e10196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:26.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.122+0000 7f9e16a8a640 1 --2- 172.21.15.17:0/578423961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe9f0 0x7f9e10196940 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9df800d6f0 tx=0x7f9df800dbb0 comp rx=0 tx=0).stop 2024-08-19T00:52:26.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.122+0000 7f9e16a8a640 1 -- 172.21.15.17:0/578423961 shutdown_connections 2024-08-19T00:52:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.122+0000 7f9e16a8a640 1 --2- 172.21.15.17:0/578423961 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9dfc06cc50 0x7f9dfc06f110 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.122+0000 7f9e16a8a640 1 --2- 172.21.15.17:0/578423961 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e101049f0 0x7f9e10196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.122+0000 7f9e16a8a640 1 --2- 172.21.15.17:0/578423961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe9f0 0x7f9e10196940 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.122+0000 7f9e16a8a640 1 -- 172.21.15.17:0/578423961 >> 172.21.15.17:0/578423961 conn(0x7f9e100758a0 msgr2=0x7f9e100fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.122+0000 7f9e16a8a640 1 -- 172.21.15.17:0/578423961 shutdown_connections 2024-08-19T00:52:26.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:26.122+0000 7f9e16a8a640 1 -- 172.21.15.17:0/578423961 wait complete. 2024-08-19T00:52:26.750 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:26 smithi017 ceph-mon[16627]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:26.750 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:26 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/578423961' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:52:26.773 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-19T00:52:26.773 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-19T00:52:26.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-19T00:52:26.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-19T00:52:26.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-19T00:52:26.775 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-19T00:52:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:26 smithi086 ceph-mon[24511]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:26 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/578423961' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-19T00:52:27.068 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:27.309 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:27.745 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:27.747 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:27.748 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:27.759 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:28.891 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:28 smithi017 ceph-mon[16627]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:28 smithi086 ceph-mon[24511]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:30.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:30 smithi017 ceph-mon[16627]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:30 smithi086 ceph-mon[24511]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:31.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.108+0000 7fa831907640 1 -- 172.21.15.17:0/1800356437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0ffda0 msgr2=0x7fa82c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:31.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.108+0000 7fa831907640 1 --2- 172.21.15.17:0/1800356437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0ffda0 0x7fa82c100180 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009880 tx=0x7fa81c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:31.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.108+0000 7fa831907640 1 -- 172.21.15.17:0/1800356437 shutdown_connections 2024-08-19T00:52:31.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.108+0000 7fa831907640 1 --2- 172.21.15.17:0/1800356437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82c100750 0x7fa82c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:31.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.108+0000 7fa831907640 1 --2- 172.21.15.17:0/1800356437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0ffda0 0x7fa82c100180 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:31.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.108+0000 7fa831907640 1 -- 172.21.15.17:0/1800356437 >> 172.21.15.17:0/1800356437 conn(0x7fa82c0fb840 msgr2=0x7fa82c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:31.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.108+0000 7fa831907640 1 -- 172.21.15.17:0/1800356437 shutdown_connections 2024-08-19T00:52:31.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.108+0000 7fa831907640 1 -- 172.21.15.17:0/1800356437 wait complete. 2024-08-19T00:52:31.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa831907640 1 Processor -- start 2024-08-19T00:52:31.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa831907640 1 -- start start 2024-08-19T00:52:31.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa831907640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0ffda0 0x7fa82c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:31.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa831907640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82c100750 0x7fa82c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:31.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa831907640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c073230 con 0x7fa82c0ffda0 2024-08-19T00:52:31.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa831907640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0733a0 con 0x7fa82c100750 2024-08-19T00:52:31.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa82affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0ffda0 0x7fa82c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:31.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa82affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0ffda0 0x7fa82c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46150/0 (socket says 172.21.15.17:46150) 2024-08-19T00:52:31.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa82affd640 1 -- 172.21.15.17:0/2339111819 learned_addr learned my addr 172.21.15.17:0/2339111819 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:31.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa82a7fc640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82c100750 0x7fa82c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:31.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa82affd640 1 -- 172.21.15.17:0/2339111819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82c100750 msgr2=0x7fa82c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:31.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa82affd640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82c100750 0x7fa82c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:31.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.109+0000 7fa82affd640 1 -- 172.21.15.17:0/2339111819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c009560 con 0x7fa82c0ffda0 2024-08-19T00:52:31.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.110+0000 7fa82a7fc640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82c100750 0x7fa82c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:52:31.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.110+0000 7fa82affd640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0ffda0 0x7fa82c0727b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa81c02a9c0 tx=0x7fa81c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:31.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.110+0000 7fa830905640 1 -- 172.21.15.17:0/2339111819 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa81c004aa0 con 0x7fa82c0ffda0 2024-08-19T00:52:31.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.110+0000 7fa830905640 1 -- 172.21.15.17:0/2339111819 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa81c004c00 con 0x7fa82c0ffda0 2024-08-19T00:52:31.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.110+0000 7fa831907640 1 -- 172.21.15.17:0/2339111819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c073620 con 0x7fa82c0ffda0 2024-08-19T00:52:31.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.110+0000 7fa830905640 1 -- 172.21.15.17:0/2339111819 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa81c003ab0 con 0x7fa82c0ffda0 2024-08-19T00:52:31.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.110+0000 7fa831907640 1 -- 172.21.15.17:0/2339111819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c1a2010 con 0x7fa82c0ffda0 2024-08-19T00:52:31.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.111+0000 7fa831907640 1 -- 172.21.15.17:0/2339111819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa82c10d0f0 con 0x7fa82c0ffda0 2024-08-19T00:52:31.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.111+0000 7fa830905640 1 -- 172.21.15.17:0/2339111819 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa81c031d20 con 0x7fa82c0ffda0 2024-08-19T00:52:31.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.112+0000 7fa830905640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa81406cc50 0x7fa81406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:31.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.112+0000 7fa830905640 1 -- 172.21.15.17:0/2339111819 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa81c0ace60 con 0x7fa82c0ffda0 2024-08-19T00:52:31.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.112+0000 7fa82a7fc640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa81406cc50 0x7fa81406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:31.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.112+0000 7fa830905640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183] conn(0x7fa8140729e0 0x7fa814074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:31.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.112+0000 7fa830905640 1 -- 172.21.15.17:0/2339111819 --> [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8140754b0 con 0x7fa8140729e0 2024-08-19T00:52:31.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.112+0000 7fa830905640 1 -- 172.21.15.17:0/2339111819 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa81c0b2540 con 0x7fa82c0ffda0 2024-08-19T00:52:31.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.112+0000 7fa82a7fc640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa81406cc50 0x7fa81406f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa820006fd0 tx=0x7fa820008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:31.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.112+0000 7fa82b7fe640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183] conn(0x7fa8140729e0 0x7fa814074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:31.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.113+0000 7fa82b7fe640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183] conn(0x7fa8140729e0 0x7fa814074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:31.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.113+0000 7fa830905640 1 -- 172.21.15.17:0/2339111819 <== osd.3 v2:172.21.15.86:6800/1485542183 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa8140754b0 con 0x7fa8140729e0 2024-08-19T00:52:31.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.127+0000 7fa831907640 1 -- 172.21.15.17:0/2339111819 --> [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa82c073620 con 0x7fa8140729e0 2024-08-19T00:52:31.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.127+0000 7fa830905640 1 -- 172.21.15.17:0/2339111819 <== osd.3 v2:172.21.15.86:6800/1485542183 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa82c073620 con 0x7fa8140729e0 2024-08-19T00:52:31.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 -- 172.21.15.17:0/2339111819 >> [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183] conn(0x7fa8140729e0 msgr2=0x7fa814074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:31.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183] conn(0x7fa8140729e0 0x7fa814074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:31.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 -- 172.21.15.17:0/2339111819 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa81406cc50 msgr2=0x7fa81406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa81406cc50 0x7fa81406f110 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa820006fd0 tx=0x7fa820008040 comp rx=0 tx=0).stop 2024-08-19T00:52:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 -- 172.21.15.17:0/2339111819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0ffda0 msgr2=0x7fa82c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0ffda0 0x7fa82c0727b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa81c02a9c0 tx=0x7fa81c0055a0 comp rx=0 tx=0).stop 2024-08-19T00:52:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 -- 172.21.15.17:0/2339111819 shutdown_connections 2024-08-19T00:52:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa81406cc50 0x7fa81406f110 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa82c100750 0x7fa82c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.86:6800/1485542183,v1:172.21.15.86:6801/1485542183] conn(0x7fa8140729e0 0x7fa814074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 --2- 172.21.15.17:0/2339111819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa82c0ffda0 0x7fa82c0727b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 -- 172.21.15.17:0/2339111819 >> 172.21.15.17:0/2339111819 conn(0x7fa82c0fb840 msgr2=0x7fa82c0fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 -- 172.21.15.17:0/2339111819 shutdown_connections 2024-08-19T00:52:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:31.128+0000 7fa831907640 1 -- 172.21.15.17:0/2339111819 wait complete. 2024-08-19T00:52:32.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:32 smithi017 ceph-mon[16627]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:32 smithi086 ceph-mon[24511]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:33.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.354+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1610244797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22e8101610 msgr2=0x7f22e8109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:33.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.354+0000 7f22ee3cd640 1 --2- 172.21.15.17:0/1610244797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22e8101610 0x7f22e8109b00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f22dc0098b0 tx=0x7f22dc02a4d0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.354+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1610244797 shutdown_connections 2024-08-19T00:52:33.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.354+0000 7f22ee3cd640 1 --2- 172.21.15.17:0/1610244797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22e8101610 0x7f22e8109b00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.354+0000 7f22ee3cd640 1 --2- 172.21.15.17:0/1610244797 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e8100c60 0x7f22e8101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.354+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1610244797 >> 172.21.15.17:0/1610244797 conn(0x7f22e80fa730 msgr2=0x7f22e80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:33.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.354+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1610244797 shutdown_connections 2024-08-19T00:52:33.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.354+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1610244797 wait complete. 2024-08-19T00:52:33.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22ee3cd640 1 Processor -- start 2024-08-19T00:52:33.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22ee3cd640 1 -- start start 2024-08-19T00:52:33.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22ee3cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22e8100c60 0x7f22e819b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22ee3cd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e8101610 0x7f22e819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22ee3cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e819c330 con 0x7f22e8100c60 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22ee3cd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e8195950 con 0x7f22e8101610 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22e8100c60 0x7f22e819b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22e7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22e8100c60 0x7f22e819b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46174/0 (socket says 172.21.15.17:46174) 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22e7fff640 1 -- 172.21.15.17:0/1776380623 learned_addr learned my addr 172.21.15.17:0/1776380623 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22e77fe640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e8101610 0x7f22e819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22e7fff640 1 -- 172.21.15.17:0/1776380623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e8101610 msgr2=0x7f22e819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22e7fff640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e8101610 0x7f22e819bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.355+0000 7f22e7fff640 1 -- 172.21.15.17:0/1776380623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc009560 con 0x7f22e8100c60 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.356+0000 7f22e7fff640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22e8100c60 0x7f22e819b860 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f22d800c8a0 tx=0x7f22d800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:33.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.356+0000 7f22e57fa640 1 -- 172.21.15.17:0/1776380623 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22d8007b80 con 0x7f22e8100c60 2024-08-19T00:52:33.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.356+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1776380623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e8195c30 con 0x7f22e8100c60 2024-08-19T00:52:33.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.356+0000 7f22e57fa640 1 -- 172.21.15.17:0/1776380623 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f22d8007ce0 con 0x7f22e8100c60 2024-08-19T00:52:33.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.356+0000 7f22e57fa640 1 -- 172.21.15.17:0/1776380623 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22d8018810 con 0x7f22e8100c60 2024-08-19T00:52:33.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.356+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1776380623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e8196150 con 0x7f22e8100c60 2024-08-19T00:52:33.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.357+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1776380623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22e810d0b0 con 0x7f22e8100c60 2024-08-19T00:52:33.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.357+0000 7f22e57fa640 1 -- 172.21.15.17:0/1776380623 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f22d8018a80 con 0x7f22e8100c60 2024-08-19T00:52:33.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.358+0000 7f22e57fa640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f22d006cc50 0x7f22d006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:33.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.358+0000 7f22e57fa640 1 -- 172.21.15.17:0/1776380623 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f22d808c440 con 0x7f22e8100c60 2024-08-19T00:52:33.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.358+0000 7f22e77fe640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f22d006cc50 0x7f22d006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:33.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.358+0000 7f22e57fa640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898] conn(0x7f22d00729e0 0x7f22d0074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:33.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.358+0000 7f22e57fa640 1 -- 172.21.15.17:0/1776380623 --> [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22d00754b0 con 0x7f22d00729e0 2024-08-19T00:52:33.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.358+0000 7f22e57fa640 1 -- 172.21.15.17:0/1776380623 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22d808c8a0 con 0x7f22e8100c60 2024-08-19T00:52:33.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.358+0000 7f22ec96a640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898] conn(0x7f22d00729e0 0x7f22d0074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:33.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.358+0000 7f22e77fe640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f22d006cc50 0x7f22d006f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009230 tx=0x7f22dc005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:33.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.359+0000 7f22ec96a640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898] conn(0x7f22d00729e0 0x7f22d0074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:33.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.359+0000 7f22e57fa640 1 -- 172.21.15.17:0/1776380623 <== osd.0 v2:172.21.15.17:6802/3585477898 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f22d00754b0 con 0x7f22d00729e0 2024-08-19T00:52:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1776380623 --> [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22e8196690 con 0x7f22d00729e0 2024-08-19T00:52:33.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22e57fa640 1 -- 172.21.15.17:0/1776380623 <== osd.0 v2:172.21.15.17:6802/3585477898 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22e8196690 con 0x7f22d00729e0 2024-08-19T00:52:33.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898] conn(0x7f22d00729e0 msgr2=0x7f22d0074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:33.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898] conn(0x7f22d00729e0 0x7f22d0074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f22d006cc50 msgr2=0x7f22d006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f22d006cc50 0x7f22d006f110 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009230 tx=0x7f22dc005a20 comp rx=0 tx=0).stop 2024-08-19T00:52:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22e8100c60 msgr2=0x7f22e819b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22e8100c60 0x7f22e819b860 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f22d800c8a0 tx=0x7f22d800cd60 comp rx=0 tx=0).stop 2024-08-19T00:52:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1776380623 shutdown_connections 2024-08-19T00:52:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6802/3585477898,v1:172.21.15.17:6803/3585477898] conn(0x7f22d00729e0 0x7f22d0074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f22d006cc50 0x7f22d006f110 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22e8101610 0x7f22e819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 --2- 172.21.15.17:0/1776380623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f22e8100c60 0x7f22e819b860 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1776380623 >> 172.21.15.17:0/1776380623 conn(0x7f22e80fa730 msgr2=0x7f22e8101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1776380623 shutdown_connections 2024-08-19T00:52:33.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.373+0000 7f22ee3cd640 1 -- 172.21.15.17:0/1776380623 wait complete. 2024-08-19T00:52:33.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.934+0000 7fbc8ec34640 1 -- 172.21.15.17:0/2638015275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc88100d10 msgr2=0x7fbc881010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.934+0000 7fbc8ec34640 1 --2- 172.21.15.17:0/2638015275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc88100d10 0x7fbc881010f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbc700098b0 tx=0x7fbc7002a560 comp rx=0 tx=0).stop 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.934+0000 7fbc8ec34640 1 -- 172.21.15.17:0/2638015275 shutdown_connections 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.934+0000 7fbc8ec34640 1 --2- 172.21.15.17:0/2638015275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88101630 0x7fbc88109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.934+0000 7fbc8ec34640 1 --2- 172.21.15.17:0/2638015275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc88100d10 0x7fbc881010f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.934+0000 7fbc8ec34640 1 -- 172.21.15.17:0/2638015275 >> 172.21.15.17:0/2638015275 conn(0x7fbc880758a0 msgr2=0x7fbc880fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.935+0000 7fbc8ec34640 1 -- 172.21.15.17:0/2638015275 shutdown_connections 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.935+0000 7fbc8ec34640 1 -- 172.21.15.17:0/2638015275 wait complete. 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.935+0000 7fbc8ec34640 1 Processor -- start 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.935+0000 7fbc8ec34640 1 -- start start 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.935+0000 7fbc8ec34640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88100d10 0x7fbc8819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.935+0000 7fbc8ec34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc88101630 0x7fbc8819bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.935+0000 7fbc8ec34640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc88195a20 con 0x7fbc88101630 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.935+0000 7fbc8ec34640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc88195b60 con 0x7fbc88100d10 2024-08-19T00:52:33.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.935+0000 7fbc87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc88101630 0x7fbc8819bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.935+0000 7fbc87fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc88101630 0x7fbc8819bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46196/0 (socket says 172.21.15.17:46196) 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.935+0000 7fbc87fff640 1 -- 172.21.15.17:0/3242991591 learned_addr learned my addr 172.21.15.17:0/3242991591 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.936+0000 7fbc8c9d0640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88100d10 0x7fbc8819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.936+0000 7fbc87fff640 1 -- 172.21.15.17:0/3242991591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88100d10 msgr2=0x7fbc8819b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.936+0000 7fbc87fff640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88100d10 0x7fbc8819b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.936+0000 7fbc87fff640 1 -- 172.21.15.17:0/3242991591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc70009560 con 0x7fbc88101630 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.936+0000 7fbc87fff640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc88101630 0x7fbc8819bf00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800d6f0 tx=0x7fbc7800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.936+0000 7fbc85ffb640 1 -- 172.21.15.17:0/3242991591 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc78009a30 con 0x7fbc88101630 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.936+0000 7fbc8ec34640 1 -- 172.21.15.17:0/3242991591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc88195e40 con 0x7fbc88101630 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.936+0000 7fbc85ffb640 1 -- 172.21.15.17:0/3242991591 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc780054e0 con 0x7fbc88101630 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.936+0000 7fbc85ffb640 1 -- 172.21.15.17:0/3242991591 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc78010460 con 0x7fbc88101630 2024-08-19T00:52:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.936+0000 7fbc8ec34640 1 -- 172.21.15.17:0/3242991591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc88196390 con 0x7fbc88101630 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.937+0000 7fbc8ec34640 1 -- 172.21.15.17:0/3242991591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc8810d020 con 0x7fbc88101630 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.938+0000 7fbc85ffb640 1 -- 172.21.15.17:0/3242991591 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fbc78009b90 con 0x7fbc88101630 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.938+0000 7fbc85ffb640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fbc7406cc50 0x7fbc7406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.938+0000 7fbc85ffb640 1 -- 172.21.15.17:0/3242991591 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fbc7808ba10 con 0x7fbc88101630 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.938+0000 7fbc8c9d0640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fbc7406cc50 0x7fbc7406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.938+0000 7fbc85ffb640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562] conn(0x7fbc740729e0 0x7fbc74074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.938+0000 7fbc85ffb640 1 -- 172.21.15.17:0/3242991591 --> [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc740754b0 con 0x7fbc740729e0 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.938+0000 7fbc85ffb640 1 -- 172.21.15.17:0/3242991591 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc780902a0 con 0x7fbc88101630 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.939+0000 7fbc8d1d1640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562] conn(0x7fbc740729e0 0x7fbc74074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.939+0000 7fbc8c9d0640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fbc7406cc50 0x7fbc7406f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009880 tx=0x7fbc700058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.939+0000 7fbc8d1d1640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562] conn(0x7fbc740729e0 0x7fbc74074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:33.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.940+0000 7fbc85ffb640 1 -- 172.21.15.17:0/3242991591 <== osd.4 v2:172.21.15.86:6808/2303545562 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbc740754b0 con 0x7fbc740729e0 2024-08-19T00:52:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.953+0000 7fbc8ec34640 1 -- 172.21.15.17:0/3242991591 --> [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc881967f0 con 0x7fbc740729e0 2024-08-19T00:52:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc85ffb640 1 -- 172.21.15.17:0/3242991591 <== osd.4 v2:172.21.15.86:6808/2303545562 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbc881967f0 con 0x7fbc740729e0 2024-08-19T00:52:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 -- 172.21.15.17:0/3242991591 >> [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562] conn(0x7fbc740729e0 msgr2=0x7fbc74074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562] conn(0x7fbc740729e0 0x7fbc74074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 -- 172.21.15.17:0/3242991591 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fbc7406cc50 msgr2=0x7fbc7406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fbc7406cc50 0x7fbc7406f110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009880 tx=0x7fbc700058d0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 -- 172.21.15.17:0/3242991591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc88101630 msgr2=0x7fbc8819bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc88101630 0x7fbc8819bf00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc7800d6f0 tx=0x7fbc7800dbb0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 -- 172.21.15.17:0/3242991591 shutdown_connections 2024-08-19T00:52:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.86:6808/2303545562,v1:172.21.15.86:6809/2303545562] conn(0x7fbc740729e0 0x7fbc74074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fbc7406cc50 0x7fbc7406f110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc88101630 0x7fbc8819bf00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 --2- 172.21.15.17:0/3242991591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc88100d10 0x7fbc8819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 -- 172.21.15.17:0/3242991591 >> 172.21.15.17:0/3242991591 conn(0x7fbc880758a0 msgr2=0x7fbc88101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 -- 172.21.15.17:0/3242991591 shutdown_connections 2024-08-19T00:52:33.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:33.954+0000 7fbc8ec34640 1 -- 172.21.15.17:0/3242991591 wait complete. 2024-08-19T00:52:34.651 INFO:teuthology.orchestra.run.smithi017.stdout:146028888078 2024-08-19T00:52:34.651 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-19T00:52:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:34 smithi017 ceph-mon[16627]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:34.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:34 smithi086 ceph-mon[24511]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:35.108 INFO:teuthology.orchestra.run.smithi017.stdout:38654705697 2024-08-19T00:52:35.109 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-19T00:52:35.639 INFO:teuthology.orchestra.run.smithi017.stdout:111669149715 2024-08-19T00:52:35.639 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-19T00:52:35.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:52:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:52:36.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.586+0000 7ffae55f9640 1 -- 172.21.15.17:0/1875874780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae0100750 msgr2=0x7ffae01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:36.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.586+0000 7ffae55f9640 1 --2- 172.21.15.17:0/1875874780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae0100750 0x7ffae01047a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009880 tx=0x7ffad402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.586+0000 7ffae55f9640 1 -- 172.21.15.17:0/1875874780 shutdown_connections 2024-08-19T00:52:36.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.586+0000 7ffae55f9640 1 --2- 172.21.15.17:0/1875874780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae0100750 0x7ffae01047a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.586+0000 7ffae55f9640 1 --2- 172.21.15.17:0/1875874780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae00ffda0 0x7ffae0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.586+0000 7ffae55f9640 1 -- 172.21.15.17:0/1875874780 >> 172.21.15.17:0/1875874780 conn(0x7ffae00fb840 msgr2=0x7ffae00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:36.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.586+0000 7ffae55f9640 1 -- 172.21.15.17:0/1875874780 shutdown_connections 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.586+0000 7ffae55f9640 1 -- 172.21.15.17:0/1875874780 wait complete. 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.586+0000 7ffae55f9640 1 Processor -- start 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffae55f9640 1 -- start start 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffae55f9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae00ffda0 0x7ffae019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffae55f9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae0100750 0x7ffae019be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffae55f9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae019c480 con 0x7ffae00ffda0 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffae55f9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae0195a10 con 0x7ffae0100750 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffadeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae00ffda0 0x7ffae019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffadeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae00ffda0 0x7ffae019b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46210/0 (socket says 172.21.15.17:46210) 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffadeffd640 1 -- 172.21.15.17:0/1635116520 learned_addr learned my addr 172.21.15.17:0/1635116520 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffade7fc640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae0100750 0x7ffae019be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:36.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffadeffd640 1 -- 172.21.15.17:0/1635116520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae0100750 msgr2=0x7ffae019be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffadeffd640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae0100750 0x7ffae019be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffadeffd640 1 -- 172.21.15.17:0/1635116520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad4009560 con 0x7ffae00ffda0 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.587+0000 7ffadeffd640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae00ffda0 0x7ffae019b920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffad000b420 tx=0x7ffad000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.588+0000 7ffac7fff640 1 -- 172.21.15.17:0/1635116520 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffad0011800 con 0x7ffae00ffda0 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.588+0000 7ffae55f9640 1 -- 172.21.15.17:0/1635116520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae0195cf0 con 0x7ffae00ffda0 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.588+0000 7ffac7fff640 1 -- 172.21.15.17:0/1635116520 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffad0011e20 con 0x7ffae00ffda0 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.588+0000 7ffac7fff640 1 -- 172.21.15.17:0/1635116520 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffad000f2e0 con 0x7ffae00ffda0 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.588+0000 7ffae55f9640 1 -- 172.21.15.17:0/1635116520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae0196210 con 0x7ffae00ffda0 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.588+0000 7ffae55f9640 1 -- 172.21.15.17:0/1635116520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffae010d130 con 0x7ffae00ffda0 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.589+0000 7ffac7fff640 1 -- 172.21.15.17:0/1635116520 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ffad0010380 con 0x7ffae00ffda0 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.590+0000 7ffac7fff640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffac806cc50 0x7ffac806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.590+0000 7ffac7fff640 1 -- 172.21.15.17:0/1635116520 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ffad008b7f0 con 0x7ffae00ffda0 2024-08-19T00:52:36.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.590+0000 7ffade7fc640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffac806cc50 0x7ffac806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.590+0000 7ffac7fff640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485] conn(0x7ffac80729e0 0x7ffac8074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.590+0000 7ffac7fff640 1 -- 172.21.15.17:0/1635116520 --> [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffac80754b0 con 0x7ffac80729e0 2024-08-19T00:52:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.590+0000 7ffac7fff640 1 -- 172.21.15.17:0/1635116520 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffad00902a0 con 0x7ffae00ffda0 2024-08-19T00:52:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.590+0000 7ffade7fc640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffac806cc50 0x7ffac806f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009230 tx=0x7ffad40058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.590+0000 7ffadf7fe640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485] conn(0x7ffac80729e0 0x7ffac8074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.591+0000 7ffadf7fe640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485] conn(0x7ffac80729e0 0x7ffac8074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:36.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.591+0000 7ffac7fff640 1 -- 172.21.15.17:0/1635116520 <== osd.5 v2:172.21.15.86:6816/248380485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ffac80754b0 con 0x7ffac80729e0 2024-08-19T00:52:36.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.606+0000 7ffae55f9640 1 -- 172.21.15.17:0/1635116520 --> [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffae0101280 con 0x7ffac80729e0 2024-08-19T00:52:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffac7fff640 1 -- 172.21.15.17:0/1635116520 <== osd.5 v2:172.21.15.86:6816/248380485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ffae0101280 con 0x7ffac80729e0 2024-08-19T00:52:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 -- 172.21.15.17:0/1635116520 >> [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485] conn(0x7ffac80729e0 msgr2=0x7ffac8074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485] conn(0x7ffac80729e0 0x7ffac8074e00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 -- 172.21.15.17:0/1635116520 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffac806cc50 msgr2=0x7ffac806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffac806cc50 0x7ffac806f110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009230 tx=0x7ffad40058d0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 -- 172.21.15.17:0/1635116520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae00ffda0 msgr2=0x7ffae019b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae00ffda0 0x7ffae019b920 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffad000b420 tx=0x7ffad000b8e0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 -- 172.21.15.17:0/1635116520 shutdown_connections 2024-08-19T00:52:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.86:6816/248380485,v1:172.21.15.86:6817/248380485] conn(0x7ffac80729e0 0x7ffac8074e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ffac806cc50 0x7ffac806f110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffae0100750 0x7ffae019be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 --2- 172.21.15.17:0/1635116520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffae00ffda0 0x7ffae019b920 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 -- 172.21.15.17:0/1635116520 >> 172.21.15.17:0/1635116520 conn(0x7ffae00fb840 msgr2=0x7ffae00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.607+0000 7ffae55f9640 1 -- 172.21.15.17:0/1635116520 shutdown_connections 2024-08-19T00:52:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.608+0000 7ffae55f9640 1 -- 172.21.15.17:0/1635116520 wait complete. 2024-08-19T00:52:36.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:36 smithi086 ceph-mon[24511]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:36.803 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:36 smithi017 ceph-mon[16627]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.801+0000 7fa3ef45b640 1 -- 172.21.15.17:0/3345298671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3e80ffda0 msgr2=0x7fa3e8100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.801+0000 7fa3ef45b640 1 --2- 172.21.15.17:0/3345298671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3e80ffda0 0x7fa3e8100180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009880 tx=0x7fa3e002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.801+0000 7fa3ef45b640 1 -- 172.21.15.17:0/3345298671 shutdown_connections 2024-08-19T00:52:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.801+0000 7fa3ef45b640 1 --2- 172.21.15.17:0/3345298671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e8100750 0x7fa3e81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.801+0000 7fa3ef45b640 1 --2- 172.21.15.17:0/3345298671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3e80ffda0 0x7fa3e8100180 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.801+0000 7fa3ef45b640 1 -- 172.21.15.17:0/3345298671 >> 172.21.15.17:0/3345298671 conn(0x7fa3e80fb860 msgr2=0x7fa3e80fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.802+0000 7fa3ef45b640 1 -- 172.21.15.17:0/3345298671 shutdown_connections 2024-08-19T00:52:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.802+0000 7fa3ef45b640 1 -- 172.21.15.17:0/3345298671 wait complete. 2024-08-19T00:52:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.802+0000 7fa3ef45b640 1 Processor -- start 2024-08-19T00:52:36.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ef45b640 1 -- start start 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ef45b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3e80ffda0 0x7fa3e819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ef45b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e8100750 0x7fa3e819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ef45b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e819c480 con 0x7fa3e80ffda0 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ef45b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8195a10 con 0x7fa3e8100750 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ed1f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3e80ffda0 0x7fa3e819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ed1f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3e80ffda0 0x7fa3e819b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36214/0 (socket says 172.21.15.17:36214) 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ed1f7640 1 -- 172.21.15.17:0/2254613677 learned_addr learned my addr 172.21.15.17:0/2254613677 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ec9f6640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e8100750 0x7fa3e819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ed1f7640 1 -- 172.21.15.17:0/2254613677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e8100750 msgr2=0x7fa3e819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ed1f7640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e8100750 0x7fa3e819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ed1f7640 1 -- 172.21.15.17:0/2254613677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e0009560 con 0x7fa3e80ffda0 2024-08-19T00:52:36.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ec9f6640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e8100750 0x7fa3e819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ed1f7640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3e80ffda0 0x7fa3e819b920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3e002a9c0 tx=0x7fa3e00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3e67fc640 1 -- 172.21.15.17:0/2254613677 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e0004aa0 con 0x7fa3e80ffda0 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3e67fc640 1 -- 172.21.15.17:0/2254613677 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3e0004c00 con 0x7fa3e80ffda0 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.803+0000 7fa3ef45b640 1 -- 172.21.15.17:0/2254613677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e8195c90 con 0x7fa3e80ffda0 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.804+0000 7fa3e67fc640 1 -- 172.21.15.17:0/2254613677 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3e0003ab0 con 0x7fa3e80ffda0 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.804+0000 7fa3ef45b640 1 -- 172.21.15.17:0/2254613677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e8196180 con 0x7fa3e80ffda0 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.804+0000 7fa3ef45b640 1 -- 172.21.15.17:0/2254613677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3e810d130 con 0x7fa3e80ffda0 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.805+0000 7fa3e67fc640 1 -- 172.21.15.17:0/2254613677 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa3e0003ce0 con 0x7fa3e80ffda0 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.805+0000 7fa3e67fc640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa3d006cc50 0x7fa3d006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.805+0000 7fa3e67fc640 1 -- 172.21.15.17:0/2254613677 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa3e00ad000 con 0x7fa3e80ffda0 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.805+0000 7fa3ec9f6640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa3d006cc50 0x7fa3d006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.806+0000 7fa3e67fc640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649] conn(0x7fa3d00729e0 0x7fa3d0074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:36.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.806+0000 7fa3e67fc640 1 -- 172.21.15.17:0/2254613677 --> [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3d00754b0 con 0x7fa3d00729e0 2024-08-19T00:52:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.806+0000 7fa3e67fc640 1 -- 172.21.15.17:0/2254613677 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3e00af6d0 con 0x7fa3e80ffda0 2024-08-19T00:52:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.806+0000 7fa3ed9f8640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649] conn(0x7fa3d00729e0 0x7fa3d0074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.806+0000 7fa3ec9f6640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa3d006cc50 0x7fa3d006f110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc006fd0 tx=0x7fa3dc008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.806+0000 7fa3ed9f8640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649] conn(0x7fa3d00729e0 0x7fa3d0074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.807+0000 7fa3e67fc640 1 -- 172.21.15.17:0/2254613677 <== osd.2 v2:172.21.15.17:6818/306210649 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa3d00754b0 con 0x7fa3d00729e0 2024-08-19T00:52:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 -- 172.21.15.17:0/2254613677 --> [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3e8101280 con 0x7fa3d00729e0 2024-08-19T00:52:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3e67fc640 1 -- 172.21.15.17:0/2254613677 <== osd.2 v2:172.21.15.17:6818/306210649 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3e8101280 con 0x7fa3d00729e0 2024-08-19T00:52:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 -- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649] conn(0x7fa3d00729e0 msgr2=0x7fa3d0074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:36.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649] conn(0x7fa3d00729e0 0x7fa3d0074e00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 -- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa3d006cc50 msgr2=0x7fa3d006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa3d006cc50 0x7fa3d006f110 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc006fd0 tx=0x7fa3dc008040 comp rx=0 tx=0).stop 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 -- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3e80ffda0 msgr2=0x7fa3e819b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3e80ffda0 0x7fa3e819b920 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3e002a9c0 tx=0x7fa3e00055a0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 -- 172.21.15.17:0/2254613677 shutdown_connections 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6818/306210649,v1:172.21.15.17:6819/306210649] conn(0x7fa3d00729e0 0x7fa3d0074e00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa3d006cc50 0x7fa3d006f110 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3e8100750 0x7fa3e819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 --2- 172.21.15.17:0/2254613677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3e80ffda0 0x7fa3e819b920 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 -- 172.21.15.17:0/2254613677 >> 172.21.15.17:0/2254613677 conn(0x7fa3e80fb860 msgr2=0x7fa3e80fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 -- 172.21.15.17:0/2254613677 shutdown_connections 2024-08-19T00:52:36.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:36.820+0000 7fa3ef45b640 1 -- 172.21.15.17:0/2254613677 wait complete. 2024-08-19T00:52:37.507 INFO:teuthology.orchestra.run.smithi017.stdout:81604378648 2024-08-19T00:52:37.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-19T00:52:38.826 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:38 smithi017 ceph-mon[16627]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:38.851 INFO:teuthology.orchestra.run.smithi017.stdout:167503724553 2024-08-19T00:52:38.851 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-19T00:52:38.880 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:38 smithi086 ceph-mon[24511]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:40.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.015+0000 7f4f0da5f640 1 -- 172.21.15.17:0/383284223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f080ffda0 msgr2=0x7f4f08100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:40.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.015+0000 7f4f0da5f640 1 --2- 172.21.15.17:0/383284223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f080ffda0 0x7f4f08100180 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009880 tx=0x7f4ef802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:40.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.016+0000 7f4f0da5f640 1 -- 172.21.15.17:0/383284223 shutdown_connections 2024-08-19T00:52:40.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.016+0000 7f4f0da5f640 1 --2- 172.21.15.17:0/383284223 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f08100750 0x7f4f081047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:40.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.016+0000 7f4f0da5f640 1 --2- 172.21.15.17:0/383284223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f080ffda0 0x7f4f08100180 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:40.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.016+0000 7f4f0da5f640 1 -- 172.21.15.17:0/383284223 >> 172.21.15.17:0/383284223 conn(0x7f4f080fb860 msgr2=0x7f4f080fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:40.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.016+0000 7f4f0da5f640 1 -- 172.21.15.17:0/383284223 shutdown_connections 2024-08-19T00:52:40.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.016+0000 7f4f0da5f640 1 -- 172.21.15.17:0/383284223 wait complete. 2024-08-19T00:52:40.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.016+0000 7f4f0da5f640 1 Processor -- start 2024-08-19T00:52:40.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.016+0000 7f4f0da5f640 1 -- start start 2024-08-19T00:52:40.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.016+0000 7f4f0da5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f080ffda0 0x7f4f0819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:40.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f0da5f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f08100750 0x7f4f0819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:40.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f0da5f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0819c480 con 0x7f4f080ffda0 2024-08-19T00:52:40.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f0da5f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08195a10 con 0x7f4f08100750 2024-08-19T00:52:40.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f06ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f080ffda0 0x7f4f0819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f06ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f080ffda0 0x7f4f0819b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36226/0 (socket says 172.21.15.17:36226) 2024-08-19T00:52:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f06ffd640 1 -- 172.21.15.17:0/25211608 learned_addr learned my addr 172.21.15.17:0/25211608 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f067fc640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f08100750 0x7f4f0819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f06ffd640 1 -- 172.21.15.17:0/25211608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f08100750 msgr2=0x7f4f0819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f06ffd640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f08100750 0x7f4f0819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f06ffd640 1 -- 172.21.15.17:0/25211608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef8009560 con 0x7f4f080ffda0 2024-08-19T00:52:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f06ffd640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f080ffda0 0x7f4f0819b920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ef802a9c0 tx=0x7f4ef80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f0ca5d640 1 -- 172.21.15.17:0/25211608 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef8004aa0 con 0x7f4f080ffda0 2024-08-19T00:52:40.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f0ca5d640 1 -- 172.21.15.17:0/25211608 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ef8004c00 con 0x7f4f080ffda0 2024-08-19T00:52:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f0da5f640 1 -- 172.21.15.17:0/25211608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f08195c90 con 0x7f4f080ffda0 2024-08-19T00:52:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.017+0000 7f4f0ca5d640 1 -- 172.21.15.17:0/25211608 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef8003a20 con 0x7f4f080ffda0 2024-08-19T00:52:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.018+0000 7f4f0da5f640 1 -- 172.21.15.17:0/25211608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f08196180 con 0x7f4f080ffda0 2024-08-19T00:52:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.018+0000 7f4f0da5f640 1 -- 172.21.15.17:0/25211608 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f0810d130 con 0x7f4f080ffda0 2024-08-19T00:52:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.019+0000 7f4f0ca5d640 1 -- 172.21.15.17:0/25211608 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4ef8031c90 con 0x7f4f080ffda0 2024-08-19T00:52:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.019+0000 7f4f0ca5d640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4ef006cc50 0x7f4ef006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:40.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.019+0000 7f4f0ca5d640 1 -- 172.21.15.17:0/25211608 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f4ef80acff0 con 0x7f4f080ffda0 2024-08-19T00:52:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.019+0000 7f4f067fc640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4ef006cc50 0x7f4ef006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.020+0000 7f4f0ca5d640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054] conn(0x7f4ef00729e0 0x7f4ef0074e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.020+0000 7f4f0ca5d640 1 -- 172.21.15.17:0/25211608 --> [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ef00754b0 con 0x7f4ef00729e0 2024-08-19T00:52:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.020+0000 7f4f0ca5d640 1 -- 172.21.15.17:0/25211608 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ef80af6c0 con 0x7f4f080ffda0 2024-08-19T00:52:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.020+0000 7f4f077fe640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054] conn(0x7f4ef00729e0 0x7f4ef0074e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.020+0000 7f4f067fc640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4ef006cc50 0x7f4ef006f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f08196e80 tx=0x7f4efc009110 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.020+0000 7f4f077fe640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054] conn(0x7f4ef00729e0 0x7f4ef0074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.021+0000 7f4f0ca5d640 1 -- 172.21.15.17:0/25211608 <== osd.1 v2:172.21.15.17:6810/2276907054 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4ef00754b0 con 0x7f4ef00729e0 2024-08-19T00:52:40.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.034+0000 7f4f0da5f640 1 -- 172.21.15.17:0/25211608 --> [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f08101280 con 0x7f4ef00729e0 2024-08-19T00:52:40.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.034+0000 7f4f0ca5d640 1 -- 172.21.15.17:0/25211608 <== osd.1 v2:172.21.15.17:6810/2276907054 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f08101280 con 0x7f4ef00729e0 2024-08-19T00:52:40.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.034+0000 7f4f0da5f640 1 -- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054] conn(0x7f4ef00729e0 msgr2=0x7f4ef0074e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:40.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.034+0000 7f4f0da5f640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054] conn(0x7f4ef00729e0 0x7f4ef0074e00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:40.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 -- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4ef006cc50 msgr2=0x7f4ef006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:40.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4ef006cc50 0x7f4ef006f110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f08196e80 tx=0x7f4efc009110 comp rx=0 tx=0).stop 2024-08-19T00:52:40.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 -- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f080ffda0 msgr2=0x7f4f0819b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:40.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f080ffda0 0x7f4f0819b920 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4ef802a9c0 tx=0x7f4ef80055a0 comp rx=0 tx=0).stop 2024-08-19T00:52:40.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 -- 172.21.15.17:0/25211608 shutdown_connections 2024-08-19T00:52:40.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6810/2276907054,v1:172.21.15.17:6811/2276907054] conn(0x7f4ef00729e0 0x7f4ef0074e00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:40.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4ef006cc50 0x7f4ef006f110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f08100750 0x7f4f0819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 --2- 172.21.15.17:0/25211608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f080ffda0 0x7f4f0819b920 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 -- 172.21.15.17:0/25211608 >> 172.21.15.17:0/25211608 conn(0x7f4f080fb860 msgr2=0x7f4f080fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 -- 172.21.15.17:0/25211608 shutdown_connections 2024-08-19T00:52:40.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:40.035+0000 7f4f0da5f640 1 -- 172.21.15.17:0/25211608 wait complete. 2024-08-19T00:52:40.794 INFO:teuthology.orchestra.run.smithi017.stdout:60129542174 2024-08-19T00:52:40.795 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-19T00:52:40.861 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:40 smithi017 ceph-mon[16627]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:40 smithi086 ceph-mon[24511]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.663+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/3528067188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cbc104a30 msgr2=0x7f9cbc104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:41.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.663+0000 7f9cc1e4b640 1 --2- 172.21.15.17:0/3528067188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cbc104a30 0x7f9cbc104e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009880 tx=0x7f9cac02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.663+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/3528067188 shutdown_connections 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.663+0000 7f9cc1e4b640 1 --2- 172.21.15.17:0/3528067188 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc0fea30 0x7f9cbc0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.663+0000 7f9cc1e4b640 1 --2- 172.21.15.17:0/3528067188 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cbc104a30 0x7f9cbc104e10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.663+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/3528067188 >> 172.21.15.17:0/3528067188 conn(0x7f9cbc0fa730 msgr2=0x7f9cbc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.663+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/3528067188 shutdown_connections 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.663+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/3528067188 wait complete. 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cc1e4b640 1 Processor -- start 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cc1e4b640 1 -- start start 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cc1e4b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc0fea30 0x7f9cbc19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cc1e4b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cbc104a30 0x7f9cbc19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cc1e4b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc19c460 con 0x7f9cbc104a30 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cc1e4b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc1959f0 con 0x7f9cbc0fea30 2024-08-19T00:52:41.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cbaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cbc104a30 0x7f9cbc19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cbaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cbc104a30 0x7f9cbc19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36238/0 (socket says 172.21.15.17:36238) 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cbaffd640 1 -- 172.21.15.17:0/2499180705 learned_addr learned my addr 172.21.15.17:0/2499180705 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cbb7fe640 1 --2- 172.21.15.17:0/2499180705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc0fea30 0x7f9cbc19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cbaffd640 1 -- 172.21.15.17:0/2499180705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc0fea30 msgr2=0x7f9cbc19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cbaffd640 1 --2- 172.21.15.17:0/2499180705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc0fea30 0x7f9cbc19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.664+0000 7f9cbaffd640 1 -- 172.21.15.17:0/2499180705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac009560 con 0x7f9cbc104a30 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.665+0000 7f9cbaffd640 1 --2- 172.21.15.17:0/2499180705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cbc104a30 0x7f9cbc19be40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000b420 tx=0x7f9cb000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.665+0000 7f9cb8ff9640 1 -- 172.21.15.17:0/2499180705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb0011800 con 0x7f9cbc104a30 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.665+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/2499180705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc195cd0 con 0x7f9cbc104a30 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.665+0000 7f9cb8ff9640 1 -- 172.21.15.17:0/2499180705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cb0011e20 con 0x7f9cbc104a30 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.665+0000 7f9cb8ff9640 1 -- 172.21.15.17:0/2499180705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cb000f2e0 con 0x7f9cbc104a30 2024-08-19T00:52:41.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.665+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/2499180705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc196220 con 0x7f9cbc104a30 2024-08-19T00:52:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.666+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/2499180705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc100170 con 0x7f9cbc104a30 2024-08-19T00:52:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.666+0000 7f9cb8ff9640 1 -- 172.21.15.17:0/2499180705 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9cb0010380 con 0x7f9cbc104a30 2024-08-19T00:52:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.667+0000 7f9cb8ff9640 1 --2- 172.21.15.17:0/2499180705 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ca406cc50 0x7f9ca406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.667+0000 7f9cb8ff9640 1 -- 172.21.15.17:0/2499180705 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9cb008b7f0 con 0x7f9cbc104a30 2024-08-19T00:52:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.667+0000 7f9cbb7fe640 1 --2- 172.21.15.17:0/2499180705 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ca406cc50 0x7f9ca406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.668+0000 7f9cbb7fe640 1 --2- 172.21.15.17:0/2499180705 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ca406cc50 0x7f9ca406f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009230 tx=0x7f9cac0058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:41.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.671+0000 7f9cb8ff9640 1 -- 172.21.15.17:0/2499180705 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f9cb0055f00 con 0x7f9cbc104a30 2024-08-19T00:52:41.691 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:41.693 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:41.748 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:41.749 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:41.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.868+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/2499180705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9cbc0fef10 con 0x7f9cbc104a30 2024-08-19T00:52:41.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.868+0000 7f9cb8ff9640 1 -- 172.21.15.17:0/2499180705 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cb0059520 con 0x7f9cbc104a30 2024-08-19T00:52:41.871 INFO:teuthology.orchestra.run.smithi017.stdout:111669149717 2024-08-19T00:52:41.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.870+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/2499180705 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ca406cc50 msgr2=0x7f9ca406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:41.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.870+0000 7f9cc1e4b640 1 --2- 172.21.15.17:0/2499180705 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ca406cc50 0x7f9ca406f110 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009230 tx=0x7f9cac0058d0 comp rx=0 tx=0).stop 2024-08-19T00:52:41.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.870+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/2499180705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cbc104a30 msgr2=0x7f9cbc19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:41.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.870+0000 7f9cc1e4b640 1 --2- 172.21.15.17:0/2499180705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cbc104a30 0x7f9cbc19be40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000b420 tx=0x7f9cb000b8e0 comp rx=0 tx=0).stop 2024-08-19T00:52:41.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.870+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/2499180705 shutdown_connections 2024-08-19T00:52:41.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.870+0000 7f9cc1e4b640 1 --2- 172.21.15.17:0/2499180705 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ca406cc50 0x7f9ca406f110 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:41.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.870+0000 7f9cc1e4b640 1 --2- 172.21.15.17:0/2499180705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9cbc104a30 0x7f9cbc19be40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:41.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.870+0000 7f9cc1e4b640 1 --2- 172.21.15.17:0/2499180705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9cbc0fea30 0x7f9cbc19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:41.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.870+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/2499180705 >> 172.21.15.17:0/2499180705 conn(0x7f9cbc0fa730 msgr2=0x7f9cbc068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.870+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/2499180705 shutdown_connections 2024-08-19T00:52:41.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:41.870+0000 7f9cc1e4b640 1 -- 172.21.15.17:0/2499180705 wait complete. 2024-08-19T00:52:42.691 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149715 got 111669149717 for osd.3 2024-08-19T00:52:42.692 DEBUG:teuthology.parallel:result is None 2024-08-19T00:52:42.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:42 smithi017 ceph-mon[16627]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:42.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:42 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2499180705' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-19T00:52:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:42 smithi086 ceph-mon[24511]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:42 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/2499180705' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-19T00:52:44.808 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:44 smithi017 ceph-mon[16627]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:44 smithi086 ceph-mon[24511]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.080+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/2723004290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ffda0 msgr2=0x7f3f08100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.080+0000 7f3f0c9bd640 1 --2- 172.21.15.17:0/2723004290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ffda0 0x7f3f08100180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009880 tx=0x7f3ef802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.080+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/2723004290 shutdown_connections 2024-08-19T00:52:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.080+0000 7f3f0c9bd640 1 --2- 172.21.15.17:0/2723004290 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f08100750 0x7f3f081047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.080+0000 7f3f0c9bd640 1 --2- 172.21.15.17:0/2723004290 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ffda0 0x7f3f08100180 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.080+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/2723004290 >> 172.21.15.17:0/2723004290 conn(0x7f3f080fb840 msgr2=0x7f3f080fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.080+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/2723004290 shutdown_connections 2024-08-19T00:52:45.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.080+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/2723004290 wait complete. 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.081+0000 7f3f0c9bd640 1 Processor -- start 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.081+0000 7f3f0c9bd640 1 -- start start 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.081+0000 7f3f0c9bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ffda0 0x7f3f080727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.081+0000 7f3f0c9bd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f08100750 0x7f3f08072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.081+0000 7f3f0c9bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08073230 con 0x7f3f080ffda0 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.081+0000 7f3f0c9bd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08073370 con 0x7f3f08100750 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.081+0000 7f3f0659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ffda0 0x7f3f080727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.081+0000 7f3f0659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ffda0 0x7f3f080727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36260/0 (socket says 172.21.15.17:36260) 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.081+0000 7f3f0659c640 1 -- 172.21.15.17:0/1277045050 learned_addr learned my addr 172.21.15.17:0/1277045050 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.081+0000 7f3f05d9b640 1 --2- 172.21.15.17:0/1277045050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f08100750 0x7f3f08072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.082+0000 7f3f0659c640 1 -- 172.21.15.17:0/1277045050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f08100750 msgr2=0x7f3f08072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:45.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.082+0000 7f3f0659c640 1 --2- 172.21.15.17:0/1277045050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f08100750 0x7f3f08072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.082+0000 7f3f0659c640 1 -- 172.21.15.17:0/1277045050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef8009560 con 0x7f3f080ffda0 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.082+0000 7f3f0659c640 1 --2- 172.21.15.17:0/1277045050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ffda0 0x7f3f080727b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3ef802a9c0 tx=0x7f3ef80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.082+0000 7f3ef77fe640 1 -- 172.21.15.17:0/1277045050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef80048d0 con 0x7f3f080ffda0 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.082+0000 7f3ef77fe640 1 -- 172.21.15.17:0/1277045050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ef8031640 con 0x7f3f080ffda0 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.082+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/1277045050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f080735f0 con 0x7f3f080ffda0 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.082+0000 7f3ef77fe640 1 -- 172.21.15.17:0/1277045050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef80038d0 con 0x7f3f080ffda0 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.082+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/1277045050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f081a20e0 con 0x7f3f080ffda0 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.083+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/1277045050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f08101280 con 0x7f3f080ffda0 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.083+0000 7f3ef77fe640 1 -- 172.21.15.17:0/1277045050 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3ef8004a30 con 0x7f3f080ffda0 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.084+0000 7f3ef77fe640 1 --2- 172.21.15.17:0/1277045050 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3ef006cc50 0x7f3ef006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.084+0000 7f3ef77fe640 1 -- 172.21.15.17:0/1277045050 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3ef80acd80 con 0x7f3f080ffda0 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.084+0000 7f3f05d9b640 1 --2- 172.21.15.17:0/1277045050 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3ef006cc50 0x7f3ef006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:45.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.084+0000 7f3f05d9b640 1 --2- 172.21.15.17:0/1277045050 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3ef006cc50 0x7f3ef006f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f080742b0 tx=0x7f3efc005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:45.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.088+0000 7f3ef77fe640 1 -- 172.21.15.17:0/1277045050 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f3ef80775c0 con 0x7f3f080ffda0 2024-08-19T00:52:45.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.262+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/1277045050 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f08100180 con 0x7f3f080ffda0 2024-08-19T00:52:45.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.263+0000 7f3ef77fe640 1 -- 172.21.15.17:0/1277045050 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ef807abe0 con 0x7f3f080ffda0 2024-08-19T00:52:45.265 INFO:teuthology.orchestra.run.smithi017.stdout:38654705699 2024-08-19T00:52:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.264+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/1277045050 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3ef006cc50 msgr2=0x7f3ef006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.264+0000 7f3f0c9bd640 1 --2- 172.21.15.17:0/1277045050 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3ef006cc50 0x7f3ef006f110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f080742b0 tx=0x7f3efc005f90 comp rx=0 tx=0).stop 2024-08-19T00:52:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.264+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/1277045050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ffda0 msgr2=0x7f3f080727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.264+0000 7f3f0c9bd640 1 --2- 172.21.15.17:0/1277045050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ffda0 0x7f3f080727b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3ef802a9c0 tx=0x7f3ef80055a0 comp rx=0 tx=0).stop 2024-08-19T00:52:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.265+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/1277045050 shutdown_connections 2024-08-19T00:52:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.265+0000 7f3f0c9bd640 1 --2- 172.21.15.17:0/1277045050 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3ef006cc50 0x7f3ef006f110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.265+0000 7f3f0c9bd640 1 --2- 172.21.15.17:0/1277045050 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f08100750 0x7f3f08072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.265+0000 7f3f0c9bd640 1 --2- 172.21.15.17:0/1277045050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f080ffda0 0x7f3f080727b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.265+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/1277045050 >> 172.21.15.17:0/1277045050 conn(0x7f3f080fb840 msgr2=0x7f3f080fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.265+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/1277045050 shutdown_connections 2024-08-19T00:52:45.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:45.265+0000 7f3f0c9bd640 1 -- 172.21.15.17:0/1277045050 wait complete. 2024-08-19T00:52:45.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:45 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1277045050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-19T00:52:45.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:45 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/1277045050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-19T00:52:46.075 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705697 got 38654705699 for osd.0 2024-08-19T00:52:46.075 DEBUG:teuthology.parallel:result is None 2024-08-19T00:52:46.638 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:46 smithi017 ceph-mon[16627]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:46 smithi086 ceph-mon[24511]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:48.738 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:48 smithi017 ceph-mon[16627]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:48 smithi086 ceph-mon[24511]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.555+0000 7f61c4df7640 1 -- 172.21.15.17:0/3649498460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00ffda0 msgr2=0x7f61c0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.555+0000 7f61c4df7640 1 --2- 172.21.15.17:0/3649498460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00ffda0 0x7f61c0100180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009880 tx=0x7f61b002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.555+0000 7f61c4df7640 1 -- 172.21.15.17:0/3649498460 shutdown_connections 2024-08-19T00:52:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.555+0000 7f61c4df7640 1 --2- 172.21.15.17:0/3649498460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61c0100750 0x7f61c01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.555+0000 7f61c4df7640 1 --2- 172.21.15.17:0/3649498460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c00ffda0 0x7f61c0100180 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.555+0000 7f61c4df7640 1 -- 172.21.15.17:0/3649498460 >> 172.21.15.17:0/3649498460 conn(0x7f61c00fb840 msgr2=0x7f61c00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.555+0000 7f61c4df7640 1 -- 172.21.15.17:0/3649498460 shutdown_connections 2024-08-19T00:52:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.555+0000 7f61c4df7640 1 -- 172.21.15.17:0/3649498460 wait complete. 2024-08-19T00:52:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61c4df7640 1 Processor -- start 2024-08-19T00:52:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61c4df7640 1 -- start start 2024-08-19T00:52:49.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61c4df7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61c00ffda0 0x7f61c019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61c4df7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c0100750 0x7f61c019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61c4df7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c019c2d0 con 0x7f61c0100750 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61c4df7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c01958f0 con 0x7f61c00ffda0 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61bdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c0100750 0x7f61c019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61bdd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c0100750 0x7f61c019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48362/0 (socket says 172.21.15.17:48362) 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61bdd9b640 1 -- 172.21.15.17:0/873851981 learned_addr learned my addr 172.21.15.17:0/873851981 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61be59c640 1 --2- 172.21.15.17:0/873851981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61c00ffda0 0x7f61c019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61bdd9b640 1 -- 172.21.15.17:0/873851981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61c00ffda0 msgr2=0x7f61c019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.556+0000 7f61bdd9b640 1 --2- 172.21.15.17:0/873851981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61c00ffda0 0x7f61c019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.557+0000 7f61bdd9b640 1 -- 172.21.15.17:0/873851981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b0009560 con 0x7f61c0100750 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.557+0000 7f61bdd9b640 1 --2- 172.21.15.17:0/873851981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c0100750 0x7f61c019bd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f61a800c8a0 tx=0x7f61a800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.557+0000 7f61b77fe640 1 -- 172.21.15.17:0/873851981 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61a8007b80 con 0x7f61c0100750 2024-08-19T00:52:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.557+0000 7f61b77fe640 1 -- 172.21.15.17:0/873851981 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61a8007ce0 con 0x7f61c0100750 2024-08-19T00:52:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.557+0000 7f61c4df7640 1 -- 172.21.15.17:0/873851981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c0195bd0 con 0x7f61c0100750 2024-08-19T00:52:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.557+0000 7f61b77fe640 1 -- 172.21.15.17:0/873851981 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61a8018810 con 0x7f61c0100750 2024-08-19T00:52:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.557+0000 7f61c4df7640 1 -- 172.21.15.17:0/873851981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c0196120 con 0x7f61c0100750 2024-08-19T00:52:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.558+0000 7f61c4df7640 1 -- 172.21.15.17:0/873851981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c0101280 con 0x7f61c0100750 2024-08-19T00:52:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.558+0000 7f61b77fe640 1 -- 172.21.15.17:0/873851981 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f61a8018a80 con 0x7f61c0100750 2024-08-19T00:52:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.559+0000 7f61b77fe640 1 --2- 172.21.15.17:0/873851981 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f61ac06cc50 0x7f61ac06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.559+0000 7f61b77fe640 1 -- 172.21.15.17:0/873851981 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f61a808c070 con 0x7f61c0100750 2024-08-19T00:52:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.559+0000 7f61be59c640 1 --2- 172.21.15.17:0/873851981 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f61ac06cc50 0x7f61ac06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.559+0000 7f61be59c640 1 --2- 172.21.15.17:0/873851981 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f61ac06cc50 0x7f61ac06f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009230 tx=0x7f61b00058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:60129542176 2024-08-19T00:52:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.563+0000 7f61b77fe640 1 -- 172.21.15.17:0/873851981 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f61a8056780 con 0x7f61c0100750 2024-08-19T00:52:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.735+0000 7f61c4df7640 1 -- 172.21.15.17:0/873851981 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61c0100180 con 0x7f61c0100750 2024-08-19T00:52:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.736+0000 7f61b77fe640 1 -- 172.21.15.17:0/873851981 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61a8059da0 con 0x7f61c0100750 2024-08-19T00:52:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.738+0000 7f61c4df7640 1 -- 172.21.15.17:0/873851981 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f61ac06cc50 msgr2=0x7f61ac06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.738+0000 7f61c4df7640 1 --2- 172.21.15.17:0/873851981 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f61ac06cc50 0x7f61ac06f110 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009230 tx=0x7f61b00058d0 comp rx=0 tx=0).stop 2024-08-19T00:52:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.738+0000 7f61c4df7640 1 -- 172.21.15.17:0/873851981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c0100750 msgr2=0x7f61c019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.738+0000 7f61c4df7640 1 --2- 172.21.15.17:0/873851981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c0100750 0x7f61c019bd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f61a800c8a0 tx=0x7f61a800cd60 comp rx=0 tx=0).stop 2024-08-19T00:52:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.738+0000 7f61c4df7640 1 -- 172.21.15.17:0/873851981 shutdown_connections 2024-08-19T00:52:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.738+0000 7f61c4df7640 1 --2- 172.21.15.17:0/873851981 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f61ac06cc50 0x7f61ac06f110 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.738+0000 7f61c4df7640 1 --2- 172.21.15.17:0/873851981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61c0100750 0x7f61c019bd40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.738+0000 7f61c4df7640 1 --2- 172.21.15.17:0/873851981 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61c00ffda0 0x7f61c019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.738+0000 7f61c4df7640 1 -- 172.21.15.17:0/873851981 >> 172.21.15.17:0/873851981 conn(0x7f61c00fb840 msgr2=0x7f61c00fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.738+0000 7f61c4df7640 1 -- 172.21.15.17:0/873851981 shutdown_connections 2024-08-19T00:52:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:48.738+0000 7f61c4df7640 1 -- 172.21.15.17:0/873851981 wait complete. 2024-08-19T00:52:49.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:49 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/873851981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-19T00:52:49.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:49 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/873851981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-19T00:52:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.658+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3054410452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e80105bf0 msgr2=0x7f1e80105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.658+0000 7f1e86c3a640 1 --2- 172.21.15.17:0/3054410452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e80105bf0 0x7f1e80105fd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009880 tx=0x7f1e6802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.658+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3054410452 shutdown_connections 2024-08-19T00:52:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.658+0000 7f1e86c3a640 1 --2- 172.21.15.17:0/3054410452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e800ffb40 0x7f1e800fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.658+0000 7f1e86c3a640 1 --2- 172.21.15.17:0/3054410452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e80105bf0 0x7f1e80105fd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.658+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3054410452 >> 172.21.15.17:0/3054410452 conn(0x7f1e800fb860 msgr2=0x7f1e800fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.658+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3054410452 shutdown_connections 2024-08-19T00:52:50.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.658+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3054410452 wait complete. 2024-08-19T00:52:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.659+0000 7f1e86c3a640 1 Processor -- start 2024-08-19T00:52:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.659+0000 7f1e86c3a640 1 -- start start 2024-08-19T00:52:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e86c3a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e800ffb40 0x7f1e8019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e86c3a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e80105bf0 0x7f1e8019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e86c3a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8019c360 con 0x7f1e80105bf0 2024-08-19T00:52:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e86c3a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e801958f0 con 0x7f1e800ffb40 2024-08-19T00:52:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e7ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e80105bf0 0x7f1e8019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e7ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e80105bf0 0x7f1e8019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48382/0 (socket says 172.21.15.17:48382) 2024-08-19T00:52:50.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e7ffff640 1 -- 172.21.15.17:0/3601149232 learned_addr learned my addr 172.21.15.17:0/3601149232 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e849d6640 1 --2- 172.21.15.17:0/3601149232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e800ffb40 0x7f1e8019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e7ffff640 1 -- 172.21.15.17:0/3601149232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e800ffb40 msgr2=0x7f1e8019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e7ffff640 1 --2- 172.21.15.17:0/3601149232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e800ffb40 0x7f1e8019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e7ffff640 1 -- 172.21.15.17:0/3601149232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e68009560 con 0x7f1e80105bf0 2024-08-19T00:52:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e7ffff640 1 --2- 172.21.15.17:0/3601149232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e80105bf0 0x7f1e8019bd40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000d6f0 tx=0x7f1e7000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.660+0000 7f1e7dffb640 1 -- 172.21.15.17:0/3601149232 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e70009a30 con 0x7f1e80105bf0 2024-08-19T00:52:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.661+0000 7f1e7dffb640 1 -- 172.21.15.17:0/3601149232 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e700054e0 con 0x7f1e80105bf0 2024-08-19T00:52:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.661+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3601149232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e80195bd0 con 0x7f1e80105bf0 2024-08-19T00:52:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.661+0000 7f1e7dffb640 1 -- 172.21.15.17:0/3601149232 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e70010460 con 0x7f1e80105bf0 2024-08-19T00:52:50.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.661+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3601149232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e801961a0 con 0x7f1e80105bf0 2024-08-19T00:52:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.662+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3601149232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e801011f0 con 0x7f1e80105bf0 2024-08-19T00:52:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.662+0000 7f1e7dffb640 1 -- 172.21.15.17:0/3601149232 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1e70009b90 con 0x7f1e80105bf0 2024-08-19T00:52:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.663+0000 7f1e7dffb640 1 --2- 172.21.15.17:0/3601149232 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f1e6c06cc60 0x7f1e6c06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.663+0000 7f1e7dffb640 1 -- 172.21.15.17:0/3601149232 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1e7008b9d0 con 0x7f1e80105bf0 2024-08-19T00:52:50.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.663+0000 7f1e849d6640 1 --2- 172.21.15.17:0/3601149232 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f1e6c06cc60 0x7f1e6c06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:50.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.663+0000 7f1e849d6640 1 --2- 172.21.15.17:0/3601149232 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f1e6c06cc60 0x7f1e6c06f120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e68000c00 tx=0x7f1e68005e30 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:50.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.671+0000 7f1e7dffb640 1 -- 172.21.15.17:0/3601149232 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f1e70056160 con 0x7f1e80105bf0 2024-08-19T00:52:50.748 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:50 smithi017 ceph-mon[16627]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:50.748 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:52:50.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.844+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3601149232 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1e80108010 con 0x7f1e80105bf0 2024-08-19T00:52:50.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.845+0000 7f1e7dffb640 1 -- 172.21.15.17:0/3601149232 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e70020090 con 0x7f1e80105bf0 2024-08-19T00:52:50.847 INFO:teuthology.orchestra.run.smithi017.stdout:167503724555 2024-08-19T00:52:50.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.847+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3601149232 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f1e6c06cc60 msgr2=0x7f1e6c06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:50.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.847+0000 7f1e86c3a640 1 --2- 172.21.15.17:0/3601149232 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f1e6c06cc60 0x7f1e6c06f120 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1e68000c00 tx=0x7f1e68005e30 comp rx=0 tx=0).stop 2024-08-19T00:52:50.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.847+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3601149232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e80105bf0 msgr2=0x7f1e8019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:50.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.847+0000 7f1e86c3a640 1 --2- 172.21.15.17:0/3601149232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e80105bf0 0x7f1e8019bd40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000d6f0 tx=0x7f1e7000dbb0 comp rx=0 tx=0).stop 2024-08-19T00:52:50.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.847+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3601149232 shutdown_connections 2024-08-19T00:52:50.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.847+0000 7f1e86c3a640 1 --2- 172.21.15.17:0/3601149232 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f1e6c06cc60 0x7f1e6c06f120 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:50.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.847+0000 7f1e86c3a640 1 --2- 172.21.15.17:0/3601149232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e80105bf0 0x7f1e8019bd40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:50.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.847+0000 7f1e86c3a640 1 --2- 172.21.15.17:0/3601149232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e800ffb40 0x7f1e8019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:50.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.847+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3601149232 >> 172.21.15.17:0/3601149232 conn(0x7f1e800fb860 msgr2=0x7f1e800fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:50.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.847+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3601149232 shutdown_connections 2024-08-19T00:52:50.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:50.847+0000 7f1e86c3a640 1 -- 172.21.15.17:0/3601149232 wait complete. 2024-08-19T00:52:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:50 smithi086 ceph-mon[24511]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:52:51.442 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724553 got 167503724555 for osd.5 2024-08-19T00:52:51.442 DEBUG:teuthology.parallel:result is None 2024-08-19T00:52:51.679 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:51 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3601149232' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-19T00:52:51.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.827+0000 7f6b574ed640 1 -- 172.21.15.17:0/1783987382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b500ffb30 msgr2=0x7f6b500fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:51.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.827+0000 7f6b574ed640 1 --2- 172.21.15.17:0/1783987382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b500ffb30 0x7f6b500fff90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009880 tx=0x7f6b4402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:51.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.827+0000 7f6b574ed640 1 -- 172.21.15.17:0/1783987382 shutdown_connections 2024-08-19T00:52:51.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.827+0000 7f6b574ed640 1 --2- 172.21.15.17:0/1783987382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b500ffb30 0x7f6b500fff90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:51.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.827+0000 7f6b574ed640 1 --2- 172.21.15.17:0/1783987382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b50105be0 0x7f6b50105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:51.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.827+0000 7f6b574ed640 1 -- 172.21.15.17:0/1783987382 >> 172.21.15.17:0/1783987382 conn(0x7f6b500fb810 msgr2=0x7f6b500fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:51.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.828+0000 7f6b574ed640 1 -- 172.21.15.17:0/1783987382 shutdown_connections 2024-08-19T00:52:51.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.828+0000 7f6b574ed640 1 -- 172.21.15.17:0/1783987382 wait complete. 2024-08-19T00:52:51.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.828+0000 7f6b574ed640 1 Processor -- start 2024-08-19T00:52:51.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.828+0000 7f6b574ed640 1 -- start start 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.828+0000 7f6b574ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b500ffb30 0x7f6b5019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.828+0000 7f6b574ed640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b50105be0 0x7f6b5019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.828+0000 7f6b574ed640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5019c330 con 0x7f6b500ffb30 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.828+0000 7f6b574ed640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b501958c0 con 0x7f6b50105be0 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.828+0000 7f6b55289640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b500ffb30 0x7f6b5019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b55289640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b500ffb30 0x7f6b5019b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48398/0 (socket says 172.21.15.17:48398) 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b55289640 1 -- 172.21.15.17:0/1910626515 learned_addr learned my addr 172.21.15.17:0/1910626515 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b54a88640 1 --2- 172.21.15.17:0/1910626515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b50105be0 0x7f6b5019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b55289640 1 -- 172.21.15.17:0/1910626515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b50105be0 msgr2=0x7f6b5019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b55289640 1 --2- 172.21.15.17:0/1910626515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b50105be0 0x7f6b5019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b55289640 1 -- 172.21.15.17:0/1910626515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b44009560 con 0x7f6b500ffb30 2024-08-19T00:52:51.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b55289640 1 --2- 172.21.15.17:0/1910626515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b500ffb30 0x7f6b5019b7d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800d6f0 tx=0x7f6b4800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:51.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b4e7fc640 1 -- 172.21.15.17:0/1910626515 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b48009a30 con 0x7f6b500ffb30 2024-08-19T00:52:51.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b574ed640 1 -- 172.21.15.17:0/1910626515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b50195ba0 con 0x7f6b500ffb30 2024-08-19T00:52:51.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b4e7fc640 1 -- 172.21.15.17:0/1910626515 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b480054e0 con 0x7f6b500ffb30 2024-08-19T00:52:51.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b4e7fc640 1 -- 172.21.15.17:0/1910626515 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b48010460 con 0x7f6b500ffb30 2024-08-19T00:52:51.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.829+0000 7f6b574ed640 1 -- 172.21.15.17:0/1910626515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b50196140 con 0x7f6b500ffb30 2024-08-19T00:52:51.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.830+0000 7f6b574ed640 1 -- 172.21.15.17:0/1910626515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b501011e0 con 0x7f6b500ffb30 2024-08-19T00:52:51.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.831+0000 7f6b4e7fc640 1 -- 172.21.15.17:0/1910626515 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f6b48009b90 con 0x7f6b500ffb30 2024-08-19T00:52:51.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.831+0000 7f6b4e7fc640 1 --2- 172.21.15.17:0/1910626515 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f6b3806cc50 0x7f6b3806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:51.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.831+0000 7f6b4e7fc640 1 -- 172.21.15.17:0/1910626515 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6b4808ba10 con 0x7f6b500ffb30 2024-08-19T00:52:51.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.831+0000 7f6b54a88640 1 --2- 172.21.15.17:0/1910626515 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f6b3806cc50 0x7f6b3806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:51.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.832+0000 7f6b54a88640 1 --2- 172.21.15.17:0/1910626515 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f6b3806cc50 0x7f6b3806f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009230 tx=0x7f6b440058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:51.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:51.835+0000 7f6b4e7fc640 1 -- 172.21.15.17:0/1910626515 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f6b480561d0 con 0x7f6b500ffb30 2024-08-19T00:52:51.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:51 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3601149232' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-19T00:52:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.009+0000 7f6b574ed640 1 -- 172.21.15.17:0/1910626515 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6b500fff90 con 0x7f6b500ffb30 2024-08-19T00:52:52.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.009+0000 7f6b4e7fc640 1 -- 172.21.15.17:0/1910626515 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6b48020090 con 0x7f6b500ffb30 2024-08-19T00:52:52.012 INFO:teuthology.orchestra.run.smithi017.stdout:146028888082 2024-08-19T00:52:52.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7f6b574ed640 1 -- 172.21.15.17:0/1910626515 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f6b3806cc50 msgr2=0x7f6b3806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7f6b574ed640 1 --2- 172.21.15.17:0/1910626515 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f6b3806cc50 0x7f6b3806f110 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009230 tx=0x7f6b440058d0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7f6b574ed640 1 -- 172.21.15.17:0/1910626515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b500ffb30 msgr2=0x7f6b5019b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7f6b574ed640 1 --2- 172.21.15.17:0/1910626515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b500ffb30 0x7f6b5019b7d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800d6f0 tx=0x7f6b4800dbb0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7f6b574ed640 1 -- 172.21.15.17:0/1910626515 shutdown_connections 2024-08-19T00:52:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7f6b574ed640 1 --2- 172.21.15.17:0/1910626515 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f6b3806cc50 0x7f6b3806f110 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7f6b574ed640 1 --2- 172.21.15.17:0/1910626515 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b50105be0 0x7f6b5019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7f6b574ed640 1 --2- 172.21.15.17:0/1910626515 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b500ffb30 0x7f6b5019b7d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7f6b574ed640 1 -- 172.21.15.17:0/1910626515 >> 172.21.15.17:0/1910626515 conn(0x7f6b500fb810 msgr2=0x7f6b500fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7f6b574ed640 1 -- 172.21.15.17:0/1910626515 shutdown_connections 2024-08-19T00:52:52.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7f6b574ed640 1 -- 172.21.15.17:0/1910626515 wait complete. 2024-08-19T00:52:52.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7fb1a4acd640 1 -- 172.21.15.17:0/3164813391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1a00fe9f0 msgr2=0x7fb1a00fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7fb1a4acd640 1 --2- 172.21.15.17:0/3164813391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1a00fe9f0 0x7fb1a00fee50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb190009880 tx=0x7fb19002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7fb1a4acd640 1 -- 172.21.15.17:0/3164813391 shutdown_connections 2024-08-19T00:52:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7fb1a4acd640 1 --2- 172.21.15.17:0/3164813391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1a00fe9f0 0x7fb1a00fee50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7fb1a4acd640 1 --2- 172.21.15.17:0/3164813391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a01049f0 0x7fb1a0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7fb1a4acd640 1 -- 172.21.15.17:0/3164813391 >> 172.21.15.17:0/3164813391 conn(0x7fb1a00758a0 msgr2=0x7fb1a00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7fb1a4acd640 1 -- 172.21.15.17:0/3164813391 shutdown_connections 2024-08-19T00:52:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.011+0000 7fb1a4acd640 1 -- 172.21.15.17:0/3164813391 wait complete. 2024-08-19T00:52:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.012+0000 7fb1a4acd640 1 Processor -- start 2024-08-19T00:52:52.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.012+0000 7fb1a4acd640 1 -- start start 2024-08-19T00:52:52.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.012+0000 7fb1a4acd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1a00fe9f0 0x7fb1a019da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:52.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.012+0000 7fb1a4acd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a01049f0 0x7fb1a019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:52.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.012+0000 7fb1a4acd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a0197b40 con 0x7fb1a00fe9f0 2024-08-19T00:52:52.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.012+0000 7fb1a4acd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a0197cb0 con 0x7fb1a01049f0 2024-08-19T00:52:52.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.012+0000 7fb19e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1a00fe9f0 0x7fb1a019da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:52.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.012+0000 7fb19e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1a00fe9f0 0x7fb1a019da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48420/0 (socket says 172.21.15.17:48420) 2024-08-19T00:52:52.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.012+0000 7fb19e59c640 1 -- 172.21.15.17:0/2037678721 learned_addr learned my addr 172.21.15.17:0/2037678721 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:52.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.012+0000 7fb19dd9b640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a01049f0 0x7fb1a019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:52.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.013+0000 7fb19dd9b640 1 -- 172.21.15.17:0/2037678721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1a00fe9f0 msgr2=0x7fb1a019da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:52.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.013+0000 7fb19dd9b640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1a00fe9f0 0x7fb1a019da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.013+0000 7fb19dd9b640 1 -- 172.21.15.17:0/2037678721 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190009560 con 0x7fb1a01049f0 2024-08-19T00:52:52.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.013+0000 7fb19e59c640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1a00fe9f0 0x7fb1a019da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:52:52.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.013+0000 7fb19dd9b640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a01049f0 0x7fb1a019df90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb19002a9c0 tx=0x7fb1900055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:52.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.013+0000 7fb1977fe640 1 -- 172.21.15.17:0/2037678721 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb190004aa0 con 0x7fb1a01049f0 2024-08-19T00:52:52.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.013+0000 7fb1977fe640 1 -- 172.21.15.17:0/2037678721 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb190031470 con 0x7fb1a01049f0 2024-08-19T00:52:52.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.013+0000 7fb1a4acd640 1 -- 172.21.15.17:0/2037678721 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a0197f30 con 0x7fb1a01049f0 2024-08-19T00:52:52.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.013+0000 7fb1977fe640 1 -- 172.21.15.17:0/2037678721 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1900039b0 con 0x7fb1a01049f0 2024-08-19T00:52:52.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.013+0000 7fb1a4acd640 1 -- 172.21.15.17:0/2037678721 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a0198420 con 0x7fb1a01049f0 2024-08-19T00:52:52.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.014+0000 7fb1a4acd640 1 -- 172.21.15.17:0/2037678721 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a0100130 con 0x7fb1a01049f0 2024-08-19T00:52:52.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.015+0000 7fb1977fe640 1 -- 172.21.15.17:0/2037678721 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb190031c00 con 0x7fb1a01049f0 2024-08-19T00:52:52.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.015+0000 7fb1977fe640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb18c06cc50 0x7fb18c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:52.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.015+0000 7fb1977fe640 1 -- 172.21.15.17:0/2037678721 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb1900ace50 con 0x7fb1a01049f0 2024-08-19T00:52:52.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.015+0000 7fb19e59c640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb18c06cc50 0x7fb18c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:52.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.016+0000 7fb19e59c640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb18c06cc50 0x7fb18c06f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb188005fd0 tx=0x7fb18800b4a0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:52.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.020+0000 7fb1977fe640 1 -- 172.21.15.17:0/2037678721 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb190077610 con 0x7fb1a01049f0 2024-08-19T00:52:52.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.194+0000 7fb1a4acd640 1 -- 172.21.15.17:0/2037678721 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb1a010bc60 con 0x7fb1a01049f0 2024-08-19T00:52:52.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.194+0000 7fb1977fe640 1 -- 172.21.15.17:0/2037678721 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb19007ac30 con 0x7fb1a01049f0 2024-08-19T00:52:52.200 INFO:teuthology.orchestra.run.smithi017.stdout:81604378651 2024-08-19T00:52:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.196+0000 7fb1a4acd640 1 -- 172.21.15.17:0/2037678721 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb18c06cc50 msgr2=0x7fb18c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.196+0000 7fb1a4acd640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb18c06cc50 0x7fb18c06f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb188005fd0 tx=0x7fb18800b4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.196+0000 7fb1a4acd640 1 -- 172.21.15.17:0/2037678721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a01049f0 msgr2=0x7fb1a019df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.196+0000 7fb1a4acd640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a01049f0 0x7fb1a019df90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb19002a9c0 tx=0x7fb1900055a0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.196+0000 7fb1a4acd640 1 -- 172.21.15.17:0/2037678721 shutdown_connections 2024-08-19T00:52:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.196+0000 7fb1a4acd640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb18c06cc50 0x7fb18c06f110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.196+0000 7fb1a4acd640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb1a01049f0 0x7fb1a019df90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.196+0000 7fb1a4acd640 1 --2- 172.21.15.17:0/2037678721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1a00fe9f0 0x7fb1a019da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.196+0000 7fb1a4acd640 1 -- 172.21.15.17:0/2037678721 >> 172.21.15.17:0/2037678721 conn(0x7fb1a00758a0 msgr2=0x7fb1a0102160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.196+0000 7fb1a4acd640 1 -- 172.21.15.17:0/2037678721 shutdown_connections 2024-08-19T00:52:52.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:52.197+0000 7fb1a4acd640 1 -- 172.21.15.17:0/2037678721 wait complete. 2024-08-19T00:52:52.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:52 smithi017 ceph-mon[16627]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:52.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:52 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1910626515' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-19T00:52:52.905 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:52 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2037678721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-19T00:52:52.931 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378651 for osd.2 2024-08-19T00:52:52.932 DEBUG:teuthology.parallel:result is None 2024-08-19T00:52:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:52 smithi086 ceph-mon[24511]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:52 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/1910626515' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-19T00:52:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:52 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/2037678721' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-19T00:52:53.458 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888078 got 146028888082 for osd.4 2024-08-19T00:52:53.459 DEBUG:teuthology.parallel:result is None 2024-08-19T00:52:53.642 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542176 for osd.1 2024-08-19T00:52:53.642 DEBUG:teuthology.parallel:result is None 2024-08-19T00:52:53.642 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-19T00:52:53.643 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-19T00:52:53.856 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:54.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:54 smithi017 ceph-mon[16627]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:54 smithi086 ceph-mon[24511]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:55.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.406+0000 7fb74941f640 1 -- 172.21.15.17:0/498772004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7440fe9f0 msgr2=0x7fb7440fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:55.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.406+0000 7fb74941f640 1 --2- 172.21.15.17:0/498772004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7440fe9f0 0x7fb7440fee50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009880 tx=0x7fb72c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:52:55.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.406+0000 7fb74941f640 1 -- 172.21.15.17:0/498772004 shutdown_connections 2024-08-19T00:52:55.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.406+0000 7fb74941f640 1 --2- 172.21.15.17:0/498772004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7440fe9f0 0x7fb7440fee50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:55.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.406+0000 7fb74941f640 1 --2- 172.21.15.17:0/498772004 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7441049f0 0x7fb744104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:55.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.406+0000 7fb74941f640 1 -- 172.21.15.17:0/498772004 >> 172.21.15.17:0/498772004 conn(0x7fb7440758a0 msgr2=0x7fb7440fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:55.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.406+0000 7fb74941f640 1 -- 172.21.15.17:0/498772004 shutdown_connections 2024-08-19T00:52:55.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.406+0000 7fb74941f640 1 -- 172.21.15.17:0/498772004 wait complete. 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.407+0000 7fb74941f640 1 Processor -- start 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.407+0000 7fb74941f640 1 -- start start 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.407+0000 7fb74941f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7440fe9f0 0x7fb744196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.407+0000 7fb74941f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7441049f0 0x7fb744196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.407+0000 7fb74941f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb744197450 con 0x7fb7440fe9f0 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.407+0000 7fb74941f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7441975c0 con 0x7fb7441049f0 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.407+0000 7fb742ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7440fe9f0 0x7fb744196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.407+0000 7fb742ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7440fe9f0 0x7fb744196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48428/0 (socket says 172.21.15.17:48428) 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.407+0000 7fb742ffd640 1 -- 172.21.15.17:0/2685751432 learned_addr learned my addr 172.21.15.17:0/2685751432 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.407+0000 7fb7427fc640 1 --2- 172.21.15.17:0/2685751432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7441049f0 0x7fb744196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.408+0000 7fb742ffd640 1 -- 172.21.15.17:0/2685751432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7441049f0 msgr2=0x7fb744196e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.408+0000 7fb742ffd640 1 --2- 172.21.15.17:0/2685751432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7441049f0 0x7fb744196e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.408+0000 7fb742ffd640 1 -- 172.21.15.17:0/2685751432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c009560 con 0x7fb7440fe9f0 2024-08-19T00:52:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.408+0000 7fb742ffd640 1 --2- 172.21.15.17:0/2685751432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7440fe9f0 0x7fb744196940 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb73400e970 tx=0x7fb73400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.408+0000 7fb73bfff640 1 -- 172.21.15.17:0/2685751432 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb73400cc90 con 0x7fb7440fe9f0 2024-08-19T00:52:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.408+0000 7fb74941f640 1 -- 172.21.15.17:0/2685751432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74419f9b0 con 0x7fb7440fe9f0 2024-08-19T00:52:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.408+0000 7fb73bfff640 1 -- 172.21.15.17:0/2685751432 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb73400cdf0 con 0x7fb7440fe9f0 2024-08-19T00:52:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.408+0000 7fb73bfff640 1 -- 172.21.15.17:0/2685751432 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb734010430 con 0x7fb7440fe9f0 2024-08-19T00:52:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.408+0000 7fb74941f640 1 -- 172.21.15.17:0/2685751432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74419fe20 con 0x7fb7440fe9f0 2024-08-19T00:52:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.409+0000 7fb74941f640 1 -- 172.21.15.17:0/2685751432 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb744100130 con 0x7fb7440fe9f0 2024-08-19T00:52:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.410+0000 7fb73bfff640 1 -- 172.21.15.17:0/2685751432 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fb734005020 con 0x7fb7440fe9f0 2024-08-19T00:52:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.410+0000 7fb73bfff640 1 --2- 172.21.15.17:0/2685751432 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb73006cc50 0x7fb73006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.410+0000 7fb73bfff640 1 -- 172.21.15.17:0/2685751432 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb734014070 con 0x7fb7440fe9f0 2024-08-19T00:52:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.410+0000 7fb7427fc640 1 --2- 172.21.15.17:0/2685751432 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb73006cc50 0x7fb73006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:55.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.411+0000 7fb7427fc640 1 --2- 172.21.15.17:0/2685751432 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb73006cc50 0x7fb73006f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009230 tx=0x7fb72c0058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.418+0000 7fb73bfff640 1 -- 172.21.15.17:0/2685751432 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fb734056b00 con 0x7fb7440fe9f0 2024-08-19T00:52:55.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.589+0000 7fb74941f640 1 -- 172.21.15.17:0/2685751432 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb74410bc80 con 0x7fb73006cc50 2024-08-19T00:52:55.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.591+0000 7fb73bfff640 1 -- 172.21.15.17:0/2685751432 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27675 (secure 0 0 0) 0x7fb74410bc80 con 0x7fb73006cc50 2024-08-19T00:52:55.593 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:52:55.593 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-08-19T00:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.593+0000 7fb74941f640 1 -- 172.21.15.17:0/2685751432 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb73006cc50 msgr2=0x7fb73006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.593+0000 7fb74941f640 1 --2- 172.21.15.17:0/2685751432 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb73006cc50 0x7fb73006f110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009230 tx=0x7fb72c0058d0 comp rx=0 tx=0).stop 2024-08-19T00:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.593+0000 7fb74941f640 1 -- 172.21.15.17:0/2685751432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7440fe9f0 msgr2=0x7fb744196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.593+0000 7fb74941f640 1 --2- 172.21.15.17:0/2685751432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7440fe9f0 0x7fb744196940 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb73400e970 tx=0x7fb73400ed70 comp rx=0 tx=0).stop 2024-08-19T00:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.593+0000 7fb74941f640 1 -- 172.21.15.17:0/2685751432 shutdown_connections 2024-08-19T00:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.593+0000 7fb74941f640 1 --2- 172.21.15.17:0/2685751432 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fb73006cc50 0x7fb73006f110 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.593+0000 7fb74941f640 1 --2- 172.21.15.17:0/2685751432 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb7441049f0 0x7fb744196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.593+0000 7fb74941f640 1 --2- 172.21.15.17:0/2685751432 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7440fe9f0 0x7fb744196940 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.593+0000 7fb74941f640 1 -- 172.21.15.17:0/2685751432 >> 172.21.15.17:0/2685751432 conn(0x7fb7440758a0 msgr2=0x7fb7440fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.593+0000 7fb74941f640 1 -- 172.21.15.17:0/2685751432 shutdown_connections 2024-08-19T00:52:55.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:55.593+0000 7fb74941f640 1 -- 172.21.15.17:0/2685751432 wait complete. 2024-08-19T00:52:55.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:55 smithi017 ceph-mon[16627]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:55.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:55 smithi017 ceph-mon[16627]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:52:55.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:55 smithi086 ceph-mon[24511]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:55.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:55 smithi086 ceph-mon[24511]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:52:56.194 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-08-19T00:52:55.516133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":194672,"kb_used_data":3872,"kb_used_omap":9,"kb_used_meta":190710,"kb_avail":562276240,"statfs":{"total":575970213888,"available":575770869760,"internally_reserved":0,"allocated":3964928,"data_stored":2606519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":195287719},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002051"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-19T00:52:03.605199+0000","last_change":"2024-08-19T00:51:38.374807+0000","last_active":"2024-08-19T00:52:03.605199+0000","last_peered":"2024-08-19T00:52:03.605199+0000","last_clean":"2024-08-19T00:52:03.605199+0000","last_became_active":"2024-08-19T00:51:38.374502+0000","last_became_peered":"2024-08-19T00:51:38.374502+0000","last_unstale":"2024-08-19T00:52:03.605199+0000","last_undegraded":"2024-08-19T00:52:03.605199+0000","last_fullsized":"2024-08-19T00:52:03.605199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:50:53.831128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:50:53.831128+0000","last_clean_scrub_stamp":"2024-08-19T00:50:53.831128+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:45:30.124433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":4,"up_from":34,"seq":146028888083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31476,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713676,"statfs":{"total":95995035648,"available":95962804224,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Aug 19 00:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42499999999999999}]},{"osd":1,"last update":"Mon Aug 19 00:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.439},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.505}]},{"osd":2,"last update":"Mon Aug 19 00:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Mon Aug 19 00:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":954368,"data_stored":729328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Aug 19 00:52:14 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Aug 19 00:52:14 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.434},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54800000000000004}]},{"osd":2,"last update":"Mon Aug 19 00:52:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53300000000000003}]},{"osd":4,"last update":"Mon Aug 19 00:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Aug 19 00:51:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.33500000000000002}]},{"osd":1,"last update":"Mon Aug 19 00:51:55 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"last":0.30599999999999999}]},{"osd":3,"last update":"Mon Aug 19 00:52:14 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.624}]},{"osd":4,"last update":"Mon Aug 19 00:52:40 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":13.987,"5min":13.987,"15min":13.987},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":958464,"data_stored":729659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Aug 19 00:52:29 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.33500000000000002,"15min":0.33000000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51400000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.218,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.44900000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.45200000000000001}]},{"osd":2,"last update":"Mon Aug 19 00:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.42799999999999999}]},{"osd":3,"last update":"Mon Aug 19 00:52:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.55400000000000005}]},{"osd":4,"last update":"Mon Aug 19 00:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40248,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93704904,"statfs":{"total":95995035648,"available":95953821696,"internally_reserved":0,"allocated":958464,"data_stored":729659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Aug 19 00:52:26 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.28999999999999998},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.42399999999999999,"5min":0.441,"15min":0.441},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.31,"15min":0.30399999999999999},"min":{"1min":0.251,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.35399999999999998}]},{"osd":2,"last update":"Mon Aug 19 00:51:56 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.32400000000000001}]},{"osd":3,"last update":"Mon Aug 19 00:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.55900000000000005}]},{"osd":4,"last update":"Mon Aug 19 00:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:52:56.195 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-19T00:52:56.408 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:58.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.084+0000 7fd5b5f02640 1 -- 172.21.15.17:0/727869776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0101630 msgr2=0x7fd5b0109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:58.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.084+0000 7fd5b5f02640 1 --2- 172.21.15.17:0/727869776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0101630 0x7fd5b0109b20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40098b0 tx=0x7fd5a402a560 comp rx=0 tx=0).stop 2024-08-19T00:52:58.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.084+0000 7fd5b5f02640 1 -- 172.21.15.17:0/727869776 shutdown_connections 2024-08-19T00:52:58.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.084+0000 7fd5b5f02640 1 --2- 172.21.15.17:0/727869776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0101630 0x7fd5b0109b20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:58.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.084+0000 7fd5b5f02640 1 --2- 172.21.15.17:0/727869776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b0100d10 0x7fd5b01010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:58.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.084+0000 7fd5b5f02640 1 -- 172.21.15.17:0/727869776 >> 172.21.15.17:0/727869776 conn(0x7fd5b00758a0 msgr2=0x7fd5b00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:58.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.084+0000 7fd5b5f02640 1 -- 172.21.15.17:0/727869776 shutdown_connections 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.084+0000 7fd5b5f02640 1 -- 172.21.15.17:0/727869776 wait complete. 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.084+0000 7fd5b5f02640 1 Processor -- start 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5b5f02640 1 -- start start 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5b5f02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0100d10 0x7fd5b019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5b5f02640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b0101630 0x7fd5b019bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5b5f02640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b019c550 con 0x7fd5b0100d10 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5b5f02640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b0195ae0 con 0x7fd5b0101630 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5af7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0100d10 0x7fd5b019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5af7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0100d10 0x7fd5b019b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33786/0 (socket says 172.21.15.17:33786) 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5af7fe640 1 -- 172.21.15.17:0/641771455 learned_addr learned my addr 172.21.15.17:0/641771455 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5aeffd640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b0101630 0x7fd5b019bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5af7fe640 1 -- 172.21.15.17:0/641771455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b0101630 msgr2=0x7fd5b019bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5af7fe640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b0101630 0x7fd5b019bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.085+0000 7fd5af7fe640 1 -- 172.21.15.17:0/641771455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4009560 con 0x7fd5b0100d10 2024-08-19T00:52:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.086+0000 7fd5aeffd640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b0101630 0x7fd5b019bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:52:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.086+0000 7fd5af7fe640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0100d10 0x7fd5b019b9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000b420 tx=0x7fd5a000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.086+0000 7fd5acff9640 1 -- 172.21.15.17:0/641771455 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5a0011800 con 0x7fd5b0100d10 2024-08-19T00:52:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.086+0000 7fd5acff9640 1 -- 172.21.15.17:0/641771455 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5a0011e20 con 0x7fd5b0100d10 2024-08-19T00:52:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.086+0000 7fd5acff9640 1 -- 172.21.15.17:0/641771455 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5a000f2e0 con 0x7fd5b0100d10 2024-08-19T00:52:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.086+0000 7fd5b5f02640 1 -- 172.21.15.17:0/641771455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b0195d60 con 0x7fd5b0100d10 2024-08-19T00:52:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.086+0000 7fd5b5f02640 1 -- 172.21.15.17:0/641771455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b0196260 con 0x7fd5b0100d10 2024-08-19T00:52:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.087+0000 7fd5b5f02640 1 -- 172.21.15.17:0/641771455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b00684b0 con 0x7fd5b0100d10 2024-08-19T00:52:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.087+0000 7fd5acff9640 1 -- 172.21.15.17:0/641771455 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd5a0010380 con 0x7fd5b0100d10 2024-08-19T00:52:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.088+0000 7fd5acff9640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd59806cc50 0x7fd59806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:52:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.088+0000 7fd5acff9640 1 -- 172.21.15.17:0/641771455 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd5a008b880 con 0x7fd5b0100d10 2024-08-19T00:52:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.088+0000 7fd5aeffd640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd59806cc50 0x7fd59806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:52:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.089+0000 7fd5aeffd640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd59806cc50 0x7fd59806f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4000c00 tx=0x7fd5a4005e60 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:52:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.093+0000 7fd5acff9640 1 -- 172.21.15.17:0/641771455 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd5a0055f90 con 0x7fd5b0100d10 2024-08-19T00:52:58.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.266+0000 7fd5b5f02640 1 -- 172.21.15.17:0/641771455 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5b010ce00 con 0x7fd59806cc50 2024-08-19T00:52:58.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.267+0000 7fd5acff9640 1 -- 172.21.15.17:0/641771455 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27647 (secure 0 0 0) 0x7fd5b010ce00 con 0x7fd59806cc50 2024-08-19T00:52:58.269 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:52:58.269 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-08-19T00:52:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.269+0000 7fd5b5f02640 1 -- 172.21.15.17:0/641771455 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd59806cc50 msgr2=0x7fd59806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.269+0000 7fd5b5f02640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd59806cc50 0x7fd59806f110 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4000c00 tx=0x7fd5a4005e60 comp rx=0 tx=0).stop 2024-08-19T00:52:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.269+0000 7fd5b5f02640 1 -- 172.21.15.17:0/641771455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0100d10 msgr2=0x7fd5b019b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:52:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.269+0000 7fd5b5f02640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0100d10 0x7fd5b019b9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000b420 tx=0x7fd5a000b8e0 comp rx=0 tx=0).stop 2024-08-19T00:52:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.269+0000 7fd5b5f02640 1 -- 172.21.15.17:0/641771455 shutdown_connections 2024-08-19T00:52:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.269+0000 7fd5b5f02640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd59806cc50 0x7fd59806f110 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.269+0000 7fd5b5f02640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b0101630 0x7fd5b019bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:58.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.269+0000 7fd5b5f02640 1 --2- 172.21.15.17:0/641771455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0100d10 0x7fd5b019b9f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:52:58.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.269+0000 7fd5b5f02640 1 -- 172.21.15.17:0/641771455 >> 172.21.15.17:0/641771455 conn(0x7fd5b00758a0 msgr2=0x7fd5b0101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:52:58.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.269+0000 7fd5b5f02640 1 -- 172.21.15.17:0/641771455 shutdown_connections 2024-08-19T00:52:58.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:52:58.269+0000 7fd5b5f02640 1 -- 172.21.15.17:0/641771455 wait complete. 2024-08-19T00:52:58.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:58 smithi017 ceph-mon[16627]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:58.907 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-08-19T00:52:57.516415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":194672,"kb_used_data":3872,"kb_used_omap":9,"kb_used_meta":190710,"kb_avail":562276240,"statfs":{"total":575970213888,"available":575770869760,"internally_reserved":0,"allocated":3964928,"data_stored":2606519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9561,"internal_metadata":195287719},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002004"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-08-19T00:52:03.605199+0000","last_change":"2024-08-19T00:51:38.374807+0000","last_active":"2024-08-19T00:52:03.605199+0000","last_peered":"2024-08-19T00:52:03.605199+0000","last_clean":"2024-08-19T00:52:03.605199+0000","last_became_active":"2024-08-19T00:51:38.374502+0000","last_became_peered":"2024-08-19T00:51:38.374502+0000","last_unstale":"2024-08-19T00:52:03.605199+0000","last_undegraded":"2024-08-19T00:52:03.605199+0000","last_fullsized":"2024-08-19T00:52:03.605199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-19T00:50:53.831128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-19T00:50:53.831128+0000","last_clean_scrub_stamp":"2024-08-19T00:50:53.831128+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-20T07:45:30.124433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":4,"up_from":34,"seq":146028888083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31476,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713676,"statfs":{"total":95995035648,"available":95962804224,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Aug 19 00:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.42499999999999999}]},{"osd":1,"last update":"Mon Aug 19 00:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.439},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.505}]},{"osd":2,"last update":"Mon Aug 19 00:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Mon Aug 19 00:52:40 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":954368,"data_stored":729328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31848905},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Aug 19 00:52:14 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.51000000000000001}]},{"osd":1,"last update":"Mon Aug 19 00:52:14 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.434},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.54800000000000004}]},{"osd":2,"last update":"Mon Aug 19 00:52:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.53300000000000003}]},{"osd":4,"last update":"Mon Aug 19 00:52:38 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.56999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":364544,"data_stored":139291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Aug 19 00:51:55 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.33500000000000002}]},{"osd":1,"last update":"Mon Aug 19 00:51:55 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"last":0.30599999999999999}]},{"osd":3,"last update":"Mon Aug 19 00:52:14 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.624}]},{"osd":4,"last update":"Mon Aug 19 00:52:40 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.304,"15min":1.304},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":13.987,"5min":13.987,"15min":13.987},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36148,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709004,"statfs":{"total":95995035648,"available":95958020096,"internally_reserved":0,"allocated":958464,"data_stored":729659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Aug 19 00:52:29 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.33500000000000002,"15min":0.33000000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.51400000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.219},{"interface":"front","average":{"1min":0.376,"5min":0.34499999999999997,"15min":0.34000000000000002},"min":{"1min":0.218,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.44900000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.25600000000000001}]},{"osd":2,"last update":"Mon Aug 19 00:51:54 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.27500000000000002}]},{"osd":3,"last update":"Mon Aug 19 00:52:17 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.42199999999999999}]},{"osd":4,"last update":"Mon Aug 19 00:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40248,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":93704904,"statfs":{"total":95995035648,"available":95953821696,"internally_reserved":0,"allocated":958464,"data_stored":729659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Aug 19 00:52:26 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.29399999999999998,"15min":0.28999999999999998},"min":{"1min":0.23400000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.42399999999999999,"5min":0.441,"15min":0.441},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.31,"15min":0.30399999999999999},"min":{"1min":0.251,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.29799999999999999}]},{"osd":2,"last update":"Mon Aug 19 00:51:56 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.249},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.28199999999999997}]},{"osd":3,"last update":"Mon Aug 19 00:52:15 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Aug 19 00:52:41 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-19T00:52:58.908 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-19T00:52:58.908 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-19T00:52:58.909 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-19T00:52:58.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph health --format=json 2024-08-19T00:52:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:58 smithi086 ceph-mon[24511]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:52:59.119 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:52:59.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:52:59 smithi017 ceph-mon[16627]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:52:59.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:52:59 smithi086 ceph-mon[24511]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-19T00:53:00.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.731+0000 7f93d06f7640 1 -- 172.21.15.17:0/829613007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93c80fea30 msgr2=0x7f93c80fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.731+0000 7f93d06f7640 1 --2- 172.21.15.17:0/829613007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93c80fea30 0x7f93c80fee90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009880 tx=0x7f93b802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.731+0000 7f93d06f7640 1 -- 172.21.15.17:0/829613007 shutdown_connections 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.731+0000 7f93d06f7640 1 --2- 172.21.15.17:0/829613007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93c80fea30 0x7f93c80fee90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.731+0000 7f93d06f7640 1 --2- 172.21.15.17:0/829613007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93c8104a30 0x7f93c8104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.731+0000 7f93d06f7640 1 -- 172.21.15.17:0/829613007 >> 172.21.15.17:0/829613007 conn(0x7f93c80fa730 msgr2=0x7f93c80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.732+0000 7f93d06f7640 1 -- 172.21.15.17:0/829613007 shutdown_connections 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.732+0000 7f93d06f7640 1 -- 172.21.15.17:0/829613007 wait complete. 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.732+0000 7f93d06f7640 1 Processor -- start 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.732+0000 7f93d06f7640 1 -- start start 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.732+0000 7f93d06f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93c80fea30 0x7f93c81968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.732+0000 7f93d06f7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93c8104a30 0x7f93c8196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:00.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.732+0000 7f93d06f7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c81973f0 con 0x7f93c80fea30 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.732+0000 7f93d06f7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c8197560 con 0x7f93c8104a30 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93ce493640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93c80fea30 0x7f93c81968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93ce493640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93c80fea30 0x7f93c81968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33804/0 (socket says 172.21.15.17:33804) 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93ce493640 1 -- 172.21.15.17:0/2019095733 learned_addr learned my addr 172.21.15.17:0/2019095733 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93cdc92640 1 --2- 172.21.15.17:0/2019095733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93c8104a30 0x7f93c8196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93ce493640 1 -- 172.21.15.17:0/2019095733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93c8104a30 msgr2=0x7f93c8196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93ce493640 1 --2- 172.21.15.17:0/2019095733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93c8104a30 0x7f93c8196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93ce493640 1 -- 172.21.15.17:0/2019095733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b8009560 con 0x7f93c80fea30 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93ce493640 1 --2- 172.21.15.17:0/2019095733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93c80fea30 0x7f93c81968e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f93c400c810 tx=0x7f93c400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93bf7fe640 1 -- 172.21.15.17:0/2019095733 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c40041f0 con 0x7f93c80fea30 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93bf7fe640 1 -- 172.21.15.17:0/2019095733 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93c4007e70 con 0x7f93c80fea30 2024-08-19T00:53:00.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93d06f7640 1 -- 172.21.15.17:0/2019095733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c819f950 con 0x7f93c80fea30 2024-08-19T00:53:00.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93bf7fe640 1 -- 172.21.15.17:0/2019095733 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93c40049d0 con 0x7f93c80fea30 2024-08-19T00:53:00.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.733+0000 7f93d06f7640 1 -- 172.21.15.17:0/2019095733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c819fdc0 con 0x7f93c80fea30 2024-08-19T00:53:00.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.734+0000 7f93d06f7640 1 -- 172.21.15.17:0/2019095733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c8100170 con 0x7f93c80fea30 2024-08-19T00:53:00.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.735+0000 7f93bf7fe640 1 -- 172.21.15.17:0/2019095733 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f93c40079b0 con 0x7f93c80fea30 2024-08-19T00:53:00.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.735+0000 7f93bf7fe640 1 --2- 172.21.15.17:0/2019095733 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f93b406cc50 0x7f93b406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:00.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.735+0000 7f93cdc92640 1 --2- 172.21.15.17:0/2019095733 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f93b406cc50 0x7f93b406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:00.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.735+0000 7f93bf7fe640 1 -- 172.21.15.17:0/2019095733 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f93c408bc90 con 0x7f93c80fea30 2024-08-19T00:53:00.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.736+0000 7f93cdc92640 1 --2- 172.21.15.17:0/2019095733 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f93b406cc50 0x7f93b406f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009230 tx=0x7f93b80058d0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:00.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.740+0000 7f93bf7fe640 1 -- 172.21.15.17:0/2019095733 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f93c4056450 con 0x7f93c80fea30 2024-08-19T00:53:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:00 smithi017 ceph-mon[16627]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:00 smithi086 ceph-mon[24511]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:00.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.948+0000 7f93d06f7640 1 -- 172.21.15.17:0/2019095733 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f93c8068b60 con 0x7f93c80fea30 2024-08-19T00:53:00.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.948+0000 7f93bf7fe640 1 -- 172.21.15.17:0/2019095733 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f93c8068b60 con 0x7f93c80fea30 2024-08-19T00:53:00.950 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:53:00.950 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-19T00:53:00.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.950+0000 7f93d06f7640 1 -- 172.21.15.17:0/2019095733 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f93b406cc50 msgr2=0x7f93b406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:00.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.950+0000 7f93d06f7640 1 --2- 172.21.15.17:0/2019095733 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f93b406cc50 0x7f93b406f110 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009230 tx=0x7f93b80058d0 comp rx=0 tx=0).stop 2024-08-19T00:53:00.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.950+0000 7f93d06f7640 1 -- 172.21.15.17:0/2019095733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93c80fea30 msgr2=0x7f93c81968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:00.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.950+0000 7f93d06f7640 1 --2- 172.21.15.17:0/2019095733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93c80fea30 0x7f93c81968e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f93c400c810 tx=0x7f93c400ccd0 comp rx=0 tx=0).stop 2024-08-19T00:53:00.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.950+0000 7f93d06f7640 1 -- 172.21.15.17:0/2019095733 shutdown_connections 2024-08-19T00:53:00.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.950+0000 7f93d06f7640 1 --2- 172.21.15.17:0/2019095733 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f93b406cc50 0x7f93b406f110 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:00.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.950+0000 7f93d06f7640 1 --2- 172.21.15.17:0/2019095733 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f93c8104a30 0x7f93c8196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:00.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.950+0000 7f93d06f7640 1 --2- 172.21.15.17:0/2019095733 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93c80fea30 0x7f93c81968e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:00.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.950+0000 7f93d06f7640 1 -- 172.21.15.17:0/2019095733 >> 172.21.15.17:0/2019095733 conn(0x7f93c80fa730 msgr2=0x7f93c80fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:00.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.950+0000 7f93d06f7640 1 -- 172.21.15.17:0/2019095733 shutdown_connections 2024-08-19T00:53:00.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:00.950+0000 7f93d06f7640 1 -- 172.21.15.17:0/2019095733 wait complete. 2024-08-19T00:53:01.569 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-19T00:53:01.569 INFO:tasks.cephadm:Setup complete, yielding 2024-08-19T00:53:01.569 INFO:teuthology.run_tasks:Running task print... 2024-08-19T00:53:01.579 INFO:teuthology.task.print:**** done end installing reef cephadm ... 2024-08-19T00:53:01.579 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-19T00:53:01.587 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:53:01.587 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-08-19T00:53:01.793 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:01.915 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:01 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2019095733' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-19T00:53:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:01 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/2019095733' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-19T00:53:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:02 smithi017 ceph-mon[16627]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:02.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:02 smithi086 ceph-mon[24511]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:03.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.438+0000 7fc2abec0640 1 -- 172.21.15.17:0/2462201811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2a40ffca0 msgr2=0x7fc2a4100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.438+0000 7fc2abec0640 1 --2- 172.21.15.17:0/2462201811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2a40ffca0 0x7fc2a4100120 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc294009880 tx=0x7fc29402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.438+0000 7fc2abec0640 1 -- 172.21.15.17:0/2462201811 shutdown_connections 2024-08-19T00:53:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.438+0000 7fc2abec0640 1 --2- 172.21.15.17:0/2462201811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2a40ffca0 0x7fc2a4100120 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.438+0000 7fc2abec0640 1 --2- 172.21.15.17:0/2462201811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2a40feaa0 0x7fc2a40feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.438+0000 7fc2abec0640 1 -- 172.21.15.17:0/2462201811 >> 172.21.15.17:0/2462201811 conn(0x7fc2a40fa250 msgr2=0x7fc2a40fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.438+0000 7fc2abec0640 1 -- 172.21.15.17:0/2462201811 shutdown_connections 2024-08-19T00:53:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.438+0000 7fc2abec0640 1 -- 172.21.15.17:0/2462201811 wait complete. 2024-08-19T00:53:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2abec0640 1 Processor -- start 2024-08-19T00:53:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2abec0640 1 -- start start 2024-08-19T00:53:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2abec0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2a40feaa0 0x7fc2a41029e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:03.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2abec0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2a40ffca0 0x7fc2a4101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2abec0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a41015c0 con 0x7fc2a40ffca0 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2abec0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4101730 con 0x7fc2a40feaa0 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2a945b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2a40ffca0 0x7fc2a4101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2a945b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2a40ffca0 0x7fc2a4101080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33818/0 (socket says 172.21.15.17:33818) 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2a945b640 1 -- 172.21.15.17:0/378423931 learned_addr learned my addr 172.21.15.17:0/378423931 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2a9c5c640 1 --2- 172.21.15.17:0/378423931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2a40feaa0 0x7fc2a41029e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2a945b640 1 -- 172.21.15.17:0/378423931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2a40feaa0 msgr2=0x7fc2a41029e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2a945b640 1 --2- 172.21.15.17:0/378423931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2a40feaa0 0x7fc2a41029e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2a945b640 1 -- 172.21.15.17:0/378423931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc294009560 con 0x7fc2a40ffca0 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.439+0000 7fc2a945b640 1 --2- 172.21.15.17:0/378423931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2a40ffca0 0x7fc2a4101080 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc2940054f0 tx=0x7fc294005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.440+0000 7fc29affd640 1 -- 172.21.15.17:0/378423931 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc294004aa0 con 0x7fc2a40ffca0 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.440+0000 7fc2abec0640 1 -- 172.21.15.17:0/378423931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a41019b0 con 0x7fc2a40ffca0 2024-08-19T00:53:03.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.440+0000 7fc29affd640 1 -- 172.21.15.17:0/378423931 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc294004c00 con 0x7fc2a40ffca0 2024-08-19T00:53:03.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.440+0000 7fc29affd640 1 -- 172.21.15.17:0/378423931 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc294003ac0 con 0x7fc2a40ffca0 2024-08-19T00:53:03.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.440+0000 7fc2abec0640 1 -- 172.21.15.17:0/378423931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a419d6d0 con 0x7fc2a40ffca0 2024-08-19T00:53:03.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.441+0000 7fc2abec0640 1 -- 172.21.15.17:0/378423931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a40feea0 con 0x7fc2a40ffca0 2024-08-19T00:53:03.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.441+0000 7fc29affd640 1 -- 172.21.15.17:0/378423931 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc294031c70 con 0x7fc2a40ffca0 2024-08-19T00:53:03.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.442+0000 7fc29affd640 1 --2- 172.21.15.17:0/378423931 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc29006cc50 0x7fc29006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:03.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.442+0000 7fc29affd640 1 -- 172.21.15.17:0/378423931 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc2940ad0c0 con 0x7fc2a40ffca0 2024-08-19T00:53:03.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.442+0000 7fc2a9c5c640 1 --2- 172.21.15.17:0/378423931 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc29006cc50 0x7fc29006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:03.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.442+0000 7fc2a9c5c640 1 --2- 172.21.15.17:0/378423931 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc29006cc50 0x7fc29006f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40ffb00 tx=0x7fc2a000b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:03.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.446+0000 7fc29affd640 1 -- 172.21.15.17:0/378423931 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fc294077880 con 0x7fc2a40ffca0 2024-08-19T00:53:03.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.618+0000 7fc2abec0640 1 -- 172.21.15.17:0/378423931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fc2a4107690 con 0x7fc2a40ffca0 2024-08-19T00:53:03.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.622+0000 7fc29affd640 1 -- 172.21.15.17:0/378423931 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v24)=0 v24) v1 ==== 143+0+0 (secure 0 0 0) 0x7fc29407aea0 con 0x7fc2a40ffca0 2024-08-19T00:53:03.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.624+0000 7fc2abec0640 1 -- 172.21.15.17:0/378423931 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc29006cc50 msgr2=0x7fc29006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:03.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.624+0000 7fc2abec0640 1 --2- 172.21.15.17:0/378423931 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc29006cc50 0x7fc29006f110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc2a40ffb00 tx=0x7fc2a000b390 comp rx=0 tx=0).stop 2024-08-19T00:53:03.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.624+0000 7fc2abec0640 1 -- 172.21.15.17:0/378423931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2a40ffca0 msgr2=0x7fc2a4101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:03.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.624+0000 7fc2abec0640 1 --2- 172.21.15.17:0/378423931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2a40ffca0 0x7fc2a4101080 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc2940054f0 tx=0x7fc294005520 comp rx=0 tx=0).stop 2024-08-19T00:53:03.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.624+0000 7fc2abec0640 1 -- 172.21.15.17:0/378423931 shutdown_connections 2024-08-19T00:53:03.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.624+0000 7fc2abec0640 1 --2- 172.21.15.17:0/378423931 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc29006cc50 0x7fc29006f110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:03.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.624+0000 7fc2abec0640 1 --2- 172.21.15.17:0/378423931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc2a40ffca0 0x7fc2a4101080 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:03.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.624+0000 7fc2abec0640 1 --2- 172.21.15.17:0/378423931 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc2a40feaa0 0x7fc2a41029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:03.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.624+0000 7fc2abec0640 1 -- 172.21.15.17:0/378423931 >> 172.21.15.17:0/378423931 conn(0x7fc2a40fa250 msgr2=0x7fc2a4068520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:03.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.625+0000 7fc2abec0640 1 -- 172.21.15.17:0/378423931 shutdown_connections 2024-08-19T00:53:03.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:03.625+0000 7fc2abec0640 1 -- 172.21.15.17:0/378423931 wait complete. 2024-08-19T00:53:04.364 INFO:teuthology.run_tasks:Running task print... 2024-08-19T00:53:04.373 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-08-19T00:53:04.373 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-19T00:53:04.445 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:53:04.445 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph orch status' 2024-08-19T00:53:04.652 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:04.922 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:04 smithi017 ceph-mon[16627]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:04.922 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:04 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/378423931' entity='client.admin' 2024-08-19T00:53:04.922 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:53:04.922 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:04.922 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:53:04.922 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:04 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:04 smithi086 ceph-mon[24511]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:04 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/378423931' entity='client.admin' 2024-08-19T00:53:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:53:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:53:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:04 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:05.750 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:05 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:53:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:05 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:53:06.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.251+0000 7fd8e5900640 1 -- 172.21.15.17:0/4181085090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e0100d90 msgr2=0x7fd8e0101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:06.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.251+0000 7fd8e5900640 1 --2- 172.21.15.17:0/4181085090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e0100d90 0x7fd8e0101210 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009880 tx=0x7fd8c802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:06.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.251+0000 7fd8e5900640 1 -- 172.21.15.17:0/4181085090 shutdown_connections 2024-08-19T00:53:06.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.251+0000 7fd8e5900640 1 --2- 172.21.15.17:0/4181085090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e0100d90 0x7fd8e0101210 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:06.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.251+0000 7fd8e5900640 1 --2- 172.21.15.17:0/4181085090 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e00ffb90 0x7fd8e00fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:06.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.252+0000 7fd8e5900640 1 -- 172.21.15.17:0/4181085090 >> 172.21.15.17:0/4181085090 conn(0x7fd8e00fb320 msgr2=0x7fd8e00fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:06.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.252+0000 7fd8e5900640 1 -- 172.21.15.17:0/4181085090 shutdown_connections 2024-08-19T00:53:06.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.252+0000 7fd8e5900640 1 -- 172.21.15.17:0/4181085090 wait complete. 2024-08-19T00:53:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.252+0000 7fd8e5900640 1 Processor -- start 2024-08-19T00:53:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.252+0000 7fd8e5900640 1 -- start start 2024-08-19T00:53:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.252+0000 7fd8e5900640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e00ffb90 0x7fd8e0195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.252+0000 7fd8e5900640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e0100d90 0x7fd8e0195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.252+0000 7fd8e5900640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e0196140 con 0x7fd8e00ffb90 2024-08-19T00:53:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.252+0000 7fd8e5900640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e01962b0 con 0x7fd8e0100d90 2024-08-19T00:53:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e00ffb90 0x7fd8e0195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8deffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e00ffb90 0x7fd8e0195630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33834/0 (socket says 172.21.15.17:33834) 2024-08-19T00:53:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8deffd640 1 -- 172.21.15.17:0/2668551143 learned_addr learned my addr 172.21.15.17:0/2668551143 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8de7fc640 1 --2- 172.21.15.17:0/2668551143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e0100d90 0x7fd8e0195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:06.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8deffd640 1 -- 172.21.15.17:0/2668551143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e0100d90 msgr2=0x7fd8e0195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:06.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8deffd640 1 --2- 172.21.15.17:0/2668551143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e0100d90 0x7fd8e0195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:06.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8deffd640 1 -- 172.21.15.17:0/2668551143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c8009560 con 0x7fd8e00ffb90 2024-08-19T00:53:06.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8deffd640 1 --2- 172.21.15.17:0/2668551143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e00ffb90 0x7fd8e0195630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000ea50 tx=0x7fd8d000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:06.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8e48fe640 1 -- 172.21.15.17:0/2668551143 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8d000cd90 con 0x7fd8e00ffb90 2024-08-19T00:53:06.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8e48fe640 1 -- 172.21.15.17:0/2668551143 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8d0003e30 con 0x7fd8e00ffb90 2024-08-19T00:53:06.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8e5900640 1 -- 172.21.15.17:0/2668551143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e019ad50 con 0x7fd8e00ffb90 2024-08-19T00:53:06.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8e48fe640 1 -- 172.21.15.17:0/2668551143 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8d00116a0 con 0x7fd8e00ffb90 2024-08-19T00:53:06.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.253+0000 7fd8e5900640 1 -- 172.21.15.17:0/2668551143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e019b290 con 0x7fd8e00ffb90 2024-08-19T00:53:06.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.254+0000 7fd8e5900640 1 -- 172.21.15.17:0/2668551143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e018f730 con 0x7fd8e00ffb90 2024-08-19T00:53:06.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.255+0000 7fd8e48fe640 1 -- 172.21.15.17:0/2668551143 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd8d0004030 con 0x7fd8e00ffb90 2024-08-19T00:53:06.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.255+0000 7fd8e48fe640 1 --2- 172.21.15.17:0/2668551143 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd8cc06cc50 0x7fd8cc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:06.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.256+0000 7fd8e48fe640 1 -- 172.21.15.17:0/2668551143 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd8d008c400 con 0x7fd8e00ffb90 2024-08-19T00:53:06.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.256+0000 7fd8de7fc640 1 --2- 172.21.15.17:0/2668551143 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd8cc06cc50 0x7fd8cc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:06.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.256+0000 7fd8de7fc640 1 --2- 172.21.15.17:0/2668551143 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd8cc06cc50 0x7fd8cc06f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8000c00 tx=0x7fd8c80314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:06.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.260+0000 7fd8e48fe640 1 -- 172.21.15.17:0/2668551143 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd8d0056b20 con 0x7fd8e00ffb90 2024-08-19T00:53:06.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.445+0000 7fd8e5900640 1 -- 172.21.15.17:0/2668551143 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8e002c520 con 0x7fd8cc06cc50 2024-08-19T00:53:06.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.446+0000 7fd8e48fe640 1 -- 172.21.15.17:0/2668551143 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd8e002c520 con 0x7fd8cc06cc50 2024-08-19T00:53:06.449 INFO:teuthology.orchestra.run.smithi017.stdout:Backend: cephadm 2024-08-19T00:53:06.449 INFO:teuthology.orchestra.run.smithi017.stdout:Available: Yes 2024-08-19T00:53:06.449 INFO:teuthology.orchestra.run.smithi017.stdout:Paused: No 2024-08-19T00:53:06.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.448+0000 7fd8e5900640 1 -- 172.21.15.17:0/2668551143 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd8cc06cc50 msgr2=0x7fd8cc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:06.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.448+0000 7fd8e5900640 1 --2- 172.21.15.17:0/2668551143 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd8cc06cc50 0x7fd8cc06f110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8000c00 tx=0x7fd8c80314e0 comp rx=0 tx=0).stop 2024-08-19T00:53:06.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.448+0000 7fd8e5900640 1 -- 172.21.15.17:0/2668551143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e00ffb90 msgr2=0x7fd8e0195630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:06.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.448+0000 7fd8e5900640 1 --2- 172.21.15.17:0/2668551143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e00ffb90 0x7fd8e0195630 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd8d000ea50 tx=0x7fd8d000ef10 comp rx=0 tx=0).stop 2024-08-19T00:53:06.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.448+0000 7fd8e5900640 1 -- 172.21.15.17:0/2668551143 shutdown_connections 2024-08-19T00:53:06.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.448+0000 7fd8e5900640 1 --2- 172.21.15.17:0/2668551143 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd8cc06cc50 0x7fd8cc06f110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.448+0000 7fd8e5900640 1 --2- 172.21.15.17:0/2668551143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8e0100d90 0x7fd8e0195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.448+0000 7fd8e5900640 1 --2- 172.21.15.17:0/2668551143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8e00ffb90 0x7fd8e0195630 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.448+0000 7fd8e5900640 1 -- 172.21.15.17:0/2668551143 >> 172.21.15.17:0/2668551143 conn(0x7fd8e00fb320 msgr2=0x7fd8e0104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.448+0000 7fd8e5900640 1 -- 172.21.15.17:0/2668551143 shutdown_connections 2024-08-19T00:53:06.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:06.448+0000 7fd8e5900640 1 -- 172.21.15.17:0/2668551143 wait complete. 2024-08-19T00:53:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:06 smithi017 ceph-mon[16627]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:06 smithi086 ceph-mon[24511]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:07.306 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-19T00:53:07.518 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:07.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:07 smithi017 ceph-mon[16627]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:07.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:07 smithi086 ceph-mon[24511]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:08.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:08 smithi017 ceph-mon[16627]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:08.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:08 smithi086 ceph-mon[24511]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:09.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.155+0000 7ff5e7188640 1 -- 172.21.15.17:0/1577244656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00feaf0 msgr2=0x7ff5e00feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.155+0000 7ff5e7188640 1 --2- 172.21.15.17:0/1577244656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00feaf0 0x7ff5e00feef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009880 tx=0x7ff5dc02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.155+0000 7ff5e7188640 1 -- 172.21.15.17:0/1577244656 shutdown_connections 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.155+0000 7ff5e7188640 1 --2- 172.21.15.17:0/1577244656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e00ffcf0 0x7ff5e0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.155+0000 7ff5e7188640 1 --2- 172.21.15.17:0/1577244656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00feaf0 0x7ff5e00feef0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.155+0000 7ff5e7188640 1 -- 172.21.15.17:0/1577244656 >> 172.21.15.17:0/1577244656 conn(0x7ff5e00fa280 msgr2=0x7ff5e00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.155+0000 7ff5e7188640 1 -- 172.21.15.17:0/1577244656 shutdown_connections 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.155+0000 7ff5e7188640 1 -- 172.21.15.17:0/1577244656 wait complete. 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.156+0000 7ff5e7188640 1 Processor -- start 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.156+0000 7ff5e7188640 1 -- start start 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.156+0000 7ff5e7188640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e00feaf0 0x7ff5e01956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.156+0000 7ff5e7188640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffcf0 0x7ff5e0195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:09.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.156+0000 7ff5e7188640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e01961c0 con 0x7ff5e00ffcf0 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.156+0000 7ff5e7188640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0196330 con 0x7ff5e00feaf0 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.156+0000 7ff5d7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffcf0 0x7ff5e0195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.156+0000 7ff5d7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffcf0 0x7ff5e0195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48884/0 (socket says 172.21.15.17:48884) 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.156+0000 7ff5d7fff640 1 -- 172.21.15.17:0/2074606015 learned_addr learned my addr 172.21.15.17:0/2074606015 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.156+0000 7ff5e4f24640 1 --2- 172.21.15.17:0/2074606015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e00feaf0 0x7ff5e01956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.157+0000 7ff5d7fff640 1 -- 172.21.15.17:0/2074606015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e00feaf0 msgr2=0x7ff5e01956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.157+0000 7ff5d7fff640 1 --2- 172.21.15.17:0/2074606015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e00feaf0 0x7ff5e01956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.157+0000 7ff5d7fff640 1 -- 172.21.15.17:0/2074606015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc009560 con 0x7ff5e00ffcf0 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.157+0000 7ff5d7fff640 1 --2- 172.21.15.17:0/2074606015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffcf0 0x7ff5e0195bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000c840 tx=0x7ff5d000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.157+0000 7ff5d5ffb640 1 -- 172.21.15.17:0/2074606015 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d00041f0 con 0x7ff5e00ffcf0 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.157+0000 7ff5d5ffb640 1 -- 172.21.15.17:0/2074606015 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5d0007e70 con 0x7ff5e00ffcf0 2024-08-19T00:53:09.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.157+0000 7ff5e7188640 1 -- 172.21.15.17:0/2074606015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e019add0 con 0x7ff5e00ffcf0 2024-08-19T00:53:09.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.157+0000 7ff5d5ffb640 1 -- 172.21.15.17:0/2074606015 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d00049d0 con 0x7ff5e00ffcf0 2024-08-19T00:53:09.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.157+0000 7ff5e7188640 1 -- 172.21.15.17:0/2074606015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e019b2f0 con 0x7ff5e00ffcf0 2024-08-19T00:53:09.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.158+0000 7ff5e7188640 1 -- 172.21.15.17:0/2074606015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e00feef0 con 0x7ff5e00ffcf0 2024-08-19T00:53:09.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.159+0000 7ff5d5ffb640 1 -- 172.21.15.17:0/2074606015 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff5d00079b0 con 0x7ff5e00ffcf0 2024-08-19T00:53:09.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.159+0000 7ff5d5ffb640 1 --2- 172.21.15.17:0/2074606015 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5c806cc50 0x7ff5c806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:09.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.159+0000 7ff5d5ffb640 1 -- 172.21.15.17:0/2074606015 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff5d008bbf0 con 0x7ff5e00ffcf0 2024-08-19T00:53:09.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.159+0000 7ff5e4f24640 1 --2- 172.21.15.17:0/2074606015 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5c806cc50 0x7ff5c806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:09.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.160+0000 7ff5e4f24640 1 --2- 172.21.15.17:0/2074606015 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5c806cc50 0x7ff5c806f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009230 tx=0x7ff5dc0314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:09.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.164+0000 7ff5d5ffb640 1 -- 172.21.15.17:0/2074606015 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff5d0056430 con 0x7ff5e00ffcf0 2024-08-19T00:53:09.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.342+0000 7ff5e7188640 1 -- 172.21.15.17:0/2074606015 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5e00683f0 con 0x7ff5c806cc50 2024-08-19T00:53:09.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.351+0000 7ff5d5ffb640 1 -- 172.21.15.17:0/2074606015 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3080 (secure 0 0 0) 0x7ff5e00683f0 con 0x7ff5c806cc50 2024-08-19T00:53:09.353 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:53:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (3m) 2m ago 5m 25.8M - 0.25.0 c8568f914cd2 eb29e4d36dfe 2024-08-19T00:53:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (5m) 2m ago 5m 7130k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T00:53:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (4m) 68s ago 4m 7050k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T00:53:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (5m) 2m ago 5m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T00:53:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (4m) 68s ago 4m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T00:53:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (3m) 2m ago 4m 79.4M - 9.4.7 954c08fa6188 293dd58dd677 2024-08-19T00:53:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:9283,8765,8443 running (6m) 2m ago 6m 480M - 18.2.4-721-gbaa926de e6c292a6bc95 41b04ec2a4ce 2024-08-19T00:53:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (4m) 68s ago 4m 440M - 18.2.4-721-gbaa926de e6c292a6bc95 9dded54f98f7 2024-08-19T00:53:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (6m) 2m ago 6m 44.7M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 771bc6b905a5 2024-08-19T00:53:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (4m) 68s ago 4m 42.8M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 c6fce0ad535d 2024-08-19T00:53:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (5m) 2m ago 5m 15.9M - 1.5.0 0da6a335fe13 33c11a243263 2024-08-19T00:53:09.355 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (4m) 68s ago 4m 16.2M - 1.5.0 0da6a335fe13 15ad23a27a0c 2024-08-19T00:53:09.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (3m) 2m ago 3m 48.7M 3948M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T00:53:09.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (2m) 2m ago 2m 47.3M 3948M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T00:53:09.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (2m) 2m ago 2m 40.0M 3948M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T00:53:09.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (2m) 68s ago 2m 49.7M 4970M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T00:53:09.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (97s) 68s ago 97s 48.3M 4970M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T00:53:09.355 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (72s) 68s ago 72s 12.1M 4970M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T00:53:09.355 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (3m) 2m ago 4m 40.1M - 2.43.0 a07b618ecd1d b4713fd83be3 2024-08-19T00:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.352+0000 7ff5e7188640 1 -- 172.21.15.17:0/2074606015 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5c806cc50 msgr2=0x7ff5c806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.353+0000 7ff5e7188640 1 --2- 172.21.15.17:0/2074606015 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5c806cc50 0x7ff5c806f110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009230 tx=0x7ff5dc0314e0 comp rx=0 tx=0).stop 2024-08-19T00:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.353+0000 7ff5e7188640 1 -- 172.21.15.17:0/2074606015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffcf0 msgr2=0x7ff5e0195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.353+0000 7ff5e7188640 1 --2- 172.21.15.17:0/2074606015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffcf0 0x7ff5e0195bf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000c840 tx=0x7ff5d000cd00 comp rx=0 tx=0).stop 2024-08-19T00:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.353+0000 7ff5e7188640 1 -- 172.21.15.17:0/2074606015 shutdown_connections 2024-08-19T00:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.353+0000 7ff5e7188640 1 --2- 172.21.15.17:0/2074606015 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5c806cc50 0x7ff5c806f110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:09.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.353+0000 7ff5e7188640 1 --2- 172.21.15.17:0/2074606015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffcf0 0x7ff5e0195bf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.353+0000 7ff5e7188640 1 --2- 172.21.15.17:0/2074606015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e00feaf0 0x7ff5e01956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.353+0000 7ff5e7188640 1 -- 172.21.15.17:0/2074606015 >> 172.21.15.17:0/2074606015 conn(0x7ff5e00fa280 msgr2=0x7ff5e0067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.353+0000 7ff5e7188640 1 -- 172.21.15.17:0/2074606015 shutdown_connections 2024-08-19T00:53:09.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:09.353+0000 7ff5e7188640 1 -- 172.21.15.17:0/2074606015 wait complete. 2024-08-19T00:53:09.922 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:09 smithi017 ceph-mon[16627]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:09.922 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:09 smithi017 ceph-mon[16627]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:09.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-19T00:53:09.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:09 smithi086 ceph-mon[24511]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:09.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:09 smithi086 ceph-mon[24511]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:10.150 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:11.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.660+0000 7fe8406af640 1 -- 172.21.15.17:0/3392118167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8380ffca0 msgr2=0x7fe838100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:11.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.660+0000 7fe8406af640 1 --2- 172.21.15.17:0/3392118167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8380ffca0 0x7fe838100120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe828009880 tx=0x7fe82802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:11.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.660+0000 7fe8406af640 1 -- 172.21.15.17:0/3392118167 shutdown_connections 2024-08-19T00:53:11.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.660+0000 7fe8406af640 1 --2- 172.21.15.17:0/3392118167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8380ffca0 0x7fe838100120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:11.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.660+0000 7fe8406af640 1 --2- 172.21.15.17:0/3392118167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380feaa0 0x7fe8380feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:11.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.660+0000 7fe8406af640 1 -- 172.21.15.17:0/3392118167 >> 172.21.15.17:0/3392118167 conn(0x7fe8380fa250 msgr2=0x7fe8380fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:11.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.660+0000 7fe8406af640 1 -- 172.21.15.17:0/3392118167 shutdown_connections 2024-08-19T00:53:11.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.660+0000 7fe8406af640 1 -- 172.21.15.17:0/3392118167 wait complete. 2024-08-19T00:53:11.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe8406af640 1 Processor -- start 2024-08-19T00:53:11.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe8406af640 1 -- start start 2024-08-19T00:53:11.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe8406af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380feaa0 0x7fe8381945f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:11.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe8406af640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8380ffca0 0x7fe838194b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:11.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe8406af640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe838195100 con 0x7fe8380ffca0 2024-08-19T00:53:11.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe8406af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe838195270 con 0x7fe8380feaa0 2024-08-19T00:53:11.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe83dc4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8380ffca0 0x7fe838194b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:11.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe83dc4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8380ffca0 0x7fe838194b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48908/0 (socket says 172.21.15.17:48908) 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe83dc4a640 1 -- 172.21.15.17:0/2074530615 learned_addr learned my addr 172.21.15.17:0/2074530615 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe83e44b640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380feaa0 0x7fe8381945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe83dc4a640 1 -- 172.21.15.17:0/2074530615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380feaa0 msgr2=0x7fe8381945f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe83dc4a640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380feaa0 0x7fe8381945f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe83dc4a640 1 -- 172.21.15.17:0/2074530615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe828009560 con 0x7fe8380ffca0 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe83e44b640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380feaa0 0x7fe8381945f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.661+0000 7fe83dc4a640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8380ffca0 0x7fe838194b30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe8280055f0 tx=0x7fe828005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.662+0000 7fe82f7fe640 1 -- 172.21.15.17:0/2074530615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe828004b20 con 0x7fe8380ffca0 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.662+0000 7fe82f7fe640 1 -- 172.21.15.17:0/2074530615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe828004c80 con 0x7fe8380ffca0 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.662+0000 7fe8406af640 1 -- 172.21.15.17:0/2074530615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe838199cb0 con 0x7fe8380ffca0 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.662+0000 7fe82f7fe640 1 -- 172.21.15.17:0/2074530615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe828003bc0 con 0x7fe8380ffca0 2024-08-19T00:53:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.662+0000 7fe8406af640 1 -- 172.21.15.17:0/2074530615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83819a220 con 0x7fe8380ffca0 2024-08-19T00:53:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.663+0000 7fe8406af640 1 -- 172.21.15.17:0/2074530615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe838107730 con 0x7fe8380ffca0 2024-08-19T00:53:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.663+0000 7fe82f7fe640 1 -- 172.21.15.17:0/2074530615 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe828031640 con 0x7fe8380ffca0 2024-08-19T00:53:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.664+0000 7fe82f7fe640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe82406cc60 0x7fe82406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.664+0000 7fe82f7fe640 1 -- 172.21.15.17:0/2074530615 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe8280ad160 con 0x7fe8380ffca0 2024-08-19T00:53:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.664+0000 7fe83e44b640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe82406cc60 0x7fe82406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.665+0000 7fe83e44b640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe82406cc60 0x7fe82406f120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe834006fd0 tx=0x7fe834008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:11.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.668+0000 7fe82f7fe640 1 -- 172.21.15.17:0/2074530615 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe8280778f0 con 0x7fe8380ffca0 2024-08-19T00:53:11.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.845+0000 7fe8406af640 1 -- 172.21.15.17:0/2074530615 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe83819a460 con 0x7fe82406cc60 2024-08-19T00:53:11.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.849+0000 7fe82f7fe640 1 -- 172.21.15.17:0/2074530615 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1290 (secure 0 0 0) 0x7fe83819a460 con 0x7fe82406cc60 2024-08-19T00:53:11.852 INFO:teuthology.orchestra.run.smithi017.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-19T00:53:11.852 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-08-19T00:53:11.852 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter 2/2 2m ago 5m * 2024-08-19T00:53:11.853 INFO:teuthology.orchestra.run.smithi017.stdout:crash 2/2 2m ago 5m * 2024-08-19T00:53:11.853 INFO:teuthology.orchestra.run.smithi017.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-08-19T00:53:11.853 INFO:teuthology.orchestra.run.smithi017.stdout:mgr 2/2 2m ago 5m count:2 2024-08-19T00:53:11.853 INFO:teuthology.orchestra.run.smithi017.stdout:mon 2/2 2m ago 5m smithi017:172.21.15.17=smithi017;smithi086:172.21.15.86=smithi086;count:2 2024-08-19T00:53:11.853 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-08-19T00:53:11.853 INFO:teuthology.orchestra.run.smithi017.stdout:osd 6 2m ago - 2024-08-19T00:53:11.853 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-08-19T00:53:11.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.851+0000 7fe8406af640 1 -- 172.21.15.17:0/2074530615 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe82406cc60 msgr2=0x7fe82406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:11.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.851+0000 7fe8406af640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe82406cc60 0x7fe82406f120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe834006fd0 tx=0x7fe834008040 comp rx=0 tx=0).stop 2024-08-19T00:53:11.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.851+0000 7fe8406af640 1 -- 172.21.15.17:0/2074530615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8380ffca0 msgr2=0x7fe838194b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:11.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.851+0000 7fe8406af640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8380ffca0 0x7fe838194b30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe8280055f0 tx=0x7fe828005620 comp rx=0 tx=0).stop 2024-08-19T00:53:11.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.851+0000 7fe8406af640 1 -- 172.21.15.17:0/2074530615 shutdown_connections 2024-08-19T00:53:11.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.851+0000 7fe8406af640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe82406cc60 0x7fe82406f120 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:11.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.851+0000 7fe8406af640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8380ffca0 0x7fe838194b30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:11.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.851+0000 7fe8406af640 1 --2- 172.21.15.17:0/2074530615 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8380feaa0 0x7fe8381945f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:11.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.851+0000 7fe8406af640 1 -- 172.21.15.17:0/2074530615 >> 172.21.15.17:0/2074530615 conn(0x7fe8380fa250 msgr2=0x7fe838102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:11.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.851+0000 7fe8406af640 1 -- 172.21.15.17:0/2074530615 shutdown_connections 2024-08-19T00:53:11.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:11.851+0000 7fe8406af640 1 -- 172.21.15.17:0/2074530615 wait complete. 2024-08-19T00:53:12.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-19T00:53:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:12.885 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:12 smithi017 ceph-mon[16627]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:12 smithi086 ceph-mon[24511]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:13.859 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:13 smithi017 ceph-mon[16627]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:13.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:13 smithi086 ceph-mon[24511]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:14.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.359+0000 7f436d37c640 1 -- 172.21.15.17:0/3746769208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43680ffc80 msgr2=0x7f4368100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:14.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.359+0000 7f436d37c640 1 --2- 172.21.15.17:0/3746769208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43680ffc80 0x7f4368100100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f435c009880 tx=0x7f435c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:14.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.359+0000 7f436d37c640 1 -- 172.21.15.17:0/3746769208 shutdown_connections 2024-08-19T00:53:14.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.359+0000 7f436d37c640 1 --2- 172.21.15.17:0/3746769208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43680ffc80 0x7f4368100100 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.359+0000 7f436d37c640 1 --2- 172.21.15.17:0/3746769208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43680fea80 0x7f43680fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.359+0000 7f436d37c640 1 -- 172.21.15.17:0/3746769208 >> 172.21.15.17:0/3746769208 conn(0x7f43680fa230 msgr2=0x7f43680fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.359+0000 7f436d37c640 1 -- 172.21.15.17:0/3746769208 shutdown_connections 2024-08-19T00:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.359+0000 7f436d37c640 1 -- 172.21.15.17:0/3746769208 wait complete. 2024-08-19T00:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.359+0000 7f436d37c640 1 Processor -- start 2024-08-19T00:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f436d37c640 1 -- start start 2024-08-19T00:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f436d37c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43680fea80 0x7f4368068fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f436d37c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43680ffc80 0x7f436819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f436d37c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436819a970 con 0x7f43680ffc80 2024-08-19T00:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f436d37c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436819aab0 con 0x7f43680fea80 2024-08-19T00:53:14.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f43667fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43680ffc80 0x7f436819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f43667fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43680ffc80 0x7f436819a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48926/0 (socket says 172.21.15.17:48926) 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f43667fc640 1 -- 172.21.15.17:0/2817567728 learned_addr learned my addr 172.21.15.17:0/2817567728 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f4366ffd640 1 --2- 172.21.15.17:0/2817567728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43680fea80 0x7f4368068fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f43667fc640 1 -- 172.21.15.17:0/2817567728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43680fea80 msgr2=0x7f4368068fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f43667fc640 1 --2- 172.21.15.17:0/2817567728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43680fea80 0x7f4368068fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.360+0000 7f43667fc640 1 -- 172.21.15.17:0/2817567728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c009560 con 0x7f43680ffc80 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.361+0000 7f43667fc640 1 --2- 172.21.15.17:0/2817567728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43680ffc80 0x7f436819a3a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f435c004650 tx=0x7f435c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.361+0000 7f434ffff640 1 -- 172.21.15.17:0/2817567728 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f435c004aa0 con 0x7f43680ffc80 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.361+0000 7f436d37c640 1 -- 172.21.15.17:0/2817567728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436819ace0 con 0x7f43680ffc80 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.361+0000 7f434ffff640 1 -- 172.21.15.17:0/2817567728 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f435c005d50 con 0x7f43680ffc80 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.361+0000 7f434ffff640 1 -- 172.21.15.17:0/2817567728 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f435c0039e0 con 0x7f43680ffc80 2024-08-19T00:53:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.361+0000 7f436d37c640 1 -- 172.21.15.17:0/2817567728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436819b250 con 0x7f43680ffc80 2024-08-19T00:53:14.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.362+0000 7f436d37c640 1 -- 172.21.15.17:0/2817567728 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436818e620 con 0x7f43680ffc80 2024-08-19T00:53:14.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.362+0000 7f434ffff640 1 -- 172.21.15.17:0/2817567728 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f435c031c00 con 0x7f43680ffc80 2024-08-19T00:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.363+0000 7f434ffff640 1 --2- 172.21.15.17:0/2817567728 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f435006cc50 0x7f435006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.363+0000 7f434ffff640 1 -- 172.21.15.17:0/2817567728 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f435c0acf70 con 0x7f43680ffc80 2024-08-19T00:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.363+0000 7f4366ffd640 1 --2- 172.21.15.17:0/2817567728 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f435006cc50 0x7f435006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.363+0000 7f4366ffd640 1 --2- 172.21.15.17:0/2817567728 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f435006cc50 0x7f435006f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f43680ffae0 tx=0x7f4358005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.367+0000 7f434ffff640 1 -- 172.21.15.17:0/2817567728 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f435c0e0de0 con 0x7f43680ffc80 2024-08-19T00:53:14.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.544+0000 7f436d37c640 1 -- 172.21.15.17:0/2817567728 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f436802c450 con 0x7f435006cc50 2024-08-19T00:53:14.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.545+0000 7f434ffff640 1 -- 172.21.15.17:0/2817567728 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7f436802c450 con 0x7f435006cc50 2024-08-19T00:53:14.547 INFO:teuthology.orchestra.run.smithi017.stdout:HOST ADDR LABELS STATUS 2024-08-19T00:53:14.547 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 172.21.15.17 2024-08-19T00:53:14.548 INFO:teuthology.orchestra.run.smithi017.stdout:smithi086 172.21.15.86 2024-08-19T00:53:14.548 INFO:teuthology.orchestra.run.smithi017.stdout:2 hosts in cluster 2024-08-19T00:53:14.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.547+0000 7f436d37c640 1 -- 172.21.15.17:0/2817567728 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f435006cc50 msgr2=0x7f435006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:14.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.547+0000 7f436d37c640 1 --2- 172.21.15.17:0/2817567728 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f435006cc50 0x7f435006f110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f43680ffae0 tx=0x7f4358005f90 comp rx=0 tx=0).stop 2024-08-19T00:53:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.547+0000 7f436d37c640 1 -- 172.21.15.17:0/2817567728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43680ffc80 msgr2=0x7f436819a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.547+0000 7f436d37c640 1 --2- 172.21.15.17:0/2817567728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43680ffc80 0x7f436819a3a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f435c004650 tx=0x7f435c0055a0 comp rx=0 tx=0).stop 2024-08-19T00:53:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.548+0000 7f436d37c640 1 -- 172.21.15.17:0/2817567728 shutdown_connections 2024-08-19T00:53:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.548+0000 7f436d37c640 1 --2- 172.21.15.17:0/2817567728 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f435006cc50 0x7f435006f110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.548+0000 7f436d37c640 1 --2- 172.21.15.17:0/2817567728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43680ffc80 0x7f436819a3a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.548+0000 7f436d37c640 1 --2- 172.21.15.17:0/2817567728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43680fea80 0x7f4368068fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.548+0000 7f436d37c640 1 -- 172.21.15.17:0/2817567728 >> 172.21.15.17:0/2817567728 conn(0x7f43680fa230 msgr2=0x7f4368103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.548+0000 7f436d37c640 1 -- 172.21.15.17:0/2817567728 shutdown_connections 2024-08-19T00:53:14.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:14.548+0000 7f436d37c640 1 -- 172.21.15.17:0/2817567728 wait complete. 2024-08-19T00:53:14.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:14 smithi086 ceph-mon[24511]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:14.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:14 smithi017 ceph-mon[16627]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:15.221 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-19T00:53:15.426 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:15.869 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:15 smithi017 ceph-mon[16627]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:15.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:15 smithi086 ceph-mon[24511]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:16.844 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:16 smithi017 ceph-mon[16627]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:16.885 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:16 smithi086 ceph-mon[24511]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.044+0000 7fe688edb640 1 -- 172.21.15.17:0/3261981152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6840ff410 msgr2=0x7fe6840ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.044+0000 7fe688edb640 1 --2- 172.21.15.17:0/3261981152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6840ff410 0x7fe6840ff890 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009880 tx=0x7fe66c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.044+0000 7fe688edb640 1 -- 172.21.15.17:0/3261981152 shutdown_connections 2024-08-19T00:53:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.044+0000 7fe688edb640 1 --2- 172.21.15.17:0/3261981152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6840ff410 0x7fe6840ff890 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.044+0000 7fe688edb640 1 --2- 172.21.15.17:0/3261981152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6840fe210 0x7fe6840fe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.044+0000 7fe688edb640 1 -- 172.21.15.17:0/3261981152 >> 172.21.15.17:0/3261981152 conn(0x7fe6840f99c0 msgr2=0x7fe6840fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.044+0000 7fe688edb640 1 -- 172.21.15.17:0/3261981152 shutdown_connections 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.044+0000 7fe688edb640 1 -- 172.21.15.17:0/3261981152 wait complete. 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.045+0000 7fe688edb640 1 Processor -- start 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.045+0000 7fe688edb640 1 -- start start 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.045+0000 7fe688edb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6840fe210 0x7fe684102150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.045+0000 7fe688edb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6840ff410 0x7fe6841007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.045+0000 7fe688edb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe684100d30 con 0x7fe6840fe210 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.045+0000 7fe688edb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe684100ea0 con 0x7fe6840ff410 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe68259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6840fe210 0x7fe684102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe68259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6840fe210 0x7fe684102150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41300/0 (socket says 172.21.15.17:41300) 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe68259c640 1 -- 172.21.15.17:0/2591043964 learned_addr learned my addr 172.21.15.17:0/2591043964 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe67bfff640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6840ff410 0x7fe6841007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe68259c640 1 -- 172.21.15.17:0/2591043964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6840ff410 msgr2=0x7fe6841007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe68259c640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6840ff410 0x7fe6841007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe68259c640 1 -- 172.21.15.17:0/2591043964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c009560 con 0x7fe6840fe210 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe67bfff640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6840ff410 0x7fe6841007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe68259c640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6840fe210 0x7fe684102150 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe67400e9e0 tx=0x7fe67400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe67b7fe640 1 -- 172.21.15.17:0/2591043964 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe67400ce20 con 0x7fe6840fe210 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe67b7fe640 1 -- 172.21.15.17:0/2591043964 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe6740044f0 con 0x7fe6840fe210 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe688edb640 1 -- 172.21.15.17:0/2591043964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe684101180 con 0x7fe6840fe210 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe67b7fe640 1 -- 172.21.15.17:0/2591043964 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe674016630 con 0x7fe6840fe210 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.046+0000 7fe688edb640 1 -- 172.21.15.17:0/2591043964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68419d700 con 0x7fe6840fe210 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.047+0000 7fe688edb640 1 -- 172.21.15.17:0/2591043964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe684106f60 con 0x7fe6840fe210 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.048+0000 7fe67b7fe640 1 -- 172.21.15.17:0/2591043964 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fe674003980 con 0x7fe6840fe210 2024-08-19T00:53:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.048+0000 7fe67b7fe640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe67006cc50 0x7fe67006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.048+0000 7fe67b7fe640 1 -- 172.21.15.17:0/2591043964 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fe67408c0c0 con 0x7fe6840fe210 2024-08-19T00:53:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.048+0000 7fe67bfff640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe67006cc50 0x7fe67006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.049+0000 7fe67bfff640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe67006cc50 0x7fe67006f110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe66c000c00 tx=0x7fe66c0314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.053+0000 7fe67b7fe640 1 -- 172.21.15.17:0/2591043964 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fe684106f60 con 0x7fe6840fe210 2024-08-19T00:53:17.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.234+0000 7fe688edb640 1 -- 172.21.15.17:0/2591043964 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe68418f5f0 con 0x7fe67006cc50 2024-08-19T00:53:17.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.235+0000 7fe67b7fe640 1 -- 172.21.15.17:0/2591043964 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fe68418f5f0 con 0x7fe67006cc50 2024-08-19T00:53:17.237 INFO:teuthology.orchestra.run.smithi017.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-19T00:53:17.237 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7473003Q480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-08-19T00:53:17.237 INFO:teuthology.orchestra.run.smithi017.stdout:smithi086 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400UL400BGN 372G No 72s ago Has a FileSystem, LVM detected 2024-08-19T00:53:17.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.237+0000 7fe688edb640 1 -- 172.21.15.17:0/2591043964 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe67006cc50 msgr2=0x7fe67006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:17.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.237+0000 7fe688edb640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe67006cc50 0x7fe67006f110 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe66c000c00 tx=0x7fe66c0314e0 comp rx=0 tx=0).stop 2024-08-19T00:53:17.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.237+0000 7fe688edb640 1 -- 172.21.15.17:0/2591043964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6840fe210 msgr2=0x7fe684102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:17.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.237+0000 7fe688edb640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6840fe210 0x7fe684102150 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe67400e9e0 tx=0x7fe67400eea0 comp rx=0 tx=0).stop 2024-08-19T00:53:17.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.237+0000 7fe688edb640 1 -- 172.21.15.17:0/2591043964 shutdown_connections 2024-08-19T00:53:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.237+0000 7fe688edb640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fe67006cc50 0x7fe67006f110 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.237+0000 7fe688edb640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6840ff410 0x7fe6841007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.237+0000 7fe688edb640 1 --2- 172.21.15.17:0/2591043964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6840fe210 0x7fe684102150 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.237+0000 7fe688edb640 1 -- 172.21.15.17:0/2591043964 >> 172.21.15.17:0/2591043964 conn(0x7fe6840f99c0 msgr2=0x7fe684102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.237+0000 7fe688edb640 1 -- 172.21.15.17:0/2591043964 shutdown_connections 2024-08-19T00:53:17.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:17.237+0000 7fe688edb640 1 -- 172.21.15.17:0/2591043964 wait complete. 2024-08-19T00:53:17.978 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-19T00:53:17.987 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:53:17.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-08-19T00:53:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:18 smithi017 ceph-mon[16627]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:18 smithi017 ceph-mon[16627]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:18 smithi086 ceph-mon[24511]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:18 smithi086 ceph-mon[24511]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:19.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.835+0000 7f32b8160640 1 -- 172.21.15.17:0/4029958532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32b00ffca0 msgr2=0x7f32b0100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:19.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.835+0000 7f32b8160640 1 --2- 172.21.15.17:0/4029958532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32b00ffca0 0x7f32b0100120 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009880 tx=0x7f32a402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:19.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.835+0000 7f32b8160640 1 -- 172.21.15.17:0/4029958532 shutdown_connections 2024-08-19T00:53:19.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.835+0000 7f32b8160640 1 --2- 172.21.15.17:0/4029958532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32b00ffca0 0x7f32b0100120 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:19.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.835+0000 7f32b8160640 1 --2- 172.21.15.17:0/4029958532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b00feaa0 0x7f32b00feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:19.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.835+0000 7f32b8160640 1 -- 172.21.15.17:0/4029958532 >> 172.21.15.17:0/4029958532 conn(0x7f32b00fa250 msgr2=0x7f32b00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:19.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.835+0000 7f32b8160640 1 -- 172.21.15.17:0/4029958532 shutdown_connections 2024-08-19T00:53:19.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.835+0000 7f32b8160640 1 -- 172.21.15.17:0/4029958532 wait complete. 2024-08-19T00:53:19.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.836+0000 7f32b8160640 1 Processor -- start 2024-08-19T00:53:19.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.836+0000 7f32b8160640 1 -- start start 2024-08-19T00:53:19.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.836+0000 7f32b8160640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32b00feaa0 0x7f32b0197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:19.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.836+0000 7f32b8160640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b00ffca0 0x7f32b0197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:19.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.836+0000 7f32b8160640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b0198440 con 0x7f32b00feaa0 2024-08-19T00:53:19.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.836+0000 7f32b8160640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b01985b0 con 0x7f32b00ffca0 2024-08-19T00:53:19.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.836+0000 7f32b5efc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32b00feaa0 0x7f32b0197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:19.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.836+0000 7f32b5efc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32b00feaa0 0x7f32b0197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41312/0 (socket says 172.21.15.17:41312) 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.836+0000 7f32b5efc640 1 -- 172.21.15.17:0/1962169726 learned_addr learned my addr 172.21.15.17:0/1962169726 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.836+0000 7f32b56fb640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b00ffca0 0x7f32b0197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.837+0000 7f32b5efc640 1 -- 172.21.15.17:0/1962169726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b00ffca0 msgr2=0x7f32b0197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.837+0000 7f32b5efc640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b00ffca0 0x7f32b0197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.837+0000 7f32b5efc640 1 -- 172.21.15.17:0/1962169726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a4009560 con 0x7f32b00feaa0 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.837+0000 7f32b56fb640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b00ffca0 0x7f32b0197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.837+0000 7f32b5efc640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32b00feaa0 0x7f32b0197930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00b400 tx=0x7f32ac00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.837+0000 7f32a2ffd640 1 -- 172.21.15.17:0/1962169726 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32ac011800 con 0x7f32b00feaa0 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.837+0000 7f32a2ffd640 1 -- 172.21.15.17:0/1962169726 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32ac011e20 con 0x7f32b00feaa0 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.837+0000 7f32b8160640 1 -- 172.21.15.17:0/1962169726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b019cff0 con 0x7f32b00feaa0 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.837+0000 7f32a2ffd640 1 -- 172.21.15.17:0/1962169726 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32ac00f2e0 con 0x7f32b00feaa0 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.837+0000 7f32b8160640 1 -- 172.21.15.17:0/1962169726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b019d590 con 0x7f32b00feaa0 2024-08-19T00:53:19.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.838+0000 7f32b8160640 1 -- 172.21.15.17:0/1962169726 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b00fef20 con 0x7f32b00feaa0 2024-08-19T00:53:19.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.839+0000 7f32a2ffd640 1 -- 172.21.15.17:0/1962169726 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f32ac010380 con 0x7f32b00feaa0 2024-08-19T00:53:19.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.839+0000 7f32a2ffd640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f329c06cc50 0x7f329c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:19.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.839+0000 7f32b56fb640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f329c06cc50 0x7f329c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:19.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.839+0000 7f32a2ffd640 1 -- 172.21.15.17:0/1962169726 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f32ac08bb30 con 0x7f32b00feaa0 2024-08-19T00:53:19.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.840+0000 7f32b56fb640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f329c06cc50 0x7f329c06f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32a4000c00 tx=0x7f32a40314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:19.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:19.844+0000 7f32a2ffd640 1 -- 172.21.15.17:0/1962169726 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f32ac0562c0 con 0x7f32b00feaa0 2024-08-19T00:53:20.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:20.039+0000 7f32b8160640 1 -- 172.21.15.17:0/1962169726 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f32b00fc420 con 0x7f329c06cc50 2024-08-19T00:53:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:20 smithi017 ceph-mon[16627]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-08-19T00:53:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:53:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:20 smithi086 ceph-mon[24511]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-08-19T00:53:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:53:21.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.626+0000 7f32a2ffd640 1 -- 172.21.15.17:0/1962169726 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f32b00fc420 con 0x7f329c06cc50 2024-08-19T00:53:21.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.629+0000 7f32b8160640 1 -- 172.21.15.17:0/1962169726 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f329c06cc50 msgr2=0x7f329c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:21.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.629+0000 7f32b8160640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f329c06cc50 0x7f329c06f110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f32a4000c00 tx=0x7f32a40314e0 comp rx=0 tx=0).stop 2024-08-19T00:53:21.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.629+0000 7f32b8160640 1 -- 172.21.15.17:0/1962169726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32b00feaa0 msgr2=0x7f32b0197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:21.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.629+0000 7f32b8160640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32b00feaa0 0x7f32b0197930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00b400 tx=0x7f32ac00b8c0 comp rx=0 tx=0).stop 2024-08-19T00:53:21.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.629+0000 7f32b8160640 1 -- 172.21.15.17:0/1962169726 shutdown_connections 2024-08-19T00:53:21.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.629+0000 7f32b8160640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f329c06cc50 0x7f329c06f110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:21.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.629+0000 7f32b8160640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32b00ffca0 0x7f32b0197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:21.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.629+0000 7f32b8160640 1 --2- 172.21.15.17:0/1962169726 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32b00feaa0 0x7f32b0197930 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:21.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.629+0000 7f32b8160640 1 -- 172.21.15.17:0/1962169726 >> 172.21.15.17:0/1962169726 conn(0x7f32b00fa250 msgr2=0x7f32b00fbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:21.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.629+0000 7f32b8160640 1 -- 172.21.15.17:0/1962169726 shutdown_connections 2024-08-19T00:53:21.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:21.629+0000 7f32b8160640 1 -- 172.21.15.17:0/1962169726 wait complete. 2024-08-19T00:53:21.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:21 smithi017 ceph-mon[16627]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:21.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:21 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-08-19T00:53:21.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:21 smithi017 ceph-mon[16627]: osdmap e41: 6 total, 6 up, 6 in 2024-08-19T00:53:21.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:21 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-08-19T00:53:21.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:21 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[16623]: 2024-08-19T00:53:21.602+0000 7f06dce96640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:53:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:21 smithi086 ceph-mon[24511]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:53:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:21 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-08-19T00:53:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:21 smithi086 ceph-mon[24511]: osdmap e41: 6 total, 6 up, 6 in 2024-08-19T00:53:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:21 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-08-19T00:53:22.208 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-19T00:53:22.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: pgmap v172: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:22.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-19T00:53:22.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-08-19T00:53:22.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: osdmap e42: 6 total, 6 up, 6 in 2024-08-19T00:53:22.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-08-19T00:53:22.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:53:22.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-19T00:53:22.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: osdmap e43: 6 total, 6 up, 6 in 2024-08-19T00:53:22.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-08-19T00:53:22.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: fsmap cephfs:0 2024-08-19T00:53:22.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: Saving service mds.cephfs spec with placement count:4 2024-08-19T00:53:22.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:22.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:53:22.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:22.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:53:22.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:22.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.junbdp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:53:22.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.junbdp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:53:22.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:22 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: pgmap v172: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-19T00:53:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-08-19T00:53:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: osdmap e42: 6 total, 6 up, 6 in 2024-08-19T00:53:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-08-19T00:53:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: osdmap e43: 6 total, 6 up, 6 in 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: fsmap cephfs:0 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: Saving service mds.cephfs spec with placement count:4 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.junbdp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.junbdp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:53:22.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:22 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:23.414 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:23.619 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:23 smithi017 ceph-mon[16627]: Deploying daemon mds.cephfs.smithi017.junbdp on smithi017 2024-08-19T00:53:23.620 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:23 smithi017 ceph-mon[16627]: osdmap e44: 6 total, 6 up, 6 in 2024-08-19T00:53:23.886 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:23 smithi086 ceph-mon[24511]: Deploying daemon mds.cephfs.smithi017.junbdp on smithi017 2024-08-19T00:53:23.887 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:23 smithi086 ceph-mon[24511]: osdmap e44: 6 total, 6 up, 6 in 2024-08-19T00:53:24.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:24 smithi086 ceph-mon[24511]: pgmap v176: 65 pgs: 11 creating+peering, 48 unknown, 6 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:24.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:24 smithi086 ceph-mon[24511]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-19T00:53:24.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:24 smithi086 ceph-mon[24511]: osdmap e45: 6 total, 6 up, 6 in 2024-08-19T00:53:24.843 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:24 smithi017 ceph-mon[16627]: pgmap v176: 65 pgs: 11 creating+peering, 48 unknown, 6 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:24.843 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:24 smithi017 ceph-mon[16627]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-19T00:53:24.843 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:24 smithi017 ceph-mon[16627]: osdmap e45: 6 total, 6 up, 6 in 2024-08-19T00:53:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.377+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/2744845760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c280ffca0 msgr2=0x7f3c28100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.377+0000 7f3c2f5e8640 1 --2- 172.21.15.17:0/2744845760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c280ffca0 0x7f3c28100120 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009880 tx=0x7f3c1802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.377+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/2744845760 shutdown_connections 2024-08-19T00:53:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.377+0000 7f3c2f5e8640 1 --2- 172.21.15.17:0/2744845760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c280ffca0 0x7f3c28100120 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.377+0000 7f3c2f5e8640 1 --2- 172.21.15.17:0/2744845760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c280feaa0 0x7f3c280feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.377+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/2744845760 >> 172.21.15.17:0/2744845760 conn(0x7f3c280fa230 msgr2=0x7f3c280fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:25.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.377+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/2744845760 shutdown_connections 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.377+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/2744845760 wait complete. 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.378+0000 7f3c2f5e8640 1 Processor -- start 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.378+0000 7f3c2f5e8640 1 -- start start 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.378+0000 7f3c2f5e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c280feaa0 0x7f3c28102ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.378+0000 7f3c2f5e8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c280ffca0 0x7f3c28101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.378+0000 7f3c2f5e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28101a80 con 0x7f3c280feaa0 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.378+0000 7f3c2f5e8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28101bf0 con 0x7f3c280ffca0 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c2d384640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c280feaa0 0x7f3c28102ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c2d384640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c280feaa0 0x7f3c28102ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41320/0 (socket says 172.21.15.17:41320) 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c2d384640 1 -- 172.21.15.17:0/3850882673 learned_addr learned my addr 172.21.15.17:0/3850882673 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c2cb83640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c280ffca0 0x7f3c28101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c2d384640 1 -- 172.21.15.17:0/3850882673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c280ffca0 msgr2=0x7f3c28101540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c2d384640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c280ffca0 0x7f3c28101540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:25.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c2d384640 1 -- 172.21.15.17:0/3850882673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c18009560 con 0x7f3c280feaa0 2024-08-19T00:53:25.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c2cb83640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c280ffca0 0x7f3c28101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:53:25.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c2d384640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c280feaa0 0x7f3c28102ea0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400d8d0 tx=0x7f3c2400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:25.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c1e7fc640 1 -- 172.21.15.17:0/3850882673 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c24009a30 con 0x7f3c280feaa0 2024-08-19T00:53:25.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c1e7fc640 1 -- 172.21.15.17:0/3850882673 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c24009b90 con 0x7f3c280feaa0 2024-08-19T00:53:25.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/3850882673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c28101ed0 con 0x7f3c280feaa0 2024-08-19T00:53:25.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c1e7fc640 1 -- 172.21.15.17:0/3850882673 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2400f680 con 0x7f3c280feaa0 2024-08-19T00:53:25.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.379+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/3850882673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2819d6c0 con 0x7f3c280feaa0 2024-08-19T00:53:25.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.381+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/3850882673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c28108010 con 0x7f3c280feaa0 2024-08-19T00:53:25.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.381+0000 7f3c1e7fc640 1 -- 172.21.15.17:0/3850882673 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f3c24009d00 con 0x7f3c280feaa0 2024-08-19T00:53:25.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.381+0000 7f3c1e7fc640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3c1406cc50 0x7f3c1406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:25.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.381+0000 7f3c1e7fc640 1 -- 172.21.15.17:0/3850882673 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f3c2408c0e0 con 0x7f3c280feaa0 2024-08-19T00:53:25.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.381+0000 7f3c2cb83640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3c1406cc50 0x7f3c1406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:25.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.382+0000 7f3c2cb83640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3c1406cc50 0x7f3c1406f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3c18000c00 tx=0x7f3c180314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:25.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.386+0000 7f3c1e7fc640 1 -- 172.21.15.17:0/3850882673 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f3c240564b0 con 0x7f3c280feaa0 2024-08-19T00:53:25.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.600+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/3850882673 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3c2819d990 con 0x7f3c280feaa0 2024-08-19T00:53:25.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.601+0000 7f3c1e7fc640 1 -- 172.21.15.17:0/3850882673 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1114 (secure 0 0 0) 0x7f3c24059ad0 con 0x7f3c280feaa0 2024-08-19T00:53:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:e2 2024-08-19T00:53:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T00:53:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T00:53:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T00:53:25.603 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:53:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T00:53:25.603 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 2 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T00:53:21.603310+0000 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T00:53:25.604 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 0 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 1 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:in 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data disabled 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 0 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:53:25.605 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:53:25.606 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2024-08-19T00:53:25.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.603+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/3850882673 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3c1406cc50 msgr2=0x7f3c1406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:25.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.603+0000 7f3c2f5e8640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3c1406cc50 0x7f3c1406f110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3c18000c00 tx=0x7f3c180314e0 comp rx=0 tx=0).stop 2024-08-19T00:53:25.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.603+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/3850882673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c280feaa0 msgr2=0x7f3c28102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:25.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.603+0000 7f3c2f5e8640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c280feaa0 0x7f3c28102ea0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400d8d0 tx=0x7f3c2400dd90 comp rx=0 tx=0).stop 2024-08-19T00:53:25.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.604+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/3850882673 shutdown_connections 2024-08-19T00:53:25.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.604+0000 7f3c2f5e8640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f3c1406cc50 0x7f3c1406f110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:25.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.604+0000 7f3c2f5e8640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3c280ffca0 0x7f3c28101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:25.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.604+0000 7f3c2f5e8640 1 --2- 172.21.15.17:0/3850882673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3c280feaa0 0x7f3c28102ea0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:25.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.604+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/3850882673 >> 172.21.15.17:0/3850882673 conn(0x7f3c280fa230 msgr2=0x7f3c280fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:25.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.604+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/3850882673 shutdown_connections 2024-08-19T00:53:25.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:25.604+0000 7f3c2f5e8640 1 -- 172.21.15.17:0/3850882673 wait complete. 2024-08-19T00:53:25.681 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:25 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3850882673' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T00:53:25.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:25 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3850882673' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T00:53:26.258 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-19T00:53:26.272 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:53:26.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-08-19T00:53:26.563 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:26.852 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:26 smithi017 ceph-mon[16627]: pgmap v178: 65 pgs: 11 creating+peering, 14 unknown, 40 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:26.852 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:26 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:26.852 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:26 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:26.852 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:26 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:26.853 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:26 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.uxhjfl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:53:26.853 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:26 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.uxhjfl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:53:26.853 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:26 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:26 smithi086 ceph-mon[24511]: pgmap v178: 65 pgs: 11 creating+peering, 14 unknown, 40 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:26 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:26 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:26 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:26 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.uxhjfl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:53:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:26 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.uxhjfl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:53:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:26 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:27.745 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:27 smithi017 ceph-mon[16627]: Deploying daemon mds.cephfs.smithi086.uxhjfl on smithi086 2024-08-19T00:53:27.746 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:27 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.17:6826/785560798,v1:172.21.15.17:6827/785560798] up:boot 2024-08-19T00:53:27.746 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:27 smithi017 ceph-mon[16627]: daemon mds.cephfs.smithi017.junbdp assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-08-19T00:53:27.746 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:27 smithi017 ceph-mon[16627]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-19T00:53:27.746 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:27 smithi017 ceph-mon[16627]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-19T00:53:27.746 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:27 smithi017 ceph-mon[16627]: Cluster is now healthy 2024-08-19T00:53:27.746 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:27 smithi017 ceph-mon[16627]: fsmap cephfs:0 1 up:standby 2024-08-19T00:53:27.746 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:27 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T00:53:27.746 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:27 smithi017 ceph-mon[16627]: fsmap cephfs:1 {0=cephfs.smithi017.junbdp=up:creating} 2024-08-19T00:53:27.746 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:27 smithi017 ceph-mon[16627]: daemon mds.cephfs.smithi017.junbdp is now active in filesystem cephfs as rank 0 2024-08-19T00:53:27.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:27 smithi086 ceph-mon[24511]: Deploying daemon mds.cephfs.smithi086.uxhjfl on smithi086 2024-08-19T00:53:27.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:27 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.17:6826/785560798,v1:172.21.15.17:6827/785560798] up:boot 2024-08-19T00:53:27.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:27 smithi086 ceph-mon[24511]: daemon mds.cephfs.smithi017.junbdp assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-08-19T00:53:27.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:27 smithi086 ceph-mon[24511]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-19T00:53:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:27 smithi086 ceph-mon[24511]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-19T00:53:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:27 smithi086 ceph-mon[24511]: Cluster is now healthy 2024-08-19T00:53:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:27 smithi086 ceph-mon[24511]: fsmap cephfs:0 1 up:standby 2024-08-19T00:53:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:27 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T00:53:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:27 smithi086 ceph-mon[24511]: fsmap cephfs:1 {0=cephfs.smithi017.junbdp=up:creating} 2024-08-19T00:53:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:27 smithi086 ceph-mon[24511]: daemon mds.cephfs.smithi017.junbdp is now active in filesystem cephfs as rank 0 2024-08-19T00:53:28.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.258+0000 7f0dfcc23640 1 -- 172.21.15.17:0/722149415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df80ffca0 msgr2=0x7f0df8100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.258+0000 7f0dfcc23640 1 --2- 172.21.15.17:0/722149415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df80ffca0 0x7f0df8100120 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009880 tx=0x7f0dec02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.258+0000 7f0dfcc23640 1 -- 172.21.15.17:0/722149415 shutdown_connections 2024-08-19T00:53:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.258+0000 7f0dfcc23640 1 --2- 172.21.15.17:0/722149415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df80ffca0 0x7f0df8100120 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.258+0000 7f0dfcc23640 1 --2- 172.21.15.17:0/722149415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df80feaa0 0x7f0df80feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.258+0000 7f0dfcc23640 1 -- 172.21.15.17:0/722149415 >> 172.21.15.17:0/722149415 conn(0x7f0df80fa250 msgr2=0x7f0df80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.258+0000 7f0dfcc23640 1 -- 172.21.15.17:0/722149415 shutdown_connections 2024-08-19T00:53:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.258+0000 7f0dfcc23640 1 -- 172.21.15.17:0/722149415 wait complete. 2024-08-19T00:53:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0dfcc23640 1 Processor -- start 2024-08-19T00:53:28.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0dfcc23640 1 -- start start 2024-08-19T00:53:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0dfcc23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df80feaa0 0x7f0df8068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0dfcc23640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df80ffca0 0x7f0df819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0dfcc23640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df819a930 con 0x7f0df80feaa0 2024-08-19T00:53:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0dfcc23640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df819aa70 con 0x7f0df80ffca0 2024-08-19T00:53:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0df659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df80feaa0 0x7f0df8068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0df659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df80feaa0 0x7f0df8068fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45418/0 (socket says 172.21.15.17:45418) 2024-08-19T00:53:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0df659c640 1 -- 172.21.15.17:0/1371006053 learned_addr learned my addr 172.21.15.17:0/1371006053 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:28.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0df5d9b640 1 --2- 172.21.15.17:0/1371006053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df80ffca0 0x7f0df819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0df659c640 1 -- 172.21.15.17:0/1371006053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df80ffca0 msgr2=0x7f0df819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0df659c640 1 --2- 172.21.15.17:0/1371006053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df80ffca0 0x7f0df819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.259+0000 7f0df659c640 1 -- 172.21.15.17:0/1371006053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec009560 con 0x7f0df80feaa0 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.260+0000 7f0df659c640 1 --2- 172.21.15.17:0/1371006053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df80feaa0 0x7f0df8068fb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0de800eaf0 tx=0x7f0de800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.260+0000 7f0de77fe640 1 -- 172.21.15.17:0/1371006053 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de8003970 con 0x7f0df80feaa0 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.260+0000 7f0dfcc23640 1 -- 172.21.15.17:0/1371006053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df819ad20 con 0x7f0df80feaa0 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.260+0000 7f0de77fe640 1 -- 172.21.15.17:0/1371006053 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0de8004020 con 0x7f0df80feaa0 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.260+0000 7f0de77fe640 1 -- 172.21.15.17:0/1371006053 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de8010660 con 0x7f0df80feaa0 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.260+0000 7f0dfcc23640 1 -- 172.21.15.17:0/1371006053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df819b2c0 con 0x7f0df80feaa0 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.261+0000 7f0dfcc23640 1 -- 172.21.15.17:0/1371006053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df80feea0 con 0x7f0df80feaa0 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.261+0000 7f0de77fe640 1 -- 172.21.15.17:0/1371006053 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0de8004190 con 0x7f0df80feaa0 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.262+0000 7f0de77fe640 1 --2- 172.21.15.17:0/1371006053 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0de006cc50 0x7f0de006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:28.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.262+0000 7f0de77fe640 1 -- 172.21.15.17:0/1371006053 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f0de8014070 con 0x7f0df80feaa0 2024-08-19T00:53:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.262+0000 7f0df5d9b640 1 --2- 172.21.15.17:0/1371006053 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0de006cc50 0x7f0de006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.262+0000 7f0df5d9b640 1 --2- 172.21.15.17:0/1371006053 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0de006cc50 0x7f0de006f110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0dec000c00 tx=0x7f0dec0314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:28.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.266+0000 7f0de77fe640 1 -- 172.21.15.17:0/1371006053 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f0de8056ed0 con 0x7f0df80feaa0 2024-08-19T00:53:28.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.481+0000 7f0dfcc23640 1 -- 172.21.15.17:0/1371006053 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f0df819b510 con 0x7f0df80feaa0 2024-08-19T00:53:28.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.635+0000 7f0de77fe640 1 -- 172.21.15.17:0/1371006053 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0de8004440 con 0x7f0df80feaa0 2024-08-19T00:53:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.638+0000 7f0dfcc23640 1 -- 172.21.15.17:0/1371006053 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0de006cc50 msgr2=0x7f0de006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.638+0000 7f0dfcc23640 1 --2- 172.21.15.17:0/1371006053 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0de006cc50 0x7f0de006f110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0dec000c00 tx=0x7f0dec0314e0 comp rx=0 tx=0).stop 2024-08-19T00:53:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.638+0000 7f0dfcc23640 1 -- 172.21.15.17:0/1371006053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df80feaa0 msgr2=0x7f0df8068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.638+0000 7f0dfcc23640 1 --2- 172.21.15.17:0/1371006053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df80feaa0 0x7f0df8068fb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0de800eaf0 tx=0x7f0de800c2d0 comp rx=0 tx=0).stop 2024-08-19T00:53:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.638+0000 7f0dfcc23640 1 -- 172.21.15.17:0/1371006053 shutdown_connections 2024-08-19T00:53:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.638+0000 7f0dfcc23640 1 --2- 172.21.15.17:0/1371006053 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f0de006cc50 0x7f0de006f110 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.638+0000 7f0dfcc23640 1 --2- 172.21.15.17:0/1371006053 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df80ffca0 0x7f0df819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.638+0000 7f0dfcc23640 1 --2- 172.21.15.17:0/1371006053 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df80feaa0 0x7f0df8068fb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.638+0000 7f0dfcc23640 1 -- 172.21.15.17:0/1371006053 >> 172.21.15.17:0/1371006053 conn(0x7f0df80fa250 msgr2=0x7f0df8102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:28.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.638+0000 7f0dfcc23640 1 -- 172.21.15.17:0/1371006053 shutdown_connections 2024-08-19T00:53:28.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:28.638+0000 7f0dfcc23640 1 -- 172.21.15.17:0/1371006053 wait complete. 2024-08-19T00:53:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:28 smithi017 ceph-mon[16627]: pgmap v179: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:28 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.17:6826/785560798,v1:172.21.15.17:6827/785560798] up:active 2024-08-19T00:53:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:28 smithi017 ceph-mon[16627]: fsmap cephfs:1 {0=cephfs.smithi017.junbdp=up:active} 2024-08-19T00:53:28.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:28 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1371006053' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-08-19T00:53:28.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:28 smithi086 ceph-mon[24511]: pgmap v179: 65 pgs: 4 creating+peering, 61 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:53:28.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:28 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.17:6826/785560798,v1:172.21.15.17:6827/785560798] up:active 2024-08-19T00:53:28.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:28 smithi086 ceph-mon[24511]: fsmap cephfs:1 {0=cephfs.smithi017.junbdp=up:active} 2024-08-19T00:53:28.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:28 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/1371006053' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-08-19T00:53:29.249 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-19T00:53:29.258 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:53:29.259 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-08-19T00:53:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:29 smithi017 ceph-mon[16627]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-19T00:53:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:29 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1371006053' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-08-19T00:53:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:29 smithi017 ceph-mon[16627]: fsmap cephfs:1 {0=cephfs.smithi017.junbdp=up:active} 2024-08-19T00:53:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:29 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:29 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:29 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:29 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.gvlpoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:53:29.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:29 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.gvlpoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:53:29.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:29 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:29.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:29 smithi017 ceph-mon[16627]: Deploying daemon mds.cephfs.smithi017.gvlpoy on smithi017 2024-08-19T00:53:29.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:29 smithi017 ceph-mon[16627]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 129 B/s wr, 2 op/s 2024-08-19T00:53:29.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:29 smithi086 ceph-mon[24511]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-19T00:53:29.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:29 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/1371006053' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-08-19T00:53:29.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:29 smithi086 ceph-mon[24511]: fsmap cephfs:1 {0=cephfs.smithi017.junbdp=up:active} 2024-08-19T00:53:29.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:29 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:29.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:29 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:29.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:29 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:29.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:29 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.gvlpoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:53:29.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:29 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.gvlpoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:53:29.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:29 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:29.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:29 smithi086 ceph-mon[24511]: Deploying daemon mds.cephfs.smithi017.gvlpoy on smithi017 2024-08-19T00:53:29.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:29 smithi086 ceph-mon[24511]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 194 MiB used, 536 GiB / 536 GiB avail; 129 B/s wr, 2 op/s 2024-08-19T00:53:30.015 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:30.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:30 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] up:boot 2024-08-19T00:53:30.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:30 smithi017 ceph-mon[16627]: daemon mds.cephfs.smithi086.uxhjfl assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-19T00:53:30.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:30 smithi017 ceph-mon[16627]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-08-19T00:53:30.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:30 smithi017 ceph-mon[16627]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-19T00:53:30.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:30 smithi017 ceph-mon[16627]: fsmap cephfs:1 {0=cephfs.smithi017.junbdp=up:active} 1 up:standby 2024-08-19T00:53:30.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:30 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T00:53:30.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:30 smithi017 ceph-mon[16627]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:creating} 2024-08-19T00:53:30.871 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:30 smithi017 ceph-mon[16627]: daemon mds.cephfs.smithi086.uxhjfl is now active in filesystem cephfs as rank 1 2024-08-19T00:53:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:30 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] up:boot 2024-08-19T00:53:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:30 smithi086 ceph-mon[24511]: daemon mds.cephfs.smithi086.uxhjfl assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-19T00:53:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:30 smithi086 ceph-mon[24511]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-08-19T00:53:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:30 smithi086 ceph-mon[24511]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-19T00:53:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:30 smithi086 ceph-mon[24511]: fsmap cephfs:1 {0=cephfs.smithi017.junbdp=up:active} 1 up:standby 2024-08-19T00:53:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:30 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T00:53:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:30 smithi086 ceph-mon[24511]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:creating} 2024-08-19T00:53:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:30 smithi086 ceph-mon[24511]: daemon mds.cephfs.smithi086.uxhjfl is now active in filesystem cephfs as rank 1 2024-08-19T00:53:31.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:31 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] up:active 2024-08-19T00:53:31.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:31 smithi086 ceph-mon[24511]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2024-08-19T00:53:31.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:31 smithi086 ceph-mon[24511]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-08-19T00:53:31.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:31 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] up:active 2024-08-19T00:53:31.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:31 smithi017 ceph-mon[16627]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2024-08-19T00:53:31.777 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:31 smithi017 ceph-mon[16627]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-08-19T00:53:32.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.793+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3376825246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec0ffb90 msgr2=0x7fd6ec0fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:32.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.793+0000 7fd6f0bcb640 1 --2- 172.21.15.17:0/3376825246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec0ffb90 0x7fd6ec0fff90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009880 tx=0x7fd6dc02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:32.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.793+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3376825246 shutdown_connections 2024-08-19T00:53:32.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.793+0000 7fd6f0bcb640 1 --2- 172.21.15.17:0/3376825246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec100d90 0x7fd6ec101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:32.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.793+0000 7fd6f0bcb640 1 --2- 172.21.15.17:0/3376825246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec0ffb90 0x7fd6ec0fff90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:32.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.793+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3376825246 >> 172.21.15.17:0/3376825246 conn(0x7fd6ec0fb360 msgr2=0x7fd6ec0fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.793+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3376825246 shutdown_connections 2024-08-19T00:53:32.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.793+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3376825246 wait complete. 2024-08-19T00:53:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6f0bcb640 1 Processor -- start 2024-08-19T00:53:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6f0bcb640 1 -- start start 2024-08-19T00:53:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6f0bcb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec0ffb90 0x7fd6ec195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6f0bcb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec100d90 0x7fd6ec195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:32.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6f0bcb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec196160 con 0x7fd6ec0ffb90 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6f0bcb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec1962d0 con 0x7fd6ec100d90 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec0ffb90 0x7fd6ec195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec0ffb90 0x7fd6ec195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45462/0 (socket says 172.21.15.17:45462) 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6ea59c640 1 -- 172.21.15.17:0/3197477940 learned_addr learned my addr 172.21.15.17:0/3197477940 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6e9d9b640 1 --2- 172.21.15.17:0/3197477940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec100d90 0x7fd6ec195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6ea59c640 1 -- 172.21.15.17:0/3197477940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec100d90 msgr2=0x7fd6ec195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6ea59c640 1 --2- 172.21.15.17:0/3197477940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec100d90 0x7fd6ec195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.794+0000 7fd6ea59c640 1 -- 172.21.15.17:0/3197477940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc009560 con 0x7fd6ec0ffb90 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.795+0000 7fd6ea59c640 1 --2- 172.21.15.17:0/3197477940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec0ffb90 0x7fd6ec195650 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0054f0 tx=0x7fd6dc005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.795+0000 7fd6db7fe640 1 -- 172.21.15.17:0/3197477940 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc004aa0 con 0x7fd6ec0ffb90 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.795+0000 7fd6db7fe640 1 -- 172.21.15.17:0/3197477940 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6dc004c00 con 0x7fd6ec0ffb90 2024-08-19T00:53:32.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.795+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3197477940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec19ad10 con 0x7fd6ec0ffb90 2024-08-19T00:53:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.795+0000 7fd6db7fe640 1 -- 172.21.15.17:0/3197477940 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6dc003ac0 con 0x7fd6ec0ffb90 2024-08-19T00:53:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.795+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3197477940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec19b230 con 0x7fd6ec0ffb90 2024-08-19T00:53:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.796+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3197477940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec1087a0 con 0x7fd6ec0ffb90 2024-08-19T00:53:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.796+0000 7fd6db7fe640 1 -- 172.21.15.17:0/3197477940 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fd6dc003d80 con 0x7fd6ec0ffb90 2024-08-19T00:53:32.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.797+0000 7fd6db7fe640 1 --2- 172.21.15.17:0/3197477940 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd6d406cc50 0x7fd6d406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:32.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.797+0000 7fd6db7fe640 1 -- 172.21.15.17:0/3197477940 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd6dc0ad410 con 0x7fd6ec0ffb90 2024-08-19T00:53:32.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.797+0000 7fd6e9d9b640 1 --2- 172.21.15.17:0/3197477940 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd6d406cc50 0x7fd6d406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:32.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.797+0000 7fd6e9d9b640 1 --2- 172.21.15.17:0/3197477940 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd6d406cc50 0x7fd6d406f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec196b70 tx=0x7fd6e000b390 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:32.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:32.801+0000 7fd6db7fe640 1 -- 172.21.15.17:0/3197477940 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fd6dc077890 con 0x7fd6ec0ffb90 2024-08-19T00:53:33.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.011+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3197477940 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fd6ec19b420 con 0x7fd6ec0ffb90 2024-08-19T00:53:33.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.659+0000 7fd6db7fe640 1 -- 172.21.15.17:0/3197477940 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7fd6dc07aeb0 con 0x7fd6ec0ffb90 2024-08-19T00:53:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.661+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3197477940 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd6d406cc50 msgr2=0x7fd6d406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.661+0000 7fd6f0bcb640 1 --2- 172.21.15.17:0/3197477940 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd6d406cc50 0x7fd6d406f110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec196b70 tx=0x7fd6e000b390 comp rx=0 tx=0).stop 2024-08-19T00:53:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.661+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3197477940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec0ffb90 msgr2=0x7fd6ec195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.661+0000 7fd6f0bcb640 1 --2- 172.21.15.17:0/3197477940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec0ffb90 0x7fd6ec195650 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0054f0 tx=0x7fd6dc005520 comp rx=0 tx=0).stop 2024-08-19T00:53:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.661+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3197477940 shutdown_connections 2024-08-19T00:53:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.661+0000 7fd6f0bcb640 1 --2- 172.21.15.17:0/3197477940 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fd6d406cc50 0x7fd6d406f110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.661+0000 7fd6f0bcb640 1 --2- 172.21.15.17:0/3197477940 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec100d90 0x7fd6ec195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.661+0000 7fd6f0bcb640 1 --2- 172.21.15.17:0/3197477940 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec0ffb90 0x7fd6ec195650 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:33.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.661+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3197477940 >> 172.21.15.17:0/3197477940 conn(0x7fd6ec0fb360 msgr2=0x7fd6ec103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.661+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3197477940 shutdown_connections 2024-08-19T00:53:33.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:33.661+0000 7fd6f0bcb640 1 -- 172.21.15.17:0/3197477940 wait complete. 2024-08-19T00:53:33.926 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.oncasl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.oncasl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: Deploying daemon mds.cephfs.smithi086.oncasl on smithi086 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: Cluster is now healthy 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:boot 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T00:53:33.927 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:33 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3197477940' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.oncasl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.oncasl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: Deploying daemon mds.cephfs.smithi086.oncasl on smithi086 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: Cluster is now healthy 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:boot 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby 2024-08-19T00:53:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T00:53:33.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:33 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3197477940' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-19T00:53:34.300 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-19T00:53:34.309 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:53:34.309 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-08-19T00:53:34.520 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:34.855 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:34 smithi086 ceph-mon[24511]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s wr, 7 op/s 2024-08-19T00:53:34.856 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:34 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3197477940' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-19T00:53:34.856 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:34 smithi086 ceph-mon[24511]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby 2024-08-19T00:53:34.856 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:34 smithi086 ceph-mon[24511]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 2024-08-19T00:53:34.865 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:34 smithi017 ceph-mon[16627]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s wr, 7 op/s 2024-08-19T00:53:34.865 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:34 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3197477940' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-19T00:53:34.865 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:34 smithi017 ceph-mon[16627]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby 2024-08-19T00:53:34.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:34 smithi017 ceph-mon[16627]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 2024-08-19T00:53:36.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.098+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/4159073805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ef00feaf0 msgr2=0x7f9ef00feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:36.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.098+0000 7f9ef4e0b640 1 --2- 172.21.15.17:0/4159073805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ef00feaf0 0x7f9ef00feef0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009880 tx=0x7f9ee002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.098+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/4159073805 shutdown_connections 2024-08-19T00:53:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.098+0000 7f9ef4e0b640 1 --2- 172.21.15.17:0/4159073805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ef00ffcf0 0x7f9ef0100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.098+0000 7f9ef4e0b640 1 --2- 172.21.15.17:0/4159073805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ef00feaf0 0x7f9ef00feef0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.098+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/4159073805 >> 172.21.15.17:0/4159073805 conn(0x7f9ef00fa280 msgr2=0x7f9ef00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.098+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/4159073805 shutdown_connections 2024-08-19T00:53:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.098+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/4159073805 wait complete. 2024-08-19T00:53:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.098+0000 7f9ef4e0b640 1 Processor -- start 2024-08-19T00:53:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.098+0000 7f9ef4e0b640 1 -- start start 2024-08-19T00:53:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9ef4e0b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ef00feaf0 0x7f9ef0102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:36.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9ef4e0b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ef00ffcf0 0x7f9ef01010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9ef4e0b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0101610 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9ef4e0b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0101780 con 0x7f9ef00feaf0 2024-08-19T00:53:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9eedd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ef00ffcf0 0x7f9ef01010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9eedd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ef00ffcf0 0x7f9ef01010d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45480/0 (socket says 172.21.15.17:45480) 2024-08-19T00:53:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9eedd9b640 1 -- 172.21.15.17:0/2562231104 learned_addr learned my addr 172.21.15.17:0/2562231104 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9eee59c640 1 --2- 172.21.15.17:0/2562231104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ef00feaf0 0x7f9ef0102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9eedd9b640 1 -- 172.21.15.17:0/2562231104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ef00feaf0 msgr2=0x7f9ef0102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9eedd9b640 1 --2- 172.21.15.17:0/2562231104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ef00feaf0 0x7f9ef0102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9eedd9b640 1 -- 172.21.15.17:0/2562231104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee0009560 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9eedd9b640 1 --2- 172.21.15.17:0/2562231104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ef00ffcf0 0x7f9ef01010d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400d6f0 tx=0x7f9ee400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:36.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9edf7fe640 1 -- 172.21.15.17:0/2562231104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee4009a30 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9edf7fe640 1 -- 172.21.15.17:0/2562231104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ee40054e0 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/2562231104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef0101a60 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.099+0000 7f9edf7fe640 1 -- 172.21.15.17:0/2562231104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ee4010460 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.100+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/2562231104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef019d730 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.100+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/2562231104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef00feef0 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.101+0000 7f9edf7fe640 1 -- 172.21.15.17:0/2562231104 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9ee4009b90 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.101+0000 7f9edf7fe640 1 --2- 172.21.15.17:0/2562231104 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ed806cc50 0x7f9ed806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:36.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.102+0000 7f9edf7fe640 1 -- 172.21.15.17:0/2562231104 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f9ee408bd50 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.102+0000 7f9eee59c640 1 --2- 172.21.15.17:0/2562231104 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ed806cc50 0x7f9ed806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:36.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.102+0000 7f9eee59c640 1 --2- 172.21.15.17:0/2562231104 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ed806cc50 0x7f9ed806f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009230 tx=0x7f9ee00314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:36.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.106+0000 7f9edf7fe640 1 -- 172.21.15.17:0/2562231104 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f9ee40561d0 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.108 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.108 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.108 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.108 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.109 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.109 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:53:36.109 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:53:36.109 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 602 B/s rd, 2.2 KiB/s wr, 7 op/s 2024-08-19T00:53:36.109 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.109 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] up:boot 2024-08-19T00:53:36.109 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 1 up:standby 2024-08-19T00:53:36.109 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T00:53:36.109 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:35 smithi017 ceph-mon[16627]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T00:53:36.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.329+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/2562231104 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ef0107700 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.353 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.353 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.353 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.354 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.354 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.354 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:53:36.354 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:53:36.354 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 602 B/s rd, 2.2 KiB/s wr, 7 op/s 2024-08-19T00:53:36.354 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:36.354 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] up:boot 2024-08-19T00:53:36.354 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 1 up:standby 2024-08-19T00:53:36.354 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T00:53:36.354 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:35 smithi086 ceph-mon[24511]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T00:53:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.989+0000 7f9edf7fe640 1 -- 172.21.15.17:0/2562231104 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v15) v1 ==== 168+0+0 (secure 0 0 0) 0x7f9ee40597f0 con 0x7f9ef00ffcf0 2024-08-19T00:53:36.992 INFO:teuthology.orchestra.run.smithi017.stderr:inline data enabled 2024-08-19T00:53:36.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.993+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/2562231104 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ed806cc50 msgr2=0x7f9ed806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:36.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.993+0000 7f9ef4e0b640 1 --2- 172.21.15.17:0/2562231104 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ed806cc50 0x7f9ed806f110 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009230 tx=0x7f9ee00314e0 comp rx=0 tx=0).stop 2024-08-19T00:53:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.993+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/2562231104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ef00ffcf0 msgr2=0x7f9ef01010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.993+0000 7f9ef4e0b640 1 --2- 172.21.15.17:0/2562231104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ef00ffcf0 0x7f9ef01010d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400d6f0 tx=0x7f9ee400dbb0 comp rx=0 tx=0).stop 2024-08-19T00:53:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.993+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/2562231104 shutdown_connections 2024-08-19T00:53:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.993+0000 7f9ef4e0b640 1 --2- 172.21.15.17:0/2562231104 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9ed806cc50 0x7f9ed806f110 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.993+0000 7f9ef4e0b640 1 --2- 172.21.15.17:0/2562231104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ef00ffcf0 0x7f9ef01010d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.993+0000 7f9ef4e0b640 1 --2- 172.21.15.17:0/2562231104 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ef00feaf0 0x7f9ef0102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.993+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/2562231104 >> 172.21.15.17:0/2562231104 conn(0x7f9ef00fa280 msgr2=0x7f9ef0067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.993+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/2562231104 shutdown_connections 2024-08-19T00:53:36.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:36.993+0000 7f9ef4e0b640 1 -- 172.21.15.17:0/2562231104 wait complete. 2024-08-19T00:53:37.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:36 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2562231104' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-19T00:53:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:36 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/2562231104' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-19T00:53:37.926 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-19T00:53:37.938 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:53:37.938 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-19T00:53:38.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-08-19T00:53:38.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2562231104' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-08-19T00:53:38.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:standby-replay 2024-08-19T00:53:38.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: Dropping low affinity active daemon mds.cephfs.smithi017.junbdp in favor of higher affinity standby. 2024-08-19T00:53:38.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: Replacing daemon mds.cephfs.smithi017.junbdp as rank 0 with standby daemon mds.cephfs.smithi017.gvlpoy 2024-08-19T00:53:38.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-19T00:53:38.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T00:53:38.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: osdmap e46: 6 total, 6 up, 6 in 2024-08-19T00:53:38.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: fsmap cephfs:2/2 {0=cephfs.smithi017.gvlpoy=up:replay,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 2024-08-19T00:53:38.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:38.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:38.171 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:37 smithi017 ceph-mon[16627]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-08-19T00:53:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-08-19T00:53:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/2562231104' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-08-19T00:53:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:standby-replay 2024-08-19T00:53:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: Dropping low affinity active daemon mds.cephfs.smithi017.junbdp in favor of higher affinity standby. 2024-08-19T00:53:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: Replacing daemon mds.cephfs.smithi017.junbdp as rank 0 with standby daemon mds.cephfs.smithi017.gvlpoy 2024-08-19T00:53:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-19T00:53:38.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T00:53:38.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: osdmap e46: 6 total, 6 up, 6 in 2024-08-19T00:53:38.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: fsmap cephfs:2/2 {0=cephfs.smithi017.gvlpoy=up:replay,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 2024-08-19T00:53:38.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:38.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:38.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:37 smithi086 ceph-mon[24511]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-08-19T00:53:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:39 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] up:boot 2024-08-19T00:53:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:39 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] up:active 2024-08-19T00:53:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:39 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:resolve 2024-08-19T00:53:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:39 smithi017 ceph-mon[16627]: fsmap cephfs:2/2 {0=cephfs.smithi017.gvlpoy=up:resolve,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 1 up:standby 2024-08-19T00:53:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:39 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T00:53:39.311 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:39 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] up:boot 2024-08-19T00:53:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:39 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] up:active 2024-08-19T00:53:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:39 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:resolve 2024-08-19T00:53:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:39 smithi086 ceph-mon[24511]: fsmap cephfs:2/2 {0=cephfs.smithi017.gvlpoy=up:resolve,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 1 up:standby 2024-08-19T00:53:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:39 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T00:53:40.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:40 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:reconnect 2024-08-19T00:53:40.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:40 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] up:standby-replay 2024-08-19T00:53:40.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:40 smithi017 ceph-mon[16627]: fsmap cephfs:2/2 {0=cephfs.smithi017.gvlpoy=up:reconnect,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 1 up:standby 2024-08-19T00:53:40.395 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:40 smithi017 ceph-mon[16627]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-08-19T00:53:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:40 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:reconnect 2024-08-19T00:53:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:40 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] up:standby-replay 2024-08-19T00:53:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:40 smithi086 ceph-mon[24511]: fsmap cephfs:2/2 {0=cephfs.smithi017.gvlpoy=up:reconnect,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 1 up:standby 2024-08-19T00:53:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:40 smithi086 ceph-mon[24511]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-08-19T00:53:41.331 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:41 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:rejoin 2024-08-19T00:53:41.331 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:41 smithi017 ceph-mon[16627]: fsmap cephfs:2/2 {0=cephfs.smithi017.gvlpoy=up:rejoin,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 1 up:standby 2024-08-19T00:53:41.331 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:41 smithi017 ceph-mon[16627]: daemon mds.cephfs.smithi017.gvlpoy is now active in filesystem cephfs as rank 0 2024-08-19T00:53:41.331 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:41 smithi017 ceph-mon[16627]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-19T00:53:41.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.114+0000 7f9e5e532640 1 -- 172.21.15.17:0/2761738460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e580ffcf0 msgr2=0x7f9e58100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:41.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.114+0000 7f9e5e532640 1 --2- 172.21.15.17:0/2761738460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e580ffcf0 0x7f9e58100170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009880 tx=0x7f9e4c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:41.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.114+0000 7f9e5e532640 1 -- 172.21.15.17:0/2761738460 shutdown_connections 2024-08-19T00:53:41.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.114+0000 7f9e5e532640 1 --2- 172.21.15.17:0/2761738460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e580ffcf0 0x7f9e58100170 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:41.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.114+0000 7f9e5e532640 1 --2- 172.21.15.17:0/2761738460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e580feaf0 0x7f9e580feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:41.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.114+0000 7f9e5e532640 1 -- 172.21.15.17:0/2761738460 >> 172.21.15.17:0/2761738460 conn(0x7f9e580fa280 msgr2=0x7f9e580fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:41.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.114+0000 7f9e5e532640 1 -- 172.21.15.17:0/2761738460 shutdown_connections 2024-08-19T00:53:41.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.114+0000 7f9e5e532640 1 -- 172.21.15.17:0/2761738460 wait complete. 2024-08-19T00:53:41.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.114+0000 7f9e5e532640 1 Processor -- start 2024-08-19T00:53:41.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.114+0000 7f9e5e532640 1 -- start start 2024-08-19T00:53:41.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e5e532640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e580feaf0 0x7f9e581945f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:41.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e5e532640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e580ffcf0 0x7f9e58194b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:41.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e5e532640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e58195100 con 0x7f9e580feaf0 2024-08-19T00:53:41.445 INFO:teuthology.orchestra.run.smithi017.stdout:e21 2024-08-19T00:53:41.445 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T00:53:41.445 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T00:53:41.445 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T00:53:41.445 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 21 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T00:53:41.004049+0000 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T00:53:41.446 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 46 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14486,1=24299} 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T00:53:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T00:53:41.448 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T00:53:41.448 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:53:41.448 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:53:41.448 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:53:41.448 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:53:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:53:41.448 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:53:41.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e5e532640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e58195270 con 0x7f9e580ffcf0 2024-08-19T00:53:41.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e580feaf0 0x7f9e581945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e57fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e580feaf0 0x7f9e581945f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39076/0 (socket says 172.21.15.17:39076) 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e57fff640 1 -- 172.21.15.17:0/661941167 learned_addr learned my addr 172.21.15.17:0/661941167 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e57fff640 1 -- 172.21.15.17:0/661941167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e580ffcf0 msgr2=0x7f9e58194b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e57fff640 1 --2- 172.21.15.17:0/661941167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e580ffcf0 0x7f9e58194b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e57fff640 1 -- 172.21.15.17:0/661941167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c009560 con 0x7f9e580feaf0 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e57fff640 1 --2- 172.21.15.17:0/661941167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e580feaf0 0x7f9e581945f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800d900 tx=0x7f9e4800ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e557fa640 1 -- 172.21.15.17:0/661941167 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e48009c00 con 0x7f9e580feaf0 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e557fa640 1 -- 172.21.15.17:0/661941167 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e48009d60 con 0x7f9e580feaf0 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e5e532640 1 -- 172.21.15.17:0/661941167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e58199d10 con 0x7f9e580feaf0 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e557fa640 1 -- 172.21.15.17:0/661941167 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e4800f660 con 0x7f9e580feaf0 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.115+0000 7f9e5e532640 1 -- 172.21.15.17:0/661941167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5819a260 con 0x7f9e580feaf0 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.116+0000 7f9e5e532640 1 -- 172.21.15.17:0/661941167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e5818e690 con 0x7f9e580feaf0 2024-08-19T00:53:41.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.117+0000 7f9e557fa640 1 -- 172.21.15.17:0/661941167 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f9e48010460 con 0x7f9e580feaf0 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.117+0000 7f9e557fa640 1 --2- 172.21.15.17:0/661941167 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9e4006cc50 0x7f9e4006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.118+0000 7f9e577fe640 1 --2- 172.21.15.17:0/661941167 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9e4006cc50 0x7f9e4006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.118+0000 7f9e557fa640 1 -- 172.21.15.17:0/661941167 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f9e4808c180 con 0x7f9e580feaf0 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.118+0000 7f9e577fe640 1 --2- 172.21.15.17:0/661941167 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9e4006cc50 0x7f9e4006f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c02a9c0 tx=0x7f9e4c000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.122+0000 7f9e557fa640 1 -- 172.21.15.17:0/661941167 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f9e480564f0 con 0x7f9e580feaf0 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.329+0000 7f9e5e532640 1 -- 172.21.15.17:0/661941167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e58107970 con 0x7f9e580feaf0 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.329+0000 7f9e557fa640 1 -- 172.21.15.17:0/661941167 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1863 (secure 0 0 0) 0x7f9e48059b10 con 0x7f9e580feaf0 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.331+0000 7f9e5e532640 1 -- 172.21.15.17:0/661941167 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9e4006cc50 msgr2=0x7f9e4006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.331+0000 7f9e5e532640 1 --2- 172.21.15.17:0/661941167 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9e4006cc50 0x7f9e4006f110 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c02a9c0 tx=0x7f9e4c000bc0 comp rx=0 tx=0).stop 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.331+0000 7f9e5e532640 1 -- 172.21.15.17:0/661941167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e580feaf0 msgr2=0x7f9e581945f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.331+0000 7f9e5e532640 1 --2- 172.21.15.17:0/661941167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e580feaf0 0x7f9e581945f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800d900 tx=0x7f9e4800ddc0 comp rx=0 tx=0).stop 2024-08-19T00:53:41.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.331+0000 7f9e5e532640 1 -- 172.21.15.17:0/661941167 shutdown_connections 2024-08-19T00:53:41.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.331+0000 7f9e5e532640 1 --2- 172.21.15.17:0/661941167 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f9e4006cc50 0x7f9e4006f110 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:41.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.331+0000 7f9e5e532640 1 --2- 172.21.15.17:0/661941167 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e580ffcf0 0x7f9e58194b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:41.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.331+0000 7f9e5e532640 1 --2- 172.21.15.17:0/661941167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e580feaf0 0x7f9e581945f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:41.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.331+0000 7f9e5e532640 1 -- 172.21.15.17:0/661941167 >> 172.21.15.17:0/661941167 conn(0x7f9e580fa280 msgr2=0x7f9e581033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:41.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.332+0000 7f9e5e532640 1 -- 172.21.15.17:0/661941167 shutdown_connections 2024-08-19T00:53:41.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:41.332+0000 7f9e5e532640 1 -- 172.21.15.17:0/661941167 wait complete. 2024-08-19T00:53:41.451 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:41 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:rejoin 2024-08-19T00:53:41.451 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:41 smithi086 ceph-mon[24511]: fsmap cephfs:2/2 {0=cephfs.smithi017.gvlpoy=up:rejoin,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 1 up:standby 2024-08-19T00:53:41.452 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:41 smithi086 ceph-mon[24511]: daemon mds.cephfs.smithi017.gvlpoy is now active in filesystem cephfs as rank 0 2024-08-19T00:53:41.452 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:41 smithi086 ceph-mon[24511]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-19T00:53:42.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:42 smithi017 ceph-mon[16627]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:active 2024-08-19T00:53:42.050 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:42 smithi017 ceph-mon[16627]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 1 up:standby 2024-08-19T00:53:42.050 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:42 smithi017 ceph-mon[16627]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T00:53:42.050 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:42 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/661941167' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T00:53:42.050 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:42 smithi017 ceph-mon[16627]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 716 B/s wr, 5 op/s 2024-08-19T00:53:42.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-08-19T00:53:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:42 smithi086 ceph-mon[24511]: mds.? [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] up:active 2024-08-19T00:53:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:42 smithi086 ceph-mon[24511]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 1 up:standby-replay 1 up:standby 2024-08-19T00:53:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:42 smithi086 ceph-mon[24511]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T00:53:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:42 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/661941167' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T00:53:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:42 smithi086 ceph-mon[24511]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 716 B/s wr, 5 op/s 2024-08-19T00:53:42.930 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.494+0000 7fba9c65c640 1 -- 172.21.15.17:0/3191752247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba94100dc0 msgr2=0x7fba94101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.494+0000 7fba9c65c640 1 --2- 172.21.15.17:0/3191752247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba94100dc0 0x7fba94101240 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fba84009880 tx=0x7fba8402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.495+0000 7fba9c65c640 1 -- 172.21.15.17:0/3191752247 shutdown_connections 2024-08-19T00:53:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.495+0000 7fba9c65c640 1 --2- 172.21.15.17:0/3191752247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba94100dc0 0x7fba94101240 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.495+0000 7fba9c65c640 1 --2- 172.21.15.17:0/3191752247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba940ffbc0 0x7fba940fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.495+0000 7fba9c65c640 1 -- 172.21.15.17:0/3191752247 >> 172.21.15.17:0/3191752247 conn(0x7fba940fb350 msgr2=0x7fba940fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.495+0000 7fba9c65c640 1 -- 172.21.15.17:0/3191752247 shutdown_connections 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.495+0000 7fba9c65c640 1 -- 172.21.15.17:0/3191752247 wait complete. 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.495+0000 7fba9c65c640 1 Processor -- start 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.495+0000 7fba9c65c640 1 -- start start 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba9c65c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba940ffbc0 0x7fba94074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba9c65c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba94100dc0 0x7fba940728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba9c65c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba94072de0 con 0x7fba94100dc0 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba9c65c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba94072f50 con 0x7fba940ffbc0 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba99bf7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba94100dc0 0x7fba940728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba99bf7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba94100dc0 0x7fba940728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39082/0 (socket says 172.21.15.17:39082) 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba99bf7640 1 -- 172.21.15.17:0/869952184 learned_addr learned my addr 172.21.15.17:0/869952184 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba9a3f8640 1 --2- 172.21.15.17:0/869952184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba940ffbc0 0x7fba94074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba99bf7640 1 -- 172.21.15.17:0/869952184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba940ffbc0 msgr2=0x7fba94074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba99bf7640 1 --2- 172.21.15.17:0/869952184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba940ffbc0 0x7fba94074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba99bf7640 1 -- 172.21.15.17:0/869952184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba84009560 con 0x7fba94100dc0 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.496+0000 7fba99bf7640 1 --2- 172.21.15.17:0/869952184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba94100dc0 0x7fba940728a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fba84004650 tx=0x7fba840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.497+0000 7fba8b7fe640 1 -- 172.21.15.17:0/869952184 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba84004aa0 con 0x7fba94100dc0 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.497+0000 7fba9c65c640 1 -- 172.21.15.17:0/869952184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba940731d0 con 0x7fba94100dc0 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.497+0000 7fba9c65c640 1 -- 172.21.15.17:0/869952184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9419d680 con 0x7fba94100dc0 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.497+0000 7fba8b7fe640 1 -- 172.21.15.17:0/869952184 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba84005d50 con 0x7fba94100dc0 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.497+0000 7fba8b7fe640 1 -- 172.21.15.17:0/869952184 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba840038b0 con 0x7fba94100dc0 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.498+0000 7fba9c65c640 1 -- 172.21.15.17:0/869952184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba78005280 con 0x7fba94100dc0 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.498+0000 7fba8b7fe640 1 -- 172.21.15.17:0/869952184 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fba84004c00 con 0x7fba94100dc0 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.499+0000 7fba8b7fe640 1 --2- 172.21.15.17:0/869952184 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fba8006cc50 0x7fba8006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.499+0000 7fba8b7fe640 1 -- 172.21.15.17:0/869952184 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fba840ad270 con 0x7fba94100dc0 2024-08-19T00:53:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.499+0000 7fba9a3f8640 1 --2- 172.21.15.17:0/869952184 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fba8006cc50 0x7fba8006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:44.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.499+0000 7fba9a3f8640 1 --2- 172.21.15.17:0/869952184 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fba8006cc50 0x7fba8006f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba94100c20 tx=0x7fba90005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:44.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.503+0000 7fba8b7fe640 1 -- 172.21.15.17:0/869952184 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fba84077690 con 0x7fba94100dc0 2024-08-19T00:53:44.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.767+0000 7fba9c65c640 1 -- 172.21.15.17:0/869952184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba78005ab0 con 0x7fba94100dc0 2024-08-19T00:53:44.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.768+0000 7fba8b7fe640 1 -- 172.21.15.17:0/869952184 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4850 (secure 0 0 0) 0x7fba8407acb0 con 0x7fba94100dc0 2024-08-19T00:53:44.770 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T00:53:44.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.770+0000 7fba9c65c640 1 -- 172.21.15.17:0/869952184 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fba8006cc50 msgr2=0x7fba8006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.770+0000 7fba9c65c640 1 --2- 172.21.15.17:0/869952184 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fba8006cc50 0x7fba8006f110 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba94100c20 tx=0x7fba90005f90 comp rx=0 tx=0).stop 2024-08-19T00:53:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.771+0000 7fba9c65c640 1 -- 172.21.15.17:0/869952184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba94100dc0 msgr2=0x7fba940728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.771+0000 7fba9c65c640 1 --2- 172.21.15.17:0/869952184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba94100dc0 0x7fba940728a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fba84004650 tx=0x7fba840055a0 comp rx=0 tx=0).stop 2024-08-19T00:53:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.771+0000 7fba9c65c640 1 -- 172.21.15.17:0/869952184 shutdown_connections 2024-08-19T00:53:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.771+0000 7fba9c65c640 1 --2- 172.21.15.17:0/869952184 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fba8006cc50 0x7fba8006f110 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.771+0000 7fba9c65c640 1 --2- 172.21.15.17:0/869952184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba94100dc0 0x7fba940728a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.771+0000 7fba9c65c640 1 --2- 172.21.15.17:0/869952184 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba940ffbc0 0x7fba94074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.771+0000 7fba9c65c640 1 -- 172.21.15.17:0/869952184 >> 172.21.15.17:0/869952184 conn(0x7fba940fb350 msgr2=0x7fba94104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.771+0000 7fba9c65c640 1 -- 172.21.15.17:0/869952184 shutdown_connections 2024-08-19T00:53:44.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:44.771+0000 7fba9c65c640 1 -- 172.21.15.17:0/869952184 wait complete. 2024-08-19T00:53:44.782 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:53:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:44 smithi017 ceph-mon[16627]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.7 KiB/s rd, 716 B/s wr, 8 op/s 2024-08-19T00:53:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:53:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:53:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:44 smithi086 ceph-mon[24511]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 5.7 KiB/s rd, 716 B/s wr, 8 op/s 2024-08-19T00:53:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:53:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:53:45.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-08-19T00:53:45.865 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:45 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/869952184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:53:45.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:45 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/869952184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:53:46.116 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:46.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:46 smithi017 ceph-mon[16627]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-19T00:53:46.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:46 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:46.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:46 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:46 smithi086 ceph-mon[24511]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.8 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-19T00:53:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:46 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:46 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:47.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.683+0000 7f4e1c171640 1 -- 172.21.15.17:0/3603663368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e140ffb90 msgr2=0x7f4e140fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.683+0000 7f4e1c171640 1 --2- 172.21.15.17:0/3603663368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e140ffb90 0x7f4e140fff90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009880 tx=0x7f4e1002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.683+0000 7f4e1c171640 1 -- 172.21.15.17:0/3603663368 shutdown_connections 2024-08-19T00:53:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.683+0000 7f4e1c171640 1 --2- 172.21.15.17:0/3603663368 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e14100d90 0x7f4e14101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.683+0000 7f4e1c171640 1 --2- 172.21.15.17:0/3603663368 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e140ffb90 0x7f4e140fff90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.683+0000 7f4e1c171640 1 -- 172.21.15.17:0/3603663368 >> 172.21.15.17:0/3603663368 conn(0x7f4e140fb320 msgr2=0x7f4e140fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.684+0000 7f4e1c171640 1 -- 172.21.15.17:0/3603663368 shutdown_connections 2024-08-19T00:53:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.684+0000 7f4e1c171640 1 -- 172.21.15.17:0/3603663368 wait complete. 2024-08-19T00:53:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.684+0000 7f4e1c171640 1 Processor -- start 2024-08-19T00:53:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.684+0000 7f4e1c171640 1 -- start start 2024-08-19T00:53:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1c171640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e140ffb90 0x7f4e14074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:47.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1c171640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e14100d90 0x7f4e140728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1c171640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e14074790 con 0x7f4e14100d90 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1c171640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e14072e10 con 0x7f4e140ffb90 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1970c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e14100d90 0x7f4e140728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1970c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e14100d90 0x7f4e140728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46936/0 (socket says 172.21.15.17:46936) 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1970c640 1 -- 172.21.15.17:0/4232349549 learned_addr learned my addr 172.21.15.17:0/4232349549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e19f0d640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e140ffb90 0x7f4e14074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1970c640 1 -- 172.21.15.17:0/4232349549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e140ffb90 msgr2=0x7f4e14074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1970c640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e140ffb90 0x7f4e14074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1970c640 1 -- 172.21.15.17:0/4232349549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e10009560 con 0x7f4e14100d90 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e19f0d640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e140ffb90 0x7f4e14074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1970c640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e14100d90 0x7f4e140728a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400c8a0 tx=0x7f4e0400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e0affd640 1 -- 172.21.15.17:0/4232349549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e04007b80 con 0x7f4e14100d90 2024-08-19T00:53:47.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e1c171640 1 -- 172.21.15.17:0/4232349549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e140730f0 con 0x7f4e14100d90 2024-08-19T00:53:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e0affd640 1 -- 172.21.15.17:0/4232349549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e04007ce0 con 0x7f4e14100d90 2024-08-19T00:53:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.685+0000 7f4e0affd640 1 -- 172.21.15.17:0/4232349549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e04018810 con 0x7f4e14100d90 2024-08-19T00:53:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.686+0000 7f4e1c171640 1 -- 172.21.15.17:0/4232349549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e140736c0 con 0x7f4e14100d90 2024-08-19T00:53:47.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.687+0000 7f4e0affd640 1 -- 172.21.15.17:0/4232349549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f4e0400f450 con 0x7f4e14100d90 2024-08-19T00:53:47.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.687+0000 7f4e1c171640 1 -- 172.21.15.17:0/4232349549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e1418f710 con 0x7f4e14100d90 2024-08-19T00:53:47.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.688+0000 7f4e0affd640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4e0006cc50 0x7f4e0006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:47.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.688+0000 7f4e0affd640 1 -- 172.21.15.17:0/4232349549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4e0408c4b0 con 0x7f4e14100d90 2024-08-19T00:53:47.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.688+0000 7f4e19f0d640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4e0006cc50 0x7f4e0006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:47.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.688+0000 7f4e19f0d640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4e0006cc50 0x7f4e0006f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e10031540 tx=0x7f4e10005de0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:47.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.692+0000 7f4e0affd640 1 -- 172.21.15.17:0/4232349549 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f4e04056820 con 0x7f4e14100d90 2024-08-19T00:53:47.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.932+0000 7f4e1c171640 1 -- 172.21.15.17:0/4232349549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f4e14108780 con 0x7f4e14100d90 2024-08-19T00:53:47.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.932+0000 7f4e0affd640 1 -- 172.21.15.17:0/4232349549 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v21) v1 ==== 78+0+97 (secure 0 0 0) 0x7f4e04059e40 con 0x7f4e14100d90 2024-08-19T00:53:47.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.934+0000 7f4e1c171640 1 -- 172.21.15.17:0/4232349549 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4e0006cc50 msgr2=0x7f4e0006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:47.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.934+0000 7f4e1c171640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4e0006cc50 0x7f4e0006f110 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4e10031540 tx=0x7f4e10005de0 comp rx=0 tx=0).stop 2024-08-19T00:53:47.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.934+0000 7f4e1c171640 1 -- 172.21.15.17:0/4232349549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e14100d90 msgr2=0x7f4e140728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:47.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.934+0000 7f4e1c171640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e14100d90 0x7f4e140728a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400c8a0 tx=0x7f4e0400cd60 comp rx=0 tx=0).stop 2024-08-19T00:53:47.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.934+0000 7f4e1c171640 1 -- 172.21.15.17:0/4232349549 shutdown_connections 2024-08-19T00:53:47.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.934+0000 7f4e1c171640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f4e0006cc50 0x7f4e0006f110 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:47.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.934+0000 7f4e1c171640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e14100d90 0x7f4e140728a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:47.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.934+0000 7f4e1c171640 1 --2- 172.21.15.17:0/4232349549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e140ffb90 0x7f4e14074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:47.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.934+0000 7f4e1c171640 1 -- 172.21.15.17:0/4232349549 >> 172.21.15.17:0/4232349549 conn(0x7f4e140fb320 msgr2=0x7f4e14104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:47.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.934+0000 7f4e1c171640 1 -- 172.21.15.17:0/4232349549 shutdown_connections 2024-08-19T00:53:47.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:47.934+0000 7f4e1c171640 1 -- 172.21.15.17:0/4232349549 wait complete. 2024-08-19T00:53:47.945 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:53:48.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:48 smithi017 ceph-mon[16627]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-19T00:53:48.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:48 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/4232349549' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-08-19T00:53:48.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:48 smithi086 ceph-mon[24511]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 9.6 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-19T00:53:48.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:48 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/4232349549' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-08-19T00:53:49.053 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-08-19T00:53:49.089 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T00:53:49.751 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:50.849 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:50 smithi017 ceph-mon[16627]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-19T00:53:50.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:50.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:53:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:50 smithi086 ceph-mon[24511]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-19T00:53:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:53:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.959+0000 7f155d365640 1 -- 172.21.15.17:0/1921341255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1558100d50 msgr2=0x7f1558101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:51.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.959+0000 7f155d365640 1 --2- 172.21.15.17:0/1921341255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1558100d50 0x7f1558101130 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1548009880 tx=0x7f154802a530 comp rx=0 tx=0).stop 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.960+0000 7f155d365640 1 -- 172.21.15.17:0/1921341255 shutdown_connections 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.960+0000 7f155d365640 1 --2- 172.21.15.17:0/1921341255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1558101670 0x7f1558109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.960+0000 7f155d365640 1 --2- 172.21.15.17:0/1921341255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1558100d50 0x7f1558101130 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.960+0000 7f155d365640 1 -- 172.21.15.17:0/1921341255 >> 172.21.15.17:0/1921341255 conn(0x7f15580758a0 msgr2=0x7f15580fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.960+0000 7f155d365640 1 -- 172.21.15.17:0/1921341255 shutdown_connections 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.960+0000 7f155d365640 1 -- 172.21.15.17:0/1921341255 wait complete. 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.960+0000 7f155d365640 1 Processor -- start 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.960+0000 7f155d365640 1 -- start start 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f155d365640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1558100d50 0x7f155819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f155d365640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1558101670 0x7f155819bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f155d365640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155819c510 con 0x7f1558100d50 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f155d365640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1558195aa0 con 0x7f1558101670 2024-08-19T00:53:51.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f1556ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1558100d50 0x7f155819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f1556ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1558100d50 0x7f155819b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46964/0 (socket says 172.21.15.17:46964) 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f1556ffd640 1 -- 172.21.15.17:0/1115991103 learned_addr learned my addr 172.21.15.17:0/1115991103 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f15567fc640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1558101670 0x7f155819bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f1556ffd640 1 -- 172.21.15.17:0/1115991103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1558101670 msgr2=0x7f155819bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f1556ffd640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1558101670 0x7f155819bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f1556ffd640 1 -- 172.21.15.17:0/1115991103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1548009560 con 0x7f1558100d50 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f15567fc640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1558101670 0x7f155819bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f1556ffd640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1558100d50 0x7f155819b9b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1548005940 tx=0x7f1548032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f153ffff640 1 -- 172.21.15.17:0/1115991103 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1548005220 con 0x7f1558100d50 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f153ffff640 1 -- 172.21.15.17:0/1115991103 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1548005380 con 0x7f1558100d50 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f153ffff640 1 -- 172.21.15.17:0/1115991103 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1548003a50 con 0x7f1558100d50 2024-08-19T00:53:51.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.961+0000 7f155d365640 1 -- 172.21.15.17:0/1115991103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1558195d20 con 0x7f1558100d50 2024-08-19T00:53:51.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.962+0000 7f155d365640 1 -- 172.21.15.17:0/1115991103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1558196210 con 0x7f1558100d50 2024-08-19T00:53:51.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.963+0000 7f155d365640 1 -- 172.21.15.17:0/1115991103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1558068470 con 0x7f1558100d50 2024-08-19T00:53:51.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.963+0000 7f153ffff640 1 -- 172.21.15.17:0/1115991103 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f154802ad50 con 0x7f1558100d50 2024-08-19T00:53:51.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.964+0000 7f153ffff640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f154006cc50 0x7f154006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:51.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.964+0000 7f153ffff640 1 -- 172.21.15.17:0/1115991103 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f15480acc90 con 0x7f1558100d50 2024-08-19T00:53:51.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.964+0000 7f15567fc640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f154006cc50 0x7f154006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:51.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.964+0000 7f15567fc640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f154006cc50 0x7f154006f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1558196f10 tx=0x7f154c008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:51.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:51.968+0000 7f153ffff640 1 -- 172.21.15.17:0/1115991103 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f1548077080 con 0x7f1558100d50 2024-08-19T00:53:52.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.177+0000 7f155d365640 1 -- 172.21.15.17:0/1115991103 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1558104440 con 0x7f1558100d50 2024-08-19T00:53:52.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.178+0000 7f153ffff640 1 -- 172.21.15.17:0/1115991103 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4850 (secure 0 0 0) 0x7f154807a6a0 con 0x7f1558100d50 2024-08-19T00:53:52.180 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:53:52.180 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T00:53:41.004049+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14486,"mds_1":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi017.gvlpoy","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.17:6829/1603673340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1603673340},{"type":"v1","addr":"172.21.15.17:6829","nonce":1603673340}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14500":{"gid":14500,"name":"cephfs.smithi017.junbdp","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.17:6827/4086584591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":4086584591},{"type":"v1","addr":"172.21.15.17:6827","nonce":4086584591}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24299":{"gid":24299,"name":"cephfs.smithi086.uxhjfl","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6825/3387019469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3387019469},{"type":"v1","addr":"172.21.15.86:6825","nonce":3387019469}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24311":{"gid":24311,"name":"cephfs.smithi086.oncasl","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.86:6827/91507416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":91507416},{"type":"v1","addr":"172.21.15.86:6827","nonce":91507416}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-08-19T00:53:52.180 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T00:53:52.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.180+0000 7f155d365640 1 -- 172.21.15.17:0/1115991103 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f154006cc50 msgr2=0x7f154006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:52.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.180+0000 7f155d365640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f154006cc50 0x7f154006f110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1558196f10 tx=0x7f154c008040 comp rx=0 tx=0).stop 2024-08-19T00:53:52.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.180+0000 7f155d365640 1 -- 172.21.15.17:0/1115991103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1558100d50 msgr2=0x7f155819b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:52.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.180+0000 7f155d365640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1558100d50 0x7f155819b9b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1548005940 tx=0x7f1548032bd0 comp rx=0 tx=0).stop 2024-08-19T00:53:52.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.180+0000 7f155d365640 1 -- 172.21.15.17:0/1115991103 shutdown_connections 2024-08-19T00:53:52.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.180+0000 7f155d365640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f154006cc50 0x7f154006f110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:52.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.180+0000 7f155d365640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1558101670 0x7f155819bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:52.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.180+0000 7f155d365640 1 --2- 172.21.15.17:0/1115991103 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1558100d50 0x7f155819b9b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:52.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.180+0000 7f155d365640 1 -- 172.21.15.17:0/1115991103 >> 172.21.15.17:0/1115991103 conn(0x7f15580758a0 msgr2=0x7f1558101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:52.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.180+0000 7f155d365640 1 -- 172.21.15.17:0/1115991103 shutdown_connections 2024-08-19T00:53:52.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:52.180+0000 7f155d365640 1 -- 172.21.15.17:0/1115991103 wait complete. 2024-08-19T00:53:52.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:52 smithi086 ceph-mon[24511]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 9.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-19T00:53:52.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:52 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/1115991103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:53:52.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:52 smithi017 ceph-mon[16627]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 9.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-08-19T00:53:52.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:52 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1115991103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T00:53:52.997 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 21, 'max_mds': 2, 'flags': 50} 2024-08-19T00:53:52.998 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-08-19T00:53:53.027 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-08-19T00:53:53.027 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-08-19T00:53:53.027 INFO:tasks.ceph_fuse:client.0 config is {} 2024-08-19T00:53:53.027 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-19T00:53:53.027 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:53:53.027 INFO:tasks.ceph_fuse:client.1 config is {} 2024-08-19T00:53:53.027 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-19T00:53:53.028 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-19T00:53:53.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:53.028 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-08-19T00:53:53.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:53.049 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link delete ceph-brx 2024-08-19T00:53:53.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:53:53.128 INFO:teuthology.orchestra.run.smithi086.stderr:Cannot find device "ceph-brx" 2024-08-19T00:53:53.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:53.128 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-08-19T00:53:53.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:53.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-08-19T00:53:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2024-08-19T00:53:53.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T00:53:53.224 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-08-19T00:53:53.224 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-19T00:53:53.224 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-19T00:53:53.487 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:54.787 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:54.787 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:54.787 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:54.788 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:53:54.788 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:54 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:54.788 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:54 smithi017 ceph-mon[16627]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-19T00:53:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:53:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:53:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:54 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:53:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:54 smithi086 ceph-mon[24511]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 8.1 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-19T00:53:55.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.194+0000 7f0688e5a640 1 -- 172.21.15.17:0/795810914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0684100cd0 msgr2=0x7f06841010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:55.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.194+0000 7f0688e5a640 1 --2- 172.21.15.17:0/795810914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0684100cd0 0x7f06841010b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0674009880 tx=0x7f067402a530 comp rx=0 tx=0).stop 2024-08-19T00:53:55.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.194+0000 7f0688e5a640 1 -- 172.21.15.17:0/795810914 shutdown_connections 2024-08-19T00:53:55.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.194+0000 7f0688e5a640 1 --2- 172.21.15.17:0/795810914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06841015f0 0x7f0684109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:55.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.194+0000 7f0688e5a640 1 --2- 172.21.15.17:0/795810914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0684100cd0 0x7f06841010b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:55.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.194+0000 7f0688e5a640 1 -- 172.21.15.17:0/795810914 >> 172.21.15.17:0/795810914 conn(0x7f06840fa730 msgr2=0x7f06840fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:55.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.194+0000 7f0688e5a640 1 -- 172.21.15.17:0/795810914 shutdown_connections 2024-08-19T00:53:55.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.194+0000 7f0688e5a640 1 -- 172.21.15.17:0/795810914 wait complete. 2024-08-19T00:53:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0688e5a640 1 Processor -- start 2024-08-19T00:53:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0688e5a640 1 -- start start 2024-08-19T00:53:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0688e5a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0684100cd0 0x7f06840fe930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0688e5a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06841015f0 0x7f06840fee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0688e5a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0684100900 con 0x7f06841015f0 2024-08-19T00:53:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0688e5a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06840ff3b0 con 0x7f0684100cd0 2024-08-19T00:53:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0681d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06841015f0 0x7f06840fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0681d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06841015f0 0x7f06840fee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46986/0 (socket says 172.21.15.17:46986) 2024-08-19T00:53:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0681d9b640 1 -- 172.21.15.17:0/1075501406 learned_addr learned my addr 172.21.15.17:0/1075501406 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f068259c640 1 --2- 172.21.15.17:0/1075501406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0684100cd0 0x7f06840fe930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:55.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0681d9b640 1 -- 172.21.15.17:0/1075501406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0684100cd0 msgr2=0x7f06840fe930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0681d9b640 1 --2- 172.21.15.17:0/1075501406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0684100cd0 0x7f06840fe930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.195+0000 7f0681d9b640 1 -- 172.21.15.17:0/1075501406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0674009560 con 0x7f06841015f0 2024-08-19T00:53:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.196+0000 7f0681d9b640 1 --2- 172.21.15.17:0/1075501406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06841015f0 0x7f06840fee70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f067800c8f0 tx=0x7f067800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.196+0000 7f06737fe640 1 -- 172.21.15.17:0/1075501406 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0678007b80 con 0x7f06841015f0 2024-08-19T00:53:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.196+0000 7f0688e5a640 1 -- 172.21.15.17:0/1075501406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06840ff690 con 0x7f06841015f0 2024-08-19T00:53:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.196+0000 7f06737fe640 1 -- 172.21.15.17:0/1075501406 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0678007ce0 con 0x7f06841015f0 2024-08-19T00:53:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.196+0000 7f06737fe640 1 -- 172.21.15.17:0/1075501406 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0678018830 con 0x7f06841015f0 2024-08-19T00:53:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.196+0000 7f0688e5a640 1 -- 172.21.15.17:0/1075501406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06841a1fa0 con 0x7f06841015f0 2024-08-19T00:53:55.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.197+0000 7f0688e5a640 1 -- 172.21.15.17:0/1075501406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0684068d30 con 0x7f06841015f0 2024-08-19T00:53:55.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.198+0000 7f06737fe640 1 -- 172.21.15.17:0/1075501406 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0678018aa0 con 0x7f06841015f0 2024-08-19T00:53:55.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.198+0000 7f06737fe640 1 --2- 172.21.15.17:0/1075501406 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f066c06cc50 0x7f066c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:55.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.198+0000 7f06737fe640 1 -- 172.21.15.17:0/1075501406 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f067808c410 con 0x7f06841015f0 2024-08-19T00:53:55.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.198+0000 7f068259c640 1 --2- 172.21.15.17:0/1075501406 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f066c06cc50 0x7f066c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:55.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.199+0000 7f068259c640 1 --2- 172.21.15.17:0/1075501406 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f066c06cc50 0x7f066c06f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0674000c00 tx=0x7f0674005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:55.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.207+0000 7f06737fe640 1 -- 172.21.15.17:0/1075501406 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f0678056780 con 0x7f06841015f0 2024-08-19T00:53:55.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.413+0000 7f0688e5a640 1 -- 172.21.15.17:0/1075501406 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0684104350 con 0x7f06841015f0 2024-08-19T00:53:55.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.414+0000 7f06737fe640 1 -- 172.21.15.17:0/1075501406 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+83 (secure 0 0 0) 0x7f0678059da0 con 0x7f06841015f0 2024-08-19T00:53:55.416 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-08-19T00:53:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.417+0000 7f0688e5a640 1 -- 172.21.15.17:0/1075501406 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f066c06cc50 msgr2=0x7f066c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.417+0000 7f0688e5a640 1 --2- 172.21.15.17:0/1075501406 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f066c06cc50 0x7f066c06f110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0674000c00 tx=0x7f0674005a20 comp rx=0 tx=0).stop 2024-08-19T00:53:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.417+0000 7f0688e5a640 1 -- 172.21.15.17:0/1075501406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06841015f0 msgr2=0x7f06840fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.417+0000 7f0688e5a640 1 --2- 172.21.15.17:0/1075501406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06841015f0 0x7f06840fee70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f067800c8f0 tx=0x7f067800cdb0 comp rx=0 tx=0).stop 2024-08-19T00:53:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.417+0000 7f0688e5a640 1 -- 172.21.15.17:0/1075501406 shutdown_connections 2024-08-19T00:53:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.417+0000 7f0688e5a640 1 --2- 172.21.15.17:0/1075501406 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f066c06cc50 0x7f066c06f110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.417+0000 7f0688e5a640 1 --2- 172.21.15.17:0/1075501406 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06841015f0 0x7f06840fee70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.417+0000 7f0688e5a640 1 --2- 172.21.15.17:0/1075501406 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0684100cd0 0x7f06840fe930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.417+0000 7f0688e5a640 1 -- 172.21.15.17:0/1075501406 >> 172.21.15.17:0/1075501406 conn(0x7f06840fa730 msgr2=0x7f0684101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.417+0000 7f0688e5a640 1 -- 172.21.15.17:0/1075501406 shutdown_connections 2024-08-19T00:53:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:55.417+0000 7f0688e5a640 1 -- 172.21.15.17:0/1075501406 wait complete. 2024-08-19T00:53:55.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:55 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1075501406' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-19T00:53:55.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:55 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/1075501406' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-19T00:53:56.141 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-19T00:53:56.141 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:53:56.141 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-08-19T00:53:56.141 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-19T00:53:56.141 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-19T00:53:56.141 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-19T00:53:56.141 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-19T00:53:56.141 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:53:56.141 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:53:56.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:56.142 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-08-19T00:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-08-19T00:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-08-19T00:53:56.158 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42420sec preferred_lft 42420sec 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::4d04:c3b0:ac84:c55b/64 scope link noprefixroute 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:53:56.159 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-08-19T00:53:56.160 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-19T00:53:56.160 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:53:56.160 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-08-19T00:53:56.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-08-19T00:53:56.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-08-19T00:53:56.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-08-19T00:53:56.161 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-19T00:53:56.161 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-08-19T00:53:56.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:53:56.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:53:56.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:56.357 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:53:56.383 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-08-19T00:53:56.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:56.384 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-08-19T00:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-08-19T00:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-19T00:53:56.451 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-19T00:53:56.452 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:53:56.452 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:53:56.452 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-08-19T00:53:56.452 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-19T00:53:56.452 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-19T00:53:56.452 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-19T00:53:56.452 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-08-19T00:53:56.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:53:56.629 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:56 smithi017 ceph-mon[16627]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-19T00:53:56.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:53:56.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:56.721 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-08-19T00:53:56.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:56.737 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-08-19T00:53:56.792 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:53:56.792 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-08-19T00:53:56.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:53:56.792 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-19T00:53:56.792 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-08-19T00:53:56.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:53:56.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:53:56.909 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-19T00:53:56.909 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:53:56.909 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-08-19T00:53:56.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-19T00:53:56.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-19T00:53:56.909 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-19T00:53:56.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-19T00:53:56.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-19T00:53:56.910 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-08-19T00:53:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:56 smithi086 ceph-mon[24511]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 8 op/s 2024-08-19T00:53:56.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:53:57.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:53:57.034 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:53:57.034 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-08-19T00:53:57.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-08-19T00:53:57.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-08-19T00:53:57.035 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-08-19T00:53:57.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:53:57.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:53:57.112 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-08-19T00:53:57.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:53:57.112 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-19T00:53:57.127 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-19T00:53:57.127 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:53:57.127 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:53:57.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-08-19T00:53:57.247 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-08-19T00:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-08-19T00:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-08-19T00:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-08-19T00:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-08-19T00:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-08-19T00:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-08-19T00:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-08-19T00:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-08-19T00:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-08-19T00:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-08-19T00:53:57.303 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-08-19T00:53:57.304 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/78f8feb1880c68f8d63e93eabe24e267604b40777d45c3db15aa4b20d17e7a39/merged 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9276d9c16ce8a596b29e2c7389346c4aa8771e3cd5d6bedfd2f7359a94349a68/merged 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/4cd4b42ae10809f7fb34b7839f8ea42cc7add0bf2a41e51cb6d500e037b6c1ad/merged 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/10f6624337c51fd949767c339b09e4dde67a1ceb10e42ccc30dc1eb61f6224a3/merged 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/dd7830324fd51741b167eb611522c8299c8cb070fed25e1354e75f2ab1742a86/merged 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/feeaba5b67dd0823a05dd2630a43227e4a70fa7f8ee64acc329551585b9c6f08/merged 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6a13eb5ef6853254c7e92891a549331380ecb795cd8e211a3dfe008ca383e7ea/merged 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/fc1dcc3741fb6167bb74c7d2a29fc2100c465feda25c684f0f4cd2249ca4fb30/merged 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d4e6a80368375f8bb63ba95707a65df6e2b65fe2cc13a69f12b1144aa80b6fcc/merged 2024-08-19T00:53:57.305 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/4f1e9e85ff9c4c7dbebfc27156a85c3e8c0ebceb9be087696d9b2f051bdaa191/merged 2024-08-19T00:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/ad10adbbe91f071ea793401497ffe0c17e9c2f6422f323aafde1703416223fdf/merged 2024-08-19T00:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0f7d221d25e38b300d14b6d51192561fcf4e468911bb0f4ecf52f00bb8c27d18/merged 2024-08-19T00:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/f7280a542e14b6951e0949aa63e3a4726220b9c2d839f2367a5647814fdbcf8a/merged 2024-08-19T00:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-08-19T00:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:53:57.306 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:53:57.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:57.306 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-08-19T00:53:57.358 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-19T00:53:57.358 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-08-19T00:53:57.400 DEBUG:teuthology.orchestra.run.smithi017:> sudo modprobe fuse 2024-08-19T00:53:57.424 DEBUG:teuthology.orchestra.run.smithi017:> cat /proc/self/mounts | awk '{print $2}' 2024-08-19T00:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout:/proc 2024-08-19T00:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout:/sys 2024-08-19T00:53:57.480 INFO:teuthology.orchestra.run.smithi017.stdout:/dev 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/security 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/shm 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/pts 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/run 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/cgroup 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/pstore 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/bpf 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/ 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/selinux 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/mqueue 2024-08-19T00:53:57.481 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/debug 2024-08-19T00:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout:/dev/hugepages 2024-08-19T00:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/tracing 2024-08-19T00:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysusers.service 2024-08-19T00:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/kernel/config 2024-08-19T00:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout:/sys/fs/fuse/connections 2024-08-19T00:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-sysctl.service 2024-08-19T00:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-19T00:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-19T00:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/nfs/rpc_pipefs 2024-08-19T00:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/1000 2024-08-19T00:53:57.482 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/ceph 2024-08-19T00:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay 2024-08-19T00:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/78f8feb1880c68f8d63e93eabe24e267604b40777d45c3db15aa4b20d17e7a39/merged 2024-08-19T00:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/9276d9c16ce8a596b29e2c7389346c4aa8771e3cd5d6bedfd2f7359a94349a68/merged 2024-08-19T00:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout:/run/user/0 2024-08-19T00:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/4cd4b42ae10809f7fb34b7839f8ea42cc7add0bf2a41e51cb6d500e037b6c1ad/merged 2024-08-19T00:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/10f6624337c51fd949767c339b09e4dde67a1ceb10e42ccc30dc1eb61f6224a3/merged 2024-08-19T00:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/dd7830324fd51741b167eb611522c8299c8cb070fed25e1354e75f2ab1742a86/merged 2024-08-19T00:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/feeaba5b67dd0823a05dd2630a43227e4a70fa7f8ee64acc329551585b9c6f08/merged 2024-08-19T00:53:57.483 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/6a13eb5ef6853254c7e92891a549331380ecb795cd8e211a3dfe008ca383e7ea/merged 2024-08-19T00:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/fc1dcc3741fb6167bb74c7d2a29fc2100c465feda25c684f0f4cd2249ca4fb30/merged 2024-08-19T00:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/d4e6a80368375f8bb63ba95707a65df6e2b65fe2cc13a69f12b1144aa80b6fcc/merged 2024-08-19T00:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/4f1e9e85ff9c4c7dbebfc27156a85c3e8c0ebceb9be087696d9b2f051bdaa191/merged 2024-08-19T00:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/ad10adbbe91f071ea793401497ffe0c17e9c2f6422f323aafde1703416223fdf/merged 2024-08-19T00:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/0f7d221d25e38b300d14b6d51192561fcf4e468911bb0f4ecf52f00bb8c27d18/merged 2024-08-19T00:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout:/var/lib/containers/storage/overlay/f7280a542e14b6951e0949aa63e3a4726220b9c2d839f2367a5647814fdbcf8a/merged 2024-08-19T00:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns 2024-08-19T00:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:53:57.484 INFO:teuthology.orchestra.run.smithi017.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-19T00:53:57.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:57.485 DEBUG:teuthology.orchestra.run.smithi017:> ls /sys/fs/fuse/connections 2024-08-19T00:53:57.504 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:2024-08-19T00:53:57.502+0000 7f1ad7a1f480 -1 init, newargv = 0x55bc16b0feb0 newargc=15 2024-08-19T00:53:57.504 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[63828]: starting ceph client 2024-08-19T00:53:57.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[63828]: starting fuse 2024-08-19T00:53:57.520 INFO:teuthology.orchestra.run.smithi017.stdout:166 2024-08-19T00:53:57.520 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [166] 2024-08-19T00:53:57.520 DEBUG:teuthology.orchestra.run.smithi017:> sudo stdin-killer -- python3 -c ' 2024-08-19T00:53:57.520 DEBUG:teuthology.orchestra.run.smithi017:> import glob 2024-08-19T00:53:57.520 DEBUG:teuthology.orchestra.run.smithi017:> import re 2024-08-19T00:53:57.520 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-08-19T00:53:57.520 DEBUG:teuthology.orchestra.run.smithi017:> import subprocess 2024-08-19T00:53:57.520 DEBUG:teuthology.orchestra.run.smithi017:> 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> def _find_admin_socket(client_name): 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> files = glob.glob(asok_path) 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> # Given a non-glob path, it better be there 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> if "*" not in asok_path: 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> assert(len(files) == 1) 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> return files[0] 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> for f in files: 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-19T00:53:57.521 DEBUG:teuthology.orchestra.run.smithi017:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-19T00:53:57.522 DEBUG:teuthology.orchestra.run.smithi017:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-19T00:53:57.522 DEBUG:teuthology.orchestra.run.smithi017:> contents = proc_f.read() 2024-08-19T00:53:57.522 DEBUG:teuthology.orchestra.run.smithi017:> if mountpoint in contents: 2024-08-19T00:53:57.522 DEBUG:teuthology.orchestra.run.smithi017:> return f 2024-08-19T00:53:57.522 DEBUG:teuthology.orchestra.run.smithi017:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-19T00:53:57.522 DEBUG:teuthology.orchestra.run.smithi017:> 2024-08-19T00:53:57.522 DEBUG:teuthology.orchestra.run.smithi017:> print(_find_admin_socket("client.0")) 2024-08-19T00:53:57.522 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-08-19T00:53:57.639 INFO:teuthology.orchestra.run.smithi017.stdout:/var/run/ceph/ceph-client.0.63828.asok 2024-08-19T00:53:57.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:53:57.649 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.63828.asok 2024-08-19T00:53:57.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:53:57.649 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.63828.asok status 2024-08-19T00:53:57.785 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:53:57.785 INFO:teuthology.orchestra.run.smithi017.stdout: "metadata": { 2024-08-19T00:53:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_sha1": "baa926deef3d9e81dd31b10a4ae9969a5fbce5ae", 2024-08-19T00:53:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph_version": "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)", 2024-08-19T00:53:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "entity_id": "0", 2024-08-19T00:53:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "hostname": "smithi017", 2024-08-19T00:53:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-08-19T00:53:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "pid": "63828", 2024-08-19T00:53:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: "root": "/" 2024-08-19T00:53:57.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:53:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_count": 0, 2024-08-19T00:53:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "dentry_pinned_count": 0, 2024-08-19T00:53:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 14524, 2024-08-19T00:53:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "inst": { 2024-08-19T00:53:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "name": { 2024-08-19T00:53:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "client", 2024-08-19T00:53:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: "num": 14524 2024-08-19T00:53:57.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 167351478 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": { 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "type": "v1", 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "addr": "192.168.0.1:0", 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "nonce": 167351478 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:53:57.788 INFO:teuthology.orchestra.run.smithi017.stdout: "inst_str": "client.14524 192.168.0.1:0/167351478", 2024-08-19T00:53:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "addr_str": "192.168.0.1:0/167351478", 2024-08-19T00:53:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "inode_count": 1, 2024-08-19T00:53:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_epoch": 21, 2024-08-19T00:53:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch": 46, 2024-08-19T00:53:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_epoch_barrier": 0, 2024-08-19T00:53:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "blocklisted": false, 2024-08-19T00:53:57.789 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs" 2024-08-19T00:53:57.789 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:53:57.793 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-08-19T00:53:57.794 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-19T00:53:58.000 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:53:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:53:58 smithi017 ceph-mon[16627]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-08-19T00:53:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:53:58 smithi086 ceph-mon[24511]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-08-19T00:53:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.630+0000 7f599cea0640 1 -- 172.21.15.17:0/3929253880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980fe9f0 msgr2=0x7f59980fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.630+0000 7f599cea0640 1 --2- 172.21.15.17:0/3929253880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980fe9f0 0x7f59980fee50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f598c009880 tx=0x7f598c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:53:59.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.630+0000 7f599cea0640 1 -- 172.21.15.17:0/3929253880 shutdown_connections 2024-08-19T00:53:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.630+0000 7f599cea0640 1 --2- 172.21.15.17:0/3929253880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980fe9f0 0x7f59980fee50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.630+0000 7f599cea0640 1 --2- 172.21.15.17:0/3929253880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59981049f0 0x7f5998104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.630+0000 7f599cea0640 1 -- 172.21.15.17:0/3929253880 >> 172.21.15.17:0/3929253880 conn(0x7f59980758a0 msgr2=0x7f59980fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.630+0000 7f599cea0640 1 -- 172.21.15.17:0/3929253880 shutdown_connections 2024-08-19T00:53:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.630+0000 7f599cea0640 1 -- 172.21.15.17:0/3929253880 wait complete. 2024-08-19T00:53:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599cea0640 1 Processor -- start 2024-08-19T00:53:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599cea0640 1 -- start start 2024-08-19T00:53:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599cea0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980fe9f0 0x7f5998196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:59.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599cea0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59981049f0 0x7f5998196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599cea0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59981974e0 con 0x7f59980fe9f0 2024-08-19T00:53:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599cea0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5998197650 con 0x7f59981049f0 2024-08-19T00:53:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980fe9f0 0x7f5998196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980fe9f0 0x7f5998196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43794/0 (socket says 172.21.15.17:43794) 2024-08-19T00:53:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599659c640 1 -- 172.21.15.17:0/3686517444 learned_addr learned my addr 172.21.15.17:0/3686517444 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:53:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f5995d9b640 1 --2- 172.21.15.17:0/3686517444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59981049f0 0x7f5998196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599659c640 1 -- 172.21.15.17:0/3686517444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59981049f0 msgr2=0x7f5998196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599659c640 1 --2- 172.21.15.17:0/3686517444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59981049f0 0x7f5998196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:59.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599659c640 1 -- 172.21.15.17:0/3686517444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c009560 con 0x7f59980fe9f0 2024-08-19T00:53:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.631+0000 7f599659c640 1 --2- 172.21.15.17:0/3686517444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980fe9f0 0x7f5998196a60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f598800b420 tx=0x7f598800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.632+0000 7f59877fe640 1 -- 172.21.15.17:0/3686517444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5988011800 con 0x7f59980fe9f0 2024-08-19T00:53:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.632+0000 7f599cea0640 1 -- 172.21.15.17:0/3686517444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599819fad0 con 0x7f59980fe9f0 2024-08-19T00:53:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.632+0000 7f59877fe640 1 -- 172.21.15.17:0/3686517444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5988011e20 con 0x7f59980fe9f0 2024-08-19T00:53:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.632+0000 7f59877fe640 1 -- 172.21.15.17:0/3686517444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f598800f2e0 con 0x7f59980fe9f0 2024-08-19T00:53:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.632+0000 7f599cea0640 1 -- 172.21.15.17:0/3686517444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599819fee0 con 0x7f59980fe9f0 2024-08-19T00:53:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.633+0000 7f599cea0640 1 -- 172.21.15.17:0/3686517444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5998100130 con 0x7f59980fe9f0 2024-08-19T00:53:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.633+0000 7f59877fe640 1 -- 172.21.15.17:0/3686517444 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f5988011960 con 0x7f59980fe9f0 2024-08-19T00:53:59.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.633+0000 7f59877fe640 1 --2- 172.21.15.17:0/3686517444 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f598006cc50 0x7f598006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:53:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.634+0000 7f5995d9b640 1 --2- 172.21.15.17:0/3686517444 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f598006cc50 0x7f598006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:53:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.634+0000 7f59877fe640 1 -- 172.21.15.17:0/3686517444 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f598808bc10 con 0x7f59980fe9f0 2024-08-19T00:53:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.634+0000 7f5995d9b640 1 --2- 172.21.15.17:0/3686517444 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f598006cc50 0x7f598006f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f598c000c00 tx=0x7f598c005a20 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:53:59.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.638+0000 7f59877fe640 1 -- 172.21.15.17:0/3686517444 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f5988055f80 con 0x7f59980fe9f0 2024-08-19T00:53:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.847+0000 7f599cea0640 1 -- 172.21.15.17:0/3686517444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f59980682c0 con 0x7f59980fe9f0 2024-08-19T00:53:59.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.848+0000 7f59877fe640 1 -- 172.21.15.17:0/3686517444 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+83 (secure 0 0 0) 0x7f59880595a0 con 0x7f59980fe9f0 2024-08-19T00:53:59.850 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-08-19T00:53:59.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.849+0000 7f599cea0640 1 -- 172.21.15.17:0/3686517444 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f598006cc50 msgr2=0x7f598006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:59.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.849+0000 7f599cea0640 1 --2- 172.21.15.17:0/3686517444 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f598006cc50 0x7f598006f110 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f598c000c00 tx=0x7f598c005a20 comp rx=0 tx=0).stop 2024-08-19T00:53:59.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.849+0000 7f599cea0640 1 -- 172.21.15.17:0/3686517444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980fe9f0 msgr2=0x7f5998196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:53:59.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.849+0000 7f599cea0640 1 --2- 172.21.15.17:0/3686517444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980fe9f0 0x7f5998196a60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f598800b420 tx=0x7f598800b8e0 comp rx=0 tx=0).stop 2024-08-19T00:53:59.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.849+0000 7f599cea0640 1 -- 172.21.15.17:0/3686517444 shutdown_connections 2024-08-19T00:53:59.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.849+0000 7f599cea0640 1 --2- 172.21.15.17:0/3686517444 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f598006cc50 0x7f598006f110 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:59.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.849+0000 7f599cea0640 1 --2- 172.21.15.17:0/3686517444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59981049f0 0x7f5998196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:59.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.849+0000 7f599cea0640 1 --2- 172.21.15.17:0/3686517444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59980fe9f0 0x7f5998196a60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:53:59.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.850+0000 7f599cea0640 1 -- 172.21.15.17:0/3686517444 >> 172.21.15.17:0/3686517444 conn(0x7f59980758a0 msgr2=0x7f59980fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:53:59.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.850+0000 7f599cea0640 1 -- 172.21.15.17:0/3686517444 shutdown_connections 2024-08-19T00:53:59.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:53:59.850+0000 7f599cea0640 1 -- 172.21.15.17:0/3686517444 wait complete. 2024-08-19T00:54:00.513 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-19T00:54:00.513 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-19T00:54:00.514 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi086.front.sepia.ceph.com 2024-08-19T00:54:00.514 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-19T00:54:00.514 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-19T00:54:00.514 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-19T00:54:00.514 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-19T00:54:00.514 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-19T00:54:00.514 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-19T00:54:00.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:00.514 DEBUG:teuthology.orchestra.run.smithi086:> ip addr 2024-08-19T00:54:00.535 INFO:teuthology.orchestra.run.smithi086.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-19T00:54:00.535 INFO:teuthology.orchestra.run.smithi086.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-19T00:54:00.535 INFO:teuthology.orchestra.run.smithi086.stdout: inet 127.0.0.1/8 scope host lo 2024-08-19T00:54:00.535 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:54:00.535 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 ::1/128 scope host 2024-08-19T00:54:00.535 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f6 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f0 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:d8:da:f7 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout: altname enp7s0f1 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:08 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout: link/ether 0c:c4:7a:8f:d8:09 brd ff:ff:ff:ff:ff:ff 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout: inet 172.21.15.86/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft 42424sec preferred_lft 42424sec 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout: inet6 fe80::ec4:7aff:fe8f:d809/64 scope link noprefixroute 2024-08-19T00:54:00.536 INFO:teuthology.orchestra.run.smithi086.stdout: valid_lft forever preferred_lft forever 2024-08-19T00:54:00.537 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-19T00:54:00.537 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:54:00.537 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-08-19T00:54:00.537 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add name ceph-brx type bridge 2024-08-19T00:54:00.537 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr flush dev ceph-brx 2024-08-19T00:54:00.537 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set ceph-brx up 2024-08-19T00:54:00.537 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-19T00:54:00.537 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-08-19T00:54:00.632 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:54:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:54:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:00 smithi017 ceph-mon[16627]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:00 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3686517444' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-19T00:54:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:00 smithi086 ceph-mon[24511]: pgmap v196: 65 pgs: 65 active+clean; 580 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:00 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3686517444' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-19T00:54:01.025 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:54:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:54:01.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:01.033 DEBUG:teuthology.orchestra.run.smithi086:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-19T00:54:01.057 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-08-19T00:54:01.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:01.059 DEBUG:teuthology.orchestra.run.smithi086:> route 2024-08-19T00:54:01.129 INFO:teuthology.orchestra.run.smithi086.stdout:Kernel IP routing table 2024-08-19T00:54:01.130 INFO:teuthology.orchestra.run.smithi086.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-19T00:54:01.130 INFO:teuthology.orchestra.run.smithi086.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-19T00:54:01.130 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-19T00:54:01.130 INFO:teuthology.orchestra.run.smithi086.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-19T00:54:01.130 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:54:01.130 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-08-19T00:54:01.130 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-19T00:54:01.130 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-19T00:54:01.131 DEBUG:teuthology.orchestra.run.smithi086:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-19T00:54:01.131 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-08-19T00:54:01.218 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:54:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:54:01.393 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:54:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:54:01.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:01.399 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list 2024-08-19T00:54:01.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:01.414 DEBUG:teuthology.orchestra.run.smithi086:> ip netns list-id 2024-08-19T00:54:01.471 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:54:01.471 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-08-19T00:54:01.471 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-19T00:54:01.471 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-19T00:54:01.471 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-08-19T00:54:01.560 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:54:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:54:01.584 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:54:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:54:01.591 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-19T00:54:01.591 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:54:01.591 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-08-19T00:54:01.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-19T00:54:01.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-19T00:54:01.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-19T00:54:01.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-19T00:54:01.591 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-19T00:54:01.592 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-08-19T00:54:01.642 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:54:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:54:01.715 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:54:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:54:01.721 DEBUG:teuthology.orchestra.run.smithi086:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-19T00:54:01.722 DEBUG:teuthology.orchestra.run.smithi086:> set -e 2024-08-19T00:54:01.722 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set brx.0 up 2024-08-19T00:54:01.722 DEBUG:teuthology.orchestra.run.smithi086:> sudo ip link set dev brx.0 master ceph-brx 2024-08-19T00:54:01.722 DEBUG:teuthology.orchestra.run.smithi086:> ') 2024-08-19T00:54:01.770 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:54:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-19T00:54:01.793 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:54:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:54:01.800 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-08-19T00:54:01.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:54:01.800 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-19T00:54:01.815 INFO:teuthology.orchestra.run.smithi086.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-19T00:54:01.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-19T00:54:01.816 DEBUG:teuthology.orchestra.run.smithi086:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-19T00:54:01.871 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-08-19T00:54:01.938 DEBUG:teuthology.orchestra.run.smithi086:> cat /proc/self/mounts | awk '{print $2}' 2024-08-19T00:54:01.994 INFO:teuthology.orchestra.run.smithi086.stdout:/proc 2024-08-19T00:54:01.994 INFO:teuthology.orchestra.run.smithi086.stdout:/sys 2024-08-19T00:54:01.994 INFO:teuthology.orchestra.run.smithi086.stdout:/dev 2024-08-19T00:54:01.994 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/security 2024-08-19T00:54:01.995 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/shm 2024-08-19T00:54:01.995 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/pts 2024-08-19T00:54:01.995 INFO:teuthology.orchestra.run.smithi086.stdout:/run 2024-08-19T00:54:01.995 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/cgroup 2024-08-19T00:54:01.995 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/pstore 2024-08-19T00:54:01.995 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/bpf 2024-08-19T00:54:01.995 INFO:teuthology.orchestra.run.smithi086.stdout:/ 2024-08-19T00:54:01.995 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/selinux 2024-08-19T00:54:01.996 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:54:01.996 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/mqueue 2024-08-19T00:54:01.996 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/hugepages 2024-08-19T00:54:01.996 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/debug 2024-08-19T00:54:01.996 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/tracing 2024-08-19T00:54:01.996 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysusers.service 2024-08-19T00:54:01.996 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/config 2024-08-19T00:54:01.996 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/fuse/connections 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysctl.service 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/nfs/rpc_pipefs 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/1000 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/0 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/62445c5bbfc6fc08d32de1187ca4b9912685ab99aaeda0870eaf0ad15b0f3e43/merged 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/02b0dd80421ee659b11205bc176794b78f1baa1511b210759a81f95f407399e3/merged 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/4244449449ad459b399ba5c9beb11da16ea996091693f650de534014d128abda/merged 2024-08-19T00:54:01.997 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/8169459cbd7acea03d00d3e370520938b1ea51df1420e48f69e9f018298aaed2/merged 2024-08-19T00:54:01.998 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/90038075bc6416621e4bde7ef9b95f0a4169d1d62da4ca3cf000292dcab48591/merged 2024-08-19T00:54:01.998 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/3862c076f3d8bc04283f331616e1f6e144fee99aac2dc0b58c755407853970b8/merged 2024-08-19T00:54:01.998 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/c77a423fd91c12b816e21ebad54d899bf7110d0c799b77002b723704636c6c9a/merged 2024-08-19T00:54:01.998 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/c09de274380e216f752c6034a4135f5eac8bfe6a8cbd475c38b489378f7ed425/merged 2024-08-19T00:54:01.998 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/f0901a50efd81739e3140ccdd8a10c9a289a897bc6ce214124aa102393d07ac9/merged 2024-08-19T00:54:01.998 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/1ac81d804f6abeaffd554ce1cc822ee0587175b4cb24c12a13a17328428b85ee/merged 2024-08-19T00:54:01.998 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns 2024-08-19T00:54:01.998 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-19T00:54:01.998 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-19T00:54:01.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:01.999 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-08-19T00:54:02.050 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-19T00:54:02.050 DEBUG:teuthology.orchestra.run.smithi086:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-08-19T00:54:02.092 DEBUG:teuthology.orchestra.run.smithi086:> sudo modprobe fuse 2024-08-19T00:54:02.117 DEBUG:teuthology.orchestra.run.smithi086:> cat /proc/self/mounts | awk '{print $2}' 2024-08-19T00:54:02.175 INFO:teuthology.orchestra.run.smithi086.stdout:/proc 2024-08-19T00:54:02.175 INFO:teuthology.orchestra.run.smithi086.stdout:/sys 2024-08-19T00:54:02.175 INFO:teuthology.orchestra.run.smithi086.stdout:/dev 2024-08-19T00:54:02.175 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/security 2024-08-19T00:54:02.175 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/shm 2024-08-19T00:54:02.175 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/pts 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/run 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/cgroup 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/pstore 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/bpf 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/ 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/selinux 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/mqueue 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/dev/hugepages 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/debug 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/tracing 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysusers.service 2024-08-19T00:54:02.176 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/kernel/config 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/sys/fs/fuse/connections 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-sysctl.service 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/nfs/rpc_pipefs 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/1000 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/ceph 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/run/user/0 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/proc/sys/fs/binfmt_misc 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/62445c5bbfc6fc08d32de1187ca4b9912685ab99aaeda0870eaf0ad15b0f3e43/merged 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/02b0dd80421ee659b11205bc176794b78f1baa1511b210759a81f95f407399e3/merged 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/4244449449ad459b399ba5c9beb11da16ea996091693f650de534014d128abda/merged 2024-08-19T00:54:02.177 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/8169459cbd7acea03d00d3e370520938b1ea51df1420e48f69e9f018298aaed2/merged 2024-08-19T00:54:02.178 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/90038075bc6416621e4bde7ef9b95f0a4169d1d62da4ca3cf000292dcab48591/merged 2024-08-19T00:54:02.178 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/3862c076f3d8bc04283f331616e1f6e144fee99aac2dc0b58c755407853970b8/merged 2024-08-19T00:54:02.178 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/c77a423fd91c12b816e21ebad54d899bf7110d0c799b77002b723704636c6c9a/merged 2024-08-19T00:54:02.178 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/c09de274380e216f752c6034a4135f5eac8bfe6a8cbd475c38b489378f7ed425/merged 2024-08-19T00:54:02.178 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/f0901a50efd81739e3140ccdd8a10c9a289a897bc6ce214124aa102393d07ac9/merged 2024-08-19T00:54:02.178 INFO:teuthology.orchestra.run.smithi086.stdout:/var/lib/containers/storage/overlay/1ac81d804f6abeaffd554ce1cc822ee0587175b4cb24c12a13a17328428b85ee/merged 2024-08-19T00:54:02.178 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns 2024-08-19T00:54:02.178 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-19T00:54:02.178 INFO:teuthology.orchestra.run.smithi086.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-19T00:54:02.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:02.179 DEBUG:teuthology.orchestra.run.smithi086:> ls /sys/fs/fuse/connections 2024-08-19T00:54:02.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi086.stderr:2024-08-19T00:54:02.193+0000 7f7f74355480 -1 init, newargv = 0x55a9090bdeb0 newargc=15 2024-08-19T00:54:02.196 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi086.stderr:ceph-fuse[50368]: starting ceph client 2024-08-19T00:54:02.203 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi086.stderr:ceph-fuse[50368]: starting fuse 2024-08-19T00:54:02.212 INFO:teuthology.orchestra.run.smithi086.stdout:130 2024-08-19T00:54:02.212 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [130] 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> sudo stdin-killer -- python3 -c ' 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> import glob 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> import re 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> import os 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> import subprocess 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> def _find_admin_socket(client_name): 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> files = glob.glob(asok_path) 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> # Given a non-glob path, it better be there 2024-08-19T00:54:02.213 DEBUG:teuthology.orchestra.run.smithi086:> if "*" not in asok_path: 2024-08-19T00:54:02.214 DEBUG:teuthology.orchestra.run.smithi086:> assert(len(files) == 1) 2024-08-19T00:54:02.214 DEBUG:teuthology.orchestra.run.smithi086:> return files[0] 2024-08-19T00:54:02.214 DEBUG:teuthology.orchestra.run.smithi086:> 2024-08-19T00:54:02.214 DEBUG:teuthology.orchestra.run.smithi086:> for f in files: 2024-08-19T00:54:02.214 DEBUG:teuthology.orchestra.run.smithi086:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-19T00:54:02.214 DEBUG:teuthology.orchestra.run.smithi086:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-19T00:54:02.214 DEBUG:teuthology.orchestra.run.smithi086:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-19T00:54:02.214 DEBUG:teuthology.orchestra.run.smithi086:> contents = proc_f.read() 2024-08-19T00:54:02.214 DEBUG:teuthology.orchestra.run.smithi086:> if mountpoint in contents: 2024-08-19T00:54:02.214 DEBUG:teuthology.orchestra.run.smithi086:> return f 2024-08-19T00:54:02.215 DEBUG:teuthology.orchestra.run.smithi086:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-19T00:54:02.215 DEBUG:teuthology.orchestra.run.smithi086:> 2024-08-19T00:54:02.215 DEBUG:teuthology.orchestra.run.smithi086:> print(_find_admin_socket("client.1")) 2024-08-19T00:54:02.215 DEBUG:teuthology.orchestra.run.smithi086:> ' 2024-08-19T00:54:02.329 INFO:teuthology.orchestra.run.smithi086.stdout:/var/run/ceph/ceph-client.1.50368.asok 2024-08-19T00:54:02.333 INFO:teuthology.orchestra.run.smithi086.stderr:2024-08-19T00:54:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-19T00:54:02.344 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50368.asok 2024-08-19T00:54:02.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:02.344 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50368.asok status 2024-08-19T00:54:02.488 INFO:teuthology.orchestra.run.smithi086.stdout:{ 2024-08-19T00:54:02.488 INFO:teuthology.orchestra.run.smithi086.stdout: "metadata": { 2024-08-19T00:54:02.488 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_sha1": "baa926deef3d9e81dd31b10a4ae9969a5fbce5ae", 2024-08-19T00:54:02.489 INFO:teuthology.orchestra.run.smithi086.stdout: "ceph_version": "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)", 2024-08-19T00:54:02.489 INFO:teuthology.orchestra.run.smithi086.stdout: "entity_id": "1", 2024-08-19T00:54:02.489 INFO:teuthology.orchestra.run.smithi086.stdout: "hostname": "smithi086", 2024-08-19T00:54:02.489 INFO:teuthology.orchestra.run.smithi086.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-08-19T00:54:02.489 INFO:teuthology.orchestra.run.smithi086.stdout: "pid": "50368", 2024-08-19T00:54:02.490 INFO:teuthology.orchestra.run.smithi086.stdout: "root": "/" 2024-08-19T00:54:02.490 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-08-19T00:54:02.490 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_count": 0, 2024-08-19T00:54:02.490 INFO:teuthology.orchestra.run.smithi086.stdout: "dentry_pinned_count": 0, 2024-08-19T00:54:02.490 INFO:teuthology.orchestra.run.smithi086.stdout: "id": 24339, 2024-08-19T00:54:02.490 INFO:teuthology.orchestra.run.smithi086.stdout: "inst": { 2024-08-19T00:54:02.491 INFO:teuthology.orchestra.run.smithi086.stdout: "name": { 2024-08-19T00:54:02.491 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "client", 2024-08-19T00:54:02.491 INFO:teuthology.orchestra.run.smithi086.stdout: "num": 24339 2024-08-19T00:54:02.491 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-08-19T00:54:02.491 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2024-08-19T00:54:02.491 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-08-19T00:54:02.492 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2024-08-19T00:54:02.492 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 819526977 2024-08-19T00:54:02.492 INFO:teuthology.orchestra.run.smithi086.stdout: } 2024-08-19T00:54:02.492 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-08-19T00:54:02.492 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": { 2024-08-19T00:54:02.492 INFO:teuthology.orchestra.run.smithi086.stdout: "type": "v1", 2024-08-19T00:54:02.493 INFO:teuthology.orchestra.run.smithi086.stdout: "addr": "192.168.0.1:0", 2024-08-19T00:54:02.493 INFO:teuthology.orchestra.run.smithi086.stdout: "nonce": 819526977 2024-08-19T00:54:02.493 INFO:teuthology.orchestra.run.smithi086.stdout: }, 2024-08-19T00:54:02.493 INFO:teuthology.orchestra.run.smithi086.stdout: "inst_str": "client.24339 192.168.0.1:0/819526977", 2024-08-19T00:54:02.493 INFO:teuthology.orchestra.run.smithi086.stdout: "addr_str": "192.168.0.1:0/819526977", 2024-08-19T00:54:02.493 INFO:teuthology.orchestra.run.smithi086.stdout: "inode_count": 1, 2024-08-19T00:54:02.493 INFO:teuthology.orchestra.run.smithi086.stdout: "mds_epoch": 21, 2024-08-19T00:54:02.494 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch": 46, 2024-08-19T00:54:02.494 INFO:teuthology.orchestra.run.smithi086.stdout: "osd_epoch_barrier": 0, 2024-08-19T00:54:02.494 INFO:teuthology.orchestra.run.smithi086.stdout: "blocklisted": false, 2024-08-19T00:54:02.494 INFO:teuthology.orchestra.run.smithi086.stdout: "fs_name": "cephfs" 2024-08-19T00:54:02.494 INFO:teuthology.orchestra.run.smithi086.stdout:} 2024-08-19T00:54:02.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:02.497 DEBUG:teuthology.orchestra.run.smithi017:> stat --file-system '--printf=%T 2024-08-19T00:54:02.498 DEBUG:teuthology.orchestra.run.smithi017:> ' -- /home/ubuntu/cephtest/mnt.0 2024-08-19T00:54:02.518 INFO:teuthology.orchestra.run.smithi017.stdout:fuseblk 2024-08-19T00:54:02.518 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-08-19T00:54:02.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:02.519 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-19T00:54:02.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:02.593 DEBUG:teuthology.orchestra.run.smithi086:> stat --file-system '--printf=%T 2024-08-19T00:54:02.593 DEBUG:teuthology.orchestra.run.smithi086:> ' -- /home/ubuntu/cephtest/mnt.1 2024-08-19T00:54:02.609 INFO:teuthology.orchestra.run.smithi086.stdout:fuseblk 2024-08-19T00:54:02.609 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-08-19T00:54:02.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T00:54:02.609 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-19T00:54:02.671 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:02 smithi086 ceph-mon[24511]: pgmap v197: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-19T00:54:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:02 smithi017 ceph-mon[16627]: pgmap v197: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-19T00:54:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:04 smithi017 ceph-mon[16627]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-08-19T00:54:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:04 smithi086 ceph-mon[24511]: pgmap v198: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-08-19T00:54:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:05 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:54:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:05 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:54:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:06 smithi017 ceph-mon[16627]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-19T00:54:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:06 smithi086 ceph-mon[24511]: pgmap v199: 65 pgs: 65 active+clean; 581 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-19T00:54:07.502 INFO:teuthology.run_tasks:Running task print... 2024-08-19T00:54:07.517 INFO:teuthology.task.print:**** done client 2024-08-19T00:54:07.518 INFO:teuthology.run_tasks:Running task parallel... 2024-08-19T00:54:07.551 INFO:teuthology.task.parallel:starting parallel... 2024-08-19T00:54:07.552 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-08-19T00:54:07.553 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-19T00:54:07.553 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:54:07.553 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-08-19T00:54:07.554 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-08-19T00:54:07.554 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-08-19T00:54:07.558 INFO:tasks.workunit:Pulling workunits from ref 78215f5a1cf5eaf321d506a66539942e12851f34 2024-08-19T00:54:07.559 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-19T00:54:07.559 INFO:tasks.workunit:timeout=3h 2024-08-19T00:54:07.559 INFO:tasks.workunit:cleanup=True 2024-08-19T00:54:07.559 DEBUG:teuthology.orchestra.run.smithi017:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-19T00:54:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-19T00:54:07.580 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-19T00:54:07.580 INFO:teuthology.orchestra.run.smithi017.stdout:Device: a6h/166d Inode: 1 Links: 2 2024-08-19T00:54:07.580 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:54:07.580 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-19T00:54:07.580 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-08-19T00:54:07.580 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-08-19 00:53:26.631253691 +0000 2024-08-19T00:54:07.581 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-08-19 00:54:02.588669538 +0000 2024-08-19T00:54:07.581 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-08-19T00:54:07.581 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-19T00:54:07.581 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-19T00:54:07.654 DEBUG:teuthology.orchestra.run.smithi086:> stat -- /home/ubuntu/cephtest/mnt.1 2024-08-19T00:54:07.676 INFO:teuthology.orchestra.run.smithi086.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-08-19T00:54:07.676 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-08-19T00:54:07.676 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 82h/130d Inode: 1 Links: 3 2024-08-19T00:54:07.676 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-19T00:54:07.676 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:fusefs_t:s0 2024-08-19T00:54:07.676 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-08-19T00:54:07.676 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-08-19 00:54:07.645824856 +0000 2024-08-19T00:54:07.676 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-08-19 00:54:07.645824856 +0000 2024-08-19T00:54:07.676 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: - 2024-08-19T00:54:07.676 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-08-19T00:54:07.677 DEBUG:teuthology.orchestra.run.smithi086:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-08-19T00:54:07.749 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 78215f5a1cf5eaf321d506a66539942e12851f34 2024-08-19T00:54:07.750 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 78215f5a1cf5eaf321d506a66539942e12851f34 2024-08-19T00:54:07.766 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-19T00:54:07.788 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:54:07.806 INFO:tasks.workunit.client.1.smithi086.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-08-19T00:54:08.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:08 smithi017 ceph-mon[16627]: pgmap v200: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-19T00:54:08.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:08 smithi086 ceph-mon[24511]: pgmap v200: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-19T00:54:09.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.583+0000 7fc9b577e640 1 -- 172.21.15.17:0/239098542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b0100680 msgr2=0x7fc9b0102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.583+0000 7fc9b577e640 1 --2- 172.21.15.17:0/239098542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b0100680 0x7fc9b0102a70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009c50 tx=0x7fc9a002a9a0 comp rx=0 tx=0).stop 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 -- 172.21.15.17:0/239098542 shutdown_connections 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 --2- 172.21.15.17:0/239098542 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9b0102fb0 0x7fc9b01053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 --2- 172.21.15.17:0/239098542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b0100680 0x7fc9b0102a70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 -- 172.21.15.17:0/239098542 >> 172.21.15.17:0/239098542 conn(0x7fc9b00fa280 msgr2=0x7fc9b00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 -- 172.21.15.17:0/239098542 shutdown_connections 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 -- 172.21.15.17:0/239098542 wait complete. 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 Processor -- start 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 -- start start 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b0100680 0x7fc9b0195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9b0102fb0 0x7fc9b0195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b0196240 con 0x7fc9b0100680 2024-08-19T00:54:09.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.584+0000 7fc9b577e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b01963b0 con 0x7fc9b0102fb0 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9aeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b0100680 0x7fc9b0195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9aeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b0100680 0x7fc9b0195730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42764/0 (socket says 172.21.15.17:42764) 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9aeffd640 1 -- 172.21.15.17:0/2284546335 learned_addr learned my addr 172.21.15.17:0/2284546335 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9ae7fc640 1 --2- 172.21.15.17:0/2284546335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9b0102fb0 0x7fc9b0195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9aeffd640 1 -- 172.21.15.17:0/2284546335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9b0102fb0 msgr2=0x7fc9b0195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9aeffd640 1 --2- 172.21.15.17:0/2284546335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9b0102fb0 0x7fc9b0195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9aeffd640 1 -- 172.21.15.17:0/2284546335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a0009900 con 0x7fc9b0100680 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9aeffd640 1 --2- 172.21.15.17:0/2284546335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b0100680 0x7fc9b0195730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00098d0 tx=0x7fc9a0030890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9a7fff640 1 -- 172.21.15.17:0/2284546335 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9a0003b40 con 0x7fc9b0100680 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9a7fff640 1 -- 172.21.15.17:0/2284546335 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9a0030cc0 con 0x7fc9b0100680 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9b577e640 1 -- 172.21.15.17:0/2284546335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b019adf0 con 0x7fc9b0100680 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9a7fff640 1 -- 172.21.15.17:0/2284546335 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9a0044790 con 0x7fc9b0100680 2024-08-19T00:54:09.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.585+0000 7fc9b577e640 1 -- 172.21.15.17:0/2284546335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b019b2d0 con 0x7fc9b0100680 2024-08-19T00:54:09.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.586+0000 7fc9b577e640 1 -- 172.21.15.17:0/2284546335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b0108880 con 0x7fc9b0100680 2024-08-19T00:54:09.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.587+0000 7fc9a7fff640 1 -- 172.21.15.17:0/2284546335 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fc9a000a040 con 0x7fc9b0100680 2024-08-19T00:54:09.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.587+0000 7fc9a7fff640 1 --2- 172.21.15.17:0/2284546335 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc99c06cc50 0x7fc99c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:09.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.587+0000 7fc9a7fff640 1 -- 172.21.15.17:0/2284546335 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fc9a00ad890 con 0x7fc9b0100680 2024-08-19T00:54:09.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.587+0000 7fc9ae7fc640 1 --2- 172.21.15.17:0/2284546335 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc99c06cc50 0x7fc99c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:09.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.588+0000 7fc9ae7fc640 1 --2- 172.21.15.17:0/2284546335 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc99c06cc50 0x7fc99c06f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0196c50 tx=0x7fc998008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:54:09.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.592+0000 7fc9a7fff640 1 -- 172.21.15.17:0/2284546335 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fc9a0077c00 con 0x7fc9b0100680 2024-08-19T00:54:09.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.768+0000 7fc9b577e640 1 -- 172.21.15.17:0/2284546335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fc9b0108a60 con 0x7fc9b0100680 2024-08-19T00:54:09.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.769+0000 7fc9a7fff640 1 -- 172.21.15.17:0/2284546335 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v25)=0 v25) v1 ==== 155+0+0 (secure 0 0 0) 0x7fc9a0003ca0 con 0x7fc9b0100680 2024-08-19T00:54:09.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.771+0000 7fc9b577e640 1 -- 172.21.15.17:0/2284546335 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc99c06cc50 msgr2=0x7fc99c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:09.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.771+0000 7fc9b577e640 1 --2- 172.21.15.17:0/2284546335 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc99c06cc50 0x7fc99c06f110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0196c50 tx=0x7fc998008040 comp rx=0 tx=0).stop 2024-08-19T00:54:09.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.771+0000 7fc9b577e640 1 -- 172.21.15.17:0/2284546335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b0100680 msgr2=0x7fc9b0195730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:09.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.771+0000 7fc9b577e640 1 --2- 172.21.15.17:0/2284546335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b0100680 0x7fc9b0195730 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00098d0 tx=0x7fc9a0030890 comp rx=0 tx=0).stop 2024-08-19T00:54:09.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.771+0000 7fc9b577e640 1 -- 172.21.15.17:0/2284546335 shutdown_connections 2024-08-19T00:54:09.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.771+0000 7fc9b577e640 1 --2- 172.21.15.17:0/2284546335 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fc99c06cc50 0x7fc99c06f110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:09.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.771+0000 7fc9b577e640 1 --2- 172.21.15.17:0/2284546335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9b0102fb0 0x7fc9b0195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:09.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.771+0000 7fc9b577e640 1 --2- 172.21.15.17:0/2284546335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9b0100680 0x7fc9b0195730 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:09.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.771+0000 7fc9b577e640 1 -- 172.21.15.17:0/2284546335 >> 172.21.15.17:0/2284546335 conn(0x7fc9b00fa280 msgr2=0x7fc9b00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:54:09.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.771+0000 7fc9b577e640 1 -- 172.21.15.17:0/2284546335 shutdown_connections 2024-08-19T00:54:09.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:09.771+0000 7fc9b577e640 1 -- 172.21.15.17:0/2284546335 wait complete. 2024-08-19T00:54:10.425 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-08-19T00:54:10.680 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:54:10.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:10 smithi017 ceph-mon[16627]: pgmap v201: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-19T00:54:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:10 smithi086 ceph-mon[24511]: pgmap v201: 65 pgs: 65 active+clean; 582 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-19T00:54:12.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.187+0000 7f05f55b8640 1 -- 172.21.15.17:0/815465165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f0102f60 msgr2=0x7f05f0105350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:12.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.187+0000 7f05f55b8640 1 --2- 172.21.15.17:0/815465165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f0102f60 0x7f05f0105350 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f05e00098b0 tx=0x7f05e002a4d0 comp rx=0 tx=0).stop 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.187+0000 7f05f55b8640 1 -- 172.21.15.17:0/815465165 shutdown_connections 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.187+0000 7f05f55b8640 1 --2- 172.21.15.17:0/815465165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f0102f60 0x7f05f0105350 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.187+0000 7f05f55b8640 1 --2- 172.21.15.17:0/815465165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05f0100630 0x7f05f0102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.187+0000 7f05f55b8640 1 -- 172.21.15.17:0/815465165 >> 172.21.15.17:0/815465165 conn(0x7f05f00fa250 msgr2=0x7f05f00fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.187+0000 7f05f55b8640 1 -- 172.21.15.17:0/815465165 shutdown_connections 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.187+0000 7f05f55b8640 1 -- 172.21.15.17:0/815465165 wait complete. 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.188+0000 7f05f55b8640 1 Processor -- start 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.188+0000 7f05f55b8640 1 -- start start 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.188+0000 7f05f55b8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05f0100630 0x7f05f0197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.188+0000 7f05f55b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f0102f60 0x7f05f0197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.188+0000 7f05f55b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f01982c0 con 0x7f05f0102f60 2024-08-19T00:54:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.188+0000 7f05f55b8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f0198430 con 0x7f05f0100630 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.188+0000 7f05ee7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f0102f60 0x7f05f0197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.188+0000 7f05ee7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f0102f60 0x7f05f0197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42790/0 (socket says 172.21.15.17:42790) 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.188+0000 7f05ee7fc640 1 -- 172.21.15.17:0/2062925025 learned_addr learned my addr 172.21.15.17:0/2062925025 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.188+0000 7f05eeffd640 1 --2- 172.21.15.17:0/2062925025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05f0100630 0x7f05f0197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.189+0000 7f05ee7fc640 1 -- 172.21.15.17:0/2062925025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05f0100630 msgr2=0x7f05f0197840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.189+0000 7f05ee7fc640 1 --2- 172.21.15.17:0/2062925025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05f0100630 0x7f05f0197840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.189+0000 7f05ee7fc640 1 -- 172.21.15.17:0/2062925025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e0009560 con 0x7f05f0102f60 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.189+0000 7f05ee7fc640 1 --2- 172.21.15.17:0/2062925025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f0102f60 0x7f05f0197d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f05e002a9f0 tx=0x7f05e0005610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.189+0000 7f05d7fff640 1 -- 172.21.15.17:0/2062925025 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e0004b20 con 0x7f05f0102f60 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.189+0000 7f05d7fff640 1 -- 172.21.15.17:0/2062925025 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05e0004c80 con 0x7f05f0102f60 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.189+0000 7f05f55b8640 1 -- 172.21.15.17:0/2062925025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f019ceb0 con 0x7f05f0102f60 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.189+0000 7f05d7fff640 1 -- 172.21.15.17:0/2062925025 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05e0003bc0 con 0x7f05f0102f60 2024-08-19T00:54:12.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.189+0000 7f05f55b8640 1 -- 172.21.15.17:0/2062925025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f019d3a0 con 0x7f05f0102f60 2024-08-19T00:54:12.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.190+0000 7f05f55b8640 1 -- 172.21.15.17:0/2062925025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f00fbd40 con 0x7f05f0102f60 2024-08-19T00:54:12.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.191+0000 7f05d7fff640 1 -- 172.21.15.17:0/2062925025 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f05e0031640 con 0x7f05f0102f60 2024-08-19T00:54:12.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.191+0000 7f05d7fff640 1 --2- 172.21.15.17:0/2062925025 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f05d806cc50 0x7f05d806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:12.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.191+0000 7f05d7fff640 1 -- 172.21.15.17:0/2062925025 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f05e00ad4c0 con 0x7f05f0102f60 2024-08-19T00:54:12.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.191+0000 7f05eeffd640 1 --2- 172.21.15.17:0/2062925025 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f05d806cc50 0x7f05d806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:12.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.191+0000 7f05eeffd640 1 --2- 172.21.15.17:0/2062925025 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f05d806cc50 0x7f05d806f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05e4005e10 tx=0x7f05e4005da0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:54:12.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.195+0000 7f05d7fff640 1 -- 172.21.15.17:0/2062925025 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f05e0077830 con 0x7f05f0102f60 2024-08-19T00:54:12.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.368+0000 7f05f55b8640 1 -- 172.21.15.17:0/2062925025 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f05f0108790 con 0x7f05f0102f60 2024-08-19T00:54:12.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.368+0000 7f05d7fff640 1 -- 172.21.15.17:0/2062925025 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v25)=0 v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7f05f0108790 con 0x7f05f0102f60 2024-08-19T00:54:12.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.370+0000 7f05f55b8640 1 -- 172.21.15.17:0/2062925025 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f05d806cc50 msgr2=0x7f05d806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:12.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.370+0000 7f05f55b8640 1 --2- 172.21.15.17:0/2062925025 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f05d806cc50 0x7f05d806f110 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f05e4005e10 tx=0x7f05e4005da0 comp rx=0 tx=0).stop 2024-08-19T00:54:12.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.370+0000 7f05f55b8640 1 -- 172.21.15.17:0/2062925025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f0102f60 msgr2=0x7f05f0197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:12.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.370+0000 7f05f55b8640 1 --2- 172.21.15.17:0/2062925025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f0102f60 0x7f05f0197d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f05e002a9f0 tx=0x7f05e0005610 comp rx=0 tx=0).stop 2024-08-19T00:54:12.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.370+0000 7f05f55b8640 1 -- 172.21.15.17:0/2062925025 shutdown_connections 2024-08-19T00:54:12.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.370+0000 7f05f55b8640 1 --2- 172.21.15.17:0/2062925025 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f05d806cc50 0x7f05d806f110 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:12.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.370+0000 7f05f55b8640 1 --2- 172.21.15.17:0/2062925025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05f0102f60 0x7f05f0197d80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:12.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.370+0000 7f05f55b8640 1 --2- 172.21.15.17:0/2062925025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05f0100630 0x7f05f0197840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:12.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.370+0000 7f05f55b8640 1 -- 172.21.15.17:0/2062925025 >> 172.21.15.17:0/2062925025 conn(0x7f05f00fa250 msgr2=0x7f05f0103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:54:12.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.370+0000 7f05f55b8640 1 -- 172.21.15.17:0/2062925025 shutdown_connections 2024-08-19T00:54:12.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:12.370+0000 7f05f55b8640 1 -- 172.21.15.17:0/2062925025 wait complete. 2024-08-19T00:54:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:12 smithi017 ceph-mon[16627]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-19T00:54:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:12 smithi086 ceph-mon[24511]: pgmap v202: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-19T00:54:12.970 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph config set global log_to_journald false --force' 2024-08-19T00:54:13.179 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:54:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.758+0000 7efd8e527640 1 -- 172.21.15.17:0/2928481519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880fea80 msgr2=0x7efd880fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.758+0000 7efd8e527640 1 --2- 172.21.15.17:0/2928481519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880fea80 0x7efd880fee80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efd78009880 tx=0x7efd7802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:54:14.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.758+0000 7efd8e527640 1 -- 172.21.15.17:0/2928481519 shutdown_connections 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.758+0000 7efd8e527640 1 --2- 172.21.15.17:0/2928481519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd880ffc80 0x7efd88100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.758+0000 7efd8e527640 1 --2- 172.21.15.17:0/2928481519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880fea80 0x7efd880fee80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.758+0000 7efd8e527640 1 -- 172.21.15.17:0/2928481519 >> 172.21.15.17:0/2928481519 conn(0x7efd880fa230 msgr2=0x7efd880fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.759+0000 7efd8e527640 1 -- 172.21.15.17:0/2928481519 shutdown_connections 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.759+0000 7efd8e527640 1 -- 172.21.15.17:0/2928481519 wait complete. 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.759+0000 7efd8e527640 1 Processor -- start 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.759+0000 7efd8e527640 1 -- start start 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.759+0000 7efd8e527640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd880fea80 0x7efd88195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.759+0000 7efd8e527640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880ffc80 0x7efd88195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.759+0000 7efd8e527640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd88196160 con 0x7efd880ffc80 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.759+0000 7efd8e527640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd881962d0 con 0x7efd880fea80 2024-08-19T00:54:14.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880ffc80 0x7efd88195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880ffc80 0x7efd88195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42820/0 (socket says 172.21.15.17:42820) 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd877fe640 1 -- 172.21.15.17:0/943559989 learned_addr learned my addr 172.21.15.17:0/943559989 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd87fff640 1 --2- 172.21.15.17:0/943559989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd880fea80 0x7efd88195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd877fe640 1 -- 172.21.15.17:0/943559989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd880fea80 msgr2=0x7efd88195650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd877fe640 1 --2- 172.21.15.17:0/943559989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd880fea80 0x7efd88195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd877fe640 1 -- 172.21.15.17:0/943559989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd78009560 con 0x7efd880ffc80 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd877fe640 1 --2- 172.21.15.17:0/943559989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880ffc80 0x7efd88195b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00d900 tx=0x7efd7c00ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd857fa640 1 -- 172.21.15.17:0/943559989 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7c009c00 con 0x7efd880ffc80 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd8e527640 1 -- 172.21.15.17:0/943559989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8819ad70 con 0x7efd880ffc80 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd857fa640 1 -- 172.21.15.17:0/943559989 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd7c00b660 con 0x7efd880ffc80 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd857fa640 1 -- 172.21.15.17:0/943559989 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd7c00f680 con 0x7efd880ffc80 2024-08-19T00:54:14.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.760+0000 7efd8e527640 1 -- 172.21.15.17:0/943559989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8819b340 con 0x7efd880ffc80 2024-08-19T00:54:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.761+0000 7efd8e527640 1 -- 172.21.15.17:0/943559989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd88107670 con 0x7efd880ffc80 2024-08-19T00:54:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.762+0000 7efd857fa640 1 -- 172.21.15.17:0/943559989 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efd7c010ab0 con 0x7efd880ffc80 2024-08-19T00:54:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.762+0000 7efd857fa640 1 --2- 172.21.15.17:0/943559989 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc60 0x7efd7006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.762+0000 7efd857fa640 1 -- 172.21.15.17:0/943559989 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7efd7c08c060 con 0x7efd880ffc80 2024-08-19T00:54:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.762+0000 7efd87fff640 1 --2- 172.21.15.17:0/943559989 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc60 0x7efd7006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.763+0000 7efd87fff640 1 --2- 172.21.15.17:0/943559989 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc60 0x7efd7006f120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd7802a9c0 tx=0x7efd78000bc0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:54:14.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.767+0000 7efd857fa640 1 -- 172.21.15.17:0/943559989 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7efd7c0563d0 con 0x7efd880ffc80 2024-08-19T00:54:14.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:14 smithi017 ceph-mon[16627]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-08-19T00:54:14.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.943+0000 7efd8e527640 1 -- 172.21.15.17:0/943559989 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7efd8819b530 con 0x7efd880ffc80 2024-08-19T00:54:14.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:14 smithi086 ceph-mon[24511]: pgmap v203: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-08-19T00:54:14.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.944+0000 7efd857fa640 1 -- 172.21.15.17:0/943559989 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v25)=0 v25) v1 ==== 135+0+0 (secure 0 0 0) 0x7efd7c0599f0 con 0x7efd880ffc80 2024-08-19T00:54:14.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.946+0000 7efd8e527640 1 -- 172.21.15.17:0/943559989 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc60 msgr2=0x7efd7006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:14.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.946+0000 7efd8e527640 1 --2- 172.21.15.17:0/943559989 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc60 0x7efd7006f120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd7802a9c0 tx=0x7efd78000bc0 comp rx=0 tx=0).stop 2024-08-19T00:54:14.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.946+0000 7efd8e527640 1 -- 172.21.15.17:0/943559989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880ffc80 msgr2=0x7efd88195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:14.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.946+0000 7efd8e527640 1 --2- 172.21.15.17:0/943559989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880ffc80 0x7efd88195b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00d900 tx=0x7efd7c00ddc0 comp rx=0 tx=0).stop 2024-08-19T00:54:14.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.946+0000 7efd8e527640 1 -- 172.21.15.17:0/943559989 shutdown_connections 2024-08-19T00:54:14.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.946+0000 7efd8e527640 1 --2- 172.21.15.17:0/943559989 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efd7006cc60 0x7efd7006f120 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:14.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.946+0000 7efd8e527640 1 --2- 172.21.15.17:0/943559989 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd880ffc80 0x7efd88195b90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:14.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.946+0000 7efd8e527640 1 --2- 172.21.15.17:0/943559989 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd880fea80 0x7efd88195650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:14.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.946+0000 7efd8e527640 1 -- 172.21.15.17:0/943559989 >> 172.21.15.17:0/943559989 conn(0x7efd880fa230 msgr2=0x7efd88068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:54:14.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.946+0000 7efd8e527640 1 -- 172.21.15.17:0/943559989 shutdown_connections 2024-08-19T00:54:14.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:14.946+0000 7efd8e527640 1 -- 172.21.15.17:0/943559989 wait complete. 2024-08-19T00:54:15.648 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-08-19T00:54:15.861 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:54:16.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:16 smithi017 ceph-mon[16627]: pgmap v204: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-19T00:54:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:16 smithi086 ceph-mon[24511]: pgmap v204: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-08-19T00:54:17.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.518+0000 7f0a0fa62640 1 -- 172.21.15.17:0/783182102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a0810a8b0 msgr2=0x7f0a0810acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:17.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.518+0000 7f0a0fa62640 1 --2- 172.21.15.17:0/783182102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a0810a8b0 0x7f0a0810acb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009880 tx=0x7f0a0402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:54:17.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.518+0000 7f0a0fa62640 1 -- 172.21.15.17:0/783182102 shutdown_connections 2024-08-19T00:54:17.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.518+0000 7f0a0fa62640 1 --2- 172.21.15.17:0/783182102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0810b790 0x7f0a0810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:17.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.518+0000 7f0a0fa62640 1 --2- 172.21.15.17:0/783182102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a0810a8b0 0x7f0a0810acb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:17.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.518+0000 7f0a0fa62640 1 -- 172.21.15.17:0/783182102 >> 172.21.15.17:0/783182102 conn(0x7f0a08069fe0 msgr2=0x7f0a0806a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:54:17.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.519+0000 7f0a0fa62640 1 -- 172.21.15.17:0/783182102 shutdown_connections 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.519+0000 7f0a0fa62640 1 -- 172.21.15.17:0/783182102 wait complete. 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.519+0000 7f0a0fa62640 1 Processor -- start 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.519+0000 7f0a0fa62640 1 -- start start 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.519+0000 7f0a0fa62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a0810a8b0 0x7f0a081a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.519+0000 7f0a0fa62640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0810b790 0x7f0a081a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.519+0000 7f0a0fa62640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081a0c00 con 0x7f0a0810a8b0 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.519+0000 7f0a0fa62640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a081a0d70 con 0x7f0a0810b790 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f0a0d7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a0810a8b0 0x7f0a081a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f0a0d7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a0810a8b0 0x7f0a081a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60218/0 (socket says 172.21.15.17:60218) 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f0a0d7fe640 1 -- 172.21.15.17:0/2116262350 learned_addr learned my addr 172.21.15.17:0/2116262350 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f0a0cffd640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0810b790 0x7f0a081a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:17.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f0a0d7fe640 1 -- 172.21.15.17:0/2116262350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0810b790 msgr2=0x7f0a081a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:17.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f0a0d7fe640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0810b790 0x7f0a081a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:17.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f0a0d7fe640 1 -- 172.21.15.17:0/2116262350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04009560 con 0x7f0a0810a8b0 2024-08-19T00:54:17.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f0a0cffd640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0810b790 0x7f0a081a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:54:17.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f0a0d7fe640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a0810a8b0 0x7f0a081a00f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0a04005610 tx=0x7f0a04005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:54:17.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f09fe7fc640 1 -- 172.21.15.17:0/2116262350 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a04004ba0 con 0x7f0a0810a8b0 2024-08-19T00:54:17.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f09fe7fc640 1 -- 172.21.15.17:0/2116262350 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a04004d00 con 0x7f0a0810a8b0 2024-08-19T00:54:17.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f0a0fa62640 1 -- 172.21.15.17:0/2116262350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a081a57b0 con 0x7f0a0810a8b0 2024-08-19T00:54:17.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f09fe7fc640 1 -- 172.21.15.17:0/2116262350 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a04003bf0 con 0x7f0a0810a8b0 2024-08-19T00:54:17.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.520+0000 7f0a0fa62640 1 -- 172.21.15.17:0/2116262350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a081a5d20 con 0x7f0a0810a8b0 2024-08-19T00:54:17.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.521+0000 7f0a0fa62640 1 -- 172.21.15.17:0/2116262350 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a08113200 con 0x7f0a0810a8b0 2024-08-19T00:54:17.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.522+0000 7f09fe7fc640 1 -- 172.21.15.17:0/2116262350 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f0a04031640 con 0x7f0a0810a8b0 2024-08-19T00:54:17.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.522+0000 7f09fe7fc640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f09f406cc60 0x7f09f406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:54:17.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.522+0000 7f09fe7fc640 1 -- 172.21.15.17:0/2116262350 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f0a040ad650 con 0x7f0a0810a8b0 2024-08-19T00:54:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.522+0000 7f0a0cffd640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f09f406cc60 0x7f09f406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:54:17.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.523+0000 7f0a0cffd640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f09f406cc60 0x7f09f406f120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0a081a1610 tx=0x7f09f8008040 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:54:17.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.526+0000 7f09fe7fc640 1 -- 172.21.15.17:0/2116262350 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f0a040779c0 con 0x7f0a0810a8b0 2024-08-19T00:54:17.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:17.716+0000 7f0a0fa62640 1 -- 172.21.15.17:0/2116262350 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a081100e0 con 0x7f09f406cc60 2024-08-19T00:54:18.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:18 smithi017 ceph-mon[16627]: pgmap v205: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-08-19T00:54:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:18 smithi086 ceph-mon[24511]: pgmap v205: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-08-19T00:54:19.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:19 smithi017 ceph-mon[16627]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:54:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:19 smithi086 ceph-mon[24511]: from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:54:20.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:20 smithi017 ceph-mon[16627]: pgmap v206: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-19T00:54:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:54:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:20 smithi086 ceph-mon[24511]: pgmap v206: 65 pgs: 65 active+clean; 587 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-19T00:54:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:54:22.903 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:22 smithi086 ceph-mon[24511]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-19T00:54:22.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:22 smithi017 ceph-mon[16627]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-08-19T00:54:23.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:23 smithi086 ceph-mon[24511]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-08-19T00:54:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:23 smithi017 ceph-mon[16627]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 3 op/s 2024-08-19T00:54:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:26 smithi017 ceph-mon[16627]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-19T00:54:26.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:26 smithi086 ceph-mon[24511]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 5 op/s 2024-08-19T00:54:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:28 smithi017 ceph-mon[16627]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-19T00:54:28.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:28 smithi086 ceph-mon[24511]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-08-19T00:54:30.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:30 smithi017 ceph-mon[16627]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-08-19T00:54:30.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:30 smithi086 ceph-mon[24511]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-08-19T00:54:32.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:32 smithi017 ceph-mon[16627]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-19T00:54:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:32 smithi086 ceph-mon[24511]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-19T00:54:34.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:34 smithi017 ceph-mon[16627]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:34.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:34 smithi086 ceph-mon[24511]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:35.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:54:35.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:35 smithi017 ceph-mon[16627]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:54:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:54:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:35 smithi086 ceph-mon[24511]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:54:38.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:38 smithi017 ceph-mon[16627]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:38 smithi086 ceph-mon[24511]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:40 smithi017 ceph-mon[16627]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:40.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:40 smithi086 ceph-mon[24511]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:42 smithi017 ceph-mon[16627]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:54:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:42 smithi086 ceph-mon[24511]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:54:44.900 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:44 smithi017 ceph-mon[16627]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:44 smithi086 ceph-mon[24511]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:46.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:46 smithi017 ceph-mon[16627]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:54:46.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:46 smithi086 ceph-mon[24511]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:54:48.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.315+0000 7f09fe7fc640 1 -- 172.21.15.17:0/2116262350 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f0a081100e0 con 0x7f09f406cc60 2024-08-19T00:54:48.318 INFO:teuthology.orchestra.run.smithi017.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:54:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.318+0000 7f0a0fa62640 1 -- 172.21.15.17:0/2116262350 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f09f406cc60 msgr2=0x7f09f406f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.318+0000 7f0a0fa62640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f09f406cc60 0x7f09f406f120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0a081a1610 tx=0x7f09f8008040 comp rx=0 tx=0).stop 2024-08-19T00:54:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.318+0000 7f0a0fa62640 1 -- 172.21.15.17:0/2116262350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a0810a8b0 msgr2=0x7f0a081a00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:54:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.318+0000 7f0a0fa62640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a0810a8b0 0x7f0a081a00f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0a04005610 tx=0x7f0a04005640 comp rx=0 tx=0).stop 2024-08-19T00:54:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.318+0000 7f0a0fa62640 1 -- 172.21.15.17:0/2116262350 shutdown_connections 2024-08-19T00:54:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.318+0000 7f0a0fa62640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f09f406cc60 0x7f09f406f120 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.318+0000 7f0a0fa62640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a0810b790 0x7f0a081a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.318+0000 7f0a0fa62640 1 --2- 172.21.15.17:0/2116262350 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a0810a8b0 0x7f0a081a00f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:54:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.318+0000 7f0a0fa62640 1 -- 172.21.15.17:0/2116262350 >> 172.21.15.17:0/2116262350 conn(0x7f0a08069fe0 msgr2=0x7f0a0810e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:54:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.318+0000 7f0a0fa62640 1 -- 172.21.15.17:0/2116262350 shutdown_connections 2024-08-19T00:54:48.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:54:48.318+0000 7f0a0fa62640 1 -- 172.21.15.17:0/2116262350 wait complete. 2024-08-19T00:54:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:48 smithi086 ceph-mon[24511]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:48 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:54:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:48 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:54:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:48 smithi017 ceph-mon[16627]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:48 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:54:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:48 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:54:49.028 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-08-19T00:54:49.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:49 smithi017 ceph-mon[16627]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:54:49.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:49 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:54:49.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:49 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:54:49.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:49 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:54:49.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:49 smithi086 ceph-mon[24511]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:54:49.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:49 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:54:49.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:49 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:54:49.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:49 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:54:50.402 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:54:50.606 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:50 smithi017 ceph-mon[16627]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:54:50.606 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:50 smithi017 ceph-mon[16627]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:50.606 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:54:50.606 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:54:50.606 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:54:50.606 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:50 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:54:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:50 smithi086 ceph-mon[24511]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:54:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:50 smithi086 ceph-mon[24511]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:54:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:54:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:54:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:50 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:54:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:51 smithi017 ceph-mon[16627]: Upgrade: Target is version 19.1.0-1382-gde09dd01 (unknown) 2024-08-19T00:54:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:51 smithi017 ceph-mon[16627]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9'] 2024-08-19T00:54:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:51 smithi017 ceph-mon[16627]: Upgrade: Need to upgrade myself (mgr.smithi017.hfpawi) 2024-08-19T00:54:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:51 smithi017 ceph-mon[16627]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 on smithi086 2024-08-19T00:54:51.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:51 smithi086 ceph-mon[24511]: Upgrade: Target is version 19.1.0-1382-gde09dd01 (unknown) 2024-08-19T00:54:51.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:51 smithi086 ceph-mon[24511]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9'] 2024-08-19T00:54:51.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:51 smithi086 ceph-mon[24511]: Upgrade: Need to upgrade myself (mgr.smithi017.hfpawi) 2024-08-19T00:54:51.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:51 smithi086 ceph-mon[24511]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 on smithi086 2024-08-19T00:54:52.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:52 smithi017 ceph-mon[16627]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:54:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:52 smithi086 ceph-mon[24511]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:54:54.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:54 smithi017 ceph-mon[16627]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:54.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:54 smithi086 ceph-mon[24511]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:56.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:56 smithi017 ceph-mon[16627]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:54:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:56 smithi086 ceph-mon[24511]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:54:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:54:58 smithi017 ceph-mon[16627]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:54:58.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:54:58 smithi086 ceph-mon[24511]: pgmap v225: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:55:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:00 smithi017 ceph-mon[16627]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:55:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:00 smithi086 ceph-mon[24511]: pgmap v226: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:55:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:02 smithi017 ceph-mon[16627]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:55:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:02 smithi086 ceph-mon[24511]: pgmap v227: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:55:03.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.343+0000 7f8f0b704640 1 -- 172.21.15.17:0/3825797663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f04100d90 msgr2=0x7f8f04101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:03.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.343+0000 7f8f0b704640 1 --2- 172.21.15.17:0/3825797663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f04100d90 0x7f8f04101210 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009880 tx=0x7f8ef402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.343+0000 7f8f0b704640 1 -- 172.21.15.17:0/3825797663 shutdown_connections 2024-08-19T00:55:03.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.343+0000 7f8f0b704640 1 --2- 172.21.15.17:0/3825797663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f04100d90 0x7f8f04101210 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.343+0000 7f8f0b704640 1 --2- 172.21.15.17:0/3825797663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f040ffb90 0x7f8f040fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.343+0000 7f8f0b704640 1 -- 172.21.15.17:0/3825797663 >> 172.21.15.17:0/3825797663 conn(0x7f8f040fb320 msgr2=0x7f8f040fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.343+0000 7f8f0b704640 1 -- 172.21.15.17:0/3825797663 shutdown_connections 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.343+0000 7f8f0b704640 1 -- 172.21.15.17:0/3825797663 wait complete. 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.344+0000 7f8f0b704640 1 Processor -- start 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.344+0000 7f8f0b704640 1 -- start start 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.344+0000 7f8f0b704640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f040ffb90 0x7f8f04074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.344+0000 7f8f0b704640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f04100d90 0x7f8f040728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.344+0000 7f8f0b704640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04072de0 con 0x7f8f04100d90 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.345+0000 7f8f0b704640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f04072f50 con 0x7f8f040ffb90 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.345+0000 7f8f08c9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f04100d90 0x7f8f040728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.345+0000 7f8f08c9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f04100d90 0x7f8f040728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53734/0 (socket says 172.21.15.17:53734) 2024-08-19T00:55:03.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.345+0000 7f8f08c9f640 1 -- 172.21.15.17:0/1057553261 learned_addr learned my addr 172.21.15.17:0/1057553261 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.345+0000 7f8f094a0640 1 --2- 172.21.15.17:0/1057553261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f040ffb90 0x7f8f04074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.345+0000 7f8f08c9f640 1 -- 172.21.15.17:0/1057553261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f040ffb90 msgr2=0x7f8f04074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.345+0000 7f8f08c9f640 1 --2- 172.21.15.17:0/1057553261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f040ffb90 0x7f8f04074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.345+0000 7f8f08c9f640 1 -- 172.21.15.17:0/1057553261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef4009560 con 0x7f8f04100d90 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.345+0000 7f8f08c9f640 1 --2- 172.21.15.17:0/1057553261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f04100d90 0x7f8f040728a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4004650 tx=0x7f8ef40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.346+0000 7f8efa7fc640 1 -- 172.21.15.17:0/1057553261 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ef4004aa0 con 0x7f8f04100d90 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.346+0000 7f8f0b704640 1 -- 172.21.15.17:0/1057553261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f040731d0 con 0x7f8f04100d90 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.346+0000 7f8f0b704640 1 -- 172.21.15.17:0/1057553261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0419d6a0 con 0x7f8f04100d90 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.346+0000 7f8efa7fc640 1 -- 172.21.15.17:0/1057553261 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ef4005d50 con 0x7f8f04100d90 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.346+0000 7f8efa7fc640 1 -- 172.21.15.17:0/1057553261 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ef40039e0 con 0x7f8f04100d90 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.347+0000 7f8f0b704640 1 -- 172.21.15.17:0/1057553261 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee8005280 con 0x7f8f04100d90 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.348+0000 7f8efa7fc640 1 -- 172.21.15.17:0/1057553261 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8ef4004c00 con 0x7f8f04100d90 2024-08-19T00:55:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.349+0000 7f8efa7fc640 1 --2- 172.21.15.17:0/1057553261 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8ef006cca0 0x7f8ef006f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:03.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.349+0000 7f8efa7fc640 1 -- 172.21.15.17:0/1057553261 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8ef40acdd0 con 0x7f8f04100d90 2024-08-19T00:55:03.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.349+0000 7f8f094a0640 1 --2- 172.21.15.17:0/1057553261 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8ef006cca0 0x7f8ef006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:03.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.350+0000 7f8f094a0640 1 --2- 172.21.15.17:0/1057553261 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8ef006cca0 0x7f8ef006f160 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f04100bf0 tx=0x7f8f00005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:03.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.353+0000 7f8efa7fc640 1 -- 172.21.15.17:0/1057553261 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f8ef40b0030 con 0x7f8f04100d90 2024-08-19T00:55:03.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.670+0000 7f8f0b704640 1 -- 172.21.15.17:0/1057553261 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ee8000bf0 con 0x7f8ef006cca0 2024-08-19T00:55:03.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.672+0000 7f8efa7fc640 1 -- 172.21.15.17:0/1057553261 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f8ee8000bf0 con 0x7f8ef006cca0 2024-08-19T00:55:03.822 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.674+0000 7f8f0b704640 1 -- 172.21.15.17:0/1057553261 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8ef006cca0 msgr2=0x7f8ef006f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.674+0000 7f8f0b704640 1 --2- 172.21.15.17:0/1057553261 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8ef006cca0 0x7f8ef006f160 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8f04100bf0 tx=0x7f8f00005f90 comp rx=0 tx=0).stop 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.674+0000 7f8f0b704640 1 -- 172.21.15.17:0/1057553261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f04100d90 msgr2=0x7f8f040728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.674+0000 7f8f0b704640 1 --2- 172.21.15.17:0/1057553261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f04100d90 0x7f8f040728a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4004650 tx=0x7f8ef40055a0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.674+0000 7f8f0b704640 1 -- 172.21.15.17:0/1057553261 shutdown_connections 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.674+0000 7f8f0b704640 1 --2- 172.21.15.17:0/1057553261 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8ef006cca0 0x7f8ef006f160 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.674+0000 7f8f0b704640 1 --2- 172.21.15.17:0/1057553261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f04100d90 0x7f8f040728a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.674+0000 7f8f0b704640 1 --2- 172.21.15.17:0/1057553261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f040ffb90 0x7f8f04074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.674+0000 7f8f0b704640 1 -- 172.21.15.17:0/1057553261 >> 172.21.15.17:0/1057553261 conn(0x7f8f040fb320 msgr2=0x7f8f04104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.674+0000 7f8f0b704640 1 -- 172.21.15.17:0/1057553261 shutdown_connections 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.674+0000 7f8f0b704640 1 -- 172.21.15.17:0/1057553261 wait complete. 2024-08-19T00:55:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.763+0000 7f68adb7f640 1 -- 172.21.15.17:0/330408091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68a8100d90 msgr2=0x7f68a8101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.763+0000 7f68adb7f640 1 --2- 172.21.15.17:0/330408091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68a8100d90 0x7f68a8101210 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f689c009880 tx=0x7f689c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.763+0000 7f68adb7f640 1 -- 172.21.15.17:0/330408091 shutdown_connections 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.763+0000 7f68adb7f640 1 --2- 172.21.15.17:0/330408091 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68a8100d90 0x7f68a8101210 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.763+0000 7f68adb7f640 1 --2- 172.21.15.17:0/330408091 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a80ffb90 0x7f68a80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.763+0000 7f68adb7f640 1 -- 172.21.15.17:0/330408091 >> 172.21.15.17:0/330408091 conn(0x7f68a80fb320 msgr2=0x7f68a80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.763+0000 7f68adb7f640 1 -- 172.21.15.17:0/330408091 shutdown_connections 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.763+0000 7f68adb7f640 1 -- 172.21.15.17:0/330408091 wait complete. 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.764+0000 7f68adb7f640 1 Processor -- start 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.764+0000 7f68adb7f640 1 -- start start 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.764+0000 7f68adb7f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68a80ffb90 0x7f68a8074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68adb7f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8100d90 0x7f68a80728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68adb7f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a8072de0 con 0x7f68a80ffb90 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68adb7f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a8072f50 con 0x7f68a8100d90 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68a80ffb90 0x7f68a8074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68a77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68a80ffb90 0x7f68a8074250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53750/0 (socket says 172.21.15.17:53750) 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68a77fe640 1 -- 172.21.15.17:0/704227271 learned_addr learned my addr 172.21.15.17:0/704227271 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68a77fe640 1 -- 172.21.15.17:0/704227271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8100d90 msgr2=0x7f68a80728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68a6ffd640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8100d90 0x7f68a80728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68a77fe640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8100d90 0x7f68a80728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68a77fe640 1 -- 172.21.15.17:0/704227271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c009560 con 0x7f68a80ffb90 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68a6ffd640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8100d90 0x7f68a80728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.765+0000 7f68a77fe640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68a80ffb90 0x7f68a8074250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f689800e940 tx=0x7f689800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.766+0000 7f68a4ff9640 1 -- 172.21.15.17:0/704227271 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68980096e0 con 0x7f68a80ffb90 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.766+0000 7f68a4ff9640 1 -- 172.21.15.17:0/704227271 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68980044f0 con 0x7f68a80ffb90 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.766+0000 7f68adb7f640 1 -- 172.21.15.17:0/704227271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a8073230 con 0x7f68a80ffb90 2024-08-19T00:55:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.766+0000 7f68a4ff9640 1 -- 172.21.15.17:0/704227271 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6898010430 con 0x7f68a80ffb90 2024-08-19T00:55:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.766+0000 7f68adb7f640 1 -- 172.21.15.17:0/704227271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a819d6c0 con 0x7f68a80ffb90 2024-08-19T00:55:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.767+0000 7f68adb7f640 1 -- 172.21.15.17:0/704227271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a818f730 con 0x7f68a80ffb90 2024-08-19T00:55:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.768+0000 7f68a4ff9640 1 -- 172.21.15.17:0/704227271 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f689800cc90 con 0x7f68a80ffb90 2024-08-19T00:55:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.768+0000 7f68a4ff9640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f689006cc50 0x7f689006f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.769+0000 7f68a4ff9640 1 -- 172.21.15.17:0/704227271 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6898014070 con 0x7f68a80ffb90 2024-08-19T00:55:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.769+0000 7f68a6ffd640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f689006cc50 0x7f689006f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.769+0000 7f68a6ffd640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f689006cc50 0x7f689006f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f689c000c00 tx=0x7f689c005d50 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.773+0000 7f68a4ff9640 1 -- 172.21.15.17:0/704227271 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f6898056b10 con 0x7f68a80ffb90 2024-08-19T00:55:03.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.963+0000 7f68adb7f640 1 -- 172.21.15.17:0/704227271 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f68a802c4f0 con 0x7f689006cc50 2024-08-19T00:55:03.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.965+0000 7f68a4ff9640 1 -- 172.21.15.17:0/704227271 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f68a802c4f0 con 0x7f689006cc50 2024-08-19T00:55:03.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.967+0000 7f68adb7f640 1 -- 172.21.15.17:0/704227271 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f689006cc50 msgr2=0x7f689006f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:03.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.967+0000 7f68adb7f640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f689006cc50 0x7f689006f110 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f689c000c00 tx=0x7f689c005d50 comp rx=0 tx=0).stop 2024-08-19T00:55:03.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.967+0000 7f68adb7f640 1 -- 172.21.15.17:0/704227271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68a80ffb90 msgr2=0x7f68a8074250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:03.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.967+0000 7f68adb7f640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68a80ffb90 0x7f68a8074250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f689800e940 tx=0x7f689800ee00 comp rx=0 tx=0).stop 2024-08-19T00:55:03.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.967+0000 7f68adb7f640 1 -- 172.21.15.17:0/704227271 shutdown_connections 2024-08-19T00:55:03.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.967+0000 7f68adb7f640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f689006cc50 0x7f689006f110 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.967+0000 7f68adb7f640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68a8100d90 0x7f68a80728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.967+0000 7f68adb7f640 1 --2- 172.21.15.17:0/704227271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68a80ffb90 0x7f68a8074250 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.967+0000 7f68adb7f640 1 -- 172.21.15.17:0/704227271 >> 172.21.15.17:0/704227271 conn(0x7f68a80fb320 msgr2=0x7f68a8104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.968+0000 7f68adb7f640 1 -- 172.21.15.17:0/704227271 shutdown_connections 2024-08-19T00:55:03.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:03.968+0000 7f68adb7f640 1 -- 172.21.15.17:0/704227271 wait complete. 2024-08-19T00:55:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.054+0000 7fa5f93df640 1 -- 172.21.15.17:0/1721743887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f4102fb0 msgr2=0x7fa5f41053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.054+0000 7fa5f93df640 1 --2- 172.21.15.17:0/1721743887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f4102fb0 0x7fa5f41053a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80098b0 tx=0x7fa5e802a4d0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.054+0000 7fa5f93df640 1 -- 172.21.15.17:0/1721743887 shutdown_connections 2024-08-19T00:55:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.054+0000 7fa5f93df640 1 --2- 172.21.15.17:0/1721743887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f4102fb0 0x7fa5f41053a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.054+0000 7fa5f93df640 1 --2- 172.21.15.17:0/1721743887 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f4100680 0x7fa5f4102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.054+0000 7fa5f93df640 1 -- 172.21.15.17:0/1721743887 >> 172.21.15.17:0/1721743887 conn(0x7fa5f40fa280 msgr2=0x7fa5f40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.055+0000 7fa5f93df640 1 -- 172.21.15.17:0/1721743887 shutdown_connections 2024-08-19T00:55:04.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.055+0000 7fa5f93df640 1 -- 172.21.15.17:0/1721743887 wait complete. 2024-08-19T00:55:04.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.055+0000 7fa5f93df640 1 Processor -- start 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.055+0000 7fa5f93df640 1 -- start start 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f93df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f4100680 0x7fa5f4195490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f93df640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f4102fb0 0x7fa5f41959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f93df640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f4195fa0 con 0x7fa5f4100680 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f93df640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f4196110 con 0x7fa5f4102fb0 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f27fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f4102fb0 0x7fa5f41959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f4100680 0x7fa5f4195490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f27fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f4102fb0 0x7fa5f41959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.17:40552/0 (socket says 172.21.15.17:40552) 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f27fc640 1 -- 172.21.15.17:0/2544181057 learned_addr learned my addr 172.21.15.17:0/2544181057 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f27fc640 1 -- 172.21.15.17:0/2544181057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f4100680 msgr2=0x7fa5f4195490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f27fc640 1 --2- 172.21.15.17:0/2544181057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f4100680 0x7fa5f4195490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f27fc640 1 -- 172.21.15.17:0/2544181057 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8009560 con 0x7fa5f4102fb0 2024-08-19T00:55:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.056+0000 7fa5f2ffd640 1 --2- 172.21.15.17:0/2544181057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f4100680 0x7fa5f4195490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:55:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.057+0000 7fa5f27fc640 1 --2- 172.21.15.17:0/2544181057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f4102fb0 0x7fa5f41959d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5e802a9f0 tx=0x7fa5e80045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.057+0000 7fa5dbfff640 1 -- 172.21.15.17:0/2544181057 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5e80053e0 con 0x7fa5f4102fb0 2024-08-19T00:55:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.057+0000 7fa5f93df640 1 -- 172.21.15.17:0/2544181057 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f419ab50 con 0x7fa5f4102fb0 2024-08-19T00:55:04.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.057+0000 7fa5dbfff640 1 -- 172.21.15.17:0/2544181057 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5e8005540 con 0x7fa5f4102fb0 2024-08-19T00:55:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.057+0000 7fa5dbfff640 1 -- 172.21.15.17:0/2544181057 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5e8003b80 con 0x7fa5f4102fb0 2024-08-19T00:55:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.057+0000 7fa5f93df640 1 -- 172.21.15.17:0/2544181057 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f419aff0 con 0x7fa5f4102fb0 2024-08-19T00:55:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.058+0000 7fa5f93df640 1 -- 172.21.15.17:0/2544181057 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f4108930 con 0x7fa5f4102fb0 2024-08-19T00:55:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.058+0000 7fa5dbfff640 1 -- 172.21.15.17:0/2544181057 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7fa5e80046c0 con 0x7fa5f4102fb0 2024-08-19T00:55:04.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.059+0000 7fa5dbfff640 1 --2- 172.21.15.17:0/2544181057 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa5dc06cc50 0x7fa5dc06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.059+0000 7fa5dbfff640 1 -- 172.21.15.17:0/2544181057 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa5e80ad1a0 con 0x7fa5f4102fb0 2024-08-19T00:55:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.059+0000 7fa5f2ffd640 1 --2- 172.21.15.17:0/2544181057 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa5dc06cc50 0x7fa5dc06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:04.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.060+0000 7fa5f2ffd640 1 --2- 172.21.15.17:0/2544181057 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa5dc06cc50 0x7fa5dc06f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009fc0 tx=0x7fa5e4005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:04.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.064+0000 7fa5dbfff640 1 -- 172.21.15.17:0/2544181057 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7fa5e8077620 con 0x7fa5f4102fb0 2024-08-19T00:55:04.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.245+0000 7fa5f93df640 1 -- 172.21.15.17:0/2544181057 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5f4103930 con 0x7fa5dc06cc50 2024-08-19T00:55:04.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.263+0000 7fa5dbfff640 1 -- 172.21.15.17:0/2544181057 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3792 (secure 0 0 0) 0x7fa5f4103930 con 0x7fa5dc06cc50 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (5m) 70s ago 6m 24.7M - 0.25.0 c8568f914cd2 eb29e4d36dfe 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (7m) 70s ago 7m 7570k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (6m) 77s ago 6m 7507k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (7m) 70s ago 7m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (6m) 77s ago 6m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (5m) 70s ago 6m 84.5M - 9.4.7 954c08fa6188 293dd58dd677 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (92s) 70s ago 91s 20.4M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (99s) 70s ago 97s 13.3M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (89s) 77s ago 89s 15.0M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (95s) 77s ago 95s 15.8M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T00:55:04.266 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:9283,8765,8443 running (8m) 70s ago 8m 487M - 18.2.4-721-gbaa926de e6c292a6bc95 41b04ec2a4ce 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (6m) 77s ago 6m 441M - 18.2.4-721-gbaa926de e6c292a6bc95 9dded54f98f7 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (8m) 70s ago 8m 46.2M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 771bc6b905a5 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (5m) 77s ago 5m 38.0M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 c6fce0ad535d 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (7m) 70s ago 7m 16.1M - 1.5.0 0da6a335fe13 33c11a243263 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (6m) 77s ago 6m 16.3M - 1.5.0 0da6a335fe13 15ad23a27a0c 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (5m) 70s ago 5m 54.7M 3948M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (4m) 70s ago 4m 54.4M 3948M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (4m) 70s ago 4m 46.9M 3948M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (3m) 77s ago 3m 54.4M 4970M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (3m) 77s ago 3m 52.9M 4970M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (3m) 77s ago 3m 44.4M 4970M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T00:55:04.267 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (5m) 70s ago 6m 54.0M - 2.43.0 a07b618ecd1d b4713fd83be3 2024-08-19T00:55:04.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.266+0000 7fa5f93df640 1 -- 172.21.15.17:0/2544181057 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa5dc06cc50 msgr2=0x7fa5dc06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.266+0000 7fa5f93df640 1 --2- 172.21.15.17:0/2544181057 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa5dc06cc50 0x7fa5dc06f110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009fc0 tx=0x7fa5e4005f90 comp rx=0 tx=0).stop 2024-08-19T00:55:04.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.266+0000 7fa5f93df640 1 -- 172.21.15.17:0/2544181057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f4102fb0 msgr2=0x7fa5f41959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.266+0000 7fa5f93df640 1 --2- 172.21.15.17:0/2544181057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f4102fb0 0x7fa5f41959d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5e802a9f0 tx=0x7fa5e80045e0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.266+0000 7fa5f93df640 1 -- 172.21.15.17:0/2544181057 shutdown_connections 2024-08-19T00:55:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.266+0000 7fa5f93df640 1 --2- 172.21.15.17:0/2544181057 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7fa5dc06cc50 0x7fa5dc06f110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.266+0000 7fa5f93df640 1 --2- 172.21.15.17:0/2544181057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f4102fb0 0x7fa5f41959d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.266+0000 7fa5f93df640 1 --2- 172.21.15.17:0/2544181057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f4100680 0x7fa5f4195490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.266+0000 7fa5f93df640 1 -- 172.21.15.17:0/2544181057 >> 172.21.15.17:0/2544181057 conn(0x7fa5f40fa280 msgr2=0x7fa5f40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.267+0000 7fa5f93df640 1 -- 172.21.15.17:0/2544181057 shutdown_connections 2024-08-19T00:55:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.267+0000 7fa5f93df640 1 -- 172.21.15.17:0/2544181057 wait complete. 2024-08-19T00:55:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.386+0000 7efecf90c640 1 -- 172.21.15.17:0/1136568428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec81005b0 msgr2=0x7efec81029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.386+0000 7efecf90c640 1 --2- 172.21.15.17:0/1136568428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec81005b0 0x7efec81029a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efec40098b0 tx=0x7efec402a4d0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.386+0000 7efecf90c640 1 -- 172.21.15.17:0/1136568428 shutdown_connections 2024-08-19T00:55:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.386+0000 7efecf90c640 1 --2- 172.21.15.17:0/1136568428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efec8102ee0 0x7efec81052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.386+0000 7efecf90c640 1 --2- 172.21.15.17:0/1136568428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec81005b0 0x7efec81029a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.386+0000 7efecf90c640 1 -- 172.21.15.17:0/1136568428 >> 172.21.15.17:0/1136568428 conn(0x7efec80fa1b0 msgr2=0x7efec80fc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.386+0000 7efecf90c640 1 -- 172.21.15.17:0/1136568428 shutdown_connections 2024-08-19T00:55:04.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.386+0000 7efecf90c640 1 -- 172.21.15.17:0/1136568428 wait complete. 2024-08-19T00:55:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.387+0000 7efecf90c640 1 Processor -- start 2024-08-19T00:55:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.387+0000 7efecf90c640 1 -- start start 2024-08-19T00:55:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.387+0000 7efecf90c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec81005b0 0x7efec80fff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.387+0000 7efecf90c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efec8102ee0 0x7efec80fe560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.387+0000 7efecf90c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec80feaa0 con 0x7efec81005b0 2024-08-19T00:55:04.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.387+0000 7efecf90c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec80fec10 con 0x7efec8102ee0 2024-08-19T00:55:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.388+0000 7efecd6a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec81005b0 0x7efec80fff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.388+0000 7efeccea7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efec8102ee0 0x7efec80fe560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.388+0000 7efeccea7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efec8102ee0 0x7efec80fe560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.17:40560/0 (socket says 172.21.15.17:40560) 2024-08-19T00:55:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.388+0000 7efeccea7640 1 -- 172.21.15.17:0/3558740998 learned_addr learned my addr 172.21.15.17:0/3558740998 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:55:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.388+0000 7efeccea7640 1 -- 172.21.15.17:0/3558740998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec81005b0 msgr2=0x7efec80fff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.388+0000 7efeccea7640 1 --2- 172.21.15.17:0/3558740998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec81005b0 0x7efec80fff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.388+0000 7efeccea7640 1 -- 172.21.15.17:0/3558740998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4009560 con 0x7efec8102ee0 2024-08-19T00:55:04.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.388+0000 7efeccea7640 1 --2- 172.21.15.17:0/3558740998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efec8102ee0 0x7efec80fe560 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e940 tx=0x7efeb800ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.388+0000 7efebe7fc640 1 -- 172.21.15.17:0/3558740998 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efeb8009700 con 0x7efec8102ee0 2024-08-19T00:55:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.388+0000 7efecf90c640 1 -- 172.21.15.17:0/3558740998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec80feef0 con 0x7efec8102ee0 2024-08-19T00:55:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.388+0000 7efecf90c640 1 -- 172.21.15.17:0/3558740998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec819d650 con 0x7efec8102ee0 2024-08-19T00:55:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.389+0000 7efebe7fc640 1 -- 172.21.15.17:0/3558740998 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efeb80054e0 con 0x7efec8102ee0 2024-08-19T00:55:04.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.389+0000 7efebe7fc640 1 -- 172.21.15.17:0/3558740998 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efeb8010430 con 0x7efec8102ee0 2024-08-19T00:55:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.390+0000 7efecf90c640 1 -- 172.21.15.17:0/3558740998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac005280 con 0x7efec8102ee0 2024-08-19T00:55:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.390+0000 7efebe7fc640 1 -- 172.21.15.17:0/3558740998 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7efeb800cc90 con 0x7efec8102ee0 2024-08-19T00:55:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.391+0000 7efebe7fc640 1 --2- 172.21.15.17:0/3558740998 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efeb406cc50 0x7efeb406f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.391+0000 7efebe7fc640 1 -- 172.21.15.17:0/3558740998 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7efeb8014070 con 0x7efec8102ee0 2024-08-19T00:55:04.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.391+0000 7efecd6a8640 1 --2- 172.21.15.17:0/3558740998 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efeb406cc50 0x7efeb406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:04.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.392+0000 7efecd6a8640 1 --2- 172.21.15.17:0/3558740998 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efeb406cc50 0x7efeb406f110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efec4006010 tx=0x7efec40314e0 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:04.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.395+0000 7efebe7fc640 1 -- 172.21.15.17:0/3558740998 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7efeb8056970 con 0x7efec8102ee0 2024-08-19T00:55:04.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.648+0000 7efecf90c640 1 -- 172.21.15.17:0/3558740998 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efeac005d40 con 0x7efec8102ee0 2024-08-19T00:55:04.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.648+0000 7efebe7fc640 1 -- 172.21.15.17:0/3558740998 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7efeb8059f90 con 0x7efec8102ee0 2024-08-19T00:55:04.651 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:55:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T00:55:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2 2024-08-19T00:55:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:55:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T00:55:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2 2024-08-19T00:55:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:55:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T00:55:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6 2024-08-19T00:55:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:55:04.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T00:55:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T00:55:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:55:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T00:55:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 14 2024-08-19T00:55:04.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T00:55:04.652 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:55:04.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.651+0000 7efecf90c640 1 -- 172.21.15.17:0/3558740998 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efeb406cc50 msgr2=0x7efeb406f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.651+0000 7efecf90c640 1 --2- 172.21.15.17:0/3558740998 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efeb406cc50 0x7efeb406f110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efec4006010 tx=0x7efec40314e0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.651+0000 7efecf90c640 1 -- 172.21.15.17:0/3558740998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efec8102ee0 msgr2=0x7efec80fe560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.651+0000 7efecf90c640 1 --2- 172.21.15.17:0/3558740998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efec8102ee0 0x7efec80fe560 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e940 tx=0x7efeb800ee00 comp rx=0 tx=0).stop 2024-08-19T00:55:04.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.651+0000 7efecf90c640 1 -- 172.21.15.17:0/3558740998 shutdown_connections 2024-08-19T00:55:04.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.651+0000 7efecf90c640 1 --2- 172.21.15.17:0/3558740998 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7efeb406cc50 0x7efeb406f110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.651+0000 7efecf90c640 1 --2- 172.21.15.17:0/3558740998 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efec8102ee0 0x7efec80fe560 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.651+0000 7efecf90c640 1 --2- 172.21.15.17:0/3558740998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efec81005b0 0x7efec80fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.651+0000 7efecf90c640 1 -- 172.21.15.17:0/3558740998 >> 172.21.15.17:0/3558740998 conn(0x7efec80fa1b0 msgr2=0x7efec80fc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:04.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.651+0000 7efecf90c640 1 -- 172.21.15.17:0/3558740998 shutdown_connections 2024-08-19T00:55:04.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.651+0000 7efecf90c640 1 -- 172.21.15.17:0/3558740998 wait complete. 2024-08-19T00:55:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.735+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/587438282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5c8100d90 msgr2=0x7ff5c8101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.735+0000 7ff5cdbdc640 1 --2- 172.21.15.17:0/587438282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5c8100d90 0x7ff5c8101210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009880 tx=0x7ff5bc02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.736+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/587438282 shutdown_connections 2024-08-19T00:55:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.736+0000 7ff5cdbdc640 1 --2- 172.21.15.17:0/587438282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5c8100d90 0x7ff5c8101210 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.736+0000 7ff5cdbdc640 1 --2- 172.21.15.17:0/587438282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c80ffb90 0x7ff5c80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.736+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/587438282 >> 172.21.15.17:0/587438282 conn(0x7ff5c80fb320 msgr2=0x7ff5c80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:04.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.736+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/587438282 shutdown_connections 2024-08-19T00:55:04.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.736+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/587438282 wait complete. 2024-08-19T00:55:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.737+0000 7ff5cdbdc640 1 Processor -- start 2024-08-19T00:55:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.737+0000 7ff5cdbdc640 1 -- start start 2024-08-19T00:55:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.737+0000 7ff5cdbdc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c80ffb90 0x7ff5c81978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.737+0000 7ff5cdbdc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5c8197e20 0x7ff5c819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.737+0000 7ff5cdbdc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81982a0 con 0x7ff5c8197e20 2024-08-19T00:55:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.737+0000 7ff5cdbdc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c8198410 con 0x7ff5c80ffb90 2024-08-19T00:55:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.737+0000 7ff5c6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5c8197e20 0x7ff5c819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:04.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.737+0000 7ff5c6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5c8197e20 0x7ff5c819ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53822/0 (socket says 172.21.15.17:53822) 2024-08-19T00:55:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.737+0000 7ff5c6ffd640 1 -- 172.21.15.17:0/3927954069 learned_addr learned my addr 172.21.15.17:0/3927954069 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:55:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.737+0000 7ff5c77fe640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c80ffb90 0x7ff5c81978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.738+0000 7ff5c6ffd640 1 -- 172.21.15.17:0/3927954069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c80ffb90 msgr2=0x7ff5c81978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.738+0000 7ff5c6ffd640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c80ffb90 0x7ff5c81978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.738+0000 7ff5c6ffd640 1 -- 172.21.15.17:0/3927954069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc009560 con 0x7ff5c8197e20 2024-08-19T00:55:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.738+0000 7ff5c77fe640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c80ffb90 0x7ff5c81978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:55:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.738+0000 7ff5c6ffd640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5c8197e20 0x7ff5c819ce40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009230 tx=0x7ff5bc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:04.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.738+0000 7ff5c4ff9640 1 -- 172.21.15.17:0/3927954069 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5bc0053e0 con 0x7ff5c8197e20 2024-08-19T00:55:04.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.738+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/3927954069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c819d380 con 0x7ff5c8197e20 2024-08-19T00:55:04.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.738+0000 7ff5c4ff9640 1 -- 172.21.15.17:0/3927954069 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5bc005540 con 0x7ff5c8197e20 2024-08-19T00:55:04.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.738+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/3927954069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c819d7e0 con 0x7ff5c8197e20 2024-08-19T00:55:04.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.740+0000 7ff5c4ff9640 1 -- 172.21.15.17:0/3927954069 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5bc003d40 con 0x7ff5c8197e20 2024-08-19T00:55:04.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.740+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/3927954069 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c81056d0 con 0x7ff5c8197e20 2024-08-19T00:55:04.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.740+0000 7ff5c4ff9640 1 -- 172.21.15.17:0/3927954069 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7ff5bc03c470 con 0x7ff5c8197e20 2024-08-19T00:55:04.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.741+0000 7ff5c4ff9640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5b006cc60 0x7ff5b006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:04.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.741+0000 7ff5c4ff9640 1 -- 172.21.15.17:0/3927954069 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff5bc0ad520 con 0x7ff5c8197e20 2024-08-19T00:55:04.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.741+0000 7ff5c77fe640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5b006cc60 0x7ff5b006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:04.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.742+0000 7ff5c77fe640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5b006cc60 0x7ff5b006f120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8100bf0 tx=0x7ff5b8005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:04.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.746+0000 7ff5c4ff9640 1 -- 172.21.15.17:0/3927954069 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7ff5bc077890 con 0x7ff5c8197e20 2024-08-19T00:55:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:04 smithi017 ceph-mon[16627]: pgmap v228: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:55:04.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.934+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/3927954069 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5c8108880 con 0x7ff5b006cc60 2024-08-19T00:55:04.938 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:55:04.938 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T00:55:04.938 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T00:55:04.938 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-19T00:55:04.938 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [], 2024-08-19T00:55:04.938 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "0/2 daemons upgraded", 2024-08-19T00:55:04.938 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 image on host smithi086", 2024-08-19T00:55:04.938 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T00:55:04.938 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:55:04.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.935+0000 7ff5c4ff9640 1 -- 172.21.15.17:0/3927954069 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7ff5c8108880 con 0x7ff5b006cc60 2024-08-19T00:55:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.938+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/3927954069 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5b006cc60 msgr2=0x7ff5b006f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.938+0000 7ff5cdbdc640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5b006cc60 0x7ff5b006f120 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8100bf0 tx=0x7ff5b8005f90 comp rx=0 tx=0).stop 2024-08-19T00:55:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.938+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/3927954069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5c8197e20 msgr2=0x7ff5c819ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.938+0000 7ff5cdbdc640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5c8197e20 0x7ff5c819ce40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009230 tx=0x7ff5bc0045e0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.938+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/3927954069 shutdown_connections 2024-08-19T00:55:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.938+0000 7ff5cdbdc640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7ff5b006cc60 0x7ff5b006f120 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.938+0000 7ff5cdbdc640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5c8197e20 0x7ff5c819ce40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.938+0000 7ff5cdbdc640 1 --2- 172.21.15.17:0/3927954069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5c80ffb90 0x7ff5c81978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.938+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/3927954069 >> 172.21.15.17:0/3927954069 conn(0x7ff5c80fb320 msgr2=0x7ff5c8072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:04.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.938+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/3927954069 shutdown_connections 2024-08-19T00:55:04.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:04.938+0000 7ff5cdbdc640 1 -- 172.21.15.17:0/3927954069 wait complete. 2024-08-19T00:55:04.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:04 smithi086 ceph-mon[24511]: pgmap v228: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:55:05.112 INFO:tasks.workunit.client.1.smithi086.stderr:Updating files: 92% (11947/12849) Updating files: 93% (11950/12849) Updating files: 94% (12079/12849) Updating files: 95% (12207/12849) Updating files: 96% (12336/12849) Updating files: 97% (12464/12849) Updating files: 98% (12593/12849) Updating files: 99% (12721/12849) Updating files: 100% (12849/12849) Updating files: 100% (12849/12849), done. 2024-08-19T00:55:05.526 INFO:tasks.workunit.client.1.smithi086.stderr:Note: switching to '78215f5a1cf5eaf321d506a66539942e12851f34'. 2024-08-19T00:55:05.526 INFO:tasks.workunit.client.1.smithi086.stderr: 2024-08-19T00:55:05.526 INFO:tasks.workunit.client.1.smithi086.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-19T00:55:05.526 INFO:tasks.workunit.client.1.smithi086.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-19T00:55:05.526 INFO:tasks.workunit.client.1.smithi086.stderr:state without impacting any branches by switching back to a branch. 2024-08-19T00:55:05.526 INFO:tasks.workunit.client.1.smithi086.stderr: 2024-08-19T00:55:05.527 INFO:tasks.workunit.client.1.smithi086.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-19T00:55:05.527 INFO:tasks.workunit.client.1.smithi086.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-19T00:55:05.527 INFO:tasks.workunit.client.1.smithi086.stderr: 2024-08-19T00:55:05.527 INFO:tasks.workunit.client.1.smithi086.stderr: git switch -c 2024-08-19T00:55:05.527 INFO:tasks.workunit.client.1.smithi086.stderr: 2024-08-19T00:55:05.527 INFO:tasks.workunit.client.1.smithi086.stderr:Or undo this operation with: 2024-08-19T00:55:05.527 INFO:tasks.workunit.client.1.smithi086.stderr: 2024-08-19T00:55:05.527 INFO:tasks.workunit.client.1.smithi086.stderr: git switch - 2024-08-19T00:55:05.527 INFO:tasks.workunit.client.1.smithi086.stderr: 2024-08-19T00:55:05.527 INFO:tasks.workunit.client.1.smithi086.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-19T00:55:05.527 INFO:tasks.workunit.client.1.smithi086.stderr: 2024-08-19T00:55:05.528 INFO:tasks.workunit.client.1.smithi086.stderr:HEAD is now at 78215f5a1cf Merge pull request #59291 from zdover23/wip-doc-2024-08-19-backport-59290-to-squid 2024-08-19T00:55:05.531 DEBUG:teuthology.orchestra.run.smithi086:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-08-19T00:55:05.596 INFO:tasks.workunit.client.1.smithi086.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-19T00:55:05.598 INFO:tasks.workunit.client.1.smithi086.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-08-19T00:55:05.598 INFO:tasks.workunit.client.1.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-19T00:55:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:05 smithi017 ceph-mon[16627]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:05 smithi017 ceph-mon[16627]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:05 smithi017 ceph-mon[16627]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:05 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3558740998' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:55:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:05 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:55:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:05 smithi086 ceph-mon[24511]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:05 smithi086 ceph-mon[24511]: from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:05 smithi086 ceph-mon[24511]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:05 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3558740998' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:55:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:05 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:55:06.239 INFO:tasks.workunit.client.1.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-19T00:55:06.300 INFO:tasks.workunit.client.1.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-19T00:55:06.340 INFO:tasks.workunit.client.1.smithi086.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-08-19T00:55:06.341 INFO:tasks.workunit.client.1.smithi086.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-08-19T00:55:06.342 INFO:tasks.workunit.client.1.smithi086.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-19T00:55:06.390 INFO:tasks.workunit.client.1.smithi086.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-08-19T00:55:06.393 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-08-19T00:55:06.393 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-08-19T00:55:06.449 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-08-19T00:55:06.451 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-08-19T00:55:06.451 DEBUG:teuthology.orchestra.run.smithi086:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-08-19T00:55:06.518 INFO:tasks.workunit.client.1.smithi086.stderr:+ mkdir -p fsstress 2024-08-19T00:55:06.520 INFO:tasks.workunit.client.1.smithi086.stderr:+ pushd fsstress 2024-08-19T00:55:06.521 INFO:tasks.workunit.client.1.smithi086.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-19T00:55:06.522 INFO:tasks.workunit.client.1.smithi086.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-08-19T00:55:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:06 smithi017 ceph-mon[16627]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:06 smithi017 ceph-mon[16627]: pgmap v229: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:55:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:06 smithi086 ceph-mon[24511]: from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:06 smithi086 ceph-mon[24511]: pgmap v229: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:55:07.046 INFO:tasks.workunit.client.1.smithi086.stderr:+ tar xzf ltp-full.tgz 2024-08-19T00:55:08.179 INFO:tasks.workunit.client.0.smithi017.stderr:Updating files: 86% (11082/12849) Updating files: 87% (11179/12849) Updating files: 88% (11308/12849) Updating files: 89% (11436/12849) Updating files: 90% (11565/12849) Updating files: 91% (11693/12849) Updating files: 92% (11822/12849) Updating files: 93% (11950/12849) Updating files: 94% (12079/12849) Updating files: 95% (12207/12849) Updating files: 96% (12336/12849) Updating files: 97% (12464/12849) Updating files: 98% (12593/12849) Updating files: 99% (12721/12849) Updating files: 100% (12849/12849) Updating files: 100% (12849/12849), done. 2024-08-19T00:55:08.626 INFO:tasks.workunit.client.0.smithi017.stderr:Note: switching to '78215f5a1cf5eaf321d506a66539942e12851f34'. 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr:state without impacting any branches by switching back to a branch. 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr: git switch -c 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr:Or undo this operation with: 2024-08-19T00:55:08.627 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-08-19T00:55:08.628 INFO:tasks.workunit.client.0.smithi017.stderr: git switch - 2024-08-19T00:55:08.628 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-08-19T00:55:08.628 INFO:tasks.workunit.client.0.smithi017.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-19T00:55:08.628 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-08-19T00:55:08.628 INFO:tasks.workunit.client.0.smithi017.stderr:HEAD is now at 78215f5a1cf Merge pull request #59291 from zdover23/wip-doc-2024-08-19-backport-59290-to-squid 2024-08-19T00:55:08.631 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-19T00:55:08.659 INFO:tasks.workunit.client.0.smithi017.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-19T00:55:08.661 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-19T00:55:08.661 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-19T00:55:08.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:08 smithi017 ceph-mon[16627]: pgmap v230: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:55:08.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:08 smithi086 ceph-mon[24511]: pgmap v230: 65 pgs: 65 active+clean; 590 KiB data, 195 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:55:09.267 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-19T00:55:09.336 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-19T00:55:09.380 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-19T00:55:09.382 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-19T00:55:09.382 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-19T00:55:09.425 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-19T00:55:09.429 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T00:55:09.430 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-19T00:55:09.494 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-08-19T00:55:09.495 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-08-19T00:55:09.495 DEBUG:teuthology.orchestra.run.smithi017:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=78215f5a1cf5eaf321d506a66539942e12851f34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-08-19T00:55:09.559 INFO:tasks.workunit.client.0.smithi017.stderr:+ mkdir -p fsstress 2024-08-19T00:55:09.561 INFO:tasks.workunit.client.0.smithi017.stderr:+ pushd fsstress 2024-08-19T00:55:09.562 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-19T00:55:09.563 INFO:tasks.workunit.client.0.smithi017.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-08-19T00:55:10.476 INFO:tasks.workunit.client.0.smithi017.stderr:+ tar xzf ltp-full.tgz 2024-08-19T00:55:10.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:10 smithi017 ceph-mon[16627]: pgmap v231: 65 pgs: 65 active+clean; 1.0 MiB data, 205 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 40 KiB/s wr, 6 op/s 2024-08-19T00:55:10.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:10 smithi086 ceph-mon[24511]: pgmap v231: 65 pgs: 65 active+clean; 1.0 MiB data, 205 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 40 KiB/s wr, 6 op/s 2024-08-19T00:55:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:12 smithi017 ceph-mon[16627]: pgmap v232: 65 pgs: 65 active+clean; 19 MiB data, 244 MiB used, 536 GiB / 536 GiB avail; 34 KiB/s rd, 1.6 MiB/s wr, 41 op/s 2024-08-19T00:55:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:12 smithi086 ceph-mon[24511]: pgmap v232: 65 pgs: 65 active+clean; 19 MiB data, 244 MiB used, 536 GiB / 536 GiB avail; 34 KiB/s rd, 1.6 MiB/s wr, 41 op/s 2024-08-19T00:55:14.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:14 smithi017 ceph-mon[16627]: pgmap v233: 65 pgs: 65 active+clean; 20 MiB data, 248 MiB used, 536 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 48 op/s 2024-08-19T00:55:14.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:14 smithi086 ceph-mon[24511]: pgmap v233: 65 pgs: 65 active+clean; 20 MiB data, 248 MiB used, 536 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 48 op/s 2024-08-19T00:55:16.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:16 smithi017 ceph-mon[16627]: pgmap v234: 65 pgs: 65 active+clean; 31 MiB data, 292 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 2.6 MiB/s wr, 99 op/s 2024-08-19T00:55:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:16 smithi086 ceph-mon[24511]: pgmap v234: 65 pgs: 65 active+clean; 31 MiB data, 292 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 2.6 MiB/s wr, 99 op/s 2024-08-19T00:55:18.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:18 smithi086 ceph-mon[24511]: pgmap v235: 65 pgs: 65 active+clean; 38 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 708 KiB/s rd, 3.1 MiB/s wr, 128 op/s 2024-08-19T00:55:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:18 smithi017 ceph-mon[16627]: pgmap v235: 65 pgs: 65 active+clean; 38 MiB data, 316 MiB used, 536 GiB / 536 GiB avail; 708 KiB/s rd, 3.1 MiB/s wr, 128 op/s 2024-08-19T00:55:20.430 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:19 smithi086 ceph-mon[24511]: Upgrade: Updating mgr.smithi086.uthxct 2024-08-19T00:55:20.430 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:19 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:20.430 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:19 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi086.uthxct", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:55:20.430 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:19 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:55:20.430 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:19 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:55:20.430 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:19 smithi086 ceph-mon[24511]: Deploying daemon mgr.smithi086.uthxct on smithi086 2024-08-19T00:55:20.430 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:19 smithi086 ceph-mon[24511]: pgmap v236: 65 pgs: 65 active+clean; 39 MiB data, 339 MiB used, 536 GiB / 536 GiB avail; 708 KiB/s rd, 3.2 MiB/s wr, 143 op/s 2024-08-19T00:55:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:19 smithi017 ceph-mon[16627]: Upgrade: Updating mgr.smithi086.uthxct 2024-08-19T00:55:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:19 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:19 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi086.uthxct", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:55:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:19 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:55:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:19 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:55:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:19 smithi017 ceph-mon[16627]: Deploying daemon mgr.smithi086.uthxct on smithi086 2024-08-19T00:55:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:19 smithi017 ceph-mon[16627]: pgmap v236: 65 pgs: 65 active+clean; 39 MiB data, 339 MiB used, 536 GiB / 536 GiB avail; 708 KiB/s rd, 3.2 MiB/s wr, 143 op/s 2024-08-19T00:55:21.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:20 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:55:21.378 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:20 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:55:22.315 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:21 smithi086 ceph-mon[24511]: pgmap v237: 65 pgs: 65 active+clean; 61 MiB data, 391 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 210 op/s 2024-08-19T00:55:22.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:21 smithi017 ceph-mon[16627]: pgmap v237: 65 pgs: 65 active+clean; 61 MiB data, 391 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.0 MiB/s wr, 210 op/s 2024-08-19T00:55:24.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:24 smithi017 ceph-mon[16627]: pgmap v238: 65 pgs: 65 active+clean; 66 MiB data, 401 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 193 op/s 2024-08-19T00:55:24.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:24 smithi086 ceph-mon[24511]: pgmap v238: 65 pgs: 65 active+clean; 66 MiB data, 401 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 193 op/s 2024-08-19T00:55:26.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:26 smithi017 ceph-mon[16627]: pgmap v239: 65 pgs: 65 active+clean; 85 MiB data, 456 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 233 op/s 2024-08-19T00:55:26.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:26 smithi086 ceph-mon[24511]: pgmap v239: 65 pgs: 65 active+clean; 85 MiB data, 456 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.5 MiB/s wr, 233 op/s 2024-08-19T00:55:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:28 smithi017 ceph-mon[16627]: pgmap v240: 65 pgs: 65 active+clean; 93 MiB data, 476 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.2 MiB/s wr, 216 op/s 2024-08-19T00:55:28.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:28 smithi086 ceph-mon[24511]: pgmap v240: 65 pgs: 65 active+clean; 93 MiB data, 476 MiB used, 536 GiB / 536 GiB avail; 3.0 MiB/s rd, 5.2 MiB/s wr, 216 op/s 2024-08-19T00:55:30.769 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:30 smithi086 ceph-mon[24511]: pgmap v241: 65 pgs: 65 active+clean; 95 MiB data, 495 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 206 op/s 2024-08-19T00:55:30.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:30 smithi017 ceph-mon[16627]: pgmap v241: 65 pgs: 65 active+clean; 95 MiB data, 495 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.8 MiB/s wr, 206 op/s 2024-08-19T00:55:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:32 smithi017 ceph-mon[16627]: pgmap v242: 65 pgs: 65 active+clean; 108 MiB data, 529 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.9 MiB/s wr, 243 op/s 2024-08-19T00:55:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:32 smithi086 ceph-mon[24511]: pgmap v242: 65 pgs: 65 active+clean; 108 MiB data, 529 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 5.9 MiB/s wr, 243 op/s 2024-08-19T00:55:34.767 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:34 smithi086 ceph-mon[24511]: pgmap v243: 65 pgs: 65 active+clean; 108 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 181 op/s 2024-08-19T00:55:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:34 smithi017 ceph-mon[16627]: pgmap v243: 65 pgs: 65 active+clean; 108 MiB data, 538 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.1 MiB/s wr, 181 op/s 2024-08-19T00:55:35.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.060+0000 7f889960d640 1 -- 172.21.15.17:0/1287786423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8894100040 msgr2=0x7f8894100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:35.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.060+0000 7f889960d640 1 --2- 172.21.15.17:0/1287786423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8894100040 0x7f8894100440 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8884009880 tx=0x7f888402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.060+0000 7f889960d640 1 -- 172.21.15.17:0/1287786423 shutdown_connections 2024-08-19T00:55:35.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.060+0000 7f889960d640 1 --2- 172.21.15.17:0/1287786423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f88940fecf0 0x7f88940ff170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.060+0000 7f889960d640 1 --2- 172.21.15.17:0/1287786423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8894100040 0x7f8894100440 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.060+0000 7f889960d640 1 -- 172.21.15.17:0/1287786423 >> 172.21.15.17:0/1287786423 conn(0x7f88940f9950 msgr2=0x7f88940fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.060+0000 7f889960d640 1 -- 172.21.15.17:0/1287786423 shutdown_connections 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.060+0000 7f889960d640 1 -- 172.21.15.17:0/1287786423 wait complete. 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.060+0000 7f889960d640 1 Processor -- start 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f889960d640 1 -- start start 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f889960d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88940fecf0 0x7f88940fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f889960d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8894100040 0x7f889419c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f889960d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8894196200 con 0x7f88940fecf0 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f889960d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889419ccd0 con 0x7f8894100040 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f8892ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88940fecf0 0x7f88940fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f8892ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88940fecf0 0x7f88940fe740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36002/0 (socket says 172.21.15.17:36002) 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f8892ffd640 1 -- 172.21.15.17:0/2921238042 learned_addr learned my addr 172.21.15.17:0/2921238042 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:55:35.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f88927fc640 1 --2- 172.21.15.17:0/2921238042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8894100040 0x7f889419c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f8892ffd640 1 -- 172.21.15.17:0/2921238042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8894100040 msgr2=0x7f889419c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f8892ffd640 1 --2- 172.21.15.17:0/2921238042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8894100040 0x7f889419c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.061+0000 7f8892ffd640 1 -- 172.21.15.17:0/2921238042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8884009560 con 0x7f88940fecf0 2024-08-19T00:55:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.062+0000 7f8892ffd640 1 --2- 172.21.15.17:0/2921238042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88940fecf0 0x7f88940fe740 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f888402a9c0 tx=0x7f88840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.062+0000 7f887bfff640 1 -- 172.21.15.17:0/2921238042 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8884004aa0 con 0x7f88940fecf0 2024-08-19T00:55:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.062+0000 7f887bfff640 1 -- 172.21.15.17:0/2921238042 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8884004c00 con 0x7f88940fecf0 2024-08-19T00:55:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.062+0000 7f889960d640 1 -- 172.21.15.17:0/2921238042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889419cf00 con 0x7f88940fecf0 2024-08-19T00:55:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.062+0000 7f889960d640 1 -- 172.21.15.17:0/2921238042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889419d3e0 con 0x7f88940fecf0 2024-08-19T00:55:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.062+0000 7f887bfff640 1 -- 172.21.15.17:0/2921238042 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8884003b10 con 0x7f88940fecf0 2024-08-19T00:55:35.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.064+0000 7f889960d640 1 -- 172.21.15.17:0/2921238042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889418e5d0 con 0x7f88940fecf0 2024-08-19T00:55:35.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.064+0000 7f887bfff640 1 -- 172.21.15.17:0/2921238042 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8884031d20 con 0x7f88940fecf0 2024-08-19T00:55:35.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.064+0000 7f887bfff640 1 --2- 172.21.15.17:0/2921238042 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f887c06cc50 0x7f887c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:35.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.064+0000 7f887bfff640 1 -- 172.21.15.17:0/2921238042 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f88840ad3a0 con 0x7f88940fecf0 2024-08-19T00:55:35.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.065+0000 7f88927fc640 1 --2- 172.21.15.17:0/2921238042 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f887c06cc50 0x7f887c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:35.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.065+0000 7f88927fc640 1 --2- 172.21.15.17:0/2921238042 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f887c06cc50 0x7f887c06f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f88940fecc0 tx=0x7f8888005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:35.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.072+0000 7f887bfff640 1 -- 172.21.15.17:0/2921238042 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f8884077880 con 0x7f88940fecf0 2024-08-19T00:55:35.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.328+0000 7f889960d640 1 -- 172.21.15.17:0/2921238042 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f889402c4f0 con 0x7f887c06cc50 2024-08-19T00:55:35.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.330+0000 7f887bfff640 1 -- 172.21.15.17:0/2921238042 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f889402c4f0 con 0x7f887c06cc50 2024-08-19T00:55:35.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.333+0000 7f889960d640 1 -- 172.21.15.17:0/2921238042 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f887c06cc50 msgr2=0x7f887c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:35.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.333+0000 7f889960d640 1 --2- 172.21.15.17:0/2921238042 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f887c06cc50 0x7f887c06f110 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f88940fecc0 tx=0x7f8888005f90 comp rx=0 tx=0).stop 2024-08-19T00:55:35.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.333+0000 7f889960d640 1 -- 172.21.15.17:0/2921238042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88940fecf0 msgr2=0x7f88940fe740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:35.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.333+0000 7f889960d640 1 --2- 172.21.15.17:0/2921238042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88940fecf0 0x7f88940fe740 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f888402a9c0 tx=0x7f88840055a0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.333+0000 7f889960d640 1 -- 172.21.15.17:0/2921238042 shutdown_connections 2024-08-19T00:55:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.333+0000 7f889960d640 1 --2- 172.21.15.17:0/2921238042 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f887c06cc50 0x7f887c06f110 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.333+0000 7f889960d640 1 --2- 172.21.15.17:0/2921238042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8894100040 0x7f889419c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.333+0000 7f889960d640 1 --2- 172.21.15.17:0/2921238042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88940fecf0 0x7f88940fe740 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.333+0000 7f889960d640 1 -- 172.21.15.17:0/2921238042 >> 172.21.15.17:0/2921238042 conn(0x7f88940f9950 msgr2=0x7f8894103410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.333+0000 7f889960d640 1 -- 172.21.15.17:0/2921238042 shutdown_connections 2024-08-19T00:55:35.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.334+0000 7f889960d640 1 -- 172.21.15.17:0/2921238042 wait complete. 2024-08-19T00:55:35.347 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:55:35.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.452+0000 7f132a143640 1 -- 172.21.15.17:0/1945437594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1324101db0 msgr2=0x7f13241021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.452+0000 7f132a143640 1 --2- 172.21.15.17:0/1945437594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1324101db0 0x7f13241021b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1314009880 tx=0x7f131402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.452+0000 7f132a143640 1 -- 172.21.15.17:0/1945437594 shutdown_connections 2024-08-19T00:55:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.452+0000 7f132a143640 1 --2- 172.21.15.17:0/1945437594 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1324102fb0 0x7f1324103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.452+0000 7f132a143640 1 --2- 172.21.15.17:0/1945437594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1324101db0 0x7f13241021b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.452+0000 7f132a143640 1 -- 172.21.15.17:0/1945437594 >> 172.21.15.17:0/1945437594 conn(0x7f13240fd540 msgr2=0x7f13240ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.452+0000 7f132a143640 1 -- 172.21.15.17:0/1945437594 shutdown_connections 2024-08-19T00:55:35.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.453+0000 7f132a143640 1 -- 172.21.15.17:0/1945437594 wait complete. 2024-08-19T00:55:35.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.453+0000 7f132a143640 1 Processor -- start 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.454+0000 7f132a143640 1 -- start start 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.454+0000 7f132a143640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1324101db0 0x7f132419bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.454+0000 7f132a143640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1324102fb0 0x7f132419c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.454+0000 7f132a143640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132419c730 con 0x7f1324101db0 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.454+0000 7f132a143640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132419c8a0 con 0x7f1324102fb0 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.454+0000 7f13237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1324101db0 0x7f132419bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.454+0000 7f13237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1324101db0 0x7f132419bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36026/0 (socket says 172.21.15.17:36026) 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.454+0000 7f13237fe640 1 -- 172.21.15.17:0/1483096041 learned_addr learned my addr 172.21.15.17:0/1483096041 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.454+0000 7f1322ffd640 1 --2- 172.21.15.17:0/1483096041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1324102fb0 0x7f132419c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.455+0000 7f13237fe640 1 -- 172.21.15.17:0/1483096041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1324102fb0 msgr2=0x7f132419c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.455+0000 7f13237fe640 1 --2- 172.21.15.17:0/1483096041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1324102fb0 0x7f132419c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.455+0000 7f13237fe640 1 -- 172.21.15.17:0/1483096041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1314009560 con 0x7f1324101db0 2024-08-19T00:55:35.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.455+0000 7f13237fe640 1 --2- 172.21.15.17:0/1483096041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1324101db0 0x7f132419bc20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f131402a9c0 tx=0x7f13140055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.455+0000 7f1320ff9640 1 -- 172.21.15.17:0/1483096041 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1314004aa0 con 0x7f1324101db0 2024-08-19T00:55:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.455+0000 7f1320ff9640 1 -- 172.21.15.17:0/1483096041 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1314005d50 con 0x7f1324101db0 2024-08-19T00:55:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.455+0000 7f1320ff9640 1 -- 172.21.15.17:0/1483096041 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13140039e0 con 0x7f1324101db0 2024-08-19T00:55:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.455+0000 7f132a143640 1 -- 172.21.15.17:0/1483096041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13241a12d0 con 0x7f1324101db0 2024-08-19T00:55:35.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.455+0000 7f132a143640 1 -- 172.21.15.17:0/1483096041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13241a1780 con 0x7f1324101db0 2024-08-19T00:55:35.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.457+0000 7f132a143640 1 -- 172.21.15.17:0/1483096041 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132410a9a0 con 0x7f1324101db0 2024-08-19T00:55:35.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.458+0000 7f1320ff9640 1 -- 172.21.15.17:0/1483096041 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f1314031c00 con 0x7f1324101db0 2024-08-19T00:55:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.459+0000 7f1320ff9640 1 --2- 172.21.15.17:0/1483096041 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f130c06cc50 0x7f130c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.459+0000 7f1320ff9640 1 -- 172.21.15.17:0/1483096041 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f13140ad230 con 0x7f1324101db0 2024-08-19T00:55:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.459+0000 7f1322ffd640 1 --2- 172.21.15.17:0/1483096041 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f130c06cc50 0x7f130c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:35.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.460+0000 7f1322ffd640 1 --2- 172.21.15.17:0/1483096041 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f130c06cc50 0x7f130c06f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1318009bd0 tx=0x7f1318005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:35.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.466+0000 7f1320ff9640 1 -- 172.21.15.17:0/1483096041 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f13140776d0 con 0x7f1324101db0 2024-08-19T00:55:35.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:35.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:35.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:55:35.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:35 smithi086 ceph-mon[24511]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:35.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:35 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:55:35.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:35 smithi086 ceph-mon[24511]: pgmap v244: 65 pgs: 65 active+clean; 122 MiB data, 572 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 220 op/s 2024-08-19T00:55:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.737+0000 7f132a143640 1 -- 172.21.15.17:0/1483096041 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1324107760 con 0x7f130c06cc50 2024-08-19T00:55:35.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.738+0000 7f1320ff9640 1 -- 172.21.15.17:0/1483096041 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f1324107760 con 0x7f130c06cc50 2024-08-19T00:55:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.740+0000 7f132a143640 1 -- 172.21.15.17:0/1483096041 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f130c06cc50 msgr2=0x7f130c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.740+0000 7f132a143640 1 --2- 172.21.15.17:0/1483096041 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f130c06cc50 0x7f130c06f110 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1318009bd0 tx=0x7f1318005f90 comp rx=0 tx=0).stop 2024-08-19T00:55:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.740+0000 7f132a143640 1 -- 172.21.15.17:0/1483096041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1324101db0 msgr2=0x7f132419bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.740+0000 7f132a143640 1 --2- 172.21.15.17:0/1483096041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1324101db0 0x7f132419bc20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f131402a9c0 tx=0x7f13140055a0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.740+0000 7f132a143640 1 -- 172.21.15.17:0/1483096041 shutdown_connections 2024-08-19T00:55:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.740+0000 7f132a143640 1 --2- 172.21.15.17:0/1483096041 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f130c06cc50 0x7f130c06f110 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.740+0000 7f132a143640 1 --2- 172.21.15.17:0/1483096041 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1324102fb0 0x7f132419c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.740+0000 7f132a143640 1 --2- 172.21.15.17:0/1483096041 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1324101db0 0x7f132419bc20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.740+0000 7f132a143640 1 -- 172.21.15.17:0/1483096041 >> 172.21.15.17:0/1483096041 conn(0x7f13240fd540 msgr2=0x7f13240ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.740+0000 7f132a143640 1 -- 172.21.15.17:0/1483096041 shutdown_connections 2024-08-19T00:55:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.740+0000 7f132a143640 1 -- 172.21.15.17:0/1483096041 wait complete. 2024-08-19T00:55:35.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.844+0000 7f8bf9d94640 1 -- 172.21.15.17:0/2840651680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf4102fb0 msgr2=0x7f8bf41053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:35.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.844+0000 7f8bf9d94640 1 --2- 172.21.15.17:0/2840651680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf4102fb0 0x7f8bf41053a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8be80098b0 tx=0x7f8be802a4d0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.844+0000 7f8bf9d94640 1 -- 172.21.15.17:0/2840651680 shutdown_connections 2024-08-19T00:55:35.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.844+0000 7f8bf9d94640 1 --2- 172.21.15.17:0/2840651680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf4102fb0 0x7f8bf41053a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.844+0000 7f8bf9d94640 1 --2- 172.21.15.17:0/2840651680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf4100680 0x7f8bf4102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.844+0000 7f8bf9d94640 1 -- 172.21.15.17:0/2840651680 >> 172.21.15.17:0/2840651680 conn(0x7f8bf40fa280 msgr2=0x7f8bf40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.844+0000 7f8bf9d94640 1 -- 172.21.15.17:0/2840651680 shutdown_connections 2024-08-19T00:55:35.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.844+0000 7f8bf9d94640 1 -- 172.21.15.17:0/2840651680 wait complete. 2024-08-19T00:55:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.845+0000 7f8bf9d94640 1 Processor -- start 2024-08-19T00:55:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.845+0000 7f8bf9d94640 1 -- start start 2024-08-19T00:55:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.845+0000 7f8bf9d94640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf4100680 0x7f8bf41956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.845+0000 7f8bf9d94640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf4102fb0 0x7f8bf4195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.845+0000 7f8bf9d94640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf4196200 con 0x7f8bf4100680 2024-08-19T00:55:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.845+0000 7f8bf9d94640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf4196370 con 0x7f8bf4102fb0 2024-08-19T00:55:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.846+0000 7f8bf37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf4100680 0x7f8bf41956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.846+0000 7f8bf37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf4100680 0x7f8bf41956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36046/0 (socket says 172.21.15.17:36046) 2024-08-19T00:55:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.846+0000 7f8bf37fe640 1 -- 172.21.15.17:0/1810325625 learned_addr learned my addr 172.21.15.17:0/1810325625 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:55:35.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.846+0000 7f8bf2ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf4102fb0 0x7f8bf4195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.846+0000 7f8bf2ffd640 1 -- 172.21.15.17:0/1810325625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf4100680 msgr2=0x7f8bf41956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.846+0000 7f8bf2ffd640 1 --2- 172.21.15.17:0/1810325625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf4100680 0x7f8bf41956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.846+0000 7f8bf2ffd640 1 -- 172.21.15.17:0/1810325625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8009560 con 0x7f8bf4102fb0 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.846+0000 7f8bf2ffd640 1 --2- 172.21.15.17:0/1810325625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf4102fb0 0x7f8bf4195c30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009230 tx=0x7f8be80055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.847+0000 7f8bf0ff9640 1 -- 172.21.15.17:0/1810325625 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8be8004aa0 con 0x7f8bf4102fb0 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.847+0000 7f8bf9d94640 1 -- 172.21.15.17:0/1810325625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf419adb0 con 0x7f8bf4102fb0 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.847+0000 7f8bf9d94640 1 -- 172.21.15.17:0/1810325625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf419b270 con 0x7f8bf4102fb0 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.847+0000 7f8bf0ff9640 1 -- 172.21.15.17:0/1810325625 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8be8005d50 con 0x7f8bf4102fb0 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.847+0000 7f8bf0ff9640 1 -- 172.21.15.17:0/1810325625 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8be80039b0 con 0x7f8bf4102fb0 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.848+0000 7f8bf9d94640 1 -- 172.21.15.17:0/1810325625 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf41087e0 con 0x7f8bf4102fb0 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.849+0000 7f8bf0ff9640 1 -- 172.21.15.17:0/1810325625 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f8be8031c00 con 0x7f8bf4102fb0 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.849+0000 7f8bf0ff9640 1 --2- 172.21.15.17:0/1810325625 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8bdc06cc60 0x7f8bdc06f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:35.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.850+0000 7f8bf0ff9640 1 -- 172.21.15.17:0/1810325625 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8be80ad190 con 0x7f8bf4102fb0 2024-08-19T00:55:35.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.850+0000 7f8bf37fe640 1 --2- 172.21.15.17:0/1810325625 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8bdc06cc60 0x7f8bdc06f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:35.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.850+0000 7f8bf37fe640 1 --2- 172.21.15.17:0/1810325625 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8bdc06cc60 0x7f8bdc06f120 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009c90 tx=0x7f8be4005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:35.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:35.858+0000 7f8bf0ff9640 1 -- 172.21.15.17:0/1810325625 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f8be8077630 con 0x7f8bf4102fb0 2024-08-19T00:55:36.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:36.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:36.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:55:36.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:35 smithi017 ceph-mon[16627]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:36.153 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:35 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:55:36.154 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:35 smithi017 ceph-mon[16627]: pgmap v244: 65 pgs: 65 active+clean; 122 MiB data, 572 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 4.7 MiB/s wr, 220 op/s 2024-08-19T00:55:36.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.158+0000 7f8bf9d94640 1 -- 172.21.15.17:0/1810325625 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bf419b4b0 con 0x7f8bdc06cc60 2024-08-19T00:55:36.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.173+0000 7f8bf0ff9640 1 -- 172.21.15.17:0/1810325625 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3768 (secure 0 0 0) 0x7f8bf419b4b0 con 0x7f8bdc06cc60 2024-08-19T00:55:36.175 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (6m) 102s ago 7m 24.7M - 0.25.0 c8568f914cd2 eb29e4d36dfe 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (7m) 102s ago 7m 7570k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (6m) 109s ago 6m 7507k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (7m) 102s ago 7m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (6m) 109s ago 6m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (6m) 102s ago 7m 84.5M - 9.4.7 954c08fa6188 293dd58dd677 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (2m) 102s ago 2m 20.4M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (2m) 102s ago 2m 13.3M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (2m) 109s ago 2m 15.0M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (2m) 109s ago 2m 15.8M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:9283,8765,8443 running (8m) 102s ago 8m 487M - 18.2.4-721-gbaa926de e6c292a6bc95 41b04ec2a4ce 2024-08-19T00:55:36.176 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 starting - - - - 2024-08-19T00:55:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (9m) 102s ago 9m 46.2M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 771bc6b905a5 2024-08-19T00:55:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (6m) 109s ago 6m 38.0M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 c6fce0ad535d 2024-08-19T00:55:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (7m) 102s ago 7m 16.1M - 1.5.0 0da6a335fe13 33c11a243263 2024-08-19T00:55:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (6m) 109s ago 6m 16.3M - 1.5.0 0da6a335fe13 15ad23a27a0c 2024-08-19T00:55:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (5m) 102s ago 5m 54.7M 3948M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T00:55:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (5m) 102s ago 5m 54.4M 3948M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T00:55:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (4m) 102s ago 4m 46.9M 3948M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T00:55:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (4m) 109s ago 4m 54.4M 4970M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T00:55:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (4m) 109s ago 4m 52.9M 4970M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T00:55:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (3m) 109s ago 3m 44.4M 4970M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T00:55:36.177 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (5m) 102s ago 7m 54.0M - 2.43.0 a07b618ecd1d b4713fd83be3 2024-08-19T00:55:36.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.176+0000 7f8bf9d94640 1 -- 172.21.15.17:0/1810325625 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8bdc06cc60 msgr2=0x7f8bdc06f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.176+0000 7f8bf9d94640 1 --2- 172.21.15.17:0/1810325625 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8bdc06cc60 0x7f8bdc06f120 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009c90 tx=0x7f8be4005f90 comp rx=0 tx=0).stop 2024-08-19T00:55:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.176+0000 7f8bf9d94640 1 -- 172.21.15.17:0/1810325625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf4102fb0 msgr2=0x7f8bf4195c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.176+0000 7f8bf9d94640 1 --2- 172.21.15.17:0/1810325625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf4102fb0 0x7f8bf4195c30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009230 tx=0x7f8be80055a0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.176+0000 7f8bf9d94640 1 -- 172.21.15.17:0/1810325625 shutdown_connections 2024-08-19T00:55:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.176+0000 7f8bf9d94640 1 --2- 172.21.15.17:0/1810325625 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f8bdc06cc60 0x7f8bdc06f120 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.176+0000 7f8bf9d94640 1 --2- 172.21.15.17:0/1810325625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8bf4102fb0 0x7f8bf4195c30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.176+0000 7f8bf9d94640 1 --2- 172.21.15.17:0/1810325625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8bf4100680 0x7f8bf41956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.176+0000 7f8bf9d94640 1 -- 172.21.15.17:0/1810325625 >> 172.21.15.17:0/1810325625 conn(0x7f8bf40fa280 msgr2=0x7f8bf40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.177+0000 7f8bf9d94640 1 -- 172.21.15.17:0/1810325625 shutdown_connections 2024-08-19T00:55:36.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.177+0000 7f8bf9d94640 1 -- 172.21.15.17:0/1810325625 wait complete. 2024-08-19T00:55:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.293+0000 7f2f670e0640 1 -- 172.21.15.17:0/2258060361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f600744e0 msgr2=0x7f2f60072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.293+0000 7f2f670e0640 1 --2- 172.21.15.17:0/2258060361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f600744e0 0x7f2f60072940 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009880 tx=0x7f2f5402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.293+0000 7f2f670e0640 1 -- 172.21.15.17:0/2258060361 shutdown_connections 2024-08-19T00:55:36.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.293+0000 7f2f670e0640 1 --2- 172.21.15.17:0/2258060361 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f60072f10 0x7f2f60073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.293+0000 7f2f670e0640 1 --2- 172.21.15.17:0/2258060361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f600744e0 0x7f2f60072940 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.293+0000 7f2f670e0640 1 -- 172.21.15.17:0/2258060361 >> 172.21.15.17:0/2258060361 conn(0x7f2f600fb310 msgr2=0x7f2f600fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.293+0000 7f2f670e0640 1 -- 172.21.15.17:0/2258060361 shutdown_connections 2024-08-19T00:55:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.294+0000 7f2f670e0640 1 -- 172.21.15.17:0/2258060361 wait complete. 2024-08-19T00:55:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.294+0000 7f2f670e0640 1 Processor -- start 2024-08-19T00:55:36.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.294+0000 7f2f670e0640 1 -- start start 2024-08-19T00:55:36.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.294+0000 7f2f670e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f60072f10 0x7f2f601977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.294+0000 7f2f670e0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f600744e0 0x7f2f60197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.294+0000 7f2f670e0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f601982f0 con 0x7f2f60072f10 2024-08-19T00:55:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.294+0000 7f2f670e0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60198460 con 0x7f2f600744e0 2024-08-19T00:55:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.295+0000 7f2f64e7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f60072f10 0x7f2f601977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.295+0000 7f2f64e7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f60072f10 0x7f2f601977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36050/0 (socket says 172.21.15.17:36050) 2024-08-19T00:55:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.295+0000 7f2f5ffff640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f600744e0 0x7f2f60197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.295+0000 7f2f64e7c640 1 -- 172.21.15.17:0/114213544 learned_addr learned my addr 172.21.15.17:0/114213544 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:55:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.295+0000 7f2f64e7c640 1 -- 172.21.15.17:0/114213544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f600744e0 msgr2=0x7f2f60197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.295+0000 7f2f64e7c640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f600744e0 0x7f2f60197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.295+0000 7f2f64e7c640 1 -- 172.21.15.17:0/114213544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009560 con 0x7f2f60072f10 2024-08-19T00:55:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.295+0000 7f2f5ffff640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f600744e0 0x7f2f60197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:55:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.296+0000 7f2f64e7c640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f60072f10 0x7f2f601977e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2f54004650 tx=0x7f2f540055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.296+0000 7f2f5dffb640 1 -- 172.21.15.17:0/114213544 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f54004aa0 con 0x7f2f60072f10 2024-08-19T00:55:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.296+0000 7f2f5dffb640 1 -- 172.21.15.17:0/114213544 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f54005d50 con 0x7f2f60072f10 2024-08-19T00:55:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.296+0000 7f2f670e0640 1 -- 172.21.15.17:0/114213544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6019cea0 con 0x7f2f60072f10 2024-08-19T00:55:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.296+0000 7f2f5dffb640 1 -- 172.21.15.17:0/114213544 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f540039e0 con 0x7f2f60072f10 2024-08-19T00:55:36.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.296+0000 7f2f670e0640 1 -- 172.21.15.17:0/114213544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6019d390 con 0x7f2f60072f10 2024-08-19T00:55:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.297+0000 7f2f670e0640 1 -- 172.21.15.17:0/114213544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6010a960 con 0x7f2f60072f10 2024-08-19T00:55:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.298+0000 7f2f5dffb640 1 -- 172.21.15.17:0/114213544 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7f2f54031640 con 0x7f2f60072f10 2024-08-19T00:55:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.299+0000 7f2f5dffb640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f2f5006ccb0 0x7f2f5006f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.299+0000 7f2f5ffff640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f2f5006ccb0 0x7f2f5006f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:36.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.299+0000 7f2f5dffb640 1 -- 172.21.15.17:0/114213544 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2f540ad160 con 0x7f2f60072f10 2024-08-19T00:55:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.300+0000 7f2f5ffff640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f2f5006ccb0 0x7f2f5006f170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2f60198d00 tx=0x7f2f4c005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.304+0000 7f2f5dffb640 1 -- 172.21.15.17:0/114213544 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7f2f540776a0 con 0x7f2f60072f10 2024-08-19T00:55:36.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.692+0000 7f2f670e0640 1 -- 172.21.15.17:0/114213544 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2f6019d8e0 con 0x7f2f60072f10 2024-08-19T00:55:36.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.693+0000 7f2f5dffb640 1 -- 172.21.15.17:0/114213544 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f2f54031c00 con 0x7f2f60072f10 2024-08-19T00:55:36.695 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:55:36.695 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T00:55:36.695 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2 2024-08-19T00:55:36.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:55:36.695 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T00:55:36.695 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2 2024-08-19T00:55:36.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:55:36.695 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T00:55:36.695 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6 2024-08-19T00:55:36.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:55:36.696 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T00:55:36.696 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T00:55:36.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:55:36.696 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T00:55:36.696 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 14 2024-08-19T00:55:36.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T00:55:36.696 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:55:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.696+0000 7f2f670e0640 1 -- 172.21.15.17:0/114213544 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f2f5006ccb0 msgr2=0x7f2f5006f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.696+0000 7f2f670e0640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f2f5006ccb0 0x7f2f5006f170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2f60198d00 tx=0x7f2f4c005f90 comp rx=0 tx=0).stop 2024-08-19T00:55:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.696+0000 7f2f670e0640 1 -- 172.21.15.17:0/114213544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f60072f10 msgr2=0x7f2f601977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.696+0000 7f2f670e0640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f60072f10 0x7f2f601977e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2f54004650 tx=0x7f2f540055a0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.696+0000 7f2f670e0640 1 -- 172.21.15.17:0/114213544 shutdown_connections 2024-08-19T00:55:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.696+0000 7f2f670e0640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7f2f5006ccb0 0x7f2f5006f170 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.696+0000 7f2f670e0640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f600744e0 0x7f2f60197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.696+0000 7f2f670e0640 1 --2- 172.21.15.17:0/114213544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f60072f10 0x7f2f601977e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.696+0000 7f2f670e0640 1 -- 172.21.15.17:0/114213544 >> 172.21.15.17:0/114213544 conn(0x7f2f600fb310 msgr2=0x7f2f60105960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:36.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.696+0000 7f2f670e0640 1 -- 172.21.15.17:0/114213544 shutdown_connections 2024-08-19T00:55:36.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.696+0000 7f2f670e0640 1 -- 172.21.15.17:0/114213544 wait complete. 2024-08-19T00:55:36.750 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:36 smithi086 ceph-mon[24511]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:36.750 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:36 smithi086 ceph-mon[24511]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:36.750 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:36 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/114213544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:55:36.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.804+0000 7febb410d640 1 -- 172.21.15.17:0/3481587792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febac0ffcf0 msgr2=0x7febac100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:36.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.804+0000 7febb410d640 1 --2- 172.21.15.17:0/3481587792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febac0ffcf0 0x7febac100170 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009880 tx=0x7feb9c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.804+0000 7febb410d640 1 -- 172.21.15.17:0/3481587792 shutdown_connections 2024-08-19T00:55:36.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.804+0000 7febb410d640 1 --2- 172.21.15.17:0/3481587792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febac0ffcf0 0x7febac100170 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.804+0000 7febb410d640 1 --2- 172.21.15.17:0/3481587792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febac0feaf0 0x7febac0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.804+0000 7febb410d640 1 -- 172.21.15.17:0/3481587792 >> 172.21.15.17:0/3481587792 conn(0x7febac0fa280 msgr2=0x7febac0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:36.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.805+0000 7febb410d640 1 -- 172.21.15.17:0/3481587792 shutdown_connections 2024-08-19T00:55:36.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.805+0000 7febb410d640 1 -- 172.21.15.17:0/3481587792 wait complete. 2024-08-19T00:55:36.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.805+0000 7febb410d640 1 Processor -- start 2024-08-19T00:55:36.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.805+0000 7febb410d640 1 -- start start 2024-08-19T00:55:36.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.805+0000 7febb410d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febac0feaf0 0x7febac068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:36.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.805+0000 7febb410d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febac0ffcf0 0x7febac19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:36.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.805+0000 7febb410d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac19a9a0 con 0x7febac0ffcf0 2024-08-19T00:55:36.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.805+0000 7febb410d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac19aae0 con 0x7febac0feaf0 2024-08-19T00:55:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.806+0000 7febb16a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febac0ffcf0 0x7febac19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.806+0000 7febb16a8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febac0ffcf0 0x7febac19a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40202/0 (socket says 172.21.15.17:40202) 2024-08-19T00:55:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.806+0000 7febb16a8640 1 -- 172.21.15.17:0/3780141313 learned_addr learned my addr 172.21.15.17:0/3780141313 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:55:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.806+0000 7febb1ea9640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febac0feaf0 0x7febac068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.806+0000 7febb16a8640 1 -- 172.21.15.17:0/3780141313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febac0feaf0 msgr2=0x7febac068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.806+0000 7febb16a8640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febac0feaf0 0x7febac068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.806+0000 7febb16a8640 1 -- 172.21.15.17:0/3780141313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c009560 con 0x7febac0ffcf0 2024-08-19T00:55:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.806+0000 7febb1ea9640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febac0feaf0 0x7febac068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:55:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.806+0000 7febb16a8640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febac0ffcf0 0x7febac19a3d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb9c004650 tx=0x7feb9c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.806+0000 7feba2ffd640 1 -- 172.21.15.17:0/3780141313 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb9c004aa0 con 0x7febac0ffcf0 2024-08-19T00:55:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.807+0000 7febb410d640 1 -- 172.21.15.17:0/3780141313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac19ad30 con 0x7febac0ffcf0 2024-08-19T00:55:36.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.807+0000 7febb410d640 1 -- 172.21.15.17:0/3780141313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac19b220 con 0x7febac0ffcf0 2024-08-19T00:55:36.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.807+0000 7feba2ffd640 1 -- 172.21.15.17:0/3780141313 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb9c005d50 con 0x7febac0ffcf0 2024-08-19T00:55:36.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.807+0000 7feba2ffd640 1 -- 172.21.15.17:0/3780141313 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb9c003840 con 0x7febac0ffcf0 2024-08-19T00:55:36.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.808+0000 7febb410d640 1 -- 172.21.15.17:0/3780141313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb90005280 con 0x7febac0ffcf0 2024-08-19T00:55:36.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.809+0000 7feba2ffd640 1 -- 172.21.15.17:0/3780141313 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 19) v1 ==== 90850+0+0 (secure 0 0 0) 0x7feb9c004c00 con 0x7febac0ffcf0 2024-08-19T00:55:36.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.809+0000 7feba2ffd640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7feb9806cc50 0x7feb9806f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:55:36.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.810+0000 7feba2ffd640 1 -- 172.21.15.17:0/3780141313 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7feb9c0ad360 con 0x7febac0ffcf0 2024-08-19T00:55:36.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.810+0000 7febb1ea9640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7feb9806cc50 0x7feb9806f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:55:36.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.810+0000 7febb1ea9640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7feb9806cc50 0x7feb9806f110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7febac0ffb50 tx=0x7feba8005f90 comp rx=0 tx=0).ready entity=mgr.14213 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:55:36.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:36.814+0000 7feba2ffd640 1 -- 172.21.15.17:0/3780141313 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183746 (secure 0 0 0) 0x7feb9c077780 con 0x7febac0ffcf0 2024-08-19T00:55:37.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.102+0000 7febb410d640 1 -- 172.21.15.17:0/3780141313 --> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb90000bf0 con 0x7feb9806cc50 2024-08-19T00:55:37.105 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:36 smithi017 ceph-mon[16627]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:37.105 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:36 smithi017 ceph-mon[16627]: from='client.24381 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:37.105 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:36 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/114213544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:55:37.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.104+0000 7feba2ffd640 1 -- 172.21.15.17:0/3780141313 <== mgr.14213 v2:172.21.15.17:6800/3703965574 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7feb90000bf0 con 0x7feb9806cc50 2024-08-19T00:55:37.106 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:55:37.106 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T00:55:37.106 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T00:55:37.106 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-19T00:55:37.106 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [], 2024-08-19T00:55:37.106 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "", 2024-08-19T00:55:37.106 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mgr daemons", 2024-08-19T00:55:37.106 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T00:55:37.107 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:55:37.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.106+0000 7febb410d640 1 -- 172.21.15.17:0/3780141313 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7feb9806cc50 msgr2=0x7feb9806f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:37.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.106+0000 7febb410d640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7feb9806cc50 0x7feb9806f110 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7febac0ffb50 tx=0x7feba8005f90 comp rx=0 tx=0).stop 2024-08-19T00:55:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.106+0000 7febb410d640 1 -- 172.21.15.17:0/3780141313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febac0ffcf0 msgr2=0x7febac19a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:55:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.106+0000 7febb410d640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febac0ffcf0 0x7febac19a3d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb9c004650 tx=0x7feb9c0055a0 comp rx=0 tx=0).stop 2024-08-19T00:55:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.106+0000 7febb410d640 1 -- 172.21.15.17:0/3780141313 shutdown_connections 2024-08-19T00:55:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.106+0000 7febb410d640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.17:6800/3703965574,v1:172.21.15.17:6801/3703965574] conn(0x7feb9806cc50 0x7feb9806f110 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.106+0000 7febb410d640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febac0ffcf0 0x7febac19a3d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.106+0000 7febb410d640 1 --2- 172.21.15.17:0/3780141313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febac0feaf0 0x7febac068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:55:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.106+0000 7febb410d640 1 -- 172.21.15.17:0/3780141313 >> 172.21.15.17:0/3780141313 conn(0x7febac0fa280 msgr2=0x7febac1033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:55:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.106+0000 7febb410d640 1 -- 172.21.15.17:0/3780141313 shutdown_connections 2024-08-19T00:55:37.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:55:37.106+0000 7febb410d640 1 -- 172.21.15.17:0/3780141313 wait complete. 2024-08-19T00:55:38.154 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:37 smithi086 ceph-mon[24511]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:38.154 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:37 smithi086 ceph-mon[24511]: pgmap v245: 65 pgs: 65 active+clean; 128 MiB data, 601 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 208 op/s 2024-08-19T00:55:38.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:37 smithi017 ceph-mon[16627]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:55:38.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:37 smithi017 ceph-mon[16627]: pgmap v245: 65 pgs: 65 active+clean; 128 MiB data, 601 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 3.7 MiB/s wr, 208 op/s 2024-08-19T00:55:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:38 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:38 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:38 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:38 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:38 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:38 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:38 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:38 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:39.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:39 smithi086 ceph-mon[24511]: pgmap v246: 65 pgs: 65 active+clean; 135 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 204 op/s 2024-08-19T00:55:40.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:39 smithi017 ceph-mon[16627]: pgmap v246: 65 pgs: 65 active+clean; 135 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 3.6 MiB/s wr, 204 op/s 2024-08-19T00:55:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:40 smithi017 ceph-mon[16627]: Standby manager daemon smithi086.uthxct restarted 2024-08-19T00:55:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:40 smithi017 ceph-mon[16627]: Standby manager daemon smithi086.uthxct started 2024-08-19T00:55:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:40 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/crt"}]: dispatch 2024-08-19T00:55:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:40 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:55:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:40 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/key"}]: dispatch 2024-08-19T00:55:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:40 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:55:41.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:40 smithi086 ceph-mon[24511]: Standby manager daemon smithi086.uthxct restarted 2024-08-19T00:55:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:40 smithi086 ceph-mon[24511]: Standby manager daemon smithi086.uthxct started 2024-08-19T00:55:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:40 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/crt"}]: dispatch 2024-08-19T00:55:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:40 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:55:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:40 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/key"}]: dispatch 2024-08-19T00:55:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:40 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:55:42.096 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:41 smithi086 ceph-mon[24511]: mgrmap e20: smithi017.hfpawi(active, since 7m), standbys: smithi086.uthxct 2024-08-19T00:55:42.096 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:41 smithi086 ceph-mon[24511]: pgmap v247: 65 pgs: 65 active+clean; 150 MiB data, 652 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 279 op/s 2024-08-19T00:55:42.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:41 smithi017 ceph-mon[16627]: mgrmap e20: smithi017.hfpawi(active, since 7m), standbys: smithi086.uthxct 2024-08-19T00:55:42.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:41 smithi017 ceph-mon[16627]: pgmap v247: 65 pgs: 65 active+clean; 150 MiB data, 652 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 279 op/s 2024-08-19T00:55:44.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: pgmap v248: 65 pgs: 65 active+clean; 152 MiB data, 669 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 247 op/s 2024-08-19T00:55:44.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:44.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:44.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:55:44.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:55:44.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:44.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:55:44.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr fail", "who": "smithi017.hfpawi"}]: dispatch 2024-08-19T00:55:44.839 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: Activating manager daemon smithi086.uthxct 2024-08-19T00:55:44.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: osdmap e47: 6 total, 6 up, 6 in 2024-08-19T00:55:44.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "mgr fail", "who": "smithi017.hfpawi"}]': finished 2024-08-19T00:55:44.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: mgrmap e21: smithi086.uthxct(active, starting, since 0.0079727s) 2024-08-19T00:55:44.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:55:44.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:55:44.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T00:55:44.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T00:55:44.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T00:55:44.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T00:55:44.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mgr metadata", "who": "smithi086.uthxct", "id": "smithi086.uthxct"}]: dispatch 2024-08-19T00:55:44.840 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: Manager daemon smithi086.uthxct is now available 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:44.841 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:44.842 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:44.842 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:55:44.842 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:55:44.842 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi086.uthxct/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:55:44.842 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi086.uthxct/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:55:44.842 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi086.uthxct/trash_purge_schedule"}]: dispatch 2024-08-19T00:55:44.842 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:44 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi086.uthxct/trash_purge_schedule"}]: dispatch 2024-08-19T00:55:44.845 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: pgmap v248: 65 pgs: 65 active+clean; 152 MiB data, 669 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 247 op/s 2024-08-19T00:55:44.845 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:44.845 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:44.845 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:55:44.845 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:55:44.845 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' 2024-08-19T00:55:44.845 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr fail", "who": "smithi017.hfpawi"}]: dispatch 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: Activating manager daemon smithi086.uthxct 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: osdmap e47: 6 total, 6 up, 6 in 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.14213 172.21.15.17:0/1609014104' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "mgr fail", "who": "smithi017.hfpawi"}]': finished 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: mgrmap e21: smithi086.uthxct(active, starting, since 0.0079727s) 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mgr metadata", "who": "smithi086.uthxct", "id": "smithi086.uthxct"}]: dispatch 2024-08-19T00:55:44.846 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: Manager daemon smithi086.uthxct is now available 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:44.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:44.848 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:44.848 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:55:44.848 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:55:44.848 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi086.uthxct/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:55:44.848 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi086.uthxct/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:55:44.848 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi086.uthxct/trash_purge_schedule"}]: dispatch 2024-08-19T00:55:44.848 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:44 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi086.uthxct/trash_purge_schedule"}]: dispatch 2024-08-19T00:55:46.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:45 smithi017 ceph-mon[16627]: Migrating agent root cert to cert store 2024-08-19T00:55:46.167 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:45 smithi017 ceph-mon[16627]: Migrating agent root key to cert store 2024-08-19T00:55:46.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:45 smithi017 ceph-mon[16627]: Checking for cert/key for grafana.smithi017 2024-08-19T00:55:46.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:45 smithi017 ceph-mon[16627]: Migrating grafana.smithi017 cert to cert store 2024-08-19T00:55:46.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:45 smithi017 ceph-mon[16627]: Migrating grafana.smithi017 key to cert store 2024-08-19T00:55:46.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:45 smithi017 ceph-mon[16627]: mgrmap e22: smithi086.uthxct(active, since 1.01174s) 2024-08-19T00:55:46.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:45 smithi017 ceph-mon[16627]: pgmap v3: 65 pgs: 65 active+clean; 173 MiB data, 759 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:55:46.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:45 smithi017 ceph-mon[16627]: Deploying cephadm binary to smithi086 2024-08-19T00:55:46.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:45 smithi017 ceph-mon[16627]: Deploying cephadm binary to smithi017 2024-08-19T00:55:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:45 smithi086 ceph-mon[24511]: Migrating agent root cert to cert store 2024-08-19T00:55:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:45 smithi086 ceph-mon[24511]: Migrating agent root key to cert store 2024-08-19T00:55:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:45 smithi086 ceph-mon[24511]: Checking for cert/key for grafana.smithi017 2024-08-19T00:55:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:45 smithi086 ceph-mon[24511]: Migrating grafana.smithi017 cert to cert store 2024-08-19T00:55:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:45 smithi086 ceph-mon[24511]: Migrating grafana.smithi017 key to cert store 2024-08-19T00:55:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:45 smithi086 ceph-mon[24511]: mgrmap e22: smithi086.uthxct(active, since 1.01174s) 2024-08-19T00:55:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:45 smithi086 ceph-mon[24511]: pgmap v3: 65 pgs: 65 active+clean; 173 MiB data, 759 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:55:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:45 smithi086 ceph-mon[24511]: Deploying cephadm binary to smithi086 2024-08-19T00:55:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:45 smithi086 ceph-mon[24511]: Deploying cephadm binary to smithi017 2024-08-19T00:55:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:46 smithi017 ceph-mon[16627]: [19/Aug/2024:00:55:45] ENGINE Bus STARTING 2024-08-19T00:55:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:46 smithi017 ceph-mon[16627]: pgmap v4: 65 pgs: 65 active+clean; 173 MiB data, 759 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:55:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:46 smithi017 ceph-mon[16627]: [19/Aug/2024:00:55:45] ENGINE Serving on https://172.21.15.86:7150 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:46 smithi017 ceph-mon[16627]: [19/Aug/2024:00:55:45] ENGINE Error in HTTPServer.serve 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Traceback (most recent call last): 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._run(expiration_interval) 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:55:47.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s = self.context.wrap_socket( 2024-08-19T00:55:47.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:55:47.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: return self.sslsocket_class._create( 2024-08-19T00:55:47.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:55:47.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self.do_handshake() 2024-08-19T00:55:47.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:55:47.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._sslobj.do_handshake() 2024-08-19T00:55:47.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:55:47.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:46 smithi017 ceph-mon[16627]: [19/Aug/2024:00:55:46] ENGINE Serving on http://172.21.15.86:8765 2024-08-19T00:55:47.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:46 smithi017 ceph-mon[16627]: [19/Aug/2024:00:55:46] ENGINE Bus STARTED 2024-08-19T00:55:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:46 smithi086 ceph-mon[24511]: [19/Aug/2024:00:55:45] ENGINE Bus STARTING 2024-08-19T00:55:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:46 smithi086 ceph-mon[24511]: pgmap v4: 65 pgs: 65 active+clean; 173 MiB data, 759 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:55:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:46 smithi086 ceph-mon[24511]: [19/Aug/2024:00:55:45] ENGINE Serving on https://172.21.15.86:7150 2024-08-19T00:55:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:46 smithi086 ceph-mon[24511]: [19/Aug/2024:00:55:45] ENGINE Error in HTTPServer.serve 2024-08-19T00:55:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Traceback (most recent call last): 2024-08-19T00:55:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:55:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:55:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:55:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self._run(expiration_interval) 2024-08-19T00:55:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: s = self.context.wrap_socket( 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: return self.sslsocket_class._create( 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self.do_handshake() 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self._sslobj.do_handshake() 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:46 smithi086 ceph-mon[24511]: [19/Aug/2024:00:55:46] ENGINE Serving on http://172.21.15.86:8765 2024-08-19T00:55:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:46 smithi086 ceph-mon[24511]: [19/Aug/2024:00:55:46] ENGINE Bus STARTED 2024-08-19T00:55:47.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:47 smithi086 ceph-mon[24511]: mgrmap e23: smithi086.uthxct(active, since 3s) 2024-08-19T00:55:48.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:47 smithi017 ceph-mon[16627]: mgrmap e23: smithi086.uthxct(active, since 3s) 2024-08-19T00:55:49.170 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:48 smithi017 ceph-mon[16627]: pgmap v5: 65 pgs: 65 active+clean; 173 MiB data, 759 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:55:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:48 smithi086 ceph-mon[24511]: pgmap v5: 65 pgs: 65 active+clean; 173 MiB data, 759 MiB used, 536 GiB / 536 GiB avail 2024-08-19T00:55:50.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:49 smithi017 ceph-mon[16627]: mgrmap e24: smithi086.uthxct(active, since 5s) 2024-08-19T00:55:50.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:49 smithi086 ceph-mon[24511]: mgrmap e24: smithi086.uthxct(active, since 5s) 2024-08-19T00:55:51.342 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:51 smithi086 ceph-mon[24511]: pgmap v6: 65 pgs: 65 active+clean; 175 MiB data, 760 MiB used, 536 GiB / 536 GiB avail; 1.0 KiB/s rd, 478 KiB/s wr, 92 op/s 2024-08-19T00:55:51.342 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:51 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:51.342 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:51 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:51.342 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:51 smithi086 ceph-mon[24511]: Standby manager daemon smithi017.hfpawi started 2024-08-19T00:55:51.342 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:51 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.17:0/1124135668' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.hfpawi/crt"}]: dispatch 2024-08-19T00:55:51.342 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:51 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.17:0/1124135668' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:55:51.342 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:51 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.17:0/1124135668' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.hfpawi/key"}]: dispatch 2024-08-19T00:55:51.342 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:51 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.17:0/1124135668' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:55:51.343 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:51 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:51.343 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:51 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:51.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:51 smithi017 ceph-mon[16627]: pgmap v6: 65 pgs: 65 active+clean; 175 MiB data, 760 MiB used, 536 GiB / 536 GiB avail; 1.0 KiB/s rd, 478 KiB/s wr, 92 op/s 2024-08-19T00:55:51.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:51 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:51.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:51 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:51.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:51 smithi017 ceph-mon[16627]: Standby manager daemon smithi017.hfpawi started 2024-08-19T00:55:51.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:51 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.17:0/1124135668' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.hfpawi/crt"}]: dispatch 2024-08-19T00:55:51.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:51 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.17:0/1124135668' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:55:51.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:51 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.17:0/1124135668' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.hfpawi/key"}]: dispatch 2024-08-19T00:55:51.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:51 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.17:0/1124135668' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:55:51.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:51 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:51.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:51 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:51.639 INFO:tasks.workunit.client.1.smithi086.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-08-19T00:55:51.643 INFO:tasks.workunit.client.1.smithi086.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-19T00:55:51.644 INFO:tasks.workunit.client.1.smithi086.stderr:+ make 2024-08-19T00:55:52.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:52 smithi086 ceph-mon[24511]: mgrmap e25: smithi086.uthxct(active, since 7s), standbys: smithi017.hfpawi 2024-08-19T00:55:52.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:52 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mgr metadata", "who": "smithi017.hfpawi", "id": "smithi017.hfpawi"}]: dispatch 2024-08-19T00:55:52.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:52 smithi017 ceph-mon[16627]: mgrmap e25: smithi086.uthxct(active, since 7s), standbys: smithi017.hfpawi 2024-08-19T00:55:52.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:52 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mgr metadata", "who": "smithi017.hfpawi", "id": "smithi017.hfpawi"}]: dispatch 2024-08-19T00:55:52.623 INFO:tasks.workunit.client.1.smithi086.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-08-19T00:55:53.269 INFO:tasks.workunit.client.1.smithi086.stderr:++ readlink -f fsstress 2024-08-19T00:55:53.270 INFO:tasks.workunit.client.1.smithi086.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-08-19T00:55:53.271 INFO:tasks.workunit.client.1.smithi086.stderr:+ popd 2024-08-19T00:55:53.271 INFO:tasks.workunit.client.1.smithi086.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-08-19T00:55:53.271 INFO:tasks.workunit.client.1.smithi086.stderr:+ popd 2024-08-19T00:55:53.272 INFO:tasks.workunit.client.1.smithi086.stdout:~/cephtest/mnt.1/client.1/tmp 2024-08-19T00:55:53.272 INFO:tasks.workunit.client.1.smithi086.stderr:++ mktemp -d -p . 2024-08-19T00:55:53.288 INFO:tasks.workunit.client.1.smithi086.stderr:+ T=./tmp.g6vnd3v2ps 2024-08-19T00:55:53.288 INFO:tasks.workunit.client.1.smithi086.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.g6vnd3v2ps -l 1 -n 1000 -p 10 -v 2024-08-19T00:55:53.294 INFO:tasks.workunit.client.1.smithi086.stdout:seed = 1724310404 2024-08-19T00:55:53.299 INFO:tasks.workunit.client.1.smithi086.stdout:0/0: dwrite - no filename 2024-08-19T00:55:53.304 INFO:tasks.workunit.client.1.smithi086.stdout:2/0: fsync - no filename 2024-08-19T00:55:53.304 INFO:tasks.workunit.client.1.smithi086.stdout:2/1: stat - no entries 2024-08-19T00:55:53.304 INFO:tasks.workunit.client.1.smithi086.stdout:2/2: truncate - no filename 2024-08-19T00:55:53.305 INFO:tasks.workunit.client.1.smithi086.stdout:0/1: symlink l0 0 2024-08-19T00:55:53.306 INFO:tasks.workunit.client.1.smithi086.stdout:0/2: dwrite - no filename 2024-08-19T00:55:53.306 INFO:tasks.workunit.client.1.smithi086.stdout:0/3: dread - no filename 2024-08-19T00:55:53.307 INFO:tasks.workunit.client.1.smithi086.stdout:3/0: chown . 14461 1 2024-08-19T00:55:53.307 INFO:tasks.workunit.client.1.smithi086.stdout:3/1: write - no filename 2024-08-19T00:55:53.309 INFO:tasks.workunit.client.1.smithi086.stdout:1/0: creat f0 x:0 0 0 2024-08-19T00:55:53.310 INFO:tasks.workunit.client.1.smithi086.stdout:0/4: symlink l1 0 2024-08-19T00:55:53.311 INFO:tasks.workunit.client.1.smithi086.stdout:0/5: read - no filename 2024-08-19T00:55:53.311 INFO:tasks.workunit.client.1.smithi086.stdout:0/6: write - no filename 2024-08-19T00:55:53.311 INFO:tasks.workunit.client.1.smithi086.stdout:0/7: truncate - no filename 2024-08-19T00:55:53.311 INFO:tasks.workunit.client.1.smithi086.stdout:0/8: fdatasync - no filename 2024-08-19T00:55:53.313 INFO:tasks.workunit.client.1.smithi086.stdout:4/0: dread - no filename 2024-08-19T00:55:53.314 INFO:tasks.workunit.client.1.smithi086.stdout:2/3: getdents . 0 2024-08-19T00:55:53.314 INFO:tasks.workunit.client.1.smithi086.stdout:2/4: unlink - no file 2024-08-19T00:55:53.314 INFO:tasks.workunit.client.1.smithi086.stdout:2/5: dwrite - no filename 2024-08-19T00:55:53.315 INFO:tasks.workunit.client.1.smithi086.stdout:2/6: dwrite - no filename 2024-08-19T00:55:53.315 INFO:tasks.workunit.client.1.smithi086.stdout:0/9: rename l1 to l2 0 2024-08-19T00:55:53.316 INFO:tasks.workunit.client.1.smithi086.stdout:0/10: dwrite - no filename 2024-08-19T00:55:53.316 INFO:tasks.workunit.client.1.smithi086.stdout:0/11: rmdir - no directory 2024-08-19T00:55:53.316 INFO:tasks.workunit.client.1.smithi086.stdout:0/12: dwrite - no filename 2024-08-19T00:55:53.317 INFO:tasks.workunit.client.1.smithi086.stdout:1/1: dwrite f0 [0,4194304] 0 2024-08-19T00:55:53.318 INFO:tasks.workunit.client.1.smithi086.stdout:5/0: dread - no filename 2024-08-19T00:55:53.318 INFO:tasks.workunit.client.1.smithi086.stdout:3/2: symlink l0 0 2024-08-19T00:55:53.318 INFO:tasks.workunit.client.1.smithi086.stdout:3/3: fdatasync - no filename 2024-08-19T00:55:53.319 INFO:tasks.workunit.client.1.smithi086.stdout:3/4: write - no filename 2024-08-19T00:55:53.319 INFO:tasks.workunit.client.1.smithi086.stdout:3/5: dwrite - no filename 2024-08-19T00:55:53.319 INFO:tasks.workunit.client.1.smithi086.stdout:5/1: chown . 0 1 2024-08-19T00:55:53.319 INFO:tasks.workunit.client.1.smithi086.stdout:5/2: truncate - no filename 2024-08-19T00:55:53.319 INFO:tasks.workunit.client.1.smithi086.stdout:5/3: unlink - no file 2024-08-19T00:55:53.319 INFO:tasks.workunit.client.1.smithi086.stdout:5/4: dwrite - no filename 2024-08-19T00:55:53.326 INFO:tasks.workunit.client.1.smithi086.stdout:6/0: read - no filename 2024-08-19T00:55:53.332 INFO:tasks.workunit.client.1.smithi086.stdout:4/1: mknod c0 0 2024-08-19T00:55:53.332 INFO:tasks.workunit.client.1.smithi086.stdout:4/2: fsync - no filename 2024-08-19T00:55:53.333 INFO:tasks.workunit.client.1.smithi086.stdout:2/7: creat f0 x:0 0 0 2024-08-19T00:55:53.335 INFO:tasks.workunit.client.1.smithi086.stdout:7/0: rename - no filename 2024-08-19T00:55:53.335 INFO:tasks.workunit.client.1.smithi086.stdout:7/1: chown . 90159 1 2024-08-19T00:55:53.340 INFO:tasks.workunit.client.1.smithi086.stdout:2/8: symlink l1 0 2024-08-19T00:55:53.343 INFO:tasks.workunit.client.1.smithi086.stdout:8/0: unlink - no file 2024-08-19T00:55:53.343 INFO:tasks.workunit.client.1.smithi086.stdout:8/1: dread - no filename 2024-08-19T00:55:53.344 INFO:tasks.workunit.client.1.smithi086.stdout:6/1: mknod c0 0 2024-08-19T00:55:53.345 INFO:tasks.workunit.client.1.smithi086.stdout:6/2: write - no filename 2024-08-19T00:55:53.348 INFO:tasks.workunit.client.1.smithi086.stdout:2/9: dwrite f0 [0,4194304] 0 2024-08-19T00:55:53.349 INFO:tasks.workunit.client.1.smithi086.stdout:9/0: rename - no filename 2024-08-19T00:55:53.349 INFO:tasks.workunit.client.1.smithi086.stdout:9/1: readlink - no filename 2024-08-19T00:55:53.349 INFO:tasks.workunit.client.1.smithi086.stdout:9/2: dread - no filename 2024-08-19T00:55:53.349 INFO:tasks.workunit.client.1.smithi086.stdout:9/3: chown . 195246 1 2024-08-19T00:55:53.350 INFO:tasks.workunit.client.1.smithi086.stdout:9/4: dread - no filename 2024-08-19T00:55:53.350 INFO:tasks.workunit.client.1.smithi086.stdout:9/5: dwrite - no filename 2024-08-19T00:55:53.350 INFO:tasks.workunit.client.1.smithi086.stdout:7/2: creat f0 x:0 0 0 2024-08-19T00:55:53.351 INFO:tasks.workunit.client.1.smithi086.stdout:7/3: truncate f0 126183 0 2024-08-19T00:55:53.351 INFO:tasks.workunit.client.1.smithi086.stdout:7/4: write f0 [851658,23711] 0 2024-08-19T00:55:53.355 INFO:tasks.workunit.client.1.smithi086.stdout:6/3: symlink l1 0 2024-08-19T00:55:53.355 INFO:tasks.workunit.client.1.smithi086.stdout:6/4: fsync - no filename 2024-08-19T00:55:53.357 INFO:tasks.workunit.client.1.smithi086.stdout:6/5: chown l1 167600 1 2024-08-19T00:55:53.357 INFO:tasks.workunit.client.1.smithi086.stdout:6/6: dwrite - no filename 2024-08-19T00:55:53.358 INFO:tasks.workunit.client.1.smithi086.stdout:4/3: link c0 c1 0 2024-08-19T00:55:53.358 INFO:tasks.workunit.client.1.smithi086.stdout:4/4: read - no filename 2024-08-19T00:55:53.358 INFO:tasks.workunit.client.1.smithi086.stdout:4/5: dread - no filename 2024-08-19T00:55:53.361 INFO:tasks.workunit.client.1.smithi086.stdout:7/5: dwrite f0 [0,4194304] 0 2024-08-19T00:55:53.365 INFO:tasks.workunit.client.1.smithi086.stdout:7/6: dread f0 [0,4194304] 0 2024-08-19T00:55:53.366 INFO:tasks.workunit.client.1.smithi086.stdout:8/2: mknod c0 0 2024-08-19T00:55:53.366 INFO:tasks.workunit.client.1.smithi086.stdout:8/3: write - no filename 2024-08-19T00:55:53.370 INFO:tasks.workunit.client.1.smithi086.stdout:6/7: mknod c2 0 2024-08-19T00:55:53.370 INFO:tasks.workunit.client.1.smithi086.stdout:6/8: readlink l1 0 2024-08-19T00:55:53.371 INFO:tasks.workunit.client.1.smithi086.stdout:4/6: mkdir d2 0 2024-08-19T00:55:53.371 INFO:tasks.workunit.client.1.smithi086.stdout:4/7: fdatasync - no filename 2024-08-19T00:55:53.374 INFO:tasks.workunit.client.1.smithi086.stdout:9/6: creat f0 x:0 0 0 2024-08-19T00:55:53.378 INFO:tasks.workunit.client.1.smithi086.stdout:8/4: creat f1 x:0 0 0 2024-08-19T00:55:53.379 INFO:tasks.workunit.client.1.smithi086.stdout:6/9: creat f3 x:0 0 0 2024-08-19T00:55:53.381 INFO:tasks.workunit.client.1.smithi086.stdout:6/10: write f3 [791012,71285] 0 2024-08-19T00:55:53.384 INFO:tasks.workunit.client.1.smithi086.stdout:7/7: rename f0 to f1 0 2024-08-19T00:55:53.384 INFO:tasks.workunit.client.1.smithi086.stdout:9/7: dwrite f0 [0,4194304] 0 2024-08-19T00:55:53.386 INFO:tasks.workunit.client.1.smithi086.stdout:9/8: write f0 [705958,71374] 0 2024-08-19T00:55:53.386 INFO:tasks.workunit.client.1.smithi086.stdout:4/8: mkdir d2/d3 0 2024-08-19T00:55:53.387 INFO:tasks.workunit.client.1.smithi086.stdout:4/9: write - no filename 2024-08-19T00:55:53.387 INFO:tasks.workunit.client.1.smithi086.stdout:4/10: rename d2 to d2/d3/d4 22 2024-08-19T00:55:53.392 INFO:tasks.workunit.client.1.smithi086.stdout:7/8: write f1 [3924048,75298] 0 2024-08-19T00:55:53.394 INFO:tasks.workunit.client.1.smithi086.stdout:7/9: write f1 [1961992,117294] 0 2024-08-19T00:55:53.394 INFO:tasks.workunit.client.1.smithi086.stdout:9/9: creat f1 x:0 0 0 2024-08-19T00:55:53.396 INFO:tasks.workunit.client.1.smithi086.stdout:4/11: creat d2/f5 x:0 0 0 2024-08-19T00:55:53.398 INFO:tasks.workunit.client.1.smithi086.stdout:4/12: dread - d2/f5 zero size 2024-08-19T00:55:53.399 INFO:tasks.workunit.client.1.smithi086.stdout:4/13: dread - d2/f5 zero size 2024-08-19T00:55:53.402 INFO:tasks.workunit.client.1.smithi086.stdout:7/10: dread f1 [0,4194304] 0 2024-08-19T00:55:53.405 INFO:tasks.workunit.client.1.smithi086.stdout:9/10: dwrite f1 [0,4194304] 0 2024-08-19T00:55:53.405 INFO:tasks.workunit.client.1.smithi086.stdout:9/11: read f0 [2253090,29227] 0 2024-08-19T00:55:53.408 INFO:tasks.workunit.client.1.smithi086.stdout:4/14: creat d2/d3/f6 x:0 0 0 2024-08-19T00:55:53.409 INFO:tasks.workunit.client.1.smithi086.stdout:4/15: truncate d2/d3/f6 363764 0 2024-08-19T00:55:53.411 INFO:tasks.workunit.client.1.smithi086.stdout:7/11: link f1 f2 0 2024-08-19T00:55:53.419 INFO:tasks.workunit.client.1.smithi086.stdout:7/12: mkdir d3 0 2024-08-19T00:55:53.419 INFO:tasks.workunit.client.1.smithi086.stdout:4/16: dwrite d2/f5 [0,4194304] 0 2024-08-19T00:55:53.420 INFO:tasks.workunit.client.1.smithi086.stdout:4/17: dread d2/d3/f6 [0,4194304] 0 2024-08-19T00:55:53.428 INFO:tasks.workunit.client.1.smithi086.stdout:4/18: dread d2/f5 [0,4194304] 0 2024-08-19T00:55:53.428 INFO:tasks.workunit.client.1.smithi086.stdout:7/13: dwrite f1 [0,4194304] 0 2024-08-19T00:55:53.428 INFO:tasks.workunit.client.1.smithi086.stdout:7/14: chown f2 1059901 1 2024-08-19T00:55:53.432 INFO:tasks.workunit.client.1.smithi086.stdout:7/15: dread f2 [0,4194304] 0 2024-08-19T00:55:53.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:53 smithi017 ceph-mon[16627]: pgmap v7: 65 pgs: 65 active+clean; 193 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 275 op/s 2024-08-19T00:55:53.439 INFO:tasks.workunit.client.1.smithi086.stdout:7/16: dwrite f2 [0,4194304] 0 2024-08-19T00:55:53.443 INFO:tasks.workunit.client.1.smithi086.stdout:7/17: creat d3/f4 x:0 0 0 2024-08-19T00:55:53.444 INFO:tasks.workunit.client.1.smithi086.stdout:7/18: write f2 [3545145,44464] 0 2024-08-19T00:55:53.445 INFO:tasks.workunit.client.1.smithi086.stdout:7/19: write d3/f4 [73673,62707] 0 2024-08-19T00:55:53.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:53 smithi086 ceph-mon[24511]: pgmap v7: 65 pgs: 65 active+clean; 193 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 275 op/s 2024-08-19T00:55:53.446 INFO:tasks.workunit.client.1.smithi086.stdout:7/20: chown d3/f4 283 1 2024-08-19T00:55:53.469 INFO:tasks.workunit.client.1.smithi086.stdout:1/2: fsync f0 0 2024-08-19T00:55:53.471 INFO:tasks.workunit.client.1.smithi086.stdout:1/3: symlink l1 0 2024-08-19T00:55:53.475 INFO:tasks.workunit.client.1.smithi086.stdout:1/4: dread f0 [0,4194304] 0 2024-08-19T00:55:53.475 INFO:tasks.workunit.client.1.smithi086.stdout:1/5: chown l1 205214 1 2024-08-19T00:55:53.476 INFO:tasks.workunit.client.1.smithi086.stdout:0/13: rename l2 to l3 0 2024-08-19T00:55:53.476 INFO:tasks.workunit.client.1.smithi086.stdout:0/14: fsync - no filename 2024-08-19T00:55:53.477 INFO:tasks.workunit.client.1.smithi086.stdout:3/6: getdents . 0 2024-08-19T00:55:53.477 INFO:tasks.workunit.client.1.smithi086.stdout:3/7: readlink l0 0 2024-08-19T00:55:53.477 INFO:tasks.workunit.client.1.smithi086.stdout:3/8: write - no filename 2024-08-19T00:55:53.478 INFO:tasks.workunit.client.1.smithi086.stdout:1/6: rename f0 to f2 0 2024-08-19T00:55:53.481 INFO:tasks.workunit.client.1.smithi086.stdout:0/15: rename l0 to l4 0 2024-08-19T00:55:53.481 INFO:tasks.workunit.client.1.smithi086.stdout:0/16: dwrite - no filename 2024-08-19T00:55:53.481 INFO:tasks.workunit.client.1.smithi086.stdout:0/17: write - no filename 2024-08-19T00:55:53.482 INFO:tasks.workunit.client.1.smithi086.stdout:1/7: dread f2 [0,4194304] 0 2024-08-19T00:55:53.483 INFO:tasks.workunit.client.1.smithi086.stdout:3/9: mknod c1 0 2024-08-19T00:55:53.483 INFO:tasks.workunit.client.1.smithi086.stdout:3/10: dwrite - no filename 2024-08-19T00:55:53.483 INFO:tasks.workunit.client.1.smithi086.stdout:3/11: dwrite - no filename 2024-08-19T00:55:53.491 INFO:tasks.workunit.client.1.smithi086.stdout:2/10: getdents . 0 2024-08-19T00:55:53.491 INFO:tasks.workunit.client.1.smithi086.stdout:2/11: write f0 [621794,82050] 0 2024-08-19T00:55:53.503 INFO:tasks.workunit.client.1.smithi086.stdout:9/12: fsync f0 0 2024-08-19T00:55:53.503 INFO:tasks.workunit.client.1.smithi086.stdout:9/13: readlink - no filename 2024-08-19T00:55:53.504 INFO:tasks.workunit.client.1.smithi086.stdout:9/14: creat f2 x:0 0 0 2024-08-19T00:55:53.506 INFO:tasks.workunit.client.1.smithi086.stdout:9/15: symlink l3 0 2024-08-19T00:55:53.507 INFO:tasks.workunit.client.1.smithi086.stdout:9/16: truncate f2 440778 0 2024-08-19T00:55:53.507 INFO:tasks.workunit.client.1.smithi086.stdout:6/11: fsync f3 0 2024-08-19T00:55:53.507 INFO:tasks.workunit.client.1.smithi086.stdout:6/12: truncate f3 1528968 0 2024-08-19T00:55:53.507 INFO:tasks.workunit.client.1.smithi086.stdout:6/13: chown l1 5067 1 2024-08-19T00:55:53.508 INFO:tasks.workunit.client.1.smithi086.stdout:9/17: creat f4 x:0 0 0 2024-08-19T00:55:53.509 INFO:tasks.workunit.client.1.smithi086.stdout:9/18: rmdir - no directory 2024-08-19T00:55:53.515 INFO:tasks.workunit.client.1.smithi086.stdout:6/14: dwrite f3 [0,4194304] 0 2024-08-19T00:55:53.518 INFO:tasks.workunit.client.1.smithi086.stdout:6/15: unlink c0 0 2024-08-19T00:55:53.518 INFO:tasks.workunit.client.1.smithi086.stdout:6/16: write f3 [2224277,40475] 0 2024-08-19T00:55:53.520 INFO:tasks.workunit.client.1.smithi086.stdout:6/17: creat f4 x:0 0 0 2024-08-19T00:55:53.526 INFO:tasks.workunit.client.1.smithi086.stdout:9/19: write f1 [4344017,31960] 0 2024-08-19T00:55:53.526 INFO:tasks.workunit.client.1.smithi086.stdout:9/20: chown l3 2327 1 2024-08-19T00:55:53.526 INFO:tasks.workunit.client.1.smithi086.stdout:9/21: fdatasync f4 0 2024-08-19T00:55:53.528 INFO:tasks.workunit.client.1.smithi086.stdout:9/22: creat f5 x:0 0 0 2024-08-19T00:55:53.529 INFO:tasks.workunit.client.1.smithi086.stdout:9/23: dread - f4 zero size 2024-08-19T00:55:53.538 INFO:tasks.workunit.client.1.smithi086.stdout:7/21: rmdir d3 39 2024-08-19T00:55:53.541 INFO:tasks.workunit.client.1.smithi086.stdout:7/22: dread f1 [0,4194304] 0 2024-08-19T00:55:53.542 INFO:tasks.workunit.client.1.smithi086.stdout:7/23: stat d3/f4 0 2024-08-19T00:55:53.542 INFO:tasks.workunit.client.1.smithi086.stdout:7/24: chown d3 1 1 2024-08-19T00:55:53.545 INFO:tasks.workunit.client.1.smithi086.stdout:7/25: rename d3/f4 to d3/f5 0 2024-08-19T00:55:53.548 INFO:tasks.workunit.client.1.smithi086.stdout:7/26: unlink f1 0 2024-08-19T00:55:53.550 INFO:tasks.workunit.client.1.smithi086.stdout:7/27: symlink d3/l6 0 2024-08-19T00:55:53.553 INFO:tasks.workunit.client.1.smithi086.stdout:0/18: readlink l4 0 2024-08-19T00:55:53.553 INFO:tasks.workunit.client.1.smithi086.stdout:0/19: fsync - no filename 2024-08-19T00:55:53.553 INFO:tasks.workunit.client.1.smithi086.stdout:0/20: write - no filename 2024-08-19T00:55:53.555 INFO:tasks.workunit.client.1.smithi086.stdout:0/21: symlink l5 0 2024-08-19T00:55:53.555 INFO:tasks.workunit.client.1.smithi086.stdout:1/8: truncate f2 1177769 0 2024-08-19T00:55:53.556 INFO:tasks.workunit.client.1.smithi086.stdout:0/22: creat f6 x:0 0 0 2024-08-19T00:55:53.558 INFO:tasks.workunit.client.1.smithi086.stdout:0/23: stat l3 0 2024-08-19T00:55:53.565 INFO:tasks.workunit.client.1.smithi086.stdout:0/24: dwrite f6 [0,4194304] 0 2024-08-19T00:55:53.567 INFO:tasks.workunit.client.1.smithi086.stdout:0/25: mknod c7 0 2024-08-19T00:55:53.569 INFO:tasks.workunit.client.1.smithi086.stdout:0/26: symlink l8 0 2024-08-19T00:55:53.570 INFO:tasks.workunit.client.1.smithi086.stdout:6/18: getdents . 0 2024-08-19T00:55:53.570 INFO:tasks.workunit.client.1.smithi086.stdout:6/19: write f4 [73903,108799] 0 2024-08-19T00:55:53.574 INFO:tasks.workunit.client.1.smithi086.stdout:6/20: rename c2 to c5 0 2024-08-19T00:55:53.577 INFO:tasks.workunit.client.1.smithi086.stdout:6/21: rename f4 to f6 0 2024-08-19T00:55:53.580 INFO:tasks.workunit.client.1.smithi086.stdout:7/28: unlink d3/f5 0 2024-08-19T00:55:53.583 INFO:tasks.workunit.client.1.smithi086.stdout:7/29: creat d3/f7 x:0 0 0 2024-08-19T00:55:53.585 INFO:tasks.workunit.client.1.smithi086.stdout:7/30: symlink d3/l8 0 2024-08-19T00:55:53.589 INFO:tasks.workunit.client.1.smithi086.stdout:0/27: fdatasync f6 0 2024-08-19T00:55:53.593 INFO:tasks.workunit.client.1.smithi086.stdout:7/31: rename d3/l8 to d3/l9 0 2024-08-19T00:55:53.594 INFO:tasks.workunit.client.1.smithi086.stdout:7/32: chown d3 13571552 1 2024-08-19T00:55:53.595 INFO:tasks.workunit.client.1.smithi086.stdout:0/28: dread f6 [0,4194304] 0 2024-08-19T00:55:53.595 INFO:tasks.workunit.client.1.smithi086.stdout:0/29: truncate f6 4490839 0 2024-08-19T00:55:53.596 INFO:tasks.workunit.client.1.smithi086.stdout:0/30: fsync f6 0 2024-08-19T00:55:53.596 INFO:tasks.workunit.client.1.smithi086.stdout:0/31: chown l5 696 1 2024-08-19T00:55:53.597 INFO:tasks.workunit.client.1.smithi086.stdout:7/33: symlink d3/la 0 2024-08-19T00:55:53.598 INFO:tasks.workunit.client.1.smithi086.stdout:0/32: symlink l9 0 2024-08-19T00:55:53.600 INFO:tasks.workunit.client.1.smithi086.stdout:0/33: mkdir da 0 2024-08-19T00:55:53.603 INFO:tasks.workunit.client.1.smithi086.stdout:6/22: getdents . 0 2024-08-19T00:55:53.604 INFO:tasks.workunit.client.1.smithi086.stdout:0/34: rename c7 to da/cb 0 2024-08-19T00:55:53.607 INFO:tasks.workunit.client.1.smithi086.stdout:0/35: rename l8 to da/lc 0 2024-08-19T00:55:53.608 INFO:tasks.workunit.client.1.smithi086.stdout:6/23: getdents . 0 2024-08-19T00:55:53.609 INFO:tasks.workunit.client.1.smithi086.stdout:6/24: fsync f3 0 2024-08-19T00:55:53.609 INFO:tasks.workunit.client.1.smithi086.stdout:6/25: write f3 [3364954,118399] 0 2024-08-19T00:55:53.611 INFO:tasks.workunit.client.1.smithi086.stdout:0/36: creat da/fd x:0 0 0 2024-08-19T00:55:53.613 INFO:tasks.workunit.client.1.smithi086.stdout:6/26: mknod c7 0 2024-08-19T00:55:53.614 INFO:tasks.workunit.client.1.smithi086.stdout:6/27: rmdir - no directory 2024-08-19T00:55:53.615 INFO:tasks.workunit.client.1.smithi086.stdout:0/37: unlink l3 0 2024-08-19T00:55:53.615 INFO:tasks.workunit.client.1.smithi086.stdout:6/28: fdatasync f3 0 2024-08-19T00:55:53.616 INFO:tasks.workunit.client.1.smithi086.stdout:6/29: stat c5 0 2024-08-19T00:55:53.617 INFO:tasks.workunit.client.1.smithi086.stdout:7/34: dread f2 [0,4194304] 0 2024-08-19T00:55:53.618 INFO:tasks.workunit.client.1.smithi086.stdout:1/9: dwrite f2 [0,4194304] 0 2024-08-19T00:55:53.618 INFO:tasks.workunit.client.1.smithi086.stdout:0/38: write f6 [593029,16242] 0 2024-08-19T00:55:53.619 INFO:tasks.workunit.client.1.smithi086.stdout:6/30: creat f8 x:0 0 0 2024-08-19T00:55:53.619 INFO:tasks.workunit.client.1.smithi086.stdout:6/31: chown f8 194811911 1 2024-08-19T00:55:53.620 INFO:tasks.workunit.client.1.smithi086.stdout:6/32: dread - f8 zero size 2024-08-19T00:55:53.622 INFO:tasks.workunit.client.1.smithi086.stdout:1/10: mknod c3 0 2024-08-19T00:55:53.624 INFO:tasks.workunit.client.1.smithi086.stdout:1/11: read f2 [1635464,26486] 0 2024-08-19T00:55:53.624 INFO:tasks.workunit.client.1.smithi086.stdout:0/39: creat da/fe x:0 0 0 2024-08-19T00:55:53.625 INFO:tasks.workunit.client.1.smithi086.stdout:6/33: symlink l9 0 2024-08-19T00:55:53.626 INFO:tasks.workunit.client.1.smithi086.stdout:0/40: write da/fe [132449,81927] 0 2024-08-19T00:55:53.631 INFO:tasks.workunit.client.1.smithi086.stdout:6/34: unlink l1 0 2024-08-19T00:55:53.632 INFO:tasks.workunit.client.1.smithi086.stdout:7/35: dwrite f2 [0,4194304] 0 2024-08-19T00:55:53.634 INFO:tasks.workunit.client.1.smithi086.stdout:6/35: symlink la 0 2024-08-19T00:55:53.636 INFO:tasks.workunit.client.1.smithi086.stdout:7/36: write d3/f7 [761011,97089] 0 2024-08-19T00:55:53.638 INFO:tasks.workunit.client.1.smithi086.stdout:1/12: dwrite f2 [0,4194304] 0 2024-08-19T00:55:53.638 INFO:tasks.workunit.client.1.smithi086.stdout:6/36: write f3 [4309240,102596] 0 2024-08-19T00:55:53.643 INFO:tasks.workunit.client.1.smithi086.stdout:0/41: dwrite da/fd [0,4194304] 0 2024-08-19T00:55:53.644 INFO:tasks.workunit.client.1.smithi086.stdout:1/13: mkdir d4 0 2024-08-19T00:55:53.646 INFO:tasks.workunit.client.1.smithi086.stdout:0/42: chown l5 32 1 2024-08-19T00:55:53.648 INFO:tasks.workunit.client.1.smithi086.stdout:7/37: dread f2 [0,4194304] 0 2024-08-19T00:55:53.651 INFO:tasks.workunit.client.1.smithi086.stdout:0/43: write da/fe [785606,104813] 0 2024-08-19T00:55:53.655 INFO:tasks.workunit.client.1.smithi086.stdout:1/14: dread f2 [0,4194304] 0 2024-08-19T00:55:53.656 INFO:tasks.workunit.client.1.smithi086.stdout:0/44: chown da/lc 26689689 1 2024-08-19T00:55:53.657 INFO:tasks.workunit.client.1.smithi086.stdout:6/37: dwrite f8 [0,4194304] 0 2024-08-19T00:55:53.659 INFO:tasks.workunit.client.1.smithi086.stdout:7/38: getdents d3 0 2024-08-19T00:55:53.659 INFO:tasks.workunit.client.1.smithi086.stdout:6/38: dread f6 [0,4194304] 0 2024-08-19T00:55:53.660 INFO:tasks.workunit.client.1.smithi086.stdout:7/39: stat d3/f7 0 2024-08-19T00:55:53.661 INFO:tasks.workunit.client.1.smithi086.stdout:0/45: dread da/fd [0,4194304] 0 2024-08-19T00:55:53.663 INFO:tasks.workunit.client.1.smithi086.stdout:7/40: creat d3/fb x:0 0 0 2024-08-19T00:55:53.664 INFO:tasks.workunit.client.1.smithi086.stdout:0/46: write da/fd [1459859,58792] 0 2024-08-19T00:55:53.665 INFO:tasks.workunit.client.1.smithi086.stdout:6/39: dread f8 [0,4194304] 0 2024-08-19T00:55:53.665 INFO:tasks.workunit.client.1.smithi086.stdout:0/47: chown da/lc 429 1 2024-08-19T00:55:53.665 INFO:tasks.workunit.client.1.smithi086.stdout:7/41: write f2 [431405,15605] 0 2024-08-19T00:55:53.669 INFO:tasks.workunit.client.1.smithi086.stdout:1/15: fsync f2 0 2024-08-19T00:55:53.670 INFO:tasks.workunit.client.1.smithi086.stdout:7/42: symlink d3/lc 0 2024-08-19T00:55:53.671 INFO:tasks.workunit.client.1.smithi086.stdout:0/48: creat da/ff x:0 0 0 2024-08-19T00:55:53.674 INFO:tasks.workunit.client.1.smithi086.stdout:1/16: symlink d4/l5 0 2024-08-19T00:55:53.674 INFO:tasks.workunit.client.1.smithi086.stdout:6/40: dwrite f3 [0,4194304] 0 2024-08-19T00:55:53.679 INFO:tasks.workunit.client.1.smithi086.stdout:6/41: truncate f6 619837 0 2024-08-19T00:55:53.679 INFO:tasks.workunit.client.1.smithi086.stdout:6/42: rmdir - no directory 2024-08-19T00:55:53.679 INFO:tasks.workunit.client.1.smithi086.stdout:1/17: rmdir d4 39 2024-08-19T00:55:53.679 INFO:tasks.workunit.client.1.smithi086.stdout:0/49: dread f6 [0,4194304] 0 2024-08-19T00:55:53.679 INFO:tasks.workunit.client.1.smithi086.stdout:1/18: fdatasync f2 0 2024-08-19T00:55:53.680 INFO:tasks.workunit.client.1.smithi086.stdout:6/43: dread f6 [0,4194304] 0 2024-08-19T00:55:53.680 INFO:tasks.workunit.client.1.smithi086.stdout:0/50: creat da/f10 x:0 0 0 2024-08-19T00:55:53.681 INFO:tasks.workunit.client.1.smithi086.stdout:6/44: write f8 [4294303,48956] 0 2024-08-19T00:55:53.684 INFO:tasks.workunit.client.1.smithi086.stdout:6/45: mkdir db 0 2024-08-19T00:55:53.685 INFO:tasks.workunit.client.1.smithi086.stdout:1/19: dread f2 [0,4194304] 0 2024-08-19T00:55:53.685 INFO:tasks.workunit.client.1.smithi086.stdout:6/46: write f3 [167493,6297] 0 2024-08-19T00:55:53.686 INFO:tasks.workunit.client.1.smithi086.stdout:1/20: chown c3 0 1 2024-08-19T00:55:53.688 INFO:tasks.workunit.client.1.smithi086.stdout:0/51: dwrite da/fd [0,4194304] 0 2024-08-19T00:55:53.690 INFO:tasks.workunit.client.1.smithi086.stdout:1/21: creat d4/f6 x:0 0 0 2024-08-19T00:55:53.695 INFO:tasks.workunit.client.1.smithi086.stdout:1/22: truncate f2 2345686 0 2024-08-19T00:55:53.697 INFO:tasks.workunit.client.1.smithi086.stdout:0/52: dwrite da/ff [0,4194304] 0 2024-08-19T00:55:53.697 INFO:tasks.workunit.client.1.smithi086.stdout:1/23: mkdir d4/d7 0 2024-08-19T00:55:53.702 INFO:tasks.workunit.client.1.smithi086.stdout:0/53: dread da/fd [0,4194304] 0 2024-08-19T00:55:53.706 INFO:tasks.workunit.client.1.smithi086.stdout:1/24: dwrite d4/f6 [0,4194304] 0 2024-08-19T00:55:53.707 INFO:tasks.workunit.client.1.smithi086.stdout:0/54: symlink da/l11 0 2024-08-19T00:55:53.710 INFO:tasks.workunit.client.1.smithi086.stdout:0/55: symlink da/l12 0 2024-08-19T00:55:53.713 INFO:tasks.workunit.client.1.smithi086.stdout:0/56: symlink da/l13 0 2024-08-19T00:55:53.717 INFO:tasks.workunit.client.1.smithi086.stdout:1/25: dread f2 [0,4194304] 0 2024-08-19T00:55:53.718 INFO:tasks.workunit.client.1.smithi086.stdout:1/26: chown d4/l5 5 1 2024-08-19T00:55:53.720 INFO:tasks.workunit.client.1.smithi086.stdout:1/27: mkdir d4/d8 0 2024-08-19T00:55:53.725 INFO:tasks.workunit.client.1.smithi086.stdout:0/57: rmdir da 39 2024-08-19T00:55:53.728 INFO:tasks.workunit.client.1.smithi086.stdout:1/28: truncate d4/f6 1809587 0 2024-08-19T00:55:53.729 INFO:tasks.workunit.client.1.smithi086.stdout:0/58: dread f6 [0,4194304] 0 2024-08-19T00:55:53.731 INFO:tasks.workunit.client.1.smithi086.stdout:1/29: symlink d4/d7/l9 0 2024-08-19T00:55:53.731 INFO:tasks.workunit.client.1.smithi086.stdout:0/59: mkdir da/d14 0 2024-08-19T00:55:53.733 INFO:tasks.workunit.client.1.smithi086.stdout:1/30: unlink l1 0 2024-08-19T00:55:53.736 INFO:tasks.workunit.client.1.smithi086.stdout:0/60: creat da/d14/f15 x:0 0 0 2024-08-19T00:55:53.737 INFO:tasks.workunit.client.1.smithi086.stdout:1/31: creat d4/d7/fa x:0 0 0 2024-08-19T00:55:53.739 INFO:tasks.workunit.client.1.smithi086.stdout:1/32: mkdir d4/d8/db 0 2024-08-19T00:55:53.743 INFO:tasks.workunit.client.1.smithi086.stdout:0/61: dwrite da/f10 [0,4194304] 0 2024-08-19T00:55:53.745 INFO:tasks.workunit.client.1.smithi086.stdout:0/62: mknod da/d14/c16 0 2024-08-19T00:55:53.746 INFO:tasks.workunit.client.1.smithi086.stdout:0/63: stat da 0 2024-08-19T00:55:53.754 INFO:tasks.workunit.client.1.smithi086.stdout:0/64: dwrite f6 [0,4194304] 0 2024-08-19T00:55:53.756 INFO:tasks.workunit.client.1.smithi086.stdout:0/65: chown da/fe 383 1 2024-08-19T00:55:53.758 INFO:tasks.workunit.client.1.smithi086.stdout:1/33: dwrite f2 [0,4194304] 0 2024-08-19T00:55:53.760 INFO:tasks.workunit.client.1.smithi086.stdout:1/34: chown d4/l5 67107315 1 2024-08-19T00:55:53.764 INFO:tasks.workunit.client.1.smithi086.stdout:0/66: dwrite f6 [4194304,4194304] 0 2024-08-19T00:55:53.765 INFO:tasks.workunit.client.1.smithi086.stdout:0/67: fdatasync da/f10 0 2024-08-19T00:55:53.771 INFO:tasks.workunit.client.1.smithi086.stdout:0/68: rename da/fd to da/d14/f17 0 2024-08-19T00:55:53.777 INFO:tasks.workunit.client.1.smithi086.stdout:0/69: dwrite da/ff [0,4194304] 0 2024-08-19T00:55:53.782 INFO:tasks.workunit.client.1.smithi086.stdout:0/70: rename l4 to da/l18 0 2024-08-19T00:55:53.782 INFO:tasks.workunit.client.1.smithi086.stdout:0/71: write f6 [6612544,32363] 0 2024-08-19T00:55:53.785 INFO:tasks.workunit.client.1.smithi086.stdout:0/72: mknod da/c19 0 2024-08-19T00:55:53.787 INFO:tasks.workunit.client.1.smithi086.stdout:0/73: mkdir da/d14/d1a 0 2024-08-19T00:55:53.790 INFO:tasks.workunit.client.1.smithi086.stdout:0/74: creat da/d14/f1b x:0 0 0 2024-08-19T00:55:53.790 INFO:tasks.workunit.client.1.smithi086.stdout:0/75: stat da/l11 0 2024-08-19T00:55:53.791 INFO:tasks.workunit.client.1.smithi086.stdout:0/76: chown f6 31 1 2024-08-19T00:55:53.795 INFO:tasks.workunit.client.1.smithi086.stdout:1/35: write d4/f6 [1728497,40777] 0 2024-08-19T00:55:53.799 INFO:tasks.workunit.client.1.smithi086.stdout:0/77: rename da/l18 to da/d14/d1a/l1c 0 2024-08-19T00:55:53.800 INFO:tasks.workunit.client.1.smithi086.stdout:0/78: chown da/l12 107285 1 2024-08-19T00:55:53.803 INFO:tasks.workunit.client.1.smithi086.stdout:1/36: dwrite f2 [0,4194304] 0 2024-08-19T00:55:53.804 INFO:tasks.workunit.client.1.smithi086.stdout:1/37: fdatasync d4/d7/fa 0 2024-08-19T00:55:53.804 INFO:tasks.workunit.client.1.smithi086.stdout:0/79: creat da/d14/f1d x:0 0 0 2024-08-19T00:55:53.805 INFO:tasks.workunit.client.1.smithi086.stdout:1/38: mknod d4/cc 0 2024-08-19T00:55:53.806 INFO:tasks.workunit.client.1.smithi086.stdout:0/80: mknod da/d14/c1e 0 2024-08-19T00:55:53.806 INFO:tasks.workunit.client.1.smithi086.stdout:0/81: stat da/d14/f1d 0 2024-08-19T00:55:53.808 INFO:tasks.workunit.client.1.smithi086.stdout:1/39: unlink d4/l5 0 2024-08-19T00:55:53.810 INFO:tasks.workunit.client.1.smithi086.stdout:1/40: symlink d4/ld 0 2024-08-19T00:55:53.811 INFO:tasks.workunit.client.1.smithi086.stdout:1/41: readlink d4/d7/l9 0 2024-08-19T00:55:53.811 INFO:tasks.workunit.client.1.smithi086.stdout:0/82: dread da/ff [0,4194304] 0 2024-08-19T00:55:53.813 INFO:tasks.workunit.client.1.smithi086.stdout:1/42: creat d4/d7/fe x:0 0 0 2024-08-19T00:55:53.815 INFO:tasks.workunit.client.1.smithi086.stdout:1/43: dread - d4/d7/fa zero size 2024-08-19T00:55:53.816 INFO:tasks.workunit.client.1.smithi086.stdout:1/44: write d4/f6 [956226,114737] 0 2024-08-19T00:55:53.827 INFO:tasks.workunit.client.1.smithi086.stdout:0/83: truncate da/d14/f17 2608318 0 2024-08-19T00:55:53.828 INFO:tasks.workunit.client.1.smithi086.stdout:0/84: write da/d14/f1d [411251,126127] 0 2024-08-19T00:55:53.829 INFO:tasks.workunit.client.1.smithi086.stdout:0/85: mknod da/c1f 0 2024-08-19T00:55:53.830 INFO:tasks.workunit.client.1.smithi086.stdout:0/86: stat da/d14/f17 0 2024-08-19T00:55:53.831 INFO:tasks.workunit.client.1.smithi086.stdout:0/87: fsync da/d14/f1b 0 2024-08-19T00:55:53.831 INFO:tasks.workunit.client.1.smithi086.stdout:0/88: write da/d14/f15 [703729,22660] 0 2024-08-19T00:55:53.832 INFO:tasks.workunit.client.1.smithi086.stdout:0/89: rename da to da/d14/d1a/d20 22 2024-08-19T00:55:53.833 INFO:tasks.workunit.client.1.smithi086.stdout:0/90: mknod da/c21 0 2024-08-19T00:55:53.833 INFO:tasks.workunit.client.1.smithi086.stdout:0/91: fdatasync da/fe 0 2024-08-19T00:55:53.839 INFO:tasks.workunit.client.1.smithi086.stdout:0/92: dwrite da/fe [0,4194304] 0 2024-08-19T00:55:54.820 INFO:tasks.workunit.client.1.smithi086.stdout:5/5: sync 2024-08-19T00:55:54.988 INFO:tasks.workunit.client.1.smithi086.stdout:3/12: sync 2024-08-19T00:55:54.988 INFO:tasks.workunit.client.1.smithi086.stdout:5/6: sync 2024-08-19T00:55:54.988 INFO:tasks.workunit.client.1.smithi086.stdout:4/19: sync 2024-08-19T00:55:54.988 INFO:tasks.workunit.client.1.smithi086.stdout:5/7: link - no file 2024-08-19T00:55:54.988 INFO:tasks.workunit.client.1.smithi086.stdout:5/8: write - no filename 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:5/9: dwrite - no filename 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:6/47: sync 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:5/10: truncate - no filename 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:5/11: rmdir - no directory 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:5/12: read - no filename 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:5/13: write - no filename 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:5/14: fsync - no filename 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:2/12: sync 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:0/93: sync 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:8/5: sync 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:7/43: sync 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:8/6: rmdir - no directory 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:1/45: sync 2024-08-19T00:55:54.989 INFO:tasks.workunit.client.1.smithi086.stdout:9/24: sync 2024-08-19T00:55:54.990 INFO:tasks.workunit.client.1.smithi086.stdout:8/7: write f1 [828761,75137] 0 2024-08-19T00:55:54.992 INFO:tasks.workunit.client.1.smithi086.stdout:2/13: dread f0 [0,4194304] 0 2024-08-19T00:55:54.992 INFO:tasks.workunit.client.1.smithi086.stdout:2/14: rmdir - no directory 2024-08-19T00:55:54.995 INFO:tasks.workunit.client.1.smithi086.stdout:2/15: dread f0 [0,4194304] 0 2024-08-19T00:55:54.996 INFO:tasks.workunit.client.1.smithi086.stdout:2/16: chown f0 14 1 2024-08-19T00:55:54.997 INFO:tasks.workunit.client.1.smithi086.stdout:9/25: write f5 [469941,76583] 0 2024-08-19T00:55:55.003 INFO:tasks.workunit.client.1.smithi086.stdout:7/44: dwrite d3/fb [0,4194304] 0 2024-08-19T00:55:55.025 INFO:tasks.workunit.client.1.smithi086.stdout:3/13: creat f2 x:0 0 0 2024-08-19T00:55:55.025 INFO:tasks.workunit.client.1.smithi086.stdout:6/48: fsync f6 0 2024-08-19T00:55:55.026 INFO:tasks.workunit.client.1.smithi086.stdout:3/14: write f2 [556482,23324] 0 2024-08-19T00:55:55.027 INFO:tasks.workunit.client.1.smithi086.stdout:3/15: write f2 [789137,113255] 0 2024-08-19T00:55:55.027 INFO:tasks.workunit.client.1.smithi086.stdout:3/16: rmdir - no directory 2024-08-19T00:55:55.029 INFO:tasks.workunit.client.1.smithi086.stdout:1/46: symlink d4/d7/lf 0 2024-08-19T00:55:55.030 INFO:tasks.workunit.client.1.smithi086.stdout:1/47: dread - d4/d7/fe zero size 2024-08-19T00:55:55.031 INFO:tasks.workunit.client.1.smithi086.stdout:4/20: rename d2/d3/f6 to d2/d3/f7 0 2024-08-19T00:55:55.032 INFO:tasks.workunit.client.1.smithi086.stdout:8/8: creat f2 x:0 0 0 2024-08-19T00:55:55.034 INFO:tasks.workunit.client.1.smithi086.stdout:4/21: dread d2/f5 [0,4194304] 0 2024-08-19T00:55:55.035 INFO:tasks.workunit.client.1.smithi086.stdout:7/45: symlink d3/ld 0 2024-08-19T00:55:55.036 INFO:tasks.workunit.client.1.smithi086.stdout:5/15: mkdir d0 0 2024-08-19T00:55:55.036 INFO:tasks.workunit.client.1.smithi086.stdout:5/16: dwrite - no filename 2024-08-19T00:55:55.039 INFO:tasks.workunit.client.1.smithi086.stdout:3/17: unlink c1 0 2024-08-19T00:55:55.042 INFO:tasks.workunit.client.1.smithi086.stdout:0/94: truncate da/f10 2154472 0 2024-08-19T00:55:55.043 INFO:tasks.workunit.client.1.smithi086.stdout:8/9: creat f3 x:0 0 0 2024-08-19T00:55:55.043 INFO:tasks.workunit.client.1.smithi086.stdout:7/46: dwrite d3/fb [0,4194304] 0 2024-08-19T00:55:55.044 INFO:tasks.workunit.client.1.smithi086.stdout:2/17: getdents . 0 2024-08-19T00:55:55.046 INFO:tasks.workunit.client.1.smithi086.stdout:9/26: truncate f0 598232 0 2024-08-19T00:55:55.046 INFO:tasks.workunit.client.1.smithi086.stdout:0/95: dread da/d14/f1d [0,4194304] 0 2024-08-19T00:55:55.050 INFO:tasks.workunit.client.1.smithi086.stdout:0/96: rename da/d14/d1a to da/d14/d1a/d22 22 2024-08-19T00:55:55.051 INFO:tasks.workunit.client.1.smithi086.stdout:6/49: mknod db/cc 0 2024-08-19T00:55:55.051 INFO:tasks.workunit.client.1.smithi086.stdout:3/18: mkdir d3 0 2024-08-19T00:55:55.054 INFO:tasks.workunit.client.1.smithi086.stdout:0/97: dread da/ff [0,4194304] 0 2024-08-19T00:55:55.054 INFO:tasks.workunit.client.1.smithi086.stdout:8/10: creat f4 x:0 0 0 2024-08-19T00:55:55.055 INFO:tasks.workunit.client.1.smithi086.stdout:7/47: mkdir d3/de 0 2024-08-19T00:55:55.057 INFO:tasks.workunit.client.1.smithi086.stdout:2/18: creat f2 x:0 0 0 2024-08-19T00:55:55.057 INFO:tasks.workunit.client.1.smithi086.stdout:2/19: rmdir - no directory 2024-08-19T00:55:55.057 INFO:tasks.workunit.client.1.smithi086.stdout:9/27: creat f6 x:0 0 0 2024-08-19T00:55:55.058 INFO:tasks.workunit.client.1.smithi086.stdout:5/17: mknod d0/c1 0 2024-08-19T00:55:55.059 INFO:tasks.workunit.client.1.smithi086.stdout:6/50: mknod db/cd 0 2024-08-19T00:55:55.060 INFO:tasks.workunit.client.1.smithi086.stdout:1/48: rmdir d4/d8/db 0 2024-08-19T00:55:55.061 INFO:tasks.workunit.client.1.smithi086.stdout:6/51: fsync f3 0 2024-08-19T00:55:55.062 INFO:tasks.workunit.client.1.smithi086.stdout:0/98: mknod da/d14/c23 0 2024-08-19T00:55:55.064 INFO:tasks.workunit.client.1.smithi086.stdout:3/19: dwrite f2 [0,4194304] 0 2024-08-19T00:55:55.064 INFO:tasks.workunit.client.1.smithi086.stdout:6/52: fdatasync f3 0 2024-08-19T00:55:55.064 INFO:tasks.workunit.client.1.smithi086.stdout:1/49: write f2 [4164460,119079] 0 2024-08-19T00:55:55.066 INFO:tasks.workunit.client.1.smithi086.stdout:2/20: creat f3 x:0 0 0 2024-08-19T00:55:55.067 INFO:tasks.workunit.client.1.smithi086.stdout:6/53: rename db to db/de 22 2024-08-19T00:55:55.068 INFO:tasks.workunit.client.1.smithi086.stdout:6/54: readlink la 0 2024-08-19T00:55:55.068 INFO:tasks.workunit.client.1.smithi086.stdout:7/48: dread d3/f7 [0,4194304] 0 2024-08-19T00:55:55.069 INFO:tasks.workunit.client.1.smithi086.stdout:6/55: truncate f3 4662609 0 2024-08-19T00:55:55.071 INFO:tasks.workunit.client.1.smithi086.stdout:8/11: dwrite f2 [0,4194304] 0 2024-08-19T00:55:55.071 INFO:tasks.workunit.client.1.smithi086.stdout:7/49: truncate d3/f7 1796509 0 2024-08-19T00:55:55.074 INFO:tasks.workunit.client.1.smithi086.stdout:8/12: read f1 [515504,112432] 0 2024-08-19T00:55:55.076 INFO:tasks.workunit.client.1.smithi086.stdout:6/56: symlink db/lf 0 2024-08-19T00:55:55.076 INFO:tasks.workunit.client.1.smithi086.stdout:2/21: dread f0 [0,4194304] 0 2024-08-19T00:55:55.077 INFO:tasks.workunit.client.1.smithi086.stdout:6/57: dread f6 [0,4194304] 0 2024-08-19T00:55:55.078 INFO:tasks.workunit.client.1.smithi086.stdout:5/18: link d0/c1 d0/c2 0 2024-08-19T00:55:55.079 INFO:tasks.workunit.client.1.smithi086.stdout:3/20: getdents d3 0 2024-08-19T00:55:55.082 INFO:tasks.workunit.client.1.smithi086.stdout:8/13: dwrite f3 [0,4194304] 0 2024-08-19T00:55:55.083 INFO:tasks.workunit.client.1.smithi086.stdout:2/22: rename l1 to l4 0 2024-08-19T00:55:55.084 INFO:tasks.workunit.client.1.smithi086.stdout:6/58: symlink db/l10 0 2024-08-19T00:55:55.087 INFO:tasks.workunit.client.1.smithi086.stdout:5/19: mknod d0/c3 0 2024-08-19T00:55:55.088 INFO:tasks.workunit.client.1.smithi086.stdout:2/23: rename f3 to f5 0 2024-08-19T00:55:55.091 INFO:tasks.workunit.client.1.smithi086.stdout:3/21: mknod d3/c4 0 2024-08-19T00:55:55.092 INFO:tasks.workunit.client.1.smithi086.stdout:3/22: write f2 [1660269,24153] 0 2024-08-19T00:55:55.094 INFO:tasks.workunit.client.1.smithi086.stdout:2/24: creat f6 x:0 0 0 2024-08-19T00:55:55.101 INFO:tasks.workunit.client.1.smithi086.stdout:5/20: rename d0/c2 to d0/c4 0 2024-08-19T00:55:55.101 INFO:tasks.workunit.client.1.smithi086.stdout:5/21: fsync - no filename 2024-08-19T00:55:55.101 INFO:tasks.workunit.client.1.smithi086.stdout:5/22: write - no filename 2024-08-19T00:55:55.102 INFO:tasks.workunit.client.1.smithi086.stdout:2/25: rename f6 to f7 0 2024-08-19T00:55:55.106 INFO:tasks.workunit.client.1.smithi086.stdout:2/26: mkdir d8 0 2024-08-19T00:55:55.106 INFO:tasks.workunit.client.1.smithi086.stdout:2/27: chown f2 0 1 2024-08-19T00:55:55.114 INFO:tasks.workunit.client.1.smithi086.stdout:2/28: dwrite f7 [0,4194304] 0 2024-08-19T00:55:55.121 INFO:tasks.workunit.client.1.smithi086.stdout:2/29: dwrite f7 [0,4194304] 0 2024-08-19T00:55:55.126 INFO:tasks.workunit.client.1.smithi086.stdout:2/30: dread f0 [0,4194304] 0 2024-08-19T00:55:55.129 INFO:tasks.workunit.client.1.smithi086.stdout:2/31: symlink d8/l9 0 2024-08-19T00:55:55.196 INFO:tasks.workunit.client.1.smithi086.stdout:7/50: sync 2024-08-19T00:55:55.196 INFO:tasks.workunit.client.1.smithi086.stdout:7/51: write d3/fb [1511211,82762] 0 2024-08-19T00:55:55.203 INFO:tasks.workunit.client.1.smithi086.stdout:7/52: dwrite d3/f7 [0,4194304] 0 2024-08-19T00:55:55.208 INFO:tasks.workunit.client.1.smithi086.stdout:7/53: dwrite d3/fb [0,4194304] 0 2024-08-19T00:55:55.209 INFO:tasks.workunit.client.1.smithi086.stdout:7/54: write f2 [2880091,31684] 0 2024-08-19T00:55:55.214 INFO:tasks.workunit.client.1.smithi086.stdout:7/55: unlink d3/l9 0 2024-08-19T00:55:55.217 INFO:tasks.workunit.client.1.smithi086.stdout:7/56: creat d3/ff x:0 0 0 2024-08-19T00:55:55.333 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:55 smithi017 ceph-mon[16627]: pgmap v8: 65 pgs: 65 active+clean; 193 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 213 op/s 2024-08-19T00:55:55.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:55 smithi086 ceph-mon[24511]: pgmap v8: 65 pgs: 65 active+clean; 193 MiB data, 812 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 213 op/s 2024-08-19T00:55:55.500 INFO:tasks.workunit.client.1.smithi086.stdout:4/22: read d2/d3/f7 [355229,30516] 0 2024-08-19T00:55:55.501 INFO:tasks.workunit.client.1.smithi086.stdout:4/23: creat d2/f8 x:0 0 0 2024-08-19T00:55:55.503 INFO:tasks.workunit.client.1.smithi086.stdout:4/24: stat c1 0 2024-08-19T00:55:55.506 INFO:tasks.workunit.client.1.smithi086.stdout:4/25: rename c0 to d2/d3/c9 0 2024-08-19T00:55:55.513 INFO:tasks.workunit.client.1.smithi086.stdout:9/28: rename f0 to f7 0 2024-08-19T00:55:55.514 INFO:tasks.workunit.client.1.smithi086.stdout:9/29: read f5 [48488,61335] 0 2024-08-19T00:55:55.522 INFO:tasks.workunit.client.1.smithi086.stdout:1/50: truncate d4/f6 163727 0 2024-08-19T00:55:55.522 INFO:tasks.workunit.client.1.smithi086.stdout:1/51: chown d4/d7/fa 1405257669 1 2024-08-19T00:55:55.523 INFO:tasks.workunit.client.1.smithi086.stdout:1/52: truncate d4/d7/fa 439192 0 2024-08-19T00:55:55.525 INFO:tasks.workunit.client.1.smithi086.stdout:3/23: getdents d3 0 2024-08-19T00:55:55.527 INFO:tasks.workunit.client.1.smithi086.stdout:8/14: truncate f2 3238818 0 2024-08-19T00:55:55.529 INFO:tasks.workunit.client.1.smithi086.stdout:6/59: truncate f8 3202726 0 2024-08-19T00:55:55.530 INFO:tasks.workunit.client.1.smithi086.stdout:1/53: dwrite d4/d7/fe [0,4194304] 0 2024-08-19T00:55:55.531 INFO:tasks.workunit.client.1.smithi086.stdout:6/60: chown db/cc 1770317374 1 2024-08-19T00:55:55.533 INFO:tasks.workunit.client.1.smithi086.stdout:3/24: dread f2 [0,4194304] 0 2024-08-19T00:55:55.534 INFO:tasks.workunit.client.1.smithi086.stdout:8/15: dread f3 [0,4194304] 0 2024-08-19T00:55:55.536 INFO:tasks.workunit.client.1.smithi086.stdout:1/54: mkdir d4/d10 0 2024-08-19T00:55:55.540 INFO:tasks.workunit.client.1.smithi086.stdout:3/25: write f2 [3304457,33067] 0 2024-08-19T00:55:55.543 INFO:tasks.workunit.client.1.smithi086.stdout:5/23: link d0/c4 d0/c5 0 2024-08-19T00:55:55.543 INFO:tasks.workunit.client.1.smithi086.stdout:5/24: dwrite - no filename 2024-08-19T00:55:55.545 INFO:tasks.workunit.client.1.smithi086.stdout:3/26: creat d3/f5 x:0 0 0 2024-08-19T00:55:55.547 INFO:tasks.workunit.client.1.smithi086.stdout:5/25: rmdir d0 39 2024-08-19T00:55:55.547 INFO:tasks.workunit.client.1.smithi086.stdout:5/26: dread - no filename 2024-08-19T00:55:55.547 INFO:tasks.workunit.client.1.smithi086.stdout:2/32: truncate f7 3261334 0 2024-08-19T00:55:55.548 INFO:tasks.workunit.client.1.smithi086.stdout:3/27: creat d3/f6 x:0 0 0 2024-08-19T00:55:55.552 INFO:tasks.workunit.client.1.smithi086.stdout:5/27: unlink d0/c3 0 2024-08-19T00:55:55.552 INFO:tasks.workunit.client.1.smithi086.stdout:5/28: read - no filename 2024-08-19T00:55:55.554 INFO:tasks.workunit.client.1.smithi086.stdout:2/33: unlink l4 0 2024-08-19T00:55:55.556 INFO:tasks.workunit.client.1.smithi086.stdout:5/29: creat d0/f6 x:0 0 0 2024-08-19T00:55:55.562 INFO:tasks.workunit.client.1.smithi086.stdout:5/30: chown d0/c1 109455 1 2024-08-19T00:55:55.563 INFO:tasks.workunit.client.1.smithi086.stdout:5/31: chown d0/f6 533548 1 2024-08-19T00:55:55.568 INFO:tasks.workunit.client.1.smithi086.stdout:7/57: truncate d3/fb 1663630 0 2024-08-19T00:55:55.569 INFO:tasks.workunit.client.1.smithi086.stdout:5/32: dwrite d0/f6 [0,4194304] 0 2024-08-19T00:55:55.570 INFO:tasks.workunit.client.1.smithi086.stdout:7/58: symlink d3/l10 0 2024-08-19T00:55:55.574 INFO:tasks.workunit.client.1.smithi086.stdout:5/33: dread d0/f6 [0,4194304] 0 2024-08-19T00:55:55.576 INFO:tasks.workunit.client.1.smithi086.stdout:5/34: creat d0/f7 x:0 0 0 2024-08-19T00:55:55.582 INFO:tasks.workunit.client.1.smithi086.stdout:5/35: dwrite d0/f7 [0,4194304] 0 2024-08-19T00:55:55.586 INFO:tasks.workunit.client.1.smithi086.stdout:5/36: mkdir d0/d8 0 2024-08-19T00:55:55.592 INFO:tasks.workunit.client.1.smithi086.stdout:5/37: dwrite d0/f6 [0,4194304] 0 2024-08-19T00:55:55.594 INFO:tasks.workunit.client.1.smithi086.stdout:5/38: symlink d0/d8/l9 0 2024-08-19T00:55:55.599 INFO:tasks.workunit.client.1.smithi086.stdout:5/39: link d0/f6 d0/fa 0 2024-08-19T00:55:55.602 INFO:tasks.workunit.client.1.smithi086.stdout:5/40: link d0/fa d0/fb 0 2024-08-19T00:55:55.602 INFO:tasks.workunit.client.1.smithi086.stdout:5/41: readlink d0/d8/l9 0 2024-08-19T00:55:55.611 INFO:tasks.workunit.client.1.smithi086.stdout:5/42: fdatasync d0/f6 0 2024-08-19T00:55:55.613 INFO:tasks.workunit.client.1.smithi086.stdout:5/43: rename d0/d8/l9 to d0/d8/lc 0 2024-08-19T00:55:55.618 INFO:tasks.workunit.client.1.smithi086.stdout:5/44: dwrite d0/fa [0,4194304] 0 2024-08-19T00:55:55.621 INFO:tasks.workunit.client.1.smithi086.stdout:5/45: dread d0/fa [0,4194304] 0 2024-08-19T00:55:55.625 INFO:tasks.workunit.client.1.smithi086.stdout:5/46: symlink d0/d8/ld 0 2024-08-19T00:55:55.625 INFO:tasks.workunit.client.1.smithi086.stdout:5/47: truncate d0/f7 4361261 0 2024-08-19T00:55:55.633 INFO:tasks.workunit.client.1.smithi086.stdout:5/48: dwrite d0/f6 [0,4194304] 0 2024-08-19T00:55:55.635 INFO:tasks.workunit.client.1.smithi086.stdout:5/49: symlink d0/d8/le 0 2024-08-19T00:55:55.636 INFO:tasks.workunit.client.1.smithi086.stdout:5/50: write d0/fa [1306923,12209] 0 2024-08-19T00:55:55.642 INFO:tasks.workunit.client.1.smithi086.stdout:5/51: dwrite d0/fb [0,4194304] 0 2024-08-19T00:55:55.645 INFO:tasks.workunit.client.1.smithi086.stdout:5/52: mkdir d0/df 0 2024-08-19T00:55:55.651 INFO:tasks.workunit.client.1.smithi086.stdout:5/53: dwrite d0/f7 [0,4194304] 0 2024-08-19T00:55:55.669 INFO:tasks.workunit.client.1.smithi086.stdout:4/26: write d2/d3/f7 [1134577,35581] 0 2024-08-19T00:55:55.673 INFO:tasks.workunit.client.1.smithi086.stdout:4/27: dread d2/f5 [0,4194304] 0 2024-08-19T00:55:55.677 INFO:tasks.workunit.client.1.smithi086.stdout:4/28: rename d2/d3 to d2/da 0 2024-08-19T00:55:55.677 INFO:tasks.workunit.client.1.smithi086.stdout:4/29: dread - d2/f8 zero size 2024-08-19T00:55:55.680 INFO:tasks.workunit.client.1.smithi086.stdout:6/61: read f8 [1188945,92612] 0 2024-08-19T00:55:55.681 INFO:tasks.workunit.client.1.smithi086.stdout:8/16: dwrite f2 [0,4194304] 0 2024-08-19T00:55:55.683 INFO:tasks.workunit.client.1.smithi086.stdout:6/62: creat db/f11 x:0 0 0 2024-08-19T00:55:55.684 INFO:tasks.workunit.client.1.smithi086.stdout:6/63: readlink db/lf 0 2024-08-19T00:55:55.684 INFO:tasks.workunit.client.1.smithi086.stdout:6/64: chown f8 80567 1 2024-08-19T00:55:55.685 INFO:tasks.workunit.client.1.smithi086.stdout:8/17: rename f2 to f5 0 2024-08-19T00:55:55.687 INFO:tasks.workunit.client.1.smithi086.stdout:6/65: mknod db/c12 0 2024-08-19T00:55:55.688 INFO:tasks.workunit.client.1.smithi086.stdout:3/28: getdents d3 0 2024-08-19T00:55:55.691 INFO:tasks.workunit.client.1.smithi086.stdout:8/18: creat f6 x:0 0 0 2024-08-19T00:55:55.692 INFO:tasks.workunit.client.1.smithi086.stdout:8/19: read - f4 zero size 2024-08-19T00:55:55.692 INFO:tasks.workunit.client.1.smithi086.stdout:8/20: read - f4 zero size 2024-08-19T00:55:55.692 INFO:tasks.workunit.client.1.smithi086.stdout:8/21: rmdir - no directory 2024-08-19T00:55:55.693 INFO:tasks.workunit.client.1.smithi086.stdout:3/29: symlink d3/l7 0 2024-08-19T00:55:55.693 INFO:tasks.workunit.client.1.smithi086.stdout:3/30: write d3/f6 [642904,63215] 0 2024-08-19T00:55:55.695 INFO:tasks.workunit.client.1.smithi086.stdout:2/34: write f0 [3701205,4101] 0 2024-08-19T00:55:55.696 INFO:tasks.workunit.client.1.smithi086.stdout:3/31: mknod d3/c8 0 2024-08-19T00:55:55.698 INFO:tasks.workunit.client.1.smithi086.stdout:2/35: creat d8/fa x:0 0 0 2024-08-19T00:55:55.699 INFO:tasks.workunit.client.1.smithi086.stdout:2/36: write f2 [790670,114302] 0 2024-08-19T00:55:55.700 INFO:tasks.workunit.client.1.smithi086.stdout:3/32: mkdir d3/d9 0 2024-08-19T00:55:55.704 INFO:tasks.workunit.client.1.smithi086.stdout:3/33: creat d3/d9/fa x:0 0 0 2024-08-19T00:55:55.704 INFO:tasks.workunit.client.1.smithi086.stdout:7/59: rmdir d3 39 2024-08-19T00:55:55.706 INFO:tasks.workunit.client.1.smithi086.stdout:3/34: write d3/f6 [698714,100621] 0 2024-08-19T00:55:55.707 INFO:tasks.workunit.client.1.smithi086.stdout:7/60: readlink d3/lc 0 2024-08-19T00:55:55.708 INFO:tasks.workunit.client.1.smithi086.stdout:2/37: dwrite f5 [0,4194304] 0 2024-08-19T00:55:55.708 INFO:tasks.workunit.client.1.smithi086.stdout:7/61: write d3/ff [895830,114538] 0 2024-08-19T00:55:55.709 INFO:tasks.workunit.client.1.smithi086.stdout:3/35: rmdir d3 39 2024-08-19T00:55:55.719 INFO:tasks.workunit.client.1.smithi086.stdout:7/62: creat d3/de/f11 x:0 0 0 2024-08-19T00:55:55.720 INFO:tasks.workunit.client.1.smithi086.stdout:3/36: dwrite d3/f5 [0,4194304] 0 2024-08-19T00:55:55.721 INFO:tasks.workunit.client.1.smithi086.stdout:3/37: truncate d3/f6 974477 0 2024-08-19T00:55:55.721 INFO:tasks.workunit.client.1.smithi086.stdout:7/63: truncate d3/de/f11 962054 0 2024-08-19T00:55:55.726 INFO:tasks.workunit.client.1.smithi086.stdout:3/38: link d3/l7 d3/d9/lb 0 2024-08-19T00:55:55.728 INFO:tasks.workunit.client.1.smithi086.stdout:3/39: dread - d3/d9/fa zero size 2024-08-19T00:55:55.728 INFO:tasks.workunit.client.1.smithi086.stdout:7/64: dwrite d3/ff [0,4194304] 0 2024-08-19T00:55:55.729 INFO:tasks.workunit.client.1.smithi086.stdout:7/65: read d3/f7 [117423,122880] 0 2024-08-19T00:55:55.732 INFO:tasks.workunit.client.1.smithi086.stdout:3/40: mknod d3/cc 0 2024-08-19T00:55:55.733 INFO:tasks.workunit.client.1.smithi086.stdout:0/99: write da/d14/f17 [140544,17656] 0 2024-08-19T00:55:55.736 INFO:tasks.workunit.client.1.smithi086.stdout:3/41: creat d3/d9/fd x:0 0 0 2024-08-19T00:55:55.737 INFO:tasks.workunit.client.1.smithi086.stdout:3/42: fdatasync f2 0 2024-08-19T00:55:55.737 INFO:tasks.workunit.client.1.smithi086.stdout:0/100: rmdir da/d14 39 2024-08-19T00:55:55.740 INFO:tasks.workunit.client.1.smithi086.stdout:3/43: mknod d3/d9/ce 0 2024-08-19T00:55:55.744 INFO:tasks.workunit.client.1.smithi086.stdout:3/44: creat d3/ff x:0 0 0 2024-08-19T00:55:55.745 INFO:tasks.workunit.client.1.smithi086.stdout:9/30: dwrite f7 [0,4194304] 0 2024-08-19T00:55:55.746 INFO:tasks.workunit.client.1.smithi086.stdout:9/31: stat f6 0 2024-08-19T00:55:55.750 INFO:tasks.workunit.client.1.smithi086.stdout:1/55: dwrite d4/f6 [0,4194304] 0 2024-08-19T00:55:55.751 INFO:tasks.workunit.client.1.smithi086.stdout:9/32: rename f1 to f8 0 2024-08-19T00:55:55.757 INFO:tasks.workunit.client.1.smithi086.stdout:1/56: creat d4/d8/f11 x:0 0 0 2024-08-19T00:55:55.759 INFO:tasks.workunit.client.1.smithi086.stdout:2/38: truncate f2 643383 0 2024-08-19T00:55:55.761 INFO:tasks.workunit.client.1.smithi086.stdout:3/45: dwrite f2 [4194304,4194304] 0 2024-08-19T00:55:55.761 INFO:tasks.workunit.client.1.smithi086.stdout:8/22: dwrite f1 [0,4194304] 0 2024-08-19T00:55:55.762 INFO:tasks.workunit.client.1.smithi086.stdout:8/23: truncate f6 652905 0 2024-08-19T00:55:55.763 INFO:tasks.workunit.client.1.smithi086.stdout:8/24: dread - f4 zero size 2024-08-19T00:55:55.764 INFO:tasks.workunit.client.1.smithi086.stdout:1/57: creat d4/d10/f12 x:0 0 0 2024-08-19T00:55:55.765 INFO:tasks.workunit.client.1.smithi086.stdout:2/39: creat d8/fb x:0 0 0 2024-08-19T00:55:55.766 INFO:tasks.workunit.client.1.smithi086.stdout:3/46: mknod d3/c10 0 2024-08-19T00:55:55.768 INFO:tasks.workunit.client.1.smithi086.stdout:8/25: creat f7 x:0 0 0 2024-08-19T00:55:55.770 INFO:tasks.workunit.client.1.smithi086.stdout:2/40: creat d8/fc x:0 0 0 2024-08-19T00:55:55.771 INFO:tasks.workunit.client.1.smithi086.stdout:2/41: write d8/fa [664250,28170] 0 2024-08-19T00:55:55.772 INFO:tasks.workunit.client.1.smithi086.stdout:2/42: dread - d8/fb zero size 2024-08-19T00:55:55.773 INFO:tasks.workunit.client.1.smithi086.stdout:8/26: creat f8 x:0 0 0 2024-08-19T00:55:55.775 INFO:tasks.workunit.client.1.smithi086.stdout:8/27: write f5 [3221345,122667] 0 2024-08-19T00:55:55.779 INFO:tasks.workunit.client.1.smithi086.stdout:9/33: getdents . 0 2024-08-19T00:55:55.783 INFO:tasks.workunit.client.1.smithi086.stdout:1/58: getdents d4/d7 0 2024-08-19T00:55:55.783 INFO:tasks.workunit.client.1.smithi086.stdout:9/34: mknod c9 0 2024-08-19T00:55:55.788 INFO:tasks.workunit.client.1.smithi086.stdout:9/35: unlink f5 0 2024-08-19T00:55:55.791 INFO:tasks.workunit.client.1.smithi086.stdout:9/36: write f7 [954482,17764] 0 2024-08-19T00:55:55.792 INFO:tasks.workunit.client.1.smithi086.stdout:1/59: dwrite d4/d7/fe [0,4194304] 0 2024-08-19T00:55:55.797 INFO:tasks.workunit.client.1.smithi086.stdout:8/28: dwrite f1 [4194304,4194304] 0 2024-08-19T00:55:55.799 INFO:tasks.workunit.client.1.smithi086.stdout:9/37: dread f7 [0,4194304] 0 2024-08-19T00:55:55.799 INFO:tasks.workunit.client.1.smithi086.stdout:1/60: creat d4/d8/f13 x:0 0 0 2024-08-19T00:55:55.801 INFO:tasks.workunit.client.1.smithi086.stdout:1/61: write d4/d8/f13 [278706,127906] 0 2024-08-19T00:55:55.804 INFO:tasks.workunit.client.1.smithi086.stdout:8/29: rename f6 to f9 0 2024-08-19T00:55:55.806 INFO:tasks.workunit.client.1.smithi086.stdout:1/62: dread d4/d7/fe [0,4194304] 0 2024-08-19T00:55:55.806 INFO:tasks.workunit.client.1.smithi086.stdout:1/63: chown d4/d8 766815043 1 2024-08-19T00:55:55.812 INFO:tasks.workunit.client.1.smithi086.stdout:1/64: dwrite f2 [0,4194304] 0 2024-08-19T00:55:55.812 INFO:tasks.workunit.client.1.smithi086.stdout:8/30: link c0 ca 0 2024-08-19T00:55:55.813 INFO:tasks.workunit.client.1.smithi086.stdout:1/65: creat d4/f14 x:0 0 0 2024-08-19T00:55:55.814 INFO:tasks.workunit.client.1.smithi086.stdout:8/31: symlink lb 0 2024-08-19T00:55:55.815 INFO:tasks.workunit.client.1.smithi086.stdout:8/32: truncate f8 819266 0 2024-08-19T00:55:55.817 INFO:tasks.workunit.client.1.smithi086.stdout:8/33: write f9 [440980,46220] 0 2024-08-19T00:55:55.821 INFO:tasks.workunit.client.1.smithi086.stdout:1/66: dwrite d4/d7/fa [0,4194304] 0 2024-08-19T00:55:55.827 INFO:tasks.workunit.client.1.smithi086.stdout:1/67: unlink d4/d10/f12 0 2024-08-19T00:55:55.829 INFO:tasks.workunit.client.1.smithi086.stdout:8/34: dwrite f3 [0,4194304] 0 2024-08-19T00:55:55.830 INFO:tasks.workunit.client.1.smithi086.stdout:8/35: truncate f8 919529 0 2024-08-19T00:55:55.832 INFO:tasks.workunit.client.1.smithi086.stdout:1/68: dread f2 [0,4194304] 0 2024-08-19T00:55:55.833 INFO:tasks.workunit.client.1.smithi086.stdout:1/69: dread - d4/f14 zero size 2024-08-19T00:55:55.833 INFO:tasks.workunit.client.1.smithi086.stdout:8/36: mkdir dc 0 2024-08-19T00:55:55.837 INFO:tasks.workunit.client.1.smithi086.stdout:8/37: rename f4 to dc/fd 0 2024-08-19T00:55:55.839 INFO:tasks.workunit.client.1.smithi086.stdout:8/38: symlink dc/le 0 2024-08-19T00:55:55.839 INFO:tasks.workunit.client.1.smithi086.stdout:8/39: readlink lb 0 2024-08-19T00:55:55.840 INFO:tasks.workunit.client.1.smithi086.stdout:8/40: chown f5 545 1 2024-08-19T00:55:55.840 INFO:tasks.workunit.client.1.smithi086.stdout:1/70: dwrite d4/f6 [0,4194304] 0 2024-08-19T00:55:55.844 INFO:tasks.workunit.client.1.smithi086.stdout:1/71: unlink d4/d7/fa 0 2024-08-19T00:55:55.847 INFO:tasks.workunit.client.1.smithi086.stdout:1/72: mknod d4/c15 0 2024-08-19T00:55:55.849 INFO:tasks.workunit.client.1.smithi086.stdout:1/73: symlink d4/d8/l16 0 2024-08-19T00:55:55.852 INFO:tasks.workunit.client.1.smithi086.stdout:1/74: symlink d4/d7/l17 0 2024-08-19T00:55:55.852 INFO:tasks.workunit.client.1.smithi086.stdout:1/75: truncate d4/f14 170091 0 2024-08-19T00:55:55.853 INFO:tasks.workunit.client.1.smithi086.stdout:1/76: chown d4/d8 224827346 1 2024-08-19T00:55:55.855 INFO:tasks.workunit.client.1.smithi086.stdout:1/77: creat d4/f18 x:0 0 0 2024-08-19T00:55:55.855 INFO:tasks.workunit.client.1.smithi086.stdout:8/41: write dc/fd [3415,39031] 0 2024-08-19T00:55:55.857 INFO:tasks.workunit.client.1.smithi086.stdout:8/42: mknod dc/cf 0 2024-08-19T00:55:55.859 INFO:tasks.workunit.client.1.smithi086.stdout:1/78: rename f2 to d4/d7/f19 0 2024-08-19T00:55:55.860 INFO:tasks.workunit.client.1.smithi086.stdout:8/43: chown ca 825015 1 2024-08-19T00:55:55.860 INFO:tasks.workunit.client.1.smithi086.stdout:8/44: rename dc to dc/d10 22 2024-08-19T00:55:55.861 INFO:tasks.workunit.client.1.smithi086.stdout:1/79: creat d4/d8/f1a x:0 0 0 2024-08-19T00:55:55.863 INFO:tasks.workunit.client.1.smithi086.stdout:1/80: mknod d4/c1b 0 2024-08-19T00:55:55.866 INFO:tasks.workunit.client.1.smithi086.stdout:8/45: link f7 dc/f11 0 2024-08-19T00:55:55.868 INFO:tasks.workunit.client.1.smithi086.stdout:8/46: rename f1 to dc/f12 0 2024-08-19T00:55:55.869 INFO:tasks.workunit.client.1.smithi086.stdout:1/81: dwrite d4/f18 [0,4194304] 0 2024-08-19T00:55:55.870 INFO:tasks.workunit.client.1.smithi086.stdout:8/47: mknod dc/c13 0 2024-08-19T00:55:55.871 INFO:tasks.workunit.client.1.smithi086.stdout:8/48: fsync f8 0 2024-08-19T00:55:55.873 INFO:tasks.workunit.client.1.smithi086.stdout:1/82: dread d4/f6 [0,4194304] 0 2024-08-19T00:55:55.875 INFO:tasks.workunit.client.1.smithi086.stdout:1/83: chown d4/d7/l17 373013 1 2024-08-19T00:55:55.875 INFO:tasks.workunit.client.1.smithi086.stdout:1/84: write d4/d8/f13 [742024,71174] 0 2024-08-19T00:55:55.876 INFO:tasks.workunit.client.1.smithi086.stdout:8/49: creat dc/f14 x:0 0 0 2024-08-19T00:55:55.877 INFO:tasks.workunit.client.1.smithi086.stdout:1/85: truncate d4/d8/f1a 440812 0 2024-08-19T00:55:55.882 INFO:tasks.workunit.client.1.smithi086.stdout:1/86: dread d4/d8/f13 [0,4194304] 0 2024-08-19T00:55:55.883 INFO:tasks.workunit.client.1.smithi086.stdout:1/87: write d4/f18 [1101227,10049] 0 2024-08-19T00:55:55.884 INFO:tasks.workunit.client.1.smithi086.stdout:8/50: write dc/f11 [249513,25188] 0 2024-08-19T00:55:55.884 INFO:tasks.workunit.client.1.smithi086.stdout:8/51: fsync f3 0 2024-08-19T00:55:55.889 INFO:tasks.workunit.client.1.smithi086.stdout:1/88: creat d4/d8/f1c x:0 0 0 2024-08-19T00:55:55.890 INFO:tasks.workunit.client.1.smithi086.stdout:8/52: dwrite f5 [0,4194304] 0 2024-08-19T00:55:55.891 INFO:tasks.workunit.client.1.smithi086.stdout:8/53: read dc/fd [31736,22203] 0 2024-08-19T00:55:55.892 INFO:tasks.workunit.client.1.smithi086.stdout:8/54: truncate f7 1185827 0 2024-08-19T00:55:55.895 INFO:tasks.workunit.client.1.smithi086.stdout:1/89: creat d4/d10/f1d x:0 0 0 2024-08-19T00:55:55.898 INFO:tasks.workunit.client.1.smithi086.stdout:8/55: rename f9 to dc/f15 0 2024-08-19T00:55:55.903 INFO:tasks.workunit.client.1.smithi086.stdout:1/90: fsync d4/d8/f13 0 2024-08-19T00:55:55.919 INFO:tasks.workunit.client.1.smithi086.stdout:1/91: rename d4/d8 to d4/d1e 0 2024-08-19T00:55:55.920 INFO:tasks.workunit.client.1.smithi086.stdout:8/56: write dc/fd [140501,6120] 0 2024-08-19T00:55:56.036 INFO:tasks.workunit.client.1.smithi086.stdout:1/92: creat d4/f1f x:0 0 0 2024-08-19T00:55:56.041 INFO:tasks.workunit.client.1.smithi086.stdout:1/93: dwrite d4/f6 [0,4194304] 0 2024-08-19T00:55:56.048 INFO:tasks.workunit.client.1.smithi086.stdout:1/94: dwrite d4/d10/f1d [0,4194304] 0 2024-08-19T00:55:56.057 INFO:tasks.workunit.client.1.smithi086.stdout:5/54: sync 2024-08-19T00:55:56.057 INFO:tasks.workunit.client.1.smithi086.stdout:1/95: dwrite d4/f14 [0,4194304] 0 2024-08-19T00:55:56.058 INFO:tasks.workunit.client.1.smithi086.stdout:1/96: stat d4/d7/lf 0 2024-08-19T00:55:56.059 INFO:tasks.workunit.client.1.smithi086.stdout:1/97: read d4/f6 [1531431,81849] 0 2024-08-19T00:55:56.062 INFO:tasks.workunit.client.1.smithi086.stdout:1/98: dread - d4/d1e/f1c zero size 2024-08-19T00:55:56.062 INFO:tasks.workunit.client.1.smithi086.stdout:1/99: read - d4/f1f zero size 2024-08-19T00:55:56.062 INFO:tasks.workunit.client.1.smithi086.stdout:5/55: dread d0/f6 [0,4194304] 0 2024-08-19T00:55:56.066 INFO:tasks.workunit.client.1.smithi086.stdout:5/56: mkdir d0/d8/d10 0 2024-08-19T00:55:56.167 INFO:tasks.workunit.client.1.smithi086.stdout:1/100: truncate d4/d7/f19 372372 0 2024-08-19T00:55:56.170 INFO:tasks.workunit.client.1.smithi086.stdout:1/101: rename d4/d1e/f1a to d4/d1e/f20 0 2024-08-19T00:55:56.172 INFO:tasks.workunit.client.1.smithi086.stdout:1/102: creat d4/d7/f21 x:0 0 0 2024-08-19T00:55:56.191 INFO:tasks.workunit.client.1.smithi086.stdout:1/103: write d4/f6 [505041,128788] 0 2024-08-19T00:55:56.192 INFO:tasks.workunit.client.1.smithi086.stdout:3/47: sync 2024-08-19T00:55:56.192 INFO:tasks.workunit.client.1.smithi086.stdout:7/66: sync 2024-08-19T00:55:56.192 INFO:tasks.workunit.client.1.smithi086.stdout:6/66: sync 2024-08-19T00:55:56.192 INFO:tasks.workunit.client.1.smithi086.stdout:2/43: sync 2024-08-19T00:55:56.192 INFO:tasks.workunit.client.1.smithi086.stdout:8/57: sync 2024-08-19T00:55:56.192 INFO:tasks.workunit.client.1.smithi086.stdout:4/30: sync 2024-08-19T00:55:56.192 INFO:tasks.workunit.client.1.smithi086.stdout:5/57: sync 2024-08-19T00:55:56.192 INFO:tasks.workunit.client.1.smithi086.stdout:9/38: sync 2024-08-19T00:55:56.192 INFO:tasks.workunit.client.1.smithi086.stdout:0/101: sync 2024-08-19T00:55:56.192 INFO:tasks.workunit.client.1.smithi086.stdout:8/58: chown dc 24168126 1 2024-08-19T00:55:56.193 INFO:tasks.workunit.client.1.smithi086.stdout:2/44: read - d8/fc zero size 2024-08-19T00:55:56.193 INFO:tasks.workunit.client.1.smithi086.stdout:1/104: symlink d4/d10/l22 0 2024-08-19T00:55:56.193 INFO:tasks.workunit.client.1.smithi086.stdout:9/39: read f2 [84929,76511] 0 2024-08-19T00:55:56.194 INFO:tasks.workunit.client.1.smithi086.stdout:5/58: chown d0/d8/le 8057 1 2024-08-19T00:55:56.194 INFO:tasks.workunit.client.1.smithi086.stdout:9/40: stat f6 0 2024-08-19T00:55:56.195 INFO:tasks.workunit.client.1.smithi086.stdout:7/67: creat d3/de/f12 x:0 0 0 2024-08-19T00:55:56.195 INFO:tasks.workunit.client.1.smithi086.stdout:6/67: chown db/f11 908787739 1 2024-08-19T00:55:56.195 INFO:tasks.workunit.client.1.smithi086.stdout:8/59: truncate dc/f14 503365 0 2024-08-19T00:55:56.195 INFO:tasks.workunit.client.1.smithi086.stdout:5/59: stat d0/d8/d10 0 2024-08-19T00:55:56.195 INFO:tasks.workunit.client.1.smithi086.stdout:9/41: dread - f6 zero size 2024-08-19T00:55:56.196 INFO:tasks.workunit.client.1.smithi086.stdout:0/102: fdatasync da/d14/f15 0 2024-08-19T00:55:56.197 INFO:tasks.workunit.client.1.smithi086.stdout:5/60: chown d0 761 1 2024-08-19T00:55:56.197 INFO:tasks.workunit.client.1.smithi086.stdout:9/42: dread - f4 zero size 2024-08-19T00:55:56.197 INFO:tasks.workunit.client.1.smithi086.stdout:1/105: truncate d4/d1e/f1c 866091 0 2024-08-19T00:55:56.197 INFO:tasks.workunit.client.1.smithi086.stdout:3/48: rename l0 to d3/d9/l11 0 2024-08-19T00:55:56.198 INFO:tasks.workunit.client.1.smithi086.stdout:9/43: chown f2 167 1 2024-08-19T00:55:56.198 INFO:tasks.workunit.client.1.smithi086.stdout:1/106: fsync d4/d1e/f11 0 2024-08-19T00:55:56.198 INFO:tasks.workunit.client.1.smithi086.stdout:9/44: fdatasync f4 0 2024-08-19T00:55:56.200 INFO:tasks.workunit.client.1.smithi086.stdout:9/45: chown l3 3 1 2024-08-19T00:55:56.201 INFO:tasks.workunit.client.1.smithi086.stdout:8/60: mkdir dc/d16 0 2024-08-19T00:55:56.201 INFO:tasks.workunit.client.1.smithi086.stdout:4/31: dread d2/da/f7 [0,4194304] 0 2024-08-19T00:55:56.202 INFO:tasks.workunit.client.1.smithi086.stdout:8/61: fdatasync f8 0 2024-08-19T00:55:56.203 INFO:tasks.workunit.client.1.smithi086.stdout:5/61: chown d0/c4 136638 1 2024-08-19T00:55:56.204 INFO:tasks.workunit.client.1.smithi086.stdout:0/103: creat da/d14/f24 x:0 0 0 2024-08-19T00:55:56.204 INFO:tasks.workunit.client.1.smithi086.stdout:3/49: dread d3/f6 [0,4194304] 0 2024-08-19T00:55:56.206 INFO:tasks.workunit.client.1.smithi086.stdout:2/45: rename f5 to d8/fd 0 2024-08-19T00:55:56.207 INFO:tasks.workunit.client.1.smithi086.stdout:4/32: dread d2/da/f7 [0,4194304] 0 2024-08-19T00:55:56.208 INFO:tasks.workunit.client.1.smithi086.stdout:0/104: truncate da/d14/f15 1551943 0 2024-08-19T00:55:56.208 INFO:tasks.workunit.client.1.smithi086.stdout:1/107: dwrite d4/d7/f21 [0,4194304] 0 2024-08-19T00:55:56.209 INFO:tasks.workunit.client.1.smithi086.stdout:9/46: creat fa x:0 0 0 2024-08-19T00:55:56.210 INFO:tasks.workunit.client.1.smithi086.stdout:9/47: chown fa 26301 1 2024-08-19T00:55:56.211 INFO:tasks.workunit.client.1.smithi086.stdout:0/105: write da/d14/f17 [3132654,58543] 0 2024-08-19T00:55:56.211 INFO:tasks.workunit.client.1.smithi086.stdout:8/62: mkdir dc/d17 0 2024-08-19T00:55:56.212 INFO:tasks.workunit.client.1.smithi086.stdout:0/106: chown da/d14/f24 2978470 1 2024-08-19T00:55:56.212 INFO:tasks.workunit.client.1.smithi086.stdout:7/68: write d3/f7 [1932954,75287] 0 2024-08-19T00:55:56.212 INFO:tasks.workunit.client.1.smithi086.stdout:8/63: write f5 [561035,57349] 0 2024-08-19T00:55:56.213 INFO:tasks.workunit.client.1.smithi086.stdout:5/62: dread d0/fa [0,4194304] 0 2024-08-19T00:55:56.214 INFO:tasks.workunit.client.1.smithi086.stdout:3/50: creat d3/d9/f12 x:0 0 0 2024-08-19T00:55:56.214 INFO:tasks.workunit.client.1.smithi086.stdout:6/68: write f8 [710107,114020] 0 2024-08-19T00:55:56.215 INFO:tasks.workunit.client.1.smithi086.stdout:0/107: truncate da/d14/f24 734827 0 2024-08-19T00:55:56.215 INFO:tasks.workunit.client.1.smithi086.stdout:6/69: fsync db/f11 0 2024-08-19T00:55:56.217 INFO:tasks.workunit.client.1.smithi086.stdout:6/70: fdatasync db/f11 0 2024-08-19T00:55:56.218 INFO:tasks.workunit.client.1.smithi086.stdout:2/46: rename d8/fa to d8/fe 0 2024-08-19T00:55:56.218 INFO:tasks.workunit.client.1.smithi086.stdout:6/71: read f8 [2178025,21739] 0 2024-08-19T00:55:56.221 INFO:tasks.workunit.client.1.smithi086.stdout:5/63: dwrite d0/f7 [0,4194304] 0 2024-08-19T00:55:56.224 INFO:tasks.workunit.client.1.smithi086.stdout:1/108: mknod d4/d10/c23 0 2024-08-19T00:55:56.225 INFO:tasks.workunit.client.1.smithi086.stdout:9/48: mkdir db 0 2024-08-19T00:55:56.226 INFO:tasks.workunit.client.1.smithi086.stdout:4/33: dwrite d2/f5 [4194304,4194304] 0 2024-08-19T00:55:56.226 INFO:tasks.workunit.client.1.smithi086.stdout:2/47: dread d8/fd [0,4194304] 0 2024-08-19T00:55:56.228 INFO:tasks.workunit.client.1.smithi086.stdout:2/48: chown d8/fd 1942265 1 2024-08-19T00:55:56.228 INFO:tasks.workunit.client.1.smithi086.stdout:7/69: unlink d3/lc 0 2024-08-19T00:55:56.229 INFO:tasks.workunit.client.1.smithi086.stdout:2/49: write d8/fb [80051,87536] 0 2024-08-19T00:55:56.230 INFO:tasks.workunit.client.1.smithi086.stdout:3/51: readlink d3/d9/lb 0 2024-08-19T00:55:56.232 INFO:tasks.workunit.client.1.smithi086.stdout:0/108: rename da/c19 to da/d14/d1a/c25 0 2024-08-19T00:55:56.232 INFO:tasks.workunit.client.1.smithi086.stdout:4/34: rename d2 to d2/da/db 22 2024-08-19T00:55:56.233 INFO:tasks.workunit.client.1.smithi086.stdout:0/109: chown da/d14/c23 31176 1 2024-08-19T00:55:56.234 INFO:tasks.workunit.client.1.smithi086.stdout:2/50: dread d8/fd [0,4194304] 0 2024-08-19T00:55:56.234 INFO:tasks.workunit.client.1.smithi086.stdout:6/72: creat db/f13 x:0 0 0 2024-08-19T00:55:56.234 INFO:tasks.workunit.client.1.smithi086.stdout:4/35: dread d2/da/f7 [0,4194304] 0 2024-08-19T00:55:56.235 INFO:tasks.workunit.client.1.smithi086.stdout:5/64: write d0/fa [3468461,109229] 0 2024-08-19T00:55:56.236 INFO:tasks.workunit.client.1.smithi086.stdout:5/65: chown d0/d8 19390861 1 2024-08-19T00:55:56.236 INFO:tasks.workunit.client.1.smithi086.stdout:1/109: mknod d4/c24 0 2024-08-19T00:55:56.236 INFO:tasks.workunit.client.1.smithi086.stdout:5/66: readlink d0/d8/le 0 2024-08-19T00:55:56.245 INFO:tasks.workunit.client.1.smithi086.stdout:8/64: mkdir dc/d16/d18 0 2024-08-19T00:55:56.246 INFO:tasks.workunit.client.1.smithi086.stdout:7/70: creat d3/de/f13 x:0 0 0 2024-08-19T00:55:56.247 INFO:tasks.workunit.client.1.smithi086.stdout:3/52: read d3/f6 [317741,26796] 0 2024-08-19T00:55:56.256 INFO:tasks.workunit.client.1.smithi086.stdout:0/110: mkdir da/d14/d26 0 2024-08-19T00:55:56.259 INFO:tasks.workunit.client.1.smithi086.stdout:6/73: dread f8 [0,4194304] 0 2024-08-19T00:55:56.259 INFO:tasks.workunit.client.1.smithi086.stdout:2/51: rename d8/fd to d8/ff 0 2024-08-19T00:55:56.260 INFO:tasks.workunit.client.1.smithi086.stdout:4/36: creat d2/da/fc x:0 0 0 2024-08-19T00:55:56.262 INFO:tasks.workunit.client.1.smithi086.stdout:2/52: dread f0 [0,4194304] 0 2024-08-19T00:55:56.262 INFO:tasks.workunit.client.1.smithi086.stdout:1/110: creat d4/d10/f25 x:0 0 0 2024-08-19T00:55:56.264 INFO:tasks.workunit.client.1.smithi086.stdout:5/67: rename d0/c5 to d0/df/c11 0 2024-08-19T00:55:56.266 INFO:tasks.workunit.client.1.smithi086.stdout:9/49: symlink db/lc 0 2024-08-19T00:55:56.269 INFO:tasks.workunit.client.1.smithi086.stdout:7/71: mknod d3/c14 0 2024-08-19T00:55:56.275 INFO:tasks.workunit.client.1.smithi086.stdout:6/74: creat db/f14 x:0 0 0 2024-08-19T00:55:56.282 INFO:tasks.workunit.client.1.smithi086.stdout:4/37: write d2/da/f7 [463186,118533] 0 2024-08-19T00:55:56.287 INFO:tasks.workunit.client.1.smithi086.stdout:2/53: dread f2 [0,4194304] 0 2024-08-19T00:55:56.289 INFO:tasks.workunit.client.1.smithi086.stdout:1/111: creat d4/f26 x:0 0 0 2024-08-19T00:55:56.294 INFO:tasks.workunit.client.1.smithi086.stdout:9/50: fdatasync f8 0 2024-08-19T00:55:56.295 INFO:tasks.workunit.client.1.smithi086.stdout:0/111: dwrite da/d14/f1d [0,4194304] 0 2024-08-19T00:55:56.296 INFO:tasks.workunit.client.1.smithi086.stdout:8/65: mkdir dc/d17/d19 0 2024-08-19T00:55:56.300 INFO:tasks.workunit.client.1.smithi086.stdout:6/75: creat db/f15 x:0 0 0 2024-08-19T00:55:56.306 INFO:tasks.workunit.client.1.smithi086.stdout:2/54: fsync d8/ff 0 2024-08-19T00:55:56.308 INFO:tasks.workunit.client.1.smithi086.stdout:1/112: write d4/d7/fe [4618115,89066] 0 2024-08-19T00:55:56.313 INFO:tasks.workunit.client.1.smithi086.stdout:9/51: unlink f4 0 2024-08-19T00:55:56.321 INFO:tasks.workunit.client.1.smithi086.stdout:6/76: creat db/f16 x:0 0 0 2024-08-19T00:55:56.321 INFO:tasks.workunit.client.1.smithi086.stdout:6/77: chown c7 477 1 2024-08-19T00:55:56.326 INFO:tasks.workunit.client.1.smithi086.stdout:2/55: creat d8/f10 x:0 0 0 2024-08-19T00:55:56.326 INFO:tasks.workunit.client.1.smithi086.stdout:2/56: stat d8/fe 0 2024-08-19T00:55:56.337 INFO:tasks.workunit.client.1.smithi086.stdout:5/68: truncate d0/f7 1294798 0 2024-08-19T00:55:56.338 INFO:tasks.workunit.client.1.smithi086.stdout:9/52: dwrite f7 [4194304,4194304] 0 2024-08-19T00:55:56.339 INFO:tasks.workunit.client.1.smithi086.stdout:2/57: fdatasync f2 0 2024-08-19T00:55:56.341 INFO:tasks.workunit.client.1.smithi086.stdout:3/53: sync 2024-08-19T00:55:56.342 INFO:tasks.workunit.client.1.smithi086.stdout:1/113: truncate d4/d7/f19 1089381 0 2024-08-19T00:55:56.343 INFO:tasks.workunit.client.1.smithi086.stdout:0/112: write da/fe [4404768,10135] 0 2024-08-19T00:55:56.345 INFO:tasks.workunit.client.1.smithi086.stdout:7/72: getdents d3/de 0 2024-08-19T00:55:56.348 INFO:tasks.workunit.client.1.smithi086.stdout:4/38: truncate d2/da/f7 896700 0 2024-08-19T00:55:56.350 INFO:tasks.workunit.client.1.smithi086.stdout:4/39: chown d2/f8 9078299 1 2024-08-19T00:55:56.350 INFO:tasks.workunit.client.1.smithi086.stdout:3/54: dwrite d3/d9/f12 [0,4194304] 0 2024-08-19T00:55:56.351 INFO:tasks.workunit.client.1.smithi086.stdout:9/53: mkdir db/dd 0 2024-08-19T00:55:56.353 INFO:tasks.workunit.client.1.smithi086.stdout:1/114: dwrite d4/d10/f1d [0,4194304] 0 2024-08-19T00:55:56.355 INFO:tasks.workunit.client.1.smithi086.stdout:2/58: rmdir d8 39 2024-08-19T00:55:56.360 INFO:tasks.workunit.client.1.smithi086.stdout:8/66: truncate dc/f14 319631 0 2024-08-19T00:55:56.361 INFO:tasks.workunit.client.1.smithi086.stdout:5/69: symlink d0/d8/d10/l12 0 2024-08-19T00:55:56.361 INFO:tasks.workunit.client.1.smithi086.stdout:8/67: read dc/fd [61379,52529] 0 2024-08-19T00:55:56.361 INFO:tasks.workunit.client.1.smithi086.stdout:5/70: write d0/fa [4153132,115948] 0 2024-08-19T00:55:56.362 INFO:tasks.workunit.client.1.smithi086.stdout:8/68: write f3 [1151397,50701] 0 2024-08-19T00:55:56.368 INFO:tasks.workunit.client.1.smithi086.stdout:0/113: rename da/lc to da/d14/l27 0 2024-08-19T00:55:56.379 INFO:tasks.workunit.client.1.smithi086.stdout:3/55: creat d3/d9/f13 x:0 0 0 2024-08-19T00:55:56.380 INFO:tasks.workunit.client.1.smithi086.stdout:3/56: write d3/d9/f12 [470095,128604] 0 2024-08-19T00:55:56.383 INFO:tasks.workunit.client.1.smithi086.stdout:2/59: readlink d8/l9 0 2024-08-19T00:55:56.384 INFO:tasks.workunit.client.1.smithi086.stdout:3/57: dread f2 [0,4194304] 0 2024-08-19T00:55:56.387 INFO:tasks.workunit.client.1.smithi086.stdout:2/60: dread d8/fe [0,4194304] 0 2024-08-19T00:55:56.391 INFO:tasks.workunit.client.1.smithi086.stdout:6/78: getdents db 0 2024-08-19T00:55:56.404 INFO:tasks.workunit.client.1.smithi086.stdout:3/58: rename d3/d9/fd to d3/f14 0 2024-08-19T00:55:56.405 INFO:tasks.workunit.client.1.smithi086.stdout:2/61: fdatasync f0 0 2024-08-19T00:55:56.406 INFO:tasks.workunit.client.1.smithi086.stdout:2/62: chown d8/fb 23403 1 2024-08-19T00:55:56.407 INFO:tasks.workunit.client.1.smithi086.stdout:5/71: rename d0/c1 to d0/c13 0 2024-08-19T00:55:56.407 INFO:tasks.workunit.client.1.smithi086.stdout:5/72: rename d0 to d0/d8/d14 22 2024-08-19T00:55:56.409 INFO:tasks.workunit.client.1.smithi086.stdout:7/73: truncate d3/fb 449858 0 2024-08-19T00:55:56.409 INFO:tasks.workunit.client.1.smithi086.stdout:7/74: stat d3/c14 0 2024-08-19T00:55:56.410 INFO:tasks.workunit.client.1.smithi086.stdout:8/69: mknod dc/d17/d19/c1a 0 2024-08-19T00:55:56.414 INFO:tasks.workunit.client.1.smithi086.stdout:6/79: creat db/f17 x:0 0 0 2024-08-19T00:55:56.414 INFO:tasks.workunit.client.1.smithi086.stdout:6/80: dread - db/f11 zero size 2024-08-19T00:55:56.415 INFO:tasks.workunit.client.1.smithi086.stdout:7/75: dwrite d3/de/f13 [0,4194304] 0 2024-08-19T00:55:56.417 INFO:tasks.workunit.client.1.smithi086.stdout:1/115: write d4/d7/f19 [1623423,120379] 0 2024-08-19T00:55:56.417 INFO:tasks.workunit.client.1.smithi086.stdout:9/54: link db/lc db/le 0 2024-08-19T00:55:56.419 INFO:tasks.workunit.client.1.smithi086.stdout:1/116: write d4/f26 [1010663,97071] 0 2024-08-19T00:55:56.422 INFO:tasks.workunit.client.1.smithi086.stdout:1/117: fdatasync d4/f26 0 2024-08-19T00:55:56.425 INFO:tasks.workunit.client.1.smithi086.stdout:4/40: dwrite d2/da/f7 [0,4194304] 0 2024-08-19T00:55:56.428 INFO:tasks.workunit.client.1.smithi086.stdout:0/114: creat da/f28 x:0 0 0 2024-08-19T00:55:56.430 INFO:tasks.workunit.client.1.smithi086.stdout:8/70: truncate dc/fd 831493 0 2024-08-19T00:55:56.430 INFO:tasks.workunit.client.1.smithi086.stdout:8/71: rename dc/d16 to dc/d16/d1b 22 2024-08-19T00:55:56.436 INFO:tasks.workunit.client.1.smithi086.stdout:7/76: creat d3/de/f15 x:0 0 0 2024-08-19T00:55:56.437 INFO:tasks.workunit.client.1.smithi086.stdout:7/77: stat d3/ff 0 2024-08-19T00:55:56.444 INFO:tasks.workunit.client.1.smithi086.stdout:1/118: mkdir d4/d1e/d27 0 2024-08-19T00:55:56.445 INFO:tasks.workunit.client.1.smithi086.stdout:1/119: write d4/d1e/f13 [263335,57062] 0 2024-08-19T00:55:56.447 INFO:tasks.workunit.client.1.smithi086.stdout:3/59: link d3/f6 d3/d9/f15 0 2024-08-19T00:55:56.451 INFO:tasks.workunit.client.1.smithi086.stdout:4/41: symlink d2/da/ld 0 2024-08-19T00:55:56.451 INFO:tasks.workunit.client.1.smithi086.stdout:4/42: fsync d2/f8 0 2024-08-19T00:55:56.452 INFO:tasks.workunit.client.1.smithi086.stdout:4/43: dread - d2/f8 zero size 2024-08-19T00:55:56.453 INFO:tasks.workunit.client.1.smithi086.stdout:0/115: unlink da/l12 0 2024-08-19T00:55:56.455 INFO:tasks.workunit.client.1.smithi086.stdout:4/44: dread d2/da/f7 [0,4194304] 0 2024-08-19T00:55:56.455 INFO:tasks.workunit.client.1.smithi086.stdout:4/45: readlink d2/da/ld 0 2024-08-19T00:55:56.456 INFO:tasks.workunit.client.1.smithi086.stdout:4/46: write d2/f5 [4896882,71243] 0 2024-08-19T00:55:56.462 INFO:tasks.workunit.client.1.smithi086.stdout:7/78: mknod d3/de/c16 0 2024-08-19T00:55:56.462 INFO:tasks.workunit.client.1.smithi086.stdout:4/47: dwrite d2/f8 [0,4194304] 0 2024-08-19T00:55:56.464 INFO:tasks.workunit.client.1.smithi086.stdout:4/48: write d2/da/f7 [1173489,110994] 0 2024-08-19T00:55:56.465 INFO:tasks.workunit.client.1.smithi086.stdout:9/55: truncate f8 2849092 0 2024-08-19T00:55:56.467 INFO:tasks.workunit.client.1.smithi086.stdout:1/120: creat d4/d7/f28 x:0 0 0 2024-08-19T00:55:56.478 INFO:tasks.workunit.client.1.smithi086.stdout:6/81: link f8 db/f18 0 2024-08-19T00:55:56.482 INFO:tasks.workunit.client.1.smithi086.stdout:5/73: write d0/f7 [1819617,44184] 0 2024-08-19T00:55:56.483 INFO:tasks.workunit.client.1.smithi086.stdout:4/49: creat d2/da/fe x:0 0 0 2024-08-19T00:55:56.484 INFO:tasks.workunit.client.1.smithi086.stdout:5/74: chown d0/f6 81582483 1 2024-08-19T00:55:56.488 INFO:tasks.workunit.client.1.smithi086.stdout:1/121: rename d4/d1e/l16 to d4/d1e/l29 0 2024-08-19T00:55:56.488 INFO:tasks.workunit.client.1.smithi086.stdout:7/79: dwrite f2 [0,4194304] 0 2024-08-19T00:55:56.493 INFO:tasks.workunit.client.1.smithi086.stdout:0/116: creat da/d14/d26/f29 x:0 0 0 2024-08-19T00:55:56.494 INFO:tasks.workunit.client.1.smithi086.stdout:7/80: dwrite d3/f7 [0,4194304] 0 2024-08-19T00:55:56.495 INFO:tasks.workunit.client.1.smithi086.stdout:7/81: chown d3/de/f11 658880 1 2024-08-19T00:55:56.496 INFO:tasks.workunit.client.1.smithi086.stdout:6/82: symlink db/l19 0 2024-08-19T00:55:56.499 INFO:tasks.workunit.client.1.smithi086.stdout:9/56: creat db/dd/ff x:0 0 0 2024-08-19T00:55:56.501 INFO:tasks.workunit.client.1.smithi086.stdout:4/50: rename d2/f5 to d2/da/ff 0 2024-08-19T00:55:56.502 INFO:tasks.workunit.client.1.smithi086.stdout:5/75: mknod d0/d8/d10/c15 0 2024-08-19T00:55:56.506 INFO:tasks.workunit.client.1.smithi086.stdout:3/60: link d3/c8 d3/c16 0 2024-08-19T00:55:56.509 INFO:tasks.workunit.client.1.smithi086.stdout:8/72: getdents dc/d17/d19 0 2024-08-19T00:55:56.511 INFO:tasks.workunit.client.1.smithi086.stdout:0/117: dread da/f10 [0,4194304] 0 2024-08-19T00:55:56.513 INFO:tasks.workunit.client.1.smithi086.stdout:7/82: rename f2 to d3/de/f17 0 2024-08-19T00:55:56.514 INFO:tasks.workunit.client.1.smithi086.stdout:4/51: symlink d2/l10 0 2024-08-19T00:55:56.515 INFO:tasks.workunit.client.1.smithi086.stdout:6/83: dread f8 [0,4194304] 0 2024-08-19T00:55:56.517 INFO:tasks.workunit.client.1.smithi086.stdout:8/73: dwrite f7 [0,4194304] 0 2024-08-19T00:55:56.521 INFO:tasks.workunit.client.1.smithi086.stdout:0/118: symlink da/d14/d26/l2a 0 2024-08-19T00:55:56.522 INFO:tasks.workunit.client.1.smithi086.stdout:0/119: dread - da/d14/d26/f29 zero size 2024-08-19T00:55:56.522 INFO:tasks.workunit.client.1.smithi086.stdout:0/120: fdatasync da/d14/f1d 0 2024-08-19T00:55:56.526 INFO:tasks.workunit.client.1.smithi086.stdout:4/52: unlink d2/da/f7 0 2024-08-19T00:55:56.528 INFO:tasks.workunit.client.1.smithi086.stdout:3/61: chown d3/c16 203043 1 2024-08-19T00:55:56.529 INFO:tasks.workunit.client.1.smithi086.stdout:7/83: dwrite d3/de/f13 [0,4194304] 0 2024-08-19T00:55:56.530 INFO:tasks.workunit.client.1.smithi086.stdout:6/84: creat db/f1a x:0 0 0 2024-08-19T00:55:56.534 INFO:tasks.workunit.client.1.smithi086.stdout:9/57: truncate f8 2205550 0 2024-08-19T00:55:56.534 INFO:tasks.workunit.client.1.smithi086.stdout:8/74: fdatasync f7 0 2024-08-19T00:55:56.540 INFO:tasks.workunit.client.1.smithi086.stdout:0/121: creat da/d14/d26/f2b x:0 0 0 2024-08-19T00:55:56.542 INFO:tasks.workunit.client.1.smithi086.stdout:4/53: mknod d2/c11 0 2024-08-19T00:55:56.544 INFO:tasks.workunit.client.1.smithi086.stdout:7/84: mknod d3/c18 0 2024-08-19T00:55:56.545 INFO:tasks.workunit.client.1.smithi086.stdout:7/85: chown d3/ff 48251 1 2024-08-19T00:55:56.549 INFO:tasks.workunit.client.1.smithi086.stdout:6/85: mkdir db/d1b 0 2024-08-19T00:55:56.551 INFO:tasks.workunit.client.1.smithi086.stdout:9/58: symlink db/l10 0 2024-08-19T00:55:56.555 INFO:tasks.workunit.client.1.smithi086.stdout:0/122: creat da/d14/d26/f2c x:0 0 0 2024-08-19T00:55:56.556 INFO:tasks.workunit.client.1.smithi086.stdout:0/123: truncate da/d14/d26/f2c 161871 0 2024-08-19T00:55:56.558 INFO:tasks.workunit.client.1.smithi086.stdout:0/124: read da/fe [2041247,47904] 0 2024-08-19T00:55:56.558 INFO:tasks.workunit.client.1.smithi086.stdout:4/54: chown d2/da/c9 7452 1 2024-08-19T00:55:56.558 INFO:tasks.workunit.client.1.smithi086.stdout:0/125: write da/d14/f17 [2190211,88121] 0 2024-08-19T00:55:56.564 INFO:tasks.workunit.client.1.smithi086.stdout:1/122: truncate d4/f14 1794222 0 2024-08-19T00:55:56.565 INFO:tasks.workunit.client.1.smithi086.stdout:1/123: dread - d4/f1f zero size 2024-08-19T00:55:56.574 INFO:tasks.workunit.client.1.smithi086.stdout:4/55: rename d2/da/ld to d2/l12 0 2024-08-19T00:55:56.574 INFO:tasks.workunit.client.1.smithi086.stdout:4/56: fdatasync d2/f8 0 2024-08-19T00:55:56.575 INFO:tasks.workunit.client.1.smithi086.stdout:0/126: chown da/d14/d1a/l1c 62 1 2024-08-19T00:55:56.576 INFO:tasks.workunit.client.1.smithi086.stdout:0/127: chown da/ff 3542 1 2024-08-19T00:55:56.576 INFO:tasks.workunit.client.1.smithi086.stdout:0/128: read - da/f28 zero size 2024-08-19T00:55:56.577 INFO:tasks.workunit.client.1.smithi086.stdout:6/86: mknod db/d1b/c1c 0 2024-08-19T00:55:56.579 INFO:tasks.workunit.client.1.smithi086.stdout:2/63: sync 2024-08-19T00:55:56.579 INFO:tasks.workunit.client.1.smithi086.stdout:5/76: sync 2024-08-19T00:55:56.586 INFO:tasks.workunit.client.1.smithi086.stdout:4/57: creat d2/da/f13 x:0 0 0 2024-08-19T00:55:56.586 INFO:tasks.workunit.client.1.smithi086.stdout:0/129: creat da/d14/f2d x:0 0 0 2024-08-19T00:55:56.588 INFO:tasks.workunit.client.1.smithi086.stdout:6/87: symlink db/l1d 0 2024-08-19T00:55:56.590 INFO:tasks.workunit.client.1.smithi086.stdout:5/77: symlink d0/l16 0 2024-08-19T00:55:56.591 INFO:tasks.workunit.client.1.smithi086.stdout:5/78: fsync d0/f6 0 2024-08-19T00:55:56.592 INFO:tasks.workunit.client.1.smithi086.stdout:2/64: fdatasync d8/fe 0 2024-08-19T00:55:56.595 INFO:tasks.workunit.client.1.smithi086.stdout:7/86: getdents d3 0 2024-08-19T00:55:56.595 INFO:tasks.workunit.client.1.smithi086.stdout:4/58: dwrite d2/f8 [4194304,4194304] 0 2024-08-19T00:55:56.597 INFO:tasks.workunit.client.1.smithi086.stdout:6/88: unlink db/f17 0 2024-08-19T00:55:56.597 INFO:tasks.workunit.client.1.smithi086.stdout:7/87: chown d3/c14 102602 1 2024-08-19T00:55:56.597 INFO:tasks.workunit.client.1.smithi086.stdout:0/130: dwrite da/d14/d26/f29 [0,4194304] 0 2024-08-19T00:55:56.603 INFO:tasks.workunit.client.1.smithi086.stdout:1/124: getdents d4 0 2024-08-19T00:55:56.605 INFO:tasks.workunit.client.1.smithi086.stdout:2/65: creat d8/f11 x:0 0 0 2024-08-19T00:55:56.605 INFO:tasks.workunit.client.1.smithi086.stdout:5/79: dread d0/fb [0,4194304] 0 2024-08-19T00:55:56.607 INFO:tasks.workunit.client.1.smithi086.stdout:1/125: write d4/f26 [897053,49308] 0 2024-08-19T00:55:56.610 INFO:tasks.workunit.client.1.smithi086.stdout:2/66: write d8/fb [539268,38049] 0 2024-08-19T00:55:56.611 INFO:tasks.workunit.client.1.smithi086.stdout:3/62: dwrite d3/d9/f15 [0,4194304] 0 2024-08-19T00:55:56.612 INFO:tasks.workunit.client.1.smithi086.stdout:0/131: mkdir da/d14/d1a/d2e 0 2024-08-19T00:55:56.613 INFO:tasks.workunit.client.1.smithi086.stdout:0/132: stat l5 0 2024-08-19T00:55:56.614 INFO:tasks.workunit.client.1.smithi086.stdout:6/89: dwrite f3 [0,4194304] 0 2024-08-19T00:55:56.621 INFO:tasks.workunit.client.1.smithi086.stdout:5/80: creat d0/f17 x:0 0 0 2024-08-19T00:55:56.631 INFO:tasks.workunit.client.1.smithi086.stdout:1/126: dwrite d4/d7/fe [0,4194304] 0 2024-08-19T00:55:56.632 INFO:tasks.workunit.client.1.smithi086.stdout:5/81: chown d0/d8/lc 364565 1 2024-08-19T00:55:56.637 INFO:tasks.workunit.client.1.smithi086.stdout:5/82: fsync d0/f6 0 2024-08-19T00:55:56.638 INFO:tasks.workunit.client.1.smithi086.stdout:9/59: dwrite f2 [0,4194304] 0 2024-08-19T00:55:56.638 INFO:tasks.workunit.client.1.smithi086.stdout:0/133: rename da/d14/l27 to da/d14/l2f 0 2024-08-19T00:55:56.640 INFO:tasks.workunit.client.1.smithi086.stdout:8/75: dwrite dc/fd [0,4194304] 0 2024-08-19T00:55:56.642 INFO:tasks.workunit.client.1.smithi086.stdout:3/63: dwrite d3/d9/fa [0,4194304] 0 2024-08-19T00:55:56.642 INFO:tasks.workunit.client.1.smithi086.stdout:7/88: getdents d3/de 0 2024-08-19T00:55:56.649 INFO:tasks.workunit.client.1.smithi086.stdout:6/90: link db/lf db/l1e 0 2024-08-19T00:55:56.653 INFO:tasks.workunit.client.1.smithi086.stdout:6/91: stat db/f16 0 2024-08-19T00:55:56.653 INFO:tasks.workunit.client.1.smithi086.stdout:2/67: fsync d8/f11 0 2024-08-19T00:55:56.655 INFO:tasks.workunit.client.1.smithi086.stdout:3/64: readlink d3/d9/l11 0 2024-08-19T00:55:56.656 INFO:tasks.workunit.client.1.smithi086.stdout:6/92: read - db/f1a zero size 2024-08-19T00:55:56.658 INFO:tasks.workunit.client.1.smithi086.stdout:0/134: mkdir da/d14/d1a/d2e/d30 0 2024-08-19T00:55:56.659 INFO:tasks.workunit.client.1.smithi086.stdout:8/76: dwrite f8 [0,4194304] 0 2024-08-19T00:55:56.659 INFO:tasks.workunit.client.1.smithi086.stdout:3/65: fdatasync d3/f6 0 2024-08-19T00:55:56.659 INFO:tasks.workunit.client.1.smithi086.stdout:2/68: write d8/fb [976240,128012] 0 2024-08-19T00:55:56.661 INFO:tasks.workunit.client.1.smithi086.stdout:5/83: dwrite d0/fb [0,4194304] 0 2024-08-19T00:55:56.663 INFO:tasks.workunit.client.1.smithi086.stdout:8/77: readlink lb 0 2024-08-19T00:55:56.666 INFO:tasks.workunit.client.1.smithi086.stdout:4/59: truncate d2/f8 7542293 0 2024-08-19T00:55:56.667 INFO:tasks.workunit.client.1.smithi086.stdout:7/89: dread d3/ff [0,4194304] 0 2024-08-19T00:55:56.670 INFO:tasks.workunit.client.1.smithi086.stdout:7/90: fdatasync d3/de/f11 0 2024-08-19T00:55:56.670 INFO:tasks.workunit.client.1.smithi086.stdout:1/127: getdents d4/d7 0 2024-08-19T00:55:56.671 INFO:tasks.workunit.client.1.smithi086.stdout:5/84: creat d0/df/f18 x:0 0 0 2024-08-19T00:55:56.672 INFO:tasks.workunit.client.1.smithi086.stdout:3/66: mknod d3/d9/c17 0 2024-08-19T00:55:56.673 INFO:tasks.workunit.client.1.smithi086.stdout:7/91: chown d3/l6 1875 1 2024-08-19T00:55:56.673 INFO:tasks.workunit.client.1.smithi086.stdout:0/135: symlink da/d14/d26/l31 0 2024-08-19T00:55:56.674 INFO:tasks.workunit.client.1.smithi086.stdout:6/93: dwrite f3 [0,4194304] 0 2024-08-19T00:55:56.675 INFO:tasks.workunit.client.1.smithi086.stdout:3/67: chown d3/f14 15 1 2024-08-19T00:55:56.676 INFO:tasks.workunit.client.1.smithi086.stdout:6/94: fdatasync db/f13 0 2024-08-19T00:55:56.676 INFO:tasks.workunit.client.1.smithi086.stdout:0/136: chown da/c1f 6700446 1 2024-08-19T00:55:56.678 INFO:tasks.workunit.client.1.smithi086.stdout:4/60: creat d2/da/f14 x:0 0 0 2024-08-19T00:55:56.682 INFO:tasks.workunit.client.1.smithi086.stdout:5/85: creat d0/d8/d10/f19 x:0 0 0 2024-08-19T00:55:56.682 INFO:tasks.workunit.client.1.smithi086.stdout:8/78: dwrite f5 [0,4194304] 0 2024-08-19T00:55:56.684 INFO:tasks.workunit.client.1.smithi086.stdout:9/60: truncate f8 2941584 0 2024-08-19T00:55:56.684 INFO:tasks.workunit.client.1.smithi086.stdout:3/68: mkdir d3/d18 0 2024-08-19T00:55:56.686 INFO:tasks.workunit.client.1.smithi086.stdout:6/95: unlink db/l10 0 2024-08-19T00:55:56.687 INFO:tasks.workunit.client.1.smithi086.stdout:1/128: dwrite d4/d1e/f11 [0,4194304] 0 2024-08-19T00:55:56.690 INFO:tasks.workunit.client.1.smithi086.stdout:1/129: fdatasync d4/f6 0 2024-08-19T00:55:56.690 INFO:tasks.workunit.client.1.smithi086.stdout:0/137: symlink da/d14/d26/l32 0 2024-08-19T00:55:56.695 INFO:tasks.workunit.client.1.smithi086.stdout:7/92: getdents d3/de 0 2024-08-19T00:55:56.697 INFO:tasks.workunit.client.1.smithi086.stdout:9/61: unlink db/lc 0 2024-08-19T00:55:56.698 INFO:tasks.workunit.client.1.smithi086.stdout:5/86: dwrite d0/f7 [0,4194304] 0 2024-08-19T00:55:56.698 INFO:tasks.workunit.client.1.smithi086.stdout:8/79: dwrite f8 [0,4194304] 0 2024-08-19T00:55:56.699 INFO:tasks.workunit.client.1.smithi086.stdout:1/130: mkdir d4/d7/d2a 0 2024-08-19T00:55:56.700 INFO:tasks.workunit.client.1.smithi086.stdout:5/87: fsync d0/f17 0 2024-08-19T00:55:56.700 INFO:tasks.workunit.client.1.smithi086.stdout:6/96: dread db/f18 [0,4194304] 0 2024-08-19T00:55:56.702 INFO:tasks.workunit.client.1.smithi086.stdout:5/88: dread - d0/df/f18 zero size 2024-08-19T00:55:56.703 INFO:tasks.workunit.client.1.smithi086.stdout:3/69: mkdir d3/d18/d19 0 2024-08-19T00:55:56.703 INFO:tasks.workunit.client.1.smithi086.stdout:6/97: fdatasync db/f11 0 2024-08-19T00:55:56.705 INFO:tasks.workunit.client.1.smithi086.stdout:7/93: unlink d3/de/f13 0 2024-08-19T00:55:56.706 INFO:tasks.workunit.client.1.smithi086.stdout:8/80: dread dc/f15 [0,4194304] 0 2024-08-19T00:55:56.707 INFO:tasks.workunit.client.1.smithi086.stdout:4/61: link d2/l10 d2/da/l15 0 2024-08-19T00:55:56.708 INFO:tasks.workunit.client.1.smithi086.stdout:7/94: fdatasync d3/de/f12 0 2024-08-19T00:55:56.709 INFO:tasks.workunit.client.1.smithi086.stdout:7/95: read d3/de/f11 [850142,2432] 0 2024-08-19T00:55:56.710 INFO:tasks.workunit.client.1.smithi086.stdout:9/62: readlink db/le 0 2024-08-19T00:55:56.711 INFO:tasks.workunit.client.1.smithi086.stdout:9/63: truncate f6 849757 0 2024-08-19T00:55:56.712 INFO:tasks.workunit.client.1.smithi086.stdout:5/89: dwrite d0/fb [0,4194304] 0 2024-08-19T00:55:56.713 INFO:tasks.workunit.client.1.smithi086.stdout:0/138: link da/ff da/d14/d26/f33 0 2024-08-19T00:55:56.719 INFO:tasks.workunit.client.1.smithi086.stdout:3/70: mkdir d3/d18/d1a 0 2024-08-19T00:55:56.719 INFO:tasks.workunit.client.1.smithi086.stdout:6/98: symlink db/l1f 0 2024-08-19T00:55:56.720 INFO:tasks.workunit.client.1.smithi086.stdout:4/62: creat d2/da/f16 x:0 0 0 2024-08-19T00:55:56.722 INFO:tasks.workunit.client.1.smithi086.stdout:7/96: symlink d3/l19 0 2024-08-19T00:55:56.723 INFO:tasks.workunit.client.1.smithi086.stdout:4/63: dread d2/f8 [4194304,4194304] 0 2024-08-19T00:55:56.726 INFO:tasks.workunit.client.1.smithi086.stdout:0/139: symlink da/d14/l34 0 2024-08-19T00:55:56.729 INFO:tasks.workunit.client.1.smithi086.stdout:6/99: creat db/d1b/f20 x:0 0 0 2024-08-19T00:55:56.731 INFO:tasks.workunit.client.1.smithi086.stdout:6/100: write db/f11 [644029,37611] 0 2024-08-19T00:55:56.734 INFO:tasks.workunit.client.1.smithi086.stdout:7/97: mknod d3/de/c1a 0 2024-08-19T00:55:56.734 INFO:tasks.workunit.client.1.smithi086.stdout:6/101: dread f8 [0,4194304] 0 2024-08-19T00:55:56.735 INFO:tasks.workunit.client.1.smithi086.stdout:6/102: write db/f13 [957147,73135] 0 2024-08-19T00:55:56.738 INFO:tasks.workunit.client.1.smithi086.stdout:9/64: creat db/f11 x:0 0 0 2024-08-19T00:55:56.739 INFO:tasks.workunit.client.1.smithi086.stdout:4/64: mknod d2/c17 0 2024-08-19T00:55:56.740 INFO:tasks.workunit.client.1.smithi086.stdout:3/71: symlink d3/d18/d1a/l1b 0 2024-08-19T00:55:56.740 INFO:tasks.workunit.client.1.smithi086.stdout:4/65: fsync d2/da/fc 0 2024-08-19T00:55:56.742 INFO:tasks.workunit.client.1.smithi086.stdout:6/103: dwrite db/d1b/f20 [0,4194304] 0 2024-08-19T00:55:56.743 INFO:tasks.workunit.client.1.smithi086.stdout:7/98: mkdir d3/de/d1b 0 2024-08-19T00:55:56.747 INFO:tasks.workunit.client.1.smithi086.stdout:8/81: truncate f5 2468389 0 2024-08-19T00:55:56.750 INFO:tasks.workunit.client.1.smithi086.stdout:3/72: dwrite d3/f6 [4194304,4194304] 0 2024-08-19T00:55:56.750 INFO:tasks.workunit.client.1.smithi086.stdout:0/140: link da/d14/f2d da/d14/d1a/d2e/f35 0 2024-08-19T00:55:56.751 INFO:tasks.workunit.client.1.smithi086.stdout:4/66: mkdir d2/d18 0 2024-08-19T00:55:56.759 INFO:tasks.workunit.client.1.smithi086.stdout:3/73: creat d3/d18/f1c x:0 0 0 2024-08-19T00:55:56.760 INFO:tasks.workunit.client.1.smithi086.stdout:3/74: write d3/f5 [4390229,39870] 0 2024-08-19T00:55:56.762 INFO:tasks.workunit.client.1.smithi086.stdout:4/67: readlink d2/l10 0 2024-08-19T00:55:56.765 INFO:tasks.workunit.client.1.smithi086.stdout:9/65: fdatasync db/dd/ff 0 2024-08-19T00:55:56.766 INFO:tasks.workunit.client.1.smithi086.stdout:9/66: dread f6 [0,4194304] 0 2024-08-19T00:55:56.770 INFO:tasks.workunit.client.1.smithi086.stdout:0/141: creat da/f36 x:0 0 0 2024-08-19T00:55:56.771 INFO:tasks.workunit.client.1.smithi086.stdout:0/142: read da/d14/d26/f33 [3362689,98798] 0 2024-08-19T00:55:56.772 INFO:tasks.workunit.client.1.smithi086.stdout:0/143: write da/d14/f1b [878824,81190] 0 2024-08-19T00:55:56.773 INFO:tasks.workunit.client.1.smithi086.stdout:0/144: read da/d14/d26/f2c [45150,31079] 0 2024-08-19T00:55:56.774 INFO:tasks.workunit.client.1.smithi086.stdout:4/68: creat d2/d18/f19 x:0 0 0 2024-08-19T00:55:56.775 INFO:tasks.workunit.client.1.smithi086.stdout:3/75: rmdir d3 39 2024-08-19T00:55:56.776 INFO:tasks.workunit.client.1.smithi086.stdout:6/104: truncate db/f13 138141 0 2024-08-19T00:55:56.781 INFO:tasks.workunit.client.1.smithi086.stdout:4/69: dwrite d2/d18/f19 [0,4194304] 0 2024-08-19T00:55:56.782 INFO:tasks.workunit.client.1.smithi086.stdout:3/76: readlink d3/d9/lb 0 2024-08-19T00:55:56.786 INFO:tasks.workunit.client.1.smithi086.stdout:8/82: dwrite f5 [0,4194304] 0 2024-08-19T00:55:56.786 INFO:tasks.workunit.client.1.smithi086.stdout:6/105: creat db/d1b/f21 x:0 0 0 2024-08-19T00:55:56.788 INFO:tasks.workunit.client.1.smithi086.stdout:9/67: getdents db 0 2024-08-19T00:55:56.789 INFO:tasks.workunit.client.1.smithi086.stdout:8/83: write dc/f11 [4021654,115370] 0 2024-08-19T00:55:56.794 INFO:tasks.workunit.client.1.smithi086.stdout:3/77: dwrite d3/d18/f1c [0,4194304] 0 2024-08-19T00:55:56.798 INFO:tasks.workunit.client.1.smithi086.stdout:8/84: creat dc/f1c x:0 0 0 2024-08-19T00:55:56.799 INFO:tasks.workunit.client.1.smithi086.stdout:9/68: mknod db/dd/c12 0 2024-08-19T00:55:56.799 INFO:tasks.workunit.client.1.smithi086.stdout:9/69: fdatasync f2 0 2024-08-19T00:55:56.800 INFO:tasks.workunit.client.1.smithi086.stdout:4/70: link c1 d2/d18/c1a 0 2024-08-19T00:55:56.801 INFO:tasks.workunit.client.1.smithi086.stdout:4/71: truncate d2/d18/f19 4937766 0 2024-08-19T00:55:56.804 INFO:tasks.workunit.client.1.smithi086.stdout:8/85: mknod dc/c1d 0 2024-08-19T00:55:56.804 INFO:tasks.workunit.client.1.smithi086.stdout:3/78: creat d3/d18/d19/f1d x:0 0 0 2024-08-19T00:55:56.805 INFO:tasks.workunit.client.1.smithi086.stdout:6/106: getdents db/d1b 0 2024-08-19T00:55:56.808 INFO:tasks.workunit.client.1.smithi086.stdout:3/79: write d3/f5 [4537981,81729] 0 2024-08-19T00:55:56.809 INFO:tasks.workunit.client.1.smithi086.stdout:6/107: mknod db/c22 0 2024-08-19T00:55:56.811 INFO:tasks.workunit.client.1.smithi086.stdout:6/108: dread - db/d1b/f21 zero size 2024-08-19T00:55:56.812 INFO:tasks.workunit.client.1.smithi086.stdout:4/72: dwrite d2/d18/f19 [0,4194304] 0 2024-08-19T00:55:56.813 INFO:tasks.workunit.client.1.smithi086.stdout:4/73: fdatasync d2/da/fe 0 2024-08-19T00:55:56.815 INFO:tasks.workunit.client.1.smithi086.stdout:9/70: dread f8 [0,4194304] 0 2024-08-19T00:55:56.818 INFO:tasks.workunit.client.1.smithi086.stdout:8/86: truncate dc/f14 1220345 0 2024-08-19T00:55:56.818 INFO:tasks.workunit.client.1.smithi086.stdout:8/87: dread - dc/f1c zero size 2024-08-19T00:55:56.819 INFO:tasks.workunit.client.1.smithi086.stdout:3/80: rename d3/d9/c17 to d3/d18/d19/c1e 0 2024-08-19T00:55:56.820 INFO:tasks.workunit.client.1.smithi086.stdout:3/81: write d3/f5 [2763996,66799] 0 2024-08-19T00:55:56.821 INFO:tasks.workunit.client.1.smithi086.stdout:3/82: write d3/d9/f15 [2726171,129909] 0 2024-08-19T00:55:56.822 INFO:tasks.workunit.client.1.smithi086.stdout:4/74: creat d2/f1b x:0 0 0 2024-08-19T00:55:56.823 INFO:tasks.workunit.client.1.smithi086.stdout:6/109: creat db/f23 x:0 0 0 2024-08-19T00:55:56.823 INFO:tasks.workunit.client.1.smithi086.stdout:9/71: readlink db/le 0 2024-08-19T00:55:56.824 INFO:tasks.workunit.client.1.smithi086.stdout:8/88: dread dc/fd [0,4194304] 0 2024-08-19T00:55:56.824 INFO:tasks.workunit.client.1.smithi086.stdout:4/75: dread - d2/f1b zero size 2024-08-19T00:55:56.825 INFO:tasks.workunit.client.1.smithi086.stdout:9/72: chown db/le 57 1 2024-08-19T00:55:56.825 INFO:tasks.workunit.client.1.smithi086.stdout:9/73: stat f8 0 2024-08-19T00:55:56.826 INFO:tasks.workunit.client.1.smithi086.stdout:3/83: rename d3/d18/d19/f1d to d3/d18/d19/f1f 0 2024-08-19T00:55:56.846 INFO:tasks.workunit.client.1.smithi086.stdout:2/69: sync 2024-08-19T00:55:56.859 INFO:tasks.workunit.client.1.smithi086.stdout:4/76: mkdir d2/d1c 0 2024-08-19T00:55:56.860 INFO:tasks.workunit.client.1.smithi086.stdout:8/89: mkdir dc/d17/d1e 0 2024-08-19T00:55:56.860 INFO:tasks.workunit.client.1.smithi086.stdout:9/74: mknod db/c13 0 2024-08-19T00:55:56.862 INFO:tasks.workunit.client.1.smithi086.stdout:6/110: dwrite db/f11 [0,4194304] 0 2024-08-19T00:55:56.864 INFO:tasks.workunit.client.1.smithi086.stdout:2/70: read f0 [2795059,117337] 0 2024-08-19T00:55:56.864 INFO:tasks.workunit.client.1.smithi086.stdout:8/90: mkdir dc/d1f 0 2024-08-19T00:55:56.864 INFO:tasks.workunit.client.1.smithi086.stdout:8/91: readlink lb 0 2024-08-19T00:55:56.865 INFO:tasks.workunit.client.1.smithi086.stdout:2/71: read f0 [562490,48128] 0 2024-08-19T00:55:56.865 INFO:tasks.workunit.client.1.smithi086.stdout:8/92: read f8 [3706234,101851] 0 2024-08-19T00:55:56.865 INFO:tasks.workunit.client.1.smithi086.stdout:3/84: dread d3/d9/fa [0,4194304] 0 2024-08-19T00:55:56.866 INFO:tasks.workunit.client.1.smithi086.stdout:4/77: mkdir d2/d1c/d1d 0 2024-08-19T00:55:56.869 INFO:tasks.workunit.client.1.smithi086.stdout:9/75: truncate f2 2393153 0 2024-08-19T00:55:56.870 INFO:tasks.workunit.client.1.smithi086.stdout:2/72: rename d8/fb to d8/f12 0 2024-08-19T00:55:56.873 INFO:tasks.workunit.client.1.smithi086.stdout:3/85: mkdir d3/d18/d19/d20 0 2024-08-19T00:55:56.878 INFO:tasks.workunit.client.1.smithi086.stdout:9/76: creat db/dd/f14 x:0 0 0 2024-08-19T00:55:56.880 INFO:tasks.workunit.client.1.smithi086.stdout:2/73: symlink d8/l13 0 2024-08-19T00:55:56.880 INFO:tasks.workunit.client.1.smithi086.stdout:2/74: read - d8/fc zero size 2024-08-19T00:55:56.881 INFO:tasks.workunit.client.1.smithi086.stdout:8/93: creat dc/d17/d1e/f20 x:0 0 0 2024-08-19T00:55:56.886 INFO:tasks.workunit.client.1.smithi086.stdout:9/77: creat db/f15 x:0 0 0 2024-08-19T00:55:56.886 INFO:tasks.workunit.client.1.smithi086.stdout:3/86: creat d3/d18/d19/d20/f21 x:0 0 0 2024-08-19T00:55:56.889 INFO:tasks.workunit.client.1.smithi086.stdout:8/94: rename c0 to dc/d17/c21 0 2024-08-19T00:55:56.891 INFO:tasks.workunit.client.1.smithi086.stdout:6/111: truncate db/f11 567484 0 2024-08-19T00:55:56.892 INFO:tasks.workunit.client.1.smithi086.stdout:6/112: chown db/d1b/f20 247402 1 2024-08-19T00:55:56.895 INFO:tasks.workunit.client.1.smithi086.stdout:3/87: creat d3/d18/f22 x:0 0 0 2024-08-19T00:55:56.895 INFO:tasks.workunit.client.1.smithi086.stdout:3/88: read d3/f5 [3103160,48808] 0 2024-08-19T00:55:56.896 INFO:tasks.workunit.client.1.smithi086.stdout:6/113: creat db/d1b/f24 x:0 0 0 2024-08-19T00:55:56.902 INFO:tasks.workunit.client.1.smithi086.stdout:3/89: rename d3/d9/ce to d3/d18/d1a/c23 0 2024-08-19T00:55:56.906 INFO:tasks.workunit.client.1.smithi086.stdout:3/90: creat d3/d18/f24 x:0 0 0 2024-08-19T00:55:56.907 INFO:tasks.workunit.client.1.smithi086.stdout:3/91: truncate d3/d18/f1c 5212390 0 2024-08-19T00:55:56.907 INFO:tasks.workunit.client.1.smithi086.stdout:3/92: dread - d3/d18/d19/d20/f21 zero size 2024-08-19T00:55:56.911 INFO:tasks.workunit.client.1.smithi086.stdout:3/93: symlink d3/d9/l25 0 2024-08-19T00:55:56.912 INFO:tasks.workunit.client.1.smithi086.stdout:9/78: dwrite f8 [0,4194304] 0 2024-08-19T00:55:56.912 INFO:tasks.workunit.client.1.smithi086.stdout:3/94: chown d3/d9/f12 1559 1 2024-08-19T00:55:56.913 INFO:tasks.workunit.client.1.smithi086.stdout:3/95: chown d3/d9/f12 130566630 1 2024-08-19T00:55:56.914 INFO:tasks.workunit.client.1.smithi086.stdout:9/79: creat db/f16 x:0 0 0 2024-08-19T00:55:56.914 INFO:tasks.workunit.client.1.smithi086.stdout:6/114: write f8 [577050,120828] 0 2024-08-19T00:55:56.931 INFO:tasks.workunit.client.1.smithi086.stdout:3/96: dwrite d3/f14 [0,4194304] 0 2024-08-19T00:55:56.932 INFO:tasks.workunit.client.1.smithi086.stdout:3/97: fdatasync d3/d9/f13 0 2024-08-19T00:55:56.937 INFO:tasks.workunit.client.1.smithi086.stdout:3/98: dread d3/d9/f15 [0,4194304] 0 2024-08-19T00:55:56.938 INFO:tasks.workunit.client.1.smithi086.stdout:3/99: chown d3/d18/f1c 27291689 1 2024-08-19T00:55:56.939 INFO:tasks.workunit.client.1.smithi086.stdout:6/115: dwrite db/f13 [0,4194304] 0 2024-08-19T00:55:56.945 INFO:tasks.workunit.client.1.smithi086.stdout:3/100: dwrite d3/d18/f24 [0,4194304] 0 2024-08-19T00:55:56.966 INFO:tasks.workunit.client.0.smithi017.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-08-19T00:55:56.971 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-19T00:55:56.971 INFO:tasks.workunit.client.0.smithi017.stderr:+ make 2024-08-19T00:55:56.977 INFO:tasks.workunit.client.1.smithi086.stdout:1/131: sync 2024-08-19T00:55:56.978 INFO:tasks.workunit.client.1.smithi086.stdout:1/132: read d4/d1e/f1c [803050,93275] 0 2024-08-19T00:55:56.979 INFO:tasks.workunit.client.1.smithi086.stdout:1/133: chown d4/f6 989 1 2024-08-19T00:55:57.034 INFO:tasks.workunit.client.1.smithi086.stdout:9/80: getdents db/dd 0 2024-08-19T00:55:57.037 INFO:tasks.workunit.client.1.smithi086.stdout:6/116: write db/f11 [131936,112932] 0 2024-08-19T00:55:57.039 INFO:tasks.workunit.client.1.smithi086.stdout:3/101: mkdir d3/d26 0 2024-08-19T00:55:57.043 INFO:tasks.workunit.client.1.smithi086.stdout:3/102: mkdir d3/d18/d27 0 2024-08-19T00:55:57.044 INFO:tasks.workunit.client.1.smithi086.stdout:1/134: creat d4/d7/d2a/f2b x:0 0 0 2024-08-19T00:55:57.044 INFO:tasks.workunit.client.1.smithi086.stdout:6/117: dwrite db/d1b/f20 [4194304,4194304] 0 2024-08-19T00:55:57.046 INFO:tasks.workunit.client.1.smithi086.stdout:5/90: sync 2024-08-19T00:55:57.046 INFO:tasks.workunit.client.1.smithi086.stdout:7/99: sync 2024-08-19T00:55:57.046 INFO:tasks.workunit.client.1.smithi086.stdout:6/118: write db/f15 [1025245,117376] 0 2024-08-19T00:55:57.049 INFO:tasks.workunit.client.1.smithi086.stdout:1/135: fdatasync d4/d1e/f20 0 2024-08-19T00:55:57.049 INFO:tasks.workunit.client.1.smithi086.stdout:6/119: write db/f1a [181917,31389] 0 2024-08-19T00:55:57.051 INFO:tasks.workunit.client.1.smithi086.stdout:5/91: creat d0/df/f1a x:0 0 0 2024-08-19T00:55:57.052 INFO:tasks.workunit.client.1.smithi086.stdout:6/120: write db/f18 [4014513,124688] 0 2024-08-19T00:55:57.052 INFO:tasks.workunit.client.1.smithi086.stdout:1/136: mknod d4/d7/c2c 0 2024-08-19T00:55:57.053 INFO:tasks.workunit.client.1.smithi086.stdout:3/103: dread d3/f14 [0,4194304] 0 2024-08-19T00:55:57.057 INFO:tasks.workunit.client.1.smithi086.stdout:3/104: mknod d3/d18/d1a/c28 0 2024-08-19T00:55:57.058 INFO:tasks.workunit.client.1.smithi086.stdout:7/100: dwrite d3/ff [0,4194304] 0 2024-08-19T00:55:57.058 INFO:tasks.workunit.client.1.smithi086.stdout:7/101: read d3/fb [68414,92485] 0 2024-08-19T00:55:57.060 INFO:tasks.workunit.client.1.smithi086.stdout:1/137: rename d4/d7/l9 to d4/d10/l2d 0 2024-08-19T00:55:57.061 INFO:tasks.workunit.client.1.smithi086.stdout:7/102: dread d3/de/f11 [0,4194304] 0 2024-08-19T00:55:57.061 INFO:tasks.workunit.client.1.smithi086.stdout:3/105: creat d3/f29 x:0 0 0 2024-08-19T00:55:57.062 INFO:tasks.workunit.client.1.smithi086.stdout:6/121: getdents db/d1b 0 2024-08-19T00:55:57.064 INFO:tasks.workunit.client.1.smithi086.stdout:3/106: write d3/d9/f13 [1026052,46604] 0 2024-08-19T00:55:57.064 INFO:tasks.workunit.client.1.smithi086.stdout:5/92: getdents d0/d8/d10 0 2024-08-19T00:55:57.065 INFO:tasks.workunit.client.1.smithi086.stdout:5/93: stat d0/d8/lc 0 2024-08-19T00:55:57.065 INFO:tasks.workunit.client.1.smithi086.stdout:1/138: creat d4/d7/d2a/f2e x:0 0 0 2024-08-19T00:55:57.067 INFO:tasks.workunit.client.1.smithi086.stdout:6/122: dread f3 [0,4194304] 0 2024-08-19T00:55:57.069 INFO:tasks.workunit.client.1.smithi086.stdout:5/94: mknod d0/d8/c1b 0 2024-08-19T00:55:57.071 INFO:tasks.workunit.client.1.smithi086.stdout:1/139: mknod d4/d1e/c2f 0 2024-08-19T00:55:57.072 INFO:tasks.workunit.client.1.smithi086.stdout:7/103: symlink d3/de/d1b/l1c 0 2024-08-19T00:55:57.073 INFO:tasks.workunit.client.1.smithi086.stdout:3/107: mkdir d3/d26/d2a 0 2024-08-19T00:55:57.074 INFO:tasks.workunit.client.0.smithi017.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-08-19T00:55:57.075 INFO:tasks.workunit.client.1.smithi086.stdout:6/123: rename db/c22 to db/d1b/c25 0 2024-08-19T00:55:57.076 INFO:tasks.workunit.client.1.smithi086.stdout:5/95: dwrite d0/df/f1a [0,4194304] 0 2024-08-19T00:55:57.077 INFO:tasks.workunit.client.1.smithi086.stdout:6/124: write db/d1b/f24 [764074,60355] 0 2024-08-19T00:55:57.079 INFO:tasks.workunit.client.1.smithi086.stdout:7/104: fsync d3/de/f17 0 2024-08-19T00:55:57.079 INFO:tasks.workunit.client.1.smithi086.stdout:3/108: mkdir d3/d26/d2b 0 2024-08-19T00:55:57.081 INFO:tasks.workunit.client.1.smithi086.stdout:6/125: mknod db/c26 0 2024-08-19T00:55:57.084 INFO:tasks.workunit.client.1.smithi086.stdout:7/105: symlink d3/de/l1d 0 2024-08-19T00:55:57.085 INFO:tasks.workunit.client.1.smithi086.stdout:6/126: rmdir db/d1b 39 2024-08-19T00:55:57.087 INFO:tasks.workunit.client.1.smithi086.stdout:6/127: stat c5 0 2024-08-19T00:55:57.087 INFO:tasks.workunit.client.1.smithi086.stdout:7/106: rmdir d3 39 2024-08-19T00:55:57.088 INFO:tasks.workunit.client.1.smithi086.stdout:5/96: dwrite d0/df/f18 [0,4194304] 0 2024-08-19T00:55:57.091 INFO:tasks.workunit.client.1.smithi086.stdout:3/109: dread d3/f6 [0,4194304] 0 2024-08-19T00:55:57.091 INFO:tasks.workunit.client.1.smithi086.stdout:7/107: dread d3/de/f11 [0,4194304] 0 2024-08-19T00:55:57.091 INFO:tasks.workunit.client.1.smithi086.stdout:5/97: symlink d0/d8/d10/l1c 0 2024-08-19T00:55:57.091 INFO:tasks.workunit.client.1.smithi086.stdout:7/108: readlink d3/ld 0 2024-08-19T00:55:57.091 INFO:tasks.workunit.client.1.smithi086.stdout:3/110: chown d3/d18/d1a/c28 1 1 2024-08-19T00:55:57.092 INFO:tasks.workunit.client.1.smithi086.stdout:7/109: chown d3/ff 120907280 1 2024-08-19T00:55:57.092 INFO:tasks.workunit.client.1.smithi086.stdout:6/128: creat db/d1b/f27 x:0 0 0 2024-08-19T00:55:57.098 INFO:tasks.workunit.client.1.smithi086.stdout:7/110: creat d3/de/f1e x:0 0 0 2024-08-19T00:55:57.100 INFO:tasks.workunit.client.1.smithi086.stdout:7/111: write d3/de/f1e [274074,124358] 0 2024-08-19T00:55:57.101 INFO:tasks.workunit.client.1.smithi086.stdout:6/129: write db/f13 [4486089,80961] 0 2024-08-19T00:55:57.116 INFO:tasks.workunit.client.1.smithi086.stdout:7/112: dread - d3/de/f15 zero size 2024-08-19T00:55:57.117 INFO:tasks.workunit.client.1.smithi086.stdout:1/140: getdents d4/d7 0 2024-08-19T00:55:57.118 INFO:tasks.workunit.client.1.smithi086.stdout:1/141: write d4/f1f [1012913,36568] 0 2024-08-19T00:55:57.119 INFO:tasks.workunit.client.1.smithi086.stdout:7/113: mknod d3/de/d1b/c1f 0 2024-08-19T00:55:57.119 INFO:tasks.workunit.client.1.smithi086.stdout:3/111: dwrite d3/f6 [0,4194304] 0 2024-08-19T00:55:57.120 INFO:tasks.workunit.client.1.smithi086.stdout:3/112: dread - d3/ff zero size 2024-08-19T00:55:57.121 INFO:tasks.workunit.client.1.smithi086.stdout:1/142: symlink d4/d1e/l30 0 2024-08-19T00:55:57.124 INFO:tasks.workunit.client.1.smithi086.stdout:7/114: dread d3/de/f17 [0,4194304] 0 2024-08-19T00:55:57.126 INFO:tasks.workunit.client.1.smithi086.stdout:1/143: dread d4/f6 [0,4194304] 0 2024-08-19T00:55:57.128 INFO:tasks.workunit.client.1.smithi086.stdout:7/115: creat d3/de/d1b/f20 x:0 0 0 2024-08-19T00:55:57.130 INFO:tasks.workunit.client.1.smithi086.stdout:3/113: truncate d3/f6 6367505 0 2024-08-19T00:55:57.132 INFO:tasks.workunit.client.1.smithi086.stdout:7/116: link d3/l6 d3/de/d1b/l21 0 2024-08-19T00:55:57.132 INFO:tasks.workunit.client.1.smithi086.stdout:1/144: dwrite d4/f26 [0,4194304] 0 2024-08-19T00:55:57.134 INFO:tasks.workunit.client.1.smithi086.stdout:1/145: fsync d4/d7/f19 0 2024-08-19T00:55:57.134 INFO:tasks.workunit.client.1.smithi086.stdout:7/117: mknod d3/c22 0 2024-08-19T00:55:57.136 INFO:tasks.workunit.client.1.smithi086.stdout:1/146: fdatasync d4/d1e/f13 0 2024-08-19T00:55:57.137 INFO:tasks.workunit.client.1.smithi086.stdout:7/118: write d3/de/f1e [197145,59171] 0 2024-08-19T00:55:57.138 INFO:tasks.workunit.client.1.smithi086.stdout:1/147: symlink d4/l31 0 2024-08-19T00:55:57.140 INFO:tasks.workunit.client.1.smithi086.stdout:3/114: dwrite d3/d9/fa [4194304,4194304] 0 2024-08-19T00:55:57.140 INFO:tasks.workunit.client.1.smithi086.stdout:7/119: unlink d3/c18 0 2024-08-19T00:55:57.143 INFO:tasks.workunit.client.1.smithi086.stdout:1/148: mknod d4/d7/d2a/c32 0 2024-08-19T00:55:57.144 INFO:tasks.workunit.client.1.smithi086.stdout:7/120: unlink d3/de/d1b/f20 0 2024-08-19T00:55:57.145 INFO:tasks.workunit.client.1.smithi086.stdout:1/149: write d4/d10/f1d [1994404,65835] 0 2024-08-19T00:55:57.147 INFO:tasks.workunit.client.1.smithi086.stdout:3/115: dread d3/d18/f24 [0,4194304] 0 2024-08-19T00:55:57.148 INFO:tasks.workunit.client.1.smithi086.stdout:7/121: creat d3/de/d1b/f23 x:0 0 0 2024-08-19T00:55:57.150 INFO:tasks.workunit.client.1.smithi086.stdout:3/116: creat d3/d18/f2c x:0 0 0 2024-08-19T00:55:57.151 INFO:tasks.workunit.client.1.smithi086.stdout:1/150: dread d4/d1e/f11 [0,4194304] 0 2024-08-19T00:55:57.153 INFO:tasks.workunit.client.1.smithi086.stdout:7/122: link d3/ld d3/de/l24 0 2024-08-19T00:55:57.155 INFO:tasks.workunit.client.1.smithi086.stdout:3/117: dread d3/d18/f24 [0,4194304] 0 2024-08-19T00:55:57.155 INFO:tasks.workunit.client.1.smithi086.stdout:7/123: mknod d3/c25 0 2024-08-19T00:55:57.157 INFO:tasks.workunit.client.1.smithi086.stdout:7/124: creat d3/de/f26 x:0 0 0 2024-08-19T00:55:57.158 INFO:tasks.workunit.client.1.smithi086.stdout:3/118: mkdir d3/d9/d2d 0 2024-08-19T00:55:57.158 INFO:tasks.workunit.client.1.smithi086.stdout:7/125: readlink d3/de/l1d 0 2024-08-19T00:55:57.159 INFO:tasks.workunit.client.1.smithi086.stdout:1/151: dwrite d4/f6 [0,4194304] 0 2024-08-19T00:55:57.161 INFO:tasks.workunit.client.1.smithi086.stdout:7/126: creat d3/de/f27 x:0 0 0 2024-08-19T00:55:57.162 INFO:tasks.workunit.client.1.smithi086.stdout:3/119: symlink d3/d18/d19/l2e 0 2024-08-19T00:55:57.165 INFO:tasks.workunit.client.1.smithi086.stdout:1/152: dread d4/d7/fe [0,4194304] 0 2024-08-19T00:55:57.165 INFO:tasks.workunit.client.1.smithi086.stdout:7/127: link d3/de/c16 d3/de/c28 0 2024-08-19T00:55:57.167 INFO:tasks.workunit.client.1.smithi086.stdout:8/95: sync 2024-08-19T00:55:57.168 INFO:tasks.workunit.client.1.smithi086.stdout:0/145: sync 2024-08-19T00:55:57.168 INFO:tasks.workunit.client.1.smithi086.stdout:2/75: sync 2024-08-19T00:55:57.168 INFO:tasks.workunit.client.1.smithi086.stdout:4/78: sync 2024-08-19T00:55:57.169 INFO:tasks.workunit.client.1.smithi086.stdout:7/128: mknod d3/de/c29 0 2024-08-19T00:55:57.169 INFO:tasks.workunit.client.1.smithi086.stdout:3/120: link d3/d18/d1a/c28 d3/d18/d1a/c2f 0 2024-08-19T00:55:57.171 INFO:tasks.workunit.client.1.smithi086.stdout:2/76: mkdir d8/d14 0 2024-08-19T00:55:57.172 INFO:tasks.workunit.client.1.smithi086.stdout:4/79: unlink d2/da/fc 0 2024-08-19T00:55:57.172 INFO:tasks.workunit.client.1.smithi086.stdout:2/77: write d8/f11 [885999,67060] 0 2024-08-19T00:55:57.173 INFO:tasks.workunit.client.1.smithi086.stdout:7/129: creat d3/de/f2a x:0 0 0 2024-08-19T00:55:57.174 INFO:tasks.workunit.client.1.smithi086.stdout:2/78: fdatasync d8/fc 0 2024-08-19T00:55:57.174 INFO:tasks.workunit.client.1.smithi086.stdout:3/121: rename d3/c4 to d3/d18/d27/c30 0 2024-08-19T00:55:57.175 INFO:tasks.workunit.client.1.smithi086.stdout:0/146: dwrite f6 [4194304,4194304] 0 2024-08-19T00:55:57.176 INFO:tasks.workunit.client.1.smithi086.stdout:2/79: read f2 [30389,64388] 0 2024-08-19T00:55:57.176 INFO:tasks.workunit.client.1.smithi086.stdout:3/122: write d3/d18/f2c [721786,38015] 0 2024-08-19T00:55:57.177 INFO:tasks.workunit.client.1.smithi086.stdout:2/80: dread d8/fe [0,4194304] 0 2024-08-19T00:55:57.179 INFO:tasks.workunit.client.1.smithi086.stdout:4/80: mknod d2/d18/c1e 0 2024-08-19T00:55:57.181 INFO:tasks.workunit.client.1.smithi086.stdout:4/81: write d2/da/f16 [900481,82923] 0 2024-08-19T00:55:57.182 INFO:tasks.workunit.client.1.smithi086.stdout:4/82: dread - d2/f1b zero size 2024-08-19T00:55:57.183 INFO:tasks.workunit.client.1.smithi086.stdout:4/83: truncate d2/da/f14 633976 0 2024-08-19T00:55:57.188 INFO:tasks.workunit.client.1.smithi086.stdout:8/96: getdents dc 0 2024-08-19T00:55:57.189 INFO:tasks.workunit.client.1.smithi086.stdout:8/97: write dc/f11 [1744758,48661] 0 2024-08-19T00:55:57.190 INFO:tasks.workunit.client.1.smithi086.stdout:7/130: unlink d3/de/f26 0 2024-08-19T00:55:57.192 INFO:tasks.workunit.client.1.smithi086.stdout:7/131: read d3/ff [2558942,123674] 0 2024-08-19T00:55:57.192 INFO:tasks.workunit.client.1.smithi086.stdout:4/84: mknod d2/da/c1f 0 2024-08-19T00:55:57.195 INFO:tasks.workunit.client.1.smithi086.stdout:2/81: creat d8/d14/f15 x:0 0 0 2024-08-19T00:55:57.195 INFO:tasks.workunit.client.1.smithi086.stdout:1/153: dwrite d4/f14 [0,4194304] 0 2024-08-19T00:55:57.196 INFO:tasks.workunit.client.1.smithi086.stdout:4/85: write d2/da/f14 [1640625,49135] 0 2024-08-19T00:55:57.197 INFO:tasks.workunit.client.1.smithi086.stdout:1/154: chown d4/f18 18212402 1 2024-08-19T00:55:57.198 INFO:tasks.workunit.client.1.smithi086.stdout:0/147: write da/d14/d26/f2c [200520,127267] 0 2024-08-19T00:55:57.199 INFO:tasks.workunit.client.1.smithi086.stdout:1/155: fsync d4/f18 0 2024-08-19T00:55:57.200 INFO:tasks.workunit.client.1.smithi086.stdout:4/86: write d2/da/f14 [996311,32821] 0 2024-08-19T00:55:57.201 INFO:tasks.workunit.client.1.smithi086.stdout:8/98: dwrite dc/f11 [4194304,4194304] 0 2024-08-19T00:55:57.201 INFO:tasks.workunit.client.1.smithi086.stdout:7/132: creat d3/de/f2b x:0 0 0 2024-08-19T00:55:57.207 INFO:tasks.workunit.client.1.smithi086.stdout:3/123: getdents d3/d18 0 2024-08-19T00:55:57.208 INFO:tasks.workunit.client.1.smithi086.stdout:4/87: dread d2/f8 [0,4194304] 0 2024-08-19T00:55:57.208 INFO:tasks.workunit.client.1.smithi086.stdout:0/148: mkdir da/d14/d1a/d37 0 2024-08-19T00:55:57.209 INFO:tasks.workunit.client.1.smithi086.stdout:3/124: chown d3/f5 12544 1 2024-08-19T00:55:57.209 INFO:tasks.workunit.client.1.smithi086.stdout:1/156: creat d4/d7/d2a/f33 x:0 0 0 2024-08-19T00:55:57.211 INFO:tasks.workunit.client.1.smithi086.stdout:0/149: readlink da/d14/d26/l32 0 2024-08-19T00:55:57.212 INFO:tasks.workunit.client.1.smithi086.stdout:7/133: dwrite d3/de/f2b [0,4194304] 0 2024-08-19T00:55:57.215 INFO:tasks.workunit.client.1.smithi086.stdout:7/134: dread - d3/de/f12 zero size 2024-08-19T00:55:57.215 INFO:tasks.workunit.client.1.smithi086.stdout:8/99: creat dc/d1f/f22 x:0 0 0 2024-08-19T00:55:57.215 INFO:tasks.workunit.client.1.smithi086.stdout:1/157: unlink d4/ld 0 2024-08-19T00:55:57.217 INFO:tasks.workunit.client.1.smithi086.stdout:4/88: rename d2/da/c1f to d2/da/c20 0 2024-08-19T00:55:57.217 INFO:tasks.workunit.client.1.smithi086.stdout:1/158: fdatasync d4/d10/f1d 0 2024-08-19T00:55:57.219 INFO:tasks.workunit.client.1.smithi086.stdout:0/150: creat da/d14/d26/f38 x:0 0 0 2024-08-19T00:55:57.223 INFO:tasks.workunit.client.1.smithi086.stdout:7/135: rename d3/de/c29 to d3/de/c2c 0 2024-08-19T00:55:57.227 INFO:tasks.workunit.client.1.smithi086.stdout:7/136: mkdir d3/de/d2d 0 2024-08-19T00:55:57.228 INFO:tasks.workunit.client.1.smithi086.stdout:4/89: dwrite d2/f1b [0,4194304] 0 2024-08-19T00:55:57.232 INFO:tasks.workunit.client.1.smithi086.stdout:0/151: dwrite da/d14/d26/f38 [0,4194304] 0 2024-08-19T00:55:57.233 INFO:tasks.workunit.client.1.smithi086.stdout:4/90: creat d2/f21 x:0 0 0 2024-08-19T00:55:57.234 INFO:tasks.workunit.client.1.smithi086.stdout:0/152: chown da/c1f 58 1 2024-08-19T00:55:57.235 INFO:tasks.workunit.client.1.smithi086.stdout:7/137: rename d3/ld to d3/l2e 0 2024-08-19T00:55:57.235 INFO:tasks.workunit.client.1.smithi086.stdout:8/100: fsync dc/d1f/f22 0 2024-08-19T00:55:57.236 INFO:tasks.workunit.client.1.smithi086.stdout:4/91: symlink d2/d18/l22 0 2024-08-19T00:55:57.236 INFO:tasks.workunit.client.1.smithi086.stdout:8/101: truncate dc/f15 1148013 0 2024-08-19T00:55:57.237 INFO:tasks.workunit.client.1.smithi086.stdout:0/153: mkdir da/d14/d1a/d2e/d39 0 2024-08-19T00:55:57.241 INFO:tasks.workunit.client.1.smithi086.stdout:4/92: unlink d2/f8 0 2024-08-19T00:55:57.242 INFO:tasks.workunit.client.1.smithi086.stdout:4/93: readlink d2/l10 0 2024-08-19T00:55:57.243 INFO:tasks.workunit.client.1.smithi086.stdout:8/102: creat dc/f23 x:0 0 0 2024-08-19T00:55:57.244 INFO:tasks.workunit.client.1.smithi086.stdout:3/125: truncate d3/d9/f13 771998 0 2024-08-19T00:55:57.245 INFO:tasks.workunit.client.1.smithi086.stdout:0/154: rename da/l11 to da/d14/l3a 0 2024-08-19T00:55:57.247 INFO:tasks.workunit.client.1.smithi086.stdout:7/138: creat d3/de/d2d/f2f x:0 0 0 2024-08-19T00:55:57.248 INFO:tasks.workunit.client.1.smithi086.stdout:1/159: truncate d4/d7/f21 1674148 0 2024-08-19T00:55:57.248 INFO:tasks.workunit.client.1.smithi086.stdout:1/160: chown d4/d1e 11 1 2024-08-19T00:55:57.249 INFO:tasks.workunit.client.1.smithi086.stdout:8/103: rmdir dc/d17 39 2024-08-19T00:55:57.249 INFO:tasks.workunit.client.1.smithi086.stdout:0/155: dread da/d14/f1b [0,4194304] 0 2024-08-19T00:55:57.250 INFO:tasks.workunit.client.1.smithi086.stdout:8/104: chown dc/d16/d18 0 1 2024-08-19T00:55:57.250 INFO:tasks.workunit.client.1.smithi086.stdout:0/156: truncate da/f36 176110 0 2024-08-19T00:55:57.251 INFO:tasks.workunit.client.1.smithi086.stdout:3/126: unlink d3/d9/l11 0 2024-08-19T00:55:57.254 INFO:tasks.workunit.client.1.smithi086.stdout:4/94: link d2/da/f16 d2/f23 0 2024-08-19T00:55:57.255 INFO:tasks.workunit.client.1.smithi086.stdout:1/161: symlink d4/d7/d2a/l34 0 2024-08-19T00:55:57.257 INFO:tasks.workunit.client.1.smithi086.stdout:3/127: creat d3/d18/d19/d20/f31 x:0 0 0 2024-08-19T00:55:57.260 INFO:tasks.workunit.client.1.smithi086.stdout:4/95: mknod d2/d18/c24 0 2024-08-19T00:55:57.261 INFO:tasks.workunit.client.1.smithi086.stdout:1/162: write d4/d7/fe [2520613,125070] 0 2024-08-19T00:55:57.261 INFO:tasks.workunit.client.1.smithi086.stdout:0/157: getdents da/d14/d1a/d2e/d39 0 2024-08-19T00:55:57.266 INFO:tasks.workunit.client.1.smithi086.stdout:4/96: dwrite d2/d18/f19 [0,4194304] 0 2024-08-19T00:55:57.267 INFO:tasks.workunit.client.1.smithi086.stdout:7/139: getdents d3 0 2024-08-19T00:55:57.277 INFO:tasks.workunit.client.1.smithi086.stdout:7/140: mkdir d3/de/d30 0 2024-08-19T00:55:57.280 INFO:tasks.workunit.client.1.smithi086.stdout:8/105: dwrite f8 [0,4194304] 0 2024-08-19T00:55:57.287 INFO:tasks.workunit.client.1.smithi086.stdout:1/163: dwrite d4/d7/f21 [0,4194304] 0 2024-08-19T00:55:57.287 INFO:tasks.workunit.client.1.smithi086.stdout:4/97: write d2/f23 [320216,118497] 0 2024-08-19T00:55:57.289 INFO:tasks.workunit.client.1.smithi086.stdout:1/164: dread - d4/d7/f28 zero size 2024-08-19T00:55:57.290 INFO:tasks.workunit.client.1.smithi086.stdout:8/106: chown dc/d17/d1e/f20 182 1 2024-08-19T00:55:57.294 INFO:tasks.workunit.client.1.smithi086.stdout:9/81: sync 2024-08-19T00:55:57.294 INFO:tasks.workunit.client.1.smithi086.stdout:9/82: chown db/f15 32 1 2024-08-19T00:55:57.298 INFO:tasks.workunit.client.1.smithi086.stdout:0/158: getdents da/d14/d26 0 2024-08-19T00:55:57.301 INFO:tasks.workunit.client.1.smithi086.stdout:7/141: dwrite d3/ff [0,4194304] 0 2024-08-19T00:55:57.304 INFO:tasks.workunit.client.1.smithi086.stdout:9/83: mkdir db/dd/d17 0 2024-08-19T00:55:57.308 INFO:tasks.workunit.client.1.smithi086.stdout:1/165: dwrite d4/d1e/f11 [0,4194304] 0 2024-08-19T00:55:57.310 INFO:tasks.workunit.client.1.smithi086.stdout:9/84: mkdir db/dd/d17/d18 0 2024-08-19T00:55:57.311 INFO:tasks.workunit.client.1.smithi086.stdout:9/85: read - fa zero size 2024-08-19T00:55:57.312 INFO:tasks.workunit.client.1.smithi086.stdout:8/107: dwrite dc/f12 [4194304,4194304] 0 2024-08-19T00:55:57.313 INFO:tasks.workunit.client.1.smithi086.stdout:8/108: fsync dc/f11 0 2024-08-19T00:55:57.314 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:57 smithi017 ceph-mon[16627]: pgmap v9: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 13 MiB/s wr, 303 op/s 2024-08-19T00:55:57.314 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:57 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:57.315 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:57 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:57.315 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:57 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.315 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:57 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.315 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:57 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.315 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:57 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.315 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:57 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.315 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:57 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.315 INFO:tasks.workunit.client.1.smithi086.stdout:1/166: mkdir d4/d1e/d35 0 2024-08-19T00:55:57.318 INFO:tasks.workunit.client.1.smithi086.stdout:4/98: truncate d2/f23 382685 0 2024-08-19T00:55:57.321 INFO:tasks.workunit.client.1.smithi086.stdout:8/109: creat dc/d17/f24 x:0 0 0 2024-08-19T00:55:57.323 INFO:tasks.workunit.client.1.smithi086.stdout:1/167: rmdir d4/d7 39 2024-08-19T00:55:57.323 INFO:tasks.workunit.client.1.smithi086.stdout:1/168: fdatasync d4/d10/f25 0 2024-08-19T00:55:57.325 INFO:tasks.workunit.client.1.smithi086.stdout:4/99: mkdir d2/d1c/d25 0 2024-08-19T00:55:57.325 INFO:tasks.workunit.client.1.smithi086.stdout:4/100: chown d2/l10 536046896 1 2024-08-19T00:55:57.327 INFO:tasks.workunit.client.1.smithi086.stdout:8/110: chown dc/d17/c21 348 1 2024-08-19T00:55:57.327 INFO:tasks.workunit.client.1.smithi086.stdout:1/169: readlink d4/d7/d2a/l34 0 2024-08-19T00:55:57.329 INFO:tasks.workunit.client.1.smithi086.stdout:8/111: dread - dc/d17/d1e/f20 zero size 2024-08-19T00:55:57.330 INFO:tasks.workunit.client.1.smithi086.stdout:9/86: getdents db/dd 0 2024-08-19T00:55:57.331 INFO:tasks.workunit.client.1.smithi086.stdout:8/112: read - dc/d17/f24 zero size 2024-08-19T00:55:57.331 INFO:tasks.workunit.client.1.smithi086.stdout:4/101: dwrite d2/da/fe [0,4194304] 0 2024-08-19T00:55:57.333 INFO:tasks.workunit.client.1.smithi086.stdout:9/87: truncate db/f15 775440 0 2024-08-19T00:55:57.333 INFO:tasks.workunit.client.1.smithi086.stdout:8/113: rename dc/d16 to dc/d16/d18/d25 22 2024-08-19T00:55:57.333 INFO:tasks.workunit.client.1.smithi086.stdout:9/88: stat c9 0 2024-08-19T00:55:57.337 INFO:tasks.workunit.client.1.smithi086.stdout:4/102: rename d2/da/fe to d2/f26 0 2024-08-19T00:55:57.340 INFO:tasks.workunit.client.1.smithi086.stdout:1/170: rmdir d4/d1e/d27 0 2024-08-19T00:55:57.341 INFO:tasks.workunit.client.1.smithi086.stdout:8/114: dwrite dc/d17/d1e/f20 [0,4194304] 0 2024-08-19T00:55:57.343 INFO:tasks.workunit.client.1.smithi086.stdout:9/89: rename db/dd/d17 to db/dd/d19 0 2024-08-19T00:55:57.343 INFO:tasks.workunit.client.1.smithi086.stdout:9/90: read - fa zero size 2024-08-19T00:55:57.345 INFO:tasks.workunit.client.1.smithi086.stdout:4/103: dwrite d2/da/f13 [0,4194304] 0 2024-08-19T00:55:57.353 INFO:tasks.workunit.client.1.smithi086.stdout:1/171: mkdir d4/d7/d2a/d36 0 2024-08-19T00:55:57.355 INFO:tasks.workunit.client.1.smithi086.stdout:1/172: write d4/d7/d2a/f33 [12541,23809] 0 2024-08-19T00:55:57.355 INFO:tasks.workunit.client.1.smithi086.stdout:1/173: chown d4/f26 231325527 1 2024-08-19T00:55:57.357 INFO:tasks.workunit.client.1.smithi086.stdout:8/115: symlink dc/d1f/l26 0 2024-08-19T00:55:57.360 INFO:tasks.workunit.client.1.smithi086.stdout:9/91: mknod db/dd/c1a 0 2024-08-19T00:55:57.361 INFO:tasks.workunit.client.1.smithi086.stdout:9/92: chown f7 0 1 2024-08-19T00:55:57.365 INFO:tasks.workunit.client.1.smithi086.stdout:4/104: mkdir d2/d1c/d1d/d27 0 2024-08-19T00:55:57.372 INFO:tasks.workunit.client.1.smithi086.stdout:4/105: creat d2/d18/f28 x:0 0 0 2024-08-19T00:55:57.375 INFO:tasks.workunit.client.1.smithi086.stdout:9/93: link f7 db/f1b 0 2024-08-19T00:55:57.376 INFO:tasks.workunit.client.1.smithi086.stdout:9/94: dread - db/f11 zero size 2024-08-19T00:55:57.377 INFO:tasks.workunit.client.1.smithi086.stdout:4/106: dwrite d2/d18/f19 [0,4194304] 0 2024-08-19T00:55:57.378 INFO:tasks.workunit.client.1.smithi086.stdout:9/95: rename db/dd/d19/d18 to db/dd/d19/d18/d1c 22 2024-08-19T00:55:57.378 INFO:tasks.workunit.client.1.smithi086.stdout:9/96: dread - fa zero size 2024-08-19T00:55:57.387 INFO:tasks.workunit.client.1.smithi086.stdout:9/97: dwrite f7 [4194304,4194304] 0 2024-08-19T00:55:57.395 INFO:tasks.workunit.client.1.smithi086.stdout:9/98: dwrite db/dd/f14 [0,4194304] 0 2024-08-19T00:55:57.399 INFO:tasks.workunit.client.1.smithi086.stdout:8/116: truncate f5 3646462 0 2024-08-19T00:55:57.402 INFO:tasks.workunit.client.1.smithi086.stdout:5/98: sync 2024-08-19T00:55:57.402 INFO:tasks.workunit.client.1.smithi086.stdout:6/130: sync 2024-08-19T00:55:57.408 INFO:tasks.workunit.client.1.smithi086.stdout:8/117: unlink dc/cf 0 2024-08-19T00:55:57.411 INFO:tasks.workunit.client.1.smithi086.stdout:5/99: creat d0/d8/d10/f1d x:0 0 0 2024-08-19T00:55:57.413 INFO:tasks.workunit.client.1.smithi086.stdout:6/131: mkdir db/d1b/d28 0 2024-08-19T00:55:57.416 INFO:tasks.workunit.client.1.smithi086.stdout:8/118: rename dc/f15 to dc/d1f/f27 0 2024-08-19T00:55:57.419 INFO:tasks.workunit.client.1.smithi086.stdout:5/100: creat d0/f1e x:0 0 0 2024-08-19T00:55:57.419 INFO:tasks.workunit.client.1.smithi086.stdout:5/101: chown d0/df 43 1 2024-08-19T00:55:57.422 INFO:tasks.workunit.client.1.smithi086.stdout:8/119: dwrite dc/f12 [0,4194304] 0 2024-08-19T00:55:57.424 INFO:tasks.workunit.client.1.smithi086.stdout:5/102: dread d0/fb [0,4194304] 0 2024-08-19T00:55:57.425 INFO:tasks.workunit.client.1.smithi086.stdout:5/103: stat d0 0 2024-08-19T00:55:57.426 INFO:tasks.workunit.client.1.smithi086.stdout:6/132: mknod db/d1b/d28/c29 0 2024-08-19T00:55:57.429 INFO:tasks.workunit.client.1.smithi086.stdout:8/120: mkdir dc/d17/d19/d28 0 2024-08-19T00:55:57.430 INFO:tasks.workunit.client.1.smithi086.stdout:8/121: write f8 [2794444,87800] 0 2024-08-19T00:55:57.434 INFO:tasks.workunit.client.1.smithi086.stdout:9/99: truncate f7 5818025 0 2024-08-19T00:55:57.435 INFO:tasks.workunit.client.1.smithi086.stdout:5/104: mkdir d0/df/d1f 0 2024-08-19T00:55:57.435 INFO:tasks.workunit.client.1.smithi086.stdout:9/100: write db/dd/ff [513678,17377] 0 2024-08-19T00:55:57.439 INFO:tasks.workunit.client.1.smithi086.stdout:5/105: mkdir d0/d20 0 2024-08-19T00:55:57.442 INFO:tasks.workunit.client.1.smithi086.stdout:8/122: mkdir dc/d16/d18/d29 0 2024-08-19T00:55:57.445 INFO:tasks.workunit.client.1.smithi086.stdout:5/106: dwrite d0/f7 [0,4194304] 0 2024-08-19T00:55:57.445 INFO:tasks.workunit.client.1.smithi086.stdout:9/101: mknod db/dd/d19/d18/c1d 0 2024-08-19T00:55:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:57 smithi086 ceph-mon[24511]: pgmap v9: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 13 MiB/s wr, 303 op/s 2024-08-19T00:55:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:57 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:57 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:57 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:57 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:57 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:57 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:57 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:57 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:55:57.447 INFO:tasks.workunit.client.1.smithi086.stdout:5/107: dread - d0/f1e zero size 2024-08-19T00:55:57.447 INFO:tasks.workunit.client.1.smithi086.stdout:9/102: read - db/f16 zero size 2024-08-19T00:55:57.449 INFO:tasks.workunit.client.1.smithi086.stdout:8/123: write dc/d1f/f27 [1533476,27504] 0 2024-08-19T00:55:57.453 INFO:tasks.workunit.client.1.smithi086.stdout:4/107: dwrite d2/f23 [0,4194304] 0 2024-08-19T00:55:57.457 INFO:tasks.workunit.client.1.smithi086.stdout:5/108: dwrite d0/f7 [0,4194304] 0 2024-08-19T00:55:57.459 INFO:tasks.workunit.client.1.smithi086.stdout:5/109: fsync d0/f1e 0 2024-08-19T00:55:57.460 INFO:tasks.workunit.client.1.smithi086.stdout:8/124: rename dc/fd to dc/d17/f2a 0 2024-08-19T00:55:57.463 INFO:tasks.workunit.client.1.smithi086.stdout:4/108: dwrite d2/f21 [0,4194304] 0 2024-08-19T00:55:57.469 INFO:tasks.workunit.client.1.smithi086.stdout:9/103: getdents db/dd/d19 0 2024-08-19T00:55:57.470 INFO:tasks.workunit.client.1.smithi086.stdout:9/104: chown db 323 1 2024-08-19T00:55:57.470 INFO:tasks.workunit.client.1.smithi086.stdout:4/109: dwrite d2/da/f13 [0,4194304] 0 2024-08-19T00:55:57.472 INFO:tasks.workunit.client.1.smithi086.stdout:4/110: write d2/f21 [2032454,12251] 0 2024-08-19T00:55:57.472 INFO:tasks.workunit.client.1.smithi086.stdout:8/125: mkdir dc/d17/d19/d28/d2b 0 2024-08-19T00:55:57.473 INFO:tasks.workunit.client.1.smithi086.stdout:8/126: chown dc/f23 1822 1 2024-08-19T00:55:57.474 INFO:tasks.workunit.client.1.smithi086.stdout:9/105: symlink db/dd/d19/d18/l1e 0 2024-08-19T00:55:57.476 INFO:tasks.workunit.client.1.smithi086.stdout:9/106: read db/dd/ff [290865,116436] 0 2024-08-19T00:55:57.478 INFO:tasks.workunit.client.1.smithi086.stdout:5/110: fdatasync d0/f7 0 2024-08-19T00:55:57.479 INFO:tasks.workunit.client.1.smithi086.stdout:4/111: mknod d2/d18/c29 0 2024-08-19T00:55:57.479 INFO:tasks.workunit.client.1.smithi086.stdout:5/111: stat d0/df/f18 0 2024-08-19T00:55:57.480 INFO:tasks.workunit.client.1.smithi086.stdout:5/112: chown d0/d20 78811818 1 2024-08-19T00:55:57.480 INFO:tasks.workunit.client.1.smithi086.stdout:4/112: rename d2/d1c to d2/d1c/d1d/d2a 22 2024-08-19T00:55:57.481 INFO:tasks.workunit.client.1.smithi086.stdout:8/127: symlink dc/d17/d19/l2c 0 2024-08-19T00:55:57.482 INFO:tasks.workunit.client.1.smithi086.stdout:8/128: truncate dc/f1c 822095 0 2024-08-19T00:55:57.487 INFO:tasks.workunit.client.1.smithi086.stdout:9/107: dread f2 [0,4194304] 0 2024-08-19T00:55:57.490 INFO:tasks.workunit.client.1.smithi086.stdout:8/129: rename dc/d1f/f22 to dc/d16/f2d 0 2024-08-19T00:55:57.493 INFO:tasks.workunit.client.1.smithi086.stdout:5/113: mknod d0/df/d1f/c21 0 2024-08-19T00:55:57.494 INFO:tasks.workunit.client.1.smithi086.stdout:8/130: dwrite f8 [0,4194304] 0 2024-08-19T00:55:57.495 INFO:tasks.workunit.client.1.smithi086.stdout:9/108: creat db/dd/d19/f1f x:0 0 0 2024-08-19T00:55:57.497 INFO:tasks.workunit.client.1.smithi086.stdout:5/114: dread d0/f6 [0,4194304] 0 2024-08-19T00:55:57.508 INFO:tasks.workunit.client.1.smithi086.stdout:8/131: dread f5 [0,4194304] 0 2024-08-19T00:55:57.508 INFO:tasks.workunit.client.1.smithi086.stdout:5/115: write d0/fb [505165,67217] 0 2024-08-19T00:55:57.509 INFO:tasks.workunit.client.1.smithi086.stdout:8/132: dread - dc/d17/f24 zero size 2024-08-19T00:55:57.509 INFO:tasks.workunit.client.1.smithi086.stdout:2/82: sync 2024-08-19T00:55:57.509 INFO:tasks.workunit.client.1.smithi086.stdout:3/128: sync 2024-08-19T00:55:57.514 INFO:tasks.workunit.client.1.smithi086.stdout:2/83: mknod d8/d14/c16 0 2024-08-19T00:55:57.515 INFO:tasks.workunit.client.1.smithi086.stdout:5/116: dwrite d0/d8/d10/f1d [0,4194304] 0 2024-08-19T00:55:57.519 INFO:tasks.workunit.client.1.smithi086.stdout:8/133: rename dc/d17/d19 to dc/d16/d18/d29/d2e 0 2024-08-19T00:55:57.519 INFO:tasks.workunit.client.1.smithi086.stdout:5/117: dread d0/f7 [0,4194304] 0 2024-08-19T00:55:57.520 INFO:tasks.workunit.client.1.smithi086.stdout:8/134: truncate dc/d1f/f27 1613103 0 2024-08-19T00:55:57.521 INFO:tasks.workunit.client.1.smithi086.stdout:9/109: getdents db/dd/d19/d18 0 2024-08-19T00:55:57.521 INFO:tasks.workunit.client.1.smithi086.stdout:9/110: fdatasync f8 0 2024-08-19T00:55:57.522 INFO:tasks.workunit.client.1.smithi086.stdout:8/135: fsync dc/d17/f24 0 2024-08-19T00:55:57.524 INFO:tasks.workunit.client.1.smithi086.stdout:2/84: mknod d8/c17 0 2024-08-19T00:55:57.525 INFO:tasks.workunit.client.1.smithi086.stdout:2/85: truncate d8/fc 1042376 0 2024-08-19T00:55:57.525 INFO:tasks.workunit.client.1.smithi086.stdout:3/129: getdents d3/d9/d2d 0 2024-08-19T00:55:57.526 INFO:tasks.workunit.client.1.smithi086.stdout:5/118: dwrite d0/fa [0,4194304] 0 2024-08-19T00:55:57.527 INFO:tasks.workunit.client.1.smithi086.stdout:3/130: dread - d3/d18/f22 zero size 2024-08-19T00:55:57.527 INFO:tasks.workunit.client.1.smithi086.stdout:5/119: chown d0/df/f1a 733 1 2024-08-19T00:55:57.528 INFO:tasks.workunit.client.1.smithi086.stdout:4/113: truncate d2/f23 793490 0 2024-08-19T00:55:57.570 INFO:tasks.workunit.client.1.smithi086.stdout:8/136: rmdir dc/d17 39 2024-08-19T00:55:57.571 INFO:tasks.workunit.client.1.smithi086.stdout:8/137: write dc/d1f/f27 [448567,37713] 0 2024-08-19T00:55:57.572 INFO:tasks.workunit.client.1.smithi086.stdout:5/120: creat d0/d20/f22 x:0 0 0 2024-08-19T00:55:57.573 INFO:tasks.workunit.client.1.smithi086.stdout:5/121: fdatasync d0/df/f18 0 2024-08-19T00:55:57.573 INFO:tasks.workunit.client.1.smithi086.stdout:8/138: write dc/f1c [645964,111160] 0 2024-08-19T00:55:57.574 INFO:tasks.workunit.client.1.smithi086.stdout:8/139: readlink dc/d1f/l26 0 2024-08-19T00:55:57.574 INFO:tasks.workunit.client.1.smithi086.stdout:3/131: link d3/f14 d3/d9/d2d/f32 0 2024-08-19T00:55:57.575 INFO:tasks.workunit.client.1.smithi086.stdout:5/122: write d0/f7 [1705102,48938] 0 2024-08-19T00:55:57.575 INFO:tasks.workunit.client.1.smithi086.stdout:5/123: stat d0/l16 0 2024-08-19T00:55:57.577 INFO:tasks.workunit.client.1.smithi086.stdout:5/124: write d0/fa [5150754,46485] 0 2024-08-19T00:55:57.583 INFO:tasks.workunit.client.1.smithi086.stdout:9/111: getdents db/dd/d19 0 2024-08-19T00:55:57.584 INFO:tasks.workunit.client.1.smithi086.stdout:9/112: write db/dd/f14 [2168944,122194] 0 2024-08-19T00:55:57.584 INFO:tasks.workunit.client.1.smithi086.stdout:2/86: write f0 [3735536,52463] 0 2024-08-19T00:55:57.588 INFO:tasks.workunit.client.1.smithi086.stdout:5/125: creat d0/df/f23 x:0 0 0 2024-08-19T00:55:57.588 INFO:tasks.workunit.client.1.smithi086.stdout:8/140: dwrite dc/d17/d1e/f20 [4194304,4194304] 0 2024-08-19T00:55:57.589 INFO:tasks.workunit.client.1.smithi086.stdout:5/126: write d0/d20/f22 [493414,64030] 0 2024-08-19T00:55:57.593 INFO:tasks.workunit.client.1.smithi086.stdout:9/113: rename f8 to db/f20 0 2024-08-19T00:55:57.597 INFO:tasks.workunit.client.1.smithi086.stdout:2/87: creat d8/d14/f18 x:0 0 0 2024-08-19T00:55:57.599 INFO:tasks.workunit.client.1.smithi086.stdout:8/141: creat dc/d16/d18/f2f x:0 0 0 2024-08-19T00:55:57.600 INFO:tasks.workunit.client.1.smithi086.stdout:5/127: mknod d0/c24 0 2024-08-19T00:55:57.603 INFO:tasks.workunit.client.1.smithi086.stdout:9/114: mknod db/dd/c21 0 2024-08-19T00:55:57.605 INFO:tasks.workunit.client.1.smithi086.stdout:8/142: dread dc/d1f/f27 [0,4194304] 0 2024-08-19T00:55:57.606 INFO:tasks.workunit.client.1.smithi086.stdout:2/88: dwrite d8/f11 [0,4194304] 0 2024-08-19T00:55:57.609 INFO:tasks.workunit.client.1.smithi086.stdout:9/115: mknod db/dd/d19/d18/c22 0 2024-08-19T00:55:57.612 INFO:tasks.workunit.client.1.smithi086.stdout:5/128: dwrite d0/df/f23 [0,4194304] 0 2024-08-19T00:55:57.613 INFO:tasks.workunit.client.1.smithi086.stdout:6/133: sync 2024-08-19T00:55:57.613 INFO:tasks.workunit.client.1.smithi086.stdout:0/159: sync 2024-08-19T00:55:57.613 INFO:tasks.workunit.client.1.smithi086.stdout:1/174: sync 2024-08-19T00:55:57.613 INFO:tasks.workunit.client.1.smithi086.stdout:7/142: sync 2024-08-19T00:55:57.619 INFO:tasks.workunit.client.1.smithi086.stdout:5/129: creat d0/d20/f25 x:0 0 0 2024-08-19T00:55:57.622 INFO:tasks.workunit.client.1.smithi086.stdout:6/134: symlink db/d1b/l2a 0 2024-08-19T00:55:57.623 INFO:tasks.workunit.client.1.smithi086.stdout:5/130: dread - d0/f1e zero size 2024-08-19T00:55:57.623 INFO:tasks.workunit.client.1.smithi086.stdout:1/175: creat d4/d7/f37 x:0 0 0 2024-08-19T00:55:57.624 INFO:tasks.workunit.client.1.smithi086.stdout:6/135: chown db/d1b 45 1 2024-08-19T00:55:57.625 INFO:tasks.workunit.client.1.smithi086.stdout:7/143: creat d3/de/d2d/f31 x:0 0 0 2024-08-19T00:55:57.625 INFO:tasks.workunit.client.1.smithi086.stdout:2/89: dwrite d8/fe [0,4194304] 0 2024-08-19T00:55:57.626 INFO:tasks.workunit.client.1.smithi086.stdout:1/176: chown d4/l31 268787 1 2024-08-19T00:55:57.628 INFO:tasks.workunit.client.1.smithi086.stdout:0/160: mkdir da/d14/d1a/d2e/d39/d3b 0 2024-08-19T00:55:57.628 INFO:tasks.workunit.client.1.smithi086.stdout:8/143: dwrite dc/d1f/f27 [0,4194304] 0 2024-08-19T00:55:57.629 INFO:tasks.workunit.client.1.smithi086.stdout:7/144: fdatasync d3/de/f2a 0 2024-08-19T00:55:57.631 INFO:tasks.workunit.client.1.smithi086.stdout:2/90: creat d8/f19 x:0 0 0 2024-08-19T00:55:57.633 INFO:tasks.workunit.client.1.smithi086.stdout:8/144: fsync dc/f14 0 2024-08-19T00:55:57.637 INFO:tasks.workunit.client.1.smithi086.stdout:7/145: truncate d3/de/d2d/f31 175429 0 2024-08-19T00:55:57.640 INFO:tasks.workunit.client.1.smithi086.stdout:3/132: truncate d3/f6 3110056 0 2024-08-19T00:55:57.641 INFO:tasks.workunit.client.1.smithi086.stdout:6/136: dwrite db/f14 [0,4194304] 0 2024-08-19T00:55:57.643 INFO:tasks.workunit.client.1.smithi086.stdout:8/145: link lb dc/d16/l30 0 2024-08-19T00:55:57.648 INFO:tasks.workunit.client.1.smithi086.stdout:0/161: dwrite da/d14/f17 [0,4194304] 0 2024-08-19T00:55:57.650 INFO:tasks.workunit.client.1.smithi086.stdout:0/162: fsync da/f28 0 2024-08-19T00:55:57.651 INFO:tasks.workunit.client.1.smithi086.stdout:2/91: dwrite d8/ff [0,4194304] 0 2024-08-19T00:55:57.652 INFO:tasks.workunit.client.1.smithi086.stdout:8/146: write dc/d16/f2d [499895,61454] 0 2024-08-19T00:55:57.653 INFO:tasks.workunit.client.1.smithi086.stdout:3/133: rename d3/d26/d2a to d3/d26/d2b/d33 0 2024-08-19T00:55:57.654 INFO:tasks.workunit.client.1.smithi086.stdout:2/92: readlink d8/l9 0 2024-08-19T00:55:57.655 INFO:tasks.workunit.client.1.smithi086.stdout:9/116: getdents db/dd/d19/d18 0 2024-08-19T00:55:57.657 INFO:tasks.workunit.client.1.smithi086.stdout:8/147: write dc/f12 [461145,70490] 0 2024-08-19T00:55:57.657 INFO:tasks.workunit.client.1.smithi086.stdout:0/163: write da/d14/f17 [5108281,65617] 0 2024-08-19T00:55:57.660 INFO:tasks.workunit.client.1.smithi086.stdout:6/137: dwrite db/f13 [0,4194304] 0 2024-08-19T00:55:57.660 INFO:tasks.workunit.client.1.smithi086.stdout:9/117: mkdir db/d23 0 2024-08-19T00:55:57.662 INFO:tasks.workunit.client.1.smithi086.stdout:3/134: chown d3/d9/f15 41922 1 2024-08-19T00:55:57.662 INFO:tasks.workunit.client.1.smithi086.stdout:1/177: getdents d4/d7 0 2024-08-19T00:55:57.668 INFO:tasks.workunit.client.1.smithi086.stdout:2/93: dwrite d8/f12 [0,4194304] 0 2024-08-19T00:55:57.669 INFO:tasks.workunit.client.1.smithi086.stdout:3/135: creat d3/d18/d1a/f34 x:0 0 0 2024-08-19T00:55:57.669 INFO:tasks.workunit.client.1.smithi086.stdout:8/148: write dc/f14 [1679969,89638] 0 2024-08-19T00:55:57.671 INFO:tasks.workunit.client.1.smithi086.stdout:8/149: write dc/f1c [1645967,127286] 0 2024-08-19T00:55:57.675 INFO:tasks.workunit.client.1.smithi086.stdout:2/94: dread d8/ff [0,4194304] 0 2024-08-19T00:55:57.679 INFO:tasks.workunit.client.1.smithi086.stdout:1/178: rename d4/d1e/l30 to d4/d7/d2a/d36/l38 0 2024-08-19T00:55:57.681 INFO:tasks.workunit.client.1.smithi086.stdout:1/179: stat d4/d7/c2c 0 2024-08-19T00:55:57.681 INFO:tasks.workunit.client.1.smithi086.stdout:0/164: rename da/f28 to da/f3c 0 2024-08-19T00:55:57.682 INFO:tasks.workunit.client.1.smithi086.stdout:0/165: truncate da/f3c 1024451 0 2024-08-19T00:55:57.683 INFO:tasks.workunit.client.1.smithi086.stdout:7/146: truncate d3/de/f1e 322363 0 2024-08-19T00:55:57.684 INFO:tasks.workunit.client.1.smithi086.stdout:3/136: unlink d3/d9/fa 0 2024-08-19T00:55:57.685 INFO:tasks.workunit.client.1.smithi086.stdout:2/95: dwrite d8/d14/f15 [0,4194304] 0 2024-08-19T00:55:57.686 INFO:tasks.workunit.client.1.smithi086.stdout:8/150: creat dc/d17/f31 x:0 0 0 2024-08-19T00:55:57.687 INFO:tasks.workunit.client.1.smithi086.stdout:9/118: dread f7 [0,4194304] 0 2024-08-19T00:55:57.687 INFO:tasks.workunit.client.1.smithi086.stdout:2/96: readlink d8/l9 0 2024-08-19T00:55:57.688 INFO:tasks.workunit.client.1.smithi086.stdout:3/137: chown d3/d9/l25 50470135 1 2024-08-19T00:55:57.688 INFO:tasks.workunit.client.1.smithi086.stdout:6/138: creat db/f2b x:0 0 0 2024-08-19T00:55:57.689 INFO:tasks.workunit.client.1.smithi086.stdout:6/139: fsync db/f16 0 2024-08-19T00:55:57.695 INFO:tasks.workunit.client.1.smithi086.stdout:7/147: dwrite d3/de/f15 [0,4194304] 0 2024-08-19T00:55:57.697 INFO:tasks.workunit.client.1.smithi086.stdout:7/148: dread d3/fb [0,4194304] 0 2024-08-19T00:55:57.699 INFO:tasks.workunit.client.1.smithi086.stdout:6/140: rename c7 to db/d1b/d28/c2c 0 2024-08-19T00:55:57.703 INFO:tasks.workunit.client.1.smithi086.stdout:2/97: link d8/ff d8/f1a 0 2024-08-19T00:55:57.705 INFO:tasks.workunit.client.1.smithi086.stdout:7/149: dwrite d3/ff [4194304,4194304] 0 2024-08-19T00:55:57.705 INFO:tasks.workunit.client.1.smithi086.stdout:0/166: write da/fe [5241416,48043] 0 2024-08-19T00:55:57.705 INFO:tasks.workunit.client.1.smithi086.stdout:7/150: readlink d3/la 0 2024-08-19T00:55:57.706 INFO:tasks.workunit.client.1.smithi086.stdout:0/167: stat da/d14/d26/f33 0 2024-08-19T00:55:57.709 INFO:tasks.workunit.client.1.smithi086.stdout:8/151: write f5 [1120108,69171] 0 2024-08-19T00:55:57.709 INFO:tasks.workunit.client.1.smithi086.stdout:9/119: link l3 db/dd/d19/l24 0 2024-08-19T00:55:57.709 INFO:tasks.workunit.client.1.smithi086.stdout:7/151: rmdir d3 39 2024-08-19T00:55:57.710 INFO:tasks.workunit.client.1.smithi086.stdout:6/141: mknod db/c2d 0 2024-08-19T00:55:57.711 INFO:tasks.workunit.client.1.smithi086.stdout:3/138: getdents d3/d18/d19/d20 0 2024-08-19T00:55:57.713 INFO:tasks.workunit.client.1.smithi086.stdout:8/152: mkdir dc/d16/d18/d29/d32 0 2024-08-19T00:55:57.714 INFO:tasks.workunit.client.1.smithi086.stdout:9/120: creat db/dd/d19/d18/f25 x:0 0 0 2024-08-19T00:55:57.716 INFO:tasks.workunit.client.1.smithi086.stdout:7/152: chown d3/de/c16 48 1 2024-08-19T00:55:57.716 INFO:tasks.workunit.client.1.smithi086.stdout:0/168: rmdir da/d14/d1a/d37 0 2024-08-19T00:55:57.717 INFO:tasks.workunit.client.1.smithi086.stdout:9/121: fdatasync db/f1b 0 2024-08-19T00:55:57.718 INFO:tasks.workunit.client.1.smithi086.stdout:0/169: write da/d14/d26/f2c [148691,54164] 0 2024-08-19T00:55:57.719 INFO:tasks.workunit.client.1.smithi086.stdout:6/142: dwrite db/d1b/f21 [0,4194304] 0 2024-08-19T00:55:57.720 INFO:tasks.workunit.client.1.smithi086.stdout:6/143: readlink db/l1d 0 2024-08-19T00:55:57.720 INFO:tasks.workunit.client.1.smithi086.stdout:9/122: write db/dd/f14 [3274860,33075] 0 2024-08-19T00:55:57.720 INFO:tasks.workunit.client.1.smithi086.stdout:3/139: creat d3/d9/d2d/f35 x:0 0 0 2024-08-19T00:55:57.721 INFO:tasks.workunit.client.1.smithi086.stdout:6/144: write db/f13 [1452647,105934] 0 2024-08-19T00:55:57.722 INFO:tasks.workunit.client.1.smithi086.stdout:3/140: stat d3/d9/lb 0 2024-08-19T00:55:57.722 INFO:tasks.workunit.client.1.smithi086.stdout:6/145: chown la 24174584 1 2024-08-19T00:55:57.728 INFO:tasks.workunit.client.1.smithi086.stdout:9/123: dwrite f7 [4194304,4194304] 0 2024-08-19T00:55:57.728 INFO:tasks.workunit.client.1.smithi086.stdout:0/170: creat da/d14/d1a/f3d x:0 0 0 2024-08-19T00:55:57.732 INFO:tasks.workunit.client.1.smithi086.stdout:7/153: dread d3/de/f1e [0,4194304] 0 2024-08-19T00:55:57.734 INFO:tasks.workunit.client.1.smithi086.stdout:9/124: mkdir db/d26 0 2024-08-19T00:55:57.736 INFO:tasks.workunit.client.1.smithi086.stdout:0/171: mknod da/d14/d26/c3e 0 2024-08-19T00:55:57.736 INFO:tasks.workunit.client.1.smithi086.stdout:0/172: chown da/ff 1405281 1 2024-08-19T00:55:57.737 INFO:tasks.workunit.client.1.smithi086.stdout:2/98: truncate d8/d14/f15 2733662 0 2024-08-19T00:55:57.740 INFO:tasks.workunit.client.1.smithi086.stdout:7/154: creat d3/de/d2d/f32 x:0 0 0 2024-08-19T00:55:57.740 INFO:tasks.workunit.client.1.smithi086.stdout:7/155: chown d3/de/f11 605 1 2024-08-19T00:55:57.742 INFO:tasks.workunit.client.1.smithi086.stdout:6/146: creat db/f2e x:0 0 0 2024-08-19T00:55:57.744 INFO:tasks.workunit.client.1.smithi086.stdout:0/173: unlink da/d14/l34 0 2024-08-19T00:55:57.745 INFO:tasks.workunit.client.1.smithi086.stdout:3/141: dread d3/f5 [0,4194304] 0 2024-08-19T00:55:57.746 INFO:tasks.workunit.client.1.smithi086.stdout:2/99: mknod d8/d14/c1b 0 2024-08-19T00:55:57.748 INFO:tasks.workunit.client.1.smithi086.stdout:4/114: sync 2024-08-19T00:55:57.748 INFO:tasks.workunit.client.1.smithi086.stdout:7/156: unlink d3/f7 0 2024-08-19T00:55:57.748 INFO:tasks.workunit.client.1.smithi086.stdout:8/153: truncate dc/d17/f2a 2242081 0 2024-08-19T00:55:57.749 INFO:tasks.workunit.client.1.smithi086.stdout:9/125: creat db/d26/f27 x:0 0 0 2024-08-19T00:55:57.750 INFO:tasks.workunit.client.1.smithi086.stdout:6/147: unlink db/f23 0 2024-08-19T00:55:57.750 INFO:tasks.workunit.client.1.smithi086.stdout:2/100: dread d8/f11 [0,4194304] 0 2024-08-19T00:55:57.751 INFO:tasks.workunit.client.1.smithi086.stdout:3/142: creat d3/d18/f36 x:0 0 0 2024-08-19T00:55:57.752 INFO:tasks.workunit.client.1.smithi086.stdout:6/148: dread - db/f2e zero size 2024-08-19T00:55:57.754 INFO:tasks.workunit.client.1.smithi086.stdout:9/126: symlink db/l28 0 2024-08-19T00:55:57.755 INFO:tasks.workunit.client.1.smithi086.stdout:9/127: chown db/c13 0 1 2024-08-19T00:55:57.755 INFO:tasks.workunit.client.1.smithi086.stdout:4/115: mkdir d2/d1c/d1d/d27/d2b 0 2024-08-19T00:55:57.757 INFO:tasks.workunit.client.1.smithi086.stdout:7/157: dwrite d3/ff [0,4194304] 0 2024-08-19T00:55:57.757 INFO:tasks.workunit.client.1.smithi086.stdout:2/101: rename d8/d14/c1b to d8/c1c 0 2024-08-19T00:55:57.759 INFO:tasks.workunit.client.1.smithi086.stdout:7/158: fdatasync d3/de/f15 0 2024-08-19T00:55:57.759 INFO:tasks.workunit.client.1.smithi086.stdout:2/102: fsync d8/fe 0 2024-08-19T00:55:57.762 INFO:tasks.workunit.client.1.smithi086.stdout:9/128: creat db/d26/f29 x:0 0 0 2024-08-19T00:55:57.763 INFO:tasks.workunit.client.1.smithi086.stdout:7/159: stat d3/de/f12 0 2024-08-19T00:55:57.763 INFO:tasks.workunit.client.1.smithi086.stdout:8/154: creat dc/f33 x:0 0 0 2024-08-19T00:55:57.766 INFO:tasks.workunit.client.1.smithi086.stdout:7/160: fsync d3/de/d2d/f2f 0 2024-08-19T00:55:57.767 INFO:tasks.workunit.client.1.smithi086.stdout:6/149: dwrite db/d1b/f21 [4194304,4194304] 0 2024-08-19T00:55:57.770 INFO:tasks.workunit.client.1.smithi086.stdout:9/129: rmdir db/dd/d19/d18 39 2024-08-19T00:55:57.770 INFO:tasks.workunit.client.1.smithi086.stdout:4/116: dwrite d2/da/f13 [0,4194304] 0 2024-08-19T00:55:57.773 INFO:tasks.workunit.client.1.smithi086.stdout:0/174: write da/d14/f1b [1205487,56511] 0 2024-08-19T00:55:57.775 INFO:tasks.workunit.client.1.smithi086.stdout:8/155: dread dc/d1f/f27 [0,4194304] 0 2024-08-19T00:55:57.775 INFO:tasks.workunit.client.1.smithi086.stdout:7/161: symlink d3/l33 0 2024-08-19T00:55:57.777 INFO:tasks.workunit.client.1.smithi086.stdout:6/150: mkdir db/d1b/d28/d2f 0 2024-08-19T00:55:57.778 INFO:tasks.workunit.client.1.smithi086.stdout:2/103: link d8/fc d8/f1d 0 2024-08-19T00:55:57.778 INFO:tasks.workunit.client.1.smithi086.stdout:6/151: write db/f18 [1715792,86017] 0 2024-08-19T00:55:57.781 INFO:tasks.workunit.client.1.smithi086.stdout:9/130: dwrite db/f15 [0,4194304] 0 2024-08-19T00:55:57.783 INFO:tasks.workunit.client.1.smithi086.stdout:3/143: getdents d3/d18/d27 0 2024-08-19T00:55:57.784 INFO:tasks.workunit.client.1.smithi086.stdout:3/144: chown d3/d18/d19/d20/f21 1 1 2024-08-19T00:55:57.785 INFO:tasks.workunit.client.1.smithi086.stdout:7/162: mkdir d3/d34 0 2024-08-19T00:55:57.786 INFO:tasks.workunit.client.1.smithi086.stdout:8/156: mknod dc/d17/d1e/c34 0 2024-08-19T00:55:57.786 INFO:tasks.workunit.client.1.smithi086.stdout:8/157: chown f5 559077877 1 2024-08-19T00:55:57.793 INFO:tasks.workunit.client.1.smithi086.stdout:3/145: mkdir d3/d18/d19/d37 0 2024-08-19T00:55:57.796 INFO:tasks.workunit.client.0.smithi017.stderr:++ readlink -f fsstress 2024-08-19T00:55:57.798 INFO:tasks.workunit.client.0.smithi017.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-08-19T00:55:57.799 INFO:tasks.workunit.client.0.smithi017.stderr:+ popd 2024-08-19T00:55:57.800 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-08-19T00:55:57.800 INFO:tasks.workunit.client.0.smithi017.stderr:+ popd 2024-08-19T00:55:57.801 INFO:tasks.workunit.client.0.smithi017.stdout:~/cephtest/mnt.0/client.0/tmp 2024-08-19T00:55:57.801 INFO:tasks.workunit.client.0.smithi017.stderr:++ mktemp -d -p . 2024-08-19T00:55:57.803 INFO:tasks.workunit.client.0.smithi017.stderr:+ T=./tmp.fHyOCfnTF1 2024-08-19T00:55:57.803 INFO:tasks.workunit.client.0.smithi017.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.fHyOCfnTF1 -l 1 -n 1000 -p 10 -v 2024-08-19T00:55:57.808 INFO:tasks.workunit.client.0.smithi017.stdout:seed = 1724828151 2024-08-19T00:55:57.812 INFO:tasks.workunit.client.0.smithi017.stdout:0/0: dwrite - no filename 2024-08-19T00:55:57.812 INFO:tasks.workunit.client.0.smithi017.stdout:0/1: chown . 2896 1 2024-08-19T00:55:57.814 INFO:tasks.workunit.client.0.smithi017.stdout:0/2: creat f0 x:0 0 0 2024-08-19T00:55:57.816 INFO:tasks.workunit.client.0.smithi017.stdout:2/0: dread - no filename 2024-08-19T00:55:57.817 INFO:tasks.workunit.client.0.smithi017.stdout:0/3: creat f1 x:0 0 0 2024-08-19T00:55:57.817 INFO:tasks.workunit.client.0.smithi017.stdout:0/4: rmdir - no directory 2024-08-19T00:55:57.817 INFO:tasks.workunit.client.0.smithi017.stdout:1/0: symlink l0 0 2024-08-19T00:55:57.817 INFO:tasks.workunit.client.0.smithi017.stdout:1/1: dread - no filename 2024-08-19T00:55:57.819 INFO:tasks.workunit.client.0.smithi017.stdout:3/0: write - no filename 2024-08-19T00:55:57.819 INFO:tasks.workunit.client.0.smithi017.stdout:0/5: mknod c2 0 2024-08-19T00:55:57.819 INFO:tasks.workunit.client.0.smithi017.stdout:3/1: chown . 104631896 1 2024-08-19T00:55:57.819 INFO:tasks.workunit.client.0.smithi017.stdout:3/2: write - no filename 2024-08-19T00:55:57.819 INFO:tasks.workunit.client.0.smithi017.stdout:3/3: fsync - no filename 2024-08-19T00:55:57.819 INFO:tasks.workunit.client.0.smithi017.stdout:3/4: dread - no filename 2024-08-19T00:55:57.819 INFO:tasks.workunit.client.0.smithi017.stdout:3/5: read - no filename 2024-08-19T00:55:57.820 INFO:tasks.workunit.client.0.smithi017.stdout:1/2: symlink l1 0 2024-08-19T00:55:57.820 INFO:tasks.workunit.client.0.smithi017.stdout:1/3: stat l0 0 2024-08-19T00:55:57.820 INFO:tasks.workunit.client.0.smithi017.stdout:2/1: symlink l0 0 2024-08-19T00:55:57.820 INFO:tasks.workunit.client.0.smithi017.stdout:2/2: dwrite - no filename 2024-08-19T00:55:57.820 INFO:tasks.workunit.client.0.smithi017.stdout:2/3: chown l0 810995004 1 2024-08-19T00:55:57.821 INFO:tasks.workunit.client.0.smithi017.stdout:4/0: dwrite - no filename 2024-08-19T00:55:57.822 INFO:tasks.workunit.client.0.smithi017.stdout:0/6: mknod c3 0 2024-08-19T00:55:57.822 INFO:tasks.workunit.client.0.smithi017.stdout:0/7: dread - f0 zero size 2024-08-19T00:55:57.823 INFO:tasks.workunit.client.0.smithi017.stdout:1/4: creat f2 x:0 0 0 2024-08-19T00:55:57.824 INFO:tasks.workunit.client.0.smithi017.stdout:2/4: symlink l1 0 2024-08-19T00:55:57.824 INFO:tasks.workunit.client.0.smithi017.stdout:2/5: write - no filename 2024-08-19T00:55:57.824 INFO:tasks.workunit.client.0.smithi017.stdout:2/6: dread - no filename 2024-08-19T00:55:57.825 INFO:tasks.workunit.client.0.smithi017.stdout:3/6: symlink l0 0 2024-08-19T00:55:57.826 INFO:tasks.workunit.client.0.smithi017.stdout:5/0: write - no filename 2024-08-19T00:55:57.826 INFO:tasks.workunit.client.0.smithi017.stdout:1/5: symlink l3 0 2024-08-19T00:55:57.827 INFO:tasks.workunit.client.0.smithi017.stdout:2/7: unlink l1 0 2024-08-19T00:55:57.828 INFO:tasks.workunit.client.0.smithi017.stdout:1/6: fdatasync f2 0 2024-08-19T00:55:57.829 INFO:tasks.workunit.client.0.smithi017.stdout:4/1: creat f0 x:0 0 0 2024-08-19T00:55:57.829 INFO:tasks.workunit.client.0.smithi017.stdout:3/7: creat f1 x:0 0 0 2024-08-19T00:55:57.831 INFO:tasks.workunit.client.0.smithi017.stdout:4/2: chown f0 38171 1 2024-08-19T00:55:57.831 INFO:tasks.workunit.client.0.smithi017.stdout:1/7: dread - f2 zero size 2024-08-19T00:55:57.832 INFO:tasks.workunit.client.0.smithi017.stdout:2/8: mkdir d2 0 2024-08-19T00:55:57.835 INFO:tasks.workunit.client.0.smithi017.stdout:5/1: symlink l0 0 2024-08-19T00:55:57.835 INFO:tasks.workunit.client.0.smithi017.stdout:5/2: fsync - no filename 2024-08-19T00:55:57.835 INFO:tasks.workunit.client.0.smithi017.stdout:5/3: dread - no filename 2024-08-19T00:55:57.835 INFO:tasks.workunit.client.0.smithi017.stdout:7/0: write - no filename 2024-08-19T00:55:57.836 INFO:tasks.workunit.client.0.smithi017.stdout:0/8: dwrite f0 [0,4194304] 0 2024-08-19T00:55:57.839 INFO:tasks.workunit.client.0.smithi017.stdout:4/3: link f0 f1 0 2024-08-19T00:55:57.839 INFO:tasks.workunit.client.0.smithi017.stdout:4/4: readlink - no filename 2024-08-19T00:55:57.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/4: symlink l1 0 2024-08-19T00:55:57.841 INFO:tasks.workunit.client.0.smithi017.stdout:2/9: creat d2/f3 x:0 0 0 2024-08-19T00:55:57.842 INFO:tasks.workunit.client.1.smithi086.stdout:7/163: creat d3/de/d2d/f35 x:0 0 0 2024-08-19T00:55:57.842 INFO:tasks.workunit.client.1.smithi086.stdout:0/175: mkdir da/d14/d1a/d2e/d39/d3b/d3f 0 2024-08-19T00:55:57.843 INFO:tasks.workunit.client.1.smithi086.stdout:9/131: link f7 db/d23/f2a 0 2024-08-19T00:55:57.843 INFO:tasks.workunit.client.1.smithi086.stdout:7/164: fdatasync d3/de/d2d/f35 0 2024-08-19T00:55:57.844 INFO:tasks.workunit.client.1.smithi086.stdout:2/104: rmdir d8 39 2024-08-19T00:55:57.847 INFO:tasks.workunit.client.0.smithi017.stdout:0/9: mknod c4 0 2024-08-19T00:55:57.847 INFO:tasks.workunit.client.0.smithi017.stdout:1/8: dwrite f2 [0,4194304] 0 2024-08-19T00:55:57.848 INFO:tasks.workunit.client.1.smithi086.stdout:0/176: truncate da/d14/d1a/d2e/f35 592376 0 2024-08-19T00:55:57.848 INFO:tasks.workunit.client.1.smithi086.stdout:7/165: truncate d3/de/f12 597321 0 2024-08-19T00:55:57.849 INFO:tasks.workunit.client.1.smithi086.stdout:3/146: chown d3/d18/d1a/c28 236 1 2024-08-19T00:55:57.850 INFO:tasks.workunit.client.0.smithi017.stdout:4/5: unlink f1 0 2024-08-19T00:55:57.850 INFO:tasks.workunit.client.1.smithi086.stdout:0/177: fdatasync da/f36 0 2024-08-19T00:55:57.851 INFO:tasks.workunit.client.0.smithi017.stdout:5/5: mknod c2 0 2024-08-19T00:55:57.852 INFO:tasks.workunit.client.1.smithi086.stdout:9/132: rmdir db/dd 39 2024-08-19T00:55:57.853 INFO:tasks.workunit.client.0.smithi017.stdout:5/6: chown c2 1516562754 1 2024-08-19T00:55:57.853 INFO:tasks.workunit.client.1.smithi086.stdout:8/158: dwrite dc/d1f/f27 [4194304,4194304] 0 2024-08-19T00:55:57.854 INFO:tasks.workunit.client.0.smithi017.stdout:2/10: mkdir d2/d4 0 2024-08-19T00:55:57.856 INFO:tasks.workunit.client.0.smithi017.stdout:7/1: symlink l0 0 2024-08-19T00:55:57.856 INFO:tasks.workunit.client.1.smithi086.stdout:4/117: dwrite d2/f23 [0,4194304] 0 2024-08-19T00:55:57.857 INFO:tasks.workunit.client.0.smithi017.stdout:0/10: dwrite f0 [0,4194304] 0 2024-08-19T00:55:57.859 INFO:tasks.workunit.client.0.smithi017.stdout:9/0: link - no file 2024-08-19T00:55:57.859 INFO:tasks.workunit.client.0.smithi017.stdout:9/1: chown . 15642907 1 2024-08-19T00:55:57.860 INFO:tasks.workunit.client.1.smithi086.stdout:8/159: chown dc/d17/f31 349669 1 2024-08-19T00:55:57.862 INFO:tasks.workunit.client.1.smithi086.stdout:3/147: creat d3/d26/d2b/f38 x:0 0 0 2024-08-19T00:55:57.865 INFO:tasks.workunit.client.0.smithi017.stdout:3/8: fsync f1 0 2024-08-19T00:55:57.867 INFO:tasks.workunit.client.1.smithi086.stdout:7/166: dwrite d3/de/f27 [0,4194304] 0 2024-08-19T00:55:57.868 INFO:tasks.workunit.client.0.smithi017.stdout:3/9: write f1 [388900,16168] 0 2024-08-19T00:55:57.869 INFO:tasks.workunit.client.1.smithi086.stdout:2/105: dwrite d8/f10 [0,4194304] 0 2024-08-19T00:55:57.870 INFO:tasks.workunit.client.0.smithi017.stdout:3/10: truncate f1 492164 0 2024-08-19T00:55:57.870 INFO:tasks.workunit.client.1.smithi086.stdout:0/178: rename f6 to da/d14/d1a/f40 0 2024-08-19T00:55:57.873 INFO:tasks.workunit.client.0.smithi017.stdout:4/6: dread - f0 zero size 2024-08-19T00:55:57.874 INFO:tasks.workunit.client.1.smithi086.stdout:0/179: read da/d14/f15 [495719,120786] 0 2024-08-19T00:55:57.874 INFO:tasks.workunit.client.1.smithi086.stdout:4/118: mkdir d2/d1c/d2c 0 2024-08-19T00:55:57.874 INFO:tasks.workunit.client.1.smithi086.stdout:8/160: symlink dc/d17/d1e/l35 0 2024-08-19T00:55:57.874 INFO:tasks.workunit.client.0.smithi017.stdout:4/7: stat f0 0 2024-08-19T00:55:57.874 INFO:tasks.workunit.client.0.smithi017.stdout:4/8: dread - f0 zero size 2024-08-19T00:55:57.875 INFO:tasks.workunit.client.1.smithi086.stdout:0/180: chown da/d14/d26/f2c 2029 1 2024-08-19T00:55:57.875 INFO:tasks.workunit.client.0.smithi017.stdout:2/11: symlink d2/l5 0 2024-08-19T00:55:57.876 INFO:tasks.workunit.client.1.smithi086.stdout:3/148: creat d3/d9/f39 x:0 0 0 2024-08-19T00:55:57.876 INFO:tasks.workunit.client.1.smithi086.stdout:3/149: fdatasync d3/f29 0 2024-08-19T00:55:57.880 INFO:tasks.workunit.client.1.smithi086.stdout:8/161: dread dc/f11 [4194304,4194304] 0 2024-08-19T00:55:57.880 INFO:tasks.workunit.client.0.smithi017.stdout:7/2: symlink l1 0 2024-08-19T00:55:57.880 INFO:tasks.workunit.client.0.smithi017.stdout:7/3: read - no filename 2024-08-19T00:55:57.881 INFO:tasks.workunit.client.1.smithi086.stdout:8/162: write dc/f23 [165911,91176] 0 2024-08-19T00:55:57.881 INFO:tasks.workunit.client.1.smithi086.stdout:0/181: dwrite da/d14/f17 [0,4194304] 0 2024-08-19T00:55:57.882 INFO:tasks.workunit.client.0.smithi017.stdout:0/11: mkdir d5 0 2024-08-19T00:55:57.884 INFO:tasks.workunit.client.0.smithi017.stdout:2/12: dwrite d2/f3 [0,4194304] 0 2024-08-19T00:55:57.886 INFO:tasks.workunit.client.0.smithi017.stdout:0/12: write f0 [4799474,82034] 0 2024-08-19T00:55:57.887 INFO:tasks.workunit.client.1.smithi086.stdout:7/167: symlink d3/de/l36 0 2024-08-19T00:55:57.890 INFO:tasks.workunit.client.1.smithi086.stdout:2/106: creat d8/f1e x:0 0 0 2024-08-19T00:55:57.891 INFO:tasks.workunit.client.0.smithi017.stdout:8/0: creat f0 x:0 0 0 2024-08-19T00:55:57.891 INFO:tasks.workunit.client.1.smithi086.stdout:2/107: readlink d8/l9 0 2024-08-19T00:55:57.891 INFO:tasks.workunit.client.1.smithi086.stdout:7/168: dread d3/ff [4194304,4194304] 0 2024-08-19T00:55:57.892 INFO:tasks.workunit.client.1.smithi086.stdout:7/169: truncate d3/de/d2d/f32 750297 0 2024-08-19T00:55:57.898 INFO:tasks.workunit.client.0.smithi017.stdout:3/11: creat f2 x:0 0 0 2024-08-19T00:55:57.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/13: dread d2/f3 [0,4194304] 0 2024-08-19T00:55:57.903 INFO:tasks.workunit.client.1.smithi086.stdout:5/131: sync 2024-08-19T00:55:57.903 INFO:tasks.workunit.client.1.smithi086.stdout:4/119: dwrite d2/f26 [0,4194304] 0 2024-08-19T00:55:57.904 INFO:tasks.workunit.client.0.smithi017.stdout:1/9: dwrite f2 [4194304,4194304] 0 2024-08-19T00:55:57.904 INFO:tasks.workunit.client.1.smithi086.stdout:4/120: chown d2/f21 91 1 2024-08-19T00:55:57.905 INFO:tasks.workunit.client.0.smithi017.stdout:4/9: fsync f0 0 2024-08-19T00:55:57.905 INFO:tasks.workunit.client.0.smithi017.stdout:2/14: chown l0 34898 1 2024-08-19T00:55:57.905 INFO:tasks.workunit.client.1.smithi086.stdout:0/182: write da/d14/d1a/f40 [2290278,61242] 0 2024-08-19T00:55:57.908 INFO:tasks.workunit.client.0.smithi017.stdout:1/10: chown l3 1 1 2024-08-19T00:55:57.910 INFO:tasks.workunit.client.1.smithi086.stdout:2/108: rename d8/fc to d8/f1f 0 2024-08-19T00:55:57.911 INFO:tasks.workunit.client.0.smithi017.stdout:9/2: mkdir d0 0 2024-08-19T00:55:57.911 INFO:tasks.workunit.client.0.smithi017.stdout:8/1: dwrite f0 [0,4194304] 0 2024-08-19T00:55:57.913 INFO:tasks.workunit.client.0.smithi017.stdout:9/3: chown d0 732824 1 2024-08-19T00:55:57.914 INFO:tasks.workunit.client.0.smithi017.stdout:9/4: rename d0 to d0/d1 22 2024-08-19T00:55:57.914 INFO:tasks.workunit.client.0.smithi017.stdout:9/5: dread - no filename 2024-08-19T00:55:57.914 INFO:tasks.workunit.client.0.smithi017.stdout:9/6: dwrite - no filename 2024-08-19T00:55:57.914 INFO:tasks.workunit.client.1.smithi086.stdout:9/133: rename db/dd/d19/d18/c22 to db/dd/c2b 0 2024-08-19T00:55:57.915 INFO:tasks.workunit.client.0.smithi017.stdout:3/12: dwrite f2 [0,4194304] 0 2024-08-19T00:55:57.916 INFO:tasks.workunit.client.0.smithi017.stdout:3/13: fsync f1 0 2024-08-19T00:55:57.918 INFO:tasks.workunit.client.1.smithi086.stdout:3/150: mkdir d3/d18/d19/d37/d3a 0 2024-08-19T00:55:57.918 INFO:tasks.workunit.client.0.smithi017.stdout:5/7: link l0 l3 0 2024-08-19T00:55:57.921 INFO:tasks.workunit.client.1.smithi086.stdout:5/132: creat d0/d8/f26 x:0 0 0 2024-08-19T00:55:57.922 INFO:tasks.workunit.client.0.smithi017.stdout:4/10: mkdir d2 0 2024-08-19T00:55:57.923 INFO:tasks.workunit.client.1.smithi086.stdout:9/134: dwrite db/dd/f14 [0,4194304] 0 2024-08-19T00:55:57.924 INFO:tasks.workunit.client.1.smithi086.stdout:9/135: write db/dd/f14 [1635403,60419] 0 2024-08-19T00:55:57.925 INFO:tasks.workunit.client.1.smithi086.stdout:5/133: truncate d0/d8/d10/f19 86133 0 2024-08-19T00:55:57.926 INFO:tasks.workunit.client.1.smithi086.stdout:2/109: unlink d8/d14/f18 0 2024-08-19T00:55:57.929 INFO:tasks.workunit.client.1.smithi086.stdout:9/136: dread db/f1b [0,4194304] 0 2024-08-19T00:55:57.930 INFO:tasks.workunit.client.1.smithi086.stdout:9/137: chown db/le 27 1 2024-08-19T00:55:57.933 INFO:tasks.workunit.client.0.smithi017.stdout:2/15: unlink l0 0 2024-08-19T00:55:57.935 INFO:tasks.workunit.client.1.smithi086.stdout:7/170: creat d3/de/d30/f37 x:0 0 0 2024-08-19T00:55:57.937 INFO:tasks.workunit.client.1.smithi086.stdout:8/163: creat dc/f36 x:0 0 0 2024-08-19T00:55:57.939 INFO:tasks.workunit.client.1.smithi086.stdout:9/138: dread db/dd/f14 [0,4194304] 0 2024-08-19T00:55:57.940 INFO:tasks.workunit.client.1.smithi086.stdout:4/121: mknod d2/d1c/d2c/c2d 0 2024-08-19T00:55:57.941 INFO:tasks.workunit.client.1.smithi086.stdout:4/122: dread - d2/d18/f28 zero size 2024-08-19T00:55:57.943 INFO:tasks.workunit.client.0.smithi017.stdout:8/2: symlink l1 0 2024-08-19T00:55:57.945 INFO:tasks.workunit.client.0.smithi017.stdout:3/14: creat f3 x:0 0 0 2024-08-19T00:55:57.948 INFO:tasks.workunit.client.1.smithi086.stdout:5/134: unlink d0/d8/c1b 0 2024-08-19T00:55:57.948 INFO:tasks.workunit.client.1.smithi086.stdout:5/135: stat d0/d8/d10/f1d 0 2024-08-19T00:55:57.949 INFO:tasks.workunit.client.1.smithi086.stdout:5/136: chown d0/d8/le 61 1 2024-08-19T00:55:57.950 INFO:tasks.workunit.client.0.smithi017.stdout:5/8: rename l1 to l4 0 2024-08-19T00:55:57.952 INFO:tasks.workunit.client.1.smithi086.stdout:2/110: creat d8/f20 x:0 0 0 2024-08-19T00:55:57.953 INFO:tasks.workunit.client.0.smithi017.stdout:7/4: link l0 l2 0 2024-08-19T00:55:57.959 INFO:tasks.workunit.client.1.smithi086.stdout:7/171: creat d3/f38 x:0 0 0 2024-08-19T00:55:57.961 INFO:tasks.workunit.client.1.smithi086.stdout:3/151: truncate d3/f14 1576128 0 2024-08-19T00:55:57.964 INFO:tasks.workunit.client.0.smithi017.stdout:4/11: dwrite f0 [0,4194304] 0 2024-08-19T00:55:57.965 INFO:tasks.workunit.client.0.smithi017.stdout:0/13: truncate f0 2244517 0 2024-08-19T00:55:57.965 INFO:tasks.workunit.client.0.smithi017.stdout:0/14: readlink - no filename 2024-08-19T00:55:57.965 INFO:tasks.workunit.client.0.smithi017.stdout:9/7: creat d0/f2 x:0 0 0 2024-08-19T00:55:57.967 INFO:tasks.workunit.client.0.smithi017.stdout:8/3: symlink l2 0 2024-08-19T00:55:57.969 INFO:tasks.workunit.client.1.smithi086.stdout:4/123: creat d2/d1c/d2c/f2e x:0 0 0 2024-08-19T00:55:57.972 INFO:tasks.workunit.client.1.smithi086.stdout:5/137: creat d0/df/d1f/f27 x:0 0 0 2024-08-19T00:55:57.973 INFO:tasks.workunit.client.0.smithi017.stdout:5/9: creat f5 x:0 0 0 2024-08-19T00:55:57.975 INFO:tasks.workunit.client.1.smithi086.stdout:4/124: dwrite d2/f1b [4194304,4194304] 0 2024-08-19T00:55:57.975 INFO:tasks.workunit.client.1.smithi086.stdout:2/111: mknod d8/c21 0 2024-08-19T00:55:57.976 INFO:tasks.workunit.client.0.smithi017.stdout:8/4: dwrite f0 [0,4194304] 0 2024-08-19T00:55:57.977 INFO:tasks.workunit.client.1.smithi086.stdout:5/138: dread d0/df/f23 [0,4194304] 0 2024-08-19T00:55:57.977 INFO:tasks.workunit.client.0.smithi017.stdout:7/5: mkdir d3 0 2024-08-19T00:55:57.978 INFO:tasks.workunit.client.0.smithi017.stdout:7/6: read - no filename 2024-08-19T00:55:57.978 INFO:tasks.workunit.client.0.smithi017.stdout:7/7: truncate - no filename 2024-08-19T00:55:57.978 INFO:tasks.workunit.client.0.smithi017.stdout:7/8: dread - no filename 2024-08-19T00:55:57.978 INFO:tasks.workunit.client.0.smithi017.stdout:7/9: dwrite - no filename 2024-08-19T00:55:57.978 INFO:tasks.workunit.client.0.smithi017.stdout:7/10: chown d3 19 1 2024-08-19T00:55:57.979 INFO:tasks.workunit.client.0.smithi017.stdout:2/16: symlink d2/d4/l6 0 2024-08-19T00:55:57.982 INFO:tasks.workunit.client.1.smithi086.stdout:7/172: unlink d3/de/l36 0 2024-08-19T00:55:57.985 INFO:tasks.workunit.client.0.smithi017.stdout:0/15: rename c2 to d5/c6 0 2024-08-19T00:55:57.986 INFO:tasks.workunit.client.0.smithi017.stdout:1/11: truncate f2 3950608 0 2024-08-19T00:55:57.986 INFO:tasks.workunit.client.0.smithi017.stdout:1/12: readlink l0 0 2024-08-19T00:55:57.987 INFO:tasks.workunit.client.0.smithi017.stdout:0/16: truncate f1 318714 0 2024-08-19T00:55:57.987 INFO:tasks.workunit.client.1.smithi086.stdout:1/180: sync 2024-08-19T00:55:57.988 INFO:tasks.workunit.client.0.smithi017.stdout:1/13: chown l0 749794 1 2024-08-19T00:55:57.989 INFO:tasks.workunit.client.0.smithi017.stdout:9/8: mknod d0/c3 0 2024-08-19T00:55:57.993 INFO:tasks.workunit.client.1.smithi086.stdout:2/112: dread d8/f1d [0,4194304] 0 2024-08-19T00:55:57.994 INFO:tasks.workunit.client.0.smithi017.stdout:5/10: creat f6 x:0 0 0 2024-08-19T00:55:57.994 INFO:tasks.workunit.client.0.smithi017.stdout:5/11: rmdir - no directory 2024-08-19T00:55:57.994 INFO:tasks.workunit.client.0.smithi017.stdout:5/12: read - f5 zero size 2024-08-19T00:55:57.995 INFO:tasks.workunit.client.0.smithi017.stdout:5/13: dread - f5 zero size 2024-08-19T00:55:57.995 INFO:tasks.workunit.client.1.smithi086.stdout:4/125: rename d2/d1c/d1d/d27 to d2/da/d2f 0 2024-08-19T00:55:57.996 INFO:tasks.workunit.client.0.smithi017.stdout:8/5: fsync f0 0 2024-08-19T00:55:57.996 INFO:tasks.workunit.client.1.smithi086.stdout:5/139: creat d0/df/d1f/f28 x:0 0 0 2024-08-19T00:55:57.998 INFO:tasks.workunit.client.0.smithi017.stdout:7/11: unlink l0 0 2024-08-19T00:55:57.998 INFO:tasks.workunit.client.0.smithi017.stdout:7/12: read - no filename 2024-08-19T00:55:57.998 INFO:tasks.workunit.client.0.smithi017.stdout:7/13: chown d3 91186403 1 2024-08-19T00:55:58.000 INFO:tasks.workunit.client.1.smithi086.stdout:7/173: rmdir d3/de/d30 39 2024-08-19T00:55:58.000 INFO:tasks.workunit.client.1.smithi086.stdout:7/174: fdatasync d3/de/d2d/f2f 0 2024-08-19T00:55:58.001 INFO:tasks.workunit.client.1.smithi086.stdout:7/175: dread - d3/de/d1b/f23 zero size 2024-08-19T00:55:58.005 INFO:tasks.workunit.client.1.smithi086.stdout:1/181: creat d4/d7/f39 x:0 0 0 2024-08-19T00:55:58.006 INFO:tasks.workunit.client.0.smithi017.stdout:2/17: rmdir d2 39 2024-08-19T00:55:58.006 INFO:tasks.workunit.client.1.smithi086.stdout:7/176: dwrite d3/de/f12 [0,4194304] 0 2024-08-19T00:55:58.007 INFO:tasks.workunit.client.0.smithi017.stdout:9/9: mknod d0/c4 0 2024-08-19T00:55:58.010 INFO:tasks.workunit.client.1.smithi086.stdout:1/182: dread d4/f6 [0,4194304] 0 2024-08-19T00:55:58.010 INFO:tasks.workunit.client.1.smithi086.stdout:2/113: creat d8/d14/f22 x:0 0 0 2024-08-19T00:55:58.011 INFO:tasks.workunit.client.1.smithi086.stdout:2/114: fdatasync d8/d14/f22 0 2024-08-19T00:55:58.011 INFO:tasks.workunit.client.1.smithi086.stdout:2/115: stat d8/d14/f15 0 2024-08-19T00:55:58.012 INFO:tasks.workunit.client.0.smithi017.stdout:1/14: write f2 [342695,3281] 0 2024-08-19T00:55:58.012 INFO:tasks.workunit.client.1.smithi086.stdout:2/116: chown d8 4486 1 2024-08-19T00:55:58.012 INFO:tasks.workunit.client.1.smithi086.stdout:2/117: chown d8/d14/f22 4179255 1 2024-08-19T00:55:58.013 INFO:tasks.workunit.client.1.smithi086.stdout:2/118: fsync d8/f10 0 2024-08-19T00:55:58.013 INFO:tasks.workunit.client.1.smithi086.stdout:0/183: sync 2024-08-19T00:55:58.013 INFO:tasks.workunit.client.1.smithi086.stdout:6/152: sync 2024-08-19T00:55:58.014 INFO:tasks.workunit.client.0.smithi017.stdout:8/6: unlink l1 0 2024-08-19T00:55:58.015 INFO:tasks.workunit.client.0.smithi017.stdout:1/15: read f2 [2734501,130596] 0 2024-08-19T00:55:58.016 INFO:tasks.workunit.client.1.smithi086.stdout:5/140: rmdir d0/d8/d10 39 2024-08-19T00:55:58.017 INFO:tasks.workunit.client.0.smithi017.stdout:1/16: write f2 [3984190,34210] 0 2024-08-19T00:55:58.020 INFO:tasks.workunit.client.0.smithi017.stdout:9/10: dwrite d0/f2 [0,4194304] 0 2024-08-19T00:55:58.020 INFO:tasks.workunit.client.0.smithi017.stdout:3/15: truncate f2 2595414 0 2024-08-19T00:55:58.021 INFO:tasks.workunit.client.0.smithi017.stdout:5/14: fsync f6 0 2024-08-19T00:55:58.022 INFO:tasks.workunit.client.1.smithi086.stdout:8/164: getdents dc/d16/d18/d29/d2e/d28 0 2024-08-19T00:55:58.022 INFO:tasks.workunit.client.0.smithi017.stdout:5/15: dread - f5 zero size 2024-08-19T00:55:58.022 INFO:tasks.workunit.client.1.smithi086.stdout:5/141: dwrite d0/df/d1f/f27 [0,4194304] 0 2024-08-19T00:55:58.025 INFO:tasks.workunit.client.0.smithi017.stdout:7/14: creat d3/f4 x:0 0 0 2024-08-19T00:55:58.028 INFO:tasks.workunit.client.0.smithi017.stdout:7/15: write d3/f4 [332068,99025] 0 2024-08-19T00:55:58.031 INFO:tasks.workunit.client.0.smithi017.stdout:2/18: mkdir d2/d7 0 2024-08-19T00:55:58.032 INFO:tasks.workunit.client.1.smithi086.stdout:9/139: getdents db/dd/d19 0 2024-08-19T00:55:58.033 INFO:tasks.workunit.client.0.smithi017.stdout:3/16: dwrite f1 [0,4194304] 0 2024-08-19T00:55:58.035 INFO:tasks.workunit.client.0.smithi017.stdout:3/17: write f1 [2775472,56860] 0 2024-08-19T00:55:58.035 INFO:tasks.workunit.client.1.smithi086.stdout:7/177: creat d3/f39 x:0 0 0 2024-08-19T00:55:58.036 INFO:tasks.workunit.client.1.smithi086.stdout:7/178: dread - d3/de/d1b/f23 zero size 2024-08-19T00:55:58.039 INFO:tasks.workunit.client.1.smithi086.stdout:1/183: mkdir d4/d7/d2a/d36/d3a 0 2024-08-19T00:55:58.039 INFO:tasks.workunit.client.0.smithi017.stdout:9/11: rename d0/c4 to d0/c5 0 2024-08-19T00:55:58.042 INFO:tasks.workunit.client.0.smithi017.stdout:5/16: creat f7 x:0 0 0 2024-08-19T00:55:58.042 INFO:tasks.workunit.client.0.smithi017.stdout:5/17: dread - f7 zero size 2024-08-19T00:55:58.045 INFO:tasks.workunit.client.0.smithi017.stdout:9/12: fdatasync d0/f2 0 2024-08-19T00:55:58.047 INFO:tasks.workunit.client.1.smithi086.stdout:2/119: creat d8/f23 x:0 0 0 2024-08-19T00:55:58.048 INFO:tasks.workunit.client.1.smithi086.stdout:4/126: mkdir d2/d1c/d25/d30 0 2024-08-19T00:55:58.049 INFO:tasks.workunit.client.1.smithi086.stdout:6/153: fdatasync f3 0 2024-08-19T00:55:58.050 INFO:tasks.workunit.client.1.smithi086.stdout:6/154: chown db/d1b/f24 37046696 1 2024-08-19T00:55:58.051 INFO:tasks.workunit.client.1.smithi086.stdout:6/155: write db/f2e [1014377,48775] 0 2024-08-19T00:55:58.051 INFO:tasks.workunit.client.1.smithi086.stdout:0/184: creat da/d14/f41 x:0 0 0 2024-08-19T00:55:58.052 INFO:tasks.workunit.client.0.smithi017.stdout:7/16: readlink l2 0 2024-08-19T00:55:58.053 INFO:tasks.workunit.client.1.smithi086.stdout:3/152: getdents d3/d26 0 2024-08-19T00:55:58.054 INFO:tasks.workunit.client.1.smithi086.stdout:3/153: dread - d3/d18/f36 zero size 2024-08-19T00:55:58.054 INFO:tasks.workunit.client.1.smithi086.stdout:3/154: chown d3/f5 69747 1 2024-08-19T00:55:58.056 INFO:tasks.workunit.client.1.smithi086.stdout:8/165: mkdir dc/d1f/d37 0 2024-08-19T00:55:58.056 INFO:tasks.workunit.client.1.smithi086.stdout:8/166: stat dc/d17/d1e/l35 0 2024-08-19T00:55:58.057 INFO:tasks.workunit.client.1.smithi086.stdout:5/142: creat d0/f29 x:0 0 0 2024-08-19T00:55:58.058 INFO:tasks.workunit.client.1.smithi086.stdout:5/143: readlink d0/d8/ld 0 2024-08-19T00:55:58.058 INFO:tasks.workunit.client.0.smithi017.stdout:5/18: creat f8 x:0 0 0 2024-08-19T00:55:58.061 INFO:tasks.workunit.client.1.smithi086.stdout:9/140: creat db/dd/d19/f2c x:0 0 0 2024-08-19T00:55:58.062 INFO:tasks.workunit.client.1.smithi086.stdout:9/141: dread - db/f16 zero size 2024-08-19T00:55:58.063 INFO:tasks.workunit.client.1.smithi086.stdout:5/144: dwrite d0/fa [0,4194304] 0 2024-08-19T00:55:58.064 INFO:tasks.workunit.client.0.smithi017.stdout:2/19: mknod d2/d7/c8 0 2024-08-19T00:55:58.066 INFO:tasks.workunit.client.1.smithi086.stdout:2/120: mkdir d8/d24 0 2024-08-19T00:55:58.068 INFO:tasks.workunit.client.1.smithi086.stdout:4/127: rename d2/d18/f19 to d2/d18/f31 0 2024-08-19T00:55:58.069 INFO:tasks.workunit.client.1.smithi086.stdout:4/128: fdatasync d2/d1c/d2c/f2e 0 2024-08-19T00:55:58.069 INFO:tasks.workunit.client.1.smithi086.stdout:4/129: read d2/da/f13 [2967452,14564] 0 2024-08-19T00:55:58.070 INFO:tasks.workunit.client.0.smithi017.stdout:0/17: write f0 [102082,42359] 0 2024-08-19T00:55:58.071 INFO:tasks.workunit.client.1.smithi086.stdout:6/156: mkdir db/d1b/d30 0 2024-08-19T00:55:58.073 INFO:tasks.workunit.client.0.smithi017.stdout:0/18: dread f1 [0,4194304] 0 2024-08-19T00:55:58.074 INFO:tasks.workunit.client.1.smithi086.stdout:3/155: creat d3/d26/d2b/f3b x:0 0 0 2024-08-19T00:55:58.074 INFO:tasks.workunit.client.1.smithi086.stdout:3/156: chown d3/d9/lb 371 1 2024-08-19T00:55:58.074 INFO:tasks.workunit.client.0.smithi017.stdout:5/19: symlink l9 0 2024-08-19T00:55:58.076 INFO:tasks.workunit.client.0.smithi017.stdout:5/20: write f5 [799321,62670] 0 2024-08-19T00:55:58.076 INFO:tasks.workunit.client.1.smithi086.stdout:6/157: dread db/f2e [0,4194304] 0 2024-08-19T00:55:58.076 INFO:tasks.workunit.client.1.smithi086.stdout:6/158: fsync f3 0 2024-08-19T00:55:58.080 INFO:tasks.workunit.client.0.smithi017.stdout:2/20: creat d2/d7/f9 x:0 0 0 2024-08-19T00:55:58.083 INFO:tasks.workunit.client.1.smithi086.stdout:7/179: unlink d3/f39 0 2024-08-19T00:55:58.084 INFO:tasks.workunit.client.0.smithi017.stdout:7/17: creat d3/f5 x:0 0 0 2024-08-19T00:55:58.087 INFO:tasks.workunit.client.1.smithi086.stdout:2/121: rename d8/f23 to d8/d14/f25 0 2024-08-19T00:55:58.088 INFO:tasks.workunit.client.0.smithi017.stdout:3/18: write f2 [3480089,110046] 0 2024-08-19T00:55:58.089 INFO:tasks.workunit.client.0.smithi017.stdout:0/19: symlink d5/l7 0 2024-08-19T00:55:58.089 INFO:tasks.workunit.client.0.smithi017.stdout:0/20: fsync f0 0 2024-08-19T00:55:58.091 INFO:tasks.workunit.client.1.smithi086.stdout:4/130: mknod d2/c32 0 2024-08-19T00:55:58.092 INFO:tasks.workunit.client.0.smithi017.stdout:2/21: creat d2/fa x:0 0 0 2024-08-19T00:55:58.092 INFO:tasks.workunit.client.1.smithi086.stdout:2/122: dwrite d8/f10 [0,4194304] 0 2024-08-19T00:55:58.093 INFO:tasks.workunit.client.0.smithi017.stdout:7/18: readlink l1 0 2024-08-19T00:55:58.093 INFO:tasks.workunit.client.0.smithi017.stdout:2/22: truncate d2/fa 947323 0 2024-08-19T00:55:58.094 INFO:tasks.workunit.client.0.smithi017.stdout:7/19: dread - d3/f5 zero size 2024-08-19T00:55:58.096 INFO:tasks.workunit.client.1.smithi086.stdout:3/157: symlink d3/d26/l3c 0 2024-08-19T00:55:58.098 INFO:tasks.workunit.client.0.smithi017.stdout:0/21: symlink d5/l8 0 2024-08-19T00:55:58.098 INFO:tasks.workunit.client.0.smithi017.stdout:0/22: readlink d5/l8 0 2024-08-19T00:55:58.099 INFO:tasks.workunit.client.1.smithi086.stdout:9/142: mkdir db/d2d 0 2024-08-19T00:55:58.099 INFO:tasks.workunit.client.0.smithi017.stdout:0/23: fdatasync f0 0 2024-08-19T00:55:58.100 INFO:tasks.workunit.client.1.smithi086.stdout:9/143: readlink db/l28 0 2024-08-19T00:55:58.100 INFO:tasks.workunit.client.0.smithi017.stdout:9/13: link d0/c5 d0/c6 0 2024-08-19T00:55:58.100 INFO:tasks.workunit.client.1.smithi086.stdout:7/180: creat d3/f3a x:0 0 0 2024-08-19T00:55:58.101 INFO:tasks.workunit.client.0.smithi017.stdout:9/14: write d0/f2 [1562852,57746] 0 2024-08-19T00:55:58.102 INFO:tasks.workunit.client.1.smithi086.stdout:3/158: dwrite d3/d18/f1c [0,4194304] 0 2024-08-19T00:55:58.103 INFO:tasks.workunit.client.0.smithi017.stdout:2/23: unlink d2/d7/c8 0 2024-08-19T00:55:58.106 INFO:tasks.workunit.client.0.smithi017.stdout:9/15: fsync d0/f2 0 2024-08-19T00:55:58.108 INFO:tasks.workunit.client.0.smithi017.stdout:9/16: write d0/f2 [1525377,36153] 0 2024-08-19T00:55:58.108 INFO:tasks.workunit.client.0.smithi017.stdout:7/20: symlink d3/l6 0 2024-08-19T00:55:58.109 INFO:tasks.workunit.client.1.smithi086.stdout:3/159: dwrite d3/d18/f22 [0,4194304] 0 2024-08-19T00:55:58.110 INFO:tasks.workunit.client.1.smithi086.stdout:3/160: chown d3/d26/d2b 113 1 2024-08-19T00:55:58.112 INFO:tasks.workunit.client.0.smithi017.stdout:0/24: symlink d5/l9 0 2024-08-19T00:55:58.115 INFO:tasks.workunit.client.1.smithi086.stdout:4/131: rename d2/da/d2f/d2b to d2/d18/d33 0 2024-08-19T00:55:58.117 INFO:tasks.workunit.client.1.smithi086.stdout:0/185: truncate da/d14/f1b 763765 0 2024-08-19T00:55:58.120 INFO:tasks.workunit.client.0.smithi017.stdout:2/24: creat d2/d4/fb x:0 0 0 2024-08-19T00:55:58.121 INFO:tasks.workunit.client.0.smithi017.stdout:2/25: stat d2/d7/f9 0 2024-08-19T00:55:58.122 INFO:tasks.workunit.client.1.smithi086.stdout:4/132: dread d2/da/f14 [0,4194304] 0 2024-08-19T00:55:58.123 INFO:tasks.workunit.client.0.smithi017.stdout:7/21: dwrite d3/f5 [0,4194304] 0 2024-08-19T00:55:58.128 INFO:tasks.workunit.client.0.smithi017.stdout:3/19: truncate f2 1282500 0 2024-08-19T00:55:58.129 INFO:tasks.workunit.client.1.smithi086.stdout:7/181: stat d3/de/l24 0 2024-08-19T00:55:58.130 INFO:tasks.workunit.client.1.smithi086.stdout:7/182: truncate d3/de/f1e 502574 0 2024-08-19T00:55:58.130 INFO:tasks.workunit.client.0.smithi017.stdout:2/26: write d2/f3 [2177009,51855] 0 2024-08-19T00:55:58.131 INFO:tasks.workunit.client.1.smithi086.stdout:7/183: read d3/de/f12 [2611781,94639] 0 2024-08-19T00:55:58.131 INFO:tasks.workunit.client.0.smithi017.stdout:2/27: write d2/d4/fb [930983,2939] 0 2024-08-19T00:55:58.132 INFO:tasks.workunit.client.0.smithi017.stdout:9/17: rename d0/c6 to d0/c7 0 2024-08-19T00:55:58.133 INFO:tasks.workunit.client.0.smithi017.stdout:2/28: dread - d2/d7/f9 zero size 2024-08-19T00:55:58.133 INFO:tasks.workunit.client.0.smithi017.stdout:9/18: stat d0/c3 0 2024-08-19T00:55:58.135 INFO:tasks.workunit.client.1.smithi086.stdout:3/161: symlink d3/d26/d2b/l3d 0 2024-08-19T00:55:58.136 INFO:tasks.workunit.client.1.smithi086.stdout:3/162: readlink d3/d18/d19/l2e 0 2024-08-19T00:55:58.137 INFO:tasks.workunit.client.1.smithi086.stdout:3/163: fdatasync d3/f29 0 2024-08-19T00:55:58.138 INFO:tasks.workunit.client.0.smithi017.stdout:3/20: mknod c4 0 2024-08-19T00:55:58.140 INFO:tasks.workunit.client.0.smithi017.stdout:9/19: mknod d0/c8 0 2024-08-19T00:55:58.141 INFO:tasks.workunit.client.1.smithi086.stdout:2/123: creat d8/d24/f26 x:0 0 0 2024-08-19T00:55:58.142 INFO:tasks.workunit.client.0.smithi017.stdout:9/20: chown d0/c3 0 1 2024-08-19T00:55:58.142 INFO:tasks.workunit.client.1.smithi086.stdout:2/124: dread - d8/d14/f22 zero size 2024-08-19T00:55:58.143 INFO:tasks.workunit.client.0.smithi017.stdout:9/21: stat d0 0 2024-08-19T00:55:58.143 INFO:tasks.workunit.client.1.smithi086.stdout:0/186: mkdir da/d14/d1a/d2e/d42 0 2024-08-19T00:55:58.144 INFO:tasks.workunit.client.1.smithi086.stdout:0/187: chown da/f10 947 1 2024-08-19T00:55:58.144 INFO:tasks.workunit.client.1.smithi086.stdout:9/144: dwrite f2 [0,4194304] 0 2024-08-19T00:55:58.144 INFO:tasks.workunit.client.0.smithi017.stdout:7/22: rename l2 to d3/l7 0 2024-08-19T00:55:58.145 INFO:tasks.workunit.client.1.smithi086.stdout:8/167: getdents dc/d16/d18/d29/d2e 0 2024-08-19T00:55:58.145 INFO:tasks.workunit.client.0.smithi017.stdout:0/25: dwrite f1 [0,4194304] 0 2024-08-19T00:55:58.146 INFO:tasks.workunit.client.1.smithi086.stdout:0/188: read da/d14/f2d [488215,12234] 0 2024-08-19T00:55:58.146 INFO:tasks.workunit.client.0.smithi017.stdout:3/21: mkdir d5 0 2024-08-19T00:55:58.149 INFO:tasks.workunit.client.0.smithi017.stdout:9/22: mknod d0/c9 0 2024-08-19T00:55:58.152 INFO:tasks.workunit.client.0.smithi017.stdout:7/23: symlink d3/l8 0 2024-08-19T00:55:58.154 INFO:tasks.workunit.client.1.smithi086.stdout:7/184: rename d3/de/c1a to d3/c3b 0 2024-08-19T00:55:58.156 INFO:tasks.workunit.client.0.smithi017.stdout:0/26: creat d5/fa x:0 0 0 2024-08-19T00:55:58.158 INFO:tasks.workunit.client.1.smithi086.stdout:2/125: dwrite d8/f1e [0,4194304] 0 2024-08-19T00:55:58.159 INFO:tasks.workunit.client.1.smithi086.stdout:3/164: mknod d3/d9/d2d/c3e 0 2024-08-19T00:55:58.162 INFO:tasks.workunit.client.1.smithi086.stdout:3/165: stat d3/cc 0 2024-08-19T00:55:58.164 INFO:tasks.workunit.client.1.smithi086.stdout:9/145: dwrite db/f15 [4194304,4194304] 0 2024-08-19T00:55:58.164 INFO:tasks.workunit.client.0.smithi017.stdout:9/23: rename d0/f2 to d0/fa 0 2024-08-19T00:55:58.166 INFO:tasks.workunit.client.1.smithi086.stdout:8/168: dwrite f8 [4194304,4194304] 0 2024-08-19T00:55:58.166 INFO:tasks.workunit.client.1.smithi086.stdout:4/133: dwrite d2/da/ff [0,4194304] 0 2024-08-19T00:55:58.168 INFO:tasks.workunit.client.1.smithi086.stdout:9/146: chown f6 21 1 2024-08-19T00:55:58.169 INFO:tasks.workunit.client.0.smithi017.stdout:7/24: rename d3/l8 to d3/l9 0 2024-08-19T00:55:58.173 INFO:tasks.workunit.client.0.smithi017.stdout:0/27: creat d5/fb x:0 0 0 2024-08-19T00:55:58.177 INFO:tasks.workunit.client.1.smithi086.stdout:5/145: getdents d0/d8/d10 0 2024-08-19T00:55:58.178 INFO:tasks.workunit.client.0.smithi017.stdout:2/29: getdents d2/d4 0 2024-08-19T00:55:58.178 INFO:tasks.workunit.client.1.smithi086.stdout:5/146: fdatasync d0/df/d1f/f28 0 2024-08-19T00:55:58.180 INFO:tasks.workunit.client.1.smithi086.stdout:1/184: sync 2024-08-19T00:55:58.180 INFO:tasks.workunit.client.1.smithi086.stdout:1/185: stat d4/c15 0 2024-08-19T00:55:58.181 INFO:tasks.workunit.client.0.smithi017.stdout:7/25: dwrite d3/f5 [0,4194304] 0 2024-08-19T00:55:58.181 INFO:tasks.workunit.client.1.smithi086.stdout:0/189: mkdir da/d14/d1a/d2e/d43 0 2024-08-19T00:55:58.181 INFO:tasks.workunit.client.0.smithi017.stdout:2/30: write d2/d4/fb [1384308,43978] 0 2024-08-19T00:55:58.182 INFO:tasks.workunit.client.1.smithi086.stdout:0/190: truncate da/d14/d26/f2c 731885 0 2024-08-19T00:55:58.183 INFO:tasks.workunit.client.0.smithi017.stdout:0/28: dread f1 [0,4194304] 0 2024-08-19T00:55:58.183 INFO:tasks.workunit.client.1.smithi086.stdout:0/191: stat da/d14/d26/f33 0 2024-08-19T00:55:58.185 INFO:tasks.workunit.client.0.smithi017.stdout:2/31: write d2/fa [980588,60484] 0 2024-08-19T00:55:58.185 INFO:tasks.workunit.client.0.smithi017.stdout:0/29: dread - d5/fb zero size 2024-08-19T00:55:58.188 INFO:tasks.workunit.client.0.smithi017.stdout:7/26: mkdir d3/da 0 2024-08-19T00:55:58.189 INFO:tasks.workunit.client.1.smithi086.stdout:3/166: mkdir d3/d9/d2d/d3f 0 2024-08-19T00:55:58.194 INFO:tasks.workunit.client.1.smithi086.stdout:1/186: rmdir d4/d1e 39 2024-08-19T00:55:58.195 INFO:tasks.workunit.client.0.smithi017.stdout:2/32: creat d2/d7/fc x:0 0 0 2024-08-19T00:55:58.196 INFO:tasks.workunit.client.1.smithi086.stdout:0/192: mkdir da/d14/d44 0 2024-08-19T00:55:58.197 INFO:tasks.workunit.client.0.smithi017.stdout:0/30: rename f0 to d5/fc 0 2024-08-19T00:55:58.198 INFO:tasks.workunit.client.1.smithi086.stdout:7/185: symlink d3/d34/l3c 0 2024-08-19T00:55:58.199 INFO:tasks.workunit.client.1.smithi086.stdout:2/126: rename d8/c1c to d8/d24/c27 0 2024-08-19T00:55:58.200 INFO:tasks.workunit.client.1.smithi086.stdout:9/147: symlink db/l2e 0 2024-08-19T00:55:58.200 INFO:tasks.workunit.client.1.smithi086.stdout:9/148: chown f7 234349930 1 2024-08-19T00:55:58.201 INFO:tasks.workunit.client.1.smithi086.stdout:3/167: mkdir d3/d18/d19/d40 0 2024-08-19T00:55:58.203 INFO:tasks.workunit.client.0.smithi017.stdout:0/31: creat d5/fd x:0 0 0 2024-08-19T00:55:58.208 INFO:tasks.workunit.client.1.smithi086.stdout:7/186: creat d3/de/d1b/f3d x:0 0 0 2024-08-19T00:55:58.209 INFO:tasks.workunit.client.0.smithi017.stdout:0/32: link d5/l7 d5/le 0 2024-08-19T00:55:58.210 INFO:tasks.workunit.client.1.smithi086.stdout:9/149: rmdir db/dd 39 2024-08-19T00:55:58.211 INFO:tasks.workunit.client.1.smithi086.stdout:3/168: creat d3/d26/d2b/d33/f41 x:0 0 0 2024-08-19T00:55:58.211 INFO:tasks.workunit.client.1.smithi086.stdout:1/187: getdents d4/d7/d2a/d36/d3a 0 2024-08-19T00:55:58.212 INFO:tasks.workunit.client.1.smithi086.stdout:3/169: chown d3/d18/d27/c30 0 1 2024-08-19T00:55:58.214 INFO:tasks.workunit.client.1.smithi086.stdout:3/170: write d3/d26/d2b/d33/f41 [593293,32763] 0 2024-08-19T00:55:58.215 INFO:tasks.workunit.client.1.smithi086.stdout:6/159: sync 2024-08-19T00:55:58.216 INFO:tasks.workunit.client.1.smithi086.stdout:0/193: rmdir da/d14/d1a/d2e/d42 0 2024-08-19T00:55:58.217 INFO:tasks.workunit.client.0.smithi017.stdout:7/27: fdatasync d3/f5 0 2024-08-19T00:55:58.217 INFO:tasks.workunit.client.1.smithi086.stdout:6/160: truncate db/d1b/f20 8426222 0 2024-08-19T00:55:58.218 INFO:tasks.workunit.client.1.smithi086.stdout:2/127: link d8/ff d8/d24/f28 0 2024-08-19T00:55:58.219 INFO:tasks.workunit.client.0.smithi017.stdout:7/28: write d3/f5 [3576277,73621] 0 2024-08-19T00:55:58.219 INFO:tasks.workunit.client.0.smithi017.stdout:2/33: dread d2/fa [0,4194304] 0 2024-08-19T00:55:58.219 INFO:tasks.workunit.client.1.smithi086.stdout:7/187: unlink d3/de/d1b/l21 0 2024-08-19T00:55:58.220 INFO:tasks.workunit.client.1.smithi086.stdout:6/161: fdatasync db/f14 0 2024-08-19T00:55:58.220 INFO:tasks.workunit.client.0.smithi017.stdout:9/24: getdents d0 0 2024-08-19T00:55:58.220 INFO:tasks.workunit.client.0.smithi017.stdout:9/25: read d0/fa [307650,28713] 0 2024-08-19T00:55:58.221 INFO:tasks.workunit.client.1.smithi086.stdout:1/188: dwrite d4/f26 [0,4194304] 0 2024-08-19T00:55:58.222 INFO:tasks.workunit.client.0.smithi017.stdout:9/26: truncate d0/fa 4707424 0 2024-08-19T00:55:58.222 INFO:tasks.workunit.client.1.smithi086.stdout:7/188: dread - d3/de/f2a zero size 2024-08-19T00:55:58.223 INFO:tasks.workunit.client.1.smithi086.stdout:5/147: dread d0/df/f1a [0,4194304] 0 2024-08-19T00:55:58.223 INFO:tasks.workunit.client.1.smithi086.stdout:6/162: dread - db/d1b/f27 zero size 2024-08-19T00:55:58.223 INFO:tasks.workunit.client.1.smithi086.stdout:0/194: creat da/d14/d1a/d2e/d39/f45 x:0 0 0 2024-08-19T00:55:58.223 INFO:tasks.workunit.client.1.smithi086.stdout:1/189: fdatasync d4/d7/fe 0 2024-08-19T00:55:58.225 INFO:tasks.workunit.client.1.smithi086.stdout:5/148: readlink d0/d8/d10/l1c 0 2024-08-19T00:55:58.225 INFO:tasks.workunit.client.1.smithi086.stdout:0/195: dread - da/d14/d1a/f3d zero size 2024-08-19T00:55:58.225 INFO:tasks.workunit.client.1.smithi086.stdout:7/189: dread - d3/de/d2d/f2f zero size 2024-08-19T00:55:58.226 INFO:tasks.workunit.client.1.smithi086.stdout:1/190: write d4/d7/f37 [772203,11545] 0 2024-08-19T00:55:58.227 INFO:tasks.workunit.client.1.smithi086.stdout:0/196: stat da/d14/f15 0 2024-08-19T00:55:58.227 INFO:tasks.workunit.client.1.smithi086.stdout:1/191: chown d4 79773 1 2024-08-19T00:55:58.227 INFO:tasks.workunit.client.1.smithi086.stdout:7/190: chown d3/de/f12 12385380 1 2024-08-19T00:55:58.227 INFO:tasks.workunit.client.1.smithi086.stdout:9/150: truncate db/dd/d19/f1f 201899 0 2024-08-19T00:55:58.227 INFO:tasks.workunit.client.1.smithi086.stdout:7/191: fdatasync d3/de/f27 0 2024-08-19T00:55:58.228 INFO:tasks.workunit.client.1.smithi086.stdout:0/197: truncate da/d14/f41 253055 0 2024-08-19T00:55:58.228 INFO:tasks.workunit.client.1.smithi086.stdout:3/171: mknod d3/d9/d2d/d3f/c42 0 2024-08-19T00:55:58.228 INFO:tasks.workunit.client.1.smithi086.stdout:7/192: readlink d3/l33 0 2024-08-19T00:55:58.229 INFO:tasks.workunit.client.0.smithi017.stdout:9/27: mkdir d0/db 0 2024-08-19T00:55:58.229 INFO:tasks.workunit.client.1.smithi086.stdout:3/172: dread - d3/d9/d2d/f35 zero size 2024-08-19T00:55:58.231 INFO:tasks.workunit.client.0.smithi017.stdout:7/29: rename l1 to d3/lb 0 2024-08-19T00:55:58.232 INFO:tasks.workunit.client.0.smithi017.stdout:7/30: stat d3/l6 0 2024-08-19T00:55:58.232 INFO:tasks.workunit.client.1.smithi086.stdout:2/128: creat d8/d14/f29 x:0 0 0 2024-08-19T00:55:58.233 INFO:tasks.workunit.client.1.smithi086.stdout:2/129: dread - d8/d24/f26 zero size 2024-08-19T00:55:58.234 INFO:tasks.workunit.client.1.smithi086.stdout:2/130: truncate d8/d14/f22 1023534 0 2024-08-19T00:55:58.236 INFO:tasks.workunit.client.1.smithi086.stdout:6/163: mkdir db/d1b/d28/d31 0 2024-08-19T00:55:58.237 INFO:tasks.workunit.client.1.smithi086.stdout:6/164: truncate db/f2b 788359 0 2024-08-19T00:55:58.237 INFO:tasks.workunit.client.0.smithi017.stdout:9/28: creat d0/fc x:0 0 0 2024-08-19T00:55:58.238 INFO:tasks.workunit.client.0.smithi017.stdout:9/29: readlink - no filename 2024-08-19T00:55:58.238 INFO:tasks.workunit.client.1.smithi086.stdout:5/149: mknod d0/d8/d10/c2a 0 2024-08-19T00:55:58.239 INFO:tasks.workunit.client.1.smithi086.stdout:5/150: chown d0/d20/f25 42333 1 2024-08-19T00:55:58.244 INFO:tasks.workunit.client.0.smithi017.stdout:9/30: unlink d0/c7 0 2024-08-19T00:55:58.247 INFO:tasks.workunit.client.1.smithi086.stdout:3/173: chown d3/c16 318141 1 2024-08-19T00:55:58.247 INFO:tasks.workunit.client.1.smithi086.stdout:3/174: chown d3 16504711 1 2024-08-19T00:55:58.247 INFO:tasks.workunit.client.1.smithi086.stdout:3/175: fsync d3/f29 0 2024-08-19T00:55:58.248 INFO:tasks.workunit.client.1.smithi086.stdout:3/176: write d3/f29 [434921,36418] 0 2024-08-19T00:55:58.248 INFO:tasks.workunit.client.1.smithi086.stdout:8/169: truncate dc/d17/d1e/f20 2488589 0 2024-08-19T00:55:58.249 INFO:tasks.workunit.client.1.smithi086.stdout:3/177: write d3/ff [898286,94820] 0 2024-08-19T00:55:58.249 INFO:tasks.workunit.client.1.smithi086.stdout:1/192: symlink d4/d7/d2a/d36/d3a/l3b 0 2024-08-19T00:55:58.250 INFO:tasks.workunit.client.1.smithi086.stdout:4/134: truncate d2/da/f16 2302832 0 2024-08-19T00:55:58.251 INFO:tasks.workunit.client.1.smithi086.stdout:9/151: creat db/dd/d19/d18/f2f x:0 0 0 2024-08-19T00:55:58.251 INFO:tasks.workunit.client.1.smithi086.stdout:4/135: dread - d2/d1c/d2c/f2e zero size 2024-08-19T00:55:58.252 INFO:tasks.workunit.client.1.smithi086.stdout:4/136: read - d2/d18/f28 zero size 2024-08-19T00:55:58.253 INFO:tasks.workunit.client.1.smithi086.stdout:4/137: chown d2/d18/l22 7228664 1 2024-08-19T00:55:58.253 INFO:tasks.workunit.client.1.smithi086.stdout:7/193: mkdir d3/de/d30/d3e 0 2024-08-19T00:55:58.253 INFO:tasks.workunit.client.0.smithi017.stdout:9/31: dwrite d0/fa [0,4194304] 0 2024-08-19T00:55:58.253 INFO:tasks.workunit.client.0.smithi017.stdout:9/32: chown d0/db 43 1 2024-08-19T00:55:58.254 INFO:tasks.workunit.client.1.smithi086.stdout:7/194: write d3/de/f2a [30974,75379] 0 2024-08-19T00:55:58.256 INFO:tasks.workunit.client.1.smithi086.stdout:6/165: link db/f15 db/d1b/d28/d31/f32 0 2024-08-19T00:55:58.261 INFO:tasks.workunit.client.1.smithi086.stdout:3/178: mknod d3/d26/d2b/d33/c43 0 2024-08-19T00:55:58.262 INFO:tasks.workunit.client.1.smithi086.stdout:3/179: write d3/d18/d1a/f34 [810786,115110] 0 2024-08-19T00:55:58.262 INFO:tasks.workunit.client.0.smithi017.stdout:9/33: rename d0/c5 to d0/cd 0 2024-08-19T00:55:58.263 INFO:tasks.workunit.client.1.smithi086.stdout:3/180: dread - d3/d26/d2b/f3b zero size 2024-08-19T00:55:58.265 INFO:tasks.workunit.client.1.smithi086.stdout:0/198: rename da/ff to da/f46 0 2024-08-19T00:55:58.266 INFO:tasks.workunit.client.0.smithi017.stdout:7/31: rmdir d3 39 2024-08-19T00:55:58.267 INFO:tasks.workunit.client.0.smithi017.stdout:9/34: creat d0/fe x:0 0 0 2024-08-19T00:55:58.267 INFO:tasks.workunit.client.1.smithi086.stdout:4/138: creat d2/da/f34 x:0 0 0 2024-08-19T00:55:58.268 INFO:tasks.workunit.client.0.smithi017.stdout:2/34: truncate d2/f3 1422870 0 2024-08-19T00:55:58.269 INFO:tasks.workunit.client.0.smithi017.stdout:2/35: dread - d2/d7/fc zero size 2024-08-19T00:55:58.269 INFO:tasks.workunit.client.0.smithi017.stdout:7/32: write d3/f4 [537744,26357] 0 2024-08-19T00:55:58.272 INFO:tasks.workunit.client.0.smithi017.stdout:9/35: rename d0/c3 to d0/db/cf 0 2024-08-19T00:55:58.272 INFO:tasks.workunit.client.0.smithi017.stdout:9/36: dread - d0/fe zero size 2024-08-19T00:55:58.273 INFO:tasks.workunit.client.1.smithi086.stdout:7/195: mknod d3/c3f 0 2024-08-19T00:55:58.273 INFO:tasks.workunit.client.1.smithi086.stdout:7/196: chown d3/c22 21442856 1 2024-08-19T00:55:58.277 INFO:tasks.workunit.client.1.smithi086.stdout:8/170: creat dc/d16/d18/d29/d2e/d28/d2b/f38 x:0 0 0 2024-08-19T00:55:58.281 INFO:tasks.workunit.client.1.smithi086.stdout:1/193: rename d4/d7/d2a/f2e to d4/d1e/f3c 0 2024-08-19T00:55:58.281 INFO:tasks.workunit.client.1.smithi086.stdout:7/197: dwrite d3/de/f2a [0,4194304] 0 2024-08-19T00:55:58.286 INFO:tasks.workunit.client.1.smithi086.stdout:3/181: creat d3/d18/d19/d20/f44 x:0 0 0 2024-08-19T00:55:58.288 INFO:tasks.workunit.client.0.smithi017.stdout:7/33: rename d3/da to d3/dc 0 2024-08-19T00:55:58.290 INFO:tasks.workunit.client.1.smithi086.stdout:0/199: symlink da/d14/l47 0 2024-08-19T00:55:58.292 INFO:tasks.workunit.client.0.smithi017.stdout:3/22: dwrite f2 [0,4194304] 0 2024-08-19T00:55:58.293 INFO:tasks.workunit.client.0.smithi017.stdout:3/23: chown f3 54 1 2024-08-19T00:55:58.296 INFO:tasks.workunit.client.1.smithi086.stdout:2/131: getdents d8/d14 0 2024-08-19T00:55:58.298 INFO:tasks.workunit.client.1.smithi086.stdout:4/139: dread d2/da/f13 [0,4194304] 0 2024-08-19T00:55:58.298 INFO:tasks.workunit.client.1.smithi086.stdout:9/152: dwrite f7 [4194304,4194304] 0 2024-08-19T00:55:58.303 INFO:tasks.workunit.client.1.smithi086.stdout:6/166: creat db/d1b/d30/f33 x:0 0 0 2024-08-19T00:55:58.304 INFO:tasks.workunit.client.1.smithi086.stdout:8/171: mknod dc/d16/d18/d29/d2e/d28/c39 0 2024-08-19T00:55:58.305 INFO:tasks.workunit.client.1.smithi086.stdout:4/140: dread d2/f21 [0,4194304] 0 2024-08-19T00:55:58.305 INFO:tasks.workunit.client.1.smithi086.stdout:8/172: stat dc/d16/d18/d29 0 2024-08-19T00:55:58.308 INFO:tasks.workunit.client.1.smithi086.stdout:1/194: creat d4/d7/f3d x:0 0 0 2024-08-19T00:55:58.310 INFO:tasks.workunit.client.1.smithi086.stdout:7/198: write d3/de/f12 [1221538,34379] 0 2024-08-19T00:55:58.314 INFO:tasks.workunit.client.1.smithi086.stdout:7/199: write d3/de/d2d/f35 [40729,120396] 0 2024-08-19T00:55:58.315 INFO:tasks.workunit.client.0.smithi017.stdout:2/36: dwrite d2/fa [0,4194304] 0 2024-08-19T00:55:58.316 INFO:tasks.workunit.client.0.smithi017.stdout:2/37: read - d2/d7/f9 zero size 2024-08-19T00:55:58.317 INFO:tasks.workunit.client.1.smithi086.stdout:2/132: fsync d8/d14/f25 0 2024-08-19T00:55:58.323 INFO:tasks.workunit.client.1.smithi086.stdout:2/133: dwrite d8/d14/f25 [0,4194304] 0 2024-08-19T00:55:58.329 INFO:tasks.workunit.client.1.smithi086.stdout:1/195: creat d4/d7/d2a/d36/d3a/f3e x:0 0 0 2024-08-19T00:55:58.330 INFO:tasks.workunit.client.1.smithi086.stdout:1/196: dread - d4/d7/f3d zero size 2024-08-19T00:55:58.332 INFO:tasks.workunit.client.1.smithi086.stdout:7/200: rename d3/de/l24 to d3/de/d30/l40 0 2024-08-19T00:55:58.333 INFO:tasks.workunit.client.1.smithi086.stdout:3/182: getdents d3/d18/d27 0 2024-08-19T00:55:58.334 INFO:tasks.workunit.client.1.smithi086.stdout:3/183: chown d3/d26/d2b 64146 1 2024-08-19T00:55:58.337 INFO:tasks.workunit.client.1.smithi086.stdout:0/200: link da/d14/d1a/f40 da/d14/d26/f48 0 2024-08-19T00:55:58.338 INFO:tasks.workunit.client.1.smithi086.stdout:5/151: sync 2024-08-19T00:55:58.340 INFO:tasks.workunit.client.1.smithi086.stdout:9/153: write db/dd/ff [860558,34803] 0 2024-08-19T00:55:58.341 INFO:tasks.workunit.client.1.smithi086.stdout:6/167: mkdir db/d34 0 2024-08-19T00:55:58.342 INFO:tasks.workunit.client.1.smithi086.stdout:6/168: readlink db/l1d 0 2024-08-19T00:55:58.344 INFO:tasks.workunit.client.1.smithi086.stdout:2/134: rmdir d8/d24 39 2024-08-19T00:55:58.345 INFO:tasks.workunit.client.1.smithi086.stdout:2/135: readlink d8/l13 0 2024-08-19T00:55:58.345 INFO:tasks.workunit.client.1.smithi086.stdout:9/154: dread f7 [4194304,4194304] 0 2024-08-19T00:55:58.347 INFO:tasks.workunit.client.1.smithi086.stdout:9/155: write db/f1b [8454151,44036] 0 2024-08-19T00:55:58.348 INFO:tasks.workunit.client.1.smithi086.stdout:7/201: unlink d3/de/c16 0 2024-08-19T00:55:58.348 INFO:tasks.workunit.client.1.smithi086.stdout:9/156: write fa [629537,76293] 0 2024-08-19T00:55:58.349 INFO:tasks.workunit.client.1.smithi086.stdout:6/169: dwrite db/f13 [0,4194304] 0 2024-08-19T00:55:58.350 INFO:tasks.workunit.client.1.smithi086.stdout:3/184: symlink d3/d18/d19/d37/l45 0 2024-08-19T00:55:58.350 INFO:tasks.workunit.client.1.smithi086.stdout:7/202: write d3/de/d2d/f35 [534955,76067] 0 2024-08-19T00:55:58.352 INFO:tasks.workunit.client.1.smithi086.stdout:0/201: chown da/d14/d26/f33 4144592 1 2024-08-19T00:55:58.354 INFO:tasks.workunit.client.1.smithi086.stdout:5/152: creat d0/d8/d10/f2b x:0 0 0 2024-08-19T00:55:58.354 INFO:tasks.workunit.client.1.smithi086.stdout:6/170: dread db/d1b/f24 [0,4194304] 0 2024-08-19T00:55:58.354 INFO:tasks.workunit.client.1.smithi086.stdout:5/153: readlink d0/d8/d10/l12 0 2024-08-19T00:55:58.355 INFO:tasks.workunit.client.1.smithi086.stdout:5/154: dread - d0/f17 zero size 2024-08-19T00:55:58.356 INFO:tasks.workunit.client.1.smithi086.stdout:5/155: write d0/f6 [4490799,109576] 0 2024-08-19T00:55:58.363 INFO:tasks.workunit.client.1.smithi086.stdout:8/173: truncate dc/d1f/f27 8020222 0 2024-08-19T00:55:58.366 INFO:tasks.workunit.client.1.smithi086.stdout:7/203: mknod d3/de/d30/c41 0 2024-08-19T00:55:58.370 INFO:tasks.workunit.client.1.smithi086.stdout:4/141: getdents d2/d1c 0 2024-08-19T00:55:58.370 INFO:tasks.workunit.client.1.smithi086.stdout:6/171: dread f8 [0,4194304] 0 2024-08-19T00:55:58.371 INFO:tasks.workunit.client.1.smithi086.stdout:9/157: mkdir db/d23/d30 0 2024-08-19T00:55:58.406 INFO:tasks.workunit.client.1.smithi086.stdout:3/185: mkdir d3/d18/d19/d40/d46 0 2024-08-19T00:55:58.407 INFO:tasks.workunit.client.1.smithi086.stdout:4/142: fsync d2/d1c/d2c/f2e 0 2024-08-19T00:55:58.407 INFO:tasks.workunit.client.1.smithi086.stdout:0/202: mkdir da/d14/d44/d49 0 2024-08-19T00:55:58.408 INFO:tasks.workunit.client.1.smithi086.stdout:7/204: dwrite d3/de/d1b/f23 [0,4194304] 0 2024-08-19T00:55:58.409 INFO:tasks.workunit.client.1.smithi086.stdout:0/203: fdatasync da/d14/d26/f29 0 2024-08-19T00:55:58.409 INFO:tasks.workunit.client.1.smithi086.stdout:9/158: chown db/dd/d19/d18/f2f 0 1 2024-08-19T00:55:58.409 INFO:tasks.workunit.client.1.smithi086.stdout:8/174: mknod dc/c3a 0 2024-08-19T00:55:58.410 INFO:tasks.workunit.client.1.smithi086.stdout:9/159: write fa [341908,73052] 0 2024-08-19T00:55:58.411 INFO:tasks.workunit.client.1.smithi086.stdout:6/172: mknod db/d1b/c35 0 2024-08-19T00:55:58.418 INFO:tasks.workunit.client.1.smithi086.stdout:3/186: rmdir d3/d18/d1a 39 2024-08-19T00:55:58.419 INFO:tasks.workunit.client.1.smithi086.stdout:3/187: chown d3/d9/d2d/c3e 3 1 2024-08-19T00:55:58.421 INFO:tasks.workunit.client.1.smithi086.stdout:4/143: creat d2/d1c/d25/f35 x:0 0 0 2024-08-19T00:55:58.422 INFO:tasks.workunit.client.1.smithi086.stdout:4/144: truncate d2/d1c/d25/f35 47904 0 2024-08-19T00:55:58.423 INFO:tasks.workunit.client.1.smithi086.stdout:4/145: read d2/da/f13 [1241699,5094] 0 2024-08-19T00:55:58.428 INFO:tasks.workunit.client.1.smithi086.stdout:8/175: mkdir dc/d16/d18/d29/d2e/d28/d2b/d3b 0 2024-08-19T00:55:58.428 INFO:tasks.workunit.client.1.smithi086.stdout:4/146: dwrite d2/da/f34 [0,4194304] 0 2024-08-19T00:55:58.431 INFO:tasks.workunit.client.1.smithi086.stdout:3/188: creat d3/d9/d2d/d3f/f47 x:0 0 0 2024-08-19T00:55:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:58 smithi017 ceph-mon[16627]: Adjusting osd_memory_target on smithi086 to 2240M 2024-08-19T00:55:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:58 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:58.433 INFO:tasks.workunit.client.1.smithi086.stdout:0/204: getdents da/d14/d1a/d2e/d43 0 2024-08-19T00:55:58.433 INFO:tasks.workunit.client.1.smithi086.stdout:0/205: stat da/d14/d44 0 2024-08-19T00:55:58.434 INFO:tasks.workunit.client.1.smithi086.stdout:0/206: truncate da/d14/f41 480920 0 2024-08-19T00:55:58.441 INFO:tasks.workunit.client.1.smithi086.stdout:0/207: dwrite da/d14/f1d [4194304,4194304] 0 2024-08-19T00:55:58.441 INFO:tasks.workunit.client.1.smithi086.stdout:6/173: mknod db/d34/c36 0 2024-08-19T00:55:58.443 INFO:tasks.workunit.client.1.smithi086.stdout:4/147: readlink d2/l12 0 2024-08-19T00:55:58.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:58 smithi086 ceph-mon[24511]: Adjusting osd_memory_target on smithi086 to 2240M 2024-08-19T00:55:58.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:58 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:58.446 INFO:tasks.workunit.client.1.smithi086.stdout:3/189: mkdir d3/d18/d27/d48 0 2024-08-19T00:55:58.450 INFO:tasks.workunit.client.1.smithi086.stdout:1/197: sync 2024-08-19T00:55:58.451 INFO:tasks.workunit.client.1.smithi086.stdout:8/176: dread dc/d17/f2a [0,4194304] 0 2024-08-19T00:55:58.452 INFO:tasks.workunit.client.1.smithi086.stdout:1/198: readlink d4/d7/d2a/l34 0 2024-08-19T00:55:58.454 INFO:tasks.workunit.client.1.smithi086.stdout:6/174: rmdir db/d1b/d30 39 2024-08-19T00:55:58.456 INFO:tasks.workunit.client.1.smithi086.stdout:0/208: unlink da/d14/f24 0 2024-08-19T00:55:58.458 INFO:tasks.workunit.client.1.smithi086.stdout:8/177: dwrite dc/d17/f24 [0,4194304] 0 2024-08-19T00:55:58.459 INFO:tasks.workunit.client.1.smithi086.stdout:4/148: creat d2/d18/d33/f36 x:0 0 0 2024-08-19T00:55:58.460 INFO:tasks.workunit.client.1.smithi086.stdout:6/175: dread db/f11 [0,4194304] 0 2024-08-19T00:55:58.463 INFO:tasks.workunit.client.1.smithi086.stdout:9/160: getdents db/dd 0 2024-08-19T00:55:58.465 INFO:tasks.workunit.client.1.smithi086.stdout:9/161: write db/dd/d19/d18/f25 [330756,77340] 0 2024-08-19T00:55:58.465 INFO:tasks.workunit.client.1.smithi086.stdout:9/162: dread - db/f11 zero size 2024-08-19T00:55:58.465 INFO:tasks.workunit.client.1.smithi086.stdout:1/199: mknod d4/d1e/c3f 0 2024-08-19T00:55:58.466 INFO:tasks.workunit.client.1.smithi086.stdout:1/200: chown d4/d7/f3d 52454 1 2024-08-19T00:55:58.472 INFO:tasks.workunit.client.1.smithi086.stdout:9/163: dwrite db/dd/ff [0,4194304] 0 2024-08-19T00:55:58.478 INFO:tasks.workunit.client.1.smithi086.stdout:9/164: dwrite db/f15 [4194304,4194304] 0 2024-08-19T00:55:58.479 INFO:tasks.workunit.client.1.smithi086.stdout:9/165: stat db/dd/c1a 0 2024-08-19T00:55:58.483 INFO:tasks.workunit.client.1.smithi086.stdout:3/190: fsync d3/d9/f15 0 2024-08-19T00:55:58.485 INFO:tasks.workunit.client.1.smithi086.stdout:7/205: stat d3/de/d1b/c1f 0 2024-08-19T00:55:58.490 INFO:tasks.workunit.client.1.smithi086.stdout:5/156: sync 2024-08-19T00:55:58.490 INFO:tasks.workunit.client.1.smithi086.stdout:2/136: sync 2024-08-19T00:55:58.494 INFO:tasks.workunit.client.1.smithi086.stdout:5/157: dread d0/fb [0,4194304] 0 2024-08-19T00:55:58.497 INFO:tasks.workunit.client.1.smithi086.stdout:8/178: creat dc/d16/d18/d29/d2e/d28/d2b/d3b/f3c x:0 0 0 2024-08-19T00:55:58.498 INFO:tasks.workunit.client.1.smithi086.stdout:5/158: dread d0/fa [0,4194304] 0 2024-08-19T00:55:58.498 INFO:tasks.workunit.client.1.smithi086.stdout:4/149: truncate d2/da/f16 813763 0 2024-08-19T00:55:58.499 INFO:tasks.workunit.client.1.smithi086.stdout:4/150: fsync d2/d1c/d2c/f2e 0 2024-08-19T00:55:58.499 INFO:tasks.workunit.client.1.smithi086.stdout:4/151: chown d2/d18/c1e 2 1 2024-08-19T00:55:58.506 INFO:tasks.workunit.client.1.smithi086.stdout:3/191: rename d3/d9/d2d to d3/d18/d27/d49 0 2024-08-19T00:55:58.506 INFO:tasks.workunit.client.1.smithi086.stdout:0/209: write da/f46 [4134074,92243] 0 2024-08-19T00:55:58.508 INFO:tasks.workunit.client.1.smithi086.stdout:7/206: mkdir d3/de/d1b/d42 0 2024-08-19T00:55:58.508 INFO:tasks.workunit.client.1.smithi086.stdout:7/207: chown d3/de 124109708 1 2024-08-19T00:55:58.509 INFO:tasks.workunit.client.1.smithi086.stdout:7/208: dread - d3/f3a zero size 2024-08-19T00:55:58.512 INFO:tasks.workunit.client.1.smithi086.stdout:0/210: dwrite da/f36 [0,4194304] 0 2024-08-19T00:55:58.513 INFO:tasks.workunit.client.1.smithi086.stdout:8/179: unlink dc/c3a 0 2024-08-19T00:55:58.514 INFO:tasks.workunit.client.1.smithi086.stdout:8/180: readlink dc/d1f/l26 0 2024-08-19T00:55:58.514 INFO:tasks.workunit.client.1.smithi086.stdout:8/181: write dc/d16/d18/f2f [155775,96659] 0 2024-08-19T00:55:58.518 INFO:tasks.workunit.client.1.smithi086.stdout:5/159: write d0/df/f1a [1136111,115599] 0 2024-08-19T00:55:58.519 INFO:tasks.workunit.client.1.smithi086.stdout:9/166: mkdir db/d23/d30/d31 0 2024-08-19T00:55:58.522 INFO:tasks.workunit.client.1.smithi086.stdout:6/176: rmdir db/d1b/d28/d2f 0 2024-08-19T00:55:58.526 INFO:tasks.workunit.client.1.smithi086.stdout:3/192: mkdir d3/d26/d2b/d33/d4a 0 2024-08-19T00:55:58.528 INFO:tasks.workunit.client.1.smithi086.stdout:6/177: dwrite db/f13 [0,4194304] 0 2024-08-19T00:55:58.528 INFO:tasks.workunit.client.1.smithi086.stdout:1/201: creat d4/f40 x:0 0 0 2024-08-19T00:55:58.533 INFO:tasks.workunit.client.1.smithi086.stdout:7/209: dread d3/de/f2a [0,4194304] 0 2024-08-19T00:55:58.539 INFO:tasks.workunit.client.1.smithi086.stdout:0/211: symlink da/d14/d1a/d2e/l4a 0 2024-08-19T00:55:58.550 INFO:tasks.workunit.client.1.smithi086.stdout:1/202: mkdir d4/d7/d2a/d36/d3a/d41 0 2024-08-19T00:55:58.556 INFO:tasks.workunit.client.1.smithi086.stdout:0/212: rename da/l13 to da/d14/l4b 0 2024-08-19T00:55:58.557 INFO:tasks.workunit.client.1.smithi086.stdout:0/213: truncate da/f46 4406827 0 2024-08-19T00:55:58.557 INFO:tasks.workunit.client.1.smithi086.stdout:8/182: creat dc/d16/d18/d29/d32/f3d x:0 0 0 2024-08-19T00:55:58.561 INFO:tasks.workunit.client.1.smithi086.stdout:4/152: read d2/da/f16 [522266,122234] 0 2024-08-19T00:55:58.561 INFO:tasks.workunit.client.1.smithi086.stdout:9/167: dwrite db/dd/f14 [0,4194304] 0 2024-08-19T00:55:58.562 INFO:tasks.workunit.client.1.smithi086.stdout:9/168: stat db/d2d 0 2024-08-19T00:55:58.563 INFO:tasks.workunit.client.1.smithi086.stdout:3/193: creat d3/d18/d27/d48/f4b x:0 0 0 2024-08-19T00:55:58.565 INFO:tasks.workunit.client.0.smithi017.stdout:7/34: mknod d3/dc/cd 0 2024-08-19T00:55:58.566 INFO:tasks.workunit.client.1.smithi086.stdout:1/203: rename d4/d10/l22 to d4/d1e/d35/l42 0 2024-08-19T00:55:58.570 INFO:tasks.workunit.client.0.smithi017.stdout:3/24: rename f1 to d5/f6 0 2024-08-19T00:55:58.570 INFO:tasks.workunit.client.0.smithi017.stdout:3/25: read - f3 zero size 2024-08-19T00:55:58.571 INFO:tasks.workunit.client.1.smithi086.stdout:8/183: symlink dc/d16/d18/d29/d32/l3e 0 2024-08-19T00:55:58.573 INFO:tasks.workunit.client.1.smithi086.stdout:5/160: creat d0/d8/f2c x:0 0 0 2024-08-19T00:55:58.574 INFO:tasks.workunit.client.0.smithi017.stdout:2/38: mkdir d2/d7/dd 0 2024-08-19T00:55:58.575 INFO:tasks.workunit.client.1.smithi086.stdout:4/153: creat d2/da/f37 x:0 0 0 2024-08-19T00:55:58.577 INFO:tasks.workunit.client.1.smithi086.stdout:8/184: dread dc/d16/f2d [0,4194304] 0 2024-08-19T00:55:58.577 INFO:tasks.workunit.client.1.smithi086.stdout:9/169: mkdir db/d23/d30/d32 0 2024-08-19T00:55:58.579 INFO:tasks.workunit.client.1.smithi086.stdout:3/194: creat d3/d9/f4c x:0 0 0 2024-08-19T00:55:58.580 INFO:tasks.workunit.client.0.smithi017.stdout:2/39: dread d2/d4/fb [0,4194304] 0 2024-08-19T00:55:58.580 INFO:tasks.workunit.client.0.smithi017.stdout:7/35: symlink d3/dc/le 0 2024-08-19T00:55:58.581 INFO:tasks.workunit.client.0.smithi017.stdout:2/40: write d2/d7/fc [269742,130644] 0 2024-08-19T00:55:58.581 INFO:tasks.workunit.client.0.smithi017.stdout:7/36: chown d3/dc/le 21131047 1 2024-08-19T00:55:58.582 INFO:tasks.workunit.client.0.smithi017.stdout:7/37: read d3/f5 [4091623,122281] 0 2024-08-19T00:55:58.583 INFO:tasks.workunit.client.1.smithi086.stdout:6/178: rename db/d1b to db/d37 0 2024-08-19T00:55:58.583 INFO:tasks.workunit.client.1.smithi086.stdout:4/154: dwrite d2/d18/d33/f36 [0,4194304] 0 2024-08-19T00:55:58.586 INFO:tasks.workunit.client.1.smithi086.stdout:2/137: getdents d8/d24 0 2024-08-19T00:55:58.587 INFO:tasks.workunit.client.1.smithi086.stdout:2/138: read d8/f12 [3478974,15600] 0 2024-08-19T00:55:58.591 INFO:tasks.workunit.client.1.smithi086.stdout:1/204: creat d4/d7/d2a/d36/d3a/f43 x:0 0 0 2024-08-19T00:55:58.592 INFO:tasks.workunit.client.0.smithi017.stdout:9/37: getdents d0 0 2024-08-19T00:55:58.592 INFO:tasks.workunit.client.1.smithi086.stdout:1/205: truncate d4/d7/f3d 483317 0 2024-08-19T00:55:58.593 INFO:tasks.workunit.client.1.smithi086.stdout:0/214: truncate da/d14/f1b 176942 0 2024-08-19T00:55:58.593 INFO:tasks.workunit.client.1.smithi086.stdout:1/206: write d4/d7/f3d [918202,36704] 0 2024-08-19T00:55:58.595 INFO:tasks.workunit.client.1.smithi086.stdout:0/215: dread da/f3c [0,4194304] 0 2024-08-19T00:55:58.596 INFO:tasks.workunit.client.1.smithi086.stdout:5/161: mkdir d0/d2d 0 2024-08-19T00:55:58.597 INFO:tasks.workunit.client.1.smithi086.stdout:5/162: chown d0/df/d1f 1326321 1 2024-08-19T00:55:58.597 INFO:tasks.workunit.client.0.smithi017.stdout:7/38: mkdir d3/dc/df 0 2024-08-19T00:55:58.598 INFO:tasks.workunit.client.1.smithi086.stdout:8/185: rmdir dc/d16/d18/d29/d2e 39 2024-08-19T00:55:58.601 INFO:tasks.workunit.client.1.smithi086.stdout:3/195: mkdir d3/d18/d27/d48/d4d 0 2024-08-19T00:55:58.603 INFO:tasks.workunit.client.1.smithi086.stdout:6/179: read db/d37/f24 [62762,10691] 0 2024-08-19T00:55:58.603 INFO:tasks.workunit.client.1.smithi086.stdout:3/196: read d3/d26/d2b/d33/f41 [388759,70667] 0 2024-08-19T00:55:58.604 INFO:tasks.workunit.client.1.smithi086.stdout:3/197: chown d3/d18/d19 30 1 2024-08-19T00:55:58.605 INFO:tasks.workunit.client.1.smithi086.stdout:8/186: dwrite dc/f23 [0,4194304] 0 2024-08-19T00:55:58.605 INFO:tasks.workunit.client.1.smithi086.stdout:3/198: chown d3/d18/d27/c30 2660 1 2024-08-19T00:55:58.606 INFO:tasks.workunit.client.0.smithi017.stdout:7/39: readlink d3/l7 0 2024-08-19T00:55:58.606 INFO:tasks.workunit.client.1.smithi086.stdout:7/210: link d3/de/d1b/c1f d3/de/d2d/c43 0 2024-08-19T00:55:58.607 INFO:tasks.workunit.client.1.smithi086.stdout:7/211: chown d3/de/d2d/f2f 333129187 1 2024-08-19T00:55:58.611 INFO:tasks.workunit.client.0.smithi017.stdout:2/41: link d2/d4/l6 d2/d7/dd/le 0 2024-08-19T00:55:58.616 INFO:tasks.workunit.client.1.smithi086.stdout:1/207: rename d4/c24 to d4/d7/d2a/d36/d3a/d41/c44 0 2024-08-19T00:55:58.617 INFO:tasks.workunit.client.0.smithi017.stdout:3/26: getdents d5 0 2024-08-19T00:55:58.626 INFO:tasks.workunit.client.0.smithi017.stdout:9/38: getdents d0/db 0 2024-08-19T00:55:58.627 INFO:tasks.workunit.client.0.smithi017.stdout:3/27: dwrite f2 [4194304,4194304] 0 2024-08-19T00:55:58.628 INFO:tasks.workunit.client.1.smithi086.stdout:4/155: link d2/d18/f28 d2/d1c/d1d/f38 0 2024-08-19T00:55:58.631 INFO:tasks.workunit.client.0.smithi017.stdout:7/40: dwrite d3/f5 [4194304,4194304] 0 2024-08-19T00:55:58.631 INFO:tasks.workunit.client.0.smithi017.stdout:3/28: read d5/f6 [1022935,66075] 0 2024-08-19T00:55:58.631 INFO:tasks.workunit.client.0.smithi017.stdout:9/39: write d0/fa [2769072,98505] 0 2024-08-19T00:55:58.634 INFO:tasks.workunit.client.1.smithi086.stdout:7/212: dread d3/de/f15 [0,4194304] 0 2024-08-19T00:55:58.634 INFO:tasks.workunit.client.1.smithi086.stdout:0/216: rename da/d14/d26/f2c to da/d14/d1a/d2e/d30/f4c 0 2024-08-19T00:55:58.635 INFO:tasks.workunit.client.1.smithi086.stdout:1/208: creat d4/d7/d2a/d36/f45 x:0 0 0 2024-08-19T00:55:58.636 INFO:tasks.workunit.client.1.smithi086.stdout:7/213: write d3/de/d2d/f31 [212349,47208] 0 2024-08-19T00:55:58.636 INFO:tasks.workunit.client.0.smithi017.stdout:9/40: write d0/fe [78054,73142] 0 2024-08-19T00:55:58.636 INFO:tasks.workunit.client.1.smithi086.stdout:7/214: fsync d3/f38 0 2024-08-19T00:55:58.638 INFO:tasks.workunit.client.0.smithi017.stdout:3/29: write d5/f6 [382162,69586] 0 2024-08-19T00:55:58.639 INFO:tasks.workunit.client.0.smithi017.stdout:3/30: stat d5 0 2024-08-19T00:55:58.640 INFO:tasks.workunit.client.0.smithi017.stdout:3/31: chown l0 6 1 2024-08-19T00:55:58.640 INFO:tasks.workunit.client.0.smithi017.stdout:2/42: dwrite d2/d4/fb [0,4194304] 0 2024-08-19T00:55:58.641 INFO:tasks.workunit.client.0.smithi017.stdout:7/41: symlink d3/dc/df/l10 0 2024-08-19T00:55:58.642 INFO:tasks.workunit.client.1.smithi086.stdout:9/170: creat db/dd/d19/f33 x:0 0 0 2024-08-19T00:55:58.642 INFO:tasks.workunit.client.0.smithi017.stdout:7/42: rename d3 to d3/d11 22 2024-08-19T00:55:58.643 INFO:tasks.workunit.client.1.smithi086.stdout:6/180: mknod db/d37/d28/d31/c38 0 2024-08-19T00:55:58.644 INFO:tasks.workunit.client.1.smithi086.stdout:4/156: write d2/f23 [1353001,68802] 0 2024-08-19T00:55:58.644 INFO:tasks.workunit.client.0.smithi017.stdout:7/43: read d3/f4 [246558,36553] 0 2024-08-19T00:55:58.645 INFO:tasks.workunit.client.1.smithi086.stdout:8/187: unlink dc/d17/d1e/f20 0 2024-08-19T00:55:58.647 INFO:tasks.workunit.client.0.smithi017.stdout:3/32: mknod d5/c7 0 2024-08-19T00:55:58.649 INFO:tasks.workunit.client.0.smithi017.stdout:2/43: mknod d2/d4/cf 0 2024-08-19T00:55:58.649 INFO:tasks.workunit.client.0.smithi017.stdout:3/33: write d5/f6 [2624922,21184] 0 2024-08-19T00:55:58.652 INFO:tasks.workunit.client.0.smithi017.stdout:7/44: unlink d3/l7 0 2024-08-19T00:55:58.654 INFO:tasks.workunit.client.0.smithi017.stdout:2/44: mkdir d2/d7/d10 0 2024-08-19T00:55:58.656 INFO:tasks.workunit.client.0.smithi017.stdout:7/45: dread d3/f5 [4194304,4194304] 0 2024-08-19T00:55:58.657 INFO:tasks.workunit.client.1.smithi086.stdout:6/181: mkdir db/d34/d39 0 2024-08-19T00:55:58.657 INFO:tasks.workunit.client.1.smithi086.stdout:0/217: dwrite da/d14/d1a/d2e/d30/f4c [0,4194304] 0 2024-08-19T00:55:58.660 INFO:tasks.workunit.client.1.smithi086.stdout:4/157: creat d2/da/d2f/f39 x:0 0 0 2024-08-19T00:55:58.662 INFO:tasks.workunit.client.0.smithi017.stdout:7/46: stat d3/l9 0 2024-08-19T00:55:58.663 INFO:tasks.workunit.client.0.smithi017.stdout:7/47: stat d3 0 2024-08-19T00:55:58.664 INFO:tasks.workunit.client.1.smithi086.stdout:6/182: dwrite f3 [0,4194304] 0 2024-08-19T00:55:58.665 INFO:tasks.workunit.client.1.smithi086.stdout:6/183: write f6 [984904,9515] 0 2024-08-19T00:55:58.665 INFO:tasks.workunit.client.1.smithi086.stdout:7/215: rename d3/de/d30 to d3/d34/d44 0 2024-08-19T00:55:58.666 INFO:tasks.workunit.client.1.smithi086.stdout:6/184: write db/f16 [133848,9857] 0 2024-08-19T00:55:58.670 INFO:tasks.workunit.client.0.smithi017.stdout:7/48: creat d3/f12 x:0 0 0 2024-08-19T00:55:58.670 INFO:tasks.workunit.client.0.smithi017.stdout:7/49: chown d3/f5 1 1 2024-08-19T00:55:58.671 INFO:tasks.workunit.client.1.smithi086.stdout:9/171: creat db/d2d/f34 x:0 0 0 2024-08-19T00:55:58.674 INFO:tasks.workunit.client.1.smithi086.stdout:5/163: sync 2024-08-19T00:55:58.674 INFO:tasks.workunit.client.1.smithi086.stdout:2/139: sync 2024-08-19T00:55:58.674 INFO:tasks.workunit.client.1.smithi086.stdout:3/199: sync 2024-08-19T00:55:58.675 INFO:tasks.workunit.client.0.smithi017.stdout:7/50: unlink d3/dc/cd 0 2024-08-19T00:55:58.675 INFO:tasks.workunit.client.1.smithi086.stdout:3/200: readlink d3/d18/d19/l2e 0 2024-08-19T00:55:58.676 INFO:tasks.workunit.client.1.smithi086.stdout:3/201: write d3/d18/d19/d20/f31 [454024,120055] 0 2024-08-19T00:55:58.677 INFO:tasks.workunit.client.0.smithi017.stdout:2/45: rmdir d2/d7 39 2024-08-19T00:55:58.677 INFO:tasks.workunit.client.0.smithi017.stdout:2/46: read d2/fa [2598962,39412] 0 2024-08-19T00:55:58.678 INFO:tasks.workunit.client.0.smithi017.stdout:7/51: mknod d3/dc/df/c13 0 2024-08-19T00:55:58.678 INFO:tasks.workunit.client.1.smithi086.stdout:3/202: write d3/d18/f2c [1439741,97860] 0 2024-08-19T00:55:58.678 INFO:tasks.workunit.client.1.smithi086.stdout:1/209: link d4/d7/l17 d4/d7/d2a/d36/d3a/l46 0 2024-08-19T00:55:58.679 INFO:tasks.workunit.client.1.smithi086.stdout:3/203: write d3/d26/d2b/f38 [248339,76219] 0 2024-08-19T00:55:58.683 INFO:tasks.workunit.client.1.smithi086.stdout:2/140: rmdir d8 39 2024-08-19T00:55:58.684 INFO:tasks.workunit.client.1.smithi086.stdout:8/188: link dc/d17/f31 dc/d16/d18/d29/d2e/f3f 0 2024-08-19T00:55:58.685 INFO:tasks.workunit.client.0.smithi017.stdout:2/47: dwrite d2/d4/fb [0,4194304] 0 2024-08-19T00:55:58.686 INFO:tasks.workunit.client.1.smithi086.stdout:5/164: mknod d0/df/c2e 0 2024-08-19T00:55:58.687 INFO:tasks.workunit.client.0.smithi017.stdout:7/52: truncate d3/f5 9344208 0 2024-08-19T00:55:58.689 INFO:tasks.workunit.client.1.smithi086.stdout:6/185: rename f6 to db/d37/d30/f3a 0 2024-08-19T00:55:58.693 INFO:tasks.workunit.client.1.smithi086.stdout:1/210: symlink d4/d1e/l47 0 2024-08-19T00:55:58.695 INFO:tasks.workunit.client.1.smithi086.stdout:4/158: write d2/f21 [3781720,37450] 0 2024-08-19T00:55:58.695 INFO:tasks.workunit.client.1.smithi086.stdout:3/204: fsync f2 0 2024-08-19T00:55:58.697 INFO:tasks.workunit.client.1.smithi086.stdout:4/159: write d2/da/ff [5434338,61695] 0 2024-08-19T00:55:58.697 INFO:tasks.workunit.client.0.smithi017.stdout:2/48: creat d2/d7/d10/f11 x:0 0 0 2024-08-19T00:55:58.699 INFO:tasks.workunit.client.1.smithi086.stdout:2/141: chown d8/l13 743 1 2024-08-19T00:55:58.699 INFO:tasks.workunit.client.1.smithi086.stdout:0/218: dwrite da/d14/d1a/f40 [0,4194304] 0 2024-08-19T00:55:58.702 INFO:tasks.workunit.client.0.smithi017.stdout:2/49: symlink d2/l12 0 2024-08-19T00:55:58.703 INFO:tasks.workunit.client.1.smithi086.stdout:1/211: creat d4/d1e/f48 x:0 0 0 2024-08-19T00:55:58.704 INFO:tasks.workunit.client.1.smithi086.stdout:9/172: creat db/f35 x:0 0 0 2024-08-19T00:55:58.705 INFO:tasks.workunit.client.1.smithi086.stdout:9/173: write db/d2d/f34 [822855,12777] 0 2024-08-19T00:55:58.706 INFO:tasks.workunit.client.0.smithi017.stdout:2/50: mknod d2/c13 0 2024-08-19T00:55:58.707 INFO:tasks.workunit.client.1.smithi086.stdout:3/205: creat d3/d18/d19/d37/f4e x:0 0 0 2024-08-19T00:55:58.708 INFO:tasks.workunit.client.1.smithi086.stdout:4/160: creat d2/d1c/d25/f3a x:0 0 0 2024-08-19T00:55:58.710 INFO:tasks.workunit.client.0.smithi017.stdout:2/51: mknod d2/d7/c14 0 2024-08-19T00:55:58.711 INFO:tasks.workunit.client.1.smithi086.stdout:0/219: rmdir da/d14/d1a/d2e 39 2024-08-19T00:55:58.713 INFO:tasks.workunit.client.1.smithi086.stdout:1/212: mknod d4/d7/c49 0 2024-08-19T00:55:58.715 INFO:tasks.workunit.client.1.smithi086.stdout:3/206: dread d3/d18/f2c [0,4194304] 0 2024-08-19T00:55:58.715 INFO:tasks.workunit.client.1.smithi086.stdout:1/213: truncate d4/f1f 1350883 0 2024-08-19T00:55:58.716 INFO:tasks.workunit.client.1.smithi086.stdout:5/165: rmdir d0 39 2024-08-19T00:55:58.716 INFO:tasks.workunit.client.0.smithi017.stdout:7/53: truncate d3/f5 1661114 0 2024-08-19T00:55:58.719 INFO:tasks.workunit.client.1.smithi086.stdout:7/216: truncate d3/de/f11 235249 0 2024-08-19T00:55:58.720 INFO:tasks.workunit.client.0.smithi017.stdout:7/54: symlink d3/l14 0 2024-08-19T00:55:58.721 INFO:tasks.workunit.client.1.smithi086.stdout:1/214: dwrite d4/f26 [0,4194304] 0 2024-08-19T00:55:58.721 INFO:tasks.workunit.client.1.smithi086.stdout:0/220: fdatasync da/d14/f2d 0 2024-08-19T00:55:58.722 INFO:tasks.workunit.client.1.smithi086.stdout:1/215: truncate d4/d1e/f11 5169760 0 2024-08-19T00:55:58.723 INFO:tasks.workunit.client.1.smithi086.stdout:6/186: creat db/f3b x:0 0 0 2024-08-19T00:55:58.725 INFO:tasks.workunit.client.1.smithi086.stdout:9/174: creat db/dd/d19/d18/f36 x:0 0 0 2024-08-19T00:55:58.728 INFO:tasks.workunit.client.1.smithi086.stdout:4/161: rename d2/da/c9 to d2/da/c3b 0 2024-08-19T00:55:58.730 INFO:tasks.workunit.client.1.smithi086.stdout:4/162: truncate d2/d1c/d2c/f2e 589486 0 2024-08-19T00:55:58.730 INFO:tasks.workunit.client.1.smithi086.stdout:3/207: symlink d3/d18/d19/l4f 0 2024-08-19T00:55:58.734 INFO:tasks.workunit.client.1.smithi086.stdout:7/217: readlink d3/de/d1b/l1c 0 2024-08-19T00:55:58.734 INFO:tasks.workunit.client.1.smithi086.stdout:7/218: chown d3/l33 174680529 1 2024-08-19T00:55:58.735 INFO:tasks.workunit.client.1.smithi086.stdout:8/189: dwrite dc/d1f/f27 [4194304,4194304] 0 2024-08-19T00:55:58.737 INFO:tasks.workunit.client.0.smithi017.stdout:7/55: dread d3/f5 [0,4194304] 0 2024-08-19T00:55:58.737 INFO:tasks.workunit.client.0.smithi017.stdout:2/52: dwrite d2/fa [0,4194304] 0 2024-08-19T00:55:58.740 INFO:tasks.workunit.client.1.smithi086.stdout:6/187: rename db/d34/c36 to db/d37/d30/c3c 0 2024-08-19T00:55:58.741 INFO:tasks.workunit.client.0.smithi017.stdout:2/53: fdatasync d2/d7/d10/f11 0 2024-08-19T00:55:58.743 INFO:tasks.workunit.client.1.smithi086.stdout:9/175: truncate db/d23/f2a 2612581 0 2024-08-19T00:55:58.743 INFO:tasks.workunit.client.0.smithi017.stdout:7/56: rename d3/dc/df/l10 to d3/dc/df/l15 0 2024-08-19T00:55:58.745 INFO:tasks.workunit.client.1.smithi086.stdout:2/142: getdents d8 0 2024-08-19T00:55:58.746 INFO:tasks.workunit.client.1.smithi086.stdout:9/176: write db/d26/f27 [832336,122648] 0 2024-08-19T00:55:58.746 INFO:tasks.workunit.client.1.smithi086.stdout:1/216: dread d4/d10/f1d [0,4194304] 0 2024-08-19T00:55:58.747 INFO:tasks.workunit.client.0.smithi017.stdout:2/54: unlink d2/l12 0 2024-08-19T00:55:58.747 INFO:tasks.workunit.client.1.smithi086.stdout:9/177: fdatasync db/f16 0 2024-08-19T00:55:58.747 INFO:tasks.workunit.client.0.smithi017.stdout:7/57: fdatasync d3/f5 0 2024-08-19T00:55:58.748 INFO:tasks.workunit.client.1.smithi086.stdout:9/178: write f2 [3371741,115571] 0 2024-08-19T00:55:58.748 INFO:tasks.workunit.client.1.smithi086.stdout:8/190: creat dc/d16/d18/d29/d2e/d28/d2b/f40 x:0 0 0 2024-08-19T00:55:58.749 INFO:tasks.workunit.client.1.smithi086.stdout:0/221: creat da/d14/d44/d49/f4d x:0 0 0 2024-08-19T00:55:58.751 INFO:tasks.workunit.client.0.smithi017.stdout:7/58: rename d3/l9 to d3/l16 0 2024-08-19T00:55:58.752 INFO:tasks.workunit.client.1.smithi086.stdout:5/166: symlink d0/d2d/l2f 0 2024-08-19T00:55:58.752 INFO:tasks.workunit.client.1.smithi086.stdout:8/191: dread dc/f23 [0,4194304] 0 2024-08-19T00:55:58.753 INFO:tasks.workunit.client.1.smithi086.stdout:8/192: write f3 [689497,33445] 0 2024-08-19T00:55:58.753 INFO:tasks.workunit.client.0.smithi017.stdout:2/55: creat d2/d7/dd/f15 x:0 0 0 2024-08-19T00:55:58.754 INFO:tasks.workunit.client.1.smithi086.stdout:6/188: mknod db/d37/d28/d31/c3d 0 2024-08-19T00:55:58.754 INFO:tasks.workunit.client.0.smithi017.stdout:7/59: dread d3/f5 [0,4194304] 0 2024-08-19T00:55:58.755 INFO:tasks.workunit.client.0.smithi017.stdout:2/56: write d2/d7/f9 [59597,85654] 0 2024-08-19T00:55:58.755 INFO:tasks.workunit.client.1.smithi086.stdout:2/143: unlink d8/l13 0 2024-08-19T00:55:58.756 INFO:tasks.workunit.client.1.smithi086.stdout:3/208: mknod d3/d18/d19/d37/d3a/c50 0 2024-08-19T00:55:58.757 INFO:tasks.workunit.client.1.smithi086.stdout:3/209: dread - d3/d18/d19/d20/f44 zero size 2024-08-19T00:55:58.757 INFO:tasks.workunit.client.1.smithi086.stdout:1/217: creat d4/d1e/d35/f4a x:0 0 0 2024-08-19T00:55:58.758 INFO:tasks.workunit.client.1.smithi086.stdout:1/218: fdatasync d4/d7/f19 0 2024-08-19T00:55:58.759 INFO:tasks.workunit.client.0.smithi017.stdout:2/57: symlink d2/d7/l16 0 2024-08-19T00:55:58.761 INFO:tasks.workunit.client.0.smithi017.stdout:2/58: write d2/d7/dd/f15 [947598,92844] 0 2024-08-19T00:55:58.761 INFO:tasks.workunit.client.1.smithi086.stdout:9/179: mkdir db/d23/d37 0 2024-08-19T00:55:58.762 INFO:tasks.workunit.client.1.smithi086.stdout:9/180: readlink db/dd/d19/d18/l1e 0 2024-08-19T00:55:58.763 INFO:tasks.workunit.client.0.smithi017.stdout:7/60: dwrite d3/f5 [0,4194304] 0 2024-08-19T00:55:58.763 INFO:tasks.workunit.client.1.smithi086.stdout:9/181: fdatasync db/dd/d19/d18/f2f 0 2024-08-19T00:55:58.764 INFO:tasks.workunit.client.0.smithi017.stdout:2/59: truncate d2/d7/f9 726872 0 2024-08-19T00:55:58.764 INFO:tasks.workunit.client.0.smithi017.stdout:7/61: read d3/f5 [2212055,33879] 0 2024-08-19T00:55:58.765 INFO:tasks.workunit.client.0.smithi017.stdout:7/62: stat d3/dc/df 0 2024-08-19T00:55:58.771 INFO:tasks.workunit.client.1.smithi086.stdout:5/167: rename d0/c24 to d0/df/d1f/c30 0 2024-08-19T00:55:58.773 INFO:tasks.workunit.client.1.smithi086.stdout:5/168: write d0/f1e [271729,5892] 0 2024-08-19T00:55:58.773 INFO:tasks.workunit.client.0.smithi017.stdout:2/60: dwrite d2/d7/d10/f11 [0,4194304] 0 2024-08-19T00:55:58.786 INFO:tasks.workunit.client.1.smithi086.stdout:4/163: getdents d2/da 0 2024-08-19T00:55:58.787 INFO:tasks.workunit.client.0.smithi017.stdout:2/61: rename d2/d4 to d2/d17 0 2024-08-19T00:55:58.789 INFO:tasks.workunit.client.1.smithi086.stdout:1/219: rename d4/d1e/f3c to d4/d7/d2a/d36/d3a/d41/f4b 0 2024-08-19T00:55:58.790 INFO:tasks.workunit.client.0.smithi017.stdout:2/62: symlink d2/d7/l18 0 2024-08-19T00:55:58.791 INFO:tasks.workunit.client.1.smithi086.stdout:5/169: unlink d0/d8/d10/l12 0 2024-08-19T00:55:58.792 INFO:tasks.workunit.client.1.smithi086.stdout:6/189: unlink db/d37/d28/c2c 0 2024-08-19T00:55:58.795 INFO:tasks.workunit.client.1.smithi086.stdout:9/182: mkdir db/dd/d19/d38 0 2024-08-19T00:55:58.797 INFO:tasks.workunit.client.1.smithi086.stdout:0/222: write da/d14/f1b [96907,65977] 0 2024-08-19T00:55:58.799 INFO:tasks.workunit.client.0.smithi017.stdout:2/63: rename d2/d17 to d2/d7/d10/d19 0 2024-08-19T00:55:58.801 INFO:tasks.workunit.client.1.smithi086.stdout:0/223: write da/d14/f17 [3741297,12664] 0 2024-08-19T00:55:58.801 INFO:tasks.workunit.client.0.smithi017.stdout:7/63: dwrite d3/f4 [0,4194304] 0 2024-08-19T00:55:58.802 INFO:tasks.workunit.client.1.smithi086.stdout:6/190: dwrite db/d37/f21 [0,4194304] 0 2024-08-19T00:55:58.803 INFO:tasks.workunit.client.1.smithi086.stdout:6/191: stat db/f14 0 2024-08-19T00:55:58.805 INFO:tasks.workunit.client.1.smithi086.stdout:0/224: chown da/d14/d26/l31 60 1 2024-08-19T00:55:58.806 INFO:tasks.workunit.client.1.smithi086.stdout:3/210: dwrite d3/f5 [0,4194304] 0 2024-08-19T00:55:58.807 INFO:tasks.workunit.client.1.smithi086.stdout:6/192: chown db/f14 1438645 1 2024-08-19T00:55:58.808 INFO:tasks.workunit.client.1.smithi086.stdout:0/225: write da/d14/d1a/f40 [7384229,62000] 0 2024-08-19T00:55:58.809 INFO:tasks.workunit.client.1.smithi086.stdout:9/183: dwrite db/f15 [4194304,4194304] 0 2024-08-19T00:55:58.810 INFO:tasks.workunit.client.1.smithi086.stdout:4/164: getdents d2/d1c/d25/d30 0 2024-08-19T00:55:58.810 INFO:tasks.workunit.client.1.smithi086.stdout:0/226: chown da/f3c 105333 1 2024-08-19T00:55:58.811 INFO:tasks.workunit.client.1.smithi086.stdout:0/227: stat da/c1f 0 2024-08-19T00:55:58.812 INFO:tasks.workunit.client.1.smithi086.stdout:8/193: getdents dc/d16/d18/d29 0 2024-08-19T00:55:58.812 INFO:tasks.workunit.client.1.smithi086.stdout:8/194: fdatasync dc/d1f/f27 0 2024-08-19T00:55:58.813 INFO:tasks.workunit.client.1.smithi086.stdout:8/195: write dc/f1c [193267,107802] 0 2024-08-19T00:55:58.814 INFO:tasks.workunit.client.1.smithi086.stdout:2/144: dread d8/f1a [0,4194304] 0 2024-08-19T00:55:58.814 INFO:tasks.workunit.client.0.smithi017.stdout:2/64: dwrite d2/fa [4194304,4194304] 0 2024-08-19T00:55:58.820 INFO:tasks.workunit.client.1.smithi086.stdout:5/170: dwrite d0/df/f23 [0,4194304] 0 2024-08-19T00:55:58.824 INFO:tasks.workunit.client.0.smithi017.stdout:7/64: dwrite d3/f5 [0,4194304] 0 2024-08-19T00:55:58.825 INFO:tasks.workunit.client.0.smithi017.stdout:7/65: rename d3 to d3/dc/d17 22 2024-08-19T00:55:58.826 INFO:tasks.workunit.client.1.smithi086.stdout:4/165: creat d2/d1c/f3c x:0 0 0 2024-08-19T00:55:58.826 INFO:tasks.workunit.client.1.smithi086.stdout:0/228: stat da/d14/d1a/d2e/d39/d3b 0 2024-08-19T00:55:58.831 INFO:tasks.workunit.client.1.smithi086.stdout:1/220: rename d4/d7/c49 to d4/c4c 0 2024-08-19T00:55:58.834 INFO:tasks.workunit.client.1.smithi086.stdout:3/211: mkdir d3/d18/d1a/d51 0 2024-08-19T00:55:58.836 INFO:tasks.workunit.client.1.smithi086.stdout:5/171: symlink d0/d8/d10/l31 0 2024-08-19T00:55:58.838 INFO:tasks.workunit.client.1.smithi086.stdout:0/229: mkdir da/d14/d1a/d2e/d39/d3b/d4e 0 2024-08-19T00:55:58.839 INFO:tasks.workunit.client.1.smithi086.stdout:2/145: mknod d8/d24/c2a 0 2024-08-19T00:55:58.841 INFO:tasks.workunit.client.1.smithi086.stdout:0/230: read da/d14/f41 [71250,94407] 0 2024-08-19T00:55:58.841 INFO:tasks.workunit.client.1.smithi086.stdout:6/193: link db/d37/d30/f3a db/f3e 0 2024-08-19T00:55:58.844 INFO:tasks.workunit.client.1.smithi086.stdout:9/184: creat db/f39 x:0 0 0 2024-08-19T00:55:58.844 INFO:tasks.workunit.client.1.smithi086.stdout:3/212: dwrite d3/ff [0,4194304] 0 2024-08-19T00:55:58.847 INFO:tasks.workunit.client.0.smithi017.stdout:2/65: dwrite d2/f3 [0,4194304] 0 2024-08-19T00:55:58.847 INFO:tasks.workunit.client.1.smithi086.stdout:2/146: chown d8/c17 78 1 2024-08-19T00:55:58.848 INFO:tasks.workunit.client.0.smithi017.stdout:2/66: stat d2/d7/dd/f15 0 2024-08-19T00:55:58.848 INFO:tasks.workunit.client.1.smithi086.stdout:6/194: creat db/d37/d30/f3f x:0 0 0 2024-08-19T00:55:58.850 INFO:tasks.workunit.client.1.smithi086.stdout:3/213: rmdir d3/d18/d27/d49 39 2024-08-19T00:55:58.853 INFO:tasks.workunit.client.1.smithi086.stdout:2/147: creat d8/d24/f2b x:0 0 0 2024-08-19T00:55:58.854 INFO:tasks.workunit.client.1.smithi086.stdout:0/231: creat da/d14/d1a/d2e/d39/d3b/d4e/f4f x:0 0 0 2024-08-19T00:55:58.855 INFO:tasks.workunit.client.1.smithi086.stdout:3/214: mknod d3/d26/d2b/d33/c52 0 2024-08-19T00:55:58.856 INFO:tasks.workunit.client.1.smithi086.stdout:6/195: dwrite db/f14 [0,4194304] 0 2024-08-19T00:55:58.856 INFO:tasks.workunit.client.1.smithi086.stdout:9/185: creat db/d23/d30/d32/f3a x:0 0 0 2024-08-19T00:55:58.857 INFO:tasks.workunit.client.0.smithi017.stdout:2/67: dwrite d2/d7/d10/d19/fb [0,4194304] 0 2024-08-19T00:55:58.860 INFO:tasks.workunit.client.1.smithi086.stdout:3/215: write d3/ff [317991,91018] 0 2024-08-19T00:55:58.860 INFO:tasks.workunit.client.0.smithi017.stdout:2/68: readlink d2/d7/dd/le 0 2024-08-19T00:55:58.861 INFO:tasks.workunit.client.1.smithi086.stdout:2/148: mkdir d8/d2c 0 2024-08-19T00:55:58.861 INFO:tasks.workunit.client.1.smithi086.stdout:6/196: chown db/d37/d28/c29 674806 1 2024-08-19T00:55:58.861 INFO:tasks.workunit.client.1.smithi086.stdout:9/186: truncate db/dd/d19/d18/f2f 303118 0 2024-08-19T00:55:58.863 INFO:tasks.workunit.client.1.smithi086.stdout:6/197: read db/f3e [482493,40578] 0 2024-08-19T00:55:58.864 INFO:tasks.workunit.client.1.smithi086.stdout:2/149: write d8/d14/f25 [2808276,87164] 0 2024-08-19T00:55:58.866 INFO:tasks.workunit.client.1.smithi086.stdout:3/216: truncate d3/d9/f15 2213022 0 2024-08-19T00:55:58.866 INFO:tasks.workunit.client.1.smithi086.stdout:3/217: chown d3/d26/l3c 0 1 2024-08-19T00:55:58.868 INFO:tasks.workunit.client.1.smithi086.stdout:0/232: link da/d14/d26/f29 da/d14/d1a/d2e/d30/f50 0 2024-08-19T00:55:58.868 INFO:tasks.workunit.client.0.smithi017.stdout:2/69: dread d2/d7/dd/f15 [0,4194304] 0 2024-08-19T00:55:58.871 INFO:tasks.workunit.client.1.smithi086.stdout:2/150: fdatasync d8/ff 0 2024-08-19T00:55:58.871 INFO:tasks.workunit.client.0.smithi017.stdout:2/70: creat d2/f1a x:0 0 0 2024-08-19T00:55:58.873 INFO:tasks.workunit.client.1.smithi086.stdout:6/198: getdents db/d37/d28/d31 0 2024-08-19T00:55:58.874 INFO:tasks.workunit.client.0.smithi017.stdout:2/71: unlink d2/d7/f9 0 2024-08-19T00:55:58.875 INFO:tasks.workunit.client.1.smithi086.stdout:2/151: symlink d8/l2d 0 2024-08-19T00:55:58.875 INFO:tasks.workunit.client.1.smithi086.stdout:2/152: chown d8/d14/f22 187090326 1 2024-08-19T00:55:58.878 INFO:tasks.workunit.client.0.smithi017.stdout:2/72: rename d2/d7/dd/le to d2/d7/d10/l1b 0 2024-08-19T00:55:58.880 INFO:tasks.workunit.client.1.smithi086.stdout:6/199: creat db/d34/d39/f40 x:0 0 0 2024-08-19T00:55:58.880 INFO:tasks.workunit.client.1.smithi086.stdout:6/200: chown db/f15 7 1 2024-08-19T00:55:58.881 INFO:tasks.workunit.client.1.smithi086.stdout:6/201: dread - db/d37/d30/f3f zero size 2024-08-19T00:55:58.882 INFO:tasks.workunit.client.1.smithi086.stdout:2/153: getdents d8/d14 0 2024-08-19T00:55:58.883 INFO:tasks.workunit.client.1.smithi086.stdout:2/154: readlink d8/l2d 0 2024-08-19T00:55:58.883 INFO:tasks.workunit.client.1.smithi086.stdout:1/221: stat d4/c4c 0 2024-08-19T00:55:58.883 INFO:tasks.workunit.client.1.smithi086.stdout:6/202: read db/f11 [267562,97724] 0 2024-08-19T00:55:58.884 INFO:tasks.workunit.client.0.smithi017.stdout:2/73: chown d2/d7/d10/d19/l6 2606 1 2024-08-19T00:55:58.884 INFO:tasks.workunit.client.1.smithi086.stdout:1/222: truncate d4/d7/d2a/d36/f45 894221 0 2024-08-19T00:55:58.885 INFO:tasks.workunit.client.0.smithi017.stdout:2/74: truncate d2/fa 8628026 0 2024-08-19T00:55:58.885 INFO:tasks.workunit.client.1.smithi086.stdout:2/155: dread - d8/d24/f26 zero size 2024-08-19T00:55:58.888 INFO:tasks.workunit.client.1.smithi086.stdout:1/223: readlink d4/d10/l2d 0 2024-08-19T00:55:58.889 INFO:tasks.workunit.client.1.smithi086.stdout:6/203: mkdir db/d37/d41 0 2024-08-19T00:55:58.890 INFO:tasks.workunit.client.1.smithi086.stdout:2/156: mknod d8/d2c/c2e 0 2024-08-19T00:55:58.890 INFO:tasks.workunit.client.1.smithi086.stdout:1/224: creat d4/d7/d2a/f4d x:0 0 0 2024-08-19T00:55:58.893 INFO:tasks.workunit.client.1.smithi086.stdout:7/219: sync 2024-08-19T00:55:58.893 INFO:tasks.workunit.client.1.smithi086.stdout:4/166: dwrite d2/da/f14 [0,4194304] 0 2024-08-19T00:55:58.893 INFO:tasks.workunit.client.1.smithi086.stdout:6/204: write db/f3e [1665061,52721] 0 2024-08-19T00:55:58.894 INFO:tasks.workunit.client.1.smithi086.stdout:1/225: write d4/f1f [351572,55814] 0 2024-08-19T00:55:58.895 INFO:tasks.workunit.client.1.smithi086.stdout:7/220: dread - d3/f38 zero size 2024-08-19T00:55:58.896 INFO:tasks.workunit.client.1.smithi086.stdout:6/205: write db/f13 [3823471,50225] 0 2024-08-19T00:55:58.896 INFO:tasks.workunit.client.1.smithi086.stdout:4/167: dread - d2/da/d2f/f39 zero size 2024-08-19T00:55:58.897 INFO:tasks.workunit.client.1.smithi086.stdout:6/206: stat db/l1f 0 2024-08-19T00:55:58.897 INFO:tasks.workunit.client.1.smithi086.stdout:2/157: rename d8/f10 to d8/d14/f2f 0 2024-08-19T00:55:58.898 INFO:tasks.workunit.client.1.smithi086.stdout:6/207: rename db to db/d37/d41/d42 22 2024-08-19T00:55:58.899 INFO:tasks.workunit.client.1.smithi086.stdout:6/208: fsync db/d37/f27 0 2024-08-19T00:55:58.901 INFO:tasks.workunit.client.0.smithi017.stdout:7/66: fdatasync d3/f5 0 2024-08-19T00:55:58.902 INFO:tasks.workunit.client.1.smithi086.stdout:6/209: write db/f2b [1128279,94904] 0 2024-08-19T00:55:58.902 INFO:tasks.workunit.client.1.smithi086.stdout:4/168: unlink d2/d18/c29 0 2024-08-19T00:55:58.902 INFO:tasks.workunit.client.1.smithi086.stdout:7/221: symlink d3/d34/d44/d3e/l45 0 2024-08-19T00:55:58.902 INFO:tasks.workunit.client.1.smithi086.stdout:4/169: chown d2/da/c20 230116472 1 2024-08-19T00:55:58.903 INFO:tasks.workunit.client.1.smithi086.stdout:7/222: chown d3/c25 80 1 2024-08-19T00:55:58.906 INFO:tasks.workunit.client.0.smithi017.stdout:7/67: dread d3/f5 [0,4194304] 0 2024-08-19T00:55:58.906 INFO:tasks.workunit.client.1.smithi086.stdout:6/210: symlink db/d37/d28/d31/l43 0 2024-08-19T00:55:58.906 INFO:tasks.workunit.client.1.smithi086.stdout:3/218: dread d3/d9/f12 [0,4194304] 0 2024-08-19T00:55:58.907 INFO:tasks.workunit.client.1.smithi086.stdout:6/211: stat f8 0 2024-08-19T00:55:58.907 INFO:tasks.workunit.client.1.smithi086.stdout:4/170: fsync d2/d18/f28 0 2024-08-19T00:55:58.909 INFO:tasks.workunit.client.1.smithi086.stdout:7/223: write d3/de/d2d/f2f [45450,60842] 0 2024-08-19T00:55:58.910 INFO:tasks.workunit.client.1.smithi086.stdout:2/158: link d8/d14/f15 d8/d14/f30 0 2024-08-19T00:55:58.910 INFO:tasks.workunit.client.1.smithi086.stdout:7/224: truncate d3/de/d2d/f31 336529 0 2024-08-19T00:55:58.914 INFO:tasks.workunit.client.0.smithi017.stdout:7/68: dwrite d3/f12 [0,4194304] 0 2024-08-19T00:55:58.915 INFO:tasks.workunit.client.1.smithi086.stdout:0/233: truncate da/d14/f41 1426571 0 2024-08-19T00:55:58.915 INFO:tasks.workunit.client.1.smithi086.stdout:0/234: chown da/d14/f1b 65 1 2024-08-19T00:55:58.915 INFO:tasks.workunit.client.1.smithi086.stdout:0/235: fsync da/d14/f1b 0 2024-08-19T00:55:58.927 INFO:tasks.workunit.client.0.smithi017.stdout:7/69: dwrite d3/f12 [0,4194304] 0 2024-08-19T00:55:58.927 INFO:tasks.workunit.client.0.smithi017.stdout:7/70: write d3/f5 [2665378,7182] 0 2024-08-19T00:55:58.927 INFO:tasks.workunit.client.0.smithi017.stdout:7/71: chown d3/f5 5 1 2024-08-19T00:55:58.927 INFO:tasks.workunit.client.0.smithi017.stdout:7/72: fdatasync d3/f4 0 2024-08-19T00:55:58.932 INFO:tasks.workunit.client.0.smithi017.stdout:7/73: link d3/l14 d3/dc/l18 0 2024-08-19T00:55:58.934 INFO:tasks.workunit.client.0.smithi017.stdout:7/74: mknod d3/dc/c19 0 2024-08-19T00:55:58.935 INFO:tasks.workunit.client.0.smithi017.stdout:2/75: rmdir d2/d7 39 2024-08-19T00:55:58.938 INFO:tasks.workunit.client.0.smithi017.stdout:2/76: write d2/d7/d10/d19/fb [4278772,61805] 0 2024-08-19T00:55:58.941 INFO:tasks.workunit.client.0.smithi017.stdout:2/77: creat d2/d7/dd/f1c x:0 0 0 2024-08-19T00:55:58.943 INFO:tasks.workunit.client.0.smithi017.stdout:2/78: fdatasync d2/fa 0 2024-08-19T00:55:58.945 INFO:tasks.workunit.client.0.smithi017.stdout:2/79: creat d2/d7/d10/d19/f1d x:0 0 0 2024-08-19T00:55:58.946 INFO:tasks.workunit.client.0.smithi017.stdout:2/80: rmdir d2/d7 39 2024-08-19T00:55:58.950 INFO:tasks.workunit.client.0.smithi017.stdout:2/81: getdents d2 0 2024-08-19T00:55:58.951 INFO:tasks.workunit.client.0.smithi017.stdout:2/82: write d2/d7/d10/f11 [527735,52907] 0 2024-08-19T00:55:58.951 INFO:tasks.workunit.client.1.smithi086.stdout:4/171: creat d2/d1c/d1d/f3d x:0 0 0 2024-08-19T00:55:58.952 INFO:tasks.workunit.client.1.smithi086.stdout:2/159: rmdir d8/d24 39 2024-08-19T00:55:58.953 INFO:tasks.workunit.client.1.smithi086.stdout:7/225: symlink d3/d34/d44/l46 0 2024-08-19T00:55:58.953 INFO:tasks.workunit.client.1.smithi086.stdout:1/226: link d4/d7/d2a/d36/l38 d4/d1e/d35/l4e 0 2024-08-19T00:55:58.953 INFO:tasks.workunit.client.1.smithi086.stdout:6/212: mkdir db/d37/d44 0 2024-08-19T00:55:58.954 INFO:tasks.workunit.client.1.smithi086.stdout:1/227: stat d4/d1e/d35/f4a 0 2024-08-19T00:55:58.954 INFO:tasks.workunit.client.1.smithi086.stdout:9/187: write db/f1b [635950,18804] 0 2024-08-19T00:55:58.955 INFO:tasks.workunit.client.1.smithi086.stdout:9/188: read - db/f11 zero size 2024-08-19T00:55:58.956 INFO:tasks.workunit.client.0.smithi017.stdout:7/75: rmdir d3/dc 39 2024-08-19T00:55:58.956 INFO:tasks.workunit.client.1.smithi086.stdout:4/172: mknod d2/da/c3e 0 2024-08-19T00:55:58.957 INFO:tasks.workunit.client.1.smithi086.stdout:0/236: creat da/d14/d1a/d2e/f51 x:0 0 0 2024-08-19T00:55:58.957 INFO:tasks.workunit.client.1.smithi086.stdout:2/160: creat d8/d2c/f31 x:0 0 0 2024-08-19T00:55:58.959 INFO:tasks.workunit.client.0.smithi017.stdout:2/83: dwrite d2/d7/d10/d19/f1d [0,4194304] 0 2024-08-19T00:55:58.960 INFO:tasks.workunit.client.1.smithi086.stdout:6/213: symlink db/d34/d39/l45 0 2024-08-19T00:55:58.962 INFO:tasks.workunit.client.1.smithi086.stdout:1/228: dwrite d4/f18 [4194304,4194304] 0 2024-08-19T00:55:58.963 INFO:tasks.workunit.client.0.smithi017.stdout:7/76: mkdir d3/dc/df/d1a 0 2024-08-19T00:55:58.968 INFO:tasks.workunit.client.0.smithi017.stdout:7/77: symlink d3/dc/df/d1a/l1b 0 2024-08-19T00:55:58.968 INFO:tasks.workunit.client.1.smithi086.stdout:7/226: unlink d3/de/f11 0 2024-08-19T00:55:58.969 INFO:tasks.workunit.client.1.smithi086.stdout:6/214: fsync db/f15 0 2024-08-19T00:55:58.970 INFO:tasks.workunit.client.0.smithi017.stdout:7/78: mkdir d3/dc/df/d1c 0 2024-08-19T00:55:58.972 INFO:tasks.workunit.client.1.smithi086.stdout:7/227: symlink d3/d34/d44/d3e/l47 0 2024-08-19T00:55:58.972 INFO:tasks.workunit.client.1.smithi086.stdout:2/161: dread d8/f1e [0,4194304] 0 2024-08-19T00:55:58.975 INFO:tasks.workunit.client.1.smithi086.stdout:7/228: fdatasync d3/de/f1e 0 2024-08-19T00:55:58.975 INFO:tasks.workunit.client.1.smithi086.stdout:6/215: creat db/f46 x:0 0 0 2024-08-19T00:55:58.978 INFO:tasks.workunit.client.1.smithi086.stdout:1/229: dwrite d4/d7/d2a/d36/d3a/d41/f4b [0,4194304] 0 2024-08-19T00:55:58.978 INFO:tasks.workunit.client.1.smithi086.stdout:7/229: creat d3/d34/d44/f48 x:0 0 0 2024-08-19T00:55:58.979 INFO:tasks.workunit.client.1.smithi086.stdout:6/216: creat db/d37/d41/f47 x:0 0 0 2024-08-19T00:55:58.981 INFO:tasks.workunit.client.1.smithi086.stdout:6/217: write db/f3b [932166,36183] 0 2024-08-19T00:55:58.982 INFO:tasks.workunit.client.1.smithi086.stdout:7/230: unlink d3/de/f2a 0 2024-08-19T00:55:58.987 INFO:tasks.workunit.client.1.smithi086.stdout:0/237: write da/d14/f41 [349348,70784] 0 2024-08-19T00:55:58.991 INFO:tasks.workunit.client.1.smithi086.stdout:2/162: truncate d8/f12 467010 0 2024-08-19T00:55:58.991 INFO:tasks.workunit.client.1.smithi086.stdout:1/230: dwrite d4/d7/fe [0,4194304] 0 2024-08-19T00:55:58.993 INFO:tasks.workunit.client.1.smithi086.stdout:0/238: dread - da/d14/d1a/f3d zero size 2024-08-19T00:55:58.994 INFO:tasks.workunit.client.1.smithi086.stdout:6/218: dwrite db/f1a [0,4194304] 0 2024-08-19T00:55:58.997 INFO:tasks.workunit.client.1.smithi086.stdout:4/173: dwrite d2/d1c/d1d/f38 [0,4194304] 0 2024-08-19T00:55:58.997 INFO:tasks.workunit.client.1.smithi086.stdout:6/219: truncate f8 4805775 0 2024-08-19T00:55:58.998 INFO:tasks.workunit.client.1.smithi086.stdout:2/163: mkdir d8/d24/d32 0 2024-08-19T00:55:59.000 INFO:tasks.workunit.client.1.smithi086.stdout:0/239: unlink da/d14/d1a/f3d 0 2024-08-19T00:55:59.005 INFO:tasks.workunit.client.1.smithi086.stdout:7/231: truncate d3/de/f1e 481072 0 2024-08-19T00:55:59.005 INFO:tasks.workunit.client.1.smithi086.stdout:4/174: dwrite d2/da/f37 [0,4194304] 0 2024-08-19T00:55:59.007 INFO:tasks.workunit.client.1.smithi086.stdout:6/220: dread db/f2e [0,4194304] 0 2024-08-19T00:55:59.011 INFO:tasks.workunit.client.1.smithi086.stdout:7/232: fdatasync d3/de/f17 0 2024-08-19T00:55:59.015 INFO:tasks.workunit.client.1.smithi086.stdout:2/164: creat d8/f33 x:0 0 0 2024-08-19T00:55:59.017 INFO:tasks.workunit.client.1.smithi086.stdout:7/233: write d3/de/d2d/f2f [67957,120461] 0 2024-08-19T00:55:59.017 INFO:tasks.workunit.client.1.smithi086.stdout:0/240: creat da/d14/d1a/f52 x:0 0 0 2024-08-19T00:55:59.019 INFO:tasks.workunit.client.1.smithi086.stdout:0/241: dread - da/d14/d1a/d2e/f51 zero size 2024-08-19T00:55:59.022 INFO:tasks.workunit.client.1.smithi086.stdout:1/231: dread d4/d1e/f11 [0,4194304] 0 2024-08-19T00:55:59.022 INFO:tasks.workunit.client.1.smithi086.stdout:0/242: mknod da/d14/d1a/c53 0 2024-08-19T00:55:59.024 INFO:tasks.workunit.client.1.smithi086.stdout:7/234: dwrite d3/de/f17 [0,4194304] 0 2024-08-19T00:55:59.027 INFO:tasks.workunit.client.1.smithi086.stdout:7/235: mkdir d3/de/d49 0 2024-08-19T00:55:59.030 INFO:tasks.workunit.client.1.smithi086.stdout:6/221: write db/f11 [1131350,78658] 0 2024-08-19T00:55:59.031 INFO:tasks.workunit.client.1.smithi086.stdout:2/165: write d8/d14/f30 [2570222,80974] 0 2024-08-19T00:55:59.032 INFO:tasks.workunit.client.1.smithi086.stdout:1/232: dwrite d4/d7/f37 [0,4194304] 0 2024-08-19T00:55:59.033 INFO:tasks.workunit.client.1.smithi086.stdout:6/222: truncate db/d34/d39/f40 74284 0 2024-08-19T00:55:59.034 INFO:tasks.workunit.client.1.smithi086.stdout:0/243: getdents da/d14/d1a 0 2024-08-19T00:55:59.034 INFO:tasks.workunit.client.1.smithi086.stdout:6/223: truncate db/f18 5476108 0 2024-08-19T00:55:59.036 INFO:tasks.workunit.client.1.smithi086.stdout:0/244: dread da/d14/f2d [0,4194304] 0 2024-08-19T00:55:59.036 INFO:tasks.workunit.client.1.smithi086.stdout:2/166: unlink f7 0 2024-08-19T00:55:59.036 INFO:tasks.workunit.client.1.smithi086.stdout:2/167: readlink d8/l2d 0 2024-08-19T00:55:59.038 INFO:tasks.workunit.client.1.smithi086.stdout:1/233: rename d4/d1e/f1c to d4/d10/f4f 0 2024-08-19T00:55:59.040 INFO:tasks.workunit.client.1.smithi086.stdout:1/234: truncate d4/d7/f21 4307207 0 2024-08-19T00:55:59.040 INFO:tasks.workunit.client.1.smithi086.stdout:0/245: unlink da/d14/d1a/f40 0 2024-08-19T00:55:59.041 INFO:tasks.workunit.client.1.smithi086.stdout:1/235: write d4/d7/f21 [1320260,16109] 0 2024-08-19T00:55:59.042 INFO:tasks.workunit.client.1.smithi086.stdout:2/168: symlink d8/d24/l34 0 2024-08-19T00:55:59.043 INFO:tasks.workunit.client.1.smithi086.stdout:1/236: chown d4/d7/d2a/d36/d3a 1043280046 1 2024-08-19T00:55:59.045 INFO:tasks.workunit.client.1.smithi086.stdout:6/224: rename db/f1a to db/d34/d39/f48 0 2024-08-19T00:55:59.049 INFO:tasks.workunit.client.1.smithi086.stdout:1/237: mkdir d4/d7/d2a/d36/d50 0 2024-08-19T00:55:59.050 INFO:tasks.workunit.client.1.smithi086.stdout:2/169: dwrite d8/d14/f15 [0,4194304] 0 2024-08-19T00:55:59.052 INFO:tasks.workunit.client.1.smithi086.stdout:1/238: creat d4/d10/f51 x:0 0 0 2024-08-19T00:55:59.052 INFO:tasks.workunit.client.1.smithi086.stdout:0/246: rmdir da/d14/d1a/d2e/d39/d3b/d3f 0 2024-08-19T00:55:59.054 INFO:tasks.workunit.client.1.smithi086.stdout:1/239: dread d4/d7/d2a/d36/f45 [0,4194304] 0 2024-08-19T00:55:59.056 INFO:tasks.workunit.client.1.smithi086.stdout:2/170: link d8/d14/f22 d8/d24/f35 0 2024-08-19T00:55:59.056 INFO:tasks.workunit.client.1.smithi086.stdout:1/240: dread - d4/d7/d2a/d36/d3a/f43 zero size 2024-08-19T00:55:59.056 INFO:tasks.workunit.client.1.smithi086.stdout:2/171: dread - d8/d14/f29 zero size 2024-08-19T00:55:59.059 INFO:tasks.workunit.client.1.smithi086.stdout:0/247: dread da/d14/d1a/d2e/d30/f4c [0,4194304] 0 2024-08-19T00:55:59.066 INFO:tasks.workunit.client.1.smithi086.stdout:2/172: rename d8/d2c/f31 to d8/f36 0 2024-08-19T00:55:59.066 INFO:tasks.workunit.client.1.smithi086.stdout:1/241: dwrite d4/d7/f37 [0,4194304] 0 2024-08-19T00:55:59.066 INFO:tasks.workunit.client.1.smithi086.stdout:0/248: creat da/d14/d1a/f54 x:0 0 0 2024-08-19T00:55:59.068 INFO:tasks.workunit.client.1.smithi086.stdout:7/236: dread d3/de/f1e [0,4194304] 0 2024-08-19T00:55:59.068 INFO:tasks.workunit.client.1.smithi086.stdout:6/225: dread db/d37/f20 [0,4194304] 0 2024-08-19T00:55:59.069 INFO:tasks.workunit.client.1.smithi086.stdout:2/173: mknod d8/d14/c37 0 2024-08-19T00:55:59.071 INFO:tasks.workunit.client.1.smithi086.stdout:7/237: dread d3/de/d2d/f32 [0,4194304] 0 2024-08-19T00:55:59.071 INFO:tasks.workunit.client.1.smithi086.stdout:0/249: mkdir da/d14/d55 0 2024-08-19T00:55:59.074 INFO:tasks.workunit.client.1.smithi086.stdout:1/242: dwrite d4/f18 [8388608,4194304] 0 2024-08-19T00:55:59.078 INFO:tasks.workunit.client.1.smithi086.stdout:6/226: rmdir db/d37/d41 39 2024-08-19T00:55:59.081 INFO:tasks.workunit.client.1.smithi086.stdout:7/238: stat d3/de/d1b/l1c 0 2024-08-19T00:55:59.082 INFO:tasks.workunit.client.1.smithi086.stdout:0/250: write da/f3c [1425843,18709] 0 2024-08-19T00:55:59.084 INFO:tasks.workunit.client.1.smithi086.stdout:1/243: dwrite d4/d7/f28 [0,4194304] 0 2024-08-19T00:55:59.085 INFO:tasks.workunit.client.1.smithi086.stdout:7/239: write d3/de/f2b [4177496,106402] 0 2024-08-19T00:55:59.087 INFO:tasks.workunit.client.1.smithi086.stdout:1/244: write d4/d1e/f20 [1101979,64354] 0 2024-08-19T00:55:59.089 INFO:tasks.workunit.client.1.smithi086.stdout:0/251: creat da/f56 x:0 0 0 2024-08-19T00:55:59.093 INFO:tasks.workunit.client.1.smithi086.stdout:1/245: read d4/d7/d2a/d36/f45 [856674,60889] 0 2024-08-19T00:55:59.093 INFO:tasks.workunit.client.1.smithi086.stdout:6/227: dwrite db/f18 [4194304,4194304] 0 2024-08-19T00:55:59.095 INFO:tasks.workunit.client.1.smithi086.stdout:2/174: write d8/f1f [1617020,66370] 0 2024-08-19T00:55:59.096 INFO:tasks.workunit.client.1.smithi086.stdout:1/246: mknod d4/d7/d2a/c52 0 2024-08-19T00:55:59.099 INFO:tasks.workunit.client.1.smithi086.stdout:6/228: dread db/f16 [0,4194304] 0 2024-08-19T00:55:59.104 INFO:tasks.workunit.client.1.smithi086.stdout:1/247: readlink d4/d7/d2a/d36/l38 0 2024-08-19T00:55:59.109 INFO:tasks.workunit.client.1.smithi086.stdout:2/175: dwrite d8/d24/f2b [0,4194304] 0 2024-08-19T00:55:59.112 INFO:tasks.workunit.client.1.smithi086.stdout:6/229: truncate db/d37/f21 2658119 0 2024-08-19T00:55:59.113 INFO:tasks.workunit.client.1.smithi086.stdout:2/176: mkdir d8/d2c/d38 0 2024-08-19T00:55:59.115 INFO:tasks.workunit.client.1.smithi086.stdout:2/177: dread - d8/d24/f26 zero size 2024-08-19T00:55:59.116 INFO:tasks.workunit.client.1.smithi086.stdout:1/248: dwrite d4/d1e/f11 [4194304,4194304] 0 2024-08-19T00:55:59.116 INFO:tasks.workunit.client.1.smithi086.stdout:6/230: creat db/d37/d30/f49 x:0 0 0 2024-08-19T00:55:59.120 INFO:tasks.workunit.client.1.smithi086.stdout:0/252: dread da/d14/d26/f38 [0,4194304] 0 2024-08-19T00:55:59.121 INFO:tasks.workunit.client.1.smithi086.stdout:2/178: symlink d8/l39 0 2024-08-19T00:55:59.123 INFO:tasks.workunit.client.1.smithi086.stdout:6/231: fsync db/d34/d39/f48 0 2024-08-19T00:55:59.124 INFO:tasks.workunit.client.1.smithi086.stdout:8/196: sync 2024-08-19T00:55:59.124 INFO:tasks.workunit.client.1.smithi086.stdout:5/172: sync 2024-08-19T00:55:59.124 INFO:tasks.workunit.client.1.smithi086.stdout:7/240: dread d3/ff [4194304,4194304] 0 2024-08-19T00:55:59.125 INFO:tasks.workunit.client.1.smithi086.stdout:0/253: readlink da/d14/d26/l31 0 2024-08-19T00:55:59.127 INFO:tasks.workunit.client.1.smithi086.stdout:5/173: readlink d0/d2d/l2f 0 2024-08-19T00:55:59.128 INFO:tasks.workunit.client.1.smithi086.stdout:6/232: rename db/l19 to db/d37/d28/l4a 0 2024-08-19T00:55:59.128 INFO:tasks.workunit.client.1.smithi086.stdout:0/254: symlink da/d14/d44/l57 0 2024-08-19T00:55:59.129 INFO:tasks.workunit.client.1.smithi086.stdout:1/249: dwrite d4/d1e/d35/f4a [0,4194304] 0 2024-08-19T00:55:59.129 INFO:tasks.workunit.client.1.smithi086.stdout:7/241: mknod d3/de/d1b/c4a 0 2024-08-19T00:55:59.130 INFO:tasks.workunit.client.1.smithi086.stdout:5/174: rmdir d0/d2d 39 2024-08-19T00:55:59.130 INFO:tasks.workunit.client.1.smithi086.stdout:6/233: chown db/d37/d28/c29 12240686 1 2024-08-19T00:55:59.131 INFO:tasks.workunit.client.1.smithi086.stdout:8/197: mkdir dc/d16/d18/d29/d2e/d28/d41 0 2024-08-19T00:55:59.131 INFO:tasks.workunit.client.1.smithi086.stdout:2/179: dread d8/f12 [0,4194304] 0 2024-08-19T00:55:59.133 INFO:tasks.workunit.client.1.smithi086.stdout:0/255: dread - da/d14/d1a/f52 zero size 2024-08-19T00:55:59.133 INFO:tasks.workunit.client.1.smithi086.stdout:1/250: creat d4/d7/f53 x:0 0 0 2024-08-19T00:55:59.134 INFO:tasks.workunit.client.1.smithi086.stdout:6/234: mknod db/d34/d39/c4b 0 2024-08-19T00:55:59.140 INFO:tasks.workunit.client.1.smithi086.stdout:0/256: chown da/d14/f1d 0 1 2024-08-19T00:55:59.141 INFO:tasks.workunit.client.1.smithi086.stdout:1/251: read d4/d7/f21 [2501733,129539] 0 2024-08-19T00:55:59.144 INFO:tasks.workunit.client.1.smithi086.stdout:7/242: dwrite d3/de/f2b [0,4194304] 0 2024-08-19T00:55:59.145 INFO:tasks.workunit.client.1.smithi086.stdout:5/175: dwrite d0/df/f18 [0,4194304] 0 2024-08-19T00:55:59.147 INFO:tasks.workunit.client.1.smithi086.stdout:5/176: readlink d0/l16 0 2024-08-19T00:55:59.147 INFO:tasks.workunit.client.1.smithi086.stdout:6/235: creat db/d37/f4c x:0 0 0 2024-08-19T00:55:59.149 INFO:tasks.workunit.client.1.smithi086.stdout:8/198: write dc/d17/f31 [99679,128375] 0 2024-08-19T00:55:59.151 INFO:tasks.workunit.client.1.smithi086.stdout:1/252: creat d4/d1e/f54 x:0 0 0 2024-08-19T00:55:59.152 INFO:tasks.workunit.client.1.smithi086.stdout:6/236: write db/f3b [1348693,3133] 0 2024-08-19T00:55:59.152 INFO:tasks.workunit.client.1.smithi086.stdout:5/177: chown d0/df/d1f/f28 1 1 2024-08-19T00:55:59.154 INFO:tasks.workunit.client.1.smithi086.stdout:2/180: dwrite d8/f1d [0,4194304] 0 2024-08-19T00:55:59.154 INFO:tasks.workunit.client.1.smithi086.stdout:7/243: rename d3/de/d1b to d3/de/d49/d4b 0 2024-08-19T00:55:59.154 INFO:tasks.workunit.client.1.smithi086.stdout:8/199: write dc/d1f/f27 [7248145,57507] 0 2024-08-19T00:55:59.155 INFO:tasks.workunit.client.1.smithi086.stdout:9/189: sync 2024-08-19T00:55:59.155 INFO:tasks.workunit.client.1.smithi086.stdout:3/219: sync 2024-08-19T00:55:59.158 INFO:tasks.workunit.client.1.smithi086.stdout:6/237: creat db/d34/d39/f4d x:0 0 0 2024-08-19T00:55:59.161 INFO:tasks.workunit.client.1.smithi086.stdout:6/238: write db/f46 [442346,43759] 0 2024-08-19T00:55:59.162 INFO:tasks.workunit.client.1.smithi086.stdout:2/181: chown d8/d14/f25 13 1 2024-08-19T00:55:59.164 INFO:tasks.workunit.client.1.smithi086.stdout:1/253: truncate d4/d7/d2a/d36/d3a/d41/f4b 4509028 0 2024-08-19T00:55:59.172 INFO:tasks.workunit.client.1.smithi086.stdout:1/254: mknod d4/d7/d2a/c55 0 2024-08-19T00:55:59.173 INFO:tasks.workunit.client.1.smithi086.stdout:6/239: fsync db/d37/f21 0 2024-08-19T00:55:59.173 INFO:tasks.workunit.client.1.smithi086.stdout:8/200: dwrite dc/f36 [0,4194304] 0 2024-08-19T00:55:59.176 INFO:tasks.workunit.client.1.smithi086.stdout:2/182: symlink d8/d24/d32/l3a 0 2024-08-19T00:55:59.176 INFO:tasks.workunit.client.1.smithi086.stdout:7/244: dwrite d3/f3a [0,4194304] 0 2024-08-19T00:55:59.177 INFO:tasks.workunit.client.1.smithi086.stdout:9/190: rename db/d2d to db/d3b 0 2024-08-19T00:55:59.177 INFO:tasks.workunit.client.1.smithi086.stdout:5/178: getdents d0/d8 0 2024-08-19T00:55:59.179 INFO:tasks.workunit.client.1.smithi086.stdout:9/191: chown db/dd/c1a 92 1 2024-08-19T00:55:59.183 INFO:tasks.workunit.client.1.smithi086.stdout:2/183: read - d8/d24/f26 zero size 2024-08-19T00:55:59.184 INFO:tasks.workunit.client.1.smithi086.stdout:1/255: fdatasync d4/d10/f4f 0 2024-08-19T00:55:59.185 INFO:tasks.workunit.client.1.smithi086.stdout:6/240: truncate db/f3e 2586364 0 2024-08-19T00:55:59.185 INFO:tasks.workunit.client.1.smithi086.stdout:9/192: rmdir db/d23 39 2024-08-19T00:55:59.188 INFO:tasks.workunit.client.1.smithi086.stdout:5/179: creat d0/d2d/f32 x:0 0 0 2024-08-19T00:55:59.189 INFO:tasks.workunit.client.1.smithi086.stdout:6/241: mkdir db/d34/d4e 0 2024-08-19T00:55:59.190 INFO:tasks.workunit.client.1.smithi086.stdout:9/193: rmdir db/dd 39 2024-08-19T00:55:59.190 INFO:tasks.workunit.client.1.smithi086.stdout:2/184: truncate d8/d24/f35 1939612 0 2024-08-19T00:55:59.192 INFO:tasks.workunit.client.1.smithi086.stdout:6/242: fsync db/f14 0 2024-08-19T00:55:59.195 INFO:tasks.workunit.client.1.smithi086.stdout:8/201: dread dc/d1f/f27 [4194304,4194304] 0 2024-08-19T00:55:59.195 INFO:tasks.workunit.client.1.smithi086.stdout:5/180: write d0/d8/d10/f2b [26163,17592] 0 2024-08-19T00:55:59.195 INFO:tasks.workunit.client.1.smithi086.stdout:7/245: dwrite d3/de/d49/d4b/f3d [0,4194304] 0 2024-08-19T00:55:59.196 INFO:tasks.workunit.client.1.smithi086.stdout:1/256: truncate d4/d7/d2a/d36/d3a/f3e 283085 0 2024-08-19T00:55:59.196 INFO:tasks.workunit.client.1.smithi086.stdout:2/185: symlink d8/d24/d32/l3b 0 2024-08-19T00:55:59.197 INFO:tasks.workunit.client.1.smithi086.stdout:2/186: stat d8/f1f 0 2024-08-19T00:55:59.198 INFO:tasks.workunit.client.1.smithi086.stdout:9/194: rename f2 to db/dd/d19/d38/f3c 0 2024-08-19T00:55:59.200 INFO:tasks.workunit.client.1.smithi086.stdout:2/187: write d8/f33 [135928,126060] 0 2024-08-19T00:55:59.204 INFO:tasks.workunit.client.1.smithi086.stdout:3/220: dread d3/d18/d27/d49/f32 [0,4194304] 0 2024-08-19T00:55:59.204 INFO:tasks.workunit.client.1.smithi086.stdout:8/202: creat dc/d16/f42 x:0 0 0 2024-08-19T00:55:59.205 INFO:tasks.workunit.client.1.smithi086.stdout:1/257: mkdir d4/d1e/d35/d56 0 2024-08-19T00:55:59.208 INFO:tasks.workunit.client.1.smithi086.stdout:7/246: symlink d3/de/d49/d4b/d42/l4c 0 2024-08-19T00:55:59.209 INFO:tasks.workunit.client.1.smithi086.stdout:2/188: write d8/d14/f2f [1662377,84306] 0 2024-08-19T00:55:59.214 INFO:tasks.workunit.client.1.smithi086.stdout:8/203: mknod dc/d16/d18/d29/d2e/d28/d2b/c43 0 2024-08-19T00:55:59.214 INFO:tasks.workunit.client.1.smithi086.stdout:1/258: dread d4/d7/d2a/f33 [0,4194304] 0 2024-08-19T00:55:59.215 INFO:tasks.workunit.client.1.smithi086.stdout:5/181: dwrite d0/df/f1a [4194304,4194304] 0 2024-08-19T00:55:59.216 INFO:tasks.workunit.client.1.smithi086.stdout:6/243: dwrite db/f11 [0,4194304] 0 2024-08-19T00:55:59.217 INFO:tasks.workunit.client.1.smithi086.stdout:8/204: chown dc/d16/f42 12 1 2024-08-19T00:55:59.218 INFO:tasks.workunit.client.1.smithi086.stdout:3/221: write d3/f6 [9406,12414] 0 2024-08-19T00:55:59.219 INFO:tasks.workunit.client.1.smithi086.stdout:6/244: chown db/d34 937742585 1 2024-08-19T00:55:59.220 INFO:tasks.workunit.client.1.smithi086.stdout:2/189: write d8/f12 [1327453,34094] 0 2024-08-19T00:55:59.222 INFO:tasks.workunit.client.1.smithi086.stdout:5/182: dread d0/d8/d10/f2b [0,4194304] 0 2024-08-19T00:55:59.224 INFO:tasks.workunit.client.1.smithi086.stdout:8/205: write dc/d1f/f27 [3076630,117223] 0 2024-08-19T00:55:59.224 INFO:tasks.workunit.client.1.smithi086.stdout:7/247: truncate d3/de/d2d/f32 1666703 0 2024-08-19T00:55:59.225 INFO:tasks.workunit.client.1.smithi086.stdout:3/222: read - d3/d18/d19/d20/f21 zero size 2024-08-19T00:55:59.225 INFO:tasks.workunit.client.1.smithi086.stdout:7/248: stat d3 0 2024-08-19T00:55:59.228 INFO:tasks.workunit.client.1.smithi086.stdout:8/206: write f7 [6925780,60847] 0 2024-08-19T00:55:59.230 INFO:tasks.workunit.client.1.smithi086.stdout:5/183: mkdir d0/df/d1f/d33 0 2024-08-19T00:55:59.231 INFO:tasks.workunit.client.1.smithi086.stdout:7/249: fdatasync d3/de/f1e 0 2024-08-19T00:55:59.234 INFO:tasks.workunit.client.1.smithi086.stdout:8/207: write f3 [4945528,3880] 0 2024-08-19T00:55:59.234 INFO:tasks.workunit.client.1.smithi086.stdout:1/259: dwrite d4/d7/d2a/d36/d3a/f43 [0,4194304] 0 2024-08-19T00:55:59.237 INFO:tasks.workunit.client.1.smithi086.stdout:6/245: dread db/d34/d39/f48 [0,4194304] 0 2024-08-19T00:55:59.239 INFO:tasks.workunit.client.1.smithi086.stdout:7/250: write d3/d34/d44/f37 [870213,22722] 0 2024-08-19T00:55:59.239 INFO:tasks.workunit.client.1.smithi086.stdout:8/208: unlink dc/d17/f2a 0 2024-08-19T00:55:59.240 INFO:tasks.workunit.client.1.smithi086.stdout:2/190: dwrite d8/d14/f29 [0,4194304] 0 2024-08-19T00:55:59.244 INFO:tasks.workunit.client.1.smithi086.stdout:8/209: write dc/d16/f42 [441431,61032] 0 2024-08-19T00:55:59.244 INFO:tasks.workunit.client.1.smithi086.stdout:7/251: write d3/de/d2d/f31 [10815,91913] 0 2024-08-19T00:55:59.246 INFO:tasks.workunit.client.1.smithi086.stdout:6/246: rename db/d34/d39/f4d to db/d37/d44/f4f 0 2024-08-19T00:55:59.249 INFO:tasks.workunit.client.1.smithi086.stdout:7/252: unlink d3/de/d2d/f2f 0 2024-08-19T00:55:59.249 INFO:tasks.workunit.client.1.smithi086.stdout:5/184: dwrite d0/f6 [0,4194304] 0 2024-08-19T00:55:59.251 INFO:tasks.workunit.client.1.smithi086.stdout:1/260: link d4/d1e/d35/l4e d4/d1e/d35/d56/l57 0 2024-08-19T00:55:59.253 INFO:tasks.workunit.client.1.smithi086.stdout:2/191: rename d8/d14/f29 to d8/d24/d32/f3c 0 2024-08-19T00:55:59.256 INFO:tasks.workunit.client.1.smithi086.stdout:2/192: fdatasync d8/d14/f25 0 2024-08-19T00:55:59.257 INFO:tasks.workunit.client.1.smithi086.stdout:7/253: write d3/de/d2d/f31 [1286206,100915] 0 2024-08-19T00:55:59.261 INFO:tasks.workunit.client.1.smithi086.stdout:6/247: dwrite db/f18 [8388608,4194304] 0 2024-08-19T00:55:59.264 INFO:tasks.workunit.client.1.smithi086.stdout:5/185: dwrite d0/f17 [0,4194304] 0 2024-08-19T00:55:59.268 INFO:tasks.workunit.client.1.smithi086.stdout:7/254: dwrite d3/de/d2d/f31 [0,4194304] 0 2024-08-19T00:55:59.352 INFO:tasks.workunit.client.1.smithi086.stdout:4/175: sync 2024-08-19T00:55:59.387 INFO:tasks.workunit.client.1.smithi086.stdout:8/210: getdents dc/d16/d18/d29/d2e/d28/d41 0 2024-08-19T00:55:59.388 INFO:tasks.workunit.client.1.smithi086.stdout:8/211: write dc/f14 [1742894,50431] 0 2024-08-19T00:55:59.391 INFO:tasks.workunit.client.1.smithi086.stdout:1/261: stat d4/d7/d2a/d36/l38 0 2024-08-19T00:55:59.391 INFO:tasks.workunit.client.1.smithi086.stdout:1/262: fdatasync d4/d7/f53 0 2024-08-19T00:55:59.397 INFO:tasks.workunit.client.1.smithi086.stdout:5/186: chown d0/c4 1 1 2024-08-19T00:55:59.398 INFO:tasks.workunit.client.1.smithi086.stdout:7/255: symlink d3/d34/d44/l4d 0 2024-08-19T00:55:59.398 INFO:tasks.workunit.client.1.smithi086.stdout:5/187: write d0/df/f1a [4387753,120291] 0 2024-08-19T00:55:59.399 INFO:tasks.workunit.client.1.smithi086.stdout:5/188: dread - d0/d20/f25 zero size 2024-08-19T00:55:59.400 INFO:tasks.workunit.client.1.smithi086.stdout:4/176: mknod d2/da/c3f 0 2024-08-19T00:55:59.400 INFO:tasks.workunit.client.1.smithi086.stdout:7/256: write d3/de/d49/d4b/f23 [357854,69599] 0 2024-08-19T00:55:59.402 INFO:tasks.workunit.client.1.smithi086.stdout:2/193: mknod d8/c3d 0 2024-08-19T00:55:59.403 INFO:tasks.workunit.client.1.smithi086.stdout:8/212: creat dc/d16/d18/d29/d2e/d28/d2b/d3b/f44 x:0 0 0 2024-08-19T00:55:59.405 INFO:tasks.workunit.client.1.smithi086.stdout:1/263: symlink d4/d7/d2a/l58 0 2024-08-19T00:55:59.405 INFO:tasks.workunit.client.1.smithi086.stdout:7/257: dread - d3/d34/d44/f48 zero size 2024-08-19T00:55:59.409 INFO:tasks.workunit.client.1.smithi086.stdout:7/258: write d3/f3a [602815,121697] 0 2024-08-19T00:55:59.410 INFO:tasks.workunit.client.1.smithi086.stdout:2/194: symlink d8/d24/d32/l3e 0 2024-08-19T00:55:59.412 INFO:tasks.workunit.client.1.smithi086.stdout:5/189: dread d0/f6 [4194304,4194304] 0 2024-08-19T00:55:59.417 INFO:tasks.workunit.client.1.smithi086.stdout:6/248: dwrite db/f2e [0,4194304] 0 2024-08-19T00:55:59.419 INFO:tasks.workunit.client.1.smithi086.stdout:7/259: write d3/de/d49/d4b/f3d [3069538,50337] 0 2024-08-19T00:55:59.420 INFO:tasks.workunit.client.1.smithi086.stdout:4/177: dwrite d2/f23 [0,4194304] 0 2024-08-19T00:55:59.425 INFO:tasks.workunit.client.1.smithi086.stdout:2/195: rename d8/fe to d8/d2c/d38/f3f 0 2024-08-19T00:55:59.428 INFO:tasks.workunit.client.1.smithi086.stdout:5/190: creat d0/df/d1f/d33/f34 x:0 0 0 2024-08-19T00:55:59.428 INFO:tasks.workunit.client.1.smithi086.stdout:1/264: dread d4/d7/d2a/d36/d3a/d41/f4b [0,4194304] 0 2024-08-19T00:55:59.429 INFO:tasks.workunit.client.1.smithi086.stdout:4/178: chown d2/d1c/d2c/f2e 1 1 2024-08-19T00:55:59.432 INFO:tasks.workunit.client.1.smithi086.stdout:7/260: dread d3/fb [0,4194304] 0 2024-08-19T00:55:59.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:59 smithi017 ceph-mon[16627]: pgmap v10: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 278 op/s 2024-08-19T00:55:59.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:59 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:59.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:55:59 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:59.434 INFO:tasks.workunit.client.1.smithi086.stdout:8/213: dwrite dc/d16/d18/d29/d2e/d28/d2b/d3b/f44 [0,4194304] 0 2024-08-19T00:55:59.435 INFO:tasks.workunit.client.1.smithi086.stdout:2/196: unlink d8/d24/f28 0 2024-08-19T00:55:59.438 INFO:tasks.workunit.client.1.smithi086.stdout:5/191: symlink d0/d8/l35 0 2024-08-19T00:55:59.439 INFO:tasks.workunit.client.1.smithi086.stdout:1/265: mknod d4/d1e/d35/c59 0 2024-08-19T00:55:59.440 INFO:tasks.workunit.client.1.smithi086.stdout:4/179: dwrite d2/d1c/d25/f35 [0,4194304] 0 2024-08-19T00:55:59.443 INFO:tasks.workunit.client.1.smithi086.stdout:6/249: rename db/l1e to db/l50 0 2024-08-19T00:55:59.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:59 smithi086 ceph-mon[24511]: pgmap v10: 65 pgs: 65 active+clean; 275 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 12 MiB/s wr, 278 op/s 2024-08-19T00:55:59.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:59 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:59.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:55:59 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:55:59.446 INFO:tasks.workunit.client.1.smithi086.stdout:8/214: unlink dc/d16/d18/d29/d2e/d28/d2b/c43 0 2024-08-19T00:55:59.449 INFO:tasks.workunit.client.1.smithi086.stdout:8/215: fsync dc/d16/d18/d29/d32/f3d 0 2024-08-19T00:55:59.450 INFO:tasks.workunit.client.1.smithi086.stdout:1/266: dwrite d4/d7/f3d [0,4194304] 0 2024-08-19T00:55:59.451 INFO:tasks.workunit.client.1.smithi086.stdout:5/192: creat d0/d20/f36 x:0 0 0 2024-08-19T00:55:59.451 INFO:tasks.workunit.client.1.smithi086.stdout:7/261: dwrite d3/de/f27 [0,4194304] 0 2024-08-19T00:55:59.454 INFO:tasks.workunit.client.1.smithi086.stdout:4/180: creat d2/d1c/d1d/f40 x:0 0 0 2024-08-19T00:55:59.458 INFO:tasks.workunit.client.1.smithi086.stdout:6/250: creat db/d34/d39/f51 x:0 0 0 2024-08-19T00:55:59.460 INFO:tasks.workunit.client.1.smithi086.stdout:9/195: sync 2024-08-19T00:55:59.460 INFO:tasks.workunit.client.1.smithi086.stdout:0/257: sync 2024-08-19T00:55:59.461 INFO:tasks.workunit.client.1.smithi086.stdout:9/196: dread - db/f11 zero size 2024-08-19T00:55:59.462 INFO:tasks.workunit.client.1.smithi086.stdout:8/216: creat dc/d16/d18/d29/d2e/d28/f45 x:0 0 0 2024-08-19T00:55:59.465 INFO:tasks.workunit.client.1.smithi086.stdout:7/262: mknod d3/c4e 0 2024-08-19T00:55:59.465 INFO:tasks.workunit.client.1.smithi086.stdout:8/217: stat dc/d16/d18/d29/d2e/f3f 0 2024-08-19T00:55:59.467 INFO:tasks.workunit.client.1.smithi086.stdout:7/263: dread - d3/d34/d44/f48 zero size 2024-08-19T00:55:59.467 INFO:tasks.workunit.client.1.smithi086.stdout:4/181: creat d2/da/f41 x:0 0 0 2024-08-19T00:55:59.468 INFO:tasks.workunit.client.1.smithi086.stdout:0/258: dwrite da/d14/d1a/f52 [0,4194304] 0 2024-08-19T00:55:59.469 INFO:tasks.workunit.client.1.smithi086.stdout:2/197: creat d8/f40 x:0 0 0 2024-08-19T00:55:59.471 INFO:tasks.workunit.client.1.smithi086.stdout:6/251: symlink db/d37/d28/d31/l52 0 2024-08-19T00:55:59.476 INFO:tasks.workunit.client.1.smithi086.stdout:6/252: write db/d37/d30/f3f [764294,125356] 0 2024-08-19T00:55:59.478 INFO:tasks.workunit.client.1.smithi086.stdout:6/253: stat db/cd 0 2024-08-19T00:55:59.478 INFO:tasks.workunit.client.1.smithi086.stdout:8/218: dwrite dc/d16/d18/f2f [0,4194304] 0 2024-08-19T00:55:59.480 INFO:tasks.workunit.client.1.smithi086.stdout:4/182: dread d2/da/f14 [0,4194304] 0 2024-08-19T00:55:59.480 INFO:tasks.workunit.client.1.smithi086.stdout:8/219: write dc/f11 [4673488,90829] 0 2024-08-19T00:55:59.482 INFO:tasks.workunit.client.1.smithi086.stdout:0/259: symlink da/d14/d44/d49/l58 0 2024-08-19T00:55:59.485 INFO:tasks.workunit.client.1.smithi086.stdout:2/198: creat d8/d24/d32/f41 x:0 0 0 2024-08-19T00:55:59.485 INFO:tasks.workunit.client.1.smithi086.stdout:4/183: truncate d2/da/d2f/f39 516366 0 2024-08-19T00:55:59.485 INFO:tasks.workunit.client.1.smithi086.stdout:9/197: mknod db/dd/d19/c3d 0 2024-08-19T00:55:59.485 INFO:tasks.workunit.client.1.smithi086.stdout:0/260: chown da/d14/d1a/d2e/d39/d3b/d4e 5620 1 2024-08-19T00:55:59.487 INFO:tasks.workunit.client.1.smithi086.stdout:0/261: dread - da/d14/d1a/d2e/f51 zero size 2024-08-19T00:55:59.488 INFO:tasks.workunit.client.1.smithi086.stdout:7/264: mkdir d3/de/d4f 0 2024-08-19T00:55:59.491 INFO:tasks.workunit.client.1.smithi086.stdout:6/254: unlink db/d37/d28/d31/l43 0 2024-08-19T00:55:59.494 INFO:tasks.workunit.client.1.smithi086.stdout:7/265: dwrite d3/f38 [0,4194304] 0 2024-08-19T00:55:59.494 INFO:tasks.workunit.client.1.smithi086.stdout:8/220: unlink dc/d16/d18/f2f 0 2024-08-19T00:55:59.496 INFO:tasks.workunit.client.1.smithi086.stdout:8/221: write dc/f36 [4967619,12922] 0 2024-08-19T00:55:59.520 INFO:tasks.workunit.client.1.smithi086.stdout:5/193: rename d0/f7 to d0/d8/f37 0 2024-08-19T00:55:59.521 INFO:tasks.workunit.client.1.smithi086.stdout:4/184: mkdir d2/d18/d33/d42 0 2024-08-19T00:55:59.521 INFO:tasks.workunit.client.1.smithi086.stdout:1/267: getdents d4/d1e/d35/d56 0 2024-08-19T00:55:59.522 INFO:tasks.workunit.client.1.smithi086.stdout:9/198: mknod db/dd/d19/d38/c3e 0 2024-08-19T00:55:59.524 INFO:tasks.workunit.client.1.smithi086.stdout:1/268: dread - d4/d1e/f54 zero size 2024-08-19T00:55:59.524 INFO:tasks.workunit.client.1.smithi086.stdout:5/194: write d0/df/d1f/f27 [2287423,62093] 0 2024-08-19T00:55:59.593 INFO:tasks.workunit.client.1.smithi086.stdout:3/223: sync 2024-08-19T00:55:59.595 INFO:tasks.workunit.client.1.smithi086.stdout:4/185: write d2/d1c/d1d/f40 [228451,29695] 0 2024-08-19T00:55:59.595 INFO:tasks.workunit.client.1.smithi086.stdout:8/222: chown dc/d16/d18/d29/d2e/d28/d2b/d3b/f44 106563 1 2024-08-19T00:55:59.596 INFO:tasks.workunit.client.1.smithi086.stdout:5/195: stat d0/fa 0 2024-08-19T00:55:59.596 INFO:tasks.workunit.client.1.smithi086.stdout:7/266: dread d3/f38 [0,4194304] 0 2024-08-19T00:55:59.598 INFO:tasks.workunit.client.1.smithi086.stdout:3/224: truncate d3/d18/f24 4629907 0 2024-08-19T00:55:59.599 INFO:tasks.workunit.client.1.smithi086.stdout:1/269: creat d4/d10/f5a x:0 0 0 2024-08-19T00:55:59.600 INFO:tasks.workunit.client.1.smithi086.stdout:2/199: dwrite d8/d24/d32/f3c [0,4194304] 0 2024-08-19T00:55:59.602 INFO:tasks.workunit.client.1.smithi086.stdout:5/196: write d0/fb [3388931,25958] 0 2024-08-19T00:55:59.603 INFO:tasks.workunit.client.1.smithi086.stdout:3/225: read d3/d9/f15 [1490364,88833] 0 2024-08-19T00:55:59.604 INFO:tasks.workunit.client.1.smithi086.stdout:4/186: dread d2/da/f16 [0,4194304] 0 2024-08-19T00:55:59.604 INFO:tasks.workunit.client.1.smithi086.stdout:5/197: write d0/df/d1f/f28 [468830,84929] 0 2024-08-19T00:55:59.605 INFO:tasks.workunit.client.1.smithi086.stdout:5/198: chown d0/d8 4132499 1 2024-08-19T00:55:59.605 INFO:tasks.workunit.client.1.smithi086.stdout:3/226: chown d3/d9/f12 3345719 1 2024-08-19T00:55:59.606 INFO:tasks.workunit.client.1.smithi086.stdout:9/199: mkdir db/d23/d30/d3f 0 2024-08-19T00:55:59.609 INFO:tasks.workunit.client.1.smithi086.stdout:8/223: unlink lb 0 2024-08-19T00:55:59.613 INFO:tasks.workunit.client.1.smithi086.stdout:1/270: rename d4/f26 to d4/d1e/d35/f5b 0 2024-08-19T00:55:59.614 INFO:tasks.workunit.client.1.smithi086.stdout:9/200: dwrite db/f15 [0,4194304] 0 2024-08-19T00:55:59.617 INFO:tasks.workunit.client.1.smithi086.stdout:6/255: getdents db/d37/d44 0 2024-08-19T00:55:59.619 INFO:tasks.workunit.client.1.smithi086.stdout:2/200: dwrite d8/f19 [0,4194304] 0 2024-08-19T00:55:59.624 INFO:tasks.workunit.client.1.smithi086.stdout:5/199: symlink d0/df/l38 0 2024-08-19T00:55:59.630 INFO:tasks.workunit.client.1.smithi086.stdout:3/227: rename d3/d18/d19/d20 to d3/d18/d1a/d53 0 2024-08-19T00:55:59.635 INFO:tasks.workunit.client.1.smithi086.stdout:6/256: fsync db/f16 0 2024-08-19T00:55:59.637 INFO:tasks.workunit.client.1.smithi086.stdout:3/228: dwrite d3/d18/d19/d37/f4e [0,4194304] 0 2024-08-19T00:55:59.637 INFO:tasks.workunit.client.1.smithi086.stdout:6/257: read db/f13 [1732906,7442] 0 2024-08-19T00:55:59.642 INFO:tasks.workunit.client.1.smithi086.stdout:8/224: mknod dc/d16/d18/d29/d2e/d28/d41/c46 0 2024-08-19T00:55:59.645 INFO:tasks.workunit.client.1.smithi086.stdout:9/201: mknod db/c40 0 2024-08-19T00:55:59.646 INFO:tasks.workunit.client.1.smithi086.stdout:0/262: sync 2024-08-19T00:55:59.650 INFO:tasks.workunit.client.1.smithi086.stdout:3/229: fdatasync d3/d9/f15 0 2024-08-19T00:55:59.651 INFO:tasks.workunit.client.1.smithi086.stdout:6/258: mknod db/d37/d28/c53 0 2024-08-19T00:55:59.653 INFO:tasks.workunit.client.1.smithi086.stdout:8/225: mknod dc/d16/d18/c47 0 2024-08-19T00:55:59.655 INFO:tasks.workunit.client.1.smithi086.stdout:1/271: creat d4/f5c x:0 0 0 2024-08-19T00:55:59.656 INFO:tasks.workunit.client.1.smithi086.stdout:9/202: creat db/d3b/f41 x:0 0 0 2024-08-19T00:55:59.658 INFO:tasks.workunit.client.1.smithi086.stdout:9/203: write db/dd/d19/d18/f36 [1024670,69447] 0 2024-08-19T00:55:59.662 INFO:tasks.workunit.client.1.smithi086.stdout:1/272: dwrite d4/d7/f3d [0,4194304] 0 2024-08-19T00:55:59.662 INFO:tasks.workunit.client.1.smithi086.stdout:3/230: mkdir d3/d18/d27/d49/d3f/d54 0 2024-08-19T00:55:59.672 INFO:tasks.workunit.client.1.smithi086.stdout:9/204: creat db/d23/f42 x:0 0 0 2024-08-19T00:55:59.673 INFO:tasks.workunit.client.1.smithi086.stdout:9/205: write db/dd/d19/f33 [934012,112939] 0 2024-08-19T00:55:59.673 INFO:tasks.workunit.client.1.smithi086.stdout:2/201: getdents d8/d2c 0 2024-08-19T00:55:59.675 INFO:tasks.workunit.client.1.smithi086.stdout:9/206: write db/dd/d19/f2c [58441,13767] 0 2024-08-19T00:55:59.676 INFO:tasks.workunit.client.1.smithi086.stdout:1/273: stat d4/d1e/d35/l42 0 2024-08-19T00:55:59.678 INFO:tasks.workunit.client.1.smithi086.stdout:3/231: creat d3/d18/d19/f55 x:0 0 0 2024-08-19T00:55:59.680 INFO:tasks.workunit.client.1.smithi086.stdout:8/226: mkdir dc/d1f/d37/d48 0 2024-08-19T00:55:59.682 INFO:tasks.workunit.client.1.smithi086.stdout:2/202: creat d8/d2c/d38/f42 x:0 0 0 2024-08-19T00:55:59.685 INFO:tasks.workunit.client.1.smithi086.stdout:1/274: unlink d4/f18 0 2024-08-19T00:55:59.686 INFO:tasks.workunit.client.1.smithi086.stdout:3/232: stat d3/d18/d19/c1e 0 2024-08-19T00:55:59.686 INFO:tasks.workunit.client.1.smithi086.stdout:3/233: fsync d3/d18/d1a/f34 0 2024-08-19T00:55:59.688 INFO:tasks.workunit.client.1.smithi086.stdout:8/227: mkdir dc/d17/d1e/d49 0 2024-08-19T00:55:59.691 INFO:tasks.workunit.client.1.smithi086.stdout:9/207: mkdir db/d23/d30/d3f/d43 0 2024-08-19T00:55:59.692 INFO:tasks.workunit.client.1.smithi086.stdout:9/208: fsync db/dd/d19/d18/f25 0 2024-08-19T00:55:59.695 INFO:tasks.workunit.client.1.smithi086.stdout:1/275: rename d4/c1b to d4/d7/d2a/d36/d3a/c5d 0 2024-08-19T00:55:59.701 INFO:tasks.workunit.client.1.smithi086.stdout:8/228: symlink dc/d16/d18/d29/d2e/d28/l4a 0 2024-08-19T00:55:59.703 INFO:tasks.workunit.client.1.smithi086.stdout:8/229: write dc/f33 [548397,129095] 0 2024-08-19T00:55:59.704 INFO:tasks.workunit.client.1.smithi086.stdout:3/234: dwrite d3/d9/f12 [0,4194304] 0 2024-08-19T00:55:59.704 INFO:tasks.workunit.client.1.smithi086.stdout:4/187: write d2/da/f16 [5209857,40741] 0 2024-08-19T00:55:59.707 INFO:tasks.workunit.client.1.smithi086.stdout:9/209: readlink db/dd/d19/l24 0 2024-08-19T00:55:59.707 INFO:tasks.workunit.client.1.smithi086.stdout:1/276: creat d4/d7/f5e x:0 0 0 2024-08-19T00:55:59.710 INFO:tasks.workunit.client.1.smithi086.stdout:8/230: mknod dc/d16/d18/d29/d2e/c4b 0 2024-08-19T00:55:59.711 INFO:tasks.workunit.client.1.smithi086.stdout:8/231: write f3 [857251,74337] 0 2024-08-19T00:55:59.713 INFO:tasks.workunit.client.1.smithi086.stdout:4/188: creat d2/d1c/d2c/f43 x:0 0 0 2024-08-19T00:55:59.714 INFO:tasks.workunit.client.1.smithi086.stdout:4/189: write d2/da/f37 [3602887,83411] 0 2024-08-19T00:55:59.716 INFO:tasks.workunit.client.1.smithi086.stdout:4/190: write d2/d1c/d25/f3a [453567,47676] 0 2024-08-19T00:55:59.720 INFO:tasks.workunit.client.1.smithi086.stdout:9/210: mkdir db/d23/d30/d32/d44 0 2024-08-19T00:55:59.721 INFO:tasks.workunit.client.1.smithi086.stdout:8/232: dwrite dc/d16/d18/d29/d32/f3d [0,4194304] 0 2024-08-19T00:55:59.728 INFO:tasks.workunit.client.1.smithi086.stdout:3/235: creat d3/d18/d27/d48/d4d/f56 x:0 0 0 2024-08-19T00:55:59.728 INFO:tasks.workunit.client.1.smithi086.stdout:7/267: dwrite d3/de/d2d/f32 [0,4194304] 0 2024-08-19T00:55:59.729 INFO:tasks.workunit.client.1.smithi086.stdout:4/191: symlink d2/da/l44 0 2024-08-19T00:55:59.733 INFO:tasks.workunit.client.1.smithi086.stdout:4/192: fsync d2/f21 0 2024-08-19T00:55:59.736 INFO:tasks.workunit.client.1.smithi086.stdout:9/211: dwrite db/f1b [0,4194304] 0 2024-08-19T00:55:59.736 INFO:tasks.workunit.client.1.smithi086.stdout:8/233: dread dc/f36 [0,4194304] 0 2024-08-19T00:55:59.742 INFO:tasks.workunit.client.1.smithi086.stdout:3/236: mkdir d3/d26/d2b/d33/d4a/d57 0 2024-08-19T00:55:59.742 INFO:tasks.workunit.client.1.smithi086.stdout:4/193: creat d2/f45 x:0 0 0 2024-08-19T00:55:59.744 INFO:tasks.workunit.client.1.smithi086.stdout:4/194: dread - d2/da/f41 zero size 2024-08-19T00:55:59.745 INFO:tasks.workunit.client.1.smithi086.stdout:7/268: dwrite d3/de/d49/d4b/f3d [0,4194304] 0 2024-08-19T00:55:59.747 INFO:tasks.workunit.client.1.smithi086.stdout:6/259: getdents db/d37/d28 0 2024-08-19T00:55:59.751 INFO:tasks.workunit.client.1.smithi086.stdout:6/260: mknod db/d34/d39/c54 0 2024-08-19T00:55:59.752 INFO:tasks.workunit.client.1.smithi086.stdout:5/200: truncate d0/d8/d10/f1d 3834175 0 2024-08-19T00:55:59.754 INFO:tasks.workunit.client.1.smithi086.stdout:7/269: symlink d3/de/d4f/l50 0 2024-08-19T00:55:59.756 INFO:tasks.workunit.client.1.smithi086.stdout:5/201: write d0/d8/d10/f19 [181653,3989] 0 2024-08-19T00:55:59.759 INFO:tasks.workunit.client.1.smithi086.stdout:6/261: rename db/d37/d28/d31 to db/d34/d4e/d55 0 2024-08-19T00:55:59.760 INFO:tasks.workunit.client.1.smithi086.stdout:0/263: dwrite da/d14/d1a/d2e/d30/f50 [0,4194304] 0 2024-08-19T00:55:59.763 INFO:tasks.workunit.client.1.smithi086.stdout:7/270: unlink d3/de/c2c 0 2024-08-19T00:55:59.764 INFO:tasks.workunit.client.1.smithi086.stdout:0/264: creat da/d14/f59 x:0 0 0 2024-08-19T00:55:59.766 INFO:tasks.workunit.client.1.smithi086.stdout:7/271: symlink d3/l51 0 2024-08-19T00:55:59.771 INFO:tasks.workunit.client.1.smithi086.stdout:5/202: dwrite d0/f29 [0,4194304] 0 2024-08-19T00:55:59.772 INFO:tasks.workunit.client.1.smithi086.stdout:1/277: rmdir d4 39 2024-08-19T00:55:59.772 INFO:tasks.workunit.client.1.smithi086.stdout:2/203: write d8/f11 [4120949,46378] 0 2024-08-19T00:55:59.774 INFO:tasks.workunit.client.1.smithi086.stdout:4/195: dread d2/d18/d33/f36 [0,4194304] 0 2024-08-19T00:55:59.780 INFO:tasks.workunit.client.1.smithi086.stdout:2/204: dread - d8/d24/d32/f41 zero size 2024-08-19T00:55:59.781 INFO:tasks.workunit.client.1.smithi086.stdout:6/262: dwrite db/d37/d30/f33 [0,4194304] 0 2024-08-19T00:55:59.781 INFO:tasks.workunit.client.1.smithi086.stdout:9/212: dread db/dd/ff [0,4194304] 0 2024-08-19T00:55:59.785 INFO:tasks.workunit.client.1.smithi086.stdout:8/234: truncate dc/f33 215625 0 2024-08-19T00:55:59.785 INFO:tasks.workunit.client.1.smithi086.stdout:4/196: creat d2/f46 x:0 0 0 2024-08-19T00:55:59.788 INFO:tasks.workunit.client.1.smithi086.stdout:7/272: dread d3/de/d2d/f31 [0,4194304] 0 2024-08-19T00:55:59.789 INFO:tasks.workunit.client.1.smithi086.stdout:9/213: chown db/dd/d19/f1f 11698 1 2024-08-19T00:55:59.790 INFO:tasks.workunit.client.1.smithi086.stdout:1/278: mknod d4/d7/d2a/d36/d50/c5f 0 2024-08-19T00:55:59.796 INFO:tasks.workunit.client.1.smithi086.stdout:1/279: chown d4/d7/f37 13665192 1 2024-08-19T00:55:59.797 INFO:tasks.workunit.client.1.smithi086.stdout:6/263: dwrite db/d34/d39/f40 [0,4194304] 0 2024-08-19T00:55:59.798 INFO:tasks.workunit.client.1.smithi086.stdout:7/273: creat d3/d34/f52 x:0 0 0 2024-08-19T00:55:59.799 INFO:tasks.workunit.client.1.smithi086.stdout:4/197: mknod d2/d1c/d25/d30/c47 0 2024-08-19T00:55:59.801 INFO:tasks.workunit.client.1.smithi086.stdout:8/235: fsync dc/d16/d18/d29/d2e/d28/f45 0 2024-08-19T00:55:59.803 INFO:tasks.workunit.client.1.smithi086.stdout:6/264: chown db/f14 0 1 2024-08-19T00:55:59.808 INFO:tasks.workunit.client.1.smithi086.stdout:5/203: dwrite d0/d8/f2c [0,4194304] 0 2024-08-19T00:55:59.808 INFO:tasks.workunit.client.1.smithi086.stdout:0/265: dwrite da/f10 [0,4194304] 0 2024-08-19T00:55:59.813 INFO:tasks.workunit.client.1.smithi086.stdout:9/214: rename db/le to db/l45 0 2024-08-19T00:55:59.815 INFO:tasks.workunit.client.1.smithi086.stdout:8/236: write dc/d16/d18/d29/d2e/d28/d2b/f40 [833258,11441] 0 2024-08-19T00:55:59.817 INFO:tasks.workunit.client.1.smithi086.stdout:4/198: mknod d2/d18/d33/d42/c48 0 2024-08-19T00:55:59.819 INFO:tasks.workunit.client.1.smithi086.stdout:1/280: link d4/d1e/d35/c59 d4/d7/c60 0 2024-08-19T00:55:59.822 INFO:tasks.workunit.client.1.smithi086.stdout:1/281: fsync d4/d1e/f54 0 2024-08-19T00:55:59.823 INFO:tasks.workunit.client.1.smithi086.stdout:5/204: mknod d0/df/d1f/d33/c39 0 2024-08-19T00:55:59.826 INFO:tasks.workunit.client.1.smithi086.stdout:4/199: write d2/d18/f31 [4475873,96405] 0 2024-08-19T00:55:59.826 INFO:tasks.workunit.client.1.smithi086.stdout:7/274: dwrite d3/de/f2b [4194304,4194304] 0 2024-08-19T00:55:59.829 INFO:tasks.workunit.client.1.smithi086.stdout:6/265: dread db/f11 [0,4194304] 0 2024-08-19T00:55:59.829 INFO:tasks.workunit.client.1.smithi086.stdout:3/237: sync 2024-08-19T00:55:59.830 INFO:tasks.workunit.client.1.smithi086.stdout:8/237: rename dc/d17/f31 to dc/d1f/f4c 0 2024-08-19T00:55:59.831 INFO:tasks.workunit.client.1.smithi086.stdout:5/205: mkdir d0/d20/d3a 0 2024-08-19T00:55:59.831 INFO:tasks.workunit.client.1.smithi086.stdout:2/205: dwrite d8/f1a [0,4194304] 0 2024-08-19T00:55:59.837 INFO:tasks.workunit.client.1.smithi086.stdout:0/266: dwrite da/d14/f1d [0,4194304] 0 2024-08-19T00:55:59.838 INFO:tasks.workunit.client.1.smithi086.stdout:7/275: chown d3/de/l1d 17265 1 2024-08-19T00:55:59.843 INFO:tasks.workunit.client.1.smithi086.stdout:4/200: symlink d2/da/d2f/l49 0 2024-08-19T00:55:59.843 INFO:tasks.workunit.client.1.smithi086.stdout:9/215: dwrite db/f11 [0,4194304] 0 2024-08-19T00:55:59.848 INFO:tasks.workunit.client.1.smithi086.stdout:5/206: chown d0/d8/d10/f2b 52062396 1 2024-08-19T00:55:59.848 INFO:tasks.workunit.client.1.smithi086.stdout:3/238: mknod d3/d18/d1a/d53/c58 0 2024-08-19T00:55:59.850 INFO:tasks.workunit.client.1.smithi086.stdout:1/282: dwrite d4/d7/f28 [4194304,4194304] 0 2024-08-19T00:55:59.851 INFO:tasks.workunit.client.1.smithi086.stdout:3/239: write f2 [7965173,79319] 0 2024-08-19T00:55:59.853 INFO:tasks.workunit.client.1.smithi086.stdout:4/201: creat d2/d1c/d1d/f4a x:0 0 0 2024-08-19T00:55:59.853 INFO:tasks.workunit.client.1.smithi086.stdout:0/267: write da/d14/d26/f2b [275545,49169] 0 2024-08-19T00:55:59.855 INFO:tasks.workunit.client.1.smithi086.stdout:7/276: symlink d3/de/d2d/l53 0 2024-08-19T00:55:59.857 INFO:tasks.workunit.client.1.smithi086.stdout:1/283: read d4/d7/d2a/d36/d3a/f43 [60829,66996] 0 2024-08-19T00:55:59.858 INFO:tasks.workunit.client.1.smithi086.stdout:4/202: fdatasync d2/d1c/d2c/f43 0 2024-08-19T00:55:59.858 INFO:tasks.workunit.client.1.smithi086.stdout:0/268: stat da/d14/d44/d49 0 2024-08-19T00:55:59.859 INFO:tasks.workunit.client.1.smithi086.stdout:7/277: chown d3/d34/d44/d3e/l45 1 1 2024-08-19T00:55:59.859 INFO:tasks.workunit.client.1.smithi086.stdout:9/216: getdents db/d23/d30/d32/d44 0 2024-08-19T00:55:59.861 INFO:tasks.workunit.client.1.smithi086.stdout:5/207: rmdir d0/d20/d3a 0 2024-08-19T00:55:59.861 INFO:tasks.workunit.client.1.smithi086.stdout:0/269: chown da/d14/d1a/d2e/d39/d3b 7 1 2024-08-19T00:55:59.862 INFO:tasks.workunit.client.1.smithi086.stdout:6/266: getdents db/d37/d28 0 2024-08-19T00:55:59.862 INFO:tasks.workunit.client.1.smithi086.stdout:9/217: dread - db/f35 zero size 2024-08-19T00:55:59.862 INFO:tasks.workunit.client.1.smithi086.stdout:7/278: rmdir d3/d34/d44/d3e 39 2024-08-19T00:55:59.867 INFO:tasks.workunit.client.1.smithi086.stdout:4/203: link d2/d18/l22 d2/da/l4b 0 2024-08-19T00:55:59.867 INFO:tasks.workunit.client.1.smithi086.stdout:5/208: truncate d0/d20/f25 79410 0 2024-08-19T00:55:59.868 INFO:tasks.workunit.client.1.smithi086.stdout:9/218: fsync db/dd/d19/d38/f3c 0 2024-08-19T00:55:59.868 INFO:tasks.workunit.client.1.smithi086.stdout:7/279: symlink d3/de/d49/d4b/l54 0 2024-08-19T00:55:59.873 INFO:tasks.workunit.client.1.smithi086.stdout:3/240: dwrite d3/d18/d19/f1f [0,4194304] 0 2024-08-19T00:55:59.882 INFO:tasks.workunit.client.1.smithi086.stdout:1/284: dread d4/d10/f1d [0,4194304] 0 2024-08-19T00:55:59.882 INFO:tasks.workunit.client.1.smithi086.stdout:0/270: dread da/d14/d26/f2b [0,4194304] 0 2024-08-19T00:55:59.884 INFO:tasks.workunit.client.1.smithi086.stdout:3/241: creat d3/d26/f59 x:0 0 0 2024-08-19T00:55:59.886 INFO:tasks.workunit.client.1.smithi086.stdout:2/206: truncate d8/f1f 3507742 0 2024-08-19T00:55:59.889 INFO:tasks.workunit.client.1.smithi086.stdout:4/204: dwrite d2/da/f37 [0,4194304] 0 2024-08-19T00:55:59.890 INFO:tasks.workunit.client.1.smithi086.stdout:5/209: dread d0/d8/f2c [0,4194304] 0 2024-08-19T00:55:59.891 INFO:tasks.workunit.client.1.smithi086.stdout:8/238: dread f8 [4194304,4194304] 0 2024-08-19T00:55:59.894 INFO:tasks.workunit.client.1.smithi086.stdout:3/242: write d3/d18/d27/d49/f35 [902717,65670] 0 2024-08-19T00:55:59.894 INFO:tasks.workunit.client.1.smithi086.stdout:1/285: chown d4/d7/d2a/d36/d3a/c5d 4818 1 2024-08-19T00:55:59.896 INFO:tasks.workunit.client.1.smithi086.stdout:0/271: creat da/d14/d44/f5a x:0 0 0 2024-08-19T00:55:59.898 INFO:tasks.workunit.client.1.smithi086.stdout:7/280: dread d3/de/d49/d4b/f3d [0,4194304] 0 2024-08-19T00:55:59.899 INFO:tasks.workunit.client.1.smithi086.stdout:9/219: dwrite db/dd/d19/d18/f25 [0,4194304] 0 2024-08-19T00:55:59.899 INFO:tasks.workunit.client.1.smithi086.stdout:1/286: mkdir d4/d7/d2a/d36/d61 0 2024-08-19T00:55:59.899 INFO:tasks.workunit.client.1.smithi086.stdout:4/205: symlink d2/d1c/d1d/l4c 0 2024-08-19T00:55:59.900 INFO:tasks.workunit.client.1.smithi086.stdout:6/267: dread f3 [0,4194304] 0 2024-08-19T00:55:59.902 INFO:tasks.workunit.client.1.smithi086.stdout:2/207: mkdir d8/d43 0 2024-08-19T00:55:59.902 INFO:tasks.workunit.client.1.smithi086.stdout:2/208: readlink d8/l39 0 2024-08-19T00:55:59.902 INFO:tasks.workunit.client.1.smithi086.stdout:3/243: mkdir d3/d18/d19/d37/d5a 0 2024-08-19T00:55:59.905 INFO:tasks.workunit.client.1.smithi086.stdout:4/206: write d2/da/f41 [962179,129342] 0 2024-08-19T00:55:59.906 INFO:tasks.workunit.client.1.smithi086.stdout:5/210: symlink d0/df/d1f/l3b 0 2024-08-19T00:55:59.906 INFO:tasks.workunit.client.1.smithi086.stdout:6/268: chown db/d34/d39/f40 504384385 1 2024-08-19T00:55:59.907 INFO:tasks.workunit.client.1.smithi086.stdout:8/239: mknod dc/d1f/c4d 0 2024-08-19T00:55:59.907 INFO:tasks.workunit.client.1.smithi086.stdout:1/287: truncate d4/d10/f25 232090 0 2024-08-19T00:55:59.908 INFO:tasks.workunit.client.1.smithi086.stdout:2/209: mknod d8/d2c/c44 0 2024-08-19T00:55:59.910 INFO:tasks.workunit.client.1.smithi086.stdout:9/220: creat db/d23/d30/d32/f46 x:0 0 0 2024-08-19T00:55:59.910 INFO:tasks.workunit.client.1.smithi086.stdout:2/210: fdatasync d8/f19 0 2024-08-19T00:55:59.911 INFO:tasks.workunit.client.1.smithi086.stdout:9/221: chown db/d26 53294276 1 2024-08-19T00:55:59.912 INFO:tasks.workunit.client.1.smithi086.stdout:8/240: read - dc/d16/d18/d29/d2e/d28/d2b/f38 zero size 2024-08-19T00:55:59.916 INFO:tasks.workunit.client.1.smithi086.stdout:2/211: creat d8/d2c/d38/f45 x:0 0 0 2024-08-19T00:55:59.916 INFO:tasks.workunit.client.1.smithi086.stdout:8/241: write dc/f1c [483231,26754] 0 2024-08-19T00:55:59.918 INFO:tasks.workunit.client.1.smithi086.stdout:6/269: creat db/f56 x:0 0 0 2024-08-19T00:55:59.918 INFO:tasks.workunit.client.1.smithi086.stdout:2/212: chown d8/d14 1276074874 1 2024-08-19T00:55:59.918 INFO:tasks.workunit.client.1.smithi086.stdout:9/222: symlink db/d23/d30/d32/d44/l47 0 2024-08-19T00:55:59.921 INFO:tasks.workunit.client.1.smithi086.stdout:9/223: readlink db/l2e 0 2024-08-19T00:55:59.923 INFO:tasks.workunit.client.1.smithi086.stdout:5/211: truncate d0/fb 2456198 0 2024-08-19T00:55:59.925 INFO:tasks.workunit.client.1.smithi086.stdout:6/270: mkdir db/d37/d28/d57 0 2024-08-19T00:55:59.927 INFO:tasks.workunit.client.1.smithi086.stdout:1/288: dwrite d4/d7/d2a/d36/d3a/f3e [0,4194304] 0 2024-08-19T00:55:59.930 INFO:tasks.workunit.client.1.smithi086.stdout:3/244: dread d3/d9/f15 [0,4194304] 0 2024-08-19T00:55:59.932 INFO:tasks.workunit.client.1.smithi086.stdout:1/289: readlink d4/d7/d2a/l58 0 2024-08-19T00:55:59.932 INFO:tasks.workunit.client.1.smithi086.stdout:5/212: creat d0/d20/f3c x:0 0 0 2024-08-19T00:55:59.932 INFO:tasks.workunit.client.1.smithi086.stdout:9/224: write db/dd/d19/d18/f2f [22132,47091] 0 2024-08-19T00:55:59.934 INFO:tasks.workunit.client.1.smithi086.stdout:3/245: fsync d3/d26/d2b/f3b 0 2024-08-19T00:55:59.935 INFO:tasks.workunit.client.1.smithi086.stdout:6/271: creat db/f58 x:0 0 0 2024-08-19T00:55:59.937 INFO:tasks.workunit.client.1.smithi086.stdout:8/242: dwrite dc/f14 [0,4194304] 0 2024-08-19T00:55:59.937 INFO:tasks.workunit.client.1.smithi086.stdout:5/213: readlink d0/d8/le 0 2024-08-19T00:55:59.939 INFO:tasks.workunit.client.1.smithi086.stdout:9/225: write db/d3b/f41 [539473,84752] 0 2024-08-19T00:55:59.945 INFO:tasks.workunit.client.1.smithi086.stdout:3/246: dread d3/d18/f1c [4194304,4194304] 0 2024-08-19T00:55:59.947 INFO:tasks.workunit.client.1.smithi086.stdout:1/290: creat d4/d7/d2a/d36/d50/f62 x:0 0 0 2024-08-19T00:55:59.948 INFO:tasks.workunit.client.1.smithi086.stdout:0/272: dread da/d14/d26/f48 [4194304,4194304] 0 2024-08-19T00:55:59.950 INFO:tasks.workunit.client.1.smithi086.stdout:9/226: creat db/d23/d37/f48 x:0 0 0 2024-08-19T00:55:59.951 INFO:tasks.workunit.client.1.smithi086.stdout:1/291: fdatasync d4/d10/f51 0 2024-08-19T00:55:59.957 INFO:tasks.workunit.client.1.smithi086.stdout:2/213: dread d8/d24/f2b [0,4194304] 0 2024-08-19T00:55:59.958 INFO:tasks.workunit.client.1.smithi086.stdout:9/227: dread - db/d26/f29 zero size 2024-08-19T00:55:59.958 INFO:tasks.workunit.client.1.smithi086.stdout:6/272: dwrite db/f46 [0,4194304] 0 2024-08-19T00:55:59.960 INFO:tasks.workunit.client.1.smithi086.stdout:5/214: truncate d0/f1e 201740 0 2024-08-19T00:55:59.962 INFO:tasks.workunit.client.1.smithi086.stdout:8/243: truncate dc/d16/f2d 471786 0 2024-08-19T00:55:59.964 INFO:tasks.workunit.client.1.smithi086.stdout:6/273: write f8 [6121216,70830] 0 2024-08-19T00:55:59.966 INFO:tasks.workunit.client.1.smithi086.stdout:1/292: rmdir d4/d7 39 2024-08-19T00:55:59.968 INFO:tasks.workunit.client.1.smithi086.stdout:9/228: creat db/d26/f49 x:0 0 0 2024-08-19T00:55:59.969 INFO:tasks.workunit.client.1.smithi086.stdout:0/273: dwrite da/f46 [4194304,4194304] 0 2024-08-19T00:55:59.971 INFO:tasks.workunit.client.1.smithi086.stdout:5/215: creat d0/df/d1f/d33/f3d x:0 0 0 2024-08-19T00:55:59.974 INFO:tasks.workunit.client.1.smithi086.stdout:9/229: readlink db/dd/d19/d18/l1e 0 2024-08-19T00:55:59.976 INFO:tasks.workunit.client.1.smithi086.stdout:8/244: truncate dc/d16/d18/d29/d32/f3d 4219722 0 2024-08-19T00:55:59.976 INFO:tasks.workunit.client.1.smithi086.stdout:3/247: dwrite d3/d18/f2c [0,4194304] 0 2024-08-19T00:55:59.978 INFO:tasks.workunit.client.1.smithi086.stdout:1/293: mkdir d4/d7/d2a/d36/d63 0 2024-08-19T00:55:59.983 INFO:tasks.workunit.client.1.smithi086.stdout:6/274: write db/d37/d41/f47 [19096,26577] 0 2024-08-19T00:55:59.985 INFO:tasks.workunit.client.1.smithi086.stdout:2/214: dwrite d8/f33 [0,4194304] 0 2024-08-19T00:55:59.985 INFO:tasks.workunit.client.1.smithi086.stdout:3/248: readlink d3/d18/d1a/l1b 0 2024-08-19T00:55:59.985 INFO:tasks.workunit.client.1.smithi086.stdout:5/216: rename d0/d8/ld to d0/d8/d10/l3e 0 2024-08-19T00:55:59.985 INFO:tasks.workunit.client.1.smithi086.stdout:8/245: write dc/f14 [1379115,17789] 0 2024-08-19T00:55:59.988 INFO:tasks.workunit.client.1.smithi086.stdout:6/275: chown db/d37/d30 209 1 2024-08-19T00:55:59.990 INFO:tasks.workunit.client.1.smithi086.stdout:1/294: rename d4/d1e/d35/l4e to d4/d10/l64 0 2024-08-19T00:55:59.991 INFO:tasks.workunit.client.1.smithi086.stdout:0/274: truncate da/d14/d1a/d2e/f35 24590 0 2024-08-19T00:55:59.997 INFO:tasks.workunit.client.1.smithi086.stdout:9/230: dwrite db/d23/d30/d32/f3a [0,4194304] 0 2024-08-19T00:56:00.022 INFO:tasks.workunit.client.1.smithi086.stdout:0/275: mknod da/d14/d1a/d2e/d39/d3b/d4e/c5b 0 2024-08-19T00:56:00.026 INFO:tasks.workunit.client.1.smithi086.stdout:2/215: link d8/d14/c16 d8/d14/c46 0 2024-08-19T00:56:00.026 INFO:tasks.workunit.client.1.smithi086.stdout:5/217: dwrite d0/d20/f36 [0,4194304] 0 2024-08-19T00:56:00.027 INFO:tasks.workunit.client.1.smithi086.stdout:8/246: dwrite dc/f11 [4194304,4194304] 0 2024-08-19T00:56:00.029 INFO:tasks.workunit.client.1.smithi086.stdout:9/231: creat db/d23/d37/f4a x:0 0 0 2024-08-19T00:56:00.031 INFO:tasks.workunit.client.1.smithi086.stdout:2/216: chown d8/d24/d32/l3b 15 1 2024-08-19T00:56:00.031 INFO:tasks.workunit.client.1.smithi086.stdout:6/276: truncate db/d34/d39/f48 3817839 0 2024-08-19T00:56:00.032 INFO:tasks.workunit.client.1.smithi086.stdout:3/249: dread d3/d18/f22 [0,4194304] 0 2024-08-19T00:56:00.032 INFO:tasks.workunit.client.1.smithi086.stdout:0/276: write da/d14/d26/f48 [7249243,21527] 0 2024-08-19T00:56:00.034 INFO:tasks.workunit.client.1.smithi086.stdout:9/232: write db/f20 [1822678,22414] 0 2024-08-19T00:56:00.036 INFO:tasks.workunit.client.1.smithi086.stdout:2/217: chown d8/d14/f22 14 1 2024-08-19T00:56:00.037 INFO:tasks.workunit.client.1.smithi086.stdout:9/233: chown db/d23/d30/d3f 509 1 2024-08-19T00:56:00.037 INFO:tasks.workunit.client.1.smithi086.stdout:8/247: unlink dc/d16/d18/d29/d2e/d28/d2b/d3b/f44 0 2024-08-19T00:56:00.040 INFO:tasks.workunit.client.1.smithi086.stdout:3/250: mkdir d3/d18/d27/d49/d3f/d5b 0 2024-08-19T00:56:00.041 INFO:tasks.workunit.client.1.smithi086.stdout:0/277: creat da/d14/d1a/d2e/d39/f5c x:0 0 0 2024-08-19T00:56:00.042 INFO:tasks.workunit.client.1.smithi086.stdout:9/234: symlink db/d26/l4b 0 2024-08-19T00:56:00.042 INFO:tasks.workunit.client.1.smithi086.stdout:2/218: truncate d8/d2c/d38/f42 478236 0 2024-08-19T00:56:00.042 INFO:tasks.workunit.client.1.smithi086.stdout:5/218: dwrite d0/d20/f22 [0,4194304] 0 2024-08-19T00:56:00.044 INFO:tasks.workunit.client.1.smithi086.stdout:8/248: write dc/f36 [5786449,128659] 0 2024-08-19T00:56:00.046 INFO:tasks.workunit.client.1.smithi086.stdout:0/278: chown da/d14/d1a/c53 20 1 2024-08-19T00:56:00.051 INFO:tasks.workunit.client.1.smithi086.stdout:2/219: getdents d8/d43 0 2024-08-19T00:56:00.051 INFO:tasks.workunit.client.1.smithi086.stdout:0/279: mkdir da/d5d 0 2024-08-19T00:56:00.052 INFO:tasks.workunit.client.1.smithi086.stdout:8/249: mknod dc/d16/c4e 0 2024-08-19T00:56:00.055 INFO:tasks.workunit.client.1.smithi086.stdout:2/220: mkdir d8/d2c/d47 0 2024-08-19T00:56:00.057 INFO:tasks.workunit.client.1.smithi086.stdout:3/251: dwrite d3/d9/f39 [0,4194304] 0 2024-08-19T00:56:00.057 INFO:tasks.workunit.client.1.smithi086.stdout:2/221: write d8/ff [2516929,23810] 0 2024-08-19T00:56:00.063 INFO:tasks.workunit.client.1.smithi086.stdout:0/280: symlink da/d14/d1a/d2e/d39/d3b/d4e/l5e 0 2024-08-19T00:56:00.063 INFO:tasks.workunit.client.1.smithi086.stdout:8/250: fdatasync dc/f11 0 2024-08-19T00:56:00.064 INFO:tasks.workunit.client.1.smithi086.stdout:0/281: chown da/d14/d55 4 1 2024-08-19T00:56:00.065 INFO:tasks.workunit.client.1.smithi086.stdout:9/235: dread db/f20 [0,4194304] 0 2024-08-19T00:56:00.065 INFO:tasks.workunit.client.1.smithi086.stdout:0/282: chown da/d14 62 1 2024-08-19T00:56:00.066 INFO:tasks.workunit.client.1.smithi086.stdout:6/277: dread db/f13 [0,4194304] 0 2024-08-19T00:56:00.066 INFO:tasks.workunit.client.1.smithi086.stdout:2/222: creat d8/d43/f48 x:0 0 0 2024-08-19T00:56:00.066 INFO:tasks.workunit.client.1.smithi086.stdout:3/252: symlink d3/d18/d27/d49/d3f/d54/l5c 0 2024-08-19T00:56:00.067 INFO:tasks.workunit.client.1.smithi086.stdout:8/251: mkdir dc/d1f/d37/d4f 0 2024-08-19T00:56:00.068 INFO:tasks.workunit.client.1.smithi086.stdout:3/253: fdatasync d3/d18/f36 0 2024-08-19T00:56:00.068 INFO:tasks.workunit.client.1.smithi086.stdout:2/223: write d8/f19 [4812225,122982] 0 2024-08-19T00:56:00.069 INFO:tasks.workunit.client.1.smithi086.stdout:0/283: chown da/cb 1 1 2024-08-19T00:56:00.071 INFO:tasks.workunit.client.1.smithi086.stdout:6/278: unlink db/d34/d4e/d55/l52 0 2024-08-19T00:56:00.074 INFO:tasks.workunit.client.1.smithi086.stdout:2/224: creat d8/d2c/f49 x:0 0 0 2024-08-19T00:56:00.076 INFO:tasks.workunit.client.1.smithi086.stdout:0/284: creat da/d14/d44/d49/f5f x:0 0 0 2024-08-19T00:56:00.079 INFO:tasks.workunit.client.1.smithi086.stdout:3/254: getdents d3/d18/d1a/d51 0 2024-08-19T00:56:00.080 INFO:tasks.workunit.client.1.smithi086.stdout:6/279: symlink db/d37/d28/d57/l59 0 2024-08-19T00:56:00.080 INFO:tasks.workunit.client.1.smithi086.stdout:8/252: dread dc/d16/d18/d29/d2e/f3f [0,4194304] 0 2024-08-19T00:56:00.081 INFO:tasks.workunit.client.1.smithi086.stdout:2/225: truncate d8/d24/f26 497545 0 2024-08-19T00:56:00.082 INFO:tasks.workunit.client.1.smithi086.stdout:3/255: readlink d3/l7 0 2024-08-19T00:56:00.082 INFO:tasks.workunit.client.1.smithi086.stdout:9/236: dwrite db/d23/d37/f4a [0,4194304] 0 2024-08-19T00:56:00.083 INFO:tasks.workunit.client.1.smithi086.stdout:5/219: dwrite d0/f1e [0,4194304] 0 2024-08-19T00:56:00.083 INFO:tasks.workunit.client.1.smithi086.stdout:6/280: stat db/d37/d30/f3a 0 2024-08-19T00:56:00.085 INFO:tasks.workunit.client.1.smithi086.stdout:9/237: chown fa 73452396 1 2024-08-19T00:56:00.087 INFO:tasks.workunit.client.1.smithi086.stdout:0/285: fsync da/d14/d44/d49/f5f 0 2024-08-19T00:56:00.088 INFO:tasks.workunit.client.1.smithi086.stdout:8/253: mknod dc/d1f/d37/c50 0 2024-08-19T00:56:00.089 INFO:tasks.workunit.client.1.smithi086.stdout:2/226: symlink d8/d43/l4a 0 2024-08-19T00:56:00.089 INFO:tasks.workunit.client.1.smithi086.stdout:6/281: mkdir db/d37/d44/d5a 0 2024-08-19T00:56:00.090 INFO:tasks.workunit.client.1.smithi086.stdout:3/256: write d3/d18/f22 [5179557,56924] 0 2024-08-19T00:56:00.090 INFO:tasks.workunit.client.1.smithi086.stdout:2/227: stat d8/ff 0 2024-08-19T00:56:00.094 INFO:tasks.workunit.client.1.smithi086.stdout:6/282: fdatasync db/f2e 0 2024-08-19T00:56:00.095 INFO:tasks.workunit.client.1.smithi086.stdout:7/281: sync 2024-08-19T00:56:00.096 INFO:tasks.workunit.client.1.smithi086.stdout:3/257: unlink f2 0 2024-08-19T00:56:00.096 INFO:tasks.workunit.client.1.smithi086.stdout:0/286: truncate da/d14/d1a/d2e/d30/f50 4332979 0 2024-08-19T00:56:00.098 INFO:tasks.workunit.client.1.smithi086.stdout:8/254: creat dc/f51 x:0 0 0 2024-08-19T00:56:00.099 INFO:tasks.workunit.client.1.smithi086.stdout:5/220: truncate d0/df/d1f/f27 1745699 0 2024-08-19T00:56:00.100 INFO:tasks.workunit.client.1.smithi086.stdout:9/238: dwrite db/d23/d37/f48 [0,4194304] 0 2024-08-19T00:56:00.102 INFO:tasks.workunit.client.1.smithi086.stdout:2/228: link d8/d14/f15 d8/d24/d32/f4b 0 2024-08-19T00:56:00.102 INFO:tasks.workunit.client.1.smithi086.stdout:5/221: stat d0/d8/f37 0 2024-08-19T00:56:00.104 INFO:tasks.workunit.client.1.smithi086.stdout:6/283: mknod db/d37/d28/c5b 0 2024-08-19T00:56:00.109 INFO:tasks.workunit.client.1.smithi086.stdout:2/229: write d8/d14/f15 [2045044,26488] 0 2024-08-19T00:56:00.114 INFO:tasks.workunit.client.1.smithi086.stdout:3/258: mkdir d3/d18/d19/d37/d5a/d5d 0 2024-08-19T00:56:00.115 INFO:tasks.workunit.client.1.smithi086.stdout:8/255: truncate dc/d16/d18/d29/d2e/d28/d2b/f38 39989 0 2024-08-19T00:56:00.116 INFO:tasks.workunit.client.1.smithi086.stdout:2/230: symlink d8/d24/l4c 0 2024-08-19T00:56:00.121 INFO:tasks.workunit.client.1.smithi086.stdout:3/259: fdatasync d3/d18/f24 0 2024-08-19T00:56:00.123 INFO:tasks.workunit.client.1.smithi086.stdout:5/222: dwrite d0/d20/f22 [0,4194304] 0 2024-08-19T00:56:00.124 INFO:tasks.workunit.client.1.smithi086.stdout:6/284: dread db/d34/d4e/d55/f32 [0,4194304] 0 2024-08-19T00:56:00.125 INFO:tasks.workunit.client.1.smithi086.stdout:3/260: mknod d3/d9/c5e 0 2024-08-19T00:56:00.126 INFO:tasks.workunit.client.1.smithi086.stdout:2/231: chown d8/d43/l4a 1869 1 2024-08-19T00:56:00.126 INFO:tasks.workunit.client.1.smithi086.stdout:9/239: dwrite db/f15 [8388608,4194304] 0 2024-08-19T00:56:00.129 INFO:tasks.workunit.client.1.smithi086.stdout:8/256: creat dc/d16/d18/d29/d2e/d28/d41/f52 x:0 0 0 2024-08-19T00:56:00.131 INFO:tasks.workunit.client.1.smithi086.stdout:5/223: creat d0/df/f3f x:0 0 0 2024-08-19T00:56:00.132 INFO:tasks.workunit.client.1.smithi086.stdout:7/282: dread d3/de/d49/d4b/f23 [0,4194304] 0 2024-08-19T00:56:00.134 INFO:tasks.workunit.client.1.smithi086.stdout:6/285: creat db/d37/d44/d5a/f5c x:0 0 0 2024-08-19T00:56:00.135 INFO:tasks.workunit.client.1.smithi086.stdout:0/287: dread da/d14/d26/f33 [0,4194304] 0 2024-08-19T00:56:00.139 INFO:tasks.workunit.client.1.smithi086.stdout:7/283: fdatasync d3/f38 0 2024-08-19T00:56:00.139 INFO:tasks.workunit.client.1.smithi086.stdout:9/240: symlink db/d23/d30/d31/l4c 0 2024-08-19T00:56:00.142 INFO:tasks.workunit.client.1.smithi086.stdout:2/232: getdents d8 0 2024-08-19T00:56:00.142 INFO:tasks.workunit.client.1.smithi086.stdout:9/241: write db/d26/f29 [267001,62651] 0 2024-08-19T00:56:00.144 INFO:tasks.workunit.client.1.smithi086.stdout:2/233: chown d8/d24/d32/f41 29 1 2024-08-19T00:56:00.145 INFO:tasks.workunit.client.1.smithi086.stdout:7/284: creat d3/de/d49/f55 x:0 0 0 2024-08-19T00:56:00.145 INFO:tasks.workunit.client.1.smithi086.stdout:3/261: getdents d3/d26/d2b/d33/d4a 0 2024-08-19T00:56:00.146 INFO:tasks.workunit.client.1.smithi086.stdout:8/257: getdents dc/d16/d18/d29/d2e/d28/d2b/d3b 0 2024-08-19T00:56:00.150 INFO:tasks.workunit.client.1.smithi086.stdout:4/207: sync 2024-08-19T00:56:00.151 INFO:tasks.workunit.client.1.smithi086.stdout:6/286: truncate db/f11 2963725 0 2024-08-19T00:56:00.152 INFO:tasks.workunit.client.1.smithi086.stdout:0/288: creat da/f60 x:0 0 0 2024-08-19T00:56:00.154 INFO:tasks.workunit.client.1.smithi086.stdout:4/208: mkdir d2/d1c/d1d/d4d 0 2024-08-19T00:56:00.155 INFO:tasks.workunit.client.1.smithi086.stdout:2/234: dwrite d8/ff [0,4194304] 0 2024-08-19T00:56:00.157 INFO:tasks.workunit.client.1.smithi086.stdout:6/287: chown db/d37/d41/f47 743644 1 2024-08-19T00:56:00.157 INFO:tasks.workunit.client.1.smithi086.stdout:3/262: link d3/d18/d1a/l1b d3/d9/l5f 0 2024-08-19T00:56:00.158 INFO:tasks.workunit.client.1.smithi086.stdout:8/258: rmdir dc/d1f/d37/d48 0 2024-08-19T00:56:00.160 INFO:tasks.workunit.client.1.smithi086.stdout:4/209: write d2/d1c/d25/f3a [949822,3184] 0 2024-08-19T00:56:00.160 INFO:tasks.workunit.client.1.smithi086.stdout:9/242: dwrite db/d26/f29 [0,4194304] 0 2024-08-19T00:56:00.163 INFO:tasks.workunit.client.1.smithi086.stdout:2/235: mkdir d8/d24/d32/d4d 0 2024-08-19T00:56:00.164 INFO:tasks.workunit.client.1.smithi086.stdout:0/289: mkdir da/d14/d1a/d2e/d43/d61 0 2024-08-19T00:56:00.165 INFO:tasks.workunit.client.1.smithi086.stdout:6/288: write db/d37/f27 [591227,40537] 0 2024-08-19T00:56:00.170 INFO:tasks.workunit.client.1.smithi086.stdout:6/289: stat db/d37/d28 0 2024-08-19T00:56:00.170 INFO:tasks.workunit.client.1.smithi086.stdout:7/285: dread d3/de/d2d/f31 [0,4194304] 0 2024-08-19T00:56:00.175 INFO:tasks.workunit.client.1.smithi086.stdout:5/224: dwrite d0/fa [0,4194304] 0 2024-08-19T00:56:00.175 INFO:tasks.workunit.client.1.smithi086.stdout:9/243: mkdir db/d23/d30/d3f/d43/d4d 0 2024-08-19T00:56:00.177 INFO:tasks.workunit.client.1.smithi086.stdout:6/290: mknod db/d34/d39/c5d 0 2024-08-19T00:56:00.177 INFO:tasks.workunit.client.1.smithi086.stdout:7/286: write d3/de/f2b [1694809,80129] 0 2024-08-19T00:56:00.180 INFO:tasks.workunit.client.1.smithi086.stdout:6/291: write db/d37/f27 [537517,79016] 0 2024-08-19T00:56:00.184 INFO:tasks.workunit.client.1.smithi086.stdout:3/263: dwrite d3/d18/f22 [0,4194304] 0 2024-08-19T00:56:00.185 INFO:tasks.workunit.client.1.smithi086.stdout:5/225: rename d0/d8/f2c to d0/df/d1f/d33/f40 0 2024-08-19T00:56:00.186 INFO:tasks.workunit.client.1.smithi086.stdout:0/290: truncate da/f10 2409183 0 2024-08-19T00:56:00.186 INFO:tasks.workunit.client.1.smithi086.stdout:2/236: link d8/d24/c27 d8/d43/c4e 0 2024-08-19T00:56:00.188 INFO:tasks.workunit.client.1.smithi086.stdout:6/292: unlink db/d37/d41/f47 0 2024-08-19T00:56:00.188 INFO:tasks.workunit.client.1.smithi086.stdout:0/291: stat da/d14/d1a/d2e/l4a 0 2024-08-19T00:56:00.189 INFO:tasks.workunit.client.1.smithi086.stdout:2/237: write d8/d2c/d38/f42 [1190696,38023] 0 2024-08-19T00:56:00.189 INFO:tasks.workunit.client.1.smithi086.stdout:5/226: write d0/f1e [4081292,115067] 0 2024-08-19T00:56:00.189 INFO:tasks.workunit.client.1.smithi086.stdout:9/244: mkdir db/d23/d30/d3f/d43/d4e 0 2024-08-19T00:56:00.190 INFO:tasks.workunit.client.1.smithi086.stdout:8/259: dwrite dc/f23 [0,4194304] 0 2024-08-19T00:56:00.193 INFO:tasks.workunit.client.1.smithi086.stdout:3/264: write d3/d18/d27/d49/f35 [149672,61927] 0 2024-08-19T00:56:00.195 INFO:tasks.workunit.client.1.smithi086.stdout:4/210: truncate d2/d18/f28 3201769 0 2024-08-19T00:56:00.196 INFO:tasks.workunit.client.1.smithi086.stdout:4/211: chown d2/d1c/d2c/f43 88 1 2024-08-19T00:56:00.197 INFO:tasks.workunit.client.1.smithi086.stdout:4/212: write d2/f23 [5736653,24403] 0 2024-08-19T00:56:00.198 INFO:tasks.workunit.client.1.smithi086.stdout:5/227: symlink d0/d20/l41 0 2024-08-19T00:56:00.198 INFO:tasks.workunit.client.1.smithi086.stdout:2/238: fsync d8/f1e 0 2024-08-19T00:56:00.199 INFO:tasks.workunit.client.1.smithi086.stdout:6/293: write f3 [947382,91663] 0 2024-08-19T00:56:00.199 INFO:tasks.workunit.client.1.smithi086.stdout:7/287: creat d3/d34/d44/d3e/f56 x:0 0 0 2024-08-19T00:56:00.202 INFO:tasks.workunit.client.1.smithi086.stdout:9/245: mknod db/d23/d37/c4f 0 2024-08-19T00:56:00.206 INFO:tasks.workunit.client.1.smithi086.stdout:0/292: rename da/d14/f59 to da/d14/d1a/d2e/f62 0 2024-08-19T00:56:00.210 INFO:tasks.workunit.client.1.smithi086.stdout:5/228: creat d0/d8/d10/f42 x:0 0 0 2024-08-19T00:56:00.212 INFO:tasks.workunit.client.1.smithi086.stdout:7/288: symlink d3/de/d2d/l57 0 2024-08-19T00:56:00.214 INFO:tasks.workunit.client.1.smithi086.stdout:9/246: creat db/d23/d30/d3f/d43/f50 x:0 0 0 2024-08-19T00:56:00.217 INFO:tasks.workunit.client.1.smithi086.stdout:6/294: dwrite db/f46 [0,4194304] 0 2024-08-19T00:56:00.218 INFO:tasks.workunit.client.1.smithi086.stdout:4/213: dwrite d2/f26 [4194304,4194304] 0 2024-08-19T00:56:00.218 INFO:tasks.workunit.client.1.smithi086.stdout:7/289: chown d3/d34/d44/c41 114785063 1 2024-08-19T00:56:00.220 INFO:tasks.workunit.client.1.smithi086.stdout:5/229: truncate d0/d8/d10/f19 538326 0 2024-08-19T00:56:00.220 INFO:tasks.workunit.client.1.smithi086.stdout:8/260: dwrite dc/d16/f42 [0,4194304] 0 2024-08-19T00:56:00.220 INFO:tasks.workunit.client.1.smithi086.stdout:4/214: fsync d2/f21 0 2024-08-19T00:56:00.227 INFO:tasks.workunit.client.1.smithi086.stdout:9/247: creat db/d23/d30/d3f/d43/f51 x:0 0 0 2024-08-19T00:56:00.230 INFO:tasks.workunit.client.1.smithi086.stdout:4/215: rename d2/l12 to d2/l4e 0 2024-08-19T00:56:00.233 INFO:tasks.workunit.client.1.smithi086.stdout:8/261: rename dc/d16/d18/d29/d2e/d28/c39 to dc/d16/d18/d29/d32/c53 0 2024-08-19T00:56:00.233 INFO:tasks.workunit.client.1.smithi086.stdout:9/248: read db/d23/d37/f48 [2838372,9640] 0 2024-08-19T00:56:00.235 INFO:tasks.workunit.client.1.smithi086.stdout:2/239: dwrite d8/d14/f22 [0,4194304] 0 2024-08-19T00:56:00.237 INFO:tasks.workunit.client.1.smithi086.stdout:5/230: dread d0/d20/f36 [0,4194304] 0 2024-08-19T00:56:00.238 INFO:tasks.workunit.client.1.smithi086.stdout:7/290: dread d3/de/d49/d4b/f3d [0,4194304] 0 2024-08-19T00:56:00.238 INFO:tasks.workunit.client.1.smithi086.stdout:2/240: creat d8/d24/d32/f4f x:0 0 0 2024-08-19T00:56:00.239 INFO:tasks.workunit.client.1.smithi086.stdout:8/262: symlink dc/l54 0 2024-08-19T00:56:00.240 INFO:tasks.workunit.client.1.smithi086.stdout:8/263: readlink dc/d16/d18/d29/d32/l3e 0 2024-08-19T00:56:00.241 INFO:tasks.workunit.client.1.smithi086.stdout:4/216: getdents d2/da 0 2024-08-19T00:56:00.242 INFO:tasks.workunit.client.1.smithi086.stdout:5/231: getdents d0/d8 0 2024-08-19T00:56:00.243 INFO:tasks.workunit.client.1.smithi086.stdout:8/264: mkdir dc/d17/d1e/d55 0 2024-08-19T00:56:00.243 INFO:tasks.workunit.client.1.smithi086.stdout:4/217: symlink d2/d18/d33/d42/l4f 0 2024-08-19T00:56:00.245 INFO:tasks.workunit.client.1.smithi086.stdout:7/291: rename d3/de/d49 to d3/d34/d44/d58 0 2024-08-19T00:56:00.245 INFO:tasks.workunit.client.1.smithi086.stdout:5/232: mkdir d0/d2d/d43 0 2024-08-19T00:56:00.246 INFO:tasks.workunit.client.1.smithi086.stdout:8/265: fsync dc/d16/d18/d29/d2e/f3f 0 2024-08-19T00:56:00.247 INFO:tasks.workunit.client.1.smithi086.stdout:5/233: symlink d0/d2d/l44 0 2024-08-19T00:56:00.248 INFO:tasks.workunit.client.1.smithi086.stdout:7/292: creat d3/de/f59 x:0 0 0 2024-08-19T00:56:00.249 INFO:tasks.workunit.client.1.smithi086.stdout:7/293: chown d3/de/d2d 0 1 2024-08-19T00:56:00.251 INFO:tasks.workunit.client.1.smithi086.stdout:7/294: creat d3/de/d4f/f5a x:0 0 0 2024-08-19T00:56:00.258 INFO:tasks.workunit.client.1.smithi086.stdout:7/295: dwrite d3/de/d2d/f31 [0,4194304] 0 2024-08-19T00:56:00.260 INFO:tasks.workunit.client.1.smithi086.stdout:8/266: dread f7 [0,4194304] 0 2024-08-19T00:56:00.260 INFO:tasks.workunit.client.1.smithi086.stdout:7/296: mkdir d3/d5b 0 2024-08-19T00:56:00.262 INFO:tasks.workunit.client.1.smithi086.stdout:8/267: truncate f7 7146120 0 2024-08-19T00:56:00.263 INFO:tasks.workunit.client.1.smithi086.stdout:7/297: fdatasync d3/d34/d44/d58/d4b/f23 0 2024-08-19T00:56:00.263 INFO:tasks.workunit.client.1.smithi086.stdout:7/298: fdatasync d3/d34/d44/d58/d4b/f23 0 2024-08-19T00:56:00.264 INFO:tasks.workunit.client.1.smithi086.stdout:7/299: write d3/f3a [491989,105751] 0 2024-08-19T00:56:00.265 INFO:tasks.workunit.client.1.smithi086.stdout:7/300: dread - d3/d34/d44/f48 zero size 2024-08-19T00:56:00.266 INFO:tasks.workunit.client.1.smithi086.stdout:8/268: truncate dc/d16/f2d 164936 0 2024-08-19T00:56:00.267 INFO:tasks.workunit.client.1.smithi086.stdout:7/301: rmdir d3/d34/d44/d58/d4b/d42 39 2024-08-19T00:56:00.269 INFO:tasks.workunit.client.1.smithi086.stdout:8/269: symlink dc/d16/l56 0 2024-08-19T00:56:00.270 INFO:tasks.workunit.client.1.smithi086.stdout:7/302: creat d3/d34/d44/d3e/f5c x:0 0 0 2024-08-19T00:56:00.270 INFO:tasks.workunit.client.1.smithi086.stdout:8/270: readlink dc/d16/d18/d29/d32/l3e 0 2024-08-19T00:56:00.273 INFO:tasks.workunit.client.1.smithi086.stdout:8/271: creat dc/f57 x:0 0 0 2024-08-19T00:56:00.276 INFO:tasks.workunit.client.1.smithi086.stdout:7/303: dwrite d3/d34/d44/f37 [0,4194304] 0 2024-08-19T00:56:00.277 INFO:tasks.workunit.client.1.smithi086.stdout:7/304: chown d3/d34/d44/d3e/f5c 217583 1 2024-08-19T00:56:00.283 INFO:tasks.workunit.client.1.smithi086.stdout:7/305: dread d3/de/d2d/f31 [0,4194304] 0 2024-08-19T00:56:00.287 INFO:tasks.workunit.client.1.smithi086.stdout:7/306: link d3/de/f1e d3/d34/d44/d3e/f5d 0 2024-08-19T00:56:00.303 INFO:tasks.workunit.client.1.smithi086.stdout:1/295: sync 2024-08-19T00:56:00.304 INFO:tasks.workunit.client.1.smithi086.stdout:1/296: readlink d4/d1e/l47 0 2024-08-19T00:56:00.307 INFO:tasks.workunit.client.1.smithi086.stdout:1/297: rename d4/d7/d2a/c52 to d4/d7/d2a/d36/d63/c65 0 2024-08-19T00:56:00.317 INFO:tasks.workunit.client.1.smithi086.stdout:1/298: dread d4/d7/f19 [0,4194304] 0 2024-08-19T00:56:00.319 INFO:tasks.workunit.client.1.smithi086.stdout:1/299: write d4/d7/d2a/d36/d3a/f3e [2836218,55436] 0 2024-08-19T00:56:00.320 INFO:tasks.workunit.client.1.smithi086.stdout:1/300: stat d4/d7/f37 0 2024-08-19T00:56:00.324 INFO:tasks.workunit.client.1.smithi086.stdout:1/301: creat d4/d7/d2a/d36/d50/f66 x:0 0 0 2024-08-19T00:56:00.324 INFO:tasks.workunit.client.1.smithi086.stdout:9/249: getdents db/d23/d30/d3f/d43 0 2024-08-19T00:56:00.326 INFO:tasks.workunit.client.1.smithi086.stdout:6/295: truncate db/f2b 650164 0 2024-08-19T00:56:00.328 INFO:tasks.workunit.client.1.smithi086.stdout:1/302: creat d4/d7/d2a/d36/d3a/d41/f67 x:0 0 0 2024-08-19T00:56:00.328 INFO:tasks.workunit.client.1.smithi086.stdout:6/296: dread db/f15 [0,4194304] 0 2024-08-19T00:56:00.330 INFO:tasks.workunit.client.1.smithi086.stdout:1/303: chown d4/d7/d2a/l34 208859 1 2024-08-19T00:56:00.331 INFO:tasks.workunit.client.1.smithi086.stdout:1/304: chown d4/d7/f53 3609477 1 2024-08-19T00:56:00.332 INFO:tasks.workunit.client.1.smithi086.stdout:9/250: dwrite db/f11 [0,4194304] 0 2024-08-19T00:56:00.332 INFO:tasks.workunit.client.1.smithi086.stdout:6/297: unlink db/f2e 0 2024-08-19T00:56:00.334 INFO:tasks.workunit.client.1.smithi086.stdout:9/251: write db/d26/f49 [454708,111991] 0 2024-08-19T00:56:00.335 INFO:tasks.workunit.client.1.smithi086.stdout:6/298: dread f3 [4194304,4194304] 0 2024-08-19T00:56:00.336 INFO:tasks.workunit.client.1.smithi086.stdout:1/305: read d4/d1e/f13 [777638,43038] 0 2024-08-19T00:56:00.337 INFO:tasks.workunit.client.1.smithi086.stdout:4/218: getdents d2/d18/d33/d42 0 2024-08-19T00:56:00.338 INFO:tasks.workunit.client.1.smithi086.stdout:9/252: unlink db/d23/d37/c4f 0 2024-08-19T00:56:00.339 INFO:tasks.workunit.client.1.smithi086.stdout:4/219: fsync d2/d1c/d25/f35 0 2024-08-19T00:56:00.341 INFO:tasks.workunit.client.1.smithi086.stdout:1/306: creat d4/d7/d2a/d36/d3a/d41/f68 x:0 0 0 2024-08-19T00:56:00.342 INFO:tasks.workunit.client.1.smithi086.stdout:5/234: truncate d0/f6 2214846 0 2024-08-19T00:56:00.343 INFO:tasks.workunit.client.1.smithi086.stdout:7/307: getdents d3/de/d4f 0 2024-08-19T00:56:00.346 INFO:tasks.workunit.client.1.smithi086.stdout:1/307: symlink d4/d7/d2a/d36/d50/l69 0 2024-08-19T00:56:00.351 INFO:tasks.workunit.client.1.smithi086.stdout:9/253: rename db/dd/d19/d18/f36 to db/f52 0 2024-08-19T00:56:00.351 INFO:tasks.workunit.client.1.smithi086.stdout:8/272: truncate dc/f14 14536 0 2024-08-19T00:56:00.353 INFO:tasks.workunit.client.1.smithi086.stdout:5/235: creat d0/d2d/d43/f45 x:0 0 0 2024-08-19T00:56:00.358 INFO:tasks.workunit.client.1.smithi086.stdout:9/254: dread db/d23/d37/f4a [0,4194304] 0 2024-08-19T00:56:00.362 INFO:tasks.workunit.client.1.smithi086.stdout:1/308: dread d4/d1e/f11 [0,4194304] 0 2024-08-19T00:56:00.364 INFO:tasks.workunit.client.1.smithi086.stdout:9/255: rename db/d3b/f34 to db/dd/d19/d38/f53 0 2024-08-19T00:56:00.367 INFO:tasks.workunit.client.1.smithi086.stdout:9/256: rmdir db/dd/d19/d38 39 2024-08-19T00:56:00.367 INFO:tasks.workunit.client.1.smithi086.stdout:8/273: dread dc/f36 [0,4194304] 0 2024-08-19T00:56:00.369 INFO:tasks.workunit.client.1.smithi086.stdout:1/309: link d4/d7/d2a/d36/d50/f66 d4/d7/d2a/d36/f6a 0 2024-08-19T00:56:00.369 INFO:tasks.workunit.client.1.smithi086.stdout:9/257: write db/d3b/f41 [405767,14761] 0 2024-08-19T00:56:00.372 INFO:tasks.workunit.client.1.smithi086.stdout:1/310: dread - d4/d7/d2a/f4d zero size 2024-08-19T00:56:00.372 INFO:tasks.workunit.client.1.smithi086.stdout:4/220: write d2/d1c/d1d/f38 [2890997,51519] 0 2024-08-19T00:56:00.375 INFO:tasks.workunit.client.1.smithi086.stdout:9/258: chown db/dd/d19/f1f 57021358 1 2024-08-19T00:56:00.375 INFO:tasks.workunit.client.1.smithi086.stdout:6/299: dwrite db/f15 [0,4194304] 0 2024-08-19T00:56:00.376 INFO:tasks.workunit.client.1.smithi086.stdout:9/259: dread - db/f35 zero size 2024-08-19T00:56:00.377 INFO:tasks.workunit.client.1.smithi086.stdout:5/236: dread d0/fa [0,4194304] 0 2024-08-19T00:56:00.378 INFO:tasks.workunit.client.1.smithi086.stdout:7/308: write d3/de/f1e [338998,60749] 0 2024-08-19T00:56:00.380 INFO:tasks.workunit.client.1.smithi086.stdout:6/300: chown db/f16 7 1 2024-08-19T00:56:00.427 INFO:tasks.workunit.client.1.smithi086.stdout:5/237: chown d0/d2d/l44 375667 1 2024-08-19T00:56:00.428 INFO:tasks.workunit.client.1.smithi086.stdout:8/274: dread f7 [0,4194304] 0 2024-08-19T00:56:00.428 INFO:tasks.workunit.client.1.smithi086.stdout:9/260: write db/d23/d37/f4a [2485225,119861] 0 2024-08-19T00:56:00.428 INFO:tasks.workunit.client.1.smithi086.stdout:1/311: getdents d4 0 2024-08-19T00:56:00.429 INFO:tasks.workunit.client.1.smithi086.stdout:6/301: chown db/d37/d44/f4f 410 1 2024-08-19T00:56:00.431 INFO:tasks.workunit.client.1.smithi086.stdout:8/275: write dc/d16/d18/d29/d2e/d28/d41/f52 [1021421,128818] 0 2024-08-19T00:56:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: Adjusting osd_memory_target on smithi017 to 1217M 2024-08-19T00:56:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:56:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:56:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: Updating smithi017:/etc/ceph/ceph.conf 2024-08-19T00:56:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: Updating smithi086:/etc/ceph/ceph.conf 2024-08-19T00:56:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:00 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:56:00.434 INFO:tasks.workunit.client.1.smithi086.stdout:9/261: creat db/d23/f54 x:0 0 0 2024-08-19T00:56:00.435 INFO:tasks.workunit.client.1.smithi086.stdout:1/312: creat d4/d7/d2a/f6b x:0 0 0 2024-08-19T00:56:00.439 INFO:tasks.workunit.client.1.smithi086.stdout:8/276: creat dc/d16/d18/d29/d2e/d28/d2b/d3b/f58 x:0 0 0 2024-08-19T00:56:00.442 INFO:tasks.workunit.client.1.smithi086.stdout:1/313: mknod d4/d7/d2a/d36/d3a/d41/c6c 0 2024-08-19T00:56:00.442 INFO:tasks.workunit.client.1.smithi086.stdout:7/309: dread d3/de/f12 [0,4194304] 0 2024-08-19T00:56:00.444 INFO:tasks.workunit.client.1.smithi086.stdout:7/310: write d3/d34/f52 [630195,53901] 0 2024-08-19T00:56:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-19T00:56:00.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: Adjusting osd_memory_target on smithi017 to 1217M 2024-08-19T00:56:00.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:00.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:56:00.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:56:00.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: Updating smithi017:/etc/ceph/ceph.conf 2024-08-19T00:56:00.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: Updating smithi086:/etc/ceph/ceph.conf 2024-08-19T00:56:00.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:00 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:56:00.448 INFO:tasks.workunit.client.1.smithi086.stdout:9/262: symlink db/dd/d19/l55 0 2024-08-19T00:56:00.448 INFO:tasks.workunit.client.1.smithi086.stdout:8/277: dwrite dc/d16/d18/d29/d2e/d28/d2b/d3b/f58 [0,4194304] 0 2024-08-19T00:56:00.448 INFO:tasks.workunit.client.1.smithi086.stdout:6/302: link db/d37/c35 db/d37/d30/c5e 0 2024-08-19T00:56:00.454 INFO:tasks.workunit.client.1.smithi086.stdout:5/238: getdents d0/df/d1f/d33 0 2024-08-19T00:56:00.455 INFO:tasks.workunit.client.1.smithi086.stdout:5/239: chown d0/df/f23 33220 1 2024-08-19T00:56:00.455 INFO:tasks.workunit.client.1.smithi086.stdout:8/278: rename dc/d16/f42 to dc/d16/d18/d29/d2e/d28/d41/f59 0 2024-08-19T00:56:00.458 INFO:tasks.workunit.client.1.smithi086.stdout:7/311: dwrite d3/d34/d44/f48 [0,4194304] 0 2024-08-19T00:56:00.461 INFO:tasks.workunit.client.1.smithi086.stdout:6/303: link db/d37/d44/d5a/f5c db/d37/d44/d5a/f5f 0 2024-08-19T00:56:00.463 INFO:tasks.workunit.client.1.smithi086.stdout:9/263: rename db/d23/d30/d3f/d43/f51 to db/d23/d30/d32/d44/f56 0 2024-08-19T00:56:00.465 INFO:tasks.workunit.client.1.smithi086.stdout:5/240: truncate d0/fb 2830423 0 2024-08-19T00:56:00.469 INFO:tasks.workunit.client.1.smithi086.stdout:6/304: fdatasync db/f13 0 2024-08-19T00:56:00.474 INFO:tasks.workunit.client.1.smithi086.stdout:6/305: dread db/f46 [0,4194304] 0 2024-08-19T00:56:00.474 INFO:tasks.workunit.client.1.smithi086.stdout:5/241: rename d0/d8/d10/c15 to d0/d8/c46 0 2024-08-19T00:56:00.475 INFO:tasks.workunit.client.1.smithi086.stdout:6/306: truncate db/d34/d39/f51 1022106 0 2024-08-19T00:56:00.479 INFO:tasks.workunit.client.1.smithi086.stdout:6/307: dwrite db/f15 [0,4194304] 0 2024-08-19T00:56:00.487 INFO:tasks.workunit.client.1.smithi086.stdout:8/279: link dc/d16/d18/c47 dc/d16/d18/d29/d2e/c5a 0 2024-08-19T00:56:00.491 INFO:tasks.workunit.client.1.smithi086.stdout:9/264: creat db/f57 x:0 0 0 2024-08-19T00:56:00.492 INFO:tasks.workunit.client.1.smithi086.stdout:8/280: symlink dc/d17/l5b 0 2024-08-19T00:56:00.493 INFO:tasks.workunit.client.1.smithi086.stdout:8/281: stat dc/f12 0 2024-08-19T00:56:00.494 INFO:tasks.workunit.client.1.smithi086.stdout:9/265: mkdir db/d23/d30/d58 0 2024-08-19T00:56:00.494 INFO:tasks.workunit.client.1.smithi086.stdout:6/308: dread db/f14 [0,4194304] 0 2024-08-19T00:56:00.495 INFO:tasks.workunit.client.1.smithi086.stdout:9/266: write db/f16 [716075,124441] 0 2024-08-19T00:56:00.495 INFO:tasks.workunit.client.1.smithi086.stdout:8/282: mknod dc/d1f/d37/c5c 0 2024-08-19T00:56:00.496 INFO:tasks.workunit.client.1.smithi086.stdout:6/309: read db/d34/d4e/d55/f32 [1793231,76753] 0 2024-08-19T00:56:00.497 INFO:tasks.workunit.client.1.smithi086.stdout:9/267: write db/d3b/f41 [1419355,53730] 0 2024-08-19T00:56:00.502 INFO:tasks.workunit.client.1.smithi086.stdout:6/310: mknod db/d37/d44/c60 0 2024-08-19T00:56:00.502 INFO:tasks.workunit.client.1.smithi086.stdout:6/311: chown db/d34/d39/c54 19663 1 2024-08-19T00:56:00.503 INFO:tasks.workunit.client.1.smithi086.stdout:9/268: mknod db/d23/d37/c59 0 2024-08-19T00:56:00.506 INFO:tasks.workunit.client.1.smithi086.stdout:8/283: unlink dc/f33 0 2024-08-19T00:56:00.508 INFO:tasks.workunit.client.1.smithi086.stdout:9/269: rename db/dd/d19/d18/c1d to db/d23/c5a 0 2024-08-19T00:56:00.515 INFO:tasks.workunit.client.1.smithi086.stdout:9/270: creat db/d23/d30/d58/f5b x:0 0 0 2024-08-19T00:56:00.520 INFO:tasks.workunit.client.1.smithi086.stdout:9/271: rename db/d23/d30/d3f/d43/d4d to db/d26/d5c 0 2024-08-19T00:56:00.521 INFO:tasks.workunit.client.1.smithi086.stdout:9/272: read db/d3b/f41 [565117,17232] 0 2024-08-19T00:56:00.525 INFO:tasks.workunit.client.1.smithi086.stdout:9/273: dread fa [0,4194304] 0 2024-08-19T00:56:00.526 INFO:tasks.workunit.client.1.smithi086.stdout:9/274: write db/d23/f54 [286063,72452] 0 2024-08-19T00:56:00.531 INFO:tasks.workunit.client.1.smithi086.stdout:9/275: mkdir db/d23/d30/d3f/d43/d4e/d5d 0 2024-08-19T00:56:00.531 INFO:tasks.workunit.client.1.smithi086.stdout:9/276: fdatasync db/f15 0 2024-08-19T00:56:00.591 INFO:tasks.workunit.client.1.smithi086.stdout:3/265: sync 2024-08-19T00:56:00.591 INFO:tasks.workunit.client.1.smithi086.stdout:0/293: sync 2024-08-19T00:56:00.591 INFO:tasks.workunit.client.1.smithi086.stdout:2/241: sync 2024-08-19T00:56:00.591 INFO:tasks.workunit.client.1.smithi086.stdout:1/314: rmdir d4/d7/d2a/d36/d3a/d41 39 2024-08-19T00:56:00.593 INFO:tasks.workunit.client.1.smithi086.stdout:1/315: chown d4/c15 1465725 1 2024-08-19T00:56:00.593 INFO:tasks.workunit.client.1.smithi086.stdout:3/266: read d3/ff [1980143,9599] 0 2024-08-19T00:56:00.594 INFO:tasks.workunit.client.1.smithi086.stdout:7/312: write d3/fb [1295237,29359] 0 2024-08-19T00:56:00.594 INFO:tasks.workunit.client.1.smithi086.stdout:2/242: write d8/d24/d32/f4f [413035,91927] 0 2024-08-19T00:56:00.594 INFO:tasks.workunit.client.1.smithi086.stdout:8/284: getdents dc/d16/d18/d29/d2e 0 2024-08-19T00:56:00.597 INFO:tasks.workunit.client.1.smithi086.stdout:3/267: read d3/f5 [1945375,29565] 0 2024-08-19T00:56:00.597 INFO:tasks.workunit.client.1.smithi086.stdout:9/277: mkdir db/d5e 0 2024-08-19T00:56:00.599 INFO:tasks.workunit.client.1.smithi086.stdout:9/278: readlink db/d23/d30/d31/l4c 0 2024-08-19T00:56:00.601 INFO:tasks.workunit.client.1.smithi086.stdout:0/294: dwrite da/d14/d1a/d2e/d39/f45 [0,4194304] 0 2024-08-19T00:56:00.602 INFO:tasks.workunit.client.1.smithi086.stdout:0/295: fdatasync da/d14/f41 0 2024-08-19T00:56:00.604 INFO:tasks.workunit.client.1.smithi086.stdout:1/316: mknod d4/d1e/d35/c6d 0 2024-08-19T00:56:00.606 INFO:tasks.workunit.client.1.smithi086.stdout:2/243: chown d8/d43/c4e 32195 1 2024-08-19T00:56:00.611 INFO:tasks.workunit.client.1.smithi086.stdout:8/285: dread dc/d16/d18/d29/d32/f3d [0,4194304] 0 2024-08-19T00:56:00.614 INFO:tasks.workunit.client.1.smithi086.stdout:8/286: truncate dc/d16/d18/d29/d2e/f3f 801148 0 2024-08-19T00:56:00.619 INFO:tasks.workunit.client.1.smithi086.stdout:5/242: creat d0/d8/d10/f47 x:0 0 0 2024-08-19T00:56:00.620 INFO:tasks.workunit.client.1.smithi086.stdout:9/279: dread f6 [0,4194304] 0 2024-08-19T00:56:00.622 INFO:tasks.workunit.client.1.smithi086.stdout:8/287: dwrite dc/d16/d18/d29/d2e/f3f [0,4194304] 0 2024-08-19T00:56:00.624 INFO:tasks.workunit.client.1.smithi086.stdout:8/288: readlink dc/d16/d18/d29/d32/l3e 0 2024-08-19T00:56:00.624 INFO:tasks.workunit.client.1.smithi086.stdout:0/296: creat da/d14/d44/d49/f63 x:0 0 0 2024-08-19T00:56:00.625 INFO:tasks.workunit.client.1.smithi086.stdout:2/244: dread d8/d14/f30 [0,4194304] 0 2024-08-19T00:56:00.627 INFO:tasks.workunit.client.1.smithi086.stdout:1/317: mkdir d4/d7/d2a/d6e 0 2024-08-19T00:56:00.628 INFO:tasks.workunit.client.1.smithi086.stdout:1/318: write d4/d10/f51 [221526,23205] 0 2024-08-19T00:56:00.631 INFO:tasks.workunit.client.1.smithi086.stdout:7/313: mknod d3/d5b/c5e 0 2024-08-19T00:56:00.638 INFO:tasks.workunit.client.1.smithi086.stdout:5/243: rename d0/d8/d10/f47 to d0/d2d/d43/f48 0 2024-08-19T00:56:00.639 INFO:tasks.workunit.client.1.smithi086.stdout:9/280: creat db/d23/d30/d3f/d43/f5f x:0 0 0 2024-08-19T00:56:00.640 INFO:tasks.workunit.client.1.smithi086.stdout:9/281: fdatasync db/dd/f14 0 2024-08-19T00:56:00.651 INFO:tasks.workunit.client.1.smithi086.stdout:5/244: creat d0/df/d1f/d33/f49 x:0 0 0 2024-08-19T00:56:00.651 INFO:tasks.workunit.client.1.smithi086.stdout:5/245: dread - d0/d2d/d43/f45 zero size 2024-08-19T00:56:00.655 INFO:tasks.workunit.client.1.smithi086.stdout:2/245: symlink d8/d2c/d47/l50 0 2024-08-19T00:56:00.657 INFO:tasks.workunit.client.1.smithi086.stdout:9/282: symlink db/dd/d19/d18/l60 0 2024-08-19T00:56:00.661 INFO:tasks.workunit.client.1.smithi086.stdout:5/246: symlink d0/df/d1f/d33/l4a 0 2024-08-19T00:56:00.662 INFO:tasks.workunit.client.1.smithi086.stdout:2/246: creat d8/d2c/d47/f51 x:0 0 0 2024-08-19T00:56:00.666 INFO:tasks.workunit.client.1.smithi086.stdout:5/247: rename d0/df/f18 to d0/df/d1f/d33/f4b 0 2024-08-19T00:56:00.668 INFO:tasks.workunit.client.1.smithi086.stdout:2/247: rmdir d8/d43 39 2024-08-19T00:56:00.672 INFO:tasks.workunit.client.1.smithi086.stdout:5/248: mknod d0/df/c4c 0 2024-08-19T00:56:00.675 INFO:tasks.workunit.client.1.smithi086.stdout:9/283: creat db/f61 x:0 0 0 2024-08-19T00:56:00.676 INFO:tasks.workunit.client.1.smithi086.stdout:5/249: mkdir d0/d2d/d43/d4d 0 2024-08-19T00:56:00.678 INFO:tasks.workunit.client.1.smithi086.stdout:9/284: creat db/dd/f62 x:0 0 0 2024-08-19T00:56:00.679 INFO:tasks.workunit.client.1.smithi086.stdout:9/285: chown db/d26/d5c 8870984 1 2024-08-19T00:56:00.680 INFO:tasks.workunit.client.1.smithi086.stdout:5/250: readlink d0/d8/d10/l3e 0 2024-08-19T00:56:00.680 INFO:tasks.workunit.client.1.smithi086.stdout:9/286: dread db/dd/d19/f1f [0,4194304] 0 2024-08-19T00:56:00.681 INFO:tasks.workunit.client.1.smithi086.stdout:2/248: symlink d8/d43/l52 0 2024-08-19T00:56:00.685 INFO:tasks.workunit.client.1.smithi086.stdout:9/287: symlink db/d3b/l63 0 2024-08-19T00:56:00.686 INFO:tasks.workunit.client.1.smithi086.stdout:9/288: read db/d26/f49 [455475,14953] 0 2024-08-19T00:56:00.691 INFO:tasks.workunit.client.1.smithi086.stdout:5/251: rename d0/d8/f26 to d0/d2d/f4e 0 2024-08-19T00:56:00.695 INFO:tasks.workunit.client.1.smithi086.stdout:2/249: creat d8/d2c/d38/f53 x:0 0 0 2024-08-19T00:56:00.695 INFO:tasks.workunit.client.1.smithi086.stdout:3/268: write d3/d26/d2b/d33/f41 [8534,108323] 0 2024-08-19T00:56:00.695 INFO:tasks.workunit.client.1.smithi086.stdout:3/269: fdatasync d3/d9/f15 0 2024-08-19T00:56:00.696 INFO:tasks.workunit.client.1.smithi086.stdout:9/289: symlink db/d23/d30/d3f/d43/l64 0 2024-08-19T00:56:00.699 INFO:tasks.workunit.client.1.smithi086.stdout:9/290: truncate db/d23/d30/d3f/d43/f50 951614 0 2024-08-19T00:56:00.700 INFO:tasks.workunit.client.1.smithi086.stdout:5/252: mkdir d0/d2d/d4f 0 2024-08-19T00:56:00.701 INFO:tasks.workunit.client.1.smithi086.stdout:3/270: dwrite d3/d9/f4c [0,4194304] 0 2024-08-19T00:56:00.703 INFO:tasks.workunit.client.1.smithi086.stdout:3/271: dread - d3/d26/d2b/f3b zero size 2024-08-19T00:56:00.705 INFO:tasks.workunit.client.1.smithi086.stdout:2/250: truncate d8/f12 2141937 0 2024-08-19T00:56:00.706 INFO:tasks.workunit.client.1.smithi086.stdout:3/272: write d3/d18/d19/d37/f4e [245643,14111] 0 2024-08-19T00:56:00.706 INFO:tasks.workunit.client.1.smithi086.stdout:7/314: getdents d3/d5b 0 2024-08-19T00:56:00.709 INFO:tasks.workunit.client.1.smithi086.stdout:9/291: dwrite db/f39 [0,4194304] 0 2024-08-19T00:56:00.710 INFO:tasks.workunit.client.1.smithi086.stdout:7/315: truncate d3/de/d2d/f35 1567000 0 2024-08-19T00:56:00.712 INFO:tasks.workunit.client.1.smithi086.stdout:5/253: mknod d0/d2d/d43/d4d/c50 0 2024-08-19T00:56:00.713 INFO:tasks.workunit.client.1.smithi086.stdout:3/273: mkdir d3/d26/d60 0 2024-08-19T00:56:00.715 INFO:tasks.workunit.client.1.smithi086.stdout:7/316: dread d3/d34/d44/f37 [0,4194304] 0 2024-08-19T00:56:00.717 INFO:tasks.workunit.client.1.smithi086.stdout:9/292: creat db/d23/d30/d32/d44/f65 x:0 0 0 2024-08-19T00:56:00.723 INFO:tasks.workunit.client.1.smithi086.stdout:9/293: dwrite db/f11 [0,4194304] 0 2024-08-19T00:56:00.724 INFO:tasks.workunit.client.1.smithi086.stdout:2/251: link d8/d43/f48 d8/d24/f54 0 2024-08-19T00:56:00.725 INFO:tasks.workunit.client.1.smithi086.stdout:0/297: truncate da/d14/d1a/d2e/d39/f45 2617602 0 2024-08-19T00:56:00.726 INFO:tasks.workunit.client.1.smithi086.stdout:7/317: symlink d3/de/d4f/l5f 0 2024-08-19T00:56:00.726 INFO:tasks.workunit.client.1.smithi086.stdout:0/298: rename da to da/d14/d1a/d2e/d39/d64 22 2024-08-19T00:56:00.727 INFO:tasks.workunit.client.1.smithi086.stdout:7/318: rename d3/d34 to d3/d34/d44/d3e/d60 22 2024-08-19T00:56:00.728 INFO:tasks.workunit.client.1.smithi086.stdout:5/254: truncate d0/df/d1f/f27 2117772 0 2024-08-19T00:56:00.730 INFO:tasks.workunit.client.1.smithi086.stdout:9/294: mknod db/d23/d30/d32/d44/c66 0 2024-08-19T00:56:00.732 INFO:tasks.workunit.client.1.smithi086.stdout:9/295: read db/dd/f14 [1932072,2360] 0 2024-08-19T00:56:00.737 INFO:tasks.workunit.client.1.smithi086.stdout:2/252: creat d8/d14/f55 x:0 0 0 2024-08-19T00:56:00.739 INFO:tasks.workunit.client.1.smithi086.stdout:9/296: mkdir db/d23/d30/d32/d44/d67 0 2024-08-19T00:56:00.740 INFO:tasks.workunit.client.1.smithi086.stdout:0/299: mkdir da/d14/d26/d65 0 2024-08-19T00:56:00.744 INFO:tasks.workunit.client.1.smithi086.stdout:2/253: rename d8/d2c/d47/l50 to d8/d14/l56 0 2024-08-19T00:56:00.751 INFO:tasks.workunit.client.1.smithi086.stdout:4/221: sync 2024-08-19T00:56:00.752 INFO:tasks.workunit.client.1.smithi086.stdout:2/254: unlink d8/d14/f15 0 2024-08-19T00:56:00.757 INFO:tasks.workunit.client.1.smithi086.stdout:7/319: link d3/ff d3/d34/d44/d58/d4b/f61 0 2024-08-19T00:56:00.762 INFO:tasks.workunit.client.1.smithi086.stdout:4/222: dwrite d2/f26 [4194304,4194304] 0 2024-08-19T00:56:00.764 INFO:tasks.workunit.client.1.smithi086.stdout:2/255: symlink d8/l57 0 2024-08-19T00:56:00.764 INFO:tasks.workunit.client.1.smithi086.stdout:4/223: truncate d2/d1c/d1d/f38 4030188 0 2024-08-19T00:56:00.770 INFO:tasks.workunit.client.1.smithi086.stdout:2/256: creat d8/d2c/d47/f58 x:0 0 0 2024-08-19T00:56:00.771 INFO:tasks.workunit.client.1.smithi086.stdout:4/224: mknod d2/d18/c50 0 2024-08-19T00:56:00.772 INFO:tasks.workunit.client.1.smithi086.stdout:2/257: read d8/d14/f25 [2479671,130044] 0 2024-08-19T00:56:00.773 INFO:tasks.workunit.client.1.smithi086.stdout:4/225: truncate d2/d1c/d1d/f4a 182712 0 2024-08-19T00:56:00.774 INFO:tasks.workunit.client.1.smithi086.stdout:4/226: fsync d2/d1c/d1d/f40 0 2024-08-19T00:56:00.775 INFO:tasks.workunit.client.1.smithi086.stdout:7/320: getdents d3/d34/d44/d58 0 2024-08-19T00:56:00.779 INFO:tasks.workunit.client.1.smithi086.stdout:7/321: dread d3/de/f12 [0,4194304] 0 2024-08-19T00:56:00.780 INFO:tasks.workunit.client.1.smithi086.stdout:4/227: mknod d2/d1c/d2c/c51 0 2024-08-19T00:56:00.780 INFO:tasks.workunit.client.1.smithi086.stdout:4/228: chown d2/da 1 1 2024-08-19T00:56:00.781 INFO:tasks.workunit.client.1.smithi086.stdout:4/229: stat d2/d1c/d2c/c51 0 2024-08-19T00:56:00.786 INFO:tasks.workunit.client.1.smithi086.stdout:4/230: mknod d2/c52 0 2024-08-19T00:56:00.786 INFO:tasks.workunit.client.1.smithi086.stdout:4/231: chown d2/da/f34 1267758 1 2024-08-19T00:56:00.787 INFO:tasks.workunit.client.1.smithi086.stdout:4/232: chown d2/d18/c1e 25 1 2024-08-19T00:56:00.787 INFO:tasks.workunit.client.1.smithi086.stdout:3/274: write d3/f14 [2135951,59796] 0 2024-08-19T00:56:00.789 INFO:tasks.workunit.client.1.smithi086.stdout:7/322: creat d3/d34/d44/d58/d4b/d42/f62 x:0 0 0 2024-08-19T00:56:00.790 INFO:tasks.workunit.client.1.smithi086.stdout:7/323: chown d3/c22 384 1 2024-08-19T00:56:00.791 INFO:tasks.workunit.client.1.smithi086.stdout:7/324: chown d3/d34/l3c 7853067 1 2024-08-19T00:56:00.792 INFO:tasks.workunit.client.1.smithi086.stdout:7/325: stat d3/de/f1e 0 2024-08-19T00:56:00.792 INFO:tasks.workunit.client.1.smithi086.stdout:4/233: dwrite d2/f46 [0,4194304] 0 2024-08-19T00:56:00.804 INFO:tasks.workunit.client.1.smithi086.stdout:3/275: rename d3/d18/d27/d48/d4d to d3/d18/d61 0 2024-08-19T00:56:00.806 INFO:tasks.workunit.client.1.smithi086.stdout:7/326: symlink d3/d34/d44/d58/d4b/l63 0 2024-08-19T00:56:00.813 INFO:tasks.workunit.client.1.smithi086.stdout:3/276: getdents d3/d18/d19/d37/d5a/d5d 0 2024-08-19T00:56:00.814 INFO:tasks.workunit.client.1.smithi086.stdout:7/327: mkdir d3/d34/d44/d58/d4b/d64 0 2024-08-19T00:56:00.814 INFO:tasks.workunit.client.1.smithi086.stdout:3/277: write d3/f6 [341144,59550] 0 2024-08-19T00:56:00.816 INFO:tasks.workunit.client.1.smithi086.stdout:7/328: chown d3/l10 3274 1 2024-08-19T00:56:00.817 INFO:tasks.workunit.client.1.smithi086.stdout:9/297: dwrite fa [0,4194304] 0 2024-08-19T00:56:00.823 INFO:tasks.workunit.client.1.smithi086.stdout:7/329: dwrite d3/d34/f52 [0,4194304] 0 2024-08-19T00:56:00.824 INFO:tasks.workunit.client.1.smithi086.stdout:9/298: chown db/d23/c5a 1213463 1 2024-08-19T00:56:00.826 INFO:tasks.workunit.client.1.smithi086.stdout:7/330: mknod d3/c65 0 2024-08-19T00:56:00.831 INFO:tasks.workunit.client.1.smithi086.stdout:3/278: dread d3/d9/f13 [0,4194304] 0 2024-08-19T00:56:00.836 INFO:tasks.workunit.client.1.smithi086.stdout:3/279: rename d3/d18/d19/d40 to d3/d18/d19/d62 0 2024-08-19T00:56:00.837 INFO:tasks.workunit.client.1.smithi086.stdout:2/258: dwrite d8/f1f [0,4194304] 0 2024-08-19T00:56:00.837 INFO:tasks.workunit.client.1.smithi086.stdout:0/300: write da/d14/d1a/d2e/d39/f45 [921369,73000] 0 2024-08-19T00:56:00.841 INFO:tasks.workunit.client.1.smithi086.stdout:0/301: write da/f46 [2529086,35034] 0 2024-08-19T00:56:00.841 INFO:tasks.workunit.client.1.smithi086.stdout:3/280: rename d3/d9/l25 to d3/d18/d1a/d51/l63 0 2024-08-19T00:56:00.841 INFO:tasks.workunit.client.1.smithi086.stdout:8/289: sync 2024-08-19T00:56:00.842 INFO:tasks.workunit.client.1.smithi086.stdout:6/312: sync 2024-08-19T00:56:00.843 INFO:tasks.workunit.client.1.smithi086.stdout:3/281: fdatasync d3/d18/d1a/d53/f21 0 2024-08-19T00:56:00.843 INFO:tasks.workunit.client.1.smithi086.stdout:6/313: stat db/d37/d30/f3a 0 2024-08-19T00:56:00.845 INFO:tasks.workunit.client.1.smithi086.stdout:4/234: truncate d2/d18/f31 1217103 0 2024-08-19T00:56:00.847 INFO:tasks.workunit.client.1.smithi086.stdout:4/235: chown d2/f21 1 1 2024-08-19T00:56:00.848 INFO:tasks.workunit.client.1.smithi086.stdout:9/299: write f6 [999999,130018] 0 2024-08-19T00:56:00.849 INFO:tasks.workunit.client.1.smithi086.stdout:7/331: truncate d3/d34/d44/d3e/f5d 345091 0 2024-08-19T00:56:00.851 INFO:tasks.workunit.client.1.smithi086.stdout:7/332: stat d3/l33 0 2024-08-19T00:56:00.851 INFO:tasks.workunit.client.1.smithi086.stdout:4/236: chown d2/d18/c1e 93522932 1 2024-08-19T00:56:00.852 INFO:tasks.workunit.client.1.smithi086.stdout:3/282: truncate d3/d18/d1a/d53/f44 669771 0 2024-08-19T00:56:00.853 INFO:tasks.workunit.client.1.smithi086.stdout:0/302: dwrite da/d14/d1a/f52 [0,4194304] 0 2024-08-19T00:56:00.856 INFO:tasks.workunit.client.1.smithi086.stdout:9/300: mkdir db/d26/d5c/d68 0 2024-08-19T00:56:00.857 INFO:tasks.workunit.client.1.smithi086.stdout:8/290: dwrite dc/d16/d18/d29/d2e/d28/d41/f59 [0,4194304] 0 2024-08-19T00:56:00.860 INFO:tasks.workunit.client.1.smithi086.stdout:4/237: symlink d2/d18/l53 0 2024-08-19T00:56:00.862 INFO:tasks.workunit.client.1.smithi086.stdout:7/333: unlink d3/d34/d44/d58/d4b/d42/f62 0 2024-08-19T00:56:00.863 INFO:tasks.workunit.client.1.smithi086.stdout:2/259: truncate d8/d24/f2b 2078349 0 2024-08-19T00:56:00.896 INFO:tasks.workunit.client.1.smithi086.stdout:6/314: truncate db/d37/d30/f3f 685203 0 2024-08-19T00:56:00.896 INFO:tasks.workunit.client.1.smithi086.stdout:4/238: write d2/d1c/d1d/f38 [4282223,67560] 0 2024-08-19T00:56:00.896 INFO:tasks.workunit.client.1.smithi086.stdout:9/301: creat db/d23/d30/d32/d44/f69 x:0 0 0 2024-08-19T00:56:00.898 INFO:tasks.workunit.client.1.smithi086.stdout:3/283: dwrite d3/d18/f22 [0,4194304] 0 2024-08-19T00:56:00.901 INFO:tasks.workunit.client.1.smithi086.stdout:4/239: write d2/da/f34 [3854188,35817] 0 2024-08-19T00:56:00.901 INFO:tasks.workunit.client.1.smithi086.stdout:3/284: stat d3/d18/d27/d49/f32 0 2024-08-19T00:56:00.901 INFO:tasks.workunit.client.1.smithi086.stdout:2/260: rename f0 to d8/d24/f59 0 2024-08-19T00:56:00.902 INFO:tasks.workunit.client.1.smithi086.stdout:9/302: dread - db/d23/d30/d32/d44/f65 zero size 2024-08-19T00:56:00.902 INFO:tasks.workunit.client.1.smithi086.stdout:6/315: mknod db/d37/d28/d57/c61 0 2024-08-19T00:56:00.902 INFO:tasks.workunit.client.1.smithi086.stdout:8/291: dwrite dc/f57 [0,4194304] 0 2024-08-19T00:56:00.905 INFO:tasks.workunit.client.1.smithi086.stdout:9/303: write f6 [472074,61050] 0 2024-08-19T00:56:00.906 INFO:tasks.workunit.client.1.smithi086.stdout:4/240: write d2/d1c/d2c/f43 [91873,56706] 0 2024-08-19T00:56:00.907 INFO:tasks.workunit.client.1.smithi086.stdout:7/334: creat d3/de/f66 x:0 0 0 2024-08-19T00:56:00.912 INFO:tasks.workunit.client.1.smithi086.stdout:7/335: creat d3/d34/d44/d3e/f67 x:0 0 0 2024-08-19T00:56:00.914 INFO:tasks.workunit.client.1.smithi086.stdout:4/241: creat d2/d1c/d25/f54 x:0 0 0 2024-08-19T00:56:00.915 INFO:tasks.workunit.client.1.smithi086.stdout:9/304: rename db/f16 to db/d23/d30/d32/f6a 0 2024-08-19T00:56:00.916 INFO:tasks.workunit.client.1.smithi086.stdout:8/292: dwrite dc/d1f/f27 [4194304,4194304] 0 2024-08-19T00:56:00.916 INFO:tasks.workunit.client.1.smithi086.stdout:7/336: rmdir d3/d5b 39 2024-08-19T00:56:00.916 INFO:tasks.workunit.client.1.smithi086.stdout:4/242: write d2/f21 [94171,33361] 0 2024-08-19T00:56:00.919 INFO:tasks.workunit.client.1.smithi086.stdout:2/261: dwrite d8/d14/f2f [4194304,4194304] 0 2024-08-19T00:56:00.919 INFO:tasks.workunit.client.1.smithi086.stdout:4/243: readlink d2/da/l15 0 2024-08-19T00:56:00.920 INFO:tasks.workunit.client.1.smithi086.stdout:2/262: chown d8/d24/c2a 105574654 1 2024-08-19T00:56:00.920 INFO:tasks.workunit.client.1.smithi086.stdout:4/244: chown d2/d18/c1e 0 1 2024-08-19T00:56:00.921 INFO:tasks.workunit.client.1.smithi086.stdout:8/293: write dc/d16/d18/d29/d2e/d28/d2b/f40 [1445739,73096] 0 2024-08-19T00:56:00.922 INFO:tasks.workunit.client.1.smithi086.stdout:4/245: chown d2/d18/l53 674 1 2024-08-19T00:56:00.922 INFO:tasks.workunit.client.1.smithi086.stdout:9/305: rmdir db/d23/d30/d3f/d43/d4e/d5d 0 2024-08-19T00:56:00.923 INFO:tasks.workunit.client.1.smithi086.stdout:9/306: read db/d23/f54 [254300,61147] 0 2024-08-19T00:56:00.926 INFO:tasks.workunit.client.1.smithi086.stdout:4/246: rename d2/d1c/d1d to d2/d1c/d25/d55 0 2024-08-19T00:56:00.928 INFO:tasks.workunit.client.1.smithi086.stdout:2/263: dwrite d8/d2c/d38/f3f [0,4194304] 0 2024-08-19T00:56:00.932 INFO:tasks.workunit.client.1.smithi086.stdout:2/264: creat d8/d43/f5a x:0 0 0 2024-08-19T00:56:00.932 INFO:tasks.workunit.client.1.smithi086.stdout:4/247: getdents d2/d18/d33 0 2024-08-19T00:56:00.935 INFO:tasks.workunit.client.1.smithi086.stdout:4/248: unlink d2/da/c3e 0 2024-08-19T00:56:00.941 INFO:tasks.workunit.client.1.smithi086.stdout:4/249: dwrite d2/f23 [4194304,4194304] 0 2024-08-19T00:56:00.943 INFO:tasks.workunit.client.1.smithi086.stdout:4/250: symlink d2/d1c/d25/d55/l56 0 2024-08-19T00:56:00.945 INFO:tasks.workunit.client.1.smithi086.stdout:4/251: dread d2/d1c/d25/d55/f4a [0,4194304] 0 2024-08-19T00:56:00.946 INFO:tasks.workunit.client.1.smithi086.stdout:4/252: fdatasync d2/d1c/d2c/f2e 0 2024-08-19T00:56:00.949 INFO:tasks.workunit.client.1.smithi086.stdout:4/253: link d2/f46 d2/d18/d33/f57 0 2024-08-19T00:56:00.950 INFO:tasks.workunit.client.1.smithi086.stdout:4/254: unlink d2/f46 0 2024-08-19T00:56:00.953 INFO:tasks.workunit.client.1.smithi086.stdout:4/255: creat d2/d1c/d25/f58 x:0 0 0 2024-08-19T00:56:00.954 INFO:tasks.workunit.client.1.smithi086.stdout:4/256: read d2/d1c/d25/f35 [237047,46238] 0 2024-08-19T00:56:00.955 INFO:tasks.workunit.client.1.smithi086.stdout:4/257: write d2/da/d2f/f39 [1102429,112942] 0 2024-08-19T00:56:00.959 INFO:tasks.workunit.client.1.smithi086.stdout:4/258: mkdir d2/da/d2f/d59 0 2024-08-19T00:56:00.968 INFO:tasks.workunit.client.1.smithi086.stdout:5/255: sync 2024-08-19T00:56:00.968 INFO:tasks.workunit.client.1.smithi086.stdout:1/319: sync 2024-08-19T00:56:00.971 INFO:tasks.workunit.client.1.smithi086.stdout:1/320: readlink d4/d7/d2a/d36/d3a/l46 0 2024-08-19T00:56:00.971 INFO:tasks.workunit.client.1.smithi086.stdout:5/256: stat d0/d8/f37 0 2024-08-19T00:56:00.972 INFO:tasks.workunit.client.1.smithi086.stdout:5/257: dread - d0/df/f3f zero size 2024-08-19T00:56:00.974 INFO:tasks.workunit.client.1.smithi086.stdout:1/321: mkdir d4/d1e/d6f 0 2024-08-19T00:56:00.976 INFO:tasks.workunit.client.1.smithi086.stdout:1/322: dread - d4/d7/d2a/f2b zero size 2024-08-19T00:56:00.976 INFO:tasks.workunit.client.1.smithi086.stdout:1/323: chown d4/d7/d2a 58427 1 2024-08-19T00:56:01.024 INFO:tasks.workunit.client.1.smithi086.stdout:7/337: truncate d3/de/d2d/f35 949598 0 2024-08-19T00:56:01.029 INFO:tasks.workunit.client.1.smithi086.stdout:7/338: rename d3/d34/d44/d58/d4b/d64 to d3/de/d68 0 2024-08-19T00:56:01.030 INFO:tasks.workunit.client.1.smithi086.stdout:2/265: write d8/d14/f30 [844352,123880] 0 2024-08-19T00:56:01.031 INFO:tasks.workunit.client.1.smithi086.stdout:7/339: mkdir d3/d34/d69 0 2024-08-19T00:56:01.035 INFO:tasks.workunit.client.1.smithi086.stdout:7/340: rmdir d3/d34/d44/d3e 39 2024-08-19T00:56:01.037 INFO:tasks.workunit.client.1.smithi086.stdout:7/341: write d3/d34/d44/d58/f55 [386480,117084] 0 2024-08-19T00:56:01.039 INFO:tasks.workunit.client.1.smithi086.stdout:2/266: dwrite d8/d14/f22 [0,4194304] 0 2024-08-19T00:56:01.040 INFO:tasks.workunit.client.1.smithi086.stdout:3/285: dread d3/d18/d19/d37/f4e [0,4194304] 0 2024-08-19T00:56:01.042 INFO:tasks.workunit.client.1.smithi086.stdout:4/259: dread d2/f26 [0,4194304] 0 2024-08-19T00:56:01.042 INFO:tasks.workunit.client.1.smithi086.stdout:1/324: write d4/f6 [3843685,2954] 0 2024-08-19T00:56:01.042 INFO:tasks.workunit.client.1.smithi086.stdout:5/258: write d0/fb [2999447,74236] 0 2024-08-19T00:56:01.044 INFO:tasks.workunit.client.1.smithi086.stdout:4/260: stat d2/c32 0 2024-08-19T00:56:01.045 INFO:tasks.workunit.client.1.smithi086.stdout:2/267: stat d8/f11 0 2024-08-19T00:56:01.049 INFO:tasks.workunit.client.1.smithi086.stdout:2/268: chown d8/d24/d32/d4d 228992 1 2024-08-19T00:56:01.049 INFO:tasks.workunit.client.1.smithi086.stdout:5/259: rmdir d0/d2d/d43 39 2024-08-19T00:56:01.051 INFO:tasks.workunit.client.1.smithi086.stdout:4/261: mknod d2/d1c/d25/d55/c5a 0 2024-08-19T00:56:01.054 INFO:tasks.workunit.client.1.smithi086.stdout:7/342: dwrite d3/d34/d44/d58/f55 [0,4194304] 0 2024-08-19T00:56:01.054 INFO:tasks.workunit.client.1.smithi086.stdout:1/325: truncate d4/d7/d2a/d36/d50/f62 164241 0 2024-08-19T00:56:01.055 INFO:tasks.workunit.client.1.smithi086.stdout:3/286: dread d3/d9/f4c [0,4194304] 0 2024-08-19T00:56:01.058 INFO:tasks.workunit.client.1.smithi086.stdout:7/343: readlink d3/la 0 2024-08-19T00:56:01.059 INFO:tasks.workunit.client.1.smithi086.stdout:3/287: chown d3/f29 132765 1 2024-08-19T00:56:01.060 INFO:tasks.workunit.client.1.smithi086.stdout:1/326: dread - d4/d10/f5a zero size 2024-08-19T00:56:01.061 INFO:tasks.workunit.client.1.smithi086.stdout:7/344: chown d3/c3f 1572779 1 2024-08-19T00:56:01.063 INFO:tasks.workunit.client.1.smithi086.stdout:0/303: sync 2024-08-19T00:56:01.064 INFO:tasks.workunit.client.1.smithi086.stdout:7/345: stat d3/d34/f52 0 2024-08-19T00:56:01.067 INFO:tasks.workunit.client.1.smithi086.stdout:2/269: dwrite d8/f19 [4194304,4194304] 0 2024-08-19T00:56:01.068 INFO:tasks.workunit.client.1.smithi086.stdout:2/270: chown d8/d14/f22 1534104327 1 2024-08-19T00:56:01.069 INFO:tasks.workunit.client.1.smithi086.stdout:5/260: dwrite d0/df/f23 [0,4194304] 0 2024-08-19T00:56:01.069 INFO:tasks.workunit.client.1.smithi086.stdout:3/288: mknod d3/d26/d2b/d33/d4a/c64 0 2024-08-19T00:56:01.074 INFO:tasks.workunit.client.1.smithi086.stdout:4/262: dwrite d2/d1c/d25/d55/f3d [0,4194304] 0 2024-08-19T00:56:01.076 INFO:tasks.workunit.client.1.smithi086.stdout:7/346: creat d3/d5b/f6a x:0 0 0 2024-08-19T00:56:01.077 INFO:tasks.workunit.client.1.smithi086.stdout:7/347: chown d3/d34/d44 38685 1 2024-08-19T00:56:01.079 INFO:tasks.workunit.client.1.smithi086.stdout:2/271: truncate d8/d24/f2b 2872448 0 2024-08-19T00:56:01.079 INFO:tasks.workunit.client.1.smithi086.stdout:4/263: dread - d2/d1c/d25/f58 zero size 2024-08-19T00:56:01.084 INFO:tasks.workunit.client.1.smithi086.stdout:4/264: write d2/f23 [5553811,43789] 0 2024-08-19T00:56:01.085 INFO:tasks.workunit.client.1.smithi086.stdout:0/304: dwrite da/d14/d44/f5a [0,4194304] 0 2024-08-19T00:56:01.085 INFO:tasks.workunit.client.1.smithi086.stdout:3/289: link d3/d18/d27/d49/f35 d3/d18/d19/d37/d5a/f65 0 2024-08-19T00:56:01.086 INFO:tasks.workunit.client.1.smithi086.stdout:0/305: readlink l5 0 2024-08-19T00:56:01.088 INFO:tasks.workunit.client.1.smithi086.stdout:5/261: getdents d0/d8/d10 0 2024-08-19T00:56:01.088 INFO:tasks.workunit.client.1.smithi086.stdout:7/348: write d3/d34/d44/d58/d4b/f3d [3339669,102791] 0 2024-08-19T00:56:01.089 INFO:tasks.workunit.client.1.smithi086.stdout:3/290: write d3/f29 [1419945,128058] 0 2024-08-19T00:56:01.090 INFO:tasks.workunit.client.1.smithi086.stdout:4/265: fsync d2/d18/f31 0 2024-08-19T00:56:01.093 INFO:tasks.workunit.client.1.smithi086.stdout:5/262: readlink d0/d8/d10/l1c 0 2024-08-19T00:56:01.096 INFO:tasks.workunit.client.1.smithi086.stdout:0/306: rmdir da/d14/d26/d65 0 2024-08-19T00:56:01.099 INFO:tasks.workunit.client.1.smithi086.stdout:5/263: getdents d0/df 0 2024-08-19T00:56:01.102 INFO:tasks.workunit.client.1.smithi086.stdout:1/327: dwrite d4/d7/d2a/d36/d3a/d41/f4b [0,4194304] 0 2024-08-19T00:56:01.103 INFO:tasks.workunit.client.1.smithi086.stdout:0/307: write da/d14/f1b [979809,73784] 0 2024-08-19T00:56:01.104 INFO:tasks.workunit.client.1.smithi086.stdout:7/349: dwrite d3/de/f59 [0,4194304] 0 2024-08-19T00:56:01.107 INFO:tasks.workunit.client.1.smithi086.stdout:4/266: dwrite d2/d1c/d2c/f2e [0,4194304] 0 2024-08-19T00:56:01.108 INFO:tasks.workunit.client.1.smithi086.stdout:5/264: rename d0 to d0/d2d/d43/d4d/d51 22 2024-08-19T00:56:01.114 INFO:tasks.workunit.client.1.smithi086.stdout:0/308: mkdir da/d14/d1a/d2e/d66 0 2024-08-19T00:56:01.116 INFO:tasks.workunit.client.1.smithi086.stdout:1/328: symlink d4/d1e/d6f/l70 0 2024-08-19T00:56:01.118 INFO:tasks.workunit.client.1.smithi086.stdout:5/265: mkdir d0/d20/d52 0 2024-08-19T00:56:01.120 INFO:tasks.workunit.client.1.smithi086.stdout:7/350: dwrite d3/de/f12 [0,4194304] 0 2024-08-19T00:56:01.121 INFO:tasks.workunit.client.1.smithi086.stdout:3/291: dwrite d3/f5 [0,4194304] 0 2024-08-19T00:56:01.123 INFO:tasks.workunit.client.1.smithi086.stdout:0/309: truncate da/d14/d1a/d2e/f62 920248 0 2024-08-19T00:56:01.124 INFO:tasks.workunit.client.1.smithi086.stdout:5/266: creat d0/d20/f53 x:0 0 0 2024-08-19T00:56:01.125 INFO:tasks.workunit.client.1.smithi086.stdout:7/351: mknod d3/de/d68/c6b 0 2024-08-19T00:56:01.128 INFO:tasks.workunit.client.1.smithi086.stdout:0/310: creat da/d14/d1a/d2e/d30/f67 x:0 0 0 2024-08-19T00:56:01.130 INFO:tasks.workunit.client.1.smithi086.stdout:3/292: mkdir d3/d18/d27/d49/d3f/d5b/d66 0 2024-08-19T00:56:01.133 INFO:tasks.workunit.client.1.smithi086.stdout:5/267: write d0/df/d1f/d33/f40 [4546845,119214] 0 2024-08-19T00:56:01.136 INFO:tasks.workunit.client.1.smithi086.stdout:1/329: dwrite d4/d1e/f20 [0,4194304] 0 2024-08-19T00:56:01.137 INFO:tasks.workunit.client.1.smithi086.stdout:0/311: creat da/d14/d26/f68 x:0 0 0 2024-08-19T00:56:01.138 INFO:tasks.workunit.client.1.smithi086.stdout:4/267: dwrite d2/d18/d33/f36 [0,4194304] 0 2024-08-19T00:56:01.143 INFO:tasks.workunit.client.1.smithi086.stdout:0/312: chown da/d14/d1a/d2e/d39/f45 1180 1 2024-08-19T00:56:01.143 INFO:tasks.workunit.client.1.smithi086.stdout:1/330: creat d4/d7/d2a/d36/f71 x:0 0 0 2024-08-19T00:56:01.144 INFO:tasks.workunit.client.1.smithi086.stdout:4/268: read d2/da/ff [5806048,105767] 0 2024-08-19T00:56:01.145 INFO:tasks.workunit.client.1.smithi086.stdout:7/352: dwrite d3/de/f66 [0,4194304] 0 2024-08-19T00:56:01.148 INFO:tasks.workunit.client.1.smithi086.stdout:7/353: fsync d3/de/f27 0 2024-08-19T00:56:01.149 INFO:tasks.workunit.client.1.smithi086.stdout:1/331: write d4/d7/d2a/d36/d50/f62 [567405,123996] 0 2024-08-19T00:56:01.150 INFO:tasks.workunit.client.1.smithi086.stdout:1/332: truncate d4/d7/d2a/f2b 793881 0 2024-08-19T00:56:01.165 INFO:tasks.workunit.client.1.smithi086.stdout:5/268: dread d0/f17 [0,4194304] 0 2024-08-19T00:56:01.174 INFO:tasks.workunit.client.1.smithi086.stdout:6/316: sync 2024-08-19T00:56:01.210 INFO:tasks.workunit.client.1.smithi086.stdout:8/294: sync 2024-08-19T00:56:01.210 INFO:tasks.workunit.client.1.smithi086.stdout:2/272: sync 2024-08-19T00:56:01.210 INFO:tasks.workunit.client.1.smithi086.stdout:9/307: sync 2024-08-19T00:56:01.214 INFO:tasks.workunit.client.1.smithi086.stdout:3/293: fdatasync d3/f5 0 2024-08-19T00:56:01.222 INFO:tasks.workunit.client.1.smithi086.stdout:5/269: readlink d0/d8/le 0 2024-08-19T00:56:01.224 INFO:tasks.workunit.client.1.smithi086.stdout:3/294: write d3/d18/d19/d37/f4e [4094462,119588] 0 2024-08-19T00:56:01.226 INFO:tasks.workunit.client.1.smithi086.stdout:0/313: truncate da/d14/f41 1065379 0 2024-08-19T00:56:01.233 INFO:tasks.workunit.client.1.smithi086.stdout:5/270: unlink d0/d8/d10/c2a 0 2024-08-19T00:56:01.233 INFO:tasks.workunit.client.1.smithi086.stdout:3/295: chown d3/d18/d27/d49/d3f/c42 79645 1 2024-08-19T00:56:01.234 INFO:tasks.workunit.client.1.smithi086.stdout:9/308: link db/d23/d30/d32/d44/f65 db/d23/d30/d32/d44/f6b 0 2024-08-19T00:56:01.234 INFO:tasks.workunit.client.1.smithi086.stdout:4/269: rename d2/c32 to d2/d18/d33/c5b 0 2024-08-19T00:56:01.236 INFO:tasks.workunit.client.1.smithi086.stdout:8/295: getdents dc/d16/d18/d29/d2e 0 2024-08-19T00:56:01.236 INFO:tasks.workunit.client.1.smithi086.stdout:7/354: dread d3/d34/d44/d3e/f5d [0,4194304] 0 2024-08-19T00:56:01.237 INFO:tasks.workunit.client.1.smithi086.stdout:0/314: creat da/d14/d1a/d2e/d39/f69 x:0 0 0 2024-08-19T00:56:01.238 INFO:tasks.workunit.client.1.smithi086.stdout:3/296: stat d3/d18/d1a/c23 0 2024-08-19T00:56:01.239 INFO:tasks.workunit.client.1.smithi086.stdout:6/317: dwrite db/d37/f20 [0,4194304] 0 2024-08-19T00:56:01.239 INFO:tasks.workunit.client.1.smithi086.stdout:9/309: creat db/d23/d30/d31/f6c x:0 0 0 2024-08-19T00:56:01.240 INFO:tasks.workunit.client.1.smithi086.stdout:8/296: readlink dc/d16/l30 0 2024-08-19T00:56:01.240 INFO:tasks.workunit.client.1.smithi086.stdout:3/297: fsync d3/f6 0 2024-08-19T00:56:01.241 INFO:tasks.workunit.client.1.smithi086.stdout:9/310: stat db/d23/f54 0 2024-08-19T00:56:01.241 INFO:tasks.workunit.client.1.smithi086.stdout:7/355: read d3/f3a [3891689,7178] 0 2024-08-19T00:56:01.241 INFO:tasks.workunit.client.1.smithi086.stdout:0/315: chown da/d14/d1a/d2e/d39/f69 11877 1 2024-08-19T00:56:01.243 INFO:tasks.workunit.client.1.smithi086.stdout:1/333: rename d4/d7/fe to d4/d7/d2a/d36/d3a/f72 0 2024-08-19T00:56:01.244 INFO:tasks.workunit.client.1.smithi086.stdout:0/316: write da/d14/f1d [8090679,90677] 0 2024-08-19T00:56:01.245 INFO:tasks.workunit.client.1.smithi086.stdout:6/318: fdatasync db/f13 0 2024-08-19T00:56:01.246 INFO:tasks.workunit.client.1.smithi086.stdout:7/356: write d3/d34/d44/d3e/f56 [860823,5487] 0 2024-08-19T00:56:01.247 INFO:tasks.workunit.client.1.smithi086.stdout:3/298: unlink d3/d18/d19/f1f 0 2024-08-19T00:56:01.249 INFO:tasks.workunit.client.1.smithi086.stdout:7/357: write d3/d34/d44/d3e/f5c [748883,35072] 0 2024-08-19T00:56:01.250 INFO:tasks.workunit.client.1.smithi086.stdout:3/299: stat d3/d18/d19/d37/d5a 0 2024-08-19T00:56:01.250 INFO:tasks.workunit.client.1.smithi086.stdout:5/271: rename d0/d2d/f4e to d0/d2d/d43/d4d/f54 0 2024-08-19T00:56:01.255 INFO:tasks.workunit.client.1.smithi086.stdout:3/300: mkdir d3/d67 0 2024-08-19T00:56:01.255 INFO:tasks.workunit.client.1.smithi086.stdout:4/270: dwrite d2/d18/f31 [0,4194304] 0 2024-08-19T00:56:01.256 INFO:tasks.workunit.client.1.smithi086.stdout:7/358: fdatasync d3/d34/d44/d3e/f5d 0 2024-08-19T00:56:01.257 INFO:tasks.workunit.client.1.smithi086.stdout:9/311: rename db/d3b to db/d23/d6d 0 2024-08-19T00:56:01.257 INFO:tasks.workunit.client.1.smithi086.stdout:0/317: mkdir da/d14/d1a/d2e/d43/d61/d6a 0 2024-08-19T00:56:01.262 INFO:tasks.workunit.client.1.smithi086.stdout:1/334: getdents d4/d1e/d35 0 2024-08-19T00:56:01.263 INFO:tasks.workunit.client.1.smithi086.stdout:3/301: creat d3/d18/d19/f68 x:0 0 0 2024-08-19T00:56:01.264 INFO:tasks.workunit.client.1.smithi086.stdout:4/271: truncate d2/d1c/d25/f54 1000860 0 2024-08-19T00:56:01.266 INFO:tasks.workunit.client.1.smithi086.stdout:8/297: rename dc/d16/d18/d29/d32/c53 to dc/d17/d1e/d55/c5d 0 2024-08-19T00:56:01.266 INFO:tasks.workunit.client.1.smithi086.stdout:6/319: dwrite db/f58 [0,4194304] 0 2024-08-19T00:56:01.267 INFO:tasks.workunit.client.1.smithi086.stdout:9/312: mknod db/d23/d30/d32/d44/c6e 0 2024-08-19T00:56:01.269 INFO:tasks.workunit.client.1.smithi086.stdout:0/318: symlink da/l6b 0 2024-08-19T00:56:01.269 INFO:tasks.workunit.client.1.smithi086.stdout:9/313: chown db/dd/c12 254 1 2024-08-19T00:56:01.270 INFO:tasks.workunit.client.1.smithi086.stdout:5/272: dwrite d0/d20/f36 [0,4194304] 0 2024-08-19T00:56:01.271 INFO:tasks.workunit.client.1.smithi086.stdout:6/320: mknod db/d37/d44/c62 0 2024-08-19T00:56:01.272 INFO:tasks.workunit.client.1.smithi086.stdout:4/272: rename d2/d18/c50 to d2/d1c/d25/d55/d4d/c5c 0 2024-08-19T00:56:01.272 INFO:tasks.workunit.client.1.smithi086.stdout:9/314: write db/d23/d30/d32/d44/f69 [475444,1575] 0 2024-08-19T00:56:01.273 INFO:tasks.workunit.client.1.smithi086.stdout:1/335: getdents d4/d1e/d35/d56 0 2024-08-19T00:56:01.273 INFO:tasks.workunit.client.1.smithi086.stdout:6/321: chown db/d34/d39/f40 4777764 1 2024-08-19T00:56:01.273 INFO:tasks.workunit.client.1.smithi086.stdout:4/273: readlink d2/d1c/d25/d55/l56 0 2024-08-19T00:56:01.275 INFO:tasks.workunit.client.1.smithi086.stdout:3/302: creat d3/d26/d60/f69 x:0 0 0 2024-08-19T00:56:01.275 INFO:tasks.workunit.client.1.smithi086.stdout:6/322: chown db/d37/d28/c53 26 1 2024-08-19T00:56:01.277 INFO:tasks.workunit.client.1.smithi086.stdout:5/273: creat d0/df/d1f/d33/f55 x:0 0 0 2024-08-19T00:56:01.277 INFO:tasks.workunit.client.1.smithi086.stdout:6/323: chown db/l1f 38 1 2024-08-19T00:56:01.277 INFO:tasks.workunit.client.1.smithi086.stdout:0/319: symlink da/d5d/l6c 0 2024-08-19T00:56:01.278 INFO:tasks.workunit.client.1.smithi086.stdout:5/274: stat d0/d20/f3c 0 2024-08-19T00:56:01.278 INFO:tasks.workunit.client.1.smithi086.stdout:0/320: readlink l9 0 2024-08-19T00:56:01.282 INFO:tasks.workunit.client.1.smithi086.stdout:1/336: unlink d4/d1e/d35/l42 0 2024-08-19T00:56:01.284 INFO:tasks.workunit.client.1.smithi086.stdout:4/274: dread d2/da/f41 [0,4194304] 0 2024-08-19T00:56:01.284 INFO:tasks.workunit.client.1.smithi086.stdout:7/359: getdents d3/de/d2d 0 2024-08-19T00:56:01.286 INFO:tasks.workunit.client.1.smithi086.stdout:1/337: fdatasync d4/d10/f51 0 2024-08-19T00:56:01.287 INFO:tasks.workunit.client.1.smithi086.stdout:0/321: symlink da/d14/d1a/d2e/d30/l6d 0 2024-08-19T00:56:01.288 INFO:tasks.workunit.client.1.smithi086.stdout:7/360: write d3/de/f17 [3464940,29836] 0 2024-08-19T00:56:01.289 INFO:tasks.workunit.client.1.smithi086.stdout:8/298: getdents dc/d16/d18/d29/d2e/d28/d41 0 2024-08-19T00:56:01.290 INFO:tasks.workunit.client.1.smithi086.stdout:4/275: mkdir d2/d1c/d25/d30/d5d 0 2024-08-19T00:56:01.291 INFO:tasks.workunit.client.1.smithi086.stdout:9/315: getdents db/d23/d30/d3f/d43 0 2024-08-19T00:56:01.291 INFO:tasks.workunit.client.1.smithi086.stdout:5/275: dwrite d0/fa [0,4194304] 0 2024-08-19T00:56:01.292 INFO:tasks.workunit.client.1.smithi086.stdout:8/299: fdatasync dc/d1f/f27 0 2024-08-19T00:56:01.292 INFO:tasks.workunit.client.1.smithi086.stdout:7/361: write d3/fb [1398197,22815] 0 2024-08-19T00:56:01.292 INFO:tasks.workunit.client.1.smithi086.stdout:3/303: dread d3/f6 [0,4194304] 0 2024-08-19T00:56:01.295 INFO:tasks.workunit.client.1.smithi086.stdout:9/316: fsync db/d23/d30/d32/f46 0 2024-08-19T00:56:01.296 INFO:tasks.workunit.client.1.smithi086.stdout:4/276: readlink d2/da/d2f/l49 0 2024-08-19T00:56:01.298 INFO:tasks.workunit.client.1.smithi086.stdout:0/322: rename da/d14/c16 to da/d14/d1a/d2e/d66/c6e 0 2024-08-19T00:56:01.299 INFO:tasks.workunit.client.1.smithi086.stdout:5/276: mknod d0/d20/c56 0 2024-08-19T00:56:01.304 INFO:tasks.workunit.client.1.smithi086.stdout:3/304: dread d3/d18/d1a/f34 [0,4194304] 0 2024-08-19T00:56:01.305 INFO:tasks.workunit.client.1.smithi086.stdout:8/300: rename dc/d16/d18/d29/d2e/d28/l4a to dc/d17/d1e/d49/l5e 0 2024-08-19T00:56:01.305 INFO:tasks.workunit.client.1.smithi086.stdout:3/305: write d3/d26/d2b/f3b [273579,2945] 0 2024-08-19T00:56:01.308 INFO:tasks.workunit.client.1.smithi086.stdout:3/306: write d3/d18/d27/d48/f4b [387062,11204] 0 2024-08-19T00:56:01.309 INFO:tasks.workunit.client.1.smithi086.stdout:7/362: link d3/de/f15 d3/d5b/f6c 0 2024-08-19T00:56:01.309 INFO:tasks.workunit.client.1.smithi086.stdout:1/338: dread d4/d1e/d35/f5b [0,4194304] 0 2024-08-19T00:56:01.310 INFO:tasks.workunit.client.1.smithi086.stdout:4/277: creat d2/d18/d33/f5e x:0 0 0 2024-08-19T00:56:01.311 INFO:tasks.workunit.client.1.smithi086.stdout:1/339: write d4/d1e/d35/f4a [1206004,111519] 0 2024-08-19T00:56:01.312 INFO:tasks.workunit.client.1.smithi086.stdout:8/301: rename dc/f23 to dc/d16/d18/d29/d2e/d28/d2b/f5f 0 2024-08-19T00:56:01.313 INFO:tasks.workunit.client.1.smithi086.stdout:8/302: readlink dc/d17/l5b 0 2024-08-19T00:56:01.314 INFO:tasks.workunit.client.1.smithi086.stdout:4/278: write d2/d1c/d25/d55/f38 [327335,101754] 0 2024-08-19T00:56:01.315 INFO:tasks.workunit.client.1.smithi086.stdout:8/303: readlink dc/d17/d1e/l35 0 2024-08-19T00:56:01.315 INFO:tasks.workunit.client.1.smithi086.stdout:7/363: readlink d3/d34/d44/l40 0 2024-08-19T00:56:01.317 INFO:tasks.workunit.client.1.smithi086.stdout:9/317: link db/d23/d30/d32/d44/f6b db/d26/d5c/d68/f6f 0 2024-08-19T00:56:01.319 INFO:tasks.workunit.client.1.smithi086.stdout:3/307: creat d3/d18/d27/d49/d3f/d5b/d66/f6a x:0 0 0 2024-08-19T00:56:01.320 INFO:tasks.workunit.client.1.smithi086.stdout:4/279: creat d2/d1c/d25/f5f x:0 0 0 2024-08-19T00:56:01.323 INFO:tasks.workunit.client.1.smithi086.stdout:5/277: getdents d0/d8/d10 0 2024-08-19T00:56:01.323 INFO:tasks.workunit.client.1.smithi086.stdout:4/280: fsync d2/d1c/d2c/f43 0 2024-08-19T00:56:01.324 INFO:tasks.workunit.client.1.smithi086.stdout:1/340: dwrite d4/f5c [0,4194304] 0 2024-08-19T00:56:01.325 INFO:tasks.workunit.client.1.smithi086.stdout:0/323: dread da/d14/d1a/d2e/d30/f4c [0,4194304] 0 2024-08-19T00:56:01.325 INFO:tasks.workunit.client.1.smithi086.stdout:5/278: stat d0 0 2024-08-19T00:56:01.327 INFO:tasks.workunit.client.1.smithi086.stdout:1/341: write d4/d1e/f48 [884622,68204] 0 2024-08-19T00:56:01.330 INFO:tasks.workunit.client.1.smithi086.stdout:5/279: chown d0/df/d1f/d33/f55 4 1 2024-08-19T00:56:01.334 INFO:tasks.workunit.client.1.smithi086.stdout:8/304: getdents dc/d17/d1e 0 2024-08-19T00:56:01.337 INFO:tasks.workunit.client.1.smithi086.stdout:5/280: mkdir d0/d20/d52/d57 0 2024-08-19T00:56:01.337 INFO:tasks.workunit.client.1.smithi086.stdout:9/318: dwrite db/d23/d30/d3f/d43/f50 [0,4194304] 0 2024-08-19T00:56:01.339 INFO:tasks.workunit.client.1.smithi086.stdout:7/364: dread d3/de/f17 [0,4194304] 0 2024-08-19T00:56:01.339 INFO:tasks.workunit.client.1.smithi086.stdout:1/342: link d4/f40 d4/d7/d2a/d6e/f73 0 2024-08-19T00:56:01.341 INFO:tasks.workunit.client.1.smithi086.stdout:1/343: readlink d4/d7/l17 0 2024-08-19T00:56:01.341 INFO:tasks.workunit.client.1.smithi086.stdout:9/319: chown db/d23/f42 653 1 2024-08-19T00:56:01.341 INFO:tasks.workunit.client.1.smithi086.stdout:0/324: link da/d14/d1a/d2e/d39/d3b/d4e/f4f da/d14/f6f 0 2024-08-19T00:56:01.341 INFO:tasks.workunit.client.1.smithi086.stdout:3/308: getdents d3/d18/d27/d49/d3f/d54 0 2024-08-19T00:56:01.342 INFO:tasks.workunit.client.1.smithi086.stdout:8/305: mkdir dc/d1f/d37/d60 0 2024-08-19T00:56:01.343 INFO:tasks.workunit.client.1.smithi086.stdout:4/281: dwrite d2/d1c/d25/d55/f4a [0,4194304] 0 2024-08-19T00:56:01.346 INFO:tasks.workunit.client.1.smithi086.stdout:1/344: creat d4/d1e/d6f/f74 x:0 0 0 2024-08-19T00:56:01.347 INFO:tasks.workunit.client.1.smithi086.stdout:9/320: read db/dd/d19/d38/f53 [557639,50139] 0 2024-08-19T00:56:01.349 INFO:tasks.workunit.client.1.smithi086.stdout:1/345: fsync d4/d7/d2a/d36/d3a/d41/f4b 0 2024-08-19T00:56:01.350 INFO:tasks.workunit.client.1.smithi086.stdout:0/325: creat da/d14/d1a/d2e/d39/d3b/f70 x:0 0 0 2024-08-19T00:56:01.351 INFO:tasks.workunit.client.1.smithi086.stdout:8/306: creat dc/d16/d18/d29/d2e/f61 x:0 0 0 2024-08-19T00:56:01.352 INFO:tasks.workunit.client.1.smithi086.stdout:5/281: dwrite d0/d8/f37 [0,4194304] 0 2024-08-19T00:56:01.354 INFO:tasks.workunit.client.1.smithi086.stdout:1/346: dread - d4/d7/d2a/d36/f6a zero size 2024-08-19T00:56:01.355 INFO:tasks.workunit.client.1.smithi086.stdout:8/307: write dc/d16/d18/d29/d2e/f3f [4418950,74605] 0 2024-08-19T00:56:01.358 INFO:tasks.workunit.client.1.smithi086.stdout:8/308: fsync f3 0 2024-08-19T00:56:01.359 INFO:tasks.workunit.client.1.smithi086.stdout:7/365: link d3/de/f17 d3/d34/d44/d58/d4b/f6d 0 2024-08-19T00:56:01.362 INFO:tasks.workunit.client.1.smithi086.stdout:8/309: unlink dc/l54 0 2024-08-19T00:56:01.362 INFO:tasks.workunit.client.1.smithi086.stdout:9/321: dwrite db/d23/d30/d58/f5b [0,4194304] 0 2024-08-19T00:56:01.363 INFO:tasks.workunit.client.1.smithi086.stdout:5/282: creat d0/d20/d52/d57/f58 x:0 0 0 2024-08-19T00:56:01.363 INFO:tasks.workunit.client.1.smithi086.stdout:0/326: creat da/d14/d26/f71 x:0 0 0 2024-08-19T00:56:01.364 INFO:tasks.workunit.client.1.smithi086.stdout:4/282: getdents d2/d1c/d25/d55 0 2024-08-19T00:56:01.364 INFO:tasks.workunit.client.1.smithi086.stdout:7/366: rmdir d3/de/d2d 39 2024-08-19T00:56:01.365 INFO:tasks.workunit.client.1.smithi086.stdout:9/322: fdatasync db/d26/f29 0 2024-08-19T00:56:01.367 INFO:tasks.workunit.client.1.smithi086.stdout:0/327: dread - da/d14/d1a/f54 zero size 2024-08-19T00:56:01.368 INFO:tasks.workunit.client.1.smithi086.stdout:9/323: mknod db/c70 0 2024-08-19T00:56:01.371 INFO:tasks.workunit.client.1.smithi086.stdout:5/283: rename d0/df/c11 to d0/d8/c59 0 2024-08-19T00:56:01.371 INFO:tasks.workunit.client.1.smithi086.stdout:4/283: truncate d2/da/f14 881571 0 2024-08-19T00:56:01.373 INFO:tasks.workunit.client.1.smithi086.stdout:5/284: stat d0/df/d1f/d33/c39 0 2024-08-19T00:56:01.373 INFO:tasks.workunit.client.1.smithi086.stdout:9/324: link db/d23/d30/d32/f6a db/d23/d30/d3f/f71 0 2024-08-19T00:56:01.374 INFO:tasks.workunit.client.1.smithi086.stdout:4/284: mkdir d2/d18/d60 0 2024-08-19T00:56:01.375 INFO:tasks.workunit.client.1.smithi086.stdout:8/310: rename dc/d16/d18/d29/d2e/d28/d41/f52 to dc/f62 0 2024-08-19T00:56:01.376 INFO:tasks.workunit.client.1.smithi086.stdout:0/328: dwrite da/d14/d44/d49/f63 [0,4194304] 0 2024-08-19T00:56:01.376 INFO:tasks.workunit.client.1.smithi086.stdout:8/311: stat dc/c1d 0 2024-08-19T00:56:01.377 INFO:tasks.workunit.client.1.smithi086.stdout:5/285: creat d0/d2d/d4f/f5a x:0 0 0 2024-08-19T00:56:01.378 INFO:tasks.workunit.client.1.smithi086.stdout:9/325: unlink db/d23/d30/d32/f46 0 2024-08-19T00:56:01.382 INFO:tasks.workunit.client.1.smithi086.stdout:0/329: mknod da/d14/d26/c72 0 2024-08-19T00:56:01.382 INFO:tasks.workunit.client.1.smithi086.stdout:9/326: readlink db/d23/d6d/l63 0 2024-08-19T00:56:01.385 INFO:tasks.workunit.client.1.smithi086.stdout:4/285: link d2/d1c/d25/f54 d2/d18/d33/d42/f61 0 2024-08-19T00:56:01.385 INFO:tasks.workunit.client.1.smithi086.stdout:9/327: write db/f11 [2146908,33680] 0 2024-08-19T00:56:01.385 INFO:tasks.workunit.client.1.smithi086.stdout:0/330: stat da/d14/d1a/d2e/d39/d3b/d4e/l5e 0 2024-08-19T00:56:01.387 INFO:tasks.workunit.client.1.smithi086.stdout:0/331: dread - da/d14/d44/d49/f5f zero size 2024-08-19T00:56:01.387 INFO:tasks.workunit.client.1.smithi086.stdout:4/286: write d2/d1c/d25/f3a [992776,101420] 0 2024-08-19T00:56:01.388 INFO:tasks.workunit.client.1.smithi086.stdout:5/286: dwrite d0/fa [0,4194304] 0 2024-08-19T00:56:01.393 INFO:tasks.workunit.client.1.smithi086.stdout:5/287: mkdir d0/d20/d52/d5b 0 2024-08-19T00:56:01.394 INFO:tasks.workunit.client.1.smithi086.stdout:4/287: rename d2/d18/f31 to d2/da/f62 0 2024-08-19T00:56:01.398 INFO:tasks.workunit.client.1.smithi086.stdout:7/367: dread d3/de/f27 [0,4194304] 0 2024-08-19T00:56:01.402 INFO:tasks.workunit.client.1.smithi086.stdout:9/328: dwrite db/d23/d30/d31/f6c [0,4194304] 0 2024-08-19T00:56:01.402 INFO:tasks.workunit.client.1.smithi086.stdout:1/347: truncate d4/d7/d2a/d36/d50/f66 204800 0 2024-08-19T00:56:01.403 INFO:tasks.workunit.client.1.smithi086.stdout:0/332: dwrite da/f46 [8388608,4194304] 0 2024-08-19T00:56:01.404 INFO:tasks.workunit.client.1.smithi086.stdout:7/368: write d3/de/f12 [4826495,70570] 0 2024-08-19T00:56:01.409 INFO:tasks.workunit.client.1.smithi086.stdout:5/288: dwrite d0/df/f1a [0,4194304] 0 2024-08-19T00:56:01.409 INFO:tasks.workunit.client.1.smithi086.stdout:9/329: mknod db/d26/d5c/c72 0 2024-08-19T00:56:01.412 INFO:tasks.workunit.client.1.smithi086.stdout:5/289: dread - d0/df/d1f/d33/f34 zero size 2024-08-19T00:56:01.414 INFO:tasks.workunit.client.1.smithi086.stdout:7/369: rmdir d3/de/d4f 39 2024-08-19T00:56:01.416 INFO:tasks.workunit.client.1.smithi086.stdout:2/273: sync 2024-08-19T00:56:01.416 INFO:tasks.workunit.client.1.smithi086.stdout:1/348: dwrite d4/d10/f5a [0,4194304] 0 2024-08-19T00:56:01.417 INFO:tasks.workunit.client.1.smithi086.stdout:0/333: rename da/d14/c23 to da/d14/d55/c73 0 2024-08-19T00:56:01.422 INFO:tasks.workunit.client.1.smithi086.stdout:5/290: truncate d0/d2d/d43/f48 42364 0 2024-08-19T00:56:01.422 INFO:tasks.workunit.client.1.smithi086.stdout:9/330: creat db/d23/d30/d32/d44/f73 x:0 0 0 2024-08-19T00:56:01.424 INFO:tasks.workunit.client.1.smithi086.stdout:9/331: readlink db/dd/d19/d18/l1e 0 2024-08-19T00:56:01.424 INFO:tasks.workunit.client.1.smithi086.stdout:5/291: chown d0/df/d1f/d33/c39 874540 1 2024-08-19T00:56:01.425 INFO:tasks.workunit.client.1.smithi086.stdout:5/292: dread - d0/d2d/d4f/f5a zero size 2024-08-19T00:56:01.426 INFO:tasks.workunit.client.1.smithi086.stdout:8/312: truncate f5 3216237 0 2024-08-19T00:56:01.427 INFO:tasks.workunit.client.1.smithi086.stdout:7/370: creat d3/d5b/f6e x:0 0 0 2024-08-19T00:56:01.429 INFO:tasks.workunit.client.1.smithi086.stdout:0/334: creat da/d14/d1a/d2e/d39/f74 x:0 0 0 2024-08-19T00:56:01.431 INFO:tasks.workunit.client.1.smithi086.stdout:4/288: dread d2/da/f16 [0,4194304] 0 2024-08-19T00:56:01.432 INFO:tasks.workunit.client.1.smithi086.stdout:4/289: write d2/d1c/d25/d55/f3d [3375146,89536] 0 2024-08-19T00:56:01.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:01 smithi017 ceph-mon[16627]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:56:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:01 smithi017 ceph-mon[16627]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:56:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:01 smithi017 ceph-mon[16627]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:56:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:01 smithi017 ceph-mon[16627]: pgmap v11: 65 pgs: 65 active+clean; 416 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 36 MiB/s wr, 303 op/s 2024-08-19T00:56:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:01 smithi017 ceph-mon[16627]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:56:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:01 smithi017 ceph-mon[16627]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:56:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:01 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:01 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:01 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:01 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:01 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:01.436 INFO:tasks.workunit.client.1.smithi086.stdout:5/293: creat d0/d2d/d4f/f5c x:0 0 0 2024-08-19T00:56:01.437 INFO:tasks.workunit.client.1.smithi086.stdout:1/349: dread d4/d7/d2a/d36/d3a/f3e [0,4194304] 0 2024-08-19T00:56:01.440 INFO:tasks.workunit.client.1.smithi086.stdout:8/313: symlink dc/d16/d18/d29/l63 0 2024-08-19T00:56:01.443 INFO:tasks.workunit.client.1.smithi086.stdout:7/371: unlink d3/fb 0 2024-08-19T00:56:01.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:01 smithi086 ceph-mon[24511]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:56:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:01 smithi086 ceph-mon[24511]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:56:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:01 smithi086 ceph-mon[24511]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:56:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:01 smithi086 ceph-mon[24511]: pgmap v11: 65 pgs: 65 active+clean; 416 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 36 MiB/s wr, 303 op/s 2024-08-19T00:56:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:01 smithi086 ceph-mon[24511]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:56:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:01 smithi086 ceph-mon[24511]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:56:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:01 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:01 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:01 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:01 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:01 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:01.447 INFO:tasks.workunit.client.1.smithi086.stdout:0/335: creat da/d5d/f75 x:0 0 0 2024-08-19T00:56:01.448 INFO:tasks.workunit.client.1.smithi086.stdout:0/336: write da/d14/d1a/d2e/d30/f50 [2857344,69601] 0 2024-08-19T00:56:01.453 INFO:tasks.workunit.client.1.smithi086.stdout:4/290: rmdir d2/d1c 39 2024-08-19T00:56:01.457 INFO:tasks.workunit.client.1.smithi086.stdout:0/337: dread da/d14/d26/f33 [0,4194304] 0 2024-08-19T00:56:01.457 INFO:tasks.workunit.client.1.smithi086.stdout:5/294: symlink d0/d8/d10/l5d 0 2024-08-19T00:56:01.457 INFO:tasks.workunit.client.1.smithi086.stdout:5/295: read - d0/d20/f53 zero size 2024-08-19T00:56:01.459 INFO:tasks.workunit.client.1.smithi086.stdout:5/296: chown d0/d2d/d43/f48 43022 1 2024-08-19T00:56:01.462 INFO:tasks.workunit.client.1.smithi086.stdout:8/314: creat dc/d16/d18/d29/d2e/d28/d2b/f64 x:0 0 0 2024-08-19T00:56:01.463 INFO:tasks.workunit.client.1.smithi086.stdout:8/315: write dc/d16/d18/d29/d2e/f61 [837084,119365] 0 2024-08-19T00:56:01.464 INFO:tasks.workunit.client.1.smithi086.stdout:7/372: creat d3/d5b/f6f x:0 0 0 2024-08-19T00:56:01.465 INFO:tasks.workunit.client.1.smithi086.stdout:7/373: chown d3/d34/d44/f48 2 1 2024-08-19T00:56:01.473 INFO:tasks.workunit.client.1.smithi086.stdout:0/338: dread da/fe [0,4194304] 0 2024-08-19T00:56:01.473 INFO:tasks.workunit.client.1.smithi086.stdout:2/274: link d8/d24/l34 d8/d2c/d47/l5b 0 2024-08-19T00:56:01.476 INFO:tasks.workunit.client.1.smithi086.stdout:1/350: dread d4/d7/d2a/d36/f6a [0,4194304] 0 2024-08-19T00:56:01.478 INFO:tasks.workunit.client.1.smithi086.stdout:4/291: dwrite d2/d1c/d25/d55/f40 [0,4194304] 0 2024-08-19T00:56:01.479 INFO:tasks.workunit.client.1.smithi086.stdout:9/332: link db/d23/d30/d31/l4c db/d23/d30/d32/d44/d67/l74 0 2024-08-19T00:56:01.483 INFO:tasks.workunit.client.1.smithi086.stdout:8/316: rmdir dc/d16/d18 39 2024-08-19T00:56:01.487 INFO:tasks.workunit.client.1.smithi086.stdout:2/275: mkdir d8/d24/d32/d5c 0 2024-08-19T00:56:01.487 INFO:tasks.workunit.client.1.smithi086.stdout:2/276: chown d8/d24 0 1 2024-08-19T00:56:01.489 INFO:tasks.workunit.client.1.smithi086.stdout:0/339: mkdir da/d14/d1a/d2e/d30/d76 0 2024-08-19T00:56:01.493 INFO:tasks.workunit.client.1.smithi086.stdout:5/297: mknod d0/d8/c5e 0 2024-08-19T00:56:01.493 INFO:tasks.workunit.client.1.smithi086.stdout:5/298: truncate d0/d20/f53 520082 0 2024-08-19T00:56:01.494 INFO:tasks.workunit.client.1.smithi086.stdout:1/351: mkdir d4/d10/d75 0 2024-08-19T00:56:01.494 INFO:tasks.workunit.client.1.smithi086.stdout:1/352: stat d4/c4c 0 2024-08-19T00:56:01.495 INFO:tasks.workunit.client.1.smithi086.stdout:6/324: sync 2024-08-19T00:56:01.499 INFO:tasks.workunit.client.1.smithi086.stdout:8/317: stat dc/d17/d1e/d49/l5e 0 2024-08-19T00:56:01.499 INFO:tasks.workunit.client.1.smithi086.stdout:5/299: dwrite d0/df/d1f/d33/f40 [0,4194304] 0 2024-08-19T00:56:01.503 INFO:tasks.workunit.client.1.smithi086.stdout:9/333: mkdir db/d5e/d75 0 2024-08-19T00:56:01.506 INFO:tasks.workunit.client.1.smithi086.stdout:5/300: dwrite d0/d2d/d4f/f5c [0,4194304] 0 2024-08-19T00:56:01.506 INFO:tasks.workunit.client.1.smithi086.stdout:0/340: dread da/f46 [4194304,4194304] 0 2024-08-19T00:56:01.507 INFO:tasks.workunit.client.1.smithi086.stdout:4/292: creat d2/da/d2f/d59/f63 x:0 0 0 2024-08-19T00:56:01.508 INFO:tasks.workunit.client.1.smithi086.stdout:5/301: write d0/d20/f22 [941207,41256] 0 2024-08-19T00:56:01.508 INFO:tasks.workunit.client.1.smithi086.stdout:0/341: fdatasync da/d14/f1b 0 2024-08-19T00:56:01.510 INFO:tasks.workunit.client.1.smithi086.stdout:1/353: mknod d4/d7/d2a/d36/d63/c76 0 2024-08-19T00:56:01.511 INFO:tasks.workunit.client.1.smithi086.stdout:1/354: dread - d4/d7/d2a/f4d zero size 2024-08-19T00:56:01.512 INFO:tasks.workunit.client.1.smithi086.stdout:6/325: creat db/d37/d44/d5a/f63 x:0 0 0 2024-08-19T00:56:01.514 INFO:tasks.workunit.client.1.smithi086.stdout:7/374: creat d3/de/f70 x:0 0 0 2024-08-19T00:56:01.515 INFO:tasks.workunit.client.1.smithi086.stdout:2/277: symlink d8/l5d 0 2024-08-19T00:56:01.515 INFO:tasks.workunit.client.1.smithi086.stdout:1/355: write d4/d1e/f54 [877139,82339] 0 2024-08-19T00:56:01.518 INFO:tasks.workunit.client.1.smithi086.stdout:1/356: fsync d4/f6 0 2024-08-19T00:56:01.520 INFO:tasks.workunit.client.1.smithi086.stdout:4/293: write d2/da/f62 [1842318,52510] 0 2024-08-19T00:56:01.523 INFO:tasks.workunit.client.1.smithi086.stdout:9/334: symlink db/l76 0 2024-08-19T00:56:01.525 INFO:tasks.workunit.client.1.smithi086.stdout:2/278: chown d8/c17 2774764 1 2024-08-19T00:56:01.525 INFO:tasks.workunit.client.1.smithi086.stdout:0/342: dwrite da/d14/d26/f68 [0,4194304] 0 2024-08-19T00:56:01.526 INFO:tasks.workunit.client.1.smithi086.stdout:5/302: dwrite d0/df/d1f/d33/f49 [0,4194304] 0 2024-08-19T00:56:01.526 INFO:tasks.workunit.client.1.smithi086.stdout:8/318: unlink dc/d16/d18/d29/d2e/d28/d2b/f40 0 2024-08-19T00:56:01.530 INFO:tasks.workunit.client.1.smithi086.stdout:8/319: chown dc/c13 967 1 2024-08-19T00:56:01.532 INFO:tasks.workunit.client.1.smithi086.stdout:5/303: dread d0/d20/f53 [0,4194304] 0 2024-08-19T00:56:01.535 INFO:tasks.workunit.client.1.smithi086.stdout:5/304: write d0/f6 [3037016,63849] 0 2024-08-19T00:56:01.536 INFO:tasks.workunit.client.1.smithi086.stdout:6/326: dread db/f3e [0,4194304] 0 2024-08-19T00:56:01.537 INFO:tasks.workunit.client.1.smithi086.stdout:5/305: fsync d0/d2d/d43/f45 0 2024-08-19T00:56:01.538 INFO:tasks.workunit.client.1.smithi086.stdout:4/294: dread d2/d1c/d25/d55/f4a [0,4194304] 0 2024-08-19T00:56:01.539 INFO:tasks.workunit.client.1.smithi086.stdout:4/295: write d2/da/d2f/d59/f63 [364537,5504] 0 2024-08-19T00:56:01.541 INFO:tasks.workunit.client.1.smithi086.stdout:4/296: dread d2/da/f41 [0,4194304] 0 2024-08-19T00:56:01.545 INFO:tasks.workunit.client.1.smithi086.stdout:0/343: creat da/d14/d1a/d2e/d39/d3b/d4e/f77 x:0 0 0 2024-08-19T00:56:01.545 INFO:tasks.workunit.client.1.smithi086.stdout:0/344: chown da/cb 83 1 2024-08-19T00:56:01.549 INFO:tasks.workunit.client.1.smithi086.stdout:0/345: read da/d14/d1a/d2e/d30/f50 [2601808,54561] 0 2024-08-19T00:56:01.550 INFO:tasks.workunit.client.1.smithi086.stdout:6/327: symlink db/d34/l64 0 2024-08-19T00:56:01.553 INFO:tasks.workunit.client.1.smithi086.stdout:2/279: symlink d8/d14/l5e 0 2024-08-19T00:56:01.554 INFO:tasks.workunit.client.1.smithi086.stdout:9/335: dread db/f11 [0,4194304] 0 2024-08-19T00:56:01.554 INFO:tasks.workunit.client.1.smithi086.stdout:3/309: sync 2024-08-19T00:56:01.558 INFO:tasks.workunit.client.1.smithi086.stdout:8/320: getdents dc/d1f/d37/d60 0 2024-08-19T00:56:01.562 INFO:tasks.workunit.client.1.smithi086.stdout:5/306: mkdir d0/d5f 0 2024-08-19T00:56:01.565 INFO:tasks.workunit.client.1.smithi086.stdout:9/336: write db/f11 [4751621,40818] 0 2024-08-19T00:56:01.566 INFO:tasks.workunit.client.1.smithi086.stdout:3/310: mknod d3/c6b 0 2024-08-19T00:56:01.568 INFO:tasks.workunit.client.1.smithi086.stdout:1/357: getdents d4/d7/d2a/d36 0 2024-08-19T00:56:01.570 INFO:tasks.workunit.client.1.smithi086.stdout:7/375: dwrite d3/d34/d44/d3e/f5d [0,4194304] 0 2024-08-19T00:56:01.571 INFO:tasks.workunit.client.1.smithi086.stdout:5/307: dwrite d0/f6 [0,4194304] 0 2024-08-19T00:56:01.572 INFO:tasks.workunit.client.1.smithi086.stdout:8/321: creat dc/d17/d1e/d55/f65 x:0 0 0 2024-08-19T00:56:01.574 INFO:tasks.workunit.client.1.smithi086.stdout:5/308: chown d0/df/d1f/d33/f3d 99969222 1 2024-08-19T00:56:01.579 INFO:tasks.workunit.client.1.smithi086.stdout:9/337: fsync db/d26/f49 0 2024-08-19T00:56:01.580 INFO:tasks.workunit.client.1.smithi086.stdout:1/358: dread d4/d7/d2a/d36/d3a/d41/f4b [0,4194304] 0 2024-08-19T00:56:01.581 INFO:tasks.workunit.client.1.smithi086.stdout:3/311: creat d3/d18/d1a/f6c x:0 0 0 2024-08-19T00:56:01.582 INFO:tasks.workunit.client.1.smithi086.stdout:3/312: write d3/d18/d1a/d53/f44 [1349061,59344] 0 2024-08-19T00:56:01.583 INFO:tasks.workunit.client.1.smithi086.stdout:4/297: creat d2/d18/d33/f64 x:0 0 0 2024-08-19T00:56:01.584 INFO:tasks.workunit.client.1.smithi086.stdout:4/298: fdatasync d2/f1b 0 2024-08-19T00:56:01.585 INFO:tasks.workunit.client.1.smithi086.stdout:4/299: write d2/d1c/d2c/f2e [3561174,6540] 0 2024-08-19T00:56:01.587 INFO:tasks.workunit.client.1.smithi086.stdout:4/300: dread - d2/d1c/d25/f5f zero size 2024-08-19T00:56:01.589 INFO:tasks.workunit.client.1.smithi086.stdout:5/309: rename d0/d20/d52 to d0/d5f/d60 0 2024-08-19T00:56:01.593 INFO:tasks.workunit.client.1.smithi086.stdout:9/338: mknod db/d23/c77 0 2024-08-19T00:56:01.595 INFO:tasks.workunit.client.1.smithi086.stdout:1/359: readlink d4/d1e/d35/d56/l57 0 2024-08-19T00:56:01.596 INFO:tasks.workunit.client.1.smithi086.stdout:7/376: dread d3/d5b/f6c [0,4194304] 0 2024-08-19T00:56:01.598 INFO:tasks.workunit.client.1.smithi086.stdout:3/313: creat d3/d26/d2b/f6d x:0 0 0 2024-08-19T00:56:01.599 INFO:tasks.workunit.client.1.smithi086.stdout:8/322: dread f3 [0,4194304] 0 2024-08-19T00:56:01.603 INFO:tasks.workunit.client.1.smithi086.stdout:4/301: readlink d2/d18/l22 0 2024-08-19T00:56:01.606 INFO:tasks.workunit.client.1.smithi086.stdout:5/310: write d0/f17 [1878450,122930] 0 2024-08-19T00:56:01.607 INFO:tasks.workunit.client.1.smithi086.stdout:5/311: write d0/df/d1f/d33/f55 [698705,57492] 0 2024-08-19T00:56:01.608 INFO:tasks.workunit.client.1.smithi086.stdout:9/339: rename db/d23/d30/d32/f6a to db/d26/d5c/d68/f78 0 2024-08-19T00:56:01.610 INFO:tasks.workunit.client.1.smithi086.stdout:1/360: mknod d4/d7/d2a/c77 0 2024-08-19T00:56:01.611 INFO:tasks.workunit.client.1.smithi086.stdout:1/361: read d4/f6 [3474505,94132] 0 2024-08-19T00:56:01.615 INFO:tasks.workunit.client.1.smithi086.stdout:8/323: symlink dc/d1f/l66 0 2024-08-19T00:56:01.617 INFO:tasks.workunit.client.1.smithi086.stdout:1/362: dwrite d4/d10/f25 [0,4194304] 0 2024-08-19T00:56:01.618 INFO:tasks.workunit.client.1.smithi086.stdout:1/363: write d4/d7/f28 [7621881,5629] 0 2024-08-19T00:56:01.621 INFO:tasks.workunit.client.1.smithi086.stdout:5/312: write d0/d8/d10/f2b [932952,97122] 0 2024-08-19T00:56:01.621 INFO:tasks.workunit.client.1.smithi086.stdout:9/340: dread - db/d23/d30/d32/d44/f65 zero size 2024-08-19T00:56:01.626 INFO:tasks.workunit.client.1.smithi086.stdout:3/314: creat d3/d18/d19/d62/d46/f6e x:0 0 0 2024-08-19T00:56:01.628 INFO:tasks.workunit.client.1.smithi086.stdout:9/341: dwrite db/f11 [0,4194304] 0 2024-08-19T00:56:01.628 INFO:tasks.workunit.client.1.smithi086.stdout:3/315: dread - d3/d26/d2b/f6d zero size 2024-08-19T00:56:01.629 INFO:tasks.workunit.client.1.smithi086.stdout:9/342: stat db/d23/f54 0 2024-08-19T00:56:01.630 INFO:tasks.workunit.client.1.smithi086.stdout:8/324: symlink dc/d16/d18/d29/d2e/d28/d2b/d3b/l67 0 2024-08-19T00:56:01.630 INFO:tasks.workunit.client.1.smithi086.stdout:3/316: write d3/d18/d27/d49/d3f/f47 [723571,109027] 0 2024-08-19T00:56:01.632 INFO:tasks.workunit.client.1.smithi086.stdout:8/325: write dc/d16/d18/d29/d2e/f3f [2831221,15426] 0 2024-08-19T00:56:01.635 INFO:tasks.workunit.client.1.smithi086.stdout:1/364: creat d4/d7/d2a/d36/d63/f78 x:0 0 0 2024-08-19T00:56:01.638 INFO:tasks.workunit.client.1.smithi086.stdout:9/343: unlink db/dd/c2b 0 2024-08-19T00:56:01.638 INFO:tasks.workunit.client.1.smithi086.stdout:3/317: dwrite d3/d18/d27/d48/f4b [0,4194304] 0 2024-08-19T00:56:01.639 INFO:tasks.workunit.client.1.smithi086.stdout:9/344: write db/f1b [3354062,70289] 0 2024-08-19T00:56:01.640 INFO:tasks.workunit.client.1.smithi086.stdout:3/318: truncate d3/d26/d2b/f38 645611 0 2024-08-19T00:56:01.644 INFO:tasks.workunit.client.1.smithi086.stdout:8/326: mknod dc/d16/d18/d29/d2e/d28/d2b/c68 0 2024-08-19T00:56:01.644 INFO:tasks.workunit.client.1.smithi086.stdout:7/377: truncate d3/de/f12 3006743 0 2024-08-19T00:56:01.645 INFO:tasks.workunit.client.1.smithi086.stdout:5/313: mknod d0/d2d/c61 0 2024-08-19T00:56:01.645 INFO:tasks.workunit.client.1.smithi086.stdout:3/319: read d3/d18/d19/d37/d5a/f65 [138451,95664] 0 2024-08-19T00:56:01.645 INFO:tasks.workunit.client.1.smithi086.stdout:5/314: fdatasync d0/df/f1a 0 2024-08-19T00:56:01.646 INFO:tasks.workunit.client.1.smithi086.stdout:3/320: chown d3/cc 2 1 2024-08-19T00:56:01.646 INFO:tasks.workunit.client.1.smithi086.stdout:5/315: chown d0/d5f/d60 2 1 2024-08-19T00:56:01.647 INFO:tasks.workunit.client.1.smithi086.stdout:1/365: write d4/d7/d2a/d36/d3a/f3e [1161537,66463] 0 2024-08-19T00:56:01.655 INFO:tasks.workunit.client.1.smithi086.stdout:8/327: fsync dc/d16/d18/d29/d32/f3d 0 2024-08-19T00:56:01.661 INFO:tasks.workunit.client.1.smithi086.stdout:3/321: mknod d3/d26/d2b/d33/c6f 0 2024-08-19T00:56:01.661 INFO:tasks.workunit.client.1.smithi086.stdout:7/378: dread d3/f38 [0,4194304] 0 2024-08-19T00:56:01.674 INFO:tasks.workunit.client.1.smithi086.stdout:3/322: creat d3/d18/d27/d49/d3f/d5b/f70 x:0 0 0 2024-08-19T00:56:01.676 INFO:tasks.workunit.client.1.smithi086.stdout:1/366: symlink d4/d10/d75/l79 0 2024-08-19T00:56:01.677 INFO:tasks.workunit.client.1.smithi086.stdout:1/367: write d4/d7/d2a/f6b [763901,94258] 0 2024-08-19T00:56:01.679 INFO:tasks.workunit.client.1.smithi086.stdout:9/345: dwrite db/d23/d6d/f41 [0,4194304] 0 2024-08-19T00:56:01.680 INFO:tasks.workunit.client.1.smithi086.stdout:9/346: read db/d26/f49 [121082,48390] 0 2024-08-19T00:56:01.680 INFO:tasks.workunit.client.1.smithi086.stdout:8/328: truncate f3 4706551 0 2024-08-19T00:56:01.681 INFO:tasks.workunit.client.1.smithi086.stdout:5/316: rename d0/d2d/c61 to d0/c62 0 2024-08-19T00:56:01.682 INFO:tasks.workunit.client.1.smithi086.stdout:5/317: chown d0/d20/f22 12321376 1 2024-08-19T00:56:01.684 INFO:tasks.workunit.client.1.smithi086.stdout:3/323: creat d3/d26/d60/f71 x:0 0 0 2024-08-19T00:56:01.688 INFO:tasks.workunit.client.1.smithi086.stdout:1/368: unlink d4/l31 0 2024-08-19T00:56:01.692 INFO:tasks.workunit.client.1.smithi086.stdout:9/347: unlink fa 0 2024-08-19T00:56:01.693 INFO:tasks.workunit.client.1.smithi086.stdout:7/379: creat d3/d34/d44/f71 x:0 0 0 2024-08-19T00:56:01.699 INFO:tasks.workunit.client.1.smithi086.stdout:0/346: sync 2024-08-19T00:56:01.699 INFO:tasks.workunit.client.1.smithi086.stdout:0/347: stat da/c1f 0 2024-08-19T00:56:01.699 INFO:tasks.workunit.client.1.smithi086.stdout:0/348: dread - da/d5d/f75 zero size 2024-08-19T00:56:01.701 INFO:tasks.workunit.client.1.smithi086.stdout:0/349: truncate da/d14/d1a/d2e/d39/f69 250523 0 2024-08-19T00:56:01.701 INFO:tasks.workunit.client.1.smithi086.stdout:0/350: write da/d14/f17 [3990038,2710] 0 2024-08-19T00:56:01.707 INFO:tasks.workunit.client.1.smithi086.stdout:7/380: mkdir d3/de/d68/d72 0 2024-08-19T00:56:01.709 INFO:tasks.workunit.client.1.smithi086.stdout:7/381: write d3/d5b/f6f [796123,12167] 0 2024-08-19T00:56:01.709 INFO:tasks.workunit.client.1.smithi086.stdout:3/324: dread d3/d18/f1c [0,4194304] 0 2024-08-19T00:56:01.710 INFO:tasks.workunit.client.1.smithi086.stdout:3/325: read - d3/d26/d60/f69 zero size 2024-08-19T00:56:01.710 INFO:tasks.workunit.client.1.smithi086.stdout:3/326: stat d3/d26/d2b 0 2024-08-19T00:56:01.714 INFO:tasks.workunit.client.1.smithi086.stdout:0/351: symlink da/d14/d44/d49/l78 0 2024-08-19T00:56:01.714 INFO:tasks.workunit.client.1.smithi086.stdout:0/352: write da/d14/d26/f68 [4510647,106796] 0 2024-08-19T00:56:01.722 INFO:tasks.workunit.client.1.smithi086.stdout:3/327: mknod d3/d18/d19/d37/d5a/c72 0 2024-08-19T00:56:01.724 INFO:tasks.workunit.client.1.smithi086.stdout:7/382: rmdir d3/de 39 2024-08-19T00:56:01.726 INFO:tasks.workunit.client.1.smithi086.stdout:8/329: truncate dc/d16/d18/d29/d2e/d28/d2b/f5f 4146464 0 2024-08-19T00:56:01.727 INFO:tasks.workunit.client.1.smithi086.stdout:0/353: creat da/d14/d55/f79 x:0 0 0 2024-08-19T00:56:01.727 INFO:tasks.workunit.client.1.smithi086.stdout:0/354: stat da/d14/l47 0 2024-08-19T00:56:01.728 INFO:tasks.workunit.client.1.smithi086.stdout:1/369: mkdir d4/d10/d75/d7a 0 2024-08-19T00:56:01.731 INFO:tasks.workunit.client.1.smithi086.stdout:9/348: truncate db/d23/f2a 2333666 0 2024-08-19T00:56:01.732 INFO:tasks.workunit.client.1.smithi086.stdout:8/330: creat dc/d16/d18/d29/d2e/d28/f69 x:0 0 0 2024-08-19T00:56:01.732 INFO:tasks.workunit.client.1.smithi086.stdout:8/331: fdatasync dc/d1f/f4c 0 2024-08-19T00:56:01.733 INFO:tasks.workunit.client.1.smithi086.stdout:0/355: creat da/d5d/f7a x:0 0 0 2024-08-19T00:56:01.734 INFO:tasks.workunit.client.1.smithi086.stdout:0/356: readlink da/d14/d44/d49/l78 0 2024-08-19T00:56:01.735 INFO:tasks.workunit.client.1.smithi086.stdout:1/370: dread - d4/d7/d2a/d36/f71 zero size 2024-08-19T00:56:01.735 INFO:tasks.workunit.client.1.smithi086.stdout:3/328: link d3/f6 d3/d26/f73 0 2024-08-19T00:56:01.736 INFO:tasks.workunit.client.1.smithi086.stdout:3/329: write d3/d18/f24 [199869,18721] 0 2024-08-19T00:56:01.736 INFO:tasks.workunit.client.1.smithi086.stdout:7/383: fsync d3/de/f17 0 2024-08-19T00:56:01.737 INFO:tasks.workunit.client.1.smithi086.stdout:7/384: chown d3/de/f27 0 1 2024-08-19T00:56:01.738 INFO:tasks.workunit.client.1.smithi086.stdout:3/330: truncate d3/d18/f36 276135 0 2024-08-19T00:56:01.738 INFO:tasks.workunit.client.1.smithi086.stdout:9/349: write db/f20 [1132036,56135] 0 2024-08-19T00:56:01.739 INFO:tasks.workunit.client.1.smithi086.stdout:3/331: write d3/d18/d1a/d53/f21 [606192,38108] 0 2024-08-19T00:56:01.742 INFO:tasks.workunit.client.1.smithi086.stdout:1/371: creat d4/d10/f7b x:0 0 0 2024-08-19T00:56:01.749 INFO:tasks.workunit.client.1.smithi086.stdout:3/332: rename d3/d18/d19/l2e to d3/d26/d2b/l74 0 2024-08-19T00:56:01.751 INFO:tasks.workunit.client.1.smithi086.stdout:7/385: truncate d3/ff 16418 0 2024-08-19T00:56:01.751 INFO:tasks.workunit.client.1.smithi086.stdout:7/386: write d3/de/f70 [308804,108704] 0 2024-08-19T00:56:01.752 INFO:tasks.workunit.client.1.smithi086.stdout:7/387: fsync d3/d5b/f6a 0 2024-08-19T00:56:01.753 INFO:tasks.workunit.client.1.smithi086.stdout:1/372: write d4/d1e/d35/f5b [150246,103358] 0 2024-08-19T00:56:01.754 INFO:tasks.workunit.client.1.smithi086.stdout:7/388: read d3/de/f66 [327145,115567] 0 2024-08-19T00:56:01.754 INFO:tasks.workunit.client.1.smithi086.stdout:3/333: truncate d3/f5 2054610 0 2024-08-19T00:56:01.756 INFO:tasks.workunit.client.1.smithi086.stdout:7/389: dread d3/de/f70 [0,4194304] 0 2024-08-19T00:56:01.756 INFO:tasks.workunit.client.1.smithi086.stdout:1/373: mknod d4/d10/d75/c7c 0 2024-08-19T00:56:01.758 INFO:tasks.workunit.client.1.smithi086.stdout:3/334: mkdir d3/d18/d1a/d51/d75 0 2024-08-19T00:56:01.760 INFO:tasks.workunit.client.1.smithi086.stdout:1/374: chown d4/cc 542507 1 2024-08-19T00:56:01.762 INFO:tasks.workunit.client.1.smithi086.stdout:0/357: truncate da/d14/d26/f38 1313138 0 2024-08-19T00:56:01.763 INFO:tasks.workunit.client.1.smithi086.stdout:8/332: dwrite dc/d16/d18/d29/d32/f3d [4194304,4194304] 0 2024-08-19T00:56:01.770 INFO:tasks.workunit.client.1.smithi086.stdout:9/350: dwrite db/d26/d5c/d68/f6f [0,4194304] 0 2024-08-19T00:56:01.771 INFO:tasks.workunit.client.1.smithi086.stdout:8/333: creat dc/d17/d1e/d55/f6a x:0 0 0 2024-08-19T00:56:01.772 INFO:tasks.workunit.client.1.smithi086.stdout:3/335: dwrite d3/d18/d27/d49/d3f/d5b/f70 [0,4194304] 0 2024-08-19T00:56:01.775 INFO:tasks.workunit.client.1.smithi086.stdout:1/375: getdents d4/d7/d2a/d36/d3a/d41 0 2024-08-19T00:56:01.785 INFO:tasks.workunit.client.1.smithi086.stdout:1/376: unlink d4/d10/f7b 0 2024-08-19T00:56:01.786 INFO:tasks.workunit.client.1.smithi086.stdout:2/280: sync 2024-08-19T00:56:01.786 INFO:tasks.workunit.client.1.smithi086.stdout:6/328: sync 2024-08-19T00:56:01.786 INFO:tasks.workunit.client.1.smithi086.stdout:4/302: sync 2024-08-19T00:56:01.786 INFO:tasks.workunit.client.1.smithi086.stdout:7/390: dwrite d3/d34/d44/d58/d4b/f6d [4194304,4194304] 0 2024-08-19T00:56:01.786 INFO:tasks.workunit.client.1.smithi086.stdout:0/358: dwrite da/d14/d55/f79 [0,4194304] 0 2024-08-19T00:56:01.789 INFO:tasks.workunit.client.1.smithi086.stdout:9/351: rename db/d26/f29 to db/dd/d19/d38/f79 0 2024-08-19T00:56:01.793 INFO:tasks.workunit.client.1.smithi086.stdout:1/377: mkdir d4/d7/d2a/d36/d7d 0 2024-08-19T00:56:01.795 INFO:tasks.workunit.client.1.smithi086.stdout:0/359: mkdir da/d14/d44/d7b 0 2024-08-19T00:56:01.801 INFO:tasks.workunit.client.1.smithi086.stdout:7/391: mknod d3/d34/d44/d58/d4b/c73 0 2024-08-19T00:56:01.802 INFO:tasks.workunit.client.1.smithi086.stdout:8/334: getdents dc/d16/d18/d29/d2e/d28/d41 0 2024-08-19T00:56:01.804 INFO:tasks.workunit.client.1.smithi086.stdout:6/329: write db/d37/d30/f3f [1565048,129850] 0 2024-08-19T00:56:01.804 INFO:tasks.workunit.client.1.smithi086.stdout:4/303: creat d2/d18/d33/f65 x:0 0 0 2024-08-19T00:56:01.804 INFO:tasks.workunit.client.1.smithi086.stdout:0/360: symlink da/l7c 0 2024-08-19T00:56:01.806 INFO:tasks.workunit.client.1.smithi086.stdout:8/335: unlink dc/d16/l56 0 2024-08-19T00:56:01.808 INFO:tasks.workunit.client.1.smithi086.stdout:1/378: dwrite d4/d7/d2a/d36/d3a/f72 [4194304,4194304] 0 2024-08-19T00:56:01.809 INFO:tasks.workunit.client.1.smithi086.stdout:6/330: stat db/d37/d30/f49 0 2024-08-19T00:56:01.809 INFO:tasks.workunit.client.1.smithi086.stdout:0/361: chown da/d14/d44/d49/l78 32163961 1 2024-08-19T00:56:01.810 INFO:tasks.workunit.client.1.smithi086.stdout:8/336: write dc/d17/d1e/d55/f65 [382576,93535] 0 2024-08-19T00:56:01.814 INFO:tasks.workunit.client.1.smithi086.stdout:9/352: dwrite db/d26/d5c/d68/f78 [0,4194304] 0 2024-08-19T00:56:01.814 INFO:tasks.workunit.client.1.smithi086.stdout:1/379: readlink d4/d1e/l29 0 2024-08-19T00:56:01.815 INFO:tasks.workunit.client.1.smithi086.stdout:7/392: truncate d3/d34/d44/f48 204122 0 2024-08-19T00:56:01.817 INFO:tasks.workunit.client.1.smithi086.stdout:0/362: readlink da/d14/l3a 0 2024-08-19T00:56:01.817 INFO:tasks.workunit.client.1.smithi086.stdout:4/304: link d2/da/l4b d2/d18/d60/l66 0 2024-08-19T00:56:01.820 INFO:tasks.workunit.client.1.smithi086.stdout:5/318: sync 2024-08-19T00:56:01.821 INFO:tasks.workunit.client.1.smithi086.stdout:6/331: creat db/d34/d4e/d55/f65 x:0 0 0 2024-08-19T00:56:01.822 INFO:tasks.workunit.client.1.smithi086.stdout:8/337: symlink dc/d16/d18/l6b 0 2024-08-19T00:56:01.822 INFO:tasks.workunit.client.1.smithi086.stdout:9/353: mkdir db/d23/d30/d3f/d43/d4e/d7a 0 2024-08-19T00:56:01.828 INFO:tasks.workunit.client.1.smithi086.stdout:9/354: chown db/d26/d5c/d68/f78 642709 1 2024-08-19T00:56:01.828 INFO:tasks.workunit.client.1.smithi086.stdout:5/319: rename d0/c13 to d0/d8/c63 0 2024-08-19T00:56:01.829 INFO:tasks.workunit.client.1.smithi086.stdout:6/332: read db/d34/d39/f48 [2461126,35311] 0 2024-08-19T00:56:01.830 INFO:tasks.workunit.client.1.smithi086.stdout:3/336: dread d3/d9/f39 [0,4194304] 0 2024-08-19T00:56:01.833 INFO:tasks.workunit.client.1.smithi086.stdout:1/380: dwrite d4/d1e/d35/f4a [0,4194304] 0 2024-08-19T00:56:01.834 INFO:tasks.workunit.client.1.smithi086.stdout:7/393: rename d3/d34/d44/d58/d4b/f23 to d3/d34/d44/d3e/f74 0 2024-08-19T00:56:01.835 INFO:tasks.workunit.client.1.smithi086.stdout:4/305: dwrite d2/f1b [4194304,4194304] 0 2024-08-19T00:56:01.836 INFO:tasks.workunit.client.1.smithi086.stdout:5/320: write d0/f29 [3620859,44499] 0 2024-08-19T00:56:01.837 INFO:tasks.workunit.client.1.smithi086.stdout:1/381: readlink d4/d1e/d6f/l70 0 2024-08-19T00:56:01.838 INFO:tasks.workunit.client.1.smithi086.stdout:7/394: readlink d3/d34/d44/d3e/l45 0 2024-08-19T00:56:01.839 INFO:tasks.workunit.client.1.smithi086.stdout:9/355: rmdir db/d26/d5c/d68 39 2024-08-19T00:56:01.839 INFO:tasks.workunit.client.1.smithi086.stdout:2/281: dread d8/d14/f22 [0,4194304] 0 2024-08-19T00:56:01.839 INFO:tasks.workunit.client.1.smithi086.stdout:5/321: chown d0/f6 12235 1 2024-08-19T00:56:01.839 INFO:tasks.workunit.client.1.smithi086.stdout:0/363: dwrite da/f56 [0,4194304] 0 2024-08-19T00:56:01.842 INFO:tasks.workunit.client.1.smithi086.stdout:4/306: chown d2/d1c/d25/d55/l4c 7 1 2024-08-19T00:56:01.842 INFO:tasks.workunit.client.1.smithi086.stdout:2/282: chown d8/d43/f48 1097136 1 2024-08-19T00:56:01.842 INFO:tasks.workunit.client.1.smithi086.stdout:0/364: readlink da/d14/d44/l57 0 2024-08-19T00:56:01.843 INFO:tasks.workunit.client.1.smithi086.stdout:4/307: stat d2/c11 0 2024-08-19T00:56:01.846 INFO:tasks.workunit.client.1.smithi086.stdout:6/333: creat db/d34/d4e/f66 x:0 0 0 2024-08-19T00:56:01.849 INFO:tasks.workunit.client.1.smithi086.stdout:3/337: mkdir d3/d18/d27/d76 0 2024-08-19T00:56:01.850 INFO:tasks.workunit.client.1.smithi086.stdout:7/395: write d3/f3a [2099440,55645] 0 2024-08-19T00:56:01.852 INFO:tasks.workunit.client.1.smithi086.stdout:3/338: dread - d3/d26/f59 zero size 2024-08-19T00:56:01.853 INFO:tasks.workunit.client.1.smithi086.stdout:4/308: creat d2/d1c/f67 x:0 0 0 2024-08-19T00:56:01.853 INFO:tasks.workunit.client.1.smithi086.stdout:9/356: mknod db/c7b 0 2024-08-19T00:56:01.855 INFO:tasks.workunit.client.1.smithi086.stdout:2/283: symlink d8/d24/d32/d4d/l5f 0 2024-08-19T00:56:01.855 INFO:tasks.workunit.client.1.smithi086.stdout:7/396: fsync d3/d34/d44/d3e/f5c 0 2024-08-19T00:56:01.855 INFO:tasks.workunit.client.1.smithi086.stdout:6/334: creat db/d34/d39/f67 x:0 0 0 2024-08-19T00:56:01.856 INFO:tasks.workunit.client.1.smithi086.stdout:0/365: creat da/d14/d1a/d2e/d30/d76/f7d x:0 0 0 2024-08-19T00:56:01.858 INFO:tasks.workunit.client.1.smithi086.stdout:4/309: stat d2/d1c/d25/f54 0 2024-08-19T00:56:01.859 INFO:tasks.workunit.client.1.smithi086.stdout:5/322: dwrite d0/df/d1f/d33/f3d [0,4194304] 0 2024-08-19T00:56:01.860 INFO:tasks.workunit.client.1.smithi086.stdout:0/366: fsync da/d14/f1d 0 2024-08-19T00:56:01.860 INFO:tasks.workunit.client.1.smithi086.stdout:9/357: fdatasync db/d23/d30/d58/f5b 0 2024-08-19T00:56:01.861 INFO:tasks.workunit.client.1.smithi086.stdout:2/284: stat d8/f1a 0 2024-08-19T00:56:01.863 INFO:tasks.workunit.client.1.smithi086.stdout:8/338: dwrite dc/d16/d18/d29/d2e/d28/d2b/f5f [0,4194304] 0 2024-08-19T00:56:01.865 INFO:tasks.workunit.client.1.smithi086.stdout:3/339: creat d3/d18/d27/d49/d3f/d54/f77 x:0 0 0 2024-08-19T00:56:01.868 INFO:tasks.workunit.client.1.smithi086.stdout:4/310: symlink d2/d1c/d25/l68 0 2024-08-19T00:56:01.868 INFO:tasks.workunit.client.1.smithi086.stdout:7/397: mknod d3/de/d68/d72/c75 0 2024-08-19T00:56:01.869 INFO:tasks.workunit.client.1.smithi086.stdout:1/382: dwrite d4/d7/d2a/d36/f45 [0,4194304] 0 2024-08-19T00:56:01.871 INFO:tasks.workunit.client.1.smithi086.stdout:6/335: truncate db/d37/d30/f3a 2252810 0 2024-08-19T00:56:01.871 INFO:tasks.workunit.client.1.smithi086.stdout:0/367: mkdir da/d14/d1a/d2e/d7e 0 2024-08-19T00:56:01.874 INFO:tasks.workunit.client.1.smithi086.stdout:3/340: mkdir d3/d26/d2b/d33/d4a/d78 0 2024-08-19T00:56:01.875 INFO:tasks.workunit.client.1.smithi086.stdout:0/368: chown da/d14/d1a/d2e/d30/f4c 55 1 2024-08-19T00:56:01.875 INFO:tasks.workunit.client.1.smithi086.stdout:2/285: creat d8/f60 x:0 0 0 2024-08-19T00:56:01.876 INFO:tasks.workunit.client.1.smithi086.stdout:8/339: symlink dc/d16/d18/d29/d2e/d28/d2b/d3b/l6c 0 2024-08-19T00:56:01.878 INFO:tasks.workunit.client.1.smithi086.stdout:5/323: dwrite d0/d2d/d4f/f5a [0,4194304] 0 2024-08-19T00:56:01.879 INFO:tasks.workunit.client.1.smithi086.stdout:0/369: read - da/d5d/f75 zero size 2024-08-19T00:56:01.880 INFO:tasks.workunit.client.1.smithi086.stdout:3/341: creat d3/d26/f79 x:0 0 0 2024-08-19T00:56:01.882 INFO:tasks.workunit.client.1.smithi086.stdout:4/311: creat d2/f69 x:0 0 0 2024-08-19T00:56:01.882 INFO:tasks.workunit.client.1.smithi086.stdout:8/340: readlink dc/d16/d18/d29/d2e/l2c 0 2024-08-19T00:56:01.882 INFO:tasks.workunit.client.1.smithi086.stdout:2/286: mkdir d8/d24/d32/d61 0 2024-08-19T00:56:01.882 INFO:tasks.workunit.client.1.smithi086.stdout:5/324: dread - d0/d2d/f32 zero size 2024-08-19T00:56:01.884 INFO:tasks.workunit.client.1.smithi086.stdout:4/312: readlink d2/da/l15 0 2024-08-19T00:56:01.888 INFO:tasks.workunit.client.1.smithi086.stdout:1/383: getdents d4/d7 0 2024-08-19T00:56:01.889 INFO:tasks.workunit.client.1.smithi086.stdout:9/358: dwrite db/dd/d19/d38/f79 [0,4194304] 0 2024-08-19T00:56:01.890 INFO:tasks.workunit.client.1.smithi086.stdout:6/336: getdents db/d37/d30 0 2024-08-19T00:56:01.893 INFO:tasks.workunit.client.1.smithi086.stdout:7/398: dwrite d3/de/d2d/f32 [0,4194304] 0 2024-08-19T00:56:01.895 INFO:tasks.workunit.client.1.smithi086.stdout:9/359: chown db/d23/d30/d32/f3a 140943 1 2024-08-19T00:56:01.895 INFO:tasks.workunit.client.1.smithi086.stdout:8/341: creat dc/d17/f6d x:0 0 0 2024-08-19T00:56:01.896 INFO:tasks.workunit.client.1.smithi086.stdout:9/360: dread - db/f57 zero size 2024-08-19T00:56:01.896 INFO:tasks.workunit.client.1.smithi086.stdout:5/325: dread d0/f17 [0,4194304] 0 2024-08-19T00:56:01.899 INFO:tasks.workunit.client.1.smithi086.stdout:3/342: creat d3/d18/d61/f7a x:0 0 0 2024-08-19T00:56:01.899 INFO:tasks.workunit.client.1.smithi086.stdout:3/343: readlink d3/d18/d19/d37/l45 0 2024-08-19T00:56:01.900 INFO:tasks.workunit.client.1.smithi086.stdout:0/370: creat da/d14/d1a/d2e/d39/f7f x:0 0 0 2024-08-19T00:56:01.902 INFO:tasks.workunit.client.1.smithi086.stdout:0/371: read da/d14/f1b [444334,105481] 0 2024-08-19T00:56:01.902 INFO:tasks.workunit.client.1.smithi086.stdout:1/384: creat d4/d7/d2a/d36/d3a/d41/f7e x:0 0 0 2024-08-19T00:56:01.905 INFO:tasks.workunit.client.1.smithi086.stdout:4/313: rename d2/d1c/d25/d55/f40 to d2/d1c/d25/d55/d4d/f6a 0 2024-08-19T00:56:01.907 INFO:tasks.workunit.client.1.smithi086.stdout:2/287: dread d8/d14/f2f [0,4194304] 0 2024-08-19T00:56:01.907 INFO:tasks.workunit.client.1.smithi086.stdout:6/337: mkdir db/d34/d4e/d68 0 2024-08-19T00:56:01.908 INFO:tasks.workunit.client.1.smithi086.stdout:7/399: creat d3/d34/f76 x:0 0 0 2024-08-19T00:56:01.909 INFO:tasks.workunit.client.1.smithi086.stdout:8/342: rmdir dc/d16/d18/d29 39 2024-08-19T00:56:01.913 INFO:tasks.workunit.client.1.smithi086.stdout:8/343: stat dc/d17/d1e/d55/f6a 0 2024-08-19T00:56:01.915 INFO:tasks.workunit.client.1.smithi086.stdout:3/344: mkdir d3/d26/d7b 0 2024-08-19T00:56:01.916 INFO:tasks.workunit.client.1.smithi086.stdout:1/385: symlink d4/d10/l7f 0 2024-08-19T00:56:01.918 INFO:tasks.workunit.client.1.smithi086.stdout:9/361: rename db/d23/d30/d32/d44/l47 to db/d23/l7c 0 2024-08-19T00:56:01.918 INFO:tasks.workunit.client.1.smithi086.stdout:6/338: mkdir db/d34/d69 0 2024-08-19T00:56:01.919 INFO:tasks.workunit.client.1.smithi086.stdout:7/400: symlink d3/de/d2d/l77 0 2024-08-19T00:56:01.922 INFO:tasks.workunit.client.1.smithi086.stdout:2/288: dwrite d8/d43/f5a [0,4194304] 0 2024-08-19T00:56:01.922 INFO:tasks.workunit.client.1.smithi086.stdout:7/401: stat d3/d5b/f6c 0 2024-08-19T00:56:01.924 INFO:tasks.workunit.client.1.smithi086.stdout:3/345: write d3/d18/d19/d62/d46/f6e [636859,122101] 0 2024-08-19T00:56:01.926 INFO:tasks.workunit.client.1.smithi086.stdout:4/314: rename d2/d18/d60 to d2/d1c/d25/d6b 0 2024-08-19T00:56:01.929 INFO:tasks.workunit.client.1.smithi086.stdout:9/362: rmdir db/d23/d30 39 2024-08-19T00:56:01.930 INFO:tasks.workunit.client.1.smithi086.stdout:6/339: mknod db/d37/d41/c6a 0 2024-08-19T00:56:01.930 INFO:tasks.workunit.client.1.smithi086.stdout:0/372: link da/d5d/l6c da/d14/d44/d49/l80 0 2024-08-19T00:56:01.931 INFO:tasks.workunit.client.1.smithi086.stdout:5/326: dwrite d0/d2d/d43/f48 [0,4194304] 0 2024-08-19T00:56:01.932 INFO:tasks.workunit.client.1.smithi086.stdout:8/344: rename dc/f57 to dc/d16/d18/d29/d2e/d28/d2b/f6e 0 2024-08-19T00:56:01.932 INFO:tasks.workunit.client.1.smithi086.stdout:4/315: truncate d2/d1c/d2c/f43 708403 0 2024-08-19T00:56:01.940 INFO:tasks.workunit.client.1.smithi086.stdout:1/386: link d4/d7/d2a/d36/d3a/f72 d4/d7/d2a/d36/d63/f80 0 2024-08-19T00:56:01.941 INFO:tasks.workunit.client.1.smithi086.stdout:0/373: creat da/d14/d44/f81 x:0 0 0 2024-08-19T00:56:01.942 INFO:tasks.workunit.client.1.smithi086.stdout:0/374: chown da/d14/d1a/d2e/d30/f50 7 1 2024-08-19T00:56:01.943 INFO:tasks.workunit.client.1.smithi086.stdout:4/316: mkdir d2/d1c/d25/d55/d6c 0 2024-08-19T00:56:01.945 INFO:tasks.workunit.client.1.smithi086.stdout:8/345: creat dc/d16/d18/d29/d32/f6f x:0 0 0 2024-08-19T00:56:01.947 INFO:tasks.workunit.client.1.smithi086.stdout:5/327: mknod d0/d8/c64 0 2024-08-19T00:56:01.948 INFO:tasks.workunit.client.1.smithi086.stdout:5/328: write d0/d2d/d4f/f5a [2222130,3417] 0 2024-08-19T00:56:01.949 INFO:tasks.workunit.client.1.smithi086.stdout:1/387: rmdir d4/d7/d2a/d36 39 2024-08-19T00:56:01.951 INFO:tasks.workunit.client.1.smithi086.stdout:0/375: symlink da/d14/d44/d49/l82 0 2024-08-19T00:56:01.954 INFO:tasks.workunit.client.1.smithi086.stdout:8/346: unlink ca 0 2024-08-19T00:56:01.955 INFO:tasks.workunit.client.1.smithi086.stdout:9/363: rmdir db/d5e/d75 0 2024-08-19T00:56:01.956 INFO:tasks.workunit.client.1.smithi086.stdout:2/289: dwrite d8/d24/f2b [0,4194304] 0 2024-08-19T00:56:01.958 INFO:tasks.workunit.client.1.smithi086.stdout:4/317: dread d2/d18/d33/f36 [0,4194304] 0 2024-08-19T00:56:01.959 INFO:tasks.workunit.client.1.smithi086.stdout:5/329: mkdir d0/df/d1f/d65 0 2024-08-19T00:56:01.963 INFO:tasks.workunit.client.1.smithi086.stdout:1/388: rmdir d4/d7/d2a/d6e 39 2024-08-19T00:56:01.964 INFO:tasks.workunit.client.1.smithi086.stdout:0/376: readlink da/d14/d26/l2a 0 2024-08-19T00:56:01.966 INFO:tasks.workunit.client.1.smithi086.stdout:7/402: rename d3/de/d4f to d3/d34/d44/d58/d4b/d78 0 2024-08-19T00:56:01.966 INFO:tasks.workunit.client.1.smithi086.stdout:2/290: write d8/d24/f59 [3441637,29581] 0 2024-08-19T00:56:01.967 INFO:tasks.workunit.client.1.smithi086.stdout:0/377: chown da/c21 1046825 1 2024-08-19T00:56:01.968 INFO:tasks.workunit.client.1.smithi086.stdout:4/318: creat d2/d1c/f6d x:0 0 0 2024-08-19T00:56:01.971 INFO:tasks.workunit.client.1.smithi086.stdout:7/403: symlink d3/d5b/l79 0 2024-08-19T00:56:01.975 INFO:tasks.workunit.client.1.smithi086.stdout:1/389: write d4/d7/d2a/d36/d3a/d41/f67 [406116,48435] 0 2024-08-19T00:56:01.975 INFO:tasks.workunit.client.1.smithi086.stdout:6/340: dwrite db/d34/d4e/d55/f32 [0,4194304] 0 2024-08-19T00:56:01.977 INFO:tasks.workunit.client.1.smithi086.stdout:4/319: mkdir d2/d1c/d25/d6b/d6e 0 2024-08-19T00:56:01.979 INFO:tasks.workunit.client.1.smithi086.stdout:4/320: stat d2/d18/l53 0 2024-08-19T00:56:01.979 INFO:tasks.workunit.client.1.smithi086.stdout:5/330: dwrite d0/d2d/f32 [0,4194304] 0 2024-08-19T00:56:01.980 INFO:tasks.workunit.client.1.smithi086.stdout:7/404: rmdir d3 39 2024-08-19T00:56:01.981 INFO:tasks.workunit.client.1.smithi086.stdout:8/347: dread dc/d16/d18/d29/d2e/d28/d2b/f6e [0,4194304] 0 2024-08-19T00:56:01.982 INFO:tasks.workunit.client.1.smithi086.stdout:2/291: dwrite d8/d2c/d38/f42 [0,4194304] 0 2024-08-19T00:56:01.986 INFO:tasks.workunit.client.1.smithi086.stdout:9/364: dread db/d23/d37/f48 [0,4194304] 0 2024-08-19T00:56:01.987 INFO:tasks.workunit.client.1.smithi086.stdout:4/321: creat d2/d18/f6f x:0 0 0 2024-08-19T00:56:02.033 INFO:tasks.workunit.client.1.smithi086.stdout:0/378: link da/d14/d1a/c25 da/d14/d1a/d2e/d66/c83 0 2024-08-19T00:56:02.034 INFO:tasks.workunit.client.1.smithi086.stdout:2/292: creat d8/d24/d32/f62 x:0 0 0 2024-08-19T00:56:02.035 INFO:tasks.workunit.client.1.smithi086.stdout:2/293: chown f2 14687 1 2024-08-19T00:56:02.036 INFO:tasks.workunit.client.1.smithi086.stdout:6/341: dread db/d37/d30/f3a [0,4194304] 0 2024-08-19T00:56:02.037 INFO:tasks.workunit.client.1.smithi086.stdout:4/322: unlink d2/d1c/d25/d55/l56 0 2024-08-19T00:56:02.037 INFO:tasks.workunit.client.1.smithi086.stdout:0/379: mknod da/d14/d1a/d2e/d66/c84 0 2024-08-19T00:56:02.039 INFO:tasks.workunit.client.1.smithi086.stdout:2/294: readlink d8/d2c/d47/l5b 0 2024-08-19T00:56:02.039 INFO:tasks.workunit.client.1.smithi086.stdout:6/342: readlink db/d37/l2a 0 2024-08-19T00:56:02.039 INFO:tasks.workunit.client.1.smithi086.stdout:5/331: rename d0/d8/c59 to d0/c66 0 2024-08-19T00:56:02.041 INFO:tasks.workunit.client.1.smithi086.stdout:8/348: getdents dc 0 2024-08-19T00:56:02.042 INFO:tasks.workunit.client.1.smithi086.stdout:4/323: readlink d2/l4e 0 2024-08-19T00:56:02.043 INFO:tasks.workunit.client.1.smithi086.stdout:1/390: dwrite d4/d10/f4f [0,4194304] 0 2024-08-19T00:56:02.044 INFO:tasks.workunit.client.1.smithi086.stdout:8/349: mkdir dc/d70 0 2024-08-19T00:56:02.045 INFO:tasks.workunit.client.1.smithi086.stdout:9/365: dread db/dd/ff [0,4194304] 0 2024-08-19T00:56:02.046 INFO:tasks.workunit.client.1.smithi086.stdout:4/324: creat d2/da/f70 x:0 0 0 2024-08-19T00:56:02.048 INFO:tasks.workunit.client.1.smithi086.stdout:6/343: rename db/d37/d44/d5a/f5c to db/d37/d41/f6b 0 2024-08-19T00:56:02.048 INFO:tasks.workunit.client.1.smithi086.stdout:9/366: write db/f39 [3162861,68915] 0 2024-08-19T00:56:02.050 INFO:tasks.workunit.client.1.smithi086.stdout:1/391: unlink d4/d10/l64 0 2024-08-19T00:56:02.052 INFO:tasks.workunit.client.1.smithi086.stdout:2/295: dwrite d8/d2c/d38/f53 [0,4194304] 0 2024-08-19T00:56:02.052 INFO:tasks.workunit.client.1.smithi086.stdout:5/332: link d0/d8/d10/f2b d0/d5f/d60/d57/f67 0 2024-08-19T00:56:02.054 INFO:tasks.workunit.client.1.smithi086.stdout:8/350: stat dc/d16/d18/d29/d2e/l2c 0 2024-08-19T00:56:02.055 INFO:tasks.workunit.client.1.smithi086.stdout:4/325: mknod d2/d1c/d25/d55/d4d/c71 0 2024-08-19T00:56:02.057 INFO:tasks.workunit.client.1.smithi086.stdout:6/344: symlink db/d37/d44/d5a/l6c 0 2024-08-19T00:56:02.058 INFO:tasks.workunit.client.1.smithi086.stdout:8/351: fsync dc/d16/d18/d29/d2e/d28/d2b/f5f 0 2024-08-19T00:56:02.059 INFO:tasks.workunit.client.1.smithi086.stdout:1/392: creat d4/d10/d75/f81 x:0 0 0 2024-08-19T00:56:02.059 INFO:tasks.workunit.client.1.smithi086.stdout:6/345: fsync db/f56 0 2024-08-19T00:56:02.060 INFO:tasks.workunit.client.1.smithi086.stdout:9/367: rmdir db/d23/d30/d3f/d43/d4e 39 2024-08-19T00:56:02.062 INFO:tasks.workunit.client.1.smithi086.stdout:2/296: dwrite d8/d24/f2b [0,4194304] 0 2024-08-19T00:56:02.062 INFO:tasks.workunit.client.1.smithi086.stdout:1/393: chown d4/d7/d2a/d36/d3a/l46 846 1 2024-08-19T00:56:02.063 INFO:tasks.workunit.client.1.smithi086.stdout:4/326: rename d2/da to d2/d18/d33/d42/d72 0 2024-08-19T00:56:02.067 INFO:tasks.workunit.client.1.smithi086.stdout:6/346: mknod db/d34/c6d 0 2024-08-19T00:56:02.068 INFO:tasks.workunit.client.1.smithi086.stdout:6/347: write db/f16 [4796,116089] 0 2024-08-19T00:56:02.068 INFO:tasks.workunit.client.1.smithi086.stdout:8/352: creat dc/d16/d18/d29/d32/f71 x:0 0 0 2024-08-19T00:56:02.069 INFO:tasks.workunit.client.1.smithi086.stdout:3/346: sync 2024-08-19T00:56:02.071 INFO:tasks.workunit.client.1.smithi086.stdout:6/348: read db/f3e [533143,58919] 0 2024-08-19T00:56:02.071 INFO:tasks.workunit.client.1.smithi086.stdout:9/368: write db/d26/d5c/d68/f6f [70731,129000] 0 2024-08-19T00:56:02.071 INFO:tasks.workunit.client.1.smithi086.stdout:6/349: stat db/f18 0 2024-08-19T00:56:02.072 INFO:tasks.workunit.client.1.smithi086.stdout:1/394: rmdir d4/d7 39 2024-08-19T00:56:02.073 INFO:tasks.workunit.client.1.smithi086.stdout:5/333: truncate d0/df/d1f/d33/f49 1752401 0 2024-08-19T00:56:02.074 INFO:tasks.workunit.client.1.smithi086.stdout:6/350: write db/d37/d30/f3f [1502955,126019] 0 2024-08-19T00:56:02.074 INFO:tasks.workunit.client.1.smithi086.stdout:4/327: rename d2/d18/d33/d42/d72/d2f/d59 to d2/d1c/d25/d6b/d6e/d73 0 2024-08-19T00:56:02.076 INFO:tasks.workunit.client.1.smithi086.stdout:6/351: dread - db/d37/d41/f6b zero size 2024-08-19T00:56:02.078 INFO:tasks.workunit.client.1.smithi086.stdout:9/369: dread db/dd/d19/f1f [0,4194304] 0 2024-08-19T00:56:02.079 INFO:tasks.workunit.client.1.smithi086.stdout:6/352: read db/d37/f21 [202435,86631] 0 2024-08-19T00:56:02.079 INFO:tasks.workunit.client.1.smithi086.stdout:3/347: creat d3/d18/d27/d76/f7c x:0 0 0 2024-08-19T00:56:02.080 INFO:tasks.workunit.client.1.smithi086.stdout:5/334: dread d0/df/d1f/d33/f3d [0,4194304] 0 2024-08-19T00:56:02.083 INFO:tasks.workunit.client.1.smithi086.stdout:5/335: write d0/df/d1f/d33/f34 [434834,20745] 0 2024-08-19T00:56:02.083 INFO:tasks.workunit.client.1.smithi086.stdout:2/297: dread d8/f11 [0,4194304] 0 2024-08-19T00:56:02.085 INFO:tasks.workunit.client.1.smithi086.stdout:4/328: rmdir d2/d18 39 2024-08-19T00:56:02.086 INFO:tasks.workunit.client.1.smithi086.stdout:9/370: mknod db/d23/d30/c7d 0 2024-08-19T00:56:02.086 INFO:tasks.workunit.client.1.smithi086.stdout:2/298: dread - d8/d2c/d47/f58 zero size 2024-08-19T00:56:02.087 INFO:tasks.workunit.client.1.smithi086.stdout:1/395: truncate d4/d7/f39 727743 0 2024-08-19T00:56:02.087 INFO:tasks.workunit.client.1.smithi086.stdout:4/329: chown d2/f23 56314007 1 2024-08-19T00:56:02.087 INFO:tasks.workunit.client.1.smithi086.stdout:8/353: truncate dc/d16/d18/d29/d2e/d28/d2b/f5f 290518 0 2024-08-19T00:56:02.088 INFO:tasks.workunit.client.1.smithi086.stdout:2/299: stat d8/d43/f48 0 2024-08-19T00:56:02.089 INFO:tasks.workunit.client.1.smithi086.stdout:6/353: dwrite db/d34/d4e/d55/f32 [4194304,4194304] 0 2024-08-19T00:56:02.090 INFO:tasks.workunit.client.1.smithi086.stdout:5/336: mknod d0/d2d/d43/d4d/c68 0 2024-08-19T00:56:02.090 INFO:tasks.workunit.client.1.smithi086.stdout:5/337: chown d0/d2d/d43 129459019 1 2024-08-19T00:56:02.091 INFO:tasks.workunit.client.1.smithi086.stdout:2/300: truncate d8/d43/f5a 5162573 0 2024-08-19T00:56:02.092 INFO:tasks.workunit.client.1.smithi086.stdout:4/330: chown d2/d18/d33/d42/d72/d2f 5507 1 2024-08-19T00:56:02.092 INFO:tasks.workunit.client.1.smithi086.stdout:2/301: write d8/f12 [1583756,122972] 0 2024-08-19T00:56:02.094 INFO:tasks.workunit.client.1.smithi086.stdout:9/371: symlink db/d26/d5c/d68/l7e 0 2024-08-19T00:56:02.094 INFO:tasks.workunit.client.1.smithi086.stdout:4/331: stat d2/d1c/d25/d55 0 2024-08-19T00:56:02.096 INFO:tasks.workunit.client.1.smithi086.stdout:9/372: chown db/d26/f49 253 1 2024-08-19T00:56:02.098 INFO:tasks.workunit.client.1.smithi086.stdout:5/338: rename d0/d2d/d43/f48 to d0/d5f/d60/d57/f69 0 2024-08-19T00:56:02.099 INFO:tasks.workunit.client.1.smithi086.stdout:8/354: creat dc/d1f/d37/f72 x:0 0 0 2024-08-19T00:56:02.099 INFO:tasks.workunit.client.1.smithi086.stdout:6/354: symlink db/l6e 0 2024-08-19T00:56:02.100 INFO:tasks.workunit.client.1.smithi086.stdout:8/355: readlink dc/d1f/l66 0 2024-08-19T00:56:02.101 INFO:tasks.workunit.client.1.smithi086.stdout:1/396: dwrite d4/d1e/d6f/f74 [0,4194304] 0 2024-08-19T00:56:02.105 INFO:tasks.workunit.client.1.smithi086.stdout:3/348: truncate d3/d18/d27/d49/f32 533516 0 2024-08-19T00:56:02.107 INFO:tasks.workunit.client.1.smithi086.stdout:6/355: symlink db/d34/l6f 0 2024-08-19T00:56:02.109 INFO:tasks.workunit.client.1.smithi086.stdout:8/356: mknod dc/d16/d18/d29/d2e/d28/d2b/d3b/c73 0 2024-08-19T00:56:02.110 INFO:tasks.workunit.client.1.smithi086.stdout:8/357: fsync dc/d16/d18/d29/d2e/d28/f69 0 2024-08-19T00:56:02.113 INFO:tasks.workunit.client.1.smithi086.stdout:6/356: rename db/d37/d28/l4a to db/d37/d30/l70 0 2024-08-19T00:56:02.113 INFO:tasks.workunit.client.1.smithi086.stdout:9/373: write db/dd/d19/f1f [856562,112395] 0 2024-08-19T00:56:02.113 INFO:tasks.workunit.client.1.smithi086.stdout:2/302: truncate d8/d24/f26 20837 0 2024-08-19T00:56:02.114 INFO:tasks.workunit.client.1.smithi086.stdout:4/332: getdents d2/d1c/d25/d6b 0 2024-08-19T00:56:02.115 INFO:tasks.workunit.client.1.smithi086.stdout:8/358: creat dc/d1f/d37/f74 x:0 0 0 2024-08-19T00:56:02.116 INFO:tasks.workunit.client.1.smithi086.stdout:8/359: fsync dc/d1f/f27 0 2024-08-19T00:56:02.116 INFO:tasks.workunit.client.1.smithi086.stdout:3/349: fdatasync d3/d18/d27/d49/f32 0 2024-08-19T00:56:02.118 INFO:tasks.workunit.client.1.smithi086.stdout:6/357: creat db/d37/d28/f71 x:0 0 0 2024-08-19T00:56:02.118 INFO:tasks.workunit.client.1.smithi086.stdout:2/303: creat d8/d43/f63 x:0 0 0 2024-08-19T00:56:02.120 INFO:tasks.workunit.client.1.smithi086.stdout:4/333: unlink d2/l10 0 2024-08-19T00:56:02.123 INFO:tasks.workunit.client.1.smithi086.stdout:1/397: dwrite d4/d7/d2a/d36/d3a/f72 [0,4194304] 0 2024-08-19T00:56:02.123 INFO:tasks.workunit.client.1.smithi086.stdout:6/358: creat db/d37/d30/f72 x:0 0 0 2024-08-19T00:56:02.125 INFO:tasks.workunit.client.1.smithi086.stdout:2/304: creat d8/d24/f64 x:0 0 0 2024-08-19T00:56:02.126 INFO:tasks.workunit.client.1.smithi086.stdout:1/398: chown d4/d7/c2c 709223 1 2024-08-19T00:56:02.127 INFO:tasks.workunit.client.1.smithi086.stdout:3/350: write d3/f14 [643314,16175] 0 2024-08-19T00:56:02.127 INFO:tasks.workunit.client.1.smithi086.stdout:2/305: write d8/f1f [888885,100049] 0 2024-08-19T00:56:02.129 INFO:tasks.workunit.client.1.smithi086.stdout:4/334: rename d2/d1c/d25/f54 to d2/d1c/d25/d6b/d6e/f74 0 2024-08-19T00:56:02.130 INFO:tasks.workunit.client.1.smithi086.stdout:8/360: dwrite dc/d17/f24 [4194304,4194304] 0 2024-08-19T00:56:02.133 INFO:tasks.workunit.client.1.smithi086.stdout:1/399: write d4/d10/d75/f81 [92808,115122] 0 2024-08-19T00:56:02.135 INFO:tasks.workunit.client.1.smithi086.stdout:4/335: chown d2/d18/c1a 65 1 2024-08-19T00:56:02.137 INFO:tasks.workunit.client.1.smithi086.stdout:2/306: mkdir d8/d43/d65 0 2024-08-19T00:56:02.142 INFO:tasks.workunit.client.1.smithi086.stdout:8/361: fdatasync f5 0 2024-08-19T00:56:02.146 INFO:tasks.workunit.client.1.smithi086.stdout:6/359: dwrite db/d37/f21 [0,4194304] 0 2024-08-19T00:56:02.147 INFO:tasks.workunit.client.1.smithi086.stdout:6/360: chown db/d37/d44/d5a 0 1 2024-08-19T00:56:02.152 INFO:tasks.workunit.client.1.smithi086.stdout:6/361: dread db/d37/f21 [0,4194304] 0 2024-08-19T00:56:02.154 INFO:tasks.workunit.client.1.smithi086.stdout:6/362: write db/f58 [1186415,50814] 0 2024-08-19T00:56:02.154 INFO:tasks.workunit.client.1.smithi086.stdout:3/351: truncate d3/d18/d27/d48/f4b 3090512 0 2024-08-19T00:56:02.155 INFO:tasks.workunit.client.1.smithi086.stdout:1/400: getdents d4/d7/d2a/d36/d50 0 2024-08-19T00:56:02.156 INFO:tasks.workunit.client.1.smithi086.stdout:8/362: link f5 dc/f75 0 2024-08-19T00:56:02.158 INFO:tasks.workunit.client.1.smithi086.stdout:2/307: dwrite d8/d43/f48 [0,4194304] 0 2024-08-19T00:56:02.158 INFO:tasks.workunit.client.1.smithi086.stdout:7/405: sync 2024-08-19T00:56:02.158 INFO:tasks.workunit.client.1.smithi086.stdout:0/380: sync 2024-08-19T00:56:02.158 INFO:tasks.workunit.client.1.smithi086.stdout:1/401: read d4/d7/f28 [4836782,74208] 0 2024-08-19T00:56:02.159 INFO:tasks.workunit.client.1.smithi086.stdout:3/352: unlink d3/d26/l3c 0 2024-08-19T00:56:02.161 INFO:tasks.workunit.client.1.smithi086.stdout:6/363: creat db/d37/d44/d5a/f73 x:0 0 0 2024-08-19T00:56:02.161 INFO:tasks.workunit.client.1.smithi086.stdout:3/353: chown d3/d18/d19/d62/d46/f6e 10754073 1 2024-08-19T00:56:02.164 INFO:tasks.workunit.client.1.smithi086.stdout:4/336: dread d2/f21 [0,4194304] 0 2024-08-19T00:56:02.164 INFO:tasks.workunit.client.1.smithi086.stdout:4/337: stat d2/d1c/d25/f35 0 2024-08-19T00:56:02.165 INFO:tasks.workunit.client.1.smithi086.stdout:7/406: fsync d3/d5b/f6f 0 2024-08-19T00:56:02.166 INFO:tasks.workunit.client.1.smithi086.stdout:2/308: mknod d8/d2c/c66 0 2024-08-19T00:56:02.166 INFO:tasks.workunit.client.1.smithi086.stdout:4/338: stat d2/d1c/f3c 0 2024-08-19T00:56:02.167 INFO:tasks.workunit.client.1.smithi086.stdout:1/402: symlink d4/d10/l82 0 2024-08-19T00:56:02.168 INFO:tasks.workunit.client.1.smithi086.stdout:6/364: symlink db/d37/d28/l74 0 2024-08-19T00:56:02.172 INFO:tasks.workunit.client.1.smithi086.stdout:4/339: symlink d2/d1c/l75 0 2024-08-19T00:56:02.172 INFO:tasks.workunit.client.1.smithi086.stdout:2/309: mkdir d8/d2c/d67 0 2024-08-19T00:56:02.172 INFO:tasks.workunit.client.1.smithi086.stdout:7/407: dwrite d3/d34/f52 [0,4194304] 0 2024-08-19T00:56:02.174 INFO:tasks.workunit.client.1.smithi086.stdout:2/310: chown d8/d24/c2a 110 1 2024-08-19T00:56:02.174 INFO:tasks.workunit.client.1.smithi086.stdout:2/311: readlink d8/l5d 0 2024-08-19T00:56:02.175 INFO:tasks.workunit.client.1.smithi086.stdout:2/312: chown d8/d14/f2f 65 1 2024-08-19T00:56:02.178 INFO:tasks.workunit.client.1.smithi086.stdout:0/381: dread da/d14/d26/f48 [0,4194304] 0 2024-08-19T00:56:02.179 INFO:tasks.workunit.client.1.smithi086.stdout:1/403: unlink d4/d1e/d35/d56/l57 0 2024-08-19T00:56:02.180 INFO:tasks.workunit.client.1.smithi086.stdout:3/354: rmdir d3/d67 0 2024-08-19T00:56:02.184 INFO:tasks.workunit.client.1.smithi086.stdout:6/365: creat db/d34/d69/f75 x:0 0 0 2024-08-19T00:56:02.184 INFO:tasks.workunit.client.1.smithi086.stdout:8/363: truncate dc/d16/d18/d29/d2e/d28/d2b/d3b/f58 3837581 0 2024-08-19T00:56:02.187 INFO:tasks.workunit.client.1.smithi086.stdout:2/313: rmdir d8/d2c/d38 39 2024-08-19T00:56:02.188 INFO:tasks.workunit.client.1.smithi086.stdout:3/355: rename d3/d9/lb to d3/d18/d27/d48/l7d 0 2024-08-19T00:56:02.189 INFO:tasks.workunit.client.1.smithi086.stdout:3/356: write d3/d18/d19/f55 [203065,118888] 0 2024-08-19T00:56:02.190 INFO:tasks.workunit.client.1.smithi086.stdout:6/366: mkdir db/d34/d39/d76 0 2024-08-19T00:56:02.192 INFO:tasks.workunit.client.1.smithi086.stdout:3/357: chown d3/d18/d19/d62/d46/f6e 106488921 1 2024-08-19T00:56:02.194 INFO:tasks.workunit.client.1.smithi086.stdout:4/340: dwrite d2/d18/d33/d42/d72/d2f/f39 [0,4194304] 0 2024-08-19T00:56:02.195 INFO:tasks.workunit.client.1.smithi086.stdout:1/404: mknod d4/d7/d2a/c83 0 2024-08-19T00:56:02.199 INFO:tasks.workunit.client.1.smithi086.stdout:8/364: write dc/d16/d18/d29/d2e/d28/d2b/d3b/f58 [942858,26299] 0 2024-08-19T00:56:02.202 INFO:tasks.workunit.client.1.smithi086.stdout:8/365: chown dc/d16/d18/d29/d2e/d28 40 1 2024-08-19T00:56:02.204 INFO:tasks.workunit.client.1.smithi086.stdout:1/405: mkdir d4/d7/d2a/d36/d63/d84 0 2024-08-19T00:56:02.204 INFO:tasks.workunit.client.1.smithi086.stdout:3/358: dwrite d3/d26/d2b/f3b [0,4194304] 0 2024-08-19T00:56:02.207 INFO:tasks.workunit.client.1.smithi086.stdout:4/341: mknod d2/d18/d33/c76 0 2024-08-19T00:56:02.207 INFO:tasks.workunit.client.1.smithi086.stdout:7/408: dwrite d3/d34/d44/d58/d4b/f61 [0,4194304] 0 2024-08-19T00:56:02.207 INFO:tasks.workunit.client.1.smithi086.stdout:0/382: getdents da/d14/d1a/d2e 0 2024-08-19T00:56:02.208 INFO:tasks.workunit.client.1.smithi086.stdout:6/367: dread db/f3b [0,4194304] 0 2024-08-19T00:56:02.211 INFO:tasks.workunit.client.1.smithi086.stdout:1/406: chown d4/d7/d2a/c77 16 1 2024-08-19T00:56:02.211 INFO:tasks.workunit.client.1.smithi086.stdout:3/359: fsync d3/d9/f15 0 2024-08-19T00:56:02.213 INFO:tasks.workunit.client.1.smithi086.stdout:8/366: fdatasync dc/f62 0 2024-08-19T00:56:02.215 INFO:tasks.workunit.client.1.smithi086.stdout:4/342: symlink d2/d1c/d25/d6b/l77 0 2024-08-19T00:56:02.217 INFO:tasks.workunit.client.1.smithi086.stdout:7/409: unlink d3/d34/d44/d58/d4b/d42/l4c 0 2024-08-19T00:56:02.217 INFO:tasks.workunit.client.1.smithi086.stdout:6/368: write db/d37/f21 [3362822,9947] 0 2024-08-19T00:56:02.217 INFO:tasks.workunit.client.1.smithi086.stdout:5/339: sync 2024-08-19T00:56:02.218 INFO:tasks.workunit.client.1.smithi086.stdout:3/360: creat d3/d26/f7e x:0 0 0 2024-08-19T00:56:02.218 INFO:tasks.workunit.client.1.smithi086.stdout:1/407: dread - d4/d7/d2a/d36/f71 zero size 2024-08-19T00:56:02.220 INFO:tasks.workunit.client.1.smithi086.stdout:2/314: dwrite d8/d24/f26 [0,4194304] 0 2024-08-19T00:56:02.221 INFO:tasks.workunit.client.1.smithi086.stdout:5/340: write d0/f6 [4252248,526] 0 2024-08-19T00:56:02.221 INFO:tasks.workunit.client.1.smithi086.stdout:8/367: stat dc/d1f/f4c 0 2024-08-19T00:56:02.221 INFO:tasks.workunit.client.1.smithi086.stdout:6/369: fsync db/d34/d39/f40 0 2024-08-19T00:56:02.221 INFO:tasks.workunit.client.1.smithi086.stdout:1/408: readlink d4/d10/l2d 0 2024-08-19T00:56:02.223 INFO:tasks.workunit.client.1.smithi086.stdout:7/410: mkdir d3/de/d68/d7a 0 2024-08-19T00:56:02.228 INFO:tasks.workunit.client.1.smithi086.stdout:1/409: stat d4/d7/d2a/d36/d3a/d41/f4b 0 2024-08-19T00:56:02.230 INFO:tasks.workunit.client.1.smithi086.stdout:0/383: dwrite da/d14/d1a/d2e/d39/f69 [0,4194304] 0 2024-08-19T00:56:02.231 INFO:tasks.workunit.client.1.smithi086.stdout:1/410: stat c3 0 2024-08-19T00:56:02.233 INFO:tasks.workunit.client.1.smithi086.stdout:8/368: write dc/d16/d18/d29/d32/f71 [248511,29129] 0 2024-08-19T00:56:02.233 INFO:tasks.workunit.client.1.smithi086.stdout:5/341: rename d0/d20/l41 to d0/d20/l6a 0 2024-08-19T00:56:02.235 INFO:tasks.workunit.client.1.smithi086.stdout:3/361: dread d3/d18/d27/d49/d3f/f47 [0,4194304] 0 2024-08-19T00:56:02.236 INFO:tasks.workunit.client.1.smithi086.stdout:6/370: getdents db/d34/d69 0 2024-08-19T00:56:02.239 INFO:tasks.workunit.client.1.smithi086.stdout:3/362: fsync d3/f29 0 2024-08-19T00:56:02.243 INFO:tasks.workunit.client.1.smithi086.stdout:6/371: stat db/d37/d28/f71 0 2024-08-19T00:56:02.244 INFO:tasks.workunit.client.1.smithi086.stdout:4/343: dwrite d2/f21 [0,4194304] 0 2024-08-19T00:56:02.246 INFO:tasks.workunit.client.1.smithi086.stdout:2/315: dwrite d8/d2c/f49 [0,4194304] 0 2024-08-19T00:56:02.250 INFO:tasks.workunit.client.1.smithi086.stdout:8/369: creat dc/d16/d18/f76 x:0 0 0 2024-08-19T00:56:02.252 INFO:tasks.workunit.client.1.smithi086.stdout:7/411: dwrite d3/de/f17 [0,4194304] 0 2024-08-19T00:56:02.252 INFO:tasks.workunit.client.1.smithi086.stdout:3/363: readlink d3/d26/d2b/l74 0 2024-08-19T00:56:02.253 INFO:tasks.workunit.client.1.smithi086.stdout:9/374: sync 2024-08-19T00:56:02.254 INFO:tasks.workunit.client.1.smithi086.stdout:4/344: fdatasync d2/d1c/d25/d55/f3d 0 2024-08-19T00:56:02.257 INFO:tasks.workunit.client.1.smithi086.stdout:6/372: creat db/d34/d4e/d68/f77 x:0 0 0 2024-08-19T00:56:02.261 INFO:tasks.workunit.client.1.smithi086.stdout:0/384: dwrite da/d14/f1b [0,4194304] 0 2024-08-19T00:56:02.265 INFO:tasks.workunit.client.1.smithi086.stdout:3/364: creat d3/d18/d19/d37/f7f x:0 0 0 2024-08-19T00:56:02.268 INFO:tasks.workunit.client.1.smithi086.stdout:5/342: dwrite d0/d8/d10/f19 [0,4194304] 0 2024-08-19T00:56:02.270 INFO:tasks.workunit.client.1.smithi086.stdout:1/411: dwrite d4/d7/d2a/d36/f71 [0,4194304] 0 2024-08-19T00:56:02.271 INFO:tasks.workunit.client.1.smithi086.stdout:8/370: mknod dc/d1f/d37/d4f/c77 0 2024-08-19T00:56:02.273 INFO:tasks.workunit.client.1.smithi086.stdout:0/385: dread - da/d14/d1a/d2e/d39/d3b/f70 zero size 2024-08-19T00:56:02.278 INFO:tasks.workunit.client.1.smithi086.stdout:5/343: readlink d0/l16 0 2024-08-19T00:56:02.283 INFO:tasks.workunit.client.1.smithi086.stdout:4/345: dwrite d2/f69 [0,4194304] 0 2024-08-19T00:56:02.284 INFO:tasks.workunit.client.1.smithi086.stdout:8/371: dread dc/d16/d18/d29/d2e/d28/d2b/f38 [0,4194304] 0 2024-08-19T00:56:02.286 INFO:tasks.workunit.client.1.smithi086.stdout:9/375: dwrite db/f57 [0,4194304] 0 2024-08-19T00:56:02.287 INFO:tasks.workunit.client.1.smithi086.stdout:1/412: symlink d4/d7/d2a/d36/d3a/l85 0 2024-08-19T00:56:02.288 INFO:tasks.workunit.client.1.smithi086.stdout:7/412: link d3/d34/d44/f48 d3/d34/d44/d58/d4b/f7b 0 2024-08-19T00:56:02.289 INFO:tasks.workunit.client.1.smithi086.stdout:2/316: dwrite d8/d14/f2f [0,4194304] 0 2024-08-19T00:56:02.294 INFO:tasks.workunit.client.1.smithi086.stdout:5/344: rename d0/df/d1f/d33/c39 to d0/df/d1f/d33/c6b 0 2024-08-19T00:56:02.298 INFO:tasks.workunit.client.1.smithi086.stdout:9/376: creat db/d23/d30/f7f x:0 0 0 2024-08-19T00:56:02.299 INFO:tasks.workunit.client.1.smithi086.stdout:8/372: creat dc/d16/d18/d29/d2e/d28/d41/f78 x:0 0 0 2024-08-19T00:56:02.302 INFO:tasks.workunit.client.1.smithi086.stdout:3/365: dwrite d3/d18/d27/d49/f35 [0,4194304] 0 2024-08-19T00:56:02.302 INFO:tasks.workunit.client.1.smithi086.stdout:4/346: rename d2/d1c to d2/d18/d33/d42/d72/d78 0 2024-08-19T00:56:02.302 INFO:tasks.workunit.client.1.smithi086.stdout:0/386: dread da/d14/f41 [0,4194304] 0 2024-08-19T00:56:02.309 INFO:tasks.workunit.client.1.smithi086.stdout:8/373: write dc/d16/d18/d29/d2e/f3f [4273252,36479] 0 2024-08-19T00:56:02.310 INFO:tasks.workunit.client.1.smithi086.stdout:9/377: getdents db/dd 0 2024-08-19T00:56:02.313 INFO:tasks.workunit.client.1.smithi086.stdout:4/347: stat d2/d18/d33/d42/d72/d78/d2c/c2d 0 2024-08-19T00:56:02.313 INFO:tasks.workunit.client.1.smithi086.stdout:2/317: dwrite d8/f60 [0,4194304] 0 2024-08-19T00:56:02.313 INFO:tasks.workunit.client.1.smithi086.stdout:1/413: dwrite d4/d1e/d6f/f74 [0,4194304] 0 2024-08-19T00:56:02.313 INFO:tasks.workunit.client.1.smithi086.stdout:9/378: readlink db/l10 0 2024-08-19T00:56:02.315 INFO:tasks.workunit.client.1.smithi086.stdout:5/345: truncate d0/f1e 415491 0 2024-08-19T00:56:02.320 INFO:tasks.workunit.client.1.smithi086.stdout:8/374: stat dc/d16/d18/d29/d2e/d28/d2b/f6e 0 2024-08-19T00:56:02.321 INFO:tasks.workunit.client.1.smithi086.stdout:1/414: read - d4/d7/d2a/d36/d63/f78 zero size 2024-08-19T00:56:02.324 INFO:tasks.workunit.client.1.smithi086.stdout:2/318: mkdir d8/d24/d32/d68 0 2024-08-19T00:56:02.326 INFO:tasks.workunit.client.1.smithi086.stdout:1/415: read d4/d7/d2a/d36/f6a [36199,48355] 0 2024-08-19T00:56:02.327 INFO:tasks.workunit.client.1.smithi086.stdout:3/366: truncate d3/d18/d19/d37/d5a/f65 210119 0 2024-08-19T00:56:02.327 INFO:tasks.workunit.client.1.smithi086.stdout:4/348: write d2/d18/d33/d42/d72/d78/d25/d55/f3d [683436,109957] 0 2024-08-19T00:56:02.328 INFO:tasks.workunit.client.1.smithi086.stdout:2/319: stat d8/d24/f64 0 2024-08-19T00:56:02.328 INFO:tasks.workunit.client.1.smithi086.stdout:8/375: readlink dc/d16/d18/d29/d2e/d28/d2b/d3b/l67 0 2024-08-19T00:56:02.330 INFO:tasks.workunit.client.1.smithi086.stdout:5/346: rename d0/df/d1f/d33/c6b to d0/d5f/c6c 0 2024-08-19T00:56:02.330 INFO:tasks.workunit.client.1.smithi086.stdout:7/413: dread d3/d34/d44/d58/f55 [0,4194304] 0 2024-08-19T00:56:02.331 INFO:tasks.workunit.client.1.smithi086.stdout:0/387: dwrite da/d14/d1a/d2e/d39/f45 [0,4194304] 0 2024-08-19T00:56:02.333 INFO:tasks.workunit.client.1.smithi086.stdout:3/367: stat d3/d18/d27/d49/d3f/d5b 0 2024-08-19T00:56:02.334 INFO:tasks.workunit.client.1.smithi086.stdout:2/320: mknod d8/d43/c69 0 2024-08-19T00:56:02.336 INFO:tasks.workunit.client.1.smithi086.stdout:9/379: dwrite db/dd/f62 [0,4194304] 0 2024-08-19T00:56:02.336 INFO:tasks.workunit.client.1.smithi086.stdout:1/416: creat d4/d7/d2a/d36/d50/f86 x:0 0 0 2024-08-19T00:56:02.337 INFO:tasks.workunit.client.1.smithi086.stdout:2/321: chown d8/d24 1793 1 2024-08-19T00:56:02.340 INFO:tasks.workunit.client.1.smithi086.stdout:3/368: creat d3/f80 x:0 0 0 2024-08-19T00:56:02.342 INFO:tasks.workunit.client.1.smithi086.stdout:9/380: stat db/dd/d19/f1f 0 2024-08-19T00:56:02.343 INFO:tasks.workunit.client.1.smithi086.stdout:0/388: unlink da/d14/d1a/d2e/d39/f5c 0 2024-08-19T00:56:02.345 INFO:tasks.workunit.client.1.smithi086.stdout:7/414: creat d3/d34/d44/d58/d4b/f7c x:0 0 0 2024-08-19T00:56:02.348 INFO:tasks.workunit.client.1.smithi086.stdout:1/417: creat d4/d1e/d35/f87 x:0 0 0 2024-08-19T00:56:02.353 INFO:tasks.workunit.client.1.smithi086.stdout:9/381: write db/d23/d30/f7f [196171,19369] 0 2024-08-19T00:56:02.356 INFO:tasks.workunit.client.1.smithi086.stdout:2/322: rmdir d8/d24/d32/d68 0 2024-08-19T00:56:02.357 INFO:tasks.workunit.client.1.smithi086.stdout:5/347: dwrite d0/d8/f37 [0,4194304] 0 2024-08-19T00:56:02.357 INFO:tasks.workunit.client.1.smithi086.stdout:9/382: readlink db/l28 0 2024-08-19T00:56:02.359 INFO:tasks.workunit.client.1.smithi086.stdout:8/376: dwrite dc/d17/d1e/d55/f6a [0,4194304] 0 2024-08-19T00:56:02.360 INFO:tasks.workunit.client.1.smithi086.stdout:4/349: dwrite d2/d18/d33/d42/d72/d78/d25/f35 [0,4194304] 0 2024-08-19T00:56:02.363 INFO:tasks.workunit.client.1.smithi086.stdout:5/348: readlink d0/d8/lc 0 2024-08-19T00:56:02.363 INFO:tasks.workunit.client.1.smithi086.stdout:8/377: read - dc/d17/f6d zero size 2024-08-19T00:56:02.365 INFO:tasks.workunit.client.1.smithi086.stdout:3/369: dwrite d3/d18/f22 [4194304,4194304] 0 2024-08-19T00:56:02.365 INFO:tasks.workunit.client.1.smithi086.stdout:5/349: chown d0/d5f/d60/d5b 231842081 1 2024-08-19T00:56:02.365 INFO:tasks.workunit.client.1.smithi086.stdout:1/418: rename d4/d1e/d35 to d4/d7/d2a/d36/d7d/d88 0 2024-08-19T00:56:02.369 INFO:tasks.workunit.client.1.smithi086.stdout:2/323: dwrite d8/f1d [4194304,4194304] 0 2024-08-19T00:56:02.370 INFO:tasks.workunit.client.1.smithi086.stdout:5/350: symlink d0/d5f/d60/l6d 0 2024-08-19T00:56:02.431 INFO:tasks.workunit.client.1.smithi086.stdout:6/373: sync 2024-08-19T00:56:02.432 INFO:tasks.workunit.client.1.smithi086.stdout:4/350: read d2/d18/d33/d42/d72/f37 [2626241,26192] 0 2024-08-19T00:56:02.432 INFO:tasks.workunit.client.1.smithi086.stdout:1/419: creat d4/d10/d75/f89 x:0 0 0 2024-08-19T00:56:02.432 INFO:tasks.workunit.client.1.smithi086.stdout:3/370: symlink d3/d18/d19/d37/d5a/l81 0 2024-08-19T00:56:02.433 INFO:tasks.workunit.client.1.smithi086.stdout:9/383: link db/d23/d30/d3f/d43/l64 db/d5e/l80 0 2024-08-19T00:56:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:02 smithi017 ceph-mon[16627]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:56:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:02 smithi017 ceph-mon[16627]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-08-19T00:56:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:02 smithi017 ceph-mon[16627]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-08-19T00:56:02.435 INFO:tasks.workunit.client.1.smithi086.stdout:9/384: readlink db/d26/l4b 0 2024-08-19T00:56:02.436 INFO:tasks.workunit.client.1.smithi086.stdout:3/371: dread - d3/d18/d19/d37/f7f zero size 2024-08-19T00:56:02.436 INFO:tasks.workunit.client.1.smithi086.stdout:4/351: fdatasync d2/d18/d33/d42/d72/d78/d25/f3a 0 2024-08-19T00:56:02.437 INFO:tasks.workunit.client.1.smithi086.stdout:6/374: unlink db/d34/d39/c5d 0 2024-08-19T00:56:02.439 INFO:tasks.workunit.client.1.smithi086.stdout:2/324: dread d8/d43/f48 [0,4194304] 0 2024-08-19T00:56:02.440 INFO:tasks.workunit.client.1.smithi086.stdout:4/352: truncate d2/d18/d33/f5e 562930 0 2024-08-19T00:56:02.440 INFO:tasks.workunit.client.1.smithi086.stdout:2/325: readlink d8/d43/l4a 0 2024-08-19T00:56:02.441 INFO:tasks.workunit.client.1.smithi086.stdout:9/385: creat db/d23/d37/f81 x:0 0 0 2024-08-19T00:56:02.442 INFO:tasks.workunit.client.1.smithi086.stdout:5/351: creat d0/d5f/d60/d5b/f6e x:0 0 0 2024-08-19T00:56:02.443 INFO:tasks.workunit.client.1.smithi086.stdout:7/415: dread d3/d34/d44/d58/d4b/f3d [0,4194304] 0 2024-08-19T00:56:02.443 INFO:tasks.workunit.client.1.smithi086.stdout:4/353: chown d2/d18/d33/d42/d72/d78/d25/d55/l4c 2 1 2024-08-19T00:56:02.444 INFO:tasks.workunit.client.1.smithi086.stdout:6/375: mkdir db/d37/d44/d5a/d78 0 2024-08-19T00:56:02.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:02 smithi086 ceph-mon[24511]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:56:02.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:02 smithi086 ceph-mon[24511]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-08-19T00:56:02.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:02 smithi086 ceph-mon[24511]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-08-19T00:56:02.447 INFO:tasks.workunit.client.1.smithi086.stdout:2/326: mkdir d8/d24/d32/d4d/d6a 0 2024-08-19T00:56:02.450 INFO:tasks.workunit.client.1.smithi086.stdout:5/352: creat d0/d5f/f6f x:0 0 0 2024-08-19T00:56:02.451 INFO:tasks.workunit.client.1.smithi086.stdout:1/420: dread d4/d7/f37 [0,4194304] 0 2024-08-19T00:56:02.451 INFO:tasks.workunit.client.1.smithi086.stdout:7/416: truncate d3/d5b/f6c 2577199 0 2024-08-19T00:56:02.452 INFO:tasks.workunit.client.1.smithi086.stdout:5/353: write d0/fb [2248237,90366] 0 2024-08-19T00:56:02.452 INFO:tasks.workunit.client.1.smithi086.stdout:2/327: dwrite d8/d2c/f49 [0,4194304] 0 2024-08-19T00:56:02.454 INFO:tasks.workunit.client.1.smithi086.stdout:7/417: chown d3/d34/d44/d58/f55 46 1 2024-08-19T00:56:02.454 INFO:tasks.workunit.client.1.smithi086.stdout:5/354: chown d0/df/f1a 143610 1 2024-08-19T00:56:02.454 INFO:tasks.workunit.client.1.smithi086.stdout:5/355: dread - d0/d5f/f6f zero size 2024-08-19T00:56:02.463 INFO:tasks.workunit.client.1.smithi086.stdout:4/354: creat d2/d18/d33/d42/d72/d78/d25/d30/d5d/f79 x:0 0 0 2024-08-19T00:56:02.465 INFO:tasks.workunit.client.1.smithi086.stdout:1/421: symlink d4/d7/d2a/d6e/l8a 0 2024-08-19T00:56:02.466 INFO:tasks.workunit.client.1.smithi086.stdout:2/328: dread - d8/f36 zero size 2024-08-19T00:56:02.467 INFO:tasks.workunit.client.1.smithi086.stdout:2/329: write d8/d24/d32/f3c [981761,21384] 0 2024-08-19T00:56:02.468 INFO:tasks.workunit.client.1.smithi086.stdout:5/356: unlink d0/d5f/d60/l6d 0 2024-08-19T00:56:02.474 INFO:tasks.workunit.client.1.smithi086.stdout:1/422: unlink d4/d7/d2a/d36/d50/l69 0 2024-08-19T00:56:02.478 INFO:tasks.workunit.client.1.smithi086.stdout:5/357: rmdir d0/d2d/d4f 39 2024-08-19T00:56:02.480 INFO:tasks.workunit.client.1.smithi086.stdout:9/386: link db/d23/d30/c7d db/dd/d19/c82 0 2024-08-19T00:56:02.481 INFO:tasks.workunit.client.1.smithi086.stdout:2/330: dwrite d8/d43/f48 [0,4194304] 0 2024-08-19T00:56:02.481 INFO:tasks.workunit.client.1.smithi086.stdout:4/355: truncate d2/d18/d33/d42/d72/f13 4987899 0 2024-08-19T00:56:02.487 INFO:tasks.workunit.client.1.smithi086.stdout:9/387: readlink db/l45 0 2024-08-19T00:56:02.494 INFO:tasks.workunit.client.1.smithi086.stdout:5/358: mkdir d0/d8/d70 0 2024-08-19T00:56:02.495 INFO:tasks.workunit.client.1.smithi086.stdout:1/423: dread d4/d7/d2a/d36/d7d/d88/f4a [0,4194304] 0 2024-08-19T00:56:02.496 INFO:tasks.workunit.client.1.smithi086.stdout:2/331: dwrite d8/ff [0,4194304] 0 2024-08-19T00:56:02.497 INFO:tasks.workunit.client.1.smithi086.stdout:9/388: unlink db/d23/c5a 0 2024-08-19T00:56:02.498 INFO:tasks.workunit.client.1.smithi086.stdout:3/372: truncate d3/d26/d2b/d33/f41 275143 0 2024-08-19T00:56:02.503 INFO:tasks.workunit.client.1.smithi086.stdout:3/373: write d3/d18/d27/d49/d3f/d54/f77 [868181,111766] 0 2024-08-19T00:56:02.504 INFO:tasks.workunit.client.1.smithi086.stdout:5/359: read d0/d2d/d4f/f5c [967505,102920] 0 2024-08-19T00:56:02.509 INFO:tasks.workunit.client.1.smithi086.stdout:6/376: dwrite db/f3e [0,4194304] 0 2024-08-19T00:56:02.510 INFO:tasks.workunit.client.1.smithi086.stdout:9/389: dwrite db/dd/d19/d38/f3c [0,4194304] 0 2024-08-19T00:56:02.511 INFO:tasks.workunit.client.1.smithi086.stdout:9/390: fdatasync db/f15 0 2024-08-19T00:56:02.511 INFO:tasks.workunit.client.1.smithi086.stdout:2/332: dread d8/d2c/d38/f42 [0,4194304] 0 2024-08-19T00:56:02.513 INFO:tasks.workunit.client.1.smithi086.stdout:3/374: truncate d3/f6 2375574 0 2024-08-19T00:56:02.517 INFO:tasks.workunit.client.1.smithi086.stdout:6/377: rmdir db/d37/d28 39 2024-08-19T00:56:02.517 INFO:tasks.workunit.client.1.smithi086.stdout:4/356: dread d2/d18/d33/d42/d72/f16 [0,4194304] 0 2024-08-19T00:56:02.519 INFO:tasks.workunit.client.1.smithi086.stdout:4/357: chown d2/d18/d33/d42/d72/d78/d25/d6b/d6e 13351837 1 2024-08-19T00:56:02.520 INFO:tasks.workunit.client.1.smithi086.stdout:9/391: creat db/dd/d19/d38/f83 x:0 0 0 2024-08-19T00:56:02.521 INFO:tasks.workunit.client.1.smithi086.stdout:4/358: fsync d2/f21 0 2024-08-19T00:56:02.526 INFO:tasks.workunit.client.1.smithi086.stdout:6/378: dwrite db/f56 [0,4194304] 0 2024-08-19T00:56:02.527 INFO:tasks.workunit.client.1.smithi086.stdout:2/333: dwrite d8/f11 [0,4194304] 0 2024-08-19T00:56:02.529 INFO:tasks.workunit.client.1.smithi086.stdout:6/379: readlink db/d34/d39/l45 0 2024-08-19T00:56:02.529 INFO:tasks.workunit.client.1.smithi086.stdout:3/375: rmdir d3/d26/d7b 0 2024-08-19T00:56:02.531 INFO:tasks.workunit.client.1.smithi086.stdout:9/392: dread f6 [0,4194304] 0 2024-08-19T00:56:02.533 INFO:tasks.workunit.client.1.smithi086.stdout:3/376: dread - d3/d18/d19/d37/f7f zero size 2024-08-19T00:56:02.534 INFO:tasks.workunit.client.1.smithi086.stdout:4/359: dwrite d2/d18/d33/d42/d72/d2f/f39 [0,4194304] 0 2024-08-19T00:56:02.535 INFO:tasks.workunit.client.1.smithi086.stdout:2/334: mknod d8/d24/d32/d5c/c6b 0 2024-08-19T00:56:02.539 INFO:tasks.workunit.client.1.smithi086.stdout:9/393: dwrite db/f11 [0,4194304] 0 2024-08-19T00:56:02.541 INFO:tasks.workunit.client.1.smithi086.stdout:6/380: creat db/d37/d44/d5a/f79 x:0 0 0 2024-08-19T00:56:02.544 INFO:tasks.workunit.client.1.smithi086.stdout:6/381: dread - db/d34/d4e/f66 zero size 2024-08-19T00:56:02.548 INFO:tasks.workunit.client.1.smithi086.stdout:9/394: dwrite db/dd/d19/d38/f83 [0,4194304] 0 2024-08-19T00:56:02.590 INFO:tasks.workunit.client.1.smithi086.stdout:3/377: symlink d3/d18/d27/d49/d3f/d54/l82 0 2024-08-19T00:56:02.593 INFO:tasks.workunit.client.1.smithi086.stdout:1/424: write d4/d7/d2a/d36/d50/f66 [711233,94799] 0 2024-08-19T00:56:02.596 INFO:tasks.workunit.client.1.smithi086.stdout:1/425: mknod d4/d7/d2a/d36/d63/c8b 0 2024-08-19T00:56:02.596 INFO:tasks.workunit.client.1.smithi086.stdout:1/426: readlink d4/d7/d2a/l58 0 2024-08-19T00:56:02.597 INFO:tasks.workunit.client.1.smithi086.stdout:3/378: creat d3/d18/d27/f83 x:0 0 0 2024-08-19T00:56:02.597 INFO:tasks.workunit.client.1.smithi086.stdout:3/379: fsync d3/d18/d19/f55 0 2024-08-19T00:56:02.598 INFO:tasks.workunit.client.1.smithi086.stdout:6/382: getdents db 0 2024-08-19T00:56:02.599 INFO:tasks.workunit.client.1.smithi086.stdout:1/427: creat d4/d10/d75/f8c x:0 0 0 2024-08-19T00:56:02.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/12: sync 2024-08-19T00:56:02.603 INFO:tasks.workunit.client.0.smithi017.stdout:6/0: sync 2024-08-19T00:56:02.603 INFO:tasks.workunit.client.0.smithi017.stdout:6/1: chown . 9485909 1 2024-08-19T00:56:02.605 INFO:tasks.workunit.client.0.smithi017.stdout:1/17: sync 2024-08-19T00:56:02.605 INFO:tasks.workunit.client.0.smithi017.stdout:2/84: sync 2024-08-19T00:56:02.605 INFO:tasks.workunit.client.0.smithi017.stdout:5/21: sync 2024-08-19T00:56:02.605 INFO:tasks.workunit.client.0.smithi017.stdout:7/79: sync 2024-08-19T00:56:02.605 INFO:tasks.workunit.client.0.smithi017.stdout:9/41: sync 2024-08-19T00:56:02.605 INFO:tasks.workunit.client.0.smithi017.stdout:0/33: sync 2024-08-19T00:56:02.605 INFO:tasks.workunit.client.0.smithi017.stdout:3/34: sync 2024-08-19T00:56:02.605 INFO:tasks.workunit.client.0.smithi017.stdout:8/7: sync 2024-08-19T00:56:02.606 INFO:tasks.workunit.client.1.smithi086.stdout:3/380: dwrite d3/d18/d27/f83 [0,4194304] 0 2024-08-19T00:56:02.606 INFO:tasks.workunit.client.1.smithi086.stdout:6/383: dwrite f8 [0,4194304] 0 2024-08-19T00:56:02.606 INFO:tasks.workunit.client.1.smithi086.stdout:1/428: dread d4/d1e/d6f/f74 [0,4194304] 0 2024-08-19T00:56:02.607 INFO:tasks.workunit.client.0.smithi017.stdout:8/8: write f0 [870915,6192] 0 2024-08-19T00:56:02.607 INFO:tasks.workunit.client.0.smithi017.stdout:1/18: stat l3 0 2024-08-19T00:56:02.608 INFO:tasks.workunit.client.0.smithi017.stdout:8/9: readlink l2 0 2024-08-19T00:56:02.608 INFO:tasks.workunit.client.1.smithi086.stdout:1/429: fsync d4/d7/d2a/d36/d7d/d88/f87 0 2024-08-19T00:56:02.609 INFO:tasks.workunit.client.0.smithi017.stdout:2/85: truncate d2/d7/dd/f15 1463995 0 2024-08-19T00:56:02.610 INFO:tasks.workunit.client.1.smithi086.stdout:1/430: chown d4/d7/f5e 201710 1 2024-08-19T00:56:02.610 INFO:tasks.workunit.client.0.smithi017.stdout:8/10: write f0 [1013090,70323] 0 2024-08-19T00:56:02.611 INFO:tasks.workunit.client.0.smithi017.stdout:5/22: unlink l3 0 2024-08-19T00:56:02.611 INFO:tasks.workunit.client.0.smithi017.stdout:5/23: fdatasync f6 0 2024-08-19T00:56:02.616 INFO:tasks.workunit.client.1.smithi086.stdout:6/384: creat db/d34/f7a x:0 0 0 2024-08-19T00:56:02.616 INFO:tasks.workunit.client.1.smithi086.stdout:1/431: dwrite d4/d7/d2a/f6b [0,4194304] 0 2024-08-19T00:56:02.617 INFO:tasks.workunit.client.0.smithi017.stdout:9/42: rmdir d0 39 2024-08-19T00:56:02.617 INFO:tasks.workunit.client.1.smithi086.stdout:1/432: rename d4/d7/d2a/d36 to d4/d7/d2a/d36/d3a/d41/d8d 22 2024-08-19T00:56:02.618 INFO:tasks.workunit.client.1.smithi086.stdout:1/433: stat d4/d7/d2a/d36/f71 0 2024-08-19T00:56:02.619 INFO:tasks.workunit.client.0.smithi017.stdout:0/34: symlink d5/lf 0 2024-08-19T00:56:02.619 INFO:tasks.workunit.client.1.smithi086.stdout:1/434: chown d4/d7/d2a/d6e/l8a 159 1 2024-08-19T00:56:02.620 INFO:tasks.workunit.client.0.smithi017.stdout:4/13: dread f0 [0,4194304] 0 2024-08-19T00:56:02.620 INFO:tasks.workunit.client.1.smithi086.stdout:3/381: creat d3/d18/d19/d37/f84 x:0 0 0 2024-08-19T00:56:02.621 INFO:tasks.workunit.client.1.smithi086.stdout:1/435: write d4/d10/d75/f89 [311958,15022] 0 2024-08-19T00:56:02.622 INFO:tasks.workunit.client.1.smithi086.stdout:3/382: chown d3/d18/d61/f56 6698803 1 2024-08-19T00:56:02.623 INFO:tasks.workunit.client.1.smithi086.stdout:3/383: read d3/d18/d27/f83 [464127,42715] 0 2024-08-19T00:56:02.623 INFO:tasks.workunit.client.0.smithi017.stdout:4/14: stat d2 0 2024-08-19T00:56:02.624 INFO:tasks.workunit.client.0.smithi017.stdout:0/35: chown d5/fc 0 1 2024-08-19T00:56:02.626 INFO:tasks.workunit.client.0.smithi017.stdout:5/24: dwrite f6 [0,4194304] 0 2024-08-19T00:56:02.626 INFO:tasks.workunit.client.0.smithi017.stdout:0/36: dread - d5/fb zero size 2024-08-19T00:56:02.627 INFO:tasks.workunit.client.0.smithi017.stdout:8/11: dread f0 [0,4194304] 0 2024-08-19T00:56:02.627 INFO:tasks.workunit.client.0.smithi017.stdout:3/35: creat d5/f8 x:0 0 0 2024-08-19T00:56:02.629 INFO:tasks.workunit.client.1.smithi086.stdout:8/378: sync 2024-08-19T00:56:02.629 INFO:tasks.workunit.client.1.smithi086.stdout:0/389: sync 2024-08-19T00:56:02.629 INFO:tasks.workunit.client.1.smithi086.stdout:7/418: sync 2024-08-19T00:56:02.633 INFO:tasks.workunit.client.0.smithi017.stdout:1/19: mkdir d4 0 2024-08-19T00:56:02.637 INFO:tasks.workunit.client.0.smithi017.stdout:6/2: mkdir d0 0 2024-08-19T00:56:02.641 INFO:tasks.workunit.client.1.smithi086.stdout:3/384: mkdir d3/d18/d61/d85 0 2024-08-19T00:56:02.644 INFO:tasks.workunit.client.0.smithi017.stdout:2/86: rename d2/d7/c14 to d2/c1e 0 2024-08-19T00:56:02.645 INFO:tasks.workunit.client.0.smithi017.stdout:3/36: dwrite f3 [0,4194304] 0 2024-08-19T00:56:02.646 INFO:tasks.workunit.client.1.smithi086.stdout:6/385: creat db/d34/d39/d76/f7b x:0 0 0 2024-08-19T00:56:02.651 INFO:tasks.workunit.client.1.smithi086.stdout:7/419: mkdir d3/de/d68/d7d 0 2024-08-19T00:56:02.651 INFO:tasks.workunit.client.0.smithi017.stdout:9/43: read - d0/fc zero size 2024-08-19T00:56:02.651 INFO:tasks.workunit.client.0.smithi017.stdout:0/37: dwrite d5/fa [0,4194304] 0 2024-08-19T00:56:02.653 INFO:tasks.workunit.client.0.smithi017.stdout:5/25: dwrite f5 [0,4194304] 0 2024-08-19T00:56:02.654 INFO:tasks.workunit.client.1.smithi086.stdout:8/379: creat dc/d16/d18/d29/d2e/d28/d2b/f79 x:0 0 0 2024-08-19T00:56:02.655 INFO:tasks.workunit.client.0.smithi017.stdout:5/26: fdatasync f7 0 2024-08-19T00:56:02.657 INFO:tasks.workunit.client.0.smithi017.stdout:8/12: symlink l3 0 2024-08-19T00:56:02.657 INFO:tasks.workunit.client.1.smithi086.stdout:0/390: creat da/d14/d1a/d2e/d39/f85 x:0 0 0 2024-08-19T00:56:02.659 INFO:tasks.workunit.client.1.smithi086.stdout:1/436: dread d4/f6 [0,4194304] 0 2024-08-19T00:56:02.660 INFO:tasks.workunit.client.0.smithi017.stdout:5/27: fdatasync f6 0 2024-08-19T00:56:02.663 INFO:tasks.workunit.client.0.smithi017.stdout:9/44: dwrite d0/fc [0,4194304] 0 2024-08-19T00:56:02.665 INFO:tasks.workunit.client.0.smithi017.stdout:1/20: fsync f2 0 2024-08-19T00:56:02.667 INFO:tasks.workunit.client.1.smithi086.stdout:6/386: mknod db/d34/d4e/d68/c7c 0 2024-08-19T00:56:02.667 INFO:tasks.workunit.client.1.smithi086.stdout:2/335: write f2 [882831,123195] 0 2024-08-19T00:56:02.668 INFO:tasks.workunit.client.1.smithi086.stdout:6/387: dread - db/d34/d4e/d68/f77 zero size 2024-08-19T00:56:02.674 INFO:tasks.workunit.client.1.smithi086.stdout:7/420: rename d3/d34/d69 to d3/de/d68/d72/d7e 0 2024-08-19T00:56:02.674 INFO:tasks.workunit.client.0.smithi017.stdout:1/21: dread f2 [0,4194304] 0 2024-08-19T00:56:02.679 INFO:tasks.workunit.client.1.smithi086.stdout:5/360: sync 2024-08-19T00:56:02.681 INFO:tasks.workunit.client.1.smithi086.stdout:1/437: unlink d4/d10/d75/f8c 0 2024-08-19T00:56:02.683 INFO:tasks.workunit.client.0.smithi017.stdout:4/15: rename f0 to d2/f3 0 2024-08-19T00:56:02.684 INFO:tasks.workunit.client.1.smithi086.stdout:1/438: dread d4/d7/d2a/d36/d50/f62 [0,4194304] 0 2024-08-19T00:56:02.686 INFO:tasks.workunit.client.0.smithi017.stdout:3/37: rename d5/f8 to d5/f9 0 2024-08-19T00:56:02.687 INFO:tasks.workunit.client.0.smithi017.stdout:4/16: dread d2/f3 [0,4194304] 0 2024-08-19T00:56:02.687 INFO:tasks.workunit.client.0.smithi017.stdout:3/38: dread - d5/f9 zero size 2024-08-19T00:56:02.688 INFO:tasks.workunit.client.0.smithi017.stdout:3/39: chown d5/c7 30966 1 2024-08-19T00:56:02.688 INFO:tasks.workunit.client.0.smithi017.stdout:3/40: fsync f3 0 2024-08-19T00:56:02.689 INFO:tasks.workunit.client.0.smithi017.stdout:3/41: read d5/f6 [3383580,12371] 0 2024-08-19T00:56:02.689 INFO:tasks.workunit.client.0.smithi017.stdout:0/38: rename d5/fd to d5/f10 0 2024-08-19T00:56:02.690 INFO:tasks.workunit.client.1.smithi086.stdout:6/388: creat db/d34/d69/f7d x:0 0 0 2024-08-19T00:56:02.695 INFO:tasks.workunit.client.1.smithi086.stdout:7/421: mknod d3/d34/d44/d58/c7f 0 2024-08-19T00:56:02.695 INFO:tasks.workunit.client.1.smithi086.stdout:7/422: read - d3/d5b/f6e zero size 2024-08-19T00:56:02.696 INFO:tasks.workunit.client.1.smithi086.stdout:7/423: stat d3/d34/d44/d3e 0 2024-08-19T00:56:02.696 INFO:tasks.workunit.client.0.smithi017.stdout:8/13: unlink l2 0 2024-08-19T00:56:02.696 INFO:tasks.workunit.client.0.smithi017.stdout:8/14: rmdir - no directory 2024-08-19T00:56:02.696 INFO:tasks.workunit.client.0.smithi017.stdout:8/15: chown l3 277 1 2024-08-19T00:56:02.697 INFO:tasks.workunit.client.0.smithi017.stdout:8/16: chown f0 6479 1 2024-08-19T00:56:02.698 INFO:tasks.workunit.client.1.smithi086.stdout:8/380: mkdir dc/d70/d7a 0 2024-08-19T00:56:02.699 INFO:tasks.workunit.client.0.smithi017.stdout:5/28: creat fa x:0 0 0 2024-08-19T00:56:02.700 INFO:tasks.workunit.client.0.smithi017.stdout:5/29: dread - fa zero size 2024-08-19T00:56:02.700 INFO:tasks.workunit.client.0.smithi017.stdout:5/30: dread - f8 zero size 2024-08-19T00:56:02.701 INFO:tasks.workunit.client.0.smithi017.stdout:9/45: mkdir d0/db/d10 0 2024-08-19T00:56:02.709 INFO:tasks.workunit.client.1.smithi086.stdout:2/336: mknod d8/d24/d32/d4d/d6a/c6c 0 2024-08-19T00:56:02.712 INFO:tasks.workunit.client.0.smithi017.stdout:4/17: creat d2/f4 x:0 0 0 2024-08-19T00:56:02.713 INFO:tasks.workunit.client.1.smithi086.stdout:4/360: sync 2024-08-19T00:56:02.713 INFO:tasks.workunit.client.1.smithi086.stdout:9/395: sync 2024-08-19T00:56:02.716 INFO:tasks.workunit.client.1.smithi086.stdout:1/439: mkdir d4/d7/d2a/d36/d63/d84/d8e 0 2024-08-19T00:56:02.719 INFO:tasks.workunit.client.1.smithi086.stdout:2/337: creat d8/d2c/d47/f6d x:0 0 0 2024-08-19T00:56:02.721 INFO:tasks.workunit.client.0.smithi017.stdout:4/18: dwrite d2/f4 [0,4194304] 0 2024-08-19T00:56:02.725 INFO:tasks.workunit.client.0.smithi017.stdout:8/17: write f0 [1142388,109695] 0 2024-08-19T00:56:02.727 INFO:tasks.workunit.client.0.smithi017.stdout:8/18: chown l3 931197 1 2024-08-19T00:56:02.730 INFO:tasks.workunit.client.0.smithi017.stdout:5/31: mkdir db 0 2024-08-19T00:56:02.730 INFO:tasks.workunit.client.0.smithi017.stdout:0/39: dwrite f1 [0,4194304] 0 2024-08-19T00:56:02.731 INFO:tasks.workunit.client.0.smithi017.stdout:0/40: truncate d5/f10 159356 0 2024-08-19T00:56:02.733 INFO:tasks.workunit.client.0.smithi017.stdout:9/46: rmdir d0 39 2024-08-19T00:56:02.737 INFO:tasks.workunit.client.0.smithi017.stdout:6/3: rmdir d0 0 2024-08-19T00:56:02.737 INFO:tasks.workunit.client.0.smithi017.stdout:6/4: readlink - no filename 2024-08-19T00:56:02.741 INFO:tasks.workunit.client.0.smithi017.stdout:1/22: symlink d4/l5 0 2024-08-19T00:56:02.741 INFO:tasks.workunit.client.0.smithi017.stdout:1/23: stat f2 0 2024-08-19T00:56:02.742 INFO:tasks.workunit.client.1.smithi086.stdout:4/361: dwrite d2/d18/d33/d42/d72/f37 [4194304,4194304] 0 2024-08-19T00:56:02.742 INFO:tasks.workunit.client.0.smithi017.stdout:1/24: chown l1 69 1 2024-08-19T00:56:02.742 INFO:tasks.workunit.client.0.smithi017.stdout:1/25: stat f2 0 2024-08-19T00:56:02.747 INFO:tasks.workunit.client.0.smithi017.stdout:4/19: write d2/f3 [1872472,4204] 0 2024-08-19T00:56:02.748 INFO:tasks.workunit.client.1.smithi086.stdout:9/396: mkdir db/d23/d30/d3f/d43/d84 0 2024-08-19T00:56:02.749 INFO:tasks.workunit.client.0.smithi017.stdout:4/20: chown d2/f4 2 1 2024-08-19T00:56:02.749 INFO:tasks.workunit.client.1.smithi086.stdout:9/397: fdatasync db/d23/d37/f81 0 2024-08-19T00:56:02.753 INFO:tasks.workunit.client.1.smithi086.stdout:1/440: link d4/d10/f51 d4/d10/d75/f8f 0 2024-08-19T00:56:02.755 INFO:tasks.workunit.client.0.smithi017.stdout:0/41: creat d5/f11 x:0 0 0 2024-08-19T00:56:02.759 INFO:tasks.workunit.client.0.smithi017.stdout:6/5: creat f1 x:0 0 0 2024-08-19T00:56:02.760 INFO:tasks.workunit.client.1.smithi086.stdout:4/362: dread d2/d18/d33/d42/d72/d78/d25/d6b/d6e/f74 [0,4194304] 0 2024-08-19T00:56:02.761 INFO:tasks.workunit.client.0.smithi017.stdout:6/6: write f1 [217223,85177] 0 2024-08-19T00:56:02.762 INFO:tasks.workunit.client.1.smithi086.stdout:4/363: write d2/d18/d33/f65 [706716,39401] 0 2024-08-19T00:56:02.762 INFO:tasks.workunit.client.0.smithi017.stdout:1/26: rename l3 to d4/l6 0 2024-08-19T00:56:02.764 INFO:tasks.workunit.client.0.smithi017.stdout:0/42: dwrite d5/fa [0,4194304] 0 2024-08-19T00:56:02.767 INFO:tasks.workunit.client.1.smithi086.stdout:9/398: dread db/d26/d5c/d68/f6f [0,4194304] 0 2024-08-19T00:56:02.767 INFO:tasks.workunit.client.1.smithi086.stdout:1/441: unlink d4/d7/d2a/d36/d7d/d88/c6d 0 2024-08-19T00:56:02.769 INFO:tasks.workunit.client.0.smithi017.stdout:5/32: mknod db/cc 0 2024-08-19T00:56:02.769 INFO:tasks.workunit.client.1.smithi086.stdout:9/399: write db/d23/d30/d3f/d43/f5f [504922,114190] 0 2024-08-19T00:56:02.770 INFO:tasks.workunit.client.1.smithi086.stdout:2/338: link d8/f40 d8/d2c/d67/f6e 0 2024-08-19T00:56:02.773 INFO:tasks.workunit.client.1.smithi086.stdout:4/364: symlink d2/d18/d33/d42/d72/d78/d25/d6b/l7a 0 2024-08-19T00:56:02.774 INFO:tasks.workunit.client.1.smithi086.stdout:2/339: dread d8/f11 [0,4194304] 0 2024-08-19T00:56:02.777 INFO:tasks.workunit.client.0.smithi017.stdout:0/43: creat d5/f12 x:0 0 0 2024-08-19T00:56:02.778 INFO:tasks.workunit.client.1.smithi086.stdout:2/340: dread d8/ff [0,4194304] 0 2024-08-19T00:56:02.778 INFO:tasks.workunit.client.0.smithi017.stdout:0/44: dread d5/f10 [0,4194304] 0 2024-08-19T00:56:02.779 INFO:tasks.workunit.client.0.smithi017.stdout:0/45: chown d5/f12 14902989 1 2024-08-19T00:56:02.780 INFO:tasks.workunit.client.1.smithi086.stdout:1/442: dwrite d4/d7/d2a/d36/d50/f62 [0,4194304] 0 2024-08-19T00:56:02.782 INFO:tasks.workunit.client.1.smithi086.stdout:1/443: dread - d4/d7/d2a/d36/d63/f78 zero size 2024-08-19T00:56:02.782 INFO:tasks.workunit.client.1.smithi086.stdout:5/361: rmdir d0/d5f 39 2024-08-19T00:56:02.784 INFO:tasks.workunit.client.1.smithi086.stdout:1/444: readlink d4/d1e/l47 0 2024-08-19T00:56:02.784 INFO:tasks.workunit.client.1.smithi086.stdout:9/400: dwrite db/d23/d30/d32/d44/f6b [0,4194304] 0 2024-08-19T00:56:02.784 INFO:tasks.workunit.client.0.smithi017.stdout:5/33: rename f8 to db/fd 0 2024-08-19T00:56:02.785 INFO:tasks.workunit.client.1.smithi086.stdout:9/401: fdatasync db/dd/d19/f33 0 2024-08-19T00:56:02.788 INFO:tasks.workunit.client.1.smithi086.stdout:4/365: symlink d2/d18/d33/d42/d72/d78/d25/l7b 0 2024-08-19T00:56:02.794 INFO:tasks.workunit.client.0.smithi017.stdout:0/46: symlink d5/l13 0 2024-08-19T00:56:02.795 INFO:tasks.workunit.client.0.smithi017.stdout:0/47: write d5/f12 [635995,114082] 0 2024-08-19T00:56:02.795 INFO:tasks.workunit.client.1.smithi086.stdout:1/445: mkdir d4/d10/d90 0 2024-08-19T00:56:02.796 INFO:tasks.workunit.client.1.smithi086.stdout:1/446: chown d4/d7/d2a/d36/d63/f80 153328125 1 2024-08-19T00:56:02.799 INFO:tasks.workunit.client.1.smithi086.stdout:0/391: symlink da/l86 0 2024-08-19T00:56:02.800 INFO:tasks.workunit.client.0.smithi017.stdout:5/34: mknod db/ce 0 2024-08-19T00:56:02.800 INFO:tasks.workunit.client.0.smithi017.stdout:5/35: dread - f7 zero size 2024-08-19T00:56:02.802 INFO:tasks.workunit.client.0.smithi017.stdout:9/47: rmdir d0/db/d10 0 2024-08-19T00:56:02.803 INFO:tasks.workunit.client.1.smithi086.stdout:4/366: rmdir d2/d18/d33/d42/d72 39 2024-08-19T00:56:02.806 INFO:tasks.workunit.client.1.smithi086.stdout:3/385: write d3/d9/f15 [1364979,97946] 0 2024-08-19T00:56:02.806 INFO:tasks.workunit.client.0.smithi017.stdout:9/48: dread d0/fc [0,4194304] 0 2024-08-19T00:56:02.807 INFO:tasks.workunit.client.1.smithi086.stdout:3/386: dread d3/d18/d19/d37/d5a/f65 [0,4194304] 0 2024-08-19T00:56:02.807 INFO:tasks.workunit.client.1.smithi086.stdout:2/341: creat d8/d2c/d67/f6f x:0 0 0 2024-08-19T00:56:02.809 INFO:tasks.workunit.client.0.smithi017.stdout:3/42: rmdir d5 39 2024-08-19T00:56:02.813 INFO:tasks.workunit.client.0.smithi017.stdout:3/43: dread f2 [0,4194304] 0 2024-08-19T00:56:02.813 INFO:tasks.workunit.client.0.smithi017.stdout:5/36: creat db/ff x:0 0 0 2024-08-19T00:56:02.817 INFO:tasks.workunit.client.1.smithi086.stdout:9/402: creat db/d23/d30/d3f/d43/d84/f85 x:0 0 0 2024-08-19T00:56:02.820 INFO:tasks.workunit.client.0.smithi017.stdout:9/49: creat d0/f11 x:0 0 0 2024-08-19T00:56:02.829 INFO:tasks.workunit.client.1.smithi086.stdout:0/392: truncate da/d14/d26/f29 986437 0 2024-08-19T00:56:02.830 INFO:tasks.workunit.client.0.smithi017.stdout:5/37: creat db/f10 x:0 0 0 2024-08-19T00:56:02.830 INFO:tasks.workunit.client.1.smithi086.stdout:9/403: mknod db/d23/d30/d58/c86 0 2024-08-19T00:56:02.831 INFO:tasks.workunit.client.1.smithi086.stdout:9/404: chown db/dd/d19/d18 0 1 2024-08-19T00:56:02.833 INFO:tasks.workunit.client.0.smithi017.stdout:4/21: rmdir d2 39 2024-08-19T00:56:02.834 INFO:tasks.workunit.client.1.smithi086.stdout:0/393: dwrite da/d14/d1a/d2e/d39/f85 [0,4194304] 0 2024-08-19T00:56:02.834 INFO:tasks.workunit.client.1.smithi086.stdout:2/342: creat d8/d43/d65/f70 x:0 0 0 2024-08-19T00:56:02.835 INFO:tasks.workunit.client.1.smithi086.stdout:2/343: write d8/d24/f54 [4484252,79173] 0 2024-08-19T00:56:02.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/38: symlink db/l11 0 2024-08-19T00:56:02.840 INFO:tasks.workunit.client.0.smithi017.stdout:3/44: dread d5/f6 [0,4194304] 0 2024-08-19T00:56:02.846 INFO:tasks.workunit.client.1.smithi086.stdout:7/424: dwrite d3/de/f15 [0,4194304] 0 2024-08-19T00:56:02.847 INFO:tasks.workunit.client.1.smithi086.stdout:6/389: creat db/f7e x:0 0 0 2024-08-19T00:56:02.847 INFO:tasks.workunit.client.1.smithi086.stdout:0/394: symlink da/d14/d1a/d2e/d39/l87 0 2024-08-19T00:56:02.849 INFO:tasks.workunit.client.1.smithi086.stdout:2/344: symlink d8/d2c/d47/l71 0 2024-08-19T00:56:02.850 INFO:tasks.workunit.client.1.smithi086.stdout:2/345: chown d8/d2c/d67 4 1 2024-08-19T00:56:02.851 INFO:tasks.workunit.client.1.smithi086.stdout:0/395: write da/d14/d55/f79 [3605339,615] 0 2024-08-19T00:56:02.852 INFO:tasks.workunit.client.1.smithi086.stdout:8/381: dwrite dc/f14 [0,4194304] 0 2024-08-19T00:56:02.853 INFO:tasks.workunit.client.1.smithi086.stdout:2/346: dread - d8/d2c/d67/f6e zero size 2024-08-19T00:56:02.854 INFO:tasks.workunit.client.0.smithi017.stdout:5/39: rename l4 to db/l12 0 2024-08-19T00:56:02.858 INFO:tasks.workunit.client.0.smithi017.stdout:5/40: symlink db/l13 0 2024-08-19T00:56:02.861 INFO:tasks.workunit.client.1.smithi086.stdout:4/367: getdents d2/d18/d33/d42/d72/d78/d25/d30/d5d 0 2024-08-19T00:56:02.863 INFO:tasks.workunit.client.1.smithi086.stdout:4/368: truncate d2/d18/d33/d42/d72/d78/d2c/f43 1010743 0 2024-08-19T00:56:02.863 INFO:tasks.workunit.client.1.smithi086.stdout:4/369: read d2/d18/d33/d42/d72/f16 [5113086,5260] 0 2024-08-19T00:56:02.867 INFO:tasks.workunit.client.0.smithi017.stdout:6/7: getdents . 0 2024-08-19T00:56:02.871 INFO:tasks.workunit.client.0.smithi017.stdout:6/8: creat f2 x:0 0 0 2024-08-19T00:56:02.873 INFO:tasks.workunit.client.1.smithi086.stdout:4/370: mknod d2/d18/d33/d42/d72/d78/d25/d55/c7c 0 2024-08-19T00:56:02.878 INFO:tasks.workunit.client.0.smithi017.stdout:6/9: dwrite f1 [0,4194304] 0 2024-08-19T00:56:02.879 INFO:tasks.workunit.client.0.smithi017.stdout:6/10: write f2 [364768,103633] 0 2024-08-19T00:56:02.880 INFO:tasks.workunit.client.1.smithi086.stdout:0/396: getdents da/d14/d1a/d2e/d43 0 2024-08-19T00:56:02.880 INFO:tasks.workunit.client.0.smithi017.stdout:6/11: chown f1 0 1 2024-08-19T00:56:02.884 INFO:tasks.workunit.client.1.smithi086.stdout:2/347: rename d8/f33 to d8/d14/f72 0 2024-08-19T00:56:02.884 INFO:tasks.workunit.client.0.smithi017.stdout:6/12: dread f1 [0,4194304] 0 2024-08-19T00:56:02.886 INFO:tasks.workunit.client.1.smithi086.stdout:0/397: creat da/d14/d44/d49/f88 x:0 0 0 2024-08-19T00:56:02.891 INFO:tasks.workunit.client.1.smithi086.stdout:2/348: unlink d8/d2c/d47/l5b 0 2024-08-19T00:56:02.892 INFO:tasks.workunit.client.1.smithi086.stdout:2/349: chown d8/l57 3838 1 2024-08-19T00:56:02.894 INFO:tasks.workunit.client.0.smithi017.stdout:2/87: truncate d2/d7/dd/f15 1280386 0 2024-08-19T00:56:02.895 INFO:tasks.workunit.client.1.smithi086.stdout:2/350: mkdir d8/d2c/d47/d73 0 2024-08-19T00:56:02.896 INFO:tasks.workunit.client.0.smithi017.stdout:2/88: write d2/d7/d10/d19/f1d [357661,40090] 0 2024-08-19T00:56:02.899 INFO:tasks.workunit.client.0.smithi017.stdout:6/13: dwrite f1 [0,4194304] 0 2024-08-19T00:56:02.899 INFO:tasks.workunit.client.1.smithi086.stdout:2/351: rmdir d8/d24 39 2024-08-19T00:56:02.899 INFO:tasks.workunit.client.1.smithi086.stdout:5/362: dwrite d0/df/d1f/d33/f49 [0,4194304] 0 2024-08-19T00:56:02.900 INFO:tasks.workunit.client.0.smithi017.stdout:6/14: read f1 [2377155,50296] 0 2024-08-19T00:56:02.901 INFO:tasks.workunit.client.1.smithi086.stdout:5/363: chown d0/d20/f36 1775784 1 2024-08-19T00:56:02.902 INFO:tasks.workunit.client.1.smithi086.stdout:5/364: chown d0/d2d/d43/d4d/c50 661 1 2024-08-19T00:56:02.904 INFO:tasks.workunit.client.0.smithi017.stdout:0/48: truncate f1 16472 0 2024-08-19T00:56:02.908 INFO:tasks.workunit.client.1.smithi086.stdout:1/447: truncate d4/d7/d2a/d36/d7d/d88/f4a 2345802 0 2024-08-19T00:56:02.909 INFO:tasks.workunit.client.1.smithi086.stdout:2/352: dwrite d8/d2c/f49 [0,4194304] 0 2024-08-19T00:56:02.910 INFO:tasks.workunit.client.1.smithi086.stdout:2/353: dread - d8/d2c/d38/f45 zero size 2024-08-19T00:56:02.913 INFO:tasks.workunit.client.1.smithi086.stdout:0/398: getdents da/d14/d26 0 2024-08-19T00:56:02.916 INFO:tasks.workunit.client.1.smithi086.stdout:0/399: chown da/d14/d44/d49/f63 3 1 2024-08-19T00:56:02.917 INFO:tasks.workunit.client.0.smithi017.stdout:0/49: mknod d5/c14 0 2024-08-19T00:56:02.917 INFO:tasks.workunit.client.1.smithi086.stdout:3/387: truncate d3/d9/f39 344951 0 2024-08-19T00:56:02.918 INFO:tasks.workunit.client.0.smithi017.stdout:0/50: write d5/f11 [524550,45916] 0 2024-08-19T00:56:02.920 INFO:tasks.workunit.client.1.smithi086.stdout:1/448: dwrite d4/d7/d2a/f2b [0,4194304] 0 2024-08-19T00:56:02.920 INFO:tasks.workunit.client.0.smithi017.stdout:9/50: truncate d0/fe 115908 0 2024-08-19T00:56:02.920 INFO:tasks.workunit.client.1.smithi086.stdout:5/365: symlink d0/d5f/d60/l71 0 2024-08-19T00:56:02.921 INFO:tasks.workunit.client.1.smithi086.stdout:9/405: write db/d23/f54 [1191762,99628] 0 2024-08-19T00:56:02.925 INFO:tasks.workunit.client.0.smithi017.stdout:9/51: dread d0/fa [0,4194304] 0 2024-08-19T00:56:02.926 INFO:tasks.workunit.client.1.smithi086.stdout:2/354: symlink d8/d24/d32/d4d/l74 0 2024-08-19T00:56:02.929 INFO:tasks.workunit.client.0.smithi017.stdout:3/45: dwrite d5/f6 [4194304,4194304] 0 2024-08-19T00:56:02.929 INFO:tasks.workunit.client.1.smithi086.stdout:3/388: symlink d3/d18/d27/d76/l86 0 2024-08-19T00:56:02.929 INFO:tasks.workunit.client.1.smithi086.stdout:5/366: dwrite d0/d5f/d60/d57/f58 [0,4194304] 0 2024-08-19T00:56:02.930 INFO:tasks.workunit.client.0.smithi017.stdout:2/89: getdents d2/d7/dd 0 2024-08-19T00:56:02.932 INFO:tasks.workunit.client.1.smithi086.stdout:0/400: mkdir da/d14/d1a/d2e/d39/d3b/d89 0 2024-08-19T00:56:02.933 INFO:tasks.workunit.client.1.smithi086.stdout:0/401: fdatasync da/d14/d1a/d2e/d39/f74 0 2024-08-19T00:56:02.933 INFO:tasks.workunit.client.0.smithi017.stdout:5/41: getdents db 0 2024-08-19T00:56:02.934 INFO:tasks.workunit.client.1.smithi086.stdout:0/402: chown da/d14/d1a/d2e/d39/d3b/d89 3 1 2024-08-19T00:56:02.935 INFO:tasks.workunit.client.0.smithi017.stdout:5/42: stat db/f10 0 2024-08-19T00:56:02.936 INFO:tasks.workunit.client.0.smithi017.stdout:5/43: readlink l9 0 2024-08-19T00:56:02.938 INFO:tasks.workunit.client.1.smithi086.stdout:9/406: fdatasync db/d26/f49 0 2024-08-19T00:56:02.939 INFO:tasks.workunit.client.1.smithi086.stdout:9/407: stat db/c13 0 2024-08-19T00:56:02.940 INFO:tasks.workunit.client.0.smithi017.stdout:3/46: dwrite f3 [0,4194304] 0 2024-08-19T00:56:02.941 INFO:tasks.workunit.client.0.smithi017.stdout:3/47: readlink l0 0 2024-08-19T00:56:02.942 INFO:tasks.workunit.client.0.smithi017.stdout:3/48: chown f3 9686 1 2024-08-19T00:56:02.943 INFO:tasks.workunit.client.1.smithi086.stdout:7/425: truncate d3/de/f15 3380785 0 2024-08-19T00:56:02.943 INFO:tasks.workunit.client.0.smithi017.stdout:9/52: dread d0/fc [0,4194304] 0 2024-08-19T00:56:02.945 INFO:tasks.workunit.client.1.smithi086.stdout:8/382: dwrite f7 [0,4194304] 0 2024-08-19T00:56:02.947 INFO:tasks.workunit.client.0.smithi017.stdout:5/44: mkdir db/d14 0 2024-08-19T00:56:02.949 INFO:tasks.workunit.client.0.smithi017.stdout:3/49: mkdir d5/da 0 2024-08-19T00:56:02.954 INFO:tasks.workunit.client.1.smithi086.stdout:4/371: dwrite d2/d18/d33/d42/d72/f14 [0,4194304] 0 2024-08-19T00:56:02.962 INFO:tasks.workunit.client.0.smithi017.stdout:3/50: symlink d5/lb 0 2024-08-19T00:56:02.967 INFO:tasks.workunit.client.1.smithi086.stdout:6/390: unlink db/d37/f4c 0 2024-08-19T00:56:02.967 INFO:tasks.workunit.client.0.smithi017.stdout:5/45: mkdir db/d14/d15 0 2024-08-19T00:56:02.968 INFO:tasks.workunit.client.1.smithi086.stdout:8/383: symlink dc/d17/d1e/l7b 0 2024-08-19T00:56:02.969 INFO:tasks.workunit.client.0.smithi017.stdout:3/51: write d5/f9 [229094,46211] 0 2024-08-19T00:56:02.970 INFO:tasks.workunit.client.0.smithi017.stdout:3/52: fdatasync f3 0 2024-08-19T00:56:02.972 INFO:tasks.workunit.client.0.smithi017.stdout:0/51: dread f1 [0,4194304] 0 2024-08-19T00:56:02.973 INFO:tasks.workunit.client.0.smithi017.stdout:5/46: mknod db/d14/d15/c16 0 2024-08-19T00:56:02.974 INFO:tasks.workunit.client.0.smithi017.stdout:6/15: truncate f1 1171183 0 2024-08-19T00:56:02.974 INFO:tasks.workunit.client.0.smithi017.stdout:5/47: truncate f7 1011477 0 2024-08-19T00:56:02.974 INFO:tasks.workunit.client.1.smithi086.stdout:9/408: dread db/d23/d30/d3f/f71 [0,4194304] 0 2024-08-19T00:56:02.975 INFO:tasks.workunit.client.0.smithi017.stdout:6/16: stat f2 0 2024-08-19T00:56:02.976 INFO:tasks.workunit.client.0.smithi017.stdout:6/17: chown f2 18227 1 2024-08-19T00:56:02.977 INFO:tasks.workunit.client.1.smithi086.stdout:1/449: creat d4/d7/d2a/d36/d3a/f91 x:0 0 0 2024-08-19T00:56:02.978 INFO:tasks.workunit.client.0.smithi017.stdout:6/18: truncate f2 1053590 0 2024-08-19T00:56:02.978 INFO:tasks.workunit.client.1.smithi086.stdout:7/426: dread d3/d34/d44/f37 [0,4194304] 0 2024-08-19T00:56:02.978 INFO:tasks.workunit.client.1.smithi086.stdout:9/409: dread db/dd/d19/d18/f2f [0,4194304] 0 2024-08-19T00:56:02.979 INFO:tasks.workunit.client.0.smithi017.stdout:3/53: creat d5/fc x:0 0 0 2024-08-19T00:56:02.979 INFO:tasks.workunit.client.0.smithi017.stdout:0/52: dwrite d5/fa [0,4194304] 0 2024-08-19T00:56:02.981 INFO:tasks.workunit.client.1.smithi086.stdout:4/372: rename d2/d18/d33/d42/d72/d78/d25/d6b/d6e to d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d 0 2024-08-19T00:56:02.983 INFO:tasks.workunit.client.1.smithi086.stdout:0/403: mknod da/d14/d1a/d2e/d39/d3b/d89/c8a 0 2024-08-19T00:56:02.984 INFO:tasks.workunit.client.1.smithi086.stdout:5/367: dread d0/d2d/d4f/f5c [0,4194304] 0 2024-08-19T00:56:02.984 INFO:tasks.workunit.client.1.smithi086.stdout:1/450: dwrite d4/d1e/f20 [0,4194304] 0 2024-08-19T00:56:02.985 INFO:tasks.workunit.client.1.smithi086.stdout:0/404: fsync da/d14/d44/f5a 0 2024-08-19T00:56:02.987 INFO:tasks.workunit.client.0.smithi017.stdout:5/48: rename db/l12 to db/l17 0 2024-08-19T00:56:02.988 INFO:tasks.workunit.client.0.smithi017.stdout:5/49: write f7 [249360,25921] 0 2024-08-19T00:56:02.989 INFO:tasks.workunit.client.0.smithi017.stdout:5/50: read - db/f10 zero size 2024-08-19T00:56:02.991 INFO:tasks.workunit.client.1.smithi086.stdout:5/368: dwrite d0/d2d/f32 [0,4194304] 0 2024-08-19T00:56:02.992 INFO:tasks.workunit.client.1.smithi086.stdout:5/369: fsync d0/df/d1f/d33/f49 0 2024-08-19T00:56:02.996 INFO:tasks.workunit.client.0.smithi017.stdout:0/53: fsync f1 0 2024-08-19T00:56:02.998 INFO:tasks.workunit.client.0.smithi017.stdout:3/54: dread f2 [4194304,4194304] 0 2024-08-19T00:56:03.001 INFO:tasks.workunit.client.0.smithi017.stdout:5/51: rename c2 to db/d14/c18 0 2024-08-19T00:56:03.002 INFO:tasks.workunit.client.0.smithi017.stdout:5/52: truncate db/ff 974947 0 2024-08-19T00:56:03.002 INFO:tasks.workunit.client.0.smithi017.stdout:5/53: stat db 0 2024-08-19T00:56:03.003 INFO:tasks.workunit.client.0.smithi017.stdout:6/19: link f2 f3 0 2024-08-19T00:56:03.005 INFO:tasks.workunit.client.1.smithi086.stdout:3/389: write d3/d9/f13 [1448289,31889] 0 2024-08-19T00:56:03.007 INFO:tasks.workunit.client.1.smithi086.stdout:3/390: write d3/d26/f7e [404562,36943] 0 2024-08-19T00:56:03.007 INFO:tasks.workunit.client.1.smithi086.stdout:2/355: creat d8/d14/f75 x:0 0 0 2024-08-19T00:56:03.007 INFO:tasks.workunit.client.0.smithi017.stdout:2/90: truncate d2/d7/d10/f11 1904472 0 2024-08-19T00:56:03.008 INFO:tasks.workunit.client.1.smithi086.stdout:3/391: stat d3/d26/d2b 0 2024-08-19T00:56:03.008 INFO:tasks.workunit.client.0.smithi017.stdout:0/54: symlink d5/l15 0 2024-08-19T00:56:03.008 INFO:tasks.workunit.client.1.smithi086.stdout:3/392: readlink d3/d26/d2b/l74 0 2024-08-19T00:56:03.009 INFO:tasks.workunit.client.1.smithi086.stdout:3/393: write d3/d18/d27/d49/d3f/d5b/f70 [945343,81764] 0 2024-08-19T00:56:03.012 INFO:tasks.workunit.client.0.smithi017.stdout:5/54: mkdir db/d19 0 2024-08-19T00:56:03.012 INFO:tasks.workunit.client.0.smithi017.stdout:9/53: dwrite d0/fc [0,4194304] 0 2024-08-19T00:56:03.013 INFO:tasks.workunit.client.0.smithi017.stdout:5/55: stat db/d14/d15/c16 0 2024-08-19T00:56:03.014 INFO:tasks.workunit.client.0.smithi017.stdout:9/54: read - d0/f11 zero size 2024-08-19T00:56:03.018 INFO:tasks.workunit.client.0.smithi017.stdout:2/91: write d2/f3 [3445495,109006] 0 2024-08-19T00:56:03.019 INFO:tasks.workunit.client.0.smithi017.stdout:2/92: dread - d2/d7/dd/f1c zero size 2024-08-19T00:56:03.020 INFO:tasks.workunit.client.0.smithi017.stdout:0/55: fdatasync d5/f10 0 2024-08-19T00:56:03.021 INFO:tasks.workunit.client.0.smithi017.stdout:2/93: write d2/d7/dd/f1c [861138,13713] 0 2024-08-19T00:56:03.025 INFO:tasks.workunit.client.0.smithi017.stdout:3/55: creat d5/da/fd x:0 0 0 2024-08-19T00:56:03.027 INFO:tasks.workunit.client.0.smithi017.stdout:3/56: chown c4 405482 1 2024-08-19T00:56:03.029 INFO:tasks.workunit.client.0.smithi017.stdout:3/57: dread - d5/da/fd zero size 2024-08-19T00:56:03.030 INFO:tasks.workunit.client.0.smithi017.stdout:2/94: dwrite d2/d7/fc [0,4194304] 0 2024-08-19T00:56:03.032 INFO:tasks.workunit.client.0.smithi017.stdout:5/56: rename db/fd to db/d14/d15/f1a 0 2024-08-19T00:56:03.035 INFO:tasks.workunit.client.1.smithi086.stdout:6/391: mkdir db/d37/d28/d7f 0 2024-08-19T00:56:03.035 INFO:tasks.workunit.client.0.smithi017.stdout:2/95: dread d2/f3 [0,4194304] 0 2024-08-19T00:56:03.038 INFO:tasks.workunit.client.1.smithi086.stdout:8/384: creat dc/d70/d7a/f7c x:0 0 0 2024-08-19T00:56:03.044 INFO:tasks.workunit.client.0.smithi017.stdout:3/58: fsync f2 0 2024-08-19T00:56:03.045 INFO:tasks.workunit.client.0.smithi017.stdout:0/56: dwrite d5/fc [0,4194304] 0 2024-08-19T00:56:03.046 INFO:tasks.workunit.client.0.smithi017.stdout:3/59: write d5/fc [582418,46325] 0 2024-08-19T00:56:03.048 INFO:tasks.workunit.client.0.smithi017.stdout:5/57: mknod db/c1b 0 2024-08-19T00:56:03.052 INFO:tasks.workunit.client.0.smithi017.stdout:6/20: fsync f3 0 2024-08-19T00:56:03.054 INFO:tasks.workunit.client.1.smithi086.stdout:5/370: mkdir d0/d8/d72 0 2024-08-19T00:56:03.058 INFO:tasks.workunit.client.1.smithi086.stdout:6/392: stat db/d34/l6f 0 2024-08-19T00:56:03.059 INFO:tasks.workunit.client.0.smithi017.stdout:0/57: rename d5/fb to d5/f16 0 2024-08-19T00:56:03.061 INFO:tasks.workunit.client.0.smithi017.stdout:3/60: mknod d5/ce 0 2024-08-19T00:56:03.062 INFO:tasks.workunit.client.0.smithi017.stdout:3/61: chown f3 787934407 1 2024-08-19T00:56:03.063 INFO:tasks.workunit.client.0.smithi017.stdout:3/62: write d5/f6 [8162485,21035] 0 2024-08-19T00:56:03.063 INFO:tasks.workunit.client.0.smithi017.stdout:0/58: dread d5/f11 [0,4194304] 0 2024-08-19T00:56:03.064 INFO:tasks.workunit.client.0.smithi017.stdout:5/58: creat db/d14/f1c x:0 0 0 2024-08-19T00:56:03.064 INFO:tasks.workunit.client.0.smithi017.stdout:5/59: readlink db/l13 0 2024-08-19T00:56:03.065 INFO:tasks.workunit.client.0.smithi017.stdout:5/60: chown db/d14/f1c 13525 1 2024-08-19T00:56:03.068 INFO:tasks.workunit.client.0.smithi017.stdout:2/96: symlink d2/l1f 0 2024-08-19T00:56:03.069 INFO:tasks.workunit.client.1.smithi086.stdout:7/427: rename d3/c4e to d3/d34/d44/d58/d4b/c80 0 2024-08-19T00:56:03.070 INFO:tasks.workunit.client.1.smithi086.stdout:5/371: dread d0/d20/f36 [0,4194304] 0 2024-08-19T00:56:03.070 INFO:tasks.workunit.client.1.smithi086.stdout:7/428: write d3/de/f27 [4621850,40826] 0 2024-08-19T00:56:03.071 INFO:tasks.workunit.client.1.smithi086.stdout:5/372: write d0/d2d/d43/f45 [513511,45706] 0 2024-08-19T00:56:03.071 INFO:tasks.workunit.client.0.smithi017.stdout:9/55: write d0/fa [4520746,118681] 0 2024-08-19T00:56:03.074 INFO:tasks.workunit.client.0.smithi017.stdout:6/21: creat f4 x:0 0 0 2024-08-19T00:56:03.074 INFO:tasks.workunit.client.0.smithi017.stdout:0/59: dwrite d5/f12 [0,4194304] 0 2024-08-19T00:56:03.075 INFO:tasks.workunit.client.0.smithi017.stdout:6/22: dread - f4 zero size 2024-08-19T00:56:03.076 INFO:tasks.workunit.client.1.smithi086.stdout:7/429: dwrite d3/d5b/f6f [0,4194304] 0 2024-08-19T00:56:03.076 INFO:tasks.workunit.client.1.smithi086.stdout:6/393: unlink l9 0 2024-08-19T00:56:03.077 INFO:tasks.workunit.client.0.smithi017.stdout:5/61: dwrite fa [0,4194304] 0 2024-08-19T00:56:03.078 INFO:tasks.workunit.client.1.smithi086.stdout:7/430: write d3/ff [5099534,14018] 0 2024-08-19T00:56:03.078 INFO:tasks.workunit.client.0.smithi017.stdout:5/62: chown f5 0 1 2024-08-19T00:56:03.092 INFO:tasks.workunit.client.1.smithi086.stdout:1/451: sync 2024-08-19T00:56:03.092 INFO:tasks.workunit.client.1.smithi086.stdout:0/405: sync 2024-08-19T00:56:03.155 INFO:tasks.workunit.client.1.smithi086.stdout:7/431: sync 2024-08-19T00:56:03.227 INFO:tasks.workunit.client.0.smithi017.stdout:3/63: unlink d5/c7 0 2024-08-19T00:56:03.232 INFO:tasks.workunit.client.0.smithi017.stdout:2/97: dread d2/d7/d10/d19/fb [0,4194304] 0 2024-08-19T00:56:03.237 INFO:tasks.workunit.client.1.smithi086.stdout:6/394: creat db/d37/d44/f80 x:0 0 0 2024-08-19T00:56:03.237 INFO:tasks.workunit.client.0.smithi017.stdout:2/98: dread d2/d7/d10/d19/fb [0,4194304] 0 2024-08-19T00:56:03.238 INFO:tasks.workunit.client.0.smithi017.stdout:0/60: rmdir d5 39 2024-08-19T00:56:03.240 INFO:tasks.workunit.client.0.smithi017.stdout:6/23: mkdir d5 0 2024-08-19T00:56:03.241 INFO:tasks.workunit.client.1.smithi086.stdout:2/356: getdents d8/d24/d32/d4d/d6a 0 2024-08-19T00:56:03.243 INFO:tasks.workunit.client.1.smithi086.stdout:4/373: truncate d2/d18/d33/d42/d72/ff 1208800 0 2024-08-19T00:56:03.244 INFO:tasks.workunit.client.0.smithi017.stdout:3/64: creat d5/ff x:0 0 0 2024-08-19T00:56:03.245 INFO:tasks.workunit.client.0.smithi017.stdout:3/65: write d5/fc [170785,103097] 0 2024-08-19T00:56:03.246 INFO:tasks.workunit.client.1.smithi086.stdout:2/357: dwrite d8/d2c/d47/f6d [0,4194304] 0 2024-08-19T00:56:03.247 INFO:tasks.workunit.client.1.smithi086.stdout:5/373: mkdir d0/d8/d73 0 2024-08-19T00:56:03.249 INFO:tasks.workunit.client.1.smithi086.stdout:3/394: truncate d3/d9/f39 954235 0 2024-08-19T00:56:03.249 INFO:tasks.workunit.client.0.smithi017.stdout:2/99: dread - d2/f1a zero size 2024-08-19T00:56:03.251 INFO:tasks.workunit.client.1.smithi086.stdout:5/374: dread d0/d5f/d60/d57/f58 [0,4194304] 0 2024-08-19T00:56:03.251 INFO:tasks.workunit.client.1.smithi086.stdout:6/395: read db/f58 [3437717,40211] 0 2024-08-19T00:56:03.252 INFO:tasks.workunit.client.1.smithi086.stdout:8/385: getdents dc/d17/d1e/d55 0 2024-08-19T00:56:03.252 INFO:tasks.workunit.client.1.smithi086.stdout:8/386: read - dc/d1f/d37/f72 zero size 2024-08-19T00:56:03.260 INFO:tasks.workunit.client.0.smithi017.stdout:6/24: dread f3 [0,4194304] 0 2024-08-19T00:56:03.261 INFO:tasks.workunit.client.1.smithi086.stdout:9/410: rename db/d23 to db/d26/d5c/d87 0 2024-08-19T00:56:03.264 INFO:tasks.workunit.client.1.smithi086.stdout:9/411: read db/d26/d5c/d87/d30/d32/f3a [1292862,106039] 0 2024-08-19T00:56:03.267 INFO:tasks.workunit.client.0.smithi017.stdout:2/100: chown d2/d7/d10/d19/l6 643 1 2024-08-19T00:56:03.267 INFO:tasks.workunit.client.1.smithi086.stdout:3/395: readlink d3/d18/d27/d48/l7d 0 2024-08-19T00:56:03.268 INFO:tasks.workunit.client.0.smithi017.stdout:9/56: link d0/c9 d0/db/c12 0 2024-08-19T00:56:03.270 INFO:tasks.workunit.client.0.smithi017.stdout:0/61: mkdir d5/d17 0 2024-08-19T00:56:03.273 INFO:tasks.workunit.client.1.smithi086.stdout:6/396: rmdir db/d37/d44 39 2024-08-19T00:56:03.274 INFO:tasks.workunit.client.0.smithi017.stdout:3/66: write f2 [2144839,67887] 0 2024-08-19T00:56:03.275 INFO:tasks.workunit.client.1.smithi086.stdout:6/397: read db/d37/f27 [345652,43614] 0 2024-08-19T00:56:03.277 INFO:tasks.workunit.client.1.smithi086.stdout:7/432: creat d3/f81 x:0 0 0 2024-08-19T00:56:03.278 INFO:tasks.workunit.client.0.smithi017.stdout:2/101: read d2/d7/d10/f11 [457340,20491] 0 2024-08-19T00:56:03.279 INFO:tasks.workunit.client.1.smithi086.stdout:1/452: rename d4/d7/d2a/d36/d63/c76 to d4/d10/d75/d7a/c92 0 2024-08-19T00:56:03.280 INFO:tasks.workunit.client.0.smithi017.stdout:9/57: mknod d0/c13 0 2024-08-19T00:56:03.282 INFO:tasks.workunit.client.0.smithi017.stdout:6/25: dwrite f1 [0,4194304] 0 2024-08-19T00:56:03.282 INFO:tasks.workunit.client.0.smithi017.stdout:9/58: write d0/fa [1979302,78317] 0 2024-08-19T00:56:03.284 INFO:tasks.workunit.client.0.smithi017.stdout:0/62: unlink d5/l9 0 2024-08-19T00:56:03.284 INFO:tasks.workunit.client.0.smithi017.stdout:5/63: getdents db 0 2024-08-19T00:56:03.285 INFO:tasks.workunit.client.0.smithi017.stdout:0/63: chown c4 3 1 2024-08-19T00:56:03.285 INFO:tasks.workunit.client.0.smithi017.stdout:3/67: creat d5/f10 x:0 0 0 2024-08-19T00:56:03.288 INFO:tasks.workunit.client.0.smithi017.stdout:2/102: creat d2/d7/d10/d19/f20 x:0 0 0 2024-08-19T00:56:03.289 INFO:tasks.workunit.client.0.smithi017.stdout:2/103: read d2/d7/d10/f11 [192647,42479] 0 2024-08-19T00:56:03.289 INFO:tasks.workunit.client.1.smithi086.stdout:3/396: mknod d3/d18/d19/d37/d3a/c87 0 2024-08-19T00:56:03.291 INFO:tasks.workunit.client.0.smithi017.stdout:9/59: creat d0/f14 x:0 0 0 2024-08-19T00:56:03.294 INFO:tasks.workunit.client.1.smithi086.stdout:6/398: symlink db/d34/l81 0 2024-08-19T00:56:03.294 INFO:tasks.workunit.client.1.smithi086.stdout:6/399: stat db/d37/d41/f6b 0 2024-08-19T00:56:03.295 INFO:tasks.workunit.client.0.smithi017.stdout:2/104: chown d2/l5 29 1 2024-08-19T00:56:03.295 INFO:tasks.workunit.client.1.smithi086.stdout:0/406: getdents da/d14/d1a/d2e/d39/d3b/d89 0 2024-08-19T00:56:03.295 INFO:tasks.workunit.client.1.smithi086.stdout:6/400: truncate db/d37/d30/f72 295852 0 2024-08-19T00:56:03.296 INFO:tasks.workunit.client.0.smithi017.stdout:6/26: mkdir d5/d6 0 2024-08-19T00:56:03.298 INFO:tasks.workunit.client.1.smithi086.stdout:8/387: rename dc/d16/d18/d29/d2e/d28/d2b/d3b/l6c to dc/d17/d1e/d55/l7d 0 2024-08-19T00:56:03.300 INFO:tasks.workunit.client.1.smithi086.stdout:2/358: link d8/d2c/d47/l71 d8/d24/d32/d4d/d6a/l76 0 2024-08-19T00:56:03.301 INFO:tasks.workunit.client.1.smithi086.stdout:5/375: link d0/d20/f53 d0/d2d/d4f/f74 0 2024-08-19T00:56:03.304 INFO:tasks.workunit.client.1.smithi086.stdout:6/401: symlink db/d34/d4e/d55/l82 0 2024-08-19T00:56:03.304 INFO:tasks.workunit.client.1.smithi086.stdout:8/388: dwrite dc/d1f/d37/f72 [0,4194304] 0 2024-08-19T00:56:03.308 INFO:tasks.workunit.client.1.smithi086.stdout:2/359: mkdir d8/d43/d77 0 2024-08-19T00:56:03.309 INFO:tasks.workunit.client.1.smithi086.stdout:2/360: read d8/f1d [7248632,121807] 0 2024-08-19T00:56:03.310 INFO:tasks.workunit.client.1.smithi086.stdout:6/402: dwrite db/d34/d39/f40 [0,4194304] 0 2024-08-19T00:56:03.311 INFO:tasks.workunit.client.1.smithi086.stdout:2/361: truncate d8/d43/f5a 5738033 0 2024-08-19T00:56:03.312 INFO:tasks.workunit.client.1.smithi086.stdout:2/362: dread - d8/d2c/d47/f58 zero size 2024-08-19T00:56:03.314 INFO:tasks.workunit.client.1.smithi086.stdout:8/389: symlink dc/d1f/d37/d4f/l7e 0 2024-08-19T00:56:03.317 INFO:tasks.workunit.client.1.smithi086.stdout:1/453: rename d4/f1f to d4/d7/d2a/d36/d7d/d88/d56/f93 0 2024-08-19T00:56:03.318 INFO:tasks.workunit.client.1.smithi086.stdout:9/412: getdents db/d26/d5c/d87/d30 0 2024-08-19T00:56:03.320 INFO:tasks.workunit.client.1.smithi086.stdout:5/376: mknod d0/d8/d70/c75 0 2024-08-19T00:56:03.320 INFO:tasks.workunit.client.1.smithi086.stdout:9/413: truncate db/d26/d5c/d87/d30/f7f 360428 0 2024-08-19T00:56:03.321 INFO:tasks.workunit.client.1.smithi086.stdout:3/397: truncate d3/d18/d27/d49/d3f/d54/f77 875924 0 2024-08-19T00:56:03.324 INFO:tasks.workunit.client.1.smithi086.stdout:8/390: rmdir dc/d16 39 2024-08-19T00:56:03.324 INFO:tasks.workunit.client.1.smithi086.stdout:9/414: dwrite db/f39 [0,4194304] 0 2024-08-19T00:56:03.325 INFO:tasks.workunit.client.1.smithi086.stdout:9/415: dread - db/d26/d5c/d87/f42 zero size 2024-08-19T00:56:03.326 INFO:tasks.workunit.client.1.smithi086.stdout:0/407: truncate da/d14/d1a/d2e/d39/f45 2137204 0 2024-08-19T00:56:03.327 INFO:tasks.workunit.client.1.smithi086.stdout:6/403: rename db/f58 to db/d37/d41/f83 0 2024-08-19T00:56:03.328 INFO:tasks.workunit.client.1.smithi086.stdout:1/454: symlink d4/d7/d2a/d36/d7d/d88/d56/l94 0 2024-08-19T00:56:03.334 INFO:tasks.workunit.client.1.smithi086.stdout:0/408: dwrite da/d14/d1a/d2e/d30/f67 [0,4194304] 0 2024-08-19T00:56:03.334 INFO:tasks.workunit.client.1.smithi086.stdout:0/409: chown da/d14/f15 482578 1 2024-08-19T00:56:03.335 INFO:tasks.workunit.client.1.smithi086.stdout:5/377: dread d0/f1e [0,4194304] 0 2024-08-19T00:56:03.339 INFO:tasks.workunit.client.1.smithi086.stdout:4/374: sync 2024-08-19T00:56:03.340 INFO:tasks.workunit.client.1.smithi086.stdout:1/455: mkdir d4/d7/d2a/d6e/d95 0 2024-08-19T00:56:03.341 INFO:tasks.workunit.client.1.smithi086.stdout:1/456: chown d4/d1e/d6f/l70 237 1 2024-08-19T00:56:03.343 INFO:tasks.workunit.client.1.smithi086.stdout:5/378: unlink d0/df/d1f/d33/f55 0 2024-08-19T00:56:03.344 INFO:tasks.workunit.client.1.smithi086.stdout:8/391: dwrite dc/d16/d18/f76 [0,4194304] 0 2024-08-19T00:56:03.346 INFO:tasks.workunit.client.1.smithi086.stdout:8/392: chown dc/d17/d1e/d55/f6a 0 1 2024-08-19T00:56:03.346 INFO:tasks.workunit.client.1.smithi086.stdout:1/457: dread d4/d10/d75/f89 [0,4194304] 0 2024-08-19T00:56:03.347 INFO:tasks.workunit.client.1.smithi086.stdout:0/410: symlink da/d14/d1a/d2e/d39/d3b/d89/l8b 0 2024-08-19T00:56:03.347 INFO:tasks.workunit.client.1.smithi086.stdout:9/416: mknod db/d26/d5c/d87/c88 0 2024-08-19T00:56:03.348 INFO:tasks.workunit.client.1.smithi086.stdout:2/363: truncate d8/d43/f48 352933 0 2024-08-19T00:56:03.349 INFO:tasks.workunit.client.1.smithi086.stdout:8/393: chown dc/d16/d18/d29/d2e/c4b 0 1 2024-08-19T00:56:03.351 INFO:tasks.workunit.client.1.smithi086.stdout:3/398: write d3/f5 [2376482,24428] 0 2024-08-19T00:56:03.351 INFO:tasks.workunit.client.1.smithi086.stdout:0/411: write da/d14/d44/d49/f5f [609740,44515] 0 2024-08-19T00:56:03.354 INFO:tasks.workunit.client.1.smithi086.stdout:3/399: write d3/d18/d27/d49/d3f/d5b/d66/f6a [268725,121691] 0 2024-08-19T00:56:03.355 INFO:tasks.workunit.client.1.smithi086.stdout:0/412: write da/d14/d44/f81 [786392,127444] 0 2024-08-19T00:56:03.356 INFO:tasks.workunit.client.1.smithi086.stdout:1/458: mknod d4/d7/d2a/d36/d3a/d41/c96 0 2024-08-19T00:56:03.358 INFO:tasks.workunit.client.1.smithi086.stdout:3/400: truncate d3/f5 3333372 0 2024-08-19T00:56:03.359 INFO:tasks.workunit.client.1.smithi086.stdout:4/375: link d2/d18/d33/d42/d72/d2f/f39 d2/d18/d33/d42/d72/d78/d25/f7e 0 2024-08-19T00:56:03.360 INFO:tasks.workunit.client.1.smithi086.stdout:2/364: dwrite d8/d24/d32/f62 [0,4194304] 0 2024-08-19T00:56:03.360 INFO:tasks.workunit.client.0.smithi017.stdout:7/80: sync 2024-08-19T00:56:03.363 INFO:tasks.workunit.client.0.smithi017.stdout:9/60: dwrite d0/fa [0,4194304] 0 2024-08-19T00:56:03.365 INFO:tasks.workunit.client.0.smithi017.stdout:7/81: write d3/f5 [4005004,61199] 0 2024-08-19T00:56:03.366 INFO:tasks.workunit.client.0.smithi017.stdout:3/68: truncate f2 4534199 0 2024-08-19T00:56:03.367 INFO:tasks.workunit.client.0.smithi017.stdout:7/82: chown d3/dc/df/d1a/l1b 38 1 2024-08-19T00:56:03.367 INFO:tasks.workunit.client.1.smithi086.stdout:0/413: chown da/d5d/l6c 63 1 2024-08-19T00:56:03.368 INFO:tasks.workunit.client.0.smithi017.stdout:7/83: stat d3/dc/df 0 2024-08-19T00:56:03.369 INFO:tasks.workunit.client.1.smithi086.stdout:2/365: dwrite d8/d2c/d47/f51 [0,4194304] 0 2024-08-19T00:56:03.369 INFO:tasks.workunit.client.1.smithi086.stdout:3/401: dwrite d3/d18/d27/d49/d3f/d5b/d66/f6a [0,4194304] 0 2024-08-19T00:56:03.370 INFO:tasks.workunit.client.1.smithi086.stdout:8/394: truncate f5 1605889 0 2024-08-19T00:56:03.370 INFO:tasks.workunit.client.0.smithi017.stdout:7/84: write d3/f5 [3888817,115074] 0 2024-08-19T00:56:03.373 INFO:tasks.workunit.client.0.smithi017.stdout:2/105: rename d2/f3 to d2/d7/f21 0 2024-08-19T00:56:03.373 INFO:tasks.workunit.client.0.smithi017.stdout:7/85: rename d3/dc to d3/dc/df/d1a/d1d 22 2024-08-19T00:56:03.377 INFO:tasks.workunit.client.1.smithi086.stdout:8/395: readlink dc/d17/d1e/d49/l5e 0 2024-08-19T00:56:03.377 INFO:tasks.workunit.client.1.smithi086.stdout:8/396: write dc/d1f/f4c [3338494,56311] 0 2024-08-19T00:56:03.379 INFO:tasks.workunit.client.0.smithi017.stdout:5/64: link db/d14/c18 db/d19/c1d 0 2024-08-19T00:56:03.380 INFO:tasks.workunit.client.1.smithi086.stdout:5/379: truncate d0/df/d1f/d33/f4b 3289419 0 2024-08-19T00:56:03.380 INFO:tasks.workunit.client.1.smithi086.stdout:6/404: rename db/d37/d44/d5a/f79 to db/d34/d4e/d68/f84 0 2024-08-19T00:56:03.382 INFO:tasks.workunit.client.1.smithi086.stdout:0/414: dread da/d14/d44/f81 [0,4194304] 0 2024-08-19T00:56:03.383 INFO:tasks.workunit.client.0.smithi017.stdout:6/27: symlink d5/d6/l7 0 2024-08-19T00:56:03.387 INFO:tasks.workunit.client.1.smithi086.stdout:5/380: dwrite d0/df/d1f/d33/f34 [0,4194304] 0 2024-08-19T00:56:03.388 INFO:tasks.workunit.client.1.smithi086.stdout:5/381: readlink d0/df/l38 0 2024-08-19T00:56:03.388 INFO:tasks.workunit.client.1.smithi086.stdout:2/366: mknod d8/d24/d32/d4d/d6a/c78 0 2024-08-19T00:56:03.393 INFO:tasks.workunit.client.0.smithi017.stdout:3/69: chown f2 7279 1 2024-08-19T00:56:03.394 INFO:tasks.workunit.client.0.smithi017.stdout:3/70: chown d5/f6 2 1 2024-08-19T00:56:03.394 INFO:tasks.workunit.client.0.smithi017.stdout:3/71: dread - d5/f10 zero size 2024-08-19T00:56:03.395 INFO:tasks.workunit.client.1.smithi086.stdout:5/382: dwrite d0/d2d/d43/f45 [0,4194304] 0 2024-08-19T00:56:03.395 INFO:tasks.workunit.client.0.smithi017.stdout:9/61: unlink d0/cd 0 2024-08-19T00:56:03.395 INFO:tasks.workunit.client.0.smithi017.stdout:3/72: chown f3 449 1 2024-08-19T00:56:03.397 INFO:tasks.workunit.client.1.smithi086.stdout:1/459: link d4/d7/d2a/d36/d7d/d88/f5b d4/d1e/d6f/f97 0 2024-08-19T00:56:03.398 INFO:tasks.workunit.client.0.smithi017.stdout:5/65: rmdir db/d14 39 2024-08-19T00:56:03.401 INFO:tasks.workunit.client.0.smithi017.stdout:5/66: write fa [312645,72447] 0 2024-08-19T00:56:03.402 INFO:tasks.workunit.client.0.smithi017.stdout:6/28: truncate f2 468629 0 2024-08-19T00:56:03.404 INFO:tasks.workunit.client.1.smithi086.stdout:8/397: mkdir dc/d17/d1e/d55/d7f 0 2024-08-19T00:56:03.404 INFO:tasks.workunit.client.0.smithi017.stdout:9/62: dwrite d0/f14 [0,4194304] 0 2024-08-19T00:56:03.404 INFO:tasks.workunit.client.0.smithi017.stdout:9/63: fsync d0/f11 0 2024-08-19T00:56:03.405 INFO:tasks.workunit.client.1.smithi086.stdout:6/405: chown db/d37/c35 7165039 1 2024-08-19T00:56:03.407 INFO:tasks.workunit.client.0.smithi017.stdout:3/73: mkdir d5/d11 0 2024-08-19T00:56:03.408 INFO:tasks.workunit.client.0.smithi017.stdout:3/74: chown d5/d11 3 1 2024-08-19T00:56:03.409 INFO:tasks.workunit.client.1.smithi086.stdout:9/417: getdents db/d26/d5c/d87 0 2024-08-19T00:56:03.409 INFO:tasks.workunit.client.0.smithi017.stdout:3/75: write d5/f9 [969627,47355] 0 2024-08-19T00:56:03.411 INFO:tasks.workunit.client.0.smithi017.stdout:3/76: dread - d5/da/fd zero size 2024-08-19T00:56:03.412 INFO:tasks.workunit.client.0.smithi017.stdout:2/106: dwrite d2/d7/d10/d19/fb [0,4194304] 0 2024-08-19T00:56:03.414 INFO:tasks.workunit.client.1.smithi086.stdout:9/418: dread db/d26/d5c/d87/d30/d3f/f71 [0,4194304] 0 2024-08-19T00:56:03.414 INFO:tasks.workunit.client.0.smithi017.stdout:5/67: stat db/d14/d15/f1a 0 2024-08-19T00:56:03.415 INFO:tasks.workunit.client.1.smithi086.stdout:9/419: readlink db/d26/d5c/d87/l7c 0 2024-08-19T00:56:03.415 INFO:tasks.workunit.client.0.smithi017.stdout:6/29: rmdir d5 39 2024-08-19T00:56:03.419 INFO:tasks.workunit.client.0.smithi017.stdout:7/86: creat d3/f1e x:0 0 0 2024-08-19T00:56:03.420 INFO:tasks.workunit.client.0.smithi017.stdout:7/87: chown d3/dc/df/d1c 254363 1 2024-08-19T00:56:03.421 INFO:tasks.workunit.client.0.smithi017.stdout:7/88: fsync d3/f5 0 2024-08-19T00:56:03.421 INFO:tasks.workunit.client.0.smithi017.stdout:9/64: creat d0/f15 x:0 0 0 2024-08-19T00:56:03.422 INFO:tasks.workunit.client.0.smithi017.stdout:9/65: dread - d0/f11 zero size 2024-08-19T00:56:03.422 INFO:tasks.workunit.client.1.smithi086.stdout:2/367: mkdir d8/d24/d32/d5c/d79 0 2024-08-19T00:56:03.424 INFO:tasks.workunit.client.1.smithi086.stdout:4/376: truncate d2/d18/d33/d42/d72/f14 3331184 0 2024-08-19T00:56:03.424 INFO:tasks.workunit.client.1.smithi086.stdout:4/377: dread - d2/d18/f6f zero size 2024-08-19T00:56:03.424 INFO:tasks.workunit.client.0.smithi017.stdout:3/77: mknod d5/c12 0 2024-08-19T00:56:03.425 INFO:tasks.workunit.client.0.smithi017.stdout:2/107: fsync d2/d7/d10/f11 0 2024-08-19T00:56:03.427 INFO:tasks.workunit.client.0.smithi017.stdout:2/108: chown d2/d7/d10/d19/f1d 61 1 2024-08-19T00:56:03.427 INFO:tasks.workunit.client.0.smithi017.stdout:5/68: mkdir db/d14/d15/d1e 0 2024-08-19T00:56:03.428 INFO:tasks.workunit.client.0.smithi017.stdout:5/69: truncate f7 1049112 0 2024-08-19T00:56:03.430 INFO:tasks.workunit.client.1.smithi086.stdout:6/406: creat db/d37/d30/f85 x:0 0 0 2024-08-19T00:56:03.431 INFO:tasks.workunit.client.0.smithi017.stdout:7/89: creat d3/dc/f1f x:0 0 0 2024-08-19T00:56:03.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:03 smithi017 ceph-mon[16627]: pgmap v12: 65 pgs: 65 active+clean; 897 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 10 MiB/s rd, 106 MiB/s wr, 395 op/s 2024-08-19T00:56:03.433 INFO:tasks.workunit.client.1.smithi086.stdout:0/415: mknod da/d14/d44/d7b/c8c 0 2024-08-19T00:56:03.435 INFO:tasks.workunit.client.0.smithi017.stdout:3/78: symlink d5/da/l13 0 2024-08-19T00:56:03.436 INFO:tasks.workunit.client.1.smithi086.stdout:2/368: creat d8/d2c/d47/f7a x:0 0 0 2024-08-19T00:56:03.437 INFO:tasks.workunit.client.1.smithi086.stdout:5/383: symlink d0/df/d1f/d65/l76 0 2024-08-19T00:56:03.439 INFO:tasks.workunit.client.1.smithi086.stdout:1/460: mkdir d4/d10/d90/d98 0 2024-08-19T00:56:03.440 INFO:tasks.workunit.client.1.smithi086.stdout:4/378: creat d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/f7f x:0 0 0 2024-08-19T00:56:03.441 INFO:tasks.workunit.client.0.smithi017.stdout:6/30: creat d5/f8 x:0 0 0 2024-08-19T00:56:03.442 INFO:tasks.workunit.client.1.smithi086.stdout:8/398: mknod dc/d16/d18/c80 0 2024-08-19T00:56:03.442 INFO:tasks.workunit.client.1.smithi086.stdout:2/369: dwrite d8/d2c/f49 [0,4194304] 0 2024-08-19T00:56:03.443 INFO:tasks.workunit.client.0.smithi017.stdout:5/70: rmdir db/d14/d15 39 2024-08-19T00:56:03.444 INFO:tasks.workunit.client.1.smithi086.stdout:7/433: sync 2024-08-19T00:56:03.444 INFO:tasks.workunit.client.1.smithi086.stdout:6/407: chown db/l50 100161 1 2024-08-19T00:56:03.445 INFO:tasks.workunit.client.1.smithi086.stdout:0/416: creat da/d14/d26/f8d x:0 0 0 2024-08-19T00:56:03.445 INFO:tasks.workunit.client.0.smithi017.stdout:9/66: unlink d0/fe 0 2024-08-19T00:56:03.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:03 smithi086 ceph-mon[24511]: pgmap v12: 65 pgs: 65 active+clean; 897 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 10 MiB/s rd, 106 MiB/s wr, 395 op/s 2024-08-19T00:56:03.448 INFO:tasks.workunit.client.1.smithi086.stdout:0/417: write da/f3c [2335762,113973] 0 2024-08-19T00:56:03.448 INFO:tasks.workunit.client.1.smithi086.stdout:3/402: sync 2024-08-19T00:56:03.448 INFO:tasks.workunit.client.1.smithi086.stdout:1/461: dread d4/d7/f19 [0,4194304] 0 2024-08-19T00:56:03.450 INFO:tasks.workunit.client.1.smithi086.stdout:3/403: fsync d3/d26/d60/f71 0 2024-08-19T00:56:03.450 INFO:tasks.workunit.client.0.smithi017.stdout:2/109: symlink d2/l22 0 2024-08-19T00:56:03.451 INFO:tasks.workunit.client.1.smithi086.stdout:1/462: chown d4/d7/f19 445 1 2024-08-19T00:56:03.452 INFO:tasks.workunit.client.1.smithi086.stdout:3/404: fdatasync d3/d18/d61/f56 0 2024-08-19T00:56:03.452 INFO:tasks.workunit.client.1.smithi086.stdout:6/408: fsync db/f14 0 2024-08-19T00:56:03.457 INFO:tasks.workunit.client.1.smithi086.stdout:0/418: dwrite da/d14/d1a/f54 [0,4194304] 0 2024-08-19T00:56:03.457 INFO:tasks.workunit.client.0.smithi017.stdout:9/67: symlink d0/l16 0 2024-08-19T00:56:03.459 INFO:tasks.workunit.client.1.smithi086.stdout:4/379: rename d2/d18/d33/d42/d72/d78/d2c/c51 to d2/d18/d33/d42/d72/d78/d25/d30/d5d/c80 0 2024-08-19T00:56:03.460 INFO:tasks.workunit.client.0.smithi017.stdout:3/79: link d5/fc d5/d11/f14 0 2024-08-19T00:56:03.460 INFO:tasks.workunit.client.1.smithi086.stdout:4/380: chown c1 0 1 2024-08-19T00:56:03.461 INFO:tasks.workunit.client.1.smithi086.stdout:9/420: link db/d26/d5c/d87/d37/c59 db/dd/d19/d38/c89 0 2024-08-19T00:56:03.462 INFO:tasks.workunit.client.1.smithi086.stdout:1/463: dwrite d4/d7/d2a/d36/d3a/d41/f4b [4194304,4194304] 0 2024-08-19T00:56:03.463 INFO:tasks.workunit.client.1.smithi086.stdout:4/381: fsync d2/d18/f6f 0 2024-08-19T00:56:03.465 INFO:tasks.workunit.client.1.smithi086.stdout:5/384: write d0/d5f/d60/d57/f67 [1792561,102572] 0 2024-08-19T00:56:03.467 INFO:tasks.workunit.client.0.smithi017.stdout:2/110: dread d2/d7/dd/f15 [0,4194304] 0 2024-08-19T00:56:03.468 INFO:tasks.workunit.client.0.smithi017.stdout:5/71: unlink db/d14/c18 0 2024-08-19T00:56:03.470 INFO:tasks.workunit.client.1.smithi086.stdout:1/464: dwrite d4/d7/d2a/d36/d63/f78 [0,4194304] 0 2024-08-19T00:56:03.470 INFO:tasks.workunit.client.0.smithi017.stdout:7/90: truncate d3/f12 2971986 0 2024-08-19T00:56:03.471 INFO:tasks.workunit.client.0.smithi017.stdout:8/19: sync 2024-08-19T00:56:03.471 INFO:tasks.workunit.client.0.smithi017.stdout:1/27: sync 2024-08-19T00:56:03.471 INFO:tasks.workunit.client.0.smithi017.stdout:4/22: sync 2024-08-19T00:56:03.471 INFO:tasks.workunit.client.1.smithi086.stdout:7/434: fdatasync d3/de/f12 0 2024-08-19T00:56:03.472 INFO:tasks.workunit.client.0.smithi017.stdout:7/91: truncate d3/f1e 983203 0 2024-08-19T00:56:03.472 INFO:tasks.workunit.client.0.smithi017.stdout:1/28: read f2 [2215488,40907] 0 2024-08-19T00:56:03.473 INFO:tasks.workunit.client.0.smithi017.stdout:9/68: rmdir d0 39 2024-08-19T00:56:03.474 INFO:tasks.workunit.client.1.smithi086.stdout:5/385: dwrite d0/d2d/d4f/f5a [4194304,4194304] 0 2024-08-19T00:56:03.475 INFO:tasks.workunit.client.1.smithi086.stdout:7/435: chown d3/d34/d44/f71 495 1 2024-08-19T00:56:03.476 INFO:tasks.workunit.client.0.smithi017.stdout:3/80: mkdir d5/d15 0 2024-08-19T00:56:03.476 INFO:tasks.workunit.client.1.smithi086.stdout:5/386: fsync d0/df/d1f/d33/f49 0 2024-08-19T00:56:03.477 INFO:tasks.workunit.client.1.smithi086.stdout:7/436: chown d3/de/d68/d72/c75 21749608 1 2024-08-19T00:56:03.477 INFO:tasks.workunit.client.1.smithi086.stdout:3/405: mknod d3/d18/d1a/d51/c88 0 2024-08-19T00:56:03.477 INFO:tasks.workunit.client.0.smithi017.stdout:3/81: write d5/da/fd [555679,58967] 0 2024-08-19T00:56:03.478 INFO:tasks.workunit.client.0.smithi017.stdout:6/31: truncate f1 242157 0 2024-08-19T00:56:03.482 INFO:tasks.workunit.client.1.smithi086.stdout:2/370: rename d8/d24/d32/d4d/d6a/l76 to d8/d24/d32/d4d/d6a/l7b 0 2024-08-19T00:56:03.482 INFO:tasks.workunit.client.1.smithi086.stdout:2/371: chown d8 72404 1 2024-08-19T00:56:03.485 INFO:tasks.workunit.client.1.smithi086.stdout:5/387: dread d0/df/d1f/f28 [0,4194304] 0 2024-08-19T00:56:03.485 INFO:tasks.workunit.client.1.smithi086.stdout:0/419: creat da/d14/d1a/d2e/d39/d3b/d89/f8e x:0 0 0 2024-08-19T00:56:03.486 INFO:tasks.workunit.client.0.smithi017.stdout:6/32: dwrite d5/f8 [0,4194304] 0 2024-08-19T00:56:03.486 INFO:tasks.workunit.client.1.smithi086.stdout:5/388: dread - d0/d2d/d43/d4d/f54 zero size 2024-08-19T00:56:03.487 INFO:tasks.workunit.client.0.smithi017.stdout:6/33: truncate d5/f8 4441833 0 2024-08-19T00:56:03.488 INFO:tasks.workunit.client.1.smithi086.stdout:9/421: rmdir db/d26/d5c/d87/d30/d31 39 2024-08-19T00:56:03.493 INFO:tasks.workunit.client.0.smithi017.stdout:8/20: creat f4 x:0 0 0 2024-08-19T00:56:03.495 INFO:tasks.workunit.client.1.smithi086.stdout:9/422: dwrite db/dd/d19/f1f [0,4194304] 0 2024-08-19T00:56:03.497 INFO:tasks.workunit.client.0.smithi017.stdout:7/92: symlink d3/dc/df/d1a/l20 0 2024-08-19T00:56:03.498 INFO:tasks.workunit.client.1.smithi086.stdout:1/465: creat d4/d7/d2a/d36/d7d/d88/f99 x:0 0 0 2024-08-19T00:56:03.502 INFO:tasks.workunit.client.0.smithi017.stdout:2/111: dwrite d2/d7/dd/f15 [0,4194304] 0 2024-08-19T00:56:03.509 INFO:tasks.workunit.client.0.smithi017.stdout:1/29: dwrite f2 [4194304,4194304] 0 2024-08-19T00:56:03.511 INFO:tasks.workunit.client.0.smithi017.stdout:5/72: rename db/d14 to db/d19/d1f 0 2024-08-19T00:56:03.515 INFO:tasks.workunit.client.0.smithi017.stdout:6/34: creat d5/f9 x:0 0 0 2024-08-19T00:56:03.518 INFO:tasks.workunit.client.0.smithi017.stdout:4/23: mknod d2/c5 0 2024-08-19T00:56:03.518 INFO:tasks.workunit.client.0.smithi017.stdout:4/24: readlink - no filename 2024-08-19T00:56:03.522 INFO:tasks.workunit.client.0.smithi017.stdout:8/21: mknod c5 0 2024-08-19T00:56:03.526 INFO:tasks.workunit.client.0.smithi017.stdout:4/25: dwrite d2/f4 [4194304,4194304] 0 2024-08-19T00:56:03.529 INFO:tasks.workunit.client.0.smithi017.stdout:9/69: creat d0/db/f17 x:0 0 0 2024-08-19T00:56:03.531 INFO:tasks.workunit.client.0.smithi017.stdout:9/70: write d0/f11 [840031,74060] 0 2024-08-19T00:56:03.531 INFO:tasks.workunit.client.0.smithi017.stdout:3/82: truncate f3 1594392 0 2024-08-19T00:56:03.533 INFO:tasks.workunit.client.0.smithi017.stdout:9/71: write d0/fa [3243245,37502] 0 2024-08-19T00:56:03.534 INFO:tasks.workunit.client.0.smithi017.stdout:3/83: read d5/f9 [968028,45070] 0 2024-08-19T00:56:03.534 INFO:tasks.workunit.client.0.smithi017.stdout:1/30: unlink l0 0 2024-08-19T00:56:03.534 INFO:tasks.workunit.client.0.smithi017.stdout:9/72: stat d0/fa 0 2024-08-19T00:56:03.535 INFO:tasks.workunit.client.0.smithi017.stdout:5/73: rmdir db 39 2024-08-19T00:56:03.535 INFO:tasks.workunit.client.0.smithi017.stdout:1/31: fdatasync f2 0 2024-08-19T00:56:03.536 INFO:tasks.workunit.client.0.smithi017.stdout:9/73: dread - d0/db/f17 zero size 2024-08-19T00:56:03.537 INFO:tasks.workunit.client.0.smithi017.stdout:0/64: sync 2024-08-19T00:56:03.538 INFO:tasks.workunit.client.0.smithi017.stdout:3/84: write d5/f10 [373977,101593] 0 2024-08-19T00:56:03.539 INFO:tasks.workunit.client.0.smithi017.stdout:8/22: unlink c5 0 2024-08-19T00:56:03.541 INFO:tasks.workunit.client.0.smithi017.stdout:9/74: chown d0/db/cf 3 1 2024-08-19T00:56:03.541 INFO:tasks.workunit.client.0.smithi017.stdout:8/23: read f0 [1626074,29977] 0 2024-08-19T00:56:03.541 INFO:tasks.workunit.client.0.smithi017.stdout:6/35: dread f3 [0,4194304] 0 2024-08-19T00:56:03.542 INFO:tasks.workunit.client.0.smithi017.stdout:7/93: link d3/f1e d3/dc/f21 0 2024-08-19T00:56:03.543 INFO:tasks.workunit.client.0.smithi017.stdout:7/94: fdatasync d3/dc/f1f 0 2024-08-19T00:56:03.545 INFO:tasks.workunit.client.0.smithi017.stdout:2/112: dwrite d2/fa [4194304,4194304] 0 2024-08-19T00:56:03.548 INFO:tasks.workunit.client.0.smithi017.stdout:5/74: readlink db/l11 0 2024-08-19T00:56:03.549 INFO:tasks.workunit.client.1.smithi086.stdout:7/437: symlink d3/de/d68/d72/l82 0 2024-08-19T00:56:03.549 INFO:tasks.workunit.client.1.smithi086.stdout:3/406: creat d3/d18/d27/d49/d3f/f89 x:0 0 0 2024-08-19T00:56:03.550 INFO:tasks.workunit.client.0.smithi017.stdout:1/32: rename f2 to d4/f7 0 2024-08-19T00:56:03.550 INFO:tasks.workunit.client.0.smithi017.stdout:2/113: write d2/d7/d10/d19/f20 [299929,47044] 0 2024-08-19T00:56:03.550 INFO:tasks.workunit.client.0.smithi017.stdout:5/75: fdatasync db/f10 0 2024-08-19T00:56:03.551 INFO:tasks.workunit.client.1.smithi086.stdout:9/423: creat db/d26/d5c/d87/d30/d3f/f8a x:0 0 0 2024-08-19T00:56:03.552 INFO:tasks.workunit.client.1.smithi086.stdout:2/372: write d8/f11 [513649,5746] 0 2024-08-19T00:56:03.552 INFO:tasks.workunit.client.1.smithi086.stdout:5/389: write d0/df/d1f/d33/f3d [564055,50367] 0 2024-08-19T00:56:03.555 INFO:tasks.workunit.client.0.smithi017.stdout:9/75: dwrite d0/fa [4194304,4194304] 0 2024-08-19T00:56:03.555 INFO:tasks.workunit.client.0.smithi017.stdout:9/76: chown d0 234291211 1 2024-08-19T00:56:03.557 INFO:tasks.workunit.client.1.smithi086.stdout:7/438: dread d3/de/f15 [0,4194304] 0 2024-08-19T00:56:03.557 INFO:tasks.workunit.client.1.smithi086.stdout:8/399: getdents dc/d16/d18/d29/d2e/d28/d2b/d3b 0 2024-08-19T00:56:03.558 INFO:tasks.workunit.client.1.smithi086.stdout:6/409: link db/d34/l81 db/d34/d39/d76/l86 0 2024-08-19T00:56:03.561 INFO:tasks.workunit.client.1.smithi086.stdout:1/466: rename d4/d7/d2a/d6e/l8a to d4/d7/d2a/d6e/d95/l9a 0 2024-08-19T00:56:03.563 INFO:tasks.workunit.client.0.smithi017.stdout:8/24: mkdir d6 0 2024-08-19T00:56:03.563 INFO:tasks.workunit.client.0.smithi017.stdout:8/25: stat f0 0 2024-08-19T00:56:03.564 INFO:tasks.workunit.client.1.smithi086.stdout:5/390: dwrite d0/d20/f25 [0,4194304] 0 2024-08-19T00:56:03.565 INFO:tasks.workunit.client.0.smithi017.stdout:4/26: truncate d2/f3 816809 0 2024-08-19T00:56:03.567 INFO:tasks.workunit.client.0.smithi017.stdout:6/36: creat d5/d6/fa x:0 0 0 2024-08-19T00:56:03.567 INFO:tasks.workunit.client.0.smithi017.stdout:6/37: fsync f4 0 2024-08-19T00:56:03.568 INFO:tasks.workunit.client.1.smithi086.stdout:1/467: dread d4/d7/d2a/d36/d3a/d41/f67 [0,4194304] 0 2024-08-19T00:56:03.568 INFO:tasks.workunit.client.0.smithi017.stdout:7/95: read d3/f12 [1513913,49200] 0 2024-08-19T00:56:03.569 INFO:tasks.workunit.client.1.smithi086.stdout:9/424: creat db/d26/d5c/d87/d30/d3f/f8b x:0 0 0 2024-08-19T00:56:03.570 INFO:tasks.workunit.client.1.smithi086.stdout:8/400: mknod dc/d70/d7a/c81 0 2024-08-19T00:56:03.573 INFO:tasks.workunit.client.0.smithi017.stdout:7/96: dread d3/f5 [0,4194304] 0 2024-08-19T00:56:03.573 INFO:tasks.workunit.client.1.smithi086.stdout:6/410: mknod db/d34/d4e/c87 0 2024-08-19T00:56:03.574 INFO:tasks.workunit.client.1.smithi086.stdout:7/439: dread d3/de/f17 [0,4194304] 0 2024-08-19T00:56:03.576 INFO:tasks.workunit.client.1.smithi086.stdout:3/407: mkdir d3/d26/d2b/d33/d4a/d57/d8a 0 2024-08-19T00:56:03.578 INFO:tasks.workunit.client.0.smithi017.stdout:9/77: unlink d0/f11 0 2024-08-19T00:56:03.579 INFO:tasks.workunit.client.1.smithi086.stdout:6/411: dwrite db/d37/d44/d5a/f73 [0,4194304] 0 2024-08-19T00:56:03.580 INFO:tasks.workunit.client.0.smithi017.stdout:1/33: dwrite d4/f7 [4194304,4194304] 0 2024-08-19T00:56:03.581 INFO:tasks.workunit.client.1.smithi086.stdout:5/391: symlink d0/d5f/l77 0 2024-08-19T00:56:03.581 INFO:tasks.workunit.client.1.smithi086.stdout:5/392: dread - d0/d5f/f6f zero size 2024-08-19T00:56:03.582 INFO:tasks.workunit.client.0.smithi017.stdout:1/34: write d4/f7 [3488934,120544] 0 2024-08-19T00:56:03.583 INFO:tasks.workunit.client.1.smithi086.stdout:5/393: write d0/f6 [2780378,25275] 0 2024-08-19T00:56:03.587 INFO:tasks.workunit.client.0.smithi017.stdout:3/85: creat d5/d11/f16 x:0 0 0 2024-08-19T00:56:03.590 INFO:tasks.workunit.client.0.smithi017.stdout:8/26: write f0 [2965205,11674] 0 2024-08-19T00:56:03.591 INFO:tasks.workunit.client.1.smithi086.stdout:9/425: fsync db/d26/f49 0 2024-08-19T00:56:03.592 INFO:tasks.workunit.client.1.smithi086.stdout:9/426: chown db/d26/d5c/d87/d30/d3f/d43/d84 30974569 1 2024-08-19T00:56:03.594 INFO:tasks.workunit.client.0.smithi017.stdout:6/38: rename d5/f9 to d5/fb 0 2024-08-19T00:56:03.595 INFO:tasks.workunit.client.1.smithi086.stdout:1/468: unlink d4/d7/d2a/d36/d7d/d88/d56/l94 0 2024-08-19T00:56:03.596 INFO:tasks.workunit.client.1.smithi086.stdout:9/427: read db/d26/d5c/d87/d6d/f41 [1936055,118484] 0 2024-08-19T00:56:03.597 INFO:tasks.workunit.client.1.smithi086.stdout:8/401: unlink dc/d17/l5b 0 2024-08-19T00:56:03.597 INFO:tasks.workunit.client.1.smithi086.stdout:4/382: sync 2024-08-19T00:56:03.599 INFO:tasks.workunit.client.1.smithi086.stdout:9/428: write db/dd/d19/f1f [3060297,19522] 0 2024-08-19T00:56:03.599 INFO:tasks.workunit.client.1.smithi086.stdout:4/383: readlink d2/d18/d33/d42/d72/d78/l75 0 2024-08-19T00:56:03.599 INFO:tasks.workunit.client.1.smithi086.stdout:8/402: chown dc/d16/d18/d29/d2e/d28/d41/f59 312 1 2024-08-19T00:56:03.600 INFO:tasks.workunit.client.1.smithi086.stdout:8/403: chown dc/d16/d18/d29/d2e/d28/f69 252638575 1 2024-08-19T00:56:03.601 INFO:tasks.workunit.client.1.smithi086.stdout:8/404: chown dc/d1f/f27 156 1 2024-08-19T00:56:03.603 INFO:tasks.workunit.client.1.smithi086.stdout:3/408: dread d3/d18/d27/f83 [0,4194304] 0 2024-08-19T00:56:03.603 INFO:tasks.workunit.client.0.smithi017.stdout:8/27: dwrite f0 [0,4194304] 0 2024-08-19T00:56:03.603 INFO:tasks.workunit.client.1.smithi086.stdout:3/409: chown d3/d18 47 1 2024-08-19T00:56:03.607 INFO:tasks.workunit.client.0.smithi017.stdout:3/86: read f3 [426073,58623] 0 2024-08-19T00:56:03.610 INFO:tasks.workunit.client.0.smithi017.stdout:6/39: creat d5/d6/fc x:0 0 0 2024-08-19T00:56:03.621 INFO:tasks.workunit.client.0.smithi017.stdout:3/87: mknod d5/da/c17 0 2024-08-19T00:56:03.622 INFO:tasks.workunit.client.0.smithi017.stdout:3/88: chown d5/d11/f14 3039 1 2024-08-19T00:56:03.622 INFO:tasks.workunit.client.1.smithi086.stdout:1/469: rmdir d4/d7/d2a/d6e 39 2024-08-19T00:56:03.623 INFO:tasks.workunit.client.1.smithi086.stdout:2/373: dwrite d8/f20 [0,4194304] 0 2024-08-19T00:56:03.623 INFO:tasks.workunit.client.0.smithi017.stdout:4/27: rename d2/f3 to d2/f6 0 2024-08-19T00:56:03.625 INFO:tasks.workunit.client.1.smithi086.stdout:2/374: chown d8/d24/f59 132 1 2024-08-19T00:56:03.625 INFO:tasks.workunit.client.1.smithi086.stdout:6/412: rename db/f15 to db/d37/d28/d7f/f88 0 2024-08-19T00:56:03.626 INFO:tasks.workunit.client.0.smithi017.stdout:6/40: creat d5/d6/fd x:0 0 0 2024-08-19T00:56:03.627 INFO:tasks.workunit.client.1.smithi086.stdout:3/410: dwrite d3/d26/d2b/f6d [0,4194304] 0 2024-08-19T00:56:03.627 INFO:tasks.workunit.client.0.smithi017.stdout:2/114: getdents d2/d7 0 2024-08-19T00:56:03.628 INFO:tasks.workunit.client.1.smithi086.stdout:5/394: mknod d0/d2d/c78 0 2024-08-19T00:56:03.630 INFO:tasks.workunit.client.0.smithi017.stdout:7/97: link d3/dc/df/d1a/l20 d3/dc/df/d1c/l22 0 2024-08-19T00:56:03.632 INFO:tasks.workunit.client.1.smithi086.stdout:7/440: creat d3/d34/d44/f83 x:0 0 0 2024-08-19T00:56:03.633 INFO:tasks.workunit.client.0.smithi017.stdout:2/115: dread d2/d7/d10/d19/f20 [0,4194304] 0 2024-08-19T00:56:03.634 INFO:tasks.workunit.client.1.smithi086.stdout:9/429: fdatasync db/f1b 0 2024-08-19T00:56:03.635 INFO:tasks.workunit.client.0.smithi017.stdout:1/35: link d4/l5 d4/l8 0 2024-08-19T00:56:03.635 INFO:tasks.workunit.client.0.smithi017.stdout:2/116: fsync d2/d7/d10/d19/f20 0 2024-08-19T00:56:03.638 INFO:tasks.workunit.client.0.smithi017.stdout:4/28: creat d2/f7 x:0 0 0 2024-08-19T00:56:03.639 INFO:tasks.workunit.client.0.smithi017.stdout:2/117: chown d2/l22 56299 1 2024-08-19T00:56:03.640 INFO:tasks.workunit.client.1.smithi086.stdout:1/470: rename d4/d7/f21 to d4/d7/f9b 0 2024-08-19T00:56:03.641 INFO:tasks.workunit.client.0.smithi017.stdout:7/98: dwrite d3/dc/f1f [0,4194304] 0 2024-08-19T00:56:03.641 INFO:tasks.workunit.client.0.smithi017.stdout:6/41: write d5/fb [696919,76513] 0 2024-08-19T00:56:03.643 INFO:tasks.workunit.client.0.smithi017.stdout:6/42: dread - d5/d6/fc zero size 2024-08-19T00:56:03.646 INFO:tasks.workunit.client.0.smithi017.stdout:7/99: dread d3/f4 [0,4194304] 0 2024-08-19T00:56:03.648 INFO:tasks.workunit.client.0.smithi017.stdout:8/28: rmdir d6 0 2024-08-19T00:56:03.650 INFO:tasks.workunit.client.1.smithi086.stdout:3/411: symlink d3/d26/d2b/d33/d4a/l8b 0 2024-08-19T00:56:03.653 INFO:tasks.workunit.client.1.smithi086.stdout:5/395: write d0/f17 [2913521,62483] 0 2024-08-19T00:56:03.655 INFO:tasks.workunit.client.0.smithi017.stdout:1/36: creat d4/f9 x:0 0 0 2024-08-19T00:56:03.655 INFO:tasks.workunit.client.1.smithi086.stdout:9/430: dread db/d26/d5c/d87/d30/d3f/d43/f50 [0,4194304] 0 2024-08-19T00:56:03.655 INFO:tasks.workunit.client.1.smithi086.stdout:5/396: chown d0/df/c4c 324 1 2024-08-19T00:56:03.655 INFO:tasks.workunit.client.1.smithi086.stdout:2/375: dwrite d8/f36 [0,4194304] 0 2024-08-19T00:56:03.656 INFO:tasks.workunit.client.0.smithi017.stdout:1/37: chown d4/l5 31 1 2024-08-19T00:56:03.656 INFO:tasks.workunit.client.1.smithi086.stdout:9/431: stat db/d26/d5c 0 2024-08-19T00:56:03.657 INFO:tasks.workunit.client.0.smithi017.stdout:4/29: creat d2/f8 x:0 0 0 2024-08-19T00:56:03.660 INFO:tasks.workunit.client.0.smithi017.stdout:2/118: symlink d2/d7/d10/l23 0 2024-08-19T00:56:03.663 INFO:tasks.workunit.client.1.smithi086.stdout:1/471: rmdir d4/d7/d2a/d36/d7d 39 2024-08-19T00:56:03.664 INFO:tasks.workunit.client.1.smithi086.stdout:6/413: chown db/d34/d4e/d68/f84 7 1 2024-08-19T00:56:03.665 INFO:tasks.workunit.client.0.smithi017.stdout:6/43: fsync f2 0 2024-08-19T00:56:03.665 INFO:tasks.workunit.client.1.smithi086.stdout:1/472: dread d4/d10/d75/f8f [0,4194304] 0 2024-08-19T00:56:03.666 INFO:tasks.workunit.client.1.smithi086.stdout:1/473: chown d4/d7/f5e 389 1 2024-08-19T00:56:03.667 INFO:tasks.workunit.client.0.smithi017.stdout:7/100: mkdir d3/dc/df/d23 0 2024-08-19T00:56:03.668 INFO:tasks.workunit.client.1.smithi086.stdout:8/405: getdents dc/d1f/d37/d4f 0 2024-08-19T00:56:03.670 INFO:tasks.workunit.client.0.smithi017.stdout:1/38: mknod d4/ca 0 2024-08-19T00:56:03.671 INFO:tasks.workunit.client.0.smithi017.stdout:4/30: fsync d2/f8 0 2024-08-19T00:56:03.672 INFO:tasks.workunit.client.0.smithi017.stdout:1/39: chown d4/f7 246732520 1 2024-08-19T00:56:03.673 INFO:tasks.workunit.client.1.smithi086.stdout:0/420: sync 2024-08-19T00:56:03.673 INFO:tasks.workunit.client.0.smithi017.stdout:4/31: dread - d2/f8 zero size 2024-08-19T00:56:03.674 INFO:tasks.workunit.client.0.smithi017.stdout:2/119: creat d2/d7/d10/d19/f24 x:0 0 0 2024-08-19T00:56:03.674 INFO:tasks.workunit.client.0.smithi017.stdout:6/44: dwrite d5/d6/fd [0,4194304] 0 2024-08-19T00:56:03.675 INFO:tasks.workunit.client.0.smithi017.stdout:1/40: truncate d4/f7 8857375 0 2024-08-19T00:56:03.676 INFO:tasks.workunit.client.0.smithi017.stdout:4/32: chown d2/f7 105 1 2024-08-19T00:56:03.677 INFO:tasks.workunit.client.1.smithi086.stdout:7/441: truncate d3/de/d2d/f31 1557576 0 2024-08-19T00:56:03.677 INFO:tasks.workunit.client.0.smithi017.stdout:5/76: getdents db/d19/d1f/d15 0 2024-08-19T00:56:03.679 INFO:tasks.workunit.client.0.smithi017.stdout:3/89: getdents d5/d11 0 2024-08-19T00:56:03.679 INFO:tasks.workunit.client.1.smithi086.stdout:7/442: read d3/de/d2d/f35 [444134,113077] 0 2024-08-19T00:56:03.681 INFO:tasks.workunit.client.1.smithi086.stdout:3/412: creat d3/d18/d61/d85/f8c x:0 0 0 2024-08-19T00:56:03.682 INFO:tasks.workunit.client.1.smithi086.stdout:6/414: write f3 [3322670,93940] 0 2024-08-19T00:56:03.682 INFO:tasks.workunit.client.0.smithi017.stdout:6/45: rmdir d5 39 2024-08-19T00:56:03.685 INFO:tasks.workunit.client.0.smithi017.stdout:2/120: creat d2/d7/d10/f25 x:0 0 0 2024-08-19T00:56:03.687 INFO:tasks.workunit.client.1.smithi086.stdout:1/474: fdatasync d4/d7/f37 0 2024-08-19T00:56:03.688 INFO:tasks.workunit.client.1.smithi086.stdout:8/406: mkdir dc/d17/d1e/d82 0 2024-08-19T00:56:03.689 INFO:tasks.workunit.client.0.smithi017.stdout:1/41: mknod d4/cb 0 2024-08-19T00:56:03.690 INFO:tasks.workunit.client.1.smithi086.stdout:2/376: symlink d8/d14/l7c 0 2024-08-19T00:56:03.691 INFO:tasks.workunit.client.1.smithi086.stdout:2/377: truncate d8/d2c/d67/f6f 344410 0 2024-08-19T00:56:03.691 INFO:tasks.workunit.client.0.smithi017.stdout:4/33: creat d2/f9 x:0 0 0 2024-08-19T00:56:03.692 INFO:tasks.workunit.client.0.smithi017.stdout:4/34: write d2/f8 [929518,108766] 0 2024-08-19T00:56:03.694 INFO:tasks.workunit.client.0.smithi017.stdout:3/90: truncate f2 4001052 0 2024-08-19T00:56:03.695 INFO:tasks.workunit.client.1.smithi086.stdout:2/378: dwrite d8/d24/d32/f3c [0,4194304] 0 2024-08-19T00:56:03.699 INFO:tasks.workunit.client.0.smithi017.stdout:2/121: dread d2/d7/d10/d19/f20 [0,4194304] 0 2024-08-19T00:56:03.699 INFO:tasks.workunit.client.0.smithi017.stdout:1/42: mkdir d4/dc 0 2024-08-19T00:56:03.701 INFO:tasks.workunit.client.1.smithi086.stdout:3/413: unlink d3/d18/d19/d37/f4e 0 2024-08-19T00:56:03.701 INFO:tasks.workunit.client.1.smithi086.stdout:5/397: write d0/df/d1f/d33/f4b [3603939,94903] 0 2024-08-19T00:56:03.702 INFO:tasks.workunit.client.1.smithi086.stdout:0/421: write da/fe [3304299,89253] 0 2024-08-19T00:56:03.703 INFO:tasks.workunit.client.1.smithi086.stdout:6/415: mkdir db/d34/d4e/d68/d89 0 2024-08-19T00:56:03.704 INFO:tasks.workunit.client.1.smithi086.stdout:7/443: dwrite d3/de/f15 [0,4194304] 0 2024-08-19T00:56:03.705 INFO:tasks.workunit.client.1.smithi086.stdout:3/414: dread d3/d18/f24 [4194304,4194304] 0 2024-08-19T00:56:03.706 INFO:tasks.workunit.client.1.smithi086.stdout:6/416: dread - db/d34/d69/f7d zero size 2024-08-19T00:56:03.706 INFO:tasks.workunit.client.0.smithi017.stdout:4/35: dread d2/f6 [0,4194304] 0 2024-08-19T00:56:03.706 INFO:tasks.workunit.client.0.smithi017.stdout:3/91: mkdir d5/d18 0 2024-08-19T00:56:03.706 INFO:tasks.workunit.client.0.smithi017.stdout:3/92: stat d5/d15 0 2024-08-19T00:56:03.707 INFO:tasks.workunit.client.1.smithi086.stdout:8/407: mkdir dc/d16/d18/d29/d2e/d83 0 2024-08-19T00:56:03.709 INFO:tasks.workunit.client.1.smithi086.stdout:4/384: sync 2024-08-19T00:56:03.710 INFO:tasks.workunit.client.1.smithi086.stdout:4/385: readlink d2/d18/l53 0 2024-08-19T00:56:03.711 INFO:tasks.workunit.client.0.smithi017.stdout:1/43: creat d4/fd x:0 0 0 2024-08-19T00:56:03.712 INFO:tasks.workunit.client.1.smithi086.stdout:9/432: creat db/d26/d5c/d87/d30/d3f/d43/d4e/d7a/f8c x:0 0 0 2024-08-19T00:56:03.712 INFO:tasks.workunit.client.0.smithi017.stdout:1/44: chown d4/dc 21654653 1 2024-08-19T00:56:03.712 INFO:tasks.workunit.client.1.smithi086.stdout:4/386: fsync d2/d18/d33/d42/d72/d78/d25/d30/d5d/f79 0 2024-08-19T00:56:03.713 INFO:tasks.workunit.client.0.smithi017.stdout:5/77: creat db/f20 x:0 0 0 2024-08-19T00:56:03.713 INFO:tasks.workunit.client.0.smithi017.stdout:1/45: fsync d4/f7 0 2024-08-19T00:56:03.714 INFO:tasks.workunit.client.1.smithi086.stdout:4/387: write d2/d18/d33/f64 [615268,95391] 0 2024-08-19T00:56:03.715 INFO:tasks.workunit.client.0.smithi017.stdout:1/46: chown d4/dc 137 1 2024-08-19T00:56:03.716 INFO:tasks.workunit.client.0.smithi017.stdout:4/36: creat d2/fa x:0 0 0 2024-08-19T00:56:03.717 INFO:tasks.workunit.client.1.smithi086.stdout:9/433: dread db/f39 [0,4194304] 0 2024-08-19T00:56:03.717 INFO:tasks.workunit.client.0.smithi017.stdout:5/78: chown db/l13 23320565 1 2024-08-19T00:56:03.717 INFO:tasks.workunit.client.0.smithi017.stdout:3/93: dwrite d5/ff [0,4194304] 0 2024-08-19T00:56:03.719 INFO:tasks.workunit.client.0.smithi017.stdout:4/37: fdatasync d2/f8 0 2024-08-19T00:56:03.719 INFO:tasks.workunit.client.0.smithi017.stdout:7/101: getdents d3/dc/df/d1c 0 2024-08-19T00:56:03.719 INFO:tasks.workunit.client.0.smithi017.stdout:1/47: truncate d4/fd 940899 0 2024-08-19T00:56:03.720 INFO:tasks.workunit.client.0.smithi017.stdout:5/79: dread - db/d19/d1f/f1c zero size 2024-08-19T00:56:03.721 INFO:tasks.workunit.client.1.smithi086.stdout:9/434: dread db/dd/d19/d38/f53 [0,4194304] 0 2024-08-19T00:56:03.721 INFO:tasks.workunit.client.1.smithi086.stdout:9/435: stat db/d26 0 2024-08-19T00:56:03.721 INFO:tasks.workunit.client.0.smithi017.stdout:4/38: chown d2/f6 3438617 1 2024-08-19T00:56:03.725 INFO:tasks.workunit.client.0.smithi017.stdout:2/122: symlink d2/l26 0 2024-08-19T00:56:03.725 INFO:tasks.workunit.client.1.smithi086.stdout:5/398: dread d0/df/d1f/d33/f40 [0,4194304] 0 2024-08-19T00:56:03.725 INFO:tasks.workunit.client.0.smithi017.stdout:5/80: write db/f20 [963792,31089] 0 2024-08-19T00:56:03.726 INFO:tasks.workunit.client.0.smithi017.stdout:6/46: write f1 [979105,70805] 0 2024-08-19T00:56:03.729 INFO:tasks.workunit.client.1.smithi086.stdout:3/415: dread d3/d18/f2c [0,4194304] 0 2024-08-19T00:56:03.730 INFO:tasks.workunit.client.0.smithi017.stdout:5/81: chown db/d19/d1f/d15/c16 38289976 1 2024-08-19T00:56:03.731 INFO:tasks.workunit.client.0.smithi017.stdout:3/94: dwrite d5/da/fd [0,4194304] 0 2024-08-19T00:56:03.734 INFO:tasks.workunit.client.0.smithi017.stdout:1/48: dwrite d4/f9 [0,4194304] 0 2024-08-19T00:56:03.735 INFO:tasks.workunit.client.1.smithi086.stdout:5/399: dread d0/d8/d10/f2b [0,4194304] 0 2024-08-19T00:56:03.735 INFO:tasks.workunit.client.1.smithi086.stdout:3/416: dwrite d3/d26/d60/f69 [0,4194304] 0 2024-08-19T00:56:03.736 INFO:tasks.workunit.client.1.smithi086.stdout:5/400: write d0/df/f23 [98064,115782] 0 2024-08-19T00:56:03.737 INFO:tasks.workunit.client.0.smithi017.stdout:1/49: dread d4/f9 [0,4194304] 0 2024-08-19T00:56:03.747 INFO:tasks.workunit.client.0.smithi017.stdout:1/50: dwrite d4/f9 [0,4194304] 0 2024-08-19T00:56:03.749 INFO:tasks.workunit.client.1.smithi086.stdout:7/444: chown d3/d34/d44/f48 177 1 2024-08-19T00:56:03.752 INFO:tasks.workunit.client.0.smithi017.stdout:4/39: rename d2/f9 to d2/fb 0 2024-08-19T00:56:03.755 INFO:tasks.workunit.client.1.smithi086.stdout:2/379: getdents d8/d43/d77 0 2024-08-19T00:56:03.755 INFO:tasks.workunit.client.0.smithi017.stdout:2/123: creat d2/d7/d10/d19/f27 x:0 0 0 2024-08-19T00:56:03.755 INFO:tasks.workunit.client.0.smithi017.stdout:6/47: chown d5/f8 2123269069 1 2024-08-19T00:56:03.756 INFO:tasks.workunit.client.1.smithi086.stdout:4/388: mkdir d2/d18/d33/d42/d72/d78/d25/d6b/d81 0 2024-08-19T00:56:03.756 INFO:tasks.workunit.client.0.smithi017.stdout:2/124: write d2/d7/dd/f1c [87892,23167] 0 2024-08-19T00:56:03.757 INFO:tasks.workunit.client.0.smithi017.stdout:2/125: chown d2/fa 26444203 1 2024-08-19T00:56:03.758 INFO:tasks.workunit.client.0.smithi017.stdout:2/126: dread - d2/d7/d10/d19/f24 zero size 2024-08-19T00:56:03.761 INFO:tasks.workunit.client.1.smithi086.stdout:0/422: unlink da/d14/l2f 0 2024-08-19T00:56:03.764 INFO:tasks.workunit.client.0.smithi017.stdout:2/127: dread d2/d7/d10/d19/fb [0,4194304] 0 2024-08-19T00:56:03.769 INFO:tasks.workunit.client.1.smithi086.stdout:1/475: truncate d4/d7/d2a/d36/d63/f80 6940656 0 2024-08-19T00:56:03.770 INFO:tasks.workunit.client.1.smithi086.stdout:1/476: fsync d4/d7/d2a/d36/d50/f66 0 2024-08-19T00:56:03.770 INFO:tasks.workunit.client.1.smithi086.stdout:2/380: dread d8/f19 [0,4194304] 0 2024-08-19T00:56:03.770 INFO:tasks.workunit.client.1.smithi086.stdout:3/417: rename d3/d18/d1a/d53 to d3/d26/d2b/d33/d8d 0 2024-08-19T00:56:03.774 INFO:tasks.workunit.client.1.smithi086.stdout:7/445: fdatasync d3/d34/d44/d58/d4b/f3d 0 2024-08-19T00:56:03.776 INFO:tasks.workunit.client.1.smithi086.stdout:8/408: symlink dc/l84 0 2024-08-19T00:56:03.777 INFO:tasks.workunit.client.1.smithi086.stdout:8/409: write dc/d16/d18/d29/d2e/d28/f69 [120687,36150] 0 2024-08-19T00:56:03.778 INFO:tasks.workunit.client.1.smithi086.stdout:8/410: readlink dc/d16/d18/d29/d2e/l2c 0 2024-08-19T00:56:03.781 INFO:tasks.workunit.client.1.smithi086.stdout:4/389: creat d2/d18/d33/d42/d72/d2f/f82 x:0 0 0 2024-08-19T00:56:03.782 INFO:tasks.workunit.client.1.smithi086.stdout:4/390: fdatasync d2/d18/d33/d42/d72/d78/d25/d55/f3d 0 2024-08-19T00:56:03.783 INFO:tasks.workunit.client.1.smithi086.stdout:4/391: write d2/d18/d33/d42/d72/d78/d25/f3a [452924,58502] 0 2024-08-19T00:56:03.784 INFO:tasks.workunit.client.1.smithi086.stdout:0/423: mknod da/d14/d44/c8f 0 2024-08-19T00:56:03.784 INFO:tasks.workunit.client.1.smithi086.stdout:4/392: fdatasync d2/d18/d33/d42/d72/d78/d25/f58 0 2024-08-19T00:56:03.787 INFO:tasks.workunit.client.1.smithi086.stdout:1/477: mkdir d4/d7/d2a/d36/d50/d9c 0 2024-08-19T00:56:03.788 INFO:tasks.workunit.client.1.smithi086.stdout:3/418: symlink d3/d18/d27/d49/l8e 0 2024-08-19T00:56:03.790 INFO:tasks.workunit.client.1.smithi086.stdout:5/401: fdatasync d0/d2d/d4f/f74 0 2024-08-19T00:56:03.792 INFO:tasks.workunit.client.1.smithi086.stdout:8/411: rename dc/l84 to dc/d16/d18/d29/d2e/d28/d2b/l85 0 2024-08-19T00:56:03.795 INFO:tasks.workunit.client.1.smithi086.stdout:4/393: write d2/d18/d33/d42/d72/f34 [4102300,57868] 0 2024-08-19T00:56:03.796 INFO:tasks.workunit.client.1.smithi086.stdout:1/478: write d4/d7/d2a/d36/d7d/d88/f99 [893757,2919] 0 2024-08-19T00:56:03.797 INFO:tasks.workunit.client.1.smithi086.stdout:3/419: mkdir d3/d18/d27/d49/d3f/d5b/d8f 0 2024-08-19T00:56:03.797 INFO:tasks.workunit.client.1.smithi086.stdout:3/420: chown d3/d26/d60 7432 1 2024-08-19T00:56:03.798 INFO:tasks.workunit.client.1.smithi086.stdout:2/381: link d8/f19 d8/d24/d32/d4d/f7d 0 2024-08-19T00:56:03.801 INFO:tasks.workunit.client.1.smithi086.stdout:2/382: dread d8/d2c/d47/f6d [0,4194304] 0 2024-08-19T00:56:03.802 INFO:tasks.workunit.client.1.smithi086.stdout:5/402: rename d0/df/d1f/d33/f4b to d0/d8/d70/f79 0 2024-08-19T00:56:03.802 INFO:tasks.workunit.client.1.smithi086.stdout:9/436: getdents db/d26/d5c/d68 0 2024-08-19T00:56:03.803 INFO:tasks.workunit.client.1.smithi086.stdout:5/403: write d0/d2d/d43/f45 [1230279,47464] 0 2024-08-19T00:56:03.803 INFO:tasks.workunit.client.1.smithi086.stdout:5/404: stat d0/d2d/d4f/f5a 0 2024-08-19T00:56:03.804 INFO:tasks.workunit.client.1.smithi086.stdout:5/405: read d0/d20/f53 [255117,98516] 0 2024-08-19T00:56:03.804 INFO:tasks.workunit.client.1.smithi086.stdout:4/394: symlink d2/d18/d33/d42/d72/d78/d25/l83 0 2024-08-19T00:56:03.805 INFO:tasks.workunit.client.1.smithi086.stdout:5/406: write d0/f17 [730293,125845] 0 2024-08-19T00:56:03.806 INFO:tasks.workunit.client.1.smithi086.stdout:3/421: creat d3/d26/d60/f90 x:0 0 0 2024-08-19T00:56:03.806 INFO:tasks.workunit.client.1.smithi086.stdout:7/446: link d3/c14 d3/d34/d44/d58/c84 0 2024-08-19T00:56:03.808 INFO:tasks.workunit.client.1.smithi086.stdout:8/412: fsync f3 0 2024-08-19T00:56:03.808 INFO:tasks.workunit.client.1.smithi086.stdout:6/417: sync 2024-08-19T00:56:03.809 INFO:tasks.workunit.client.1.smithi086.stdout:0/424: link da/c1f da/d5d/c90 0 2024-08-19T00:56:03.809 INFO:tasks.workunit.client.1.smithi086.stdout:3/422: write d3/d26/d60/f69 [67726,113508] 0 2024-08-19T00:56:03.811 INFO:tasks.workunit.client.1.smithi086.stdout:0/425: stat da/d14/f41 0 2024-08-19T00:56:03.813 INFO:tasks.workunit.client.1.smithi086.stdout:3/423: chown d3/d18/d19/d37/d5a/c72 2384 1 2024-08-19T00:56:03.814 INFO:tasks.workunit.client.1.smithi086.stdout:8/413: read dc/d16/d18/d29/d2e/d28/f69 [85892,121352] 0 2024-08-19T00:56:03.814 INFO:tasks.workunit.client.1.smithi086.stdout:0/426: stat da/d14/d44/d49/f63 0 2024-08-19T00:56:03.814 INFO:tasks.workunit.client.1.smithi086.stdout:1/479: dwrite d4/d7/f9b [0,4194304] 0 2024-08-19T00:56:03.816 INFO:tasks.workunit.client.1.smithi086.stdout:2/383: creat d8/d24/d32/d61/f7e x:0 0 0 2024-08-19T00:56:03.817 INFO:tasks.workunit.client.1.smithi086.stdout:0/427: chown da/d14/d44/d49/f63 31 1 2024-08-19T00:56:03.817 INFO:tasks.workunit.client.1.smithi086.stdout:3/424: write d3/d18/d19/d37/f7f [986052,79059] 0 2024-08-19T00:56:03.818 INFO:tasks.workunit.client.1.smithi086.stdout:9/437: dwrite db/dd/ff [0,4194304] 0 2024-08-19T00:56:03.818 INFO:tasks.workunit.client.1.smithi086.stdout:1/480: read - d4/d7/d2a/d36/d7d/d88/f87 zero size 2024-08-19T00:56:03.819 INFO:tasks.workunit.client.1.smithi086.stdout:3/425: fdatasync d3/f80 0 2024-08-19T00:56:03.822 INFO:tasks.workunit.client.1.smithi086.stdout:6/418: symlink db/d34/d39/d76/l8a 0 2024-08-19T00:56:03.825 INFO:tasks.workunit.client.1.smithi086.stdout:7/447: rename d3/d34/d44/d58/d4b/c4a to d3/de/d2d/c85 0 2024-08-19T00:56:03.829 INFO:tasks.workunit.client.1.smithi086.stdout:2/384: dwrite d8/d43/d65/f70 [0,4194304] 0 2024-08-19T00:56:03.832 INFO:tasks.workunit.client.1.smithi086.stdout:8/414: fdatasync f5 0 2024-08-19T00:56:03.834 INFO:tasks.workunit.client.1.smithi086.stdout:1/481: rename d4/d7/d2a/d36/d3a/f3e to d4/d7/d2a/d36/d50/f9d 0 2024-08-19T00:56:03.835 INFO:tasks.workunit.client.1.smithi086.stdout:4/395: write d2/d18/d33/d42/d72/d78/d25/f7e [612681,28172] 0 2024-08-19T00:56:03.837 INFO:tasks.workunit.client.0.smithi017.stdout:7/102: creat d3/dc/df/d23/f24 x:0 0 0 2024-08-19T00:56:03.838 INFO:tasks.workunit.client.0.smithi017.stdout:4/40: creat d2/fc x:0 0 0 2024-08-19T00:56:03.840 INFO:tasks.workunit.client.0.smithi017.stdout:5/82: creat db/d19/d1f/d15/d1e/f21 x:0 0 0 2024-08-19T00:56:03.840 INFO:tasks.workunit.client.0.smithi017.stdout:7/103: chown d3/dc/f1f 6 1 2024-08-19T00:56:03.841 INFO:tasks.workunit.client.1.smithi086.stdout:8/415: dwrite dc/d16/d18/d29/d2e/d28/d2b/d3b/f3c [0,4194304] 0 2024-08-19T00:56:03.844 INFO:tasks.workunit.client.0.smithi017.stdout:7/104: read d3/f12 [1555281,77113] 0 2024-08-19T00:56:03.844 INFO:tasks.workunit.client.0.smithi017.stdout:5/83: chown db/l11 85 1 2024-08-19T00:56:03.844 INFO:tasks.workunit.client.0.smithi017.stdout:1/51: mknod d4/dc/ce 0 2024-08-19T00:56:03.844 INFO:tasks.workunit.client.1.smithi086.stdout:5/407: dwrite d0/d8/d10/f1d [0,4194304] 0 2024-08-19T00:56:03.846 INFO:tasks.workunit.client.0.smithi017.stdout:4/41: unlink d2/fb 0 2024-08-19T00:56:03.846 INFO:tasks.workunit.client.1.smithi086.stdout:5/408: readlink d0/d8/d10/l3e 0 2024-08-19T00:56:03.846 INFO:tasks.workunit.client.1.smithi086.stdout:9/438: dread db/d26/d5c/d87/d37/f4a [0,4194304] 0 2024-08-19T00:56:03.847 INFO:tasks.workunit.client.1.smithi086.stdout:8/416: dread dc/d16/d18/f76 [0,4194304] 0 2024-08-19T00:56:03.848 INFO:tasks.workunit.client.0.smithi017.stdout:4/42: chown d2/f6 14 1 2024-08-19T00:56:03.851 INFO:tasks.workunit.client.0.smithi017.stdout:4/43: stat d2/f4 0 2024-08-19T00:56:03.852 INFO:tasks.workunit.client.0.smithi017.stdout:2/128: dwrite d2/d7/fc [0,4194304] 0 2024-08-19T00:56:03.853 INFO:tasks.workunit.client.1.smithi086.stdout:3/426: rename d3/c16 to d3/d18/d27/d49/d3f/d5b/d8f/c91 0 2024-08-19T00:56:03.853 INFO:tasks.workunit.client.0.smithi017.stdout:3/95: dwrite d5/d11/f14 [0,4194304] 0 2024-08-19T00:56:03.854 INFO:tasks.workunit.client.1.smithi086.stdout:0/428: write da/d14/f2d [876107,94386] 0 2024-08-19T00:56:03.854 INFO:tasks.workunit.client.0.smithi017.stdout:4/44: truncate d2/fc 460374 0 2024-08-19T00:56:03.855 INFO:tasks.workunit.client.1.smithi086.stdout:0/429: dread - da/f60 zero size 2024-08-19T00:56:03.855 INFO:tasks.workunit.client.0.smithi017.stdout:3/96: readlink d5/lb 0 2024-08-19T00:56:03.858 INFO:tasks.workunit.client.1.smithi086.stdout:7/448: creat d3/de/d68/d7a/f86 x:0 0 0 2024-08-19T00:56:03.858 INFO:tasks.workunit.client.0.smithi017.stdout:3/97: write d5/d11/f16 [738842,67273] 0 2024-08-19T00:56:03.864 INFO:tasks.workunit.client.0.smithi017.stdout:6/48: getdents d5/d6 0 2024-08-19T00:56:03.865 INFO:tasks.workunit.client.0.smithi017.stdout:1/52: dwrite d4/f9 [0,4194304] 0 2024-08-19T00:56:03.866 INFO:tasks.workunit.client.0.smithi017.stdout:4/45: mkdir d2/dd 0 2024-08-19T00:56:03.866 INFO:tasks.workunit.client.0.smithi017.stdout:1/53: readlink d4/l8 0 2024-08-19T00:56:03.867 INFO:tasks.workunit.client.1.smithi086.stdout:9/439: mknod db/d26/d5c/d87/d6d/c8d 0 2024-08-19T00:56:03.867 INFO:tasks.workunit.client.0.smithi017.stdout:4/46: chown d2/f6 486 1 2024-08-19T00:56:03.874 INFO:tasks.workunit.client.1.smithi086.stdout:8/417: mkdir dc/d17/d86 0 2024-08-19T00:56:03.875 INFO:tasks.workunit.client.1.smithi086.stdout:6/419: dread db/f13 [0,4194304] 0 2024-08-19T00:56:03.877 INFO:tasks.workunit.client.1.smithi086.stdout:3/427: symlink d3/d18/d19/d37/d3a/l92 0 2024-08-19T00:56:03.879 INFO:tasks.workunit.client.1.smithi086.stdout:7/449: rename d3/d5b/c5e to d3/d34/c87 0 2024-08-19T00:56:03.880 INFO:tasks.workunit.client.0.smithi017.stdout:1/54: rename d4/f7 to d4/ff 0 2024-08-19T00:56:03.881 INFO:tasks.workunit.client.1.smithi086.stdout:2/385: link d8/d2c/c2e d8/d43/d77/c7f 0 2024-08-19T00:56:03.882 INFO:tasks.workunit.client.1.smithi086.stdout:7/450: dread - d3/d5b/f6a zero size 2024-08-19T00:56:03.883 INFO:tasks.workunit.client.0.smithi017.stdout:4/47: rename d2/f4 to d2/dd/fe 0 2024-08-19T00:56:03.883 INFO:tasks.workunit.client.1.smithi086.stdout:8/418: dwrite dc/d17/f24 [0,4194304] 0 2024-08-19T00:56:03.885 INFO:tasks.workunit.client.0.smithi017.stdout:3/98: mknod d5/d15/c19 0 2024-08-19T00:56:03.885 INFO:tasks.workunit.client.1.smithi086.stdout:7/451: chown d3/d34/d44/f71 910089 1 2024-08-19T00:56:03.885 INFO:tasks.workunit.client.0.smithi017.stdout:1/55: dread d4/ff [0,4194304] 0 2024-08-19T00:56:03.885 INFO:tasks.workunit.client.1.smithi086.stdout:6/420: dwrite db/d34/d4e/d55/f65 [0,4194304] 0 2024-08-19T00:56:03.886 INFO:tasks.workunit.client.1.smithi086.stdout:5/409: symlink d0/d2d/l7a 0 2024-08-19T00:56:03.888 INFO:tasks.workunit.client.1.smithi086.stdout:5/410: read - d0/d20/f3c zero size 2024-08-19T00:56:03.889 INFO:tasks.workunit.client.0.smithi017.stdout:6/49: link d5/d6/fd d5/d6/fe 0 2024-08-19T00:56:03.889 INFO:tasks.workunit.client.1.smithi086.stdout:8/419: write dc/d16/d18/d29/d2e/d28/f45 [846185,21727] 0 2024-08-19T00:56:03.890 INFO:tasks.workunit.client.0.smithi017.stdout:1/56: dread d4/f9 [0,4194304] 0 2024-08-19T00:56:03.891 INFO:tasks.workunit.client.0.smithi017.stdout:1/57: fsync d4/f9 0 2024-08-19T00:56:03.892 INFO:tasks.workunit.client.1.smithi086.stdout:8/420: readlink dc/d1f/l66 0 2024-08-19T00:56:03.892 INFO:tasks.workunit.client.1.smithi086.stdout:0/430: dread da/d14/f1d [0,4194304] 0 2024-08-19T00:56:03.892 INFO:tasks.workunit.client.1.smithi086.stdout:9/440: mknod db/d26/d5c/d87/d6d/c8e 0 2024-08-19T00:56:03.894 INFO:tasks.workunit.client.0.smithi017.stdout:5/84: getdents db/d19/d1f 0 2024-08-19T00:56:03.896 INFO:tasks.workunit.client.1.smithi086.stdout:5/411: dread d0/d2d/f32 [0,4194304] 0 2024-08-19T00:56:03.897 INFO:tasks.workunit.client.1.smithi086.stdout:8/421: dwrite dc/f14 [4194304,4194304] 0 2024-08-19T00:56:03.897 INFO:tasks.workunit.client.0.smithi017.stdout:7/105: getdents d3/dc/df 0 2024-08-19T00:56:03.900 INFO:tasks.workunit.client.1.smithi086.stdout:1/482: write d4/f40 [953049,11598] 0 2024-08-19T00:56:03.901 INFO:tasks.workunit.client.1.smithi086.stdout:3/428: rename d3/f5 to d3/d18/d19/d37/f93 0 2024-08-19T00:56:03.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/58: dwrite d4/fd [0,4194304] 0 2024-08-19T00:56:03.904 INFO:tasks.workunit.client.1.smithi086.stdout:2/386: mkdir d8/d2c/d38/d80 0 2024-08-19T00:56:03.905 INFO:tasks.workunit.client.1.smithi086.stdout:2/387: write d8/d24/d32/f41 [502046,67149] 0 2024-08-19T00:56:03.906 INFO:tasks.workunit.client.0.smithi017.stdout:4/48: symlink d2/dd/lf 0 2024-08-19T00:56:03.908 INFO:tasks.workunit.client.0.smithi017.stdout:0/65: sync 2024-08-19T00:56:03.911 INFO:tasks.workunit.client.0.smithi017.stdout:4/49: dread d2/dd/fe [4194304,4194304] 0 2024-08-19T00:56:03.911 INFO:tasks.workunit.client.0.smithi017.stdout:6/50: mkdir d5/df 0 2024-08-19T00:56:03.911 INFO:tasks.workunit.client.0.smithi017.stdout:4/50: stat d2 0 2024-08-19T00:56:03.912 INFO:tasks.workunit.client.0.smithi017.stdout:6/51: chown d5/d6 361829296 1 2024-08-19T00:56:03.917 INFO:tasks.workunit.client.0.smithi017.stdout:6/52: dread d5/d6/fe [0,4194304] 0 2024-08-19T00:56:03.917 INFO:tasks.workunit.client.1.smithi086.stdout:9/441: write db/d26/d5c/d87/d6d/f41 [335960,88125] 0 2024-08-19T00:56:03.917 INFO:tasks.workunit.client.1.smithi086.stdout:9/442: chown db/d5e 7 1 2024-08-19T00:56:03.920 INFO:tasks.workunit.client.1.smithi086.stdout:9/443: dread - db/d26/d5c/d87/d30/d3f/d43/d84/f85 zero size 2024-08-19T00:56:03.921 INFO:tasks.workunit.client.1.smithi086.stdout:9/444: truncate db/f52 1328931 0 2024-08-19T00:56:03.923 INFO:tasks.workunit.client.1.smithi086.stdout:8/422: mkdir dc/d16/d18/d29/d2e/d28/d2b/d3b/d87 0 2024-08-19T00:56:03.926 INFO:tasks.workunit.client.1.smithi086.stdout:2/388: dread d8/d43/f5a [0,4194304] 0 2024-08-19T00:56:03.928 INFO:tasks.workunit.client.1.smithi086.stdout:6/421: dread db/f3e [0,4194304] 0 2024-08-19T00:56:03.931 INFO:tasks.workunit.client.0.smithi017.stdout:1/59: dwrite d4/ff [4194304,4194304] 0 2024-08-19T00:56:03.933 INFO:tasks.workunit.client.1.smithi086.stdout:1/483: rename d4/d7/d2a/d36/f71 to d4/d7/d2a/d36/d50/d9c/f9e 0 2024-08-19T00:56:03.943 INFO:tasks.workunit.client.0.smithi017.stdout:4/51: creat d2/dd/f10 x:0 0 0 2024-08-19T00:56:03.944 INFO:tasks.workunit.client.1.smithi086.stdout:7/452: mknod d3/d34/d44/d58/d4b/c88 0 2024-08-19T00:56:03.944 INFO:tasks.workunit.client.0.smithi017.stdout:5/85: mknod db/c22 0 2024-08-19T00:56:03.945 INFO:tasks.workunit.client.0.smithi017.stdout:5/86: read f5 [2800820,34144] 0 2024-08-19T00:56:03.947 INFO:tasks.workunit.client.1.smithi086.stdout:5/412: dwrite d0/df/d1f/f28 [0,4194304] 0 2024-08-19T00:56:03.948 INFO:tasks.workunit.client.1.smithi086.stdout:9/445: mkdir db/d26/d5c/d87/d30/d3f/d43/d4e/d8f 0 2024-08-19T00:56:03.948 INFO:tasks.workunit.client.1.smithi086.stdout:9/446: chown db/f20 14826528 1 2024-08-19T00:56:03.949 INFO:tasks.workunit.client.0.smithi017.stdout:1/60: write d4/f9 [506521,81984] 0 2024-08-19T00:56:03.950 INFO:tasks.workunit.client.0.smithi017.stdout:1/61: chown d4 1 1 2024-08-19T00:56:03.951 INFO:tasks.workunit.client.1.smithi086.stdout:8/423: mkdir dc/d70/d7a/d88 0 2024-08-19T00:56:03.952 INFO:tasks.workunit.client.1.smithi086.stdout:9/447: truncate db/d26/d5c/d87/d30/d32/d44/f56 514955 0 2024-08-19T00:56:03.952 INFO:tasks.workunit.client.0.smithi017.stdout:3/99: truncate d5/d11/f14 2687655 0 2024-08-19T00:56:03.952 INFO:tasks.workunit.client.0.smithi017.stdout:0/66: getdents d5/d17 0 2024-08-19T00:56:03.953 INFO:tasks.workunit.client.0.smithi017.stdout:3/100: chown f3 64323 1 2024-08-19T00:56:03.954 INFO:tasks.workunit.client.0.smithi017.stdout:0/67: write d5/fc [431461,13723] 0 2024-08-19T00:56:03.954 INFO:tasks.workunit.client.1.smithi086.stdout:6/422: fdatasync db/d37/d30/f85 0 2024-08-19T00:56:03.954 INFO:tasks.workunit.client.0.smithi017.stdout:3/101: truncate d5/f10 665700 0 2024-08-19T00:56:03.955 INFO:tasks.workunit.client.0.smithi017.stdout:0/68: chown c4 20518040 1 2024-08-19T00:56:03.955 INFO:tasks.workunit.client.0.smithi017.stdout:3/102: chown d5/d15/c19 15 1 2024-08-19T00:56:03.956 INFO:tasks.workunit.client.0.smithi017.stdout:4/52: mkdir d2/d11 0 2024-08-19T00:56:03.957 INFO:tasks.workunit.client.1.smithi086.stdout:3/429: fsync d3/d9/f39 0 2024-08-19T00:56:03.957 INFO:tasks.workunit.client.1.smithi086.stdout:8/424: dwrite dc/d16/d18/d29/d2e/d28/d2b/f79 [0,4194304] 0 2024-08-19T00:56:03.957 INFO:tasks.workunit.client.0.smithi017.stdout:4/53: stat d2/dd 0 2024-08-19T00:56:03.960 INFO:tasks.workunit.client.0.smithi017.stdout:0/69: dread d5/f12 [0,4194304] 0 2024-08-19T00:56:03.962 INFO:tasks.workunit.client.0.smithi017.stdout:7/106: creat d3/f25 x:0 0 0 2024-08-19T00:56:03.967 INFO:tasks.workunit.client.0.smithi017.stdout:1/62: write d4/f9 [3764478,36323] 0 2024-08-19T00:56:03.976 INFO:tasks.workunit.client.0.smithi017.stdout:4/54: creat d2/f12 x:0 0 0 2024-08-19T00:56:03.976 INFO:tasks.workunit.client.0.smithi017.stdout:4/55: dread - d2/f12 zero size 2024-08-19T00:56:03.979 INFO:tasks.workunit.client.0.smithi017.stdout:0/70: mkdir d5/d18 0 2024-08-19T00:56:03.984 INFO:tasks.workunit.client.0.smithi017.stdout:4/56: symlink d2/l13 0 2024-08-19T00:56:03.985 INFO:tasks.workunit.client.0.smithi017.stdout:0/71: chown d5/c6 0 1 2024-08-19T00:56:03.986 INFO:tasks.workunit.client.0.smithi017.stdout:6/53: getdents d5 0 2024-08-19T00:56:03.988 INFO:tasks.workunit.client.0.smithi017.stdout:3/103: link l0 d5/l1a 0 2024-08-19T00:56:03.989 INFO:tasks.workunit.client.0.smithi017.stdout:5/87: link l0 db/d19/d1f/d15/d1e/l23 0 2024-08-19T00:56:03.990 INFO:tasks.workunit.client.0.smithi017.stdout:7/107: link d3/dc/f21 d3/dc/df/d23/f26 0 2024-08-19T00:56:03.992 INFO:tasks.workunit.client.0.smithi017.stdout:3/104: mkdir d5/d15/d1b 0 2024-08-19T00:56:03.992 INFO:tasks.workunit.client.0.smithi017.stdout:4/57: dwrite d2/f7 [0,4194304] 0 2024-08-19T00:56:03.993 INFO:tasks.workunit.client.0.smithi017.stdout:6/54: getdents d5/df 0 2024-08-19T00:56:03.994 INFO:tasks.workunit.client.0.smithi017.stdout:3/105: chown d5/d18 60 1 2024-08-19T00:56:03.996 INFO:tasks.workunit.client.0.smithi017.stdout:0/72: dread d5/fc [0,4194304] 0 2024-08-19T00:56:03.996 INFO:tasks.workunit.client.0.smithi017.stdout:5/88: truncate db/d19/d1f/f1c 153886 0 2024-08-19T00:56:04.002 INFO:tasks.workunit.client.0.smithi017.stdout:7/108: getdents d3/dc/df/d1c 0 2024-08-19T00:56:04.004 INFO:tasks.workunit.client.1.smithi086.stdout:4/396: sync 2024-08-19T00:56:04.005 INFO:tasks.workunit.client.0.smithi017.stdout:6/55: mknod d5/df/c10 0 2024-08-19T00:56:04.007 INFO:tasks.workunit.client.0.smithi017.stdout:3/106: rmdir d5 39 2024-08-19T00:56:04.007 INFO:tasks.workunit.client.1.smithi086.stdout:1/484: mkdir d4/d7/d2a/d36/d63/d9f 0 2024-08-19T00:56:04.008 INFO:tasks.workunit.client.1.smithi086.stdout:6/423: creat db/d37/d28/d57/f8b x:0 0 0 2024-08-19T00:56:04.009 INFO:tasks.workunit.client.1.smithi086.stdout:8/425: truncate f3 493579 0 2024-08-19T00:56:04.010 INFO:tasks.workunit.client.1.smithi086.stdout:3/430: creat d3/d18/d27/d49/d3f/d54/f94 x:0 0 0 2024-08-19T00:56:04.012 INFO:tasks.workunit.client.0.smithi017.stdout:7/109: read d3/f1e [89247,98188] 0 2024-08-19T00:56:04.013 INFO:tasks.workunit.client.0.smithi017.stdout:5/89: creat db/f24 x:0 0 0 2024-08-19T00:56:04.013 INFO:tasks.workunit.client.1.smithi086.stdout:7/453: dwrite d3/d34/d44/d58/d4b/f7b [0,4194304] 0 2024-08-19T00:56:04.017 INFO:tasks.workunit.client.0.smithi017.stdout:6/56: dwrite f1 [0,4194304] 0 2024-08-19T00:56:04.017 INFO:tasks.workunit.client.1.smithi086.stdout:0/431: rename da/d14/d26/f38 to da/d14/d44/d49/f91 0 2024-08-19T00:56:04.019 INFO:tasks.workunit.client.1.smithi086.stdout:5/413: symlink d0/d8/d72/l7b 0 2024-08-19T00:56:04.019 INFO:tasks.workunit.client.1.smithi086.stdout:0/432: chown da/d14/d44/d49 290 1 2024-08-19T00:56:04.020 INFO:tasks.workunit.client.1.smithi086.stdout:1/485: creat d4/d7/fa0 x:0 0 0 2024-08-19T00:56:04.021 INFO:tasks.workunit.client.1.smithi086.stdout:7/454: dwrite d3/d34/d44/f71 [0,4194304] 0 2024-08-19T00:56:04.027 INFO:tasks.workunit.client.1.smithi086.stdout:0/433: stat da/d14/d1a/d2e/d39/d3b/d89/l8b 0 2024-08-19T00:56:04.027 INFO:tasks.workunit.client.1.smithi086.stdout:4/397: symlink d2/d18/d33/d42/d72/d78/l84 0 2024-08-19T00:56:04.027 INFO:tasks.workunit.client.1.smithi086.stdout:1/486: read d4/d7/f39 [391854,18265] 0 2024-08-19T00:56:04.027 INFO:tasks.workunit.client.1.smithi086.stdout:0/434: chown da/d5d/f75 48 1 2024-08-19T00:56:04.027 INFO:tasks.workunit.client.1.smithi086.stdout:8/426: rmdir dc/d16 39 2024-08-19T00:56:04.028 INFO:tasks.workunit.client.1.smithi086.stdout:3/431: mknod d3/d26/c95 0 2024-08-19T00:56:04.028 INFO:tasks.workunit.client.0.smithi017.stdout:7/110: dread d3/dc/df/d23/f26 [0,4194304] 0 2024-08-19T00:56:04.028 INFO:tasks.workunit.client.0.smithi017.stdout:0/73: dwrite d5/f11 [0,4194304] 0 2024-08-19T00:56:04.032 INFO:tasks.workunit.client.0.smithi017.stdout:3/107: fdatasync d5/d11/f14 0 2024-08-19T00:56:04.033 INFO:tasks.workunit.client.1.smithi086.stdout:7/455: creat d3/d34/f89 x:0 0 0 2024-08-19T00:56:04.033 INFO:tasks.workunit.client.0.smithi017.stdout:4/58: dwrite d2/f6 [0,4194304] 0 2024-08-19T00:56:04.034 INFO:tasks.workunit.client.1.smithi086.stdout:4/398: dwrite d2/f69 [4194304,4194304] 0 2024-08-19T00:56:04.035 INFO:tasks.workunit.client.0.smithi017.stdout:4/59: stat d2/dd/lf 0 2024-08-19T00:56:04.035 INFO:tasks.workunit.client.1.smithi086.stdout:4/399: fdatasync d2/d18/d33/d42/d72/d78/d25/f3a 0 2024-08-19T00:56:04.036 INFO:tasks.workunit.client.1.smithi086.stdout:3/432: dread d3/d18/d19/d62/d46/f6e [0,4194304] 0 2024-08-19T00:56:04.038 INFO:tasks.workunit.client.0.smithi017.stdout:5/90: dwrite db/f24 [0,4194304] 0 2024-08-19T00:56:04.041 INFO:tasks.workunit.client.1.smithi086.stdout:1/487: mknod d4/d7/d2a/d36/d7d/ca1 0 2024-08-19T00:56:04.047 INFO:tasks.workunit.client.0.smithi017.stdout:0/74: unlink f1 0 2024-08-19T00:56:04.048 INFO:tasks.workunit.client.1.smithi086.stdout:3/433: dread d3/d18/d27/d49/d3f/f47 [0,4194304] 0 2024-08-19T00:56:04.052 INFO:tasks.workunit.client.1.smithi086.stdout:1/488: dwrite d4/d7/f5e [0,4194304] 0 2024-08-19T00:56:04.054 INFO:tasks.workunit.client.0.smithi017.stdout:4/60: rename d2/dd/f10 to d2/d11/f14 0 2024-08-19T00:56:04.056 INFO:tasks.workunit.client.1.smithi086.stdout:5/414: rename d0/c66 to d0/d5f/c7c 0 2024-08-19T00:56:04.057 INFO:tasks.workunit.client.0.smithi017.stdout:5/91: unlink db/ce 0 2024-08-19T00:56:04.058 INFO:tasks.workunit.client.1.smithi086.stdout:7/456: symlink d3/de/d2d/l8a 0 2024-08-19T00:56:04.059 INFO:tasks.workunit.client.1.smithi086.stdout:7/457: fsync d3/de/f59 0 2024-08-19T00:56:04.060 INFO:tasks.workunit.client.0.smithi017.stdout:3/108: symlink d5/d18/l1c 0 2024-08-19T00:56:04.063 INFO:tasks.workunit.client.1.smithi086.stdout:4/400: read d2/d18/d33/d42/d72/ff [249219,22039] 0 2024-08-19T00:56:04.063 INFO:tasks.workunit.client.1.smithi086.stdout:0/435: dread da/d14/d44/d49/f63 [0,4194304] 0 2024-08-19T00:56:04.064 INFO:tasks.workunit.client.0.smithi017.stdout:7/111: write d3/f1e [1973764,10306] 0 2024-08-19T00:56:04.065 INFO:tasks.workunit.client.0.smithi017.stdout:4/61: unlink d2/f8 0 2024-08-19T00:56:04.066 INFO:tasks.workunit.client.0.smithi017.stdout:9/78: sync 2024-08-19T00:56:04.068 INFO:tasks.workunit.client.0.smithi017.stdout:5/92: creat db/d19/d1f/d15/f25 x:0 0 0 2024-08-19T00:56:04.070 INFO:tasks.workunit.client.0.smithi017.stdout:9/79: dread d0/fa [4194304,4194304] 0 2024-08-19T00:56:04.070 INFO:tasks.workunit.client.0.smithi017.stdout:3/109: mknod d5/c1d 0 2024-08-19T00:56:04.071 INFO:tasks.workunit.client.0.smithi017.stdout:9/80: chown d0/fc 1006 1 2024-08-19T00:56:04.072 INFO:tasks.workunit.client.0.smithi017.stdout:3/110: write d5/d11/f16 [1215333,106809] 0 2024-08-19T00:56:04.075 INFO:tasks.workunit.client.0.smithi017.stdout:4/62: fdatasync d2/dd/fe 0 2024-08-19T00:56:04.079 INFO:tasks.workunit.client.1.smithi086.stdout:7/458: symlink d3/d5b/l8b 0 2024-08-19T00:56:04.079 INFO:tasks.workunit.client.1.smithi086.stdout:7/459: fsync d3/d34/f52 0 2024-08-19T00:56:04.081 INFO:tasks.workunit.client.1.smithi086.stdout:4/401: unlink d2/d18/d33/d42/d72/d78/d25/d30/c47 0 2024-08-19T00:56:04.085 INFO:tasks.workunit.client.0.smithi017.stdout:9/81: creat d0/f18 x:0 0 0 2024-08-19T00:56:04.086 INFO:tasks.workunit.client.1.smithi086.stdout:8/427: dwrite dc/d16/d18/d29/d2e/d28/f69 [0,4194304] 0 2024-08-19T00:56:04.087 INFO:tasks.workunit.client.1.smithi086.stdout:3/434: dwrite d3/d18/f1c [0,4194304] 0 2024-08-19T00:56:04.088 INFO:tasks.workunit.client.0.smithi017.stdout:3/111: rename d5/f6 to d5/d11/f1e 0 2024-08-19T00:56:04.089 INFO:tasks.workunit.client.0.smithi017.stdout:4/63: mkdir d2/d11/d15 0 2024-08-19T00:56:04.090 INFO:tasks.workunit.client.1.smithi086.stdout:3/435: write d3/d18/d19/d37/f7f [1434021,74373] 0 2024-08-19T00:56:04.092 INFO:tasks.workunit.client.1.smithi086.stdout:3/436: fdatasync d3/d18/d27/d76/f7c 0 2024-08-19T00:56:04.093 INFO:tasks.workunit.client.1.smithi086.stdout:5/415: dwrite d0/d2d/d4f/f5c [0,4194304] 0 2024-08-19T00:56:04.095 INFO:tasks.workunit.client.0.smithi017.stdout:9/82: dwrite d0/f14 [0,4194304] 0 2024-08-19T00:56:04.097 INFO:tasks.workunit.client.1.smithi086.stdout:0/436: symlink da/d14/d1a/d2e/d43/d61/d6a/l92 0 2024-08-19T00:56:04.098 INFO:tasks.workunit.client.0.smithi017.stdout:5/93: mknod db/d19/c26 0 2024-08-19T00:56:04.099 INFO:tasks.workunit.client.1.smithi086.stdout:0/437: chown da/d14/d44/d49/l80 119024722 1 2024-08-19T00:56:04.100 INFO:tasks.workunit.client.1.smithi086.stdout:0/438: chown da/d14/d55 407549 1 2024-08-19T00:56:04.101 INFO:tasks.workunit.client.1.smithi086.stdout:3/437: dwrite d3/d18/d1a/f6c [0,4194304] 0 2024-08-19T00:56:04.101 INFO:tasks.workunit.client.1.smithi086.stdout:0/439: write da/d14/f1b [2518190,65357] 0 2024-08-19T00:56:04.102 INFO:tasks.workunit.client.0.smithi017.stdout:9/83: dread d0/fa [0,4194304] 0 2024-08-19T00:56:04.106 INFO:tasks.workunit.client.0.smithi017.stdout:7/112: truncate d3/dc/f1f 1476642 0 2024-08-19T00:56:04.110 INFO:tasks.workunit.client.1.smithi086.stdout:7/460: mknod d3/c8c 0 2024-08-19T00:56:04.111 INFO:tasks.workunit.client.0.smithi017.stdout:9/84: creat d0/f19 x:0 0 0 2024-08-19T00:56:04.112 INFO:tasks.workunit.client.0.smithi017.stdout:9/85: write d0/f15 [37283,97696] 0 2024-08-19T00:56:04.113 INFO:tasks.workunit.client.1.smithi086.stdout:5/416: creat d0/d2d/d4f/f7d x:0 0 0 2024-08-19T00:56:04.114 INFO:tasks.workunit.client.0.smithi017.stdout:3/112: mknod d5/d15/d1b/c1f 0 2024-08-19T00:56:04.116 INFO:tasks.workunit.client.0.smithi017.stdout:7/113: creat d3/dc/df/d1c/f27 x:0 0 0 2024-08-19T00:56:04.118 INFO:tasks.workunit.client.1.smithi086.stdout:8/428: mknod dc/d70/d7a/d88/c89 0 2024-08-19T00:56:04.119 INFO:tasks.workunit.client.0.smithi017.stdout:9/86: creat d0/f1a x:0 0 0 2024-08-19T00:56:04.120 INFO:tasks.workunit.client.0.smithi017.stdout:9/87: dread - d0/db/f17 zero size 2024-08-19T00:56:04.120 INFO:tasks.workunit.client.0.smithi017.stdout:3/113: rename d5/f9 to d5/d15/d1b/f20 0 2024-08-19T00:56:04.122 INFO:tasks.workunit.client.0.smithi017.stdout:7/114: creat d3/dc/df/f28 x:0 0 0 2024-08-19T00:56:04.126 INFO:tasks.workunit.client.0.smithi017.stdout:7/115: write d3/dc/df/d23/f26 [1077445,128989] 0 2024-08-19T00:56:04.128 INFO:tasks.workunit.client.0.smithi017.stdout:9/88: dwrite d0/f18 [0,4194304] 0 2024-08-19T00:56:04.128 INFO:tasks.workunit.client.0.smithi017.stdout:3/114: creat d5/d15/f21 x:0 0 0 2024-08-19T00:56:04.130 INFO:tasks.workunit.client.0.smithi017.stdout:7/116: truncate d3/dc/df/d23/f26 2451705 0 2024-08-19T00:56:04.133 INFO:tasks.workunit.client.1.smithi086.stdout:8/429: creat dc/d16/d18/d29/d2e/f8a x:0 0 0 2024-08-19T00:56:04.134 INFO:tasks.workunit.client.1.smithi086.stdout:5/417: dwrite d0/df/d1f/d33/f40 [0,4194304] 0 2024-08-19T00:56:04.134 INFO:tasks.workunit.client.1.smithi086.stdout:5/418: stat d0/f17 0 2024-08-19T00:56:04.135 INFO:tasks.workunit.client.1.smithi086.stdout:8/430: write dc/d17/d1e/d55/f65 [189074,14885] 0 2024-08-19T00:56:04.135 INFO:tasks.workunit.client.1.smithi086.stdout:2/389: sync 2024-08-19T00:56:04.136 INFO:tasks.workunit.client.1.smithi086.stdout:0/440: symlink da/l93 0 2024-08-19T00:56:04.136 INFO:tasks.workunit.client.1.smithi086.stdout:2/390: chown d8/f11 382 1 2024-08-19T00:56:04.137 INFO:tasks.workunit.client.0.smithi017.stdout:4/64: getdents d2/dd 0 2024-08-19T00:56:04.138 INFO:tasks.workunit.client.1.smithi086.stdout:0/441: chown da/d14/d1a/d2e/d43/d61/d6a 337 1 2024-08-19T00:56:04.138 INFO:tasks.workunit.client.0.smithi017.stdout:4/65: chown d2/fa 6 1 2024-08-19T00:56:04.138 INFO:tasks.workunit.client.1.smithi086.stdout:3/438: truncate d3/d18/d27/d48/f4b 529702 0 2024-08-19T00:56:04.140 INFO:tasks.workunit.client.0.smithi017.stdout:9/89: rmdir d0 39 2024-08-19T00:56:04.141 INFO:tasks.workunit.client.0.smithi017.stdout:3/115: dwrite d5/d15/f21 [0,4194304] 0 2024-08-19T00:56:04.142 INFO:tasks.workunit.client.1.smithi086.stdout:4/402: getdents d2/d18/d33/d42 0 2024-08-19T00:56:04.144 INFO:tasks.workunit.client.0.smithi017.stdout:7/117: mknod d3/dc/df/d1a/c29 0 2024-08-19T00:56:04.145 INFO:tasks.workunit.client.1.smithi086.stdout:7/461: mknod d3/de/d68/d7d/c8d 0 2024-08-19T00:56:04.147 INFO:tasks.workunit.client.1.smithi086.stdout:7/462: write d3/d34/d44/d3e/f5d [3285809,91640] 0 2024-08-19T00:56:04.147 INFO:tasks.workunit.client.0.smithi017.stdout:7/118: dread - d3/dc/df/d1c/f27 zero size 2024-08-19T00:56:04.149 INFO:tasks.workunit.client.0.smithi017.stdout:7/119: dread - d3/f25 zero size 2024-08-19T00:56:04.149 INFO:tasks.workunit.client.0.smithi017.stdout:4/66: dwrite d2/f7 [0,4194304] 0 2024-08-19T00:56:04.150 INFO:tasks.workunit.client.1.smithi086.stdout:8/431: creat dc/d70/d7a/f8b x:0 0 0 2024-08-19T00:56:04.154 INFO:tasks.workunit.client.1.smithi086.stdout:2/391: dread - d8/d14/f55 zero size 2024-08-19T00:56:04.156 INFO:tasks.workunit.client.0.smithi017.stdout:7/120: mkdir d3/dc/d2a 0 2024-08-19T00:56:04.157 INFO:tasks.workunit.client.1.smithi086.stdout:7/463: dwrite d3/d34/d44/d3e/f67 [0,4194304] 0 2024-08-19T00:56:04.158 INFO:tasks.workunit.client.1.smithi086.stdout:7/464: chown d3/l51 12696753 1 2024-08-19T00:56:04.159 INFO:tasks.workunit.client.1.smithi086.stdout:8/432: dwrite f7 [0,4194304] 0 2024-08-19T00:56:04.160 INFO:tasks.workunit.client.1.smithi086.stdout:3/439: unlink d3/d18/d19/d37/d5a/l81 0 2024-08-19T00:56:04.162 INFO:tasks.workunit.client.0.smithi017.stdout:4/67: mkdir d2/d16 0 2024-08-19T00:56:04.166 INFO:tasks.workunit.client.1.smithi086.stdout:4/403: mkdir d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/d85 0 2024-08-19T00:56:04.166 INFO:tasks.workunit.client.0.smithi017.stdout:9/90: creat d0/db/f1b x:0 0 0 2024-08-19T00:56:04.169 INFO:tasks.workunit.client.0.smithi017.stdout:3/116: fdatasync f2 0 2024-08-19T00:56:04.169 INFO:tasks.workunit.client.1.smithi086.stdout:8/433: dwrite dc/d1f/f27 [4194304,4194304] 0 2024-08-19T00:56:04.169 INFO:tasks.workunit.client.1.smithi086.stdout:7/465: dwrite d3/de/d68/d7a/f86 [0,4194304] 0 2024-08-19T00:56:04.178 INFO:tasks.workunit.client.0.smithi017.stdout:9/91: dwrite d0/f18 [4194304,4194304] 0 2024-08-19T00:56:04.180 INFO:tasks.workunit.client.1.smithi086.stdout:5/419: rename d0/d8/c46 to d0/d8/d70/c7e 0 2024-08-19T00:56:04.186 INFO:tasks.workunit.client.0.smithi017.stdout:3/117: rename d5/lb to d5/d15/l22 0 2024-08-19T00:56:04.187 INFO:tasks.workunit.client.0.smithi017.stdout:3/118: readlink d5/da/l13 0 2024-08-19T00:56:04.191 INFO:tasks.workunit.client.1.smithi086.stdout:7/466: creat d3/de/d68/d7a/f8e x:0 0 0 2024-08-19T00:56:04.192 INFO:tasks.workunit.client.0.smithi017.stdout:3/119: dread d5/f10 [0,4194304] 0 2024-08-19T00:56:04.195 INFO:tasks.workunit.client.0.smithi017.stdout:9/92: write d0/fa [8370447,75703] 0 2024-08-19T00:56:04.195 INFO:tasks.workunit.client.1.smithi086.stdout:0/442: mknod da/d14/d26/c94 0 2024-08-19T00:56:04.196 INFO:tasks.workunit.client.1.smithi086.stdout:0/443: write da/d14/d1a/d2e/d39/f85 [3416333,29535] 0 2024-08-19T00:56:04.197 INFO:tasks.workunit.client.0.smithi017.stdout:3/120: dread d5/da/fd [0,4194304] 0 2024-08-19T00:56:04.198 INFO:tasks.workunit.client.1.smithi086.stdout:2/392: link d8/d14/f2f d8/d24/d32/d5c/f81 0 2024-08-19T00:56:04.198 INFO:tasks.workunit.client.0.smithi017.stdout:7/121: rmdir d3/dc/d2a 0 2024-08-19T00:56:04.199 INFO:tasks.workunit.client.0.smithi017.stdout:7/122: chown d3/dc/df/d1a 205045 1 2024-08-19T00:56:04.200 INFO:tasks.workunit.client.0.smithi017.stdout:4/68: rmdir d2/d11/d15 0 2024-08-19T00:56:04.200 INFO:tasks.workunit.client.1.smithi086.stdout:5/420: dread d0/d5f/d60/d57/f58 [0,4194304] 0 2024-08-19T00:56:04.201 INFO:tasks.workunit.client.1.smithi086.stdout:7/467: creat d3/de/d68/d7a/f8f x:0 0 0 2024-08-19T00:56:04.203 INFO:tasks.workunit.client.0.smithi017.stdout:9/93: rmdir d0/db 39 2024-08-19T00:56:04.207 INFO:tasks.workunit.client.1.smithi086.stdout:5/421: symlink d0/d8/d72/l7f 0 2024-08-19T00:56:04.209 INFO:tasks.workunit.client.1.smithi086.stdout:8/434: dread dc/d16/d18/d29/d2e/d28/d41/f59 [0,4194304] 0 2024-08-19T00:56:04.212 INFO:tasks.workunit.client.0.smithi017.stdout:7/123: dwrite d3/f25 [0,4194304] 0 2024-08-19T00:56:04.213 INFO:tasks.workunit.client.1.smithi086.stdout:0/444: link da/d14/d44/d49/f5f da/d5d/f95 0 2024-08-19T00:56:04.213 INFO:tasks.workunit.client.0.smithi017.stdout:7/124: stat d3/dc/df 0 2024-08-19T00:56:04.214 INFO:tasks.workunit.client.0.smithi017.stdout:4/69: dwrite d2/f12 [0,4194304] 0 2024-08-19T00:56:04.214 INFO:tasks.workunit.client.1.smithi086.stdout:2/393: symlink d8/d2c/d38/d80/l82 0 2024-08-19T00:56:04.214 INFO:tasks.workunit.client.1.smithi086.stdout:2/394: stat d8/d24/c27 0 2024-08-19T00:56:04.218 INFO:tasks.workunit.client.0.smithi017.stdout:7/125: write d3/f5 [4937173,20657] 0 2024-08-19T00:56:04.219 INFO:tasks.workunit.client.1.smithi086.stdout:3/440: getdents d3/d18/d27/d49/d3f 0 2024-08-19T00:56:04.224 INFO:tasks.workunit.client.1.smithi086.stdout:5/422: mkdir d0/d5f/d60/d57/d80 0 2024-08-19T00:56:04.225 INFO:tasks.workunit.client.1.smithi086.stdout:3/441: dwrite d3/d9/f13 [0,4194304] 0 2024-08-19T00:56:04.226 INFO:tasks.workunit.client.0.smithi017.stdout:7/126: dwrite d3/f4 [0,4194304] 0 2024-08-19T00:56:04.231 INFO:tasks.workunit.client.1.smithi086.stdout:3/442: fdatasync d3/d18/d27/d49/d3f/d5b/f70 0 2024-08-19T00:56:04.231 INFO:tasks.workunit.client.0.smithi017.stdout:7/127: write d3/dc/df/d23/f24 [858329,111068] 0 2024-08-19T00:56:04.231 INFO:tasks.workunit.client.0.smithi017.stdout:3/121: truncate d5/d15/f21 2769424 0 2024-08-19T00:56:04.232 INFO:tasks.workunit.client.1.smithi086.stdout:0/445: creat da/d5d/f96 x:0 0 0 2024-08-19T00:56:04.233 INFO:tasks.workunit.client.0.smithi017.stdout:4/70: symlink d2/d16/l17 0 2024-08-19T00:56:04.234 INFO:tasks.workunit.client.0.smithi017.stdout:4/71: truncate d2/fa 829962 0 2024-08-19T00:56:04.237 INFO:tasks.workunit.client.0.smithi017.stdout:9/94: rename d0/c9 to d0/c1c 0 2024-08-19T00:56:04.238 INFO:tasks.workunit.client.0.smithi017.stdout:3/122: fdatasync f2 0 2024-08-19T00:56:04.241 INFO:tasks.workunit.client.0.smithi017.stdout:9/95: dread d0/f15 [0,4194304] 0 2024-08-19T00:56:04.242 INFO:tasks.workunit.client.0.smithi017.stdout:4/72: dread d2/f7 [0,4194304] 0 2024-08-19T00:56:04.245 INFO:tasks.workunit.client.1.smithi086.stdout:3/443: creat d3/d18/d61/f96 x:0 0 0 2024-08-19T00:56:04.248 INFO:tasks.workunit.client.0.smithi017.stdout:7/128: link d3/dc/f21 d3/dc/df/d1a/f2b 0 2024-08-19T00:56:04.249 INFO:tasks.workunit.client.1.smithi086.stdout:7/468: getdents d3/d34/d44 0 2024-08-19T00:56:04.250 INFO:tasks.workunit.client.1.smithi086.stdout:7/469: chown d3/d34/d44/d58/d4b/c1f 6 1 2024-08-19T00:56:04.252 INFO:tasks.workunit.client.1.smithi086.stdout:8/435: creat dc/d16/d18/f8c x:0 0 0 2024-08-19T00:56:04.252 INFO:tasks.workunit.client.1.smithi086.stdout:8/436: chown dc/d70/d7a/c81 192 1 2024-08-19T00:56:04.253 INFO:tasks.workunit.client.0.smithi017.stdout:9/96: write d0/db/f1b [377443,9804] 0 2024-08-19T00:56:04.253 INFO:tasks.workunit.client.1.smithi086.stdout:3/444: creat d3/d18/d61/f97 x:0 0 0 2024-08-19T00:56:04.254 INFO:tasks.workunit.client.0.smithi017.stdout:9/97: write d0/fc [2045711,126884] 0 2024-08-19T00:56:04.254 INFO:tasks.workunit.client.1.smithi086.stdout:3/445: chown d3/d18/d27/d76 16017057 1 2024-08-19T00:56:04.256 INFO:tasks.workunit.client.1.smithi086.stdout:3/446: write d3/d18/d27/d49/d3f/d54/f94 [947466,77271] 0 2024-08-19T00:56:04.256 INFO:tasks.workunit.client.1.smithi086.stdout:5/423: link d0/d8/d72/l7b d0/df/d1f/d65/l81 0 2024-08-19T00:56:04.258 INFO:tasks.workunit.client.1.smithi086.stdout:7/470: mkdir d3/de/d2d/d90 0 2024-08-19T00:56:04.259 INFO:tasks.workunit.client.1.smithi086.stdout:8/437: dread dc/d17/d1e/d55/f65 [0,4194304] 0 2024-08-19T00:56:04.259 INFO:tasks.workunit.client.1.smithi086.stdout:9/448: sync 2024-08-19T00:56:04.260 INFO:tasks.workunit.client.1.smithi086.stdout:7/471: chown d3/l2e 2948371 1 2024-08-19T00:56:04.261 INFO:tasks.workunit.client.1.smithi086.stdout:0/446: dwrite da/d14/f6f [0,4194304] 0 2024-08-19T00:56:04.262 INFO:tasks.workunit.client.1.smithi086.stdout:3/447: symlink d3/d26/d2b/l98 0 2024-08-19T00:56:04.262 INFO:tasks.workunit.client.0.smithi017.stdout:3/123: link d5/da/fd d5/da/f23 0 2024-08-19T00:56:04.263 INFO:tasks.workunit.client.0.smithi017.stdout:9/98: dwrite d0/f1a [0,4194304] 0 2024-08-19T00:56:04.268 INFO:tasks.workunit.client.1.smithi086.stdout:5/424: dread d0/df/d1f/d33/f40 [0,4194304] 0 2024-08-19T00:56:04.269 INFO:tasks.workunit.client.0.smithi017.stdout:3/124: mknod d5/d18/c24 0 2024-08-19T00:56:04.269 INFO:tasks.workunit.client.0.smithi017.stdout:3/125: chown f3 1 1 2024-08-19T00:56:04.271 INFO:tasks.workunit.client.1.smithi086.stdout:8/438: dwrite dc/f14 [0,4194304] 0 2024-08-19T00:56:04.274 INFO:tasks.workunit.client.1.smithi086.stdout:0/447: dwrite da/d14/f2d [0,4194304] 0 2024-08-19T00:56:04.274 INFO:tasks.workunit.client.0.smithi017.stdout:3/126: dread d5/d11/f1e [0,4194304] 0 2024-08-19T00:56:04.275 INFO:tasks.workunit.client.0.smithi017.stdout:9/99: symlink d0/l1d 0 2024-08-19T00:56:04.276 INFO:tasks.workunit.client.1.smithi086.stdout:0/448: chown da/d14/f1b 35074569 1 2024-08-19T00:56:04.277 INFO:tasks.workunit.client.1.smithi086.stdout:3/448: mknod d3/d18/d27/d49/d3f/d5b/d8f/c99 0 2024-08-19T00:56:04.277 INFO:tasks.workunit.client.1.smithi086.stdout:0/449: fdatasync da/d14/d1a/f54 0 2024-08-19T00:56:04.280 INFO:tasks.workunit.client.0.smithi017.stdout:7/129: write d3/dc/f1f [1662482,7591] 0 2024-08-19T00:56:04.280 INFO:tasks.workunit.client.1.smithi086.stdout:5/425: mkdir d0/df/d1f/d65/d82 0 2024-08-19T00:56:04.280 INFO:tasks.workunit.client.0.smithi017.stdout:7/130: stat d3/f25 0 2024-08-19T00:56:04.283 INFO:tasks.workunit.client.0.smithi017.stdout:9/100: mknod d0/db/c1e 0 2024-08-19T00:56:04.284 INFO:tasks.workunit.client.1.smithi086.stdout:7/472: link d3/d34/d44/d58/f55 d3/d34/d44/d58/d4b/d42/f91 0 2024-08-19T00:56:04.287 INFO:tasks.workunit.client.0.smithi017.stdout:9/101: rmdir d0/db 39 2024-08-19T00:56:04.293 INFO:tasks.workunit.client.1.smithi086.stdout:9/449: link db/d26/d5c/d87/d30/d32/f3a db/d26/d5c/d87/d30/d32/d44/d67/f90 0 2024-08-19T00:56:04.293 INFO:tasks.workunit.client.0.smithi017.stdout:3/127: write d5/fc [1716032,58764] 0 2024-08-19T00:56:04.294 INFO:tasks.workunit.client.1.smithi086.stdout:0/450: rmdir da/d14/d1a/d2e/d30 39 2024-08-19T00:56:04.296 INFO:tasks.workunit.client.0.smithi017.stdout:9/102: chown d0/c1c 1855775 1 2024-08-19T00:56:04.298 INFO:tasks.workunit.client.1.smithi086.stdout:3/449: creat d3/d18/d27/d49/d3f/f9a x:0 0 0 2024-08-19T00:56:04.299 INFO:tasks.workunit.client.0.smithi017.stdout:7/131: write d3/dc/df/d1a/f2b [1315715,21710] 0 2024-08-19T00:56:04.300 INFO:tasks.workunit.client.1.smithi086.stdout:6/424: sync 2024-08-19T00:56:04.300 INFO:tasks.workunit.client.1.smithi086.stdout:4/404: sync 2024-08-19T00:56:04.300 INFO:tasks.workunit.client.1.smithi086.stdout:1/489: sync 2024-08-19T00:56:04.301 INFO:tasks.workunit.client.1.smithi086.stdout:6/425: stat f3 0 2024-08-19T00:56:04.303 INFO:tasks.workunit.client.0.smithi017.stdout:9/103: dwrite d0/f14 [0,4194304] 0 2024-08-19T00:56:04.303 INFO:tasks.workunit.client.1.smithi086.stdout:7/473: creat d3/de/d68/d72/d7e/f92 x:0 0 0 2024-08-19T00:56:04.304 INFO:tasks.workunit.client.0.smithi017.stdout:7/132: mkdir d3/dc/df/d1c/d2c 0 2024-08-19T00:56:04.307 INFO:tasks.workunit.client.1.smithi086.stdout:0/451: rmdir da/d14/d1a/d2e/d39 39 2024-08-19T00:56:04.310 INFO:tasks.workunit.client.1.smithi086.stdout:3/450: rename d3/d18/d27/d48 to d3/d18/d1a/d51/d9b 0 2024-08-19T00:56:04.311 INFO:tasks.workunit.client.0.smithi017.stdout:3/128: link d5/da/f23 d5/d11/f25 0 2024-08-19T00:56:04.313 INFO:tasks.workunit.client.0.smithi017.stdout:9/104: mknod d0/db/c1f 0 2024-08-19T00:56:04.314 INFO:tasks.workunit.client.0.smithi017.stdout:9/105: truncate d0/f19 667272 0 2024-08-19T00:56:04.316 INFO:tasks.workunit.client.1.smithi086.stdout:5/426: truncate d0/fa 3503485 0 2024-08-19T00:56:04.317 INFO:tasks.workunit.client.1.smithi086.stdout:6/426: stat db/f14 0 2024-08-19T00:56:04.320 INFO:tasks.workunit.client.1.smithi086.stdout:4/405: creat d2/d18/f86 x:0 0 0 2024-08-19T00:56:04.320 INFO:tasks.workunit.client.1.smithi086.stdout:1/490: mknod d4/d7/d2a/d36/d63/ca2 0 2024-08-19T00:56:04.321 INFO:tasks.workunit.client.0.smithi017.stdout:9/106: dwrite d0/fc [0,4194304] 0 2024-08-19T00:56:04.321 INFO:tasks.workunit.client.1.smithi086.stdout:9/450: link db/d26/d5c/d87/d30/d32/d44/f65 db/d26/d5c/d87/d37/f91 0 2024-08-19T00:56:04.322 INFO:tasks.workunit.client.1.smithi086.stdout:5/427: dwrite d0/d20/f3c [0,4194304] 0 2024-08-19T00:56:04.323 INFO:tasks.workunit.client.1.smithi086.stdout:5/428: readlink d0/d8/d10/l5d 0 2024-08-19T00:56:04.324 INFO:tasks.workunit.client.1.smithi086.stdout:5/429: chown d0/d2d/d4f/f7d 1659729999 1 2024-08-19T00:56:04.327 INFO:tasks.workunit.client.0.smithi017.stdout:3/129: write d5/da/fd [1242618,108085] 0 2024-08-19T00:56:04.328 INFO:tasks.workunit.client.0.smithi017.stdout:9/107: dread d0/f18 [4194304,4194304] 0 2024-08-19T00:56:04.328 INFO:tasks.workunit.client.1.smithi086.stdout:1/491: dread d4/d1e/f54 [0,4194304] 0 2024-08-19T00:56:04.328 INFO:tasks.workunit.client.1.smithi086.stdout:3/451: creat d3/d18/d19/d62/f9c x:0 0 0 2024-08-19T00:56:04.329 INFO:tasks.workunit.client.1.smithi086.stdout:6/427: truncate db/f16 801478 0 2024-08-19T00:56:04.329 INFO:tasks.workunit.client.1.smithi086.stdout:3/452: fsync d3/d18/d27/d49/d3f/f89 0 2024-08-19T00:56:04.330 INFO:tasks.workunit.client.1.smithi086.stdout:8/439: getdents dc/d16/d18/d29/d2e/d28/d2b 0 2024-08-19T00:56:04.333 INFO:tasks.workunit.client.0.smithi017.stdout:3/130: symlink d5/l26 0 2024-08-19T00:56:04.334 INFO:tasks.workunit.client.1.smithi086.stdout:4/406: creat d2/d18/d33/d42/d72/d78/f87 x:0 0 0 2024-08-19T00:56:04.337 INFO:tasks.workunit.client.0.smithi017.stdout:3/131: fdatasync f3 0 2024-08-19T00:56:04.337 INFO:tasks.workunit.client.0.smithi017.stdout:9/108: dwrite d0/fc [4194304,4194304] 0 2024-08-19T00:56:04.338 INFO:tasks.workunit.client.0.smithi017.stdout:9/109: rename d0/db to d0/db/d20 22 2024-08-19T00:56:04.339 INFO:tasks.workunit.client.0.smithi017.stdout:9/110: chown d0/l16 1 1 2024-08-19T00:56:04.340 INFO:tasks.workunit.client.1.smithi086.stdout:9/451: dwrite db/f52 [0,4194304] 0 2024-08-19T00:56:04.340 INFO:tasks.workunit.client.1.smithi086.stdout:1/492: truncate d4/d10/f51 27054 0 2024-08-19T00:56:04.341 INFO:tasks.workunit.client.1.smithi086.stdout:9/452: stat db/d26/d5c/d87/c77 0 2024-08-19T00:56:04.348 INFO:tasks.workunit.client.0.smithi017.stdout:3/132: unlink l0 0 2024-08-19T00:56:04.350 INFO:tasks.workunit.client.1.smithi086.stdout:2/395: sync 2024-08-19T00:56:04.351 INFO:tasks.workunit.client.1.smithi086.stdout:2/396: chown d8/d24/c27 3778 1 2024-08-19T00:56:04.351 INFO:tasks.workunit.client.0.smithi017.stdout:9/111: dwrite d0/db/f1b [0,4194304] 0 2024-08-19T00:56:04.352 INFO:tasks.workunit.client.1.smithi086.stdout:7/474: rename d3/de/d2d/l77 to d3/de/l93 0 2024-08-19T00:56:04.353 INFO:tasks.workunit.client.0.smithi017.stdout:9/112: chown d0/f14 0 1 2024-08-19T00:56:04.353 INFO:tasks.workunit.client.1.smithi086.stdout:3/453: read d3/d18/d1a/d51/d9b/f4b [33425,35458] 0 2024-08-19T00:56:04.354 INFO:tasks.workunit.client.1.smithi086.stdout:7/475: dread - d3/d34/f76 zero size 2024-08-19T00:56:04.356 INFO:tasks.workunit.client.0.smithi017.stdout:3/133: dread d5/ff [0,4194304] 0 2024-08-19T00:56:04.356 INFO:tasks.workunit.client.1.smithi086.stdout:9/453: mknod db/d26/d5c/d87/d6d/c92 0 2024-08-19T00:56:04.357 INFO:tasks.workunit.client.1.smithi086.stdout:3/454: stat d3/d18/d27/d49/l8e 0 2024-08-19T00:56:04.360 INFO:tasks.workunit.client.0.smithi017.stdout:9/113: dread d0/fa [0,4194304] 0 2024-08-19T00:56:04.360 INFO:tasks.workunit.client.1.smithi086.stdout:2/397: dwrite d8/d2c/d38/f3f [0,4194304] 0 2024-08-19T00:56:04.361 INFO:tasks.workunit.client.1.smithi086.stdout:8/440: creat dc/d17/d1e/d55/d7f/f8d x:0 0 0 2024-08-19T00:56:04.364 INFO:tasks.workunit.client.1.smithi086.stdout:6/428: dread db/d37/d30/f33 [0,4194304] 0 2024-08-19T00:56:04.365 INFO:tasks.workunit.client.1.smithi086.stdout:0/452: truncate da/d14/d44/d49/f63 3250975 0 2024-08-19T00:56:04.367 INFO:tasks.workunit.client.1.smithi086.stdout:5/430: dwrite d0/d20/f3c [4194304,4194304] 0 2024-08-19T00:56:04.368 INFO:tasks.workunit.client.1.smithi086.stdout:5/431: chown d0/d20/f53 591190033 1 2024-08-19T00:56:04.369 INFO:tasks.workunit.client.0.smithi017.stdout:3/134: dwrite d5/ff [0,4194304] 0 2024-08-19T00:56:04.370 INFO:tasks.workunit.client.1.smithi086.stdout:1/493: rename d4/d7/d2a/c32 to d4/d7/d2a/d6e/ca3 0 2024-08-19T00:56:04.371 INFO:tasks.workunit.client.0.smithi017.stdout:8/29: sync 2024-08-19T00:56:04.377 INFO:tasks.workunit.client.1.smithi086.stdout:3/455: creat d3/d18/d19/d37/d5a/f9d x:0 0 0 2024-08-19T00:56:04.381 INFO:tasks.workunit.client.0.smithi017.stdout:8/30: dwrite f0 [0,4194304] 0 2024-08-19T00:56:04.384 INFO:tasks.workunit.client.1.smithi086.stdout:3/456: dwrite d3/d18/d19/d37/d5a/f9d [0,4194304] 0 2024-08-19T00:56:04.390 INFO:tasks.workunit.client.1.smithi086.stdout:8/441: rmdir dc/d17/d1e/d49 39 2024-08-19T00:56:04.392 INFO:tasks.workunit.client.0.smithi017.stdout:8/31: mkdir d7 0 2024-08-19T00:56:04.393 INFO:tasks.workunit.client.1.smithi086.stdout:4/407: truncate d2/d18/d33/d42/d72/d78/d25/f7e 2498067 0 2024-08-19T00:56:04.397 INFO:tasks.workunit.client.0.smithi017.stdout:3/135: getdents d5/d18 0 2024-08-19T00:56:04.402 INFO:tasks.workunit.client.0.smithi017.stdout:9/114: dwrite d0/db/f1b [4194304,4194304] 0 2024-08-19T00:56:04.403 INFO:tasks.workunit.client.0.smithi017.stdout:9/115: chown d0/db/c1e 2836677 1 2024-08-19T00:56:04.403 INFO:tasks.workunit.client.0.smithi017.stdout:9/116: readlink d0/l1d 0 2024-08-19T00:56:04.404 INFO:tasks.workunit.client.0.smithi017.stdout:8/32: rmdir d7 0 2024-08-19T00:56:04.405 INFO:tasks.workunit.client.1.smithi086.stdout:9/454: write db/d26/d5c/d87/d30/d32/d44/d67/f90 [1176532,67015] 0 2024-08-19T00:56:04.407 INFO:tasks.workunit.client.0.smithi017.stdout:9/117: symlink d0/db/l21 0 2024-08-19T00:56:04.408 INFO:tasks.workunit.client.1.smithi086.stdout:3/457: mknod d3/d18/d27/d49/d3f/d5b/d8f/c9e 0 2024-08-19T00:56:04.409 INFO:tasks.workunit.client.1.smithi086.stdout:0/453: mkdir da/d97 0 2024-08-19T00:56:04.410 INFO:tasks.workunit.client.1.smithi086.stdout:6/429: symlink db/d37/d44/d5a/d78/l8c 0 2024-08-19T00:56:04.411 INFO:tasks.workunit.client.1.smithi086.stdout:4/408: mknod d2/d18/d33/d42/d72/d78/c88 0 2024-08-19T00:56:04.411 INFO:tasks.workunit.client.0.smithi017.stdout:9/118: dread d0/fc [4194304,4194304] 0 2024-08-19T00:56:04.412 INFO:tasks.workunit.client.0.smithi017.stdout:9/119: stat d0/c1c 0 2024-08-19T00:56:04.412 INFO:tasks.workunit.client.1.smithi086.stdout:6/430: chown db/d34/l81 10 1 2024-08-19T00:56:04.412 INFO:tasks.workunit.client.1.smithi086.stdout:0/454: write da/d14/d1a/f52 [1380664,128946] 0 2024-08-19T00:56:04.413 INFO:tasks.workunit.client.1.smithi086.stdout:8/442: rename dc/d17/f24 to dc/d16/d18/d29/d2e/d28/d2b/d3b/f8e 0 2024-08-19T00:56:04.413 INFO:tasks.workunit.client.1.smithi086.stdout:2/398: dwrite d8/f1f [4194304,4194304] 0 2024-08-19T00:56:04.413 INFO:tasks.workunit.client.0.smithi017.stdout:9/120: mkdir d0/db/d22 0 2024-08-19T00:56:04.414 INFO:tasks.workunit.client.0.smithi017.stdout:9/121: readlink d0/l1d 0 2024-08-19T00:56:04.414 INFO:tasks.workunit.client.1.smithi086.stdout:8/443: fdatasync dc/d1f/f27 0 2024-08-19T00:56:04.415 INFO:tasks.workunit.client.1.smithi086.stdout:7/476: rmdir d3/de/d2d/d90 0 2024-08-19T00:56:04.415 INFO:tasks.workunit.client.1.smithi086.stdout:4/409: write d2/d18/d33/d42/d72/f37 [2111972,11048] 0 2024-08-19T00:56:04.416 INFO:tasks.workunit.client.1.smithi086.stdout:9/455: creat db/d26/f93 x:0 0 0 2024-08-19T00:56:04.417 INFO:tasks.workunit.client.1.smithi086.stdout:1/494: creat d4/d7/d2a/d36/d3a/fa4 x:0 0 0 2024-08-19T00:56:04.418 INFO:tasks.workunit.client.1.smithi086.stdout:0/455: creat da/d14/d44/f98 x:0 0 0 2024-08-19T00:56:04.423 INFO:tasks.workunit.client.1.smithi086.stdout:6/431: creat db/d34/d4e/d55/f8d x:0 0 0 2024-08-19T00:56:04.423 INFO:tasks.workunit.client.1.smithi086.stdout:8/444: mkdir dc/d70/d8f 0 2024-08-19T00:56:04.423 INFO:tasks.workunit.client.1.smithi086.stdout:7/477: rmdir d3/de/d2d 39 2024-08-19T00:56:04.424 INFO:tasks.workunit.client.1.smithi086.stdout:4/410: read d2/d18/d33/d42/d72/d78/d2c/f2e [2923001,108402] 0 2024-08-19T00:56:04.425 INFO:tasks.workunit.client.1.smithi086.stdout:9/456: mknod db/d26/d5c/d87/d30/d3f/d43/d84/c94 0 2024-08-19T00:56:04.427 INFO:tasks.workunit.client.1.smithi086.stdout:4/411: dread d2/d18/d33/f5e [0,4194304] 0 2024-08-19T00:56:04.427 INFO:tasks.workunit.client.1.smithi086.stdout:1/495: symlink d4/d7/d2a/d36/d63/d84/la5 0 2024-08-19T00:56:04.435 INFO:tasks.workunit.client.1.smithi086.stdout:8/445: mkdir dc/d16/d18/d29/d2e/d90 0 2024-08-19T00:56:04.436 INFO:tasks.workunit.client.1.smithi086.stdout:9/457: dwrite db/d26/d5c/d87/d30/d32/d44/f69 [0,4194304] 0 2024-08-19T00:56:04.438 INFO:tasks.workunit.client.1.smithi086.stdout:4/412: dwrite d2/d18/d33/f64 [0,4194304] 0 2024-08-19T00:56:04.439 INFO:tasks.workunit.client.0.smithi017.stdout:3/136: getdents d5/d15/d1b 0 2024-08-19T00:56:04.439 INFO:tasks.workunit.client.1.smithi086.stdout:5/432: dwrite d0/d2d/f32 [4194304,4194304] 0 2024-08-19T00:56:04.439 INFO:tasks.workunit.client.0.smithi017.stdout:3/137: chown f2 98 1 2024-08-19T00:56:04.441 INFO:tasks.workunit.client.1.smithi086.stdout:5/433: chown d0/d8/lc 7648974 1 2024-08-19T00:56:04.448 INFO:tasks.workunit.client.1.smithi086.stdout:9/458: creat db/d26/d5c/d87/d30/d58/f95 x:0 0 0 2024-08-19T00:56:04.454 INFO:tasks.workunit.client.1.smithi086.stdout:2/399: dwrite d8/d14/f2f [0,4194304] 0 2024-08-19T00:56:04.455 INFO:tasks.workunit.client.1.smithi086.stdout:1/496: rename d4/d7/d2a/d36/d3a/c5d to d4/d7/d2a/d36/ca6 0 2024-08-19T00:56:04.457 INFO:tasks.workunit.client.1.smithi086.stdout:9/459: mkdir db/d96 0 2024-08-19T00:56:04.457 INFO:tasks.workunit.client.1.smithi086.stdout:6/432: write db/d37/f27 [131915,1195] 0 2024-08-19T00:56:04.460 INFO:tasks.workunit.client.1.smithi086.stdout:7/478: write d3/de/f66 [3200406,115068] 0 2024-08-19T00:56:04.464 INFO:tasks.workunit.client.1.smithi086.stdout:4/413: rename d2/d18/d33/d42/d72/d2f/f39 to d2/d18/d33/d42/d72/d78/f89 0 2024-08-19T00:56:04.467 INFO:tasks.workunit.client.0.smithi017.stdout:3/138: truncate d5/da/f23 2536945 0 2024-08-19T00:56:04.468 INFO:tasks.workunit.client.1.smithi086.stdout:4/414: truncate d2/d18/d33/f65 932534 0 2024-08-19T00:56:04.469 INFO:tasks.workunit.client.1.smithi086.stdout:2/400: link d8/d2c/c44 d8/d14/c83 0 2024-08-19T00:56:04.470 INFO:tasks.workunit.client.0.smithi017.stdout:3/139: mkdir d5/da/d27 0 2024-08-19T00:56:04.473 INFO:tasks.workunit.client.1.smithi086.stdout:7/479: dread d3/de/f17 [4194304,4194304] 0 2024-08-19T00:56:04.474 INFO:tasks.workunit.client.1.smithi086.stdout:9/460: rename db/dd/d19/f2c to db/d26/d5c/f97 0 2024-08-19T00:56:04.474 INFO:tasks.workunit.client.1.smithi086.stdout:5/434: dread d0/df/f23 [0,4194304] 0 2024-08-19T00:56:04.475 INFO:tasks.workunit.client.1.smithi086.stdout:8/446: dwrite f5 [0,4194304] 0 2024-08-19T00:56:04.480 INFO:tasks.workunit.client.1.smithi086.stdout:6/433: dread db/d34/d39/f40 [0,4194304] 0 2024-08-19T00:56:04.482 INFO:tasks.workunit.client.1.smithi086.stdout:1/497: dread d4/d7/d2a/d36/d3a/f72 [0,4194304] 0 2024-08-19T00:56:04.482 INFO:tasks.workunit.client.1.smithi086.stdout:4/415: mkdir d2/d18/d33/d42/d72/d78/d25/d6b/d81/d8a 0 2024-08-19T00:56:04.496 INFO:tasks.workunit.client.0.smithi017.stdout:3/140: dwrite d5/da/f23 [0,4194304] 0 2024-08-19T00:56:04.499 INFO:tasks.workunit.client.0.smithi017.stdout:3/141: mkdir d5/da/d27/d28 0 2024-08-19T00:56:04.500 INFO:tasks.workunit.client.0.smithi017.stdout:3/142: mknod d5/da/d27/d28/c29 0 2024-08-19T00:56:04.501 INFO:tasks.workunit.client.0.smithi017.stdout:3/143: fsync d5/d11/f14 0 2024-08-19T00:56:04.503 INFO:tasks.workunit.client.0.smithi017.stdout:3/144: creat d5/d11/f2a x:0 0 0 2024-08-19T00:56:04.516 INFO:tasks.workunit.client.0.smithi017.stdout:3/145: dwrite f3 [0,4194304] 0 2024-08-19T00:56:04.518 INFO:tasks.workunit.client.0.smithi017.stdout:3/146: rmdir d5/da/d27 39 2024-08-19T00:56:04.526 INFO:tasks.workunit.client.0.smithi017.stdout:3/147: dwrite d5/ff [4194304,4194304] 0 2024-08-19T00:56:04.530 INFO:tasks.workunit.client.1.smithi086.stdout:7/480: write d3/d34/d44/d58/d4b/d42/f91 [3370520,41770] 0 2024-08-19T00:56:04.530 INFO:tasks.workunit.client.1.smithi086.stdout:1/498: truncate d4/d7/d2a/d36/d3a/fa4 476622 0 2024-08-19T00:56:04.531 INFO:tasks.workunit.client.0.smithi017.stdout:3/148: rename f3 to d5/da/f2b 0 2024-08-19T00:56:04.533 INFO:tasks.workunit.client.1.smithi086.stdout:9/461: truncate db/d26/d5c/d87/d6d/f41 409971 0 2024-08-19T00:56:04.534 INFO:tasks.workunit.client.1.smithi086.stdout:2/401: getdents d8/d24 0 2024-08-19T00:56:04.536 INFO:tasks.workunit.client.1.smithi086.stdout:6/434: mkdir db/d8e 0 2024-08-19T00:56:04.537 INFO:tasks.workunit.client.1.smithi086.stdout:8/447: rmdir dc/d16/d18/d29/d2e/d90 0 2024-08-19T00:56:04.540 INFO:tasks.workunit.client.0.smithi017.stdout:3/149: dwrite d5/d11/f1e [0,4194304] 0 2024-08-19T00:56:04.542 INFO:tasks.workunit.client.1.smithi086.stdout:1/499: mknod d4/d7/d2a/d36/d3a/d41/ca7 0 2024-08-19T00:56:04.543 INFO:tasks.workunit.client.1.smithi086.stdout:1/500: truncate d4/d7/d2a/f4d 259612 0 2024-08-19T00:56:04.545 INFO:tasks.workunit.client.1.smithi086.stdout:8/448: write dc/d16/d18/d29/d2e/d28/d2b/d3b/f8e [3002193,51005] 0 2024-08-19T00:56:04.546 INFO:tasks.workunit.client.1.smithi086.stdout:9/462: symlink db/d26/d5c/d87/d30/l98 0 2024-08-19T00:56:04.546 INFO:tasks.workunit.client.0.smithi017.stdout:3/150: dread f2 [0,4194304] 0 2024-08-19T00:56:04.547 INFO:tasks.workunit.client.1.smithi086.stdout:6/435: mkdir db/d37/d44/d5a/d8f 0 2024-08-19T00:56:04.548 INFO:tasks.workunit.client.1.smithi086.stdout:7/481: dread d3/d34/d44/d3e/f74 [0,4194304] 0 2024-08-19T00:56:04.548 INFO:tasks.workunit.client.1.smithi086.stdout:1/501: mknod d4/d7/d2a/d6e/d95/ca8 0 2024-08-19T00:56:04.550 INFO:tasks.workunit.client.1.smithi086.stdout:9/463: truncate db/d26/d5c/d87/d30/d3f/d43/d84/f85 996625 0 2024-08-19T00:56:04.551 INFO:tasks.workunit.client.0.smithi017.stdout:2/129: sync 2024-08-19T00:56:04.551 INFO:tasks.workunit.client.1.smithi086.stdout:9/464: read - db/d26/d5c/d87/d30/d3f/f8a zero size 2024-08-19T00:56:04.551 INFO:tasks.workunit.client.0.smithi017.stdout:2/130: read - d2/d7/d10/d19/f24 zero size 2024-08-19T00:56:04.552 INFO:tasks.workunit.client.1.smithi086.stdout:9/465: fdatasync db/f11 0 2024-08-19T00:56:04.553 INFO:tasks.workunit.client.1.smithi086.stdout:9/466: write db/f15 [12391735,66393] 0 2024-08-19T00:56:04.553 INFO:tasks.workunit.client.1.smithi086.stdout:2/402: rename d8/d24/d32/d5c to d8/d84 0 2024-08-19T00:56:04.554 INFO:tasks.workunit.client.1.smithi086.stdout:8/449: fsync dc/d16/d18/d29/d2e/d28/d2b/f6e 0 2024-08-19T00:56:04.554 INFO:tasks.workunit.client.1.smithi086.stdout:4/416: write d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/f74 [752659,69158] 0 2024-08-19T00:56:04.556 INFO:tasks.workunit.client.0.smithi017.stdout:3/151: creat d5/da/d27/f2c x:0 0 0 2024-08-19T00:56:04.556 INFO:tasks.workunit.client.1.smithi086.stdout:4/417: dread - d2/d18/d33/d42/d72/d78/f87 zero size 2024-08-19T00:56:04.557 INFO:tasks.workunit.client.0.smithi017.stdout:3/152: stat d5/da/f2b 0 2024-08-19T00:56:04.558 INFO:tasks.workunit.client.0.smithi017.stdout:3/153: write d5/da/fd [1171383,59051] 0 2024-08-19T00:56:04.559 INFO:tasks.workunit.client.0.smithi017.stdout:2/131: unlink d2/c1e 0 2024-08-19T00:56:04.561 INFO:tasks.workunit.client.1.smithi086.stdout:2/403: fdatasync d8/d43/f5a 0 2024-08-19T00:56:04.563 INFO:tasks.workunit.client.1.smithi086.stdout:9/467: mknod db/d26/d5c/d87/c99 0 2024-08-19T00:56:04.566 INFO:tasks.workunit.client.1.smithi086.stdout:1/502: dread d4/d7/f3d [0,4194304] 0 2024-08-19T00:56:04.566 INFO:tasks.workunit.client.1.smithi086.stdout:8/450: creat dc/d16/d18/d29/f91 x:0 0 0 2024-08-19T00:56:04.568 INFO:tasks.workunit.client.1.smithi086.stdout:6/436: mknod db/d34/c90 0 2024-08-19T00:56:04.568 INFO:tasks.workunit.client.1.smithi086.stdout:2/404: dwrite d8/d2c/d67/f6f [0,4194304] 0 2024-08-19T00:56:04.569 INFO:tasks.workunit.client.0.smithi017.stdout:3/154: link d5/d15/d1b/f20 d5/d11/f2d 0 2024-08-19T00:56:04.570 INFO:tasks.workunit.client.1.smithi086.stdout:2/405: truncate d8/d14/f55 774304 0 2024-08-19T00:56:04.572 INFO:tasks.workunit.client.0.smithi017.stdout:3/155: chown d5/d18/l1c 14 1 2024-08-19T00:56:04.573 INFO:tasks.workunit.client.0.smithi017.stdout:3/156: fsync d5/d11/f1e 0 2024-08-19T00:56:04.576 INFO:tasks.workunit.client.1.smithi086.stdout:8/451: creat dc/d16/d18/d29/d2e/d28/f92 x:0 0 0 2024-08-19T00:56:04.577 INFO:tasks.workunit.client.1.smithi086.stdout:6/437: stat db/l1d 0 2024-08-19T00:56:04.578 INFO:tasks.workunit.client.0.smithi017.stdout:3/157: mknod d5/d15/c2e 0 2024-08-19T00:56:04.579 INFO:tasks.workunit.client.1.smithi086.stdout:4/418: link d2/d18/d33/d42/d72/d78/d25/d55/f38 d2/d18/d33/d42/d72/d78/d25/f8b 0 2024-08-19T00:56:04.580 INFO:tasks.workunit.client.1.smithi086.stdout:2/406: mknod d8/d24/d32/c85 0 2024-08-19T00:56:04.580 INFO:tasks.workunit.client.1.smithi086.stdout:4/419: fdatasync d2/d18/d33/d42/d72/d78/f67 0 2024-08-19T00:56:04.581 INFO:tasks.workunit.client.1.smithi086.stdout:4/420: write d2/f21 [1294153,107772] 0 2024-08-19T00:56:04.582 INFO:tasks.workunit.client.1.smithi086.stdout:8/452: rename dc/d16/d18/d29/d32 to dc/d70/d8f/d93 0 2024-08-19T00:56:04.584 INFO:tasks.workunit.client.1.smithi086.stdout:3/458: sync 2024-08-19T00:56:04.587 INFO:tasks.workunit.client.1.smithi086.stdout:6/438: rename db/d37/d44/c60 to db/d8e/c91 0 2024-08-19T00:56:04.588 INFO:tasks.workunit.client.1.smithi086.stdout:1/503: link d4/d7/d2a/d36/d63/c8b d4/d10/d75/d7a/ca9 0 2024-08-19T00:56:04.588 INFO:tasks.workunit.client.1.smithi086.stdout:6/439: dread db/d37/d30/f72 [0,4194304] 0 2024-08-19T00:56:04.588 INFO:tasks.workunit.client.1.smithi086.stdout:1/504: write d4/f6 [2313357,58928] 0 2024-08-19T00:56:04.589 INFO:tasks.workunit.client.0.smithi017.stdout:2/132: dwrite d2/d7/d10/d19/f20 [0,4194304] 0 2024-08-19T00:56:04.589 INFO:tasks.workunit.client.0.smithi017.stdout:3/158: dread d5/d15/d1b/f20 [0,4194304] 0 2024-08-19T00:56:04.589 INFO:tasks.workunit.client.1.smithi086.stdout:4/421: mkdir d2/d18/d33/d42/d72/d78/d25/d6b/d81/d8c 0 2024-08-19T00:56:04.593 INFO:tasks.workunit.client.0.smithi017.stdout:3/159: creat d5/d11/f2f x:0 0 0 2024-08-19T00:56:04.595 INFO:tasks.workunit.client.1.smithi086.stdout:3/459: dwrite d3/d18/f2c [0,4194304] 0 2024-08-19T00:56:04.596 INFO:tasks.workunit.client.0.smithi017.stdout:2/133: rename d2/d7/d10/d19/f24 to d2/d7/f28 0 2024-08-19T00:56:04.596 INFO:tasks.workunit.client.0.smithi017.stdout:2/134: chown d2/d7/l16 66 1 2024-08-19T00:56:04.603 INFO:tasks.workunit.client.1.smithi086.stdout:3/460: creat d3/d26/d2b/f9f x:0 0 0 2024-08-19T00:56:04.605 INFO:tasks.workunit.client.1.smithi086.stdout:2/407: truncate d8/d14/f72 3523599 0 2024-08-19T00:56:04.606 INFO:tasks.workunit.client.0.smithi017.stdout:3/160: link d5/d15/d1b/c1f d5/da/c30 0 2024-08-19T00:56:04.607 INFO:tasks.workunit.client.1.smithi086.stdout:3/461: creat d3/d18/d19/d37/d5a/fa0 x:0 0 0 2024-08-19T00:56:04.608 INFO:tasks.workunit.client.1.smithi086.stdout:2/408: readlink d8/l2d 0 2024-08-19T00:56:04.608 INFO:tasks.workunit.client.0.smithi017.stdout:3/161: symlink d5/da/d27/l31 0 2024-08-19T00:56:04.609 INFO:tasks.workunit.client.1.smithi086.stdout:1/505: dread d4/f6 [0,4194304] 0 2024-08-19T00:56:04.610 INFO:tasks.workunit.client.1.smithi086.stdout:1/506: fdatasync d4/d7/d2a/d36/d50/f62 0 2024-08-19T00:56:04.610 INFO:tasks.workunit.client.0.smithi017.stdout:3/162: mkdir d5/d32 0 2024-08-19T00:56:04.611 INFO:tasks.workunit.client.1.smithi086.stdout:4/422: dread d2/d18/d33/d42/d72/d78/f89 [0,4194304] 0 2024-08-19T00:56:04.615 INFO:tasks.workunit.client.1.smithi086.stdout:1/507: dread d4/d1e/f48 [0,4194304] 0 2024-08-19T00:56:04.615 INFO:tasks.workunit.client.0.smithi017.stdout:3/163: link d5/d11/f16 d5/d11/f33 0 2024-08-19T00:56:04.616 INFO:tasks.workunit.client.1.smithi086.stdout:4/423: rmdir d2/d18/d33/d42/d72/d78/d25/d6b/d81/d8c 0 2024-08-19T00:56:04.616 INFO:tasks.workunit.client.1.smithi086.stdout:1/508: truncate d4/d1e/f11 9260424 0 2024-08-19T00:56:04.621 INFO:tasks.workunit.client.1.smithi086.stdout:1/509: creat d4/d10/d90/d98/faa x:0 0 0 2024-08-19T00:56:04.625 INFO:tasks.workunit.client.1.smithi086.stdout:2/409: truncate d8/f36 1367186 0 2024-08-19T00:56:04.626 INFO:tasks.workunit.client.1.smithi086.stdout:1/510: dread d4/d7/d2a/d36/f6a [0,4194304] 0 2024-08-19T00:56:04.627 INFO:tasks.workunit.client.0.smithi017.stdout:3/164: getdents d5/d11 0 2024-08-19T00:56:04.628 INFO:tasks.workunit.client.1.smithi086.stdout:2/410: fdatasync d8/d2c/d38/f42 0 2024-08-19T00:56:04.629 INFO:tasks.workunit.client.1.smithi086.stdout:6/440: dwrite db/d37/d41/f83 [4194304,4194304] 0 2024-08-19T00:56:04.629 INFO:tasks.workunit.client.0.smithi017.stdout:3/165: rename d5/d11/f25 to d5/d11/f34 0 2024-08-19T00:56:04.629 INFO:tasks.workunit.client.1.smithi086.stdout:4/424: write d2/d18/d33/d42/d72/d78/f3c [722407,118670] 0 2024-08-19T00:56:04.630 INFO:tasks.workunit.client.1.smithi086.stdout:6/441: chown db/d37/d28/d57/f8b 10053290 1 2024-08-19T00:56:04.632 INFO:tasks.workunit.client.1.smithi086.stdout:4/425: dread - d2/d18/d33/d42/d72/d78/f87 zero size 2024-08-19T00:56:04.632 INFO:tasks.workunit.client.1.smithi086.stdout:2/411: creat d8/d43/f86 x:0 0 0 2024-08-19T00:56:04.633 INFO:tasks.workunit.client.0.smithi017.stdout:3/166: rmdir d5/da 39 2024-08-19T00:56:04.636 INFO:tasks.workunit.client.1.smithi086.stdout:6/442: unlink db/d34/d4e/d55/f32 0 2024-08-19T00:56:04.637 INFO:tasks.workunit.client.1.smithi086.stdout:6/443: write db/d37/d30/f85 [913097,92824] 0 2024-08-19T00:56:04.639 INFO:tasks.workunit.client.0.smithi017.stdout:3/167: chown d5/d15/l22 13 1 2024-08-19T00:56:04.640 INFO:tasks.workunit.client.0.smithi017.stdout:3/168: truncate d5/d11/f2f 800918 0 2024-08-19T00:56:04.641 INFO:tasks.workunit.client.1.smithi086.stdout:1/511: link d4/d7/d2a/d36/d3a/d41/c44 d4/d7/d2a/d36/d7d/cab 0 2024-08-19T00:56:04.642 INFO:tasks.workunit.client.1.smithi086.stdout:2/412: mknod d8/c87 0 2024-08-19T00:56:04.644 INFO:tasks.workunit.client.1.smithi086.stdout:1/512: creat d4/d7/d2a/d36/d7d/d88/fac x:0 0 0 2024-08-19T00:56:04.646 INFO:tasks.workunit.client.1.smithi086.stdout:6/444: write db/d37/d30/f72 [590179,40994] 0 2024-08-19T00:56:04.646 INFO:tasks.workunit.client.0.smithi017.stdout:3/169: write d5/da/f2b [1029535,19470] 0 2024-08-19T00:56:04.647 INFO:tasks.workunit.client.1.smithi086.stdout:1/513: creat d4/d7/d2a/d6e/fad x:0 0 0 2024-08-19T00:56:04.648 INFO:tasks.workunit.client.1.smithi086.stdout:1/514: chown d4/d7/d2a/d36/d50/f9d 215911525 1 2024-08-19T00:56:04.649 INFO:tasks.workunit.client.1.smithi086.stdout:6/445: creat db/d37/d44/d5a/d78/f92 x:0 0 0 2024-08-19T00:56:04.649 INFO:tasks.workunit.client.1.smithi086.stdout:2/413: creat d8/d14/f88 x:0 0 0 2024-08-19T00:56:04.650 INFO:tasks.workunit.client.1.smithi086.stdout:2/414: write d8/d2c/d38/f45 [38814,119946] 0 2024-08-19T00:56:04.651 INFO:tasks.workunit.client.0.smithi017.stdout:3/170: link c4 d5/da/d27/c35 0 2024-08-19T00:56:04.651 INFO:tasks.workunit.client.1.smithi086.stdout:1/515: creat d4/d10/fae x:0 0 0 2024-08-19T00:56:04.651 INFO:tasks.workunit.client.1.smithi086.stdout:6/446: truncate db/d34/d4e/d68/f84 898746 0 2024-08-19T00:56:04.653 INFO:tasks.workunit.client.1.smithi086.stdout:2/415: mknod d8/d2c/d38/d80/c89 0 2024-08-19T00:56:04.654 INFO:tasks.workunit.client.1.smithi086.stdout:1/516: symlink d4/d1e/laf 0 2024-08-19T00:56:04.655 INFO:tasks.workunit.client.1.smithi086.stdout:6/447: rename db/d37/d28/c29 to db/d34/d4e/d68/d89/c93 0 2024-08-19T00:56:04.655 INFO:tasks.workunit.client.0.smithi017.stdout:3/171: dread d5/d15/f21 [0,4194304] 0 2024-08-19T00:56:04.656 INFO:tasks.workunit.client.1.smithi086.stdout:6/448: dread - db/d34/d39/f67 zero size 2024-08-19T00:56:04.656 INFO:tasks.workunit.client.1.smithi086.stdout:2/416: symlink d8/d24/d32/d4d/l8a 0 2024-08-19T00:56:04.657 INFO:tasks.workunit.client.0.smithi017.stdout:3/172: fdatasync d5/d15/f21 0 2024-08-19T00:56:04.657 INFO:tasks.workunit.client.1.smithi086.stdout:1/517: symlink d4/d7/d2a/d36/d61/lb0 0 2024-08-19T00:56:04.658 INFO:tasks.workunit.client.0.smithi017.stdout:3/173: dread - d5/d11/f2a zero size 2024-08-19T00:56:04.658 INFO:tasks.workunit.client.1.smithi086.stdout:1/518: write d4/d1e/f13 [404421,1559] 0 2024-08-19T00:56:04.660 INFO:tasks.workunit.client.1.smithi086.stdout:1/519: fsync d4/d7/d2a/d36/d50/f66 0 2024-08-19T00:56:04.660 INFO:tasks.workunit.client.1.smithi086.stdout:6/449: unlink db/d37/d28/d57/f8b 0 2024-08-19T00:56:04.661 INFO:tasks.workunit.client.0.smithi017.stdout:3/174: dread d5/d11/f1e [4194304,4194304] 0 2024-08-19T00:56:04.662 INFO:tasks.workunit.client.1.smithi086.stdout:2/417: dwrite d8/d84/f81 [4194304,4194304] 0 2024-08-19T00:56:04.663 INFO:tasks.workunit.client.1.smithi086.stdout:2/418: write d8/d14/f55 [1145091,127784] 0 2024-08-19T00:56:04.665 INFO:tasks.workunit.client.1.smithi086.stdout:6/450: creat db/d34/d69/f94 x:0 0 0 2024-08-19T00:56:04.672 INFO:tasks.workunit.client.0.smithi017.stdout:3/175: write d5/d15/f21 [3181100,29444] 0 2024-08-19T00:56:04.672 INFO:tasks.workunit.client.1.smithi086.stdout:2/419: getdents d8/d24/d32/d61 0 2024-08-19T00:56:04.676 INFO:tasks.workunit.client.0.smithi017.stdout:3/176: rename d5/d15/c2e to d5/d18/c36 0 2024-08-19T00:56:04.677 INFO:tasks.workunit.client.1.smithi086.stdout:1/520: dread d4/d1e/f11 [4194304,4194304] 0 2024-08-19T00:56:04.677 INFO:tasks.workunit.client.0.smithi017.stdout:3/177: stat d5/da/f23 0 2024-08-19T00:56:04.678 INFO:tasks.workunit.client.0.smithi017.stdout:3/178: read d5/ff [6314286,4547] 0 2024-08-19T00:56:04.679 INFO:tasks.workunit.client.1.smithi086.stdout:2/420: dwrite d8/d14/f2f [4194304,4194304] 0 2024-08-19T00:56:04.679 INFO:tasks.workunit.client.0.smithi017.stdout:3/179: chown f2 254 1 2024-08-19T00:56:04.680 INFO:tasks.workunit.client.0.smithi017.stdout:3/180: dread - d5/da/d27/f2c zero size 2024-08-19T00:56:04.683 INFO:tasks.workunit.client.0.smithi017.stdout:1/63: sync 2024-08-19T00:56:04.685 INFO:tasks.workunit.client.1.smithi086.stdout:0/456: sync 2024-08-19T00:56:04.685 INFO:tasks.workunit.client.1.smithi086.stdout:2/421: unlink d8/d2c/c66 0 2024-08-19T00:56:04.685 INFO:tasks.workunit.client.1.smithi086.stdout:6/451: write db/d37/d41/f6b [550308,62197] 0 2024-08-19T00:56:04.687 INFO:tasks.workunit.client.1.smithi086.stdout:6/452: fdatasync db/d34/d69/f94 0 2024-08-19T00:56:04.688 INFO:tasks.workunit.client.0.smithi017.stdout:3/181: creat d5/da/d27/d28/f37 x:0 0 0 2024-08-19T00:56:04.689 INFO:tasks.workunit.client.0.smithi017.stdout:1/64: dread d4/ff [4194304,4194304] 0 2024-08-19T00:56:04.691 INFO:tasks.workunit.client.1.smithi086.stdout:0/457: rmdir da 39 2024-08-19T00:56:04.693 INFO:tasks.workunit.client.0.smithi017.stdout:3/182: mknod d5/da/d27/d28/c38 0 2024-08-19T00:56:04.694 INFO:tasks.workunit.client.1.smithi086.stdout:1/521: dread d4/d10/f5a [0,4194304] 0 2024-08-19T00:56:04.699 INFO:tasks.workunit.client.1.smithi086.stdout:0/458: creat da/d14/f99 x:0 0 0 2024-08-19T00:56:04.700 INFO:tasks.workunit.client.1.smithi086.stdout:1/522: creat d4/d7/d2a/d36/d63/d84/d8e/fb1 x:0 0 0 2024-08-19T00:56:04.700 INFO:tasks.workunit.client.1.smithi086.stdout:0/459: fsync da/f36 0 2024-08-19T00:56:04.702 INFO:tasks.workunit.client.1.smithi086.stdout:1/523: rmdir d4/d7/d2a/d36/d3a/d41 39 2024-08-19T00:56:04.703 INFO:tasks.workunit.client.0.smithi017.stdout:1/65: dwrite d4/ff [4194304,4194304] 0 2024-08-19T00:56:04.703 INFO:tasks.workunit.client.0.smithi017.stdout:3/183: dread d5/ff [4194304,4194304] 0 2024-08-19T00:56:04.704 INFO:tasks.workunit.client.0.smithi017.stdout:1/66: chown d4/f9 517 1 2024-08-19T00:56:04.704 INFO:tasks.workunit.client.0.smithi017.stdout:1/67: fdatasync d4/f9 0 2024-08-19T00:56:04.705 INFO:tasks.workunit.client.1.smithi086.stdout:0/460: rmdir da/d14/d55 39 2024-08-19T00:56:04.707 INFO:tasks.workunit.client.1.smithi086.stdout:0/461: write da/d14/f1b [3070278,14745] 0 2024-08-19T00:56:04.708 INFO:tasks.workunit.client.1.smithi086.stdout:2/422: dread d8/d24/f26 [0,4194304] 0 2024-08-19T00:56:04.709 INFO:tasks.workunit.client.1.smithi086.stdout:6/453: dread db/f11 [0,4194304] 0 2024-08-19T00:56:04.711 INFO:tasks.workunit.client.1.smithi086.stdout:1/524: dread d4/f40 [0,4194304] 0 2024-08-19T00:56:04.711 INFO:tasks.workunit.client.1.smithi086.stdout:2/423: dread d8/d2c/d38/f45 [0,4194304] 0 2024-08-19T00:56:04.713 INFO:tasks.workunit.client.0.smithi017.stdout:1/68: link d4/fd d4/f10 0 2024-08-19T00:56:04.714 INFO:tasks.workunit.client.1.smithi086.stdout:6/454: mknod db/d37/d28/c95 0 2024-08-19T00:56:04.715 INFO:tasks.workunit.client.1.smithi086.stdout:0/462: symlink da/d14/d55/l9a 0 2024-08-19T00:56:04.717 INFO:tasks.workunit.client.0.smithi017.stdout:3/184: getdents d5/da 0 2024-08-19T00:56:04.718 INFO:tasks.workunit.client.0.smithi017.stdout:1/69: link d4/f9 d4/dc/f11 0 2024-08-19T00:56:04.720 INFO:tasks.workunit.client.0.smithi017.stdout:3/185: truncate f2 3888073 0 2024-08-19T00:56:04.720 INFO:tasks.workunit.client.1.smithi086.stdout:6/455: dwrite db/d37/f27 [0,4194304] 0 2024-08-19T00:56:04.721 INFO:tasks.workunit.client.0.smithi017.stdout:3/186: write d5/d11/f2f [962456,66205] 0 2024-08-19T00:56:04.721 INFO:tasks.workunit.client.1.smithi086.stdout:6/456: readlink db/d34/d39/d76/l86 0 2024-08-19T00:56:04.723 INFO:tasks.workunit.client.0.smithi017.stdout:3/187: rmdir d5/d15/d1b 39 2024-08-19T00:56:04.723 INFO:tasks.workunit.client.0.smithi017.stdout:1/70: dread d4/f9 [0,4194304] 0 2024-08-19T00:56:04.724 INFO:tasks.workunit.client.1.smithi086.stdout:6/457: read - db/d34/d39/d76/f7b zero size 2024-08-19T00:56:04.725 INFO:tasks.workunit.client.1.smithi086.stdout:0/463: dwrite da/d14/d1a/f54 [4194304,4194304] 0 2024-08-19T00:56:04.726 INFO:tasks.workunit.client.0.smithi017.stdout:3/188: unlink d5/d11/f1e 0 2024-08-19T00:56:04.726 INFO:tasks.workunit.client.1.smithi086.stdout:6/458: write db/d37/d44/d5a/f5f [1325684,25436] 0 2024-08-19T00:56:04.727 INFO:tasks.workunit.client.0.smithi017.stdout:1/71: write d4/f9 [3751840,14864] 0 2024-08-19T00:56:04.731 INFO:tasks.workunit.client.0.smithi017.stdout:1/72: mknod d4/c12 0 2024-08-19T00:56:04.733 INFO:tasks.workunit.client.1.smithi086.stdout:0/464: mknod da/d14/d44/c9b 0 2024-08-19T00:56:04.735 INFO:tasks.workunit.client.1.smithi086.stdout:6/459: unlink db/d34/d4e/d55/c3d 0 2024-08-19T00:56:04.736 INFO:tasks.workunit.client.0.smithi017.stdout:1/73: dread d4/f10 [0,4194304] 0 2024-08-19T00:56:04.736 INFO:tasks.workunit.client.0.smithi017.stdout:1/74: stat l1 0 2024-08-19T00:56:04.738 INFO:tasks.workunit.client.1.smithi086.stdout:6/460: mkdir db/d37/d28/d7f/d96 0 2024-08-19T00:56:04.738 INFO:tasks.workunit.client.1.smithi086.stdout:6/461: chown db/d37/d30/f3a 222024 1 2024-08-19T00:56:04.739 INFO:tasks.workunit.client.0.smithi017.stdout:1/75: dread d4/fd [0,4194304] 0 2024-08-19T00:56:04.741 INFO:tasks.workunit.client.1.smithi086.stdout:0/465: creat da/d14/d1a/d2e/d30/d76/f9c x:0 0 0 2024-08-19T00:56:04.743 INFO:tasks.workunit.client.0.smithi017.stdout:1/76: creat d4/f13 x:0 0 0 2024-08-19T00:56:04.743 INFO:tasks.workunit.client.1.smithi086.stdout:6/462: dread db/d37/d41/f6b [0,4194304] 0 2024-08-19T00:56:04.747 INFO:tasks.workunit.client.1.smithi086.stdout:1/525: truncate d4/d7/d2a/d36/f45 2188585 0 2024-08-19T00:56:04.747 INFO:tasks.workunit.client.0.smithi017.stdout:1/77: dread d4/ff [4194304,4194304] 0 2024-08-19T00:56:04.749 INFO:tasks.workunit.client.1.smithi086.stdout:6/463: dwrite f8 [4194304,4194304] 0 2024-08-19T00:56:04.750 INFO:tasks.workunit.client.1.smithi086.stdout:2/424: dwrite d8/d14/f72 [0,4194304] 0 2024-08-19T00:56:04.752 INFO:tasks.workunit.client.0.smithi017.stdout:3/189: write d5/ff [2257754,60949] 0 2024-08-19T00:56:04.754 INFO:tasks.workunit.client.1.smithi086.stdout:6/464: creat db/d34/d4e/d55/f97 x:0 0 0 2024-08-19T00:56:04.756 INFO:tasks.workunit.client.0.smithi017.stdout:1/78: dwrite d4/ff [0,4194304] 0 2024-08-19T00:56:04.759 INFO:tasks.workunit.client.1.smithi086.stdout:2/425: dwrite d8/d43/f86 [0,4194304] 0 2024-08-19T00:56:04.759 INFO:tasks.workunit.client.1.smithi086.stdout:1/526: getdents d4/d7/d2a/d36 0 2024-08-19T00:56:04.759 INFO:tasks.workunit.client.0.smithi017.stdout:3/190: fdatasync d5/ff 0 2024-08-19T00:56:04.763 INFO:tasks.workunit.client.1.smithi086.stdout:6/465: mknod db/c98 0 2024-08-19T00:56:04.767 INFO:tasks.workunit.client.0.smithi017.stdout:3/191: creat d5/d15/d1b/f39 x:0 0 0 2024-08-19T00:56:04.768 INFO:tasks.workunit.client.0.smithi017.stdout:3/192: chown d5/d11/f16 339635615 1 2024-08-19T00:56:04.769 INFO:tasks.workunit.client.1.smithi086.stdout:6/466: mkdir db/d34/d4e/d68/d99 0 2024-08-19T00:56:04.770 INFO:tasks.workunit.client.0.smithi017.stdout:3/193: fdatasync d5/da/d27/d28/f37 0 2024-08-19T00:56:04.770 INFO:tasks.workunit.client.0.smithi017.stdout:3/194: readlink d5/d15/l22 0 2024-08-19T00:56:04.770 INFO:tasks.workunit.client.1.smithi086.stdout:2/426: mkdir d8/d8b 0 2024-08-19T00:56:04.771 INFO:tasks.workunit.client.1.smithi086.stdout:6/467: write db/d34/d4e/d68/f77 [930060,61187] 0 2024-08-19T00:56:04.772 INFO:tasks.workunit.client.1.smithi086.stdout:2/427: fdatasync d8/d14/f25 0 2024-08-19T00:56:04.774 INFO:tasks.workunit.client.1.smithi086.stdout:6/468: creat db/d34/f9a x:0 0 0 2024-08-19T00:56:04.774 INFO:tasks.workunit.client.1.smithi086.stdout:6/469: chown db/d34/d4e/d68/c7c 1384139507 1 2024-08-19T00:56:04.776 INFO:tasks.workunit.client.1.smithi086.stdout:6/470: write db/d37/d44/d5a/f63 [662085,54974] 0 2024-08-19T00:56:04.776 INFO:tasks.workunit.client.1.smithi086.stdout:2/428: link d8/f1a d8/d24/f8c 0 2024-08-19T00:56:04.777 INFO:tasks.workunit.client.1.smithi086.stdout:2/429: readlink d8/l39 0 2024-08-19T00:56:04.777 INFO:tasks.workunit.client.1.smithi086.stdout:2/430: chown d8/d2c/d47 13025753 1 2024-08-19T00:56:04.778 INFO:tasks.workunit.client.1.smithi086.stdout:6/471: rmdir db/d34/d4e/d68/d89 39 2024-08-19T00:56:04.778 INFO:tasks.workunit.client.1.smithi086.stdout:2/431: rename d8/d8b to d8/d8b/d8d 22 2024-08-19T00:56:04.779 INFO:tasks.workunit.client.1.smithi086.stdout:6/472: readlink db/l6e 0 2024-08-19T00:56:04.779 INFO:tasks.workunit.client.1.smithi086.stdout:6/473: stat db/f11 0 2024-08-19T00:56:04.780 INFO:tasks.workunit.client.1.smithi086.stdout:2/432: mknod d8/d84/c8e 0 2024-08-19T00:56:04.784 INFO:tasks.workunit.client.1.smithi086.stdout:6/474: mknod db/c9b 0 2024-08-19T00:56:04.787 INFO:tasks.workunit.client.1.smithi086.stdout:6/475: write db/f56 [22201,44980] 0 2024-08-19T00:56:04.787 INFO:tasks.workunit.client.1.smithi086.stdout:2/433: dwrite d8/d14/f2f [4194304,4194304] 0 2024-08-19T00:56:04.787 INFO:tasks.workunit.client.1.smithi086.stdout:1/527: dread d4/d7/d2a/d36/d3a/f43 [0,4194304] 0 2024-08-19T00:56:04.788 INFO:tasks.workunit.client.0.smithi017.stdout:3/195: truncate d5/da/fd 3724404 0 2024-08-19T00:56:04.789 INFO:tasks.workunit.client.1.smithi086.stdout:2/434: readlink d8/d43/l52 0 2024-08-19T00:56:04.790 INFO:tasks.workunit.client.0.smithi017.stdout:1/79: dwrite d4/f10 [0,4194304] 0 2024-08-19T00:56:04.791 INFO:tasks.workunit.client.1.smithi086.stdout:0/466: dwrite da/d14/d1a/d2e/d30/f50 [0,4194304] 0 2024-08-19T00:56:04.792 INFO:tasks.workunit.client.0.smithi017.stdout:1/80: write d4/dc/f11 [2882038,31286] 0 2024-08-19T00:56:04.796 INFO:tasks.workunit.client.1.smithi086.stdout:5/435: sync 2024-08-19T00:56:04.799 INFO:tasks.workunit.client.1.smithi086.stdout:1/528: rmdir d4/d7/d2a/d36/d3a 39 2024-08-19T00:56:04.800 INFO:tasks.workunit.client.0.smithi017.stdout:1/81: creat d4/f14 x:0 0 0 2024-08-19T00:56:04.804 INFO:tasks.workunit.client.1.smithi086.stdout:5/436: dwrite d0/df/d1f/f28 [0,4194304] 0 2024-08-19T00:56:04.812 INFO:tasks.workunit.client.1.smithi086.stdout:6/476: truncate db/d37/d41/f6b 843355 0 2024-08-19T00:56:04.813 INFO:tasks.workunit.client.1.smithi086.stdout:5/437: dwrite d0/d20/f3c [4194304,4194304] 0 2024-08-19T00:56:04.815 INFO:tasks.workunit.client.1.smithi086.stdout:1/529: getdents d4/d7/d2a/d36/d50 0 2024-08-19T00:56:04.815 INFO:tasks.workunit.client.1.smithi086.stdout:6/477: read f3 [3732113,53948] 0 2024-08-19T00:56:04.816 INFO:tasks.workunit.client.1.smithi086.stdout:1/530: fdatasync d4/d7/d2a/f2b 0 2024-08-19T00:56:04.817 INFO:tasks.workunit.client.1.smithi086.stdout:6/478: write db/d34/d69/f94 [670823,10522] 0 2024-08-19T00:56:04.819 INFO:tasks.workunit.client.1.smithi086.stdout:5/438: rename d0/d5f/d60/d57/f67 to d0/d5f/d60/f83 0 2024-08-19T00:56:04.820 INFO:tasks.workunit.client.1.smithi086.stdout:2/435: dread d8/d24/f8c [0,4194304] 0 2024-08-19T00:56:04.821 INFO:tasks.workunit.client.1.smithi086.stdout:2/436: chown d8/f12 384 1 2024-08-19T00:56:04.824 INFO:tasks.workunit.client.0.smithi017.stdout:1/82: truncate d4/fd 2735520 0 2024-08-19T00:56:04.824 INFO:tasks.workunit.client.1.smithi086.stdout:1/531: dwrite d4/d1e/f13 [0,4194304] 0 2024-08-19T00:56:04.825 INFO:tasks.workunit.client.1.smithi086.stdout:6/479: write db/f3e [1093574,123211] 0 2024-08-19T00:56:04.826 INFO:tasks.workunit.client.1.smithi086.stdout:2/437: symlink d8/d24/l8f 0 2024-08-19T00:56:04.828 INFO:tasks.workunit.client.0.smithi017.stdout:1/83: mknod d4/dc/c15 0 2024-08-19T00:56:04.828 INFO:tasks.workunit.client.1.smithi086.stdout:5/439: link d0/df/d1f/d33/f34 d0/d5f/d60/d57/f84 0 2024-08-19T00:56:04.829 INFO:tasks.workunit.client.0.smithi017.stdout:1/84: dread - d4/f14 zero size 2024-08-19T00:56:04.830 INFO:tasks.workunit.client.0.smithi017.stdout:1/85: write d4/f9 [4566165,103956] 0 2024-08-19T00:56:04.835 INFO:tasks.workunit.client.0.smithi017.stdout:1/86: creat d4/dc/f16 x:0 0 0 2024-08-19T00:56:04.837 INFO:tasks.workunit.client.1.smithi086.stdout:1/532: fdatasync d4/d7/d2a/d36/d3a/d41/f4b 0 2024-08-19T00:56:04.837 INFO:tasks.workunit.client.0.smithi017.stdout:1/87: mkdir d4/dc/d17 0 2024-08-19T00:56:04.839 INFO:tasks.workunit.client.0.smithi017.stdout:1/88: creat d4/dc/f18 x:0 0 0 2024-08-19T00:56:04.839 INFO:tasks.workunit.client.0.smithi017.stdout:1/89: readlink l1 0 2024-08-19T00:56:04.840 INFO:tasks.workunit.client.1.smithi086.stdout:1/533: symlink d4/d10/d90/d98/lb2 0 2024-08-19T00:56:04.841 INFO:tasks.workunit.client.0.smithi017.stdout:1/90: mkdir d4/dc/d19 0 2024-08-19T00:56:04.842 INFO:tasks.workunit.client.1.smithi086.stdout:1/534: read d4/d1e/d6f/f97 [3404894,81736] 0 2024-08-19T00:56:04.843 INFO:tasks.workunit.client.1.smithi086.stdout:2/438: dread d8/d24/f2b [0,4194304] 0 2024-08-19T00:56:04.845 INFO:tasks.workunit.client.0.smithi017.stdout:1/91: rename d4/f9 to d4/f1a 0 2024-08-19T00:56:04.851 INFO:tasks.workunit.client.1.smithi086.stdout:5/440: dread d0/d8/d10/f19 [0,4194304] 0 2024-08-19T00:56:04.851 INFO:tasks.workunit.client.1.smithi086.stdout:5/441: stat d0/d5f/d60 0 2024-08-19T00:56:04.852 INFO:tasks.workunit.client.1.smithi086.stdout:5/442: chown d0/d8/d10/l1c 5779 1 2024-08-19T00:56:04.852 INFO:tasks.workunit.client.1.smithi086.stdout:1/535: creat d4/fb3 x:0 0 0 2024-08-19T00:56:04.854 INFO:tasks.workunit.client.0.smithi017.stdout:1/92: dwrite d4/f10 [0,4194304] 0 2024-08-19T00:56:04.855 INFO:tasks.workunit.client.1.smithi086.stdout:2/439: rmdir d8/d8b 0 2024-08-19T00:56:04.855 INFO:tasks.workunit.client.1.smithi086.stdout:2/440: dread - d8/d2c/d47/f7a zero size 2024-08-19T00:56:04.856 INFO:tasks.workunit.client.1.smithi086.stdout:5/443: chown d0/d8/c63 698 1 2024-08-19T00:56:04.860 INFO:tasks.workunit.client.1.smithi086.stdout:5/444: unlink d0/df/f3f 0 2024-08-19T00:56:04.863 INFO:tasks.workunit.client.1.smithi086.stdout:6/480: dread db/d37/d44/d5a/f5f [0,4194304] 0 2024-08-19T00:56:04.864 INFO:tasks.workunit.client.0.smithi017.stdout:1/93: link d4/l8 d4/dc/l1b 0 2024-08-19T00:56:04.864 INFO:tasks.workunit.client.1.smithi086.stdout:6/481: truncate db/d37/d44/f80 642461 0 2024-08-19T00:56:04.868 INFO:tasks.workunit.client.1.smithi086.stdout:6/482: creat db/d37/d28/d7f/f9c x:0 0 0 2024-08-19T00:56:04.869 INFO:tasks.workunit.client.1.smithi086.stdout:1/536: dread d4/d7/d2a/d36/f45 [0,4194304] 0 2024-08-19T00:56:04.871 INFO:tasks.workunit.client.0.smithi017.stdout:1/94: dwrite d4/f13 [0,4194304] 0 2024-08-19T00:56:04.874 INFO:tasks.workunit.client.0.smithi017.stdout:1/95: mkdir d4/d1c 0 2024-08-19T00:56:04.875 INFO:tasks.workunit.client.1.smithi086.stdout:2/441: truncate d8/d2c/d38/f53 3951445 0 2024-08-19T00:56:04.876 INFO:tasks.workunit.client.1.smithi086.stdout:1/537: chown d4/d7/d2a/d36/d63/c8b 166841481 1 2024-08-19T00:56:04.876 INFO:tasks.workunit.client.0.smithi017.stdout:1/96: write d4/f13 [4013311,69236] 0 2024-08-19T00:56:04.877 INFO:tasks.workunit.client.1.smithi086.stdout:1/538: readlink d4/d10/l2d 0 2024-08-19T00:56:04.877 INFO:tasks.workunit.client.1.smithi086.stdout:7/482: sync 2024-08-19T00:56:04.877 INFO:tasks.workunit.client.1.smithi086.stdout:6/483: rename c5 to db/c9d 0 2024-08-19T00:56:04.878 INFO:tasks.workunit.client.1.smithi086.stdout:1/539: read d4/d7/d2a/f4d [98205,34521] 0 2024-08-19T00:56:04.879 INFO:tasks.workunit.client.0.smithi017.stdout:1/97: mkdir d4/dc/d17/d1d 0 2024-08-19T00:56:04.880 INFO:tasks.workunit.client.0.smithi017.stdout:1/98: write d4/fd [3570723,85811] 0 2024-08-19T00:56:04.880 INFO:tasks.workunit.client.1.smithi086.stdout:5/445: dread d0/d2d/f32 [0,4194304] 0 2024-08-19T00:56:04.880 INFO:tasks.workunit.client.1.smithi086.stdout:6/484: chown db/f16 79 1 2024-08-19T00:56:04.885 INFO:tasks.workunit.client.1.smithi086.stdout:2/442: rename d8/d24/l34 to d8/d2c/d67/l90 0 2024-08-19T00:56:04.886 INFO:tasks.workunit.client.1.smithi086.stdout:1/540: mkdir d4/d10/d75/d7a/db4 0 2024-08-19T00:56:04.887 INFO:tasks.workunit.client.1.smithi086.stdout:6/485: dwrite db/d37/d30/f72 [0,4194304] 0 2024-08-19T00:56:04.888 INFO:tasks.workunit.client.1.smithi086.stdout:2/443: truncate d8/d14/f2f 8495954 0 2024-08-19T00:56:04.888 INFO:tasks.workunit.client.1.smithi086.stdout:5/446: unlink d0/d20/f25 0 2024-08-19T00:56:04.889 INFO:tasks.workunit.client.0.smithi017.stdout:1/99: link d4/f10 d4/dc/d17/d1d/f1e 0 2024-08-19T00:56:04.889 INFO:tasks.workunit.client.1.smithi086.stdout:5/447: write d0/f29 [3883359,22597] 0 2024-08-19T00:56:04.894 INFO:tasks.workunit.client.1.smithi086.stdout:2/444: dread d8/f1d [4194304,4194304] 0 2024-08-19T00:56:04.895 INFO:tasks.workunit.client.0.smithi017.stdout:1/100: mkdir d4/d1c/d1f 0 2024-08-19T00:56:04.896 INFO:tasks.workunit.client.0.smithi017.stdout:1/101: chown d4/dc/f16 4 1 2024-08-19T00:56:04.897 INFO:tasks.workunit.client.1.smithi086.stdout:5/448: dwrite d0/d20/f3c [4194304,4194304] 0 2024-08-19T00:56:04.897 INFO:tasks.workunit.client.0.smithi017.stdout:1/102: write d4/dc/f18 [191377,41407] 0 2024-08-19T00:56:04.898 INFO:tasks.workunit.client.0.smithi017.stdout:1/103: chown d4/dc/f16 2313 1 2024-08-19T00:56:04.899 INFO:tasks.workunit.client.1.smithi086.stdout:1/541: truncate d4/d7/d2a/d36/d3a/f72 2534111 0 2024-08-19T00:56:04.900 INFO:tasks.workunit.client.1.smithi086.stdout:2/445: symlink d8/d84/l91 0 2024-08-19T00:56:04.903 INFO:tasks.workunit.client.1.smithi086.stdout:5/449: creat d0/df/d1f/f85 x:0 0 0 2024-08-19T00:56:04.903 INFO:tasks.workunit.client.0.smithi017.stdout:1/104: dread d4/f13 [0,4194304] 0 2024-08-19T00:56:04.904 INFO:tasks.workunit.client.1.smithi086.stdout:7/483: getdents d3/d5b 0 2024-08-19T00:56:04.905 INFO:tasks.workunit.client.1.smithi086.stdout:6/486: creat db/d37/f9e x:0 0 0 2024-08-19T00:56:04.907 INFO:tasks.workunit.client.1.smithi086.stdout:5/450: dread d0/d8/d10/f19 [0,4194304] 0 2024-08-19T00:56:04.908 INFO:tasks.workunit.client.1.smithi086.stdout:7/484: creat d3/d34/d44/d58/d4b/d78/f94 x:0 0 0 2024-08-19T00:56:04.908 INFO:tasks.workunit.client.1.smithi086.stdout:2/446: mknod d8/d84/d79/c92 0 2024-08-19T00:56:04.910 INFO:tasks.workunit.client.1.smithi086.stdout:7/485: fsync d3/de/d68/d7a/f8e 0 2024-08-19T00:56:04.911 INFO:tasks.workunit.client.1.smithi086.stdout:6/487: creat db/d34/d39/f9f x:0 0 0 2024-08-19T00:56:04.912 INFO:tasks.workunit.client.1.smithi086.stdout:9/468: sync 2024-08-19T00:56:04.912 INFO:tasks.workunit.client.1.smithi086.stdout:4/426: sync 2024-08-19T00:56:04.912 INFO:tasks.workunit.client.1.smithi086.stdout:8/453: sync 2024-08-19T00:56:04.912 INFO:tasks.workunit.client.1.smithi086.stdout:0/467: sync 2024-08-19T00:56:04.912 INFO:tasks.workunit.client.1.smithi086.stdout:3/462: sync 2024-08-19T00:56:04.913 INFO:tasks.workunit.client.1.smithi086.stdout:2/447: write d8/d24/d32/f3c [4615008,3869] 0 2024-08-19T00:56:04.913 INFO:tasks.workunit.client.1.smithi086.stdout:1/542: dread d4/d7/f19 [0,4194304] 0 2024-08-19T00:56:04.917 INFO:tasks.workunit.client.1.smithi086.stdout:8/454: read dc/f75 [402078,39197] 0 2024-08-19T00:56:04.917 INFO:tasks.workunit.client.1.smithi086.stdout:7/486: rename d3/d34/d44 to d3/d34/d44/d95 22 2024-08-19T00:56:04.918 INFO:tasks.workunit.client.1.smithi086.stdout:2/448: creat d8/d2c/d47/f93 x:0 0 0 2024-08-19T00:56:04.921 INFO:tasks.workunit.client.1.smithi086.stdout:3/463: write d3/d18/d19/d37/f93 [4033756,130320] 0 2024-08-19T00:56:04.921 INFO:tasks.workunit.client.1.smithi086.stdout:6/488: dread db/d37/f24 [0,4194304] 0 2024-08-19T00:56:04.922 INFO:tasks.workunit.client.1.smithi086.stdout:7/487: readlink d3/d34/d44/d3e/l47 0 2024-08-19T00:56:04.922 INFO:tasks.workunit.client.1.smithi086.stdout:2/449: rmdir d8 39 2024-08-19T00:56:04.923 INFO:tasks.workunit.client.1.smithi086.stdout:0/468: creat da/d14/d1a/d2e/d30/d76/f9d x:0 0 0 2024-08-19T00:56:04.924 INFO:tasks.workunit.client.1.smithi086.stdout:1/543: mknod d4/d7/d2a/d36/d3a/cb5 0 2024-08-19T00:56:04.924 INFO:tasks.workunit.client.1.smithi086.stdout:7/488: chown d3/de/d68/d72/l82 99012 1 2024-08-19T00:56:04.924 INFO:tasks.workunit.client.1.smithi086.stdout:8/455: read dc/d16/d18/d29/d2e/d28/d2b/d3b/f8e [5623905,6335] 0 2024-08-19T00:56:04.927 INFO:tasks.workunit.client.1.smithi086.stdout:9/469: symlink db/d26/d5c/d87/d30/d3f/d43/d4e/l9a 0 2024-08-19T00:56:04.927 INFO:tasks.workunit.client.1.smithi086.stdout:2/450: fdatasync d8/d2c/d47/f93 0 2024-08-19T00:56:04.927 INFO:tasks.workunit.client.1.smithi086.stdout:7/489: chown d3/d34/d44/d3e/f5c 60 1 2024-08-19T00:56:04.928 INFO:tasks.workunit.client.1.smithi086.stdout:6/489: mknod db/d37/d28/ca0 0 2024-08-19T00:56:04.931 INFO:tasks.workunit.client.1.smithi086.stdout:1/544: dread d4/d7/f3d [0,4194304] 0 2024-08-19T00:56:04.931 INFO:tasks.workunit.client.1.smithi086.stdout:4/427: mknod d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/d85/c8d 0 2024-08-19T00:56:04.931 INFO:tasks.workunit.client.1.smithi086.stdout:5/451: dread d0/d8/f37 [0,4194304] 0 2024-08-19T00:56:04.932 INFO:tasks.workunit.client.1.smithi086.stdout:1/545: chown d4/d1e/c3f 2644646 1 2024-08-19T00:56:04.932 INFO:tasks.workunit.client.1.smithi086.stdout:3/464: rename d3/d26/d2b/f9f to d3/d18/d27/d49/d3f/d5b/fa1 0 2024-08-19T00:56:04.933 INFO:tasks.workunit.client.1.smithi086.stdout:4/428: chown d2/d18/d33/d42/d72/d78/d25/d55/f3d 3 1 2024-08-19T00:56:04.933 INFO:tasks.workunit.client.1.smithi086.stdout:3/465: stat d3/d26/d2b/d33/d8d/f21 0 2024-08-19T00:56:04.933 INFO:tasks.workunit.client.1.smithi086.stdout:2/451: readlink d8/d2c/d67/l90 0 2024-08-19T00:56:04.934 INFO:tasks.workunit.client.1.smithi086.stdout:0/469: mknod da/c9e 0 2024-08-19T00:56:04.936 INFO:tasks.workunit.client.1.smithi086.stdout:7/490: mkdir d3/de/d68/d7a/d96 0 2024-08-19T00:56:04.937 INFO:tasks.workunit.client.1.smithi086.stdout:9/470: mknod db/d26/d5c/d87/d30/d3f/d43/d4e/d7a/c9b 0 2024-08-19T00:56:04.941 INFO:tasks.workunit.client.1.smithi086.stdout:3/466: mknod d3/d18/d27/d49/d3f/d54/ca2 0 2024-08-19T00:56:04.946 INFO:tasks.workunit.client.1.smithi086.stdout:3/467: dwrite d3/d18/d19/f68 [0,4194304] 0 2024-08-19T00:56:04.947 INFO:tasks.workunit.client.1.smithi086.stdout:1/546: mkdir d4/d7/d2a/d36/db6 0 2024-08-19T00:56:04.949 INFO:tasks.workunit.client.1.smithi086.stdout:4/429: fdatasync d2/d18/d33/d42/d72/f14 0 2024-08-19T00:56:04.949 INFO:tasks.workunit.client.1.smithi086.stdout:3/468: dread d3/d18/f2c [0,4194304] 0 2024-08-19T00:56:04.951 INFO:tasks.workunit.client.0.smithi017.stdout:1/105: truncate d4/f13 2258108 0 2024-08-19T00:56:04.951 INFO:tasks.workunit.client.1.smithi086.stdout:3/469: write d3/d26/d2b/f3b [64742,82400] 0 2024-08-19T00:56:04.953 INFO:tasks.workunit.client.1.smithi086.stdout:0/470: getdents da/d14/d1a/d2e/d7e 0 2024-08-19T00:56:04.958 INFO:tasks.workunit.client.0.smithi017.stdout:1/106: creat d4/dc/d19/f20 x:0 0 0 2024-08-19T00:56:04.960 INFO:tasks.workunit.client.1.smithi086.stdout:5/452: creat d0/d8/f86 x:0 0 0 2024-08-19T00:56:04.961 INFO:tasks.workunit.client.1.smithi086.stdout:5/453: write d0/d5f/f6f [396930,36410] 0 2024-08-19T00:56:04.962 INFO:tasks.workunit.client.0.smithi017.stdout:1/107: rmdir d4/d1c 39 2024-08-19T00:56:04.964 INFO:tasks.workunit.client.1.smithi086.stdout:1/547: creat d4/d7/d2a/d6e/fb7 x:0 0 0 2024-08-19T00:56:04.965 INFO:tasks.workunit.client.0.smithi017.stdout:1/108: unlink d4/f1a 0 2024-08-19T00:56:04.968 INFO:tasks.workunit.client.1.smithi086.stdout:4/430: mkdir d2/d18/d33/d42/d72/d2f/d8e 0 2024-08-19T00:56:04.971 INFO:tasks.workunit.client.1.smithi086.stdout:2/452: link d8/d84/c6b d8/d2c/d38/c94 0 2024-08-19T00:56:04.972 INFO:tasks.workunit.client.1.smithi086.stdout:8/456: write dc/f12 [2631959,69472] 0 2024-08-19T00:56:04.973 INFO:tasks.workunit.client.1.smithi086.stdout:0/471: chown da/d14/d44/d49/f63 152702 1 2024-08-19T00:56:04.974 INFO:tasks.workunit.client.1.smithi086.stdout:7/491: creat d3/f97 x:0 0 0 2024-08-19T00:56:04.975 INFO:tasks.workunit.client.1.smithi086.stdout:6/490: write db/f46 [1544011,10686] 0 2024-08-19T00:56:04.976 INFO:tasks.workunit.client.1.smithi086.stdout:9/471: creat db/d26/d5c/d87/d30/f9c x:0 0 0 2024-08-19T00:56:04.978 INFO:tasks.workunit.client.0.smithi017.stdout:1/109: fsync d4/f13 0 2024-08-19T00:56:04.980 INFO:tasks.workunit.client.1.smithi086.stdout:5/454: creat d0/d8/d70/f87 x:0 0 0 2024-08-19T00:56:04.987 INFO:tasks.workunit.client.0.smithi017.stdout:1/110: unlink d4/dc/d19/f20 0 2024-08-19T00:56:04.989 INFO:tasks.workunit.client.1.smithi086.stdout:0/472: mknod da/d14/d1a/d2e/d43/d61/c9f 0 2024-08-19T00:56:04.990 INFO:tasks.workunit.client.1.smithi086.stdout:7/492: symlink d3/d34/d44/d58/d4b/d78/l98 0 2024-08-19T00:56:04.993 INFO:tasks.workunit.client.0.smithi017.stdout:1/111: mknod d4/dc/d17/c21 0 2024-08-19T00:56:04.994 INFO:tasks.workunit.client.1.smithi086.stdout:6/491: creat db/d37/d44/d5a/fa1 x:0 0 0 2024-08-19T00:56:04.998 INFO:tasks.workunit.client.1.smithi086.stdout:9/472: unlink db/d26/d5c/d87/d30/d32/d44/c6e 0 2024-08-19T00:56:05.001 INFO:tasks.workunit.client.1.smithi086.stdout:4/431: mkdir d2/d18/d33/d42/d72/d8f 0 2024-08-19T00:56:05.004 INFO:tasks.workunit.client.1.smithi086.stdout:7/493: fsync d3/d34/d44/d3e/f74 0 2024-08-19T00:56:05.006 INFO:tasks.workunit.client.1.smithi086.stdout:6/492: unlink db/d37/f27 0 2024-08-19T00:56:05.010 INFO:tasks.workunit.client.1.smithi086.stdout:9/473: symlink db/d26/d5c/d68/l9d 0 2024-08-19T00:56:05.010 INFO:tasks.workunit.client.1.smithi086.stdout:5/455: truncate d0/fa 2763514 0 2024-08-19T00:56:05.011 INFO:tasks.workunit.client.1.smithi086.stdout:3/470: getdents d3/d18/d27/d49/d3f/d5b 0 2024-08-19T00:56:05.011 INFO:tasks.workunit.client.1.smithi086.stdout:4/432: mkdir d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90 0 2024-08-19T00:56:05.014 INFO:tasks.workunit.client.1.smithi086.stdout:8/457: rename dc/d17/d1e/d55/d7f to dc/d16/d18/d94 0 2024-08-19T00:56:05.015 INFO:tasks.workunit.client.1.smithi086.stdout:6/493: dwrite db/f46 [4194304,4194304] 0 2024-08-19T00:56:05.020 INFO:tasks.workunit.client.0.smithi017.stdout:1/112: dread d4/dc/f11 [0,4194304] 0 2024-08-19T00:56:05.021 INFO:tasks.workunit.client.1.smithi086.stdout:7/494: symlink d3/d34/d44/d58/d4b/d78/l99 0 2024-08-19T00:56:05.028 INFO:tasks.workunit.client.1.smithi086.stdout:0/473: dwrite da/f10 [0,4194304] 0 2024-08-19T00:56:05.029 INFO:tasks.workunit.client.1.smithi086.stdout:5/456: mknod d0/d20/c88 0 2024-08-19T00:56:05.031 INFO:tasks.workunit.client.1.smithi086.stdout:5/457: readlink d0/d2d/l2f 0 2024-08-19T00:56:05.031 INFO:tasks.workunit.client.1.smithi086.stdout:6/494: mknod db/d34/d69/ca2 0 2024-08-19T00:56:05.034 INFO:tasks.workunit.client.1.smithi086.stdout:0/474: symlink da/d14/la0 0 2024-08-19T00:56:05.036 INFO:tasks.workunit.client.1.smithi086.stdout:5/458: symlink d0/d8/d70/l89 0 2024-08-19T00:56:05.037 INFO:tasks.workunit.client.1.smithi086.stdout:3/471: getdents d3/d18/d19/d37/d3a 0 2024-08-19T00:56:05.037 INFO:tasks.workunit.client.1.smithi086.stdout:9/474: getdents db 0 2024-08-19T00:56:05.039 INFO:tasks.workunit.client.1.smithi086.stdout:3/472: dread - d3/d18/d61/f7a zero size 2024-08-19T00:56:05.041 INFO:tasks.workunit.client.1.smithi086.stdout:6/495: dwrite db/d34/f9a [0,4194304] 0 2024-08-19T00:56:05.045 INFO:tasks.workunit.client.1.smithi086.stdout:3/473: symlink d3/d18/d19/la3 0 2024-08-19T00:56:05.046 INFO:tasks.workunit.client.1.smithi086.stdout:9/475: creat db/dd/d19/d18/f9e x:0 0 0 2024-08-19T00:56:05.050 INFO:tasks.workunit.client.1.smithi086.stdout:6/496: getdents db/d37/d28 0 2024-08-19T00:56:05.052 INFO:tasks.workunit.client.1.smithi086.stdout:7/495: dread d3/de/f15 [0,4194304] 0 2024-08-19T00:56:05.053 INFO:tasks.workunit.client.1.smithi086.stdout:0/475: dwrite da/d14/d26/f29 [4194304,4194304] 0 2024-08-19T00:56:05.053 INFO:tasks.workunit.client.1.smithi086.stdout:3/474: creat d3/d26/d2b/d33/d4a/d57/d8a/fa4 x:0 0 0 2024-08-19T00:56:05.055 INFO:tasks.workunit.client.1.smithi086.stdout:8/458: dread dc/f11 [0,4194304] 0 2024-08-19T00:56:05.056 INFO:tasks.workunit.client.1.smithi086.stdout:7/496: chown d3/d5b/f6c 1682803 1 2024-08-19T00:56:05.058 INFO:tasks.workunit.client.1.smithi086.stdout:6/497: write db/d37/d30/f33 [408391,62314] 0 2024-08-19T00:56:05.059 INFO:tasks.workunit.client.1.smithi086.stdout:4/433: truncate d2/d18/d33/d42/d72/f41 288100 0 2024-08-19T00:56:05.060 INFO:tasks.workunit.client.1.smithi086.stdout:5/459: read d0/f6 [2057099,69404] 0 2024-08-19T00:56:05.060 INFO:tasks.workunit.client.1.smithi086.stdout:0/476: write da/d14/d1a/f52 [527279,25564] 0 2024-08-19T00:56:05.063 INFO:tasks.workunit.client.1.smithi086.stdout:3/475: symlink d3/d26/d2b/d33/d4a/d57/d8a/la5 0 2024-08-19T00:56:05.064 INFO:tasks.workunit.client.1.smithi086.stdout:0/477: stat da/d14/l3a 0 2024-08-19T00:56:05.065 INFO:tasks.workunit.client.1.smithi086.stdout:5/460: creat d0/d8/d72/f8a x:0 0 0 2024-08-19T00:56:05.065 INFO:tasks.workunit.client.1.smithi086.stdout:9/476: dwrite db/d26/d5c/d87/d30/d3f/d43/d84/f85 [0,4194304] 0 2024-08-19T00:56:05.065 INFO:tasks.workunit.client.1.smithi086.stdout:6/498: mknod db/d8e/ca3 0 2024-08-19T00:56:05.068 INFO:tasks.workunit.client.1.smithi086.stdout:4/434: creat d2/d18/d33/d42/d72/d2f/f91 x:0 0 0 2024-08-19T00:56:05.068 INFO:tasks.workunit.client.1.smithi086.stdout:6/499: write db/f16 [1280579,101436] 0 2024-08-19T00:56:05.072 INFO:tasks.workunit.client.1.smithi086.stdout:1/548: sync 2024-08-19T00:56:05.072 INFO:tasks.workunit.client.1.smithi086.stdout:9/477: dread db/d26/d5c/f97 [0,4194304] 0 2024-08-19T00:56:05.074 INFO:tasks.workunit.client.1.smithi086.stdout:4/435: unlink c1 0 2024-08-19T00:56:05.075 INFO:tasks.workunit.client.1.smithi086.stdout:7/497: dwrite d3/f81 [0,4194304] 0 2024-08-19T00:56:05.075 INFO:tasks.workunit.client.1.smithi086.stdout:0/478: chown da/d14/d1a/d2e/d39/d3b/d4e/f4f 3 1 2024-08-19T00:56:05.078 INFO:tasks.workunit.client.1.smithi086.stdout:8/459: write dc/d16/d18/f76 [845683,127737] 0 2024-08-19T00:56:05.082 INFO:tasks.workunit.client.1.smithi086.stdout:6/500: mknod db/d37/d44/d5a/d8f/ca4 0 2024-08-19T00:56:05.082 INFO:tasks.workunit.client.1.smithi086.stdout:9/478: unlink db/d26/d5c/d68/l9d 0 2024-08-19T00:56:05.084 INFO:tasks.workunit.client.1.smithi086.stdout:1/549: symlink d4/d7/d2a/d36/d50/d9c/lb8 0 2024-08-19T00:56:05.084 INFO:tasks.workunit.client.1.smithi086.stdout:5/461: dwrite d0/d5f/f6f [0,4194304] 0 2024-08-19T00:56:05.086 INFO:tasks.workunit.client.1.smithi086.stdout:7/498: mkdir d3/d34/d44/d58/d4b/d78/d9a 0 2024-08-19T00:56:05.086 INFO:tasks.workunit.client.1.smithi086.stdout:3/476: dwrite d3/d18/d27/d49/d3f/d5b/d66/f6a [0,4194304] 0 2024-08-19T00:56:05.086 INFO:tasks.workunit.client.1.smithi086.stdout:0/479: mknod da/d14/d1a/d2e/d39/d3b/d4e/ca1 0 2024-08-19T00:56:05.087 INFO:tasks.workunit.client.1.smithi086.stdout:5/462: chown d0/df/d1f/d33/f34 0 1 2024-08-19T00:56:05.088 INFO:tasks.workunit.client.1.smithi086.stdout:1/550: dread d4/d1e/f48 [0,4194304] 0 2024-08-19T00:56:05.088 INFO:tasks.workunit.client.1.smithi086.stdout:3/477: dread - d3/d18/d61/d85/f8c zero size 2024-08-19T00:56:05.091 INFO:tasks.workunit.client.1.smithi086.stdout:0/480: write da/d14/d1a/d2e/d30/d76/f9d [791656,51300] 0 2024-08-19T00:56:05.094 INFO:tasks.workunit.client.1.smithi086.stdout:7/499: write d3/d34/d44/d58/d4b/d78/f5a [924662,13024] 0 2024-08-19T00:56:05.095 INFO:tasks.workunit.client.1.smithi086.stdout:9/479: mkdir db/d26/d5c/d87/d6d/d9f 0 2024-08-19T00:56:05.097 INFO:tasks.workunit.client.1.smithi086.stdout:8/460: truncate dc/d16/d18/d29/d2e/d28/d41/f59 4858634 0 2024-08-19T00:56:05.098 INFO:tasks.workunit.client.1.smithi086.stdout:0/481: write da/d14/d1a/d2e/d39/f69 [1972851,53134] 0 2024-08-19T00:56:05.098 INFO:tasks.workunit.client.1.smithi086.stdout:7/500: truncate d3/f97 634078 0 2024-08-19T00:56:05.098 INFO:tasks.workunit.client.1.smithi086.stdout:1/551: mkdir d4/d7/d2a/d6e/d95/db9 0 2024-08-19T00:56:05.100 INFO:tasks.workunit.client.1.smithi086.stdout:7/501: chown d3/d34/d44/d3e 190 1 2024-08-19T00:56:05.101 INFO:tasks.workunit.client.1.smithi086.stdout:8/461: fdatasync dc/d16/d18/d29/d2e/d28/d2b/f6e 0 2024-08-19T00:56:05.102 INFO:tasks.workunit.client.1.smithi086.stdout:3/478: link d3/d18/f36 d3/d18/d19/d37/fa6 0 2024-08-19T00:56:05.103 INFO:tasks.workunit.client.1.smithi086.stdout:9/480: symlink db/d96/la0 0 2024-08-19T00:56:05.103 INFO:tasks.workunit.client.1.smithi086.stdout:5/463: dwrite d0/d8/f86 [0,4194304] 0 2024-08-19T00:56:05.105 INFO:tasks.workunit.client.1.smithi086.stdout:7/502: creat d3/d34/d44/d3e/f9b x:0 0 0 2024-08-19T00:56:05.106 INFO:tasks.workunit.client.1.smithi086.stdout:3/479: stat d3/d18/d27/d49/d3f/f9a 0 2024-08-19T00:56:05.111 INFO:tasks.workunit.client.1.smithi086.stdout:7/503: symlink d3/d34/d44/d58/l9c 0 2024-08-19T00:56:05.111 INFO:tasks.workunit.client.1.smithi086.stdout:1/552: dread d4/f6 [0,4194304] 0 2024-08-19T00:56:05.112 INFO:tasks.workunit.client.1.smithi086.stdout:9/481: mkdir db/d26/d5c/d87/d30/d3f/d43/d4e/d7a/da1 0 2024-08-19T00:56:05.112 INFO:tasks.workunit.client.1.smithi086.stdout:8/462: read dc/d16/d18/d29/d2e/d28/d2b/d3b/f58 [2366313,24002] 0 2024-08-19T00:56:05.113 INFO:tasks.workunit.client.1.smithi086.stdout:0/482: dwrite da/d14/f6f [4194304,4194304] 0 2024-08-19T00:56:05.116 INFO:tasks.workunit.client.1.smithi086.stdout:7/504: symlink d3/de/d68/l9d 0 2024-08-19T00:56:05.117 INFO:tasks.workunit.client.1.smithi086.stdout:7/505: stat d3/d34/d44/c41 0 2024-08-19T00:56:05.118 INFO:tasks.workunit.client.1.smithi086.stdout:9/482: creat db/dd/d19/d38/fa2 x:0 0 0 2024-08-19T00:56:05.118 INFO:tasks.workunit.client.1.smithi086.stdout:1/553: dread - d4/d7/f53 zero size 2024-08-19T00:56:05.122 INFO:tasks.workunit.client.1.smithi086.stdout:7/506: write d3/d5b/f6e [17013,25699] 0 2024-08-19T00:56:05.122 INFO:tasks.workunit.client.1.smithi086.stdout:0/483: dread da/d14/d1a/f54 [4194304,4194304] 0 2024-08-19T00:56:05.126 INFO:tasks.workunit.client.1.smithi086.stdout:5/464: dread d0/d2d/d43/f45 [0,4194304] 0 2024-08-19T00:56:05.126 INFO:tasks.workunit.client.1.smithi086.stdout:7/507: rename d3/d34/d44/l4d to d3/de/d68/d7a/l9e 0 2024-08-19T00:56:05.127 INFO:tasks.workunit.client.1.smithi086.stdout:6/501: write db/d37/d44/d5a/f5f [575490,42613] 0 2024-08-19T00:56:05.130 INFO:tasks.workunit.client.1.smithi086.stdout:6/502: creat db/d37/d28/fa5 x:0 0 0 2024-08-19T00:56:05.131 INFO:tasks.workunit.client.1.smithi086.stdout:5/465: symlink d0/l8b 0 2024-08-19T00:56:05.134 INFO:tasks.workunit.client.1.smithi086.stdout:5/466: truncate d0/d8/d10/f2b 2370727 0 2024-08-19T00:56:05.137 INFO:tasks.workunit.client.1.smithi086.stdout:6/503: dwrite db/d37/d28/fa5 [0,4194304] 0 2024-08-19T00:56:05.139 INFO:tasks.workunit.client.1.smithi086.stdout:9/483: write db/d26/f27 [495161,104689] 0 2024-08-19T00:56:05.140 INFO:tasks.workunit.client.1.smithi086.stdout:1/554: write d4/d7/d2a/f33 [121312,12640] 0 2024-08-19T00:56:05.145 INFO:tasks.workunit.client.1.smithi086.stdout:5/467: dwrite d0/d20/f3c [0,4194304] 0 2024-08-19T00:56:05.145 INFO:tasks.workunit.client.1.smithi086.stdout:9/484: mknod db/d26/d5c/d68/ca3 0 2024-08-19T00:56:05.146 INFO:tasks.workunit.client.1.smithi086.stdout:8/463: dread dc/d16/d18/d29/d2e/d28/d2b/f6e [0,4194304] 0 2024-08-19T00:56:05.146 INFO:tasks.workunit.client.1.smithi086.stdout:3/480: dread d3/d18/d27/f83 [0,4194304] 0 2024-08-19T00:56:05.147 INFO:tasks.workunit.client.1.smithi086.stdout:5/468: read d0/d2d/f32 [7268653,2303] 0 2024-08-19T00:56:05.147 INFO:tasks.workunit.client.1.smithi086.stdout:3/481: chown d3 2 1 2024-08-19T00:56:05.150 INFO:tasks.workunit.client.1.smithi086.stdout:0/484: dwrite da/d14/d26/f33 [0,4194304] 0 2024-08-19T00:56:05.150 INFO:tasks.workunit.client.1.smithi086.stdout:7/508: mknod d3/d34/d44/d58/d4b/c9f 0 2024-08-19T00:56:05.151 INFO:tasks.workunit.client.1.smithi086.stdout:9/485: dread - db/dd/d19/d38/fa2 zero size 2024-08-19T00:56:05.151 INFO:tasks.workunit.client.1.smithi086.stdout:1/555: read d4/d7/d2a/d36/d63/f80 [540341,22755] 0 2024-08-19T00:56:05.152 INFO:tasks.workunit.client.1.smithi086.stdout:3/482: write d3/d18/d61/d85/f8c [1002507,55886] 0 2024-08-19T00:56:05.153 INFO:tasks.workunit.client.1.smithi086.stdout:5/469: mknod d0/df/c8c 0 2024-08-19T00:56:05.154 INFO:tasks.workunit.client.1.smithi086.stdout:8/464: mknod dc/d16/d18/d29/d2e/c95 0 2024-08-19T00:56:05.154 INFO:tasks.workunit.client.1.smithi086.stdout:1/556: write d4/fb3 [479235,1544] 0 2024-08-19T00:56:05.156 INFO:tasks.workunit.client.1.smithi086.stdout:7/509: creat d3/de/d68/d72/fa0 x:0 0 0 2024-08-19T00:56:05.156 INFO:tasks.workunit.client.1.smithi086.stdout:5/470: read d0/d8/d10/f19 [3337259,128985] 0 2024-08-19T00:56:05.157 INFO:tasks.workunit.client.1.smithi086.stdout:3/483: chown d3/d18/d27/d49/d3f/d5b/d66/f6a 4721489 1 2024-08-19T00:56:05.158 INFO:tasks.workunit.client.1.smithi086.stdout:8/465: creat dc/d70/d7a/d88/f96 x:0 0 0 2024-08-19T00:56:05.158 INFO:tasks.workunit.client.1.smithi086.stdout:7/510: write d3/d5b/f6f [2067474,21885] 0 2024-08-19T00:56:05.159 INFO:tasks.workunit.client.1.smithi086.stdout:5/471: dread - d0/d8/d70/f87 zero size 2024-08-19T00:56:05.162 INFO:tasks.workunit.client.1.smithi086.stdout:0/485: getdents da/d14/d1a/d2e/d66 0 2024-08-19T00:56:05.162 INFO:tasks.workunit.client.1.smithi086.stdout:9/486: dwrite db/f52 [0,4194304] 0 2024-08-19T00:56:05.163 INFO:tasks.workunit.client.1.smithi086.stdout:7/511: truncate d3/d34/f89 175375 0 2024-08-19T00:56:05.166 INFO:tasks.workunit.client.1.smithi086.stdout:5/472: symlink d0/d2d/l8d 0 2024-08-19T00:56:05.166 INFO:tasks.workunit.client.1.smithi086.stdout:0/486: readlink da/d14/d26/l2a 0 2024-08-19T00:56:05.167 INFO:tasks.workunit.client.1.smithi086.stdout:1/557: getdents d4/d7/d2a/d36/d3a/d41 0 2024-08-19T00:56:05.168 INFO:tasks.workunit.client.1.smithi086.stdout:7/512: chown d3/d34/d44/d58/d4b/f7c 2 1 2024-08-19T00:56:05.168 INFO:tasks.workunit.client.1.smithi086.stdout:5/473: dread - d0/d5f/d60/d5b/f6e zero size 2024-08-19T00:56:05.170 INFO:tasks.workunit.client.1.smithi086.stdout:2/453: sync 2024-08-19T00:56:05.175 INFO:tasks.workunit.client.1.smithi086.stdout:5/474: mkdir d0/d8/d70/d8e 0 2024-08-19T00:56:05.176 INFO:tasks.workunit.client.1.smithi086.stdout:1/558: symlink d4/d7/d2a/d36/d63/d84/d8e/lba 0 2024-08-19T00:56:05.178 INFO:tasks.workunit.client.1.smithi086.stdout:1/559: read d4/d7/f9b [3450601,53542] 0 2024-08-19T00:56:05.178 INFO:tasks.workunit.client.1.smithi086.stdout:7/513: mkdir d3/da1 0 2024-08-19T00:56:05.181 INFO:tasks.workunit.client.1.smithi086.stdout:2/454: mknod d8/c95 0 2024-08-19T00:56:05.181 INFO:tasks.workunit.client.1.smithi086.stdout:3/484: truncate d3/d18/d27/d49/d3f/d54/f94 332108 0 2024-08-19T00:56:05.182 INFO:tasks.workunit.client.1.smithi086.stdout:3/485: chown d3/d18/d27/d49/d3f/c42 11019 1 2024-08-19T00:56:05.183 INFO:tasks.workunit.client.1.smithi086.stdout:7/514: stat d3/d34/d44/d3e/f67 0 2024-08-19T00:56:05.183 INFO:tasks.workunit.client.1.smithi086.stdout:3/486: write d3/d26/d60/f69 [3939304,95639] 0 2024-08-19T00:56:05.184 INFO:tasks.workunit.client.1.smithi086.stdout:7/515: chown d3/la 1063 1 2024-08-19T00:56:05.184 INFO:tasks.workunit.client.1.smithi086.stdout:3/487: dread - d3/d18/d61/f56 zero size 2024-08-19T00:56:05.191 INFO:tasks.workunit.client.1.smithi086.stdout:1/560: mknod d4/d7/d2a/d36/db6/cbb 0 2024-08-19T00:56:05.191 INFO:tasks.workunit.client.1.smithi086.stdout:7/516: mknod d3/d5b/ca2 0 2024-08-19T00:56:05.191 INFO:tasks.workunit.client.1.smithi086.stdout:8/466: dread dc/f36 [0,4194304] 0 2024-08-19T00:56:05.191 INFO:tasks.workunit.client.1.smithi086.stdout:3/488: chown d3/d18/d19/d37/l45 87085277 1 2024-08-19T00:56:05.191 INFO:tasks.workunit.client.1.smithi086.stdout:7/517: stat d3/de/f1e 0 2024-08-19T00:56:05.192 INFO:tasks.workunit.client.1.smithi086.stdout:1/561: chown d4/d7/d2a/l58 1024850641 1 2024-08-19T00:56:05.192 INFO:tasks.workunit.client.1.smithi086.stdout:9/487: dread db/dd/d19/d38/f79 [0,4194304] 0 2024-08-19T00:56:05.195 INFO:tasks.workunit.client.1.smithi086.stdout:0/487: dwrite da/d14/d26/f2b [0,4194304] 0 2024-08-19T00:56:05.195 INFO:tasks.workunit.client.1.smithi086.stdout:8/467: creat dc/d70/d7a/f97 x:0 0 0 2024-08-19T00:56:05.197 INFO:tasks.workunit.client.1.smithi086.stdout:3/489: rmdir d3/d26/d2b/d33/d4a/d57 39 2024-08-19T00:56:05.197 INFO:tasks.workunit.client.1.smithi086.stdout:9/488: read - db/d26/f93 zero size 2024-08-19T00:56:05.198 INFO:tasks.workunit.client.1.smithi086.stdout:1/562: unlink d4/d10/l82 0 2024-08-19T00:56:05.198 INFO:tasks.workunit.client.1.smithi086.stdout:5/475: dwrite d0/f6 [0,4194304] 0 2024-08-19T00:56:05.203 INFO:tasks.workunit.client.1.smithi086.stdout:7/518: write d3/de/f70 [1219096,86730] 0 2024-08-19T00:56:05.203 INFO:tasks.workunit.client.1.smithi086.stdout:2/455: dwrite d8/d14/f22 [4194304,4194304] 0 2024-08-19T00:56:05.204 INFO:tasks.workunit.client.1.smithi086.stdout:0/488: rmdir da/d14/d1a/d2e 39 2024-08-19T00:56:05.209 INFO:tasks.workunit.client.1.smithi086.stdout:7/519: write d3/f38 [895323,106771] 0 2024-08-19T00:56:05.211 INFO:tasks.workunit.client.1.smithi086.stdout:3/490: write d3/d9/f39 [159810,26703] 0 2024-08-19T00:56:05.212 INFO:tasks.workunit.client.1.smithi086.stdout:2/456: mkdir d8/d2c/d38/d96 0 2024-08-19T00:56:05.214 INFO:tasks.workunit.client.1.smithi086.stdout:9/489: creat db/d26/d5c/d87/d37/fa4 x:0 0 0 2024-08-19T00:56:05.215 INFO:tasks.workunit.client.1.smithi086.stdout:7/520: creat d3/d34/d44/d3e/fa3 x:0 0 0 2024-08-19T00:56:05.216 INFO:tasks.workunit.client.1.smithi086.stdout:0/489: mknod da/d14/d1a/d2e/ca2 0 2024-08-19T00:56:05.218 INFO:tasks.workunit.client.1.smithi086.stdout:9/490: chown db/d26/d5c/d87/d6d 63210 1 2024-08-19T00:56:05.218 INFO:tasks.workunit.client.1.smithi086.stdout:3/491: chown d3/d26/d2b/d33/d8d/f44 131855431 1 2024-08-19T00:56:05.219 INFO:tasks.workunit.client.1.smithi086.stdout:8/468: dwrite dc/d1f/d37/f72 [0,4194304] 0 2024-08-19T00:56:05.219 INFO:tasks.workunit.client.1.smithi086.stdout:2/457: rename d8 to d8/d24/d32/d4d/d6a/d97 22 2024-08-19T00:56:05.222 INFO:tasks.workunit.client.1.smithi086.stdout:1/563: dwrite d4/d7/d2a/f6b [0,4194304] 0 2024-08-19T00:56:05.222 INFO:tasks.workunit.client.1.smithi086.stdout:7/521: stat d3/d34/d44/d58/d4b/l1c 0 2024-08-19T00:56:05.223 INFO:tasks.workunit.client.1.smithi086.stdout:0/490: write da/d5d/f7a [154730,94006] 0 2024-08-19T00:56:05.223 INFO:tasks.workunit.client.1.smithi086.stdout:2/458: stat d8/d14/f88 0 2024-08-19T00:56:05.224 INFO:tasks.workunit.client.1.smithi086.stdout:3/492: chown d3/d18/d19/d37/d3a 144060107 1 2024-08-19T00:56:05.224 INFO:tasks.workunit.client.1.smithi086.stdout:5/476: dwrite d0/d5f/d60/d57/f69 [4194304,4194304] 0 2024-08-19T00:56:05.224 INFO:tasks.workunit.client.1.smithi086.stdout:8/469: dread - dc/d70/d8f/d93/f6f zero size 2024-08-19T00:56:05.231 INFO:tasks.workunit.client.1.smithi086.stdout:9/491: truncate db/d26/d5c/d87/d30/d32/d44/f69 5169737 0 2024-08-19T00:56:05.232 INFO:tasks.workunit.client.1.smithi086.stdout:1/564: creat d4/d10/d90/fbc x:0 0 0 2024-08-19T00:56:05.232 INFO:tasks.workunit.client.1.smithi086.stdout:0/491: unlink da/d14/d1a/d2e/d39/l87 0 2024-08-19T00:56:05.234 INFO:tasks.workunit.client.1.smithi086.stdout:2/459: creat d8/d84/d79/f98 x:0 0 0 2024-08-19T00:56:05.234 INFO:tasks.workunit.client.1.smithi086.stdout:0/492: chown da/d14/d44/d49/l80 1853418 1 2024-08-19T00:56:05.236 INFO:tasks.workunit.client.1.smithi086.stdout:1/565: creat d4/d10/d90/d98/fbd x:0 0 0 2024-08-19T00:56:05.238 INFO:tasks.workunit.client.1.smithi086.stdout:0/493: symlink da/d14/d1a/d2e/d43/d61/d6a/la3 0 2024-08-19T00:56:05.239 INFO:tasks.workunit.client.1.smithi086.stdout:2/460: write d8/d2c/d47/f58 [190880,62026] 0 2024-08-19T00:56:05.240 INFO:tasks.workunit.client.1.smithi086.stdout:8/470: rmdir dc/d16/d18/d29/d2e/d28/d2b 39 2024-08-19T00:56:05.242 INFO:tasks.workunit.client.1.smithi086.stdout:0/494: mkdir da/d14/d55/da4 0 2024-08-19T00:56:05.242 INFO:tasks.workunit.client.1.smithi086.stdout:8/471: readlink dc/d17/d1e/l35 0 2024-08-19T00:56:05.243 INFO:tasks.workunit.client.1.smithi086.stdout:3/493: dwrite d3/f29 [0,4194304] 0 2024-08-19T00:56:05.250 INFO:tasks.workunit.client.1.smithi086.stdout:8/472: link dc/d17/d1e/l35 dc/d16/d18/d29/l98 0 2024-08-19T00:56:05.250 INFO:tasks.workunit.client.1.smithi086.stdout:2/461: dread d8/f12 [0,4194304] 0 2024-08-19T00:56:05.251 INFO:tasks.workunit.client.1.smithi086.stdout:8/473: getdents dc/d17/d1e/d82 0 2024-08-19T00:56:05.253 INFO:tasks.workunit.client.1.smithi086.stdout:4/436: sync 2024-08-19T00:56:05.255 INFO:tasks.workunit.client.1.smithi086.stdout:7/522: rmdir d3 39 2024-08-19T00:56:05.257 INFO:tasks.workunit.client.1.smithi086.stdout:4/437: unlink d2/d18/d33/d42/d72/d2f/l49 0 2024-08-19T00:56:05.260 INFO:tasks.workunit.client.1.smithi086.stdout:8/474: dwrite dc/d16/d18/d29/d2e/f8a [0,4194304] 0 2024-08-19T00:56:05.260 INFO:tasks.workunit.client.1.smithi086.stdout:7/523: mknod d3/d5b/ca4 0 2024-08-19T00:56:05.261 INFO:tasks.workunit.client.1.smithi086.stdout:5/477: write d0/d5f/d60/f83 [1858905,15212] 0 2024-08-19T00:56:05.265 INFO:tasks.workunit.client.1.smithi086.stdout:0/495: rename da/d14/d1a/d2e/d43/d61 to da/d14/d55/da5 0 2024-08-19T00:56:05.267 INFO:tasks.workunit.client.1.smithi086.stdout:8/475: mkdir dc/d70/d99 0 2024-08-19T00:56:05.268 INFO:tasks.workunit.client.1.smithi086.stdout:5/478: mknod d0/d5f/c8f 0 2024-08-19T00:56:05.269 INFO:tasks.workunit.client.1.smithi086.stdout:9/492: dwrite db/dd/d19/d18/f25 [0,4194304] 0 2024-08-19T00:56:05.269 INFO:tasks.workunit.client.1.smithi086.stdout:7/524: rmdir d3/de/d68 39 2024-08-19T00:56:05.270 INFO:tasks.workunit.client.1.smithi086.stdout:6/504: sync 2024-08-19T00:56:05.271 INFO:tasks.workunit.client.1.smithi086.stdout:4/438: truncate d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/f63 1283471 0 2024-08-19T00:56:05.273 INFO:tasks.workunit.client.1.smithi086.stdout:7/525: readlink d3/d34/d44/d58/d4b/l54 0 2024-08-19T00:56:05.273 INFO:tasks.workunit.client.1.smithi086.stdout:8/476: chown dc/d17/d1e/d55/l7d 674 1 2024-08-19T00:56:05.274 INFO:tasks.workunit.client.1.smithi086.stdout:9/493: rmdir db/d26 39 2024-08-19T00:56:05.275 INFO:tasks.workunit.client.1.smithi086.stdout:1/566: dread d4/d10/f5a [0,4194304] 0 2024-08-19T00:56:05.276 INFO:tasks.workunit.client.1.smithi086.stdout:3/494: rename d3/d18/d27/d49/d3f/d54/f77 to d3/d18/d27/d49/d3f/d5b/fa7 0 2024-08-19T00:56:05.279 INFO:tasks.workunit.client.1.smithi086.stdout:3/495: chown d3/d18/d27/d49/d3f/f9a 118 1 2024-08-19T00:56:05.282 INFO:tasks.workunit.client.1.smithi086.stdout:7/526: fsync d3/d34/d44/d58/d4b/f6d 0 2024-08-19T00:56:05.283 INFO:tasks.workunit.client.1.smithi086.stdout:2/462: rename d8/l5d to d8/d84/l99 0 2024-08-19T00:56:05.284 INFO:tasks.workunit.client.1.smithi086.stdout:4/439: dwrite d2/d18/d33/d42/d72/d78/d25/f58 [0,4194304] 0 2024-08-19T00:56:05.285 INFO:tasks.workunit.client.1.smithi086.stdout:0/496: getdents da/d14/d1a/d2e/d30 0 2024-08-19T00:56:05.285 INFO:tasks.workunit.client.1.smithi086.stdout:8/477: chown dc/d16/d18/d29/d2e/d28/d2b/f6e 0 1 2024-08-19T00:56:05.288 INFO:tasks.workunit.client.0.smithi017.stdout:6/57: sync 2024-08-19T00:56:05.288 INFO:tasks.workunit.client.0.smithi017.stdout:0/75: sync 2024-08-19T00:56:05.289 INFO:tasks.workunit.client.1.smithi086.stdout:9/494: creat db/fa5 x:0 0 0 2024-08-19T00:56:05.290 INFO:tasks.workunit.client.1.smithi086.stdout:8/478: chown dc/d16/d18/d29/d2e 59720 1 2024-08-19T00:56:05.291 INFO:tasks.workunit.client.1.smithi086.stdout:6/505: dwrite db/d34/d4e/d68/f84 [0,4194304] 0 2024-08-19T00:56:05.293 INFO:tasks.workunit.client.1.smithi086.stdout:1/567: dwrite d4/d7/d2a/d36/d50/f9d [0,4194304] 0 2024-08-19T00:56:05.295 INFO:tasks.workunit.client.0.smithi017.stdout:0/76: rename d5/l13 to d5/d18/l19 0 2024-08-19T00:56:05.296 INFO:tasks.workunit.client.1.smithi086.stdout:5/479: truncate d0/d5f/d60/d57/f58 613134 0 2024-08-19T00:56:05.296 INFO:tasks.workunit.client.0.smithi017.stdout:6/58: dwrite f1 [0,4194304] 0 2024-08-19T00:56:05.297 INFO:tasks.workunit.client.0.smithi017.stdout:6/59: dread - f4 zero size 2024-08-19T00:56:05.300 INFO:tasks.workunit.client.0.smithi017.stdout:6/60: truncate d5/d6/fa 907462 0 2024-08-19T00:56:05.304 INFO:tasks.workunit.client.0.smithi017.stdout:5/94: sync 2024-08-19T00:56:05.305 INFO:tasks.workunit.client.0.smithi017.stdout:5/95: stat db/f24 0 2024-08-19T00:56:05.307 INFO:tasks.workunit.client.1.smithi086.stdout:8/479: mkdir dc/d16/d18/d29/d2e/d28/d41/d9a 0 2024-08-19T00:56:05.308 INFO:tasks.workunit.client.0.smithi017.stdout:6/61: dread f2 [0,4194304] 0 2024-08-19T00:56:05.308 INFO:tasks.workunit.client.0.smithi017.stdout:0/77: getdents d5/d17 0 2024-08-19T00:56:05.308 INFO:tasks.workunit.client.1.smithi086.stdout:6/506: symlink db/d34/d39/d76/la6 0 2024-08-19T00:56:05.309 INFO:tasks.workunit.client.1.smithi086.stdout:8/480: truncate dc/d70/d7a/f7c 105297 0 2024-08-19T00:56:05.311 INFO:tasks.workunit.client.0.smithi017.stdout:5/96: creat db/d19/d1f/d15/d1e/f27 x:0 0 0 2024-08-19T00:56:05.312 INFO:tasks.workunit.client.0.smithi017.stdout:6/62: unlink f1 0 2024-08-19T00:56:05.313 INFO:tasks.workunit.client.1.smithi086.stdout:8/481: dread - dc/d16/d18/d29/d2e/d28/d41/f78 zero size 2024-08-19T00:56:05.314 INFO:tasks.workunit.client.1.smithi086.stdout:5/480: rmdir d0/df/d1f 39 2024-08-19T00:56:05.315 INFO:tasks.workunit.client.0.smithi017.stdout:6/63: dread f3 [0,4194304] 0 2024-08-19T00:56:05.316 INFO:tasks.workunit.client.1.smithi086.stdout:3/496: link d3/d18/d27/d76/l86 d3/d18/d27/d49/d3f/d5b/la8 0 2024-08-19T00:56:05.316 INFO:tasks.workunit.client.0.smithi017.stdout:0/78: dwrite d5/fa [4194304,4194304] 0 2024-08-19T00:56:05.318 INFO:tasks.workunit.client.0.smithi017.stdout:6/64: write d5/d6/fc [139815,44586] 0 2024-08-19T00:56:05.318 INFO:tasks.workunit.client.0.smithi017.stdout:0/79: read d5/f12 [629789,72456] 0 2024-08-19T00:56:05.318 INFO:tasks.workunit.client.0.smithi017.stdout:6/65: chown f2 958768 1 2024-08-19T00:56:05.319 INFO:tasks.workunit.client.0.smithi017.stdout:0/80: write d5/fa [8312040,7220] 0 2024-08-19T00:56:05.319 INFO:tasks.workunit.client.0.smithi017.stdout:5/97: mknod db/d19/c28 0 2024-08-19T00:56:05.320 INFO:tasks.workunit.client.1.smithi086.stdout:6/507: dwrite db/d37/d41/f6b [0,4194304] 0 2024-08-19T00:56:05.321 INFO:tasks.workunit.client.0.smithi017.stdout:0/81: truncate d5/fc 5188136 0 2024-08-19T00:56:05.322 INFO:tasks.workunit.client.0.smithi017.stdout:0/82: chown d5/fc 1 1 2024-08-19T00:56:05.325 INFO:tasks.workunit.client.1.smithi086.stdout:6/508: dread - db/d37/f9e zero size 2024-08-19T00:56:05.325 INFO:tasks.workunit.client.1.smithi086.stdout:4/440: creat d2/d18/d33/f92 x:0 0 0 2024-08-19T00:56:05.326 INFO:tasks.workunit.client.0.smithi017.stdout:0/83: dread d5/fa [0,4194304] 0 2024-08-19T00:56:05.326 INFO:tasks.workunit.client.0.smithi017.stdout:0/84: chown d5 1 1 2024-08-19T00:56:05.327 INFO:tasks.workunit.client.0.smithi017.stdout:5/98: symlink db/l29 0 2024-08-19T00:56:05.328 INFO:tasks.workunit.client.1.smithi086.stdout:5/481: rmdir d0/d5f 39 2024-08-19T00:56:05.328 INFO:tasks.workunit.client.1.smithi086.stdout:0/497: rename l9 to da/d14/d1a/la6 0 2024-08-19T00:56:05.329 INFO:tasks.workunit.client.0.smithi017.stdout:5/99: write db/d19/d1f/d15/d1e/f21 [925448,128549] 0 2024-08-19T00:56:05.330 INFO:tasks.workunit.client.1.smithi086.stdout:4/441: write d2/d18/d33/d42/d72/d78/d25/d55/f3d [1766034,1388] 0 2024-08-19T00:56:05.330 INFO:tasks.workunit.client.1.smithi086.stdout:3/497: dwrite d3/f6 [0,4194304] 0 2024-08-19T00:56:05.330 INFO:tasks.workunit.client.1.smithi086.stdout:2/463: getdents d8/d24/d32 0 2024-08-19T00:56:05.331 INFO:tasks.workunit.client.1.smithi086.stdout:5/482: truncate d0/d8/f37 4564215 0 2024-08-19T00:56:05.332 INFO:tasks.workunit.client.1.smithi086.stdout:9/495: unlink db/d26/d5c/d87/d30/d32/d44/f6b 0 2024-08-19T00:56:05.332 INFO:tasks.workunit.client.1.smithi086.stdout:0/498: write da/d14/f1b [783566,69846] 0 2024-08-19T00:56:05.332 INFO:tasks.workunit.client.1.smithi086.stdout:1/568: link d4/d10/d75/d7a/ca9 d4/d7/d2a/d36/d50/d9c/cbe 0 2024-08-19T00:56:05.333 INFO:tasks.workunit.client.0.smithi017.stdout:6/66: getdents d5 0 2024-08-19T00:56:05.334 INFO:tasks.workunit.client.1.smithi086.stdout:0/499: stat da/d14/la0 0 2024-08-19T00:56:05.334 INFO:tasks.workunit.client.1.smithi086.stdout:3/498: write d3/d26/f79 [112500,92906] 0 2024-08-19T00:56:05.335 INFO:tasks.workunit.client.1.smithi086.stdout:2/464: rmdir d8/d43/d65 39 2024-08-19T00:56:05.336 INFO:tasks.workunit.client.1.smithi086.stdout:3/499: chown d3/f14 516189664 1 2024-08-19T00:56:05.337 INFO:tasks.workunit.client.1.smithi086.stdout:0/500: fdatasync da/d14/d1a/d2e/d30/d76/f9c 0 2024-08-19T00:56:05.339 INFO:tasks.workunit.client.1.smithi086.stdout:0/501: dread - da/d14/d1a/d2e/d39/f74 zero size 2024-08-19T00:56:05.342 INFO:tasks.workunit.client.0.smithi017.stdout:5/100: getdents db/d19/d1f 0 2024-08-19T00:56:05.343 INFO:tasks.workunit.client.0.smithi017.stdout:5/101: readlink l9 0 2024-08-19T00:56:05.343 INFO:tasks.workunit.client.1.smithi086.stdout:1/569: mkdir d4/d7/d2a/d36/d63/d84/dbf 0 2024-08-19T00:56:05.343 INFO:tasks.workunit.client.1.smithi086.stdout:7/527: rename d3/d34/d44/d3e to d3/d34/d44/d58/d4b/da5 0 2024-08-19T00:56:05.343 INFO:tasks.workunit.client.1.smithi086.stdout:4/442: mknod d2/d18/d33/d42/d72/d2f/d8e/c93 0 2024-08-19T00:56:05.346 INFO:tasks.workunit.client.1.smithi086.stdout:7/528: write d3/d34/f76 [394798,34301] 0 2024-08-19T00:56:05.348 INFO:tasks.workunit.client.1.smithi086.stdout:9/496: dwrite db/d26/d5c/d87/d30/d31/f6c [0,4194304] 0 2024-08-19T00:56:05.349 INFO:tasks.workunit.client.0.smithi017.stdout:6/67: getdents d5/d6 0 2024-08-19T00:56:05.352 INFO:tasks.workunit.client.1.smithi086.stdout:1/570: dwrite d4/d7/f37 [0,4194304] 0 2024-08-19T00:56:05.353 INFO:tasks.workunit.client.0.smithi017.stdout:6/68: rename d5/d6 to d5/df/d11 0 2024-08-19T00:56:05.354 INFO:tasks.workunit.client.0.smithi017.stdout:6/69: rename d5/df to d5/df/d12 22 2024-08-19T00:56:05.356 INFO:tasks.workunit.client.1.smithi086.stdout:8/482: rename dc/d70/d8f/d93 to dc/d70/d7a/d9b 0 2024-08-19T00:56:05.357 INFO:tasks.workunit.client.0.smithi017.stdout:5/102: creat db/f2a x:0 0 0 2024-08-19T00:56:05.358 INFO:tasks.workunit.client.1.smithi086.stdout:8/483: truncate dc/d70/d7a/f97 123835 0 2024-08-19T00:56:05.360 INFO:tasks.workunit.client.1.smithi086.stdout:8/484: dread dc/f36 [4194304,4194304] 0 2024-08-19T00:56:05.360 INFO:tasks.workunit.client.1.smithi086.stdout:3/500: dread d3/d26/d2b/f6d [0,4194304] 0 2024-08-19T00:56:05.362 INFO:tasks.workunit.client.1.smithi086.stdout:8/485: fdatasync dc/d16/d18/d29/d2e/d28/f45 0 2024-08-19T00:56:05.363 INFO:tasks.workunit.client.1.smithi086.stdout:8/486: dread - dc/d16/d18/d29/d2e/d28/d41/f78 zero size 2024-08-19T00:56:05.363 INFO:tasks.workunit.client.0.smithi017.stdout:5/103: rmdir db/d19/d1f/d15 39 2024-08-19T00:56:05.368 INFO:tasks.workunit.client.1.smithi086.stdout:1/571: chown d4/d7/d2a/d36/l38 4206697 1 2024-08-19T00:56:05.369 INFO:tasks.workunit.client.1.smithi086.stdout:8/487: dwrite dc/f12 [8388608,4194304] 0 2024-08-19T00:56:05.369 INFO:tasks.workunit.client.1.smithi086.stdout:1/572: truncate d4/d7/f5e 4389808 0 2024-08-19T00:56:05.370 INFO:tasks.workunit.client.0.smithi017.stdout:5/104: dwrite f6 [4194304,4194304] 0 2024-08-19T00:56:05.371 INFO:tasks.workunit.client.1.smithi086.stdout:6/509: rename db/d34/d4e/d55 to db/d37/d41/da7 0 2024-08-19T00:56:05.371 INFO:tasks.workunit.client.1.smithi086.stdout:6/510: chown db/d37/c1c 189898 1 2024-08-19T00:56:05.372 INFO:tasks.workunit.client.1.smithi086.stdout:4/443: symlink d2/d18/d33/l94 0 2024-08-19T00:56:05.373 INFO:tasks.workunit.client.0.smithi017.stdout:0/85: fsync d5/fc 0 2024-08-19T00:56:05.374 INFO:tasks.workunit.client.1.smithi086.stdout:3/501: rmdir d3/d18/d27/d49/d3f/d5b/d8f 39 2024-08-19T00:56:05.379 INFO:tasks.workunit.client.0.smithi017.stdout:5/105: dwrite f6 [0,4194304] 0 2024-08-19T00:56:05.380 INFO:tasks.workunit.client.0.smithi017.stdout:5/106: readlink db/l17 0 2024-08-19T00:56:05.383 INFO:tasks.workunit.client.0.smithi017.stdout:0/86: creat d5/d17/f1a x:0 0 0 2024-08-19T00:56:05.384 INFO:tasks.workunit.client.0.smithi017.stdout:6/70: rename d5/df to d5/d13 0 2024-08-19T00:56:05.387 INFO:tasks.workunit.client.1.smithi086.stdout:8/488: chown dc/c13 1540792925 1 2024-08-19T00:56:05.389 INFO:tasks.workunit.client.0.smithi017.stdout:0/87: unlink d5/l15 0 2024-08-19T00:56:05.389 INFO:tasks.workunit.client.0.smithi017.stdout:5/107: dread f7 [0,4194304] 0 2024-08-19T00:56:05.389 INFO:tasks.workunit.client.1.smithi086.stdout:2/465: truncate d8/d24/d32/d4d/f7d 4038509 0 2024-08-19T00:56:05.394 INFO:tasks.workunit.client.1.smithi086.stdout:4/444: symlink d2/d18/d33/d42/d72/d78/l95 0 2024-08-19T00:56:05.396 INFO:tasks.workunit.client.1.smithi086.stdout:3/502: truncate d3/d26/d2b/d33/d4a/d57/d8a/fa4 150154 0 2024-08-19T00:56:05.397 INFO:tasks.workunit.client.1.smithi086.stdout:7/529: link d3/de/f59 d3/de/fa6 0 2024-08-19T00:56:05.397 INFO:tasks.workunit.client.0.smithi017.stdout:5/108: mknod db/d19/c2b 0 2024-08-19T00:56:05.398 INFO:tasks.workunit.client.1.smithi086.stdout:0/502: getdents da/d14/d26 0 2024-08-19T00:56:05.399 INFO:tasks.workunit.client.1.smithi086.stdout:1/573: getdents d4/d7/d2a/d36/d3a/d41 0 2024-08-19T00:56:05.400 INFO:tasks.workunit.client.1.smithi086.stdout:1/574: stat d4/d7/d2a/d36/l38 0 2024-08-19T00:56:05.401 INFO:tasks.workunit.client.0.smithi017.stdout:0/88: getdents d5/d18 0 2024-08-19T00:56:05.402 INFO:tasks.workunit.client.1.smithi086.stdout:3/503: dwrite d3/d18/d19/d37/f7f [0,4194304] 0 2024-08-19T00:56:05.404 INFO:tasks.workunit.client.1.smithi086.stdout:5/483: rename d0/d20/l6a to d0/d8/d70/l90 0 2024-08-19T00:56:05.406 INFO:tasks.workunit.client.0.smithi017.stdout:5/109: symlink db/l2c 0 2024-08-19T00:56:05.407 INFO:tasks.workunit.client.1.smithi086.stdout:6/511: mknod db/d34/d4e/d68/d99/ca8 0 2024-08-19T00:56:05.411 INFO:tasks.workunit.client.0.smithi017.stdout:0/89: mkdir d5/d1b 0 2024-08-19T00:56:05.411 INFO:tasks.workunit.client.0.smithi017.stdout:6/71: dwrite f2 [0,4194304] 0 2024-08-19T00:56:05.413 INFO:tasks.workunit.client.0.smithi017.stdout:6/72: read f3 [1419923,80193] 0 2024-08-19T00:56:05.414 INFO:tasks.workunit.client.0.smithi017.stdout:5/110: write f5 [3396372,15902] 0 2024-08-19T00:56:05.416 INFO:tasks.workunit.client.0.smithi017.stdout:6/73: truncate d5/d13/d11/fc 237360 0 2024-08-19T00:56:05.418 INFO:tasks.workunit.client.1.smithi086.stdout:0/503: symlink da/d14/d26/la7 0 2024-08-19T00:56:05.418 INFO:tasks.workunit.client.1.smithi086.stdout:2/466: creat d8/d43/d77/f9a x:0 0 0 2024-08-19T00:56:05.419 INFO:tasks.workunit.client.0.smithi017.stdout:0/90: creat d5/f1c x:0 0 0 2024-08-19T00:56:05.421 INFO:tasks.workunit.client.1.smithi086.stdout:8/489: rename dc/d16/d18/d29/d2e/d28/d41/c46 to dc/d16/d18/d29/d2e/d28/d2b/c9c 0 2024-08-19T00:56:05.424 INFO:tasks.workunit.client.0.smithi017.stdout:6/74: fdatasync d5/d13/d11/fd 0 2024-08-19T00:56:05.424 INFO:tasks.workunit.client.0.smithi017.stdout:5/111: dwrite fa [0,4194304] 0 2024-08-19T00:56:05.426 INFO:tasks.workunit.client.0.smithi017.stdout:0/91: chown d5/le 1797618654 1 2024-08-19T00:56:05.431 INFO:tasks.workunit.client.0.smithi017.stdout:0/92: creat d5/d1b/f1d x:0 0 0 2024-08-19T00:56:05.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:05 smithi017 ceph-mon[16627]: pgmap v13: 65 pgs: 65 active+clean; 897 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.5 MiB/s rd, 104 MiB/s wr, 274 op/s 2024-08-19T00:56:05.433 INFO:tasks.workunit.client.0.smithi017.stdout:5/112: symlink db/d19/d1f/d15/d1e/l2d 0 2024-08-19T00:56:05.443 INFO:tasks.workunit.client.0.smithi017.stdout:0/93: dwrite d5/f1c [0,4194304] 0 2024-08-19T00:56:05.444 INFO:tasks.workunit.client.1.smithi086.stdout:5/484: rmdir d0/d5f/d60/d5b 39 2024-08-19T00:56:05.445 INFO:tasks.workunit.client.1.smithi086.stdout:7/530: fsync d3/d34/d44/d58/d4b/da5/fa3 0 2024-08-19T00:56:05.445 INFO:tasks.workunit.client.0.smithi017.stdout:5/113: dwrite db/f10 [0,4194304] 0 2024-08-19T00:56:05.445 INFO:tasks.workunit.client.1.smithi086.stdout:8/490: truncate dc/d1f/f27 9185450 0 2024-08-19T00:56:05.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:05 smithi086 ceph-mon[24511]: pgmap v13: 65 pgs: 65 active+clean; 897 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 9.5 MiB/s rd, 104 MiB/s wr, 274 op/s 2024-08-19T00:56:05.446 INFO:tasks.workunit.client.1.smithi086.stdout:0/504: mknod da/d14/d1a/d2e/ca8 0 2024-08-19T00:56:05.446 INFO:tasks.workunit.client.1.smithi086.stdout:8/491: readlink dc/d16/d18/d29/d2e/d28/d2b/l85 0 2024-08-19T00:56:05.447 INFO:tasks.workunit.client.1.smithi086.stdout:2/467: creat d8/d43/d65/f9b x:0 0 0 2024-08-19T00:56:05.450 INFO:tasks.workunit.client.0.smithi017.stdout:6/75: dwrite d5/d13/d11/fe [0,4194304] 0 2024-08-19T00:56:05.453 INFO:tasks.workunit.client.0.smithi017.stdout:0/94: creat d5/d18/f1e x:0 0 0 2024-08-19T00:56:05.453 INFO:tasks.workunit.client.0.smithi017.stdout:0/95: fdatasync d5/fc 0 2024-08-19T00:56:05.455 INFO:tasks.workunit.client.0.smithi017.stdout:0/96: write d5/f1c [2883868,120156] 0 2024-08-19T00:56:05.458 INFO:tasks.workunit.client.0.smithi017.stdout:6/76: creat d5/d13/f14 x:0 0 0 2024-08-19T00:56:05.459 INFO:tasks.workunit.client.0.smithi017.stdout:6/77: chown f4 1069536 1 2024-08-19T00:56:05.459 INFO:tasks.workunit.client.0.smithi017.stdout:6/78: chown d5 2 1 2024-08-19T00:56:05.460 INFO:tasks.workunit.client.0.smithi017.stdout:5/114: rename f5 to db/f2e 0 2024-08-19T00:56:05.462 INFO:tasks.workunit.client.0.smithi017.stdout:5/115: write db/d19/d1f/d15/f25 [641137,122681] 0 2024-08-19T00:56:05.462 INFO:tasks.workunit.client.0.smithi017.stdout:0/97: rename c3 to d5/d1b/c1f 0 2024-08-19T00:56:05.465 INFO:tasks.workunit.client.0.smithi017.stdout:6/79: rename d5/d13/d11/l7 to d5/l15 0 2024-08-19T00:56:05.466 INFO:tasks.workunit.client.0.smithi017.stdout:0/98: mkdir d5/d1b/d20 0 2024-08-19T00:56:05.467 INFO:tasks.workunit.client.0.smithi017.stdout:0/99: fdatasync d5/fc 0 2024-08-19T00:56:05.469 INFO:tasks.workunit.client.0.smithi017.stdout:0/100: dread - d5/d18/f1e zero size 2024-08-19T00:56:05.471 INFO:tasks.workunit.client.0.smithi017.stdout:0/101: read - d5/d1b/f1d zero size 2024-08-19T00:56:05.471 INFO:tasks.workunit.client.0.smithi017.stdout:5/116: dwrite db/d19/d1f/f1c [0,4194304] 0 2024-08-19T00:56:05.474 INFO:tasks.workunit.client.0.smithi017.stdout:0/102: mkdir d5/d17/d21 0 2024-08-19T00:56:05.475 INFO:tasks.workunit.client.0.smithi017.stdout:5/117: creat db/d19/d1f/d15/f2f x:0 0 0 2024-08-19T00:56:05.476 INFO:tasks.workunit.client.1.smithi086.stdout:4/445: rename d2/d18/f6f to d2/d18/d33/d42/d72/f96 0 2024-08-19T00:56:05.476 INFO:tasks.workunit.client.0.smithi017.stdout:0/103: creat d5/d17/f22 x:0 0 0 2024-08-19T00:56:05.477 INFO:tasks.workunit.client.0.smithi017.stdout:5/118: truncate db/d19/d1f/d15/f25 1050924 0 2024-08-19T00:56:05.478 INFO:tasks.workunit.client.0.smithi017.stdout:5/119: chown db/d19/d1f/d15/f2f 1666712914 1 2024-08-19T00:56:05.479 INFO:tasks.workunit.client.1.smithi086.stdout:8/492: creat dc/d70/d99/f9d x:0 0 0 2024-08-19T00:56:05.479 INFO:tasks.workunit.client.1.smithi086.stdout:9/497: sync 2024-08-19T00:56:05.480 INFO:tasks.workunit.client.0.smithi017.stdout:6/80: getdents d5/d13/d11 0 2024-08-19T00:56:05.481 INFO:tasks.workunit.client.0.smithi017.stdout:0/104: creat d5/d18/f23 x:0 0 0 2024-08-19T00:56:05.482 INFO:tasks.workunit.client.0.smithi017.stdout:0/105: truncate d5/d18/f23 230515 0 2024-08-19T00:56:05.482 INFO:tasks.workunit.client.1.smithi086.stdout:3/504: rename d3/d26/d2b/d33/d4a/l8b to d3/la9 0 2024-08-19T00:56:05.483 INFO:tasks.workunit.client.1.smithi086.stdout:0/505: dread da/d14/f15 [0,4194304] 0 2024-08-19T00:56:05.484 INFO:tasks.workunit.client.0.smithi017.stdout:5/120: mkdir db/d19/d1f/d15/d30 0 2024-08-19T00:56:05.485 INFO:tasks.workunit.client.1.smithi086.stdout:2/468: dwrite d8/d43/f86 [0,4194304] 0 2024-08-19T00:56:05.485 INFO:tasks.workunit.client.1.smithi086.stdout:0/506: readlink da/d14/d55/l9a 0 2024-08-19T00:56:05.486 INFO:tasks.workunit.client.1.smithi086.stdout:4/446: creat d2/d18/d33/d42/d72/d78/d25/d30/f97 x:0 0 0 2024-08-19T00:56:05.486 INFO:tasks.workunit.client.0.smithi017.stdout:6/81: creat d5/d13/f16 x:0 0 0 2024-08-19T00:56:05.487 INFO:tasks.workunit.client.1.smithi086.stdout:0/507: write da/d14/d1a/d2e/d39/d3b/f70 [840787,3544] 0 2024-08-19T00:56:05.492 INFO:tasks.workunit.client.1.smithi086.stdout:7/531: rename d3/d34/d44/d58/d4b/f7b to d3/de/d68/d7d/fa7 0 2024-08-19T00:56:05.493 INFO:tasks.workunit.client.1.smithi086.stdout:3/505: mknod d3/d9/caa 0 2024-08-19T00:56:05.494 INFO:tasks.workunit.client.1.smithi086.stdout:7/532: dread d3/f97 [0,4194304] 0 2024-08-19T00:56:05.495 INFO:tasks.workunit.client.1.smithi086.stdout:3/506: write d3/d18/d19/f68 [1543333,1156] 0 2024-08-19T00:56:05.495 INFO:tasks.workunit.client.1.smithi086.stdout:2/469: mknod d8/d2c/d38/d80/c9c 0 2024-08-19T00:56:05.495 INFO:tasks.workunit.client.0.smithi017.stdout:6/82: dwrite d5/d13/d11/fd [0,4194304] 0 2024-08-19T00:56:05.497 INFO:tasks.workunit.client.0.smithi017.stdout:5/121: mknod db/d19/c31 0 2024-08-19T00:56:05.497 INFO:tasks.workunit.client.1.smithi086.stdout:8/493: creat dc/d16/d18/d29/d2e/d28/d41/d9a/f9e x:0 0 0 2024-08-19T00:56:05.498 INFO:tasks.workunit.client.0.smithi017.stdout:5/122: chown db/d19/c26 249 1 2024-08-19T00:56:05.500 INFO:tasks.workunit.client.0.smithi017.stdout:6/83: mknod d5/c17 0 2024-08-19T00:56:05.504 INFO:tasks.workunit.client.1.smithi086.stdout:9/498: dread db/d26/d5c/d87/d30/d58/f5b [0,4194304] 0 2024-08-19T00:56:05.504 INFO:tasks.workunit.client.0.smithi017.stdout:6/84: creat d5/f18 x:0 0 0 2024-08-19T00:56:05.506 INFO:tasks.workunit.client.0.smithi017.stdout:5/123: dwrite db/f20 [0,4194304] 0 2024-08-19T00:56:05.506 INFO:tasks.workunit.client.1.smithi086.stdout:0/508: rename da/d14/d55/da5 to da/d5d/da9 0 2024-08-19T00:56:05.507 INFO:tasks.workunit.client.1.smithi086.stdout:0/509: truncate da/d14/f6f 8450238 0 2024-08-19T00:56:05.508 INFO:tasks.workunit.client.0.smithi017.stdout:5/124: truncate db/d19/d1f/d15/d1e/f27 550572 0 2024-08-19T00:56:05.509 INFO:tasks.workunit.client.0.smithi017.stdout:6/85: symlink d5/l19 0 2024-08-19T00:56:05.511 INFO:tasks.workunit.client.1.smithi086.stdout:3/507: readlink d3/d9/l5f 0 2024-08-19T00:56:05.513 INFO:tasks.workunit.client.1.smithi086.stdout:3/508: chown d3/d18/d19/d62/f9c 7177 1 2024-08-19T00:56:05.515 INFO:tasks.workunit.client.0.smithi017.stdout:6/86: rename d5/d13/d11/fe to d5/f1a 0 2024-08-19T00:56:05.516 INFO:tasks.workunit.client.0.smithi017.stdout:0/106: truncate d5/f12 2433827 0 2024-08-19T00:56:05.517 INFO:tasks.workunit.client.0.smithi017.stdout:6/87: creat d5/d13/f1b x:0 0 0 2024-08-19T00:56:05.518 INFO:tasks.workunit.client.1.smithi086.stdout:8/494: chown dc/d17/d1e/d49/l5e 866 1 2024-08-19T00:56:05.519 INFO:tasks.workunit.client.0.smithi017.stdout:6/88: dread d5/d13/d11/fa [0,4194304] 0 2024-08-19T00:56:05.519 INFO:tasks.workunit.client.1.smithi086.stdout:3/509: dwrite d3/d18/d27/d49/d3f/f89 [0,4194304] 0 2024-08-19T00:56:05.520 INFO:tasks.workunit.client.0.smithi017.stdout:6/89: write d5/f18 [226200,79450] 0 2024-08-19T00:56:05.520 INFO:tasks.workunit.client.1.smithi086.stdout:0/510: dread - da/d14/d26/f8d zero size 2024-08-19T00:56:05.521 INFO:tasks.workunit.client.0.smithi017.stdout:6/90: write d5/d13/d11/fc [451173,55458] 0 2024-08-19T00:56:05.523 INFO:tasks.workunit.client.0.smithi017.stdout:6/91: chown d5/f8 134350701 1 2024-08-19T00:56:05.523 INFO:tasks.workunit.client.1.smithi086.stdout:8/495: mkdir dc/d1f/d37/d9f 0 2024-08-19T00:56:05.524 INFO:tasks.workunit.client.1.smithi086.stdout:9/499: mknod db/dd/d19/d38/ca6 0 2024-08-19T00:56:05.524 INFO:tasks.workunit.client.1.smithi086.stdout:8/496: chown dc/d16/d18/d29/d2e/d83 394458266 1 2024-08-19T00:56:05.525 INFO:tasks.workunit.client.0.smithi017.stdout:6/92: mknod d5/d13/c1c 0 2024-08-19T00:56:05.525 INFO:tasks.workunit.client.1.smithi086.stdout:3/510: read d3/d26/d2b/d33/f41 [147079,59008] 0 2024-08-19T00:56:05.526 INFO:tasks.workunit.client.1.smithi086.stdout:0/511: truncate da/d14/d1a/d2e/f51 875922 0 2024-08-19T00:56:05.526 INFO:tasks.workunit.client.1.smithi086.stdout:7/533: link d3/c25 d3/de/ca8 0 2024-08-19T00:56:05.527 INFO:tasks.workunit.client.1.smithi086.stdout:4/447: dread d2/d18/d33/d42/d72/f62 [0,4194304] 0 2024-08-19T00:56:05.527 INFO:tasks.workunit.client.0.smithi017.stdout:6/93: mknod d5/c1d 0 2024-08-19T00:56:05.527 INFO:tasks.workunit.client.1.smithi086.stdout:8/497: unlink dc/d16/d18/l6b 0 2024-08-19T00:56:05.529 INFO:tasks.workunit.client.1.smithi086.stdout:3/511: creat d3/d18/d1a/d51/d9b/fab x:0 0 0 2024-08-19T00:56:05.530 INFO:tasks.workunit.client.1.smithi086.stdout:3/512: stat d3/d26/d2b/d33/d8d 0 2024-08-19T00:56:05.531 INFO:tasks.workunit.client.1.smithi086.stdout:0/512: symlink da/d14/d55/da4/laa 0 2024-08-19T00:56:05.531 INFO:tasks.workunit.client.1.smithi086.stdout:3/513: write d3/d26/f79 [12465,37487] 0 2024-08-19T00:56:05.532 INFO:tasks.workunit.client.1.smithi086.stdout:3/514: write d3/d26/f73 [5024989,44918] 0 2024-08-19T00:56:05.532 INFO:tasks.workunit.client.1.smithi086.stdout:7/534: link d3/de/f66 d3/d34/d44/d58/fa9 0 2024-08-19T00:56:05.534 INFO:tasks.workunit.client.1.smithi086.stdout:8/498: link dc/d16/d18/d29/d2e/d28/d2b/f79 dc/d17/d1e/d55/fa0 0 2024-08-19T00:56:05.535 INFO:tasks.workunit.client.1.smithi086.stdout:3/515: symlink d3/d26/d60/lac 0 2024-08-19T00:56:05.536 INFO:tasks.workunit.client.1.smithi086.stdout:7/535: creat d3/de/d68/faa x:0 0 0 2024-08-19T00:56:05.537 INFO:tasks.workunit.client.1.smithi086.stdout:3/516: mkdir d3/d18/d1a/d51/dad 0 2024-08-19T00:56:05.538 INFO:tasks.workunit.client.1.smithi086.stdout:7/536: symlink d3/d34/d44/d58/lab 0 2024-08-19T00:56:05.540 INFO:tasks.workunit.client.1.smithi086.stdout:8/499: dwrite dc/f12 [0,4194304] 0 2024-08-19T00:56:05.543 INFO:tasks.workunit.client.1.smithi086.stdout:8/500: unlink dc/f12 0 2024-08-19T00:56:05.545 INFO:tasks.workunit.client.1.smithi086.stdout:3/517: dwrite d3/d9/f39 [0,4194304] 0 2024-08-19T00:56:05.549 INFO:tasks.workunit.client.1.smithi086.stdout:8/501: creat dc/d17/d1e/fa1 x:0 0 0 2024-08-19T00:56:05.553 INFO:tasks.workunit.client.1.smithi086.stdout:8/502: symlink dc/d17/d1e/d82/la2 0 2024-08-19T00:56:05.553 INFO:tasks.workunit.client.1.smithi086.stdout:3/518: dwrite d3/d26/f59 [0,4194304] 0 2024-08-19T00:56:05.554 INFO:tasks.workunit.client.1.smithi086.stdout:7/537: dread d3/d34/d44/d58/d4b/f3d [0,4194304] 0 2024-08-19T00:56:05.555 INFO:tasks.workunit.client.1.smithi086.stdout:3/519: chown d3/d18/d19/d37/d3a/c50 111 1 2024-08-19T00:56:05.555 INFO:tasks.workunit.client.1.smithi086.stdout:8/503: truncate dc/d16/d18/d29/f91 50895 0 2024-08-19T00:56:05.560 INFO:tasks.workunit.client.1.smithi086.stdout:7/538: rename d3/d5b/f6f to d3/d34/d44/d58/d4b/d78/fac 0 2024-08-19T00:56:05.561 INFO:tasks.workunit.client.1.smithi086.stdout:7/539: fsync d3/de/d68/d7a/f8f 0 2024-08-19T00:56:05.561 INFO:tasks.workunit.client.1.smithi086.stdout:3/520: dwrite d3/d18/d61/f96 [0,4194304] 0 2024-08-19T00:56:05.564 INFO:tasks.workunit.client.1.smithi086.stdout:3/521: creat d3/d18/d19/d37/fae x:0 0 0 2024-08-19T00:56:05.566 INFO:tasks.workunit.client.0.smithi017.stdout:4/73: sync 2024-08-19T00:56:05.567 INFO:tasks.workunit.client.0.smithi017.stdout:6/94: truncate d5/d13/f14 162726 0 2024-08-19T00:56:05.569 INFO:tasks.workunit.client.1.smithi086.stdout:7/540: dwrite d3/d34/d44/d58/d4b/f3d [0,4194304] 0 2024-08-19T00:56:05.569 INFO:tasks.workunit.client.0.smithi017.stdout:6/95: dread d5/d13/f14 [0,4194304] 0 2024-08-19T00:56:05.569 INFO:tasks.workunit.client.1.smithi086.stdout:7/541: chown d3/f38 117 1 2024-08-19T00:56:05.571 INFO:tasks.workunit.client.1.smithi086.stdout:1/575: sync 2024-08-19T00:56:05.572 INFO:tasks.workunit.client.0.smithi017.stdout:4/74: symlink d2/d11/l18 0 2024-08-19T00:56:05.575 INFO:tasks.workunit.client.1.smithi086.stdout:3/522: getdents d3/d18/d1a/d51/dad 0 2024-08-19T00:56:05.581 INFO:tasks.workunit.client.0.smithi017.stdout:6/96: write d5/d13/d11/fd [2896151,121495] 0 2024-08-19T00:56:05.582 INFO:tasks.workunit.client.1.smithi086.stdout:1/576: write d4/d7/d2a/d36/f6a [1427112,108246] 0 2024-08-19T00:56:05.583 INFO:tasks.workunit.client.0.smithi017.stdout:4/75: symlink d2/d16/l19 0 2024-08-19T00:56:05.585 INFO:tasks.workunit.client.0.smithi017.stdout:4/76: chown d2/d11/l18 134252 1 2024-08-19T00:56:05.586 INFO:tasks.workunit.client.1.smithi086.stdout:7/542: symlink d3/lad 0 2024-08-19T00:56:05.586 INFO:tasks.workunit.client.0.smithi017.stdout:4/77: stat d2/fc 0 2024-08-19T00:56:05.586 INFO:tasks.workunit.client.1.smithi086.stdout:0/513: dread da/f36 [0,4194304] 0 2024-08-19T00:56:05.589 INFO:tasks.workunit.client.1.smithi086.stdout:1/577: creat d4/d7/d2a/d36/db6/fc0 x:0 0 0 2024-08-19T00:56:05.590 INFO:tasks.workunit.client.0.smithi017.stdout:6/97: dwrite d5/d13/d11/fc [0,4194304] 0 2024-08-19T00:56:05.593 INFO:tasks.workunit.client.0.smithi017.stdout:4/78: rename d2/dd to d2/d1a 0 2024-08-19T00:56:05.596 INFO:tasks.workunit.client.1.smithi086.stdout:3/523: link d3/d26/d2b/d33/d8d/f44 d3/d18/d1a/d51/d75/faf 0 2024-08-19T00:56:05.597 INFO:tasks.workunit.client.0.smithi017.stdout:6/98: creat d5/f1e x:0 0 0 2024-08-19T00:56:05.598 INFO:tasks.workunit.client.1.smithi086.stdout:3/524: write d3/d18/d19/d37/fae [599932,79157] 0 2024-08-19T00:56:05.598 INFO:tasks.workunit.client.1.smithi086.stdout:0/514: creat da/d5d/da9/fab x:0 0 0 2024-08-19T00:56:05.599 INFO:tasks.workunit.client.1.smithi086.stdout:0/515: chown da/f60 1 1 2024-08-19T00:56:05.600 INFO:tasks.workunit.client.0.smithi017.stdout:4/79: symlink d2/l1b 0 2024-08-19T00:56:05.600 INFO:tasks.workunit.client.1.smithi086.stdout:0/516: dread - da/d14/d1a/d2e/d39/d3b/d4e/f77 zero size 2024-08-19T00:56:05.602 INFO:tasks.workunit.client.0.smithi017.stdout:6/99: unlink d5/d13/d11/fc 0 2024-08-19T00:56:05.606 INFO:tasks.workunit.client.0.smithi017.stdout:4/80: rename d2/fa to d2/d1a/f1c 0 2024-08-19T00:56:05.607 INFO:tasks.workunit.client.0.smithi017.stdout:6/100: dread d5/d13/d11/fd [0,4194304] 0 2024-08-19T00:56:05.607 INFO:tasks.workunit.client.1.smithi086.stdout:6/512: sync 2024-08-19T00:56:05.607 INFO:tasks.workunit.client.1.smithi086.stdout:5/485: sync 2024-08-19T00:56:05.607 INFO:tasks.workunit.client.1.smithi086.stdout:3/525: symlink d3/d26/lb0 0 2024-08-19T00:56:05.608 INFO:tasks.workunit.client.0.smithi017.stdout:6/101: chown d5/d13/f16 84354535 1 2024-08-19T00:56:05.608 INFO:tasks.workunit.client.1.smithi086.stdout:6/513: dread - db/d37/d44/f4f zero size 2024-08-19T00:56:05.610 INFO:tasks.workunit.client.1.smithi086.stdout:6/514: dread - db/d34/d69/f75 zero size 2024-08-19T00:56:05.613 INFO:tasks.workunit.client.1.smithi086.stdout:2/470: dwrite d8/d2c/d38/f53 [0,4194304] 0 2024-08-19T00:56:05.614 INFO:tasks.workunit.client.1.smithi086.stdout:1/578: link d4/d7/d2a/d6e/f73 d4/d7/d2a/d36/d63/fc1 0 2024-08-19T00:56:05.615 INFO:tasks.workunit.client.1.smithi086.stdout:5/486: mkdir d0/d2d/d43/d91 0 2024-08-19T00:56:05.617 INFO:tasks.workunit.client.1.smithi086.stdout:6/515: dwrite db/f16 [0,4194304] 0 2024-08-19T00:56:05.618 INFO:tasks.workunit.client.1.smithi086.stdout:1/579: write d4/d7/d2a/d36/d3a/fa4 [1244758,110219] 0 2024-08-19T00:56:05.619 INFO:tasks.workunit.client.1.smithi086.stdout:1/580: readlink d4/d10/l2d 0 2024-08-19T00:56:05.620 INFO:tasks.workunit.client.0.smithi017.stdout:4/81: link d2/d11/f14 d2/d16/f1d 0 2024-08-19T00:56:05.624 INFO:tasks.workunit.client.0.smithi017.stdout:4/82: rename d2/l13 to d2/d16/l1e 0 2024-08-19T00:56:05.625 INFO:tasks.workunit.client.1.smithi086.stdout:1/581: write d4/d7/d2a/f33 [326761,98315] 0 2024-08-19T00:56:05.626 INFO:tasks.workunit.client.1.smithi086.stdout:2/471: creat d8/d24/d32/f9d x:0 0 0 2024-08-19T00:56:05.627 INFO:tasks.workunit.client.0.smithi017.stdout:4/83: creat d2/d16/f1f x:0 0 0 2024-08-19T00:56:05.631 INFO:tasks.workunit.client.1.smithi086.stdout:1/582: readlink d4/d7/l17 0 2024-08-19T00:56:05.631 INFO:tasks.workunit.client.0.smithi017.stdout:4/84: mkdir d2/d1a/d20 0 2024-08-19T00:56:05.634 INFO:tasks.workunit.client.1.smithi086.stdout:9/500: dwrite db/f1b [0,4194304] 0 2024-08-19T00:56:05.635 INFO:tasks.workunit.client.1.smithi086.stdout:0/517: dwrite da/d14/d26/f2b [0,4194304] 0 2024-08-19T00:56:05.635 INFO:tasks.workunit.client.1.smithi086.stdout:2/472: write d8/d43/d65/f70 [2314005,127039] 0 2024-08-19T00:56:05.636 INFO:tasks.workunit.client.1.smithi086.stdout:1/583: chown d4/d7/d2a/d36 3756 1 2024-08-19T00:56:05.636 INFO:tasks.workunit.client.1.smithi086.stdout:4/448: dwrite d2/d18/f28 [4194304,4194304] 0 2024-08-19T00:56:05.637 INFO:tasks.workunit.client.1.smithi086.stdout:2/473: stat d8/d43/f63 0 2024-08-19T00:56:05.639 INFO:tasks.workunit.client.1.smithi086.stdout:3/526: getdents d3/d18/d27 0 2024-08-19T00:56:05.640 INFO:tasks.workunit.client.1.smithi086.stdout:0/518: chown da/f10 6746 1 2024-08-19T00:56:05.640 INFO:tasks.workunit.client.1.smithi086.stdout:2/474: fdatasync d8/d43/d65/f9b 0 2024-08-19T00:56:05.646 INFO:tasks.workunit.client.1.smithi086.stdout:2/475: dwrite d8/d24/f35 [4194304,4194304] 0 2024-08-19T00:56:05.648 INFO:tasks.workunit.client.1.smithi086.stdout:2/476: truncate d8/d2c/d47/f58 1022884 0 2024-08-19T00:56:05.651 INFO:tasks.workunit.client.1.smithi086.stdout:5/487: rmdir d0/d8/d70/d8e 0 2024-08-19T00:56:05.659 INFO:tasks.workunit.client.1.smithi086.stdout:0/519: mkdir da/d14/d55/dac 0 2024-08-19T00:56:05.660 INFO:tasks.workunit.client.1.smithi086.stdout:8/504: dwrite dc/f75 [0,4194304] 0 2024-08-19T00:56:05.660 INFO:tasks.workunit.client.1.smithi086.stdout:4/449: mknod d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/c98 0 2024-08-19T00:56:05.662 INFO:tasks.workunit.client.1.smithi086.stdout:4/450: dread - d2/d18/d33/d42/d72/d78/f6d zero size 2024-08-19T00:56:05.663 INFO:tasks.workunit.client.1.smithi086.stdout:2/477: read d8/f19 [2973844,50788] 0 2024-08-19T00:56:05.665 INFO:tasks.workunit.client.1.smithi086.stdout:9/501: rename db/d26/d5c/d87/d30/d3f/d43/d84 to db/d96/da7 0 2024-08-19T00:56:05.672 INFO:tasks.workunit.client.1.smithi086.stdout:4/451: creat d2/d18/d33/d42/d72/d78/d25/d6b/f99 x:0 0 0 2024-08-19T00:56:05.674 INFO:tasks.workunit.client.1.smithi086.stdout:1/584: dread d4/d10/f25 [0,4194304] 0 2024-08-19T00:56:05.676 INFO:tasks.workunit.client.1.smithi086.stdout:2/478: mkdir d8/d14/d9e 0 2024-08-19T00:56:05.676 INFO:tasks.workunit.client.1.smithi086.stdout:3/527: link d3/d18/d27/d49/d3f/d54/f94 d3/d26/d2b/fb1 0 2024-08-19T00:56:05.676 INFO:tasks.workunit.client.1.smithi086.stdout:2/479: write f2 [762967,114022] 0 2024-08-19T00:56:05.677 INFO:tasks.workunit.client.1.smithi086.stdout:3/528: fdatasync d3/d26/f59 0 2024-08-19T00:56:05.678 INFO:tasks.workunit.client.1.smithi086.stdout:4/452: symlink d2/l9a 0 2024-08-19T00:56:05.678 INFO:tasks.workunit.client.1.smithi086.stdout:2/480: chown d8/f19 722 1 2024-08-19T00:56:05.679 INFO:tasks.workunit.client.1.smithi086.stdout:3/529: chown d3/d18/d19/d37/d5a/f9d 0 1 2024-08-19T00:56:05.680 INFO:tasks.workunit.client.1.smithi086.stdout:1/585: truncate d4/d7/d2a/d36/d3a/d41/f67 590220 0 2024-08-19T00:56:05.683 INFO:tasks.workunit.client.1.smithi086.stdout:3/530: creat d3/d9/fb2 x:0 0 0 2024-08-19T00:56:05.684 INFO:tasks.workunit.client.1.smithi086.stdout:2/481: mknod d8/d14/c9f 0 2024-08-19T00:56:05.686 INFO:tasks.workunit.client.1.smithi086.stdout:4/453: link d2/d18/d33/d42/f61 d2/d18/d33/d42/d72/d78/d25/d6b/f9b 0 2024-08-19T00:56:05.686 INFO:tasks.workunit.client.1.smithi086.stdout:7/543: dwrite d3/de/d2d/f31 [0,4194304] 0 2024-08-19T00:56:05.686 INFO:tasks.workunit.client.1.smithi086.stdout:5/488: dread d0/d20/f22 [0,4194304] 0 2024-08-19T00:56:05.688 INFO:tasks.workunit.client.1.smithi086.stdout:2/482: symlink d8/d43/d77/la0 0 2024-08-19T00:56:05.688 INFO:tasks.workunit.client.1.smithi086.stdout:3/531: chown d3/d18/d1a/d51/d75/faf 0 1 2024-08-19T00:56:05.689 INFO:tasks.workunit.client.1.smithi086.stdout:5/489: fsync d0/f29 0 2024-08-19T00:56:05.692 INFO:tasks.workunit.client.1.smithi086.stdout:2/483: stat d8/d2c/d47/f7a 0 2024-08-19T00:56:05.692 INFO:tasks.workunit.client.1.smithi086.stdout:6/516: write db/f2b [777046,115275] 0 2024-08-19T00:56:05.697 INFO:tasks.workunit.client.1.smithi086.stdout:3/532: creat d3/d18/d61/d85/fb3 x:0 0 0 2024-08-19T00:56:05.699 INFO:tasks.workunit.client.1.smithi086.stdout:0/520: dread da/f56 [0,4194304] 0 2024-08-19T00:56:05.699 INFO:tasks.workunit.client.1.smithi086.stdout:1/586: dwrite d4/d10/f25 [0,4194304] 0 2024-08-19T00:56:05.703 INFO:tasks.workunit.client.1.smithi086.stdout:6/517: read db/f18 [1825545,20337] 0 2024-08-19T00:56:05.704 INFO:tasks.workunit.client.1.smithi086.stdout:8/505: dread dc/d1f/f27 [4194304,4194304] 0 2024-08-19T00:56:05.706 INFO:tasks.workunit.client.1.smithi086.stdout:3/533: read - d3/d18/d19/d37/d5a/fa0 zero size 2024-08-19T00:56:05.707 INFO:tasks.workunit.client.1.smithi086.stdout:4/454: rename d2/d18/d33/d42/d72/d78/f87 to d2/d18/d33/d42/d72/d78/d25/d55/d6c/f9c 0 2024-08-19T00:56:05.709 INFO:tasks.workunit.client.1.smithi086.stdout:8/506: chown dc/d17/d1e/d49 2 1 2024-08-19T00:56:05.711 INFO:tasks.workunit.client.1.smithi086.stdout:2/484: dread d8/f36 [0,4194304] 0 2024-08-19T00:56:05.712 INFO:tasks.workunit.client.1.smithi086.stdout:7/544: dwrite d3/d34/d44/f71 [0,4194304] 0 2024-08-19T00:56:05.712 INFO:tasks.workunit.client.1.smithi086.stdout:5/490: dwrite d0/d8/d70/f87 [0,4194304] 0 2024-08-19T00:56:05.713 INFO:tasks.workunit.client.1.smithi086.stdout:4/455: write d2/d18/f28 [8125593,63426] 0 2024-08-19T00:56:05.713 INFO:tasks.workunit.client.1.smithi086.stdout:0/521: symlink da/lad 0 2024-08-19T00:56:05.717 INFO:tasks.workunit.client.1.smithi086.stdout:8/507: symlink dc/d1f/d37/la3 0 2024-08-19T00:56:05.719 INFO:tasks.workunit.client.1.smithi086.stdout:1/587: dread d4/d7/d2a/d36/f6a [0,4194304] 0 2024-08-19T00:56:05.720 INFO:tasks.workunit.client.1.smithi086.stdout:5/491: stat d0/d5f/d60/d57/f58 0 2024-08-19T00:56:05.721 INFO:tasks.workunit.client.1.smithi086.stdout:4/456: readlink d2/d18/d33/d42/d72/l15 0 2024-08-19T00:56:05.721 INFO:tasks.workunit.client.1.smithi086.stdout:0/522: symlink da/d14/d44/d49/lae 0 2024-08-19T00:56:05.722 INFO:tasks.workunit.client.1.smithi086.stdout:2/485: truncate d8/d24/d32/d61/f7e 593946 0 2024-08-19T00:56:05.723 INFO:tasks.workunit.client.1.smithi086.stdout:6/518: dwrite db/d37/d41/da7/f97 [0,4194304] 0 2024-08-19T00:56:05.723 INFO:tasks.workunit.client.1.smithi086.stdout:1/588: stat d4/d7/d2a/d36/d61 0 2024-08-19T00:56:05.726 INFO:tasks.workunit.client.1.smithi086.stdout:2/486: write d8/d24/d32/f9d [966584,14109] 0 2024-08-19T00:56:05.726 INFO:tasks.workunit.client.1.smithi086.stdout:5/492: chown d0/d5f/c6c 663447544 1 2024-08-19T00:56:05.726 INFO:tasks.workunit.client.1.smithi086.stdout:7/545: getdents d3/de/d68 0 2024-08-19T00:56:05.727 INFO:tasks.workunit.client.1.smithi086.stdout:8/508: symlink dc/d16/d18/d29/d2e/d28/d2b/d3b/d87/la4 0 2024-08-19T00:56:05.728 INFO:tasks.workunit.client.1.smithi086.stdout:1/589: mkdir d4/d10/dc2 0 2024-08-19T00:56:05.729 INFO:tasks.workunit.client.1.smithi086.stdout:4/457: creat d2/d18/d33/d42/d72/d78/d25/f9d x:0 0 0 2024-08-19T00:56:05.730 INFO:tasks.workunit.client.1.smithi086.stdout:6/519: mknod db/d34/ca9 0 2024-08-19T00:56:05.734 INFO:tasks.workunit.client.1.smithi086.stdout:8/509: dwrite f5 [0,4194304] 0 2024-08-19T00:56:05.734 INFO:tasks.workunit.client.1.smithi086.stdout:7/546: dread d3/d34/d44/f71 [0,4194304] 0 2024-08-19T00:56:05.735 INFO:tasks.workunit.client.1.smithi086.stdout:5/493: creat d0/d5f/d60/d57/f92 x:0 0 0 2024-08-19T00:56:05.737 INFO:tasks.workunit.client.1.smithi086.stdout:6/520: readlink db/lf 0 2024-08-19T00:56:05.737 INFO:tasks.workunit.client.1.smithi086.stdout:5/494: truncate d0/fa 4574807 0 2024-08-19T00:56:05.737 INFO:tasks.workunit.client.1.smithi086.stdout:0/523: getdents da/d14/d1a/d2e/d66 0 2024-08-19T00:56:05.738 INFO:tasks.workunit.client.1.smithi086.stdout:4/458: mkdir d2/d18/d33/d42/d72/d78/d9e 0 2024-08-19T00:56:05.741 INFO:tasks.workunit.client.1.smithi086.stdout:4/459: read - d2/d18/d33/d42/d72/d78/d25/d30/f97 zero size 2024-08-19T00:56:05.742 INFO:tasks.workunit.client.1.smithi086.stdout:7/547: write d3/d34/d44/f48 [589264,109399] 0 2024-08-19T00:56:05.743 INFO:tasks.workunit.client.1.smithi086.stdout:0/524: rename da/d14/d55/da4 to da/d14/d1a/d2e/d39/d3b/d89/daf 0 2024-08-19T00:56:05.746 INFO:tasks.workunit.client.1.smithi086.stdout:4/460: write d2/d18/d33/f36 [2169080,11126] 0 2024-08-19T00:56:05.746 INFO:tasks.workunit.client.1.smithi086.stdout:8/510: dread dc/f1c [0,4194304] 0 2024-08-19T00:56:05.746 INFO:tasks.workunit.client.1.smithi086.stdout:7/548: read d3/d5b/f6e [37209,59260] 0 2024-08-19T00:56:05.747 INFO:tasks.workunit.client.0.smithi017.stdout:7/133: sync 2024-08-19T00:56:05.747 INFO:tasks.workunit.client.1.smithi086.stdout:1/590: getdents d4/d7/d2a/d36/d50/d9c 0 2024-08-19T00:56:05.750 INFO:tasks.workunit.client.0.smithi017.stdout:7/134: chown d3/lb 0 1 2024-08-19T00:56:05.750 INFO:tasks.workunit.client.1.smithi086.stdout:7/549: write d3/d34/d44/d58/d4b/d78/f5a [1851729,117971] 0 2024-08-19T00:56:05.750 INFO:tasks.workunit.client.0.smithi017.stdout:7/135: fdatasync d3/f1e 0 2024-08-19T00:56:05.751 INFO:tasks.workunit.client.1.smithi086.stdout:0/525: creat da/d14/d1a/d2e/d39/d3b/d4e/fb0 x:0 0 0 2024-08-19T00:56:05.751 INFO:tasks.workunit.client.1.smithi086.stdout:4/461: truncate d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/f7f 173725 0 2024-08-19T00:56:05.752 INFO:tasks.workunit.client.1.smithi086.stdout:7/550: write d3/d34/d44/d58/d4b/da5/f9b [367913,114930] 0 2024-08-19T00:56:05.753 INFO:tasks.workunit.client.0.smithi017.stdout:7/136: symlink d3/dc/df/d23/l2d 0 2024-08-19T00:56:05.754 INFO:tasks.workunit.client.1.smithi086.stdout:5/495: link d0/d2d/c78 d0/df/d1f/c93 0 2024-08-19T00:56:05.756 INFO:tasks.workunit.client.1.smithi086.stdout:5/496: write d0/d5f/d60/f83 [2075758,46578] 0 2024-08-19T00:56:05.756 INFO:tasks.workunit.client.1.smithi086.stdout:6/521: getdents db/d37 0 2024-08-19T00:56:05.757 INFO:tasks.workunit.client.0.smithi017.stdout:7/137: truncate d3/f12 748437 0 2024-08-19T00:56:05.757 INFO:tasks.workunit.client.1.smithi086.stdout:6/522: chown db/d34/d69 145992 1 2024-08-19T00:56:05.757 INFO:tasks.workunit.client.1.smithi086.stdout:1/591: rmdir d4/d7/d2a/d36/d50 39 2024-08-19T00:56:05.758 INFO:tasks.workunit.client.1.smithi086.stdout:6/523: chown db/d37/f24 110730195 1 2024-08-19T00:56:05.759 INFO:tasks.workunit.client.1.smithi086.stdout:8/511: creat dc/d16/d18/d29/d2e/d28/d2b/fa5 x:0 0 0 2024-08-19T00:56:05.760 INFO:tasks.workunit.client.1.smithi086.stdout:4/462: dread d2/d18/d33/d42/d72/f16 [0,4194304] 0 2024-08-19T00:56:05.761 INFO:tasks.workunit.client.1.smithi086.stdout:0/526: unlink da/d14/d1a/d2e/ca8 0 2024-08-19T00:56:05.762 INFO:tasks.workunit.client.1.smithi086.stdout:8/512: read dc/d16/d18/d29/d2e/d28/d2b/f38 [2104,19070] 0 2024-08-19T00:56:05.766 INFO:tasks.workunit.client.1.smithi086.stdout:8/513: write dc/d70/d7a/d9b/f71 [459586,60608] 0 2024-08-19T00:56:05.767 INFO:tasks.workunit.client.1.smithi086.stdout:1/592: dwrite d4/d10/f4f [0,4194304] 0 2024-08-19T00:56:05.768 INFO:tasks.workunit.client.1.smithi086.stdout:6/524: dwrite db/d37/d44/d5a/f63 [0,4194304] 0 2024-08-19T00:56:05.769 INFO:tasks.workunit.client.1.smithi086.stdout:8/514: chown dc/d16/d18/d29/d2e/d28/d2b/c68 3 1 2024-08-19T00:56:05.775 INFO:tasks.workunit.client.1.smithi086.stdout:6/525: dwrite db/d37/f20 [0,4194304] 0 2024-08-19T00:56:05.778 INFO:tasks.workunit.client.1.smithi086.stdout:6/526: chown f3 6496330 1 2024-08-19T00:56:05.779 INFO:tasks.workunit.client.1.smithi086.stdout:6/527: write db/d34/d39/f51 [725910,28051] 0 2024-08-19T00:56:05.815 INFO:tasks.workunit.client.1.smithi086.stdout:9/502: sync 2024-08-19T00:56:05.819 INFO:tasks.workunit.client.1.smithi086.stdout:9/503: dwrite db/d26/f93 [0,4194304] 0 2024-08-19T00:56:05.846 INFO:tasks.workunit.client.0.smithi017.stdout:8/33: sync 2024-08-19T00:56:05.847 INFO:tasks.workunit.client.1.smithi086.stdout:7/551: mknod d3/d34/cae 0 2024-08-19T00:56:05.849 INFO:tasks.workunit.client.1.smithi086.stdout:7/552: write d3/de/d68/d7a/f8e [46065,104080] 0 2024-08-19T00:56:05.850 INFO:tasks.workunit.client.0.smithi017.stdout:7/138: creat d3/f2e x:0 0 0 2024-08-19T00:56:05.851 INFO:tasks.workunit.client.1.smithi086.stdout:5/497: rmdir d0/d2d/d4f 39 2024-08-19T00:56:05.853 INFO:tasks.workunit.client.0.smithi017.stdout:7/139: write d3/dc/f1f [592006,72967] 0 2024-08-19T00:56:05.855 INFO:tasks.workunit.client.0.smithi017.stdout:8/34: dwrite f0 [0,4194304] 0 2024-08-19T00:56:05.857 INFO:tasks.workunit.client.0.smithi017.stdout:8/35: write f4 [981055,7117] 0 2024-08-19T00:56:05.858 INFO:tasks.workunit.client.0.smithi017.stdout:8/36: chown f0 163836 1 2024-08-19T00:56:05.858 INFO:tasks.workunit.client.0.smithi017.stdout:8/37: stat f0 0 2024-08-19T00:56:05.867 INFO:tasks.workunit.client.1.smithi086.stdout:6/528: dread db/f56 [0,4194304] 0 2024-08-19T00:56:05.876 INFO:tasks.workunit.client.0.smithi017.stdout:8/38: fsync f0 0 2024-08-19T00:56:05.879 INFO:tasks.workunit.client.0.smithi017.stdout:8/39: dread f0 [0,4194304] 0 2024-08-19T00:56:05.879 INFO:tasks.workunit.client.0.smithi017.stdout:8/40: read f0 [3319739,47987] 0 2024-08-19T00:56:05.880 INFO:tasks.workunit.client.1.smithi086.stdout:3/534: sync 2024-08-19T00:56:05.880 INFO:tasks.workunit.client.1.smithi086.stdout:2/487: sync 2024-08-19T00:56:05.885 INFO:tasks.workunit.client.1.smithi086.stdout:3/535: dwrite d3/d26/d60/f69 [4194304,4194304] 0 2024-08-19T00:56:05.886 INFO:tasks.workunit.client.0.smithi017.stdout:8/41: dwrite f4 [0,4194304] 0 2024-08-19T00:56:05.887 INFO:tasks.workunit.client.1.smithi086.stdout:4/463: symlink d2/d18/d33/d42/d72/d2f/l9f 0 2024-08-19T00:56:05.888 INFO:tasks.workunit.client.1.smithi086.stdout:4/464: fsync d2/d18/d33/d42/d72/d78/d25/d6b/f99 0 2024-08-19T00:56:05.891 INFO:tasks.workunit.client.0.smithi017.stdout:8/42: mknod c8 0 2024-08-19T00:56:05.894 INFO:tasks.workunit.client.1.smithi086.stdout:4/465: dwrite d2/d18/d33/d42/d72/f34 [4194304,4194304] 0 2024-08-19T00:56:05.894 INFO:tasks.workunit.client.1.smithi086.stdout:1/593: truncate d4/d7/f28 6778211 0 2024-08-19T00:56:05.895 INFO:tasks.workunit.client.1.smithi086.stdout:4/466: fsync d2/f69 0 2024-08-19T00:56:05.897 INFO:tasks.workunit.client.1.smithi086.stdout:4/467: truncate d2/d18/d33/d42/d72/d78/f6d 317501 0 2024-08-19T00:56:05.898 INFO:tasks.workunit.client.0.smithi017.stdout:8/43: mknod c9 0 2024-08-19T00:56:05.900 INFO:tasks.workunit.client.1.smithi086.stdout:8/515: write dc/f51 [709748,92658] 0 2024-08-19T00:56:05.906 INFO:tasks.workunit.client.1.smithi086.stdout:7/553: mkdir d3/d34/d44/d58/d4b/da5/daf 0 2024-08-19T00:56:05.907 INFO:tasks.workunit.client.0.smithi017.stdout:8/44: dwrite f0 [4194304,4194304] 0 2024-08-19T00:56:05.913 INFO:tasks.workunit.client.1.smithi086.stdout:3/536: mkdir d3/d26/d2b/d33/d4a/d57/db4 0 2024-08-19T00:56:05.915 INFO:tasks.workunit.client.1.smithi086.stdout:1/594: creat d4/d7/d2a/d36/d63/d84/d8e/fc3 x:0 0 0 2024-08-19T00:56:05.916 INFO:tasks.workunit.client.0.smithi017.stdout:8/45: fsync f4 0 2024-08-19T00:56:05.916 INFO:tasks.workunit.client.0.smithi017.stdout:8/46: readlink l3 0 2024-08-19T00:56:05.920 INFO:tasks.workunit.client.1.smithi086.stdout:5/498: mkdir d0/d8/d94 0 2024-08-19T00:56:05.921 INFO:tasks.workunit.client.1.smithi086.stdout:3/537: dwrite d3/d26/f59 [0,4194304] 0 2024-08-19T00:56:05.922 INFO:tasks.workunit.client.1.smithi086.stdout:7/554: symlink d3/de/d2d/lb0 0 2024-08-19T00:56:05.925 INFO:tasks.workunit.client.1.smithi086.stdout:4/468: dread d2/d18/d33/d42/d72/d78/d25/d55/f3d [0,4194304] 0 2024-08-19T00:56:05.927 INFO:tasks.workunit.client.1.smithi086.stdout:0/527: creat da/d14/d26/fb1 x:0 0 0 2024-08-19T00:56:05.928 INFO:tasks.workunit.client.0.smithi017.stdout:8/47: getdents . 0 2024-08-19T00:56:05.929 INFO:tasks.workunit.client.1.smithi086.stdout:3/538: dread d3/d26/f73 [0,4194304] 0 2024-08-19T00:56:05.934 INFO:tasks.workunit.client.1.smithi086.stdout:1/595: truncate d4/d7/d2a/d36/d3a/f43 3971327 0 2024-08-19T00:56:05.934 INFO:tasks.workunit.client.0.smithi017.stdout:8/48: creat fa x:0 0 0 2024-08-19T00:56:05.934 INFO:tasks.workunit.client.0.smithi017.stdout:8/49: rmdir - no directory 2024-08-19T00:56:05.935 INFO:tasks.workunit.client.1.smithi086.stdout:7/555: dwrite d3/de/d68/d7a/f86 [4194304,4194304] 0 2024-08-19T00:56:05.937 INFO:tasks.workunit.client.0.smithi017.stdout:8/50: readlink l3 0 2024-08-19T00:56:05.940 INFO:tasks.workunit.client.1.smithi086.stdout:9/504: dwrite db/d26/f49 [0,4194304] 0 2024-08-19T00:56:05.941 INFO:tasks.workunit.client.0.smithi017.stdout:8/51: chown c9 3448 1 2024-08-19T00:56:05.942 INFO:tasks.workunit.client.1.smithi086.stdout:6/529: dwrite f3 [4194304,4194304] 0 2024-08-19T00:56:05.944 INFO:tasks.workunit.client.1.smithi086.stdout:6/530: dread - db/d34/d39/d76/f7b zero size 2024-08-19T00:56:05.947 INFO:tasks.workunit.client.1.smithi086.stdout:1/596: write d4/f6 [2486786,118499] 0 2024-08-19T00:56:05.947 INFO:tasks.workunit.client.1.smithi086.stdout:2/488: link d8/ff d8/d43/fa1 0 2024-08-19T00:56:05.950 INFO:tasks.workunit.client.1.smithi086.stdout:4/469: link d2/d18/d33/d42/d72/d78/d2c/f43 d2/d18/d33/d42/d72/d2f/d8e/fa0 0 2024-08-19T00:56:05.950 INFO:tasks.workunit.client.1.smithi086.stdout:5/499: dread d0/f17 [0,4194304] 0 2024-08-19T00:56:05.951 INFO:tasks.workunit.client.1.smithi086.stdout:6/531: rename db/d34/d39/f67 to db/d37/d44/d5a/d78/faa 0 2024-08-19T00:56:05.952 INFO:tasks.workunit.client.1.smithi086.stdout:9/505: write db/dd/d19/d38/f79 [2917948,121881] 0 2024-08-19T00:56:05.957 INFO:tasks.workunit.client.1.smithi086.stdout:4/470: mknod d2/d18/d33/d42/d72/d78/d25/d30/ca1 0 2024-08-19T00:56:05.959 INFO:tasks.workunit.client.1.smithi086.stdout:1/597: dwrite d4/d7/d2a/d36/d3a/f91 [0,4194304] 0 2024-08-19T00:56:05.960 INFO:tasks.workunit.client.1.smithi086.stdout:6/532: unlink db/d37/d44/d5a/f63 0 2024-08-19T00:56:05.963 INFO:tasks.workunit.client.1.smithi086.stdout:6/533: chown db/d37/d44/f80 1347693 1 2024-08-19T00:56:05.965 INFO:tasks.workunit.client.1.smithi086.stdout:8/516: dwrite dc/d16/d18/d29/d2e/d28/d2b/f79 [0,4194304] 0 2024-08-19T00:56:05.966 INFO:tasks.workunit.client.1.smithi086.stdout:5/500: rename d0/d5f/l77 to d0/d8/l95 0 2024-08-19T00:56:05.967 INFO:tasks.workunit.client.0.smithi017.stdout:8/52: fsync fa 0 2024-08-19T00:56:05.969 INFO:tasks.workunit.client.1.smithi086.stdout:4/471: dwrite d2/d18/d33/f92 [0,4194304] 0 2024-08-19T00:56:05.971 INFO:tasks.workunit.client.1.smithi086.stdout:2/489: truncate d8/ff 1270341 0 2024-08-19T00:56:05.972 INFO:tasks.workunit.client.1.smithi086.stdout:8/517: truncate dc/d16/d18/d29/d2e/d28/d2b/f6e 4883656 0 2024-08-19T00:56:05.974 INFO:tasks.workunit.client.1.smithi086.stdout:1/598: dread d4/d7/d2a/d36/d50/f66 [0,4194304] 0 2024-08-19T00:56:05.976 INFO:tasks.workunit.client.1.smithi086.stdout:3/539: write d3/d18/f24 [1429404,129402] 0 2024-08-19T00:56:05.977 INFO:tasks.workunit.client.0.smithi017.stdout:8/53: dread f0 [0,4194304] 0 2024-08-19T00:56:05.980 INFO:tasks.workunit.client.1.smithi086.stdout:3/540: write d3/f80 [874530,112354] 0 2024-08-19T00:56:05.980 INFO:tasks.workunit.client.1.smithi086.stdout:5/501: dwrite d0/d8/d10/f42 [0,4194304] 0 2024-08-19T00:56:05.982 INFO:tasks.workunit.client.1.smithi086.stdout:1/599: read d4/d7/d2a/d36/d63/fc1 [800243,49200] 0 2024-08-19T00:56:05.983 INFO:tasks.workunit.client.1.smithi086.stdout:5/502: read - d0/d2d/d43/d4d/f54 zero size 2024-08-19T00:56:05.984 INFO:tasks.workunit.client.1.smithi086.stdout:1/600: fsync d4/d7/d2a/d6e/fad 0 2024-08-19T00:56:05.986 INFO:tasks.workunit.client.1.smithi086.stdout:5/503: stat d0/d8/le 0 2024-08-19T00:56:05.990 INFO:tasks.workunit.client.1.smithi086.stdout:9/506: rename db/d26/d5c/d87/d30/d31/l4c to db/d26/d5c/d87/d30/d3f/d43/d4e/d7a/da1/la8 0 2024-08-19T00:56:05.991 INFO:tasks.workunit.client.1.smithi086.stdout:6/534: chown db/d34/d4e/d68/d89/c93 498 1 2024-08-19T00:56:05.991 INFO:tasks.workunit.client.0.smithi017.stdout:8/54: creat fb x:0 0 0 2024-08-19T00:56:05.992 INFO:tasks.workunit.client.1.smithi086.stdout:3/541: dwrite d3/d18/d19/d37/d5a/fa0 [0,4194304] 0 2024-08-19T00:56:05.994 INFO:tasks.workunit.client.1.smithi086.stdout:9/507: write db/d26/d5c/d87/d30/d3f/d43/d4e/d7a/f8c [804598,23615] 0 2024-08-19T00:56:05.997 INFO:tasks.workunit.client.0.smithi017.stdout:8/55: creat fc x:0 0 0 2024-08-19T00:56:05.997 INFO:tasks.workunit.client.0.smithi017.stdout:8/56: rmdir - no directory 2024-08-19T00:56:05.998 INFO:tasks.workunit.client.1.smithi086.stdout:5/504: truncate d0/d20/f36 4331559 0 2024-08-19T00:56:05.999 INFO:tasks.workunit.client.1.smithi086.stdout:9/508: read db/f11 [1481632,13643] 0 2024-08-19T00:56:05.999 INFO:tasks.workunit.client.1.smithi086.stdout:1/601: rename d4/d1e/laf to d4/d7/d2a/d36/db6/lc4 0 2024-08-19T00:56:06.001 INFO:tasks.workunit.client.0.smithi017.stdout:8/57: read f4 [371575,96560] 0 2024-08-19T00:56:06.001 INFO:tasks.workunit.client.1.smithi086.stdout:6/535: unlink db/d37/d28/f71 0 2024-08-19T00:56:06.002 INFO:tasks.workunit.client.1.smithi086.stdout:8/518: creat dc/d16/d18/fa6 x:0 0 0 2024-08-19T00:56:06.002 INFO:tasks.workunit.client.1.smithi086.stdout:6/536: fsync db/d37/d44/d5a/f73 0 2024-08-19T00:56:06.003 INFO:tasks.workunit.client.1.smithi086.stdout:5/505: creat d0/df/d1f/d33/f96 x:0 0 0 2024-08-19T00:56:06.005 INFO:tasks.workunit.client.0.smithi017.stdout:8/58: rename f4 to fd 0 2024-08-19T00:56:06.006 INFO:tasks.workunit.client.1.smithi086.stdout:8/519: read - dc/d16/d18/d29/d2e/d28/f92 zero size 2024-08-19T00:56:06.007 INFO:tasks.workunit.client.1.smithi086.stdout:2/490: dread d8/d2c/f49 [0,4194304] 0 2024-08-19T00:56:06.012 INFO:tasks.workunit.client.0.smithi017.stdout:8/59: mkdir de 0 2024-08-19T00:56:06.013 INFO:tasks.workunit.client.0.smithi017.stdout:9/122: sync 2024-08-19T00:56:06.014 INFO:tasks.workunit.client.1.smithi086.stdout:5/506: fsync d0/f1e 0 2024-08-19T00:56:06.015 INFO:tasks.workunit.client.1.smithi086.stdout:2/491: symlink d8/d2c/d47/la2 0 2024-08-19T00:56:06.015 INFO:tasks.workunit.client.1.smithi086.stdout:4/472: write d2/d18/d33/d42/f61 [577150,35403] 0 2024-08-19T00:56:06.015 INFO:tasks.workunit.client.0.smithi017.stdout:8/60: rename fb to de/ff 0 2024-08-19T00:56:06.016 INFO:tasks.workunit.client.1.smithi086.stdout:5/507: readlink d0/l8b 0 2024-08-19T00:56:06.019 INFO:tasks.workunit.client.1.smithi086.stdout:9/509: dread db/dd/d19/d38/f79 [0,4194304] 0 2024-08-19T00:56:06.020 INFO:tasks.workunit.client.1.smithi086.stdout:9/510: chown db/d26/d5c/d87/d30/d32/d44/f56 8305176 1 2024-08-19T00:56:06.023 INFO:tasks.workunit.client.0.smithi017.stdout:9/123: dwrite d0/fc [8388608,4194304] 0 2024-08-19T00:56:06.030 INFO:tasks.workunit.client.0.smithi017.stdout:9/124: dwrite d0/fc [4194304,4194304] 0 2024-08-19T00:56:06.034 INFO:tasks.workunit.client.1.smithi086.stdout:5/508: mknod d0/d8/d70/c97 0 2024-08-19T00:56:06.036 INFO:tasks.workunit.client.1.smithi086.stdout:4/473: mkdir d2/d18/d33/d42/d72/d78/d25/d30/d5d/da2 0 2024-08-19T00:56:06.038 INFO:tasks.workunit.client.1.smithi086.stdout:3/542: dwrite d3/d18/d27/d49/d3f/d54/f94 [0,4194304] 0 2024-08-19T00:56:06.038 INFO:tasks.workunit.client.0.smithi017.stdout:8/61: fsync de/ff 0 2024-08-19T00:56:06.039 INFO:tasks.workunit.client.1.smithi086.stdout:9/511: write db/f15 [10673751,90315] 0 2024-08-19T00:56:06.039 INFO:tasks.workunit.client.0.smithi017.stdout:8/62: dread - de/ff zero size 2024-08-19T00:56:06.041 INFO:tasks.workunit.client.1.smithi086.stdout:8/520: link dc/d17/d1e/d49/l5e dc/d16/d18/d29/d2e/d28/d41/la7 0 2024-08-19T00:56:06.041 INFO:tasks.workunit.client.1.smithi086.stdout:8/521: stat dc/d70/d7a/d9b/f3d 0 2024-08-19T00:56:06.042 INFO:tasks.workunit.client.1.smithi086.stdout:2/492: symlink d8/d14/la3 0 2024-08-19T00:56:06.043 INFO:tasks.workunit.client.0.smithi017.stdout:8/63: dread f0 [4194304,4194304] 0 2024-08-19T00:56:06.048 INFO:tasks.workunit.client.0.smithi017.stdout:8/64: write fd [2375164,60214] 0 2024-08-19T00:56:06.049 INFO:tasks.workunit.client.1.smithi086.stdout:4/474: mknod d2/d18/d33/d42/d72/d78/d2c/ca3 0 2024-08-19T00:56:06.049 INFO:tasks.workunit.client.1.smithi086.stdout:9/512: readlink db/l2e 0 2024-08-19T00:56:06.051 INFO:tasks.workunit.client.1.smithi086.stdout:3/543: symlink d3/d18/d27/d49/d3f/d54/lb5 0 2024-08-19T00:56:06.053 INFO:tasks.workunit.client.1.smithi086.stdout:8/522: rename dc/d1f/l66 to dc/d1f/d37/d4f/la8 0 2024-08-19T00:56:06.055 INFO:tasks.workunit.client.0.smithi017.stdout:8/65: dwrite de/ff [0,4194304] 0 2024-08-19T00:56:06.057 INFO:tasks.workunit.client.1.smithi086.stdout:5/509: link d0/d8/f86 d0/d2d/d43/d91/f98 0 2024-08-19T00:56:06.059 INFO:tasks.workunit.client.0.smithi017.stdout:8/66: write f0 [1683632,115063] 0 2024-08-19T00:56:06.059 INFO:tasks.workunit.client.0.smithi017.stdout:8/67: stat fc 0 2024-08-19T00:56:06.060 INFO:tasks.workunit.client.0.smithi017.stdout:8/68: write f0 [1058333,25321] 0 2024-08-19T00:56:06.061 INFO:tasks.workunit.client.0.smithi017.stdout:8/69: write f0 [2428607,96529] 0 2024-08-19T00:56:06.062 INFO:tasks.workunit.client.0.smithi017.stdout:8/70: chown fa 1 1 2024-08-19T00:56:06.063 INFO:tasks.workunit.client.1.smithi086.stdout:8/523: unlink dc/d70/d7a/f7c 0 2024-08-19T00:56:06.064 INFO:tasks.workunit.client.1.smithi086.stdout:9/513: dread db/dd/d19/d18/f2f [0,4194304] 0 2024-08-19T00:56:06.065 INFO:tasks.workunit.client.0.smithi017.stdout:8/71: unlink fc 0 2024-08-19T00:56:06.066 INFO:tasks.workunit.client.1.smithi086.stdout:4/475: dwrite d2/d18/d33/d42/d72/f96 [0,4194304] 0 2024-08-19T00:56:06.067 INFO:tasks.workunit.client.1.smithi086.stdout:4/476: readlink d2/d18/d33/d42/d72/d2f/l9f 0 2024-08-19T00:56:06.071 INFO:tasks.workunit.client.1.smithi086.stdout:8/524: unlink dc/d1f/f4c 0 2024-08-19T00:56:06.075 INFO:tasks.workunit.client.1.smithi086.stdout:2/493: getdents d8/d24/d32 0 2024-08-19T00:56:06.075 INFO:tasks.workunit.client.0.smithi017.stdout:8/72: fsync de/ff 0 2024-08-19T00:56:06.078 INFO:tasks.workunit.client.1.smithi086.stdout:5/510: dread d0/df/d1f/d33/f49 [0,4194304] 0 2024-08-19T00:56:06.079 INFO:tasks.workunit.client.0.smithi017.stdout:8/73: mkdir de/d10 0 2024-08-19T00:56:06.079 INFO:tasks.workunit.client.1.smithi086.stdout:8/525: dwrite dc/d16/d18/d29/d2e/d28/d2b/d3b/f3c [0,4194304] 0 2024-08-19T00:56:06.079 INFO:tasks.workunit.client.0.smithi017.stdout:8/74: fdatasync f0 0 2024-08-19T00:56:06.082 INFO:tasks.workunit.client.1.smithi086.stdout:3/544: write d3/d18/d19/d62/d46/f6e [1130100,110721] 0 2024-08-19T00:56:06.089 INFO:tasks.workunit.client.1.smithi086.stdout:5/511: dwrite d0/df/d1f/d33/f3d [0,4194304] 0 2024-08-19T00:56:06.091 INFO:tasks.workunit.client.1.smithi086.stdout:8/526: dwrite dc/d16/d18/f8c [0,4194304] 0 2024-08-19T00:56:06.093 INFO:tasks.workunit.client.1.smithi086.stdout:5/512: chown d0/df/d1f/f85 135 1 2024-08-19T00:56:06.093 INFO:tasks.workunit.client.1.smithi086.stdout:3/545: truncate d3/d26/f73 4274980 0 2024-08-19T00:56:06.095 INFO:tasks.workunit.client.0.smithi017.stdout:8/75: getdents de 0 2024-08-19T00:56:06.096 INFO:tasks.workunit.client.1.smithi086.stdout:8/527: write dc/d16/d18/d29/d2e/d28/f92 [500965,1351] 0 2024-08-19T00:56:06.096 INFO:tasks.workunit.client.1.smithi086.stdout:3/546: write d3/d18/d1a/f34 [121608,127800] 0 2024-08-19T00:56:06.099 INFO:tasks.workunit.client.1.smithi086.stdout:9/514: dread db/d26/d5c/d68/f6f [0,4194304] 0 2024-08-19T00:56:06.099 INFO:tasks.workunit.client.1.smithi086.stdout:3/547: dread - d3/d18/d61/f97 zero size 2024-08-19T00:56:06.100 INFO:tasks.workunit.client.1.smithi086.stdout:4/477: truncate d2/d18/d33/d42/d72/f16 6535946 0 2024-08-19T00:56:06.100 INFO:tasks.workunit.client.1.smithi086.stdout:5/513: read d0/df/d1f/d33/f3d [1455577,115056] 0 2024-08-19T00:56:06.103 INFO:tasks.workunit.client.1.smithi086.stdout:9/515: readlink db/d26/d5c/d87/d30/d32/d44/d67/l74 0 2024-08-19T00:56:06.105 INFO:tasks.workunit.client.1.smithi086.stdout:4/478: mknod d2/d18/ca4 0 2024-08-19T00:56:06.105 INFO:tasks.workunit.client.1.smithi086.stdout:9/516: rmdir db/d26/d5c 39 2024-08-19T00:56:06.106 INFO:tasks.workunit.client.1.smithi086.stdout:5/514: mkdir d0/d99 0 2024-08-19T00:56:06.106 INFO:tasks.workunit.client.1.smithi086.stdout:2/494: dwrite d8/f1e [0,4194304] 0 2024-08-19T00:56:06.107 INFO:tasks.workunit.client.1.smithi086.stdout:9/517: write db/dd/ff [2203158,96639] 0 2024-08-19T00:56:06.109 INFO:tasks.workunit.client.1.smithi086.stdout:4/479: fdatasync d2/d18/d33/d42/d72/d78/d25/f7e 0 2024-08-19T00:56:06.110 INFO:tasks.workunit.client.1.smithi086.stdout:9/518: readlink db/l10 0 2024-08-19T00:56:06.112 INFO:tasks.workunit.client.1.smithi086.stdout:5/515: rename d0/d8/l35 to d0/d2d/d43/d91/l9a 0 2024-08-19T00:56:06.113 INFO:tasks.workunit.client.1.smithi086.stdout:2/495: mknod d8/d2c/d47/d73/ca4 0 2024-08-19T00:56:06.116 INFO:tasks.workunit.client.1.smithi086.stdout:4/480: rmdir d2/d18/d33/d42/d72 39 2024-08-19T00:56:06.117 INFO:tasks.workunit.client.1.smithi086.stdout:3/548: write d3/ff [373156,30116] 0 2024-08-19T00:56:06.121 INFO:tasks.workunit.client.1.smithi086.stdout:9/519: creat db/d5e/fa9 x:0 0 0 2024-08-19T00:56:06.122 INFO:tasks.workunit.client.1.smithi086.stdout:3/549: creat d3/d18/d19/d37/d5a/fb6 x:0 0 0 2024-08-19T00:56:06.124 INFO:tasks.workunit.client.1.smithi086.stdout:4/481: stat d2/d18/d33/d42/d72/d78/d25/f9d 0 2024-08-19T00:56:06.125 INFO:tasks.workunit.client.1.smithi086.stdout:5/516: write d0/d5f/d60/d57/f58 [377986,44051] 0 2024-08-19T00:56:06.126 INFO:tasks.workunit.client.1.smithi086.stdout:2/496: write d8/f40 [740842,92619] 0 2024-08-19T00:56:06.127 INFO:tasks.workunit.client.1.smithi086.stdout:9/520: mknod db/d26/d5c/d87/d30/d3f/caa 0 2024-08-19T00:56:06.128 INFO:tasks.workunit.client.1.smithi086.stdout:4/482: creat d2/d18/d33/d42/d72/d78/d25/d6b/fa5 x:0 0 0 2024-08-19T00:56:06.129 INFO:tasks.workunit.client.1.smithi086.stdout:2/497: mknod d8/d24/d32/d4d/ca5 0 2024-08-19T00:56:06.129 INFO:tasks.workunit.client.1.smithi086.stdout:4/483: chown d2/d18/d33/f92 266177093 1 2024-08-19T00:56:06.131 INFO:tasks.workunit.client.1.smithi086.stdout:9/521: rename db/dd/d19/d18/f9e to db/d26/d5c/d87/d37/fab 0 2024-08-19T00:56:06.134 INFO:tasks.workunit.client.1.smithi086.stdout:4/484: creat d2/d18/d33/d42/d72/d78/d25/fa6 x:0 0 0 2024-08-19T00:56:06.136 INFO:tasks.workunit.client.1.smithi086.stdout:9/522: mknod db/d26/cac 0 2024-08-19T00:56:06.136 INFO:tasks.workunit.client.1.smithi086.stdout:7/556: sync 2024-08-19T00:56:06.136 INFO:tasks.workunit.client.1.smithi086.stdout:0/528: sync 2024-08-19T00:56:06.137 INFO:tasks.workunit.client.1.smithi086.stdout:4/485: symlink d2/d18/d33/d42/d72/d78/d25/d6b/d81/d8a/la7 0 2024-08-19T00:56:06.141 INFO:tasks.workunit.client.1.smithi086.stdout:9/523: fdatasync db/f35 0 2024-08-19T00:56:06.143 INFO:tasks.workunit.client.1.smithi086.stdout:4/486: write d2/d18/d33/d42/d72/d78/d25/f35 [2142806,114277] 0 2024-08-19T00:56:06.144 INFO:tasks.workunit.client.1.smithi086.stdout:5/517: dread d0/d8/d10/f1d [0,4194304] 0 2024-08-19T00:56:06.144 INFO:tasks.workunit.client.1.smithi086.stdout:7/557: rename d3/d34/d44/f83 to d3/d5b/fb1 0 2024-08-19T00:56:06.146 INFO:tasks.workunit.client.1.smithi086.stdout:9/524: fdatasync db/d26/d5c/d87/d30/d3f/f8b 0 2024-08-19T00:56:06.147 INFO:tasks.workunit.client.1.smithi086.stdout:2/498: dwrite d8/f1f [4194304,4194304] 0 2024-08-19T00:56:06.148 INFO:tasks.workunit.client.1.smithi086.stdout:4/487: dread - d2/d18/d33/d42/d72/d78/f67 zero size 2024-08-19T00:56:06.149 INFO:tasks.workunit.client.1.smithi086.stdout:0/529: dwrite da/d5d/f7a [0,4194304] 0 2024-08-19T00:56:06.152 INFO:tasks.workunit.client.1.smithi086.stdout:7/558: write d3/de/fa6 [4935732,3081] 0 2024-08-19T00:56:06.154 INFO:tasks.workunit.client.1.smithi086.stdout:4/488: creat d2/d18/d33/d42/d72/d2f/fa8 x:0 0 0 2024-08-19T00:56:06.156 INFO:tasks.workunit.client.1.smithi086.stdout:5/518: write d0/d5f/d60/d57/f84 [4015485,9837] 0 2024-08-19T00:56:06.157 INFO:tasks.workunit.client.1.smithi086.stdout:0/530: unlink da/d5d/da9/d6a/la3 0 2024-08-19T00:56:06.158 INFO:tasks.workunit.client.1.smithi086.stdout:2/499: creat d8/d14/fa6 x:0 0 0 2024-08-19T00:56:06.159 INFO:tasks.workunit.client.1.smithi086.stdout:5/519: mknod d0/d20/c9b 0 2024-08-19T00:56:06.159 INFO:tasks.workunit.client.1.smithi086.stdout:4/489: dread - d2/d18/d33/d42/d72/d78/d25/d6b/fa5 zero size 2024-08-19T00:56:06.160 INFO:tasks.workunit.client.1.smithi086.stdout:0/531: fdatasync da/d5d/da9/fab 0 2024-08-19T00:56:06.162 INFO:tasks.workunit.client.1.smithi086.stdout:7/559: dread d3/de/f59 [4194304,4194304] 0 2024-08-19T00:56:06.162 INFO:tasks.workunit.client.1.smithi086.stdout:9/525: dwrite db/f20 [0,4194304] 0 2024-08-19T00:56:06.163 INFO:tasks.workunit.client.1.smithi086.stdout:0/532: fdatasync da/d14/f99 0 2024-08-19T00:56:06.167 INFO:tasks.workunit.client.1.smithi086.stdout:7/560: mknod d3/de/d68/d72/d7e/cb2 0 2024-08-19T00:56:06.168 INFO:tasks.workunit.client.1.smithi086.stdout:2/500: link d8/d84/l99 d8/d43/la7 0 2024-08-19T00:56:06.169 INFO:tasks.workunit.client.1.smithi086.stdout:9/526: dread db/d26/f93 [0,4194304] 0 2024-08-19T00:56:06.170 INFO:tasks.workunit.client.1.smithi086.stdout:2/501: readlink d8/d84/l91 0 2024-08-19T00:56:06.170 INFO:tasks.workunit.client.1.smithi086.stdout:0/533: dread da/f56 [0,4194304] 0 2024-08-19T00:56:06.171 INFO:tasks.workunit.client.1.smithi086.stdout:0/534: write da/f60 [909943,29818] 0 2024-08-19T00:56:06.172 INFO:tasks.workunit.client.1.smithi086.stdout:0/535: write da/d14/f17 [3017979,106748] 0 2024-08-19T00:56:06.173 INFO:tasks.workunit.client.1.smithi086.stdout:9/527: rmdir db/d5e 39 2024-08-19T00:56:06.174 INFO:tasks.workunit.client.1.smithi086.stdout:2/502: symlink d8/d2c/d38/d80/la8 0 2024-08-19T00:56:06.175 INFO:tasks.workunit.client.1.smithi086.stdout:4/490: getdents d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73 0 2024-08-19T00:56:06.175 INFO:tasks.workunit.client.1.smithi086.stdout:2/503: write d8/d14/f75 [649222,48739] 0 2024-08-19T00:56:06.180 INFO:tasks.workunit.client.1.smithi086.stdout:2/504: write d8/d2c/d47/f58 [338550,100026] 0 2024-08-19T00:56:06.180 INFO:tasks.workunit.client.1.smithi086.stdout:9/528: read db/f1b [2940948,1241] 0 2024-08-19T00:56:06.181 INFO:tasks.workunit.client.1.smithi086.stdout:0/536: dread da/d5d/f7a [0,4194304] 0 2024-08-19T00:56:06.184 INFO:tasks.workunit.client.1.smithi086.stdout:2/505: mkdir d8/d43/d65/da9 0 2024-08-19T00:56:06.184 INFO:tasks.workunit.client.1.smithi086.stdout:5/520: dwrite d0/d20/f36 [4194304,4194304] 0 2024-08-19T00:56:06.185 INFO:tasks.workunit.client.1.smithi086.stdout:9/529: dread - db/d26/d5c/d87/d37/fab zero size 2024-08-19T00:56:06.186 INFO:tasks.workunit.client.1.smithi086.stdout:9/530: read - db/fa5 zero size 2024-08-19T00:56:06.187 INFO:tasks.workunit.client.1.smithi086.stdout:2/506: mknod d8/d43/d77/caa 0 2024-08-19T00:56:06.188 INFO:tasks.workunit.client.1.smithi086.stdout:5/521: creat d0/d8/d72/f9c x:0 0 0 2024-08-19T00:56:06.190 INFO:tasks.workunit.client.1.smithi086.stdout:0/537: write da/d14/d44/d49/f5f [187165,18711] 0 2024-08-19T00:56:06.192 INFO:tasks.workunit.client.1.smithi086.stdout:5/522: creat d0/df/d1f/d65/f9d x:0 0 0 2024-08-19T00:56:06.193 INFO:tasks.workunit.client.1.smithi086.stdout:9/531: creat db/dd/d19/d18/fad x:0 0 0 2024-08-19T00:56:06.195 INFO:tasks.workunit.client.1.smithi086.stdout:0/538: symlink da/d14/d1a/d2e/lb2 0 2024-08-19T00:56:06.195 INFO:tasks.workunit.client.1.smithi086.stdout:4/491: dread d2/d18/d33/d42/d72/f37 [0,4194304] 0 2024-08-19T00:56:06.196 INFO:tasks.workunit.client.1.smithi086.stdout:9/532: creat db/d26/d5c/d87/d6d/fae x:0 0 0 2024-08-19T00:56:06.196 INFO:tasks.workunit.client.1.smithi086.stdout:2/507: link d8/f36 d8/d14/fab 0 2024-08-19T00:56:06.197 INFO:tasks.workunit.client.1.smithi086.stdout:0/539: symlink da/d97/lb3 0 2024-08-19T00:56:06.198 INFO:tasks.workunit.client.1.smithi086.stdout:4/492: read d2/d18/d33/f5e [147352,95209] 0 2024-08-19T00:56:06.198 INFO:tasks.workunit.client.1.smithi086.stdout:2/508: write d8/d24/d32/f4b [1056466,55557] 0 2024-08-19T00:56:06.199 INFO:tasks.workunit.client.1.smithi086.stdout:0/540: chown da/d14/d55/dac 21 1 2024-08-19T00:56:06.205 INFO:tasks.workunit.client.1.smithi086.stdout:4/493: truncate d2/d18/d33/d42/d72/d78/d25/f8b 9278478 0 2024-08-19T00:56:06.209 INFO:tasks.workunit.client.1.smithi086.stdout:9/533: dwrite db/d26/d5c/d68/f6f [0,4194304] 0 2024-08-19T00:56:06.211 INFO:tasks.workunit.client.1.smithi086.stdout:0/541: dwrite da/d14/d1a/d2e/f35 [0,4194304] 0 2024-08-19T00:56:06.212 INFO:tasks.workunit.client.1.smithi086.stdout:5/523: dread d0/d8/d10/f19 [0,4194304] 0 2024-08-19T00:56:06.214 INFO:tasks.workunit.client.1.smithi086.stdout:4/494: link d2/d18/d33/f36 d2/d18/d33/d42/d72/d78/d2c/fa9 0 2024-08-19T00:56:06.215 INFO:tasks.workunit.client.1.smithi086.stdout:5/524: chown d0/d20/c56 44567224 1 2024-08-19T00:56:06.215 INFO:tasks.workunit.client.1.smithi086.stdout:4/495: fsync d2/f69 0 2024-08-19T00:56:06.216 INFO:tasks.workunit.client.1.smithi086.stdout:9/534: truncate db/d26/d5c/d87/d30/d3f/f8b 537608 0 2024-08-19T00:56:06.217 INFO:tasks.workunit.client.1.smithi086.stdout:2/509: dwrite d8/f36 [0,4194304] 0 2024-08-19T00:56:06.219 INFO:tasks.workunit.client.1.smithi086.stdout:4/496: stat d2/d18/d33/d42/d72/f70 0 2024-08-19T00:56:06.221 INFO:tasks.workunit.client.1.smithi086.stdout:5/525: mkdir d0/d5f/d60/d57/d80/d9e 0 2024-08-19T00:56:06.221 INFO:tasks.workunit.client.1.smithi086.stdout:9/535: read db/f39 [129117,94460] 0 2024-08-19T00:56:06.222 INFO:tasks.workunit.client.1.smithi086.stdout:2/510: creat d8/d43/fac x:0 0 0 2024-08-19T00:56:06.227 INFO:tasks.workunit.client.1.smithi086.stdout:4/497: rename d2/d18/d33/d42/d72/d78/d25/d6b/fa5 to d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/faa 0 2024-08-19T00:56:06.227 INFO:tasks.workunit.client.1.smithi086.stdout:2/511: fdatasync d8/d2c/f49 0 2024-08-19T00:56:06.228 INFO:tasks.workunit.client.1.smithi086.stdout:9/536: dwrite db/dd/d19/d18/f25 [0,4194304] 0 2024-08-19T00:56:06.230 INFO:tasks.workunit.client.1.smithi086.stdout:4/498: chown d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/f7f 46564 1 2024-08-19T00:56:06.230 INFO:tasks.workunit.client.1.smithi086.stdout:9/537: chown db/d26/d5c/d87/d6d/c8d 1261 1 2024-08-19T00:56:06.231 INFO:tasks.workunit.client.1.smithi086.stdout:5/526: link d0/d8/d72/l7b d0/df/d1f/d33/l9f 0 2024-08-19T00:56:06.232 INFO:tasks.workunit.client.1.smithi086.stdout:9/538: stat db/f57 0 2024-08-19T00:56:06.232 INFO:tasks.workunit.client.1.smithi086.stdout:9/539: stat db/dd/d19/d18/l60 0 2024-08-19T00:56:06.233 INFO:tasks.workunit.client.1.smithi086.stdout:2/512: symlink d8/d2c/d38/d96/lad 0 2024-08-19T00:56:06.233 INFO:tasks.workunit.client.1.smithi086.stdout:9/540: dread - db/d26/d5c/d87/d37/fa4 zero size 2024-08-19T00:56:06.235 INFO:tasks.workunit.client.1.smithi086.stdout:9/541: fdatasync db/d26/d5c/d87/d6d/fae 0 2024-08-19T00:56:06.235 INFO:tasks.workunit.client.1.smithi086.stdout:4/499: symlink d2/d18/d33/d42/d72/d8f/lab 0 2024-08-19T00:56:06.236 INFO:tasks.workunit.client.1.smithi086.stdout:9/542: stat db/d26/d5c/d87/d30/d32/d44/f65 0 2024-08-19T00:56:06.238 INFO:tasks.workunit.client.1.smithi086.stdout:2/513: mkdir d8/d14/dae 0 2024-08-19T00:56:06.239 INFO:tasks.workunit.client.1.smithi086.stdout:5/527: rmdir d0/df/d1f/d65/d82 0 2024-08-19T00:56:06.240 INFO:tasks.workunit.client.1.smithi086.stdout:9/543: mkdir db/daf 0 2024-08-19T00:56:06.241 INFO:tasks.workunit.client.1.smithi086.stdout:5/528: mkdir d0/d5f/d60/d57/d80/da0 0 2024-08-19T00:56:06.242 INFO:tasks.workunit.client.1.smithi086.stdout:2/514: read d8/d43/f86 [1517253,122669] 0 2024-08-19T00:56:06.242 INFO:tasks.workunit.client.1.smithi086.stdout:4/500: rename d2/d18/d33/d42/d72/d2f/d8e/c93 to d2/cac 0 2024-08-19T00:56:06.242 INFO:tasks.workunit.client.1.smithi086.stdout:9/544: mknod db/d26/d5c/d87/d30/d58/cb0 0 2024-08-19T00:56:06.243 INFO:tasks.workunit.client.1.smithi086.stdout:2/515: dread - d8/d43/d77/f9a zero size 2024-08-19T00:56:06.243 INFO:tasks.workunit.client.1.smithi086.stdout:5/529: read d0/d8/d10/f2b [25642,23284] 0 2024-08-19T00:56:06.244 INFO:tasks.workunit.client.1.smithi086.stdout:5/530: write d0/df/f1a [3946348,20352] 0 2024-08-19T00:56:06.245 INFO:tasks.workunit.client.1.smithi086.stdout:2/516: write d8/d2c/d47/f51 [3672086,73864] 0 2024-08-19T00:56:06.246 INFO:tasks.workunit.client.1.smithi086.stdout:4/501: mknod d2/d18/d33/d42/d72/d2f/d8e/cad 0 2024-08-19T00:56:06.250 INFO:tasks.workunit.client.1.smithi086.stdout:2/517: creat d8/d14/d9e/faf x:0 0 0 2024-08-19T00:56:06.252 INFO:tasks.workunit.client.1.smithi086.stdout:5/531: dwrite d0/f6 [4194304,4194304] 0 2024-08-19T00:56:06.252 INFO:tasks.workunit.client.1.smithi086.stdout:9/545: link db/d26/d5c/d87/d30/d3f/f71 db/d26/d5c/d87/d30/d32/d44/d67/fb1 0 2024-08-19T00:56:06.253 INFO:tasks.workunit.client.1.smithi086.stdout:5/532: write d0/d8/d72/f9c [963645,120223] 0 2024-08-19T00:56:06.254 INFO:tasks.workunit.client.1.smithi086.stdout:2/518: creat d8/d43/d65/fb0 x:0 0 0 2024-08-19T00:56:06.255 INFO:tasks.workunit.client.1.smithi086.stdout:2/519: chown d8/d14/f88 20197 1 2024-08-19T00:56:06.255 INFO:tasks.workunit.client.1.smithi086.stdout:6/537: sync 2024-08-19T00:56:06.255 INFO:tasks.workunit.client.1.smithi086.stdout:1/602: sync 2024-08-19T00:56:06.255 INFO:tasks.workunit.client.1.smithi086.stdout:9/546: chown db/dd/d19/d38/c89 956 1 2024-08-19T00:56:06.257 INFO:tasks.workunit.client.1.smithi086.stdout:6/538: chown db/l1f 35788742 1 2024-08-19T00:56:06.258 INFO:tasks.workunit.client.1.smithi086.stdout:2/520: mkdir d8/d24/d32/d4d/d6a/db1 0 2024-08-19T00:56:06.259 INFO:tasks.workunit.client.1.smithi086.stdout:2/521: chown d8 8430 1 2024-08-19T00:56:06.259 INFO:tasks.workunit.client.1.smithi086.stdout:2/522: chown d8/d2c/d47/la2 19 1 2024-08-19T00:56:06.262 INFO:tasks.workunit.client.1.smithi086.stdout:6/539: truncate db/d37/f24 476328 0 2024-08-19T00:56:06.263 INFO:tasks.workunit.client.1.smithi086.stdout:6/540: chown db/d34/d39/f51 225 1 2024-08-19T00:56:06.264 INFO:tasks.workunit.client.1.smithi086.stdout:9/547: creat db/fb2 x:0 0 0 2024-08-19T00:56:06.265 INFO:tasks.workunit.client.1.smithi086.stdout:4/502: write d2/f23 [4211950,92457] 0 2024-08-19T00:56:06.266 INFO:tasks.workunit.client.1.smithi086.stdout:9/548: stat db/d26/d5c/d87/f2a 0 2024-08-19T00:56:06.267 INFO:tasks.workunit.client.1.smithi086.stdout:5/533: link d0/c62 d0/d8/ca1 0 2024-08-19T00:56:06.268 INFO:tasks.workunit.client.1.smithi086.stdout:5/534: write d0/f6 [2322131,32424] 0 2024-08-19T00:56:06.270 INFO:tasks.workunit.client.1.smithi086.stdout:4/503: fdatasync d2/d18/d33/d42/d72/f16 0 2024-08-19T00:56:06.275 INFO:tasks.workunit.client.1.smithi086.stdout:9/549: dread db/dd/d19/d38/f79 [0,4194304] 0 2024-08-19T00:56:06.277 INFO:tasks.workunit.client.1.smithi086.stdout:1/603: dwrite d4/d7/d2a/d6e/f73 [0,4194304] 0 2024-08-19T00:56:06.279 INFO:tasks.workunit.client.1.smithi086.stdout:2/523: dread d8/d24/d32/f4b [0,4194304] 0 2024-08-19T00:56:06.279 INFO:tasks.workunit.client.0.smithi017.stdout:2/135: sync 2024-08-19T00:56:06.281 INFO:tasks.workunit.client.1.smithi086.stdout:1/604: write d4/d10/f5a [4439771,93760] 0 2024-08-19T00:56:06.281 INFO:tasks.workunit.client.0.smithi017.stdout:2/136: mkdir d2/d7/d29 0 2024-08-19T00:56:06.282 INFO:tasks.workunit.client.1.smithi086.stdout:2/524: write d8/d2c/d67/f6f [3221974,117722] 0 2024-08-19T00:56:06.282 INFO:tasks.workunit.client.0.smithi017.stdout:2/137: write d2/d7/fc [3565603,5501] 0 2024-08-19T00:56:06.283 INFO:tasks.workunit.client.1.smithi086.stdout:4/504: dwrite d2/d18/d33/d42/d72/d78/d25/d55/d6c/f9c [0,4194304] 0 2024-08-19T00:56:06.284 INFO:tasks.workunit.client.1.smithi086.stdout:1/605: write d4/d7/d2a/d6e/f73 [2404695,59060] 0 2024-08-19T00:56:06.285 INFO:tasks.workunit.client.0.smithi017.stdout:2/138: write d2/d7/f28 [66894,11039] 0 2024-08-19T00:56:06.286 INFO:tasks.workunit.client.1.smithi086.stdout:1/606: fsync d4/d7/d2a/f2b 0 2024-08-19T00:56:06.286 INFO:tasks.workunit.client.0.smithi017.stdout:2/139: fsync d2/fa 0 2024-08-19T00:56:06.288 INFO:tasks.workunit.client.1.smithi086.stdout:2/525: creat d8/d24/d32/d4d/d6a/fb2 x:0 0 0 2024-08-19T00:56:06.288 INFO:tasks.workunit.client.1.smithi086.stdout:1/607: stat d4/d10/d75/l79 0 2024-08-19T00:56:06.289 INFO:tasks.workunit.client.0.smithi017.stdout:2/140: creat d2/d7/dd/f2a x:0 0 0 2024-08-19T00:56:06.292 INFO:tasks.workunit.client.1.smithi086.stdout:2/526: symlink d8/d2c/d38/d80/lb3 0 2024-08-19T00:56:06.293 INFO:tasks.workunit.client.1.smithi086.stdout:9/550: truncate db/d26/d5c/d87/f2a 3392006 0 2024-08-19T00:56:06.293 INFO:tasks.workunit.client.1.smithi086.stdout:2/527: readlink d8/d24/d32/l3e 0 2024-08-19T00:56:06.295 INFO:tasks.workunit.client.1.smithi086.stdout:4/505: dwrite d2/d18/d33/d42/d72/d2f/fa8 [0,4194304] 0 2024-08-19T00:56:06.296 INFO:tasks.workunit.client.1.smithi086.stdout:2/528: chown d8/d14/c46 25507 1 2024-08-19T00:56:06.297 INFO:tasks.workunit.client.1.smithi086.stdout:9/551: rmdir db/dd/d19/d38 39 2024-08-19T00:56:06.298 INFO:tasks.workunit.client.1.smithi086.stdout:2/529: chown d8/d24/d32/d4d/d6a/c78 0 1 2024-08-19T00:56:06.298 INFO:tasks.workunit.client.1.smithi086.stdout:1/608: dread d4/d10/d75/f81 [0,4194304] 0 2024-08-19T00:56:06.298 INFO:tasks.workunit.client.1.smithi086.stdout:2/530: stat d8/d14/f22 0 2024-08-19T00:56:06.300 INFO:tasks.workunit.client.1.smithi086.stdout:2/531: truncate d8/d24/d32/f41 842241 0 2024-08-19T00:56:06.300 INFO:tasks.workunit.client.1.smithi086.stdout:1/609: unlink d4/d7/d2a/d36/d50/c5f 0 2024-08-19T00:56:06.302 INFO:tasks.workunit.client.1.smithi086.stdout:9/552: getdents db/d26/d5c/d87/d30/d32 0 2024-08-19T00:56:06.303 INFO:tasks.workunit.client.1.smithi086.stdout:2/532: mkdir d8/d2c/d38/d80/db4 0 2024-08-19T00:56:06.303 INFO:tasks.workunit.client.1.smithi086.stdout:9/553: dread - db/d26/d5c/d87/d6d/fae zero size 2024-08-19T00:56:06.305 INFO:tasks.workunit.client.0.smithi017.stdout:2/141: getdents d2/d7/dd 0 2024-08-19T00:56:06.306 INFO:tasks.workunit.client.0.smithi017.stdout:2/142: chown d2/d7/f28 6118249 1 2024-08-19T00:56:06.309 INFO:tasks.workunit.client.1.smithi086.stdout:1/610: dwrite d4/d7/f37 [0,4194304] 0 2024-08-19T00:56:06.314 INFO:tasks.workunit.client.1.smithi086.stdout:2/533: dwrite d8/d2c/d47/f7a [0,4194304] 0 2024-08-19T00:56:06.321 INFO:tasks.workunit.client.1.smithi086.stdout:4/506: dread d2/f26 [0,4194304] 0 2024-08-19T00:56:06.321 INFO:tasks.workunit.client.1.smithi086.stdout:1/611: mknod d4/d7/d2a/d36/d7d/d88/d56/cc5 0 2024-08-19T00:56:06.322 INFO:tasks.workunit.client.1.smithi086.stdout:9/554: truncate db/d26/d5c/d87/d37/f91 1557756 0 2024-08-19T00:56:06.324 INFO:tasks.workunit.client.1.smithi086.stdout:4/507: mkdir d2/d18/d33/d42/d72/d78/d2c/dae 0 2024-08-19T00:56:06.325 INFO:tasks.workunit.client.0.smithi017.stdout:2/143: dread d2/fa [4194304,4194304] 0 2024-08-19T00:56:06.326 INFO:tasks.workunit.client.1.smithi086.stdout:9/555: truncate db/dd/d19/d38/fa2 319210 0 2024-08-19T00:56:06.326 INFO:tasks.workunit.client.1.smithi086.stdout:4/508: chown d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/d85/c8d 3340 1 2024-08-19T00:56:06.327 INFO:tasks.workunit.client.0.smithi017.stdout:2/144: symlink d2/l2b 0 2024-08-19T00:56:06.328 INFO:tasks.workunit.client.0.smithi017.stdout:2/145: rename d2 to d2/d7/d29/d2c 22 2024-08-19T00:56:06.329 INFO:tasks.workunit.client.1.smithi086.stdout:9/556: fdatasync db/d26/d5c/d87/d30/d32/d44/d67/fb1 0 2024-08-19T00:56:06.330 INFO:tasks.workunit.client.1.smithi086.stdout:9/557: write db/d26/d5c/d87/d30/f9c [38275,49215] 0 2024-08-19T00:56:06.335 INFO:tasks.workunit.client.0.smithi017.stdout:2/146: dwrite d2/d7/dd/f15 [4194304,4194304] 0 2024-08-19T00:56:06.335 INFO:tasks.workunit.client.1.smithi086.stdout:9/558: rmdir db/d26/d5c/d87/d30/d3f/d43/d4e/d8f 0 2024-08-19T00:56:06.338 INFO:tasks.workunit.client.1.smithi086.stdout:9/559: readlink db/d26/d5c/d87/d30/d3f/d43/l64 0 2024-08-19T00:56:06.344 INFO:tasks.workunit.client.1.smithi086.stdout:9/560: creat db/d26/d5c/d87/fb3 x:0 0 0 2024-08-19T00:56:06.346 INFO:tasks.workunit.client.1.smithi086.stdout:1/612: dwrite d4/d7/f39 [0,4194304] 0 2024-08-19T00:56:06.347 INFO:tasks.workunit.client.1.smithi086.stdout:4/509: dwrite d2/d18/d33/d42/d72/d78/d2c/f43 [0,4194304] 0 2024-08-19T00:56:06.349 INFO:tasks.workunit.client.1.smithi086.stdout:1/613: symlink d4/d10/d75/d7a/db4/lc6 0 2024-08-19T00:56:06.350 INFO:tasks.workunit.client.0.smithi017.stdout:2/147: dread d2/d7/f21 [0,4194304] 0 2024-08-19T00:56:06.351 INFO:tasks.workunit.client.1.smithi086.stdout:4/510: read d2/d18/d33/d42/d72/d78/d25/d55/f4a [217120,107801] 0 2024-08-19T00:56:06.352 INFO:tasks.workunit.client.1.smithi086.stdout:9/561: rename db/f1b to db/d96/fb4 0 2024-08-19T00:56:06.355 INFO:tasks.workunit.client.0.smithi017.stdout:2/148: mknod d2/d7/d10/d19/c2d 0 2024-08-19T00:56:06.360 INFO:tasks.workunit.client.1.smithi086.stdout:1/614: rename d4/cc to d4/d7/d2a/d36/d61/cc7 0 2024-08-19T00:56:06.363 INFO:tasks.workunit.client.0.smithi017.stdout:2/149: dwrite d2/d7/f28 [0,4194304] 0 2024-08-19T00:56:06.365 INFO:tasks.workunit.client.1.smithi086.stdout:9/562: rename db/l10 to db/d26/d5c/d87/d30/lb5 0 2024-08-19T00:56:06.369 INFO:tasks.workunit.client.1.smithi086.stdout:4/511: rename d2/d18/d33/d42/d72/d78/d25/d30/d5d/c80 to d2/d18/d33/d42/d72/d78/d25/d55/d4d/caf 0 2024-08-19T00:56:06.371 INFO:tasks.workunit.client.1.smithi086.stdout:9/563: creat db/d5e/fb6 x:0 0 0 2024-08-19T00:56:06.371 INFO:tasks.workunit.client.1.smithi086.stdout:9/564: chown db/dd/c1a 153 1 2024-08-19T00:56:06.372 INFO:tasks.workunit.client.1.smithi086.stdout:9/565: fdatasync db/f11 0 2024-08-19T00:56:06.373 INFO:tasks.workunit.client.1.smithi086.stdout:4/512: truncate d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/faa 108820 0 2024-08-19T00:56:06.374 INFO:tasks.workunit.client.1.smithi086.stdout:9/566: creat db/d5e/fb7 x:0 0 0 2024-08-19T00:56:06.376 INFO:tasks.workunit.client.1.smithi086.stdout:4/513: mkdir d2/d18/d33/d42/d72/d78/d2c/db0 0 2024-08-19T00:56:06.376 INFO:tasks.workunit.client.0.smithi017.stdout:2/150: truncate d2/d7/d10/d19/f20 2198803 0 2024-08-19T00:56:06.377 INFO:tasks.workunit.client.1.smithi086.stdout:9/567: fdatasync db/d26/d5c/d87/d30/d32/d44/d67/fb1 0 2024-08-19T00:56:06.378 INFO:tasks.workunit.client.1.smithi086.stdout:4/514: creat d2/d18/d33/d42/d72/d8f/fb1 x:0 0 0 2024-08-19T00:56:06.379 INFO:tasks.workunit.client.0.smithi017.stdout:2/151: mknod d2/d7/d29/c2e 0 2024-08-19T00:56:06.380 INFO:tasks.workunit.client.1.smithi086.stdout:9/568: creat db/dd/d19/d38/fb8 x:0 0 0 2024-08-19T00:56:06.382 INFO:tasks.workunit.client.0.smithi017.stdout:2/152: creat d2/d7/dd/f2f x:0 0 0 2024-08-19T00:56:06.382 INFO:tasks.workunit.client.1.smithi086.stdout:9/569: mkdir db/dd/d19/d18/db9 0 2024-08-19T00:56:06.383 INFO:tasks.workunit.client.1.smithi086.stdout:1/615: dread d4/d10/f25 [0,4194304] 0 2024-08-19T00:56:06.383 INFO:tasks.workunit.client.1.smithi086.stdout:9/570: readlink db/dd/d19/d18/l60 0 2024-08-19T00:56:06.385 INFO:tasks.workunit.client.0.smithi017.stdout:2/153: unlink d2/d7/d10/d19/fb 0 2024-08-19T00:56:06.385 INFO:tasks.workunit.client.1.smithi086.stdout:4/515: creat d2/d18/d33/fb2 x:0 0 0 2024-08-19T00:56:06.386 INFO:tasks.workunit.client.0.smithi017.stdout:2/154: write d2/d7/d10/f25 [357199,53455] 0 2024-08-19T00:56:06.386 INFO:tasks.workunit.client.0.smithi017.stdout:2/155: fsync d2/d7/fc 0 2024-08-19T00:56:06.387 INFO:tasks.workunit.client.1.smithi086.stdout:8/528: sync 2024-08-19T00:56:06.387 INFO:tasks.workunit.client.0.smithi017.stdout:2/156: fdatasync d2/d7/dd/f2f 0 2024-08-19T00:56:06.402 INFO:tasks.workunit.client.0.smithi017.stdout:3/196: sync 2024-08-19T00:56:06.405 INFO:tasks.workunit.client.1.smithi086.stdout:4/516: fdatasync d2/d18/d33/d42/d72/f14 0 2024-08-19T00:56:06.406 INFO:tasks.workunit.client.0.smithi017.stdout:2/157: rename d2/d7/d10/l23 to d2/d7/l30 0 2024-08-19T00:56:06.407 INFO:tasks.workunit.client.1.smithi086.stdout:1/616: dread d4/d1e/d6f/f97 [0,4194304] 0 2024-08-19T00:56:06.408 INFO:tasks.workunit.client.1.smithi086.stdout:8/529: unlink dc/d17/d1e/d55/f65 0 2024-08-19T00:56:06.408 INFO:tasks.workunit.client.1.smithi086.stdout:1/617: write d4/d7/d2a/d36/d63/d84/d8e/fc3 [965701,120425] 0 2024-08-19T00:56:06.410 INFO:tasks.workunit.client.1.smithi086.stdout:8/530: write dc/d70/d7a/d88/f96 [991746,64805] 0 2024-08-19T00:56:06.410 INFO:tasks.workunit.client.1.smithi086.stdout:9/571: unlink db/f35 0 2024-08-19T00:56:06.411 INFO:tasks.workunit.client.0.smithi017.stdout:2/158: creat d2/d7/d29/f31 x:0 0 0 2024-08-19T00:56:06.415 INFO:tasks.workunit.client.1.smithi086.stdout:9/572: dwrite db/dd/d19/f1f [4194304,4194304] 0 2024-08-19T00:56:06.416 INFO:tasks.workunit.client.0.smithi017.stdout:2/159: mknod d2/d7/d10/c32 0 2024-08-19T00:56:06.416 INFO:tasks.workunit.client.0.smithi017.stdout:2/160: fsync d2/d7/d10/d19/f27 0 2024-08-19T00:56:06.420 INFO:tasks.workunit.client.1.smithi086.stdout:4/517: write d2/d18/d33/d42/d72/ff [270169,33773] 0 2024-08-19T00:56:06.420 INFO:tasks.workunit.client.0.smithi017.stdout:3/197: getdents d5/da/d27/d28 0 2024-08-19T00:56:06.422 INFO:tasks.workunit.client.1.smithi086.stdout:1/618: creat d4/d7/d2a/d36/d63/d9f/fc8 x:0 0 0 2024-08-19T00:56:06.424 INFO:tasks.workunit.client.0.smithi017.stdout:3/198: creat d5/da/d27/f3a x:0 0 0 2024-08-19T00:56:06.425 INFO:tasks.workunit.client.1.smithi086.stdout:8/531: creat dc/d17/d86/fa9 x:0 0 0 2024-08-19T00:56:06.426 INFO:tasks.workunit.client.0.smithi017.stdout:2/161: creat d2/f33 x:0 0 0 2024-08-19T00:56:06.426 INFO:tasks.workunit.client.1.smithi086.stdout:4/518: dwrite d2/d18/d33/d42/d72/d78/d25/f35 [0,4194304] 0 2024-08-19T00:56:06.427 INFO:tasks.workunit.client.0.smithi017.stdout:3/199: mknod d5/da/d27/c3b 0 2024-08-19T00:56:06.428 INFO:tasks.workunit.client.1.smithi086.stdout:9/573: mknod db/dd/d19/cba 0 2024-08-19T00:56:06.429 INFO:tasks.workunit.client.1.smithi086.stdout:1/619: symlink d4/d7/d2a/d36/db6/lc9 0 2024-08-19T00:56:06.429 INFO:tasks.workunit.client.1.smithi086.stdout:8/532: mknod dc/d16/d18/d29/caa 0 2024-08-19T00:56:06.431 INFO:tasks.workunit.client.1.smithi086.stdout:9/574: symlink db/d96/lbb 0 2024-08-19T00:56:06.435 INFO:tasks.workunit.client.0.smithi017.stdout:2/162: getdents d2/d7 0 2024-08-19T00:56:06.436 INFO:tasks.workunit.client.0.smithi017.stdout:2/163: chown d2/d7/l16 379042917 1 2024-08-19T00:56:06.445 INFO:tasks.workunit.client.0.smithi017.stdout:2/164: dwrite d2/d7/f21 [0,4194304] 0 2024-08-19T00:56:06.447 INFO:tasks.workunit.client.0.smithi017.stdout:2/165: creat d2/d7/d29/f34 x:0 0 0 2024-08-19T00:56:06.450 INFO:tasks.workunit.client.0.smithi017.stdout:2/166: mkdir d2/d7/d10/d35 0 2024-08-19T00:56:06.452 INFO:tasks.workunit.client.0.smithi017.stdout:2/167: truncate d2/d7/d10/d19/f27 572928 0 2024-08-19T00:56:06.453 INFO:tasks.workunit.client.0.smithi017.stdout:2/168: truncate d2/d7/dd/f2a 213421 0 2024-08-19T00:56:06.453 INFO:tasks.workunit.client.0.smithi017.stdout:2/169: dread - d2/f33 zero size 2024-08-19T00:56:06.454 INFO:tasks.workunit.client.0.smithi017.stdout:2/170: fdatasync d2/f33 0 2024-08-19T00:56:06.460 INFO:tasks.workunit.client.0.smithi017.stdout:2/171: dwrite d2/d7/d29/f31 [0,4194304] 0 2024-08-19T00:56:06.461 INFO:tasks.workunit.client.0.smithi017.stdout:2/172: write d2/d7/dd/f2f [393088,49173] 0 2024-08-19T00:56:06.463 INFO:tasks.workunit.client.0.smithi017.stdout:2/173: write d2/d7/dd/f2a [620165,98419] 0 2024-08-19T00:56:06.463 INFO:tasks.workunit.client.0.smithi017.stdout:2/174: chown d2/d7 1862425 1 2024-08-19T00:56:06.464 INFO:tasks.workunit.client.0.smithi017.stdout:2/175: readlink d2/l1f 0 2024-08-19T00:56:06.469 INFO:tasks.workunit.client.0.smithi017.stdout:2/176: truncate d2/d7/d29/f31 1191203 0 2024-08-19T00:56:06.469 INFO:tasks.workunit.client.0.smithi017.stdout:2/177: fdatasync d2/d7/dd/f15 0 2024-08-19T00:56:06.470 INFO:tasks.workunit.client.0.smithi017.stdout:2/178: dread - d2/f1a zero size 2024-08-19T00:56:06.475 INFO:tasks.workunit.client.0.smithi017.stdout:2/179: stat d2/d7/d10/d19 0 2024-08-19T00:56:06.475 INFO:tasks.workunit.client.0.smithi017.stdout:2/180: mknod d2/d7/d10/d35/c36 0 2024-08-19T00:56:06.475 INFO:tasks.workunit.client.0.smithi017.stdout:2/181: creat d2/d7/d29/f37 x:0 0 0 2024-08-19T00:56:06.475 INFO:tasks.workunit.client.0.smithi017.stdout:2/182: chown d2/d7/l16 48 1 2024-08-19T00:56:06.480 INFO:tasks.workunit.client.0.smithi017.stdout:2/183: dwrite d2/d7/f28 [0,4194304] 0 2024-08-19T00:56:06.487 INFO:tasks.workunit.client.0.smithi017.stdout:2/184: dwrite d2/d7/dd/f15 [0,4194304] 0 2024-08-19T00:56:06.491 INFO:tasks.workunit.client.0.smithi017.stdout:2/185: link d2/d7/d29/c2e d2/d7/c38 0 2024-08-19T00:56:06.491 INFO:tasks.workunit.client.1.smithi086.stdout:1/620: creat d4/d1e/d6f/fca x:0 0 0 2024-08-19T00:56:06.497 INFO:tasks.workunit.client.1.smithi086.stdout:8/533: dwrite dc/d16/d18/fa6 [0,4194304] 0 2024-08-19T00:56:06.497 INFO:tasks.workunit.client.1.smithi086.stdout:1/621: write d4/d7/d2a/d36/d63/d84/d8e/fc3 [1376208,81759] 0 2024-08-19T00:56:06.500 INFO:tasks.workunit.client.0.smithi017.stdout:2/186: dwrite d2/d7/d29/f37 [0,4194304] 0 2024-08-19T00:56:06.503 INFO:tasks.workunit.client.1.smithi086.stdout:1/622: chown d4/d10/d75/d7a/db4/lc6 16 1 2024-08-19T00:56:06.504 INFO:tasks.workunit.client.0.smithi017.stdout:2/187: creat d2/d7/d10/d19/f39 x:0 0 0 2024-08-19T00:56:06.505 INFO:tasks.workunit.client.1.smithi086.stdout:1/623: chown d4/d10/dc2 13 1 2024-08-19T00:56:06.505 INFO:tasks.workunit.client.1.smithi086.stdout:4/519: dwrite d2/f45 [0,4194304] 0 2024-08-19T00:56:06.506 INFO:tasks.workunit.client.1.smithi086.stdout:9/575: dwrite db/f39 [0,4194304] 0 2024-08-19T00:56:06.513 INFO:tasks.workunit.client.1.smithi086.stdout:8/534: write dc/d16/d18/d29/d2e/d28/d2b/f64 [849183,119875] 0 2024-08-19T00:56:06.513 INFO:tasks.workunit.client.1.smithi086.stdout:8/535: dread dc/d16/d18/d29/f91 [0,4194304] 0 2024-08-19T00:56:06.516 INFO:tasks.workunit.client.1.smithi086.stdout:1/624: unlink d4/d10/c23 0 2024-08-19T00:56:06.516 INFO:tasks.workunit.client.1.smithi086.stdout:9/576: rename db/dd/d19/c3d to db/dd/d19/d18/db9/cbc 0 2024-08-19T00:56:06.517 INFO:tasks.workunit.client.0.smithi017.stdout:2/188: rmdir d2/d7/d10 39 2024-08-19T00:56:06.517 INFO:tasks.workunit.client.1.smithi086.stdout:1/625: dread - d4/d7/d2a/d36/d3a/d41/f7e zero size 2024-08-19T00:56:06.518 INFO:tasks.workunit.client.1.smithi086.stdout:9/577: truncate db/d5e/fb6 39713 0 2024-08-19T00:56:06.518 INFO:tasks.workunit.client.1.smithi086.stdout:1/626: dread - d4/d1e/d6f/fca zero size 2024-08-19T00:56:06.519 INFO:tasks.workunit.client.0.smithi017.stdout:2/189: creat d2/d7/f3a x:0 0 0 2024-08-19T00:56:06.522 INFO:tasks.workunit.client.1.smithi086.stdout:1/627: truncate d4/d7/d2a/d36/d50/d9c/f9e 4624198 0 2024-08-19T00:56:06.523 INFO:tasks.workunit.client.1.smithi086.stdout:1/628: chown d4/d7/d2a/l58 2966025 1 2024-08-19T00:56:06.524 INFO:tasks.workunit.client.0.smithi017.stdout:2/190: dread d2/d7/d10/f25 [0,4194304] 0 2024-08-19T00:56:06.524 INFO:tasks.workunit.client.1.smithi086.stdout:9/578: dwrite db/f39 [4194304,4194304] 0 2024-08-19T00:56:06.525 INFO:tasks.workunit.client.0.smithi017.stdout:2/191: chown d2/d7/d10/f11 2 1 2024-08-19T00:56:06.526 INFO:tasks.workunit.client.1.smithi086.stdout:9/579: readlink db/d26/d5c/d87/d30/d3f/d43/d4e/d7a/da1/la8 0 2024-08-19T00:56:06.527 INFO:tasks.workunit.client.1.smithi086.stdout:3/550: sync 2024-08-19T00:56:06.528 INFO:tasks.workunit.client.1.smithi086.stdout:1/629: dread d4/d10/f25 [0,4194304] 0 2024-08-19T00:56:06.530 INFO:tasks.workunit.client.0.smithi017.stdout:2/192: getdents d2 0 2024-08-19T00:56:06.531 INFO:tasks.workunit.client.1.smithi086.stdout:3/551: symlink d3/d18/d27/d49/lb7 0 2024-08-19T00:56:06.532 INFO:tasks.workunit.client.0.smithi017.stdout:2/193: write d2/d7/d10/d19/f27 [486819,75248] 0 2024-08-19T00:56:06.533 INFO:tasks.workunit.client.1.smithi086.stdout:1/630: mknod d4/d7/d2a/d6e/d95/ccb 0 2024-08-19T00:56:06.538 INFO:tasks.workunit.client.1.smithi086.stdout:3/552: dwrite d3/d18/d27/d49/f32 [0,4194304] 0 2024-08-19T00:56:06.539 INFO:tasks.workunit.client.0.smithi017.stdout:2/194: dwrite d2/fa [8388608,4194304] 0 2024-08-19T00:56:06.540 INFO:tasks.workunit.client.1.smithi086.stdout:1/631: link d4/d10/fae d4/d7/d2a/d36/d7d/d88/fcc 0 2024-08-19T00:56:06.544 INFO:tasks.workunit.client.1.smithi086.stdout:9/580: write db/d26/d5c/d68/f78 [4717899,19062] 0 2024-08-19T00:56:06.544 INFO:tasks.workunit.client.1.smithi086.stdout:1/632: dread d4/d7/d2a/f4d [0,4194304] 0 2024-08-19T00:56:06.545 INFO:tasks.workunit.client.0.smithi017.stdout:2/195: dread d2/d7/dd/f1c [0,4194304] 0 2024-08-19T00:56:06.546 INFO:tasks.workunit.client.1.smithi086.stdout:8/536: dread dc/d70/d7a/d9b/f3d [0,4194304] 0 2024-08-19T00:56:06.546 INFO:tasks.workunit.client.1.smithi086.stdout:3/553: getdents d3/d18/d19/d62 0 2024-08-19T00:56:06.546 INFO:tasks.workunit.client.0.smithi017.stdout:2/196: write d2/d7/f21 [1134970,42918] 0 2024-08-19T00:56:06.547 INFO:tasks.workunit.client.1.smithi086.stdout:3/554: write d3/d18/d19/d37/f84 [941551,41095] 0 2024-08-19T00:56:06.548 INFO:tasks.workunit.client.0.smithi017.stdout:2/197: stat d2/d7/d10/d19/f27 0 2024-08-19T00:56:06.550 INFO:tasks.workunit.client.1.smithi086.stdout:1/633: rename d4/d10/f4f to d4/d7/fcd 0 2024-08-19T00:56:06.551 INFO:tasks.workunit.client.0.smithi017.stdout:2/198: mkdir d2/d7/d10/d3b 0 2024-08-19T00:56:06.552 INFO:tasks.workunit.client.0.smithi017.stdout:2/199: write d2/f33 [831504,55383] 0 2024-08-19T00:56:06.553 INFO:tasks.workunit.client.1.smithi086.stdout:9/581: dwrite db/d96/da7/f85 [0,4194304] 0 2024-08-19T00:56:06.555 INFO:tasks.workunit.client.1.smithi086.stdout:8/537: link dc/d1f/c4d dc/d17/cab 0 2024-08-19T00:56:06.556 INFO:tasks.workunit.client.1.smithi086.stdout:3/555: getdents d3/d18/d1a/d51/dad 0 2024-08-19T00:56:06.558 INFO:tasks.workunit.client.1.smithi086.stdout:1/634: creat d4/d7/d2a/d36/fce x:0 0 0 2024-08-19T00:56:06.560 INFO:tasks.workunit.client.1.smithi086.stdout:9/582: symlink db/d26/d5c/d87/d6d/d9f/lbd 0 2024-08-19T00:56:06.561 INFO:tasks.workunit.client.1.smithi086.stdout:8/538: write dc/d16/d18/d29/d2e/d28/d41/f59 [1411889,97007] 0 2024-08-19T00:56:06.562 INFO:tasks.workunit.client.1.smithi086.stdout:3/556: rename d3/d26/d2b/d33/d8d to d3/d18/d19/d37/d5a/db8 0 2024-08-19T00:56:06.563 INFO:tasks.workunit.client.1.smithi086.stdout:3/557: readlink d3/d18/d1a/l1b 0 2024-08-19T00:56:06.566 INFO:tasks.workunit.client.1.smithi086.stdout:8/539: truncate dc/d16/d18/d29/d2e/d28/d2b/f38 413159 0 2024-08-19T00:56:06.568 INFO:tasks.workunit.client.1.smithi086.stdout:8/540: chown dc/c1d 31840 1 2024-08-19T00:56:06.568 INFO:tasks.workunit.client.1.smithi086.stdout:8/541: chown dc/d1f/d37 15641 1 2024-08-19T00:56:06.570 INFO:tasks.workunit.client.1.smithi086.stdout:8/542: write dc/d16/d18/d29/d2e/d28/d2b/f64 [1496105,96169] 0 2024-08-19T00:56:06.572 INFO:tasks.workunit.client.1.smithi086.stdout:8/543: rmdir dc/d70/d7a 39 2024-08-19T00:56:06.574 INFO:tasks.workunit.client.1.smithi086.stdout:3/558: write d3/d18/d19/d37/fa6 [413309,62276] 0 2024-08-19T00:56:06.576 INFO:tasks.workunit.client.1.smithi086.stdout:3/559: chown d3/d18/d19/d37/f7f 1847468042 1 2024-08-19T00:56:06.576 INFO:tasks.workunit.client.1.smithi086.stdout:3/560: fdatasync d3/d18/d19/d37/f93 0 2024-08-19T00:56:06.578 INFO:tasks.workunit.client.1.smithi086.stdout:1/635: dwrite d4/d7/d2a/d36/d3a/d41/f67 [0,4194304] 0 2024-08-19T00:56:06.579 INFO:tasks.workunit.client.1.smithi086.stdout:1/636: dread - d4/d10/d90/d98/faa zero size 2024-08-19T00:56:06.580 INFO:tasks.workunit.client.1.smithi086.stdout:3/561: mkdir d3/d26/d2b/d33/db9 0 2024-08-19T00:56:06.584 INFO:tasks.workunit.client.1.smithi086.stdout:3/562: dwrite d3/d18/d27/d49/d3f/d5b/f70 [0,4194304] 0 2024-08-19T00:56:06.585 INFO:tasks.workunit.client.1.smithi086.stdout:3/563: dread - d3/d26/d60/f90 zero size 2024-08-19T00:56:06.630 INFO:tasks.workunit.client.1.smithi086.stdout:7/561: sync 2024-08-19T00:56:06.630 INFO:tasks.workunit.client.1.smithi086.stdout:0/542: sync 2024-08-19T00:56:06.631 INFO:tasks.workunit.client.1.smithi086.stdout:1/637: truncate d4/d7/f39 1182846 0 2024-08-19T00:56:06.633 INFO:tasks.workunit.client.1.smithi086.stdout:7/562: creat d3/de/d68/d7d/fb3 x:0 0 0 2024-08-19T00:56:06.634 INFO:tasks.workunit.client.1.smithi086.stdout:1/638: mknod d4/d10/d90/d98/ccf 0 2024-08-19T00:56:06.637 INFO:tasks.workunit.client.1.smithi086.stdout:7/563: creat d3/d34/d44/d58/d4b/d42/fb4 x:0 0 0 2024-08-19T00:56:06.637 INFO:tasks.workunit.client.1.smithi086.stdout:1/639: symlink d4/d7/d2a/d36/d61/ld0 0 2024-08-19T00:56:06.647 INFO:tasks.workunit.client.1.smithi086.stdout:0/543: dread da/d14/d1a/d2e/d30/f4c [0,4194304] 0 2024-08-19T00:56:06.649 INFO:tasks.workunit.client.1.smithi086.stdout:3/564: dread d3/d9/f39 [0,4194304] 0 2024-08-19T00:56:06.649 INFO:tasks.workunit.client.1.smithi086.stdout:1/640: dwrite d4/d10/fae [0,4194304] 0 2024-08-19T00:56:06.651 INFO:tasks.workunit.client.1.smithi086.stdout:1/641: write d4/d7/d2a/d36/d3a/d41/f4b [1556579,35788] 0 2024-08-19T00:56:06.651 INFO:tasks.workunit.client.1.smithi086.stdout:7/564: dread d3/de/f12 [0,4194304] 0 2024-08-19T00:56:06.651 INFO:tasks.workunit.client.1.smithi086.stdout:0/544: mkdir da/d14/db4 0 2024-08-19T00:56:06.654 INFO:tasks.workunit.client.1.smithi086.stdout:0/545: fsync da/d14/f2d 0 2024-08-19T00:56:06.658 INFO:tasks.workunit.client.1.smithi086.stdout:1/642: rename d4/d1e/f13 to d4/d7/d2a/d36/d63/d84/dbf/fd1 0 2024-08-19T00:56:06.659 INFO:tasks.workunit.client.1.smithi086.stdout:0/546: write da/d14/d1a/d2e/d39/f7f [406222,2959] 0 2024-08-19T00:56:06.660 INFO:tasks.workunit.client.1.smithi086.stdout:3/565: dwrite d3/d26/f7e [0,4194304] 0 2024-08-19T00:56:06.661 INFO:tasks.workunit.client.1.smithi086.stdout:1/643: truncate d4/fb3 1162020 0 2024-08-19T00:56:06.662 INFO:tasks.workunit.client.1.smithi086.stdout:7/565: dwrite d3/de/f70 [0,4194304] 0 2024-08-19T00:56:06.664 INFO:tasks.workunit.client.1.smithi086.stdout:1/644: fsync d4/d7/d2a/d36/d63/d9f/fc8 0 2024-08-19T00:56:06.667 INFO:tasks.workunit.client.1.smithi086.stdout:1/645: write d4/d7/d2a/d36/d7d/d88/fac [251728,35635] 0 2024-08-19T00:56:06.669 INFO:tasks.workunit.client.1.smithi086.stdout:3/566: getdents d3/d18/d27 0 2024-08-19T00:56:06.670 INFO:tasks.workunit.client.1.smithi086.stdout:1/646: truncate d4/d7/d2a/d36/d7d/d88/f87 433769 0 2024-08-19T00:56:06.673 INFO:tasks.workunit.client.1.smithi086.stdout:7/566: link d3/d34/d44/d58/d4b/d78/l98 d3/d34/d44/lb5 0 2024-08-19T00:56:06.677 INFO:tasks.workunit.client.1.smithi086.stdout:3/567: dwrite d3/d18/d19/f55 [0,4194304] 0 2024-08-19T00:56:06.683 INFO:tasks.workunit.client.1.smithi086.stdout:0/547: truncate da/d14/d26/f29 3937035 0 2024-08-19T00:56:06.688 INFO:tasks.workunit.client.1.smithi086.stdout:3/568: dwrite d3/d26/d60/f90 [0,4194304] 0 2024-08-19T00:56:06.691 INFO:tasks.workunit.client.1.smithi086.stdout:3/569: mkdir d3/d26/dba 0 2024-08-19T00:56:06.692 INFO:tasks.workunit.client.1.smithi086.stdout:6/541: sync 2024-08-19T00:56:06.692 INFO:tasks.workunit.client.1.smithi086.stdout:5/535: sync 2024-08-19T00:56:06.692 INFO:tasks.workunit.client.1.smithi086.stdout:1/647: dwrite d4/d1e/d6f/f97 [4194304,4194304] 0 2024-08-19T00:56:06.694 INFO:tasks.workunit.client.1.smithi086.stdout:7/567: dwrite d3/de/f2b [4194304,4194304] 0 2024-08-19T00:56:06.695 INFO:tasks.workunit.client.1.smithi086.stdout:7/568: fdatasync d3/de/f27 0 2024-08-19T00:56:06.698 INFO:tasks.workunit.client.1.smithi086.stdout:1/648: chown d4/d10/f51 14 1 2024-08-19T00:56:06.699 INFO:tasks.workunit.client.1.smithi086.stdout:5/536: write d0/d2d/d4f/f7d [974503,114054] 0 2024-08-19T00:56:06.699 INFO:tasks.workunit.client.1.smithi086.stdout:6/542: creat db/d37/d30/fab x:0 0 0 2024-08-19T00:56:06.701 INFO:tasks.workunit.client.1.smithi086.stdout:1/649: write d4/d7/d2a/d6e/fb7 [297787,94154] 0 2024-08-19T00:56:06.701 INFO:tasks.workunit.client.1.smithi086.stdout:6/543: chown db/d37/d28/d7f/f9c 6 1 2024-08-19T00:56:06.703 INFO:tasks.workunit.client.1.smithi086.stdout:3/570: dwrite d3/d26/d60/f90 [0,4194304] 0 2024-08-19T00:56:06.706 INFO:tasks.workunit.client.1.smithi086.stdout:7/569: getdents d3/d34/d44/d58/d4b 0 2024-08-19T00:56:06.707 INFO:tasks.workunit.client.1.smithi086.stdout:0/548: dread da/d14/d44/d49/f5f [0,4194304] 0 2024-08-19T00:56:06.709 INFO:tasks.workunit.client.1.smithi086.stdout:3/571: creat d3/d18/d27/fbb x:0 0 0 2024-08-19T00:56:06.716 INFO:tasks.workunit.client.1.smithi086.stdout:3/572: dwrite d3/d18/d19/d37/d5a/fb6 [0,4194304] 0 2024-08-19T00:56:06.717 INFO:tasks.workunit.client.1.smithi086.stdout:3/573: dread - d3/d18/d61/d85/fb3 zero size 2024-08-19T00:56:06.719 INFO:tasks.workunit.client.0.smithi017.stdout:1/113: sync 2024-08-19T00:56:06.724 INFO:tasks.workunit.client.1.smithi086.stdout:0/549: rmdir da/d14/d44 39 2024-08-19T00:56:06.729 INFO:tasks.workunit.client.0.smithi017.stdout:1/114: dwrite d4/f14 [0,4194304] 0 2024-08-19T00:56:06.732 INFO:tasks.workunit.client.1.smithi086.stdout:0/550: dread da/d14/d1a/d2e/d39/d3b/f70 [0,4194304] 0 2024-08-19T00:56:06.734 INFO:tasks.workunit.client.1.smithi086.stdout:3/574: rename d3/d18/d19/d37/d5a to d3/d18/d19/dbc 0 2024-08-19T00:56:06.737 INFO:tasks.workunit.client.0.smithi017.stdout:1/115: rename d4 to d4/d1c/d1f/d22 22 2024-08-19T00:56:06.739 INFO:tasks.workunit.client.1.smithi086.stdout:7/570: truncate d3/d34/d44/d58/d4b/da5/f74 800835 0 2024-08-19T00:56:06.742 INFO:tasks.workunit.client.0.smithi017.stdout:1/116: dread d4/dc/f18 [0,4194304] 0 2024-08-19T00:56:06.745 INFO:tasks.workunit.client.1.smithi086.stdout:7/571: rename d3/d34/d44/f71 to d3/de/d68/fb6 0 2024-08-19T00:56:06.747 INFO:tasks.workunit.client.0.smithi017.stdout:1/117: chown d4/dc/d17/d1d/f1e 366905 1 2024-08-19T00:56:06.748 INFO:tasks.workunit.client.1.smithi086.stdout:7/572: symlink d3/d34/d44/lb7 0 2024-08-19T00:56:06.751 INFO:tasks.workunit.client.1.smithi086.stdout:1/650: dwrite d4/d7/f39 [0,4194304] 0 2024-08-19T00:56:06.754 INFO:tasks.workunit.client.1.smithi086.stdout:5/537: truncate d0/df/d1f/d33/f40 913335 0 2024-08-19T00:56:06.754 INFO:tasks.workunit.client.1.smithi086.stdout:1/651: fsync d4/d7/d2a/d36/d3a/d41/f7e 0 2024-08-19T00:56:06.755 INFO:tasks.workunit.client.0.smithi017.stdout:1/118: link d4/l5 d4/dc/d17/d1d/l23 0 2024-08-19T00:56:06.757 INFO:tasks.workunit.client.1.smithi086.stdout:7/573: dwrite d3/de/d68/d72/fa0 [0,4194304] 0 2024-08-19T00:56:06.761 INFO:tasks.workunit.client.1.smithi086.stdout:1/652: rmdir d4/d7/d2a/d36/d63/d9f 39 2024-08-19T00:56:06.763 INFO:tasks.workunit.client.1.smithi086.stdout:5/538: mkdir d0/d99/da2 0 2024-08-19T00:56:06.765 INFO:tasks.workunit.client.0.smithi017.stdout:1/119: dwrite d4/dc/f11 [0,4194304] 0 2024-08-19T00:56:06.767 INFO:tasks.workunit.client.1.smithi086.stdout:0/551: dread da/d14/f6f [0,4194304] 0 2024-08-19T00:56:06.769 INFO:tasks.workunit.client.1.smithi086.stdout:5/539: read d0/d8/d10/f42 [3248627,95481] 0 2024-08-19T00:56:06.770 INFO:tasks.workunit.client.1.smithi086.stdout:1/653: dwrite d4/d7/d2a/d36/d7d/d88/f5b [4194304,4194304] 0 2024-08-19T00:56:06.770 INFO:tasks.workunit.client.0.smithi017.stdout:1/120: mknod d4/dc/d17/c24 0 2024-08-19T00:56:06.777 INFO:tasks.workunit.client.1.smithi086.stdout:5/540: fdatasync d0/d2d/f32 0 2024-08-19T00:56:06.779 INFO:tasks.workunit.client.1.smithi086.stdout:5/541: chown d0/d8/d72/l7f 10422 1 2024-08-19T00:56:06.780 INFO:tasks.workunit.client.0.smithi017.stdout:1/121: link d4/f13 d4/d1c/f25 0 2024-08-19T00:56:06.782 INFO:tasks.workunit.client.1.smithi086.stdout:1/654: creat d4/d7/d2a/d36/d63/d84/fd2 x:0 0 0 2024-08-19T00:56:06.782 INFO:tasks.workunit.client.1.smithi086.stdout:7/574: link d3/l2e d3/de/lb8 0 2024-08-19T00:56:06.784 INFO:tasks.workunit.client.1.smithi086.stdout:0/552: dwrite da/d14/d26/f68 [4194304,4194304] 0 2024-08-19T00:56:06.784 INFO:tasks.workunit.client.0.smithi017.stdout:1/122: mknod d4/d1c/d1f/c26 0 2024-08-19T00:56:06.785 INFO:tasks.workunit.client.0.smithi017.stdout:1/123: chown d4/ff 0 1 2024-08-19T00:56:06.787 INFO:tasks.workunit.client.0.smithi017.stdout:1/124: mknod d4/d1c/c27 0 2024-08-19T00:56:06.787 INFO:tasks.workunit.client.0.smithi017.stdout:1/125: chown d4/dc/f11 1223 1 2024-08-19T00:56:06.789 INFO:tasks.workunit.client.0.smithi017.stdout:1/126: mknod d4/dc/d17/c28 0 2024-08-19T00:56:06.790 INFO:tasks.workunit.client.1.smithi086.stdout:0/553: write da/d14/d1a/f54 [2531748,81677] 0 2024-08-19T00:56:06.791 INFO:tasks.workunit.client.0.smithi017.stdout:1/127: symlink d4/dc/d17/d1d/l29 0 2024-08-19T00:56:06.792 INFO:tasks.workunit.client.0.smithi017.stdout:1/128: fsync d4/ff 0 2024-08-19T00:56:06.793 INFO:tasks.workunit.client.1.smithi086.stdout:7/575: dwrite d3/d5b/f6c [4194304,4194304] 0 2024-08-19T00:56:06.797 INFO:tasks.workunit.client.1.smithi086.stdout:7/576: creat d3/de/d68/d7a/d96/fb9 x:0 0 0 2024-08-19T00:56:06.798 INFO:tasks.workunit.client.0.smithi017.stdout:1/129: dwrite d4/dc/f11 [0,4194304] 0 2024-08-19T00:56:06.800 INFO:tasks.workunit.client.1.smithi086.stdout:7/577: creat d3/d34/d44/d58/d4b/da5/fba x:0 0 0 2024-08-19T00:56:06.806 INFO:tasks.workunit.client.1.smithi086.stdout:7/578: link d3/de/f70 d3/de/d68/d72/fbb 0 2024-08-19T00:56:06.806 INFO:tasks.workunit.client.1.smithi086.stdout:7/579: fdatasync d3/d34/f52 0 2024-08-19T00:56:06.808 INFO:tasks.workunit.client.1.smithi086.stdout:7/580: symlink d3/d34/lbc 0 2024-08-19T00:56:06.810 INFO:tasks.workunit.client.1.smithi086.stdout:7/581: creat d3/d34/d44/d58/d4b/fbd x:0 0 0 2024-08-19T00:56:06.810 INFO:tasks.workunit.client.1.smithi086.stdout:9/583: sync 2024-08-19T00:56:06.810 INFO:tasks.workunit.client.1.smithi086.stdout:4/520: sync 2024-08-19T00:56:06.810 INFO:tasks.workunit.client.1.smithi086.stdout:8/544: sync 2024-08-19T00:56:06.811 INFO:tasks.workunit.client.1.smithi086.stdout:2/534: sync 2024-08-19T00:56:06.812 INFO:tasks.workunit.client.1.smithi086.stdout:8/545: truncate dc/f36 6929095 0 2024-08-19T00:56:06.813 INFO:tasks.workunit.client.1.smithi086.stdout:2/535: write d8/f12 [1031122,86070] 0 2024-08-19T00:56:06.813 INFO:tasks.workunit.client.1.smithi086.stdout:9/584: creat db/d5e/fbe x:0 0 0 2024-08-19T00:56:06.813 INFO:tasks.workunit.client.1.smithi086.stdout:7/582: creat d3/de/d68/d7a/fbe x:0 0 0 2024-08-19T00:56:06.816 INFO:tasks.workunit.client.1.smithi086.stdout:9/585: chown db/d26/d5c/c72 962 1 2024-08-19T00:56:06.816 INFO:tasks.workunit.client.1.smithi086.stdout:5/542: dread d0/d8/f37 [0,4194304] 0 2024-08-19T00:56:06.816 INFO:tasks.workunit.client.1.smithi086.stdout:4/521: truncate d2/d18/d33/d42/d72/f62 4818075 0 2024-08-19T00:56:06.819 INFO:tasks.workunit.client.1.smithi086.stdout:4/522: stat d2/cac 0 2024-08-19T00:56:06.819 INFO:tasks.workunit.client.1.smithi086.stdout:9/586: mkdir db/d26/d5c/d87/d6d/dbf 0 2024-08-19T00:56:06.822 INFO:tasks.workunit.client.1.smithi086.stdout:0/554: dread da/d14/d44/f5a [0,4194304] 0 2024-08-19T00:56:06.825 INFO:tasks.workunit.client.0.smithi017.stdout:1/130: dwrite d4/f10 [0,4194304] 0 2024-08-19T00:56:06.825 INFO:tasks.workunit.client.1.smithi086.stdout:9/587: truncate db/dd/f14 2165229 0 2024-08-19T00:56:06.826 INFO:tasks.workunit.client.1.smithi086.stdout:2/536: dwrite d8/d84/d79/f98 [0,4194304] 0 2024-08-19T00:56:06.828 INFO:tasks.workunit.client.1.smithi086.stdout:7/583: write d3/d34/d44/d58/d4b/d78/f94 [159914,79259] 0 2024-08-19T00:56:06.828 INFO:tasks.workunit.client.1.smithi086.stdout:9/588: fdatasync db/d5e/fb6 0 2024-08-19T00:56:06.828 INFO:tasks.workunit.client.1.smithi086.stdout:8/546: dwrite dc/d16/d18/d29/d2e/d28/d41/f59 [4194304,4194304] 0 2024-08-19T00:56:06.828 INFO:tasks.workunit.client.0.smithi017.stdout:1/131: creat d4/d1c/f2a x:0 0 0 2024-08-19T00:56:06.830 INFO:tasks.workunit.client.0.smithi017.stdout:0/107: sync 2024-08-19T00:56:06.830 INFO:tasks.workunit.client.0.smithi017.stdout:6/102: sync 2024-08-19T00:56:06.830 INFO:tasks.workunit.client.0.smithi017.stdout:4/85: sync 2024-08-19T00:56:06.831 INFO:tasks.workunit.client.0.smithi017.stdout:8/76: sync 2024-08-19T00:56:06.831 INFO:tasks.workunit.client.0.smithi017.stdout:5/125: sync 2024-08-19T00:56:06.831 INFO:tasks.workunit.client.0.smithi017.stdout:3/200: sync 2024-08-19T00:56:06.831 INFO:tasks.workunit.client.0.smithi017.stdout:9/125: sync 2024-08-19T00:56:06.831 INFO:tasks.workunit.client.0.smithi017.stdout:7/140: sync 2024-08-19T00:56:06.831 INFO:tasks.workunit.client.0.smithi017.stdout:2/200: sync 2024-08-19T00:56:06.832 INFO:tasks.workunit.client.0.smithi017.stdout:8/77: fdatasync f0 0 2024-08-19T00:56:06.834 INFO:tasks.workunit.client.0.smithi017.stdout:8/78: readlink l3 0 2024-08-19T00:56:06.834 INFO:tasks.workunit.client.0.smithi017.stdout:9/126: fdatasync d0/f18 0 2024-08-19T00:56:06.835 INFO:tasks.workunit.client.1.smithi086.stdout:0/555: creat da/d14/d44/d7b/fb5 x:0 0 0 2024-08-19T00:56:06.835 INFO:tasks.workunit.client.1.smithi086.stdout:4/523: symlink d2/d18/d33/d42/d72/d78/d2c/dae/lb3 0 2024-08-19T00:56:06.835 INFO:tasks.workunit.client.0.smithi017.stdout:5/126: dread - db/d19/d1f/d15/f1a zero size 2024-08-19T00:56:06.836 INFO:tasks.workunit.client.0.smithi017.stdout:3/201: mkdir d5/da/d3c 0 2024-08-19T00:56:06.837 INFO:tasks.workunit.client.1.smithi086.stdout:0/556: readlink da/d97/lb3 0 2024-08-19T00:56:06.840 INFO:tasks.workunit.client.1.smithi086.stdout:7/584: dwrite d3/ff [0,4194304] 0 2024-08-19T00:56:06.840 INFO:tasks.workunit.client.1.smithi086.stdout:2/537: creat d8/d43/d65/fb5 x:0 0 0 2024-08-19T00:56:06.841 INFO:tasks.workunit.client.0.smithi017.stdout:0/108: creat d5/d18/f24 x:0 0 0 2024-08-19T00:56:06.842 INFO:tasks.workunit.client.1.smithi086.stdout:2/538: read d8/d2c/f49 [2514192,35805] 0 2024-08-19T00:56:06.843 INFO:tasks.workunit.client.0.smithi017.stdout:8/79: mknod de/c11 0 2024-08-19T00:56:06.843 INFO:tasks.workunit.client.1.smithi086.stdout:5/543: dread d0/d2d/d43/f45 [0,4194304] 0 2024-08-19T00:56:06.843 INFO:tasks.workunit.client.1.smithi086.stdout:0/557: mknod da/d14/d1a/d2e/d30/d76/cb6 0 2024-08-19T00:56:06.845 INFO:tasks.workunit.client.1.smithi086.stdout:2/539: chown d8/d24/d32/d4d/d6a/c6c 245 1 2024-08-19T00:56:06.845 INFO:tasks.workunit.client.1.smithi086.stdout:9/589: creat db/d26/d5c/d87/fc0 x:0 0 0 2024-08-19T00:56:06.846 INFO:tasks.workunit.client.0.smithi017.stdout:9/127: dwrite d0/f18 [4194304,4194304] 0 2024-08-19T00:56:06.847 INFO:tasks.workunit.client.1.smithi086.stdout:2/540: chown d8/d2c/d47/d73/ca4 8 1 2024-08-19T00:56:06.849 INFO:tasks.workunit.client.0.smithi017.stdout:3/202: symlink d5/d18/l3d 0 2024-08-19T00:56:06.850 INFO:tasks.workunit.client.1.smithi086.stdout:5/544: fsync d0/d5f/d60/d5b/f6e 0 2024-08-19T00:56:06.850 INFO:tasks.workunit.client.1.smithi086.stdout:2/541: chown d8/d43/d77 160492 1 2024-08-19T00:56:06.850 INFO:tasks.workunit.client.1.smithi086.stdout:7/585: creat d3/d34/d44/d58/d4b/d42/fbf x:0 0 0 2024-08-19T00:56:06.852 INFO:tasks.workunit.client.0.smithi017.stdout:0/109: fsync d5/fa 0 2024-08-19T00:56:06.853 INFO:tasks.workunit.client.1.smithi086.stdout:2/542: write d8/d14/f22 [915039,27279] 0 2024-08-19T00:56:06.854 INFO:tasks.workunit.client.0.smithi017.stdout:2/201: mkdir d2/d7/d10/d3b/d3c 0 2024-08-19T00:56:06.856 INFO:tasks.workunit.client.1.smithi086.stdout:0/558: dwrite da/d14/d1a/d2e/d39/f74 [0,4194304] 0 2024-08-19T00:56:06.858 INFO:tasks.workunit.client.0.smithi017.stdout:7/141: mkdir d3/dc/df/d1c/d2c/d2f 0 2024-08-19T00:56:06.858 INFO:tasks.workunit.client.0.smithi017.stdout:7/142: write d3/f25 [1484140,75540] 0 2024-08-19T00:56:06.859 INFO:tasks.workunit.client.1.smithi086.stdout:4/524: dread d2/d18/d33/d42/d72/d78/f89 [0,4194304] 0 2024-08-19T00:56:06.859 INFO:tasks.workunit.client.1.smithi086.stdout:7/586: symlink d3/d34/lc0 0 2024-08-19T00:56:06.859 INFO:tasks.workunit.client.1.smithi086.stdout:0/559: truncate da/d14/f99 498874 0 2024-08-19T00:56:06.860 INFO:tasks.workunit.client.0.smithi017.stdout:9/128: creat d0/db/f23 x:0 0 0 2024-08-19T00:56:06.862 INFO:tasks.workunit.client.0.smithi017.stdout:3/203: creat d5/d11/f3e x:0 0 0 2024-08-19T00:56:06.862 INFO:tasks.workunit.client.1.smithi086.stdout:2/543: symlink d8/d2c/d67/lb6 0 2024-08-19T00:56:06.863 INFO:tasks.workunit.client.0.smithi017.stdout:9/129: dread - d0/db/f23 zero size 2024-08-19T00:56:06.866 INFO:tasks.workunit.client.1.smithi086.stdout:5/545: dwrite d0/d8/d10/f42 [0,4194304] 0 2024-08-19T00:56:06.868 INFO:tasks.workunit.client.1.smithi086.stdout:7/587: mknod d3/d34/d44/d58/d4b/d78/cc1 0 2024-08-19T00:56:06.871 INFO:tasks.workunit.client.0.smithi017.stdout:0/110: mknod d5/d1b/c25 0 2024-08-19T00:56:06.873 INFO:tasks.workunit.client.1.smithi086.stdout:8/547: dread dc/f14 [0,4194304] 0 2024-08-19T00:56:06.873 INFO:tasks.workunit.client.1.smithi086.stdout:7/588: truncate d3/d34/d44/d58/d4b/d78/f94 1228973 0 2024-08-19T00:56:06.874 INFO:tasks.workunit.client.0.smithi017.stdout:9/130: dwrite d0/db/f17 [0,4194304] 0 2024-08-19T00:56:06.875 INFO:tasks.workunit.client.1.smithi086.stdout:5/546: fsync d0/d8/d10/f19 0 2024-08-19T00:56:06.878 INFO:tasks.workunit.client.1.smithi086.stdout:2/544: mkdir d8/d2c/d38/d80/db4/db7 0 2024-08-19T00:56:06.879 INFO:tasks.workunit.client.0.smithi017.stdout:9/131: dread d0/f19 [0,4194304] 0 2024-08-19T00:56:06.882 INFO:tasks.workunit.client.1.smithi086.stdout:0/560: mknod da/d14/d26/cb7 0 2024-08-19T00:56:06.883 INFO:tasks.workunit.client.1.smithi086.stdout:0/561: fsync da/f46 0 2024-08-19T00:56:06.883 INFO:tasks.workunit.client.0.smithi017.stdout:1/132: dwrite d4/f13 [0,4194304] 0 2024-08-19T00:56:06.884 INFO:tasks.workunit.client.1.smithi086.stdout:0/562: write da/fe [3771677,5307] 0 2024-08-19T00:56:06.886 INFO:tasks.workunit.client.1.smithi086.stdout:8/548: mkdir dc/d1f/d37/d4f/dac 0 2024-08-19T00:56:06.889 INFO:tasks.workunit.client.1.smithi086.stdout:9/590: dread db/d26/d5c/d87/d30/d32/d44/d67/fb1 [0,4194304] 0 2024-08-19T00:56:06.889 INFO:tasks.workunit.client.0.smithi017.stdout:8/80: rmdir de/d10 0 2024-08-19T00:56:06.889 INFO:tasks.workunit.client.0.smithi017.stdout:4/86: truncate d2/f6 1916348 0 2024-08-19T00:56:06.893 INFO:tasks.workunit.client.1.smithi086.stdout:2/545: rename d8/f20 to d8/d14/d9e/fb8 0 2024-08-19T00:56:06.897 INFO:tasks.workunit.client.0.smithi017.stdout:4/87: dwrite d2/f12 [0,4194304] 0 2024-08-19T00:56:06.897 INFO:tasks.workunit.client.1.smithi086.stdout:5/547: dwrite d0/df/d1f/d33/f3d [0,4194304] 0 2024-08-19T00:56:06.898 INFO:tasks.workunit.client.0.smithi017.stdout:5/127: getdents db 0 2024-08-19T00:56:06.906 INFO:tasks.workunit.client.0.smithi017.stdout:2/202: creat d2/d7/d10/d3b/d3c/f3d x:0 0 0 2024-08-19T00:56:06.909 INFO:tasks.workunit.client.1.smithi086.stdout:9/591: stat f7 0 2024-08-19T00:56:06.912 INFO:tasks.workunit.client.0.smithi017.stdout:1/133: creat d4/d1c/f2b x:0 0 0 2024-08-19T00:56:06.913 INFO:tasks.workunit.client.0.smithi017.stdout:1/134: chown d4/d1c/d1f 1 1 2024-08-19T00:56:06.914 INFO:tasks.workunit.client.0.smithi017.stdout:9/132: dwrite d0/fa [4194304,4194304] 0 2024-08-19T00:56:06.914 INFO:tasks.workunit.client.1.smithi086.stdout:7/589: rename d3/d34/d44/d58/d4b/d78/l50 to d3/d34/d44/d58/d4b/da5/daf/lc2 0 2024-08-19T00:56:06.915 INFO:tasks.workunit.client.0.smithi017.stdout:3/204: chown d5/da/f2b 8363780 1 2024-08-19T00:56:06.917 INFO:tasks.workunit.client.1.smithi086.stdout:2/546: mkdir d8/d2c/d38/d80/db4/db9 0 2024-08-19T00:56:06.917 INFO:tasks.workunit.client.1.smithi086.stdout:2/547: chown d8/d24 62674059 1 2024-08-19T00:56:06.920 INFO:tasks.workunit.client.1.smithi086.stdout:5/548: mkdir d0/d5f/d60/d57/d80/da3 0 2024-08-19T00:56:06.925 INFO:tasks.workunit.client.0.smithi017.stdout:4/88: unlink d2/d11/l18 0 2024-08-19T00:56:06.928 INFO:tasks.workunit.client.0.smithi017.stdout:4/89: dread d2/f7 [0,4194304] 0 2024-08-19T00:56:06.929 INFO:tasks.workunit.client.1.smithi086.stdout:7/590: creat d3/d5b/fc3 x:0 0 0 2024-08-19T00:56:06.931 INFO:tasks.workunit.client.0.smithi017.stdout:2/203: rmdir d2/d7/d10/d3b/d3c 39 2024-08-19T00:56:06.932 INFO:tasks.workunit.client.1.smithi086.stdout:2/548: creat d8/d24/d32/d61/fba x:0 0 0 2024-08-19T00:56:06.935 INFO:tasks.workunit.client.0.smithi017.stdout:1/135: mknod d4/d1c/d1f/c2c 0 2024-08-19T00:56:06.936 INFO:tasks.workunit.client.0.smithi017.stdout:1/136: write d4/dc/f11 [3461945,65680] 0 2024-08-19T00:56:06.939 INFO:tasks.workunit.client.1.smithi086.stdout:5/549: dwrite d0/d8/d10/f2b [0,4194304] 0 2024-08-19T00:56:06.940 INFO:tasks.workunit.client.0.smithi017.stdout:3/205: readlink d5/da/d27/l31 0 2024-08-19T00:56:06.941 INFO:tasks.workunit.client.0.smithi017.stdout:1/137: dread d4/f13 [0,4194304] 0 2024-08-19T00:56:06.943 INFO:tasks.workunit.client.0.smithi017.stdout:0/111: rmdir d5/d1b/d20 0 2024-08-19T00:56:06.944 INFO:tasks.workunit.client.0.smithi017.stdout:0/112: chown d5/lf 224872 1 2024-08-19T00:56:06.944 INFO:tasks.workunit.client.1.smithi086.stdout:8/549: link dc/d16/l30 dc/d16/d18/d29/d2e/d28/lad 0 2024-08-19T00:56:06.945 INFO:tasks.workunit.client.0.smithi017.stdout:5/128: symlink db/d19/d1f/l32 0 2024-08-19T00:56:06.949 INFO:tasks.workunit.client.0.smithi017.stdout:4/90: mkdir d2/d21 0 2024-08-19T00:56:06.951 INFO:tasks.workunit.client.0.smithi017.stdout:2/204: creat d2/d7/d10/f3e x:0 0 0 2024-08-19T00:56:06.951 INFO:tasks.workunit.client.0.smithi017.stdout:4/91: write d2/d1a/fe [8137973,99489] 0 2024-08-19T00:56:06.951 INFO:tasks.workunit.client.0.smithi017.stdout:0/113: dwrite d5/f1c [0,4194304] 0 2024-08-19T00:56:06.952 INFO:tasks.workunit.client.1.smithi086.stdout:3/575: sync 2024-08-19T00:56:06.952 INFO:tasks.workunit.client.1.smithi086.stdout:1/655: sync 2024-08-19T00:56:06.952 INFO:tasks.workunit.client.1.smithi086.stdout:4/525: sync 2024-08-19T00:56:06.952 INFO:tasks.workunit.client.1.smithi086.stdout:6/544: sync 2024-08-19T00:56:06.953 INFO:tasks.workunit.client.0.smithi017.stdout:7/143: getdents d3/dc/df/d23 0 2024-08-19T00:56:06.953 INFO:tasks.workunit.client.1.smithi086.stdout:2/549: mknod d8/d2c/d38/d80/db4/db7/cbb 0 2024-08-19T00:56:06.954 INFO:tasks.workunit.client.1.smithi086.stdout:3/576: dread - d3/d18/d27/d49/d3f/f9a zero size 2024-08-19T00:56:06.955 INFO:tasks.workunit.client.1.smithi086.stdout:0/563: truncate da/d14/d1a/d2e/d39/d3b/d4e/f4f 6211181 0 2024-08-19T00:56:06.955 INFO:tasks.workunit.client.1.smithi086.stdout:2/550: write d8/d24/f59 [2773030,29978] 0 2024-08-19T00:56:06.956 INFO:tasks.workunit.client.0.smithi017.stdout:9/133: symlink d0/db/d22/l24 0 2024-08-19T00:56:06.961 INFO:tasks.workunit.client.1.smithi086.stdout:6/545: unlink db/d37/d44/d5a/f5f 0 2024-08-19T00:56:06.962 INFO:tasks.workunit.client.1.smithi086.stdout:4/526: creat d2/d18/d33/d42/d72/d2f/fb4 x:0 0 0 2024-08-19T00:56:06.964 INFO:tasks.workunit.client.1.smithi086.stdout:6/546: write db/d34/d39/d76/f7b [387713,98655] 0 2024-08-19T00:56:06.965 INFO:tasks.workunit.client.1.smithi086.stdout:0/564: dread da/d14/d1a/d2e/d39/f7f [0,4194304] 0 2024-08-19T00:56:06.965 INFO:tasks.workunit.client.1.smithi086.stdout:1/656: dwrite d4/d7/d2a/d36/d7d/d88/fac [0,4194304] 0 2024-08-19T00:56:06.966 INFO:tasks.workunit.client.1.smithi086.stdout:3/577: creat d3/d26/fbd x:0 0 0 2024-08-19T00:56:06.967 INFO:tasks.workunit.client.1.smithi086.stdout:6/547: fsync db/f2b 0 2024-08-19T00:56:06.969 INFO:tasks.workunit.client.0.smithi017.stdout:5/129: rmdir db/d19 39 2024-08-19T00:56:06.971 INFO:tasks.workunit.client.1.smithi086.stdout:7/591: truncate d3/d34/d44/d58/d4b/d78/f5a 65412 0 2024-08-19T00:56:06.971 INFO:tasks.workunit.client.1.smithi086.stdout:3/578: write d3/d18/d27/d49/d3f/d5b/f70 [1298079,6854] 0 2024-08-19T00:56:06.971 INFO:tasks.workunit.client.1.smithi086.stdout:9/592: dwrite db/d26/d5c/d87/d30/d32/d44/f65 [0,4194304] 0 2024-08-19T00:56:06.973 INFO:tasks.workunit.client.0.smithi017.stdout:0/114: mkdir d5/d17/d26 0 2024-08-19T00:56:06.974 INFO:tasks.workunit.client.0.smithi017.stdout:0/115: truncate d5/f10 1034559 0 2024-08-19T00:56:06.975 INFO:tasks.workunit.client.0.smithi017.stdout:0/116: readlink d5/lf 0 2024-08-19T00:56:06.975 INFO:tasks.workunit.client.0.smithi017.stdout:0/117: chown d5/d1b/f1d 2540 1 2024-08-19T00:56:06.977 INFO:tasks.workunit.client.1.smithi086.stdout:5/550: getdents d0/d5f/d60 0 2024-08-19T00:56:06.978 INFO:tasks.workunit.client.1.smithi086.stdout:6/548: dwrite db/d37/d41/da7/f97 [4194304,4194304] 0 2024-08-19T00:56:06.980 INFO:tasks.workunit.client.0.smithi017.stdout:4/92: rename d2/d16/f1d to d2/d16/f22 0 2024-08-19T00:56:06.981 INFO:tasks.workunit.client.0.smithi017.stdout:4/93: chown d2/d1a/lf 3109 1 2024-08-19T00:56:06.982 INFO:tasks.workunit.client.1.smithi086.stdout:5/551: read d0/f6 [4651459,118945] 0 2024-08-19T00:56:06.984 INFO:tasks.workunit.client.1.smithi086.stdout:5/552: write d0/d5f/d60/d57/f92 [964004,82765] 0 2024-08-19T00:56:06.985 INFO:tasks.workunit.client.1.smithi086.stdout:4/527: creat d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/d85/fb5 x:0 0 0 2024-08-19T00:56:06.986 INFO:tasks.workunit.client.0.smithi017.stdout:9/134: mknod d0/db/c25 0 2024-08-19T00:56:06.991 INFO:tasks.workunit.client.1.smithi086.stdout:1/657: symlink d4/d10/d90/ld3 0 2024-08-19T00:56:06.991 INFO:tasks.workunit.client.0.smithi017.stdout:8/81: getdents de 0 2024-08-19T00:56:06.992 INFO:tasks.workunit.client.0.smithi017.stdout:8/82: chown de/c11 90503912 1 2024-08-19T00:56:06.994 INFO:tasks.workunit.client.0.smithi017.stdout:8/83: write fd [209053,83830] 0 2024-08-19T00:56:06.995 INFO:tasks.workunit.client.0.smithi017.stdout:1/138: mknod d4/c2d 0 2024-08-19T00:56:06.995 INFO:tasks.workunit.client.0.smithi017.stdout:8/84: write fa [509037,81573] 0 2024-08-19T00:56:07.000 INFO:tasks.workunit.client.1.smithi086.stdout:9/593: read db/f15 [11118884,74721] 0 2024-08-19T00:56:07.000 INFO:tasks.workunit.client.1.smithi086.stdout:7/592: symlink d3/d34/lc4 0 2024-08-19T00:56:07.001 INFO:tasks.workunit.client.1.smithi086.stdout:7/593: readlink d3/d34/lc4 0 2024-08-19T00:56:07.002 INFO:tasks.workunit.client.0.smithi017.stdout:7/144: mknod d3/dc/df/d1c/d2c/d2f/c30 0 2024-08-19T00:56:07.004 INFO:tasks.workunit.client.0.smithi017.stdout:7/145: readlink d3/dc/df/d1a/l20 0 2024-08-19T00:56:07.004 INFO:tasks.workunit.client.0.smithi017.stdout:6/103: sync 2024-08-19T00:56:07.006 INFO:tasks.workunit.client.1.smithi086.stdout:9/594: dwrite db/d26/d5c/d87/d30/d3f/f8a [0,4194304] 0 2024-08-19T00:56:07.008 INFO:tasks.workunit.client.1.smithi086.stdout:6/549: rename db/l6e to db/d34/lac 0 2024-08-19T00:56:07.009 INFO:tasks.workunit.client.0.smithi017.stdout:4/94: dwrite d2/f7 [0,4194304] 0 2024-08-19T00:56:07.011 INFO:tasks.workunit.client.0.smithi017.stdout:3/206: dwrite d5/d11/f34 [0,4194304] 0 2024-08-19T00:56:07.012 INFO:tasks.workunit.client.1.smithi086.stdout:2/551: creat d8/d43/fbc x:0 0 0 2024-08-19T00:56:07.013 INFO:tasks.workunit.client.1.smithi086.stdout:2/552: chown d8/d84/c8e 1722915033 1 2024-08-19T00:56:07.013 INFO:tasks.workunit.client.1.smithi086.stdout:0/565: getdents da/d14/db4 0 2024-08-19T00:56:07.014 INFO:tasks.workunit.client.0.smithi017.stdout:3/207: write d5/da/f2b [155499,81808] 0 2024-08-19T00:56:07.014 INFO:tasks.workunit.client.0.smithi017.stdout:8/85: creat de/f12 x:0 0 0 2024-08-19T00:56:07.015 INFO:tasks.workunit.client.0.smithi017.stdout:8/86: dread - de/f12 zero size 2024-08-19T00:56:07.016 INFO:tasks.workunit.client.0.smithi017.stdout:2/205: creat d2/d7/d10/d3b/f3f x:0 0 0 2024-08-19T00:56:07.018 INFO:tasks.workunit.client.0.smithi017.stdout:4/95: truncate d2/d16/f1f 496167 0 2024-08-19T00:56:07.019 INFO:tasks.workunit.client.0.smithi017.stdout:5/130: truncate db/f2e 4721897 0 2024-08-19T00:56:07.021 INFO:tasks.workunit.client.0.smithi017.stdout:4/96: dread - d2/d11/f14 zero size 2024-08-19T00:56:07.021 INFO:tasks.workunit.client.1.smithi086.stdout:1/658: symlink d4/d7/d2a/d36/d50/ld4 0 2024-08-19T00:56:07.024 INFO:tasks.workunit.client.0.smithi017.stdout:0/118: symlink d5/d17/d21/l27 0 2024-08-19T00:56:07.026 INFO:tasks.workunit.client.1.smithi086.stdout:8/550: sync 2024-08-19T00:56:07.026 INFO:tasks.workunit.client.0.smithi017.stdout:7/146: unlink d3/l6 0 2024-08-19T00:56:07.030 INFO:tasks.workunit.client.0.smithi017.stdout:3/208: dread d5/da/f2b [0,4194304] 0 2024-08-19T00:56:07.030 INFO:tasks.workunit.client.0.smithi017.stdout:8/87: dread fd [0,4194304] 0 2024-08-19T00:56:07.032 INFO:tasks.workunit.client.1.smithi086.stdout:6/550: fdatasync db/f18 0 2024-08-19T00:56:07.033 INFO:tasks.workunit.client.1.smithi086.stdout:5/553: mknod d0/d99/da2/ca4 0 2024-08-19T00:56:07.034 INFO:tasks.workunit.client.0.smithi017.stdout:5/131: readlink db/d19/d1f/d15/d1e/l2d 0 2024-08-19T00:56:07.034 INFO:tasks.workunit.client.1.smithi086.stdout:5/554: truncate d0/df/d1f/d65/f9d 148823 0 2024-08-19T00:56:07.038 INFO:tasks.workunit.client.0.smithi017.stdout:9/135: rename d0/l1d to d0/l26 0 2024-08-19T00:56:07.041 INFO:tasks.workunit.client.1.smithi086.stdout:0/566: stat da/d14/d1a/la6 0 2024-08-19T00:56:07.043 INFO:tasks.workunit.client.0.smithi017.stdout:0/119: rename d5/c14 to d5/c28 0 2024-08-19T00:56:07.044 INFO:tasks.workunit.client.0.smithi017.stdout:0/120: write d5/f11 [2883062,43148] 0 2024-08-19T00:56:07.045 INFO:tasks.workunit.client.0.smithi017.stdout:1/139: getdents d4/dc 0 2024-08-19T00:56:07.045 INFO:tasks.workunit.client.0.smithi017.stdout:1/140: fsync d4/d1c/f2b 0 2024-08-19T00:56:07.052 INFO:tasks.workunit.client.0.smithi017.stdout:6/104: dwrite d5/d13/f14 [0,4194304] 0 2024-08-19T00:56:07.054 INFO:tasks.workunit.client.0.smithi017.stdout:5/132: readlink db/l13 0 2024-08-19T00:56:07.054 INFO:tasks.workunit.client.0.smithi017.stdout:5/133: stat db/d19/d1f/d15/d1e 0 2024-08-19T00:56:07.055 INFO:tasks.workunit.client.0.smithi017.stdout:5/134: read - db/d19/d1f/d15/f1a zero size 2024-08-19T00:56:07.056 INFO:tasks.workunit.client.0.smithi017.stdout:5/135: chown db/d19/d1f/f1c 66 1 2024-08-19T00:56:07.057 INFO:tasks.workunit.client.1.smithi086.stdout:4/528: truncate d2/d18/d33/d42/d72/f96 3701143 0 2024-08-19T00:56:07.058 INFO:tasks.workunit.client.0.smithi017.stdout:9/136: mknod d0/db/d22/c27 0 2024-08-19T00:56:07.059 INFO:tasks.workunit.client.0.smithi017.stdout:9/137: truncate d0/f1a 4767111 0 2024-08-19T00:56:07.065 INFO:tasks.workunit.client.0.smithi017.stdout:7/147: symlink d3/l31 0 2024-08-19T00:56:07.066 INFO:tasks.workunit.client.0.smithi017.stdout:1/141: symlink d4/dc/d17/d1d/l2e 0 2024-08-19T00:56:07.069 INFO:tasks.workunit.client.0.smithi017.stdout:3/209: truncate d5/d11/f14 2384952 0 2024-08-19T00:56:07.069 INFO:tasks.workunit.client.0.smithi017.stdout:9/138: dwrite d0/db/f1b [4194304,4194304] 0 2024-08-19T00:56:07.076 INFO:tasks.workunit.client.0.smithi017.stdout:6/105: creat d5/d13/f1f x:0 0 0 2024-08-19T00:56:07.080 INFO:tasks.workunit.client.1.smithi086.stdout:8/551: symlink dc/d1f/d37/d4f/lae 0 2024-08-19T00:56:07.080 INFO:tasks.workunit.client.0.smithi017.stdout:5/136: write db/f10 [1057862,126316] 0 2024-08-19T00:56:07.081 INFO:tasks.workunit.client.0.smithi017.stdout:7/148: dwrite d3/dc/df/d1c/f27 [0,4194304] 0 2024-08-19T00:56:07.081 INFO:tasks.workunit.client.0.smithi017.stdout:1/142: dwrite d4/dc/f16 [0,4194304] 0 2024-08-19T00:56:07.086 INFO:tasks.workunit.client.0.smithi017.stdout:1/143: chown d4/d1c/f25 0 1 2024-08-19T00:56:07.087 INFO:tasks.workunit.client.1.smithi086.stdout:9/595: unlink db/dd/f14 0 2024-08-19T00:56:07.087 INFO:tasks.workunit.client.0.smithi017.stdout:0/121: truncate d5/f12 414325 0 2024-08-19T00:56:07.087 INFO:tasks.workunit.client.0.smithi017.stdout:0/122: truncate d5/f1c 4884660 0 2024-08-19T00:56:07.088 INFO:tasks.workunit.client.0.smithi017.stdout:4/97: truncate d2/fc 401680 0 2024-08-19T00:56:07.088 INFO:tasks.workunit.client.0.smithi017.stdout:4/98: readlink d2/l1b 0 2024-08-19T00:56:07.089 INFO:tasks.workunit.client.0.smithi017.stdout:4/99: write d2/f12 [1992223,43598] 0 2024-08-19T00:56:07.092 INFO:tasks.workunit.client.1.smithi086.stdout:5/555: creat d0/d5f/fa5 x:0 0 0 2024-08-19T00:56:07.092 INFO:tasks.workunit.client.1.smithi086.stdout:9/596: dwrite db/d26/d5c/d87/d30/d31/f6c [0,4194304] 0 2024-08-19T00:56:07.096 INFO:tasks.workunit.client.1.smithi086.stdout:2/553: unlink d8/d2c/c2e 0 2024-08-19T00:56:07.099 INFO:tasks.workunit.client.1.smithi086.stdout:0/567: rename da/d14/d1a/d2e/d39/d3b/d89/f8e to da/d14/d1a/d2e/d30/d76/fb8 0 2024-08-19T00:56:07.100 INFO:tasks.workunit.client.1.smithi086.stdout:0/568: truncate da/d14/f17 5422535 0 2024-08-19T00:56:07.100 INFO:tasks.workunit.client.0.smithi017.stdout:0/123: dwrite d5/d17/f1a [0,4194304] 0 2024-08-19T00:56:07.104 INFO:tasks.workunit.client.1.smithi086.stdout:4/529: symlink d2/d18/d33/d42/d72/d2f/lb6 0 2024-08-19T00:56:07.105 INFO:tasks.workunit.client.1.smithi086.stdout:1/659: creat d4/d7/d2a/d36/d63/d9f/fd5 x:0 0 0 2024-08-19T00:56:07.108 INFO:tasks.workunit.client.0.smithi017.stdout:6/106: mkdir d5/d13/d20 0 2024-08-19T00:56:07.112 INFO:tasks.workunit.client.1.smithi086.stdout:3/579: getdents d3 0 2024-08-19T00:56:07.115 INFO:tasks.workunit.client.1.smithi086.stdout:8/552: unlink dc/d16/d18/d29/d2e/d28/d2b/d3b/d87/la4 0 2024-08-19T00:56:07.119 INFO:tasks.workunit.client.1.smithi086.stdout:3/580: dwrite d3/d18/d27/d76/f7c [0,4194304] 0 2024-08-19T00:56:07.123 INFO:tasks.workunit.client.0.smithi017.stdout:1/144: dwrite d4/f13 [0,4194304] 0 2024-08-19T00:56:07.123 INFO:tasks.workunit.client.1.smithi086.stdout:9/597: dread db/d26/d5c/d87/d30/d32/d44/f69 [0,4194304] 0 2024-08-19T00:56:07.124 INFO:tasks.workunit.client.1.smithi086.stdout:9/598: read - db/fb2 zero size 2024-08-19T00:56:07.125 INFO:tasks.workunit.client.0.smithi017.stdout:1/145: write d4/ff [995628,109284] 0 2024-08-19T00:56:07.127 INFO:tasks.workunit.client.1.smithi086.stdout:3/581: dwrite d3/d18/d27/d49/d3f/f89 [0,4194304] 0 2024-08-19T00:56:07.128 INFO:tasks.workunit.client.1.smithi086.stdout:3/582: fsync d3/d18/f1c 0 2024-08-19T00:56:07.130 INFO:tasks.workunit.client.0.smithi017.stdout:1/146: dread d4/f14 [0,4194304] 0 2024-08-19T00:56:07.130 INFO:tasks.workunit.client.0.smithi017.stdout:4/100: creat d2/d1a/f23 x:0 0 0 2024-08-19T00:56:07.131 INFO:tasks.workunit.client.1.smithi086.stdout:5/556: rmdir d0/d20 39 2024-08-19T00:56:07.134 INFO:tasks.workunit.client.0.smithi017.stdout:9/139: write d0/f19 [1632934,67026] 0 2024-08-19T00:56:07.134 INFO:tasks.workunit.client.0.smithi017.stdout:8/88: getdents de 0 2024-08-19T00:56:07.134 INFO:tasks.workunit.client.1.smithi086.stdout:6/551: dwrite db/f11 [0,4194304] 0 2024-08-19T00:56:07.135 INFO:tasks.workunit.client.1.smithi086.stdout:6/552: readlink db/d34/l6f 0 2024-08-19T00:56:07.137 INFO:tasks.workunit.client.0.smithi017.stdout:9/140: dread d0/f18 [4194304,4194304] 0 2024-08-19T00:56:07.145 INFO:tasks.workunit.client.0.smithi017.stdout:0/124: rename d5/d18/l19 to d5/d17/l29 0 2024-08-19T00:56:07.147 INFO:tasks.workunit.client.0.smithi017.stdout:2/206: link d2/d7/d10/d19/f20 d2/d7/d10/d3b/d3c/f40 0 2024-08-19T00:56:07.152 INFO:tasks.workunit.client.1.smithi086.stdout:0/569: unlink da/d14/d1a/d2e/l4a 0 2024-08-19T00:56:07.152 INFO:tasks.workunit.client.0.smithi017.stdout:9/141: fdatasync d0/f19 0 2024-08-19T00:56:07.154 INFO:tasks.workunit.client.0.smithi017.stdout:9/142: chown d0/db/f17 547 1 2024-08-19T00:56:07.158 INFO:tasks.workunit.client.0.smithi017.stdout:6/107: mknod d5/d13/d11/c21 0 2024-08-19T00:56:07.161 INFO:tasks.workunit.client.1.smithi086.stdout:1/660: rmdir d4/d7/d2a/d6e 39 2024-08-19T00:56:07.165 INFO:tasks.workunit.client.1.smithi086.stdout:7/594: getdents d3/d34 0 2024-08-19T00:56:07.167 INFO:tasks.workunit.client.1.smithi086.stdout:1/661: dwrite d4/d10/f5a [0,4194304] 0 2024-08-19T00:56:07.170 INFO:tasks.workunit.client.1.smithi086.stdout:7/595: dread d3/ff [0,4194304] 0 2024-08-19T00:56:07.170 INFO:tasks.workunit.client.0.smithi017.stdout:1/147: mknod d4/dc/c2f 0 2024-08-19T00:56:07.172 INFO:tasks.workunit.client.1.smithi086.stdout:7/596: chown d3/de/f12 138813 1 2024-08-19T00:56:07.173 INFO:tasks.workunit.client.0.smithi017.stdout:1/148: write d4/f10 [3961001,54905] 0 2024-08-19T00:56:07.173 INFO:tasks.workunit.client.0.smithi017.stdout:1/149: write d4/fd [412024,113692] 0 2024-08-19T00:56:07.174 INFO:tasks.workunit.client.1.smithi086.stdout:7/597: read - d3/de/d68/faa zero size 2024-08-19T00:56:07.174 INFO:tasks.workunit.client.0.smithi017.stdout:8/89: rmdir de 39 2024-08-19T00:56:07.174 INFO:tasks.workunit.client.1.smithi086.stdout:1/662: dwrite d4/d7/f5e [0,4194304] 0 2024-08-19T00:56:07.176 INFO:tasks.workunit.client.1.smithi086.stdout:1/663: readlink d4/d7/d2a/d36/d50/ld4 0 2024-08-19T00:56:07.181 INFO:tasks.workunit.client.0.smithi017.stdout:4/101: mkdir d2/d11/d24 0 2024-08-19T00:56:07.181 INFO:tasks.workunit.client.0.smithi017.stdout:7/149: write d3/f12 [1785974,128362] 0 2024-08-19T00:56:07.183 INFO:tasks.workunit.client.0.smithi017.stdout:7/150: chown d3/dc/df/c13 6025512 1 2024-08-19T00:56:07.183 INFO:tasks.workunit.client.0.smithi017.stdout:7/151: chown d3/dc/df/d1c 92980 1 2024-08-19T00:56:07.184 INFO:tasks.workunit.client.0.smithi017.stdout:7/152: write d3/dc/df/d1c/f27 [3812649,32966] 0 2024-08-19T00:56:07.185 INFO:tasks.workunit.client.0.smithi017.stdout:0/125: symlink d5/l2a 0 2024-08-19T00:56:07.186 INFO:tasks.workunit.client.1.smithi086.stdout:8/553: dwrite dc/f1c [0,4194304] 0 2024-08-19T00:56:07.187 INFO:tasks.workunit.client.1.smithi086.stdout:8/554: write dc/f51 [951364,76853] 0 2024-08-19T00:56:07.189 INFO:tasks.workunit.client.1.smithi086.stdout:5/557: creat d0/d2d/d43/d4d/fa6 x:0 0 0 2024-08-19T00:56:07.191 INFO:tasks.workunit.client.1.smithi086.stdout:6/553: unlink db/d37/l2a 0 2024-08-19T00:56:07.192 INFO:tasks.workunit.client.0.smithi017.stdout:9/143: mknod d0/db/c28 0 2024-08-19T00:56:07.192 INFO:tasks.workunit.client.0.smithi017.stdout:9/144: stat d0/db/c1e 0 2024-08-19T00:56:07.194 INFO:tasks.workunit.client.0.smithi017.stdout:6/108: creat d5/d13/f22 x:0 0 0 2024-08-19T00:56:07.196 INFO:tasks.workunit.client.0.smithi017.stdout:6/109: write d5/d13/f1b [794618,76116] 0 2024-08-19T00:56:07.201 INFO:tasks.workunit.client.0.smithi017.stdout:9/145: dwrite d0/db/f1b [0,4194304] 0 2024-08-19T00:56:07.201 INFO:tasks.workunit.client.1.smithi086.stdout:0/570: creat da/d14/d44/fb9 x:0 0 0 2024-08-19T00:56:07.204 INFO:tasks.workunit.client.1.smithi086.stdout:4/530: symlink d2/d18/d33/d42/d72/d78/d2c/db0/lb7 0 2024-08-19T00:56:07.205 INFO:tasks.workunit.client.1.smithi086.stdout:4/531: truncate d2/d18/d33/d42/d72/d2f/f82 899754 0 2024-08-19T00:56:07.211 INFO:tasks.workunit.client.1.smithi086.stdout:4/532: dwrite d2/d18/f86 [0,4194304] 0 2024-08-19T00:56:07.212 INFO:tasks.workunit.client.0.smithi017.stdout:9/146: dwrite d0/f1a [0,4194304] 0 2024-08-19T00:56:07.220 INFO:tasks.workunit.client.0.smithi017.stdout:1/150: rmdir d4/d1c/d1f 39 2024-08-19T00:56:07.225 INFO:tasks.workunit.client.0.smithi017.stdout:8/90: mknod de/c13 0 2024-08-19T00:56:07.227 INFO:tasks.workunit.client.1.smithi086.stdout:2/554: truncate d8/f1e 990335 0 2024-08-19T00:56:07.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.241+0000 7facef91d640 1 -- 172.21.15.17:0/770370653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8102fb0 msgr2=0x7face81053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:07.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.241+0000 7facef91d640 1 --2- 172.21.15.17:0/770370653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8102fb0 0x7face81053a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7facd80098b0 tx=0x7facd802a4d0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.241+0000 7facef91d640 1 -- 172.21.15.17:0/770370653 shutdown_connections 2024-08-19T00:56:07.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.241+0000 7facef91d640 1 --2- 172.21.15.17:0/770370653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8102fb0 0x7face81053a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.241+0000 7facef91d640 1 --2- 172.21.15.17:0/770370653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face8100680 0x7face8102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.241+0000 7facef91d640 1 -- 172.21.15.17:0/770370653 >> 172.21.15.17:0/770370653 conn(0x7face80fa280 msgr2=0x7face80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.241+0000 7facef91d640 1 -- 172.21.15.17:0/770370653 shutdown_connections 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.241+0000 7facef91d640 1 -- 172.21.15.17:0/770370653 wait complete. 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.242+0000 7facef91d640 1 Processor -- start 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.242+0000 7facef91d640 1 -- start start 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.242+0000 7facef91d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face8100680 0x7face81956f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.242+0000 7facef91d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8102fb0 0x7face8195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.242+0000 7facef91d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face8196200 con 0x7face8102fb0 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.242+0000 7facef91d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face8196370 con 0x7face8100680 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.242+0000 7faceceb8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8102fb0 0x7face8195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.242+0000 7faceceb8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8102fb0 0x7face8195c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46996/0 (socket says 172.21.15.17:46996) 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.242+0000 7faceceb8640 1 -- 172.21.15.17:0/4109446023 learned_addr learned my addr 172.21.15.17:0/4109446023 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:56:07.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.242+0000 7faced6b9640 1 --2- 172.21.15.17:0/4109446023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face8100680 0x7face81956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:07.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.243+0000 7faceceb8640 1 -- 172.21.15.17:0/4109446023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face8100680 msgr2=0x7face81956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:07.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.243+0000 7faceceb8640 1 --2- 172.21.15.17:0/4109446023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face8100680 0x7face81956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.243+0000 7faceceb8640 1 -- 172.21.15.17:0/4109446023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd8009560 con 0x7face8102fb0 2024-08-19T00:56:07.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.243+0000 7faceceb8640 1 --2- 172.21.15.17:0/4109446023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8102fb0 0x7face8195c30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7facd80055a0 tx=0x7facd80055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:07.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.243+0000 7facde7fc640 1 -- 172.21.15.17:0/4109446023 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd8004aa0 con 0x7face8102fb0 2024-08-19T00:56:07.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.243+0000 7facde7fc640 1 -- 172.21.15.17:0/4109446023 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7facd8004c00 con 0x7face8102fb0 2024-08-19T00:56:07.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.243+0000 7facde7fc640 1 -- 172.21.15.17:0/4109446023 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facd8003b50 con 0x7face8102fb0 2024-08-19T00:56:07.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.243+0000 7facef91d640 1 -- 172.21.15.17:0/4109446023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face819adb0 con 0x7face8102fb0 2024-08-19T00:56:07.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.243+0000 7facef91d640 1 -- 172.21.15.17:0/4109446023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face819b250 con 0x7face8102fb0 2024-08-19T00:56:07.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.244+0000 7facef91d640 1 -- 172.21.15.17:0/4109446023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face81087e0 con 0x7face8102fb0 2024-08-19T00:56:07.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.245+0000 7facde7fc640 1 -- 172.21.15.17:0/4109446023 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 91559+0+0 (secure 0 0 0) 0x7facd8003cb0 con 0x7face8102fb0 2024-08-19T00:56:07.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.245+0000 7facde7fc640 1 --2- 172.21.15.17:0/4109446023 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7facd406d660 0x7facd406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:07.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.245+0000 7facde7fc640 1 -- 172.21.15.17:0/4109446023 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7facd80ae310 con 0x7face8102fb0 2024-08-19T00:56:07.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.246+0000 7faced6b9640 1 --2- 172.21.15.17:0/4109446023 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7facd406d660 0x7facd406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:07.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.246+0000 7faced6b9640 1 --2- 172.21.15.17:0/4109446023 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7facd406d660 0x7facd406fb20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7face4005d00 tx=0x7face400b410 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:07.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.250+0000 7facde7fc640 1 -- 172.21.15.17:0/4109446023 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7facd8077b00 con 0x7face8102fb0 2024-08-19T00:56:07.258 INFO:tasks.workunit.client.1.smithi086.stdout:1/664: fsync d4/d10/f51 0 2024-08-19T00:56:07.260 INFO:tasks.workunit.client.0.smithi017.stdout:7/153: unlink d3/f1e 0 2024-08-19T00:56:07.261 INFO:tasks.workunit.client.0.smithi017.stdout:7/154: stat d3/dc/df/d1c 0 2024-08-19T00:56:07.263 INFO:tasks.workunit.client.0.smithi017.stdout:0/126: mkdir d5/d17/d2b 0 2024-08-19T00:56:07.264 INFO:tasks.workunit.client.0.smithi017.stdout:0/127: chown d5/d1b/c25 354 1 2024-08-19T00:56:07.265 INFO:tasks.workunit.client.0.smithi017.stdout:0/128: chown d5/d17/d21/l27 404135 1 2024-08-19T00:56:07.268 INFO:tasks.workunit.client.0.smithi017.stdout:6/110: symlink d5/l23 0 2024-08-19T00:56:07.270 INFO:tasks.workunit.client.0.smithi017.stdout:4/102: write d2/d11/f14 [892686,107812] 0 2024-08-19T00:56:07.272 INFO:tasks.workunit.client.1.smithi086.stdout:5/558: fsync d0/d8/f37 0 2024-08-19T00:56:07.274 INFO:tasks.workunit.client.1.smithi086.stdout:9/599: truncate db/dd/f62 1783731 0 2024-08-19T00:56:07.277 INFO:tasks.workunit.client.0.smithi017.stdout:8/91: fsync fd 0 2024-08-19T00:56:07.277 INFO:tasks.workunit.client.1.smithi086.stdout:5/559: dwrite d0/d5f/d60/f83 [0,4194304] 0 2024-08-19T00:56:07.278 INFO:tasks.workunit.client.0.smithi017.stdout:2/207: truncate d2/d7/dd/f1c 774564 0 2024-08-19T00:56:07.280 INFO:tasks.workunit.client.0.smithi017.stdout:2/208: write d2/d7/d10/f3e [721938,112] 0 2024-08-19T00:56:07.281 INFO:tasks.workunit.client.0.smithi017.stdout:1/151: dwrite d4/f14 [4194304,4194304] 0 2024-08-19T00:56:07.288 INFO:tasks.workunit.client.0.smithi017.stdout:0/129: mknod d5/d1b/c2c 0 2024-08-19T00:56:07.288 INFO:tasks.workunit.client.0.smithi017.stdout:0/130: readlink d5/l8 0 2024-08-19T00:56:07.288 INFO:tasks.workunit.client.1.smithi086.stdout:2/555: creat d8/d2c/d38/d80/db4/fbd x:0 0 0 2024-08-19T00:56:07.289 INFO:tasks.workunit.client.0.smithi017.stdout:0/131: read d5/f1c [1684023,119330] 0 2024-08-19T00:56:07.289 INFO:tasks.workunit.client.0.smithi017.stdout:6/111: creat d5/d13/f24 x:0 0 0 2024-08-19T00:56:07.291 INFO:tasks.workunit.client.1.smithi086.stdout:7/598: rename d3/d34/d44/d58/d4b/f3d to d3/de/d68/d72/fc5 0 2024-08-19T00:56:07.293 INFO:tasks.workunit.client.1.smithi086.stdout:1/665: creat d4/d7/d2a/d36/d63/d84/d8e/fd6 x:0 0 0 2024-08-19T00:56:07.297 INFO:tasks.workunit.client.0.smithi017.stdout:8/92: mknod de/c14 0 2024-08-19T00:56:07.305 INFO:tasks.workunit.client.0.smithi017.stdout:2/209: creat d2/d7/d10/d19/f41 x:0 0 0 2024-08-19T00:56:07.306 INFO:tasks.workunit.client.1.smithi086.stdout:9/600: mkdir db/d26/d5c/d87/d30/d32/d44/dc1 0 2024-08-19T00:56:07.309 INFO:tasks.workunit.client.1.smithi086.stdout:0/571: creat da/d14/db4/fba x:0 0 0 2024-08-19T00:56:07.310 INFO:tasks.workunit.client.0.smithi017.stdout:0/132: creat d5/d17/d21/f2d x:0 0 0 2024-08-19T00:56:07.311 INFO:tasks.workunit.client.1.smithi086.stdout:4/533: symlink d2/lb8 0 2024-08-19T00:56:07.311 INFO:tasks.workunit.client.1.smithi086.stdout:4/534: readlink d2/d18/d33/l94 0 2024-08-19T00:56:07.312 INFO:tasks.workunit.client.0.smithi017.stdout:6/112: mknod d5/d13/c25 0 2024-08-19T00:56:07.312 INFO:tasks.workunit.client.1.smithi086.stdout:8/555: write f3 [966847,88917] 0 2024-08-19T00:56:07.314 INFO:tasks.workunit.client.0.smithi017.stdout:4/103: creat d2/d21/f25 x:0 0 0 2024-08-19T00:56:07.317 INFO:tasks.workunit.client.0.smithi017.stdout:9/147: link d0/f15 d0/db/f29 0 2024-08-19T00:56:07.320 INFO:tasks.workunit.client.0.smithi017.stdout:8/93: unlink fd 0 2024-08-19T00:56:07.321 INFO:tasks.workunit.client.1.smithi086.stdout:5/560: rename d0/df/d1f/d33/l4a to d0/d5f/d60/d57/la7 0 2024-08-19T00:56:07.326 INFO:tasks.workunit.client.1.smithi086.stdout:3/583: link d3/d18/d27/d76/l86 d3/d26/lbe 0 2024-08-19T00:56:07.326 INFO:tasks.workunit.client.1.smithi086.stdout:5/561: dwrite d0/d8/f37 [0,4194304] 0 2024-08-19T00:56:07.327 INFO:tasks.workunit.client.0.smithi017.stdout:0/133: symlink d5/d17/l2e 0 2024-08-19T00:56:07.328 INFO:tasks.workunit.client.1.smithi086.stdout:5/562: write d0/d5f/f6f [598978,120289] 0 2024-08-19T00:56:07.329 INFO:tasks.workunit.client.1.smithi086.stdout:6/554: mkdir db/d37/d41/dad 0 2024-08-19T00:56:07.330 INFO:tasks.workunit.client.1.smithi086.stdout:9/601: rmdir db/d96/da7 39 2024-08-19T00:56:07.331 INFO:tasks.workunit.client.1.smithi086.stdout:3/584: truncate d3/d18/d61/d85/fb3 121397 0 2024-08-19T00:56:07.331 INFO:tasks.workunit.client.1.smithi086.stdout:1/666: dwrite d4/d7/d2a/d36/d50/f66 [0,4194304] 0 2024-08-19T00:56:07.333 INFO:tasks.workunit.client.1.smithi086.stdout:0/572: rmdir da/d14/d44 39 2024-08-19T00:56:07.334 INFO:tasks.workunit.client.1.smithi086.stdout:0/573: dread - da/d14/d1a/d2e/d39/d3b/d4e/fb0 zero size 2024-08-19T00:56:07.339 INFO:tasks.workunit.client.0.smithi017.stdout:1/152: mkdir d4/dc/d19/d30 0 2024-08-19T00:56:07.341 INFO:tasks.workunit.client.0.smithi017.stdout:2/210: mknod d2/d7/c42 0 2024-08-19T00:56:07.345 INFO:tasks.workunit.client.0.smithi017.stdout:4/104: rename d2/d16/l1e to d2/d1a/l26 0 2024-08-19T00:56:07.347 INFO:tasks.workunit.client.0.smithi017.stdout:9/148: truncate d0/f19 198636 0 2024-08-19T00:56:07.349 INFO:tasks.workunit.client.0.smithi017.stdout:7/155: write d3/dc/df/d23/f26 [1916197,13171] 0 2024-08-19T00:56:07.350 INFO:tasks.workunit.client.0.smithi017.stdout:7/156: chown d3/dc/df/l15 60465 1 2024-08-19T00:56:07.352 INFO:tasks.workunit.client.1.smithi086.stdout:3/585: creat d3/d18/d61/d85/fbf x:0 0 0 2024-08-19T00:56:07.353 INFO:tasks.workunit.client.1.smithi086.stdout:1/667: creat d4/d7/d2a/d36/d50/fd7 x:0 0 0 2024-08-19T00:56:07.353 INFO:tasks.workunit.client.0.smithi017.stdout:0/134: mkdir d5/d17/d26/d2f 0 2024-08-19T00:56:07.354 INFO:tasks.workunit.client.1.smithi086.stdout:0/574: write da/f56 [2909387,37247] 0 2024-08-19T00:56:07.355 INFO:tasks.workunit.client.0.smithi017.stdout:4/105: mkdir d2/d27 0 2024-08-19T00:56:07.355 INFO:tasks.workunit.client.1.smithi086.stdout:0/575: write da/f3c [2423020,116993] 0 2024-08-19T00:56:07.355 INFO:tasks.workunit.client.1.smithi086.stdout:4/535: truncate d2/d18/d33/d42/d72/f96 2506578 0 2024-08-19T00:56:07.358 INFO:tasks.workunit.client.0.smithi017.stdout:1/153: symlink d4/d1c/l31 0 2024-08-19T00:56:07.359 INFO:tasks.workunit.client.1.smithi086.stdout:7/599: symlink d3/d34/d44/d58/d4b/da5/lc6 0 2024-08-19T00:56:07.359 INFO:tasks.workunit.client.0.smithi017.stdout:0/135: dread d5/d17/f1a [0,4194304] 0 2024-08-19T00:56:07.360 INFO:tasks.workunit.client.1.smithi086.stdout:8/556: dread dc/d16/d18/d29/d2e/f3f [0,4194304] 0 2024-08-19T00:56:07.360 INFO:tasks.workunit.client.0.smithi017.stdout:7/157: mkdir d3/dc/df/d32 0 2024-08-19T00:56:07.361 INFO:tasks.workunit.client.1.smithi086.stdout:6/555: rmdir db/d37/d28/d57 39 2024-08-19T00:56:07.361 INFO:tasks.workunit.client.0.smithi017.stdout:0/136: write d5/f10 [1197291,73591] 0 2024-08-19T00:56:07.362 INFO:tasks.workunit.client.0.smithi017.stdout:7/158: write d3/dc/df/f28 [317082,25503] 0 2024-08-19T00:56:07.363 INFO:tasks.workunit.client.0.smithi017.stdout:4/106: dread d2/d11/f14 [0,4194304] 0 2024-08-19T00:56:07.370 INFO:tasks.workunit.client.0.smithi017.stdout:7/159: dwrite d3/dc/f21 [0,4194304] 0 2024-08-19T00:56:07.371 INFO:tasks.workunit.client.1.smithi086.stdout:3/586: truncate d3/d9/f4c 3909924 0 2024-08-19T00:56:07.372 INFO:tasks.workunit.client.0.smithi017.stdout:7/160: rename d3 to d3/dc/df/d1c/d2c/d2f/d33 22 2024-08-19T00:56:07.373 INFO:tasks.workunit.client.1.smithi086.stdout:1/668: creat d4/d7/d2a/d36/d63/d84/fd8 x:0 0 0 2024-08-19T00:56:07.377 INFO:tasks.workunit.client.1.smithi086.stdout:3/587: dread d3/d18/d19/dbc/db8/f44 [0,4194304] 0 2024-08-19T00:56:07.377 INFO:tasks.workunit.client.0.smithi017.stdout:9/149: dwrite d0/f18 [4194304,4194304] 0 2024-08-19T00:56:07.380 INFO:tasks.workunit.client.0.smithi017.stdout:0/137: chown d5/f12 108 1 2024-08-19T00:56:07.382 INFO:tasks.workunit.client.1.smithi086.stdout:2/556: creat d8/d43/d77/fbe x:0 0 0 2024-08-19T00:56:07.383 INFO:tasks.workunit.client.0.smithi017.stdout:0/138: truncate d5/d18/f24 216685 0 2024-08-19T00:56:07.384 INFO:tasks.workunit.client.0.smithi017.stdout:0/139: dread d5/d18/f23 [0,4194304] 0 2024-08-19T00:56:07.386 INFO:tasks.workunit.client.1.smithi086.stdout:4/536: mknod d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/cb9 0 2024-08-19T00:56:07.388 INFO:tasks.workunit.client.0.smithi017.stdout:4/107: read d2/fc [399567,11457] 0 2024-08-19T00:56:07.392 INFO:tasks.workunit.client.0.smithi017.stdout:2/211: link d2/d7/f28 d2/d7/f43 0 2024-08-19T00:56:07.395 INFO:tasks.workunit.client.1.smithi086.stdout:0/576: dread da/d14/d26/f48 [0,4194304] 0 2024-08-19T00:56:07.396 INFO:tasks.workunit.client.0.smithi017.stdout:7/161: symlink d3/dc/df/d1c/l34 0 2024-08-19T00:56:07.396 INFO:tasks.workunit.client.1.smithi086.stdout:0/577: write da/f60 [1973931,115286] 0 2024-08-19T00:56:07.399 INFO:tasks.workunit.client.0.smithi017.stdout:9/150: stat d0/l26 0 2024-08-19T00:56:07.402 INFO:tasks.workunit.client.1.smithi086.stdout:3/588: dread d3/d18/d19/dbc/f9d [0,4194304] 0 2024-08-19T00:56:07.403 INFO:tasks.workunit.client.1.smithi086.stdout:3/589: truncate d3/d18/d27/fbb 854888 0 2024-08-19T00:56:07.404 INFO:tasks.workunit.client.1.smithi086.stdout:3/590: chown d3/d18/d61/f97 43809 1 2024-08-19T00:56:07.404 INFO:tasks.workunit.client.0.smithi017.stdout:4/108: fdatasync d2/d16/f22 0 2024-08-19T00:56:07.406 INFO:tasks.workunit.client.0.smithi017.stdout:7/162: dwrite d3/f5 [4194304,4194304] 0 2024-08-19T00:56:07.407 INFO:tasks.workunit.client.1.smithi086.stdout:7/600: mknod d3/d34/d44/d58/d4b/d78/cc7 0 2024-08-19T00:56:07.409 INFO:tasks.workunit.client.0.smithi017.stdout:4/109: write d2/d21/f25 [9170,121910] 0 2024-08-19T00:56:07.410 INFO:tasks.workunit.client.0.smithi017.stdout:7/163: chown d3/dc/f21 4885 1 2024-08-19T00:56:07.413 INFO:tasks.workunit.client.0.smithi017.stdout:4/110: write d2/f7 [323080,116435] 0 2024-08-19T00:56:07.414 INFO:tasks.workunit.client.1.smithi086.stdout:6/556: write db/d37/d44/d5a/d78/faa [671758,51013] 0 2024-08-19T00:56:07.415 INFO:tasks.workunit.client.0.smithi017.stdout:1/154: rmdir d4/dc/d19/d30 0 2024-08-19T00:56:07.417 INFO:tasks.workunit.client.0.smithi017.stdout:0/140: dwrite d5/f16 [0,4194304] 0 2024-08-19T00:56:07.420 INFO:tasks.workunit.client.1.smithi086.stdout:5/563: getdents d0/d5f/d60/d5b 0 2024-08-19T00:56:07.420 INFO:tasks.workunit.client.0.smithi017.stdout:0/141: read - d5/d1b/f1d zero size 2024-08-19T00:56:07.420 INFO:tasks.workunit.client.0.smithi017.stdout:2/212: dread d2/d7/fc [0,4194304] 0 2024-08-19T00:56:07.421 INFO:tasks.workunit.client.0.smithi017.stdout:2/213: stat d2/l22 0 2024-08-19T00:56:07.421 INFO:tasks.workunit.client.1.smithi086.stdout:5/564: write d0/d8/d10/f2b [572865,31549] 0 2024-08-19T00:56:07.422 INFO:tasks.workunit.client.0.smithi017.stdout:7/164: dread d3/dc/df/d1c/f27 [0,4194304] 0 2024-08-19T00:56:07.423 INFO:tasks.workunit.client.1.smithi086.stdout:8/557: truncate dc/d16/d18/d29/d2e/d28/f69 1664233 0 2024-08-19T00:56:07.423 INFO:tasks.workunit.client.0.smithi017.stdout:7/165: write d3/f4 [4242189,7047] 0 2024-08-19T00:56:07.424 INFO:tasks.workunit.client.1.smithi086.stdout:9/602: getdents db/dd 0 2024-08-19T00:56:07.426 INFO:tasks.workunit.client.1.smithi086.stdout:0/578: write da/d14/d44/f98 [771939,98788] 0 2024-08-19T00:56:07.428 INFO:tasks.workunit.client.1.smithi086.stdout:1/669: mknod d4/d7/d2a/cd9 0 2024-08-19T00:56:07.432 INFO:tasks.workunit.client.1.smithi086.stdout:1/670: dwrite d4/d10/fae [0,4194304] 0 2024-08-19T00:56:07.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:07 smithi017 ceph-mon[16627]: pgmap v14: 65 pgs: 65 active+clean; 1.5 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 44 MiB/s rd, 215 MiB/s wr, 473 op/s 2024-08-19T00:56:07.437 INFO:tasks.workunit.client.1.smithi086.stdout:1/671: dread d4/fb3 [0,4194304] 0 2024-08-19T00:56:07.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:07 smithi086 ceph-mon[24511]: pgmap v14: 65 pgs: 65 active+clean; 1.5 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 44 MiB/s rd, 215 MiB/s wr, 473 op/s 2024-08-19T00:56:07.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.524+0000 7facef91d640 1 -- 172.21.15.17:0/4109446023 --> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7face8103a30 con 0x7facd406d660 2024-08-19T00:56:07.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.525+0000 7facde7fc640 1 -- 172.21.15.17:0/4109446023 <== mgr.24369 v2:172.21.15.86:6828/261187346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7face8103a30 con 0x7facd406d660 2024-08-19T00:56:07.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.528+0000 7facef91d640 1 -- 172.21.15.17:0/4109446023 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7facd406d660 msgr2=0x7facd406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:07.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.528+0000 7facef91d640 1 --2- 172.21.15.17:0/4109446023 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7facd406d660 0x7facd406fb20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7face4005d00 tx=0x7face400b410 comp rx=0 tx=0).stop 2024-08-19T00:56:07.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.528+0000 7facef91d640 1 -- 172.21.15.17:0/4109446023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8102fb0 msgr2=0x7face8195c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:07.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.528+0000 7facef91d640 1 --2- 172.21.15.17:0/4109446023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8102fb0 0x7face8195c30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7facd80055a0 tx=0x7facd80055d0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.528+0000 7facef91d640 1 -- 172.21.15.17:0/4109446023 shutdown_connections 2024-08-19T00:56:07.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.528+0000 7facef91d640 1 --2- 172.21.15.17:0/4109446023 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7facd406d660 0x7facd406fb20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.528+0000 7facef91d640 1 --2- 172.21.15.17:0/4109446023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7face8102fb0 0x7face8195c30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.528+0000 7facef91d640 1 --2- 172.21.15.17:0/4109446023 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7face8100680 0x7face81956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.528+0000 7facef91d640 1 -- 172.21.15.17:0/4109446023 >> 172.21.15.17:0/4109446023 conn(0x7face80fa280 msgr2=0x7face80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:07.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.528+0000 7facef91d640 1 -- 172.21.15.17:0/4109446023 shutdown_connections 2024-08-19T00:56:07.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.528+0000 7facef91d640 1 -- 172.21.15.17:0/4109446023 wait complete. 2024-08-19T00:56:07.538 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:56:07.594 INFO:tasks.workunit.client.0.smithi017.stdout:4/111: mknod d2/d1a/c28 0 2024-08-19T00:56:07.600 INFO:tasks.workunit.client.0.smithi017.stdout:3/210: sync 2024-08-19T00:56:07.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.625+0000 7f7d53821640 1 -- 172.21.15.17:0/2988541334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c106670 msgr2=0x7f7d4c106a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:07.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.625+0000 7f7d53821640 1 --2- 172.21.15.17:0/2988541334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c106670 0x7f7d4c106a90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009880 tx=0x7f7d4802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.626+0000 7f7d53821640 1 -- 172.21.15.17:0/2988541334 shutdown_connections 2024-08-19T00:56:07.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.626+0000 7f7d53821640 1 --2- 172.21.15.17:0/2988541334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d4c1073f0 0x7f7d4c107850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.626+0000 7f7d53821640 1 --2- 172.21.15.17:0/2988541334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c106670 0x7f7d4c106a90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.626+0000 7f7d53821640 1 -- 172.21.15.17:0/2988541334 >> 172.21.15.17:0/2988541334 conn(0x7f7d4c075530 msgr2=0x7f7d4c077970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.626+0000 7f7d53821640 1 -- 172.21.15.17:0/2988541334 shutdown_connections 2024-08-19T00:56:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.626+0000 7f7d53821640 1 -- 172.21.15.17:0/2988541334 wait complete. 2024-08-19T00:56:07.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.627+0000 7f7d53821640 1 Processor -- start 2024-08-19T00:56:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.627+0000 7f7d53821640 1 -- start start 2024-08-19T00:56:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.628+0000 7f7d53821640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d4c106670 0x7f7d4c19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.628+0000 7f7d53821640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c1073f0 0x7f7d4c19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.628+0000 7f7d53821640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c19c820 con 0x7f7d4c106670 2024-08-19T00:56:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.628+0000 7f7d53821640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c19c990 con 0x7f7d4c1073f0 2024-08-19T00:56:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.628+0000 7f7d515bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d4c106670 0x7f7d4c19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:07.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.628+0000 7f7d50dbc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c1073f0 0x7f7d4c19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:07.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.628+0000 7f7d515bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d4c106670 0x7f7d4c19bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47014/0 (socket says 172.21.15.17:47014) 2024-08-19T00:56:07.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.628+0000 7f7d515bd640 1 -- 172.21.15.17:0/126774046 learned_addr learned my addr 172.21.15.17:0/126774046 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:56:07.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.628+0000 7f7d50dbc640 1 -- 172.21.15.17:0/126774046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d4c106670 msgr2=0x7f7d4c19bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.628+0000 7f7d50dbc640 1 --2- 172.21.15.17:0/126774046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d4c106670 0x7f7d4c19bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.628+0000 7f7d50dbc640 1 -- 172.21.15.17:0/126774046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d48009560 con 0x7f7d4c1073f0 2024-08-19T00:56:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.629+0000 7f7d50dbc640 1 --2- 172.21.15.17:0/126774046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c1073f0 0x7f7d4c19c250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00b370 tx=0x7f7d3c00b830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.629+0000 7f7d427fc640 1 -- 172.21.15.17:0/126774046 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d3c011800 con 0x7f7d4c1073f0 2024-08-19T00:56:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.629+0000 7f7d53821640 1 -- 172.21.15.17:0/126774046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c1a1420 con 0x7f7d4c1073f0 2024-08-19T00:56:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.629+0000 7f7d53821640 1 -- 172.21.15.17:0/126774046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c1a19f0 con 0x7f7d4c1073f0 2024-08-19T00:56:07.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.630+0000 7f7d427fc640 1 -- 172.21.15.17:0/126774046 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d3c011e20 con 0x7f7d4c1073f0 2024-08-19T00:56:07.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.630+0000 7f7d427fc640 1 -- 172.21.15.17:0/126774046 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d3c00f2e0 con 0x7f7d4c1073f0 2024-08-19T00:56:07.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.631+0000 7f7d53821640 1 -- 172.21.15.17:0/126774046 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d30005280 con 0x7f7d4c1073f0 2024-08-19T00:56:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.633+0000 7f7d427fc640 1 -- 172.21.15.17:0/126774046 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f7d3c011960 con 0x7f7d4c1073f0 2024-08-19T00:56:07.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.633+0000 7f7d427fc640 1 --2- 172.21.15.17:0/126774046 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f7d3806d6a0 0x7f7d3806fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:07.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.634+0000 7f7d427fc640 1 -- 172.21.15.17:0/126774046 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f7d3c08c980 con 0x7f7d4c1073f0 2024-08-19T00:56:07.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.634+0000 7f7d515bd640 1 --2- 172.21.15.17:0/126774046 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f7d3806d6a0 0x7f7d3806fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:07.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.634+0000 7f7d515bd640 1 --2- 172.21.15.17:0/126774046 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f7d3806d6a0 0x7f7d3806fb60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7d48000c00 tx=0x7f7d480314e0 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:07.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.638+0000 7f7d427fc640 1 -- 172.21.15.17:0/126774046 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f7d3c0562f0 con 0x7f7d4c1073f0 2024-08-19T00:56:07.645 INFO:tasks.workunit.client.1.smithi086.stdout:2/557: getdents d8/d14/dae 0 2024-08-19T00:56:07.657 INFO:tasks.workunit.client.1.smithi086.stdout:4/537: truncate d2/d18/d33/f36 3147156 0 2024-08-19T00:56:07.671 INFO:tasks.workunit.client.1.smithi086.stdout:6/557: fdatasync db/d34/d39/f40 0 2024-08-19T00:56:07.679 INFO:tasks.workunit.client.0.smithi017.stdout:7/166: mkdir d3/dc/df/d1c/d2c/d35 0 2024-08-19T00:56:07.681 INFO:tasks.workunit.client.1.smithi086.stdout:8/558: creat dc/d70/d8f/faf x:0 0 0 2024-08-19T00:56:07.682 INFO:tasks.workunit.client.1.smithi086.stdout:8/559: write dc/d16/d18/d29/d2e/d28/d2b/fa5 [499141,59004] 0 2024-08-19T00:56:07.682 INFO:tasks.workunit.client.0.smithi017.stdout:4/112: creat d2/f29 x:0 0 0 2024-08-19T00:56:07.685 INFO:tasks.workunit.client.1.smithi086.stdout:9/603: dread db/d26/d5c/d87/d30/d32/d44/f69 [0,4194304] 0 2024-08-19T00:56:07.686 INFO:tasks.workunit.client.1.smithi086.stdout:0/579: truncate da/d14/d1a/d2e/d39/f7f 1299097 0 2024-08-19T00:56:07.687 INFO:tasks.workunit.client.1.smithi086.stdout:0/580: fsync da/d14/d26/f2b 0 2024-08-19T00:56:07.687 INFO:tasks.workunit.client.1.smithi086.stdout:0/581: chown da/d14/d1a 44076 1 2024-08-19T00:56:07.689 INFO:tasks.workunit.client.0.smithi017.stdout:9/151: rename d0/c8 to d0/c2a 0 2024-08-19T00:56:07.694 INFO:tasks.workunit.client.0.smithi017.stdout:9/152: dread d0/f1a [0,4194304] 0 2024-08-19T00:56:07.696 INFO:tasks.workunit.client.1.smithi086.stdout:1/672: mkdir d4/d7/d2a/d36/d63/d84/dda 0 2024-08-19T00:56:07.697 INFO:tasks.workunit.client.0.smithi017.stdout:1/155: creat d4/d1c/f32 x:0 0 0 2024-08-19T00:56:07.698 INFO:tasks.workunit.client.0.smithi017.stdout:1/156: fdatasync d4/d1c/f32 0 2024-08-19T00:56:07.699 INFO:tasks.workunit.client.1.smithi086.stdout:1/673: dread d4/d7/f39 [0,4194304] 0 2024-08-19T00:56:07.699 INFO:tasks.workunit.client.1.smithi086.stdout:1/674: dread - d4/d10/d90/fbc zero size 2024-08-19T00:56:07.700 INFO:tasks.workunit.client.0.smithi017.stdout:7/167: unlink d3/dc/df/d1a/f2b 0 2024-08-19T00:56:07.700 INFO:tasks.workunit.client.1.smithi086.stdout:1/675: truncate d4/d10/d75/f81 527793 0 2024-08-19T00:56:07.701 INFO:tasks.workunit.client.1.smithi086.stdout:1/676: write d4/d7/d2a/d36/d63/fc1 [4390605,21475] 0 2024-08-19T00:56:07.702 INFO:tasks.workunit.client.1.smithi086.stdout:7/601: unlink d3/d34/d44/d58/d4b/l1c 0 2024-08-19T00:56:07.703 INFO:tasks.workunit.client.0.smithi017.stdout:1/157: dread d4/fd [0,4194304] 0 2024-08-19T00:56:07.705 INFO:tasks.workunit.client.1.smithi086.stdout:6/558: symlink db/d8e/lae 0 2024-08-19T00:56:07.707 INFO:tasks.workunit.client.1.smithi086.stdout:5/565: mknod d0/d8/ca8 0 2024-08-19T00:56:07.708 INFO:tasks.workunit.client.0.smithi017.stdout:7/168: dread d3/f12 [0,4194304] 0 2024-08-19T00:56:07.708 INFO:tasks.workunit.client.1.smithi086.stdout:5/566: truncate d0/df/d1f/d65/f9d 656700 0 2024-08-19T00:56:07.709 INFO:tasks.workunit.client.0.smithi017.stdout:7/169: fdatasync d3/f25 0 2024-08-19T00:56:07.709 INFO:tasks.workunit.client.1.smithi086.stdout:5/567: write d0/df/d1f/f28 [3609840,111803] 0 2024-08-19T00:56:07.709 INFO:tasks.workunit.client.1.smithi086.stdout:8/560: readlink dc/d16/l30 0 2024-08-19T00:56:07.710 INFO:tasks.workunit.client.0.smithi017.stdout:7/170: fsync d3/dc/f1f 0 2024-08-19T00:56:07.710 INFO:tasks.workunit.client.1.smithi086.stdout:8/561: fsync dc/d17/d1e/fa1 0 2024-08-19T00:56:07.713 INFO:tasks.workunit.client.0.smithi017.stdout:9/153: truncate d0/db/f29 328375 0 2024-08-19T00:56:07.714 INFO:tasks.workunit.client.1.smithi086.stdout:5/568: dwrite d0/df/d1f/f85 [0,4194304] 0 2024-08-19T00:56:07.728 INFO:tasks.workunit.client.0.smithi017.stdout:1/158: chown d4/dc/ce 218108901 1 2024-08-19T00:56:07.728 INFO:tasks.workunit.client.0.smithi017.stdout:9/154: dread d0/f18 [0,4194304] 0 2024-08-19T00:56:07.732 INFO:tasks.workunit.client.0.smithi017.stdout:5/137: sync 2024-08-19T00:56:07.733 INFO:tasks.workunit.client.0.smithi017.stdout:3/211: creat d5/da/f3f x:0 0 0 2024-08-19T00:56:07.737 INFO:tasks.workunit.client.1.smithi086.stdout:1/677: mknod d4/d7/d2a/d36/d63/d9f/cdb 0 2024-08-19T00:56:07.741 INFO:tasks.workunit.client.1.smithi086.stdout:9/604: symlink db/daf/lc2 0 2024-08-19T00:56:07.742 INFO:tasks.workunit.client.0.smithi017.stdout:7/171: readlink d3/dc/l18 0 2024-08-19T00:56:07.744 INFO:tasks.workunit.client.0.smithi017.stdout:0/142: getdents d5/d18 0 2024-08-19T00:56:07.746 INFO:tasks.workunit.client.1.smithi086.stdout:9/605: dwrite db/f57 [0,4194304] 0 2024-08-19T00:56:07.746 INFO:tasks.workunit.client.1.smithi086.stdout:9/606: stat db/d5e/l80 0 2024-08-19T00:56:07.748 INFO:tasks.workunit.client.0.smithi017.stdout:0/143: dread d5/fa [4194304,4194304] 0 2024-08-19T00:56:07.750 INFO:tasks.workunit.client.0.smithi017.stdout:0/144: truncate d5/d17/f1a 4924651 0 2024-08-19T00:56:07.754 INFO:tasks.workunit.client.1.smithi086.stdout:5/569: mknod d0/d8/d72/ca9 0 2024-08-19T00:56:07.754 INFO:tasks.workunit.client.1.smithi086.stdout:9/607: dwrite db/d26/d5c/d87/d37/f81 [0,4194304] 0 2024-08-19T00:56:07.756 INFO:tasks.workunit.client.1.smithi086.stdout:6/559: getdents db/d37/d28/d7f/d96 0 2024-08-19T00:56:07.759 INFO:tasks.workunit.client.0.smithi017.stdout:9/155: creat d0/db/d22/f2b x:0 0 0 2024-08-19T00:56:07.761 INFO:tasks.workunit.client.1.smithi086.stdout:6/560: dwrite db/d34/d39/f40 [0,4194304] 0 2024-08-19T00:56:07.764 INFO:tasks.workunit.client.0.smithi017.stdout:1/159: dwrite d4/dc/f16 [0,4194304] 0 2024-08-19T00:56:07.764 INFO:tasks.workunit.client.1.smithi086.stdout:1/678: symlink d4/d10/d90/ldc 0 2024-08-19T00:56:07.765 INFO:tasks.workunit.client.1.smithi086.stdout:1/679: write d4/d10/f5a [4455816,64146] 0 2024-08-19T00:56:07.778 INFO:tasks.workunit.client.1.smithi086.stdout:6/561: unlink db/d34/d39/d76/l8a 0 2024-08-19T00:56:07.784 INFO:tasks.workunit.client.1.smithi086.stdout:9/608: dread db/dd/d19/d38/f79 [0,4194304] 0 2024-08-19T00:56:07.784 INFO:tasks.workunit.client.0.smithi017.stdout:9/156: creat d0/db/d22/f2c x:0 0 0 2024-08-19T00:56:07.786 INFO:tasks.workunit.client.0.smithi017.stdout:4/113: getdents d2/d16 0 2024-08-19T00:56:07.787 INFO:tasks.workunit.client.0.smithi017.stdout:4/114: fdatasync d2/d1a/fe 0 2024-08-19T00:56:07.787 INFO:tasks.workunit.client.1.smithi086.stdout:1/680: dwrite d4/d7/fcd [0,4194304] 0 2024-08-19T00:56:07.790 INFO:tasks.workunit.client.1.smithi086.stdout:0/582: getdents da/d14/d1a/d2e/d39/d3b/d89/daf 0 2024-08-19T00:56:07.792 INFO:tasks.workunit.client.0.smithi017.stdout:5/138: unlink db/f20 0 2024-08-19T00:56:07.793 INFO:tasks.workunit.client.1.smithi086.stdout:6/562: chown db/f3b 10391616 1 2024-08-19T00:56:07.796 INFO:tasks.workunit.client.1.smithi086.stdout:3/591: rename d3/d9/f12 to d3/d18/d27/d49/fc0 0 2024-08-19T00:56:07.796 INFO:tasks.workunit.client.1.smithi086.stdout:8/562: link dc/d17/d1e/l35 dc/d17/d86/lb0 0 2024-08-19T00:56:07.800 INFO:tasks.workunit.client.1.smithi086.stdout:1/681: creat d4/d7/d2a/d36/d63/d84/fdd x:0 0 0 2024-08-19T00:56:07.800 INFO:tasks.workunit.client.0.smithi017.stdout:6/113: sync 2024-08-19T00:56:07.800 INFO:tasks.workunit.client.0.smithi017.stdout:8/94: sync 2024-08-19T00:56:07.802 INFO:tasks.workunit.client.0.smithi017.stdout:9/157: rename d0/f1a to d0/db/f2d 0 2024-08-19T00:56:07.802 INFO:tasks.workunit.client.0.smithi017.stdout:9/158: stat d0/c1c 0 2024-08-19T00:56:07.802 INFO:tasks.workunit.client.1.smithi086.stdout:0/583: symlink da/d5d/da9/d6a/lbb 0 2024-08-19T00:56:07.804 INFO:tasks.workunit.client.1.smithi086.stdout:6/563: fsync db/d37/f9e 0 2024-08-19T00:56:07.807 INFO:tasks.workunit.client.1.smithi086.stdout:7/602: rename d3/de/f1e to d3/d34/d44/d58/d4b/da5/fc8 0 2024-08-19T00:56:07.809 INFO:tasks.workunit.client.1.smithi086.stdout:3/592: mkdir d3/d18/d19/dbc/db8/dc1 0 2024-08-19T00:56:07.812 INFO:tasks.workunit.client.1.smithi086.stdout:6/564: write db/f3b [1458021,33717] 0 2024-08-19T00:56:07.814 INFO:tasks.workunit.client.1.smithi086.stdout:0/584: dread da/d5d/f7a [0,4194304] 0 2024-08-19T00:56:07.814 INFO:tasks.workunit.client.1.smithi086.stdout:0/585: readlink da/d5d/l6c 0 2024-08-19T00:56:07.819 INFO:tasks.workunit.client.1.smithi086.stdout:5/570: rename d0/d2d/d4f/f5a to d0/df/d1f/d65/faa 0 2024-08-19T00:56:07.820 INFO:tasks.workunit.client.0.smithi017.stdout:8/95: mkdir de/d15 0 2024-08-19T00:56:07.823 INFO:tasks.workunit.client.1.smithi086.stdout:5/571: dwrite d0/d8/d70/f87 [0,4194304] 0 2024-08-19T00:56:07.824 INFO:tasks.workunit.client.0.smithi017.stdout:9/159: chown d0/c2a 0 1 2024-08-19T00:56:07.824 INFO:tasks.workunit.client.1.smithi086.stdout:5/572: readlink d0/d8/lc 0 2024-08-19T00:56:07.824 INFO:tasks.workunit.client.0.smithi017.stdout:9/160: write d0/db/f23 [352750,30102] 0 2024-08-19T00:56:07.825 INFO:tasks.workunit.client.0.smithi017.stdout:9/161: fsync d0/db/f17 0 2024-08-19T00:56:07.825 INFO:tasks.workunit.client.1.smithi086.stdout:6/565: symlink db/d34/d4e/laf 0 2024-08-19T00:56:07.828 INFO:tasks.workunit.client.1.smithi086.stdout:1/682: rmdir d4/d7/d2a/d36/d7d/d88 39 2024-08-19T00:56:07.828 INFO:tasks.workunit.client.0.smithi017.stdout:5/139: mkdir db/d19/d33 0 2024-08-19T00:56:07.833 INFO:tasks.workunit.client.0.smithi017.stdout:0/145: getdents d5 0 2024-08-19T00:56:07.834 INFO:tasks.workunit.client.1.smithi086.stdout:9/609: rename db/d26/d5c/d87/d30/d32/d44/c66 to db/d26/d5c/d87/d30/d31/cc3 0 2024-08-19T00:56:07.834 INFO:tasks.workunit.client.1.smithi086.stdout:9/610: dread db/d5e/fb6 [0,4194304] 0 2024-08-19T00:56:07.836 INFO:tasks.workunit.client.0.smithi017.stdout:6/114: mknod d5/d13/d20/c26 0 2024-08-19T00:56:07.838 INFO:tasks.workunit.client.1.smithi086.stdout:7/603: link d3/de/d68/d7d/fa7 d3/d34/d44/d58/d4b/d78/fc9 0 2024-08-19T00:56:07.840 INFO:tasks.workunit.client.1.smithi086.stdout:3/593: mknod d3/d18/d1a/d51/dad/cc2 0 2024-08-19T00:56:07.840 INFO:tasks.workunit.client.0.smithi017.stdout:4/115: link d2/l1b d2/l2a 0 2024-08-19T00:56:07.841 INFO:tasks.workunit.client.0.smithi017.stdout:4/116: write d2/f7 [3374479,110253] 0 2024-08-19T00:56:07.843 INFO:tasks.workunit.client.0.smithi017.stdout:4/117: dread d2/d1a/f1c [0,4194304] 0 2024-08-19T00:56:07.846 INFO:tasks.workunit.client.1.smithi086.stdout:5/573: dwrite d0/d8/d10/f1d [0,4194304] 0 2024-08-19T00:56:07.847 INFO:tasks.workunit.client.1.smithi086.stdout:9/611: rmdir db/d26 39 2024-08-19T00:56:07.849 INFO:tasks.workunit.client.0.smithi017.stdout:0/146: mkdir d5/d17/d26/d30 0 2024-08-19T00:56:07.850 INFO:tasks.workunit.client.0.smithi017.stdout:0/147: fdatasync d5/d18/f24 0 2024-08-19T00:56:07.851 INFO:tasks.workunit.client.0.smithi017.stdout:0/148: write d5/d18/f1e [719607,30063] 0 2024-08-19T00:56:07.854 INFO:tasks.workunit.client.1.smithi086.stdout:6/566: rename db/d37/d30/fab to db/d8e/fb0 0 2024-08-19T00:56:07.855 INFO:tasks.workunit.client.0.smithi017.stdout:6/115: rmdir d5/d13/d11 39 2024-08-19T00:56:07.856 INFO:tasks.workunit.client.1.smithi086.stdout:3/594: dread d3/d26/d60/f69 [0,4194304] 0 2024-08-19T00:56:07.859 INFO:tasks.workunit.client.0.smithi017.stdout:2/214: mkdir d2/d7/d44 0 2024-08-19T00:56:07.860 INFO:tasks.workunit.client.0.smithi017.stdout:0/149: dwrite d5/d17/f22 [0,4194304] 0 2024-08-19T00:56:07.864 INFO:tasks.workunit.client.0.smithi017.stdout:0/150: write d5/f16 [2732522,92829] 0 2024-08-19T00:56:07.864 INFO:tasks.workunit.client.0.smithi017.stdout:9/162: link d0/db/d22/f2b d0/db/f2e 0 2024-08-19T00:56:07.864 INFO:tasks.workunit.client.0.smithi017.stdout:9/163: chown d0/db/f23 130030034 1 2024-08-19T00:56:07.865 INFO:tasks.workunit.client.0.smithi017.stdout:6/116: dread d5/d13/f14 [0,4194304] 0 2024-08-19T00:56:07.866 INFO:tasks.workunit.client.0.smithi017.stdout:0/151: chown d5/f16 1 1 2024-08-19T00:56:07.866 INFO:tasks.workunit.client.0.smithi017.stdout:0/152: fsync d5/d1b/f1d 0 2024-08-19T00:56:07.869 INFO:tasks.workunit.client.1.smithi086.stdout:2/558: sync 2024-08-19T00:56:07.870 INFO:tasks.workunit.client.1.smithi086.stdout:4/538: unlink d2/d18/d33/fb2 0 2024-08-19T00:56:07.871 INFO:tasks.workunit.client.1.smithi086.stdout:4/539: fsync d2/d18/d33/d42/d72/d78/d25/f3a 0 2024-08-19T00:56:07.873 INFO:tasks.workunit.client.1.smithi086.stdout:4/540: chown d2/l4e 74373 1 2024-08-19T00:56:07.873 INFO:tasks.workunit.client.0.smithi017.stdout:8/96: link de/c14 de/c16 0 2024-08-19T00:56:07.874 INFO:tasks.workunit.client.1.smithi086.stdout:4/541: dread - d2/d18/d33/d42/d72/d78/d25/f9d zero size 2024-08-19T00:56:07.877 INFO:tasks.workunit.client.1.smithi086.stdout:2/559: dwrite d8/d2c/d38/d80/db4/fbd [0,4194304] 0 2024-08-19T00:56:07.877 INFO:tasks.workunit.client.0.smithi017.stdout:8/97: dread fa [0,4194304] 0 2024-08-19T00:56:07.878 INFO:tasks.workunit.client.1.smithi086.stdout:0/586: getdents da 0 2024-08-19T00:56:07.880 INFO:tasks.workunit.client.1.smithi086.stdout:4/542: read d2/d18/d33/d42/d72/d78/d25/d55/d6c/f9c [2615275,71905] 0 2024-08-19T00:56:07.881 INFO:tasks.workunit.client.1.smithi086.stdout:5/574: mknod d0/d8/d73/cab 0 2024-08-19T00:56:07.883 INFO:tasks.workunit.client.1.smithi086.stdout:4/543: write d2/d18/d33/f64 [2480771,104331] 0 2024-08-19T00:56:07.884 INFO:tasks.workunit.client.1.smithi086.stdout:4/544: stat d2/d18/d33/d42/d72/d8f/lab 0 2024-08-19T00:56:07.886 INFO:tasks.workunit.client.1.smithi086.stdout:0/587: dwrite da/d14/d1a/d2e/d39/d3b/d4e/f77 [0,4194304] 0 2024-08-19T00:56:07.887 INFO:tasks.workunit.client.1.smithi086.stdout:0/588: readlink da/d14/d44/d49/l78 0 2024-08-19T00:56:07.890 INFO:tasks.workunit.client.0.smithi017.stdout:9/164: creat d0/db/d22/f2f x:0 0 0 2024-08-19T00:56:07.893 INFO:tasks.workunit.client.1.smithi086.stdout:3/595: dread d3/d18/f2c [0,4194304] 0 2024-08-19T00:56:07.893 INFO:tasks.workunit.client.1.smithi086.stdout:9/612: rename db/d26/d5c/d87/d6d/fae to db/d26/d5c/d87/d6d/dbf/fc4 0 2024-08-19T00:56:07.896 INFO:tasks.workunit.client.0.smithi017.stdout:6/117: stat d5/d13/d11/c21 0 2024-08-19T00:56:07.896 INFO:tasks.workunit.client.1.smithi086.stdout:6/567: symlink db/d37/d41/dad/lb1 0 2024-08-19T00:56:07.902 INFO:tasks.workunit.client.0.smithi017.stdout:4/118: unlink d2/d1a/l26 0 2024-08-19T00:56:07.903 INFO:tasks.workunit.client.0.smithi017.stdout:4/119: write d2/d1a/f23 [630716,41446] 0 2024-08-19T00:56:07.905 INFO:tasks.workunit.client.0.smithi017.stdout:5/140: creat db/f34 x:0 0 0 2024-08-19T00:56:07.907 INFO:tasks.workunit.client.0.smithi017.stdout:5/141: chown db/d19/d1f/d15/f2f 1 1 2024-08-19T00:56:07.907 INFO:tasks.workunit.client.1.smithi086.stdout:5/575: rmdir d0/d2d/d43 39 2024-08-19T00:56:07.908 INFO:tasks.workunit.client.0.smithi017.stdout:5/142: chown db/d19/d1f/d15/d1e/l2d 1078898442 1 2024-08-19T00:56:07.909 INFO:tasks.workunit.client.0.smithi017.stdout:3/212: write f2 [2996353,37900] 0 2024-08-19T00:56:07.916 INFO:tasks.workunit.client.1.smithi086.stdout:0/589: creat da/d14/d44/d49/fbc x:0 0 0 2024-08-19T00:56:07.917 INFO:tasks.workunit.client.1.smithi086.stdout:8/563: sync 2024-08-19T00:56:07.919 INFO:tasks.workunit.client.0.smithi017.stdout:1/160: truncate d4/ff 1812072 0 2024-08-19T00:56:07.919 INFO:tasks.workunit.client.1.smithi086.stdout:8/564: write dc/d17/d1e/d55/f6a [385014,112811] 0 2024-08-19T00:56:07.919 INFO:tasks.workunit.client.0.smithi017.stdout:1/161: chown d4/d1c/l31 38 1 2024-08-19T00:56:07.920 INFO:tasks.workunit.client.0.smithi017.stdout:4/120: rename d2/d1a/c28 to d2/d27/c2b 0 2024-08-19T00:56:07.921 INFO:tasks.workunit.client.1.smithi086.stdout:0/590: dwrite da/d14/d1a/f54 [4194304,4194304] 0 2024-08-19T00:56:07.921 INFO:tasks.workunit.client.0.smithi017.stdout:4/121: write d2/f29 [697101,119314] 0 2024-08-19T00:56:07.922 INFO:tasks.workunit.client.0.smithi017.stdout:4/122: write d2/f12 [904483,46797] 0 2024-08-19T00:56:07.923 INFO:tasks.workunit.client.1.smithi086.stdout:8/565: dread dc/f1c [0,4194304] 0 2024-08-19T00:56:07.924 INFO:tasks.workunit.client.1.smithi086.stdout:3/596: mknod d3/d18/d19/cc3 0 2024-08-19T00:56:07.927 INFO:tasks.workunit.client.1.smithi086.stdout:3/597: write d3/d18/d19/d37/f84 [1105593,33338] 0 2024-08-19T00:56:07.927 INFO:tasks.workunit.client.1.smithi086.stdout:9/613: symlink db/d26/d5c/d87/d30/d32/lc5 0 2024-08-19T00:56:07.929 INFO:tasks.workunit.client.1.smithi086.stdout:9/614: dread db/d5e/fb6 [0,4194304] 0 2024-08-19T00:56:07.930 INFO:tasks.workunit.client.1.smithi086.stdout:6/568: creat db/d34/d39/d76/fb2 x:0 0 0 2024-08-19T00:56:07.931 INFO:tasks.workunit.client.0.smithi017.stdout:5/143: unlink db/d19/d1f/d15/d1e/f21 0 2024-08-19T00:56:07.933 INFO:tasks.workunit.client.0.smithi017.stdout:3/213: unlink d5/d11/f2d 0 2024-08-19T00:56:07.937 INFO:tasks.workunit.client.1.smithi086.stdout:2/560: mknod d8/d14/dae/cbf 0 2024-08-19T00:56:07.946 INFO:tasks.workunit.client.0.smithi017.stdout:7/172: dwrite d3/dc/f21 [0,4194304] 0 2024-08-19T00:56:07.951 INFO:tasks.workunit.client.0.smithi017.stdout:8/98: link de/c11 de/d15/c17 0 2024-08-19T00:56:07.954 INFO:tasks.workunit.client.1.smithi086.stdout:0/591: fsync da/d14/f1d 0 2024-08-19T00:56:07.956 INFO:tasks.workunit.client.0.smithi017.stdout:8/99: dread f0 [0,4194304] 0 2024-08-19T00:56:07.959 INFO:tasks.workunit.client.1.smithi086.stdout:7/604: sync 2024-08-19T00:56:07.961 INFO:tasks.workunit.client.0.smithi017.stdout:5/144: mknod db/d19/d1f/d15/d1e/c35 0 2024-08-19T00:56:07.966 INFO:tasks.workunit.client.1.smithi086.stdout:9/615: creat db/d26/d5c/d87/d30/d58/fc6 x:0 0 0 2024-08-19T00:56:07.966 INFO:tasks.workunit.client.1.smithi086.stdout:9/616: chown f7 105477 1 2024-08-19T00:56:07.967 INFO:tasks.workunit.client.0.smithi017.stdout:7/173: mknod d3/dc/c36 0 2024-08-19T00:56:07.968 INFO:tasks.workunit.client.1.smithi086.stdout:1/683: truncate d4/d7/d2a/d36/d7d/d88/f5b 2771253 0 2024-08-19T00:56:07.970 INFO:tasks.workunit.client.0.smithi017.stdout:2/215: dwrite d2/d7/f43 [0,4194304] 0 2024-08-19T00:56:07.970 INFO:tasks.workunit.client.1.smithi086.stdout:6/569: mknod db/d37/d44/d5a/d78/cb3 0 2024-08-19T00:56:07.972 INFO:tasks.workunit.client.0.smithi017.stdout:4/123: rename d2/l2a to d2/d11/d24/l2c 0 2024-08-19T00:56:07.976 INFO:tasks.workunit.client.1.smithi086.stdout:7/605: dread d3/de/d68/d7a/f86 [0,4194304] 0 2024-08-19T00:56:07.980 INFO:tasks.workunit.client.0.smithi017.stdout:3/214: fdatasync d5/fc 0 2024-08-19T00:56:07.980 INFO:tasks.workunit.client.1.smithi086.stdout:4/545: creat d2/d18/d33/d42/fba x:0 0 0 2024-08-19T00:56:07.983 INFO:tasks.workunit.client.0.smithi017.stdout:7/174: mkdir d3/dc/df/d37 0 2024-08-19T00:56:07.985 INFO:tasks.workunit.client.0.smithi017.stdout:2/216: dwrite d2/d7/f28 [4194304,4194304] 0 2024-08-19T00:56:07.986 INFO:tasks.workunit.client.1.smithi086.stdout:0/592: mknod da/d14/d44/d7b/cbd 0 2024-08-19T00:56:07.990 INFO:tasks.workunit.client.0.smithi017.stdout:1/162: rename d4/dc/d17/c28 to d4/dc/d17/d1d/c33 0 2024-08-19T00:56:07.990 INFO:tasks.workunit.client.0.smithi017.stdout:2/217: fsync d2/d7/d10/d3b/f3f 0 2024-08-19T00:56:07.992 INFO:tasks.workunit.client.0.smithi017.stdout:5/145: dwrite db/ff [0,4194304] 0 2024-08-19T00:56:07.995 INFO:tasks.workunit.client.0.smithi017.stdout:0/153: dwrite d5/d18/f23 [0,4194304] 0 2024-08-19T00:56:07.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.996+0000 7f7d53821640 1 -- 172.21.15.17:0/126774046 --> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d30000bf0 con 0x7f7d3806d6a0 2024-08-19T00:56:08.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:07.998+0000 7f7d427fc640 1 -- 172.21.15.17:0/126774046 <== mgr.24369 v2:172.21.15.86:6828/261187346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f7d30000bf0 con 0x7f7d3806d6a0 2024-08-19T00:56:08.001 INFO:tasks.workunit.client.1.smithi086.stdout:1/684: mkdir d4/d10/dde 0 2024-08-19T00:56:08.003 INFO:tasks.workunit.client.0.smithi017.stdout:4/124: dread d2/d1a/fe [0,4194304] 0 2024-08-19T00:56:08.005 INFO:tasks.workunit.client.0.smithi017.stdout:0/154: dread d5/f16 [0,4194304] 0 2024-08-19T00:56:08.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.003+0000 7f7d37fff640 1 -- 172.21.15.17:0/126774046 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f7d3806d6a0 msgr2=0x7f7d3806fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:08.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.003+0000 7f7d37fff640 1 --2- 172.21.15.17:0/126774046 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f7d3806d6a0 0x7f7d3806fb60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7d48000c00 tx=0x7f7d480314e0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.003+0000 7f7d37fff640 1 -- 172.21.15.17:0/126774046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c1073f0 msgr2=0x7f7d4c19c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:08.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.003+0000 7f7d37fff640 1 --2- 172.21.15.17:0/126774046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c1073f0 0x7f7d4c19c250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00b370 tx=0x7f7d3c00b830 comp rx=0 tx=0).stop 2024-08-19T00:56:08.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.004+0000 7f7d37fff640 1 -- 172.21.15.17:0/126774046 shutdown_connections 2024-08-19T00:56:08.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.004+0000 7f7d37fff640 1 --2- 172.21.15.17:0/126774046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d4c1073f0 0x7f7d4c19c250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.004+0000 7f7d37fff640 1 --2- 172.21.15.17:0/126774046 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f7d3806d6a0 0x7f7d3806fb60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.004+0000 7f7d37fff640 1 --2- 172.21.15.17:0/126774046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d4c106670 0x7f7d4c19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.004+0000 7f7d37fff640 1 -- 172.21.15.17:0/126774046 >> 172.21.15.17:0/126774046 conn(0x7f7d4c075530 msgr2=0x7f7d4c10a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:08.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.005+0000 7f7d37fff640 1 -- 172.21.15.17:0/126774046 shutdown_connections 2024-08-19T00:56:08.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.005+0000 7f7d37fff640 1 -- 172.21.15.17:0/126774046 wait complete. 2024-08-19T00:56:08.010 INFO:tasks.workunit.client.0.smithi017.stdout:4/125: dread d2/d16/f1f [0,4194304] 0 2024-08-19T00:56:08.011 INFO:tasks.workunit.client.0.smithi017.stdout:6/118: dwrite d5/d13/d11/fa [0,4194304] 0 2024-08-19T00:56:08.015 INFO:tasks.workunit.client.1.smithi086.stdout:5/576: dwrite d0/f6 [4194304,4194304] 0 2024-08-19T00:56:08.018 INFO:tasks.workunit.client.1.smithi086.stdout:2/561: symlink d8/d24/d32/d4d/d6a/db1/lc0 0 2024-08-19T00:56:08.018 INFO:tasks.workunit.client.1.smithi086.stdout:2/562: fsync d8/d24/f64 0 2024-08-19T00:56:08.019 INFO:tasks.workunit.client.1.smithi086.stdout:2/563: chown d8/d2c/d38/d80 986657 1 2024-08-19T00:56:08.020 INFO:tasks.workunit.client.0.smithi017.stdout:9/165: dwrite d0/f19 [0,4194304] 0 2024-08-19T00:56:08.021 INFO:tasks.workunit.client.0.smithi017.stdout:7/175: dread d3/dc/f1f [0,4194304] 0 2024-08-19T00:56:08.022 INFO:tasks.workunit.client.1.smithi086.stdout:7/606: mkdir d3/de/d68/d72/d7e/dca 0 2024-08-19T00:56:08.022 INFO:tasks.workunit.client.0.smithi017.stdout:9/166: stat d0/db/l21 0 2024-08-19T00:56:08.025 INFO:tasks.workunit.client.0.smithi017.stdout:2/218: mkdir d2/d7/d10/d35/d45 0 2024-08-19T00:56:08.025 INFO:tasks.workunit.client.1.smithi086.stdout:4/546: unlink d2/d18/d33/d42/d72/f34 0 2024-08-19T00:56:08.026 INFO:tasks.workunit.client.1.smithi086.stdout:4/547: fsync d2/d18/d33/d42/d72/d78/d25/d55/f38 0 2024-08-19T00:56:08.031 INFO:tasks.workunit.client.1.smithi086.stdout:0/593: dread da/d14/d1a/d2e/f51 [0,4194304] 0 2024-08-19T00:56:08.036 INFO:tasks.workunit.client.1.smithi086.stdout:8/566: creat dc/d16/d18/d29/d2e/fb1 x:0 0 0 2024-08-19T00:56:08.039 INFO:tasks.workunit.client.1.smithi086.stdout:8/567: read f5 [2221604,18914] 0 2024-08-19T00:56:08.041 INFO:tasks.workunit.client.1.smithi086.stdout:3/598: creat d3/d26/d2b/d33/d4a/fc4 x:0 0 0 2024-08-19T00:56:08.043 INFO:tasks.workunit.client.0.smithi017.stdout:8/100: rename de/c16 to de/d15/c18 0 2024-08-19T00:56:08.044 INFO:tasks.workunit.client.1.smithi086.stdout:9/617: dread db/f15 [8388608,4194304] 0 2024-08-19T00:56:08.045 INFO:tasks.workunit.client.0.smithi017.stdout:0/155: dwrite d5/d17/f1a [0,4194304] 0 2024-08-19T00:56:08.045 INFO:tasks.workunit.client.0.smithi017.stdout:6/119: creat d5/d13/d20/f27 x:0 0 0 2024-08-19T00:56:08.046 INFO:tasks.workunit.client.1.smithi086.stdout:1/685: dread d4/d7/f39 [0,4194304] 0 2024-08-19T00:56:08.048 INFO:tasks.workunit.client.0.smithi017.stdout:8/101: dread de/ff [0,4194304] 0 2024-08-19T00:56:08.052 INFO:tasks.workunit.client.0.smithi017.stdout:8/102: dread f0 [4194304,4194304] 0 2024-08-19T00:56:08.053 INFO:tasks.workunit.client.0.smithi017.stdout:8/103: fdatasync f0 0 2024-08-19T00:56:08.070 INFO:tasks.workunit.client.1.smithi086.stdout:3/599: dread d3/d18/d27/d49/f32 [0,4194304] 0 2024-08-19T00:56:08.070 INFO:tasks.workunit.client.1.smithi086.stdout:3/600: readlink d3/d26/d2b/l3d 0 2024-08-19T00:56:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.112+0000 7f840d974640 1 -- 172.21.15.17:0/1244705389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84080ffb90 msgr2=0x7f84080fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.112+0000 7f840d974640 1 --2- 172.21.15.17:0/1244705389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84080ffb90 0x7f84080fff90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009880 tx=0x7f83f802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.112+0000 7f840d974640 1 -- 172.21.15.17:0/1244705389 shutdown_connections 2024-08-19T00:56:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.112+0000 7f840d974640 1 --2- 172.21.15.17:0/1244705389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8408100d90 0x7f8408101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.112+0000 7f840d974640 1 --2- 172.21.15.17:0/1244705389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f84080ffb90 0x7f84080fff90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.112+0000 7f840d974640 1 -- 172.21.15.17:0/1244705389 >> 172.21.15.17:0/1244705389 conn(0x7f84080fb320 msgr2=0x7f84080fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.112+0000 7f840d974640 1 -- 172.21.15.17:0/1244705389 shutdown_connections 2024-08-19T00:56:08.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.112+0000 7f840d974640 1 -- 172.21.15.17:0/1244705389 wait complete. 2024-08-19T00:56:08.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.112+0000 7f840d974640 1 Processor -- start 2024-08-19T00:56:08.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.112+0000 7f840d974640 1 -- start start 2024-08-19T00:56:08.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f840d974640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84080ffb90 0x7f8408195690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:08.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f840d974640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8408100d90 0x7f8408195bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:08.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f840d974640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84081961a0 con 0x7f8408100d90 2024-08-19T00:56:08.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f840d974640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8408196310 con 0x7f84080ffb90 2024-08-19T00:56:08.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f83fe7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8408100d90 0x7f8408195bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:08.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f8406ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84080ffb90 0x7f8408195690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:08.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f83fe7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8408100d90 0x7f8408195bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47042/0 (socket says 172.21.15.17:47042) 2024-08-19T00:56:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f83fe7fc640 1 -- 172.21.15.17:0/1210311823 learned_addr learned my addr 172.21.15.17:0/1210311823 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:56:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f83fe7fc640 1 -- 172.21.15.17:0/1210311823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84080ffb90 msgr2=0x7f8408195690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f83fe7fc640 1 --2- 172.21.15.17:0/1210311823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84080ffb90 0x7f8408195690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f83fe7fc640 1 -- 172.21.15.17:0/1210311823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8009560 con 0x7f8408100d90 2024-08-19T00:56:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.113+0000 7f83fe7fc640 1 --2- 172.21.15.17:0/1210311823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8408100d90 0x7f8408195bd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f83f000d720 tx=0x7f83f000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.114+0000 7f840c972640 1 -- 172.21.15.17:0/1210311823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f00051f0 con 0x7f8408100d90 2024-08-19T00:56:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.114+0000 7f840c972640 1 -- 172.21.15.17:0/1210311823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83f0009ce0 con 0x7f8408100d90 2024-08-19T00:56:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.114+0000 7f840c972640 1 -- 172.21.15.17:0/1210311823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83f0010460 con 0x7f8408100d90 2024-08-19T00:56:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.114+0000 7f840d974640 1 -- 172.21.15.17:0/1210311823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840819ad60 con 0x7f8408100d90 2024-08-19T00:56:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.114+0000 7f840d974640 1 -- 172.21.15.17:0/1210311823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840819b330 con 0x7f8408100d90 2024-08-19T00:56:08.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.115+0000 7f840d974640 1 -- 172.21.15.17:0/1210311823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840818f730 con 0x7f8408100d90 2024-08-19T00:56:08.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.115+0000 7f840c972640 1 -- 172.21.15.17:0/1210311823 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f83f0005350 con 0x7f8408100d90 2024-08-19T00:56:08.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.116+0000 7f840c972640 1 --2- 172.21.15.17:0/1210311823 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83f406d660 0x7f83f406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:08.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.116+0000 7f840c972640 1 -- 172.21.15.17:0/1210311823 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f83f008cbb0 con 0x7f8408100d90 2024-08-19T00:56:08.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.116+0000 7f8406ffd640 1 --2- 172.21.15.17:0/1210311823 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83f406d660 0x7f83f406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:08.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.117+0000 7f8406ffd640 1 --2- 172.21.15.17:0/1210311823 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83f406d660 0x7f83f406fb20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009230 tx=0x7f83f80314e0 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:08.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.120+0000 7f840c972640 1 -- 172.21.15.17:0/1210311823 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f83f0093080 con 0x7f8408100d90 2024-08-19T00:56:08.167 INFO:tasks.workunit.client.0.smithi017.stdout:5/146: creat db/d19/d1f/d15/d30/f36 x:0 0 0 2024-08-19T00:56:08.173 INFO:tasks.workunit.client.1.smithi086.stdout:6/570: dwrite f8 [12582912,4194304] 0 2024-08-19T00:56:08.179 INFO:tasks.workunit.client.0.smithi017.stdout:0/156: stat d5/d17/l29 0 2024-08-19T00:56:08.182 INFO:tasks.workunit.client.0.smithi017.stdout:1/163: creat d4/dc/f34 x:0 0 0 2024-08-19T00:56:08.183 INFO:tasks.workunit.client.0.smithi017.stdout:0/157: dread d5/d18/f1e [0,4194304] 0 2024-08-19T00:56:08.185 INFO:tasks.workunit.client.0.smithi017.stdout:6/120: fsync d5/d13/d11/fd 0 2024-08-19T00:56:08.186 INFO:tasks.workunit.client.0.smithi017.stdout:7/176: symlink d3/dc/df/d1c/d2c/d35/l38 0 2024-08-19T00:56:08.192 INFO:tasks.workunit.client.0.smithi017.stdout:5/147: creat db/d19/d1f/d15/d1e/f37 x:0 0 0 2024-08-19T00:56:08.198 INFO:tasks.workunit.client.0.smithi017.stdout:7/177: dread d3/f25 [0,4194304] 0 2024-08-19T00:56:08.198 INFO:tasks.workunit.client.0.smithi017.stdout:3/215: rename d5/da/f23 to d5/da/d27/d28/f40 0 2024-08-19T00:56:08.200 INFO:tasks.workunit.client.0.smithi017.stdout:3/216: write d5/da/d27/f2c [533534,51287] 0 2024-08-19T00:56:08.202 INFO:tasks.workunit.client.0.smithi017.stdout:1/164: mknod d4/dc/d17/d1d/c35 0 2024-08-19T00:56:08.203 INFO:tasks.workunit.client.0.smithi017.stdout:1/165: fdatasync d4/d1c/f32 0 2024-08-19T00:56:08.204 INFO:tasks.workunit.client.0.smithi017.stdout:1/166: write d4/f14 [7226701,38638] 0 2024-08-19T00:56:08.205 INFO:tasks.workunit.client.0.smithi017.stdout:0/158: symlink d5/d17/d21/l31 0 2024-08-19T00:56:08.205 INFO:tasks.workunit.client.0.smithi017.stdout:1/167: chown d4/dc/ce 43730 1 2024-08-19T00:56:08.208 INFO:tasks.workunit.client.0.smithi017.stdout:6/121: mknod d5/d13/d20/c28 0 2024-08-19T00:56:08.211 INFO:tasks.workunit.client.0.smithi017.stdout:6/122: dread d5/f18 [0,4194304] 0 2024-08-19T00:56:08.211 INFO:tasks.workunit.client.0.smithi017.stdout:6/123: chown d5/f1e 992152 1 2024-08-19T00:56:08.212 INFO:tasks.workunit.client.0.smithi017.stdout:2/219: truncate d2/d7/f28 5387512 0 2024-08-19T00:56:08.216 INFO:tasks.workunit.client.0.smithi017.stdout:4/126: rename d2/d21/f25 to d2/d16/f2d 0 2024-08-19T00:56:08.219 INFO:tasks.workunit.client.1.smithi086.stdout:7/607: fsync d3/d34/d44/d58/d4b/d42/f91 0 2024-08-19T00:56:08.223 INFO:tasks.workunit.client.0.smithi017.stdout:3/217: rmdir d5/d15 39 2024-08-19T00:56:08.224 INFO:tasks.workunit.client.0.smithi017.stdout:4/127: dwrite d2/f29 [0,4194304] 0 2024-08-19T00:56:08.228 INFO:tasks.workunit.client.0.smithi017.stdout:0/159: symlink d5/d18/l32 0 2024-08-19T00:56:08.229 INFO:tasks.workunit.client.1.smithi086.stdout:4/548: creat d2/d18/d33/d42/d72/d78/d25/fbb x:0 0 0 2024-08-19T00:56:08.230 INFO:tasks.workunit.client.0.smithi017.stdout:1/168: chown d4/dc/f11 42182 1 2024-08-19T00:56:08.231 INFO:tasks.workunit.client.1.smithi086.stdout:4/549: dread d2/d18/d33/d42/d72/d2f/f82 [0,4194304] 0 2024-08-19T00:56:08.231 INFO:tasks.workunit.client.0.smithi017.stdout:1/169: truncate d4/dc/f34 916943 0 2024-08-19T00:56:08.232 INFO:tasks.workunit.client.1.smithi086.stdout:0/594: rename da/d14/d1a/d2e/d39/d3b/d89/daf to da/d14/d1a/d2e/d39/d3b/d4e/dbe 0 2024-08-19T00:56:08.239 INFO:tasks.workunit.client.0.smithi017.stdout:1/170: dwrite d4/d1c/f25 [0,4194304] 0 2024-08-19T00:56:08.240 INFO:tasks.workunit.client.1.smithi086.stdout:0/595: dread da/f60 [0,4194304] 0 2024-08-19T00:56:08.241 INFO:tasks.workunit.client.1.smithi086.stdout:0/596: chown da/d14/d44/d7b/c8c 14570 1 2024-08-19T00:56:08.241 INFO:tasks.workunit.client.1.smithi086.stdout:0/597: dread - da/d14/db4/fba zero size 2024-08-19T00:56:08.242 INFO:tasks.workunit.client.1.smithi086.stdout:0/598: write da/f46 [5995867,12717] 0 2024-08-19T00:56:08.242 INFO:tasks.workunit.client.0.smithi017.stdout:2/220: symlink d2/d7/d29/l46 0 2024-08-19T00:56:08.245 INFO:tasks.workunit.client.0.smithi017.stdout:5/148: symlink db/d19/l38 0 2024-08-19T00:56:08.245 INFO:tasks.workunit.client.0.smithi017.stdout:1/171: dread d4/d1c/f25 [0,4194304] 0 2024-08-19T00:56:08.249 INFO:tasks.workunit.client.0.smithi017.stdout:6/124: mknod d5/d13/d20/c29 0 2024-08-19T00:56:08.250 INFO:tasks.workunit.client.1.smithi086.stdout:9/618: dwrite db/d96/da7/f85 [0,4194304] 0 2024-08-19T00:56:08.251 INFO:tasks.workunit.client.0.smithi017.stdout:7/178: stat d3/dc/df/d23/f26 0 2024-08-19T00:56:08.251 INFO:tasks.workunit.client.0.smithi017.stdout:2/221: dwrite d2/d7/d29/f37 [0,4194304] 0 2024-08-19T00:56:08.252 INFO:tasks.workunit.client.1.smithi086.stdout:3/601: mknod d3/d26/cc5 0 2024-08-19T00:56:08.253 INFO:tasks.workunit.client.1.smithi086.stdout:3/602: write d3/d18/d61/d85/fbf [141297,93577] 0 2024-08-19T00:56:08.256 INFO:tasks.workunit.client.1.smithi086.stdout:6/571: mkdir db/d34/d4e/db4 0 2024-08-19T00:56:08.257 INFO:tasks.workunit.client.1.smithi086.stdout:9/619: dwrite db/f11 [0,4194304] 0 2024-08-19T00:56:08.260 INFO:tasks.workunit.client.1.smithi086.stdout:2/564: mknod d8/d43/cc1 0 2024-08-19T00:56:08.261 INFO:tasks.workunit.client.1.smithi086.stdout:2/565: chown d8/d24/d32/d4d/d6a/db1 5052 1 2024-08-19T00:56:08.262 INFO:tasks.workunit.client.0.smithi017.stdout:2/222: dwrite d2/d7/f21 [0,4194304] 0 2024-08-19T00:56:08.263 INFO:tasks.workunit.client.0.smithi017.stdout:4/128: creat d2/d11/d24/f2e x:0 0 0 2024-08-19T00:56:08.266 INFO:tasks.workunit.client.0.smithi017.stdout:4/129: stat d2/d11/d24 0 2024-08-19T00:56:08.269 INFO:tasks.workunit.client.0.smithi017.stdout:3/218: dwrite d5/d11/f34 [0,4194304] 0 2024-08-19T00:56:08.271 INFO:tasks.workunit.client.1.smithi086.stdout:4/550: mkdir d2/d18/d33/d42/d72/d78/d2c/dbc 0 2024-08-19T00:56:08.271 INFO:tasks.workunit.client.0.smithi017.stdout:3/219: truncate d5/da/d27/f3a 324705 0 2024-08-19T00:56:08.272 INFO:tasks.workunit.client.0.smithi017.stdout:8/104: getdents de 0 2024-08-19T00:56:08.274 INFO:tasks.workunit.client.1.smithi086.stdout:7/608: dread d3/d34/d44/d58/d4b/da5/f56 [0,4194304] 0 2024-08-19T00:56:08.277 INFO:tasks.workunit.client.1.smithi086.stdout:8/568: mkdir dc/d70/d7a/d88/db2 0 2024-08-19T00:56:08.280 INFO:tasks.workunit.client.0.smithi017.stdout:1/172: fdatasync d4/f10 0 2024-08-19T00:56:08.280 INFO:tasks.workunit.client.1.smithi086.stdout:0/599: fsync da/d5d/f7a 0 2024-08-19T00:56:08.280 INFO:tasks.workunit.client.0.smithi017.stdout:1/173: fsync d4/d1c/f2a 0 2024-08-19T00:56:08.283 INFO:tasks.workunit.client.0.smithi017.stdout:6/125: rename d5/d13/d20/c26 to d5/d13/d11/c2a 0 2024-08-19T00:56:08.285 INFO:tasks.workunit.client.1.smithi086.stdout:5/577: link d0/d8/d10/l5d d0/d5f/d60/d57/lac 0 2024-08-19T00:56:08.287 INFO:tasks.workunit.client.1.smithi086.stdout:3/603: stat d3/d18/d27/d49/d3f/d5b/d8f 0 2024-08-19T00:56:08.287 INFO:tasks.workunit.client.1.smithi086.stdout:3/604: chown d3/d18/d19/c1e 5 1 2024-08-19T00:56:08.288 INFO:tasks.workunit.client.0.smithi017.stdout:2/223: creat d2/d7/d10/f47 x:0 0 0 2024-08-19T00:56:08.288 INFO:tasks.workunit.client.1.smithi086.stdout:3/605: write d3/d18/d19/dbc/fb6 [566166,126859] 0 2024-08-19T00:56:08.290 INFO:tasks.workunit.client.1.smithi086.stdout:6/572: readlink db/l50 0 2024-08-19T00:56:08.290 INFO:tasks.workunit.client.1.smithi086.stdout:9/620: creat db/d26/d5c/d87/d30/d58/fc7 x:0 0 0 2024-08-19T00:56:08.292 INFO:tasks.workunit.client.0.smithi017.stdout:3/220: fsync d5/fc 0 2024-08-19T00:56:08.298 INFO:tasks.workunit.client.1.smithi086.stdout:7/609: unlink d3/d34/d44/d58/d4b/da5/fc8 0 2024-08-19T00:56:08.300 INFO:tasks.workunit.client.1.smithi086.stdout:8/569: symlink dc/d1f/d37/d4f/lb3 0 2024-08-19T00:56:08.301 INFO:tasks.workunit.client.1.smithi086.stdout:2/566: dread d8/d2c/d38/f42 [0,4194304] 0 2024-08-19T00:56:08.302 INFO:tasks.workunit.client.0.smithi017.stdout:6/126: rename d5/l19 to d5/d13/d20/l2b 0 2024-08-19T00:56:08.303 INFO:tasks.workunit.client.1.smithi086.stdout:1/686: link d4/d7/d2a/d36/d7d/d88/fac d4/d7/d2a/d36/fdf 0 2024-08-19T00:56:08.304 INFO:tasks.workunit.client.1.smithi086.stdout:5/578: creat d0/d99/fad x:0 0 0 2024-08-19T00:56:08.305 INFO:tasks.workunit.client.0.smithi017.stdout:2/224: unlink d2/d7/f3a 0 2024-08-19T00:56:08.305 INFO:tasks.workunit.client.0.smithi017.stdout:0/160: write d5/f16 [1853605,126806] 0 2024-08-19T00:56:08.308 INFO:tasks.workunit.client.0.smithi017.stdout:4/130: fsync d2/f6 0 2024-08-19T00:56:08.308 INFO:tasks.workunit.client.0.smithi017.stdout:0/161: fdatasync d5/f16 0 2024-08-19T00:56:08.309 INFO:tasks.workunit.client.1.smithi086.stdout:5/579: write d0/d5f/f6f [3497971,117247] 0 2024-08-19T00:56:08.310 INFO:tasks.workunit.client.0.smithi017.stdout:0/162: write d5/f16 [3534253,25531] 0 2024-08-19T00:56:08.311 INFO:tasks.workunit.client.1.smithi086.stdout:8/570: dwrite dc/d17/d1e/fa1 [0,4194304] 0 2024-08-19T00:56:08.311 INFO:tasks.workunit.client.0.smithi017.stdout:0/163: write d5/f11 [4711911,4206] 0 2024-08-19T00:56:08.313 INFO:tasks.workunit.client.0.smithi017.stdout:0/164: write d5/d17/f22 [905016,32004] 0 2024-08-19T00:56:08.314 INFO:tasks.workunit.client.1.smithi086.stdout:2/567: dwrite d8/d14/f72 [0,4194304] 0 2024-08-19T00:56:08.315 INFO:tasks.workunit.client.1.smithi086.stdout:6/573: creat db/d34/d39/d76/fb5 x:0 0 0 2024-08-19T00:56:08.319 INFO:tasks.workunit.client.1.smithi086.stdout:2/568: write d8/d14/f88 [912397,40491] 0 2024-08-19T00:56:08.320 INFO:tasks.workunit.client.1.smithi086.stdout:4/551: dread d2/d18/d33/d42/d72/f96 [0,4194304] 0 2024-08-19T00:56:08.321 INFO:tasks.workunit.client.0.smithi017.stdout:8/105: truncate de/ff 3317685 0 2024-08-19T00:56:08.330 INFO:tasks.workunit.client.0.smithi017.stdout:0/165: dread d5/fc [0,4194304] 0 2024-08-19T00:56:08.331 INFO:tasks.workunit.client.0.smithi017.stdout:0/166: chown d5/d17/f22 1 1 2024-08-19T00:56:08.333 INFO:tasks.workunit.client.0.smithi017.stdout:6/127: mkdir d5/d13/d11/d2c 0 2024-08-19T00:56:08.339 INFO:tasks.workunit.client.1.smithi086.stdout:3/606: dread d3/d18/f24 [0,4194304] 0 2024-08-19T00:56:08.340 INFO:tasks.workunit.client.0.smithi017.stdout:2/225: mkdir d2/d7/d10/d19/d48 0 2024-08-19T00:56:08.340 INFO:tasks.workunit.client.1.smithi086.stdout:0/600: dread da/f56 [0,4194304] 0 2024-08-19T00:56:08.341 INFO:tasks.workunit.client.1.smithi086.stdout:1/687: dread d4/d7/d2a/d36/d63/fc1 [0,4194304] 0 2024-08-19T00:56:08.343 INFO:tasks.workunit.client.1.smithi086.stdout:6/574: stat db/cd 0 2024-08-19T00:56:08.344 INFO:tasks.workunit.client.1.smithi086.stdout:9/621: symlink db/d26/d5c/d87/d30/d32/d44/dc1/lc8 0 2024-08-19T00:56:08.344 INFO:tasks.workunit.client.1.smithi086.stdout:8/571: dwrite dc/d17/d1e/d55/fa0 [0,4194304] 0 2024-08-19T00:56:08.345 INFO:tasks.workunit.client.0.smithi017.stdout:7/179: truncate d3/dc/df/d23/f24 529114 0 2024-08-19T00:56:08.346 INFO:tasks.workunit.client.1.smithi086.stdout:6/575: dread - db/d34/d39/f9f zero size 2024-08-19T00:56:08.347 INFO:tasks.workunit.client.1.smithi086.stdout:4/552: chown d2/d18/d33/f57 75946 1 2024-08-19T00:56:08.348 INFO:tasks.workunit.client.1.smithi086.stdout:2/569: dwrite d8/d43/fbc [0,4194304] 0 2024-08-19T00:56:08.349 INFO:tasks.workunit.client.1.smithi086.stdout:8/572: read - dc/d16/d18/d94/f8d zero size 2024-08-19T00:56:08.351 INFO:tasks.workunit.client.1.smithi086.stdout:7/610: dwrite d3/d34/d44/d58/d4b/da5/f56 [0,4194304] 0 2024-08-19T00:56:08.354 INFO:tasks.workunit.client.0.smithi017.stdout:5/149: getdents db/d19/d1f/d15 0 2024-08-19T00:56:08.356 INFO:tasks.workunit.client.0.smithi017.stdout:4/131: dwrite d2/d16/f2d [0,4194304] 0 2024-08-19T00:56:08.357 INFO:tasks.workunit.client.1.smithi086.stdout:4/553: mkdir d2/d18/dbd 0 2024-08-19T00:56:08.359 INFO:tasks.workunit.client.0.smithi017.stdout:6/128: mknod d5/d13/d11/c2d 0 2024-08-19T00:56:08.360 INFO:tasks.workunit.client.0.smithi017.stdout:7/180: dwrite d3/f2e [0,4194304] 0 2024-08-19T00:56:08.362 INFO:tasks.workunit.client.0.smithi017.stdout:6/129: truncate d5/f1e 141406 0 2024-08-19T00:56:08.365 INFO:tasks.workunit.client.1.smithi086.stdout:6/576: creat db/d37/d30/fb6 x:0 0 0 2024-08-19T00:56:08.365 INFO:tasks.workunit.client.1.smithi086.stdout:9/622: rmdir db/d26/d5c/d87/d30/d3f/d43/d4e/d7a 39 2024-08-19T00:56:08.365 INFO:tasks.workunit.client.1.smithi086.stdout:6/577: stat db/d34/d69 0 2024-08-19T00:56:08.369 INFO:tasks.workunit.client.1.smithi086.stdout:2/570: creat d8/d24/fc2 x:0 0 0 2024-08-19T00:56:08.370 INFO:tasks.workunit.client.1.smithi086.stdout:2/571: write d8/d43/fbc [2786720,103388] 0 2024-08-19T00:56:08.371 INFO:tasks.workunit.client.1.smithi086.stdout:7/611: rmdir d3/de/d2d 39 2024-08-19T00:56:08.377 INFO:tasks.workunit.client.1.smithi086.stdout:1/688: rename d4/d7/d2a/d6e/d95/ccb to d4/d7/d2a/d6e/d95/db9/ce0 0 2024-08-19T00:56:08.377 INFO:tasks.workunit.client.1.smithi086.stdout:0/601: creat da/d14/d55/dac/fbf x:0 0 0 2024-08-19T00:56:08.378 INFO:tasks.workunit.client.1.smithi086.stdout:1/689: stat d4/d10/d90/ld3 0 2024-08-19T00:56:08.378 INFO:tasks.workunit.client.0.smithi017.stdout:1/174: rename d4/d1c/d1f/c26 to d4/d1c/c36 0 2024-08-19T00:56:08.379 INFO:tasks.workunit.client.0.smithi017.stdout:1/175: fsync d4/f14 0 2024-08-19T00:56:08.380 INFO:tasks.workunit.client.1.smithi086.stdout:4/554: creat d2/d18/d33/d42/d72/d78/d25/d6b/d81/fbe x:0 0 0 2024-08-19T00:56:08.381 INFO:tasks.workunit.client.1.smithi086.stdout:9/623: symlink db/daf/lc9 0 2024-08-19T00:56:08.383 INFO:tasks.workunit.client.0.smithi017.stdout:0/167: creat d5/d17/d26/d30/f33 x:0 0 0 2024-08-19T00:56:08.384 INFO:tasks.workunit.client.1.smithi086.stdout:6/578: mkdir db/d37/d41/dad/db7 0 2024-08-19T00:56:08.385 INFO:tasks.workunit.client.0.smithi017.stdout:4/132: rmdir d2/d16 39 2024-08-19T00:56:08.390 INFO:tasks.workunit.client.1.smithi086.stdout:6/579: dwrite db/d34/d39/d76/fb2 [0,4194304] 0 2024-08-19T00:56:08.391 INFO:tasks.workunit.client.0.smithi017.stdout:4/133: dread d2/d1a/f23 [0,4194304] 0 2024-08-19T00:56:08.391 INFO:tasks.workunit.client.1.smithi086.stdout:0/602: mknod da/d14/d1a/d2e/d39/cc0 0 2024-08-19T00:56:08.398 INFO:tasks.workunit.client.0.smithi017.stdout:3/221: dwrite d5/f10 [0,4194304] 0 2024-08-19T00:56:08.399 INFO:tasks.workunit.client.0.smithi017.stdout:3/222: chown d5/da/d3c 140396962 1 2024-08-19T00:56:08.400 INFO:tasks.workunit.client.0.smithi017.stdout:7/181: dread d3/f4 [0,4194304] 0 2024-08-19T00:56:08.401 INFO:tasks.workunit.client.0.smithi017.stdout:7/182: fdatasync d3/dc/f1f 0 2024-08-19T00:56:08.404 INFO:tasks.workunit.client.1.smithi086.stdout:2/572: symlink d8/lc3 0 2024-08-19T00:56:08.405 INFO:tasks.workunit.client.1.smithi086.stdout:2/573: stat d8/c95 0 2024-08-19T00:56:08.407 INFO:tasks.workunit.client.1.smithi086.stdout:7/612: mkdir d3/de/d68/d72/d7e/dca/dcb 0 2024-08-19T00:56:08.411 INFO:tasks.workunit.client.0.smithi017.stdout:4/134: mkdir d2/d1a/d2f 0 2024-08-19T00:56:08.414 INFO:tasks.workunit.client.0.smithi017.stdout:8/106: rename de/c11 to de/d15/c19 0 2024-08-19T00:56:08.418 INFO:tasks.workunit.client.1.smithi086.stdout:4/555: creat d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/fbf x:0 0 0 2024-08-19T00:56:08.418 INFO:tasks.workunit.client.0.smithi017.stdout:2/226: write d2/d7/f43 [328548,49480] 0 2024-08-19T00:56:08.419 INFO:tasks.workunit.client.0.smithi017.stdout:4/135: dwrite d2/d11/f14 [0,4194304] 0 2024-08-19T00:56:08.419 INFO:tasks.workunit.client.1.smithi086.stdout:9/624: mknod db/cca 0 2024-08-19T00:56:08.422 INFO:tasks.workunit.client.0.smithi017.stdout:5/150: fsync db/f2e 0 2024-08-19T00:56:08.424 INFO:tasks.workunit.client.0.smithi017.stdout:7/183: read d3/dc/df/d1c/f27 [544411,75530] 0 2024-08-19T00:56:08.426 INFO:tasks.workunit.client.1.smithi086.stdout:7/613: rename d3/d34/d44/lb7 to d3/d34/d44/d58/d4b/d42/lcc 0 2024-08-19T00:56:08.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.427+0000 7f840d974640 1 -- 172.21.15.17:0/1210311823 --> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f840802c4f0 con 0x7f83f406d660 2024-08-19T00:56:08.431 INFO:tasks.workunit.client.0.smithi017.stdout:7/184: dwrite d3/dc/df/d23/f26 [0,4194304] 0 2024-08-19T00:56:08.433 INFO:tasks.workunit.client.1.smithi086.stdout:4/556: unlink d2/d18/d33/d42/d72/l15 0 2024-08-19T00:56:08.435 INFO:tasks.workunit.client.1.smithi086.stdout:4/557: readlink d2/d18/d33/d42/d72/d78/d25/d6b/d81/d8a/la7 0 2024-08-19T00:56:08.435 INFO:tasks.workunit.client.1.smithi086.stdout:4/558: readlink d2/d18/l53 0 2024-08-19T00:56:08.436 INFO:tasks.workunit.client.0.smithi017.stdout:0/168: rename d5/d17/l29 to d5/l34 0 2024-08-19T00:56:08.438 INFO:tasks.workunit.client.1.smithi086.stdout:9/625: creat db/dd/d19/d18/fcb x:0 0 0 2024-08-19T00:56:08.440 INFO:tasks.workunit.client.0.smithi017.stdout:3/223: symlink d5/da/d3c/l41 0 2024-08-19T00:56:08.441 INFO:tasks.workunit.client.1.smithi086.stdout:0/603: truncate da/d14/d44/d49/f5f 45014 0 2024-08-19T00:56:08.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.442+0000 7f840c972640 1 -- 172.21.15.17:0/1210311823 <== mgr.24369 v2:172.21.15.86:6828/261187346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f840802c4f0 con 0x7f83f406d660 2024-08-19T00:56:08.444 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:56:08.444 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (6m) 10s ago 8m 24.2M - 0.25.0 c8568f914cd2 eb29e4d36dfe 2024-08-19T00:56:08.444 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (8m) 10s ago 8m 8006k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T00:56:08.444 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (7m) 18s ago 7m 7759k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T00:56:08.444 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (8m) 10s ago 8m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T00:56:08.444 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (7m) 18s ago 7m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (6m) 10s ago 7m 83.5M - 9.4.7 954c08fa6188 293dd58dd677 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (2m) 10s ago 2m 195M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (2m) 10s ago 2m 191M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (2m) 18s ago 2m 21.7M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (2m) 18s ago 2m 20.6M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:9283,8765,8443 running (9m) 10s ago 9m 240M - 18.2.4-721-gbaa926de e6c292a6bc95 41b04ec2a4ce 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (37s) 18s ago 7m 482M - 19.1.0-1382-gde09dd01 ea7a5189f30b 750e1ecdf317 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (9m) 10s ago 9m 51.1M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 771bc6b905a5 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (7m) 18s ago 7m 44.0M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 c6fce0ad535d 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (8m) 10s ago 8m 16.0M - 1.5.0 0da6a335fe13 33c11a243263 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (7m) 18s ago 7m 16.6M - 1.5.0 0da6a335fe13 15ad23a27a0c 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (6m) 10s ago 6m 96.0M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (5m) 10s ago 5m 99.5M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T00:56:08.445 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (5m) 10s ago 5m 81.8M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T00:56:08.446 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (5m) 18s ago 5m 103M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T00:56:08.446 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (4m) 18s ago 4m 101M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T00:56:08.446 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (4m) 18s ago 4m 83.2M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T00:56:08.446 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (6m) 10s ago 7m 62.2M - 2.43.0 a07b618ecd1d b4713fd83be3 2024-08-19T00:56:08.447 INFO:tasks.workunit.client.1.smithi086.stdout:1/690: link d4/d10/d75/d7a/ca9 d4/d7/d2a/d36/d7d/d88/ce1 0 2024-08-19T00:56:08.447 INFO:tasks.workunit.client.1.smithi086.stdout:1/691: readlink d4/d10/l7f 0 2024-08-19T00:56:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.445+0000 7f840d974640 1 -- 172.21.15.17:0/1210311823 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83f406d660 msgr2=0x7f83f406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.445+0000 7f840d974640 1 --2- 172.21.15.17:0/1210311823 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83f406d660 0x7f83f406fb20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009230 tx=0x7f83f80314e0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.445+0000 7f840d974640 1 -- 172.21.15.17:0/1210311823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8408100d90 msgr2=0x7f8408195bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.445+0000 7f840d974640 1 --2- 172.21.15.17:0/1210311823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8408100d90 0x7f8408195bd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f83f000d720 tx=0x7f83f000dbe0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.445+0000 7f840d974640 1 -- 172.21.15.17:0/1210311823 shutdown_connections 2024-08-19T00:56:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.445+0000 7f840d974640 1 --2- 172.21.15.17:0/1210311823 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83f406d660 0x7f83f406fb20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.445+0000 7f840d974640 1 --2- 172.21.15.17:0/1210311823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8408100d90 0x7f8408195bd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.445+0000 7f840d974640 1 --2- 172.21.15.17:0/1210311823 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f84080ffb90 0x7f8408195690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.445+0000 7f840d974640 1 -- 172.21.15.17:0/1210311823 >> 172.21.15.17:0/1210311823 conn(0x7f84080fb320 msgr2=0x7f84081044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.446+0000 7f840d974640 1 -- 172.21.15.17:0/1210311823 shutdown_connections 2024-08-19T00:56:08.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.446+0000 7f840d974640 1 -- 172.21.15.17:0/1210311823 wait complete. 2024-08-19T00:56:08.449 INFO:tasks.workunit.client.1.smithi086.stdout:1/692: chown d4/d10/d75/d7a/db4 2501 1 2024-08-19T00:56:08.449 INFO:tasks.workunit.client.1.smithi086.stdout:1/693: read - d4/d7/d2a/d36/d63/d9f/fd5 zero size 2024-08-19T00:56:08.450 INFO:tasks.workunit.client.0.smithi017.stdout:5/151: symlink db/d19/d1f/d15/d1e/l39 0 2024-08-19T00:56:08.450 INFO:tasks.workunit.client.0.smithi017.stdout:8/107: dwrite fa [0,4194304] 0 2024-08-19T00:56:08.452 INFO:tasks.workunit.client.1.smithi086.stdout:4/559: dread d2/d18/d33/d42/d72/d78/d2c/f43 [0,4194304] 0 2024-08-19T00:56:08.453 INFO:tasks.workunit.client.0.smithi017.stdout:6/130: getdents d5/d13/d11 0 2024-08-19T00:56:08.454 INFO:tasks.workunit.client.1.smithi086.stdout:5/580: sync 2024-08-19T00:56:08.455 INFO:tasks.workunit.client.0.smithi017.stdout:4/136: dread d2/f6 [0,4194304] 0 2024-08-19T00:56:08.457 INFO:tasks.workunit.client.1.smithi086.stdout:6/580: rename db/cc to db/d37/d28/d57/cb8 0 2024-08-19T00:56:08.460 INFO:tasks.workunit.client.1.smithi086.stdout:7/614: mkdir d3/d34/d44/d58/d4b/dcd 0 2024-08-19T00:56:08.460 INFO:tasks.workunit.client.1.smithi086.stdout:6/581: write db/d37/d28/fa5 [1065963,59488] 0 2024-08-19T00:56:08.461 INFO:tasks.workunit.client.1.smithi086.stdout:9/626: dwrite db/d26/d5c/d87/d30/d32/d44/f56 [0,4194304] 0 2024-08-19T00:56:08.462 INFO:tasks.workunit.client.1.smithi086.stdout:6/582: stat db/d37/d44/d5a/fa1 0 2024-08-19T00:56:08.463 INFO:tasks.workunit.client.1.smithi086.stdout:6/583: fsync db/d34/d39/f9f 0 2024-08-19T00:56:08.463 INFO:tasks.workunit.client.0.smithi017.stdout:0/169: symlink d5/d17/d21/l35 0 2024-08-19T00:56:08.464 INFO:tasks.workunit.client.0.smithi017.stdout:3/224: mknod d5/d18/c42 0 2024-08-19T00:56:08.464 INFO:tasks.workunit.client.0.smithi017.stdout:0/170: fdatasync d5/d18/f24 0 2024-08-19T00:56:08.465 INFO:tasks.workunit.client.1.smithi086.stdout:2/574: getdents d8/d24/d32/d4d/d6a/db1 0 2024-08-19T00:56:08.467 INFO:tasks.workunit.client.1.smithi086.stdout:4/560: creat d2/d18/fc0 x:0 0 0 2024-08-19T00:56:08.469 INFO:tasks.workunit.client.0.smithi017.stdout:5/152: symlink db/d19/d1f/d15/l3a 0 2024-08-19T00:56:08.472 INFO:tasks.workunit.client.0.smithi017.stdout:7/185: mkdir d3/dc/df/d37/d39 0 2024-08-19T00:56:08.477 INFO:tasks.workunit.client.0.smithi017.stdout:7/186: dread d3/dc/df/d1c/f27 [0,4194304] 0 2024-08-19T00:56:08.479 INFO:tasks.workunit.client.0.smithi017.stdout:3/225: mknod d5/da/d27/c43 0 2024-08-19T00:56:08.479 INFO:tasks.workunit.client.0.smithi017.stdout:3/226: chown d5/d18/c42 30870472 1 2024-08-19T00:56:08.480 INFO:tasks.workunit.client.0.smithi017.stdout:3/227: read - d5/da/d27/d28/f37 zero size 2024-08-19T00:56:08.480 INFO:tasks.workunit.client.1.smithi086.stdout:5/581: dread d0/d5f/d60/d57/f84 [0,4194304] 0 2024-08-19T00:56:08.481 INFO:tasks.workunit.client.0.smithi017.stdout:2/227: link d2/d7/l16 d2/d7/d10/d35/l49 0 2024-08-19T00:56:08.481 INFO:tasks.workunit.client.0.smithi017.stdout:0/171: dread d5/d18/f1e [0,4194304] 0 2024-08-19T00:56:08.484 INFO:tasks.workunit.client.1.smithi086.stdout:2/575: rmdir d8/d14/dae 39 2024-08-19T00:56:08.484 INFO:tasks.workunit.client.0.smithi017.stdout:4/137: mkdir d2/d16/d30 0 2024-08-19T00:56:08.489 INFO:tasks.workunit.client.0.smithi017.stdout:5/153: mkdir db/d19/d33/d3b 0 2024-08-19T00:56:08.489 INFO:tasks.workunit.client.1.smithi086.stdout:1/694: link d4/d7/d2a/d36/l38 d4/d7/d2a/d6e/d95/db9/le2 0 2024-08-19T00:56:08.489 INFO:tasks.workunit.client.0.smithi017.stdout:2/228: dwrite d2/d7/d29/f34 [0,4194304] 0 2024-08-19T00:56:08.490 INFO:tasks.workunit.client.0.smithi017.stdout:0/172: symlink d5/d1b/l36 0 2024-08-19T00:56:08.490 INFO:tasks.workunit.client.1.smithi086.stdout:7/615: getdents d3/d34/d44/d58/d4b/dcd 0 2024-08-19T00:56:08.491 INFO:tasks.workunit.client.0.smithi017.stdout:2/229: fdatasync d2/d7/d29/f37 0 2024-08-19T00:56:08.491 INFO:tasks.workunit.client.0.smithi017.stdout:0/173: read d5/d18/f24 [14713,116215] 0 2024-08-19T00:56:08.491 INFO:tasks.workunit.client.0.smithi017.stdout:6/131: link d5/d13/c25 d5/d13/d20/c2e 0 2024-08-19T00:56:08.492 INFO:tasks.workunit.client.0.smithi017.stdout:4/138: dread d2/f29 [0,4194304] 0 2024-08-19T00:56:08.493 INFO:tasks.workunit.client.0.smithi017.stdout:4/139: chown d2/f7 873103 1 2024-08-19T00:56:08.495 INFO:tasks.workunit.client.1.smithi086.stdout:0/604: link da/c1f da/d14/d1a/d2e/d30/d76/cc1 0 2024-08-19T00:56:08.497 INFO:tasks.workunit.client.0.smithi017.stdout:3/228: creat d5/d15/d1b/f44 x:0 0 0 2024-08-19T00:56:08.497 INFO:tasks.workunit.client.0.smithi017.stdout:0/174: dread d5/d17/f22 [0,4194304] 0 2024-08-19T00:56:08.497 INFO:tasks.workunit.client.1.smithi086.stdout:2/576: dread d8/d43/f48 [0,4194304] 0 2024-08-19T00:56:08.499 INFO:tasks.workunit.client.1.smithi086.stdout:4/561: link d2/d18/d33/d42/d72/d78/d25/d6b/f9b d2/d18/d33/d42/d72/d2f/fc1 0 2024-08-19T00:56:08.500 INFO:tasks.workunit.client.0.smithi017.stdout:5/154: readlink db/l17 0 2024-08-19T00:56:08.500 INFO:tasks.workunit.client.0.smithi017.stdout:5/155: chown db/d19/l38 3 1 2024-08-19T00:56:08.504 INFO:tasks.workunit.client.1.smithi086.stdout:0/605: creat da/d14/d1a/d2e/d66/fc2 x:0 0 0 2024-08-19T00:56:08.505 INFO:tasks.workunit.client.1.smithi086.stdout:0/606: write da/d14/d1a/d2e/d30/d76/f9c [949094,42134] 0 2024-08-19T00:56:08.505 INFO:tasks.workunit.client.0.smithi017.stdout:2/230: mknod d2/d7/d10/d3b/d3c/c4a 0 2024-08-19T00:56:08.506 INFO:tasks.workunit.client.1.smithi086.stdout:1/695: rename d4/c4c to d4/d1e/d6f/ce3 0 2024-08-19T00:56:08.506 INFO:tasks.workunit.client.0.smithi017.stdout:2/231: write d2/d7/dd/f2f [1249068,70304] 0 2024-08-19T00:56:08.507 INFO:tasks.workunit.client.1.smithi086.stdout:1/696: chown d4/d7/d2a/d36/d63/ca2 1 1 2024-08-19T00:56:08.509 INFO:tasks.workunit.client.0.smithi017.stdout:3/229: fdatasync d5/d11/f14 0 2024-08-19T00:56:08.509 INFO:tasks.workunit.client.0.smithi017.stdout:3/230: readlink d5/d18/l1c 0 2024-08-19T00:56:08.516 INFO:tasks.workunit.client.1.smithi086.stdout:0/607: unlink da/d14/d1a/d2e/lb2 0 2024-08-19T00:56:08.516 INFO:tasks.workunit.client.1.smithi086.stdout:0/608: write da/d14/d1a/d2e/d39/f69 [1882423,21158] 0 2024-08-19T00:56:08.516 INFO:tasks.workunit.client.1.smithi086.stdout:4/562: rename d2/d18/d33/d42/d72/f62 to d2/d18/d33/d42/d72/d78/d2c/db0/fc2 0 2024-08-19T00:56:08.516 INFO:tasks.workunit.client.1.smithi086.stdout:4/563: write d2/d18/d33/d42/d72/d2f/fa8 [1068509,14947] 0 2024-08-19T00:56:08.517 INFO:tasks.workunit.client.0.smithi017.stdout:3/231: dwrite d5/d11/f3e [0,4194304] 0 2024-08-19T00:56:08.517 INFO:tasks.workunit.client.1.smithi086.stdout:5/582: getdents d0/df/d1f 0 2024-08-19T00:56:08.518 INFO:tasks.workunit.client.1.smithi086.stdout:5/583: chown d0/f1e 215 1 2024-08-19T00:56:08.519 INFO:tasks.workunit.client.1.smithi086.stdout:2/577: rmdir d8/d2c/d38/d80/db4/db9 0 2024-08-19T00:56:08.521 INFO:tasks.workunit.client.0.smithi017.stdout:2/232: mkdir d2/d7/d10/d3b/d3c/d4b 0 2024-08-19T00:56:08.521 INFO:tasks.workunit.client.1.smithi086.stdout:4/564: dwrite d2/d18/d33/d42/d72/d78/f3c [0,4194304] 0 2024-08-19T00:56:08.522 INFO:tasks.workunit.client.0.smithi017.stdout:2/233: write d2/d7/f28 [869496,48578] 0 2024-08-19T00:56:08.522 INFO:tasks.workunit.client.1.smithi086.stdout:0/609: truncate da/d14/f15 2476561 0 2024-08-19T00:56:08.523 INFO:tasks.workunit.client.0.smithi017.stdout:2/234: chown d2/d7/d10/f25 58714 1 2024-08-19T00:56:08.523 INFO:tasks.workunit.client.1.smithi086.stdout:0/610: stat da/d97/lb3 0 2024-08-19T00:56:08.525 INFO:tasks.workunit.client.0.smithi017.stdout:2/235: write d2/d7/d10/d19/f39 [832634,79102] 0 2024-08-19T00:56:08.528 INFO:tasks.workunit.client.0.smithi017.stdout:4/140: rmdir d2/d1a/d2f 0 2024-08-19T00:56:08.530 INFO:tasks.workunit.client.1.smithi086.stdout:2/578: symlink d8/d84/d79/lc4 0 2024-08-19T00:56:08.531 INFO:tasks.workunit.client.0.smithi017.stdout:0/175: link d5/le d5/d17/d26/l37 0 2024-08-19T00:56:08.532 INFO:tasks.workunit.client.1.smithi086.stdout:0/611: mkdir da/d14/d1a/d2e/d39/dc3 0 2024-08-19T00:56:08.533 INFO:tasks.workunit.client.0.smithi017.stdout:6/132: getdents d5 0 2024-08-19T00:56:08.533 INFO:tasks.workunit.client.1.smithi086.stdout:7/616: link d3/de/d2d/f35 d3/d34/d44/fce 0 2024-08-19T00:56:08.534 INFO:tasks.workunit.client.0.smithi017.stdout:4/141: creat d2/d11/d24/f31 x:0 0 0 2024-08-19T00:56:08.536 INFO:tasks.workunit.client.0.smithi017.stdout:5/156: rename l0 to db/d19/l3c 0 2024-08-19T00:56:08.537 INFO:tasks.workunit.client.1.smithi086.stdout:2/579: creat d8/d2c/d38/d80/db4/db7/fc5 x:0 0 0 2024-08-19T00:56:08.538 INFO:tasks.workunit.client.0.smithi017.stdout:4/142: mkdir d2/d21/d32 0 2024-08-19T00:56:08.540 INFO:tasks.workunit.client.0.smithi017.stdout:3/232: rename d5/da/d27/d28/f40 to d5/d18/f45 0 2024-08-19T00:56:08.541 INFO:tasks.workunit.client.1.smithi086.stdout:7/617: creat d3/de/d68/d7d/fcf x:0 0 0 2024-08-19T00:56:08.541 INFO:tasks.workunit.client.0.smithi017.stdout:6/133: mknod d5/d13/c2f 0 2024-08-19T00:56:08.542 INFO:tasks.workunit.client.1.smithi086.stdout:1/697: getdents d4/d7/d2a/d36/db6 0 2024-08-19T00:56:08.542 INFO:tasks.workunit.client.1.smithi086.stdout:1/698: fdatasync d4/d10/d90/d98/fbd 0 2024-08-19T00:56:08.542 INFO:tasks.workunit.client.0.smithi017.stdout:4/143: write d2/d1a/f1c [1367466,56528] 0 2024-08-19T00:56:08.543 INFO:tasks.workunit.client.0.smithi017.stdout:4/144: fsync d2/d1a/fe 0 2024-08-19T00:56:08.543 INFO:tasks.workunit.client.1.smithi086.stdout:5/584: rename d0/f1e to d0/df/fae 0 2024-08-19T00:56:08.544 INFO:tasks.workunit.client.0.smithi017.stdout:4/145: readlink d2/d1a/lf 0 2024-08-19T00:56:08.544 INFO:tasks.workunit.client.1.smithi086.stdout:3/607: sync 2024-08-19T00:56:08.544 INFO:tasks.workunit.client.1.smithi086.stdout:5/585: write d0/d5f/d60/d57/f58 [787583,88724] 0 2024-08-19T00:56:08.545 INFO:tasks.workunit.client.1.smithi086.stdout:2/580: creat d8/d24/d32/d4d/d6a/fc6 x:0 0 0 2024-08-19T00:56:08.546 INFO:tasks.workunit.client.1.smithi086.stdout:0/612: symlink da/d14/lc4 0 2024-08-19T00:56:08.546 INFO:tasks.workunit.client.1.smithi086.stdout:5/586: write d0/d8/d10/f2b [4800755,107776] 0 2024-08-19T00:56:08.547 INFO:tasks.workunit.client.0.smithi017.stdout:0/176: rename d5/f12 to d5/d17/d26/d30/f38 0 2024-08-19T00:56:08.548 INFO:tasks.workunit.client.1.smithi086.stdout:7/618: chown d3/de/c28 1 1 2024-08-19T00:56:08.550 INFO:tasks.workunit.client.1.smithi086.stdout:5/587: write d0/df/d1f/d33/f3d [3743410,29622] 0 2024-08-19T00:56:08.550 INFO:tasks.workunit.client.1.smithi086.stdout:5/588: readlink d0/d2d/l7a 0 2024-08-19T00:56:08.551 INFO:tasks.workunit.client.1.smithi086.stdout:3/608: dwrite d3/d18/d27/d76/f7c [0,4194304] 0 2024-08-19T00:56:08.552 INFO:tasks.workunit.client.0.smithi017.stdout:0/177: mkdir d5/d17/d21/d39 0 2024-08-19T00:56:08.553 INFO:tasks.workunit.client.1.smithi086.stdout:0/613: rmdir da/d14/d1a/d2e/d39/d3b 39 2024-08-19T00:56:08.553 INFO:tasks.workunit.client.1.smithi086.stdout:3/609: rename d3/d26/d2b/d33 to d3/d26/d2b/d33/d4a/d57/d8a/dc6 22 2024-08-19T00:56:08.554 INFO:tasks.workunit.client.0.smithi017.stdout:3/233: fsync d5/d15/d1b/f20 0 2024-08-19T00:56:08.555 INFO:tasks.workunit.client.0.smithi017.stdout:6/134: creat d5/d13/d11/d2c/f30 x:0 0 0 2024-08-19T00:56:08.555 INFO:tasks.workunit.client.0.smithi017.stdout:6/135: chown d5/d13/d20/f27 32128402 1 2024-08-19T00:56:08.557 INFO:tasks.workunit.client.0.smithi017.stdout:0/178: rename d5/d17/d26/d2f to d5/d18/d3a 0 2024-08-19T00:56:08.559 INFO:tasks.workunit.client.0.smithi017.stdout:3/234: fdatasync d5/d18/f45 0 2024-08-19T00:56:08.559 INFO:tasks.workunit.client.1.smithi086.stdout:2/581: dwrite d8/d14/d9e/fb8 [4194304,4194304] 0 2024-08-19T00:56:08.560 INFO:tasks.workunit.client.1.smithi086.stdout:1/699: creat d4/d7/d2a/d36/d7d/fe4 x:0 0 0 2024-08-19T00:56:08.561 INFO:tasks.workunit.client.1.smithi086.stdout:7/619: mkdir d3/de/d68/d72/d7e/dca/dcb/dd0 0 2024-08-19T00:56:08.561 INFO:tasks.workunit.client.1.smithi086.stdout:5/589: mknod d0/d8/caf 0 2024-08-19T00:56:08.562 INFO:tasks.workunit.client.0.smithi017.stdout:0/179: symlink d5/d17/d26/d30/l3b 0 2024-08-19T00:56:08.562 INFO:tasks.workunit.client.1.smithi086.stdout:0/614: dwrite da/d14/f1b [4194304,4194304] 0 2024-08-19T00:56:08.562 INFO:tasks.workunit.client.1.smithi086.stdout:3/610: dwrite d3/d18/d19/d37/f84 [0,4194304] 0 2024-08-19T00:56:08.564 INFO:tasks.workunit.client.0.smithi017.stdout:6/136: link d5/l23 d5/l31 0 2024-08-19T00:56:08.565 INFO:tasks.workunit.client.0.smithi017.stdout:6/137: stat d5/d13/f14 0 2024-08-19T00:56:08.565 INFO:tasks.workunit.client.1.smithi086.stdout:5/590: write d0/d8/d70/f87 [404123,110826] 0 2024-08-19T00:56:08.567 INFO:tasks.workunit.client.0.smithi017.stdout:6/138: rmdir d5 39 2024-08-19T00:56:08.569 INFO:tasks.workunit.client.1.smithi086.stdout:3/611: creat d3/d9/fc7 x:0 0 0 2024-08-19T00:56:08.570 INFO:tasks.workunit.client.1.smithi086.stdout:5/591: write d0/d2d/f32 [4521421,105868] 0 2024-08-19T00:56:08.571 INFO:tasks.workunit.client.0.smithi017.stdout:6/139: creat d5/d13/d20/f32 x:0 0 0 2024-08-19T00:56:08.572 INFO:tasks.workunit.client.1.smithi086.stdout:0/615: dread da/d5d/f7a [0,4194304] 0 2024-08-19T00:56:08.573 INFO:tasks.workunit.client.1.smithi086.stdout:1/700: rename d4/d10/d75 to d4/d7/d2a/d36/d3a/de5 0 2024-08-19T00:56:08.575 INFO:tasks.workunit.client.1.smithi086.stdout:5/592: creat d0/d8/d70/fb0 x:0 0 0 2024-08-19T00:56:08.578 INFO:tasks.workunit.client.1.smithi086.stdout:1/701: mknod d4/d10/d90/d98/ce6 0 2024-08-19T00:56:08.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.577+0000 7fc0efadf640 1 -- 172.21.15.17:0/3688302340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0e80feaf0 msgr2=0x7fc0e80feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:08.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.577+0000 7fc0efadf640 1 --2- 172.21.15.17:0/3688302340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0e80feaf0 0x7fc0e80feef0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400d890 tx=0x7fc0e402c430 comp rx=0 tx=0).stop 2024-08-19T00:56:08.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.577+0000 7fc0efadf640 1 -- 172.21.15.17:0/3688302340 shutdown_connections 2024-08-19T00:56:08.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.577+0000 7fc0efadf640 1 --2- 172.21.15.17:0/3688302340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0e80ffcf0 0x7fc0e8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.577+0000 7fc0efadf640 1 --2- 172.21.15.17:0/3688302340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0e80feaf0 0x7fc0e80feef0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.577+0000 7fc0efadf640 1 -- 172.21.15.17:0/3688302340 >> 172.21.15.17:0/3688302340 conn(0x7fc0e80fa280 msgr2=0x7fc0e80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:08.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.577+0000 7fc0efadf640 1 -- 172.21.15.17:0/3688302340 shutdown_connections 2024-08-19T00:56:08.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.577+0000 7fc0efadf640 1 -- 172.21.15.17:0/3688302340 wait complete. 2024-08-19T00:56:08.580 INFO:tasks.workunit.client.1.smithi086.stdout:5/593: rename d0/d8/ca8 to d0/d99/cb1 0 2024-08-19T00:56:08.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.578+0000 7fc0efadf640 1 Processor -- start 2024-08-19T00:56:08.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.578+0000 7fc0efadf640 1 -- start start 2024-08-19T00:56:08.581 INFO:tasks.workunit.client.0.smithi017.stdout:6/140: dwrite d5/f1e [0,4194304] 0 2024-08-19T00:56:08.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.579+0000 7fc0efadf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0e80feaf0 0x7fc0e819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.579+0000 7fc0efadf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0e80ffcf0 0x7fc0e819c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.579+0000 7fc0efadf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e819c7b0 con 0x7fc0e80feaf0 2024-08-19T00:56:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.579+0000 7fc0efadf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e819c920 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.580+0000 7fc0ed07a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0e80ffcf0 0x7fc0e819c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.580+0000 7fc0ed07a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0e80ffcf0 0x7fc0e819c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.17:51050/0 (socket says 172.21.15.17:51050) 2024-08-19T00:56:08.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.580+0000 7fc0ed07a640 1 -- 172.21.15.17:0/4130797353 learned_addr learned my addr 172.21.15.17:0/4130797353 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:56:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.581+0000 7fc0ed87b640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0e80feaf0 0x7fc0e819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:08.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.581+0000 7fc0ed07a640 1 -- 172.21.15.17:0/4130797353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0e80feaf0 msgr2=0x7fc0e819bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.581+0000 7fc0ed07a640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0e80feaf0 0x7fc0e819bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.581+0000 7fc0ed07a640 1 -- 172.21.15.17:0/4130797353 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e400d570 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.582+0000 7fc0ed87b640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0e80feaf0 0x7fc0e819bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:56:08.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.582+0000 7fc0ed07a640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0e80ffcf0 0x7fc0e819c1b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800e970 tx=0x7fc0d800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:08.584 INFO:tasks.workunit.client.1.smithi086.stdout:5/594: dread d0/df/d1f/f85 [0,4194304] 0 2024-08-19T00:56:08.585 INFO:tasks.workunit.client.1.smithi086.stdout:1/702: symlink d4/d7/d2a/d36/d63/d84/le7 0 2024-08-19T00:56:08.585 INFO:tasks.workunit.client.1.smithi086.stdout:1/703: stat d4/d1e/l29 0 2024-08-19T00:56:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.583+0000 7fc0deffd640 1 -- 172.21.15.17:0/4130797353 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0d800cc90 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.583+0000 7fc0deffd640 1 -- 172.21.15.17:0/4130797353 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc0d800cdf0 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.586 INFO:tasks.workunit.client.0.smithi017.stdout:6/141: creat d5/d13/d11/f33 x:0 0 0 2024-08-19T00:56:08.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.583+0000 7fc0efadf640 1 -- 172.21.15.17:0/4130797353 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e81a13b0 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.583+0000 7fc0efadf640 1 -- 172.21.15.17:0/4130797353 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e81a1840 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.584+0000 7fc0deffd640 1 -- 172.21.15.17:0/4130797353 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0d8018810 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.587 INFO:tasks.workunit.client.1.smithi086.stdout:6/584: dread db/d37/d30/f33 [0,4194304] 0 2024-08-19T00:56:08.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.586+0000 7fc0efadf640 1 -- 172.21.15.17:0/4130797353 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e818d560 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.588 INFO:tasks.workunit.client.1.smithi086.stdout:0/616: rename da/d14/db4 to da/d14/d1a/d2e/d39/d3b/d89/dc5 0 2024-08-19T00:56:08.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.588+0000 7fc0deffd640 1 -- 172.21.15.17:0/4130797353 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) v1 ==== 91559+0+0 (secure 0 0 0) 0x7fc0d8010c10 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.589+0000 7fc0deffd640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc0d406d6b0 0x7fc0d406fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:08.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.589+0000 7fc0deffd640 1 -- 172.21.15.17:0/4130797353 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc0d8014070 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.592 INFO:tasks.workunit.client.0.smithi017.stdout:6/142: creat d5/d13/d11/d2c/f34 x:0 0 0 2024-08-19T00:56:08.592 INFO:tasks.workunit.client.1.smithi086.stdout:5/595: dread - d0/d2d/d43/d4d/fa6 zero size 2024-08-19T00:56:08.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.591+0000 7fc0ed87b640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc0d406d6b0 0x7fc0d406fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:08.593 INFO:tasks.workunit.client.1.smithi086.stdout:1/704: mkdir d4/d10/de8 0 2024-08-19T00:56:08.593 INFO:tasks.workunit.client.1.smithi086.stdout:6/585: symlink db/d34/d4e/lb9 0 2024-08-19T00:56:08.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.593+0000 7fc0ed87b640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc0d406d6b0 0x7fc0d406fb70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4004d80 tx=0x7fc0e4000bc0 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:08.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.593+0000 7fc0deffd640 1 -- 172.21.15.17:0/4130797353 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fc0d805a9b0 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.597 INFO:tasks.workunit.client.1.smithi086.stdout:0/617: mknod da/d14/d1a/d2e/d66/cc6 0 2024-08-19T00:56:08.601 INFO:tasks.workunit.client.1.smithi086.stdout:8/573: sync 2024-08-19T00:56:08.601 INFO:tasks.workunit.client.1.smithi086.stdout:7/620: dread d3/d34/d44/d58/d4b/d78/f5a [0,4194304] 0 2024-08-19T00:56:08.602 INFO:tasks.workunit.client.1.smithi086.stdout:8/574: fdatasync dc/d70/d7a/f8b 0 2024-08-19T00:56:08.602 INFO:tasks.workunit.client.1.smithi086.stdout:5/596: creat d0/d2d/d43/fb2 x:0 0 0 2024-08-19T00:56:08.602 INFO:tasks.workunit.client.1.smithi086.stdout:7/621: write d3/de/f15 [6957767,83998] 0 2024-08-19T00:56:08.604 INFO:tasks.workunit.client.1.smithi086.stdout:7/622: readlink d3/de/d68/d72/l82 0 2024-08-19T00:56:08.604 INFO:tasks.workunit.client.1.smithi086.stdout:6/586: write db/d8e/fb0 [646076,64363] 0 2024-08-19T00:56:08.606 INFO:tasks.workunit.client.1.smithi086.stdout:1/705: rename d4/d7/d2a/d36/d63/d84/fd2 to d4/d7/d2a/d6e/d95/db9/fe9 0 2024-08-19T00:56:08.607 INFO:tasks.workunit.client.1.smithi086.stdout:0/618: chown da/d14/d55/c73 8 1 2024-08-19T00:56:08.608 INFO:tasks.workunit.client.1.smithi086.stdout:0/619: stat da/d14/d44/d49/f63 0 2024-08-19T00:56:08.608 INFO:tasks.workunit.client.1.smithi086.stdout:1/706: truncate d4/d7/d2a/d6e/d95/db9/fe9 466641 0 2024-08-19T00:56:08.610 INFO:tasks.workunit.client.1.smithi086.stdout:8/575: unlink dc/d70/d7a/d88/c89 0 2024-08-19T00:56:08.612 INFO:tasks.workunit.client.0.smithi017.stdout:6/143: link d5/f8 d5/d13/f35 0 2024-08-19T00:56:08.612 INFO:tasks.workunit.client.0.smithi017.stdout:6/144: readlink d5/l15 0 2024-08-19T00:56:08.613 INFO:tasks.workunit.client.0.smithi017.stdout:6/145: chown d5/d13/d20/c29 5948 1 2024-08-19T00:56:08.614 INFO:tasks.workunit.client.1.smithi086.stdout:0/620: dwrite da/d14/f1b [0,4194304] 0 2024-08-19T00:56:08.616 INFO:tasks.workunit.client.1.smithi086.stdout:9/627: dwrite f7 [0,4194304] 0 2024-08-19T00:56:08.616 INFO:tasks.workunit.client.1.smithi086.stdout:5/597: readlink d0/df/d1f/d65/l81 0 2024-08-19T00:56:08.618 INFO:tasks.workunit.client.1.smithi086.stdout:2/582: dread d8/f1a [0,4194304] 0 2024-08-19T00:56:08.621 INFO:tasks.workunit.client.0.smithi017.stdout:7/187: write d3/dc/df/d23/f24 [1083429,28007] 0 2024-08-19T00:56:08.624 INFO:tasks.workunit.client.1.smithi086.stdout:7/623: symlink d3/de/d2d/ld1 0 2024-08-19T00:56:08.625 INFO:tasks.workunit.client.0.smithi017.stdout:7/188: fdatasync d3/f4 0 2024-08-19T00:56:08.625 INFO:tasks.workunit.client.1.smithi086.stdout:8/576: creat dc/d17/d86/fb4 x:0 0 0 2024-08-19T00:56:08.626 INFO:tasks.workunit.client.0.smithi017.stdout:6/146: dwrite d5/d13/f35 [0,4194304] 0 2024-08-19T00:56:08.629 INFO:tasks.workunit.client.0.smithi017.stdout:6/147: truncate d5/d13/d20/f27 678766 0 2024-08-19T00:56:08.630 INFO:tasks.workunit.client.1.smithi086.stdout:2/583: dwrite d8/d24/d32/d61/fba [0,4194304] 0 2024-08-19T00:56:08.630 INFO:tasks.workunit.client.1.smithi086.stdout:5/598: dread d0/d8/d10/f1d [0,4194304] 0 2024-08-19T00:56:08.633 INFO:tasks.workunit.client.1.smithi086.stdout:9/628: dread db/d26/d5c/d87/f2a [0,4194304] 0 2024-08-19T00:56:08.634 INFO:tasks.workunit.client.0.smithi017.stdout:7/189: creat d3/dc/df/d1c/d2c/d2f/f3a x:0 0 0 2024-08-19T00:56:08.635 INFO:tasks.workunit.client.1.smithi086.stdout:6/587: creat db/d34/d4e/db4/fba x:0 0 0 2024-08-19T00:56:08.635 INFO:tasks.workunit.client.0.smithi017.stdout:3/235: dwrite d5/fc [0,4194304] 0 2024-08-19T00:56:08.641 INFO:tasks.workunit.client.1.smithi086.stdout:2/584: dread d8/d2c/d67/f6e [0,4194304] 0 2024-08-19T00:56:08.641 INFO:tasks.workunit.client.0.smithi017.stdout:3/236: mknod d5/da/d27/d28/c46 0 2024-08-19T00:56:08.643 INFO:tasks.workunit.client.1.smithi086.stdout:5/599: dwrite d0/d5f/d60/d57/f69 [0,4194304] 0 2024-08-19T00:56:08.645 INFO:tasks.workunit.client.1.smithi086.stdout:5/600: write d0/d8/d10/f19 [3746152,381] 0 2024-08-19T00:56:08.647 INFO:tasks.workunit.client.1.smithi086.stdout:5/601: dread d0/df/d1f/d65/f9d [0,4194304] 0 2024-08-19T00:56:08.656 INFO:tasks.workunit.client.1.smithi086.stdout:4/565: dwrite d2/d18/d33/d42/d72/d2f/f82 [0,4194304] 0 2024-08-19T00:56:08.657 INFO:tasks.workunit.client.0.smithi017.stdout:3/237: dwrite d5/da/fd [4194304,4194304] 0 2024-08-19T00:56:08.657 INFO:tasks.workunit.client.1.smithi086.stdout:4/566: readlink d2/lb8 0 2024-08-19T00:56:08.660 INFO:tasks.workunit.client.1.smithi086.stdout:6/588: creat db/d37/d44/d5a/fbb x:0 0 0 2024-08-19T00:56:08.666 INFO:tasks.workunit.client.0.smithi017.stdout:3/238: chown d5/da/c30 6750 1 2024-08-19T00:56:08.668 INFO:tasks.workunit.client.1.smithi086.stdout:7/624: dread d3/de/f2b [0,4194304] 0 2024-08-19T00:56:08.669 INFO:tasks.workunit.client.1.smithi086.stdout:8/577: truncate dc/d16/f2d 666890 0 2024-08-19T00:56:08.670 INFO:tasks.workunit.client.1.smithi086.stdout:7/625: chown d3/d34/d44/d58/lab 642950559 1 2024-08-19T00:56:08.671 INFO:tasks.workunit.client.1.smithi086.stdout:7/626: write d3/f38 [5084315,17002] 0 2024-08-19T00:56:08.672 INFO:tasks.workunit.client.0.smithi017.stdout:5/157: truncate db/f24 757116 0 2024-08-19T00:56:08.673 INFO:tasks.workunit.client.0.smithi017.stdout:5/158: chown f6 43946 1 2024-08-19T00:56:08.674 INFO:tasks.workunit.client.1.smithi086.stdout:5/602: creat d0/df/d1f/fb3 x:0 0 0 2024-08-19T00:56:08.675 INFO:tasks.workunit.client.0.smithi017.stdout:5/159: truncate db/d19/d1f/d15/f2f 1034860 0 2024-08-19T00:56:08.675 INFO:tasks.workunit.client.1.smithi086.stdout:5/603: fdatasync d0/d8/d10/f42 0 2024-08-19T00:56:08.676 INFO:tasks.workunit.client.1.smithi086.stdout:5/604: chown d0/d8/d72/l7f 825878683 1 2024-08-19T00:56:08.679 INFO:tasks.workunit.client.1.smithi086.stdout:6/589: rename db/d34/d39/f9f to db/d8e/fbc 0 2024-08-19T00:56:08.679 INFO:tasks.workunit.client.0.smithi017.stdout:5/160: creat db/d19/d1f/d15/d1e/f3d x:0 0 0 2024-08-19T00:56:08.680 INFO:tasks.workunit.client.1.smithi086.stdout:0/621: getdents da/d5d/da9 0 2024-08-19T00:56:08.681 INFO:tasks.workunit.client.0.smithi017.stdout:4/146: truncate d2/d16/f2d 808284 0 2024-08-19T00:56:08.681 INFO:tasks.workunit.client.1.smithi086.stdout:5/605: dread d0/df/d1f/d33/f34 [0,4194304] 0 2024-08-19T00:56:08.682 INFO:tasks.workunit.client.1.smithi086.stdout:0/622: chown da/d14/d44/d49/f63 2761392 1 2024-08-19T00:56:08.682 INFO:tasks.workunit.client.0.smithi017.stdout:5/161: rmdir db/d19/d1f/d15 39 2024-08-19T00:56:08.683 INFO:tasks.workunit.client.1.smithi086.stdout:0/623: chown da/d5d/da9/d6a/lbb 137 1 2024-08-19T00:56:08.683 INFO:tasks.workunit.client.1.smithi086.stdout:2/585: dread d8/d2c/d67/f6f [0,4194304] 0 2024-08-19T00:56:08.688 INFO:tasks.workunit.client.1.smithi086.stdout:8/578: dwrite dc/d70/d7a/d9b/f3d [0,4194304] 0 2024-08-19T00:56:08.689 INFO:tasks.workunit.client.1.smithi086.stdout:7/627: stat d3/d34/d44/l46 0 2024-08-19T00:56:08.690 INFO:tasks.workunit.client.0.smithi017.stdout:5/162: mkdir db/d19/d1f/d15/d3e 0 2024-08-19T00:56:08.693 INFO:tasks.workunit.client.0.smithi017.stdout:3/239: fdatasync d5/da/fd 0 2024-08-19T00:56:08.696 INFO:tasks.workunit.client.1.smithi086.stdout:4/567: creat d2/d18/d33/d42/d72/d78/d2c/dbc/fc3 x:0 0 0 2024-08-19T00:56:08.700 INFO:tasks.workunit.client.0.smithi017.stdout:3/240: mknod d5/c47 0 2024-08-19T00:56:08.702 INFO:tasks.workunit.client.1.smithi086.stdout:2/586: creat d8/d24/d32/d61/fc7 x:0 0 0 2024-08-19T00:56:08.703 INFO:tasks.workunit.client.1.smithi086.stdout:3/612: dwrite d3/d18/f2c [0,4194304] 0 2024-08-19T00:56:08.705 INFO:tasks.workunit.client.1.smithi086.stdout:6/590: dwrite db/d37/d44/f4f [0,4194304] 0 2024-08-19T00:56:08.706 INFO:tasks.workunit.client.1.smithi086.stdout:7/628: creat d3/de/d68/d72/d7e/dca/fd2 x:0 0 0 2024-08-19T00:56:08.710 INFO:tasks.workunit.client.0.smithi017.stdout:6/148: getdents d5/d13/d11/d2c 0 2024-08-19T00:56:08.712 INFO:tasks.workunit.client.0.smithi017.stdout:3/241: creat d5/da/f48 x:0 0 0 2024-08-19T00:56:08.715 INFO:tasks.workunit.client.1.smithi086.stdout:3/613: read d3/d18/d19/d37/fa6 [402162,128317] 0 2024-08-19T00:56:08.715 INFO:tasks.workunit.client.1.smithi086.stdout:6/591: dwrite f3 [0,4194304] 0 2024-08-19T00:56:08.715 INFO:tasks.workunit.client.1.smithi086.stdout:3/614: dread - d3/d9/fc7 zero size 2024-08-19T00:56:08.716 INFO:tasks.workunit.client.1.smithi086.stdout:6/592: write db/d8e/fb0 [1502476,58575] 0 2024-08-19T00:56:08.716 INFO:tasks.workunit.client.1.smithi086.stdout:0/624: link da/d14/d44/d7b/fb5 da/d14/d1a/d2e/d43/fc7 0 2024-08-19T00:56:08.718 INFO:tasks.workunit.client.1.smithi086.stdout:2/587: symlink d8/d24/d32/d4d/lc8 0 2024-08-19T00:56:08.719 INFO:tasks.workunit.client.0.smithi017.stdout:6/149: dwrite f4 [0,4194304] 0 2024-08-19T00:56:08.720 INFO:tasks.workunit.client.1.smithi086.stdout:4/568: dread d2/d18/d33/f57 [0,4194304] 0 2024-08-19T00:56:08.725 INFO:tasks.workunit.client.1.smithi086.stdout:2/588: dwrite d8/f1d [0,4194304] 0 2024-08-19T00:56:08.726 INFO:tasks.workunit.client.0.smithi017.stdout:6/150: unlink d5/c1d 0 2024-08-19T00:56:08.727 INFO:tasks.workunit.client.1.smithi086.stdout:2/589: chown d8/f19 88092 1 2024-08-19T00:56:08.730 INFO:tasks.workunit.client.1.smithi086.stdout:7/629: mkdir d3/de/d68/d7d/dd3 0 2024-08-19T00:56:08.731 INFO:tasks.workunit.client.1.smithi086.stdout:7/630: readlink d3/l51 0 2024-08-19T00:56:08.731 INFO:tasks.workunit.client.0.smithi017.stdout:6/151: rename d5/d13/d11/fd to d5/f36 0 2024-08-19T00:56:08.735 INFO:tasks.workunit.client.0.smithi017.stdout:6/152: creat d5/d13/d11/f37 x:0 0 0 2024-08-19T00:56:08.736 INFO:tasks.workunit.client.1.smithi086.stdout:1/707: truncate d4/d7/d2a/d36/d50/f9d 383490 0 2024-08-19T00:56:08.736 INFO:tasks.workunit.client.1.smithi086.stdout:6/593: symlink db/d37/d41/da7/lbd 0 2024-08-19T00:56:08.738 INFO:tasks.workunit.client.0.smithi017.stdout:7/190: getdents d3/dc/df/d1c/d2c/d2f 0 2024-08-19T00:56:08.739 INFO:tasks.workunit.client.0.smithi017.stdout:6/153: stat d5/d13/d20/c2e 0 2024-08-19T00:56:08.740 INFO:tasks.workunit.client.0.smithi017.stdout:6/154: fdatasync d5/d13/d11/f33 0 2024-08-19T00:56:08.741 INFO:tasks.workunit.client.1.smithi086.stdout:3/615: rename d3/d18/d27/d49/d3f/d54/lb5 to d3/d26/d2b/d33/d4a/d57/lc8 0 2024-08-19T00:56:08.742 INFO:tasks.workunit.client.1.smithi086.stdout:3/616: chown d3/d18/d61 4486 1 2024-08-19T00:56:08.748 INFO:tasks.workunit.client.1.smithi086.stdout:5/606: getdents d0/d8/d70 0 2024-08-19T00:56:08.749 INFO:tasks.workunit.client.0.smithi017.stdout:6/155: dwrite f2 [0,4194304] 0 2024-08-19T00:56:08.749 INFO:tasks.workunit.client.1.smithi086.stdout:7/631: mknod d3/de/d2d/cd4 0 2024-08-19T00:56:08.750 INFO:tasks.workunit.client.1.smithi086.stdout:7/632: dread - d3/de/d68/d7a/f8f zero size 2024-08-19T00:56:08.754 INFO:tasks.workunit.client.1.smithi086.stdout:0/625: unlink da/d14/f1b 0 2024-08-19T00:56:08.756 INFO:tasks.workunit.client.0.smithi017.stdout:6/156: rename d5/d13/f35 to d5/d13/d11/d2c/f38 0 2024-08-19T00:56:08.757 INFO:tasks.workunit.client.0.smithi017.stdout:6/157: stat d5/d13/d20/c2e 0 2024-08-19T00:56:08.758 INFO:tasks.workunit.client.1.smithi086.stdout:1/708: creat d4/d7/d2a/d36/d63/d84/fea x:0 0 0 2024-08-19T00:56:08.760 INFO:tasks.workunit.client.1.smithi086.stdout:6/594: stat db/c12 0 2024-08-19T00:56:08.761 INFO:tasks.workunit.client.0.smithi017.stdout:4/147: write d2/d16/f1f [1309782,130711] 0 2024-08-19T00:56:08.762 INFO:tasks.workunit.client.0.smithi017.stdout:6/158: creat d5/f39 x:0 0 0 2024-08-19T00:56:08.765 INFO:tasks.workunit.client.1.smithi086.stdout:4/569: rename d2/d18/d33/d42/d72/d78/d25/d6b to d2/d18/d33/d42/d72/d2f/dc4 0 2024-08-19T00:56:08.766 INFO:tasks.workunit.client.1.smithi086.stdout:3/617: mkdir d3/d18/d19/dbc/db8/dc9 0 2024-08-19T00:56:08.769 INFO:tasks.workunit.client.1.smithi086.stdout:9/629: truncate db/f20 2683320 0 2024-08-19T00:56:08.769 INFO:tasks.workunit.client.0.smithi017.stdout:6/159: dwrite d5/fb [0,4194304] 0 2024-08-19T00:56:08.770 INFO:tasks.workunit.client.1.smithi086.stdout:0/626: dread da/f10 [0,4194304] 0 2024-08-19T00:56:08.771 INFO:tasks.workunit.client.1.smithi086.stdout:8/579: link dc/d17/f6d dc/d16/d18/fb5 0 2024-08-19T00:56:08.771 INFO:tasks.workunit.client.1.smithi086.stdout:9/630: write db/d26/d5c/d87/d37/fa4 [106748,65171] 0 2024-08-19T00:56:08.771 INFO:tasks.workunit.client.1.smithi086.stdout:0/627: chown da/fe 3621264 1 2024-08-19T00:56:08.775 INFO:tasks.workunit.client.1.smithi086.stdout:5/607: symlink d0/d5f/d60/d57/lb4 0 2024-08-19T00:56:08.778 INFO:tasks.workunit.client.1.smithi086.stdout:3/618: dread d3/d26/f7e [0,4194304] 0 2024-08-19T00:56:08.779 INFO:tasks.workunit.client.1.smithi086.stdout:1/709: mkdir d4/d7/d2a/d6e/d95/db9/deb 0 2024-08-19T00:56:08.780 INFO:tasks.workunit.client.1.smithi086.stdout:6/595: symlink db/d34/d4e/d68/d99/lbe 0 2024-08-19T00:56:08.781 INFO:tasks.workunit.client.1.smithi086.stdout:6/596: dread - db/d34/d4e/db4/fba zero size 2024-08-19T00:56:08.782 INFO:tasks.workunit.client.1.smithi086.stdout:1/710: dread d4/f40 [0,4194304] 0 2024-08-19T00:56:08.783 INFO:tasks.workunit.client.1.smithi086.stdout:1/711: stat d4/d7/d2a/d36/d3a/de5/d7a/db4/lc6 0 2024-08-19T00:56:08.785 INFO:tasks.workunit.client.1.smithi086.stdout:8/580: creat dc/d17/d1e/d82/fb6 x:0 0 0 2024-08-19T00:56:08.785 INFO:tasks.workunit.client.0.smithi017.stdout:3/242: write d5/d11/f16 [729889,95724] 0 2024-08-19T00:56:08.785 INFO:tasks.workunit.client.1.smithi086.stdout:2/590: link d8/c87 d8/d2c/d47/d73/cc9 0 2024-08-19T00:56:08.786 INFO:tasks.workunit.client.1.smithi086.stdout:2/591: write d8/d2c/d38/f53 [867416,25007] 0 2024-08-19T00:56:08.788 INFO:tasks.workunit.client.1.smithi086.stdout:2/592: chown d8/d24/d32/f41 5809 1 2024-08-19T00:56:08.788 INFO:tasks.workunit.client.1.smithi086.stdout:5/608: fdatasync d0/df/d1f/d33/f34 0 2024-08-19T00:56:08.789 INFO:tasks.workunit.client.1.smithi086.stdout:2/593: dread - d8/d14/d9e/faf zero size 2024-08-19T00:56:08.790 INFO:tasks.workunit.client.0.smithi017.stdout:3/243: unlink d5/f10 0 2024-08-19T00:56:08.790 INFO:tasks.workunit.client.0.smithi017.stdout:9/167: sync 2024-08-19T00:56:08.791 INFO:tasks.workunit.client.1.smithi086.stdout:7/633: write d3/d34/d44/d58/d4b/da5/fa3 [645003,37301] 0 2024-08-19T00:56:08.797 INFO:tasks.workunit.client.0.smithi017.stdout:3/244: dwrite d5/d15/d1b/f39 [0,4194304] 0 2024-08-19T00:56:08.801 INFO:tasks.workunit.client.1.smithi086.stdout:6/597: mkdir db/d34/d39/d76/dbf 0 2024-08-19T00:56:08.807 INFO:tasks.workunit.client.0.smithi017.stdout:7/191: dwrite d3/dc/df/d1c/f27 [0,4194304] 0 2024-08-19T00:56:08.810 INFO:tasks.workunit.client.1.smithi086.stdout:0/628: mkdir da/d14/d1a/dc8 0 2024-08-19T00:56:08.810 INFO:tasks.workunit.client.0.smithi017.stdout:7/192: fdatasync d3/dc/df/d1c/d2c/d2f/f3a 0 2024-08-19T00:56:08.812 INFO:tasks.workunit.client.0.smithi017.stdout:3/245: dread d5/d15/f21 [0,4194304] 0 2024-08-19T00:56:08.813 INFO:tasks.workunit.client.1.smithi086.stdout:9/631: mknod db/d26/d5c/d87/d30/d3f/d43/d4e/d7a/ccc 0 2024-08-19T00:56:08.813 INFO:tasks.workunit.client.0.smithi017.stdout:6/160: rmdir d5/d13 39 2024-08-19T00:56:08.815 INFO:tasks.workunit.client.1.smithi086.stdout:9/632: read db/dd/d19/d38/f79 [3850663,80139] 0 2024-08-19T00:56:08.815 INFO:tasks.workunit.client.0.smithi017.stdout:7/193: chown d3/dc/df/d23/l2d 4873581 1 2024-08-19T00:56:08.816 INFO:tasks.workunit.client.1.smithi086.stdout:9/633: chown db/f57 730228 1 2024-08-19T00:56:08.816 INFO:tasks.workunit.client.1.smithi086.stdout:9/634: chown db/fb2 253 1 2024-08-19T00:56:08.816 INFO:tasks.workunit.client.0.smithi017.stdout:7/194: chown d3/dc/c19 785076 1 2024-08-19T00:56:08.817 INFO:tasks.workunit.client.0.smithi017.stdout:7/195: fsync d3/f25 0 2024-08-19T00:56:08.817 INFO:tasks.workunit.client.0.smithi017.stdout:3/246: unlink d5/da/d27/f2c 0 2024-08-19T00:56:08.819 INFO:tasks.workunit.client.1.smithi086.stdout:7/634: unlink d3/de/d68/d7d/fcf 0 2024-08-19T00:56:08.822 INFO:tasks.workunit.client.0.smithi017.stdout:7/196: dread d3/dc/df/d1c/f27 [0,4194304] 0 2024-08-19T00:56:08.823 INFO:tasks.workunit.client.1.smithi086.stdout:3/619: symlink d3/d18/d27/d49/d3f/d5b/lca 0 2024-08-19T00:56:08.827 INFO:tasks.workunit.client.1.smithi086.stdout:8/581: mknod dc/cb7 0 2024-08-19T00:56:08.829 INFO:tasks.workunit.client.0.smithi017.stdout:4/148: dwrite d2/fc [0,4194304] 0 2024-08-19T00:56:08.831 INFO:tasks.workunit.client.1.smithi086.stdout:0/629: unlink da/d14/d44/d49/l78 0 2024-08-19T00:56:08.833 INFO:tasks.workunit.client.1.smithi086.stdout:2/594: truncate d8/f1e 1186003 0 2024-08-19T00:56:08.835 INFO:tasks.workunit.client.0.smithi017.stdout:7/197: creat d3/dc/df/d1a/f3b x:0 0 0 2024-08-19T00:56:08.837 INFO:tasks.workunit.client.0.smithi017.stdout:4/149: dwrite d2/d11/d24/f2e [0,4194304] 0 2024-08-19T00:56:08.887 INFO:tasks.workunit.client.1.smithi086.stdout:9/635: mknod db/d26/d5c/d87/d6d/ccd 0 2024-08-19T00:56:08.889 INFO:tasks.workunit.client.1.smithi086.stdout:9/636: dread db/d5e/fb6 [0,4194304] 0 2024-08-19T00:56:08.891 INFO:tasks.workunit.client.0.smithi017.stdout:3/247: rename d5/ce to d5/d15/d1b/c49 0 2024-08-19T00:56:08.891 INFO:tasks.workunit.client.1.smithi086.stdout:4/570: dwrite d2/d18/d33/f5e [0,4194304] 0 2024-08-19T00:56:08.894 INFO:tasks.workunit.client.1.smithi086.stdout:4/571: truncate d2/d18/d33/d42/d72/d8f/fb1 379038 0 2024-08-19T00:56:08.896 INFO:tasks.workunit.client.1.smithi086.stdout:9/637: dwrite db/d26/d5c/d87/d30/d58/fc6 [0,4194304] 0 2024-08-19T00:56:08.898 INFO:tasks.workunit.client.1.smithi086.stdout:4/572: write d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/fbf [621042,80174] 0 2024-08-19T00:56:08.904 INFO:tasks.workunit.client.1.smithi086.stdout:1/712: sync 2024-08-19T00:56:08.939 INFO:tasks.workunit.client.0.smithi017.stdout:9/168: write d0/f18 [6363518,14729] 0 2024-08-19T00:56:08.967 INFO:tasks.workunit.client.0.smithi017.stdout:9/169: read d0/db/f17 [1857314,114014] 0 2024-08-19T00:56:08.967 INFO:tasks.workunit.client.0.smithi017.stdout:9/170: read - d0/db/d22/f2b zero size 2024-08-19T00:56:08.968 INFO:tasks.workunit.client.0.smithi017.stdout:6/161: rename d5/d13/c2f to d5/d13/d11/d2c/c3a 0 2024-08-19T00:56:08.968 INFO:tasks.workunit.client.0.smithi017.stdout:3/248: creat d5/d15/d1b/f4a x:0 0 0 2024-08-19T00:56:08.968 INFO:tasks.workunit.client.0.smithi017.stdout:6/162: dwrite d5/d13/d20/f27 [0,4194304] 0 2024-08-19T00:56:08.968 INFO:tasks.workunit.client.0.smithi017.stdout:9/171: creat d0/db/f30 x:0 0 0 2024-08-19T00:56:08.968 INFO:tasks.workunit.client.0.smithi017.stdout:9/172: read d0/f18 [6096613,128776] 0 2024-08-19T00:56:08.968 INFO:tasks.workunit.client.1.smithi086.stdout:3/620: unlink d3/d26/d60/f90 0 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:3/621: stat d3/d9/f39 0 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:6/598: truncate db/d37/d44/d5a/f73 924993 0 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:3/622: dwrite d3/d18/d61/d85/f8c [0,4194304] 0 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:6/599: dread - db/d8e/fbc zero size 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:6/600: chown db/d8e/fb0 80339594 1 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:3/623: dread d3/d18/f2c [0,4194304] 0 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:6/601: dwrite db/f46 [4194304,4194304] 0 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:6/602: write db/f11 [735831,72504] 0 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:2/595: mkdir d8/d2c/d38/d80/dca 0 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:6/603: dwrite db/d34/d39/d76/f7b [0,4194304] 0 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:9/638: symlink db/daf/lce 0 2024-08-19T00:56:08.969 INFO:tasks.workunit.client.1.smithi086.stdout:4/573: creat d2/d18/d33/d42/d72/d2f/fc5 x:0 0 0 2024-08-19T00:56:08.971 INFO:tasks.workunit.client.1.smithi086.stdout:1/713: dread d4/d10/f51 [0,4194304] 0 2024-08-19T00:56:08.973 INFO:tasks.workunit.client.1.smithi086.stdout:5/609: truncate d0/d2d/d43/f45 4165798 0 2024-08-19T00:56:08.974 INFO:tasks.workunit.client.1.smithi086.stdout:5/610: write d0/d8/d10/f19 [2856084,77086] 0 2024-08-19T00:56:08.975 INFO:tasks.workunit.client.1.smithi086.stdout:5/611: write d0/d8/d72/f9c [219577,22625] 0 2024-08-19T00:56:08.978 INFO:tasks.workunit.client.0.smithi017.stdout:6/163: creat d5/d13/d11/f3b x:0 0 0 2024-08-19T00:56:08.981 INFO:tasks.workunit.client.0.smithi017.stdout:4/150: rmdir d2/d16/d30 0 2024-08-19T00:56:08.983 INFO:tasks.workunit.client.0.smithi017.stdout:4/151: fsync d2/d16/f1f 0 2024-08-19T00:56:08.985 INFO:tasks.workunit.client.0.smithi017.stdout:9/173: symlink d0/db/l31 0 2024-08-19T00:56:08.986 INFO:tasks.workunit.client.0.smithi017.stdout:9/174: chown d0/db/c1f 8637 1 2024-08-19T00:56:08.987 INFO:tasks.workunit.client.0.smithi017.stdout:6/164: dwrite d5/d13/f24 [0,4194304] 0 2024-08-19T00:56:08.992 INFO:tasks.workunit.client.1.smithi086.stdout:3/624: read d3/d18/d19/d37/fa6 [151920,62149] 0 2024-08-19T00:56:08.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.990+0000 7fc0efadf640 1 -- 172.21.15.17:0/4130797353 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc0e81065d0 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.992 INFO:tasks.workunit.client.0.smithi017.stdout:4/152: creat d2/d11/f33 x:0 0 0 2024-08-19T00:56:08.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.991+0000 7fc0deffd640 1 -- 172.21.15.17:0/4130797353 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+834 (secure 0 0 0) 0x7fc0d805a540 con 0x7fc0e80ffcf0 2024-08-19T00:56:08.993 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:56:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T00:56:08.993 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T00:56:08.994 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 13, 2024-08-19T00:56:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-19T00:56:08.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T00:56:08.995 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:56:08.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.995+0000 7fc0efadf640 1 -- 172.21.15.17:0/4130797353 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc0d406d6b0 msgr2=0x7fc0d406fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:08.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.995+0000 7fc0efadf640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc0d406d6b0 0x7fc0d406fb70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4004d80 tx=0x7fc0e4000bc0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.995+0000 7fc0efadf640 1 -- 172.21.15.17:0/4130797353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0e80ffcf0 msgr2=0x7fc0e819c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:08.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.995+0000 7fc0efadf640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0e80ffcf0 0x7fc0e819c1b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800e970 tx=0x7fc0d800ee30 comp rx=0 tx=0).stop 2024-08-19T00:56:08.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.995+0000 7fc0efadf640 1 -- 172.21.15.17:0/4130797353 shutdown_connections 2024-08-19T00:56:08.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.995+0000 7fc0efadf640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc0e80ffcf0 0x7fc0e819c1b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.995+0000 7fc0efadf640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc0d406d6b0 0x7fc0d406fb70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.995+0000 7fc0efadf640 1 --2- 172.21.15.17:0/4130797353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0e80feaf0 0x7fc0e819bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:08.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.995+0000 7fc0efadf640 1 -- 172.21.15.17:0/4130797353 >> 172.21.15.17:0/4130797353 conn(0x7fc0e80fa280 msgr2=0x7fc0e8103430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:08.998 INFO:tasks.workunit.client.0.smithi017.stdout:6/165: creat d5/d13/d20/f3c x:0 0 0 2024-08-19T00:56:08.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.995+0000 7fc0efadf640 1 -- 172.21.15.17:0/4130797353 shutdown_connections 2024-08-19T00:56:08.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:08.995+0000 7fc0efadf640 1 -- 172.21.15.17:0/4130797353 wait complete. 2024-08-19T00:56:08.998 INFO:tasks.workunit.client.0.smithi017.stdout:6/166: write d5/d13/d11/d2c/f30 [530928,91032] 0 2024-08-19T00:56:08.999 INFO:tasks.workunit.client.1.smithi086.stdout:2/596: rename d8/f36 to d8/d84/fcb 0 2024-08-19T00:56:09.000 INFO:tasks.workunit.client.1.smithi086.stdout:2/597: fdatasync d8/d84/f81 0 2024-08-19T00:56:09.000 INFO:tasks.workunit.client.1.smithi086.stdout:9/639: chown db/d26/d5c/d87/d6d/f41 420 1 2024-08-19T00:56:09.002 INFO:tasks.workunit.client.1.smithi086.stdout:0/630: dwrite da/d14/d1a/d2e/d30/d76/f7d [0,4194304] 0 2024-08-19T00:56:09.003 INFO:tasks.workunit.client.0.smithi017.stdout:6/167: write d5/f8 [3468866,55584] 0 2024-08-19T00:56:09.004 INFO:tasks.workunit.client.0.smithi017.stdout:4/153: mknod d2/c34 0 2024-08-19T00:56:09.005 INFO:tasks.workunit.client.1.smithi086.stdout:7/635: creat d3/de/fd5 x:0 0 0 2024-08-19T00:56:09.008 INFO:tasks.workunit.client.0.smithi017.stdout:4/154: creat d2/d21/f35 x:0 0 0 2024-08-19T00:56:09.009 INFO:tasks.workunit.client.0.smithi017.stdout:7/198: truncate d3/dc/df/d23/f26 2070102 0 2024-08-19T00:56:09.014 INFO:tasks.workunit.client.0.smithi017.stdout:6/168: fsync d5/f8 0 2024-08-19T00:56:09.016 INFO:tasks.workunit.client.0.smithi017.stdout:7/199: mkdir d3/d3c 0 2024-08-19T00:56:09.018 INFO:tasks.workunit.client.1.smithi086.stdout:3/625: symlink d3/d18/d1a/d51/dad/lcb 0 2024-08-19T00:56:09.020 INFO:tasks.workunit.client.0.smithi017.stdout:6/169: unlink d5/d13/c1c 0 2024-08-19T00:56:09.025 INFO:tasks.workunit.client.0.smithi017.stdout:6/170: symlink d5/d13/d11/l3d 0 2024-08-19T00:56:09.026 INFO:tasks.workunit.client.0.smithi017.stdout:7/200: dread d3/dc/df/d1c/f27 [0,4194304] 0 2024-08-19T00:56:09.030 INFO:tasks.workunit.client.0.smithi017.stdout:4/155: fsync d2/d11/f33 0 2024-08-19T00:56:09.030 INFO:tasks.workunit.client.1.smithi086.stdout:2/598: unlink d8/d2c/d38/f53 0 2024-08-19T00:56:09.030 INFO:tasks.workunit.client.0.smithi017.stdout:4/156: chown d2/f7 69743000 1 2024-08-19T00:56:09.031 INFO:tasks.workunit.client.1.smithi086.stdout:2/599: chown d8/d84/d79/f98 658316060 1 2024-08-19T00:56:09.031 INFO:tasks.workunit.client.1.smithi086.stdout:4/574: mkdir d2/d18/d33/d42/d72/d78/d9e/dc6 0 2024-08-19T00:56:09.031 INFO:tasks.workunit.client.0.smithi017.stdout:4/157: stat d2/f29 0 2024-08-19T00:56:09.031 INFO:tasks.workunit.client.0.smithi017.stdout:4/158: stat d2/d1a/lf 0 2024-08-19T00:56:09.032 INFO:tasks.workunit.client.1.smithi086.stdout:4/575: write d2/d18/d33/d42/d72/d78/d25/f58 [159543,31385] 0 2024-08-19T00:56:09.033 INFO:tasks.workunit.client.1.smithi086.stdout:4/576: fdatasync d2/d18/d33/d42/d72/d2f/fc5 0 2024-08-19T00:56:09.034 INFO:tasks.workunit.client.1.smithi086.stdout:4/577: fsync d2/d18/d33/d42/d72/d2f/fb4 0 2024-08-19T00:56:09.035 INFO:tasks.workunit.client.1.smithi086.stdout:1/714: creat d4/d7/d2a/d6e/d95/db9/deb/fec x:0 0 0 2024-08-19T00:56:09.035 INFO:tasks.workunit.client.0.smithi017.stdout:9/175: truncate d0/fc 3712170 0 2024-08-19T00:56:09.042 INFO:tasks.workunit.client.1.smithi086.stdout:0/631: dread da/d14/d26/f29 [0,4194304] 0 2024-08-19T00:56:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.092+0000 7f01cc05d640 1 -- 172.21.15.17:0/3178034906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01c4100dc0 msgr2=0x7f01c4101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.092+0000 7f01cc05d640 1 --2- 172.21.15.17:0/3178034906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01c4100dc0 0x7f01c4101240 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009880 tx=0x7f01b402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:56:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.092+0000 7f01cc05d640 1 -- 172.21.15.17:0/3178034906 shutdown_connections 2024-08-19T00:56:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.092+0000 7f01cc05d640 1 --2- 172.21.15.17:0/3178034906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01c4100dc0 0x7f01c4101240 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.092+0000 7f01cc05d640 1 --2- 172.21.15.17:0/3178034906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01c40ffbc0 0x7f01c40fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.092+0000 7f01cc05d640 1 -- 172.21.15.17:0/3178034906 >> 172.21.15.17:0/3178034906 conn(0x7f01c40fb350 msgr2=0x7f01c40fd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.092+0000 7f01cc05d640 1 -- 172.21.15.17:0/3178034906 shutdown_connections 2024-08-19T00:56:09.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.092+0000 7f01cc05d640 1 -- 172.21.15.17:0/3178034906 wait complete. 2024-08-19T00:56:09.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.092+0000 7f01cc05d640 1 Processor -- start 2024-08-19T00:56:09.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.092+0000 7f01cc05d640 1 -- start start 2024-08-19T00:56:09.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01cc05d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01c40ffbc0 0x7f01c4074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:09.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01cc05d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01c4100dc0 0x7f01c40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:09.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01cc05d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4072de0 con 0x7f01c4100dc0 2024-08-19T00:56:09.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01cc05d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4072f50 con 0x7f01c40ffbc0 2024-08-19T00:56:09.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01c95f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01c4100dc0 0x7f01c40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:09.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01c95f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01c4100dc0 0x7f01c40728a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47066/0 (socket says 172.21.15.17:47066) 2024-08-19T00:56:09.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01c95f8640 1 -- 172.21.15.17:0/3878258588 learned_addr learned my addr 172.21.15.17:0/3878258588 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:56:09.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01c9df9640 1 --2- 172.21.15.17:0/3878258588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01c40ffbc0 0x7f01c4074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:09.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01c95f8640 1 -- 172.21.15.17:0/3878258588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01c40ffbc0 msgr2=0x7f01c4074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:09.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01c95f8640 1 --2- 172.21.15.17:0/3878258588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01c40ffbc0 0x7f01c4074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:09.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01c95f8640 1 -- 172.21.15.17:0/3878258588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b4009560 con 0x7f01c4100dc0 2024-08-19T00:56:09.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01c95f8640 1 --2- 172.21.15.17:0/3878258588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01c4100dc0 0x7f01c40728a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f01b40054f0 tx=0x7f01b4005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:09.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.093+0000 7f01baffd640 1 -- 172.21.15.17:0/3878258588 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b4004aa0 con 0x7f01c4100dc0 2024-08-19T00:56:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.094+0000 7f01baffd640 1 -- 172.21.15.17:0/3878258588 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01b4004c00 con 0x7f01c4100dc0 2024-08-19T00:56:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.094+0000 7f01cc05d640 1 -- 172.21.15.17:0/3878258588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c40731d0 con 0x7f01c4100dc0 2024-08-19T00:56:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.094+0000 7f01baffd640 1 -- 172.21.15.17:0/3878258588 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01b4003ac0 con 0x7f01c4100dc0 2024-08-19T00:56:09.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.094+0000 7f01cc05d640 1 -- 172.21.15.17:0/3878258588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c419d6d0 con 0x7f01c4100dc0 2024-08-19T00:56:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.095+0000 7f01cc05d640 1 -- 172.21.15.17:0/3878258588 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c40fffc0 con 0x7f01c4100dc0 2024-08-19T00:56:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.095+0000 7f01baffd640 1 -- 172.21.15.17:0/3878258588 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f01b4003d30 con 0x7f01c4100dc0 2024-08-19T00:56:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.096+0000 7f01baffd640 1 --2- 172.21.15.17:0/3878258588 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f01b006d660 0x7f01b006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.096+0000 7f01baffd640 1 -- 172.21.15.17:0/3878258588 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f01b40ae350 con 0x7f01c4100dc0 2024-08-19T00:56:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.096+0000 7f01c9df9640 1 --2- 172.21.15.17:0/3878258588 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f01b006d660 0x7f01b006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:09.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.096+0000 7f01c9df9640 1 --2- 172.21.15.17:0/3878258588 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f01b006d660 0x7f01b006fb20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f01c0005fd0 tx=0x7f01c0005850 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:09.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.100+0000 7f01baffd640 1 -- 172.21.15.17:0/3878258588 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f01b4077b10 con 0x7f01c4100dc0 2024-08-19T00:56:09.106 INFO:tasks.workunit.client.0.smithi017.stdout:4/159: creat d2/d11/f36 x:0 0 0 2024-08-19T00:56:09.108 INFO:tasks.workunit.client.1.smithi086.stdout:5/612: symlink d0/d5f/d60/d57/d80/da3/lb5 0 2024-08-19T00:56:09.111 INFO:tasks.workunit.client.1.smithi086.stdout:8/582: getdents dc 0 2024-08-19T00:56:09.115 INFO:tasks.workunit.client.1.smithi086.stdout:5/613: dwrite d0/d8/d70/fb0 [0,4194304] 0 2024-08-19T00:56:09.119 INFO:tasks.workunit.client.1.smithi086.stdout:7/636: dread d3/d34/d44/f37 [0,4194304] 0 2024-08-19T00:56:09.121 INFO:tasks.workunit.client.1.smithi086.stdout:5/614: dwrite d0/d2d/d43/fb2 [0,4194304] 0 2024-08-19T00:56:09.122 INFO:tasks.workunit.client.1.smithi086.stdout:2/600: sync 2024-08-19T00:56:09.152 INFO:tasks.workunit.client.0.smithi017.stdout:7/201: getdents d3/dc/df/d1a 0 2024-08-19T00:56:09.158 INFO:tasks.workunit.client.0.smithi017.stdout:7/202: getdents d3/dc/df/d32 0 2024-08-19T00:56:09.163 INFO:tasks.workunit.client.0.smithi017.stdout:7/203: unlink d3/dc/df/f28 0 2024-08-19T00:56:09.177 INFO:tasks.workunit.client.0.smithi017.stdout:9/176: dwrite d0/f18 [4194304,4194304] 0 2024-08-19T00:56:09.178 INFO:tasks.workunit.client.0.smithi017.stdout:4/160: dwrite d2/d1a/f23 [0,4194304] 0 2024-08-19T00:56:09.179 INFO:tasks.workunit.client.0.smithi017.stdout:4/161: chown d2 0 1 2024-08-19T00:56:09.187 INFO:tasks.workunit.client.1.smithi086.stdout:9/640: symlink db/d26/d5c/d87/d30/d3f/d43/d4e/lcf 0 2024-08-19T00:56:09.189 INFO:tasks.workunit.client.1.smithi086.stdout:4/578: truncate d2/d18/d33/f57 648120 0 2024-08-19T00:56:09.189 INFO:tasks.workunit.client.1.smithi086.stdout:9/641: chown db/d26/d5c/d87/d30/d58/fc7 50 1 2024-08-19T00:56:09.191 INFO:tasks.workunit.client.1.smithi086.stdout:4/579: fsync d2/d18/d33/d42/d72/d78/d25/fbb 0 2024-08-19T00:56:09.191 INFO:tasks.workunit.client.1.smithi086.stdout:1/715: mkdir d4/d7/d2a/d36/d50/d9c/ded 0 2024-08-19T00:56:09.193 INFO:tasks.workunit.client.1.smithi086.stdout:8/583: truncate f5 987763 0 2024-08-19T00:56:09.195 INFO:tasks.workunit.client.0.smithi017.stdout:4/162: getdents d2/d1a/d20 0 2024-08-19T00:56:09.196 INFO:tasks.workunit.client.1.smithi086.stdout:4/580: dwrite d2/d18/d33/d42/d72/d78/d25/fbb [0,4194304] 0 2024-08-19T00:56:09.199 INFO:tasks.workunit.client.0.smithi017.stdout:9/177: creat d0/f32 x:0 0 0 2024-08-19T00:56:09.200 INFO:tasks.workunit.client.0.smithi017.stdout:4/163: dread d2/fc [0,4194304] 0 2024-08-19T00:56:09.201 INFO:tasks.workunit.client.1.smithi086.stdout:7/637: unlink d3/de/f27 0 2024-08-19T00:56:09.202 INFO:tasks.workunit.client.1.smithi086.stdout:7/638: write d3/de/d68/d7a/d96/fb9 [82209,22196] 0 2024-08-19T00:56:09.207 INFO:tasks.workunit.client.1.smithi086.stdout:5/615: mknod d0/d5f/d60/d57/d80/cb6 0 2024-08-19T00:56:09.207 INFO:tasks.workunit.client.0.smithi017.stdout:9/178: dwrite d0/db/f1b [4194304,4194304] 0 2024-08-19T00:56:09.208 INFO:tasks.workunit.client.0.smithi017.stdout:9/179: stat d0/f32 0 2024-08-19T00:56:09.212 INFO:tasks.workunit.client.0.smithi017.stdout:4/164: chown d2/d11/d24/l2c 8345 1 2024-08-19T00:56:09.219 INFO:tasks.workunit.client.1.smithi086.stdout:6/604: rename db/f3b to db/d37/d28/fc0 0 2024-08-19T00:56:09.221 INFO:tasks.workunit.client.0.smithi017.stdout:4/165: fsync d2/f6 0 2024-08-19T00:56:09.222 INFO:tasks.workunit.client.1.smithi086.stdout:9/642: write db/d96/fb4 [4903051,62086] 0 2024-08-19T00:56:09.224 INFO:tasks.workunit.client.0.smithi017.stdout:7/204: dwrite d3/dc/f21 [0,4194304] 0 2024-08-19T00:56:09.226 INFO:tasks.workunit.client.0.smithi017.stdout:4/166: write d2/d21/f35 [100665,9004] 0 2024-08-19T00:56:09.232 INFO:tasks.workunit.client.0.smithi017.stdout:4/167: dwrite d2/f7 [0,4194304] 0 2024-08-19T00:56:09.233 INFO:tasks.workunit.client.0.smithi017.stdout:4/168: fsync d2/d16/f1f 0 2024-08-19T00:56:09.235 INFO:tasks.workunit.client.0.smithi017.stdout:9/180: rename d0/db to d0/d33 0 2024-08-19T00:56:09.238 INFO:tasks.workunit.client.1.smithi086.stdout:4/581: write d2/d18/d33/d42/d72/d78/d25/d55/f3d [1906520,81064] 0 2024-08-19T00:56:09.239 INFO:tasks.workunit.client.1.smithi086.stdout:4/582: read - d2/d18/d33/d42/fba zero size 2024-08-19T00:56:09.246 INFO:tasks.workunit.client.1.smithi086.stdout:5/616: mkdir d0/d5f/d60/d57/d80/da3/db7 0 2024-08-19T00:56:09.248 INFO:tasks.workunit.client.1.smithi086.stdout:1/716: dwrite d4/d7/d2a/d36/d7d/d88/fac [0,4194304] 0 2024-08-19T00:56:09.249 INFO:tasks.workunit.client.1.smithi086.stdout:3/626: link d3/d18/d19/dbc/db8/f31 d3/d18/d19/dbc/d5d/fcc 0 2024-08-19T00:56:09.252 INFO:tasks.workunit.client.0.smithi017.stdout:4/169: rename d2/d16/f2d to d2/d27/f37 0 2024-08-19T00:56:09.253 INFO:tasks.workunit.client.0.smithi017.stdout:9/181: dread d0/f15 [0,4194304] 0 2024-08-19T00:56:09.254 INFO:tasks.workunit.client.1.smithi086.stdout:8/584: dwrite dc/d16/d18/d29/d2e/d28/d2b/f5f [0,4194304] 0 2024-08-19T00:56:09.257 INFO:tasks.workunit.client.1.smithi086.stdout:0/632: rename da/d14/d1a/d2e/d39/d3b/d4e/l5e to da/d14/d44/lc9 0 2024-08-19T00:56:09.257 INFO:tasks.workunit.client.1.smithi086.stdout:6/605: unlink db/d37/d30/f3f 0 2024-08-19T00:56:09.258 INFO:tasks.workunit.client.0.smithi017.stdout:4/170: rmdir d2/d27 39 2024-08-19T00:56:09.259 INFO:tasks.workunit.client.1.smithi086.stdout:9/643: creat db/dd/d19/d18/db9/fd0 x:0 0 0 2024-08-19T00:56:09.259 INFO:tasks.workunit.client.1.smithi086.stdout:7/639: dread d3/d34/d44/d58/d4b/da5/f5d [0,4194304] 0 2024-08-19T00:56:09.263 INFO:tasks.workunit.client.0.smithi017.stdout:9/182: dwrite d0/d33/f17 [0,4194304] 0 2024-08-19T00:56:09.266 INFO:tasks.workunit.client.0.smithi017.stdout:7/205: truncate d3/f5 1714740 0 2024-08-19T00:56:09.269 INFO:tasks.workunit.client.1.smithi086.stdout:4/583: fsync d2/d18/d33/d42/d72/d78/d25/d55/d6c/f9c 0 2024-08-19T00:56:09.271 INFO:tasks.workunit.client.1.smithi086.stdout:2/601: mkdir d8/d43/d77/dcc 0 2024-08-19T00:56:09.272 INFO:tasks.workunit.client.1.smithi086.stdout:2/602: fdatasync d8/d14/f75 0 2024-08-19T00:56:09.272 INFO:tasks.workunit.client.1.smithi086.stdout:2/603: fsync d8/d84/d79/f98 0 2024-08-19T00:56:09.272 INFO:tasks.workunit.client.0.smithi017.stdout:9/183: unlink d0/d33/f23 0 2024-08-19T00:56:09.273 INFO:tasks.workunit.client.1.smithi086.stdout:5/617: creat d0/df/d1f/d65/fb8 x:0 0 0 2024-08-19T00:56:09.275 INFO:tasks.workunit.client.0.smithi017.stdout:7/206: read d3/f12 [1342188,62514] 0 2024-08-19T00:56:09.275 INFO:tasks.workunit.client.0.smithi017.stdout:7/207: stat d3/dc/f1f 0 2024-08-19T00:56:09.280 INFO:tasks.workunit.client.1.smithi086.stdout:7/640: dread d3/d34/d44/d58/fa9 [0,4194304] 0 2024-08-19T00:56:09.281 INFO:tasks.workunit.client.1.smithi086.stdout:6/606: symlink db/d34/d4e/lc1 0 2024-08-19T00:56:09.282 INFO:tasks.workunit.client.0.smithi017.stdout:7/208: mkdir d3/dc/df/d3d 0 2024-08-19T00:56:09.284 INFO:tasks.workunit.client.1.smithi086.stdout:0/633: creat da/d14/d55/fca x:0 0 0 2024-08-19T00:56:09.285 INFO:tasks.workunit.client.0.smithi017.stdout:9/184: creat d0/f34 x:0 0 0 2024-08-19T00:56:09.286 INFO:tasks.workunit.client.0.smithi017.stdout:9/185: fdatasync d0/f34 0 2024-08-19T00:56:09.287 INFO:tasks.workunit.client.0.smithi017.stdout:9/186: dread d0/f15 [0,4194304] 0 2024-08-19T00:56:09.290 INFO:tasks.workunit.client.0.smithi017.stdout:7/209: creat d3/dc/df/d1c/f3e x:0 0 0 2024-08-19T00:56:09.290 INFO:tasks.workunit.client.0.smithi017.stdout:4/171: truncate d2/d16/f22 3942289 0 2024-08-19T00:56:09.291 INFO:tasks.workunit.client.0.smithi017.stdout:7/210: readlink d3/lb 0 2024-08-19T00:56:09.295 INFO:tasks.workunit.client.1.smithi086.stdout:4/584: creat d2/d18/d33/d42/d72/d78/d9e/fc7 x:0 0 0 2024-08-19T00:56:09.296 INFO:tasks.workunit.client.0.smithi017.stdout:9/187: dwrite d0/d33/d22/f2c [0,4194304] 0 2024-08-19T00:56:09.296 INFO:tasks.workunit.client.1.smithi086.stdout:4/585: chown d2/d18/d33/d42/d72/d78/d9e/fc7 7685514 1 2024-08-19T00:56:09.299 INFO:tasks.workunit.client.1.smithi086.stdout:8/585: write dc/d16/d18/d29/d2e/d28/d2b/d3b/f8e [4781590,86433] 0 2024-08-19T00:56:09.301 INFO:tasks.workunit.client.0.smithi017.stdout:7/211: unlink d3/dc/f21 0 2024-08-19T00:56:09.302 INFO:tasks.workunit.client.0.smithi017.stdout:7/212: write d3/f25 [3687522,19863] 0 2024-08-19T00:56:09.306 INFO:tasks.workunit.client.1.smithi086.stdout:8/586: dwrite dc/d16/d18/d94/f8d [0,4194304] 0 2024-08-19T00:56:09.310 INFO:tasks.workunit.client.0.smithi017.stdout:7/213: dwrite d3/f2e [0,4194304] 0 2024-08-19T00:56:09.310 INFO:tasks.workunit.client.1.smithi086.stdout:2/604: truncate d8/f1a 819607 0 2024-08-19T00:56:09.313 INFO:tasks.workunit.client.1.smithi086.stdout:8/587: dwrite dc/d70/d7a/d9b/f71 [0,4194304] 0 2024-08-19T00:56:09.319 INFO:tasks.workunit.client.1.smithi086.stdout:5/618: creat d0/d8/d70/fb9 x:0 0 0 2024-08-19T00:56:09.320 INFO:tasks.workunit.client.0.smithi017.stdout:7/214: dwrite d3/f4 [4194304,4194304] 0 2024-08-19T00:56:09.326 INFO:tasks.workunit.client.0.smithi017.stdout:4/172: write d2/f6 [1989218,94340] 0 2024-08-19T00:56:09.332 INFO:tasks.workunit.client.0.smithi017.stdout:7/215: dwrite d3/dc/df/d1c/f3e [0,4194304] 0 2024-08-19T00:56:09.333 INFO:tasks.workunit.client.0.smithi017.stdout:7/216: fdatasync d3/dc/f1f 0 2024-08-19T00:56:09.335 INFO:tasks.workunit.client.1.smithi086.stdout:3/627: mknod d3/d18/d19/dbc/db8/dc9/ccd 0 2024-08-19T00:56:09.336 INFO:tasks.workunit.client.1.smithi086.stdout:3/628: write d3/d18/d27/d49/d3f/f89 [547625,75951] 0 2024-08-19T00:56:09.336 INFO:tasks.workunit.client.1.smithi086.stdout:3/629: fsync d3/ff 0 2024-08-19T00:56:09.337 INFO:tasks.workunit.client.1.smithi086.stdout:3/630: chown d3/d18/f36 1440255 1 2024-08-19T00:56:09.339 INFO:tasks.workunit.client.0.smithi017.stdout:4/173: creat d2/d16/f38 x:0 0 0 2024-08-19T00:56:09.341 INFO:tasks.workunit.client.0.smithi017.stdout:4/174: write d2/d16/f1f [1655066,117467] 0 2024-08-19T00:56:09.346 INFO:tasks.workunit.client.0.smithi017.stdout:4/175: rmdir d2/d11 39 2024-08-19T00:56:09.348 INFO:tasks.workunit.client.1.smithi086.stdout:4/586: readlink d2/d18/d33/d42/d72/d2f/dc4/l66 0 2024-08-19T00:56:09.349 INFO:tasks.workunit.client.1.smithi086.stdout:4/587: chown d2/d18/f86 5 1 2024-08-19T00:56:09.351 INFO:tasks.workunit.client.0.smithi017.stdout:4/176: rename d2/d21/d32 to d2/d1a/d39 0 2024-08-19T00:56:09.352 INFO:tasks.workunit.client.1.smithi086.stdout:1/717: write d4/f14 [4520703,54831] 0 2024-08-19T00:56:09.352 INFO:tasks.workunit.client.0.smithi017.stdout:4/177: dread - d2/d16/f38 zero size 2024-08-19T00:56:09.353 INFO:tasks.workunit.client.1.smithi086.stdout:1/718: write d4/d7/d2a/d36/d3a/d41/f67 [3954563,126004] 0 2024-08-19T00:56:09.353 INFO:tasks.workunit.client.0.smithi017.stdout:4/178: fsync d2/d1a/f23 0 2024-08-19T00:56:09.355 INFO:tasks.workunit.client.1.smithi086.stdout:2/605: fsync d8/d2c/d38/f45 0 2024-08-19T00:56:09.358 INFO:tasks.workunit.client.1.smithi086.stdout:8/588: unlink dc/d1f/f27 0 2024-08-19T00:56:09.360 INFO:tasks.workunit.client.1.smithi086.stdout:5/619: creat d0/d5f/d60/d57/d80/da3/fba x:0 0 0 2024-08-19T00:56:09.364 INFO:tasks.workunit.client.0.smithi017.stdout:9/188: dwrite d0/fc [0,4194304] 0 2024-08-19T00:56:09.371 INFO:tasks.workunit.client.0.smithi017.stdout:7/217: write d3/dc/df/d23/f26 [2165851,111851] 0 2024-08-19T00:56:09.373 INFO:tasks.workunit.client.1.smithi086.stdout:6/607: mkdir db/d37/d28/d7f/d96/dc2 0 2024-08-19T00:56:09.374 INFO:tasks.workunit.client.0.smithi017.stdout:9/189: rename d0/d33/c1e to d0/d33/d22/c35 0 2024-08-19T00:56:09.374 INFO:tasks.workunit.client.0.smithi017.stdout:9/190: readlink d0/l26 0 2024-08-19T00:56:09.375 INFO:tasks.workunit.client.1.smithi086.stdout:3/631: creat d3/d26/d2b/fce x:0 0 0 2024-08-19T00:56:09.376 INFO:tasks.workunit.client.1.smithi086.stdout:7/641: truncate d3/de/f70 945015 0 2024-08-19T00:56:09.376 INFO:tasks.workunit.client.0.smithi017.stdout:9/191: dread d0/f15 [0,4194304] 0 2024-08-19T00:56:09.378 INFO:tasks.workunit.client.1.smithi086.stdout:4/588: creat d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/fc8 x:0 0 0 2024-08-19T00:56:09.382 INFO:tasks.workunit.client.0.smithi017.stdout:9/192: mkdir d0/d33/d22/d36 0 2024-08-19T00:56:09.384 INFO:tasks.workunit.client.0.smithi017.stdout:7/218: creat d3/dc/df/d23/f3f x:0 0 0 2024-08-19T00:56:09.385 INFO:tasks.workunit.client.0.smithi017.stdout:7/219: fdatasync d3/dc/f1f 0 2024-08-19T00:56:09.386 INFO:tasks.workunit.client.0.smithi017.stdout:4/179: link d2/d11/f14 d2/d21/f3a 0 2024-08-19T00:56:09.387 INFO:tasks.workunit.client.0.smithi017.stdout:7/220: dread d3/dc/f1f [0,4194304] 0 2024-08-19T00:56:09.388 INFO:tasks.workunit.client.0.smithi017.stdout:7/221: chown d3/dc/df/d1c/d2c/d35 693 1 2024-08-19T00:56:09.389 INFO:tasks.workunit.client.0.smithi017.stdout:7/222: chown d3/dc/df/d23/f24 6259914 1 2024-08-19T00:56:09.390 INFO:tasks.workunit.client.1.smithi086.stdout:8/589: rename dc/d70 to dc/d1f/d37/d4f/dac/db8 0 2024-08-19T00:56:09.393 INFO:tasks.workunit.client.0.smithi017.stdout:9/193: mknod d0/d33/c37 0 2024-08-19T00:56:09.394 INFO:tasks.workunit.client.0.smithi017.stdout:9/194: dread - d0/d33/d22/f2f zero size 2024-08-19T00:56:09.397 INFO:tasks.workunit.client.0.smithi017.stdout:7/223: dwrite d3/f2e [0,4194304] 0 2024-08-19T00:56:09.400 INFO:tasks.workunit.client.1.smithi086.stdout:1/719: write d4/d7/f39 [2961692,11659] 0 2024-08-19T00:56:09.400 INFO:tasks.workunit.client.0.smithi017.stdout:7/224: write d3/dc/df/d1c/d2c/d2f/f3a [661970,111909] 0 2024-08-19T00:56:09.401 INFO:tasks.workunit.client.1.smithi086.stdout:9/644: getdents db/d26/d5c/d87/d30/d3f/d43/d4e/d7a 0 2024-08-19T00:56:09.402 INFO:tasks.workunit.client.0.smithi017.stdout:1/176: sync 2024-08-19T00:56:09.405 INFO:tasks.workunit.client.1.smithi086.stdout:0/634: link da/d14/d26/f33 da/d14/d1a/d2e/d39/d3b/d89/dc5/fcb 0 2024-08-19T00:56:09.405 INFO:tasks.workunit.client.0.smithi017.stdout:4/180: dread d2/f12 [0,4194304] 0 2024-08-19T00:56:09.406 INFO:tasks.workunit.client.0.smithi017.stdout:9/195: rename d0/d33/d22/c27 to d0/d33/d22/d36/c38 0 2024-08-19T00:56:09.408 INFO:tasks.workunit.client.0.smithi017.stdout:9/196: chown d0/c1c 104776 1 2024-08-19T00:56:09.409 INFO:tasks.workunit.client.0.smithi017.stdout:9/197: fdatasync d0/f19 0 2024-08-19T00:56:09.415 INFO:tasks.workunit.client.1.smithi086.stdout:2/606: mknod d8/d2c/ccd 0 2024-08-19T00:56:09.416 INFO:tasks.workunit.client.1.smithi086.stdout:2/607: chown d8/d43/fbc 45 1 2024-08-19T00:56:09.422 INFO:tasks.workunit.client.0.smithi017.stdout:9/198: rename d0/d33/d22/f2b to d0/d33/f39 0 2024-08-19T00:56:09.424 INFO:tasks.workunit.client.1.smithi086.stdout:7/642: rename d3/c8c to d3/d34/d44/d58/d4b/d42/cd6 0 2024-08-19T00:56:09.425 INFO:tasks.workunit.client.0.smithi017.stdout:1/177: dread d4/dc/f16 [0,4194304] 0 2024-08-19T00:56:09.425 INFO:tasks.workunit.client.0.smithi017.stdout:1/178: dread - d4/d1c/f32 zero size 2024-08-19T00:56:09.429 INFO:tasks.workunit.client.0.smithi017.stdout:4/181: creat d2/d1a/d20/f3b x:0 0 0 2024-08-19T00:56:09.430 INFO:tasks.workunit.client.1.smithi086.stdout:6/608: symlink db/d37/d28/d7f/d96/dc2/lc3 0 2024-08-19T00:56:09.430 INFO:tasks.workunit.client.1.smithi086.stdout:6/609: chown db/d34/d4e/db4 41584 1 2024-08-19T00:56:09.431 INFO:tasks.workunit.client.1.smithi086.stdout:6/610: write db/d37/d44/d5a/fbb [864838,46642] 0 2024-08-19T00:56:09.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:09 smithi017 ceph-mon[16627]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:09 smithi017 ceph-mon[16627]: pgmap v15: 65 pgs: 65 active+clean; 1.5 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 204 MiB/s wr, 355 op/s 2024-08-19T00:56:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:09 smithi017 ceph-mon[16627]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:09 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/4130797353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:56:09.435 INFO:tasks.workunit.client.0.smithi017.stdout:1/179: fdatasync d4/f13 0 2024-08-19T00:56:09.437 INFO:tasks.workunit.client.1.smithi086.stdout:4/589: link d2/d18/d33/d42/d72/d78/d2c/dbc/fc3 d2/d18/d33/d42/d72/d78/d25/d55/d6c/fc9 0 2024-08-19T00:56:09.443 INFO:tasks.workunit.client.0.smithi017.stdout:4/182: dwrite d2/d1a/fe [4194304,4194304] 0 2024-08-19T00:56:09.445 INFO:tasks.workunit.client.0.smithi017.stdout:4/183: fdatasync d2/d11/f36 0 2024-08-19T00:56:09.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:09 smithi086 ceph-mon[24511]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:09.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:09 smithi086 ceph-mon[24511]: pgmap v15: 65 pgs: 65 active+clean; 1.5 GiB data, 4.7 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 204 MiB/s wr, 355 op/s 2024-08-19T00:56:09.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:09 smithi086 ceph-mon[24511]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:09.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:09 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/4130797353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:56:09.446 INFO:tasks.workunit.client.0.smithi017.stdout:7/225: dwrite d3/f5 [0,4194304] 0 2024-08-19T00:56:09.450 INFO:tasks.workunit.client.1.smithi086.stdout:9/645: mknod db/d26/cd1 0 2024-08-19T00:56:09.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.449+0000 7f01cc05d640 1 -- 172.21.15.17:0/3878258588 --> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f01c40608f0 con 0x7f01b006d660 2024-08-19T00:56:09.452 INFO:tasks.workunit.client.0.smithi017.stdout:9/199: creat d0/f3a x:0 0 0 2024-08-19T00:56:09.452 INFO:tasks.workunit.client.1.smithi086.stdout:2/608: write d8/d2c/d47/f6d [98788,62813] 0 2024-08-19T00:56:09.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.451+0000 7f01baffd640 1 -- 172.21.15.17:0/3878258588 <== mgr.24369 v2:172.21.15.86:6828/261187346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f01c40608f0 con 0x7f01b006d660 2024-08-19T00:56:09.453 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:56:09.453 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T00:56:09.454 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T00:56:09.454 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-19T00:56:09.454 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [], 2024-08-19T00:56:09.454 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "1/2 daemons upgraded", 2024-08-19T00:56:09.454 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-08-19T00:56:09.454 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T00:56:09.454 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:56:09.455 INFO:tasks.workunit.client.1.smithi086.stdout:6/611: readlink db/d34/lac 0 2024-08-19T00:56:09.455 INFO:tasks.workunit.client.1.smithi086.stdout:6/612: chown db/d37/d41/da7 9594494 1 2024-08-19T00:56:09.455 INFO:tasks.workunit.client.1.smithi086.stdout:9/646: dread db/dd/d19/d18/f2f [0,4194304] 0 2024-08-19T00:56:09.455 INFO:tasks.workunit.client.1.smithi086.stdout:2/609: read d8/d14/f2f [4352112,24578] 0 2024-08-19T00:56:09.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.454+0000 7f01cc05d640 1 -- 172.21.15.17:0/3878258588 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f01b006d660 msgr2=0x7f01b006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:09.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.454+0000 7f01cc05d640 1 --2- 172.21.15.17:0/3878258588 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f01b006d660 0x7f01b006fb20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f01c0005fd0 tx=0x7f01c0005850 comp rx=0 tx=0).stop 2024-08-19T00:56:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.454+0000 7f01cc05d640 1 -- 172.21.15.17:0/3878258588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01c4100dc0 msgr2=0x7f01c40728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.454+0000 7f01cc05d640 1 --2- 172.21.15.17:0/3878258588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01c4100dc0 0x7f01c40728a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f01b40054f0 tx=0x7f01b4005520 comp rx=0 tx=0).stop 2024-08-19T00:56:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.455+0000 7f01cc05d640 1 -- 172.21.15.17:0/3878258588 shutdown_connections 2024-08-19T00:56:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.455+0000 7f01cc05d640 1 --2- 172.21.15.17:0/3878258588 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f01b006d660 0x7f01b006fb20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.455+0000 7f01cc05d640 1 --2- 172.21.15.17:0/3878258588 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f01c4100dc0 0x7f01c40728a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.455+0000 7f01cc05d640 1 --2- 172.21.15.17:0/3878258588 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01c40ffbc0 0x7f01c4074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.455+0000 7f01cc05d640 1 -- 172.21.15.17:0/3878258588 >> 172.21.15.17:0/3878258588 conn(0x7f01c40fb350 msgr2=0x7f01c4104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.455+0000 7f01cc05d640 1 -- 172.21.15.17:0/3878258588 shutdown_connections 2024-08-19T00:56:09.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:09.455+0000 7f01cc05d640 1 -- 172.21.15.17:0/3878258588 wait complete. 2024-08-19T00:56:09.458 INFO:tasks.workunit.client.1.smithi086.stdout:4/590: symlink d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/lca 0 2024-08-19T00:56:09.458 INFO:tasks.workunit.client.1.smithi086.stdout:2/610: dread - d8/d24/d32/d4d/d6a/fb2 zero size 2024-08-19T00:56:09.458 INFO:tasks.workunit.client.0.smithi017.stdout:4/184: chown d2/d21/f3a 65 1 2024-08-19T00:56:09.459 INFO:tasks.workunit.client.0.smithi017.stdout:7/226: rmdir d3/dc/df/d1c/d2c/d35 39 2024-08-19T00:56:09.460 INFO:tasks.workunit.client.0.smithi017.stdout:7/227: dread - d3/dc/df/d1a/f3b zero size 2024-08-19T00:56:09.460 INFO:tasks.workunit.client.1.smithi086.stdout:8/590: creat dc/d1f/d37/d4f/dac/db8/d7a/d9b/fb9 x:0 0 0 2024-08-19T00:56:09.461 INFO:tasks.workunit.client.0.smithi017.stdout:9/200: symlink d0/d33/l3b 0 2024-08-19T00:56:09.461 INFO:tasks.workunit.client.0.smithi017.stdout:9/201: readlink d0/d33/d22/l24 0 2024-08-19T00:56:09.462 INFO:tasks.workunit.client.0.smithi017.stdout:9/202: truncate d0/f3a 797663 0 2024-08-19T00:56:09.463 INFO:tasks.workunit.client.1.smithi086.stdout:7/643: symlink d3/d34/d44/d58/d4b/da5/ld7 0 2024-08-19T00:56:09.464 INFO:tasks.workunit.client.0.smithi017.stdout:1/180: rename l1 to d4/l37 0 2024-08-19T00:56:09.465 INFO:tasks.workunit.client.1.smithi086.stdout:5/620: getdents d0/d99/da2 0 2024-08-19T00:56:09.465 INFO:tasks.workunit.client.0.smithi017.stdout:7/228: creat d3/dc/f40 x:0 0 0 2024-08-19T00:56:09.466 INFO:tasks.workunit.client.0.smithi017.stdout:9/203: rmdir d0/d33/d22/d36 39 2024-08-19T00:56:09.466 INFO:tasks.workunit.client.0.smithi017.stdout:7/229: read d3/f2e [1571688,60939] 0 2024-08-19T00:56:09.467 INFO:tasks.workunit.client.1.smithi086.stdout:4/591: dwrite d2/d18/d33/f64 [0,4194304] 0 2024-08-19T00:56:09.467 INFO:tasks.workunit.client.0.smithi017.stdout:9/204: write d0/f34 [1002739,49100] 0 2024-08-19T00:56:09.467 INFO:tasks.workunit.client.1.smithi086.stdout:6/613: creat db/d37/d44/d5a/d78/fc4 x:0 0 0 2024-08-19T00:56:09.468 INFO:tasks.workunit.client.1.smithi086.stdout:2/611: dwrite d8/d24/d32/d61/f7e [0,4194304] 0 2024-08-19T00:56:09.471 INFO:tasks.workunit.client.1.smithi086.stdout:8/591: rmdir dc/d1f/d37/d4f/dac/db8/d8f 39 2024-08-19T00:56:09.473 INFO:tasks.workunit.client.1.smithi086.stdout:0/635: getdents da/d14/d1a/d2e/d43 0 2024-08-19T00:56:09.476 INFO:tasks.workunit.client.1.smithi086.stdout:7/644: rename d3/d5b/ca4 to d3/de/d68/d72/cd8 0 2024-08-19T00:56:09.476 INFO:tasks.workunit.client.1.smithi086.stdout:5/621: dwrite d0/d5f/d60/d57/f69 [4194304,4194304] 0 2024-08-19T00:56:09.479 INFO:tasks.workunit.client.1.smithi086.stdout:2/612: dwrite d8/d14/f22 [0,4194304] 0 2024-08-19T00:56:09.480 INFO:tasks.workunit.client.0.smithi017.stdout:4/185: rename d2/d1a/fe to d2/f3c 0 2024-08-19T00:56:09.483 INFO:tasks.workunit.client.0.smithi017.stdout:9/205: fdatasync d0/d33/f2e 0 2024-08-19T00:56:09.484 INFO:tasks.workunit.client.0.smithi017.stdout:9/206: chown d0/fc 25912 1 2024-08-19T00:56:09.485 INFO:tasks.workunit.client.0.smithi017.stdout:7/230: mknod d3/dc/df/d3d/c41 0 2024-08-19T00:56:09.486 INFO:tasks.workunit.client.0.smithi017.stdout:1/181: creat d4/dc/f38 x:0 0 0 2024-08-19T00:56:09.487 INFO:tasks.workunit.client.0.smithi017.stdout:1/182: fdatasync d4/d1c/f2b 0 2024-08-19T00:56:09.488 INFO:tasks.workunit.client.1.smithi086.stdout:0/636: dread da/d14/f41 [0,4194304] 0 2024-08-19T00:56:09.490 INFO:tasks.workunit.client.1.smithi086.stdout:4/592: rename d2/d18/fc0 to d2/d18/d33/d42/d72/d78/d9e/fcb 0 2024-08-19T00:56:09.492 INFO:tasks.workunit.client.1.smithi086.stdout:7/645: fsync d3/d34/d44/d58/d4b/da5/f56 0 2024-08-19T00:56:09.493 INFO:tasks.workunit.client.1.smithi086.stdout:5/622: dwrite d0/df/d1f/d65/fb8 [0,4194304] 0 2024-08-19T00:56:09.494 INFO:tasks.workunit.client.0.smithi017.stdout:9/207: truncate d0/f14 3802455 0 2024-08-19T00:56:09.495 INFO:tasks.workunit.client.1.smithi086.stdout:2/613: read d8/ff [737586,113027] 0 2024-08-19T00:56:09.495 INFO:tasks.workunit.client.1.smithi086.stdout:4/593: chown d2/d18/d33/d42/d72/d78/d2c/dbc/fc3 22563 1 2024-08-19T00:56:09.496 INFO:tasks.workunit.client.0.smithi017.stdout:7/231: rmdir d3/dc/df/d37 39 2024-08-19T00:56:09.497 INFO:tasks.workunit.client.1.smithi086.stdout:2/614: readlink d8/d24/d32/l3a 0 2024-08-19T00:56:09.498 INFO:tasks.workunit.client.1.smithi086.stdout:8/592: dwrite dc/d16/d18/fa6 [0,4194304] 0 2024-08-19T00:56:09.499 INFO:tasks.workunit.client.1.smithi086.stdout:4/594: chown d2/d18/d33/d42/d72/f70 211318578 1 2024-08-19T00:56:09.500 INFO:tasks.workunit.client.0.smithi017.stdout:9/208: symlink d0/d33/l3c 0 2024-08-19T00:56:09.501 INFO:tasks.workunit.client.0.smithi017.stdout:9/209: read - d0/d33/d22/f2f zero size 2024-08-19T00:56:09.503 INFO:tasks.workunit.client.0.smithi017.stdout:7/232: rename d3/f25 to d3/d3c/f42 0 2024-08-19T00:56:09.505 INFO:tasks.workunit.client.0.smithi017.stdout:7/233: write d3/dc/df/d1c/d2c/d2f/f3a [361032,98603] 0 2024-08-19T00:56:09.505 INFO:tasks.workunit.client.1.smithi086.stdout:9/647: write db/d26/d5c/d87/f42 [993981,41371] 0 2024-08-19T00:56:09.505 INFO:tasks.workunit.client.1.smithi086.stdout:3/632: sync 2024-08-19T00:56:09.505 INFO:tasks.workunit.client.1.smithi086.stdout:1/720: sync 2024-08-19T00:56:09.506 INFO:tasks.workunit.client.0.smithi017.stdout:1/183: symlink d4/l39 0 2024-08-19T00:56:09.507 INFO:tasks.workunit.client.1.smithi086.stdout:6/614: write db/d34/d39/f48 [733383,102740] 0 2024-08-19T00:56:09.508 INFO:tasks.workunit.client.0.smithi017.stdout:7/234: dread d3/dc/f1f [0,4194304] 0 2024-08-19T00:56:09.508 INFO:tasks.workunit.client.1.smithi086.stdout:8/593: dread dc/d16/d18/d29/d2e/d28/f45 [0,4194304] 0 2024-08-19T00:56:09.508 INFO:tasks.workunit.client.1.smithi086.stdout:2/615: dwrite d8/d24/d32/d4d/d6a/fb2 [0,4194304] 0 2024-08-19T00:56:09.509 INFO:tasks.workunit.client.1.smithi086.stdout:5/623: mkdir d0/d8/d10/dbb 0 2024-08-19T00:56:09.510 INFO:tasks.workunit.client.0.smithi017.stdout:8/108: sync 2024-08-19T00:56:09.510 INFO:tasks.workunit.client.0.smithi017.stdout:9/210: unlink d0/f19 0 2024-08-19T00:56:09.511 INFO:tasks.workunit.client.1.smithi086.stdout:1/721: chown d4/d7/d2a/d36/d50/d9c/f9e 1942 1 2024-08-19T00:56:09.514 INFO:tasks.workunit.client.0.smithi017.stdout:8/109: dread fa [0,4194304] 0 2024-08-19T00:56:09.519 INFO:tasks.workunit.client.1.smithi086.stdout:9/648: dwrite db/d26/d5c/d87/fc0 [0,4194304] 0 2024-08-19T00:56:09.522 INFO:tasks.workunit.client.0.smithi017.stdout:4/186: dwrite d2/d21/f3a [4194304,4194304] 0 2024-08-19T00:56:09.526 INFO:tasks.workunit.client.1.smithi086.stdout:0/637: getdents da/d14/d1a/d2e/d7e 0 2024-08-19T00:56:09.526 INFO:tasks.workunit.client.1.smithi086.stdout:5/624: dwrite d0/df/d1f/fb3 [0,4194304] 0 2024-08-19T00:56:09.527 INFO:tasks.workunit.client.1.smithi086.stdout:8/594: dwrite dc/d16/d18/f76 [0,4194304] 0 2024-08-19T00:56:09.527 INFO:tasks.workunit.client.1.smithi086.stdout:9/649: fsync db/d96/fb4 0 2024-08-19T00:56:09.529 INFO:tasks.workunit.client.1.smithi086.stdout:3/633: creat d3/d18/d19/dbc/db8/dc9/fcf x:0 0 0 2024-08-19T00:56:09.530 INFO:tasks.workunit.client.0.smithi017.stdout:9/211: symlink d0/d33/l3d 0 2024-08-19T00:56:09.530 INFO:tasks.workunit.client.0.smithi017.stdout:9/212: read d0/f3a [514741,45013] 0 2024-08-19T00:56:09.532 INFO:tasks.workunit.client.1.smithi086.stdout:6/615: symlink db/d8e/lc5 0 2024-08-19T00:56:09.534 INFO:tasks.workunit.client.1.smithi086.stdout:1/722: dwrite d4/d7/d2a/d36/d50/f62 [0,4194304] 0 2024-08-19T00:56:09.535 INFO:tasks.workunit.client.1.smithi086.stdout:2/616: creat d8/d2c/d38/d80/fce x:0 0 0 2024-08-19T00:56:09.538 INFO:tasks.workunit.client.0.smithi017.stdout:1/184: symlink d4/d1c/l3a 0 2024-08-19T00:56:09.539 INFO:tasks.workunit.client.0.smithi017.stdout:1/185: dread - d4/dc/f38 zero size 2024-08-19T00:56:09.539 INFO:tasks.workunit.client.0.smithi017.stdout:7/235: dread d3/dc/df/d1c/d2c/d2f/f3a [0,4194304] 0 2024-08-19T00:56:09.539 INFO:tasks.workunit.client.1.smithi086.stdout:7/646: truncate d3/de/d68/d7d/fa7 1937911 0 2024-08-19T00:56:09.540 INFO:tasks.workunit.client.1.smithi086.stdout:4/595: write d2/d18/d33/d42/d72/d78/d25/d55/d6c/f9c [3814319,103264] 0 2024-08-19T00:56:09.540 INFO:tasks.workunit.client.0.smithi017.stdout:4/187: creat d2/d1a/f3d x:0 0 0 2024-08-19T00:56:09.541 INFO:tasks.workunit.client.0.smithi017.stdout:7/236: write d3/f4 [6037851,12572] 0 2024-08-19T00:56:09.545 INFO:tasks.workunit.client.1.smithi086.stdout:1/723: fsync d4/d7/d2a/d36/d3a/d41/f4b 0 2024-08-19T00:56:09.547 INFO:tasks.workunit.client.1.smithi086.stdout:5/625: dwrite d0/df/d1f/d33/f3d [0,4194304] 0 2024-08-19T00:56:09.550 INFO:tasks.workunit.client.1.smithi086.stdout:8/595: mknod dc/d1f/d37/cba 0 2024-08-19T00:56:09.550 INFO:tasks.workunit.client.1.smithi086.stdout:6/616: dwrite db/d37/d41/f83 [8388608,4194304] 0 2024-08-19T00:56:09.552 INFO:tasks.workunit.client.1.smithi086.stdout:6/617: chown db/d37/d28/c5b 11890 1 2024-08-19T00:56:09.554 INFO:tasks.workunit.client.1.smithi086.stdout:3/634: mknod d3/d18/d61/d85/cd0 0 2024-08-19T00:56:09.554 INFO:tasks.workunit.client.0.smithi017.stdout:8/110: truncate f0 7423124 0 2024-08-19T00:56:09.555 INFO:tasks.workunit.client.1.smithi086.stdout:9/650: creat db/d26/d5c/d87/d6d/d9f/fd2 x:0 0 0 2024-08-19T00:56:09.557 INFO:tasks.workunit.client.0.smithi017.stdout:1/186: rmdir d4/dc/d17/d1d 39 2024-08-19T00:56:09.559 INFO:tasks.workunit.client.0.smithi017.stdout:2/236: sync 2024-08-19T00:56:09.559 INFO:tasks.workunit.client.1.smithi086.stdout:2/617: mkdir d8/d24/d32/d4d/d6a/db1/dcf 0 2024-08-19T00:56:09.561 INFO:tasks.workunit.client.0.smithi017.stdout:7/237: creat d3/d3c/f43 x:0 0 0 2024-08-19T00:56:09.562 INFO:tasks.workunit.client.1.smithi086.stdout:4/596: creat d2/d18/d33/d42/d72/d8f/fcc x:0 0 0 2024-08-19T00:56:09.564 INFO:tasks.workunit.client.1.smithi086.stdout:0/638: write da/d14/d44/d49/f4d [649984,12047] 0 2024-08-19T00:56:09.567 INFO:tasks.workunit.client.0.smithi017.stdout:2/237: dwrite d2/d7/dd/f2f [0,4194304] 0 2024-08-19T00:56:09.567 INFO:tasks.workunit.client.0.smithi017.stdout:9/213: creat d0/d33/d22/d36/f3e x:0 0 0 2024-08-19T00:56:09.567 INFO:tasks.workunit.client.1.smithi086.stdout:1/724: dread - d4/d7/fa0 zero size 2024-08-19T00:56:09.571 INFO:tasks.workunit.client.1.smithi086.stdout:5/626: rename d0/d5f/d60/l71 to d0/d99/da2/lbc 0 2024-08-19T00:56:09.575 INFO:tasks.workunit.client.0.smithi017.stdout:2/238: dwrite d2/d7/d10/f47 [0,4194304] 0 2024-08-19T00:56:09.576 INFO:tasks.workunit.client.1.smithi086.stdout:6/618: unlink db/d37/d28/l74 0 2024-08-19T00:56:09.576 INFO:tasks.workunit.client.0.smithi017.stdout:7/238: fdatasync d3/d3c/f42 0 2024-08-19T00:56:09.577 INFO:tasks.workunit.client.1.smithi086.stdout:1/725: dwrite d4/d10/d90/d98/faa [0,4194304] 0 2024-08-19T00:56:09.578 INFO:tasks.workunit.client.1.smithi086.stdout:2/618: dread d8/f1f [4194304,4194304] 0 2024-08-19T00:56:09.579 INFO:tasks.workunit.client.1.smithi086.stdout:3/635: truncate d3/d18/d27/d49/f35 809633 0 2024-08-19T00:56:09.580 INFO:tasks.workunit.client.1.smithi086.stdout:9/651: rmdir db/d26/d5c/d87/d30 39 2024-08-19T00:56:09.584 INFO:tasks.workunit.client.1.smithi086.stdout:7/647: mkdir d3/dd9 0 2024-08-19T00:56:09.585 INFO:tasks.workunit.client.0.smithi017.stdout:4/188: rename d2/d21/f3a to d2/d1a/d39/f3e 0 2024-08-19T00:56:09.585 INFO:tasks.workunit.client.1.smithi086.stdout:6/619: dwrite db/f46 [4194304,4194304] 0 2024-08-19T00:56:09.586 INFO:tasks.workunit.client.0.smithi017.stdout:7/239: dwrite d3/d3c/f42 [0,4194304] 0 2024-08-19T00:56:09.587 INFO:tasks.workunit.client.0.smithi017.stdout:9/214: symlink d0/d33/l3f 0 2024-08-19T00:56:09.589 INFO:tasks.workunit.client.0.smithi017.stdout:7/240: write d3/dc/df/d1c/f3e [1157515,24796] 0 2024-08-19T00:56:09.590 INFO:tasks.workunit.client.0.smithi017.stdout:8/111: unlink de/d15/c19 0 2024-08-19T00:56:09.591 INFO:tasks.workunit.client.0.smithi017.stdout:7/241: write d3/dc/df/d23/f24 [1083225,24837] 0 2024-08-19T00:56:09.592 INFO:tasks.workunit.client.0.smithi017.stdout:7/242: chown d3 153810 1 2024-08-19T00:56:09.594 INFO:tasks.workunit.client.0.smithi017.stdout:7/243: fsync d3/dc/df/d1a/f3b 0 2024-08-19T00:56:09.594 INFO:tasks.workunit.client.1.smithi086.stdout:6/620: dwrite db/d37/d44/d5a/d78/fc4 [0,4194304] 0 2024-08-19T00:56:09.598 INFO:tasks.workunit.client.0.smithi017.stdout:1/187: mkdir d4/dc/d3b 0 2024-08-19T00:56:09.598 INFO:tasks.workunit.client.1.smithi086.stdout:8/596: mkdir dc/d17/d1e/d55/dbb 0 2024-08-19T00:56:09.601 INFO:tasks.workunit.client.0.smithi017.stdout:2/239: symlink d2/l4c 0 2024-08-19T00:56:09.613 INFO:tasks.workunit.client.0.smithi017.stdout:4/189: unlink d2/d1a/d39/f3e 0 2024-08-19T00:56:09.614 INFO:tasks.workunit.client.0.smithi017.stdout:4/190: write d2/d1a/d20/f3b [911782,58989] 0 2024-08-19T00:56:09.615 INFO:tasks.workunit.client.0.smithi017.stdout:4/191: chown d2/d1a/d39 37 1 2024-08-19T00:56:09.618 INFO:tasks.workunit.client.1.smithi086.stdout:7/648: dread d3/d34/d44/d58/d4b/da5/f9b [0,4194304] 0 2024-08-19T00:56:09.620 INFO:tasks.workunit.client.0.smithi017.stdout:9/215: mkdir d0/d33/d22/d40 0 2024-08-19T00:56:09.623 INFO:tasks.workunit.client.1.smithi086.stdout:3/636: dread d3/d9/f15 [0,4194304] 0 2024-08-19T00:56:09.623 INFO:tasks.workunit.client.1.smithi086.stdout:4/597: dwrite d2/d18/d33/d42/d72/d2f/dc4/f9b [0,4194304] 0 2024-08-19T00:56:09.624 INFO:tasks.workunit.client.0.smithi017.stdout:7/244: mknod d3/dc/df/c44 0 2024-08-19T00:56:09.624 INFO:tasks.workunit.client.1.smithi086.stdout:3/637: dread - d3/d26/fbd zero size 2024-08-19T00:56:09.627 INFO:tasks.workunit.client.1.smithi086.stdout:1/726: creat d4/d7/d2a/d36/d63/d84/dda/fee x:0 0 0 2024-08-19T00:56:09.629 INFO:tasks.workunit.client.0.smithi017.stdout:9/216: dwrite d0/d33/d22/f2f [0,4194304] 0 2024-08-19T00:56:09.629 INFO:tasks.workunit.client.0.smithi017.stdout:1/188: creat d4/dc/d17/d1d/f3c x:0 0 0 2024-08-19T00:56:09.630 INFO:tasks.workunit.client.0.smithi017.stdout:1/189: readlink d4/l39 0 2024-08-19T00:56:09.636 INFO:tasks.workunit.client.1.smithi086.stdout:8/597: write dc/f36 [7924141,76363] 0 2024-08-19T00:56:09.638 INFO:tasks.workunit.client.1.smithi086.stdout:2/619: creat d8/d43/fd0 x:0 0 0 2024-08-19T00:56:09.638 INFO:tasks.workunit.client.1.smithi086.stdout:2/620: write d8/d14/f75 [985812,72458] 0 2024-08-19T00:56:09.640 INFO:tasks.workunit.client.0.smithi017.stdout:9/217: mknod d0/d33/d22/d36/c41 0 2024-08-19T00:56:09.641 INFO:tasks.workunit.client.0.smithi017.stdout:9/218: readlink d0/d33/l3d 0 2024-08-19T00:56:09.643 INFO:tasks.workunit.client.1.smithi086.stdout:9/652: creat db/d96/fd3 x:0 0 0 2024-08-19T00:56:09.645 INFO:tasks.workunit.client.0.smithi017.stdout:2/240: dread d2/d7/d10/f25 [0,4194304] 0 2024-08-19T00:56:09.648 INFO:tasks.workunit.client.1.smithi086.stdout:4/598: dread d2/d18/d33/d42/d72/d78/d25/d55/f3d [0,4194304] 0 2024-08-19T00:56:09.650 INFO:tasks.workunit.client.1.smithi086.stdout:7/649: rmdir d3/d34/d44/d58/d4b/da5/daf 39 2024-08-19T00:56:09.652 INFO:tasks.workunit.client.1.smithi086.stdout:8/598: creat dc/d1f/fbc x:0 0 0 2024-08-19T00:56:09.652 INFO:tasks.workunit.client.0.smithi017.stdout:7/245: link d3/dc/df/d1a/l1b d3/dc/df/d1c/d2c/d2f/l45 0 2024-08-19T00:56:09.653 INFO:tasks.workunit.client.0.smithi017.stdout:4/192: write d2/d27/f37 [475075,107689] 0 2024-08-19T00:56:09.655 INFO:tasks.workunit.client.0.smithi017.stdout:2/241: creat d2/d7/d10/d35/d45/f4d x:0 0 0 2024-08-19T00:56:09.655 INFO:tasks.workunit.client.1.smithi086.stdout:9/653: chown db/d26/d5c/d87/f54 298045 1 2024-08-19T00:56:09.656 INFO:tasks.workunit.client.1.smithi086.stdout:3/638: getdents d3/d18/d19/dbc/db8/dc1 0 2024-08-19T00:56:09.656 INFO:tasks.workunit.client.1.smithi086.stdout:3/639: chown d3/d26/f7e 35153 1 2024-08-19T00:56:09.657 INFO:tasks.workunit.client.0.smithi017.stdout:7/246: write d3/dc/df/d23/f3f [489863,3550] 0 2024-08-19T00:56:09.657 INFO:tasks.workunit.client.1.smithi086.stdout:1/727: truncate d4/d7/d2a/d36/d50/f9d 1386625 0 2024-08-19T00:56:09.658 INFO:tasks.workunit.client.0.smithi017.stdout:1/190: dwrite d4/d1c/f25 [4194304,4194304] 0 2024-08-19T00:56:09.658 INFO:tasks.workunit.client.1.smithi086.stdout:4/599: mkdir d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd 0 2024-08-19T00:56:09.659 INFO:tasks.workunit.client.0.smithi017.stdout:7/247: fdatasync d3/dc/df/d23/f26 0 2024-08-19T00:56:09.660 INFO:tasks.workunit.client.0.smithi017.stdout:4/193: creat d2/d16/f3f x:0 0 0 2024-08-19T00:56:09.660 INFO:tasks.workunit.client.0.smithi017.stdout:1/191: read - d4/dc/f38 zero size 2024-08-19T00:56:09.660 INFO:tasks.workunit.client.1.smithi086.stdout:7/650: creat d3/de/d68/d72/d7e/dca/dcb/fda x:0 0 0 2024-08-19T00:56:09.663 INFO:tasks.workunit.client.1.smithi086.stdout:8/599: rename dc/f36 to dc/d1f/d37/d4f/dac/fbd 0 2024-08-19T00:56:09.667 INFO:tasks.workunit.client.1.smithi086.stdout:9/654: rmdir db/d96 39 2024-08-19T00:56:09.669 INFO:tasks.workunit.client.0.smithi017.stdout:4/194: mkdir d2/d21/d40 0 2024-08-19T00:56:09.670 INFO:tasks.workunit.client.1.smithi086.stdout:6/621: sync 2024-08-19T00:56:09.671 INFO:tasks.workunit.client.1.smithi086.stdout:5/627: sync 2024-08-19T00:56:09.671 INFO:tasks.workunit.client.1.smithi086.stdout:0/639: sync 2024-08-19T00:56:09.671 INFO:tasks.workunit.client.1.smithi086.stdout:3/640: unlink d3/d26/d2b/fce 0 2024-08-19T00:56:09.672 INFO:tasks.workunit.client.1.smithi086.stdout:5/628: chown d0/d8/d72/l7f 441801 1 2024-08-19T00:56:09.673 INFO:tasks.workunit.client.1.smithi086.stdout:6/622: write db/d34/d39/d76/fb5 [517279,90104] 0 2024-08-19T00:56:09.673 INFO:tasks.workunit.client.1.smithi086.stdout:3/641: stat d3/d18/d1a/d51/d9b 0 2024-08-19T00:56:09.673 INFO:tasks.workunit.client.1.smithi086.stdout:1/728: mknod d4/d7/d2a/d36/d63/d84/d8e/cef 0 2024-08-19T00:56:09.674 INFO:tasks.workunit.client.1.smithi086.stdout:6/623: write db/d37/d30/f85 [1914182,130990] 0 2024-08-19T00:56:09.675 INFO:tasks.workunit.client.1.smithi086.stdout:4/600: mkdir d2/d18/d33/d42/d72/d78/d25/d30/d5d/dce 0 2024-08-19T00:56:09.679 INFO:tasks.workunit.client.0.smithi017.stdout:4/195: unlink d2/d27/f37 0 2024-08-19T00:56:09.680 INFO:tasks.workunit.client.1.smithi086.stdout:2/621: dwrite d8/f1e [0,4194304] 0 2024-08-19T00:56:09.680 INFO:tasks.workunit.client.0.smithi017.stdout:4/196: write d2/d1a/f3d [663120,1733] 0 2024-08-19T00:56:09.681 INFO:tasks.workunit.client.0.smithi017.stdout:7/248: mkdir d3/dc/df/d37/d46 0 2024-08-19T00:56:09.683 INFO:tasks.workunit.client.0.smithi017.stdout:1/192: mkdir d4/dc/d3b/d3d 0 2024-08-19T00:56:09.683 INFO:tasks.workunit.client.0.smithi017.stdout:2/242: truncate d2/d7/f21 3873568 0 2024-08-19T00:56:09.685 INFO:tasks.workunit.client.1.smithi086.stdout:9/655: stat db/d26/d5c/d87/d30/d58/fc6 0 2024-08-19T00:56:09.686 INFO:tasks.workunit.client.1.smithi086.stdout:9/656: stat db/d26/d5c/d87/d37/f91 0 2024-08-19T00:56:09.689 INFO:tasks.workunit.client.1.smithi086.stdout:3/642: unlink d3/d18/d1a/f6c 0 2024-08-19T00:56:09.691 INFO:tasks.workunit.client.1.smithi086.stdout:1/729: readlink d4/d7/d2a/d36/l38 0 2024-08-19T00:56:09.691 INFO:tasks.workunit.client.0.smithi017.stdout:7/249: symlink d3/dc/df/l47 0 2024-08-19T00:56:09.692 INFO:tasks.workunit.client.1.smithi086.stdout:9/657: dwrite db/d26/d5c/d87/d30/d32/d44/d67/f90 [4194304,4194304] 0 2024-08-19T00:56:09.692 INFO:tasks.workunit.client.1.smithi086.stdout:5/629: creat d0/d2d/d43/d91/fbd x:0 0 0 2024-08-19T00:56:09.693 INFO:tasks.workunit.client.1.smithi086.stdout:6/624: mkdir db/d34/d39/d76/dc6 0 2024-08-19T00:56:09.694 INFO:tasks.workunit.client.0.smithi017.stdout:1/193: dwrite d4/d1c/f2b [0,4194304] 0 2024-08-19T00:56:09.694 INFO:tasks.workunit.client.1.smithi086.stdout:7/651: mknod d3/dd9/cdb 0 2024-08-19T00:56:09.696 INFO:tasks.workunit.client.1.smithi086.stdout:3/643: dread d3/d26/f73 [0,4194304] 0 2024-08-19T00:56:09.697 INFO:tasks.workunit.client.0.smithi017.stdout:7/250: creat d3/dc/f48 x:0 0 0 2024-08-19T00:56:09.697 INFO:tasks.workunit.client.0.smithi017.stdout:1/194: read - d4/d1c/f32 zero size 2024-08-19T00:56:09.699 INFO:tasks.workunit.client.0.smithi017.stdout:2/243: dwrite d2/d7/d10/f25 [0,4194304] 0 2024-08-19T00:56:09.703 INFO:tasks.workunit.client.1.smithi086.stdout:8/600: creat dc/d17/d1e/d55/dbb/fbe x:0 0 0 2024-08-19T00:56:09.705 INFO:tasks.workunit.client.1.smithi086.stdout:4/601: dread d2/d18/d33/d42/d72/d78/d25/d55/d6c/f9c [0,4194304] 0 2024-08-19T00:56:09.707 INFO:tasks.workunit.client.1.smithi086.stdout:2/622: dread d8/d43/f5a [0,4194304] 0 2024-08-19T00:56:09.707 INFO:tasks.workunit.client.0.smithi017.stdout:4/197: dwrite d2/d11/f14 [0,4194304] 0 2024-08-19T00:56:09.712 INFO:tasks.workunit.client.1.smithi086.stdout:8/601: dwrite dc/d1f/d37/f72 [0,4194304] 0 2024-08-19T00:56:09.715 INFO:tasks.workunit.client.1.smithi086.stdout:1/730: mkdir d4/d7/d2a/d36/d3a/de5/d7a/db4/df0 0 2024-08-19T00:56:09.716 INFO:tasks.workunit.client.0.smithi017.stdout:7/251: dwrite d3/d3c/f43 [0,4194304] 0 2024-08-19T00:56:09.717 INFO:tasks.workunit.client.1.smithi086.stdout:9/658: dwrite db/d96/da7/f85 [0,4194304] 0 2024-08-19T00:56:09.720 INFO:tasks.workunit.client.0.smithi017.stdout:7/252: stat d3/dc/df 0 2024-08-19T00:56:09.720 INFO:tasks.workunit.client.0.smithi017.stdout:2/244: dwrite d2/d7/dd/f15 [0,4194304] 0 2024-08-19T00:56:09.728 INFO:tasks.workunit.client.1.smithi086.stdout:6/625: mknod db/d34/d4e/d68/d89/cc7 0 2024-08-19T00:56:09.730 INFO:tasks.workunit.client.0.smithi017.stdout:4/198: creat d2/d21/d40/f41 x:0 0 0 2024-08-19T00:56:09.731 INFO:tasks.workunit.client.1.smithi086.stdout:3/644: symlink d3/d18/d19/dbc/ld1 0 2024-08-19T00:56:09.732 INFO:tasks.workunit.client.1.smithi086.stdout:7/652: readlink d3/d34/d44/d58/d4b/l63 0 2024-08-19T00:56:09.732 INFO:tasks.workunit.client.0.smithi017.stdout:4/199: readlink d2/d16/l19 0 2024-08-19T00:56:09.737 INFO:tasks.workunit.client.1.smithi086.stdout:6/626: dwrite db/d37/d41/f83 [0,4194304] 0 2024-08-19T00:56:09.738 INFO:tasks.workunit.client.0.smithi017.stdout:7/253: dwrite d3/dc/df/d1c/f3e [4194304,4194304] 0 2024-08-19T00:56:09.739 INFO:tasks.workunit.client.0.smithi017.stdout:2/245: dwrite d2/d7/dd/f15 [0,4194304] 0 2024-08-19T00:56:09.740 INFO:tasks.workunit.client.0.smithi017.stdout:1/195: dread d4/dc/f11 [0,4194304] 0 2024-08-19T00:56:09.740 INFO:tasks.workunit.client.1.smithi086.stdout:6/627: chown db/d34/l6f 130 1 2024-08-19T00:56:09.742 INFO:tasks.workunit.client.1.smithi086.stdout:4/602: creat d2/d18/d33/d42/d72/d78/d25/d55/d4d/fcf x:0 0 0 2024-08-19T00:56:09.742 INFO:tasks.workunit.client.1.smithi086.stdout:8/602: stat dc/d16/d18/d29/d2e/f61 0 2024-08-19T00:56:09.744 INFO:tasks.workunit.client.1.smithi086.stdout:1/731: read - d4/d7/d2a/d36/d3a/d41/f68 zero size 2024-08-19T00:56:09.745 INFO:tasks.workunit.client.1.smithi086.stdout:3/645: dwrite d3/d9/fb2 [0,4194304] 0 2024-08-19T00:56:09.747 INFO:tasks.workunit.client.0.smithi017.stdout:7/254: unlink d3/dc/df/d1c/d2c/d2f/f3a 0 2024-08-19T00:56:09.751 INFO:tasks.workunit.client.1.smithi086.stdout:5/630: creat d0/d5f/d60/d57/d80/d9e/fbe x:0 0 0 2024-08-19T00:56:09.754 INFO:tasks.workunit.client.0.smithi017.stdout:2/246: creat d2/d7/dd/f4e x:0 0 0 2024-08-19T00:56:09.754 INFO:tasks.workunit.client.0.smithi017.stdout:4/200: write d2/fc [4564171,91751] 0 2024-08-19T00:56:09.755 INFO:tasks.workunit.client.1.smithi086.stdout:6/628: dwrite db/d34/d69/f75 [0,4194304] 0 2024-08-19T00:56:09.756 INFO:tasks.workunit.client.1.smithi086.stdout:6/629: chown db/d34/l81 11 1 2024-08-19T00:56:09.757 INFO:tasks.workunit.client.0.smithi017.stdout:1/196: write d4/dc/f18 [638215,11579] 0 2024-08-19T00:56:09.757 INFO:tasks.workunit.client.1.smithi086.stdout:7/653: symlink d3/d5b/ldc 0 2024-08-19T00:56:09.758 INFO:tasks.workunit.client.1.smithi086.stdout:0/640: getdents da/d14/d1a/d2e/d66 0 2024-08-19T00:56:09.813 INFO:tasks.workunit.client.1.smithi086.stdout:2/623: sync 2024-08-19T00:56:09.862 INFO:tasks.workunit.client.0.smithi017.stdout:6/171: sync 2024-08-19T00:56:09.862 INFO:tasks.workunit.client.0.smithi017.stdout:3/249: sync 2024-08-19T00:56:09.862 INFO:tasks.workunit.client.0.smithi017.stdout:0/180: sync 2024-08-19T00:56:09.862 INFO:tasks.workunit.client.0.smithi017.stdout:5/163: sync 2024-08-19T00:56:09.863 INFO:tasks.workunit.client.0.smithi017.stdout:3/250: dread - d5/da/f48 zero size 2024-08-19T00:56:09.866 INFO:tasks.workunit.client.0.smithi017.stdout:4/201: creat d2/d21/f42 x:0 0 0 2024-08-19T00:56:09.867 INFO:tasks.workunit.client.0.smithi017.stdout:4/202: fdatasync d2/d21/d40/f41 0 2024-08-19T00:56:09.868 INFO:tasks.workunit.client.1.smithi086.stdout:8/603: mkdir dc/d1f/d37/d4f/dac/db8/d7a/d9b/dbf 0 2024-08-19T00:56:09.869 INFO:tasks.workunit.client.0.smithi017.stdout:3/251: dread d5/d11/f3e [0,4194304] 0 2024-08-19T00:56:09.871 INFO:tasks.workunit.client.1.smithi086.stdout:1/732: fdatasync d4/d7/d2a/d36/d3a/f72 0 2024-08-19T00:56:09.873 INFO:tasks.workunit.client.1.smithi086.stdout:1/733: chown d4/d7/d2a/d36/d50/d9c/f9e 50157227 1 2024-08-19T00:56:09.873 INFO:tasks.workunit.client.1.smithi086.stdout:4/603: dwrite d2/f26 [4194304,4194304] 0 2024-08-19T00:56:09.874 INFO:tasks.workunit.client.1.smithi086.stdout:5/631: truncate d0/d2d/d4f/f74 1290039 0 2024-08-19T00:56:09.875 INFO:tasks.workunit.client.1.smithi086.stdout:6/630: mknod db/d37/d41/da7/cc8 0 2024-08-19T00:56:09.876 INFO:tasks.workunit.client.1.smithi086.stdout:6/631: chown db/d8e/fb0 3773 1 2024-08-19T00:56:09.877 INFO:tasks.workunit.client.0.smithi017.stdout:3/252: dwrite d5/da/fd [4194304,4194304] 0 2024-08-19T00:56:09.877 INFO:tasks.workunit.client.1.smithi086.stdout:6/632: write db/f2b [1724760,89227] 0 2024-08-19T00:56:09.877 INFO:tasks.workunit.client.1.smithi086.stdout:4/604: read d2/d18/d33/d42/d72/d78/d25/d55/f4a [3016352,112141] 0 2024-08-19T00:56:09.878 INFO:tasks.workunit.client.1.smithi086.stdout:4/605: write d2/d18/d33/d42/d72/f16 [1009987,66777] 0 2024-08-19T00:56:09.879 INFO:tasks.workunit.client.0.smithi017.stdout:5/164: rename db/d19/d1f/d15/f2f to db/d19/d1f/d15/d1e/f3f 0 2024-08-19T00:56:09.881 INFO:tasks.workunit.client.1.smithi086.stdout:7/654: symlink d3/de/d68/d72/ldd 0 2024-08-19T00:56:09.882 INFO:tasks.workunit.client.1.smithi086.stdout:7/655: chown d3/d5b/l8b 77 1 2024-08-19T00:56:09.884 INFO:tasks.workunit.client.1.smithi086.stdout:0/641: chown da/d14/d44/lc9 2227840 1 2024-08-19T00:56:09.886 INFO:tasks.workunit.client.0.smithi017.stdout:3/253: dwrite d5/da/fd [4194304,4194304] 0 2024-08-19T00:56:09.886 INFO:tasks.workunit.client.0.smithi017.stdout:4/203: chown d2/d27/c2b 17 1 2024-08-19T00:56:09.887 INFO:tasks.workunit.client.1.smithi086.stdout:2/624: rmdir d8/d2c/d38/d80/db4/db7 39 2024-08-19T00:56:09.887 INFO:tasks.workunit.client.1.smithi086.stdout:2/625: stat d8/d2c/d38/d80 0 2024-08-19T00:56:09.888 INFO:tasks.workunit.client.1.smithi086.stdout:2/626: chown d8/d43/d77 62314618 1 2024-08-19T00:56:09.888 INFO:tasks.workunit.client.0.smithi017.stdout:3/254: write d5/d11/f2f [954925,84765] 0 2024-08-19T00:56:09.889 INFO:tasks.workunit.client.0.smithi017.stdout:4/204: fsync d2/d11/f36 0 2024-08-19T00:56:09.889 INFO:tasks.workunit.client.0.smithi017.stdout:4/205: write d2/d16/f3f [198324,21026] 0 2024-08-19T00:56:09.890 INFO:tasks.workunit.client.0.smithi017.stdout:4/206: chown d2/d1a/lf 2254468 1 2024-08-19T00:56:09.892 INFO:tasks.workunit.client.0.smithi017.stdout:1/197: write d4/ff [1933558,110059] 0 2024-08-19T00:56:09.896 INFO:tasks.workunit.client.1.smithi086.stdout:1/734: creat d4/d7/d2a/d36/d3a/d41/ff1 x:0 0 0 2024-08-19T00:56:09.900 INFO:tasks.workunit.client.1.smithi086.stdout:6/633: creat db/d37/d30/fc9 x:0 0 0 2024-08-19T00:56:09.902 INFO:tasks.workunit.client.1.smithi086.stdout:7/656: mknod d3/de/d68/d7a/cde 0 2024-08-19T00:56:09.902 INFO:tasks.workunit.client.0.smithi017.stdout:7/255: link d3/dc/df/d1c/d2c/d2f/l45 d3/dc/l49 0 2024-08-19T00:56:09.903 INFO:tasks.workunit.client.0.smithi017.stdout:3/255: readlink d5/l26 0 2024-08-19T00:56:09.904 INFO:tasks.workunit.client.0.smithi017.stdout:3/256: write d5/d18/f45 [1588648,4580] 0 2024-08-19T00:56:09.905 INFO:tasks.workunit.client.0.smithi017.stdout:6/172: creat d5/d13/f3e x:0 0 0 2024-08-19T00:56:09.906 INFO:tasks.workunit.client.1.smithi086.stdout:4/606: write d2/d18/d33/d42/d72/f70 [16881,38564] 0 2024-08-19T00:56:09.906 INFO:tasks.workunit.client.1.smithi086.stdout:2/627: unlink d8/d2c/d67/f6e 0 2024-08-19T00:56:09.907 INFO:tasks.workunit.client.0.smithi017.stdout:4/207: mkdir d2/d16/d43 0 2024-08-19T00:56:09.908 INFO:tasks.workunit.client.1.smithi086.stdout:9/659: getdents db/d96 0 2024-08-19T00:56:09.908 INFO:tasks.workunit.client.0.smithi017.stdout:2/247: getdents d2/d7/d10/d35 0 2024-08-19T00:56:09.909 INFO:tasks.workunit.client.0.smithi017.stdout:2/248: fdatasync d2/d7/d10/d19/f39 0 2024-08-19T00:56:09.910 INFO:tasks.workunit.client.0.smithi017.stdout:1/198: mknod d4/dc/d3b/c3e 0 2024-08-19T00:56:09.911 INFO:tasks.workunit.client.0.smithi017.stdout:0/181: link d5/lf d5/d1b/l3c 0 2024-08-19T00:56:09.911 INFO:tasks.workunit.client.0.smithi017.stdout:0/182: chown d5/d1b 19884753 1 2024-08-19T00:56:09.912 INFO:tasks.workunit.client.0.smithi017.stdout:0/183: fdatasync d5/d18/f24 0 2024-08-19T00:56:09.912 INFO:tasks.workunit.client.0.smithi017.stdout:5/165: mkdir db/d19/d1f/d15/d3e/d40 0 2024-08-19T00:56:09.914 INFO:tasks.workunit.client.1.smithi086.stdout:3/646: rename d3/d26/c95 to d3/d18/cd2 0 2024-08-19T00:56:09.918 INFO:tasks.workunit.client.1.smithi086.stdout:8/604: truncate dc/d16/d18/d29/d2e/d28/d2b/f5f 536596 0 2024-08-19T00:56:09.919 INFO:tasks.workunit.client.0.smithi017.stdout:0/184: dwrite d5/d18/f24 [0,4194304] 0 2024-08-19T00:56:09.920 INFO:tasks.workunit.client.0.smithi017.stdout:6/173: rename d5/d13/d11/d2c/f34 to d5/d13/d11/f3f 0 2024-08-19T00:56:09.924 INFO:tasks.workunit.client.1.smithi086.stdout:7/657: creat d3/d34/d44/d58/d4b/d78/fdf x:0 0 0 2024-08-19T00:56:09.925 INFO:tasks.workunit.client.0.smithi017.stdout:7/256: getdents d3/dc/df/d37/d46 0 2024-08-19T00:56:09.927 INFO:tasks.workunit.client.1.smithi086.stdout:2/628: creat d8/d24/fd1 x:0 0 0 2024-08-19T00:56:09.928 INFO:tasks.workunit.client.1.smithi086.stdout:9/660: write db/dd/d19/d38/f79 [708135,120607] 0 2024-08-19T00:56:09.929 INFO:tasks.workunit.client.1.smithi086.stdout:9/661: dread - db/dd/d19/d18/fcb zero size 2024-08-19T00:56:09.931 INFO:tasks.workunit.client.1.smithi086.stdout:9/662: fsync db/d26/d5c/d87/d37/f91 0 2024-08-19T00:56:09.932 INFO:tasks.workunit.client.1.smithi086.stdout:1/735: dread d4/d7/d2a/d36/d7d/d88/f4a [0,4194304] 0 2024-08-19T00:56:09.932 INFO:tasks.workunit.client.0.smithi017.stdout:2/249: creat d2/d7/d10/d3b/d3c/d4b/f4f x:0 0 0 2024-08-19T00:56:09.933 INFO:tasks.workunit.client.0.smithi017.stdout:2/250: stat d2/d7/d10/d19/cf 0 2024-08-19T00:56:09.933 INFO:tasks.workunit.client.1.smithi086.stdout:6/634: truncate db/f14 5051697 0 2024-08-19T00:56:09.934 INFO:tasks.workunit.client.0.smithi017.stdout:2/251: chown d2/d7/d10/d35 0 1 2024-08-19T00:56:09.935 INFO:tasks.workunit.client.0.smithi017.stdout:1/199: symlink d4/dc/l3f 0 2024-08-19T00:56:09.935 INFO:tasks.workunit.client.1.smithi086.stdout:6/635: chown db/d37/d28/d7f/d96/dc2/lc3 875735 1 2024-08-19T00:56:09.935 INFO:tasks.workunit.client.0.smithi017.stdout:1/200: chown d4/dc/d17/d1d 1934 1 2024-08-19T00:56:09.936 INFO:tasks.workunit.client.1.smithi086.stdout:6/636: fsync db/d37/d41/da7/f8d 0 2024-08-19T00:56:09.937 INFO:tasks.workunit.client.0.smithi017.stdout:5/166: link db/d19/d1f/d15/d1e/f37 db/d19/d1f/d15/d30/f41 0 2024-08-19T00:56:09.940 INFO:tasks.workunit.client.1.smithi086.stdout:7/658: dread d3/d34/d44/d58/d4b/da5/f56 [0,4194304] 0 2024-08-19T00:56:09.940 INFO:tasks.workunit.client.1.smithi086.stdout:4/607: truncate d2/d18/d33/d42/d72/d78/d2c/fa9 516946 0 2024-08-19T00:56:09.942 INFO:tasks.workunit.client.0.smithi017.stdout:7/257: creat d3/dc/df/d1a/f4a x:0 0 0 2024-08-19T00:56:09.943 INFO:tasks.workunit.client.1.smithi086.stdout:2/629: truncate d8/d24/d32/d4d/f7d 5015798 0 2024-08-19T00:56:09.944 INFO:tasks.workunit.client.0.smithi017.stdout:7/258: chown d3/dc/c36 22 1 2024-08-19T00:56:09.944 INFO:tasks.workunit.client.0.smithi017.stdout:7/259: chown d3/f12 55010 1 2024-08-19T00:56:09.952 INFO:tasks.workunit.client.1.smithi086.stdout:5/632: getdents d0/d2d/d43/d4d 0 2024-08-19T00:56:09.957 INFO:tasks.workunit.client.1.smithi086.stdout:8/605: rename dc/d16/d18/d29/d2e/c95 to dc/d17/cc0 0 2024-08-19T00:56:09.957 INFO:tasks.workunit.client.1.smithi086.stdout:2/630: dread d8/d2c/d38/d80/db4/fbd [0,4194304] 0 2024-08-19T00:56:09.959 INFO:tasks.workunit.client.1.smithi086.stdout:2/631: chown d8/d24/d32/d61/fc7 13012880 1 2024-08-19T00:56:09.961 INFO:tasks.workunit.client.1.smithi086.stdout:9/663: unlink db/dd/d19/d38/f79 0 2024-08-19T00:56:09.964 INFO:tasks.workunit.client.0.smithi017.stdout:6/174: rename d5/d13/f24 to d5/f40 0 2024-08-19T00:56:09.964 INFO:tasks.workunit.client.0.smithi017.stdout:0/185: write d5/d17/d26/d30/f38 [728766,97734] 0 2024-08-19T00:56:09.965 INFO:tasks.workunit.client.1.smithi086.stdout:2/632: dwrite d8/d14/f75 [0,4194304] 0 2024-08-19T00:56:09.965 INFO:tasks.workunit.client.0.smithi017.stdout:0/186: chown d5/d17/d21/l31 407 1 2024-08-19T00:56:09.966 INFO:tasks.workunit.client.1.smithi086.stdout:0/642: rename da/d14/d26/l32 to da/d14/d26/lcc 0 2024-08-19T00:56:09.966 INFO:tasks.workunit.client.1.smithi086.stdout:3/647: truncate d3/d18/d27/d76/f7c 2362349 0 2024-08-19T00:56:09.968 INFO:tasks.workunit.client.1.smithi086.stdout:6/637: creat db/d37/d28/d7f/fca x:0 0 0 2024-08-19T00:56:09.969 INFO:tasks.workunit.client.1.smithi086.stdout:2/633: chown d8/d24/d32/d4d/l8a 3992 1 2024-08-19T00:56:09.971 INFO:tasks.workunit.client.1.smithi086.stdout:9/664: dwrite db/d96/fd3 [0,4194304] 0 2024-08-19T00:56:09.971 INFO:tasks.workunit.client.0.smithi017.stdout:6/175: dwrite d5/d13/d20/f27 [0,4194304] 0 2024-08-19T00:56:09.972 INFO:tasks.workunit.client.1.smithi086.stdout:9/665: dread - db/d26/d5c/d87/d6d/d9f/fd2 zero size 2024-08-19T00:56:09.975 INFO:tasks.workunit.client.1.smithi086.stdout:5/633: chown d0/d20/f36 8306 1 2024-08-19T00:56:09.980 INFO:tasks.workunit.client.0.smithi017.stdout:2/252: dwrite d2/d7/d10/d3b/d3c/f40 [0,4194304] 0 2024-08-19T00:56:09.981 INFO:tasks.workunit.client.1.smithi086.stdout:7/659: rename d3/l19 to d3/da1/le0 0 2024-08-19T00:56:09.988 INFO:tasks.workunit.client.0.smithi017.stdout:6/176: unlink f4 0 2024-08-19T00:56:09.990 INFO:tasks.workunit.client.0.smithi017.stdout:6/177: write d5/d13/f3e [367600,5373] 0 2024-08-19T00:56:09.993 INFO:tasks.workunit.client.0.smithi017.stdout:7/260: link d3/dc/l18 d3/dc/df/d37/l4b 0 2024-08-19T00:56:09.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/178: dread d5/d13/f1b [0,4194304] 0 2024-08-19T00:56:09.997 INFO:tasks.workunit.client.0.smithi017.stdout:6/179: chown d5/d13/f3e 5446 1 2024-08-19T00:56:09.998 INFO:tasks.workunit.client.0.smithi017.stdout:2/253: symlink d2/d7/dd/l50 0 2024-08-19T00:56:09.999 INFO:tasks.workunit.client.0.smithi017.stdout:1/201: truncate d4/d1c/f25 4977063 0 2024-08-19T00:56:10.000 INFO:tasks.workunit.client.0.smithi017.stdout:7/261: dread d3/dc/df/d1c/f27 [0,4194304] 0 2024-08-19T00:56:10.001 INFO:tasks.workunit.client.1.smithi086.stdout:1/736: creat d4/d7/d2a/d36/d3a/de5/d7a/db4/df0/ff2 x:0 0 0 2024-08-19T00:56:10.001 INFO:tasks.workunit.client.1.smithi086.stdout:1/737: dread - d4/d7/d2a/d36/d63/d9f/fc8 zero size 2024-08-19T00:56:10.003 INFO:tasks.workunit.client.0.smithi017.stdout:1/202: read d4/f10 [1594046,3753] 0 2024-08-19T00:56:10.003 INFO:tasks.workunit.client.0.smithi017.stdout:5/167: truncate db/d19/d1f/f1c 1203167 0 2024-08-19T00:56:10.007 INFO:tasks.workunit.client.1.smithi086.stdout:0/643: mknod da/d5d/da9/d6a/ccd 0 2024-08-19T00:56:10.008 INFO:tasks.workunit.client.0.smithi017.stdout:2/254: dwrite d2/d7/d29/f34 [4194304,4194304] 0 2024-08-19T00:56:10.009 INFO:tasks.workunit.client.1.smithi086.stdout:0/644: write da/d14/d1a/f54 [7832538,75555] 0 2024-08-19T00:56:10.009 INFO:tasks.workunit.client.1.smithi086.stdout:2/634: dread d8/d84/fcb [0,4194304] 0 2024-08-19T00:56:10.010 INFO:tasks.workunit.client.1.smithi086.stdout:0/645: fdatasync da/d5d/f96 0 2024-08-19T00:56:10.010 INFO:tasks.workunit.client.1.smithi086.stdout:4/608: mkdir d2/d18/d33/d42/d72/dd0 0 2024-08-19T00:56:10.013 INFO:tasks.workunit.client.1.smithi086.stdout:3/648: symlink d3/d26/d2b/d33/d4a/d57/ld3 0 2024-08-19T00:56:10.014 INFO:tasks.workunit.client.0.smithi017.stdout:1/203: dread d4/ff [0,4194304] 0 2024-08-19T00:56:10.019 INFO:tasks.workunit.client.0.smithi017.stdout:5/168: creat db/d19/d33/f42 x:0 0 0 2024-08-19T00:56:10.019 INFO:tasks.workunit.client.0.smithi017.stdout:5/169: chown db/l13 20 1 2024-08-19T00:56:10.022 INFO:tasks.workunit.client.0.smithi017.stdout:6/180: rename d5/d13/d11/d2c/c3a to d5/d13/d11/d2c/c41 0 2024-08-19T00:56:10.027 INFO:tasks.workunit.client.0.smithi017.stdout:7/262: symlink d3/dc/df/d37/d39/l4c 0 2024-08-19T00:56:10.029 INFO:tasks.workunit.client.1.smithi086.stdout:5/634: rename d0/d2d/d43/d4d/c50 to d0/d2d/d43/cbf 0 2024-08-19T00:56:10.029 INFO:tasks.workunit.client.0.smithi017.stdout:1/204: dread d4/f10 [0,4194304] 0 2024-08-19T00:56:10.029 INFO:tasks.workunit.client.1.smithi086.stdout:5/635: stat d0/d5f/c8f 0 2024-08-19T00:56:10.030 INFO:tasks.workunit.client.0.smithi017.stdout:6/181: dwrite d5/f39 [0,4194304] 0 2024-08-19T00:56:10.037 INFO:tasks.workunit.client.1.smithi086.stdout:0/646: creat da/d14/d1a/d2e/d66/fce x:0 0 0 2024-08-19T00:56:10.038 INFO:tasks.workunit.client.0.smithi017.stdout:7/263: chown d3/dc/df/d1c/d2c/d35 84601 1 2024-08-19T00:56:10.039 INFO:tasks.workunit.client.1.smithi086.stdout:4/609: write d2/d18/d33/d42/d72/d78/d25/d55/f3d [2934205,29369] 0 2024-08-19T00:56:10.041 INFO:tasks.workunit.client.1.smithi086.stdout:3/649: mkdir d3/d18/d19/dbc/db8/dc9/dd4 0 2024-08-19T00:56:10.042 INFO:tasks.workunit.client.0.smithi017.stdout:6/182: fsync d5/d13/f14 0 2024-08-19T00:56:10.047 INFO:tasks.workunit.client.0.smithi017.stdout:2/255: write d2/d7/f21 [1184679,59684] 0 2024-08-19T00:56:10.049 INFO:tasks.workunit.client.0.smithi017.stdout:2/256: chown d2/d7/l18 535492559 1 2024-08-19T00:56:10.051 INFO:tasks.workunit.client.1.smithi086.stdout:2/635: dwrite d8/d43/fa1 [0,4194304] 0 2024-08-19T00:56:10.051 INFO:tasks.workunit.client.0.smithi017.stdout:6/183: dwrite f3 [4194304,4194304] 0 2024-08-19T00:56:10.051 INFO:tasks.workunit.client.0.smithi017.stdout:2/257: write d2/d7/d10/d35/d45/f4d [108987,122000] 0 2024-08-19T00:56:10.060 INFO:tasks.workunit.client.0.smithi017.stdout:5/170: dwrite db/f24 [0,4194304] 0 2024-08-19T00:56:10.060 INFO:tasks.workunit.client.0.smithi017.stdout:7/264: symlink d3/dc/df/d1c/d2c/l4d 0 2024-08-19T00:56:10.063 INFO:tasks.workunit.client.0.smithi017.stdout:7/265: read d3/d3c/f43 [2581255,85804] 0 2024-08-19T00:56:10.063 INFO:tasks.workunit.client.0.smithi017.stdout:6/184: unlink d5/f40 0 2024-08-19T00:56:10.063 INFO:tasks.workunit.client.0.smithi017.stdout:6/185: write f2 [3512052,20070] 0 2024-08-19T00:56:10.064 INFO:tasks.workunit.client.0.smithi017.stdout:1/205: creat d4/dc/f40 x:0 0 0 2024-08-19T00:56:10.065 INFO:tasks.workunit.client.0.smithi017.stdout:6/186: dread - d5/d13/d11/f37 zero size 2024-08-19T00:56:10.066 INFO:tasks.workunit.client.0.smithi017.stdout:1/206: write d4/d1c/f32 [454586,9816] 0 2024-08-19T00:56:10.067 INFO:tasks.workunit.client.0.smithi017.stdout:6/187: write f3 [5551966,83219] 0 2024-08-19T00:56:10.069 INFO:tasks.workunit.client.0.smithi017.stdout:6/188: write d5/d13/d20/f32 [261736,101580] 0 2024-08-19T00:56:10.083 INFO:tasks.workunit.client.0.smithi017.stdout:6/189: dread d5/d13/d20/f32 [0,4194304] 0 2024-08-19T00:56:10.165 INFO:tasks.workunit.client.0.smithi017.stdout:1/207: chown d4/dc/d17/d1d/c33 0 1 2024-08-19T00:56:10.172 INFO:tasks.workunit.client.0.smithi017.stdout:7/266: mknod d3/dc/df/d23/c4e 0 2024-08-19T00:56:10.172 INFO:tasks.workunit.client.0.smithi017.stdout:7/267: readlink d3/dc/df/d1a/l1b 0 2024-08-19T00:56:10.173 INFO:tasks.workunit.client.0.smithi017.stdout:7/268: stat d3/dc/df/d1c/d2c/d2f/l45 0 2024-08-19T00:56:10.174 INFO:tasks.workunit.client.0.smithi017.stdout:2/258: write d2/d7/d10/d19/f1d [2857969,36607] 0 2024-08-19T00:56:10.176 INFO:tasks.workunit.client.0.smithi017.stdout:2/259: write d2/d7/d10/f3e [1516973,63232] 0 2024-08-19T00:56:10.183 INFO:tasks.workunit.client.0.smithi017.stdout:1/208: unlink d4/dc/d17/d1d/l23 0 2024-08-19T00:56:10.186 INFO:tasks.workunit.client.0.smithi017.stdout:6/190: rename d5/f8 to d5/f42 0 2024-08-19T00:56:10.188 INFO:tasks.workunit.client.1.smithi086.stdout:5/636: mkdir d0/d99/dc0 0 2024-08-19T00:56:10.188 INFO:tasks.workunit.client.0.smithi017.stdout:1/209: creat d4/dc/d19/f41 x:0 0 0 2024-08-19T00:56:10.189 INFO:tasks.workunit.client.0.smithi017.stdout:5/171: truncate db/f10 3117193 0 2024-08-19T00:56:10.189 INFO:tasks.workunit.client.0.smithi017.stdout:1/210: readlink d4/dc/d17/d1d/l2e 0 2024-08-19T00:56:10.190 INFO:tasks.workunit.client.0.smithi017.stdout:2/260: mknod d2/d7/c51 0 2024-08-19T00:56:10.193 INFO:tasks.workunit.client.0.smithi017.stdout:6/191: symlink d5/d13/d11/d2c/l43 0 2024-08-19T00:56:10.194 INFO:tasks.workunit.client.1.smithi086.stdout:4/610: symlink d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/ld1 0 2024-08-19T00:56:10.195 INFO:tasks.workunit.client.1.smithi086.stdout:4/611: write d2/d18/d33/d42/d72/d78/d9e/fc7 [828681,126304] 0 2024-08-19T00:56:10.197 INFO:tasks.workunit.client.0.smithi017.stdout:2/261: dwrite d2/d7/d10/d19/f39 [0,4194304] 0 2024-08-19T00:56:10.198 INFO:tasks.workunit.client.0.smithi017.stdout:1/211: chown d4/d1c/f25 3 1 2024-08-19T00:56:10.200 INFO:tasks.workunit.client.0.smithi017.stdout:6/192: symlink d5/d13/d11/d2c/l44 0 2024-08-19T00:56:10.203 INFO:tasks.workunit.client.1.smithi086.stdout:0/647: dread da/d14/d1a/d2e/d30/f67 [0,4194304] 0 2024-08-19T00:56:10.204 INFO:tasks.workunit.client.0.smithi017.stdout:5/172: symlink db/d19/d33/d3b/l43 0 2024-08-19T00:56:10.204 INFO:tasks.workunit.client.1.smithi086.stdout:0/648: dread da/d14/f41 [0,4194304] 0 2024-08-19T00:56:10.205 INFO:tasks.workunit.client.1.smithi086.stdout:0/649: readlink da/d5d/da9/d6a/l92 0 2024-08-19T00:56:10.205 INFO:tasks.workunit.client.0.smithi017.stdout:7/269: dwrite d3/f2e [4194304,4194304] 0 2024-08-19T00:56:10.206 INFO:tasks.workunit.client.1.smithi086.stdout:2/636: mknod d8/d2c/d38/d80/cd2 0 2024-08-19T00:56:10.215 INFO:tasks.workunit.client.1.smithi086.stdout:5/637: unlink d0/df/d1f/f85 0 2024-08-19T00:56:10.217 INFO:tasks.workunit.client.1.smithi086.stdout:8/606: link dc/d16/d18/d29/d2e/f8a dc/d1f/d37/d4f/dac/db8/d8f/fc1 0 2024-08-19T00:56:10.218 INFO:tasks.workunit.client.1.smithi086.stdout:3/650: write d3/f6 [3368767,54063] 0 2024-08-19T00:56:10.220 INFO:tasks.workunit.client.0.smithi017.stdout:5/173: fdatasync db/d19/d1f/d15/d30/f41 0 2024-08-19T00:56:10.221 INFO:tasks.workunit.client.0.smithi017.stdout:5/174: fdatasync fa 0 2024-08-19T00:56:10.221 INFO:tasks.workunit.client.1.smithi086.stdout:4/612: creat d2/d18/d33/d42/d72/d8f/fd2 x:0 0 0 2024-08-19T00:56:10.223 INFO:tasks.workunit.client.1.smithi086.stdout:4/613: write d2/d18/d33/d42/d72/d2f/f82 [3360029,93803] 0 2024-08-19T00:56:10.223 INFO:tasks.workunit.client.0.smithi017.stdout:7/270: creat d3/dc/df/d1c/d2c/d2f/f4f x:0 0 0 2024-08-19T00:56:10.223 INFO:tasks.workunit.client.0.smithi017.stdout:2/262: dread d2/d7/d10/d19/f1d [0,4194304] 0 2024-08-19T00:56:10.224 INFO:tasks.workunit.client.1.smithi086.stdout:6/638: getdents db/d37/d28/d7f/d96/dc2 0 2024-08-19T00:56:10.226 INFO:tasks.workunit.client.0.smithi017.stdout:7/271: dread d3/dc/df/d23/f3f [0,4194304] 0 2024-08-19T00:56:10.228 INFO:tasks.workunit.client.1.smithi086.stdout:2/637: mknod d8/d43/d65/cd3 0 2024-08-19T00:56:10.231 INFO:tasks.workunit.client.1.smithi086.stdout:0/650: dwrite da/d14/d1a/d2e/d30/d76/fb8 [0,4194304] 0 2024-08-19T00:56:10.232 INFO:tasks.workunit.client.0.smithi017.stdout:8/112: sync 2024-08-19T00:56:10.235 INFO:tasks.workunit.client.1.smithi086.stdout:7/660: rename d3/f81 to d3/de/fe1 0 2024-08-19T00:56:10.235 INFO:tasks.workunit.client.1.smithi086.stdout:5/638: creat d0/df/d1f/fc1 x:0 0 0 2024-08-19T00:56:10.236 INFO:tasks.workunit.client.1.smithi086.stdout:1/738: rename d4 to d4/d7/d2a/d36/d50/d9c/ded/df3 22 2024-08-19T00:56:10.239 INFO:tasks.workunit.client.0.smithi017.stdout:2/263: creat d2/d7/d29/f52 x:0 0 0 2024-08-19T00:56:10.239 INFO:tasks.workunit.client.1.smithi086.stdout:4/614: creat d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/fd3 x:0 0 0 2024-08-19T00:56:10.240 INFO:tasks.workunit.client.0.smithi017.stdout:1/212: creat d4/dc/f42 x:0 0 0 2024-08-19T00:56:10.241 INFO:tasks.workunit.client.1.smithi086.stdout:9/666: link db/d26/d5c/d87/d30/d31/cc3 db/dd/d19/cd4 0 2024-08-19T00:56:10.243 INFO:tasks.workunit.client.1.smithi086.stdout:6/639: dread db/d37/f24 [0,4194304] 0 2024-08-19T00:56:10.247 INFO:tasks.workunit.client.1.smithi086.stdout:8/607: creat dc/d1f/d37/d9f/fc2 x:0 0 0 2024-08-19T00:56:10.249 INFO:tasks.workunit.client.1.smithi086.stdout:3/651: rename d3/d18/d19/cc3 to d3/d26/d2b/d33/db9/cd5 0 2024-08-19T00:56:10.249 INFO:tasks.workunit.client.1.smithi086.stdout:0/651: dread da/d14/d1a/d2e/d39/d3b/d4e/f4f [0,4194304] 0 2024-08-19T00:56:10.250 INFO:tasks.workunit.client.0.smithi017.stdout:1/213: rename d4/c12 to d4/dc/d19/c43 0 2024-08-19T00:56:10.251 INFO:tasks.workunit.client.0.smithi017.stdout:1/214: write d4/d1c/f2a [784761,118368] 0 2024-08-19T00:56:10.253 INFO:tasks.workunit.client.0.smithi017.stdout:7/272: mknod d3/dc/df/d1c/d2c/c50 0 2024-08-19T00:56:10.256 INFO:tasks.workunit.client.0.smithi017.stdout:6/193: getdents d5/d13/d20 0 2024-08-19T00:56:10.259 INFO:tasks.workunit.client.0.smithi017.stdout:2/264: symlink d2/d7/d10/d19/d48/l53 0 2024-08-19T00:56:10.259 INFO:tasks.workunit.client.0.smithi017.stdout:6/194: chown d5/d13/f14 4051 1 2024-08-19T00:56:10.260 INFO:tasks.workunit.client.0.smithi017.stdout:6/195: fsync d5/d13/d20/f3c 0 2024-08-19T00:56:10.260 INFO:tasks.workunit.client.0.smithi017.stdout:1/215: dwrite d4/dc/f34 [0,4194304] 0 2024-08-19T00:56:10.261 INFO:tasks.workunit.client.0.smithi017.stdout:1/216: dread - d4/dc/f42 zero size 2024-08-19T00:56:10.262 INFO:tasks.workunit.client.0.smithi017.stdout:8/113: dread de/ff [0,4194304] 0 2024-08-19T00:56:10.263 INFO:tasks.workunit.client.0.smithi017.stdout:6/196: truncate d5/d13/f16 956899 0 2024-08-19T00:56:10.263 INFO:tasks.workunit.client.0.smithi017.stdout:8/114: write de/f12 [277483,111073] 0 2024-08-19T00:56:10.265 INFO:tasks.workunit.client.0.smithi017.stdout:5/175: getdents db/d19 0 2024-08-19T00:56:10.278 INFO:tasks.workunit.client.0.smithi017.stdout:6/197: mknod d5/d13/d11/d2c/c45 0 2024-08-19T00:56:10.279 INFO:tasks.workunit.client.0.smithi017.stdout:5/176: truncate db/d19/d1f/d15/d30/f41 180494 0 2024-08-19T00:56:10.284 INFO:tasks.workunit.client.1.smithi086.stdout:6/640: mkdir db/d8e/dcb 0 2024-08-19T00:56:10.284 INFO:tasks.workunit.client.1.smithi086.stdout:8/608: symlink dc/d1f/d37/d4f/dac/db8/d8f/lc3 0 2024-08-19T00:56:10.284 INFO:tasks.workunit.client.1.smithi086.stdout:5/639: rename d0/d8/d70 to d0/d99/dc0/dc2 0 2024-08-19T00:56:10.285 INFO:tasks.workunit.client.0.smithi017.stdout:8/115: fdatasync f0 0 2024-08-19T00:56:10.286 INFO:tasks.workunit.client.1.smithi086.stdout:3/652: creat d3/d18/d1a/fd6 x:0 0 0 2024-08-19T00:56:10.286 INFO:tasks.workunit.client.0.smithi017.stdout:7/273: getdents d3/dc/df/d1c/d2c/d2f 0 2024-08-19T00:56:10.286 INFO:tasks.workunit.client.0.smithi017.stdout:2/265: dread d2/fa [8388608,4194304] 0 2024-08-19T00:56:10.288 INFO:tasks.workunit.client.1.smithi086.stdout:8/609: write dc/d1f/d37/d4f/dac/db8/d7a/d9b/f3d [5518240,32523] 0 2024-08-19T00:56:10.288 INFO:tasks.workunit.client.0.smithi017.stdout:1/217: write d4/f13 [1062584,22810] 0 2024-08-19T00:56:10.289 INFO:tasks.workunit.client.0.smithi017.stdout:1/218: write d4/dc/f34 [2777659,26553] 0 2024-08-19T00:56:10.289 INFO:tasks.workunit.client.1.smithi086.stdout:6/641: rmdir db/d37/d41 39 2024-08-19T00:56:10.290 INFO:tasks.workunit.client.1.smithi086.stdout:1/739: dwrite d4/d7/fa0 [0,4194304] 0 2024-08-19T00:56:10.291 INFO:tasks.workunit.client.0.smithi017.stdout:5/177: creat db/d19/d1f/d15/d3e/d40/f44 x:0 0 0 2024-08-19T00:56:10.291 INFO:tasks.workunit.client.1.smithi086.stdout:1/740: write d4/d7/d2a/d36/d50/f62 [2196688,96981] 0 2024-08-19T00:56:10.292 INFO:tasks.workunit.client.0.smithi017.stdout:5/178: chown db/d19/d33/d3b/l43 160 1 2024-08-19T00:56:10.293 INFO:tasks.workunit.client.1.smithi086.stdout:4/615: creat d2/fd4 x:0 0 0 2024-08-19T00:56:10.293 INFO:tasks.workunit.client.0.smithi017.stdout:5/179: chown db/d19/c31 12688205 1 2024-08-19T00:56:10.294 INFO:tasks.workunit.client.1.smithi086.stdout:4/616: write d2/f26 [8517230,94156] 0 2024-08-19T00:56:10.295 INFO:tasks.workunit.client.1.smithi086.stdout:0/652: mknod da/d14/d1a/d2e/d39/ccf 0 2024-08-19T00:56:10.296 INFO:tasks.workunit.client.1.smithi086.stdout:2/638: getdents d8/d14/d9e 0 2024-08-19T00:56:10.297 INFO:tasks.workunit.client.0.smithi017.stdout:1/219: fsync d4/dc/f11 0 2024-08-19T00:56:10.298 INFO:tasks.workunit.client.1.smithi086.stdout:5/640: mkdir d0/d5f/d60/d57/dc3 0 2024-08-19T00:56:10.300 INFO:tasks.workunit.client.0.smithi017.stdout:5/180: chown db/d19/d1f/f1c 2023350 1 2024-08-19T00:56:10.302 INFO:tasks.workunit.client.0.smithi017.stdout:1/220: dread d4/dc/f16 [0,4194304] 0 2024-08-19T00:56:10.303 INFO:tasks.workunit.client.0.smithi017.stdout:1/221: truncate d4/dc/f38 834426 0 2024-08-19T00:56:10.304 INFO:tasks.workunit.client.0.smithi017.stdout:1/222: fdatasync d4/d1c/f25 0 2024-08-19T00:56:10.305 INFO:tasks.workunit.client.0.smithi017.stdout:5/181: write db/d19/d1f/d15/d1e/f3f [1321220,83386] 0 2024-08-19T00:56:10.306 INFO:tasks.workunit.client.0.smithi017.stdout:8/116: symlink de/d15/l1a 0 2024-08-19T00:56:10.308 INFO:tasks.workunit.client.0.smithi017.stdout:7/274: creat d3/f51 x:0 0 0 2024-08-19T00:56:10.309 INFO:tasks.workunit.client.0.smithi017.stdout:7/275: dread - d3/f51 zero size 2024-08-19T00:56:10.309 INFO:tasks.workunit.client.1.smithi086.stdout:1/741: mknod d4/d7/d2a/d36/d50/d9c/cf4 0 2024-08-19T00:56:10.310 INFO:tasks.workunit.client.1.smithi086.stdout:3/653: write d3/d18/d19/dbc/db8/f21 [1625899,128070] 0 2024-08-19T00:56:10.311 INFO:tasks.workunit.client.1.smithi086.stdout:3/654: write d3/d26/f79 [181960,38165] 0 2024-08-19T00:56:10.312 INFO:tasks.workunit.client.0.smithi017.stdout:1/223: dwrite d4/f14 [0,4194304] 0 2024-08-19T00:56:10.313 INFO:tasks.workunit.client.0.smithi017.stdout:5/182: rmdir db/d19/d1f/d15/d3e 39 2024-08-19T00:56:10.316 INFO:tasks.workunit.client.1.smithi086.stdout:4/617: unlink d2/d18/d33/d42/d72/d78/d2c/c2d 0 2024-08-19T00:56:10.318 INFO:tasks.workunit.client.1.smithi086.stdout:9/667: getdents db/d26/d5c/d87/d30/d32 0 2024-08-19T00:56:10.318 INFO:tasks.workunit.client.1.smithi086.stdout:3/655: dwrite d3/d18/d19/d62/d46/f6e [0,4194304] 0 2024-08-19T00:56:10.319 INFO:tasks.workunit.client.0.smithi017.stdout:1/224: rename d4/dc/f16 to d4/dc/d19/f44 0 2024-08-19T00:56:10.321 INFO:tasks.workunit.client.1.smithi086.stdout:2/639: rmdir d8/d24 39 2024-08-19T00:56:10.323 INFO:tasks.workunit.client.1.smithi086.stdout:6/642: dread db/f56 [0,4194304] 0 2024-08-19T00:56:10.327 INFO:tasks.workunit.client.0.smithi017.stdout:7/276: truncate d3/dc/df/d23/f26 4120195 0 2024-08-19T00:56:10.327 INFO:tasks.workunit.client.0.smithi017.stdout:1/225: dwrite d4/dc/f40 [0,4194304] 0 2024-08-19T00:56:10.328 INFO:tasks.workunit.client.1.smithi086.stdout:8/610: fsync dc/f14 0 2024-08-19T00:56:10.329 INFO:tasks.workunit.client.0.smithi017.stdout:1/226: truncate d4/d1c/f32 1481252 0 2024-08-19T00:56:10.330 INFO:tasks.workunit.client.0.smithi017.stdout:5/183: symlink db/d19/d1f/l45 0 2024-08-19T00:56:10.335 INFO:tasks.workunit.client.1.smithi086.stdout:8/611: dwrite dc/d16/d18/d29/d2e/d28/d2b/d3b/f8e [4194304,4194304] 0 2024-08-19T00:56:10.336 INFO:tasks.workunit.client.1.smithi086.stdout:0/653: dwrite da/d14/f1d [4194304,4194304] 0 2024-08-19T00:56:10.337 INFO:tasks.workunit.client.0.smithi017.stdout:5/184: creat db/d19/d1f/d15/d30/f46 x:0 0 0 2024-08-19T00:56:10.337 INFO:tasks.workunit.client.0.smithi017.stdout:7/277: dread d3/dc/df/d23/f3f [0,4194304] 0 2024-08-19T00:56:10.339 INFO:tasks.workunit.client.0.smithi017.stdout:8/117: mknod de/d15/c1b 0 2024-08-19T00:56:10.339 INFO:tasks.workunit.client.0.smithi017.stdout:5/185: fsync db/d19/d1f/d15/f25 0 2024-08-19T00:56:10.340 INFO:tasks.workunit.client.1.smithi086.stdout:3/656: fsync d3/d18/f2c 0 2024-08-19T00:56:10.342 INFO:tasks.workunit.client.1.smithi086.stdout:2/640: dread d8/d84/f81 [0,4194304] 0 2024-08-19T00:56:10.343 INFO:tasks.workunit.client.1.smithi086.stdout:5/641: symlink d0/d5f/d60/d57/d80/da0/lc4 0 2024-08-19T00:56:10.343 INFO:tasks.workunit.client.0.smithi017.stdout:8/118: chown c8 0 1 2024-08-19T00:56:10.344 INFO:tasks.workunit.client.1.smithi086.stdout:5/642: read - d0/d2d/d43/d4d/fa6 zero size 2024-08-19T00:56:10.345 INFO:tasks.workunit.client.1.smithi086.stdout:1/742: write d4/d7/d2a/d36/d63/d84/d8e/fb1 [669476,8289] 0 2024-08-19T00:56:10.348 INFO:tasks.workunit.client.0.smithi017.stdout:7/278: creat d3/dc/f52 x:0 0 0 2024-08-19T00:56:10.350 INFO:tasks.workunit.client.0.smithi017.stdout:5/186: mknod db/d19/d1f/d15/d30/c47 0 2024-08-19T00:56:10.353 INFO:tasks.workunit.client.0.smithi017.stdout:8/119: truncate fa 4288437 0 2024-08-19T00:56:10.355 INFO:tasks.workunit.client.0.smithi017.stdout:7/279: creat d3/dc/df/d1c/d2c/d2f/f53 x:0 0 0 2024-08-19T00:56:10.356 INFO:tasks.workunit.client.0.smithi017.stdout:5/187: chown db/d19/c1d 498 1 2024-08-19T00:56:10.357 INFO:tasks.workunit.client.1.smithi086.stdout:5/643: creat d0/d5f/d60/d5b/fc5 x:0 0 0 2024-08-19T00:56:10.358 INFO:tasks.workunit.client.1.smithi086.stdout:8/612: mkdir dc/d16/d18/d29/d2e/d28/dc4 0 2024-08-19T00:56:10.359 INFO:tasks.workunit.client.1.smithi086.stdout:6/643: rmdir db/d37/d28/d7f/d96 39 2024-08-19T00:56:10.359 INFO:tasks.workunit.client.1.smithi086.stdout:8/613: chown dc/d1f/d37/d4f/dac/db8/d7a/d9b/f71 42182 1 2024-08-19T00:56:10.360 INFO:tasks.workunit.client.0.smithi017.stdout:8/120: symlink de/d15/l1c 0 2024-08-19T00:56:10.361 INFO:tasks.workunit.client.1.smithi086.stdout:5/644: mknod d0/df/d1f/d65/cc6 0 2024-08-19T00:56:10.362 INFO:tasks.workunit.client.1.smithi086.stdout:9/668: rename db/c70 to db/d26/cd5 0 2024-08-19T00:56:10.362 INFO:tasks.workunit.client.0.smithi017.stdout:5/188: mknod db/c48 0 2024-08-19T00:56:10.364 INFO:tasks.workunit.client.1.smithi086.stdout:8/614: symlink dc/d17/lc5 0 2024-08-19T00:56:10.366 INFO:tasks.workunit.client.1.smithi086.stdout:6/644: dread db/d8e/fb0 [0,4194304] 0 2024-08-19T00:56:10.367 INFO:tasks.workunit.client.1.smithi086.stdout:1/743: dread d4/d10/f25 [0,4194304] 0 2024-08-19T00:56:10.367 INFO:tasks.workunit.client.1.smithi086.stdout:5/645: dread d0/df/d1f/d65/fb8 [0,4194304] 0 2024-08-19T00:56:10.367 INFO:tasks.workunit.client.1.smithi086.stdout:4/618: rename d2/d18/d33/d42/d72/d2f/lb6 to d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/ld5 0 2024-08-19T00:56:10.368 INFO:tasks.workunit.client.1.smithi086.stdout:1/744: stat d4/d7/d2a/d36/d3a/de5/f8f 0 2024-08-19T00:56:10.369 INFO:tasks.workunit.client.1.smithi086.stdout:5/646: read d0/d5f/d60/f83 [3009684,122852] 0 2024-08-19T00:56:10.370 INFO:tasks.workunit.client.1.smithi086.stdout:9/669: creat db/dd/d19/d18/fd6 x:0 0 0 2024-08-19T00:56:10.371 INFO:tasks.workunit.client.0.smithi017.stdout:7/280: getdents d3/dc 0 2024-08-19T00:56:10.372 INFO:tasks.workunit.client.0.smithi017.stdout:5/189: rename db/d19/d33/d3b to db/d19/d1f/d15/d3e/d40/d49 0 2024-08-19T00:56:10.373 INFO:tasks.workunit.client.1.smithi086.stdout:8/615: rmdir dc/d1f/d37/d4f 39 2024-08-19T00:56:10.374 INFO:tasks.workunit.client.0.smithi017.stdout:8/121: read fa [4177723,52837] 0 2024-08-19T00:56:10.374 INFO:tasks.workunit.client.0.smithi017.stdout:5/190: dread - db/d19/d1f/d15/d30/f36 zero size 2024-08-19T00:56:10.374 INFO:tasks.workunit.client.1.smithi086.stdout:8/616: fdatasync dc/d16/d18/d29/d2e/d28/d2b/fa5 0 2024-08-19T00:56:10.374 INFO:tasks.workunit.client.0.smithi017.stdout:8/122: fdatasync de/f12 0 2024-08-19T00:56:10.375 INFO:tasks.workunit.client.0.smithi017.stdout:8/123: read de/ff [2039807,43082] 0 2024-08-19T00:56:10.382 INFO:tasks.workunit.client.0.smithi017.stdout:7/281: rename d3/dc/df/d23/f26 to d3/dc/df/d32/f54 0 2024-08-19T00:56:10.382 INFO:tasks.workunit.client.1.smithi086.stdout:4/619: dread - d2/d18/d33/d42/d72/d78/d25/f5f zero size 2024-08-19T00:56:10.383 INFO:tasks.workunit.client.0.smithi017.stdout:7/282: truncate d3/dc/df/d1a/f3b 607648 0 2024-08-19T00:56:10.383 INFO:tasks.workunit.client.0.smithi017.stdout:8/124: truncate de/ff 2606010 0 2024-08-19T00:56:10.385 INFO:tasks.workunit.client.1.smithi086.stdout:5/647: unlink d0/d5f/d60/d5b/f6e 0 2024-08-19T00:56:10.386 INFO:tasks.workunit.client.1.smithi086.stdout:5/648: write d0/d2d/d4f/f7d [233476,106016] 0 2024-08-19T00:56:10.386 INFO:tasks.workunit.client.1.smithi086.stdout:9/670: mknod db/d26/d5c/d87/d6d/cd7 0 2024-08-19T00:56:10.387 INFO:tasks.workunit.client.1.smithi086.stdout:9/671: readlink db/dd/d19/l55 0 2024-08-19T00:56:10.387 INFO:tasks.workunit.client.0.smithi017.stdout:5/191: rename db/l13 to db/d19/d1f/d15/d1e/l4a 0 2024-08-19T00:56:10.389 INFO:tasks.workunit.client.0.smithi017.stdout:5/192: fdatasync db/d19/d1f/d15/d3e/d40/f44 0 2024-08-19T00:56:10.389 INFO:tasks.workunit.client.0.smithi017.stdout:8/125: creat de/f1d x:0 0 0 2024-08-19T00:56:10.389 INFO:tasks.workunit.client.1.smithi086.stdout:6/645: symlink db/d37/d44/d5a/lcc 0 2024-08-19T00:56:10.390 INFO:tasks.workunit.client.0.smithi017.stdout:7/283: creat d3/dc/df/d1c/f55 x:0 0 0 2024-08-19T00:56:10.391 INFO:tasks.workunit.client.0.smithi017.stdout:7/284: write d3/dc/df/d1a/f4a [318095,76334] 0 2024-08-19T00:56:10.393 INFO:tasks.workunit.client.1.smithi086.stdout:3/657: rename d3/d26/d2b/d33/db9/cd5 to d3/d18/d61/cd7 0 2024-08-19T00:56:10.396 INFO:tasks.workunit.client.0.smithi017.stdout:7/285: creat d3/dc/df/d1c/d2c/d2f/f56 x:0 0 0 2024-08-19T00:56:10.397 INFO:tasks.workunit.client.0.smithi017.stdout:5/193: mknod db/d19/d1f/c4b 0 2024-08-19T00:56:10.402 INFO:tasks.workunit.client.0.smithi017.stdout:5/194: symlink db/d19/d1f/d15/d3e/l4c 0 2024-08-19T00:56:10.406 INFO:tasks.workunit.client.1.smithi086.stdout:2/641: rename d8/d24/f54 to d8/d2c/d38/fd4 0 2024-08-19T00:56:10.407 INFO:tasks.workunit.client.0.smithi017.stdout:7/286: creat d3/dc/df/d37/d46/f57 x:0 0 0 2024-08-19T00:56:10.408 INFO:tasks.workunit.client.1.smithi086.stdout:3/658: readlink d3/d26/d2b/d33/d4a/d57/lc8 0 2024-08-19T00:56:10.409 INFO:tasks.workunit.client.1.smithi086.stdout:3/659: dread - d3/d18/d19/dbc/db8/dc9/fcf zero size 2024-08-19T00:56:10.417 INFO:tasks.workunit.client.1.smithi086.stdout:2/642: dread d8/d2c/f49 [0,4194304] 0 2024-08-19T00:56:10.429 INFO:tasks.workunit.client.1.smithi086.stdout:7/661: sync 2024-08-19T00:56:10.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:10 smithi017 ceph-mon[16627]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:10.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:10 smithi086 ceph-mon[24511]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:10.473 INFO:tasks.workunit.client.1.smithi086.stdout:0/654: sync 2024-08-19T00:56:10.515 INFO:tasks.workunit.client.0.smithi017.stdout:5/195: rmdir db/d19/d1f/d15/d3e 39 2024-08-19T00:56:10.516 INFO:tasks.workunit.client.0.smithi017.stdout:7/287: symlink d3/d3c/l58 0 2024-08-19T00:56:10.518 INFO:tasks.workunit.client.1.smithi086.stdout:1/745: write d4/d1e/d6f/f97 [2195362,25300] 0 2024-08-19T00:56:10.519 INFO:tasks.workunit.client.1.smithi086.stdout:1/746: truncate d4/d7/d2a/d36/d50/f62 5109467 0 2024-08-19T00:56:10.520 INFO:tasks.workunit.client.1.smithi086.stdout:1/747: chown d4/d7/d2a/d36/db6/cbb 811538 1 2024-08-19T00:56:10.598 INFO:tasks.workunit.client.1.smithi086.stdout:9/672: link db/d26/d5c/d87/d37/fa4 db/daf/fd8 0 2024-08-19T00:56:10.600 INFO:tasks.workunit.client.1.smithi086.stdout:6/646: rename db/d34/d4e/d68/f77 to db/d34/d4e/fcd 0 2024-08-19T00:56:10.601 INFO:tasks.workunit.client.1.smithi086.stdout:3/660: symlink d3/d18/d1a/d51/ld8 0 2024-08-19T00:56:10.602 INFO:tasks.workunit.client.1.smithi086.stdout:4/620: dwrite d2/f1b [4194304,4194304] 0 2024-08-19T00:56:10.604 INFO:tasks.workunit.client.1.smithi086.stdout:3/661: write d3/d26/d2b/d33/d4a/fc4 [991424,123313] 0 2024-08-19T00:56:10.604 INFO:tasks.workunit.client.0.smithi017.stdout:8/126: truncate de/ff 116658 0 2024-08-19T00:56:10.605 INFO:tasks.workunit.client.0.smithi017.stdout:7/288: rmdir d3/dc/df/d1c/d2c/d2f 39 2024-08-19T00:56:10.607 INFO:tasks.workunit.client.1.smithi086.stdout:3/662: write d3/d18/d27/d49/d3f/d54/f94 [3701135,40905] 0 2024-08-19T00:56:10.610 INFO:tasks.workunit.client.1.smithi086.stdout:5/649: dwrite d0/d2d/d4f/f5c [4194304,4194304] 0 2024-08-19T00:56:10.610 INFO:tasks.workunit.client.1.smithi086.stdout:1/748: truncate d4/d1e/d6f/f74 1998384 0 2024-08-19T00:56:10.612 INFO:tasks.workunit.client.1.smithi086.stdout:9/673: symlink db/dd/d19/d18/ld9 0 2024-08-19T00:56:10.612 INFO:tasks.workunit.client.0.smithi017.stdout:7/289: creat d3/dc/df/d1c/d2c/d35/f59 x:0 0 0 2024-08-19T00:56:10.613 INFO:tasks.workunit.client.1.smithi086.stdout:7/662: dread d3/d34/d44/d58/d4b/da5/f74 [0,4194304] 0 2024-08-19T00:56:10.614 INFO:tasks.workunit.client.1.smithi086.stdout:7/663: chown d3/de 0 1 2024-08-19T00:56:10.614 INFO:tasks.workunit.client.1.smithi086.stdout:8/617: rename dc/d1f/d37/d4f/lae to dc/d16/d18/d29/d2e/d28/dc4/lc6 0 2024-08-19T00:56:10.615 INFO:tasks.workunit.client.1.smithi086.stdout:6/647: mkdir db/d34/d4e/d68/d99/dce 0 2024-08-19T00:56:10.617 INFO:tasks.workunit.client.1.smithi086.stdout:8/618: fsync dc/d1f/d37/d4f/dac/db8/d7a/d9b/fb9 0 2024-08-19T00:56:10.617 INFO:tasks.workunit.client.1.smithi086.stdout:2/643: mkdir d8/d43/dd5 0 2024-08-19T00:56:10.618 INFO:tasks.workunit.client.1.smithi086.stdout:8/619: chown dc/d16/d18/d29/d2e/f8a 1 1 2024-08-19T00:56:10.619 INFO:tasks.workunit.client.0.smithi017.stdout:8/127: rename fa to de/d15/f1e 0 2024-08-19T00:56:10.621 INFO:tasks.workunit.client.1.smithi086.stdout:0/655: link da/d14/d26/fb1 da/d14/d1a/d2e/d39/d3b/d89/dc5/fd0 0 2024-08-19T00:56:10.624 INFO:tasks.workunit.client.1.smithi086.stdout:1/749: unlink d4/d7/d2a/d6e/f73 0 2024-08-19T00:56:10.626 INFO:tasks.workunit.client.1.smithi086.stdout:5/650: creat d0/df/d1f/d33/fc7 x:0 0 0 2024-08-19T00:56:10.626 INFO:tasks.workunit.client.0.smithi017.stdout:3/257: sync 2024-08-19T00:56:10.626 INFO:tasks.workunit.client.0.smithi017.stdout:9/219: sync 2024-08-19T00:56:10.626 INFO:tasks.workunit.client.0.smithi017.stdout:9/220: chown d0 1834238725 1 2024-08-19T00:56:10.627 INFO:tasks.workunit.client.0.smithi017.stdout:8/128: mkdir de/d15/d1f 0 2024-08-19T00:56:10.627 INFO:tasks.workunit.client.1.smithi086.stdout:5/651: write d0/d99/dc0/dc2/fb0 [4544363,71344] 0 2024-08-19T00:56:10.629 INFO:tasks.workunit.client.0.smithi017.stdout:9/221: dread d0/f15 [0,4194304] 0 2024-08-19T00:56:10.629 INFO:tasks.workunit.client.1.smithi086.stdout:9/674: dread db/d26/d5c/d87/d30/d31/f6c [0,4194304] 0 2024-08-19T00:56:10.633 INFO:tasks.workunit.client.0.smithi017.stdout:5/196: dwrite db/d19/d1f/d15/d30/f41 [0,4194304] 0 2024-08-19T00:56:10.635 INFO:tasks.workunit.client.0.smithi017.stdout:3/258: rmdir d5/d11 39 2024-08-19T00:56:10.636 INFO:tasks.workunit.client.0.smithi017.stdout:5/197: write db/f24 [2898253,74575] 0 2024-08-19T00:56:10.638 INFO:tasks.workunit.client.0.smithi017.stdout:3/259: read d5/d15/d1b/f20 [306388,105293] 0 2024-08-19T00:56:10.641 INFO:tasks.workunit.client.0.smithi017.stdout:9/222: dwrite d0/fa [0,4194304] 0 2024-08-19T00:56:10.643 INFO:tasks.workunit.client.1.smithi086.stdout:3/663: rename d3/d26/d60/f69 to d3/d18/d27/d49/d3f/d5b/d66/fd9 0 2024-08-19T00:56:10.648 INFO:tasks.workunit.client.0.smithi017.stdout:8/129: dread de/d15/f1e [0,4194304] 0 2024-08-19T00:56:10.654 INFO:tasks.workunit.client.1.smithi086.stdout:1/750: fdatasync d4/d7/d2a/d36/d3a/f72 0 2024-08-19T00:56:10.655 INFO:tasks.workunit.client.1.smithi086.stdout:1/751: fsync d4/d7/d2a/d36/d63/d84/fdd 0 2024-08-19T00:56:10.656 INFO:tasks.workunit.client.1.smithi086.stdout:1/752: write d4/d7/d2a/d36/d7d/fe4 [177279,1421] 0 2024-08-19T00:56:10.657 INFO:tasks.workunit.client.1.smithi086.stdout:5/652: rmdir d0/d2d/d43/d91 39 2024-08-19T00:56:10.658 INFO:tasks.workunit.client.1.smithi086.stdout:7/664: write d3/f97 [1448512,100168] 0 2024-08-19T00:56:10.658 INFO:tasks.workunit.client.1.smithi086.stdout:5/653: fsync d0/f29 0 2024-08-19T00:56:10.659 INFO:tasks.workunit.client.1.smithi086.stdout:9/675: mknod db/d26/d5c/d87/d30/d32/cda 0 2024-08-19T00:56:10.659 INFO:tasks.workunit.client.1.smithi086.stdout:3/664: dread d3/d9/f39 [0,4194304] 0 2024-08-19T00:56:10.660 INFO:tasks.workunit.client.0.smithi017.stdout:5/198: mknod db/d19/d33/c4d 0 2024-08-19T00:56:10.661 INFO:tasks.workunit.client.1.smithi086.stdout:0/656: write da/d14/d1a/d2e/d43/fc7 [980015,122376] 0 2024-08-19T00:56:10.664 INFO:tasks.workunit.client.0.smithi017.stdout:8/130: rmdir de 39 2024-08-19T00:56:10.665 INFO:tasks.workunit.client.1.smithi086.stdout:6/648: mknod db/d37/d41/dad/ccf 0 2024-08-19T00:56:10.666 INFO:tasks.workunit.client.1.smithi086.stdout:2/644: mkdir d8/d2c/d38/d80/dca/dd6 0 2024-08-19T00:56:10.670 INFO:tasks.workunit.client.0.smithi017.stdout:8/131: truncate de/f1d 581123 0 2024-08-19T00:56:10.671 INFO:tasks.workunit.client.0.smithi017.stdout:5/199: rename db/l11 to db/d19/d1f/d15/d30/l4e 0 2024-08-19T00:56:10.672 INFO:tasks.workunit.client.0.smithi017.stdout:3/260: truncate d5/fc 2848031 0 2024-08-19T00:56:10.673 INFO:tasks.workunit.client.0.smithi017.stdout:3/261: chown d5/da/fd 207906058 1 2024-08-19T00:56:10.674 INFO:tasks.workunit.client.0.smithi017.stdout:9/223: creat d0/d33/d22/f42 x:0 0 0 2024-08-19T00:56:10.675 INFO:tasks.workunit.client.0.smithi017.stdout:9/224: chown d0/d33/f39 45383 1 2024-08-19T00:56:10.675 INFO:tasks.workunit.client.1.smithi086.stdout:9/676: symlink db/d26/d5c/d87/d30/d32/ldb 0 2024-08-19T00:56:10.676 INFO:tasks.workunit.client.1.smithi086.stdout:9/677: write db/d5e/fa9 [689781,77046] 0 2024-08-19T00:56:10.676 INFO:tasks.workunit.client.1.smithi086.stdout:0/657: mkdir da/d14/d1a/d2e/d39/d3b/d89/dd1 0 2024-08-19T00:56:10.678 INFO:tasks.workunit.client.1.smithi086.stdout:6/649: creat db/d34/d69/fd0 x:0 0 0 2024-08-19T00:56:10.679 INFO:tasks.workunit.client.1.smithi086.stdout:9/678: dread db/d26/d5c/d68/f78 [4194304,4194304] 0 2024-08-19T00:56:10.680 INFO:tasks.workunit.client.1.smithi086.stdout:9/679: fdatasync db/d26/d5c/d87/d30/d58/fc6 0 2024-08-19T00:56:10.681 INFO:tasks.workunit.client.1.smithi086.stdout:6/650: dread db/f56 [0,4194304] 0 2024-08-19T00:56:10.682 INFO:tasks.workunit.client.1.smithi086.stdout:3/665: fsync d3/d9/f4c 0 2024-08-19T00:56:10.683 INFO:tasks.workunit.client.1.smithi086.stdout:3/666: chown d3/d18/d27/d49/d3f/d5b/d8f 3 1 2024-08-19T00:56:10.684 INFO:tasks.workunit.client.0.smithi017.stdout:3/262: truncate d5/d11/f2a 225252 0 2024-08-19T00:56:10.687 INFO:tasks.workunit.client.1.smithi086.stdout:8/620: rename dc/d16/d18/d29 to dc/d16/dc7 0 2024-08-19T00:56:10.690 INFO:tasks.workunit.client.0.smithi017.stdout:9/225: symlink d0/d33/d22/l43 0 2024-08-19T00:56:10.693 INFO:tasks.workunit.client.0.smithi017.stdout:5/200: rename db/d19/d1f/d15/d1e/l23 to db/d19/d1f/d15/d3e/l4f 0 2024-08-19T00:56:10.695 INFO:tasks.workunit.client.1.smithi086.stdout:5/654: creat d0/d2d/d43/fc8 x:0 0 0 2024-08-19T00:56:10.695 INFO:tasks.workunit.client.1.smithi086.stdout:5/655: write d0/d20/f36 [3723027,4189] 0 2024-08-19T00:56:10.696 INFO:tasks.workunit.client.0.smithi017.stdout:8/132: dwrite de/ff [0,4194304] 0 2024-08-19T00:56:10.696 INFO:tasks.workunit.client.1.smithi086.stdout:5/656: write d0/d5f/d60/d57/d80/da3/fba [689796,2399] 0 2024-08-19T00:56:10.698 INFO:tasks.workunit.client.1.smithi086.stdout:6/651: creat db/d37/d44/d5a/d8f/fd1 x:0 0 0 2024-08-19T00:56:10.702 INFO:tasks.workunit.client.1.smithi086.stdout:3/667: fsync d3/d26/d2b/f38 0 2024-08-19T00:56:10.705 INFO:tasks.workunit.client.1.smithi086.stdout:2/645: rename d8/d24/d32/d4d/d6a/db1/lc0 to d8/d2c/d38/ld7 0 2024-08-19T00:56:10.705 INFO:tasks.workunit.client.1.smithi086.stdout:0/658: dwrite da/d14/f41 [0,4194304] 0 2024-08-19T00:56:10.710 INFO:tasks.workunit.client.1.smithi086.stdout:5/657: symlink d0/d5f/d60/d57/d80/lc9 0 2024-08-19T00:56:10.713 INFO:tasks.workunit.client.1.smithi086.stdout:6/652: rmdir db/d34/d39/d76 39 2024-08-19T00:56:10.717 INFO:tasks.workunit.client.0.smithi017.stdout:9/226: rename d0/f32 to d0/d33/d22/f44 0 2024-08-19T00:56:10.717 INFO:tasks.workunit.client.0.smithi017.stdout:8/133: write de/d15/f1e [4528306,102279] 0 2024-08-19T00:56:10.724 INFO:tasks.workunit.client.0.smithi017.stdout:3/263: dwrite d5/fc [0,4194304] 0 2024-08-19T00:56:10.724 INFO:tasks.workunit.client.0.smithi017.stdout:9/227: fdatasync d0/d33/f2d 0 2024-08-19T00:56:10.726 INFO:tasks.workunit.client.1.smithi086.stdout:4/621: sync 2024-08-19T00:56:10.728 INFO:tasks.workunit.client.0.smithi017.stdout:8/134: symlink de/d15/l20 0 2024-08-19T00:56:10.730 INFO:tasks.workunit.client.0.smithi017.stdout:8/135: dread de/f1d [0,4194304] 0 2024-08-19T00:56:10.730 INFO:tasks.workunit.client.1.smithi086.stdout:2/646: dread d8/d24/d32/f4b [0,4194304] 0 2024-08-19T00:56:10.730 INFO:tasks.workunit.client.1.smithi086.stdout:0/659: mknod da/d14/d1a/d2e/d7e/cd2 0 2024-08-19T00:56:10.731 INFO:tasks.workunit.client.0.smithi017.stdout:9/228: write d0/d33/f2d [5087407,49814] 0 2024-08-19T00:56:10.732 INFO:tasks.workunit.client.0.smithi017.stdout:9/229: chown d0/d33/c37 8 1 2024-08-19T00:56:10.734 INFO:tasks.workunit.client.0.smithi017.stdout:5/201: rename db/d19/d1f/d15/f1a to db/d19/d1f/f50 0 2024-08-19T00:56:10.735 INFO:tasks.workunit.client.0.smithi017.stdout:8/136: dread de/ff [0,4194304] 0 2024-08-19T00:56:10.737 INFO:tasks.workunit.client.0.smithi017.stdout:3/264: symlink d5/d32/l4b 0 2024-08-19T00:56:10.737 INFO:tasks.workunit.client.1.smithi086.stdout:4/622: write d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/faa [379878,67909] 0 2024-08-19T00:56:10.738 INFO:tasks.workunit.client.1.smithi086.stdout:2/647: read d8/d84/d79/f98 [367287,51353] 0 2024-08-19T00:56:10.739 INFO:tasks.workunit.client.1.smithi086.stdout:4/623: write d2/d18/d33/d42/d72/d2f/fb4 [943272,102093] 0 2024-08-19T00:56:10.741 INFO:tasks.workunit.client.1.smithi086.stdout:4/624: fdatasync d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/fc8 0 2024-08-19T00:56:10.741 INFO:tasks.workunit.client.1.smithi086.stdout:8/621: rename dc/d1f/d37/d4f/dac/db8/d7a/f8b to dc/d16/d18/fc8 0 2024-08-19T00:56:10.743 INFO:tasks.workunit.client.1.smithi086.stdout:4/625: read d2/f45 [139750,67790] 0 2024-08-19T00:56:10.743 INFO:tasks.workunit.client.0.smithi017.stdout:8/137: dread de/ff [0,4194304] 0 2024-08-19T00:56:10.744 INFO:tasks.workunit.client.0.smithi017.stdout:5/202: dwrite db/d19/d1f/d15/f25 [0,4194304] 0 2024-08-19T00:56:10.745 INFO:tasks.workunit.client.1.smithi086.stdout:2/648: creat d8/d24/d32/d4d/fd8 x:0 0 0 2024-08-19T00:56:10.747 INFO:tasks.workunit.client.0.smithi017.stdout:3/265: unlink d5/c47 0 2024-08-19T00:56:10.748 INFO:tasks.workunit.client.1.smithi086.stdout:5/658: truncate d0/d5f/d60/d57/f58 437494 0 2024-08-19T00:56:10.749 INFO:tasks.workunit.client.1.smithi086.stdout:3/668: getdents d3/d18/d27/d49/d3f/d5b/d66 0 2024-08-19T00:56:10.751 INFO:tasks.workunit.client.0.smithi017.stdout:9/230: mkdir d0/d33/d22/d45 0 2024-08-19T00:56:10.752 INFO:tasks.workunit.client.0.smithi017.stdout:9/231: fsync d0/d33/d22/d36/f3e 0 2024-08-19T00:56:10.752 INFO:tasks.workunit.client.0.smithi017.stdout:5/203: dread db/d19/d1f/d15/d1e/f3f [0,4194304] 0 2024-08-19T00:56:10.754 INFO:tasks.workunit.client.1.smithi086.stdout:6/653: truncate db/d37/d41/da7/f97 7265639 0 2024-08-19T00:56:10.754 INFO:tasks.workunit.client.0.smithi017.stdout:5/204: fsync db/d19/d1f/d15/d1e/f3f 0 2024-08-19T00:56:10.754 INFO:tasks.workunit.client.0.smithi017.stdout:9/232: write d0/d33/d22/f2f [1978643,41603] 0 2024-08-19T00:56:10.755 INFO:tasks.workunit.client.0.smithi017.stdout:5/205: dread - db/d19/d1f/d15/d30/f36 zero size 2024-08-19T00:56:10.758 INFO:tasks.workunit.client.1.smithi086.stdout:8/622: fsync dc/d1f/d37/d4f/dac/fbd 0 2024-08-19T00:56:10.760 INFO:tasks.workunit.client.0.smithi017.stdout:9/233: dread d0/fa [0,4194304] 0 2024-08-19T00:56:10.763 INFO:tasks.workunit.client.1.smithi086.stdout:2/649: dread d8/d43/f86 [0,4194304] 0 2024-08-19T00:56:10.765 INFO:tasks.workunit.client.0.smithi017.stdout:5/206: dwrite db/f24 [4194304,4194304] 0 2024-08-19T00:56:10.766 INFO:tasks.workunit.client.1.smithi086.stdout:6/654: rename db/d37/d44/d5a/d78/faa to db/d34/d4e/fd2 0 2024-08-19T00:56:10.767 INFO:tasks.workunit.client.0.smithi017.stdout:5/207: truncate db/d19/d1f/f50 928015 0 2024-08-19T00:56:10.767 INFO:tasks.workunit.client.0.smithi017.stdout:9/234: dread d0/fa [0,4194304] 0 2024-08-19T00:56:10.768 INFO:tasks.workunit.client.1.smithi086.stdout:0/660: dwrite da/d14/f6f [4194304,4194304] 0 2024-08-19T00:56:10.768 INFO:tasks.workunit.client.1.smithi086.stdout:4/626: dread d2/d18/d33/d42/f61 [0,4194304] 0 2024-08-19T00:56:10.770 INFO:tasks.workunit.client.1.smithi086.stdout:4/627: fsync d2/d18/d33/d42/d72/d78/f6d 0 2024-08-19T00:56:10.805 INFO:tasks.workunit.client.0.smithi017.stdout:4/208: sync 2024-08-19T00:56:10.807 INFO:tasks.workunit.client.0.smithi017.stdout:4/209: stat d2/d16/d43 0 2024-08-19T00:56:10.808 INFO:tasks.workunit.client.1.smithi086.stdout:8/623: mkdir dc/d1f/dc9 0 2024-08-19T00:56:10.808 INFO:tasks.workunit.client.0.smithi017.stdout:4/210: readlink d2/d16/l17 0 2024-08-19T00:56:10.809 INFO:tasks.workunit.client.1.smithi086.stdout:8/624: read - dc/d17/d86/fa9 zero size 2024-08-19T00:56:10.809 INFO:tasks.workunit.client.0.smithi017.stdout:8/138: mknod de/d15/d1f/c21 0 2024-08-19T00:56:10.812 INFO:tasks.workunit.client.1.smithi086.stdout:8/625: dread dc/d16/dc7/d2e/d28/d2b/fa5 [0,4194304] 0 2024-08-19T00:56:10.812 INFO:tasks.workunit.client.1.smithi086.stdout:8/626: chown dc/d16/d18/fc8 0 1 2024-08-19T00:56:10.813 INFO:tasks.workunit.client.1.smithi086.stdout:2/650: creat d8/d2c/d38/fd9 x:0 0 0 2024-08-19T00:56:10.813 INFO:tasks.workunit.client.0.smithi017.stdout:3/266: fsync d5/d11/f2a 0 2024-08-19T00:56:10.816 INFO:tasks.workunit.client.0.smithi017.stdout:5/208: fsync f6 0 2024-08-19T00:56:10.817 INFO:tasks.workunit.client.1.smithi086.stdout:6/655: fdatasync db/d34/d4e/f66 0 2024-08-19T00:56:10.820 INFO:tasks.workunit.client.0.smithi017.stdout:9/235: rename d0/d33/c28 to d0/d33/d22/d40/c46 0 2024-08-19T00:56:10.822 INFO:tasks.workunit.client.0.smithi017.stdout:4/211: mkdir d2/d21/d40/d44 0 2024-08-19T00:56:10.823 INFO:tasks.workunit.client.1.smithi086.stdout:8/627: dread dc/d16/d18/fa6 [0,4194304] 0 2024-08-19T00:56:10.824 INFO:tasks.workunit.client.1.smithi086.stdout:4/628: creat d2/d18/d33/d42/d72/d78/d2c/dae/fd6 x:0 0 0 2024-08-19T00:56:10.825 INFO:tasks.workunit.client.0.smithi017.stdout:8/139: fdatasync de/ff 0 2024-08-19T00:56:10.826 INFO:tasks.workunit.client.0.smithi017.stdout:9/236: dwrite d0/d33/f17 [0,4194304] 0 2024-08-19T00:56:10.830 INFO:tasks.workunit.client.1.smithi086.stdout:2/651: rename d8/d14/l5e to d8/d2c/d38/lda 0 2024-08-19T00:56:10.830 INFO:tasks.workunit.client.1.smithi086.stdout:2/652: chown d8/f11 108 1 2024-08-19T00:56:10.831 INFO:tasks.workunit.client.1.smithi086.stdout:2/653: write d8/f1e [4441982,84781] 0 2024-08-19T00:56:10.834 INFO:tasks.workunit.client.0.smithi017.stdout:5/209: unlink db/d19/d1f/l45 0 2024-08-19T00:56:10.835 INFO:tasks.workunit.client.0.smithi017.stdout:3/267: dwrite d5/d11/f2a [0,4194304] 0 2024-08-19T00:56:10.837 INFO:tasks.workunit.client.1.smithi086.stdout:6/656: creat db/d34/d69/fd3 x:0 0 0 2024-08-19T00:56:10.840 INFO:tasks.workunit.client.1.smithi086.stdout:0/661: dwrite da/d14/d1a/d2e/d39/d3b/f70 [0,4194304] 0 2024-08-19T00:56:10.842 INFO:tasks.workunit.client.0.smithi017.stdout:4/212: unlink d2/d11/d24/f31 0 2024-08-19T00:56:10.847 INFO:tasks.workunit.client.0.smithi017.stdout:3/268: creat d5/da/d27/f4c x:0 0 0 2024-08-19T00:56:10.848 INFO:tasks.workunit.client.0.smithi017.stdout:3/269: read d5/d11/f14 [3712473,4742] 0 2024-08-19T00:56:10.849 INFO:tasks.workunit.client.1.smithi086.stdout:2/654: creat d8/d24/d32/d4d/d6a/db1/fdb x:0 0 0 2024-08-19T00:56:10.852 INFO:tasks.workunit.client.0.smithi017.stdout:4/213: creat d2/d27/f45 x:0 0 0 2024-08-19T00:56:10.855 INFO:tasks.workunit.client.1.smithi086.stdout:0/662: mknod da/d14/d44/d49/cd3 0 2024-08-19T00:56:10.856 INFO:tasks.workunit.client.0.smithi017.stdout:3/270: dwrite d5/da/f3f [0,4194304] 0 2024-08-19T00:56:10.857 INFO:tasks.workunit.client.1.smithi086.stdout:5/659: sync 2024-08-19T00:56:10.857 INFO:tasks.workunit.client.1.smithi086.stdout:9/680: sync 2024-08-19T00:56:10.857 INFO:tasks.workunit.client.1.smithi086.stdout:7/665: sync 2024-08-19T00:56:10.858 INFO:tasks.workunit.client.1.smithi086.stdout:1/753: sync 2024-08-19T00:56:10.858 INFO:tasks.workunit.client.1.smithi086.stdout:8/628: mkdir dc/d1f/dc9/dca 0 2024-08-19T00:56:10.858 INFO:tasks.workunit.client.0.smithi017.stdout:5/210: mknod db/d19/d1f/d15/c51 0 2024-08-19T00:56:10.858 INFO:tasks.workunit.client.1.smithi086.stdout:5/660: chown d0/f29 317 1 2024-08-19T00:56:10.859 INFO:tasks.workunit.client.0.smithi017.stdout:0/187: sync 2024-08-19T00:56:10.860 INFO:tasks.workunit.client.1.smithi086.stdout:1/754: write d4/d7/d2a/d36/d63/d9f/fd5 [195640,44240] 0 2024-08-19T00:56:10.860 INFO:tasks.workunit.client.0.smithi017.stdout:0/188: write d5/f16 [3639058,126764] 0 2024-08-19T00:56:10.864 INFO:tasks.workunit.client.1.smithi086.stdout:6/657: truncate db/f13 907325 0 2024-08-19T00:56:10.865 INFO:tasks.workunit.client.1.smithi086.stdout:6/658: read db/f56 [141965,117433] 0 2024-08-19T00:56:10.865 INFO:tasks.workunit.client.0.smithi017.stdout:4/214: creat d2/d11/f46 x:0 0 0 2024-08-19T00:56:10.870 INFO:tasks.workunit.client.0.smithi017.stdout:3/271: symlink d5/da/d27/d28/l4d 0 2024-08-19T00:56:10.872 INFO:tasks.workunit.client.1.smithi086.stdout:5/661: mknod d0/df/d1f/d33/cca 0 2024-08-19T00:56:10.874 INFO:tasks.workunit.client.0.smithi017.stdout:3/272: dread d5/da/f3f [0,4194304] 0 2024-08-19T00:56:10.875 INFO:tasks.workunit.client.1.smithi086.stdout:2/655: mkdir d8/d14/dae/ddc 0 2024-08-19T00:56:10.875 INFO:tasks.workunit.client.1.smithi086.stdout:2/656: stat d8/d43/f86 0 2024-08-19T00:56:10.875 INFO:tasks.workunit.client.0.smithi017.stdout:3/273: write d5/da/d27/f4c [911686,60202] 0 2024-08-19T00:56:10.876 INFO:tasks.workunit.client.1.smithi086.stdout:1/755: rmdir d4/d7/d2a/d36/d7d/d88/d56 39 2024-08-19T00:56:10.876 INFO:tasks.workunit.client.0.smithi017.stdout:3/274: fsync d5/da/d27/d28/f37 0 2024-08-19T00:56:10.878 INFO:tasks.workunit.client.0.smithi017.stdout:0/189: fsync d5/d18/f1e 0 2024-08-19T00:56:10.880 INFO:tasks.workunit.client.0.smithi017.stdout:8/140: getdents de/d15/d1f 0 2024-08-19T00:56:10.881 INFO:tasks.workunit.client.1.smithi086.stdout:6/659: dread db/d34/d39/f40 [0,4194304] 0 2024-08-19T00:56:10.883 INFO:tasks.workunit.client.1.smithi086.stdout:4/629: getdents d2/d18/d33/d42/d72/d78 0 2024-08-19T00:56:10.884 INFO:tasks.workunit.client.1.smithi086.stdout:7/666: rmdir d3/d34/d44/d58/d4b/da5/daf 39 2024-08-19T00:56:10.885 INFO:tasks.workunit.client.1.smithi086.stdout:8/629: truncate dc/d16/dc7/d2e/d28/d2b/f5f 147384 0 2024-08-19T00:56:10.887 INFO:tasks.workunit.client.1.smithi086.stdout:1/756: readlink d4/d7/d2a/d6e/d95/l9a 0 2024-08-19T00:56:10.887 INFO:tasks.workunit.client.1.smithi086.stdout:0/663: creat da/d14/d26/fd4 x:0 0 0 2024-08-19T00:56:10.888 INFO:tasks.workunit.client.1.smithi086.stdout:6/660: mknod db/d37/d44/d5a/d78/cd4 0 2024-08-19T00:56:10.889 INFO:tasks.workunit.client.1.smithi086.stdout:6/661: write db/f46 [59040,97081] 0 2024-08-19T00:56:10.889 INFO:tasks.workunit.client.1.smithi086.stdout:4/630: creat d2/d18/d33/d42/d72/d2f/dc4/fd7 x:0 0 0 2024-08-19T00:56:10.890 INFO:tasks.workunit.client.1.smithi086.stdout:7/667: creat d3/de/d68/d72/d7e/dca/dcb/fe2 x:0 0 0 2024-08-19T00:56:10.890 INFO:tasks.workunit.client.1.smithi086.stdout:2/657: symlink d8/d43/ldd 0 2024-08-19T00:56:10.893 INFO:tasks.workunit.client.1.smithi086.stdout:1/757: truncate d4/d7/d2a/d36/d63/fc1 4934184 0 2024-08-19T00:56:10.893 INFO:tasks.workunit.client.1.smithi086.stdout:6/662: symlink db/d37/d41/ld5 0 2024-08-19T00:56:10.895 INFO:tasks.workunit.client.1.smithi086.stdout:8/630: rename dc/d1f/d37/d4f/la8 to dc/d1f/d37/d4f/dac/db8/d8f/lcb 0 2024-08-19T00:56:10.896 INFO:tasks.workunit.client.1.smithi086.stdout:7/668: rmdir d3/d34/d44/d58/d4b/da5/daf 39 2024-08-19T00:56:10.897 INFO:tasks.workunit.client.1.smithi086.stdout:7/669: chown d3/de/f15 30 1 2024-08-19T00:56:10.897 INFO:tasks.workunit.client.1.smithi086.stdout:7/670: stat d3/de/d2d/f31 0 2024-08-19T00:56:10.898 INFO:tasks.workunit.client.1.smithi086.stdout:6/663: creat db/d8e/fd6 x:0 0 0 2024-08-19T00:56:10.899 INFO:tasks.workunit.client.1.smithi086.stdout:7/671: dread d3/d34/d44/d58/d4b/da5/f74 [0,4194304] 0 2024-08-19T00:56:10.901 INFO:tasks.workunit.client.1.smithi086.stdout:2/658: creat d8/d43/d65/da9/fde x:0 0 0 2024-08-19T00:56:10.902 INFO:tasks.workunit.client.1.smithi086.stdout:4/631: rename d2/d18/d33/d42/d72/d78/d25/d55/l4c to d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/d85/ld8 0 2024-08-19T00:56:10.903 INFO:tasks.workunit.client.1.smithi086.stdout:8/631: stat dc/d16/dc7/d2e/d28/dc4/lc6 0 2024-08-19T00:56:10.903 INFO:tasks.workunit.client.1.smithi086.stdout:8/632: chown dc/d16/dc7/d2e/d28/dc4 4 1 2024-08-19T00:56:10.908 INFO:tasks.workunit.client.1.smithi086.stdout:0/664: write da/d14/d44/d49/f91 [1589242,86125] 0 2024-08-19T00:56:10.910 INFO:tasks.workunit.client.1.smithi086.stdout:8/633: dwrite dc/d1f/d37/d4f/dac/db8/d7a/d9b/fb9 [0,4194304] 0 2024-08-19T00:56:10.910 INFO:tasks.workunit.client.1.smithi086.stdout:7/672: link d3/de/d68/d7a/fbe d3/d34/d44/d58/d4b/d78/d9a/fe3 0 2024-08-19T00:56:10.910 INFO:tasks.workunit.client.1.smithi086.stdout:0/665: chown da/d14/d44/d49/f63 2698867 1 2024-08-19T00:56:10.911 INFO:tasks.workunit.client.1.smithi086.stdout:8/634: chown dc/d17/d1e 111751 1 2024-08-19T00:56:10.912 INFO:tasks.workunit.client.1.smithi086.stdout:4/632: creat d2/d18/dbd/fd9 x:0 0 0 2024-08-19T00:56:10.916 INFO:tasks.workunit.client.1.smithi086.stdout:0/666: creat da/d14/d1a/d2e/d39/d3b/d4e/fd5 x:0 0 0 2024-08-19T00:56:10.916 INFO:tasks.workunit.client.1.smithi086.stdout:4/633: write d2/d18/d33/f64 [1573429,91477] 0 2024-08-19T00:56:10.917 INFO:tasks.workunit.client.1.smithi086.stdout:6/664: write db/d37/d30/f72 [3655780,50467] 0 2024-08-19T00:56:10.920 INFO:tasks.workunit.client.1.smithi086.stdout:6/665: readlink db/d34/d4e/d68/d99/lbe 0 2024-08-19T00:56:10.922 INFO:tasks.workunit.client.1.smithi086.stdout:4/634: creat d2/d18/d33/d42/d72/dd0/fda x:0 0 0 2024-08-19T00:56:10.922 INFO:tasks.workunit.client.1.smithi086.stdout:7/673: dread d3/d34/d44/d58/d4b/da5/f5c [0,4194304] 0 2024-08-19T00:56:10.924 INFO:tasks.workunit.client.1.smithi086.stdout:1/758: dwrite d4/d7/f28 [0,4194304] 0 2024-08-19T00:56:10.924 INFO:tasks.workunit.client.1.smithi086.stdout:0/667: creat da/d14/d1a/d2e/d39/d3b/d89/dd1/fd6 x:0 0 0 2024-08-19T00:56:10.925 INFO:tasks.workunit.client.1.smithi086.stdout:8/635: dwrite dc/d16/dc7/d2e/d28/d2b/d3b/f3c [0,4194304] 0 2024-08-19T00:56:10.927 INFO:tasks.workunit.client.1.smithi086.stdout:4/635: read - d2/d18/d33/d42/d72/d78/d2c/dbc/fc3 zero size 2024-08-19T00:56:10.928 INFO:tasks.workunit.client.1.smithi086.stdout:7/674: getdents d3/dd9 0 2024-08-19T00:56:10.929 INFO:tasks.workunit.client.1.smithi086.stdout:7/675: readlink d3/d5b/l79 0 2024-08-19T00:56:10.930 INFO:tasks.workunit.client.1.smithi086.stdout:1/759: creat d4/d7/d2a/d36/d63/d84/d8e/ff5 x:0 0 0 2024-08-19T00:56:10.934 INFO:tasks.workunit.client.1.smithi086.stdout:1/760: fdatasync d4/d7/d2a/d36/d3a/d41/f67 0 2024-08-19T00:56:10.934 INFO:tasks.workunit.client.1.smithi086.stdout:6/666: dwrite db/d34/d4e/db4/fba [0,4194304] 0 2024-08-19T00:56:10.938 INFO:tasks.workunit.client.1.smithi086.stdout:1/761: write d4/d7/d2a/f33 [825662,95513] 0 2024-08-19T00:56:10.940 INFO:tasks.workunit.client.1.smithi086.stdout:6/667: rmdir db/d37/d41/dad 39 2024-08-19T00:56:10.941 INFO:tasks.workunit.client.1.smithi086.stdout:4/636: dwrite d2/d18/d33/d42/d72/d78/d9e/fc7 [0,4194304] 0 2024-08-19T00:56:10.945 INFO:tasks.workunit.client.1.smithi086.stdout:8/636: link dc/d16/dc7/d2e/d28/d41/d9a/f9e dc/d16/dc7/d2e/d83/fcc 0 2024-08-19T00:56:10.946 INFO:tasks.workunit.client.1.smithi086.stdout:6/668: chown db/d37/d44/d5a/fbb 0 1 2024-08-19T00:56:10.946 INFO:tasks.workunit.client.1.smithi086.stdout:7/676: creat d3/d34/d44/fe4 x:0 0 0 2024-08-19T00:56:10.946 INFO:tasks.workunit.client.1.smithi086.stdout:1/762: write d4/d7/d2a/d36/d3a/d41/ff1 [119049,24661] 0 2024-08-19T00:56:10.952 INFO:tasks.workunit.client.1.smithi086.stdout:0/668: dwrite da/d14/d1a/d2e/f62 [0,4194304] 0 2024-08-19T00:56:10.958 INFO:tasks.workunit.client.1.smithi086.stdout:8/637: mkdir dc/d1f/d37/d4f/dac/db8/d7a/d88/dcd 0 2024-08-19T00:56:10.959 INFO:tasks.workunit.client.1.smithi086.stdout:0/669: rmdir da/d5d/da9/d6a 39 2024-08-19T00:56:10.960 INFO:tasks.workunit.client.1.smithi086.stdout:3/669: sync 2024-08-19T00:56:10.960 INFO:tasks.workunit.client.1.smithi086.stdout:4/637: dwrite d2/d18/d33/d42/d72/d2f/fc5 [0,4194304] 0 2024-08-19T00:56:10.961 INFO:tasks.workunit.client.0.smithi017.stdout:9/237: getdents d0 0 2024-08-19T00:56:10.962 INFO:tasks.workunit.client.1.smithi086.stdout:7/677: rename d3/de/d68/d7a/cde to d3/de/d68/d72/d7e/ce5 0 2024-08-19T00:56:10.962 INFO:tasks.workunit.client.1.smithi086.stdout:4/638: write d2/d18/d33/f5e [1830604,83] 0 2024-08-19T00:56:10.963 INFO:tasks.workunit.client.1.smithi086.stdout:7/678: dread - d3/de/d68/d7d/fb3 zero size 2024-08-19T00:56:10.965 INFO:tasks.workunit.client.0.smithi017.stdout:9/238: read d0/d33/f29 [175768,118406] 0 2024-08-19T00:56:10.970 INFO:tasks.workunit.client.0.smithi017.stdout:0/190: dwrite d5/d17/d21/f2d [0,4194304] 0 2024-08-19T00:56:10.970 INFO:tasks.workunit.client.1.smithi086.stdout:8/638: creat dc/d1f/dc9/fce x:0 0 0 2024-08-19T00:56:10.972 INFO:tasks.workunit.client.0.smithi017.stdout:3/275: mknod d5/c4e 0 2024-08-19T00:56:10.972 INFO:tasks.workunit.client.0.smithi017.stdout:8/141: dwrite de/f12 [0,4194304] 0 2024-08-19T00:56:10.973 INFO:tasks.workunit.client.0.smithi017.stdout:8/142: chown de/d15 5146047 1 2024-08-19T00:56:10.974 INFO:tasks.workunit.client.1.smithi086.stdout:1/763: dread d4/d7/d2a/d36/d63/f80 [0,4194304] 0 2024-08-19T00:56:10.980 INFO:tasks.workunit.client.1.smithi086.stdout:7/679: mknod d3/d5b/ce6 0 2024-08-19T00:56:10.984 INFO:tasks.workunit.client.0.smithi017.stdout:9/239: creat d0/f47 x:0 0 0 2024-08-19T00:56:10.986 INFO:tasks.workunit.client.0.smithi017.stdout:5/211: link f6 db/d19/d1f/d15/f52 0 2024-08-19T00:56:10.986 INFO:tasks.workunit.client.1.smithi086.stdout:8/639: unlink dc/d17/d1e/d55/f6a 0 2024-08-19T00:56:10.988 INFO:tasks.workunit.client.1.smithi086.stdout:3/670: dwrite d3/d18/f24 [0,4194304] 0 2024-08-19T00:56:10.989 INFO:tasks.workunit.client.1.smithi086.stdout:1/764: symlink d4/d10/d90/lf6 0 2024-08-19T00:56:10.991 INFO:tasks.workunit.client.1.smithi086.stdout:6/669: truncate db/d37/d44/f4f 1985479 0 2024-08-19T00:56:10.995 INFO:tasks.workunit.client.0.smithi017.stdout:3/276: mkdir d5/da/d3c/d4f 0 2024-08-19T00:56:10.996 INFO:tasks.workunit.client.1.smithi086.stdout:3/671: rename d3/d18/d27/d49/d3f/d5b/d8f/c9e to d3/d18/d19/dbc/cda 0 2024-08-19T00:56:10.998 INFO:tasks.workunit.client.1.smithi086.stdout:6/670: symlink db/d37/d44/ld7 0 2024-08-19T00:56:10.998 INFO:tasks.workunit.client.1.smithi086.stdout:0/670: dread da/f46 [4194304,4194304] 0 2024-08-19T00:56:10.999 INFO:tasks.workunit.client.0.smithi017.stdout:5/212: creat db/d19/d33/f53 x:0 0 0 2024-08-19T00:56:10.999 INFO:tasks.workunit.client.1.smithi086.stdout:4/639: write d2/d18/d33/d42/d72/d78/d25/f5f [831556,20896] 0 2024-08-19T00:56:11.000 INFO:tasks.workunit.client.0.smithi017.stdout:5/213: fsync db/f2e 0 2024-08-19T00:56:11.000 INFO:tasks.workunit.client.1.smithi086.stdout:1/765: dwrite d4/d10/d90/d98/fbd [0,4194304] 0 2024-08-19T00:56:11.002 INFO:tasks.workunit.client.1.smithi086.stdout:4/640: write d2/f26 [3055441,118501] 0 2024-08-19T00:56:11.002 INFO:tasks.workunit.client.0.smithi017.stdout:8/143: getdents de/d15/d1f 0 2024-08-19T00:56:11.003 INFO:tasks.workunit.client.0.smithi017.stdout:8/144: chown de/d15/d1f/c21 14885160 1 2024-08-19T00:56:11.003 INFO:tasks.workunit.client.0.smithi017.stdout:0/191: mknod d5/d17/d2b/c3d 0 2024-08-19T00:56:11.004 INFO:tasks.workunit.client.0.smithi017.stdout:0/192: stat d5/d18/f23 0 2024-08-19T00:56:11.008 INFO:tasks.workunit.client.1.smithi086.stdout:3/672: creat d3/d26/d2b/d33/d4a/d57/d8a/fdb x:0 0 0 2024-08-19T00:56:11.011 INFO:tasks.workunit.client.0.smithi017.stdout:8/145: dwrite de/f12 [0,4194304] 0 2024-08-19T00:56:11.012 INFO:tasks.workunit.client.1.smithi086.stdout:1/766: symlink d4/d7/d2a/d6e/lf7 0 2024-08-19T00:56:11.014 INFO:tasks.workunit.client.1.smithi086.stdout:4/641: symlink d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/ldb 0 2024-08-19T00:56:11.016 INFO:tasks.workunit.client.1.smithi086.stdout:4/642: chown d2/d18/d33/d42/d72/d78/d9e/dc6 380747607 1 2024-08-19T00:56:11.017 INFO:tasks.workunit.client.0.smithi017.stdout:0/193: mkdir d5/d17/d26/d30/d3e 0 2024-08-19T00:56:11.018 INFO:tasks.workunit.client.1.smithi086.stdout:6/671: mknod db/d34/d4e/d68/cd8 0 2024-08-19T00:56:11.021 INFO:tasks.workunit.client.0.smithi017.stdout:0/194: dread d5/d18/f24 [0,4194304] 0 2024-08-19T00:56:11.023 INFO:tasks.workunit.client.1.smithi086.stdout:1/767: symlink d4/d7/d2a/d6e/d95/db9/lf8 0 2024-08-19T00:56:11.024 INFO:tasks.workunit.client.0.smithi017.stdout:5/214: symlink db/d19/d1f/d15/l54 0 2024-08-19T00:56:11.025 INFO:tasks.workunit.client.1.smithi086.stdout:4/643: dwrite d2/d18/d33/d42/d72/f16 [4194304,4194304] 0 2024-08-19T00:56:11.026 INFO:tasks.workunit.client.0.smithi017.stdout:3/277: truncate f2 1726358 0 2024-08-19T00:56:11.027 INFO:tasks.workunit.client.1.smithi086.stdout:3/673: write d3/d18/d19/d37/fa6 [67730,113945] 0 2024-08-19T00:56:11.028 INFO:tasks.workunit.client.0.smithi017.stdout:0/195: dwrite d5/d17/d26/d30/f33 [0,4194304] 0 2024-08-19T00:56:11.030 INFO:tasks.workunit.client.0.smithi017.stdout:7/290: sync 2024-08-19T00:56:11.031 INFO:tasks.workunit.client.0.smithi017.stdout:6/198: sync 2024-08-19T00:56:11.031 INFO:tasks.workunit.client.0.smithi017.stdout:2/266: sync 2024-08-19T00:56:11.031 INFO:tasks.workunit.client.0.smithi017.stdout:1/227: sync 2024-08-19T00:56:11.036 INFO:tasks.workunit.client.1.smithi086.stdout:4/644: symlink d2/d18/d33/d42/d72/d78/d25/d55/d4d/ldc 0 2024-08-19T00:56:11.036 INFO:tasks.workunit.client.1.smithi086.stdout:1/768: creat d4/d10/ff9 x:0 0 0 2024-08-19T00:56:11.036 INFO:tasks.workunit.client.0.smithi017.stdout:3/278: dread d5/d11/f3e [0,4194304] 0 2024-08-19T00:56:11.037 INFO:tasks.workunit.client.1.smithi086.stdout:3/674: write d3/d26/d2b/d33/d4a/d57/d8a/fdb [585413,122461] 0 2024-08-19T00:56:11.037 INFO:tasks.workunit.client.0.smithi017.stdout:9/240: creat d0/f48 x:0 0 0 2024-08-19T00:56:11.038 INFO:tasks.workunit.client.1.smithi086.stdout:8/640: dread dc/f1c [0,4194304] 0 2024-08-19T00:56:11.040 INFO:tasks.workunit.client.0.smithi017.stdout:1/228: dread d4/f10 [0,4194304] 0 2024-08-19T00:56:11.040 INFO:tasks.workunit.client.1.smithi086.stdout:8/641: write dc/d1f/d37/d4f/dac/db8/d7a/d9b/fb9 [852937,60642] 0 2024-08-19T00:56:11.042 INFO:tasks.workunit.client.0.smithi017.stdout:6/199: creat d5/d13/d11/d2c/f46 x:0 0 0 2024-08-19T00:56:11.043 INFO:tasks.workunit.client.0.smithi017.stdout:6/200: dread - d5/d13/f1f zero size 2024-08-19T00:56:11.044 INFO:tasks.workunit.client.0.smithi017.stdout:6/201: dread - d5/d13/d11/f3f zero size 2024-08-19T00:56:11.048 INFO:tasks.workunit.client.1.smithi086.stdout:0/671: dread da/d14/d44/d49/f63 [0,4194304] 0 2024-08-19T00:56:11.049 INFO:tasks.workunit.client.0.smithi017.stdout:3/279: creat d5/da/d3c/f50 x:0 0 0 2024-08-19T00:56:11.051 INFO:tasks.workunit.client.0.smithi017.stdout:7/291: mknod d3/dc/df/c5a 0 2024-08-19T00:56:11.054 INFO:tasks.workunit.client.0.smithi017.stdout:8/146: dwrite f0 [4194304,4194304] 0 2024-08-19T00:56:11.054 INFO:tasks.workunit.client.0.smithi017.stdout:0/196: write d5/d18/f1e [1778897,17625] 0 2024-08-19T00:56:11.056 INFO:tasks.workunit.client.0.smithi017.stdout:1/229: mkdir d4/dc/d3b/d45 0 2024-08-19T00:56:11.057 INFO:tasks.workunit.client.0.smithi017.stdout:1/230: chown d4/ff 62 1 2024-08-19T00:56:11.058 INFO:tasks.workunit.client.0.smithi017.stdout:1/231: read d4/f14 [57560,97281] 0 2024-08-19T00:56:11.060 INFO:tasks.workunit.client.1.smithi086.stdout:9/681: sync 2024-08-19T00:56:11.061 INFO:tasks.workunit.client.0.smithi017.stdout:9/241: mkdir d0/d33/d22/d36/d49 0 2024-08-19T00:56:11.062 INFO:tasks.workunit.client.1.smithi086.stdout:9/682: dread db/dd/d19/d38/fa2 [0,4194304] 0 2024-08-19T00:56:11.062 INFO:tasks.workunit.client.0.smithi017.stdout:3/280: chown d5/c1d 1064697 1 2024-08-19T00:56:11.066 INFO:tasks.workunit.client.0.smithi017.stdout:5/215: getdents db 0 2024-08-19T00:56:11.066 INFO:tasks.workunit.client.0.smithi017.stdout:5/216: stat db/d19/d33 0 2024-08-19T00:56:11.067 INFO:tasks.workunit.client.0.smithi017.stdout:5/217: chown db/d19/d1f/d15/c16 37297642 1 2024-08-19T00:56:11.068 INFO:tasks.workunit.client.0.smithi017.stdout:8/147: dread de/f1d [0,4194304] 0 2024-08-19T00:56:11.069 INFO:tasks.workunit.client.0.smithi017.stdout:0/197: fdatasync d5/f1c 0 2024-08-19T00:56:11.070 INFO:tasks.workunit.client.0.smithi017.stdout:0/198: write d5/d17/d26/d30/f38 [1520913,54649] 0 2024-08-19T00:56:11.073 INFO:tasks.workunit.client.0.smithi017.stdout:2/267: rename d2/d7/d10/d3b/d3c/d4b to d2/d7/d10/d3b/d54 0 2024-08-19T00:56:11.077 INFO:tasks.workunit.client.0.smithi017.stdout:6/202: write d5/d13/f1b [1193138,36474] 0 2024-08-19T00:56:11.077 INFO:tasks.workunit.client.0.smithi017.stdout:0/199: dwrite d5/d17/f1a [4194304,4194304] 0 2024-08-19T00:56:11.081 INFO:tasks.workunit.client.0.smithi017.stdout:3/281: symlink d5/d11/l51 0 2024-08-19T00:56:11.082 INFO:tasks.workunit.client.0.smithi017.stdout:3/282: chown d5/d15/c19 621 1 2024-08-19T00:56:11.084 INFO:tasks.workunit.client.0.smithi017.stdout:7/292: unlink d3/dc/df/d1c/d2c/d2f/f53 0 2024-08-19T00:56:11.087 INFO:tasks.workunit.client.0.smithi017.stdout:8/148: rename de/f1d to de/f22 0 2024-08-19T00:56:11.095 INFO:tasks.workunit.client.0.smithi017.stdout:0/200: creat d5/d17/d2b/f3f x:0 0 0 2024-08-19T00:56:11.096 INFO:tasks.workunit.client.0.smithi017.stdout:0/201: chown d5/d1b/f1d 1 1 2024-08-19T00:56:11.099 INFO:tasks.workunit.client.0.smithi017.stdout:3/283: unlink d5/d11/f33 0 2024-08-19T00:56:11.106 INFO:tasks.workunit.client.0.smithi017.stdout:1/232: creat d4/d1c/f46 x:0 0 0 2024-08-19T00:56:11.107 INFO:tasks.workunit.client.1.smithi086.stdout:7/680: sync 2024-08-19T00:56:11.107 INFO:tasks.workunit.client.1.smithi086.stdout:5/662: sync 2024-08-19T00:56:11.107 INFO:tasks.workunit.client.1.smithi086.stdout:2/659: sync 2024-08-19T00:56:11.108 INFO:tasks.workunit.client.0.smithi017.stdout:1/233: chown d4/dc/d17/d1d/c35 2218 1 2024-08-19T00:56:11.108 INFO:tasks.workunit.client.0.smithi017.stdout:1/234: readlink d4/l39 0 2024-08-19T00:56:11.109 INFO:tasks.workunit.client.0.smithi017.stdout:1/235: dread - d4/dc/d17/d1d/f3c zero size 2024-08-19T00:56:11.110 INFO:tasks.workunit.client.0.smithi017.stdout:9/242: creat d0/d33/d22/f4a x:0 0 0 2024-08-19T00:56:11.111 INFO:tasks.workunit.client.0.smithi017.stdout:0/202: symlink d5/d18/d3a/l40 0 2024-08-19T00:56:11.112 INFO:tasks.workunit.client.0.smithi017.stdout:0/203: chown d5/d18/d3a 1 1 2024-08-19T00:56:11.116 INFO:tasks.workunit.client.0.smithi017.stdout:9/243: dwrite d0/d33/f2d [0,4194304] 0 2024-08-19T00:56:11.116 INFO:tasks.workunit.client.0.smithi017.stdout:9/244: dread - d0/d33/f39 zero size 2024-08-19T00:56:11.120 INFO:tasks.workunit.client.0.smithi017.stdout:2/268: truncate d2/d7/dd/f15 6082124 0 2024-08-19T00:56:11.123 INFO:tasks.workunit.client.0.smithi017.stdout:1/236: mkdir d4/d1c/d1f/d47 0 2024-08-19T00:56:11.124 INFO:tasks.workunit.client.0.smithi017.stdout:6/203: write d5/f36 [1230453,84120] 0 2024-08-19T00:56:11.126 INFO:tasks.workunit.client.0.smithi017.stdout:0/204: symlink d5/d17/d2b/l41 0 2024-08-19T00:56:11.127 INFO:tasks.workunit.client.0.smithi017.stdout:0/205: chown d5/d1b/l3c 134609290 1 2024-08-19T00:56:11.128 INFO:tasks.workunit.client.0.smithi017.stdout:3/284: creat d5/da/d3c/d4f/f52 x:0 0 0 2024-08-19T00:56:11.130 INFO:tasks.workunit.client.0.smithi017.stdout:9/245: chown d0/f34 263262 1 2024-08-19T00:56:11.131 INFO:tasks.workunit.client.0.smithi017.stdout:7/293: truncate d3/f5 2252947 0 2024-08-19T00:56:11.133 INFO:tasks.workunit.client.0.smithi017.stdout:7/294: truncate d3/dc/df/d1c/d2c/d2f/f56 68232 0 2024-08-19T00:56:11.134 INFO:tasks.workunit.client.1.smithi086.stdout:1/769: symlink d4/d7/d2a/d6e/d95/db9/lfa 0 2024-08-19T00:56:11.135 INFO:tasks.workunit.client.1.smithi086.stdout:1/770: chown d4/d1e/c2f 421344 1 2024-08-19T00:56:11.136 INFO:tasks.workunit.client.0.smithi017.stdout:0/206: chown d5/d17/d26/l37 463 1 2024-08-19T00:56:11.137 INFO:tasks.workunit.client.0.smithi017.stdout:3/285: fdatasync d5/ff 0 2024-08-19T00:56:11.138 INFO:tasks.workunit.client.0.smithi017.stdout:3/286: chown d5/da/d27/d28/l4d 11200089 1 2024-08-19T00:56:11.141 INFO:tasks.workunit.client.0.smithi017.stdout:8/149: getdents de/d15 0 2024-08-19T00:56:11.143 INFO:tasks.workunit.client.1.smithi086.stdout:6/672: truncate db/d37/d44/f4f 414507 0 2024-08-19T00:56:11.144 INFO:tasks.workunit.client.1.smithi086.stdout:0/672: mkdir da/d14/d1a/d2e/d7e/dd7 0 2024-08-19T00:56:11.145 INFO:tasks.workunit.client.1.smithi086.stdout:0/673: chown da/l86 404681 1 2024-08-19T00:56:11.146 INFO:tasks.workunit.client.0.smithi017.stdout:7/295: creat d3/dc/f5b x:0 0 0 2024-08-19T00:56:11.148 INFO:tasks.workunit.client.1.smithi086.stdout:9/683: rename db/dd/d19/d18/l60 to db/dd/d19/d18/db9/ldc 0 2024-08-19T00:56:11.148 INFO:tasks.workunit.client.1.smithi086.stdout:9/684: chown db/dd/d19/d38/f53 11559 1 2024-08-19T00:56:11.148 INFO:tasks.workunit.client.0.smithi017.stdout:1/237: mknod d4/dc/c48 0 2024-08-19T00:56:11.149 INFO:tasks.workunit.client.1.smithi086.stdout:5/663: symlink d0/d5f/d60/d57/d80/da3/lcb 0 2024-08-19T00:56:11.150 INFO:tasks.workunit.client.0.smithi017.stdout:6/204: mknod d5/c47 0 2024-08-19T00:56:11.151 INFO:tasks.workunit.client.0.smithi017.stdout:0/207: fdatasync d5/f1c 0 2024-08-19T00:56:11.155 INFO:tasks.workunit.client.1.smithi086.stdout:4/645: link d2/d18/d33/d42/d72/d78/d25/d55/d4d/fcf d2/d18/d33/d42/d72/d2f/fdd 0 2024-08-19T00:56:11.155 INFO:tasks.workunit.client.1.smithi086.stdout:5/664: dwrite d0/f6 [8388608,4194304] 0 2024-08-19T00:56:11.155 INFO:tasks.workunit.client.1.smithi086.stdout:3/675: write d3/d18/f2c [5174684,38030] 0 2024-08-19T00:56:11.156 INFO:tasks.workunit.client.1.smithi086.stdout:8/642: unlink dc/d17/d1e/l35 0 2024-08-19T00:56:11.158 INFO:tasks.workunit.client.0.smithi017.stdout:8/150: mknod de/d15/c23 0 2024-08-19T00:56:11.159 INFO:tasks.workunit.client.0.smithi017.stdout:8/151: fdatasync de/f12 0 2024-08-19T00:56:11.160 INFO:tasks.workunit.client.0.smithi017.stdout:7/296: creat d3/d3c/f5c x:0 0 0 2024-08-19T00:56:11.162 INFO:tasks.workunit.client.0.smithi017.stdout:9/246: write d0/d33/f2e [299033,19717] 0 2024-08-19T00:56:11.162 INFO:tasks.workunit.client.0.smithi017.stdout:7/297: dread - d3/d3c/f5c zero size 2024-08-19T00:56:11.168 INFO:tasks.workunit.client.0.smithi017.stdout:2/269: truncate d2/d7/f28 5172986 0 2024-08-19T00:56:11.170 INFO:tasks.workunit.client.0.smithi017.stdout:7/298: dwrite d3/d3c/f5c [0,4194304] 0 2024-08-19T00:56:11.171 INFO:tasks.workunit.client.1.smithi086.stdout:9/685: truncate db/d26/d5c/d87/d30/d58/f95 357418 0 2024-08-19T00:56:11.174 INFO:tasks.workunit.client.0.smithi017.stdout:2/270: dread d2/d7/d10/f3e [0,4194304] 0 2024-08-19T00:56:11.175 INFO:tasks.workunit.client.1.smithi086.stdout:5/665: chown d0/d2d/d43/d91 405186 1 2024-08-19T00:56:11.178 INFO:tasks.workunit.client.1.smithi086.stdout:3/676: creat d3/d18/d19/fdc x:0 0 0 2024-08-19T00:56:11.179 INFO:tasks.workunit.client.0.smithi017.stdout:2/271: dread d2/d7/d10/d19/f39 [0,4194304] 0 2024-08-19T00:56:11.183 INFO:tasks.workunit.client.1.smithi086.stdout:4/646: dwrite d2/d18/d33/d42/d72/f37 [4194304,4194304] 0 2024-08-19T00:56:11.184 INFO:tasks.workunit.client.0.smithi017.stdout:8/152: chown de/d15/l1a 53138350 1 2024-08-19T00:56:11.188 INFO:tasks.workunit.client.1.smithi086.stdout:9/686: unlink db/d96/lbb 0 2024-08-19T00:56:11.189 INFO:tasks.workunit.client.1.smithi086.stdout:0/674: write da/d14/d1a/d2e/d39/f85 [56053,31538] 0 2024-08-19T00:56:11.189 INFO:tasks.workunit.client.1.smithi086.stdout:1/771: creat d4/d7/d2a/d36/ffb x:0 0 0 2024-08-19T00:56:11.194 INFO:tasks.workunit.client.1.smithi086.stdout:6/673: dwrite db/d37/d30/f3a [0,4194304] 0 2024-08-19T00:56:11.194 INFO:tasks.workunit.client.1.smithi086.stdout:4/647: dwrite d2/d18/d33/d42/d72/d78/d25/f3a [0,4194304] 0 2024-08-19T00:56:11.195 INFO:tasks.workunit.client.0.smithi017.stdout:6/205: dwrite d5/f18 [0,4194304] 0 2024-08-19T00:56:11.196 INFO:tasks.workunit.client.1.smithi086.stdout:6/674: truncate db/d37/d41/da7/f8d 677994 0 2024-08-19T00:56:11.200 INFO:tasks.workunit.client.1.smithi086.stdout:8/643: write dc/d1f/d37/f74 [681705,53455] 0 2024-08-19T00:56:11.203 INFO:tasks.workunit.client.0.smithi017.stdout:1/238: rmdir d4/d1c/d1f/d47 0 2024-08-19T00:56:11.204 INFO:tasks.workunit.client.0.smithi017.stdout:1/239: chown d4/dc/f38 2827 1 2024-08-19T00:56:11.205 INFO:tasks.workunit.client.1.smithi086.stdout:4/648: dwrite d2/d18/d33/d42/d72/d78/d25/f3a [0,4194304] 0 2024-08-19T00:56:11.206 INFO:tasks.workunit.client.0.smithi017.stdout:2/272: mkdir d2/d7/d10/d35/d55 0 2024-08-19T00:56:11.208 INFO:tasks.workunit.client.0.smithi017.stdout:9/247: mknod d0/c4b 0 2024-08-19T00:56:11.208 INFO:tasks.workunit.client.0.smithi017.stdout:2/273: write d2/d7/d10/d3b/d3c/f40 [4175833,88987] 0 2024-08-19T00:56:11.209 INFO:tasks.workunit.client.0.smithi017.stdout:1/240: truncate d4/dc/d17/d1d/f3c 682190 0 2024-08-19T00:56:11.209 INFO:tasks.workunit.client.0.smithi017.stdout:8/153: rmdir de/d15 39 2024-08-19T00:56:11.212 INFO:tasks.workunit.client.1.smithi086.stdout:4/649: dwrite d2/d18/d33/d42/d72/f16 [0,4194304] 0 2024-08-19T00:56:11.215 INFO:tasks.workunit.client.1.smithi086.stdout:8/644: rmdir dc 39 2024-08-19T00:56:11.219 INFO:tasks.workunit.client.1.smithi086.stdout:5/666: creat d0/d2d/d43/fcc x:0 0 0 2024-08-19T00:56:11.219 INFO:tasks.workunit.client.1.smithi086.stdout:4/650: dwrite d2/f69 [8388608,4194304] 0 2024-08-19T00:56:11.222 INFO:tasks.workunit.client.0.smithi017.stdout:0/208: truncate d5/d17/f1a 5615691 0 2024-08-19T00:56:11.223 INFO:tasks.workunit.client.0.smithi017.stdout:0/209: write d5/f11 [959041,35072] 0 2024-08-19T00:56:11.224 INFO:tasks.workunit.client.0.smithi017.stdout:0/210: write d5/fc [191118,13770] 0 2024-08-19T00:56:11.228 INFO:tasks.workunit.client.1.smithi086.stdout:1/772: mknod d4/d7/d2a/d36/cfc 0 2024-08-19T00:56:11.229 INFO:tasks.workunit.client.0.smithi017.stdout:9/248: chown d0/c2a 1285 1 2024-08-19T00:56:11.231 INFO:tasks.workunit.client.0.smithi017.stdout:1/241: mknod d4/dc/d3b/c49 0 2024-08-19T00:56:11.232 INFO:tasks.workunit.client.1.smithi086.stdout:3/677: dwrite d3/d26/d2b/f38 [0,4194304] 0 2024-08-19T00:56:11.233 INFO:tasks.workunit.client.1.smithi086.stdout:3/678: fsync d3/d18/d19/f55 0 2024-08-19T00:56:11.235 INFO:tasks.workunit.client.1.smithi086.stdout:4/651: symlink d2/d18/d33/d42/d72/d78/d25/lde 0 2024-08-19T00:56:11.236 INFO:tasks.workunit.client.0.smithi017.stdout:2/274: symlink d2/d7/d44/l56 0 2024-08-19T00:56:11.239 INFO:tasks.workunit.client.0.smithi017.stdout:7/299: truncate d3/dc/df/d1a/f3b 568481 0 2024-08-19T00:56:11.241 INFO:tasks.workunit.client.1.smithi086.stdout:9/687: dread db/d26/d5c/d87/d37/f4a [0,4194304] 0 2024-08-19T00:56:11.242 INFO:tasks.workunit.client.1.smithi086.stdout:1/773: dwrite d4/d7/d2a/d36/d63/d84/d8e/fd6 [0,4194304] 0 2024-08-19T00:56:11.245 INFO:tasks.workunit.client.0.smithi017.stdout:0/211: rename d5/d1b to d5/d17/d21/d42 0 2024-08-19T00:56:11.247 INFO:tasks.workunit.client.1.smithi086.stdout:0/675: dread da/d14/d26/f68 [4194304,4194304] 0 2024-08-19T00:56:11.248 INFO:tasks.workunit.client.1.smithi086.stdout:3/679: dwrite d3/d18/d19/dbc/db8/dc9/fcf [0,4194304] 0 2024-08-19T00:56:11.249 INFO:tasks.workunit.client.0.smithi017.stdout:1/242: readlink d4/l37 0 2024-08-19T00:56:11.249 INFO:tasks.workunit.client.0.smithi017.stdout:7/300: dwrite d3/dc/df/d1c/d2c/d35/f59 [0,4194304] 0 2024-08-19T00:56:11.250 INFO:tasks.workunit.client.0.smithi017.stdout:2/275: creat d2/d7/d44/f57 x:0 0 0 2024-08-19T00:56:11.251 INFO:tasks.workunit.client.0.smithi017.stdout:1/243: write d4/dc/f34 [4521815,66436] 0 2024-08-19T00:56:11.251 INFO:tasks.workunit.client.0.smithi017.stdout:7/301: chown d3/dc/df/d1c/l22 6004 1 2024-08-19T00:56:11.253 INFO:tasks.workunit.client.0.smithi017.stdout:2/276: dread - d2/d7/d10/d3b/d3c/f3d zero size 2024-08-19T00:56:11.253 INFO:tasks.workunit.client.0.smithi017.stdout:9/249: getdents d0/d33/d22/d36/d49 0 2024-08-19T00:56:11.254 INFO:tasks.workunit.client.1.smithi086.stdout:1/774: truncate d4/d7/d2a/d6e/d95/db9/deb/fec 1040814 0 2024-08-19T00:56:11.254 INFO:tasks.workunit.client.1.smithi086.stdout:9/688: symlink db/d26/d5c/d87/d30/d58/ldd 0 2024-08-19T00:56:11.255 INFO:tasks.workunit.client.0.smithi017.stdout:0/212: creat d5/d17/d2b/f43 x:0 0 0 2024-08-19T00:56:11.255 INFO:tasks.workunit.client.1.smithi086.stdout:8/645: dread dc/d16/dc7/d2e/d28/d2b/fa5 [0,4194304] 0 2024-08-19T00:56:11.258 INFO:tasks.workunit.client.1.smithi086.stdout:4/652: dread d2/d18/d33/d42/d72/d78/d2c/db0/fc2 [0,4194304] 0 2024-08-19T00:56:11.259 INFO:tasks.workunit.client.1.smithi086.stdout:8/646: chown dc/d1f/d37/d4f/dac/db8/d7a 334401899 1 2024-08-19T00:56:11.259 INFO:tasks.workunit.client.1.smithi086.stdout:0/676: dread da/f46 [4194304,4194304] 0 2024-08-19T00:56:11.259 INFO:tasks.workunit.client.1.smithi086.stdout:9/689: chown db/d26/d5c/d87/d30/d32/f3a 26354333 1 2024-08-19T00:56:11.260 INFO:tasks.workunit.client.1.smithi086.stdout:0/677: stat da/d97/lb3 0 2024-08-19T00:56:11.261 INFO:tasks.workunit.client.1.smithi086.stdout:0/678: fsync da/d14/d44/f5a 0 2024-08-19T00:56:11.263 INFO:tasks.workunit.client.0.smithi017.stdout:7/302: dwrite d3/dc/df/d1c/f3e [4194304,4194304] 0 2024-08-19T00:56:11.264 INFO:tasks.workunit.client.1.smithi086.stdout:9/690: dread db/d26/d5c/d87/d30/f9c [0,4194304] 0 2024-08-19T00:56:11.266 INFO:tasks.workunit.client.0.smithi017.stdout:1/244: creat d4/dc/d3b/f4a x:0 0 0 2024-08-19T00:56:11.266 INFO:tasks.workunit.client.1.smithi086.stdout:5/667: dwrite d0/df/f23 [0,4194304] 0 2024-08-19T00:56:11.266 INFO:tasks.workunit.client.0.smithi017.stdout:0/213: dwrite d5/d17/d26/d30/f38 [0,4194304] 0 2024-08-19T00:56:11.267 INFO:tasks.workunit.client.0.smithi017.stdout:1/245: chown d4/dc/d3b/d3d 413275385 1 2024-08-19T00:56:11.268 INFO:tasks.workunit.client.1.smithi086.stdout:1/775: rename d4/d1e/f20 to d4/d7/d2a/d36/d3a/de5/d7a/ffd 0 2024-08-19T00:56:11.271 INFO:tasks.workunit.client.1.smithi086.stdout:8/647: chown dc/c1d 2 1 2024-08-19T00:56:11.272 INFO:tasks.workunit.client.1.smithi086.stdout:8/648: stat dc/d17/d1e/d55/c5d 0 2024-08-19T00:56:11.274 INFO:tasks.workunit.client.1.smithi086.stdout:4/653: read d2/d18/d33/d42/d72/f41 [78337,41096] 0 2024-08-19T00:56:11.275 INFO:tasks.workunit.client.0.smithi017.stdout:1/246: dwrite d4/dc/f34 [0,4194304] 0 2024-08-19T00:56:11.277 INFO:tasks.workunit.client.0.smithi017.stdout:1/247: write d4/dc/f42 [649858,26408] 0 2024-08-19T00:56:11.280 INFO:tasks.workunit.client.1.smithi086.stdout:0/679: symlink da/d14/d55/ld8 0 2024-08-19T00:56:11.280 INFO:tasks.workunit.client.1.smithi086.stdout:0/680: readlink da/d14/d26/la7 0 2024-08-19T00:56:11.281 INFO:tasks.workunit.client.1.smithi086.stdout:3/680: link d3/d26/f59 d3/d18/d1a/fdd 0 2024-08-19T00:56:11.282 INFO:tasks.workunit.client.1.smithi086.stdout:3/681: write d3/f6 [3301252,45089] 0 2024-08-19T00:56:11.284 INFO:tasks.workunit.client.1.smithi086.stdout:3/682: readlink d3/d18/d27/d49/d3f/d5b/lca 0 2024-08-19T00:56:11.288 INFO:tasks.workunit.client.1.smithi086.stdout:1/776: creat d4/d7/d2a/d36/d50/ffe x:0 0 0 2024-08-19T00:56:11.289 INFO:tasks.workunit.client.0.smithi017.stdout:8/154: truncate de/d15/f1e 3003121 0 2024-08-19T00:56:11.290 INFO:tasks.workunit.client.0.smithi017.stdout:8/155: write de/f12 [2396973,5313] 0 2024-08-19T00:56:11.292 INFO:tasks.workunit.client.0.smithi017.stdout:1/248: mknod d4/dc/d17/d1d/c4b 0 2024-08-19T00:56:11.293 INFO:tasks.workunit.client.0.smithi017.stdout:1/249: chown d4/l39 83 1 2024-08-19T00:56:11.296 INFO:tasks.workunit.client.0.smithi017.stdout:8/156: dread de/f12 [0,4194304] 0 2024-08-19T00:56:11.298 INFO:tasks.workunit.client.0.smithi017.stdout:0/214: creat d5/d17/d21/d39/f44 x:0 0 0 2024-08-19T00:56:11.299 INFO:tasks.workunit.client.0.smithi017.stdout:0/215: chown d5/d17/d21/d39 14763158 1 2024-08-19T00:56:11.300 INFO:tasks.workunit.client.1.smithi086.stdout:4/654: mknod d2/d18/d33/d42/d72/d78/d2c/cdf 0 2024-08-19T00:56:11.301 INFO:tasks.workunit.client.0.smithi017.stdout:1/250: dwrite d4/f13 [4194304,4194304] 0 2024-08-19T00:56:11.302 INFO:tasks.workunit.client.0.smithi017.stdout:9/250: creat d0/d33/d22/f4c x:0 0 0 2024-08-19T00:56:11.304 INFO:tasks.workunit.client.1.smithi086.stdout:4/655: dread d2/d18/d33/d42/d72/d2f/fc5 [0,4194304] 0 2024-08-19T00:56:11.306 INFO:tasks.workunit.client.1.smithi086.stdout:3/683: unlink d3/d18/d19/d37/d3a/c50 0 2024-08-19T00:56:11.308 INFO:tasks.workunit.client.1.smithi086.stdout:3/684: read d3/d18/f2c [4131528,30046] 0 2024-08-19T00:56:11.309 INFO:tasks.workunit.client.1.smithi086.stdout:6/675: sync 2024-08-19T00:56:11.309 INFO:tasks.workunit.client.1.smithi086.stdout:2/660: sync 2024-08-19T00:56:11.309 INFO:tasks.workunit.client.1.smithi086.stdout:7/681: sync 2024-08-19T00:56:11.310 INFO:tasks.workunit.client.0.smithi017.stdout:2/277: getdents d2/d7/dd 0 2024-08-19T00:56:11.312 INFO:tasks.workunit.client.1.smithi086.stdout:2/661: chown d8/d24/d32/d4d/lc8 61 1 2024-08-19T00:56:11.313 INFO:tasks.workunit.client.0.smithi017.stdout:0/216: truncate d5/d17/f22 993098 0 2024-08-19T00:56:11.313 INFO:tasks.workunit.client.0.smithi017.stdout:7/303: write d3/f5 [1837155,46554] 0 2024-08-19T00:56:11.314 INFO:tasks.workunit.client.1.smithi086.stdout:3/685: dread d3/d18/d27/fbb [0,4194304] 0 2024-08-19T00:56:11.315 INFO:tasks.workunit.client.0.smithi017.stdout:0/217: read d5/d17/d26/d30/f33 [2133356,26533] 0 2024-08-19T00:56:11.316 INFO:tasks.workunit.client.1.smithi086.stdout:5/668: dwrite d0/d8/d72/f8a [0,4194304] 0 2024-08-19T00:56:11.316 INFO:tasks.workunit.client.0.smithi017.stdout:1/251: unlink d4/d1c/f2b 0 2024-08-19T00:56:11.325 INFO:tasks.workunit.client.1.smithi086.stdout:4/656: rename d2/d18/d33/d42/d72/d78/d2c/dbc to d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/de0 0 2024-08-19T00:56:11.326 INFO:tasks.workunit.client.0.smithi017.stdout:8/157: mknod de/d15/d1f/c24 0 2024-08-19T00:56:11.328 INFO:tasks.workunit.client.1.smithi086.stdout:6/676: dread db/f11 [0,4194304] 0 2024-08-19T00:56:11.328 INFO:tasks.workunit.client.0.smithi017.stdout:2/278: mkdir d2/d7/d10/d35/d45/d58 0 2024-08-19T00:56:11.328 INFO:tasks.workunit.client.0.smithi017.stdout:9/251: rmdir d0/d33/d22 39 2024-08-19T00:56:11.328 INFO:tasks.workunit.client.1.smithi086.stdout:6/677: readlink db/d34/l81 0 2024-08-19T00:56:11.329 INFO:tasks.workunit.client.1.smithi086.stdout:6/678: chown db/d37/d44/d5a/d78/l8c 7 1 2024-08-19T00:56:11.329 INFO:tasks.workunit.client.0.smithi017.stdout:2/279: write d2/d7/d10/f25 [2015098,118720] 0 2024-08-19T00:56:11.329 INFO:tasks.workunit.client.1.smithi086.stdout:6/679: truncate db/d8e/fd6 322003 0 2024-08-19T00:56:11.333 INFO:tasks.workunit.client.1.smithi086.stdout:8/649: write dc/d17/f6d [685963,26705] 0 2024-08-19T00:56:11.334 INFO:tasks.workunit.client.1.smithi086.stdout:8/650: write dc/d17/d86/fb4 [32685,5839] 0 2024-08-19T00:56:11.335 INFO:tasks.workunit.client.1.smithi086.stdout:8/651: chown dc/d17/d1e/d55/dbb 32183 1 2024-08-19T00:56:11.338 INFO:tasks.workunit.client.1.smithi086.stdout:7/682: dread d3/d34/f76 [0,4194304] 0 2024-08-19T00:56:11.339 INFO:tasks.workunit.client.0.smithi017.stdout:0/218: rmdir d5/d17 39 2024-08-19T00:56:11.341 INFO:tasks.workunit.client.0.smithi017.stdout:1/252: chown d4/l5 323352 1 2024-08-19T00:56:11.342 INFO:tasks.workunit.client.0.smithi017.stdout:1/253: truncate d4/dc/f40 4824415 0 2024-08-19T00:56:11.345 INFO:tasks.workunit.client.1.smithi086.stdout:2/662: mknod d8/d24/cdf 0 2024-08-19T00:56:11.348 INFO:tasks.workunit.client.1.smithi086.stdout:1/777: truncate d4/d7/d2a/d36/d63/fc1 3114822 0 2024-08-19T00:56:11.348 INFO:tasks.workunit.client.1.smithi086.stdout:3/686: rmdir d3/d18/d19/d37/d3a 39 2024-08-19T00:56:11.349 INFO:tasks.workunit.client.0.smithi017.stdout:1/254: dwrite d4/f13 [8388608,4194304] 0 2024-08-19T00:56:11.350 INFO:tasks.workunit.client.0.smithi017.stdout:1/255: chown d4/dc/c2f 42442680 1 2024-08-19T00:56:11.351 INFO:tasks.workunit.client.1.smithi086.stdout:5/669: write d0/df/d1f/d65/fb8 [4148442,7461] 0 2024-08-19T00:56:11.353 INFO:tasks.workunit.client.1.smithi086.stdout:9/691: getdents db/d26/d5c/d68 0 2024-08-19T00:56:11.353 INFO:tasks.workunit.client.0.smithi017.stdout:2/280: symlink d2/d7/d10/d3b/d3c/l59 0 2024-08-19T00:56:11.354 INFO:tasks.workunit.client.1.smithi086.stdout:0/681: link da/d14/d55/ld8 da/d14/d44/d7b/ld9 0 2024-08-19T00:56:11.355 INFO:tasks.workunit.client.0.smithi017.stdout:7/304: fdatasync d3/dc/df/d32/f54 0 2024-08-19T00:56:11.355 INFO:tasks.workunit.client.0.smithi017.stdout:1/256: read d4/dc/f18 [407327,24882] 0 2024-08-19T00:56:11.356 INFO:tasks.workunit.client.1.smithi086.stdout:4/657: rmdir d2/d18/d33/d42/d72/d78/d25/d30/d5d 39 2024-08-19T00:56:11.357 INFO:tasks.workunit.client.1.smithi086.stdout:4/658: chown d2/d18/d33/d42/d72/d78/l95 16 1 2024-08-19T00:56:11.364 INFO:tasks.workunit.client.1.smithi086.stdout:3/687: dread d3/d18/d19/dbc/fb6 [0,4194304] 0 2024-08-19T00:56:11.366 INFO:tasks.workunit.client.0.smithi017.stdout:8/158: dread de/d15/f1e [0,4194304] 0 2024-08-19T00:56:11.370 INFO:tasks.workunit.client.1.smithi086.stdout:6/680: write db/d34/d39/f51 [296821,111246] 0 2024-08-19T00:56:11.370 INFO:tasks.workunit.client.0.smithi017.stdout:2/281: symlink d2/d7/d10/d19/d48/l5a 0 2024-08-19T00:56:11.370 INFO:tasks.workunit.client.0.smithi017.stdout:2/282: readlink d2/d7/l18 0 2024-08-19T00:56:11.370 INFO:tasks.workunit.client.1.smithi086.stdout:8/652: dread dc/f51 [0,4194304] 0 2024-08-19T00:56:11.375 INFO:tasks.workunit.client.0.smithi017.stdout:1/257: dread d4/ff [0,4194304] 0 2024-08-19T00:56:11.376 INFO:tasks.workunit.client.0.smithi017.stdout:9/252: link d0/d33/f2e d0/d33/f4d 0 2024-08-19T00:56:11.376 INFO:tasks.workunit.client.0.smithi017.stdout:1/258: fdatasync d4/d1c/f46 0 2024-08-19T00:56:11.377 INFO:tasks.workunit.client.0.smithi017.stdout:7/305: dwrite d3/dc/df/d32/f54 [4194304,4194304] 0 2024-08-19T00:56:11.381 INFO:tasks.workunit.client.1.smithi086.stdout:0/682: mkdir da/d14/d1a/d2e/d39/d3b/d4e/dda 0 2024-08-19T00:56:11.382 INFO:tasks.workunit.client.1.smithi086.stdout:5/670: write d0/df/d1f/d33/f96 [378048,89321] 0 2024-08-19T00:56:11.383 INFO:tasks.workunit.client.1.smithi086.stdout:4/659: mkdir d2/d18/d33/d42/d72/d78/d25/d55/de1 0 2024-08-19T00:56:11.384 INFO:tasks.workunit.client.1.smithi086.stdout:5/671: write d0/d2d/d43/d91/fbd [654544,44482] 0 2024-08-19T00:56:11.384 INFO:tasks.workunit.client.0.smithi017.stdout:2/283: creat d2/d7/d10/d3b/d54/f5b x:0 0 0 2024-08-19T00:56:11.386 INFO:tasks.workunit.client.0.smithi017.stdout:2/284: fsync d2/d7/dd/f2f 0 2024-08-19T00:56:11.386 INFO:tasks.workunit.client.1.smithi086.stdout:3/688: mknod d3/cde 0 2024-08-19T00:56:11.389 INFO:tasks.workunit.client.0.smithi017.stdout:7/306: unlink d3/dc/df/d1c/d2c/d2f/f4f 0 2024-08-19T00:56:11.390 INFO:tasks.workunit.client.0.smithi017.stdout:7/307: write d3/dc/f48 [878409,104328] 0 2024-08-19T00:56:11.391 INFO:tasks.workunit.client.1.smithi086.stdout:7/683: mkdir d3/d34/d44/d58/d4b/da5/daf/de7 0 2024-08-19T00:56:11.407 INFO:tasks.workunit.client.0.smithi017.stdout:2/285: symlink d2/d7/dd/l5c 0 2024-08-19T00:56:11.414 INFO:tasks.workunit.client.0.smithi017.stdout:0/219: dwrite d5/d17/f1a [4194304,4194304] 0 2024-08-19T00:56:11.414 INFO:tasks.workunit.client.0.smithi017.stdout:2/286: dwrite d2/d7/fc [0,4194304] 0 2024-08-19T00:56:11.414 INFO:tasks.workunit.client.0.smithi017.stdout:7/308: rename d3/l31 to d3/dc/df/d37/l5d 0 2024-08-19T00:56:11.417 INFO:tasks.workunit.client.0.smithi017.stdout:8/159: link de/d15/d1f/c24 de/d15/c25 0 2024-08-19T00:56:11.420 INFO:tasks.workunit.client.1.smithi086.stdout:9/692: rename db/dd/d19/d18/db9/ldc to db/d26/d5c/d87/d6d/dbf/lde 0 2024-08-19T00:56:11.421 INFO:tasks.workunit.client.0.smithi017.stdout:0/220: mkdir d5/d17/d45 0 2024-08-19T00:56:11.422 INFO:tasks.workunit.client.1.smithi086.stdout:9/693: chown db/d26/d5c/d87/d30/l98 57148 1 2024-08-19T00:56:11.423 INFO:tasks.workunit.client.0.smithi017.stdout:2/287: creat d2/d7/d29/f5d x:0 0 0 2024-08-19T00:56:11.424 INFO:tasks.workunit.client.1.smithi086.stdout:5/672: mknod d0/d99/ccd 0 2024-08-19T00:56:11.424 INFO:tasks.workunit.client.0.smithi017.stdout:2/288: fsync d2/d7/d29/f34 0 2024-08-19T00:56:11.424 INFO:tasks.workunit.client.1.smithi086.stdout:5/673: chown d0/df 6 1 2024-08-19T00:56:11.425 INFO:tasks.workunit.client.1.smithi086.stdout:3/689: creat d3/d18/d19/dbc/fdf x:0 0 0 2024-08-19T00:56:11.426 INFO:tasks.workunit.client.0.smithi017.stdout:2/289: chown d2/d7/d10/f11 42131387 1 2024-08-19T00:56:11.427 INFO:tasks.workunit.client.0.smithi017.stdout:7/309: rename d3/dc/df/d1c/d2c/d2f/c30 to d3/dc/df/d1c/d2c/d35/c5e 0 2024-08-19T00:56:11.427 INFO:tasks.workunit.client.1.smithi086.stdout:8/653: dwrite f8 [0,4194304] 0 2024-08-19T00:56:11.428 INFO:tasks.workunit.client.0.smithi017.stdout:0/221: mknod d5/d17/d26/c46 0 2024-08-19T00:56:11.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:11 smithi017 ceph-mon[16627]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:11.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:11 smithi017 ceph-mon[16627]: pgmap v16: 65 pgs: 65 active+clean; 1.7 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 51 MiB/s rd, 231 MiB/s wr, 384 op/s 2024-08-19T00:56:11.433 INFO:tasks.workunit.client.1.smithi086.stdout:6/681: mkdir db/d37/d28/d7f/d96/dd9 0 2024-08-19T00:56:11.435 INFO:tasks.workunit.client.0.smithi017.stdout:0/222: dwrite d5/f11 [0,4194304] 0 2024-08-19T00:56:11.437 INFO:tasks.workunit.client.0.smithi017.stdout:0/223: chown d5/d18/d3a/l40 4 1 2024-08-19T00:56:11.438 INFO:tasks.workunit.client.1.smithi086.stdout:8/654: read dc/d17/d86/fb4 [3843,21647] 0 2024-08-19T00:56:11.439 INFO:tasks.workunit.client.1.smithi086.stdout:8/655: chown dc/d16/d18/c80 2275 1 2024-08-19T00:56:11.440 INFO:tasks.workunit.client.0.smithi017.stdout:2/290: symlink d2/d7/d10/d35/l5e 0 2024-08-19T00:56:11.443 INFO:tasks.workunit.client.0.smithi017.stdout:7/310: mkdir d3/dc/d5f 0 2024-08-19T00:56:11.443 INFO:tasks.workunit.client.1.smithi086.stdout:6/682: dread db/f2b [0,4194304] 0 2024-08-19T00:56:11.444 INFO:tasks.workunit.client.1.smithi086.stdout:1/778: link d4/d7/d2a/d36/d3a/f72 d4/d7/d2a/d36/d63/d9f/fff 0 2024-08-19T00:56:11.445 INFO:tasks.workunit.client.1.smithi086.stdout:1/779: fsync d4/d7/d2a/d36/d63/d84/dda/fee 0 2024-08-19T00:56:11.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:11 smithi086 ceph-mon[24511]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:11.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:11 smithi086 ceph-mon[24511]: pgmap v16: 65 pgs: 65 active+clean; 1.7 GiB data, 4.8 GiB used, 532 GiB / 536 GiB avail; 51 MiB/s rd, 231 MiB/s wr, 384 op/s 2024-08-19T00:56:11.446 INFO:tasks.workunit.client.1.smithi086.stdout:4/660: mknod d2/ce2 0 2024-08-19T00:56:11.447 INFO:tasks.workunit.client.0.smithi017.stdout:7/311: write d3/dc/f1f [2172224,111963] 0 2024-08-19T00:56:11.447 INFO:tasks.workunit.client.0.smithi017.stdout:0/224: mknod d5/d17/d26/d30/c47 0 2024-08-19T00:56:11.449 INFO:tasks.workunit.client.1.smithi086.stdout:9/694: creat db/d26/d5c/d87/d37/fdf x:0 0 0 2024-08-19T00:56:11.451 INFO:tasks.workunit.client.0.smithi017.stdout:8/160: dwrite de/f12 [4194304,4194304] 0 2024-08-19T00:56:11.452 INFO:tasks.workunit.client.1.smithi086.stdout:3/690: mkdir d3/d26/d2b/de0 0 2024-08-19T00:56:11.454 INFO:tasks.workunit.client.1.smithi086.stdout:7/684: link d3/de/d68/d72/fa0 d3/de/d68/d72/fe8 0 2024-08-19T00:56:11.455 INFO:tasks.workunit.client.1.smithi086.stdout:9/695: dwrite db/d26/d5c/d87/d30/d3f/f8a [4194304,4194304] 0 2024-08-19T00:56:11.456 INFO:tasks.workunit.client.0.smithi017.stdout:2/291: mknod d2/d7/d10/d35/d45/d58/c5f 0 2024-08-19T00:56:11.457 INFO:tasks.workunit.client.1.smithi086.stdout:7/685: write d3/de/d68/d72/d7e/dca/dcb/fe2 [797437,115814] 0 2024-08-19T00:56:11.458 INFO:tasks.workunit.client.0.smithi017.stdout:7/312: rename d3/d3c/f5c to d3/dc/df/d1a/f60 0 2024-08-19T00:56:11.460 INFO:tasks.workunit.client.1.smithi086.stdout:2/663: getdents d8/d14 0 2024-08-19T00:56:11.461 INFO:tasks.workunit.client.1.smithi086.stdout:8/656: mknod dc/d1f/ccf 0 2024-08-19T00:56:11.468 INFO:tasks.workunit.client.0.smithi017.stdout:7/313: dwrite d3/dc/f5b [0,4194304] 0 2024-08-19T00:56:11.470 INFO:tasks.workunit.client.0.smithi017.stdout:8/161: mknod de/d15/c26 0 2024-08-19T00:56:11.471 INFO:tasks.workunit.client.1.smithi086.stdout:5/674: mkdir d0/d2d/dce 0 2024-08-19T00:56:11.472 INFO:tasks.workunit.client.1.smithi086.stdout:5/675: dread - d0/d2d/d43/d4d/fa6 zero size 2024-08-19T00:56:11.472 INFO:tasks.workunit.client.0.smithi017.stdout:7/314: dread d3/dc/df/d1c/d2c/d35/f59 [0,4194304] 0 2024-08-19T00:56:11.473 INFO:tasks.workunit.client.1.smithi086.stdout:5/676: chown d0/d8/d94 13 1 2024-08-19T00:56:11.473 INFO:tasks.workunit.client.0.smithi017.stdout:0/225: creat d5/f48 x:0 0 0 2024-08-19T00:56:11.474 INFO:tasks.workunit.client.1.smithi086.stdout:5/677: readlink d0/d2d/l44 0 2024-08-19T00:56:11.474 INFO:tasks.workunit.client.0.smithi017.stdout:0/226: dread - d5/d17/d2b/f43 zero size 2024-08-19T00:56:11.475 INFO:tasks.workunit.client.0.smithi017.stdout:0/227: fdatasync d5/fa 0 2024-08-19T00:56:11.480 INFO:tasks.workunit.client.0.smithi017.stdout:7/315: dwrite d3/dc/df/d32/f54 [0,4194304] 0 2024-08-19T00:56:11.482 INFO:tasks.workunit.client.0.smithi017.stdout:7/316: write d3/d3c/f42 [4363522,71426] 0 2024-08-19T00:56:11.484 INFO:tasks.workunit.client.0.smithi017.stdout:8/162: symlink de/d15/d1f/l27 0 2024-08-19T00:56:11.484 INFO:tasks.workunit.client.1.smithi086.stdout:0/683: sync 2024-08-19T00:56:11.487 INFO:tasks.workunit.client.1.smithi086.stdout:2/664: mkdir d8/d84/de0 0 2024-08-19T00:56:11.487 INFO:tasks.workunit.client.0.smithi017.stdout:0/228: read d5/d18/f24 [3907102,22885] 0 2024-08-19T00:56:11.488 INFO:tasks.workunit.client.1.smithi086.stdout:4/661: write d2/d18/d33/d42/d72/d78/d25/f7e [839859,38481] 0 2024-08-19T00:56:11.489 INFO:tasks.workunit.client.1.smithi086.stdout:8/657: unlink dc/d16/dc7/d2e/f61 0 2024-08-19T00:56:11.493 INFO:tasks.workunit.client.0.smithi017.stdout:4/215: sync 2024-08-19T00:56:11.493 INFO:tasks.workunit.client.1.smithi086.stdout:1/780: link d4/d10/f25 d4/d7/d2a/d36/d3a/de5/d7a/db4/f100 0 2024-08-19T00:56:11.495 INFO:tasks.workunit.client.0.smithi017.stdout:8/163: fdatasync de/d15/f1e 0 2024-08-19T00:56:11.497 INFO:tasks.workunit.client.0.smithi017.stdout:0/229: symlink d5/d17/d21/d39/l49 0 2024-08-19T00:56:11.498 INFO:tasks.workunit.client.1.smithi086.stdout:3/691: dwrite d3/d18/d27/d49/d3f/f47 [0,4194304] 0 2024-08-19T00:56:11.498 INFO:tasks.workunit.client.0.smithi017.stdout:2/292: link d2/d7/c42 d2/d7/c60 0 2024-08-19T00:56:11.500 INFO:tasks.workunit.client.1.smithi086.stdout:9/696: symlink db/d26/d5c/le0 0 2024-08-19T00:56:11.503 INFO:tasks.workunit.client.0.smithi017.stdout:4/216: rename d2/fc to d2/d1a/d39/f47 0 2024-08-19T00:56:11.503 INFO:tasks.workunit.client.0.smithi017.stdout:0/230: dread d5/f10 [0,4194304] 0 2024-08-19T00:56:11.505 INFO:tasks.workunit.client.1.smithi086.stdout:6/683: write db/d37/d44/d5a/f73 [512272,76569] 0 2024-08-19T00:56:11.509 INFO:tasks.workunit.client.0.smithi017.stdout:8/164: fsync de/d15/f1e 0 2024-08-19T00:56:11.509 INFO:tasks.workunit.client.1.smithi086.stdout:0/684: dwrite da/f56 [0,4194304] 0 2024-08-19T00:56:11.513 INFO:tasks.workunit.client.0.smithi017.stdout:4/217: dwrite d2/d16/f38 [0,4194304] 0 2024-08-19T00:56:11.513 INFO:tasks.workunit.client.0.smithi017.stdout:4/218: dread - d2/d11/f33 zero size 2024-08-19T00:56:11.514 INFO:tasks.workunit.client.0.smithi017.stdout:2/293: creat d2/d7/d10/d3b/d54/f61 x:0 0 0 2024-08-19T00:56:11.515 INFO:tasks.workunit.client.1.smithi086.stdout:8/658: mkdir dc/d17/d1e/d55/dbb/dd0 0 2024-08-19T00:56:11.519 INFO:tasks.workunit.client.0.smithi017.stdout:0/231: creat d5/d18/f4a x:0 0 0 2024-08-19T00:56:11.522 INFO:tasks.workunit.client.1.smithi086.stdout:1/781: rename d4/d10/f1d to d4/d7/d2a/d36/d61/f101 0 2024-08-19T00:56:11.522 INFO:tasks.workunit.client.1.smithi086.stdout:8/659: dwrite dc/d1f/d37/f72 [4194304,4194304] 0 2024-08-19T00:56:11.523 INFO:tasks.workunit.client.1.smithi086.stdout:1/782: dread - d4/d7/d2a/d36/ffb zero size 2024-08-19T00:56:11.525 INFO:tasks.workunit.client.0.smithi017.stdout:4/219: dwrite d2/d21/d40/f41 [0,4194304] 0 2024-08-19T00:56:11.525 INFO:tasks.workunit.client.1.smithi086.stdout:5/678: creat d0/d8/d94/fcf x:0 0 0 2024-08-19T00:56:11.526 INFO:tasks.workunit.client.1.smithi086.stdout:5/679: fdatasync d0/df/d1f/fb3 0 2024-08-19T00:56:11.526 INFO:tasks.workunit.client.1.smithi086.stdout:2/665: write d8/d24/f26 [4954876,125249] 0 2024-08-19T00:56:11.530 INFO:tasks.workunit.client.1.smithi086.stdout:3/692: mkdir d3/d18/d19/dbc/de1 0 2024-08-19T00:56:11.532 INFO:tasks.workunit.client.1.smithi086.stdout:1/783: dread d4/d7/d2a/d36/d63/d84/d8e/fc3 [0,4194304] 0 2024-08-19T00:56:11.533 INFO:tasks.workunit.client.1.smithi086.stdout:2/666: dwrite d8/d24/d32/d4d/d6a/fb2 [0,4194304] 0 2024-08-19T00:56:11.539 INFO:tasks.workunit.client.0.smithi017.stdout:8/165: dwrite de/d15/f1e [0,4194304] 0 2024-08-19T00:56:11.541 INFO:tasks.workunit.client.1.smithi086.stdout:4/662: dwrite d2/d18/d33/d42/d72/f41 [0,4194304] 0 2024-08-19T00:56:11.547 INFO:tasks.workunit.client.1.smithi086.stdout:5/680: rmdir d0/d8/d73 39 2024-08-19T00:56:11.548 INFO:tasks.workunit.client.1.smithi086.stdout:5/681: readlink d0/d8/d10/l1c 0 2024-08-19T00:56:11.549 INFO:tasks.workunit.client.0.smithi017.stdout:4/220: rmdir d2/d21/d40/d44 0 2024-08-19T00:56:11.552 INFO:tasks.workunit.client.1.smithi086.stdout:3/693: mkdir d3/d18/d27/d49/de2 0 2024-08-19T00:56:11.552 INFO:tasks.workunit.client.0.smithi017.stdout:8/166: truncate de/ff 1170604 0 2024-08-19T00:56:11.553 INFO:tasks.workunit.client.0.smithi017.stdout:8/167: readlink de/d15/d1f/l27 0 2024-08-19T00:56:11.554 INFO:tasks.workunit.client.0.smithi017.stdout:4/221: mknod d2/d21/d40/c48 0 2024-08-19T00:56:11.555 INFO:tasks.workunit.client.1.smithi086.stdout:2/667: symlink d8/d24/d32/d61/le1 0 2024-08-19T00:56:11.556 INFO:tasks.workunit.client.1.smithi086.stdout:8/660: dread f5 [0,4194304] 0 2024-08-19T00:56:11.556 INFO:tasks.workunit.client.1.smithi086.stdout:2/668: fsync d8/d43/fa1 0 2024-08-19T00:56:11.557 INFO:tasks.workunit.client.0.smithi017.stdout:4/222: mknod d2/d11/c49 0 2024-08-19T00:56:11.557 INFO:tasks.workunit.client.1.smithi086.stdout:2/669: stat d8/d24/d32/f4b 0 2024-08-19T00:56:11.558 INFO:tasks.workunit.client.1.smithi086.stdout:7/686: getdents d3 0 2024-08-19T00:56:11.559 INFO:tasks.workunit.client.0.smithi017.stdout:8/168: mknod de/d15/c28 0 2024-08-19T00:56:11.560 INFO:tasks.workunit.client.1.smithi086.stdout:7/687: stat d3/de/d68/d72/fc5 0 2024-08-19T00:56:11.561 INFO:tasks.workunit.client.1.smithi086.stdout:0/685: symlink da/d14/ldb 0 2024-08-19T00:56:11.562 INFO:tasks.workunit.client.1.smithi086.stdout:4/663: symlink d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/le3 0 2024-08-19T00:56:11.563 INFO:tasks.workunit.client.1.smithi086.stdout:2/670: dwrite d8/d43/fbc [0,4194304] 0 2024-08-19T00:56:11.564 INFO:tasks.workunit.client.0.smithi017.stdout:4/223: dwrite d2/d11/f46 [0,4194304] 0 2024-08-19T00:56:11.565 INFO:tasks.workunit.client.1.smithi086.stdout:4/664: chown d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/ld1 156 1 2024-08-19T00:56:11.565 INFO:tasks.workunit.client.1.smithi086.stdout:5/682: chown d0/d99/da2/lbc 238 1 2024-08-19T00:56:11.566 INFO:tasks.workunit.client.1.smithi086.stdout:3/694: rmdir d3/d18/d19/d62/d46 39 2024-08-19T00:56:11.568 INFO:tasks.workunit.client.1.smithi086.stdout:9/697: mkdir db/d96/de1 0 2024-08-19T00:56:11.569 INFO:tasks.workunit.client.1.smithi086.stdout:0/686: dwrite da/d14/f2d [0,4194304] 0 2024-08-19T00:56:11.570 INFO:tasks.workunit.client.0.smithi017.stdout:8/169: creat de/d15/f29 x:0 0 0 2024-08-19T00:56:11.570 INFO:tasks.workunit.client.1.smithi086.stdout:9/698: chown db/dd/d19/f1f 529 1 2024-08-19T00:56:11.572 INFO:tasks.workunit.client.0.smithi017.stdout:4/224: mknod d2/d11/d24/c4a 0 2024-08-19T00:56:11.574 INFO:tasks.workunit.client.1.smithi086.stdout:9/699: chown db/d26/d5c/d87/d30/d32/cda 18546300 1 2024-08-19T00:56:11.574 INFO:tasks.workunit.client.0.smithi017.stdout:4/225: chown d2/f12 22952439 1 2024-08-19T00:56:11.575 INFO:tasks.workunit.client.0.smithi017.stdout:4/226: write d2/d1a/f3d [1675965,8755] 0 2024-08-19T00:56:11.576 INFO:tasks.workunit.client.0.smithi017.stdout:4/227: write d2/d1a/f23 [3539298,81249] 0 2024-08-19T00:56:11.577 INFO:tasks.workunit.client.1.smithi086.stdout:2/671: rename d8/d24/d32/d61/fba to d8/d14/d9e/fe2 0 2024-08-19T00:56:11.583 INFO:tasks.workunit.client.1.smithi086.stdout:4/665: dwrite d2/d18/d33/d42/d72/d2f/fc5 [0,4194304] 0 2024-08-19T00:56:11.585 INFO:tasks.workunit.client.1.smithi086.stdout:9/700: unlink db/dd/f62 0 2024-08-19T00:56:11.588 INFO:tasks.workunit.client.0.smithi017.stdout:4/228: creat d2/f4b x:0 0 0 2024-08-19T00:56:11.591 INFO:tasks.workunit.client.1.smithi086.stdout:8/661: mknod dc/d16/d18/cd1 0 2024-08-19T00:56:11.593 INFO:tasks.workunit.client.1.smithi086.stdout:9/701: read db/d26/d5c/d87/d30/d32/d44/f56 [3162122,70787] 0 2024-08-19T00:56:11.594 INFO:tasks.workunit.client.1.smithi086.stdout:6/684: write db/d37/d44/f80 [498399,36039] 0 2024-08-19T00:56:11.596 INFO:tasks.workunit.client.1.smithi086.stdout:4/666: unlink d2/d18/f86 0 2024-08-19T00:56:11.596 INFO:tasks.workunit.client.1.smithi086.stdout:6/685: dread - db/d37/d28/d7f/fca zero size 2024-08-19T00:56:11.598 INFO:tasks.workunit.client.1.smithi086.stdout:8/662: rmdir dc/d16/dc7/d2e 39 2024-08-19T00:56:11.599 INFO:tasks.workunit.client.1.smithi086.stdout:7/688: dread d3/de/d68/d72/fa0 [0,4194304] 0 2024-08-19T00:56:11.599 INFO:tasks.workunit.client.0.smithi017.stdout:2/294: write d2/d7/f43 [4024221,128244] 0 2024-08-19T00:56:11.600 INFO:tasks.workunit.client.0.smithi017.stdout:2/295: readlink d2/d7/d29/l46 0 2024-08-19T00:56:11.600 INFO:tasks.workunit.client.1.smithi086.stdout:9/702: dwrite db/dd/d19/d18/f25 [0,4194304] 0 2024-08-19T00:56:11.600 INFO:tasks.workunit.client.1.smithi086.stdout:7/689: chown d3/d34/cae 53365568 1 2024-08-19T00:56:11.601 INFO:tasks.workunit.client.0.smithi017.stdout:2/296: chown d2/d7/d10/d19/c2d 296914 1 2024-08-19T00:56:11.603 INFO:tasks.workunit.client.1.smithi086.stdout:4/667: truncate d2/f45 517341 0 2024-08-19T00:56:11.604 INFO:tasks.workunit.client.1.smithi086.stdout:5/683: dread d0/d2d/d43/d91/f98 [0,4194304] 0 2024-08-19T00:56:11.605 INFO:tasks.workunit.client.1.smithi086.stdout:0/687: getdents da/d14/d1a/d2e/d7e 0 2024-08-19T00:56:11.605 INFO:tasks.workunit.client.0.smithi017.stdout:2/297: symlink d2/d7/d10/d19/d48/l62 0 2024-08-19T00:56:11.606 INFO:tasks.workunit.client.1.smithi086.stdout:0/688: fsync da/d14/d1a/d2e/d39/f85 0 2024-08-19T00:56:11.608 INFO:tasks.workunit.client.0.smithi017.stdout:2/298: read d2/d7/dd/f1c [668988,120036] 0 2024-08-19T00:56:11.609 INFO:tasks.workunit.client.1.smithi086.stdout:8/663: symlink dc/d1f/d37/d9f/ld2 0 2024-08-19T00:56:11.610 INFO:tasks.workunit.client.0.smithi017.stdout:2/299: chown d2/d7/d29/f52 148 1 2024-08-19T00:56:11.611 INFO:tasks.workunit.client.1.smithi086.stdout:7/690: creat d3/fe9 x:0 0 0 2024-08-19T00:56:11.611 INFO:tasks.workunit.client.0.smithi017.stdout:2/300: write d2/d7/dd/f4e [1043530,40581] 0 2024-08-19T00:56:11.614 INFO:tasks.workunit.client.1.smithi086.stdout:4/668: readlink d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/ldb 0 2024-08-19T00:56:11.616 INFO:tasks.workunit.client.1.smithi086.stdout:4/669: read - d2/d18/d33/d42/d72/d78/d25/d55/d6c/fc9 zero size 2024-08-19T00:56:11.617 INFO:tasks.workunit.client.1.smithi086.stdout:9/703: dwrite db/d26/f93 [0,4194304] 0 2024-08-19T00:56:11.618 INFO:tasks.workunit.client.1.smithi086.stdout:5/684: creat d0/d5f/d60/fd0 x:0 0 0 2024-08-19T00:56:11.620 INFO:tasks.workunit.client.1.smithi086.stdout:9/704: write db/dd/d19/d38/fb8 [833459,70711] 0 2024-08-19T00:56:11.622 INFO:tasks.workunit.client.0.smithi017.stdout:2/301: rename d2/d7/dd/l5c to d2/l63 0 2024-08-19T00:56:11.624 INFO:tasks.workunit.client.1.smithi086.stdout:8/664: mkdir dc/d17/dd3 0 2024-08-19T00:56:11.627 INFO:tasks.workunit.client.1.smithi086.stdout:6/686: dwrite db/d37/d28/d7f/f88 [0,4194304] 0 2024-08-19T00:56:11.628 INFO:tasks.workunit.client.1.smithi086.stdout:8/665: chown dc/d16/l30 1534049 1 2024-08-19T00:56:11.629 INFO:tasks.workunit.client.0.smithi017.stdout:2/302: read d2/d7/d10/d19/f39 [1826728,1594] 0 2024-08-19T00:56:11.629 INFO:tasks.workunit.client.1.smithi086.stdout:9/705: readlink db/d26/d5c/d87/d30/d3f/d43/d4e/d7a/da1/la8 0 2024-08-19T00:56:11.630 INFO:tasks.workunit.client.1.smithi086.stdout:0/689: mkdir da/d14/d1a/ddc 0 2024-08-19T00:56:11.631 INFO:tasks.workunit.client.1.smithi086.stdout:4/670: dwrite d2/d18/d33/d42/d72/d8f/fb1 [0,4194304] 0 2024-08-19T00:56:11.632 INFO:tasks.workunit.client.1.smithi086.stdout:1/784: dwrite d4/f5c [0,4194304] 0 2024-08-19T00:56:11.635 INFO:tasks.workunit.client.1.smithi086.stdout:6/687: dread - db/d34/d69/fd0 zero size 2024-08-19T00:56:11.638 INFO:tasks.workunit.client.1.smithi086.stdout:1/785: fdatasync d4/d7/d2a/f33 0 2024-08-19T00:56:11.639 INFO:tasks.workunit.client.1.smithi086.stdout:5/685: creat d0/d8/d73/fd1 x:0 0 0 2024-08-19T00:56:11.639 INFO:tasks.workunit.client.1.smithi086.stdout:2/672: write d8/d2c/d38/f45 [272952,82519] 0 2024-08-19T00:56:11.640 INFO:tasks.workunit.client.1.smithi086.stdout:6/688: chown db/d34/d4e/db4/fba 2669 1 2024-08-19T00:56:11.643 INFO:tasks.workunit.client.1.smithi086.stdout:8/666: write dc/f11 [3793060,123279] 0 2024-08-19T00:56:11.645 INFO:tasks.workunit.client.1.smithi086.stdout:3/695: dwrite d3/d18/d19/d37/f7f [0,4194304] 0 2024-08-19T00:56:11.648 INFO:tasks.workunit.client.1.smithi086.stdout:4/671: creat d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/fe4 x:0 0 0 2024-08-19T00:56:11.652 INFO:tasks.workunit.client.1.smithi086.stdout:2/673: chown d8/d2c/d38/fd4 615448 1 2024-08-19T00:56:11.653 INFO:tasks.workunit.client.1.smithi086.stdout:0/690: dwrite da/d14/f6f [0,4194304] 0 2024-08-19T00:56:11.653 INFO:tasks.workunit.client.1.smithi086.stdout:4/672: stat d2/d18/d33/d42/d72/ff 0 2024-08-19T00:56:11.656 INFO:tasks.workunit.client.1.smithi086.stdout:8/667: fsync dc/d16/dc7/d2e/d28/d41/f59 0 2024-08-19T00:56:11.657 INFO:tasks.workunit.client.0.smithi017.stdout:8/170: dwrite de/ff [0,4194304] 0 2024-08-19T00:56:11.657 INFO:tasks.workunit.client.0.smithi017.stdout:2/303: dread d2/d7/d10/d19/f20 [0,4194304] 0 2024-08-19T00:56:11.662 INFO:tasks.workunit.client.1.smithi086.stdout:3/696: dread d3/d18/d19/dbc/db8/dc9/fcf [0,4194304] 0 2024-08-19T00:56:11.664 INFO:tasks.workunit.client.1.smithi086.stdout:6/689: truncate db/d37/f21 1489305 0 2024-08-19T00:56:11.664 INFO:tasks.workunit.client.0.smithi017.stdout:8/171: dwrite de/ff [0,4194304] 0 2024-08-19T00:56:11.665 INFO:tasks.workunit.client.0.smithi017.stdout:2/304: symlink d2/d7/d10/d35/d55/l64 0 2024-08-19T00:56:11.666 INFO:tasks.workunit.client.1.smithi086.stdout:6/690: write db/d34/d69/f75 [3023839,74367] 0 2024-08-19T00:56:11.667 INFO:tasks.workunit.client.1.smithi086.stdout:6/691: dread - db/d37/d30/fc9 zero size 2024-08-19T00:56:11.672 INFO:tasks.workunit.client.1.smithi086.stdout:1/786: write d4/d7/f9b [997037,1446] 0 2024-08-19T00:56:11.672 INFO:tasks.workunit.client.0.smithi017.stdout:2/305: mkdir d2/d7/d10/d35/d55/d65 0 2024-08-19T00:56:11.675 INFO:tasks.workunit.client.1.smithi086.stdout:8/668: rename dc/d1f/dc9/dca to dc/d1f/dd4 0 2024-08-19T00:56:11.675 INFO:tasks.workunit.client.1.smithi086.stdout:9/706: dread db/d26/d5c/d87/d30/d3f/f71 [0,4194304] 0 2024-08-19T00:56:11.676 INFO:tasks.workunit.client.1.smithi086.stdout:0/691: mknod da/d14/d1a/cdd 0 2024-08-19T00:56:11.677 INFO:tasks.workunit.client.1.smithi086.stdout:8/669: chown dc/d1f/d37 1042997 1 2024-08-19T00:56:11.679 INFO:tasks.workunit.client.1.smithi086.stdout:5/686: dread d0/d2d/d43/fb2 [0,4194304] 0 2024-08-19T00:56:11.680 INFO:tasks.workunit.client.1.smithi086.stdout:9/707: read db/d26/d5c/d87/d37/f48 [2099262,98485] 0 2024-08-19T00:56:11.680 INFO:tasks.workunit.client.1.smithi086.stdout:7/691: dwrite d3/de/d68/d72/d7e/dca/dcb/fe2 [0,4194304] 0 2024-08-19T00:56:11.682 INFO:tasks.workunit.client.1.smithi086.stdout:7/692: chown d3/de/d68/d72/l82 148914081 1 2024-08-19T00:56:11.682 INFO:tasks.workunit.client.1.smithi086.stdout:4/673: creat d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd/fe5 x:0 0 0 2024-08-19T00:56:11.685 INFO:tasks.workunit.client.0.smithi017.stdout:8/172: link de/d15/d1f/c24 de/c2a 0 2024-08-19T00:56:11.686 INFO:tasks.workunit.client.1.smithi086.stdout:3/697: symlink d3/d26/dba/le3 0 2024-08-19T00:56:11.687 INFO:tasks.workunit.client.1.smithi086.stdout:1/787: creat d4/d7/d2a/d36/d61/f102 x:0 0 0 2024-08-19T00:56:11.688 INFO:tasks.workunit.client.1.smithi086.stdout:8/670: readlink dc/d17/d1e/d49/l5e 0 2024-08-19T00:56:11.689 INFO:tasks.workunit.client.1.smithi086.stdout:5/687: chown d0/df/d1f/c93 306410 1 2024-08-19T00:56:11.690 INFO:tasks.workunit.client.0.smithi017.stdout:8/173: creat de/d15/f2b x:0 0 0 2024-08-19T00:56:11.690 INFO:tasks.workunit.client.1.smithi086.stdout:7/693: rmdir d3/de/d68/d72 39 2024-08-19T00:56:11.691 INFO:tasks.workunit.client.1.smithi086.stdout:9/708: rename db/d26/d5c/d87/d30/d3f/d43/d4e/d7a/da1 to db/dd/de2 0 2024-08-19T00:56:11.693 INFO:tasks.workunit.client.1.smithi086.stdout:2/674: link d8/d14/f22 d8/d2c/d38/d80/db4/db7/fe3 0 2024-08-19T00:56:11.695 INFO:tasks.workunit.client.0.smithi017.stdout:8/174: mknod de/d15/c2c 0 2024-08-19T00:56:11.695 INFO:tasks.workunit.client.0.smithi017.stdout:8/175: dread - de/d15/f2b zero size 2024-08-19T00:56:11.696 INFO:tasks.workunit.client.1.smithi086.stdout:5/688: dread d0/d2d/d4f/f7d [0,4194304] 0 2024-08-19T00:56:11.697 INFO:tasks.workunit.client.1.smithi086.stdout:6/692: creat db/d37/d28/d7f/fda x:0 0 0 2024-08-19T00:56:11.698 INFO:tasks.workunit.client.1.smithi086.stdout:9/709: creat db/d26/d5c/d87/d6d/fe3 x:0 0 0 2024-08-19T00:56:11.699 INFO:tasks.workunit.client.0.smithi017.stdout:8/176: dread de/ff [0,4194304] 0 2024-08-19T00:56:11.700 INFO:tasks.workunit.client.1.smithi086.stdout:2/675: creat d8/d84/d79/fe4 x:0 0 0 2024-08-19T00:56:11.703 INFO:tasks.workunit.client.1.smithi086.stdout:6/693: mkdir db/d37/d28/d7f/d96/ddb 0 2024-08-19T00:56:11.705 INFO:tasks.workunit.client.1.smithi086.stdout:9/710: mknod db/d26/d5c/d87/d6d/dbf/ce4 0 2024-08-19T00:56:11.707 INFO:tasks.workunit.client.1.smithi086.stdout:8/671: creat dc/d17/d1e/fd5 x:0 0 0 2024-08-19T00:56:11.707 INFO:tasks.workunit.client.1.smithi086.stdout:2/676: dwrite d8/d43/d65/fb5 [0,4194304] 0 2024-08-19T00:56:11.708 INFO:tasks.workunit.client.1.smithi086.stdout:7/694: fsync d3/d34/d44/d58/d4b/f7c 0 2024-08-19T00:56:11.709 INFO:tasks.workunit.client.1.smithi086.stdout:2/677: write d8/d43/d65/fb5 [2819548,92824] 0 2024-08-19T00:56:11.710 INFO:tasks.workunit.client.1.smithi086.stdout:3/698: link d3/d26/d2b/f3b d3/d18/fe4 0 2024-08-19T00:56:11.711 INFO:tasks.workunit.client.1.smithi086.stdout:2/678: chown d8/d84/de0 4 1 2024-08-19T00:56:11.712 INFO:tasks.workunit.client.1.smithi086.stdout:3/699: readlink d3/d18/d27/d49/d3f/d54/l5c 0 2024-08-19T00:56:11.713 INFO:tasks.workunit.client.1.smithi086.stdout:6/694: mkdir db/d37/d44/d5a/d78/ddc 0 2024-08-19T00:56:11.714 INFO:tasks.workunit.client.1.smithi086.stdout:6/695: write db/d37/d44/f80 [1447744,53954] 0 2024-08-19T00:56:11.714 INFO:tasks.workunit.client.0.smithi017.stdout:2/306: write d2/d7/dd/f1c [273099,104483] 0 2024-08-19T00:56:11.715 INFO:tasks.workunit.client.1.smithi086.stdout:9/711: creat db/d26/d5c/d87/d30/d31/fe5 x:0 0 0 2024-08-19T00:56:11.715 INFO:tasks.workunit.client.0.smithi017.stdout:2/307: write d2/d7/fc [4432381,36908] 0 2024-08-19T00:56:11.719 INFO:tasks.workunit.client.1.smithi086.stdout:3/700: dwrite d3/d26/f73 [0,4194304] 0 2024-08-19T00:56:11.721 INFO:tasks.workunit.client.1.smithi086.stdout:8/672: creat dc/d1f/d37/d4f/dac/db8/d7a/d88/fd6 x:0 0 0 2024-08-19T00:56:11.723 INFO:tasks.workunit.client.1.smithi086.stdout:2/679: write d8/d24/d32/f4b [4585657,47021] 0 2024-08-19T00:56:11.725 INFO:tasks.workunit.client.1.smithi086.stdout:5/689: dread d0/d2d/d4f/f5c [4194304,4194304] 0 2024-08-19T00:56:11.727 INFO:tasks.workunit.client.1.smithi086.stdout:6/696: write db/d37/f9e [970903,58533] 0 2024-08-19T00:56:11.728 INFO:tasks.workunit.client.1.smithi086.stdout:9/712: creat db/dd/fe6 x:0 0 0 2024-08-19T00:56:11.732 INFO:tasks.workunit.client.1.smithi086.stdout:7/695: symlink d3/de/d68/lea 0 2024-08-19T00:56:11.732 INFO:tasks.workunit.client.0.smithi017.stdout:2/308: link d2/d7/c60 d2/d7/d10/d35/d55/d65/c66 0 2024-08-19T00:56:11.732 INFO:tasks.workunit.client.1.smithi086.stdout:3/701: rmdir d3 39 2024-08-19T00:56:11.734 INFO:tasks.workunit.client.1.smithi086.stdout:8/673: creat dc/d17/d1e/d55/dbb/fd7 x:0 0 0 2024-08-19T00:56:11.734 INFO:tasks.workunit.client.1.smithi086.stdout:2/680: truncate f2 1928771 0 2024-08-19T00:56:11.735 INFO:tasks.workunit.client.1.smithi086.stdout:4/674: dwrite d2/d18/d33/d42/d72/d78/d25/d55/d4d/fcf [0,4194304] 0 2024-08-19T00:56:11.735 INFO:tasks.workunit.client.0.smithi017.stdout:2/309: creat d2/d7/d10/d35/d45/d58/f67 x:0 0 0 2024-08-19T00:56:11.736 INFO:tasks.workunit.client.1.smithi086.stdout:5/690: creat d0/d8/d94/fd2 x:0 0 0 2024-08-19T00:56:11.737 INFO:tasks.workunit.client.1.smithi086.stdout:4/675: truncate d2/d18/d33/d42/fba 37622 0 2024-08-19T00:56:11.743 INFO:tasks.workunit.client.1.smithi086.stdout:8/674: rmdir dc/d1f/d37/d4f/dac/db8/d99 39 2024-08-19T00:56:11.743 INFO:tasks.workunit.client.0.smithi017.stdout:2/310: dwrite d2/d7/dd/f4e [0,4194304] 0 2024-08-19T00:56:11.744 INFO:tasks.workunit.client.1.smithi086.stdout:2/681: truncate d8/f1f 7098462 0 2024-08-19T00:56:11.746 INFO:tasks.workunit.client.1.smithi086.stdout:9/713: creat db/d96/de1/fe7 x:0 0 0 2024-08-19T00:56:11.749 INFO:tasks.workunit.client.1.smithi086.stdout:4/676: mkdir d2/d18/d33/d42/d72/d78/de6 0 2024-08-19T00:56:11.751 INFO:tasks.workunit.client.0.smithi017.stdout:2/311: dwrite d2/d7/d10/d3b/d54/f61 [0,4194304] 0 2024-08-19T00:56:11.753 INFO:tasks.workunit.client.1.smithi086.stdout:7/696: dread d3/de/f70 [0,4194304] 0 2024-08-19T00:56:11.753 INFO:tasks.workunit.client.1.smithi086.stdout:8/675: read - dc/d1f/d37/d4f/dac/db8/d7a/d9b/f6f zero size 2024-08-19T00:56:11.755 INFO:tasks.workunit.client.1.smithi086.stdout:2/682: symlink d8/d24/d32/d4d/d6a/le5 0 2024-08-19T00:56:11.757 INFO:tasks.workunit.client.0.smithi017.stdout:2/312: creat d2/d7/d29/f68 x:0 0 0 2024-08-19T00:56:11.758 INFO:tasks.workunit.client.1.smithi086.stdout:5/691: symlink d0/d2d/dce/ld3 0 2024-08-19T00:56:11.758 INFO:tasks.workunit.client.1.smithi086.stdout:8/676: read dc/d16/dc7/d2e/d28/f92 [94988,54370] 0 2024-08-19T00:56:11.759 INFO:tasks.workunit.client.1.smithi086.stdout:9/714: symlink db/d26/d5c/d87/d30/d32/le8 0 2024-08-19T00:56:11.760 INFO:tasks.workunit.client.1.smithi086.stdout:4/677: rename d2/d18/d33/d42/d72/d78/d25/d30/ca1 to d2/d18/d33/d42/d72/d2f/dc4/d81/ce7 0 2024-08-19T00:56:11.762 INFO:tasks.workunit.client.0.smithi017.stdout:2/313: rmdir d2/d7/d10/d35/d55/d65 39 2024-08-19T00:56:11.762 INFO:tasks.workunit.client.1.smithi086.stdout:4/678: read d2/d18/d33/d42/d72/d78/d2c/db0/fc2 [457766,33509] 0 2024-08-19T00:56:11.762 INFO:tasks.workunit.client.1.smithi086.stdout:6/697: write db/d34/d69/f7d [985983,46264] 0 2024-08-19T00:56:11.768 INFO:tasks.workunit.client.0.smithi017.stdout:2/314: mkdir d2/d7/d10/d3b/d69 0 2024-08-19T00:56:11.768 INFO:tasks.workunit.client.1.smithi086.stdout:3/702: write d3/d26/d2b/f6d [3080055,25420] 0 2024-08-19T00:56:11.771 INFO:tasks.workunit.client.1.smithi086.stdout:8/677: symlink dc/d1f/d37/d4f/dac/db8/ld8 0 2024-08-19T00:56:11.772 INFO:tasks.workunit.client.1.smithi086.stdout:3/703: unlink d3/d26/dba/le3 0 2024-08-19T00:56:11.773 INFO:tasks.workunit.client.0.smithi017.stdout:2/315: creat d2/d7/f6a x:0 0 0 2024-08-19T00:56:11.774 INFO:tasks.workunit.client.1.smithi086.stdout:8/678: symlink dc/d16/dc7/d2e/d28/d41/ld9 0 2024-08-19T00:56:11.776 INFO:tasks.workunit.client.1.smithi086.stdout:3/704: creat d3/d18/d19/d62/d46/fe5 x:0 0 0 2024-08-19T00:56:11.777 INFO:tasks.workunit.client.0.smithi017.stdout:2/316: truncate d2/d7/d10/d19/f39 1417751 0 2024-08-19T00:56:11.777 INFO:tasks.workunit.client.1.smithi086.stdout:8/679: dread f8 [0,4194304] 0 2024-08-19T00:56:11.779 INFO:tasks.workunit.client.1.smithi086.stdout:8/680: truncate dc/d16/d18/fa6 1473233 0 2024-08-19T00:56:11.780 INFO:tasks.workunit.client.1.smithi086.stdout:3/705: truncate d3/d18/d27/d49/d3f/d5b/fa7 1918797 0 2024-08-19T00:56:11.782 INFO:tasks.workunit.client.1.smithi086.stdout:8/681: creat dc/d16/d18/fda x:0 0 0 2024-08-19T00:56:11.782 INFO:tasks.workunit.client.1.smithi086.stdout:3/706: readlink d3/d18/d19/d37/d3a/l92 0 2024-08-19T00:56:11.784 INFO:tasks.workunit.client.1.smithi086.stdout:3/707: mknod d3/d18/d1a/ce6 0 2024-08-19T00:56:11.786 INFO:tasks.workunit.client.1.smithi086.stdout:3/708: dread d3/d26/d2b/d33/f41 [0,4194304] 0 2024-08-19T00:56:11.787 INFO:tasks.workunit.client.1.smithi086.stdout:3/709: readlink d3/d26/d2b/d33/d4a/d57/d8a/la5 0 2024-08-19T00:56:11.789 INFO:tasks.workunit.client.1.smithi086.stdout:3/710: mknod d3/d18/d19/dbc/db8/ce7 0 2024-08-19T00:56:11.790 INFO:tasks.workunit.client.1.smithi086.stdout:3/711: write d3/d18/d27/d49/d3f/d54/f94 [4907588,21866] 0 2024-08-19T00:56:11.792 INFO:tasks.workunit.client.1.smithi086.stdout:3/712: creat d3/d18/d27/fe8 x:0 0 0 2024-08-19T00:56:11.831 INFO:tasks.workunit.client.1.smithi086.stdout:8/682: truncate dc/d16/dc7/d2e/d28/d2b/f64 956826 0 2024-08-19T00:56:11.831 INFO:tasks.workunit.client.1.smithi086.stdout:7/697: dwrite d3/de/d68/d7a/f86 [0,4194304] 0 2024-08-19T00:56:11.832 INFO:tasks.workunit.client.1.smithi086.stdout:6/698: dwrite db/d34/f7a [0,4194304] 0 2024-08-19T00:56:11.832 INFO:tasks.workunit.client.1.smithi086.stdout:8/683: dread - dc/d17/d1e/d55/dbb/fbe zero size 2024-08-19T00:56:11.833 INFO:tasks.workunit.client.1.smithi086.stdout:3/713: write d3/f29 [13109,30949] 0 2024-08-19T00:56:11.836 INFO:tasks.workunit.client.1.smithi086.stdout:7/698: mknod d3/d34/ceb 0 2024-08-19T00:56:11.885 INFO:tasks.workunit.client.1.smithi086.stdout:0/692: sync 2024-08-19T00:56:11.886 INFO:tasks.workunit.client.1.smithi086.stdout:6/699: write db/d37/d41/da7/f8d [279529,125236] 0 2024-08-19T00:56:11.886 INFO:tasks.workunit.client.1.smithi086.stdout:7/699: chown d3/d34/d44/d58/d4b/da5/f9b 4701 1 2024-08-19T00:56:11.888 INFO:tasks.workunit.client.1.smithi086.stdout:4/679: dread d2/d18/d33/d42/f61 [0,4194304] 0 2024-08-19T00:56:11.888 INFO:tasks.workunit.client.1.smithi086.stdout:3/714: mkdir d3/d18/d1a/d51/dad/de9 0 2024-08-19T00:56:11.889 INFO:tasks.workunit.client.1.smithi086.stdout:0/693: write da/d14/d44/d49/f4d [1065471,72354] 0 2024-08-19T00:56:11.891 INFO:tasks.workunit.client.1.smithi086.stdout:0/694: chown da/d14/d26/la7 7882617 1 2024-08-19T00:56:11.891 INFO:tasks.workunit.client.1.smithi086.stdout:7/700: creat d3/de/d68/d72/d7e/dca/dcb/fec x:0 0 0 2024-08-19T00:56:11.892 INFO:tasks.workunit.client.1.smithi086.stdout:0/695: chown da/d14/d1a/d2e/d39/d3b/d4e 278158 1 2024-08-19T00:56:11.893 INFO:tasks.workunit.client.1.smithi086.stdout:8/684: link dc/d1f/d37/d4f/dac/db8/d7a/d9b/f71 dc/d16/dc7/d2e/d28/d41/d9a/fdb 0 2024-08-19T00:56:11.894 INFO:tasks.workunit.client.1.smithi086.stdout:4/680: dread d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/faa [0,4194304] 0 2024-08-19T00:56:11.895 INFO:tasks.workunit.client.1.smithi086.stdout:6/700: rename db/d37/d41/dad/ccf to db/d37/d28/d7f/d96/dd9/cdd 0 2024-08-19T00:56:11.895 INFO:tasks.workunit.client.1.smithi086.stdout:6/701: fdatasync db/d34/d69/fd0 0 2024-08-19T00:56:11.897 INFO:tasks.workunit.client.1.smithi086.stdout:0/696: unlink da/d14/d1a/d2e/d30/f50 0 2024-08-19T00:56:11.900 INFO:tasks.workunit.client.1.smithi086.stdout:8/685: creat dc/d1f/d37/d4f/dac/db8/d8f/fdc x:0 0 0 2024-08-19T00:56:11.906 INFO:tasks.workunit.client.1.smithi086.stdout:4/681: getdents d2/d18/d33/d42/d72/d78/d25/d55/de1 0 2024-08-19T00:56:11.908 INFO:tasks.workunit.client.1.smithi086.stdout:3/715: getdents d3/d18/d1a/d51/d75 0 2024-08-19T00:56:11.910 INFO:tasks.workunit.client.1.smithi086.stdout:7/701: write d3/de/f12 [2837467,51213] 0 2024-08-19T00:56:11.914 INFO:tasks.workunit.client.1.smithi086.stdout:0/697: getdents da/d5d/da9 0 2024-08-19T00:56:11.914 INFO:tasks.workunit.client.1.smithi086.stdout:7/702: read d3/de/d68/fb6 [4052612,83292] 0 2024-08-19T00:56:11.917 INFO:tasks.workunit.client.1.smithi086.stdout:0/698: write da/d14/d1a/d2e/d39/d3b/d4e/fb0 [669537,77649] 0 2024-08-19T00:56:11.919 INFO:tasks.workunit.client.1.smithi086.stdout:7/703: chown d3/d34/d44/d58/d4b/da5/lc6 1 1 2024-08-19T00:56:11.922 INFO:tasks.workunit.client.1.smithi086.stdout:0/699: write da/d14/d26/f68 [3498762,19890] 0 2024-08-19T00:56:11.922 INFO:tasks.workunit.client.1.smithi086.stdout:8/686: dwrite dc/d16/dc7/d2e/d28/d2b/f38 [0,4194304] 0 2024-08-19T00:56:11.923 INFO:tasks.workunit.client.1.smithi086.stdout:6/702: dwrite db/f2b [0,4194304] 0 2024-08-19T00:56:11.927 INFO:tasks.workunit.client.1.smithi086.stdout:6/703: creat db/d34/d4e/db4/fde x:0 0 0 2024-08-19T00:56:11.928 INFO:tasks.workunit.client.1.smithi086.stdout:3/716: dread d3/d18/d19/dbc/fa0 [0,4194304] 0 2024-08-19T00:56:11.928 INFO:tasks.workunit.client.1.smithi086.stdout:8/687: write dc/d16/d18/fda [123305,30697] 0 2024-08-19T00:56:11.928 INFO:tasks.workunit.client.1.smithi086.stdout:0/700: creat da/d14/d1a/d2e/d30/d76/fde x:0 0 0 2024-08-19T00:56:11.933 INFO:tasks.workunit.client.1.smithi086.stdout:0/701: mknod da/d5d/cdf 0 2024-08-19T00:56:11.934 INFO:tasks.workunit.client.1.smithi086.stdout:7/704: dwrite d3/de/d68/fb6 [4194304,4194304] 0 2024-08-19T00:56:11.935 INFO:tasks.workunit.client.1.smithi086.stdout:8/688: mknod dc/d1f/d37/d4f/dac/db8/d8f/cdd 0 2024-08-19T00:56:11.940 INFO:tasks.workunit.client.1.smithi086.stdout:3/717: link d3/d9/f15 d3/d18/d1a/d51/fea 0 2024-08-19T00:56:11.944 INFO:tasks.workunit.client.1.smithi086.stdout:7/705: dwrite d3/f97 [0,4194304] 0 2024-08-19T00:56:11.946 INFO:tasks.workunit.client.1.smithi086.stdout:6/704: rename db/d37/d30/l70 to db/d34/d39/ldf 0 2024-08-19T00:56:11.950 INFO:tasks.workunit.client.1.smithi086.stdout:8/689: rename f5 to dc/d16/dc7/d2e/d28/d41/fde 0 2024-08-19T00:56:11.951 INFO:tasks.workunit.client.1.smithi086.stdout:0/702: link da/d14/d44/lc9 da/d14/le0 0 2024-08-19T00:56:11.952 INFO:tasks.workunit.client.1.smithi086.stdout:3/718: symlink d3/d18/d19/dbc/de1/leb 0 2024-08-19T00:56:11.954 INFO:tasks.workunit.client.1.smithi086.stdout:3/719: fdatasync d3/d18/d27/d49/d3f/f89 0 2024-08-19T00:56:11.955 INFO:tasks.workunit.client.1.smithi086.stdout:8/690: dread dc/d17/d86/fb4 [0,4194304] 0 2024-08-19T00:56:11.956 INFO:tasks.workunit.client.1.smithi086.stdout:6/705: creat db/d34/d39/fe0 x:0 0 0 2024-08-19T00:56:11.957 INFO:tasks.workunit.client.1.smithi086.stdout:3/720: fsync d3/d18/f36 0 2024-08-19T00:56:11.957 INFO:tasks.workunit.client.1.smithi086.stdout:6/706: fdatasync db/f2b 0 2024-08-19T00:56:11.957 INFO:tasks.workunit.client.1.smithi086.stdout:0/703: symlink da/d14/d1a/d2e/d43/le1 0 2024-08-19T00:56:11.958 INFO:tasks.workunit.client.1.smithi086.stdout:8/691: readlink dc/d17/d1e/d49/l5e 0 2024-08-19T00:56:11.958 INFO:tasks.workunit.client.1.smithi086.stdout:7/706: dwrite d3/de/f66 [0,4194304] 0 2024-08-19T00:56:11.959 INFO:tasks.workunit.client.1.smithi086.stdout:6/707: fsync db/d37/d28/d7f/fca 0 2024-08-19T00:56:11.960 INFO:tasks.workunit.client.1.smithi086.stdout:3/721: mknod d3/d26/d2b/d33/cec 0 2024-08-19T00:56:11.961 INFO:tasks.workunit.client.1.smithi086.stdout:6/708: chown db/d37/d44/d5a/l6c 2283 1 2024-08-19T00:56:11.962 INFO:tasks.workunit.client.1.smithi086.stdout:7/707: mkdir d3/d34/d44/d58/d4b/da5/ded 0 2024-08-19T00:56:11.964 INFO:tasks.workunit.client.1.smithi086.stdout:3/722: rename d3/d18/d61/d85/fb3 to d3/d18/d27/d49/fed 0 2024-08-19T00:56:11.964 INFO:tasks.workunit.client.1.smithi086.stdout:6/709: write db/d34/d39/d76/f7b [2313360,84062] 0 2024-08-19T00:56:11.968 INFO:tasks.workunit.client.1.smithi086.stdout:7/708: rename d3/de/d2d/ld1 to d3/d34/d44/d58/d4b/d42/lee 0 2024-08-19T00:56:11.969 INFO:tasks.workunit.client.1.smithi086.stdout:0/704: dwrite da/d14/d1a/d2e/d39/d3b/d89/dc5/fcb [0,4194304] 0 2024-08-19T00:56:11.971 INFO:tasks.workunit.client.1.smithi086.stdout:3/723: mkdir d3/d18/d1a/d51/dad/dee 0 2024-08-19T00:56:11.973 INFO:tasks.workunit.client.1.smithi086.stdout:0/705: write da/d14/d26/fd4 [607243,126202] 0 2024-08-19T00:56:11.975 INFO:tasks.workunit.client.1.smithi086.stdout:7/709: rename d3/d34/lbc to d3/de/d2d/lef 0 2024-08-19T00:56:11.978 INFO:tasks.workunit.client.1.smithi086.stdout:1/788: sync 2024-08-19T00:56:11.980 INFO:tasks.workunit.client.1.smithi086.stdout:3/724: creat d3/d26/d2b/d33/d4a/d57/db4/fef x:0 0 0 2024-08-19T00:56:11.983 INFO:tasks.workunit.client.1.smithi086.stdout:3/725: dread - d3/d26/d2b/d33/d4a/d57/db4/fef zero size 2024-08-19T00:56:11.985 INFO:tasks.workunit.client.1.smithi086.stdout:1/789: creat d4/d10/dc2/f103 x:0 0 0 2024-08-19T00:56:11.986 INFO:tasks.workunit.client.1.smithi086.stdout:0/706: dwrite da/d5d/da9/fab [0,4194304] 0 2024-08-19T00:56:11.988 INFO:tasks.workunit.client.1.smithi086.stdout:0/707: chown da/fe 6784209 1 2024-08-19T00:56:11.989 INFO:tasks.workunit.client.1.smithi086.stdout:1/790: symlink d4/d10/dc2/l104 0 2024-08-19T00:56:11.991 INFO:tasks.workunit.client.1.smithi086.stdout:1/791: fsync d4/d7/d2a/d36/d7d/d88/fcc 0 2024-08-19T00:56:11.992 INFO:tasks.workunit.client.1.smithi086.stdout:3/726: rename d3/d18/d27/d49/fed to d3/d18/d19/d37/ff0 0 2024-08-19T00:56:11.994 INFO:tasks.workunit.client.1.smithi086.stdout:6/710: dread db/d37/d41/da7/f65 [0,4194304] 0 2024-08-19T00:56:11.996 INFO:tasks.workunit.client.1.smithi086.stdout:1/792: rename d4/d7/d2a/d36/d3a/de5/d7a/db4/lc6 to d4/d7/d2a/d6e/d95/db9/deb/l105 0 2024-08-19T00:56:11.998 INFO:tasks.workunit.client.1.smithi086.stdout:3/727: truncate d3/d18/d19/d37/f93 1160343 0 2024-08-19T00:56:12.000 INFO:tasks.workunit.client.1.smithi086.stdout:1/793: mknod d4/d7/d2a/d36/d61/c106 0 2024-08-19T00:56:12.000 INFO:tasks.workunit.client.1.smithi086.stdout:7/710: dwrite d3/f3a [0,4194304] 0 2024-08-19T00:56:12.003 INFO:tasks.workunit.client.1.smithi086.stdout:6/711: dwrite db/d37/d44/d5a/fbb [0,4194304] 0 2024-08-19T00:56:12.003 INFO:tasks.workunit.client.1.smithi086.stdout:1/794: unlink d4/d7/d2a/l58 0 2024-08-19T00:56:12.006 INFO:tasks.workunit.client.1.smithi086.stdout:3/728: getdents d3/d26/d2b/d33/d4a 0 2024-08-19T00:56:12.007 INFO:tasks.workunit.client.1.smithi086.stdout:6/712: mkdir db/d34/d4e/d68/d99/de1 0 2024-08-19T00:56:12.008 INFO:tasks.workunit.client.1.smithi086.stdout:1/795: mknod d4/d7/d2a/d36/d3a/de5/c107 0 2024-08-19T00:56:12.009 INFO:tasks.workunit.client.1.smithi086.stdout:6/713: write db/d34/d4e/fd2 [1528354,74217] 0 2024-08-19T00:56:12.010 INFO:tasks.workunit.client.1.smithi086.stdout:6/714: chown db/d37/d30/fc9 0 1 2024-08-19T00:56:12.011 INFO:tasks.workunit.client.1.smithi086.stdout:1/796: rmdir d4/d7/d2a/d36/d7d 39 2024-08-19T00:56:12.015 INFO:tasks.workunit.client.1.smithi086.stdout:6/715: dwrite db/d34/d69/f7d [0,4194304] 0 2024-08-19T00:56:12.018 INFO:tasks.workunit.client.1.smithi086.stdout:6/716: rename db/f18 to db/d37/d44/d5a/d78/fe2 0 2024-08-19T00:56:12.052 INFO:tasks.workunit.client.0.smithi017.stdout:5/218: sync 2024-08-19T00:56:12.061 INFO:tasks.workunit.client.0.smithi017.stdout:5/219: dwrite db/d19/d1f/f50 [0,4194304] 0 2024-08-19T00:56:12.062 INFO:tasks.workunit.client.1.smithi086.stdout:1/797: dwrite d4/fb3 [0,4194304] 0 2024-08-19T00:56:12.063 INFO:tasks.workunit.client.0.smithi017.stdout:5/220: write db/d19/d1f/d15/d3e/d40/f44 [282539,124197] 0 2024-08-19T00:56:12.064 INFO:tasks.workunit.client.1.smithi086.stdout:1/798: write d4/d10/ff9 [646062,112271] 0 2024-08-19T00:56:12.065 INFO:tasks.workunit.client.0.smithi017.stdout:5/221: write db/d19/d1f/d15/d1e/f3d [410150,96931] 0 2024-08-19T00:56:12.072 INFO:tasks.workunit.client.0.smithi017.stdout:5/222: dread db/d19/d1f/d15/d1e/f37 [0,4194304] 0 2024-08-19T00:56:12.078 INFO:tasks.workunit.client.0.smithi017.stdout:5/223: dwrite db/f34 [0,4194304] 0 2024-08-19T00:56:12.089 INFO:tasks.workunit.client.1.smithi086.stdout:1/799: dread d4/d7/d2a/d36/d3a/f43 [0,4194304] 0 2024-08-19T00:56:12.093 INFO:tasks.workunit.client.0.smithi017.stdout:5/224: dread f6 [4194304,4194304] 0 2024-08-19T00:56:12.094 INFO:tasks.workunit.client.1.smithi086.stdout:1/800: rename d4/d7/d2a/d36/d7d/d88/ce1 to d4/d7/d2a/d36/d50/d9c/ded/c108 0 2024-08-19T00:56:12.094 INFO:tasks.workunit.client.0.smithi017.stdout:5/225: readlink db/d19/d1f/d15/l3a 0 2024-08-19T00:56:12.095 INFO:tasks.workunit.client.0.smithi017.stdout:5/226: chown db/d19/d1f/d15/d3e/l4c 7450 1 2024-08-19T00:56:12.096 INFO:tasks.workunit.client.1.smithi086.stdout:2/683: sync 2024-08-19T00:56:12.096 INFO:tasks.workunit.client.0.smithi017.stdout:5/227: symlink db/d19/d1f/d15/d3e/l55 0 2024-08-19T00:56:12.097 INFO:tasks.workunit.client.0.smithi017.stdout:5/228: readlink db/d19/d1f/d15/l54 0 2024-08-19T00:56:12.099 INFO:tasks.workunit.client.1.smithi086.stdout:2/684: creat d8/d2c/d38/fe6 x:0 0 0 2024-08-19T00:56:12.102 INFO:tasks.workunit.client.1.smithi086.stdout:2/685: creat d8/d43/d65/fe7 x:0 0 0 2024-08-19T00:56:12.102 INFO:tasks.workunit.client.1.smithi086.stdout:6/717: truncate db/d34/d39/f40 2274519 0 2024-08-19T00:56:12.152 INFO:tasks.workunit.client.1.smithi086.stdout:2/686: write d8/f40 [1202445,7699] 0 2024-08-19T00:56:12.152 INFO:tasks.workunit.client.1.smithi086.stdout:6/718: truncate db/d34/d39/f48 673788 0 2024-08-19T00:56:12.154 INFO:tasks.workunit.client.1.smithi086.stdout:7/711: dread d3/d34/d44/d58/d4b/f61 [0,4194304] 0 2024-08-19T00:56:12.155 INFO:tasks.workunit.client.1.smithi086.stdout:2/687: mknod d8/d43/d65/ce8 0 2024-08-19T00:56:12.159 INFO:tasks.workunit.client.1.smithi086.stdout:6/719: dread db/d37/d30/f85 [0,4194304] 0 2024-08-19T00:56:12.162 INFO:tasks.workunit.client.1.smithi086.stdout:6/720: symlink db/d37/d28/le3 0 2024-08-19T00:56:12.162 INFO:tasks.workunit.client.1.smithi086.stdout:7/712: write d3/d34/f89 [72348,15896] 0 2024-08-19T00:56:12.162 INFO:tasks.workunit.client.1.smithi086.stdout:2/688: write d8/d2c/d38/d80/db4/db7/fe3 [8080580,120437] 0 2024-08-19T00:56:12.164 INFO:tasks.workunit.client.1.smithi086.stdout:2/689: mknod d8/d84/d79/ce9 0 2024-08-19T00:56:12.165 INFO:tasks.workunit.client.1.smithi086.stdout:7/713: mkdir d3/d34/d44/d58/d4b/da5/daf/df0 0 2024-08-19T00:56:12.165 INFO:tasks.workunit.client.1.smithi086.stdout:6/721: truncate db/d37/d44/d5a/d78/f92 31223 0 2024-08-19T00:56:12.166 INFO:tasks.workunit.client.1.smithi086.stdout:2/690: creat d8/d2c/d47/d73/fea x:0 0 0 2024-08-19T00:56:12.167 INFO:tasks.workunit.client.1.smithi086.stdout:7/714: truncate d3/de/d68/d7a/d96/fb9 127025 0 2024-08-19T00:56:12.168 INFO:tasks.workunit.client.1.smithi086.stdout:6/722: dread db/d37/f24 [0,4194304] 0 2024-08-19T00:56:12.169 INFO:tasks.workunit.client.1.smithi086.stdout:2/691: rename d8/d24/f2b to d8/d2c/d38/d80/db4/db7/feb 0 2024-08-19T00:56:12.170 INFO:tasks.workunit.client.1.smithi086.stdout:6/723: truncate db/d37/d30/fc9 441350 0 2024-08-19T00:56:12.170 INFO:tasks.workunit.client.1.smithi086.stdout:2/692: fsync d8/d43/d65/f70 0 2024-08-19T00:56:12.173 INFO:tasks.workunit.client.1.smithi086.stdout:7/715: link d3/l10 d3/da1/lf1 0 2024-08-19T00:56:12.176 INFO:tasks.workunit.client.1.smithi086.stdout:2/693: dwrite d8/d14/f88 [0,4194304] 0 2024-08-19T00:56:12.179 INFO:tasks.workunit.client.1.smithi086.stdout:2/694: unlink d8/d14/c16 0 2024-08-19T00:56:12.179 INFO:tasks.workunit.client.1.smithi086.stdout:7/716: getdents d3/dd9 0 2024-08-19T00:56:12.180 INFO:tasks.workunit.client.1.smithi086.stdout:2/695: chown d8/d84/d79/lc4 1220 1 2024-08-19T00:56:12.181 INFO:tasks.workunit.client.1.smithi086.stdout:7/717: mkdir d3/d34/df2 0 2024-08-19T00:56:12.182 INFO:tasks.workunit.client.1.smithi086.stdout:2/696: dread - d8/d43/d65/fb0 zero size 2024-08-19T00:56:12.184 INFO:tasks.workunit.client.1.smithi086.stdout:2/697: dread - d8/d24/d32/d4d/fd8 zero size 2024-08-19T00:56:12.185 INFO:tasks.workunit.client.1.smithi086.stdout:6/724: dwrite db/d34/d39/f40 [0,4194304] 0 2024-08-19T00:56:12.185 INFO:tasks.workunit.client.1.smithi086.stdout:7/718: fsync d3/de/d68/d72/d7e/f92 0 2024-08-19T00:56:12.185 INFO:tasks.workunit.client.1.smithi086.stdout:9/715: sync 2024-08-19T00:56:12.185 INFO:tasks.workunit.client.1.smithi086.stdout:5/692: sync 2024-08-19T00:56:12.186 INFO:tasks.workunit.client.1.smithi086.stdout:4/682: sync 2024-08-19T00:56:12.189 INFO:tasks.workunit.client.1.smithi086.stdout:7/719: creat d3/de/d2d/ff3 x:0 0 0 2024-08-19T00:56:12.191 INFO:tasks.workunit.client.1.smithi086.stdout:7/720: readlink d3/d34/d44/d58/d4b/l63 0 2024-08-19T00:56:12.191 INFO:tasks.workunit.client.1.smithi086.stdout:9/716: creat db/d26/d5c/d87/d30/d3f/fe9 x:0 0 0 2024-08-19T00:56:12.192 INFO:tasks.workunit.client.1.smithi086.stdout:4/683: write d2/d18/d33/d42/d72/d78/d2c/f43 [1933204,47460] 0 2024-08-19T00:56:12.194 INFO:tasks.workunit.client.1.smithi086.stdout:6/725: rename db/d37/d44/d5a/f73 to db/d34/d39/d76/dbf/fe4 0 2024-08-19T00:56:12.194 INFO:tasks.workunit.client.1.smithi086.stdout:6/726: readlink db/d37/d44/d5a/l6c 0 2024-08-19T00:56:12.195 INFO:tasks.workunit.client.1.smithi086.stdout:7/721: dread d3/d34/d44/d58/fa9 [0,4194304] 0 2024-08-19T00:56:12.196 INFO:tasks.workunit.client.1.smithi086.stdout:4/684: write d2/d18/d33/d42/f61 [381849,4874] 0 2024-08-19T00:56:12.197 INFO:tasks.workunit.client.1.smithi086.stdout:9/717: unlink db/l2e 0 2024-08-19T00:56:12.200 INFO:tasks.workunit.client.1.smithi086.stdout:7/722: stat d3/ff 0 2024-08-19T00:56:12.200 INFO:tasks.workunit.client.1.smithi086.stdout:4/685: mknod d2/d18/ce8 0 2024-08-19T00:56:12.201 INFO:tasks.workunit.client.1.smithi086.stdout:5/693: write d0/d2d/d43/d4d/f54 [1008585,49360] 0 2024-08-19T00:56:12.202 INFO:tasks.workunit.client.1.smithi086.stdout:9/718: creat db/d26/d5c/d87/d30/d32/fea x:0 0 0 2024-08-19T00:56:12.203 INFO:tasks.workunit.client.1.smithi086.stdout:6/727: mknod db/d37/d28/ce5 0 2024-08-19T00:56:12.204 INFO:tasks.workunit.client.1.smithi086.stdout:4/686: chown d2/d18/d33/d42/d72/d78/d25/d55/c7c 15 1 2024-08-19T00:56:12.205 INFO:tasks.workunit.client.1.smithi086.stdout:7/723: symlink d3/d34/lf4 0 2024-08-19T00:56:12.208 INFO:tasks.workunit.client.1.smithi086.stdout:6/728: getdents db/d34/d4e 0 2024-08-19T00:56:12.209 INFO:tasks.workunit.client.1.smithi086.stdout:2/698: dwrite d8/d14/f22 [4194304,4194304] 0 2024-08-19T00:56:12.211 INFO:tasks.workunit.client.1.smithi086.stdout:7/724: rename d3/de/d68/d7a to d3/d34/d44/d58/d4b/da5/daf/de7/df5 0 2024-08-19T00:56:12.213 INFO:tasks.workunit.client.1.smithi086.stdout:6/729: mknod db/d37/d41/dad/ce6 0 2024-08-19T00:56:12.214 INFO:tasks.workunit.client.1.smithi086.stdout:2/699: creat d8/d24/d32/d4d/fec x:0 0 0 2024-08-19T00:56:12.215 INFO:tasks.workunit.client.1.smithi086.stdout:2/700: dread - d8/d43/d65/fb0 zero size 2024-08-19T00:56:12.217 INFO:tasks.workunit.client.1.smithi086.stdout:6/730: link db/d37/d41/ld5 db/d34/d4e/d68/d99/de1/le7 0 2024-08-19T00:56:12.219 INFO:tasks.workunit.client.1.smithi086.stdout:6/731: write db/d37/d30/fc9 [230842,44851] 0 2024-08-19T00:56:12.219 INFO:tasks.workunit.client.1.smithi086.stdout:5/694: dread d0/d8/d10/f1d [0,4194304] 0 2024-08-19T00:56:12.220 INFO:tasks.workunit.client.1.smithi086.stdout:5/695: chown d0/d99/fad 14262 1 2024-08-19T00:56:12.220 INFO:tasks.workunit.client.1.smithi086.stdout:6/732: symlink db/d34/d39/d76/le8 0 2024-08-19T00:56:12.224 INFO:tasks.workunit.client.1.smithi086.stdout:5/696: truncate d0/f29 2428108 0 2024-08-19T00:56:12.226 INFO:tasks.workunit.client.1.smithi086.stdout:5/697: readlink d0/d5f/d60/d57/d80/lc9 0 2024-08-19T00:56:12.227 INFO:tasks.workunit.client.1.smithi086.stdout:6/733: dwrite db/d34/d39/d76/fb2 [0,4194304] 0 2024-08-19T00:56:12.229 INFO:tasks.workunit.client.1.smithi086.stdout:6/734: mkdir db/d37/d28/d7f/d96/dc2/de9 0 2024-08-19T00:56:12.232 INFO:tasks.workunit.client.1.smithi086.stdout:2/701: dread d8/d43/fa1 [0,4194304] 0 2024-08-19T00:56:12.232 INFO:tasks.workunit.client.1.smithi086.stdout:2/702: readlink d8/l2d 0 2024-08-19T00:56:12.239 INFO:tasks.workunit.client.1.smithi086.stdout:2/703: creat d8/d14/fed x:0 0 0 2024-08-19T00:56:12.242 INFO:tasks.workunit.client.1.smithi086.stdout:6/735: dwrite db/d37/d44/d5a/fbb [4194304,4194304] 0 2024-08-19T00:56:12.242 INFO:tasks.workunit.client.1.smithi086.stdout:5/698: dread d0/d99/dc0/dc2/f79 [0,4194304] 0 2024-08-19T00:56:12.243 INFO:tasks.workunit.client.1.smithi086.stdout:2/704: read d8/d2c/d38/d80/db4/db7/feb [3231437,12992] 0 2024-08-19T00:56:12.244 INFO:tasks.workunit.client.1.smithi086.stdout:2/705: dread - d8/d2c/d38/d80/fce zero size 2024-08-19T00:56:12.245 INFO:tasks.workunit.client.1.smithi086.stdout:5/699: mknod d0/d99/cd4 0 2024-08-19T00:56:12.247 INFO:tasks.workunit.client.1.smithi086.stdout:6/736: mkdir db/d34/d39/dea 0 2024-08-19T00:56:12.248 INFO:tasks.workunit.client.1.smithi086.stdout:5/700: truncate d0/df/d1f/f28 5117216 0 2024-08-19T00:56:12.250 INFO:tasks.workunit.client.1.smithi086.stdout:5/701: creat d0/df/d1f/fd5 x:0 0 0 2024-08-19T00:56:12.251 INFO:tasks.workunit.client.1.smithi086.stdout:2/706: unlink d8/d14/fa6 0 2024-08-19T00:56:12.252 INFO:tasks.workunit.client.1.smithi086.stdout:5/702: mknod d0/df/d1f/cd6 0 2024-08-19T00:56:12.252 INFO:tasks.workunit.client.1.smithi086.stdout:5/703: chown d0/d99/fad 6242348 1 2024-08-19T00:56:12.253 INFO:tasks.workunit.client.1.smithi086.stdout:2/707: read d8/d43/f86 [3142835,66323] 0 2024-08-19T00:56:12.253 INFO:tasks.workunit.client.1.smithi086.stdout:5/704: chown d0/d99/dc0/dc2/f79 4946 1 2024-08-19T00:56:12.253 INFO:tasks.workunit.client.1.smithi086.stdout:5/705: chown d0/d2d/l2f 951029954 1 2024-08-19T00:56:12.255 INFO:tasks.workunit.client.1.smithi086.stdout:2/708: mknod d8/d14/cee 0 2024-08-19T00:56:12.256 INFO:tasks.workunit.client.1.smithi086.stdout:6/737: truncate f3 1121475 0 2024-08-19T00:56:12.256 INFO:tasks.workunit.client.1.smithi086.stdout:6/738: readlink db/d37/d28/d57/l59 0 2024-08-19T00:56:12.257 INFO:tasks.workunit.client.1.smithi086.stdout:2/709: unlink d8/d84/d79/lc4 0 2024-08-19T00:56:12.266 INFO:tasks.workunit.client.1.smithi086.stdout:5/706: dread d0/d5f/d60/f83 [0,4194304] 0 2024-08-19T00:56:12.276 INFO:tasks.workunit.client.1.smithi086.stdout:0/708: sync 2024-08-19T00:56:12.276 INFO:tasks.workunit.client.1.smithi086.stdout:8/692: sync 2024-08-19T00:56:12.326 INFO:tasks.workunit.client.1.smithi086.stdout:3/729: sync 2024-08-19T00:56:12.326 INFO:tasks.workunit.client.1.smithi086.stdout:1/801: sync 2024-08-19T00:56:12.326 INFO:tasks.workunit.client.1.smithi086.stdout:3/730: read - d3/d26/fbd zero size 2024-08-19T00:56:12.340 INFO:tasks.workunit.client.1.smithi086.stdout:6/739: unlink db/d37/c35 0 2024-08-19T00:56:12.340 INFO:tasks.workunit.client.1.smithi086.stdout:2/710: creat d8/d2c/d47/d73/fef x:0 0 0 2024-08-19T00:56:12.341 INFO:tasks.workunit.client.1.smithi086.stdout:2/711: dread - d8/d2c/d38/fd9 zero size 2024-08-19T00:56:12.342 INFO:tasks.workunit.client.1.smithi086.stdout:2/712: dread - d8/d43/d65/fb0 zero size 2024-08-19T00:56:12.342 INFO:tasks.workunit.client.1.smithi086.stdout:3/731: creat d3/d26/dba/ff1 x:0 0 0 2024-08-19T00:56:12.343 INFO:tasks.workunit.client.1.smithi086.stdout:6/740: fsync db/d34/f9a 0 2024-08-19T00:56:12.344 INFO:tasks.workunit.client.1.smithi086.stdout:0/709: mknod da/d14/ce2 0 2024-08-19T00:56:12.344 INFO:tasks.workunit.client.1.smithi086.stdout:0/710: readlink da/d14/d44/d49/l58 0 2024-08-19T00:56:12.344 INFO:tasks.workunit.client.1.smithi086.stdout:8/693: fdatasync dc/d16/dc7/d2e/d28/f69 0 2024-08-19T00:56:12.345 INFO:tasks.workunit.client.1.smithi086.stdout:1/802: mknod d4/c109 0 2024-08-19T00:56:12.346 INFO:tasks.workunit.client.1.smithi086.stdout:1/803: chown d4/d10/fae 2691 1 2024-08-19T00:56:12.347 INFO:tasks.workunit.client.1.smithi086.stdout:5/707: link d0/d99/cd4 d0/d8/d94/cd7 0 2024-08-19T00:56:12.348 INFO:tasks.workunit.client.1.smithi086.stdout:5/708: write d0/d2d/d43/d91/fbd [1271862,62757] 0 2024-08-19T00:56:12.350 INFO:tasks.workunit.client.1.smithi086.stdout:6/741: mknod db/d34/d4e/db4/ceb 0 2024-08-19T00:56:12.356 INFO:tasks.workunit.client.1.smithi086.stdout:3/732: creat d3/d18/d1a/d51/dad/dee/ff2 x:0 0 0 2024-08-19T00:56:12.358 INFO:tasks.workunit.client.1.smithi086.stdout:0/711: dread da/d14/d26/f68 [0,4194304] 0 2024-08-19T00:56:12.359 INFO:tasks.workunit.client.1.smithi086.stdout:2/713: write d8/d43/d65/fb0 [805419,107862] 0 2024-08-19T00:56:12.359 INFO:tasks.workunit.client.1.smithi086.stdout:8/694: symlink dc/d1f/d37/d4f/dac/db8/d7a/d88/db2/ldf 0 2024-08-19T00:56:12.361 INFO:tasks.workunit.client.1.smithi086.stdout:2/714: write d8/d2c/d38/d80/db4/db7/fc5 [318999,85712] 0 2024-08-19T00:56:12.366 INFO:tasks.workunit.client.1.smithi086.stdout:0/712: mknod da/d14/d1a/d2e/d39/d3b/d89/ce3 0 2024-08-19T00:56:12.367 INFO:tasks.workunit.client.1.smithi086.stdout:8/695: mknod dc/d17/d1e/d82/ce0 0 2024-08-19T00:56:12.367 INFO:tasks.workunit.client.1.smithi086.stdout:0/713: chown da/d14/d55/fca 236539 1 2024-08-19T00:56:12.368 INFO:tasks.workunit.client.1.smithi086.stdout:2/715: stat d8/d2c/d38/lda 0 2024-08-19T00:56:12.369 INFO:tasks.workunit.client.1.smithi086.stdout:5/709: creat d0/d2d/fd8 x:0 0 0 2024-08-19T00:56:12.370 INFO:tasks.workunit.client.1.smithi086.stdout:9/719: sync 2024-08-19T00:56:12.370 INFO:tasks.workunit.client.1.smithi086.stdout:7/725: sync 2024-08-19T00:56:12.370 INFO:tasks.workunit.client.1.smithi086.stdout:4/687: sync 2024-08-19T00:56:12.370 INFO:tasks.workunit.client.1.smithi086.stdout:6/742: link db/d34/d4e/fcd db/d34/d4e/d68/d99/fec 0 2024-08-19T00:56:12.370 INFO:tasks.workunit.client.1.smithi086.stdout:3/733: write d3/d18/d1a/f34 [1251241,114495] 0 2024-08-19T00:56:12.371 INFO:tasks.workunit.client.1.smithi086.stdout:2/716: mkdir d8/d24/d32/d4d/df0 0 2024-08-19T00:56:12.372 INFO:tasks.workunit.client.1.smithi086.stdout:1/804: dwrite d4/d7/d2a/d36/d63/f78 [0,4194304] 0 2024-08-19T00:56:12.372 INFO:tasks.workunit.client.1.smithi086.stdout:8/696: read dc/d16/d18/f8c [804321,123613] 0 2024-08-19T00:56:12.374 INFO:tasks.workunit.client.1.smithi086.stdout:9/720: fsync db/dd/d19/f33 0 2024-08-19T00:56:12.376 INFO:tasks.workunit.client.1.smithi086.stdout:0/714: rename da/d14/d1a/d2e/d39/f74 to da/d14/d1a/d2e/d39/d3b/d89/dd1/fe4 0 2024-08-19T00:56:12.377 INFO:tasks.workunit.client.1.smithi086.stdout:2/717: creat d8/d2c/d47/ff1 x:0 0 0 2024-08-19T00:56:12.377 INFO:tasks.workunit.client.1.smithi086.stdout:7/726: truncate d3/de/fa6 1473352 0 2024-08-19T00:56:12.380 INFO:tasks.workunit.client.1.smithi086.stdout:4/688: mknod d2/d18/d33/d42/d72/d2f/dc4/d81/ce9 0 2024-08-19T00:56:12.380 INFO:tasks.workunit.client.0.smithi017.stdout:3/287: sync 2024-08-19T00:56:12.380 INFO:tasks.workunit.client.0.smithi017.stdout:9/253: sync 2024-08-19T00:56:12.380 INFO:tasks.workunit.client.0.smithi017.stdout:6/206: sync 2024-08-19T00:56:12.381 INFO:tasks.workunit.client.0.smithi017.stdout:9/254: stat d0/d33/f29 0 2024-08-19T00:56:12.382 INFO:tasks.workunit.client.0.smithi017.stdout:6/207: dread - d5/d13/d11/f3b zero size 2024-08-19T00:56:12.382 INFO:tasks.workunit.client.0.smithi017.stdout:9/255: fsync d0/d33/f17 0 2024-08-19T00:56:12.383 INFO:tasks.workunit.client.1.smithi086.stdout:5/710: rename d0/d8/caf to d0/d5f/d60/cd9 0 2024-08-19T00:56:12.384 INFO:tasks.workunit.client.0.smithi017.stdout:6/208: write d5/d13/d11/fa [1743907,121972] 0 2024-08-19T00:56:12.384 INFO:tasks.workunit.client.1.smithi086.stdout:1/805: dread d4/d7/d2a/d36/d7d/d88/f99 [0,4194304] 0 2024-08-19T00:56:12.389 INFO:tasks.workunit.client.1.smithi086.stdout:8/697: dwrite dc/d16/dc7/d2e/d28/d2b/d3b/f8e [8388608,4194304] 0 2024-08-19T00:56:12.392 INFO:tasks.workunit.client.1.smithi086.stdout:9/721: dwrite db/d26/d5c/d87/d30/d32/d44/f65 [0,4194304] 0 2024-08-19T00:56:12.393 INFO:tasks.workunit.client.0.smithi017.stdout:6/209: dwrite d5/d13/f16 [0,4194304] 0 2024-08-19T00:56:12.393 INFO:tasks.workunit.client.0.smithi017.stdout:3/288: dwrite d5/fc [0,4194304] 0 2024-08-19T00:56:12.398 INFO:tasks.workunit.client.0.smithi017.stdout:6/210: read d5/f1e [2255853,73987] 0 2024-08-19T00:56:12.398 INFO:tasks.workunit.client.1.smithi086.stdout:8/698: write dc/d17/d86/fa9 [121646,87086] 0 2024-08-19T00:56:12.399 INFO:tasks.workunit.client.1.smithi086.stdout:7/727: write d3/de/f17 [3753964,102406] 0 2024-08-19T00:56:12.400 INFO:tasks.workunit.client.0.smithi017.stdout:6/211: write d5/d13/f1b [2064461,83400] 0 2024-08-19T00:56:12.401 INFO:tasks.workunit.client.1.smithi086.stdout:4/689: dwrite d2/d18/d33/d42/f61 [4194304,4194304] 0 2024-08-19T00:56:12.405 INFO:tasks.workunit.client.0.smithi017.stdout:3/289: truncate d5/d15/d1b/f20 1507606 0 2024-08-19T00:56:12.405 INFO:tasks.workunit.client.0.smithi017.stdout:3/290: chown d5/d18/c24 122511 1 2024-08-19T00:56:12.406 INFO:tasks.workunit.client.1.smithi086.stdout:2/718: write f2 [143308,109379] 0 2024-08-19T00:56:12.407 INFO:tasks.workunit.client.0.smithi017.stdout:3/291: write d5/d11/f34 [805935,117367] 0 2024-08-19T00:56:12.407 INFO:tasks.workunit.client.1.smithi086.stdout:4/690: write d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd/fe5 [75889,12732] 0 2024-08-19T00:56:12.407 INFO:tasks.workunit.client.1.smithi086.stdout:9/722: dread - db/d96/de1/fe7 zero size 2024-08-19T00:56:12.408 INFO:tasks.workunit.client.0.smithi017.stdout:9/256: write d0/d33/f29 [1251516,83602] 0 2024-08-19T00:56:12.409 INFO:tasks.workunit.client.0.smithi017.stdout:3/292: fdatasync d5/da/d27/d28/f37 0 2024-08-19T00:56:12.412 INFO:tasks.workunit.client.1.smithi086.stdout:4/691: write d2/d18/f28 [507415,9960] 0 2024-08-19T00:56:12.412 INFO:tasks.workunit.client.1.smithi086.stdout:8/699: mknod dc/d16/dc7/d2e/d28/d2b/ce1 0 2024-08-19T00:56:12.414 INFO:tasks.workunit.client.1.smithi086.stdout:8/700: readlink dc/d16/dc7/d2e/d28/d41/la7 0 2024-08-19T00:56:12.416 INFO:tasks.workunit.client.0.smithi017.stdout:9/257: chown d0/c13 51 1 2024-08-19T00:56:12.417 INFO:tasks.workunit.client.1.smithi086.stdout:5/711: dread d0/d8/d10/f42 [0,4194304] 0 2024-08-19T00:56:12.420 INFO:tasks.workunit.client.1.smithi086.stdout:6/743: rename db/d34/d69/f94 to db/d37/d41/fed 0 2024-08-19T00:56:12.420 INFO:tasks.workunit.client.1.smithi086.stdout:6/744: fdatasync db/d34/d39/fe0 0 2024-08-19T00:56:12.421 INFO:tasks.workunit.client.0.smithi017.stdout:6/212: dwrite d5/d13/d11/f3f [0,4194304] 0 2024-08-19T00:56:12.422 INFO:tasks.workunit.client.1.smithi086.stdout:7/728: dread d3/de/d2d/f35 [0,4194304] 0 2024-08-19T00:56:12.423 INFO:tasks.workunit.client.1.smithi086.stdout:7/729: fsync d3/de/f15 0 2024-08-19T00:56:12.424 INFO:tasks.workunit.client.1.smithi086.stdout:0/715: dread da/d14/d1a/d2e/d39/d3b/d89/dc5/fcb [4194304,4194304] 0 2024-08-19T00:56:12.426 INFO:tasks.workunit.client.1.smithi086.stdout:8/701: mkdir dc/d16/dc7/d2e/d28/d2b/d3b/d87/de2 0 2024-08-19T00:56:12.427 INFO:tasks.workunit.client.0.smithi017.stdout:6/213: dread d5/d13/f3e [0,4194304] 0 2024-08-19T00:56:12.428 INFO:tasks.workunit.client.1.smithi086.stdout:0/716: read da/d14/d1a/d2e/d39/d3b/d4e/f77 [874833,5354] 0 2024-08-19T00:56:12.429 INFO:tasks.workunit.client.1.smithi086.stdout:6/745: creat db/d37/d44/d5a/d78/fee x:0 0 0 2024-08-19T00:56:12.429 INFO:tasks.workunit.client.0.smithi017.stdout:9/258: creat d0/d33/d22/d40/f4e x:0 0 0 2024-08-19T00:56:12.434 INFO:tasks.workunit.client.0.smithi017.stdout:3/293: dread d5/d11/f16 [0,4194304] 0 2024-08-19T00:56:12.434 INFO:tasks.workunit.client.1.smithi086.stdout:5/712: truncate d0/df/d1f/d33/f34 735214 0 2024-08-19T00:56:12.437 INFO:tasks.workunit.client.1.smithi086.stdout:8/702: mkdir dc/d1f/d37/d4f/dac/de3 0 2024-08-19T00:56:12.439 INFO:tasks.workunit.client.1.smithi086.stdout:0/717: truncate da/d14/d1a/d2e/d30/f67 50721 0 2024-08-19T00:56:12.439 INFO:tasks.workunit.client.1.smithi086.stdout:8/703: dread dc/d17/d86/fa9 [0,4194304] 0 2024-08-19T00:56:12.440 INFO:tasks.workunit.client.1.smithi086.stdout:9/723: dread db/d26/d5c/d87/d37/f48 [0,4194304] 0 2024-08-19T00:56:12.440 INFO:tasks.workunit.client.1.smithi086.stdout:8/704: dread - dc/d17/d1e/d55/dbb/fd7 zero size 2024-08-19T00:56:12.441 INFO:tasks.workunit.client.1.smithi086.stdout:5/713: rmdir d0/d2d/d43/d91 39 2024-08-19T00:56:12.442 INFO:tasks.workunit.client.1.smithi086.stdout:5/714: readlink d0/df/d1f/d65/l81 0 2024-08-19T00:56:12.442 INFO:tasks.workunit.client.1.smithi086.stdout:8/705: chown dc/d17/d1e/d55/dbb/fd7 208741299 1 2024-08-19T00:56:12.443 INFO:tasks.workunit.client.1.smithi086.stdout:0/718: fdatasync da/d14/d26/fb1 0 2024-08-19T00:56:12.444 INFO:tasks.workunit.client.1.smithi086.stdout:1/806: write d4/d7/d2a/d36/fce [845068,75448] 0 2024-08-19T00:56:12.446 INFO:tasks.workunit.client.1.smithi086.stdout:1/807: write d4/d7/fa0 [4558774,45495] 0 2024-08-19T00:56:12.447 INFO:tasks.workunit.client.1.smithi086.stdout:2/719: write d8/d24/d32/f62 [3381481,130414] 0 2024-08-19T00:56:12.450 INFO:tasks.workunit.client.1.smithi086.stdout:5/715: dwrite d0/d5f/d60/d57/f69 [4194304,4194304] 0 2024-08-19T00:56:12.450 INFO:tasks.workunit.client.1.smithi086.stdout:9/724: truncate db/f61 166678 0 2024-08-19T00:56:12.451 INFO:tasks.workunit.client.1.smithi086.stdout:9/725: readlink db/daf/lce 0 2024-08-19T00:56:12.452 INFO:tasks.workunit.client.1.smithi086.stdout:5/716: write d0/df/d1f/fc1 [35610,110356] 0 2024-08-19T00:56:12.454 INFO:tasks.workunit.client.0.smithi017.stdout:6/214: write d5/d13/f14 [2176603,37623] 0 2024-08-19T00:56:12.456 INFO:tasks.workunit.client.1.smithi086.stdout:1/808: creat d4/d7/d2a/d36/d63/d9f/f10a x:0 0 0 2024-08-19T00:56:12.456 INFO:tasks.workunit.client.1.smithi086.stdout:4/692: truncate d2/d18/d33/d42/d72/d2f/f82 2102012 0 2024-08-19T00:56:12.457 INFO:tasks.workunit.client.1.smithi086.stdout:8/706: rmdir dc/d1f/d37/d4f/dac/db8/d99 39 2024-08-19T00:56:12.458 INFO:tasks.workunit.client.1.smithi086.stdout:7/730: dread d3/de/f2b [0,4194304] 0 2024-08-19T00:56:12.462 INFO:tasks.workunit.client.0.smithi017.stdout:9/259: truncate d0/fc 4095407 0 2024-08-19T00:56:12.466 INFO:tasks.workunit.client.0.smithi017.stdout:3/294: write f2 [2129144,84966] 0 2024-08-19T00:56:12.468 INFO:tasks.workunit.client.1.smithi086.stdout:1/809: rename d4/d7/d2a/d36/d3a/l85 to d4/d7/d2a/d36/d50/d9c/l10b 0 2024-08-19T00:56:12.468 INFO:tasks.workunit.client.1.smithi086.stdout:6/746: write db/d37/d41/f6b [2917994,50837] 0 2024-08-19T00:56:12.469 INFO:tasks.workunit.client.0.smithi017.stdout:9/260: chown d0/d33/d22/d40/c46 2 1 2024-08-19T00:56:12.471 INFO:tasks.workunit.client.1.smithi086.stdout:7/731: readlink d3/d34/d44/d58/d4b/da5/l45 0 2024-08-19T00:56:12.472 INFO:tasks.workunit.client.0.smithi017.stdout:9/261: readlink d0/l26 0 2024-08-19T00:56:12.473 INFO:tasks.workunit.client.0.smithi017.stdout:3/295: mkdir d5/d15/d53 0 2024-08-19T00:56:12.476 INFO:tasks.workunit.client.0.smithi017.stdout:3/296: write d5/da/f2b [1730497,130798] 0 2024-08-19T00:56:12.479 INFO:tasks.workunit.client.1.smithi086.stdout:4/693: rename d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/fc8 to d2/d18/d33/d42/d72/d78/d25/d30/d5d/fea 0 2024-08-19T00:56:12.479 INFO:tasks.workunit.client.1.smithi086.stdout:5/717: dread d0/d8/f86 [0,4194304] 0 2024-08-19T00:56:12.482 INFO:tasks.workunit.client.0.smithi017.stdout:3/297: readlink d5/l1a 0 2024-08-19T00:56:12.482 INFO:tasks.workunit.client.0.smithi017.stdout:3/298: dread - d5/d15/d1b/f4a zero size 2024-08-19T00:56:12.483 INFO:tasks.workunit.client.1.smithi086.stdout:2/720: write d8/d2c/d38/d80/db4/db7/feb [2391746,40074] 0 2024-08-19T00:56:12.484 INFO:tasks.workunit.client.1.smithi086.stdout:1/810: dread d4/f5c [0,4194304] 0 2024-08-19T00:56:12.487 INFO:tasks.workunit.client.0.smithi017.stdout:3/299: rename d5/da/d27/l31 to d5/d15/d53/l54 0 2024-08-19T00:56:12.487 INFO:tasks.workunit.client.0.smithi017.stdout:6/215: truncate d5/f39 3838670 0 2024-08-19T00:56:12.488 INFO:tasks.workunit.client.1.smithi086.stdout:4/694: dwrite d2/d18/d33/d42/d72/d78/d25/d55/d4d/fcf [4194304,4194304] 0 2024-08-19T00:56:12.490 INFO:tasks.workunit.client.1.smithi086.stdout:0/719: dwrite da/d14/d1a/d2e/d39/d3b/d89/dd1/fe4 [0,4194304] 0 2024-08-19T00:56:12.491 INFO:tasks.workunit.client.1.smithi086.stdout:5/718: creat d0/d99/dc0/fda x:0 0 0 2024-08-19T00:56:12.492 INFO:tasks.workunit.client.1.smithi086.stdout:0/720: write da/d14/d55/fca [374307,92647] 0 2024-08-19T00:56:12.494 INFO:tasks.workunit.client.0.smithi017.stdout:6/216: creat d5/d13/d20/f48 x:0 0 0 2024-08-19T00:56:12.495 INFO:tasks.workunit.client.1.smithi086.stdout:0/721: write da/d14/d55/dac/fbf [58056,27848] 0 2024-08-19T00:56:12.495 INFO:tasks.workunit.client.0.smithi017.stdout:3/300: dwrite d5/da/d27/f4c [0,4194304] 0 2024-08-19T00:56:12.497 INFO:tasks.workunit.client.1.smithi086.stdout:7/732: mknod d3/d34/d44/d58/d4b/cf6 0 2024-08-19T00:56:12.497 INFO:tasks.workunit.client.1.smithi086.stdout:6/747: dwrite db/d37/d30/fb6 [0,4194304] 0 2024-08-19T00:56:12.498 INFO:tasks.workunit.client.0.smithi017.stdout:9/262: dread d0/d33/f1b [4194304,4194304] 0 2024-08-19T00:56:12.499 INFO:tasks.workunit.client.0.smithi017.stdout:7/317: sync 2024-08-19T00:56:12.499 INFO:tasks.workunit.client.0.smithi017.stdout:1/259: sync 2024-08-19T00:56:12.500 INFO:tasks.workunit.client.0.smithi017.stdout:9/263: fsync d0/d33/f30 0 2024-08-19T00:56:12.503 INFO:tasks.workunit.client.0.smithi017.stdout:6/217: symlink d5/d13/d11/d2c/l49 0 2024-08-19T00:56:12.506 INFO:tasks.workunit.client.0.smithi017.stdout:3/301: symlink d5/da/d3c/l55 0 2024-08-19T00:56:12.508 INFO:tasks.workunit.client.0.smithi017.stdout:3/302: chown d5/da/d27/f3a 484 1 2024-08-19T00:56:12.512 INFO:tasks.workunit.client.1.smithi086.stdout:5/719: mknod d0/d5f/d60/d57/d80/da3/cdb 0 2024-08-19T00:56:12.517 INFO:tasks.workunit.client.0.smithi017.stdout:6/218: mkdir d5/d13/d11/d2c/d4a 0 2024-08-19T00:56:12.517 INFO:tasks.workunit.client.1.smithi086.stdout:8/707: getdents dc/d16/dc7/d2e/d28/d2b/d3b/d87 0 2024-08-19T00:56:12.518 INFO:tasks.workunit.client.0.smithi017.stdout:3/303: mknod d5/da/d3c/c56 0 2024-08-19T00:56:12.519 INFO:tasks.workunit.client.0.smithi017.stdout:6/219: write d5/d13/d20/f48 [428915,55469] 0 2024-08-19T00:56:12.519 INFO:tasks.workunit.client.1.smithi086.stdout:7/733: symlink d3/d34/d44/d58/d4b/d42/lf7 0 2024-08-19T00:56:12.520 INFO:tasks.workunit.client.1.smithi086.stdout:2/721: mknod d8/d14/dae/cf2 0 2024-08-19T00:56:12.520 INFO:tasks.workunit.client.1.smithi086.stdout:7/734: chown d3/d34/d44/d58/d4b/da5/f74 11298 1 2024-08-19T00:56:12.521 INFO:tasks.workunit.client.0.smithi017.stdout:3/304: chown d5/da/d3c/f50 371355 1 2024-08-19T00:56:12.522 INFO:tasks.workunit.client.1.smithi086.stdout:1/811: mknod d4/d10/dde/c10c 0 2024-08-19T00:56:12.523 INFO:tasks.workunit.client.0.smithi017.stdout:6/220: chown d5/d13/d11/d2c/f30 339 1 2024-08-19T00:56:12.523 INFO:tasks.workunit.client.0.smithi017.stdout:3/305: fsync d5/fc 0 2024-08-19T00:56:12.523 INFO:tasks.workunit.client.0.smithi017.stdout:9/264: dwrite d0/d33/f1b [4194304,4194304] 0 2024-08-19T00:56:12.523 INFO:tasks.workunit.client.1.smithi086.stdout:1/812: stat d4/d7/d2a/d36/d7d/d88/fac 0 2024-08-19T00:56:12.523 INFO:tasks.workunit.client.1.smithi086.stdout:4/695: truncate d2/d18/d33/f36 931459 0 2024-08-19T00:56:12.525 INFO:tasks.workunit.client.0.smithi017.stdout:9/265: dread - d0/d33/d22/f42 zero size 2024-08-19T00:56:12.525 INFO:tasks.workunit.client.0.smithi017.stdout:3/306: chown d5/da/f3f 1275021 1 2024-08-19T00:56:12.525 INFO:tasks.workunit.client.1.smithi086.stdout:0/722: creat da/d14/d1a/d2e/d7e/dd7/fe5 x:0 0 0 2024-08-19T00:56:12.526 INFO:tasks.workunit.client.0.smithi017.stdout:9/266: chown d0/d33/f2e 250 1 2024-08-19T00:56:12.526 INFO:tasks.workunit.client.0.smithi017.stdout:6/221: symlink d5/d13/d11/l4b 0 2024-08-19T00:56:12.527 INFO:tasks.workunit.client.0.smithi017.stdout:6/222: write d5/f36 [2019770,99298] 0 2024-08-19T00:56:12.528 INFO:tasks.workunit.client.1.smithi086.stdout:2/722: creat d8/d84/ff3 x:0 0 0 2024-08-19T00:56:12.530 INFO:tasks.workunit.client.1.smithi086.stdout:2/723: write d8/d14/f22 [2064951,52675] 0 2024-08-19T00:56:12.531 INFO:tasks.workunit.client.0.smithi017.stdout:1/260: dread d4/dc/d19/f44 [0,4194304] 0 2024-08-19T00:56:12.532 INFO:tasks.workunit.client.0.smithi017.stdout:9/267: rename d0/d33/d22/f4a to d0/d33/d22/d36/d49/f4f 0 2024-08-19T00:56:12.533 INFO:tasks.workunit.client.1.smithi086.stdout:0/723: dread da/d5d/da9/fab [0,4194304] 0 2024-08-19T00:56:12.533 INFO:tasks.workunit.client.0.smithi017.stdout:9/268: dread - d0/d33/d22/f4c zero size 2024-08-19T00:56:12.534 INFO:tasks.workunit.client.0.smithi017.stdout:9/269: truncate d0/d33/f39 809070 0 2024-08-19T00:56:12.537 INFO:tasks.workunit.client.1.smithi086.stdout:1/813: creat d4/d7/d2a/d36/d3a/de5/d7a/f10d x:0 0 0 2024-08-19T00:56:12.538 INFO:tasks.workunit.client.0.smithi017.stdout:7/318: write d3/f12 [197625,56438] 0 2024-08-19T00:56:12.540 INFO:tasks.workunit.client.0.smithi017.stdout:1/261: fsync d4/dc/d19/f44 0 2024-08-19T00:56:12.542 INFO:tasks.workunit.client.0.smithi017.stdout:9/270: dwrite d0/f48 [0,4194304] 0 2024-08-19T00:56:12.542 INFO:tasks.workunit.client.1.smithi086.stdout:4/696: dwrite d2/d18/d33/d42/d72/d78/d25/d30/d5d/fea [0,4194304] 0 2024-08-19T00:56:12.543 INFO:tasks.workunit.client.0.smithi017.stdout:9/271: stat d0/d33/l3b 0 2024-08-19T00:56:12.544 INFO:tasks.workunit.client.0.smithi017.stdout:9/272: chown d0/f48 160199 1 2024-08-19T00:56:12.545 INFO:tasks.workunit.client.0.smithi017.stdout:9/273: fsync d0/f34 0 2024-08-19T00:56:12.547 INFO:tasks.workunit.client.0.smithi017.stdout:7/319: dread d3/dc/df/d32/f54 [0,4194304] 0 2024-08-19T00:56:12.550 INFO:tasks.workunit.client.0.smithi017.stdout:3/307: write d5/d11/f16 [676029,78142] 0 2024-08-19T00:56:12.551 INFO:tasks.workunit.client.1.smithi086.stdout:0/724: fdatasync da/d14/d44/d49/f88 0 2024-08-19T00:56:12.552 INFO:tasks.workunit.client.0.smithi017.stdout:3/308: stat d5/d32 0 2024-08-19T00:56:12.553 INFO:tasks.workunit.client.1.smithi086.stdout:6/748: truncate db/d37/f9e 240753 0 2024-08-19T00:56:12.554 INFO:tasks.workunit.client.1.smithi086.stdout:7/735: write d3/de/d68/d72/d7e/f92 [36031,37210] 0 2024-08-19T00:56:12.555 INFO:tasks.workunit.client.1.smithi086.stdout:7/736: readlink d3/de/d68/d72/ldd 0 2024-08-19T00:56:12.556 INFO:tasks.workunit.client.0.smithi017.stdout:7/320: dwrite d3/dc/df/d32/f54 [4194304,4194304] 0 2024-08-19T00:56:12.558 INFO:tasks.workunit.client.1.smithi086.stdout:1/814: creat d4/d7/d2a/d36/d3a/de5/d7a/db4/df0/f10e x:0 0 0 2024-08-19T00:56:12.563 INFO:tasks.workunit.client.1.smithi086.stdout:3/734: sync 2024-08-19T00:56:12.564 INFO:tasks.workunit.client.0.smithi017.stdout:1/262: mknod d4/dc/d3b/d3d/c4c 0 2024-08-19T00:56:12.568 INFO:tasks.workunit.client.0.smithi017.stdout:6/223: dwrite d5/f39 [0,4194304] 0 2024-08-19T00:56:12.569 INFO:tasks.workunit.client.0.smithi017.stdout:6/224: write d5/d13/d11/d2c/f30 [344184,124051] 0 2024-08-19T00:56:12.570 INFO:tasks.workunit.client.1.smithi086.stdout:0/725: dread da/d14/f99 [0,4194304] 0 2024-08-19T00:56:12.572 INFO:tasks.workunit.client.0.smithi017.stdout:6/225: chown d5/d13/d20/l2b 0 1 2024-08-19T00:56:12.574 INFO:tasks.workunit.client.1.smithi086.stdout:5/720: getdents d0/d5f/d60/d57/d80/da0 0 2024-08-19T00:56:12.576 INFO:tasks.workunit.client.0.smithi017.stdout:9/274: rename d0/d33/l3d to d0/d33/d22/l50 0 2024-08-19T00:56:12.577 INFO:tasks.workunit.client.1.smithi086.stdout:7/737: fdatasync d3/d34/d44/d58/d4b/d42/fbf 0 2024-08-19T00:56:12.578 INFO:tasks.workunit.client.1.smithi086.stdout:6/749: dwrite db/d8e/fb0 [0,4194304] 0 2024-08-19T00:56:12.581 INFO:tasks.workunit.client.0.smithi017.stdout:3/309: truncate d5/da/f3f 2578634 0 2024-08-19T00:56:12.582 INFO:tasks.workunit.client.0.smithi017.stdout:6/226: mknod d5/d13/d11/c4c 0 2024-08-19T00:56:12.583 INFO:tasks.workunit.client.0.smithi017.stdout:7/321: dread d3/d3c/f43 [0,4194304] 0 2024-08-19T00:56:12.583 INFO:tasks.workunit.client.1.smithi086.stdout:8/708: getdents dc/d16/dc7/d2e/d28/d41/d9a 0 2024-08-19T00:56:12.583 INFO:tasks.workunit.client.0.smithi017.stdout:6/227: fdatasync d5/d13/d20/f27 0 2024-08-19T00:56:12.584 INFO:tasks.workunit.client.0.smithi017.stdout:7/322: fsync d3/f4 0 2024-08-19T00:56:12.584 INFO:tasks.workunit.client.0.smithi017.stdout:1/263: creat d4/dc/d3b/d45/f4d x:0 0 0 2024-08-19T00:56:12.587 INFO:tasks.workunit.client.0.smithi017.stdout:9/275: unlink d0/d33/f2d 0 2024-08-19T00:56:12.587 INFO:tasks.workunit.client.1.smithi086.stdout:3/735: truncate d3/d18/d19/dbc/fb6 1641910 0 2024-08-19T00:56:12.588 INFO:tasks.workunit.client.1.smithi086.stdout:3/736: chown d3/d18/d19/fdc 8594775 1 2024-08-19T00:56:12.588 INFO:tasks.workunit.client.1.smithi086.stdout:2/724: link d8/d2c/d47/f93 d8/d84/de0/ff4 0 2024-08-19T00:56:12.589 INFO:tasks.workunit.client.1.smithi086.stdout:0/726: creat da/d14/d1a/d2e/d39/d3b/d89/dd1/fe6 x:0 0 0 2024-08-19T00:56:12.590 INFO:tasks.workunit.client.1.smithi086.stdout:0/727: stat da/d14/d1a/d2e/d39/d3b/d89/dd1/fd6 0 2024-08-19T00:56:12.590 INFO:tasks.workunit.client.1.smithi086.stdout:5/721: truncate d0/df/d1f/f27 2764330 0 2024-08-19T00:56:12.592 INFO:tasks.workunit.client.1.smithi086.stdout:0/728: stat da/d14/d1a/f52 0 2024-08-19T00:56:12.592 INFO:tasks.workunit.client.0.smithi017.stdout:3/310: dwrite d5/d15/d1b/f44 [0,4194304] 0 2024-08-19T00:56:12.592 INFO:tasks.workunit.client.0.smithi017.stdout:3/311: chown d5/d18 749450 1 2024-08-19T00:56:12.593 INFO:tasks.workunit.client.0.smithi017.stdout:9/276: dread d0/f48 [0,4194304] 0 2024-08-19T00:56:12.593 INFO:tasks.workunit.client.0.smithi017.stdout:3/312: fsync d5/d18/f45 0 2024-08-19T00:56:12.593 INFO:tasks.workunit.client.0.smithi017.stdout:6/228: mkdir d5/d13/d11/d4d 0 2024-08-19T00:56:12.611 INFO:tasks.workunit.client.1.smithi086.stdout:9/726: sync 2024-08-19T00:56:12.612 INFO:tasks.workunit.client.0.smithi017.stdout:0/232: sync 2024-08-19T00:56:12.612 INFO:tasks.workunit.client.0.smithi017.stdout:4/229: sync 2024-08-19T00:56:12.614 INFO:tasks.workunit.client.0.smithi017.stdout:4/230: read - d2/d21/f42 zero size 2024-08-19T00:56:12.622 INFO:tasks.workunit.client.0.smithi017.stdout:4/231: dwrite d2/d16/f22 [0,4194304] 0 2024-08-19T00:56:12.645 INFO:tasks.workunit.client.0.smithi017.stdout:8/177: sync 2024-08-19T00:56:12.645 INFO:tasks.workunit.client.0.smithi017.stdout:5/229: sync 2024-08-19T00:56:12.645 INFO:tasks.workunit.client.0.smithi017.stdout:2/317: sync 2024-08-19T00:56:12.648 INFO:tasks.workunit.client.0.smithi017.stdout:8/178: rename de/d15/d1f to de/d15/d1f/d2d 22 2024-08-19T00:56:12.661 INFO:tasks.workunit.client.0.smithi017.stdout:5/230: dwrite db/d19/d1f/f50 [0,4194304] 0 2024-08-19T00:56:12.667 INFO:tasks.workunit.client.0.smithi017.stdout:2/318: dwrite d2/d7/d44/f57 [0,4194304] 0 2024-08-19T00:56:12.669 INFO:tasks.workunit.client.0.smithi017.stdout:2/319: fdatasync d2/d7/d10/f47 0 2024-08-19T00:56:12.677 INFO:tasks.workunit.client.1.smithi086.stdout:6/750: mkdir db/d37/d41/dad/def 0 2024-08-19T00:56:12.684 INFO:tasks.workunit.client.1.smithi086.stdout:1/815: dwrite d4/d7/d2a/f4d [0,4194304] 0 2024-08-19T00:56:12.690 INFO:tasks.workunit.client.1.smithi086.stdout:4/697: dwrite d2/d18/d33/d42/d72/d2f/f82 [0,4194304] 0 2024-08-19T00:56:12.690 INFO:tasks.workunit.client.1.smithi086.stdout:8/709: creat dc/d1f/d37/d9f/fe4 x:0 0 0 2024-08-19T00:56:12.695 INFO:tasks.workunit.client.0.smithi017.stdout:1/264: write d4/fd [182166,73535] 0 2024-08-19T00:56:12.696 INFO:tasks.workunit.client.0.smithi017.stdout:6/229: chown d5/l23 83987 1 2024-08-19T00:56:12.697 INFO:tasks.workunit.client.0.smithi017.stdout:6/230: chown d5/d13/d20/f32 415120274 1 2024-08-19T00:56:12.697 INFO:tasks.workunit.client.1.smithi086.stdout:2/725: write d8/d43/f86 [1989570,55734] 0 2024-08-19T00:56:12.704 INFO:tasks.workunit.client.1.smithi086.stdout:5/722: truncate d0/d2d/d43/d91/fbd 2018257 0 2024-08-19T00:56:12.705 INFO:tasks.workunit.client.1.smithi086.stdout:0/729: mknod da/d14/d44/d7b/ce7 0 2024-08-19T00:56:12.710 INFO:tasks.workunit.client.0.smithi017.stdout:8/179: mkdir de/d15/d1f/d2e 0 2024-08-19T00:56:12.717 INFO:tasks.workunit.client.0.smithi017.stdout:2/320: mkdir d2/d7/d10/d35/d55/d65/d6b 0 2024-08-19T00:56:12.720 INFO:tasks.workunit.client.1.smithi086.stdout:2/726: creat d8/d14/dae/ff5 x:0 0 0 2024-08-19T00:56:12.720 INFO:tasks.workunit.client.0.smithi017.stdout:2/321: dread d2/d7/dd/f1c [0,4194304] 0 2024-08-19T00:56:12.722 INFO:tasks.workunit.client.0.smithi017.stdout:9/277: fdatasync d0/f3a 0 2024-08-19T00:56:12.723 INFO:tasks.workunit.client.0.smithi017.stdout:9/278: fdatasync d0/d33/d22/f42 0 2024-08-19T00:56:12.724 INFO:tasks.workunit.client.1.smithi086.stdout:9/727: dread db/d26/d5c/d87/d30/d32/d44/f56 [0,4194304] 0 2024-08-19T00:56:12.724 INFO:tasks.workunit.client.1.smithi086.stdout:9/728: fdatasync f7 0 2024-08-19T00:56:12.731 INFO:tasks.workunit.client.1.smithi086.stdout:2/727: dread d8/d2c/d38/d80/db4/db7/fe3 [0,4194304] 0 2024-08-19T00:56:12.734 INFO:tasks.workunit.client.0.smithi017.stdout:2/322: write d2/d7/d10/d3b/d3c/f40 [2300899,47245] 0 2024-08-19T00:56:12.735 INFO:tasks.workunit.client.1.smithi086.stdout:9/729: dread db/d26/d5c/d87/d30/f9c [0,4194304] 0 2024-08-19T00:56:12.736 INFO:tasks.workunit.client.0.smithi017.stdout:8/180: dwrite de/ff [4194304,4194304] 0 2024-08-19T00:56:12.738 INFO:tasks.workunit.client.0.smithi017.stdout:9/279: stat d0/fa 0 2024-08-19T00:56:12.739 INFO:tasks.workunit.client.0.smithi017.stdout:6/231: creat d5/d13/d11/d4d/f4e x:0 0 0 2024-08-19T00:56:12.741 INFO:tasks.workunit.client.1.smithi086.stdout:5/723: link d0/d8/d10/l3e d0/d2d/d43/d91/ldc 0 2024-08-19T00:56:12.744 INFO:tasks.workunit.client.0.smithi017.stdout:8/181: dread de/ff [0,4194304] 0 2024-08-19T00:56:12.745 INFO:tasks.workunit.client.0.smithi017.stdout:6/232: truncate d5/d13/d11/d4d/f4e 542232 0 2024-08-19T00:56:12.746 INFO:tasks.workunit.client.1.smithi086.stdout:0/730: link da/f60 da/d14/d1a/d2e/d39/d3b/d4e/dda/fe8 0 2024-08-19T00:56:12.746 INFO:tasks.workunit.client.0.smithi017.stdout:2/323: dwrite d2/d7/d10/d19/f20 [0,4194304] 0 2024-08-19T00:56:12.747 INFO:tasks.workunit.client.1.smithi086.stdout:0/731: write da/d5d/f7a [2052475,71142] 0 2024-08-19T00:56:12.747 INFO:tasks.workunit.client.0.smithi017.stdout:8/182: write de/f12 [5042604,86008] 0 2024-08-19T00:56:12.750 INFO:tasks.workunit.client.0.smithi017.stdout:9/280: rmdir d0/d33/d22/d36/d49 39 2024-08-19T00:56:12.754 INFO:tasks.workunit.client.0.smithi017.stdout:9/281: truncate d0/d33/d22/d36/f3e 353305 0 2024-08-19T00:56:12.755 INFO:tasks.workunit.client.0.smithi017.stdout:2/324: dwrite d2/d7/f6a [0,4194304] 0 2024-08-19T00:56:12.755 INFO:tasks.workunit.client.0.smithi017.stdout:7/323: link d3/f2e d3/dc/df/d1c/d2c/f61 0 2024-08-19T00:56:12.760 INFO:tasks.workunit.client.1.smithi086.stdout:0/732: chown da/d14/d26/l31 367 1 2024-08-19T00:56:12.762 INFO:tasks.workunit.client.0.smithi017.stdout:7/324: dwrite d3/f5 [0,4194304] 0 2024-08-19T00:56:12.763 INFO:tasks.workunit.client.1.smithi086.stdout:5/724: link d0/d5f/d60/d57/d80/da3/fba d0/d99/da2/fdd 0 2024-08-19T00:56:12.763 INFO:tasks.workunit.client.1.smithi086.stdout:5/725: chown d0/df/d1f 85624 1 2024-08-19T00:56:12.764 INFO:tasks.workunit.client.1.smithi086.stdout:5/726: readlink d0/d2d/dce/ld3 0 2024-08-19T00:56:12.764 INFO:tasks.workunit.client.1.smithi086.stdout:5/727: dread - d0/d2d/fd8 zero size 2024-08-19T00:56:12.766 INFO:tasks.workunit.client.1.smithi086.stdout:5/728: chown d0/d5f/d60/d57/d80/d9e/fbe 28245664 1 2024-08-19T00:56:12.766 INFO:tasks.workunit.client.0.smithi017.stdout:7/325: dread d3/f5 [0,4194304] 0 2024-08-19T00:56:12.767 INFO:tasks.workunit.client.0.smithi017.stdout:7/326: chown d3/f5 3650 1 2024-08-19T00:56:12.767 INFO:tasks.workunit.client.0.smithi017.stdout:7/327: readlink d3/dc/df/d23/l2d 0 2024-08-19T00:56:12.768 INFO:tasks.workunit.client.1.smithi086.stdout:0/733: fsync da/d14/d44/d49/f5f 0 2024-08-19T00:56:12.772 INFO:tasks.workunit.client.1.smithi086.stdout:5/729: dwrite d0/d8/f37 [0,4194304] 0 2024-08-19T00:56:12.774 INFO:tasks.workunit.client.0.smithi017.stdout:7/328: dwrite d3/dc/f5b [0,4194304] 0 2024-08-19T00:56:12.777 INFO:tasks.workunit.client.0.smithi017.stdout:2/325: dwrite d2/d7/d10/d19/f1d [0,4194304] 0 2024-08-19T00:56:12.778 INFO:tasks.workunit.client.1.smithi086.stdout:5/730: mkdir d0/d99/da2/dde 0 2024-08-19T00:56:12.781 INFO:tasks.workunit.client.1.smithi086.stdout:4/698: sync 2024-08-19T00:56:12.783 INFO:tasks.workunit.client.0.smithi017.stdout:8/183: rename de/d15/d1f/l27 to de/l2f 0 2024-08-19T00:56:12.785 INFO:tasks.workunit.client.0.smithi017.stdout:8/184: dread - de/d15/f29 zero size 2024-08-19T00:56:12.785 INFO:tasks.workunit.client.0.smithi017.stdout:8/185: fsync f0 0 2024-08-19T00:56:12.786 INFO:tasks.workunit.client.0.smithi017.stdout:2/326: dwrite d2/d7/d29/f5d [0,4194304] 0 2024-08-19T00:56:12.789 INFO:tasks.workunit.client.0.smithi017.stdout:2/327: truncate d2/d7/d10/d35/d45/d58/f67 902225 0 2024-08-19T00:56:12.790 INFO:tasks.workunit.client.0.smithi017.stdout:7/329: unlink d3/l14 0 2024-08-19T00:56:12.792 INFO:tasks.workunit.client.1.smithi086.stdout:4/699: mknod d2/d18/d33/d42/ceb 0 2024-08-19T00:56:12.793 INFO:tasks.workunit.client.0.smithi017.stdout:9/282: link d0/d33/d22/l43 d0/d33/d22/d36/l51 0 2024-08-19T00:56:12.795 INFO:tasks.workunit.client.1.smithi086.stdout:9/730: mkdir db/d26/d5c/d87/d6d/deb 0 2024-08-19T00:56:12.796 INFO:tasks.workunit.client.0.smithi017.stdout:8/186: unlink de/ff 0 2024-08-19T00:56:12.797 INFO:tasks.workunit.client.0.smithi017.stdout:3/313: link d5/l26 d5/da/d27/l57 0 2024-08-19T00:56:12.798 INFO:tasks.workunit.client.0.smithi017.stdout:3/314: read - d5/da/d3c/f50 zero size 2024-08-19T00:56:12.801 INFO:tasks.workunit.client.0.smithi017.stdout:8/187: dread de/f12 [4194304,4194304] 0 2024-08-19T00:56:12.802 INFO:tasks.workunit.client.0.smithi017.stdout:7/330: symlink d3/dc/df/d1c/d2c/d35/l62 0 2024-08-19T00:56:12.805 INFO:tasks.workunit.client.1.smithi086.stdout:9/731: dwrite db/d96/fb4 [0,4194304] 0 2024-08-19T00:56:12.805 INFO:tasks.workunit.client.0.smithi017.stdout:9/283: mkdir d0/d33/d22/d52 0 2024-08-19T00:56:12.808 INFO:tasks.workunit.client.1.smithi086.stdout:4/700: getdents d2 0 2024-08-19T00:56:12.810 INFO:tasks.workunit.client.0.smithi017.stdout:2/328: creat d2/d7/f6c x:0 0 0 2024-08-19T00:56:12.812 INFO:tasks.workunit.client.1.smithi086.stdout:9/732: mkdir db/d26/d5c/d87/d30/d32/d44/dc1/dec 0 2024-08-19T00:56:12.813 INFO:tasks.workunit.client.0.smithi017.stdout:8/188: read de/f12 [1851820,92152] 0 2024-08-19T00:56:12.816 INFO:tasks.workunit.client.0.smithi017.stdout:7/331: unlink d3/d3c/f42 0 2024-08-19T00:56:12.816 INFO:tasks.workunit.client.0.smithi017.stdout:8/189: chown de 309045 1 2024-08-19T00:56:12.819 INFO:tasks.workunit.client.1.smithi086.stdout:9/733: dwrite f7 [4194304,4194304] 0 2024-08-19T00:56:12.819 INFO:tasks.workunit.client.0.smithi017.stdout:2/329: dwrite d2/d7/d10/d3b/f3f [0,4194304] 0 2024-08-19T00:56:12.820 INFO:tasks.workunit.client.1.smithi086.stdout:9/734: chown db/d26/d5c/d87/d30/d31 6292311 1 2024-08-19T00:56:12.827 INFO:tasks.workunit.client.1.smithi086.stdout:4/701: creat d2/d18/d33/d42/d72/fec x:0 0 0 2024-08-19T00:56:12.828 INFO:tasks.workunit.client.0.smithi017.stdout:9/284: symlink d0/d33/d22/d36/d49/l53 0 2024-08-19T00:56:12.829 INFO:tasks.workunit.client.0.smithi017.stdout:7/332: creat d3/dc/d5f/f63 x:0 0 0 2024-08-19T00:56:12.832 INFO:tasks.workunit.client.1.smithi086.stdout:4/702: mknod d2/d18/d33/d42/d72/d78/d25/d30/ced 0 2024-08-19T00:56:12.832 INFO:tasks.workunit.client.0.smithi017.stdout:2/330: dwrite d2/d7/f6c [0,4194304] 0 2024-08-19T00:56:12.833 INFO:tasks.workunit.client.1.smithi086.stdout:9/735: dread db/d26/d5c/d87/f54 [0,4194304] 0 2024-08-19T00:56:12.833 INFO:tasks.workunit.client.0.smithi017.stdout:9/285: dread - d0/d33/d22/f44 zero size 2024-08-19T00:56:12.834 INFO:tasks.workunit.client.1.smithi086.stdout:4/703: write d2/d18/d33/d42/d72/dd0/fda [151022,4073] 0 2024-08-19T00:56:12.839 INFO:tasks.workunit.client.1.smithi086.stdout:4/704: rename d2/fd4 to d2/d18/d33/d42/d72/d78/d25/d30/d5d/fee 0 2024-08-19T00:56:12.845 INFO:tasks.workunit.client.0.smithi017.stdout:9/286: dwrite d0/f48 [0,4194304] 0 2024-08-19T00:56:12.846 INFO:tasks.workunit.client.0.smithi017.stdout:9/287: chown d0/d33/d22/f42 119 1 2024-08-19T00:56:12.849 INFO:tasks.workunit.client.0.smithi017.stdout:2/331: creat d2/d7/f6d x:0 0 0 2024-08-19T00:56:12.855 INFO:tasks.workunit.client.0.smithi017.stdout:2/332: dread - d2/f1a zero size 2024-08-19T00:56:12.856 INFO:tasks.workunit.client.0.smithi017.stdout:7/333: link d3/dc/df/d1c/d2c/d2f/l45 d3/dc/df/l64 0 2024-08-19T00:56:12.858 INFO:tasks.workunit.client.0.smithi017.stdout:7/334: truncate d3/dc/df/d1a/f60 4935083 0 2024-08-19T00:56:12.858 INFO:tasks.workunit.client.0.smithi017.stdout:2/333: symlink d2/d7/d10/d35/d45/d58/l6e 0 2024-08-19T00:56:12.860 INFO:tasks.workunit.client.0.smithi017.stdout:7/335: read d3/dc/df/d1a/f4a [380756,948] 0 2024-08-19T00:56:12.861 INFO:tasks.workunit.client.0.smithi017.stdout:2/334: rmdir d2/d7/d10/d35/d55/d65 39 2024-08-19T00:56:12.862 INFO:tasks.workunit.client.0.smithi017.stdout:2/335: fsync d2/d7/d10/d3b/d54/f4f 0 2024-08-19T00:56:12.863 INFO:tasks.workunit.client.0.smithi017.stdout:2/336: fsync d2/d7/dd/f4e 0 2024-08-19T00:56:12.864 INFO:tasks.workunit.client.0.smithi017.stdout:7/336: rmdir d3/dc/df/d37 39 2024-08-19T00:56:12.872 INFO:tasks.workunit.client.0.smithi017.stdout:2/337: getdents d2/d7/d10/d3b/d3c 0 2024-08-19T00:56:12.872 INFO:tasks.workunit.client.0.smithi017.stdout:2/338: dread - d2/f1a zero size 2024-08-19T00:56:12.874 INFO:tasks.workunit.client.0.smithi017.stdout:2/339: readlink d2/l26 0 2024-08-19T00:56:12.874 INFO:tasks.workunit.client.1.smithi086.stdout:6/751: dwrite db/f11 [0,4194304] 0 2024-08-19T00:56:12.874 INFO:tasks.workunit.client.1.smithi086.stdout:7/738: truncate d3/d34/d44/d58/d4b/da5/f5d 2701477 0 2024-08-19T00:56:12.881 INFO:tasks.workunit.client.1.smithi086.stdout:7/739: dwrite d3/de/f15 [8388608,4194304] 0 2024-08-19T00:56:12.882 INFO:tasks.workunit.client.1.smithi086.stdout:7/740: write d3/de/d68/fb6 [8499236,40931] 0 2024-08-19T00:56:12.883 INFO:tasks.workunit.client.0.smithi017.stdout:5/231: creat db/f56 x:0 0 0 2024-08-19T00:56:12.884 INFO:tasks.workunit.client.0.smithi017.stdout:2/340: creat d2/d7/d10/d35/d55/f6f x:0 0 0 2024-08-19T00:56:12.890 INFO:tasks.workunit.client.0.smithi017.stdout:0/233: truncate d5/d18/f23 817881 0 2024-08-19T00:56:12.892 INFO:tasks.workunit.client.0.smithi017.stdout:0/234: write d5/fc [3059748,80542] 0 2024-08-19T00:56:12.893 INFO:tasks.workunit.client.1.smithi086.stdout:8/710: write dc/d16/dc7/d2e/d28/d2b/f64 [1993811,72320] 0 2024-08-19T00:56:12.896 INFO:tasks.workunit.client.1.smithi086.stdout:1/816: dwrite d4/d7/d2a/d36/d3a/de5/d7a/ffd [0,4194304] 0 2024-08-19T00:56:12.897 INFO:tasks.workunit.client.0.smithi017.stdout:4/232: truncate d2/f3c 4186787 0 2024-08-19T00:56:12.903 INFO:tasks.workunit.client.1.smithi086.stdout:1/817: dwrite d4/d7/d2a/d36/d63/d84/d8e/fb1 [0,4194304] 0 2024-08-19T00:56:12.904 INFO:tasks.workunit.client.0.smithi017.stdout:9/288: truncate d0/f3a 791101 0 2024-08-19T00:56:12.905 INFO:tasks.workunit.client.0.smithi017.stdout:4/233: creat d2/d21/d40/f4c x:0 0 0 2024-08-19T00:56:12.905 INFO:tasks.workunit.client.1.smithi086.stdout:8/711: mknod dc/d1f/d37/ce5 0 2024-08-19T00:56:12.906 INFO:tasks.workunit.client.0.smithi017.stdout:4/234: dread - d2/f4b zero size 2024-08-19T00:56:12.906 INFO:tasks.workunit.client.0.smithi017.stdout:4/235: chown d2/d1a/d20 67 1 2024-08-19T00:56:12.910 INFO:tasks.workunit.client.1.smithi086.stdout:2/728: write d8/d2c/d47/f93 [193988,119447] 0 2024-08-19T00:56:12.913 INFO:tasks.workunit.client.0.smithi017.stdout:4/236: rename d2/d1a/f23 to d2/d27/f4d 0 2024-08-19T00:56:12.913 INFO:tasks.workunit.client.0.smithi017.stdout:4/237: readlink d2/l1b 0 2024-08-19T00:56:12.914 INFO:tasks.workunit.client.1.smithi086.stdout:8/712: dwrite dc/d16/d18/d94/f8d [0,4194304] 0 2024-08-19T00:56:12.914 INFO:tasks.workunit.client.0.smithi017.stdout:2/341: dread d2/d7/d29/f34 [0,4194304] 0 2024-08-19T00:56:12.915 INFO:tasks.workunit.client.1.smithi086.stdout:8/713: chown dc/d16/dc7/d2e/d28/d41/f59 1340 1 2024-08-19T00:56:12.916 INFO:tasks.workunit.client.1.smithi086.stdout:8/714: readlink dc/d1f/d37/d4f/lb3 0 2024-08-19T00:56:12.918 INFO:tasks.workunit.client.1.smithi086.stdout:1/818: write d4/d7/d2a/d36/d7d/d88/d56/f93 [597222,22297] 0 2024-08-19T00:56:12.920 INFO:tasks.workunit.client.1.smithi086.stdout:2/729: mknod d8/d24/cf6 0 2024-08-19T00:56:12.925 INFO:tasks.workunit.client.0.smithi017.stdout:4/238: dwrite d2/d27/f45 [0,4194304] 0 2024-08-19T00:56:12.927 INFO:tasks.workunit.client.1.smithi086.stdout:2/730: creat d8/d2c/d38/d80/dca/ff7 x:0 0 0 2024-08-19T00:56:12.928 INFO:tasks.workunit.client.0.smithi017.stdout:2/342: dwrite d2/d7/d10/d3b/f3f [0,4194304] 0 2024-08-19T00:56:12.929 INFO:tasks.workunit.client.1.smithi086.stdout:2/731: chown d8/d24/d32/d4d/ca5 21559 1 2024-08-19T00:56:12.932 INFO:tasks.workunit.client.1.smithi086.stdout:8/715: rename dc/d17/d1e/d55/fa0 to dc/d1f/d37/d4f/dac/db8/fe6 0 2024-08-19T00:56:12.934 INFO:tasks.workunit.client.1.smithi086.stdout:1/819: dread d4/f6 [0,4194304] 0 2024-08-19T00:56:12.934 INFO:tasks.workunit.client.0.smithi017.stdout:6/233: creat d5/f4f x:0 0 0 2024-08-19T00:56:12.935 INFO:tasks.workunit.client.0.smithi017.stdout:4/239: creat d2/d11/d24/f4e x:0 0 0 2024-08-19T00:56:12.935 INFO:tasks.workunit.client.1.smithi086.stdout:2/732: write d8/d24/f35 [9317427,71031] 0 2024-08-19T00:56:12.937 INFO:tasks.workunit.client.0.smithi017.stdout:2/343: dread d2/d7/dd/f4e [0,4194304] 0 2024-08-19T00:56:12.938 INFO:tasks.workunit.client.1.smithi086.stdout:2/733: write d8/d2c/d47/d73/fea [86850,13797] 0 2024-08-19T00:56:12.939 INFO:tasks.workunit.client.1.smithi086.stdout:8/716: fdatasync dc/d16/d18/fa6 0 2024-08-19T00:56:12.940 INFO:tasks.workunit.client.1.smithi086.stdout:2/734: dread - d8/d2c/d38/fe6 zero size 2024-08-19T00:56:12.940 INFO:tasks.workunit.client.1.smithi086.stdout:1/820: symlink d4/d7/d2a/d36/d3a/de5/d7a/db4/df0/l10f 0 2024-08-19T00:56:12.943 INFO:tasks.workunit.client.0.smithi017.stdout:4/240: read d2/f29 [2271603,96807] 0 2024-08-19T00:56:12.943 INFO:tasks.workunit.client.0.smithi017.stdout:2/344: truncate d2/d7/d10/d19/f41 991929 0 2024-08-19T00:56:12.948 INFO:tasks.workunit.client.1.smithi086.stdout:1/821: dwrite d4/d7/d2a/d36/d63/d9f/fc8 [0,4194304] 0 2024-08-19T00:56:12.948 INFO:tasks.workunit.client.1.smithi086.stdout:0/734: truncate da/d14/d26/f48 911142 0 2024-08-19T00:56:12.949 INFO:tasks.workunit.client.1.smithi086.stdout:1/822: write d4/fb3 [5011934,43716] 0 2024-08-19T00:56:12.954 INFO:tasks.workunit.client.1.smithi086.stdout:0/735: dread da/d14/d26/fd4 [0,4194304] 0 2024-08-19T00:56:12.955 INFO:tasks.workunit.client.1.smithi086.stdout:0/736: chown da/d14/d1a/d2e/d39/f69 15679596 1 2024-08-19T00:56:12.955 INFO:tasks.workunit.client.1.smithi086.stdout:0/737: chown da/d14/d44/d49/fbc 11280 1 2024-08-19T00:56:12.960 INFO:tasks.workunit.client.1.smithi086.stdout:8/717: dread dc/d16/dc7/d2e/d28/d2b/f79 [0,4194304] 0 2024-08-19T00:56:12.962 INFO:tasks.workunit.client.1.smithi086.stdout:1/823: rename d4/d10/f5a to d4/d10/dde/f110 0 2024-08-19T00:56:12.965 INFO:tasks.workunit.client.0.smithi017.stdout:2/345: dwrite d2/fa [8388608,4194304] 0 2024-08-19T00:56:12.965 INFO:tasks.workunit.client.0.smithi017.stdout:4/241: link d2/f4b d2/d1a/d39/f4f 0 2024-08-19T00:56:12.967 INFO:tasks.workunit.client.1.smithi086.stdout:2/735: rmdir d8/d24/d32/d4d/df0 0 2024-08-19T00:56:12.968 INFO:tasks.workunit.client.0.smithi017.stdout:4/242: write d2/f7 [3429863,83313] 0 2024-08-19T00:56:12.970 INFO:tasks.workunit.client.0.smithi017.stdout:6/234: link d5/d13/d11/d2c/c41 d5/c50 0 2024-08-19T00:56:12.972 INFO:tasks.workunit.client.1.smithi086.stdout:0/738: creat da/d14/d1a/d2e/d39/d3b/fe9 x:0 0 0 2024-08-19T00:56:12.973 INFO:tasks.workunit.client.0.smithi017.stdout:7/337: rmdir d3/dc/df/d1c/d2c/d35 39 2024-08-19T00:56:12.974 INFO:tasks.workunit.client.0.smithi017.stdout:2/346: dwrite d2/d7/f43 [0,4194304] 0 2024-08-19T00:56:12.981 INFO:tasks.workunit.client.0.smithi017.stdout:6/235: dwrite d5/d13/f1f [0,4194304] 0 2024-08-19T00:56:12.982 INFO:tasks.workunit.client.1.smithi086.stdout:5/731: symlink d0/d99/ldf 0 2024-08-19T00:56:12.984 INFO:tasks.workunit.client.1.smithi086.stdout:5/732: read d0/fb [2549316,31860] 0 2024-08-19T00:56:12.986 INFO:tasks.workunit.client.0.smithi017.stdout:4/243: rename d2/d16/d43 to d2/d11/d50 0 2024-08-19T00:56:12.990 INFO:tasks.workunit.client.0.smithi017.stdout:3/315: rmdir d5/d32 39 2024-08-19T00:56:12.991 INFO:tasks.workunit.client.0.smithi017.stdout:4/244: read d2/d11/d24/f2e [986808,72531] 0 2024-08-19T00:56:12.991 INFO:tasks.workunit.client.0.smithi017.stdout:3/316: write d5/d11/f14 [3167676,101285] 0 2024-08-19T00:56:12.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/236: mkdir d5/d13/d11/d2c/d51 0 2024-08-19T00:56:12.997 INFO:tasks.workunit.client.0.smithi017.stdout:6/237: dread - d5/d13/d11/d2c/f46 zero size 2024-08-19T00:56:12.998 INFO:tasks.workunit.client.1.smithi086.stdout:8/718: mkdir dc/d1f/d37/d4f/dac/db8/de7 0 2024-08-19T00:56:12.999 INFO:tasks.workunit.client.0.smithi017.stdout:4/245: dwrite d2/f7 [4194304,4194304] 0 2024-08-19T00:56:13.003 INFO:tasks.workunit.client.1.smithi086.stdout:9/736: dwrite db/d26/d5c/d87/d30/d31/f6c [0,4194304] 0 2024-08-19T00:56:13.006 INFO:tasks.workunit.client.0.smithi017.stdout:3/317: creat d5/d15/d1b/f58 x:0 0 0 2024-08-19T00:56:13.008 INFO:tasks.workunit.client.0.smithi017.stdout:6/238: mkdir d5/d13/d11/d52 0 2024-08-19T00:56:13.010 INFO:tasks.workunit.client.1.smithi086.stdout:0/739: mkdir da/d14/d1a/d2e/d39/d3b/d4e/dda/dea 0 2024-08-19T00:56:13.012 INFO:tasks.workunit.client.1.smithi086.stdout:0/740: truncate da/d14/d1a/d2e/d7e/dd7/fe5 92462 0 2024-08-19T00:56:13.015 INFO:tasks.workunit.client.0.smithi017.stdout:3/318: mknod d5/da/d3c/c59 0 2024-08-19T00:56:13.017 INFO:tasks.workunit.client.1.smithi086.stdout:8/719: rmdir dc/d1f/d37/d4f/dac/db8/d7a/d88 39 2024-08-19T00:56:13.017 INFO:tasks.workunit.client.0.smithi017.stdout:6/239: dwrite d5/d13/d11/f33 [0,4194304] 0 2024-08-19T00:56:13.018 INFO:tasks.workunit.client.1.smithi086.stdout:8/720: stat dc/d1f/d37/d4f/dac/de3 0 2024-08-19T00:56:13.018 INFO:tasks.workunit.client.0.smithi017.stdout:3/319: write d5/d11/f2a [4914863,72328] 0 2024-08-19T00:56:13.022 INFO:tasks.workunit.client.1.smithi086.stdout:5/733: mknod d0/d2d/d43/ce0 0 2024-08-19T00:56:13.024 INFO:tasks.workunit.client.1.smithi086.stdout:4/705: stat d2/d18/d33/d42/d72/d2f 0 2024-08-19T00:56:13.025 INFO:tasks.workunit.client.1.smithi086.stdout:4/706: dread - d2/d18/d33/d42/d72/d2f/dc4/fd7 zero size 2024-08-19T00:56:13.026 INFO:tasks.workunit.client.1.smithi086.stdout:4/707: chown d2/d18/d33/d42/d72/d8f/fb1 5 1 2024-08-19T00:56:13.026 INFO:tasks.workunit.client.0.smithi017.stdout:3/320: dwrite d5/fc [0,4194304] 0 2024-08-19T00:56:13.028 INFO:tasks.workunit.client.0.smithi017.stdout:4/246: dread d2/d27/f4d [0,4194304] 0 2024-08-19T00:56:13.029 INFO:tasks.workunit.client.0.smithi017.stdout:4/247: truncate d2/f4b 1011222 0 2024-08-19T00:56:13.030 INFO:tasks.workunit.client.0.smithi017.stdout:3/321: stat d5/d15/d53/l54 0 2024-08-19T00:56:13.113 INFO:tasks.workunit.client.1.smithi086.stdout:3/737: link d3/d9/fc7 d3/d18/d19/dbc/ff3 0 2024-08-19T00:56:13.115 INFO:tasks.workunit.client.0.smithi017.stdout:4/248: mknod d2/d1a/c51 0 2024-08-19T00:56:13.117 INFO:tasks.workunit.client.0.smithi017.stdout:3/322: symlink d5/da/d3c/d4f/l5a 0 2024-08-19T00:56:13.118 INFO:tasks.workunit.client.1.smithi086.stdout:6/752: dwrite db/f13 [0,4194304] 0 2024-08-19T00:56:13.119 INFO:tasks.workunit.client.1.smithi086.stdout:7/741: write d3/de/d68/d7d/fa7 [1540434,12523] 0 2024-08-19T00:56:13.121 INFO:tasks.workunit.client.0.smithi017.stdout:4/249: creat d2/d1a/d20/f52 x:0 0 0 2024-08-19T00:56:13.121 INFO:tasks.workunit.client.0.smithi017.stdout:3/323: write d5/da/d3c/d4f/f52 [979161,112874] 0 2024-08-19T00:56:13.122 INFO:tasks.workunit.client.1.smithi086.stdout:3/738: dwrite d3/d26/d2b/d33/d4a/d57/d8a/fdb [0,4194304] 0 2024-08-19T00:56:13.125 INFO:tasks.workunit.client.0.smithi017.stdout:5/232: dwrite db/f56 [0,4194304] 0 2024-08-19T00:56:13.127 INFO:tasks.workunit.client.0.smithi017.stdout:0/235: read d5/d18/f23 [429933,30397] 0 2024-08-19T00:56:13.133 INFO:tasks.workunit.client.0.smithi017.stdout:4/250: dwrite d2/d16/f22 [4194304,4194304] 0 2024-08-19T00:56:13.134 INFO:tasks.workunit.client.0.smithi017.stdout:9/289: dread d0/f3a [0,4194304] 0 2024-08-19T00:56:13.135 INFO:tasks.workunit.client.1.smithi086.stdout:4/708: creat d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/fef x:0 0 0 2024-08-19T00:56:13.136 INFO:tasks.workunit.client.0.smithi017.stdout:4/251: truncate d2/f12 4533356 0 2024-08-19T00:56:13.139 INFO:tasks.workunit.client.0.smithi017.stdout:9/290: dread d0/d33/f1b [4194304,4194304] 0 2024-08-19T00:56:13.140 INFO:tasks.workunit.client.0.smithi017.stdout:3/324: symlink d5/d11/l5b 0 2024-08-19T00:56:13.142 INFO:tasks.workunit.client.0.smithi017.stdout:3/325: write d5/d11/f14 [3649171,69352] 0 2024-08-19T00:56:13.144 INFO:tasks.workunit.client.0.smithi017.stdout:5/233: chown db/l29 1958 1 2024-08-19T00:56:13.154 INFO:tasks.workunit.client.0.smithi017.stdout:9/291: rename d0/fa to d0/d33/d22/d45/f54 0 2024-08-19T00:56:13.156 INFO:tasks.workunit.client.0.smithi017.stdout:4/252: dwrite d2/f12 [0,4194304] 0 2024-08-19T00:56:13.158 INFO:tasks.workunit.client.0.smithi017.stdout:3/326: chown d5/da/l13 1052824 1 2024-08-19T00:56:13.161 INFO:tasks.workunit.client.0.smithi017.stdout:3/327: write d5/d11/f14 [350866,125872] 0 2024-08-19T00:56:13.161 INFO:tasks.workunit.client.0.smithi017.stdout:5/234: write db/ff [5081425,46573] 0 2024-08-19T00:56:13.166 INFO:tasks.workunit.client.0.smithi017.stdout:9/292: fsync d0/f18 0 2024-08-19T00:56:13.175 INFO:tasks.workunit.client.0.smithi017.stdout:3/328: mknod d5/d15/d1b/c5c 0 2024-08-19T00:56:13.178 INFO:tasks.workunit.client.0.smithi017.stdout:9/293: write d0/d33/d22/f44 [42108,109687] 0 2024-08-19T00:56:13.180 INFO:tasks.workunit.client.0.smithi017.stdout:5/235: mkdir db/d19/d57 0 2024-08-19T00:56:13.182 INFO:tasks.workunit.client.0.smithi017.stdout:5/236: write db/d19/d1f/d15/d3e/d40/f44 [1289499,84112] 0 2024-08-19T00:56:13.183 INFO:tasks.workunit.client.0.smithi017.stdout:4/253: rmdir d2/d11 39 2024-08-19T00:56:13.185 INFO:tasks.workunit.client.0.smithi017.stdout:7/338: stat d3/dc/df/d1a 0 2024-08-19T00:56:13.189 INFO:tasks.workunit.client.1.smithi086.stdout:1/824: write d4/d7/d2a/d36/d50/f9d [1999057,27990] 0 2024-08-19T00:56:13.190 INFO:tasks.workunit.client.1.smithi086.stdout:2/736: getdents d8/d2c/d38 0 2024-08-19T00:56:13.190 INFO:tasks.workunit.client.1.smithi086.stdout:1/825: chown d4/d7/d2a/c55 30346 1 2024-08-19T00:56:13.191 INFO:tasks.workunit.client.1.smithi086.stdout:1/826: write d4/d7/d2a/d36/fdf [4502943,17004] 0 2024-08-19T00:56:13.195 INFO:tasks.workunit.client.0.smithi017.stdout:4/254: rename d2/d11/d50 to d2/d21/d53 0 2024-08-19T00:56:13.198 INFO:tasks.workunit.client.0.smithi017.stdout:6/240: write d5/d13/d20/f32 [1078563,119532] 0 2024-08-19T00:56:13.199 INFO:tasks.workunit.client.0.smithi017.stdout:9/294: creat d0/d33/d22/d36/f55 x:0 0 0 2024-08-19T00:56:13.201 INFO:tasks.workunit.client.0.smithi017.stdout:4/255: creat d2/d1a/d20/f54 x:0 0 0 2024-08-19T00:56:13.202 INFO:tasks.workunit.client.1.smithi086.stdout:9/737: dwrite db/d26/d5c/d87/d37/fab [0,4194304] 0 2024-08-19T00:56:13.202 INFO:tasks.workunit.client.1.smithi086.stdout:9/738: stat db/d26/d5c/d87/d30/d32/d44/f73 0 2024-08-19T00:56:13.205 INFO:tasks.workunit.client.0.smithi017.stdout:6/241: creat d5/d13/d11/f53 x:0 0 0 2024-08-19T00:56:13.207 INFO:tasks.workunit.client.1.smithi086.stdout:8/721: write dc/d16/dc7/d2e/d28/d2b/f6e [2129640,66201] 0 2024-08-19T00:56:13.210 INFO:tasks.workunit.client.1.smithi086.stdout:3/739: creat d3/d18/d19/dbc/de1/ff4 x:0 0 0 2024-08-19T00:56:13.211 INFO:tasks.workunit.client.0.smithi017.stdout:4/256: dwrite d2/d21/d40/f4c [0,4194304] 0 2024-08-19T00:56:13.212 INFO:tasks.workunit.client.0.smithi017.stdout:4/257: chown d2/d16/f3f 665 1 2024-08-19T00:56:13.213 INFO:tasks.workunit.client.0.smithi017.stdout:4/258: truncate d2/f12 4757849 0 2024-08-19T00:56:13.215 INFO:tasks.workunit.client.1.smithi086.stdout:2/737: fsync d8/d2c/d47/f7a 0 2024-08-19T00:56:13.219 INFO:tasks.workunit.client.1.smithi086.stdout:1/827: truncate d4/d7/d2a/d36/d50/f86 855502 0 2024-08-19T00:56:13.225 INFO:tasks.workunit.client.0.smithi017.stdout:9/295: rename d0/d33/d22/d36/l51 to d0/d33/d22/l56 0 2024-08-19T00:56:13.226 INFO:tasks.workunit.client.0.smithi017.stdout:4/259: dread d2/d1a/f3d [0,4194304] 0 2024-08-19T00:56:13.227 INFO:tasks.workunit.client.1.smithi086.stdout:7/742: symlink d3/d34/d44/d58/d4b/da5/daf/df0/lf8 0 2024-08-19T00:56:13.231 INFO:tasks.workunit.client.0.smithi017.stdout:9/296: write d0/d33/d22/d45/f54 [8701910,80707] 0 2024-08-19T00:56:13.234 INFO:tasks.workunit.client.0.smithi017.stdout:4/260: dwrite d2/f7 [0,4194304] 0 2024-08-19T00:56:13.235 INFO:tasks.workunit.client.1.smithi086.stdout:2/738: symlink d8/d2c/d38/lf8 0 2024-08-19T00:56:13.236 INFO:tasks.workunit.client.1.smithi086.stdout:2/739: dread - d8/d2c/d47/d73/fef zero size 2024-08-19T00:56:13.238 INFO:tasks.workunit.client.1.smithi086.stdout:9/739: mknod db/ced 0 2024-08-19T00:56:13.239 INFO:tasks.workunit.client.1.smithi086.stdout:9/740: chown db/d26/d5c/d87/d6d/deb 163591 1 2024-08-19T00:56:13.239 INFO:tasks.workunit.client.1.smithi086.stdout:7/743: rmdir d3/d34/d44/d58/d4b/da5/daf/de7/df5 39 2024-08-19T00:56:13.240 INFO:tasks.workunit.client.0.smithi017.stdout:9/297: dwrite d0/d33/d22/d36/f3e [0,4194304] 0 2024-08-19T00:56:13.246 INFO:tasks.workunit.client.1.smithi086.stdout:4/709: rename d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/ldb to d2/lf0 0 2024-08-19T00:56:13.246 INFO:tasks.workunit.client.0.smithi017.stdout:9/298: symlink d0/d33/d22/d36/d49/l57 0 2024-08-19T00:56:13.251 INFO:tasks.workunit.client.1.smithi086.stdout:1/828: truncate d4/d10/fae 87505 0 2024-08-19T00:56:13.253 INFO:tasks.workunit.client.1.smithi086.stdout:2/740: mkdir d8/d2c/d38/d80/dca/df9 0 2024-08-19T00:56:13.255 INFO:tasks.workunit.client.1.smithi086.stdout:6/753: getdents db/d37/d44/d5a 0 2024-08-19T00:56:13.256 INFO:tasks.workunit.client.0.smithi017.stdout:3/329: write d5/ff [1425867,109268] 0 2024-08-19T00:56:13.260 INFO:tasks.workunit.client.1.smithi086.stdout:9/741: rename db/d5e to db/dd/de2/dee 0 2024-08-19T00:56:13.261 INFO:tasks.workunit.client.1.smithi086.stdout:9/742: chown db/daf 1 1 2024-08-19T00:56:13.262 INFO:tasks.workunit.client.1.smithi086.stdout:0/741: truncate da/d14/d1a/d2e/d39/d3b/d89/dd1/fe4 3033673 0 2024-08-19T00:56:13.264 INFO:tasks.workunit.client.1.smithi086.stdout:7/744: dread d3/de/d68/fb6 [0,4194304] 0 2024-08-19T00:56:13.267 INFO:tasks.workunit.client.0.smithi017.stdout:5/237: truncate db/d19/d1f/d15/d1e/f37 3292305 0 2024-08-19T00:56:13.268 INFO:tasks.workunit.client.0.smithi017.stdout:5/238: write db/ff [5342174,23068] 0 2024-08-19T00:56:13.269 INFO:tasks.workunit.client.1.smithi086.stdout:6/754: symlink db/d8e/lf0 0 2024-08-19T00:56:13.271 INFO:tasks.workunit.client.1.smithi086.stdout:9/743: mkdir db/dd/de2/dee/def 0 2024-08-19T00:56:13.272 INFO:tasks.workunit.client.0.smithi017.stdout:5/239: symlink db/d19/d1f/d15/d30/l58 0 2024-08-19T00:56:13.272 INFO:tasks.workunit.client.0.smithi017.stdout:6/242: write d5/fb [5036437,22233] 0 2024-08-19T00:56:13.273 INFO:tasks.workunit.client.1.smithi086.stdout:9/744: stat db/dd/d19/d18/db9 0 2024-08-19T00:56:13.274 INFO:tasks.workunit.client.1.smithi086.stdout:5/734: dwrite d0/df/d1f/f27 [0,4194304] 0 2024-08-19T00:56:13.275 INFO:tasks.workunit.client.1.smithi086.stdout:5/735: chown d0/df/d1f/d33/f96 10768166 1 2024-08-19T00:56:13.279 INFO:tasks.workunit.client.0.smithi017.stdout:6/243: dwrite d5/d13/d11/f37 [0,4194304] 0 2024-08-19T00:56:13.370 INFO:tasks.workunit.client.1.smithi086.stdout:0/742: rmdir da/d14/d1a/d2e/d30/d76 39 2024-08-19T00:56:13.372 INFO:tasks.workunit.client.0.smithi017.stdout:5/240: mknod db/d19/d1f/d15/d3e/d40/c59 0 2024-08-19T00:56:13.373 INFO:tasks.workunit.client.1.smithi086.stdout:2/741: creat d8/d2c/d38/d80/dca/df9/ffa x:0 0 0 2024-08-19T00:56:13.373 INFO:tasks.workunit.client.1.smithi086.stdout:2/742: stat d8/d24/d32/d4d/l8a 0 2024-08-19T00:56:13.375 INFO:tasks.workunit.client.1.smithi086.stdout:6/755: truncate db/d37/d30/fc9 559501 0 2024-08-19T00:56:13.375 INFO:tasks.workunit.client.0.smithi017.stdout:6/244: rmdir d5/d13/d11/d4d 39 2024-08-19T00:56:13.377 INFO:tasks.workunit.client.1.smithi086.stdout:4/710: creat d2/d18/d33/d42/d72/d78/d25/d55/de1/ff1 x:0 0 0 2024-08-19T00:56:13.378 INFO:tasks.workunit.client.0.smithi017.stdout:5/241: write db/f24 [1692806,92750] 0 2024-08-19T00:56:13.381 INFO:tasks.workunit.client.1.smithi086.stdout:5/736: mkdir d0/d2d/dce/de1 0 2024-08-19T00:56:13.381 INFO:tasks.workunit.client.1.smithi086.stdout:5/737: readlink d0/d8/d72/l7f 0 2024-08-19T00:56:13.383 INFO:tasks.workunit.client.1.smithi086.stdout:0/743: rename da/d14/d55/fca to da/d5d/feb 0 2024-08-19T00:56:13.384 INFO:tasks.workunit.client.0.smithi017.stdout:5/242: readlink db/d19/d1f/d15/d3e/l4f 0 2024-08-19T00:56:13.385 INFO:tasks.workunit.client.0.smithi017.stdout:5/243: stat db/d19/d1f/d15/c51 0 2024-08-19T00:56:13.385 INFO:tasks.workunit.client.1.smithi086.stdout:8/722: dwrite dc/f1c [0,4194304] 0 2024-08-19T00:56:13.386 INFO:tasks.workunit.client.0.smithi017.stdout:6/245: mknod d5/d13/d11/c54 0 2024-08-19T00:56:13.388 INFO:tasks.workunit.client.1.smithi086.stdout:2/743: fsync d8/d43/f5a 0 2024-08-19T00:56:13.391 INFO:tasks.workunit.client.0.smithi017.stdout:9/299: rename d0/d33/d22/d36 to d0/d58 0 2024-08-19T00:56:13.392 INFO:tasks.workunit.client.0.smithi017.stdout:9/300: chown d0/d33/d22/f2c 274621 1 2024-08-19T00:56:13.392 INFO:tasks.workunit.client.1.smithi086.stdout:9/745: dread db/d26/d5c/d87/d37/f81 [0,4194304] 0 2024-08-19T00:56:13.393 INFO:tasks.workunit.client.1.smithi086.stdout:3/740: dwrite d3/d18/fe4 [0,4194304] 0 2024-08-19T00:56:13.393 INFO:tasks.workunit.client.0.smithi017.stdout:4/261: truncate d2/d1a/d39/f47 1901499 0 2024-08-19T00:56:13.395 INFO:tasks.workunit.client.1.smithi086.stdout:4/711: dread d2/d18/d33/f65 [0,4194304] 0 2024-08-19T00:56:13.397 INFO:tasks.workunit.client.1.smithi086.stdout:5/738: mkdir d0/d99/dc0/dc2/de2 0 2024-08-19T00:56:13.398 INFO:tasks.workunit.client.1.smithi086.stdout:5/739: dread - d0/d99/dc0/fda zero size 2024-08-19T00:56:13.398 INFO:tasks.workunit.client.0.smithi017.stdout:6/246: rename d5/d13/d11/c2d to d5/d13/d11/d4d/c55 0 2024-08-19T00:56:13.401 INFO:tasks.workunit.client.1.smithi086.stdout:6/756: rename db/d37/d44/ld7 to db/d37/d28/d7f/d96/lf1 0 2024-08-19T00:56:13.402 INFO:tasks.workunit.client.0.smithi017.stdout:9/301: rmdir d0/d58/d49 39 2024-08-19T00:56:13.404 INFO:tasks.workunit.client.1.smithi086.stdout:0/744: unlink da/d14/d1a/d2e/d7e/dd7/fe5 0 2024-08-19T00:56:13.405 INFO:tasks.workunit.client.1.smithi086.stdout:0/745: readlink da/d14/d1a/d2e/d39/d3b/d4e/dbe/laa 0 2024-08-19T00:56:13.407 INFO:tasks.workunit.client.0.smithi017.stdout:5/244: creat db/d19/d1f/d15/f5a x:0 0 0 2024-08-19T00:56:13.407 INFO:tasks.workunit.client.1.smithi086.stdout:1/829: write d4/d7/d2a/d36/d63/f80 [687144,105917] 0 2024-08-19T00:56:13.408 INFO:tasks.workunit.client.1.smithi086.stdout:8/723: creat dc/d1f/fe8 x:0 0 0 2024-08-19T00:56:13.408 INFO:tasks.workunit.client.0.smithi017.stdout:3/330: truncate d5/d15/d1b/f39 1615906 0 2024-08-19T00:56:13.409 INFO:tasks.workunit.client.0.smithi017.stdout:4/262: mkdir d2/d1a/d55 0 2024-08-19T00:56:13.411 INFO:tasks.workunit.client.0.smithi017.stdout:6/247: creat d5/d13/d20/f56 x:0 0 0 2024-08-19T00:56:13.413 INFO:tasks.workunit.client.1.smithi086.stdout:2/744: rmdir d8/d2c/d38/d80 39 2024-08-19T00:56:13.415 INFO:tasks.workunit.client.1.smithi086.stdout:9/746: unlink db/d26/d5c/d87/d6d/f41 0 2024-08-19T00:56:13.416 INFO:tasks.workunit.client.0.smithi017.stdout:5/245: chown db/f34 26415834 1 2024-08-19T00:56:13.416 INFO:tasks.workunit.client.1.smithi086.stdout:3/741: fdatasync d3/d18/d27/d49/d3f/d5b/d66/fd9 0 2024-08-19T00:56:13.417 INFO:tasks.workunit.client.1.smithi086.stdout:7/745: write d3/d34/d44/d58/d4b/f7c [284449,65652] 0 2024-08-19T00:56:13.417 INFO:tasks.workunit.client.1.smithi086.stdout:5/740: dread d0/df/f23 [0,4194304] 0 2024-08-19T00:56:13.419 INFO:tasks.workunit.client.1.smithi086.stdout:4/712: fsync d2/d18/d33/d42/d72/d78/d25/f9d 0 2024-08-19T00:56:13.422 INFO:tasks.workunit.client.0.smithi017.stdout:9/302: mknod d0/d58/d49/c59 0 2024-08-19T00:56:13.423 INFO:tasks.workunit.client.0.smithi017.stdout:3/331: symlink d5/da/l5d 0 2024-08-19T00:56:13.425 INFO:tasks.workunit.client.0.smithi017.stdout:6/248: creat d5/d13/d11/d2c/d4a/f57 x:0 0 0 2024-08-19T00:56:13.426 INFO:tasks.workunit.client.0.smithi017.stdout:6/249: write d5/d13/d20/f48 [398700,101841] 0 2024-08-19T00:56:13.430 INFO:tasks.workunit.client.0.smithi017.stdout:4/263: rename d2/d1a/d39 to d2/d21/d40/d56 0 2024-08-19T00:56:13.430 INFO:tasks.workunit.client.1.smithi086.stdout:0/746: symlink da/d14/d44/d7b/lec 0 2024-08-19T00:56:13.431 INFO:tasks.workunit.client.1.smithi086.stdout:0/747: chown da/d14/f6f 4026 1 2024-08-19T00:56:13.431 INFO:tasks.workunit.client.1.smithi086.stdout:0/748: fdatasync da/d14/d1a/d2e/d39/d3b/fe9 0 2024-08-19T00:56:13.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:13 smithi017 ceph-mon[16627]: pgmap v17: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 78 MiB/s rd, 292 MiB/s wr, 518 op/s 2024-08-19T00:56:13.433 INFO:tasks.workunit.client.1.smithi086.stdout:0/749: write da/d14/d1a/d2e/f35 [1885342,8794] 0 2024-08-19T00:56:13.433 INFO:tasks.workunit.client.1.smithi086.stdout:0/750: chown da/cb 29070 1 2024-08-19T00:56:13.433 INFO:tasks.workunit.client.0.smithi017.stdout:3/332: mknod d5/d15/c5e 0 2024-08-19T00:56:13.434 INFO:tasks.workunit.client.0.smithi017.stdout:3/333: chown d5/da/d3c/d4f/f52 139372713 1 2024-08-19T00:56:13.436 INFO:tasks.workunit.client.0.smithi017.stdout:6/250: creat d5/d13/d20/f58 x:0 0 0 2024-08-19T00:56:13.439 INFO:tasks.workunit.client.0.smithi017.stdout:4/264: mkdir d2/d21/d53/d57 0 2024-08-19T00:56:13.439 INFO:tasks.workunit.client.1.smithi086.stdout:9/747: write db/d26/d5c/d68/f78 [5168186,95029] 0 2024-08-19T00:56:13.444 INFO:tasks.workunit.client.1.smithi086.stdout:5/741: creat d0/df/d1f/fe3 x:0 0 0 2024-08-19T00:56:13.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:13 smithi086 ceph-mon[24511]: pgmap v17: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 78 MiB/s rd, 292 MiB/s wr, 518 op/s 2024-08-19T00:56:13.446 INFO:tasks.workunit.client.0.smithi017.stdout:4/265: dread d2/d1a/f1c [0,4194304] 0 2024-08-19T00:56:13.446 INFO:tasks.workunit.client.1.smithi086.stdout:9/748: dwrite db/d26/d5c/d87/d30/d32/d44/f65 [0,4194304] 0 2024-08-19T00:56:13.453 INFO:tasks.workunit.client.0.smithi017.stdout:3/334: rename d5/d15/c5e to d5/da/c5f 0 2024-08-19T00:56:13.453 INFO:tasks.workunit.client.1.smithi086.stdout:9/749: dwrite db/d26/d5c/d87/d30/d32/f3a [4194304,4194304] 0 2024-08-19T00:56:13.453 INFO:tasks.workunit.client.0.smithi017.stdout:3/335: fdatasync d5/ff 0 2024-08-19T00:56:13.455 INFO:tasks.workunit.client.1.smithi086.stdout:1/830: mknod d4/c111 0 2024-08-19T00:56:13.459 INFO:tasks.workunit.client.1.smithi086.stdout:0/751: symlink da/d14/d1a/d2e/d39/d3b/d89/led 0 2024-08-19T00:56:13.461 INFO:tasks.workunit.client.1.smithi086.stdout:9/750: dwrite db/d26/d5c/d87/d6d/fe3 [0,4194304] 0 2024-08-19T00:56:13.463 INFO:tasks.workunit.client.1.smithi086.stdout:2/745: write d8/d43/d65/f9b [348823,78927] 0 2024-08-19T00:56:13.464 INFO:tasks.workunit.client.0.smithi017.stdout:4/266: unlink d2/d11/d24/l2c 0 2024-08-19T00:56:13.464 INFO:tasks.workunit.client.1.smithi086.stdout:2/746: stat d8/d84/de0 0 2024-08-19T00:56:13.465 INFO:tasks.workunit.client.1.smithi086.stdout:8/724: dwrite dc/d1f/d37/d4f/dac/db8/d8f/faf [0,4194304] 0 2024-08-19T00:56:13.466 INFO:tasks.workunit.client.1.smithi086.stdout:7/746: write d3/d34/d44/d58/d4b/fbd [4948,73437] 0 2024-08-19T00:56:13.469 INFO:tasks.workunit.client.1.smithi086.stdout:4/713: write d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/de0/fc3 [342542,30816] 0 2024-08-19T00:56:13.470 INFO:tasks.workunit.client.0.smithi017.stdout:6/251: getdents d5/d13/d20 0 2024-08-19T00:56:13.470 INFO:tasks.workunit.client.0.smithi017.stdout:6/252: dread - d5/f4f zero size 2024-08-19T00:56:13.471 INFO:tasks.workunit.client.1.smithi086.stdout:4/714: chown d2/d18/d33/d42/d72/d78/d25/d55/d6c 111460 1 2024-08-19T00:56:13.471 INFO:tasks.workunit.client.0.smithi017.stdout:6/253: stat d5/d13/d11/d2c/l43 0 2024-08-19T00:56:13.473 INFO:tasks.workunit.client.0.smithi017.stdout:1/265: sync 2024-08-19T00:56:13.477 INFO:tasks.workunit.client.1.smithi086.stdout:6/757: creat db/d37/d30/ff2 x:0 0 0 2024-08-19T00:56:13.480 INFO:tasks.workunit.client.0.smithi017.stdout:1/266: rmdir d4/d1c 39 2024-08-19T00:56:13.481 INFO:tasks.workunit.client.0.smithi017.stdout:6/254: dwrite d5/d13/d11/d2c/f46 [0,4194304] 0 2024-08-19T00:56:13.482 INFO:tasks.workunit.client.1.smithi086.stdout:6/758: dwrite db/f3e [0,4194304] 0 2024-08-19T00:56:13.483 INFO:tasks.workunit.client.1.smithi086.stdout:6/759: chown db/d8e 7 1 2024-08-19T00:56:13.485 INFO:tasks.workunit.client.0.smithi017.stdout:3/336: creat d5/f60 x:0 0 0 2024-08-19T00:56:13.486 INFO:tasks.workunit.client.0.smithi017.stdout:6/255: dread d5/d13/d11/d2c/f46 [0,4194304] 0 2024-08-19T00:56:13.488 INFO:tasks.workunit.client.0.smithi017.stdout:1/267: rmdir d4/dc/d19 39 2024-08-19T00:56:13.493 INFO:tasks.workunit.client.1.smithi086.stdout:8/725: creat dc/d16/dc7/d2e/d28/dc4/fe9 x:0 0 0 2024-08-19T00:56:13.494 INFO:tasks.workunit.client.0.smithi017.stdout:6/256: dwrite f3 [0,4194304] 0 2024-08-19T00:56:13.495 INFO:tasks.workunit.client.1.smithi086.stdout:2/747: dwrite d8/d14/d9e/fb8 [4194304,4194304] 0 2024-08-19T00:56:13.497 INFO:tasks.workunit.client.1.smithi086.stdout:2/748: write d8/d84/ff3 [332548,103243] 0 2024-08-19T00:56:13.497 INFO:tasks.workunit.client.0.smithi017.stdout:3/337: mkdir d5/d11/d61 0 2024-08-19T00:56:13.502 INFO:tasks.workunit.client.1.smithi086.stdout:4/715: truncate d2/d18/d33/d42/d72/d78/d25/d30/f97 235673 0 2024-08-19T00:56:13.503 INFO:tasks.workunit.client.1.smithi086.stdout:4/716: chown d2/d18/d33/d42/d72/d8f/lab 158 1 2024-08-19T00:56:13.503 INFO:tasks.workunit.client.0.smithi017.stdout:1/268: truncate d4/f14 8601622 0 2024-08-19T00:56:13.504 INFO:tasks.workunit.client.0.smithi017.stdout:4/267: getdents d2/d1a/d20 0 2024-08-19T00:56:13.505 INFO:tasks.workunit.client.0.smithi017.stdout:4/268: truncate d2/d16/f1f 1797805 0 2024-08-19T00:56:13.506 INFO:tasks.workunit.client.1.smithi086.stdout:0/752: mknod da/d14/d1a/cee 0 2024-08-19T00:56:13.510 INFO:tasks.workunit.client.0.smithi017.stdout:3/338: creat d5/d11/f62 x:0 0 0 2024-08-19T00:56:13.512 INFO:tasks.workunit.client.1.smithi086.stdout:9/751: rename db/d96/la0 to db/d26/d5c/d87/d30/d32/d44/dc1/lf0 0 2024-08-19T00:56:13.512 INFO:tasks.workunit.client.1.smithi086.stdout:7/747: dwrite d3/d34/d44/d58/d4b/da5/f74 [0,4194304] 0 2024-08-19T00:56:13.513 INFO:tasks.workunit.client.0.smithi017.stdout:4/269: mknod d2/d1a/d20/c58 0 2024-08-19T00:56:13.515 INFO:tasks.workunit.client.1.smithi086.stdout:8/726: mknod dc/d1f/d37/d4f/cea 0 2024-08-19T00:56:13.517 INFO:tasks.workunit.client.0.smithi017.stdout:4/270: creat d2/d11/f59 x:0 0 0 2024-08-19T00:56:13.517 INFO:tasks.workunit.client.1.smithi086.stdout:7/748: dread d3/de/f2b [0,4194304] 0 2024-08-19T00:56:13.517 INFO:tasks.workunit.client.0.smithi017.stdout:6/257: creat d5/d13/d11/f59 x:0 0 0 2024-08-19T00:56:13.518 INFO:tasks.workunit.client.1.smithi086.stdout:2/749: readlink d8/d2c/d38/d80/la8 0 2024-08-19T00:56:13.519 INFO:tasks.workunit.client.0.smithi017.stdout:3/339: creat d5/d11/d61/f63 x:0 0 0 2024-08-19T00:56:13.520 INFO:tasks.workunit.client.0.smithi017.stdout:6/258: write d5/d13/d20/f3c [319625,76688] 0 2024-08-19T00:56:13.521 INFO:tasks.workunit.client.0.smithi017.stdout:3/340: stat d5/d11/f2f 0 2024-08-19T00:56:13.522 INFO:tasks.workunit.client.1.smithi086.stdout:4/717: creat d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/ff2 x:0 0 0 2024-08-19T00:56:13.522 INFO:tasks.workunit.client.1.smithi086.stdout:6/760: mkdir db/d37/df3 0 2024-08-19T00:56:13.523 INFO:tasks.workunit.client.1.smithi086.stdout:8/727: dwrite dc/d1f/d37/d9f/fc2 [0,4194304] 0 2024-08-19T00:56:13.523 INFO:tasks.workunit.client.0.smithi017.stdout:4/271: dread d2/d27/f4d [0,4194304] 0 2024-08-19T00:56:13.524 INFO:tasks.workunit.client.1.smithi086.stdout:9/752: symlink db/d26/d5c/d87/d30/d58/lf1 0 2024-08-19T00:56:13.525 INFO:tasks.workunit.client.1.smithi086.stdout:6/761: stat db/d37/d44 0 2024-08-19T00:56:13.526 INFO:tasks.workunit.client.1.smithi086.stdout:5/742: getdents d0/d8/d10 0 2024-08-19T00:56:13.528 INFO:tasks.workunit.client.0.smithi017.stdout:4/272: mkdir d2/d21/d53/d5a 0 2024-08-19T00:56:13.529 INFO:tasks.workunit.client.0.smithi017.stdout:4/273: stat d2/d21/d40/d56 0 2024-08-19T00:56:13.529 INFO:tasks.workunit.client.1.smithi086.stdout:4/718: readlink d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/le3 0 2024-08-19T00:56:13.530 INFO:tasks.workunit.client.1.smithi086.stdout:2/750: dwrite d8/d14/dae/ff5 [0,4194304] 0 2024-08-19T00:56:13.532 INFO:tasks.workunit.client.1.smithi086.stdout:1/831: getdents d4/d7/d2a/d36/d50/d9c/ded 0 2024-08-19T00:56:13.533 INFO:tasks.workunit.client.1.smithi086.stdout:1/832: stat d4/d7/d2a/d6e/d95/db9/deb/fec 0 2024-08-19T00:56:13.536 INFO:tasks.workunit.client.0.smithi017.stdout:4/274: write d2/d27/f4d [3709873,110278] 0 2024-08-19T00:56:13.537 INFO:tasks.workunit.client.1.smithi086.stdout:7/749: dread d3/de/d68/d7d/fa7 [0,4194304] 0 2024-08-19T00:56:13.537 INFO:tasks.workunit.client.0.smithi017.stdout:3/341: dread d5/d11/f2a [0,4194304] 0 2024-08-19T00:56:13.543 INFO:tasks.workunit.client.1.smithi086.stdout:8/728: symlink dc/d1f/dd4/leb 0 2024-08-19T00:56:13.545 INFO:tasks.workunit.client.0.smithi017.stdout:6/259: getdents d5 0 2024-08-19T00:56:13.545 INFO:tasks.workunit.client.0.smithi017.stdout:4/275: dwrite d2/d27/f4d [0,4194304] 0 2024-08-19T00:56:13.546 INFO:tasks.workunit.client.0.smithi017.stdout:4/276: chown d2/d21/d40 25 1 2024-08-19T00:56:13.547 INFO:tasks.workunit.client.0.smithi017.stdout:6/260: write d5/d13/f16 [3447136,96235] 0 2024-08-19T00:56:13.548 INFO:tasks.workunit.client.1.smithi086.stdout:4/719: rmdir d2/d18/d33/d42/d72/d2f/dc4/d81/d8a 39 2024-08-19T00:56:13.549 INFO:tasks.workunit.client.1.smithi086.stdout:2/751: mknod d8/d24/d32/d4d/d6a/db1/cfb 0 2024-08-19T00:56:13.551 INFO:tasks.workunit.client.1.smithi086.stdout:2/752: truncate f2 2742575 0 2024-08-19T00:56:13.552 INFO:tasks.workunit.client.0.smithi017.stdout:4/277: creat d2/d16/f5b x:0 0 0 2024-08-19T00:56:13.553 INFO:tasks.workunit.client.0.smithi017.stdout:4/278: truncate d2/d21/f42 910215 0 2024-08-19T00:56:13.554 INFO:tasks.workunit.client.0.smithi017.stdout:6/261: unlink d5/d13/d11/c2a 0 2024-08-19T00:56:13.556 INFO:tasks.workunit.client.1.smithi086.stdout:4/720: dwrite d2/d18/d33/d42/d72/d78/d25/f58 [0,4194304] 0 2024-08-19T00:56:13.556 INFO:tasks.workunit.client.1.smithi086.stdout:9/753: creat db/d96/da7/ff2 x:0 0 0 2024-08-19T00:56:13.557 INFO:tasks.workunit.client.1.smithi086.stdout:9/754: readlink db/dd/d19/d18/l1e 0 2024-08-19T00:56:13.557 INFO:tasks.workunit.client.0.smithi017.stdout:4/279: symlink d2/d21/d40/l5c 0 2024-08-19T00:56:13.558 INFO:tasks.workunit.client.0.smithi017.stdout:8/190: sync 2024-08-19T00:56:13.558 INFO:tasks.workunit.client.0.smithi017.stdout:4/280: chown d2/d21/d53/d57 669 1 2024-08-19T00:56:13.558 INFO:tasks.workunit.client.0.smithi017.stdout:8/191: chown de/d15/f29 0 1 2024-08-19T00:56:13.558 INFO:tasks.workunit.client.0.smithi017.stdout:8/192: stat f0 0 2024-08-19T00:56:13.559 INFO:tasks.workunit.client.1.smithi086.stdout:9/755: chown db/dd/d19/d18/f25 160223 1 2024-08-19T00:56:13.559 INFO:tasks.workunit.client.1.smithi086.stdout:6/762: getdents db/d34/d4e/d68/d99/dce 0 2024-08-19T00:56:13.559 INFO:tasks.workunit.client.0.smithi017.stdout:6/262: dread - d5/d13/f22 zero size 2024-08-19T00:56:13.560 INFO:tasks.workunit.client.0.smithi017.stdout:6/263: stat d5/d13/f22 0 2024-08-19T00:56:13.562 INFO:tasks.workunit.client.1.smithi086.stdout:0/753: getdents da/d5d 0 2024-08-19T00:56:13.563 INFO:tasks.workunit.client.0.smithi017.stdout:6/264: write d5/d13/d20/f27 [5155219,52392] 0 2024-08-19T00:56:13.564 INFO:tasks.workunit.client.1.smithi086.stdout:2/753: creat d8/d24/d32/d61/ffc x:0 0 0 2024-08-19T00:56:13.566 INFO:tasks.workunit.client.0.smithi017.stdout:8/193: symlink de/d15/l30 0 2024-08-19T00:56:13.566 INFO:tasks.workunit.client.1.smithi086.stdout:9/756: dwrite db/d26/d5c/d87/d30/d58/fc6 [0,4194304] 0 2024-08-19T00:56:13.569 INFO:tasks.workunit.client.0.smithi017.stdout:4/281: dwrite d2/d16/f5b [0,4194304] 0 2024-08-19T00:56:13.570 INFO:tasks.workunit.client.1.smithi086.stdout:4/721: rename d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/fef to d2/d18/d33/d42/d72/d78/d2c/ff3 0 2024-08-19T00:56:13.572 INFO:tasks.workunit.client.1.smithi086.stdout:2/754: dwrite d8/d84/f81 [0,4194304] 0 2024-08-19T00:56:13.574 INFO:tasks.workunit.client.1.smithi086.stdout:8/729: link dc/d1f/d37/d4f/dac/db8/d8f/lc3 dc/d16/dc7/d2e/d28/d41/lec 0 2024-08-19T00:56:13.575 INFO:tasks.workunit.client.1.smithi086.stdout:8/730: readlink dc/d1f/d37/d4f/lb3 0 2024-08-19T00:56:13.576 INFO:tasks.workunit.client.0.smithi017.stdout:6/265: dwrite d5/fb [4194304,4194304] 0 2024-08-19T00:56:13.576 INFO:tasks.workunit.client.0.smithi017.stdout:4/282: mknod d2/d27/c5d 0 2024-08-19T00:56:13.577 INFO:tasks.workunit.client.0.smithi017.stdout:8/194: symlink de/d15/d1f/d2e/l31 0 2024-08-19T00:56:13.579 INFO:tasks.workunit.client.1.smithi086.stdout:4/722: dwrite d2/d18/d33/d42/d72/d2f/dc4/d81/fbe [0,4194304] 0 2024-08-19T00:56:13.580 INFO:tasks.workunit.client.1.smithi086.stdout:1/833: dread d4/d7/d2a/d36/d50/f66 [0,4194304] 0 2024-08-19T00:56:13.582 INFO:tasks.workunit.client.1.smithi086.stdout:6/763: rename db/d37/d30/fb6 to db/d37/d28/d57/ff4 0 2024-08-19T00:56:13.583 INFO:tasks.workunit.client.1.smithi086.stdout:1/834: stat d4/d7/d2a/d36/d7d/d88/fac 0 2024-08-19T00:56:13.584 INFO:tasks.workunit.client.1.smithi086.stdout:5/743: link d0/d2d/dce/ld3 d0/d8/le4 0 2024-08-19T00:56:13.588 INFO:tasks.workunit.client.1.smithi086.stdout:2/755: write d8/d14/f2f [3238011,7878] 0 2024-08-19T00:56:13.589 INFO:tasks.workunit.client.0.smithi017.stdout:8/195: creat de/d15/d1f/f32 x:0 0 0 2024-08-19T00:56:13.640 INFO:tasks.workunit.client.1.smithi086.stdout:3/742: sync 2024-08-19T00:56:13.672 INFO:tasks.workunit.client.1.smithi086.stdout:9/757: symlink db/lf3 0 2024-08-19T00:56:13.676 INFO:tasks.workunit.client.1.smithi086.stdout:4/723: dread d2/d18/d33/d42/d72/d78/d25/d30/f97 [0,4194304] 0 2024-08-19T00:56:13.676 INFO:tasks.workunit.client.1.smithi086.stdout:4/724: chown d2/d18/d33/f64 47 1 2024-08-19T00:56:13.677 INFO:tasks.workunit.client.1.smithi086.stdout:0/754: rename da/d14/d26/f68 to da/d14/d55/fef 0 2024-08-19T00:56:13.680 INFO:tasks.workunit.client.1.smithi086.stdout:1/835: chown d4/f40 2003 1 2024-08-19T00:56:13.682 INFO:tasks.workunit.client.0.smithi017.stdout:8/196: mknod de/c33 0 2024-08-19T00:56:13.683 INFO:tasks.workunit.client.1.smithi086.stdout:6/764: dread db/d34/d4e/fcd [0,4194304] 0 2024-08-19T00:56:13.683 INFO:tasks.workunit.client.0.smithi017.stdout:8/197: read - de/d15/d1f/f32 zero size 2024-08-19T00:56:13.683 INFO:tasks.workunit.client.0.smithi017.stdout:8/198: readlink de/d15/l1a 0 2024-08-19T00:56:13.684 INFO:tasks.workunit.client.0.smithi017.stdout:8/199: dread - de/d15/d1f/f32 zero size 2024-08-19T00:56:13.684 INFO:tasks.workunit.client.1.smithi086.stdout:2/756: fdatasync d8/d43/fac 0 2024-08-19T00:56:13.685 INFO:tasks.workunit.client.1.smithi086.stdout:2/757: dread - d8/d24/fd1 zero size 2024-08-19T00:56:13.685 INFO:tasks.workunit.client.0.smithi017.stdout:4/283: write d2/d21/d40/d56/f47 [2257191,114406] 0 2024-08-19T00:56:13.685 INFO:tasks.workunit.client.0.smithi017.stdout:8/200: chown de/d15/c28 620976122 1 2024-08-19T00:56:13.688 INFO:tasks.workunit.client.1.smithi086.stdout:9/758: dread db/d26/d5c/d87/d30/d3f/f8b [0,4194304] 0 2024-08-19T00:56:13.688 INFO:tasks.workunit.client.0.smithi017.stdout:6/266: truncate d5/f36 4041620 0 2024-08-19T00:56:13.689 INFO:tasks.workunit.client.0.smithi017.stdout:4/284: fdatasync d2/d1a/f3d 0 2024-08-19T00:56:13.692 INFO:tasks.workunit.client.1.smithi086.stdout:0/755: rename da/d14/d1a/d2e/d39/d3b/d89/dd1 to da/d14/d44/df0 0 2024-08-19T00:56:13.695 INFO:tasks.workunit.client.0.smithi017.stdout:6/267: rmdir d5/d13/d11/d2c 39 2024-08-19T00:56:13.696 INFO:tasks.workunit.client.1.smithi086.stdout:1/836: creat d4/d7/d2a/d36/d3a/de5/d7a/db4/df0/f112 x:0 0 0 2024-08-19T00:56:13.697 INFO:tasks.workunit.client.0.smithi017.stdout:6/268: write d5/d13/d20/f3c [754023,107852] 0 2024-08-19T00:56:13.697 INFO:tasks.workunit.client.1.smithi086.stdout:1/837: chown d4/d1e/f54 0 1 2024-08-19T00:56:13.698 INFO:tasks.workunit.client.1.smithi086.stdout:1/838: chown d4/d7/d2a/d36/d63/d84/d8e/fd6 1265 1 2024-08-19T00:56:13.698 INFO:tasks.workunit.client.1.smithi086.stdout:1/839: chown d4/f40 12 1 2024-08-19T00:56:13.699 INFO:tasks.workunit.client.0.smithi017.stdout:4/285: creat d2/d21/d53/f5e x:0 0 0 2024-08-19T00:56:13.699 INFO:tasks.workunit.client.1.smithi086.stdout:5/744: symlink d0/df/le5 0 2024-08-19T00:56:13.701 INFO:tasks.workunit.client.0.smithi017.stdout:8/201: truncate f0 6774970 0 2024-08-19T00:56:13.702 INFO:tasks.workunit.client.0.smithi017.stdout:8/202: dread - de/d15/f29 zero size 2024-08-19T00:56:13.702 INFO:tasks.workunit.client.1.smithi086.stdout:6/765: symlink db/d37/d28/d7f/d96/lf5 0 2024-08-19T00:56:13.705 INFO:tasks.workunit.client.1.smithi086.stdout:5/745: dwrite d0/d2d/d43/d4d/f54 [0,4194304] 0 2024-08-19T00:56:13.708 INFO:tasks.workunit.client.1.smithi086.stdout:9/759: unlink db/d26/d5c/d87/d30/d32/d44/f73 0 2024-08-19T00:56:13.709 INFO:tasks.workunit.client.1.smithi086.stdout:9/760: stat db/d26/d5c/d87/d37/fa4 0 2024-08-19T00:56:13.710 INFO:tasks.workunit.client.1.smithi086.stdout:0/756: creat da/d14/d1a/d2e/d43/ff1 x:0 0 0 2024-08-19T00:56:13.711 INFO:tasks.workunit.client.0.smithi017.stdout:6/269: creat d5/d13/d11/d52/f5a x:0 0 0 2024-08-19T00:56:13.713 INFO:tasks.workunit.client.0.smithi017.stdout:4/286: mknod d2/c5f 0 2024-08-19T00:56:13.715 INFO:tasks.workunit.client.0.smithi017.stdout:4/287: chown d2/d16/f5b 120008 1 2024-08-19T00:56:13.718 INFO:tasks.workunit.client.0.smithi017.stdout:8/203: creat de/f34 x:0 0 0 2024-08-19T00:56:13.719 INFO:tasks.workunit.client.1.smithi086.stdout:1/840: mknod d4/d7/d2a/d6e/d95/c113 0 2024-08-19T00:56:13.719 INFO:tasks.workunit.client.1.smithi086.stdout:6/766: creat db/d37/d44/d5a/d8f/ff6 x:0 0 0 2024-08-19T00:56:13.719 INFO:tasks.workunit.client.1.smithi086.stdout:3/743: link d3/d26/d2b/l3d d3/d18/d27/lf5 0 2024-08-19T00:56:13.719 INFO:tasks.workunit.client.1.smithi086.stdout:5/746: fdatasync d0/df/f23 0 2024-08-19T00:56:13.720 INFO:tasks.workunit.client.1.smithi086.stdout:1/841: readlink d4/d7/d2a/d6e/lf7 0 2024-08-19T00:56:13.720 INFO:tasks.workunit.client.1.smithi086.stdout:3/744: read - d3/d18/d1a/fd6 zero size 2024-08-19T00:56:13.721 INFO:tasks.workunit.client.1.smithi086.stdout:3/745: readlink d3/d18/d19/l4f 0 2024-08-19T00:56:13.721 INFO:tasks.workunit.client.1.smithi086.stdout:3/746: chown d3/d26/f7e 942962 1 2024-08-19T00:56:13.722 INFO:tasks.workunit.client.0.smithi017.stdout:6/270: dwrite d5/f4f [0,4194304] 0 2024-08-19T00:56:13.724 INFO:tasks.workunit.client.1.smithi086.stdout:4/725: getdents d2/d18/d33/d42/d72 0 2024-08-19T00:56:13.725 INFO:tasks.workunit.client.0.smithi017.stdout:6/271: dread - d5/d13/d11/f3b zero size 2024-08-19T00:56:13.725 INFO:tasks.workunit.client.1.smithi086.stdout:4/726: chown d2/d18/d33/d42/d72/d2f/dc4/d81/fbe 13 1 2024-08-19T00:56:13.727 INFO:tasks.workunit.client.1.smithi086.stdout:6/767: unlink db/d37/d44/d5a/d78/fc4 0 2024-08-19T00:56:13.728 INFO:tasks.workunit.client.0.smithi017.stdout:4/288: dwrite d2/d21/f35 [0,4194304] 0 2024-08-19T00:56:13.728 INFO:tasks.workunit.client.1.smithi086.stdout:5/747: write d0/df/d1f/d65/faa [7343536,82830] 0 2024-08-19T00:56:13.730 INFO:tasks.workunit.client.0.smithi017.stdout:8/204: creat de/d15/f35 x:0 0 0 2024-08-19T00:56:13.732 INFO:tasks.workunit.client.1.smithi086.stdout:1/842: creat d4/d7/d2a/d36/d61/f114 x:0 0 0 2024-08-19T00:56:13.732 INFO:tasks.workunit.client.1.smithi086.stdout:7/750: sync 2024-08-19T00:56:13.732 INFO:tasks.workunit.client.1.smithi086.stdout:8/731: sync 2024-08-19T00:56:13.733 INFO:tasks.workunit.client.0.smithi017.stdout:2/347: sync 2024-08-19T00:56:13.733 INFO:tasks.workunit.client.0.smithi017.stdout:0/236: sync 2024-08-19T00:56:13.739 INFO:tasks.workunit.client.1.smithi086.stdout:0/757: mkdir da/d14/d1a/d2e/d30/d76/df2 0 2024-08-19T00:56:13.742 INFO:tasks.workunit.client.0.smithi017.stdout:8/205: chown de/l2f 56340031 1 2024-08-19T00:56:13.746 INFO:tasks.workunit.client.1.smithi086.stdout:2/758: write d8/d14/f55 [2254844,118377] 0 2024-08-19T00:56:13.747 INFO:tasks.workunit.client.1.smithi086.stdout:2/759: chown d8 483353 1 2024-08-19T00:56:13.748 INFO:tasks.workunit.client.1.smithi086.stdout:6/768: creat db/d37/d28/d7f/d96/dc2/ff7 x:0 0 0 2024-08-19T00:56:13.749 INFO:tasks.workunit.client.1.smithi086.stdout:6/769: chown db/d37/d41/f83 16617182 1 2024-08-19T00:56:13.749 INFO:tasks.workunit.client.1.smithi086.stdout:6/770: read - db/d37/d30/ff2 zero size 2024-08-19T00:56:13.751 INFO:tasks.workunit.client.0.smithi017.stdout:8/206: dwrite de/d15/f2b [0,4194304] 0 2024-08-19T00:56:13.752 INFO:tasks.workunit.client.0.smithi017.stdout:8/207: readlink de/l2f 0 2024-08-19T00:56:13.753 INFO:tasks.workunit.client.1.smithi086.stdout:9/761: write db/fb2 [39512,74365] 0 2024-08-19T00:56:13.755 INFO:tasks.workunit.client.1.smithi086.stdout:7/751: rename d3/de/d68/d72/fc5 to d3/de/d68/d7d/ff9 0 2024-08-19T00:56:13.758 INFO:tasks.workunit.client.0.smithi017.stdout:2/348: creat d2/d7/d10/d3b/d69/f70 x:0 0 0 2024-08-19T00:56:13.759 INFO:tasks.workunit.client.1.smithi086.stdout:3/747: creat d3/d18/d27/d49/de2/ff6 x:0 0 0 2024-08-19T00:56:13.759 INFO:tasks.workunit.client.0.smithi017.stdout:6/272: dread d5/d13/d11/d2c/f38 [0,4194304] 0 2024-08-19T00:56:13.762 INFO:tasks.workunit.client.1.smithi086.stdout:0/758: symlink da/d14/d1a/d2e/d39/d3b/d4e/lf3 0 2024-08-19T00:56:13.763 INFO:tasks.workunit.client.1.smithi086.stdout:0/759: dread da/d14/d44/d49/f5f [0,4194304] 0 2024-08-19T00:56:13.764 INFO:tasks.workunit.client.1.smithi086.stdout:4/727: symlink d2/lf4 0 2024-08-19T00:56:13.765 INFO:tasks.workunit.client.1.smithi086.stdout:4/728: chown d2/d18/d33/d42/d72/d78/d25/d30/d5d/f79 1380397732 1 2024-08-19T00:56:13.766 INFO:tasks.workunit.client.1.smithi086.stdout:1/843: write d4/d7/d2a/d36/d3a/de5/f81 [965450,63890] 0 2024-08-19T00:56:13.767 INFO:tasks.workunit.client.1.smithi086.stdout:1/844: chown d4/d10/d90/d98/fbd 61 1 2024-08-19T00:56:13.768 INFO:tasks.workunit.client.0.smithi017.stdout:8/208: dread de/f22 [0,4194304] 0 2024-08-19T00:56:13.769 INFO:tasks.workunit.client.0.smithi017.stdout:6/273: dwrite d5/f39 [0,4194304] 0 2024-08-19T00:56:13.770 INFO:tasks.workunit.client.0.smithi017.stdout:8/209: readlink de/d15/l1a 0 2024-08-19T00:56:13.771 INFO:tasks.workunit.client.0.smithi017.stdout:0/237: dwrite d5/d18/f24 [4194304,4194304] 0 2024-08-19T00:56:13.772 INFO:tasks.workunit.client.1.smithi086.stdout:8/732: mknod dc/d1f/d37/d4f/dac/db8/d7a/d88/ced 0 2024-08-19T00:56:13.772 INFO:tasks.workunit.client.0.smithi017.stdout:0/238: chown d5/d17/d21/d39/f44 265044 1 2024-08-19T00:56:13.773 INFO:tasks.workunit.client.0.smithi017.stdout:4/289: getdents d2/d27 0 2024-08-19T00:56:13.774 INFO:tasks.workunit.client.1.smithi086.stdout:1/845: dwrite d4/d7/d2a/d36/d3a/de5/d7a/db4/df0/ff2 [0,4194304] 0 2024-08-19T00:56:13.774 INFO:tasks.workunit.client.1.smithi086.stdout:9/762: mknod db/d26/d5c/d87/d6d/cf4 0 2024-08-19T00:56:13.775 INFO:tasks.workunit.client.0.smithi017.stdout:6/274: rmdir d5 39 2024-08-19T00:56:13.780 INFO:tasks.workunit.client.1.smithi086.stdout:0/760: creat da/d5d/ff4 x:0 0 0 2024-08-19T00:56:13.781 INFO:tasks.workunit.client.0.smithi017.stdout:0/239: dwrite d5/d18/f24 [0,4194304] 0 2024-08-19T00:56:13.782 INFO:tasks.workunit.client.0.smithi017.stdout:0/240: chown d5/l8 3407213 1 2024-08-19T00:56:13.788 INFO:tasks.workunit.client.1.smithi086.stdout:6/771: mknod db/d37/d28/d7f/d96/dc2/de9/cf8 0 2024-08-19T00:56:13.789 INFO:tasks.workunit.client.0.smithi017.stdout:4/290: symlink d2/d11/l60 0 2024-08-19T00:56:13.790 INFO:tasks.workunit.client.0.smithi017.stdout:2/349: link d2/d7/dd/f1c d2/d7/d10/d35/d55/f71 0 2024-08-19T00:56:13.792 INFO:tasks.workunit.client.1.smithi086.stdout:8/733: creat dc/d1f/d37/d4f/fee x:0 0 0 2024-08-19T00:56:13.793 INFO:tasks.workunit.client.1.smithi086.stdout:8/734: dread - dc/d16/dc7/d2e/d28/dc4/fe9 zero size 2024-08-19T00:56:13.794 INFO:tasks.workunit.client.1.smithi086.stdout:1/846: dread - d4/d7/d2a/d36/db6/fc0 zero size 2024-08-19T00:56:13.795 INFO:tasks.workunit.client.0.smithi017.stdout:7/339: sync 2024-08-19T00:56:13.795 INFO:tasks.workunit.client.0.smithi017.stdout:6/275: creat d5/d13/d11/d4d/f5b x:0 0 0 2024-08-19T00:56:13.799 INFO:tasks.workunit.client.0.smithi017.stdout:8/210: rename de/d15/d1f to de/d36 0 2024-08-19T00:56:13.801 INFO:tasks.workunit.client.1.smithi086.stdout:2/760: creat d8/d2c/ffd x:0 0 0 2024-08-19T00:56:13.802 INFO:tasks.workunit.client.0.smithi017.stdout:0/241: unlink d5/d18/f24 0 2024-08-19T00:56:13.802 INFO:tasks.workunit.client.1.smithi086.stdout:2/761: write d8/d24/d32/d61/ffc [195245,1346] 0 2024-08-19T00:56:13.803 INFO:tasks.workunit.client.1.smithi086.stdout:4/729: symlink d2/d18/d33/d42/d72/d78/de6/lf5 0 2024-08-19T00:56:13.805 INFO:tasks.workunit.client.1.smithi086.stdout:6/772: chown db/c2d 4779 1 2024-08-19T00:56:13.805 INFO:tasks.workunit.client.0.smithi017.stdout:2/350: mknod d2/c72 0 2024-08-19T00:56:13.806 INFO:tasks.workunit.client.0.smithi017.stdout:2/351: dread - d2/d7/d29/f68 zero size 2024-08-19T00:56:13.807 INFO:tasks.workunit.client.0.smithi017.stdout:2/352: write d2/d7/d29/f5d [1941400,97669] 0 2024-08-19T00:56:13.807 INFO:tasks.workunit.client.0.smithi017.stdout:7/340: rmdir d3/dc/df/d37/d46 39 2024-08-19T00:56:13.809 INFO:tasks.workunit.client.0.smithi017.stdout:2/353: truncate d2/d7/f6d 817955 0 2024-08-19T00:56:13.810 INFO:tasks.workunit.client.1.smithi086.stdout:1/847: write d4/d7/d2a/d6e/d95/db9/fe9 [263053,63098] 0 2024-08-19T00:56:13.813 INFO:tasks.workunit.client.1.smithi086.stdout:6/773: dwrite db/d37/d44/d5a/d78/fee [0,4194304] 0 2024-08-19T00:56:13.813 INFO:tasks.workunit.client.1.smithi086.stdout:2/762: fsync d8/d14/f72 0 2024-08-19T00:56:13.813 INFO:tasks.workunit.client.0.smithi017.stdout:7/341: dread d3/dc/df/d32/f54 [4194304,4194304] 0 2024-08-19T00:56:13.816 INFO:tasks.workunit.client.0.smithi017.stdout:6/276: creat d5/d13/d11/f5c x:0 0 0 2024-08-19T00:56:13.816 INFO:tasks.workunit.client.1.smithi086.stdout:5/748: sync 2024-08-19T00:56:13.820 INFO:tasks.workunit.client.0.smithi017.stdout:0/242: link d5/d17/d21/d39/l49 d5/d17/d21/l4b 0 2024-08-19T00:56:13.820 INFO:tasks.workunit.client.0.smithi017.stdout:0/243: dread - d5/f48 zero size 2024-08-19T00:56:13.821 INFO:tasks.workunit.client.1.smithi086.stdout:7/752: write d3/d34/d44/d58/d4b/da5/f67 [3527040,49052] 0 2024-08-19T00:56:13.821 INFO:tasks.workunit.client.0.smithi017.stdout:0/244: write d5/fa [4486243,52393] 0 2024-08-19T00:56:13.822 INFO:tasks.workunit.client.0.smithi017.stdout:6/277: symlink d5/d13/d20/l5d 0 2024-08-19T00:56:13.822 INFO:tasks.workunit.client.0.smithi017.stdout:0/245: dread - d5/f48 zero size 2024-08-19T00:56:13.822 INFO:tasks.workunit.client.1.smithi086.stdout:2/763: dread - d8/d43/fac zero size 2024-08-19T00:56:13.823 INFO:tasks.workunit.client.0.smithi017.stdout:6/278: write d5/d13/f1f [538138,20995] 0 2024-08-19T00:56:13.823 INFO:tasks.workunit.client.0.smithi017.stdout:2/354: symlink d2/d7/d10/d3b/l73 0 2024-08-19T00:56:13.824 INFO:tasks.workunit.client.1.smithi086.stdout:3/748: truncate d3/d18/d61/d85/fbf 28847 0 2024-08-19T00:56:13.824 INFO:tasks.workunit.client.1.smithi086.stdout:1/848: dread d4/d1e/f48 [0,4194304] 0 2024-08-19T00:56:13.828 INFO:tasks.workunit.client.1.smithi086.stdout:0/761: getdents da/d5d 0 2024-08-19T00:56:13.828 INFO:tasks.workunit.client.0.smithi017.stdout:0/246: creat d5/d18/f4c x:0 0 0 2024-08-19T00:56:13.830 INFO:tasks.workunit.client.1.smithi086.stdout:8/735: dread dc/d1f/d37/d4f/dac/db8/d7a/d9b/f3d [0,4194304] 0 2024-08-19T00:56:13.830 INFO:tasks.workunit.client.1.smithi086.stdout:2/764: mkdir d8/d24/d32/d4d/d6a/dfe 0 2024-08-19T00:56:13.831 INFO:tasks.workunit.client.0.smithi017.stdout:6/279: write d5/d13/d11/d2c/f38 [4021827,23119] 0 2024-08-19T00:56:13.831 INFO:tasks.workunit.client.1.smithi086.stdout:2/765: write d8/d2c/d38/d80/dca/df9/ffa [48573,66616] 0 2024-08-19T00:56:13.833 INFO:tasks.workunit.client.0.smithi017.stdout:2/355: rename d2/d7/d10/d19/cf to d2/d7/d29/c74 0 2024-08-19T00:56:13.833 INFO:tasks.workunit.client.0.smithi017.stdout:2/356: stat d2/d7/d10/d3b/d54/f61 0 2024-08-19T00:56:13.834 INFO:tasks.workunit.client.1.smithi086.stdout:9/763: truncate db/d26/d5c/d68/f6f 3667944 0 2024-08-19T00:56:13.834 INFO:tasks.workunit.client.0.smithi017.stdout:2/357: chown d2/d7/d10/d35/c36 105 1 2024-08-19T00:56:13.835 INFO:tasks.workunit.client.1.smithi086.stdout:1/849: symlink d4/d7/d2a/d36/db6/l115 0 2024-08-19T00:56:13.836 INFO:tasks.workunit.client.1.smithi086.stdout:1/850: read d4/d7/d2a/f33 [159354,5467] 0 2024-08-19T00:56:13.837 INFO:tasks.workunit.client.0.smithi017.stdout:0/247: symlink d5/d17/d45/l4d 0 2024-08-19T00:56:13.838 INFO:tasks.workunit.client.0.smithi017.stdout:8/211: dread de/d15/f1e [0,4194304] 0 2024-08-19T00:56:13.839 INFO:tasks.workunit.client.1.smithi086.stdout:4/730: rename d2/d18/d33/f36 to d2/d18/d33/d42/d72/d78/d25/d30/ff6 0 2024-08-19T00:56:13.840 INFO:tasks.workunit.client.1.smithi086.stdout:9/764: dread - db/dd/d19/d18/fad zero size 2024-08-19T00:56:13.840 INFO:tasks.workunit.client.0.smithi017.stdout:0/248: truncate d5/d18/f23 1351681 0 2024-08-19T00:56:13.841 INFO:tasks.workunit.client.0.smithi017.stdout:0/249: fsync d5/d17/d26/d30/f38 0 2024-08-19T00:56:13.842 INFO:tasks.workunit.client.0.smithi017.stdout:0/250: readlink d5/l7 0 2024-08-19T00:56:13.842 INFO:tasks.workunit.client.1.smithi086.stdout:9/765: dread - db/d26/d5c/d87/d6d/d9f/fd2 zero size 2024-08-19T00:56:13.842 INFO:tasks.workunit.client.1.smithi086.stdout:1/851: mkdir d4/d7/d2a/d36/d50/d116 0 2024-08-19T00:56:13.843 INFO:tasks.workunit.client.1.smithi086.stdout:2/766: getdents d8/d24/d32/d4d/d6a/dfe 0 2024-08-19T00:56:13.843 INFO:tasks.workunit.client.0.smithi017.stdout:0/251: write d5/d17/d21/d39/f44 [350504,50899] 0 2024-08-19T00:56:13.843 INFO:tasks.workunit.client.0.smithi017.stdout:2/358: truncate d2/d7/d10/f47 3372925 0 2024-08-19T00:56:13.845 INFO:tasks.workunit.client.1.smithi086.stdout:7/753: rename d3/de/d68/d72/d7e/f92 to d3/d34/d44/d58/d4b/d78/d9a/ffa 0 2024-08-19T00:56:13.846 INFO:tasks.workunit.client.1.smithi086.stdout:8/736: creat dc/fef x:0 0 0 2024-08-19T00:56:13.847 INFO:tasks.workunit.client.1.smithi086.stdout:9/766: creat db/d26/d5c/d87/d30/d32/d44/dc1/ff5 x:0 0 0 2024-08-19T00:56:13.847 INFO:tasks.workunit.client.0.smithi017.stdout:0/252: mknod d5/d17/d21/c4e 0 2024-08-19T00:56:13.848 INFO:tasks.workunit.client.1.smithi086.stdout:0/762: dread da/d14/d1a/f52 [0,4194304] 0 2024-08-19T00:56:13.848 INFO:tasks.workunit.client.1.smithi086.stdout:9/767: readlink db/d26/d5c/d87/d30/d3f/d43/d4e/l9a 0 2024-08-19T00:56:13.848 INFO:tasks.workunit.client.1.smithi086.stdout:1/852: mkdir d4/d7/d2a/d36/d3a/de5/d7a/db4/df0/d117 0 2024-08-19T00:56:13.849 INFO:tasks.workunit.client.0.smithi017.stdout:8/212: creat de/f37 x:0 0 0 2024-08-19T00:56:13.850 INFO:tasks.workunit.client.0.smithi017.stdout:2/359: rmdir d2/d7/d10/d35/d55 39 2024-08-19T00:56:13.851 INFO:tasks.workunit.client.0.smithi017.stdout:0/253: mknod d5/d17/d21/d42/c4f 0 2024-08-19T00:56:13.852 INFO:tasks.workunit.client.0.smithi017.stdout:8/213: symlink de/d36/l38 0 2024-08-19T00:56:13.853 INFO:tasks.workunit.client.0.smithi017.stdout:2/360: mknod d2/d7/d10/d19/c75 0 2024-08-19T00:56:13.854 INFO:tasks.workunit.client.0.smithi017.stdout:2/361: chown d2/d7/d10/d19/f27 4 1 2024-08-19T00:56:13.854 INFO:tasks.workunit.client.1.smithi086.stdout:3/749: rename d3/d18/d19/dbc/fdf to d3/d18/d19/dbc/db8/dc1/ff7 0 2024-08-19T00:56:13.855 INFO:tasks.workunit.client.0.smithi017.stdout:0/254: unlink d5/d17/d21/l31 0 2024-08-19T00:56:13.857 INFO:tasks.workunit.client.1.smithi086.stdout:0/763: symlink da/d14/d1a/d2e/d39/d3b/lf5 0 2024-08-19T00:56:13.858 INFO:tasks.workunit.client.1.smithi086.stdout:0/764: stat da/d14/d1a/d2e/d66/cc6 0 2024-08-19T00:56:13.859 INFO:tasks.workunit.client.1.smithi086.stdout:2/767: creat d8/d43/dd5/fff x:0 0 0 2024-08-19T00:56:13.859 INFO:tasks.workunit.client.1.smithi086.stdout:2/768: stat d8/c17 0 2024-08-19T00:56:13.860 INFO:tasks.workunit.client.0.smithi017.stdout:0/255: read d5/f10 [1082461,96009] 0 2024-08-19T00:56:13.861 INFO:tasks.workunit.client.0.smithi017.stdout:8/214: mkdir de/d15/d39 0 2024-08-19T00:56:13.861 INFO:tasks.workunit.client.0.smithi017.stdout:2/362: dwrite d2/d7/d10/d19/f1d [0,4194304] 0 2024-08-19T00:56:13.861 INFO:tasks.workunit.client.1.smithi086.stdout:2/769: read d8/d2c/d47/f6d [88635,81436] 0 2024-08-19T00:56:13.862 INFO:tasks.workunit.client.0.smithi017.stdout:0/256: fdatasync d5/f48 0 2024-08-19T00:56:13.862 INFO:tasks.workunit.client.1.smithi086.stdout:2/770: write d8/ff [1111035,29731] 0 2024-08-19T00:56:13.862 INFO:tasks.workunit.client.0.smithi017.stdout:8/215: read de/f12 [4682607,91780] 0 2024-08-19T00:56:13.863 INFO:tasks.workunit.client.0.smithi017.stdout:0/257: fdatasync d5/fc 0 2024-08-19T00:56:13.863 INFO:tasks.workunit.client.0.smithi017.stdout:8/216: truncate de/f34 853809 0 2024-08-19T00:56:13.864 INFO:tasks.workunit.client.1.smithi086.stdout:8/737: rename dc/d17/d1e/d82 to dc/d1f/df0 0 2024-08-19T00:56:13.865 INFO:tasks.workunit.client.1.smithi086.stdout:8/738: chown dc/d1f/d37/f72 51967 1 2024-08-19T00:56:13.865 INFO:tasks.workunit.client.1.smithi086.stdout:7/754: mkdir d3/d34/d44/d58/d4b/da5/daf/de7/df5/d96/dfb 0 2024-08-19T00:56:13.870 INFO:tasks.workunit.client.1.smithi086.stdout:2/771: mkdir d8/d24/d32/d4d/d6a/d100 0 2024-08-19T00:56:13.871 INFO:tasks.workunit.client.1.smithi086.stdout:2/772: dread - d8/d24/d32/d4d/d6a/fc6 zero size 2024-08-19T00:56:13.872 INFO:tasks.workunit.client.0.smithi017.stdout:0/258: mkdir d5/d17/d45/d50 0 2024-08-19T00:56:13.873 INFO:tasks.workunit.client.1.smithi086.stdout:7/755: fsync d3/d34/d44/d58/d4b/f61 0 2024-08-19T00:56:13.873 INFO:tasks.workunit.client.1.smithi086.stdout:7/756: fdatasync d3/d34/d44/d58/d4b/da5/f56 0 2024-08-19T00:56:13.874 INFO:tasks.workunit.client.1.smithi086.stdout:7/757: chown d3/d34/d44/d58/d4b/da5 2 1 2024-08-19T00:56:13.875 INFO:tasks.workunit.client.0.smithi017.stdout:8/217: symlink de/d15/l3a 0 2024-08-19T00:56:13.875 INFO:tasks.workunit.client.0.smithi017.stdout:8/218: chown de/d36/c21 27326 1 2024-08-19T00:56:13.876 INFO:tasks.workunit.client.1.smithi086.stdout:9/768: rename db/f20 to db/d26/d5c/d87/d30/d32/d44/d67/ff6 0 2024-08-19T00:56:13.877 INFO:tasks.workunit.client.1.smithi086.stdout:2/773: truncate d8/d24/f59 4663817 0 2024-08-19T00:56:13.877 INFO:tasks.workunit.client.1.smithi086.stdout:2/774: chown d8/d2c/d67 0 1 2024-08-19T00:56:13.878 INFO:tasks.workunit.client.1.smithi086.stdout:0/765: link da/d14/d55/ld8 da/d14/d1a/dc8/lf6 0 2024-08-19T00:56:13.878 INFO:tasks.workunit.client.1.smithi086.stdout:0/766: readlink da/d14/la0 0 2024-08-19T00:56:13.879 INFO:tasks.workunit.client.0.smithi017.stdout:8/219: creat de/d15/f3b x:0 0 0 2024-08-19T00:56:13.881 INFO:tasks.workunit.client.1.smithi086.stdout:1/853: rename d4/d7/d2a/d36/d61/c106 to d4/d7/d2a/d6e/c118 0 2024-08-19T00:56:13.881 INFO:tasks.workunit.client.1.smithi086.stdout:2/775: rmdir d8/d2c/d38/d96 39 2024-08-19T00:56:13.882 INFO:tasks.workunit.client.0.smithi017.stdout:8/220: fsync de/f12 0 2024-08-19T00:56:13.882 INFO:tasks.workunit.client.1.smithi086.stdout:1/854: stat d4/d7/d2a/d36/d3a/de5/l79 0 2024-08-19T00:56:13.882 INFO:tasks.workunit.client.1.smithi086.stdout:0/767: rmdir da/d14/d1a/d2e/d39/d3b/d89/dc5 39 2024-08-19T00:56:13.883 INFO:tasks.workunit.client.1.smithi086.stdout:2/776: write d8/d14/dae/ff5 [1314837,38277] 0 2024-08-19T00:56:13.883 INFO:tasks.workunit.client.1.smithi086.stdout:7/758: mknod d3/d34/d44/d58/d4b/da5/ded/cfc 0 2024-08-19T00:56:13.883 INFO:tasks.workunit.client.1.smithi086.stdout:2/777: fdatasync d8/d2c/d38/d80/fce 0 2024-08-19T00:56:13.884 INFO:tasks.workunit.client.1.smithi086.stdout:9/769: rename db/d26/l4b to db/d26/d5c/d87/d6d/d9f/lf7 0 2024-08-19T00:56:13.884 INFO:tasks.workunit.client.1.smithi086.stdout:2/778: chown d8/d2c/d38/d80/dca/df9 5276 1 2024-08-19T00:56:13.885 INFO:tasks.workunit.client.0.smithi017.stdout:8/221: readlink de/d15/l1c 0 2024-08-19T00:56:13.886 INFO:tasks.workunit.client.1.smithi086.stdout:7/759: readlink d3/d34/d44/d58/d4b/da5/l47 0 2024-08-19T00:56:13.887 INFO:tasks.workunit.client.1.smithi086.stdout:2/779: mkdir d8/d84/d101 0 2024-08-19T00:56:13.889 INFO:tasks.workunit.client.1.smithi086.stdout:9/770: creat db/d26/d5c/d87/d6d/deb/ff8 x:0 0 0 2024-08-19T00:56:13.889 INFO:tasks.workunit.client.1.smithi086.stdout:7/760: creat d3/d34/d44/d58/d4b/dcd/ffd x:0 0 0 2024-08-19T00:56:13.890 INFO:tasks.workunit.client.1.smithi086.stdout:2/780: symlink d8/d2c/d38/l102 0 2024-08-19T00:56:13.890 INFO:tasks.workunit.client.1.smithi086.stdout:0/768: getdents da/d5d/da9/d6a 0 2024-08-19T00:56:13.891 INFO:tasks.workunit.client.1.smithi086.stdout:0/769: dread da/d5d/f95 [0,4194304] 0 2024-08-19T00:56:13.892 INFO:tasks.workunit.client.1.smithi086.stdout:7/761: truncate d3/d34/d44/f37 147619 0 2024-08-19T00:56:13.892 INFO:tasks.workunit.client.1.smithi086.stdout:2/781: creat d8/d2c/d38/d96/f103 x:0 0 0 2024-08-19T00:56:13.893 INFO:tasks.workunit.client.1.smithi086.stdout:0/770: mkdir da/d5d/df7 0 2024-08-19T00:56:13.925 INFO:tasks.workunit.client.1.smithi086.stdout:0/771: mkdir da/d5d/df8 0 2024-08-19T00:56:13.925 INFO:tasks.workunit.client.1.smithi086.stdout:2/782: creat d8/d43/d77/dcc/f104 x:0 0 0 2024-08-19T00:56:13.925 INFO:tasks.workunit.client.1.smithi086.stdout:6/774: sync 2024-08-19T00:56:13.926 INFO:tasks.workunit.client.1.smithi086.stdout:6/775: write db/f2b [2466648,31943] 0 2024-08-19T00:56:13.927 INFO:tasks.workunit.client.1.smithi086.stdout:0/772: readlink da/d14/d1a/d2e/d39/d3b/d4e/dbe/laa 0 2024-08-19T00:56:13.927 INFO:tasks.workunit.client.1.smithi086.stdout:2/783: fdatasync d8/d43/fac 0 2024-08-19T00:56:13.927 INFO:tasks.workunit.client.1.smithi086.stdout:0/773: chown da/d14/d44 290023 1 2024-08-19T00:56:13.929 INFO:tasks.workunit.client.1.smithi086.stdout:6/776: creat db/d37/df3/ff9 x:0 0 0 2024-08-19T00:56:13.929 INFO:tasks.workunit.client.1.smithi086.stdout:2/784: readlink d8/d14/l56 0 2024-08-19T00:56:13.930 INFO:tasks.workunit.client.1.smithi086.stdout:6/777: dread - db/d37/d44/d5a/d8f/ff6 zero size 2024-08-19T00:56:13.932 INFO:tasks.workunit.client.1.smithi086.stdout:6/778: mkdir db/d37/d28/d7f/d96/dc2/dfa 0 2024-08-19T00:56:13.934 INFO:tasks.workunit.client.1.smithi086.stdout:7/762: dread d3/f3a [0,4194304] 0 2024-08-19T00:56:13.935 INFO:tasks.workunit.client.1.smithi086.stdout:6/779: unlink db/d37/d30/c5e 0 2024-08-19T00:56:13.936 INFO:tasks.workunit.client.1.smithi086.stdout:6/780: write db/f3e [411419,104846] 0 2024-08-19T00:56:13.936 INFO:tasks.workunit.client.1.smithi086.stdout:7/763: chown d3/d34/d44/d58/d4b/d42/cd6 4277 1 2024-08-19T00:56:13.938 INFO:tasks.workunit.client.1.smithi086.stdout:7/764: write d3/d34/d44/d58/d4b/da5/daf/de7/df5/f86 [5152362,94141] 0 2024-08-19T00:56:13.951 INFO:tasks.workunit.client.1.smithi086.stdout:7/765: dread d3/d34/d44/d58/d4b/f6d [0,4194304] 0 2024-08-19T00:56:13.952 INFO:tasks.workunit.client.1.smithi086.stdout:7/766: chown d3/de/d68/d72/d7e/dca/dcb/fec 1325553011 1 2024-08-19T00:56:13.972 INFO:tasks.workunit.client.0.smithi017.stdout:0/259: read d5/d17/d26/d30/f33 [246967,15089] 0 2024-08-19T00:56:13.973 INFO:tasks.workunit.client.0.smithi017.stdout:0/260: write d5/d17/f1a [6999493,47618] 0 2024-08-19T00:56:13.976 INFO:tasks.workunit.client.0.smithi017.stdout:0/261: symlink d5/d17/d45/d50/l51 0 2024-08-19T00:56:13.981 INFO:tasks.workunit.client.0.smithi017.stdout:0/262: rename d5/lf to d5/d17/d45/d50/l52 0 2024-08-19T00:56:13.982 INFO:tasks.workunit.client.0.smithi017.stdout:0/263: dread - d5/d17/d2b/f3f zero size 2024-08-19T00:56:13.983 INFO:tasks.workunit.client.0.smithi017.stdout:0/264: dread - d5/d17/d2b/f43 zero size 2024-08-19T00:56:13.987 INFO:tasks.workunit.client.0.smithi017.stdout:0/265: creat d5/d17/d21/d42/f53 x:0 0 0 2024-08-19T00:56:13.988 INFO:tasks.workunit.client.0.smithi017.stdout:0/266: dread - d5/d17/d2b/f3f zero size 2024-08-19T00:56:13.992 INFO:tasks.workunit.client.0.smithi017.stdout:6/280: truncate d5/d13/d11/f33 848980 0 2024-08-19T00:56:13.994 INFO:tasks.workunit.client.0.smithi017.stdout:6/281: mkdir d5/d13/d20/d5e 0 2024-08-19T00:56:14.001 INFO:tasks.workunit.client.0.smithi017.stdout:6/282: dread d5/d13/f1b [0,4194304] 0 2024-08-19T00:56:14.001 INFO:tasks.workunit.client.0.smithi017.stdout:6/283: fdatasync d5/d13/f1f 0 2024-08-19T00:56:14.005 INFO:tasks.workunit.client.1.smithi086.stdout:4/731: truncate d2/f1b 7553168 0 2024-08-19T00:56:14.008 INFO:tasks.workunit.client.0.smithi017.stdout:9/303: sync 2024-08-19T00:56:14.008 INFO:tasks.workunit.client.0.smithi017.stdout:5/246: sync 2024-08-19T00:56:14.009 INFO:tasks.workunit.client.0.smithi017.stdout:1/269: sync 2024-08-19T00:56:14.009 INFO:tasks.workunit.client.0.smithi017.stdout:3/342: sync 2024-08-19T00:56:14.009 INFO:tasks.workunit.client.0.smithi017.stdout:6/284: dwrite d5/d13/d11/f5c [0,4194304] 0 2024-08-19T00:56:14.015 INFO:tasks.workunit.client.0.smithi017.stdout:5/247: unlink db/f34 0 2024-08-19T00:56:14.015 INFO:tasks.workunit.client.0.smithi017.stdout:9/304: truncate d0/d33/d22/f44 556124 0 2024-08-19T00:56:14.016 INFO:tasks.workunit.client.1.smithi086.stdout:5/749: sync 2024-08-19T00:56:14.016 INFO:tasks.workunit.client.1.smithi086.stdout:3/750: sync 2024-08-19T00:56:14.017 INFO:tasks.workunit.client.1.smithi086.stdout:5/750: readlink d0/d8/d72/l7b 0 2024-08-19T00:56:14.021 INFO:tasks.workunit.client.1.smithi086.stdout:3/751: fsync d3/d18/d27/d49/d3f/f9a 0 2024-08-19T00:56:14.022 INFO:tasks.workunit.client.1.smithi086.stdout:8/739: truncate dc/d16/dc7/d2e/d28/d2b/f38 3909204 0 2024-08-19T00:56:14.023 INFO:tasks.workunit.client.1.smithi086.stdout:5/751: creat d0/d8/d94/fe6 x:0 0 0 2024-08-19T00:56:14.024 INFO:tasks.workunit.client.0.smithi017.stdout:2/363: dwrite d2/d7/dd/f15 [0,4194304] 0 2024-08-19T00:56:14.024 INFO:tasks.workunit.client.1.smithi086.stdout:5/752: write d0/df/d1f/f27 [4541011,20989] 0 2024-08-19T00:56:14.025 INFO:tasks.workunit.client.0.smithi017.stdout:3/343: dwrite d5/da/d27/f4c [0,4194304] 0 2024-08-19T00:56:14.027 INFO:tasks.workunit.client.0.smithi017.stdout:9/305: chown d0/d33/d22/l43 4173983 1 2024-08-19T00:56:14.028 INFO:tasks.workunit.client.0.smithi017.stdout:1/270: dwrite d4/d1c/f46 [0,4194304] 0 2024-08-19T00:56:14.028 INFO:tasks.workunit.client.0.smithi017.stdout:8/222: write de/f12 [6381087,124543] 0 2024-08-19T00:56:14.029 INFO:tasks.workunit.client.0.smithi017.stdout:2/364: chown d2/d7/dd/f2f 26 1 2024-08-19T00:56:14.032 INFO:tasks.workunit.client.0.smithi017.stdout:5/248: creat db/d19/d33/f5b x:0 0 0 2024-08-19T00:56:14.032 INFO:tasks.workunit.client.0.smithi017.stdout:8/223: readlink de/d15/l1a 0 2024-08-19T00:56:14.033 INFO:tasks.workunit.client.0.smithi017.stdout:1/271: write d4/d1c/f46 [3243968,1585] 0 2024-08-19T00:56:14.036 INFO:tasks.workunit.client.1.smithi086.stdout:3/752: truncate d3/d9/f4c 2121430 0 2024-08-19T00:56:14.037 INFO:tasks.workunit.client.1.smithi086.stdout:3/753: stat d3/d26/fbd 0 2024-08-19T00:56:14.038 INFO:tasks.workunit.client.0.smithi017.stdout:1/272: fdatasync d4/d1c/f25 0 2024-08-19T00:56:14.040 INFO:tasks.workunit.client.0.smithi017.stdout:3/344: fdatasync d5/d15/f21 0 2024-08-19T00:56:14.042 INFO:tasks.workunit.client.1.smithi086.stdout:5/753: readlink d0/d5f/d60/d57/la7 0 2024-08-19T00:56:14.042 INFO:tasks.workunit.client.0.smithi017.stdout:3/345: truncate d5/d15/d1b/f58 492770 0 2024-08-19T00:56:14.048 INFO:tasks.workunit.client.0.smithi017.stdout:5/249: write db/f2e [3762605,109605] 0 2024-08-19T00:56:14.048 INFO:tasks.workunit.client.1.smithi086.stdout:1/855: rename d4/d7/d2a/d6e/c118 to d4/d7/d2a/d36/d3a/de5/c119 0 2024-08-19T00:56:14.049 INFO:tasks.workunit.client.1.smithi086.stdout:8/740: creat dc/d1f/d37/d4f/dac/db8/de7/ff1 x:0 0 0 2024-08-19T00:56:14.049 INFO:tasks.workunit.client.0.smithi017.stdout:5/250: dread - db/d19/d33/f5b zero size 2024-08-19T00:56:14.050 INFO:tasks.workunit.client.1.smithi086.stdout:1/856: readlink d4/d7/d2a/d6e/d95/db9/le2 0 2024-08-19T00:56:14.050 INFO:tasks.workunit.client.1.smithi086.stdout:3/754: symlink d3/d18/d19/dbc/db8/dc9/lf8 0 2024-08-19T00:56:14.054 INFO:tasks.workunit.client.0.smithi017.stdout:6/285: getdents d5/d13/d11/d2c/d4a 0 2024-08-19T00:56:14.054 INFO:tasks.workunit.client.1.smithi086.stdout:0/774: truncate da/d5d/f7a 3236602 0 2024-08-19T00:56:14.055 INFO:tasks.workunit.client.0.smithi017.stdout:6/286: read d5/d13/f14 [2474983,31155] 0 2024-08-19T00:56:14.056 INFO:tasks.workunit.client.0.smithi017.stdout:9/306: mkdir d0/d33/d22/d5a 0 2024-08-19T00:56:14.057 INFO:tasks.workunit.client.0.smithi017.stdout:9/307: dread - d0/d33/d22/f4c zero size 2024-08-19T00:56:14.057 INFO:tasks.workunit.client.1.smithi086.stdout:9/771: sync 2024-08-19T00:56:14.061 INFO:tasks.workunit.client.0.smithi017.stdout:8/224: fdatasync f0 0 2024-08-19T00:56:14.062 INFO:tasks.workunit.client.1.smithi086.stdout:9/772: dwrite db/d96/da7/ff2 [0,4194304] 0 2024-08-19T00:56:14.063 INFO:tasks.workunit.client.0.smithi017.stdout:5/251: creat db/d19/d1f/d15/d30/f5c x:0 0 0 2024-08-19T00:56:14.067 INFO:tasks.workunit.client.0.smithi017.stdout:6/287: symlink d5/d13/d11/d2c/d4a/l5f 0 2024-08-19T00:56:14.071 INFO:tasks.workunit.client.0.smithi017.stdout:0/267: write d5/d17/d21/d42/f1d [990396,120009] 0 2024-08-19T00:56:14.075 INFO:tasks.workunit.client.0.smithi017.stdout:3/346: truncate d5/d15/f21 1076752 0 2024-08-19T00:56:14.077 INFO:tasks.workunit.client.0.smithi017.stdout:6/288: dwrite d5/d13/d11/fa [0,4194304] 0 2024-08-19T00:56:14.080 INFO:tasks.workunit.client.1.smithi086.stdout:4/732: write d2/d18/d33/d42/d72/d78/f67 [891034,120112] 0 2024-08-19T00:56:14.082 INFO:tasks.workunit.client.1.smithi086.stdout:4/733: write d2/d18/d33/d42/d72/f16 [8617107,7320] 0 2024-08-19T00:56:14.084 INFO:tasks.workunit.client.1.smithi086.stdout:4/734: chown d2/d18/ce8 10804 1 2024-08-19T00:56:14.092 INFO:tasks.workunit.client.0.smithi017.stdout:3/347: rmdir d5/d15/d53 39 2024-08-19T00:56:14.095 INFO:tasks.workunit.client.0.smithi017.stdout:6/289: creat d5/f60 x:0 0 0 2024-08-19T00:56:14.098 INFO:tasks.workunit.client.0.smithi017.stdout:9/308: link d0/d33/f30 d0/f5b 0 2024-08-19T00:56:14.099 INFO:tasks.workunit.client.1.smithi086.stdout:7/767: sync 2024-08-19T00:56:14.099 INFO:tasks.workunit.client.1.smithi086.stdout:2/785: sync 2024-08-19T00:56:14.100 INFO:tasks.workunit.client.1.smithi086.stdout:2/786: write d8/d2c/d38/d80/db4/db7/fe3 [2915684,118485] 0 2024-08-19T00:56:14.102 INFO:tasks.workunit.client.0.smithi017.stdout:9/309: dread d0/d58/f3e [0,4194304] 0 2024-08-19T00:56:14.103 INFO:tasks.workunit.client.0.smithi017.stdout:5/252: creat db/d19/d1f/d15/f5d x:0 0 0 2024-08-19T00:56:14.108 INFO:tasks.workunit.client.0.smithi017.stdout:9/310: dread d0/d33/f4d [0,4194304] 0 2024-08-19T00:56:14.109 INFO:tasks.workunit.client.0.smithi017.stdout:2/365: write d2/d7/d10/d19/f41 [250924,109551] 0 2024-08-19T00:56:14.110 INFO:tasks.workunit.client.0.smithi017.stdout:9/311: truncate d0/d33/f30 640628 0 2024-08-19T00:56:14.110 INFO:tasks.workunit.client.0.smithi017.stdout:5/253: creat db/d19/d1f/d15/d30/f5e x:0 0 0 2024-08-19T00:56:14.115 INFO:tasks.workunit.client.0.smithi017.stdout:3/348: dread d5/da/fd [0,4194304] 0 2024-08-19T00:56:14.115 INFO:tasks.workunit.client.0.smithi017.stdout:2/366: dwrite d2/d7/d44/f57 [0,4194304] 0 2024-08-19T00:56:14.116 INFO:tasks.workunit.client.0.smithi017.stdout:3/349: stat d5/da/d3c/l41 0 2024-08-19T00:56:14.118 INFO:tasks.workunit.client.0.smithi017.stdout:9/312: unlink d0/d33/d22/f2c 0 2024-08-19T00:56:14.119 INFO:tasks.workunit.client.0.smithi017.stdout:9/313: chown d0/d33/d22/f44 6884503 1 2024-08-19T00:56:14.122 INFO:tasks.workunit.client.0.smithi017.stdout:9/314: chown d0/f47 418198 1 2024-08-19T00:56:14.122 INFO:tasks.workunit.client.0.smithi017.stdout:5/254: mkdir db/d19/d1f/d15/d1e/d5f 0 2024-08-19T00:56:14.122 INFO:tasks.workunit.client.0.smithi017.stdout:2/367: rmdir d2 39 2024-08-19T00:56:14.127 INFO:tasks.workunit.client.1.smithi086.stdout:6/781: rename db/d37/d44/d5a/d8f/ca4 to db/d37/d28/d7f/d96/dd9/cfb 0 2024-08-19T00:56:14.129 INFO:tasks.workunit.client.1.smithi086.stdout:1/857: symlink d4/d7/d2a/d6e/d95/db9/deb/l11a 0 2024-08-19T00:56:14.131 INFO:tasks.workunit.client.1.smithi086.stdout:3/755: creat d3/d26/dba/ff9 x:0 0 0 2024-08-19T00:56:14.132 INFO:tasks.workunit.client.1.smithi086.stdout:3/756: write d3/d18/d27/d49/d3f/f47 [3388481,123348] 0 2024-08-19T00:56:14.134 INFO:tasks.workunit.client.1.smithi086.stdout:0/775: unlink da/d14/d26/fb1 0 2024-08-19T00:56:14.135 INFO:tasks.workunit.client.1.smithi086.stdout:0/776: readlink l5 0 2024-08-19T00:56:14.135 INFO:tasks.workunit.client.1.smithi086.stdout:0/777: chown da/d5d/df7 14973 1 2024-08-19T00:56:14.135 INFO:tasks.workunit.client.0.smithi017.stdout:9/315: mkdir d0/d5c 0 2024-08-19T00:56:14.139 INFO:tasks.workunit.client.0.smithi017.stdout:2/368: symlink d2/d7/d10/d3b/d69/l76 0 2024-08-19T00:56:14.146 INFO:tasks.workunit.client.0.smithi017.stdout:0/268: dwrite d5/f1c [0,4194304] 0 2024-08-19T00:56:14.147 INFO:tasks.workunit.client.0.smithi017.stdout:5/255: getdents db/d19/d1f 0 2024-08-19T00:56:14.150 INFO:tasks.workunit.client.0.smithi017.stdout:9/316: dread d0/d33/f17 [0,4194304] 0 2024-08-19T00:56:14.151 INFO:tasks.workunit.client.0.smithi017.stdout:9/317: write d0/d33/d22/f4c [707567,107819] 0 2024-08-19T00:56:14.152 INFO:tasks.workunit.client.0.smithi017.stdout:5/256: creat db/d19/d1f/f60 x:0 0 0 2024-08-19T00:56:14.152 INFO:tasks.workunit.client.0.smithi017.stdout:9/318: readlink d0/d33/d22/l56 0 2024-08-19T00:56:14.156 INFO:tasks.workunit.client.0.smithi017.stdout:0/269: creat d5/d17/d26/d30/f54 x:0 0 0 2024-08-19T00:56:14.158 INFO:tasks.workunit.client.1.smithi086.stdout:2/787: unlink d8/d24/cdf 0 2024-08-19T00:56:14.158 INFO:tasks.workunit.client.1.smithi086.stdout:2/788: chown d8/d24/d32/d4d/d6a/d100 866820878 1 2024-08-19T00:56:14.159 INFO:tasks.workunit.client.0.smithi017.stdout:6/290: truncate d5/d13/d20/f56 735893 0 2024-08-19T00:56:14.160 INFO:tasks.workunit.client.0.smithi017.stdout:6/291: chown d5/d13/d20/f27 322107299 1 2024-08-19T00:56:14.161 INFO:tasks.workunit.client.0.smithi017.stdout:2/369: creat d2/f77 x:0 0 0 2024-08-19T00:56:14.162 INFO:tasks.workunit.client.0.smithi017.stdout:2/370: read d2/d7/dd/f15 [3414717,100278] 0 2024-08-19T00:56:14.163 INFO:tasks.workunit.client.0.smithi017.stdout:2/371: fsync d2/d7/d10/d3b/d54/f61 0 2024-08-19T00:56:14.164 INFO:tasks.workunit.client.0.smithi017.stdout:9/319: mkdir d0/d58/d49/d5d 0 2024-08-19T00:56:14.166 INFO:tasks.workunit.client.1.smithi086.stdout:5/754: creat d0/d2d/fe7 x:0 0 0 2024-08-19T00:56:14.166 INFO:tasks.workunit.client.1.smithi086.stdout:5/755: chown d0/df/d1f/f28 100246 1 2024-08-19T00:56:14.168 INFO:tasks.workunit.client.1.smithi086.stdout:3/757: read d3/d18/f1c [687110,20291] 0 2024-08-19T00:56:14.168 INFO:tasks.workunit.client.1.smithi086.stdout:3/758: readlink d3/d26/d2b/l74 0 2024-08-19T00:56:14.170 INFO:tasks.workunit.client.0.smithi017.stdout:5/257: creat db/d19/d57/f61 x:0 0 0 2024-08-19T00:56:14.178 INFO:tasks.workunit.client.0.smithi017.stdout:0/270: link d5/d17/d26/d30/f54 d5/d17/d21/f55 0 2024-08-19T00:56:14.178 INFO:tasks.workunit.client.0.smithi017.stdout:0/271: fdatasync d5/fa 0 2024-08-19T00:56:14.179 INFO:tasks.workunit.client.0.smithi017.stdout:0/272: dread - d5/d17/d2b/f3f zero size 2024-08-19T00:56:14.179 INFO:tasks.workunit.client.0.smithi017.stdout:6/292: symlink d5/d13/d11/l61 0 2024-08-19T00:56:14.179 INFO:tasks.workunit.client.1.smithi086.stdout:5/756: dread d0/df/d1f/f28 [0,4194304] 0 2024-08-19T00:56:14.179 INFO:tasks.workunit.client.1.smithi086.stdout:5/757: chown d0/d8/d10/f2b 100055 1 2024-08-19T00:56:14.180 INFO:tasks.workunit.client.1.smithi086.stdout:2/789: symlink d8/d2c/d38/d80/dca/l105 0 2024-08-19T00:56:14.184 INFO:tasks.workunit.client.0.smithi017.stdout:0/273: dread d5/d17/d21/d39/f44 [0,4194304] 0 2024-08-19T00:56:14.186 INFO:tasks.workunit.client.0.smithi017.stdout:0/274: dread - d5/d18/f4c zero size 2024-08-19T00:56:14.188 INFO:tasks.workunit.client.0.smithi017.stdout:0/275: dread - d5/d17/d26/d30/f54 zero size 2024-08-19T00:56:14.189 INFO:tasks.workunit.client.0.smithi017.stdout:9/320: mkdir d0/d33/d22/d5e 0 2024-08-19T00:56:14.190 INFO:tasks.workunit.client.1.smithi086.stdout:6/782: mknod db/d37/d41/dad/def/cfc 0 2024-08-19T00:56:14.191 INFO:tasks.workunit.client.1.smithi086.stdout:6/783: chown db/d37/d28/d7f/fda 747 1 2024-08-19T00:56:14.192 INFO:tasks.workunit.client.1.smithi086.stdout:6/784: chown db/d34/d4e/lb9 4100550 1 2024-08-19T00:56:14.210 INFO:tasks.workunit.client.1.smithi086.stdout:1/858: sync 2024-08-19T00:56:14.211 INFO:tasks.workunit.client.1.smithi086.stdout:6/785: dread db/d37/d30/fc9 [0,4194304] 0 2024-08-19T00:56:14.212 INFO:tasks.workunit.client.1.smithi086.stdout:3/759: mkdir d3/d18/d27/d49/d3f/d54/dfa 0 2024-08-19T00:56:14.213 INFO:tasks.workunit.client.1.smithi086.stdout:4/735: write d2/d18/d33/d42/d72/f96 [564550,105077] 0 2024-08-19T00:56:14.213 INFO:tasks.workunit.client.1.smithi086.stdout:2/790: dread d8/d24/d32/d61/f7e [0,4194304] 0 2024-08-19T00:56:14.213 INFO:tasks.workunit.client.1.smithi086.stdout:3/760: stat d3/d18/d1a/d51/dad/de9 0 2024-08-19T00:56:14.214 INFO:tasks.workunit.client.1.smithi086.stdout:5/758: fsync d0/d99/da2/fdd 0 2024-08-19T00:56:14.214 INFO:tasks.workunit.client.1.smithi086.stdout:7/768: dwrite d3/d34/d44/d58/d4b/da5/daf/de7/df5/f8e [0,4194304] 0 2024-08-19T00:56:14.215 INFO:tasks.workunit.client.1.smithi086.stdout:8/741: rename dc/d16/dc7/d2e/d28/dc4 to dc/d16/d18/df2 0 2024-08-19T00:56:14.215 INFO:tasks.workunit.client.0.smithi017.stdout:0/276: creat d5/d18/f56 x:0 0 0 2024-08-19T00:56:14.215 INFO:tasks.workunit.client.0.smithi017.stdout:2/372: creat d2/d7/d10/d35/d55/d65/d6b/f78 x:0 0 0 2024-08-19T00:56:14.215 INFO:tasks.workunit.client.0.smithi017.stdout:2/373: fdatasync d2/d7/d10/d3b/d3c/f3d 0 2024-08-19T00:56:14.215 INFO:tasks.workunit.client.0.smithi017.stdout:9/321: unlink d0/f15 0 2024-08-19T00:56:14.217 INFO:tasks.workunit.client.0.smithi017.stdout:0/277: creat d5/d17/f57 x:0 0 0 2024-08-19T00:56:14.219 INFO:tasks.workunit.client.1.smithi086.stdout:6/786: stat f3 0 2024-08-19T00:56:14.219 INFO:tasks.workunit.client.1.smithi086.stdout:6/787: read - db/d37/d28/d7f/d96/dc2/ff7 zero size 2024-08-19T00:56:14.219 INFO:tasks.workunit.client.1.smithi086.stdout:1/859: fsync d4/d7/d2a/d36/f6a 0 2024-08-19T00:56:14.219 INFO:tasks.workunit.client.1.smithi086.stdout:2/791: rmdir d8/d43/dd5 39 2024-08-19T00:56:14.222 INFO:tasks.workunit.client.0.smithi017.stdout:2/374: mknod d2/d7/d10/d3b/d3c/c79 0 2024-08-19T00:56:14.222 INFO:tasks.workunit.client.0.smithi017.stdout:0/278: rmdir d5/d17/d26/d30 39 2024-08-19T00:56:14.243 INFO:tasks.workunit.client.1.smithi086.stdout:2/792: write f2 [682966,45230] 0 2024-08-19T00:56:14.243 INFO:tasks.workunit.client.1.smithi086.stdout:9/773: write db/d26/d5c/d68/f6f [149598,85940] 0 2024-08-19T00:56:14.243 INFO:tasks.workunit.client.1.smithi086.stdout:0/778: write da/d14/f15 [1557734,20997] 0 2024-08-19T00:56:14.246 INFO:tasks.workunit.client.0.smithi017.stdout:0/279: chown d5/d17/d45/d50/l51 233 1 2024-08-19T00:56:14.247 INFO:tasks.workunit.client.0.smithi017.stdout:6/293: link d5/f36 d5/d13/d11/d2c/d51/f62 0 2024-08-19T00:56:14.247 INFO:tasks.workunit.client.0.smithi017.stdout:0/280: truncate d5/d18/f56 155023 0 2024-08-19T00:56:14.247 INFO:tasks.workunit.client.0.smithi017.stdout:6/294: write d5/d13/d20/f48 [274925,51228] 0 2024-08-19T00:56:14.247 INFO:tasks.workunit.client.0.smithi017.stdout:4/291: sync 2024-08-19T00:56:14.248 INFO:tasks.workunit.client.1.smithi086.stdout:5/759: symlink d0/d5f/d60/d57/d80/da3/le8 0 2024-08-19T00:56:14.248 INFO:tasks.workunit.client.1.smithi086.stdout:5/760: dwrite d0/d2d/d43/fc8 [0,4194304] 0 2024-08-19T00:56:14.248 INFO:tasks.workunit.client.1.smithi086.stdout:1/860: creat d4/d7/d2a/d36/d7d/d88/d56/f11b x:0 0 0 2024-08-19T00:56:14.248 INFO:tasks.workunit.client.0.smithi017.stdout:4/292: write d2/d11/f46 [3225643,57342] 0 2024-08-19T00:56:14.248 INFO:tasks.workunit.client.0.smithi017.stdout:6/295: symlink d5/d13/d11/d2c/l63 0 2024-08-19T00:56:14.248 INFO:tasks.workunit.client.0.smithi017.stdout:0/281: dread d5/d17/f1a [4194304,4194304] 0 2024-08-19T00:56:14.248 INFO:tasks.workunit.client.0.smithi017.stdout:6/296: rmdir d5/d13/d11/d2c 39 2024-08-19T00:56:14.249 INFO:tasks.workunit.client.0.smithi017.stdout:6/297: write d5/d13/d20/f56 [1442939,39793] 0 2024-08-19T00:56:14.250 INFO:tasks.workunit.client.1.smithi086.stdout:2/793: creat d8/d2c/d38/d80/dca/df9/f106 x:0 0 0 2024-08-19T00:56:14.253 INFO:tasks.workunit.client.1.smithi086.stdout:4/736: unlink d2/d18/d33/d42/d72/d78/d2c/fa9 0 2024-08-19T00:56:14.254 INFO:tasks.workunit.client.0.smithi017.stdout:2/375: dwrite d2/d7/d10/f11 [0,4194304] 0 2024-08-19T00:56:14.254 INFO:tasks.workunit.client.1.smithi086.stdout:7/769: write d3/de/d68/d72/fbb [1771113,52527] 0 2024-08-19T00:56:14.263 INFO:tasks.workunit.client.0.smithi017.stdout:2/376: readlink d2/d7/d10/d35/l5e 0 2024-08-19T00:56:14.266 INFO:tasks.workunit.client.1.smithi086.stdout:6/788: write db/f16 [2962328,81737] 0 2024-08-19T00:56:14.268 INFO:tasks.workunit.client.0.smithi017.stdout:4/293: creat d2/f61 x:0 0 0 2024-08-19T00:56:14.270 INFO:tasks.workunit.client.0.smithi017.stdout:4/294: read d2/d16/f5b [851375,125732] 0 2024-08-19T00:56:14.270 INFO:tasks.workunit.client.1.smithi086.stdout:6/789: truncate db/d37/d44/d5a/d8f/fd1 404909 0 2024-08-19T00:56:14.271 INFO:tasks.workunit.client.1.smithi086.stdout:6/790: stat db/d37/d44/d5a/d78/cd4 0 2024-08-19T00:56:14.272 INFO:tasks.workunit.client.0.smithi017.stdout:0/282: truncate d5/d18/f23 189890 0 2024-08-19T00:56:14.272 INFO:tasks.workunit.client.1.smithi086.stdout:0/779: write da/d14/d44/d49/fbc [87191,55582] 0 2024-08-19T00:56:14.272 INFO:tasks.workunit.client.1.smithi086.stdout:5/761: truncate d0/d8/f86 3114838 0 2024-08-19T00:56:14.273 INFO:tasks.workunit.client.0.smithi017.stdout:2/377: dread d2/d7/dd/f15 [0,4194304] 0 2024-08-19T00:56:14.273 INFO:tasks.workunit.client.1.smithi086.stdout:9/774: dwrite db/dd/d19/d18/fad [0,4194304] 0 2024-08-19T00:56:14.273 INFO:tasks.workunit.client.0.smithi017.stdout:6/298: mkdir d5/d13/d11/d2c/d4a/d64 0 2024-08-19T00:56:14.274 INFO:tasks.workunit.client.1.smithi086.stdout:9/775: write db/d26/d5c/d87/d30/d3f/fe9 [607884,65625] 0 2024-08-19T00:56:14.275 INFO:tasks.workunit.client.0.smithi017.stdout:6/299: write d5/d13/d11/d4d/f4e [1158132,117564] 0 2024-08-19T00:56:14.278 INFO:tasks.workunit.client.0.smithi017.stdout:4/295: rename d2/d21/d40/f41 to d2/d27/f62 0 2024-08-19T00:56:14.279 INFO:tasks.workunit.client.1.smithi086.stdout:1/861: rmdir d4/d10/d90/d98 39 2024-08-19T00:56:14.279 INFO:tasks.workunit.client.0.smithi017.stdout:0/283: dread d5/d17/d21/f2d [0,4194304] 0 2024-08-19T00:56:14.282 INFO:tasks.workunit.client.0.smithi017.stdout:2/378: mkdir d2/d7/d10/d3b/d69/d7a 0 2024-08-19T00:56:14.282 INFO:tasks.workunit.client.0.smithi017.stdout:4/296: fsync d2/d27/f62 0 2024-08-19T00:56:14.291 INFO:tasks.workunit.client.1.smithi086.stdout:6/791: rmdir db 39 2024-08-19T00:56:14.292 INFO:tasks.workunit.client.1.smithi086.stdout:8/742: link dc/d1f/d37/d4f/dac/db8/d8f/faf dc/ff3 0 2024-08-19T00:56:14.293 INFO:tasks.workunit.client.0.smithi017.stdout:4/297: write d2/f7 [8862828,61791] 0 2024-08-19T00:56:14.293 INFO:tasks.workunit.client.0.smithi017.stdout:0/284: fsync d5/f10 0 2024-08-19T00:56:14.295 INFO:tasks.workunit.client.1.smithi086.stdout:5/762: mkdir d0/df/d1f/d33/de9 0 2024-08-19T00:56:14.297 INFO:tasks.workunit.client.1.smithi086.stdout:9/776: rmdir db/d26/d5c/d87 39 2024-08-19T00:56:14.298 INFO:tasks.workunit.client.0.smithi017.stdout:4/298: dwrite d2/d16/f38 [0,4194304] 0 2024-08-19T00:56:14.298 INFO:tasks.workunit.client.1.smithi086.stdout:9/777: chown db/d26/d5c/d68/ca3 431 1 2024-08-19T00:56:14.298 INFO:tasks.workunit.client.1.smithi086.stdout:1/862: rename d4/d10/dde to d4/d7/d2a/d36/d50/d9c/ded/d11c 0 2024-08-19T00:56:14.298 INFO:tasks.workunit.client.1.smithi086.stdout:2/794: mknod d8/d14/c107 0 2024-08-19T00:56:14.299 INFO:tasks.workunit.client.0.smithi017.stdout:6/300: symlink d5/d13/d11/d2c/d4a/d64/l65 0 2024-08-19T00:56:14.299 INFO:tasks.workunit.client.0.smithi017.stdout:6/301: dread - d5/d13/f22 zero size 2024-08-19T00:56:14.301 INFO:tasks.workunit.client.1.smithi086.stdout:8/743: truncate dc/d16/dc7/d2e/d28/d41/f78 826446 0 2024-08-19T00:56:14.302 INFO:tasks.workunit.client.1.smithi086.stdout:0/780: symlink da/d5d/df7/lf9 0 2024-08-19T00:56:14.302 INFO:tasks.workunit.client.1.smithi086.stdout:5/763: dread d0/d8/d10/f1d [0,4194304] 0 2024-08-19T00:56:14.302 INFO:tasks.workunit.client.1.smithi086.stdout:5/764: fdatasync d0/d20/f36 0 2024-08-19T00:56:14.303 INFO:tasks.workunit.client.1.smithi086.stdout:5/765: chown d0/df/d1f/d65/f9d 161589435 1 2024-08-19T00:56:14.303 INFO:tasks.workunit.client.0.smithi017.stdout:4/299: rmdir d2/d21/d53 39 2024-08-19T00:56:14.303 INFO:tasks.workunit.client.0.smithi017.stdout:2/379: dwrite d2/d7/d10/d19/f27 [0,4194304] 0 2024-08-19T00:56:14.304 INFO:tasks.workunit.client.0.smithi017.stdout:6/302: rmdir d5/d13/d11/d2c 39 2024-08-19T00:56:14.306 INFO:tasks.workunit.client.0.smithi017.stdout:2/380: dread d2/d7/dd/f4e [0,4194304] 0 2024-08-19T00:56:14.307 INFO:tasks.workunit.client.1.smithi086.stdout:2/795: creat d8/d24/d32/d4d/d6a/f108 x:0 0 0 2024-08-19T00:56:14.308 INFO:tasks.workunit.client.0.smithi017.stdout:0/285: creat d5/d17/d26/d30/f58 x:0 0 0 2024-08-19T00:56:14.311 INFO:tasks.workunit.client.1.smithi086.stdout:0/781: fdatasync da/d5d/f95 0 2024-08-19T00:56:14.312 INFO:tasks.workunit.client.1.smithi086.stdout:0/782: fsync da/d14/d44/d49/f91 0 2024-08-19T00:56:14.314 INFO:tasks.workunit.client.1.smithi086.stdout:8/744: mkdir dc/d1f/d37/d4f/dac/db8/d8f/df4 0 2024-08-19T00:56:14.314 INFO:tasks.workunit.client.0.smithi017.stdout:4/300: dread d2/d16/f5b [0,4194304] 0 2024-08-19T00:56:14.315 INFO:tasks.workunit.client.1.smithi086.stdout:9/778: rmdir db/d26/d5c/d87 39 2024-08-19T00:56:14.315 INFO:tasks.workunit.client.1.smithi086.stdout:9/779: chown db/d96/da7 1461434298 1 2024-08-19T00:56:14.315 INFO:tasks.workunit.client.0.smithi017.stdout:4/301: read d2/f12 [4517607,38051] 0 2024-08-19T00:56:14.316 INFO:tasks.workunit.client.0.smithi017.stdout:4/302: fdatasync d2/f12 0 2024-08-19T00:56:14.317 INFO:tasks.workunit.client.0.smithi017.stdout:4/303: dread - d2/d11/d24/f4e zero size 2024-08-19T00:56:14.318 INFO:tasks.workunit.client.1.smithi086.stdout:5/766: fsync d0/d20/f22 0 2024-08-19T00:56:14.319 INFO:tasks.workunit.client.1.smithi086.stdout:5/767: chown d0/d5f/d60/d57/d80 0 1 2024-08-19T00:56:14.320 INFO:tasks.workunit.client.1.smithi086.stdout:5/768: write d0/d2d/fe7 [245759,36255] 0 2024-08-19T00:56:14.353 INFO:tasks.workunit.client.1.smithi086.stdout:3/761: sync 2024-08-19T00:56:14.353 INFO:tasks.workunit.client.1.smithi086.stdout:4/737: sync 2024-08-19T00:56:14.367 INFO:tasks.workunit.client.0.smithi017.stdout:7/342: sync 2024-08-19T00:56:14.367 INFO:tasks.workunit.client.0.smithi017.stdout:0/286: write d5/d17/d26/d30/f54 [189609,113821] 0 2024-08-19T00:56:14.368 INFO:tasks.workunit.client.1.smithi086.stdout:7/770: getdents d3/de/d68/d72/d7e/dca 0 2024-08-19T00:56:14.368 INFO:tasks.workunit.client.1.smithi086.stdout:1/863: truncate d4/d7/d2a/d36/d50/d9c/ded/d11c/f110 457076 0 2024-08-19T00:56:14.371 INFO:tasks.workunit.client.0.smithi017.stdout:4/304: creat d2/d11/f63 x:0 0 0 2024-08-19T00:56:14.372 INFO:tasks.workunit.client.0.smithi017.stdout:6/303: truncate d5/f42 1036886 0 2024-08-19T00:56:14.376 INFO:tasks.workunit.client.0.smithi017.stdout:0/287: dwrite d5/d18/f4a [0,4194304] 0 2024-08-19T00:56:14.376 INFO:tasks.workunit.client.0.smithi017.stdout:4/305: write d2/d21/d40/f4c [1954964,17059] 0 2024-08-19T00:56:14.376 INFO:tasks.workunit.client.0.smithi017.stdout:2/381: dwrite d2/d7/dd/f1c [0,4194304] 0 2024-08-19T00:56:14.378 INFO:tasks.workunit.client.0.smithi017.stdout:7/343: read d3/dc/f1f [2023526,129074] 0 2024-08-19T00:56:14.381 INFO:tasks.workunit.client.0.smithi017.stdout:7/344: write d3/f51 [149942,122429] 0 2024-08-19T00:56:14.383 INFO:tasks.workunit.client.0.smithi017.stdout:7/345: dread d3/dc/df/d1c/d2c/d2f/f56 [0,4194304] 0 2024-08-19T00:56:14.385 INFO:tasks.workunit.client.1.smithi086.stdout:6/792: truncate db/d37/d28/d7f/f88 1280070 0 2024-08-19T00:56:14.388 INFO:tasks.workunit.client.1.smithi086.stdout:9/780: mknod db/dd/cf9 0 2024-08-19T00:56:14.388 INFO:tasks.workunit.client.1.smithi086.stdout:0/783: dwrite da/d14/d26/f33 [0,4194304] 0 2024-08-19T00:56:14.388 INFO:tasks.workunit.client.1.smithi086.stdout:5/769: mkdir d0/df/d1f/d33/dea 0 2024-08-19T00:56:14.388 INFO:tasks.workunit.client.1.smithi086.stdout:0/784: dread - da/d14/d1a/d2e/d39/d3b/d4e/fd5 zero size 2024-08-19T00:56:14.389 INFO:tasks.workunit.client.1.smithi086.stdout:3/762: symlink d3/d18/d27/d76/lfb 0 2024-08-19T00:56:14.389 INFO:tasks.workunit.client.1.smithi086.stdout:4/738: creat d2/d18/d33/d42/d72/d78/d25/d55/d6c/ff7 x:0 0 0 2024-08-19T00:56:14.395 INFO:tasks.workunit.client.0.smithi017.stdout:7/346: dread d3/f12 [0,4194304] 0 2024-08-19T00:56:14.396 INFO:tasks.workunit.client.0.smithi017.stdout:2/382: rename d2/d7/f6d to d2/d7/d10/d19/f7b 0 2024-08-19T00:56:14.401 INFO:tasks.workunit.client.0.smithi017.stdout:4/306: mkdir d2/d1a/d55/d64 0 2024-08-19T00:56:14.409 INFO:tasks.workunit.client.1.smithi086.stdout:7/771: creat d3/d34/ffe x:0 0 0 2024-08-19T00:56:14.409 INFO:tasks.workunit.client.1.smithi086.stdout:8/745: creat dc/d17/dd3/ff5 x:0 0 0 2024-08-19T00:56:14.409 INFO:tasks.workunit.client.1.smithi086.stdout:8/746: dread - dc/d1f/d37/d4f/fee zero size 2024-08-19T00:56:14.409 INFO:tasks.workunit.client.1.smithi086.stdout:5/770: symlink d0/d5f/d60/d57/d80/d9e/leb 0 2024-08-19T00:56:14.409 INFO:tasks.workunit.client.1.smithi086.stdout:0/785: mknod da/d97/cfa 0 2024-08-19T00:56:14.410 INFO:tasks.workunit.client.1.smithi086.stdout:3/763: mkdir d3/d26/d2b/d33/db9/dfc 0 2024-08-19T00:56:14.412 INFO:tasks.workunit.client.1.smithi086.stdout:4/739: unlink d2/d18/d33/d42/d72/f70 0 2024-08-19T00:56:14.414 INFO:tasks.workunit.client.1.smithi086.stdout:7/772: symlink d3/de/d68/d72/d7e/dca/lff 0 2024-08-19T00:56:14.415 INFO:tasks.workunit.client.0.smithi017.stdout:7/347: symlink d3/dc/df/l65 0 2024-08-19T00:56:14.416 INFO:tasks.workunit.client.1.smithi086.stdout:1/864: rename d4/d10/d90/ldc to d4/d10/d90/d98/l11d 0 2024-08-19T00:56:14.416 INFO:tasks.workunit.client.1.smithi086.stdout:8/747: chown dc/d16/dc7/caa 51055 1 2024-08-19T00:56:14.417 INFO:tasks.workunit.client.0.smithi017.stdout:0/288: dwrite d5/d17/d21/d39/f44 [0,4194304] 0 2024-08-19T00:56:14.418 INFO:tasks.workunit.client.0.smithi017.stdout:2/383: truncate d2/d7/d10/d19/f39 2121436 0 2024-08-19T00:56:14.419 INFO:tasks.workunit.client.1.smithi086.stdout:5/771: rmdir d0/d2d/d4f 39 2024-08-19T00:56:14.421 INFO:tasks.workunit.client.0.smithi017.stdout:4/307: link d2/d16/f3f d2/d1a/f65 0 2024-08-19T00:56:14.421 INFO:tasks.workunit.client.1.smithi086.stdout:8/748: dread dc/d16/d18/fa6 [0,4194304] 0 2024-08-19T00:56:14.424 INFO:tasks.workunit.client.0.smithi017.stdout:6/304: truncate d5/d13/d11/d4d/f4e 661994 0 2024-08-19T00:56:14.425 INFO:tasks.workunit.client.1.smithi086.stdout:0/786: dread da/d14/d1a/d2e/d30/d76/f9d [0,4194304] 0 2024-08-19T00:56:14.427 INFO:tasks.workunit.client.1.smithi086.stdout:3/764: creat d3/d18/d27/d49/d3f/d5b/d8f/ffd x:0 0 0 2024-08-19T00:56:14.428 INFO:tasks.workunit.client.0.smithi017.stdout:2/384: symlink d2/d7/d10/l7c 0 2024-08-19T00:56:14.430 INFO:tasks.workunit.client.0.smithi017.stdout:2/385: dread - d2/d7/d10/d35/d55/f6f zero size 2024-08-19T00:56:14.435 INFO:tasks.workunit.client.0.smithi017.stdout:4/308: symlink d2/d21/d53/l66 0 2024-08-19T00:56:14.436 INFO:tasks.workunit.client.1.smithi086.stdout:2/796: getdents d8/d2c/d38/d80 0 2024-08-19T00:56:14.436 INFO:tasks.workunit.client.1.smithi086.stdout:7/773: fsync d3/d34/d44/d58/d4b/f61 0 2024-08-19T00:56:14.437 INFO:tasks.workunit.client.1.smithi086.stdout:9/781: dread db/d26/d5c/d87/d30/d58/f5b [0,4194304] 0 2024-08-19T00:56:14.439 INFO:tasks.workunit.client.1.smithi086.stdout:1/865: chown d4/d1e/d6f/f74 3 1 2024-08-19T00:56:14.439 INFO:tasks.workunit.client.0.smithi017.stdout:4/309: dread d2/d16/f22 [4194304,4194304] 0 2024-08-19T00:56:14.440 INFO:tasks.workunit.client.1.smithi086.stdout:2/797: dread d8/d84/f81 [0,4194304] 0 2024-08-19T00:56:14.440 INFO:tasks.workunit.client.1.smithi086.stdout:8/749: creat dc/d17/d1e/d49/ff6 x:0 0 0 2024-08-19T00:56:14.440 INFO:tasks.workunit.client.0.smithi017.stdout:7/348: rename d3/dc/df/d23/f3f to d3/dc/df/d37/f66 0 2024-08-19T00:56:14.443 INFO:tasks.workunit.client.1.smithi086.stdout:3/765: mknod d3/d18/d27/d49/d3f/d5b/d8f/cfe 0 2024-08-19T00:56:14.444 INFO:tasks.workunit.client.0.smithi017.stdout:2/386: symlink d2/d7/d10/d35/l7d 0 2024-08-19T00:56:14.452 INFO:tasks.workunit.client.0.smithi017.stdout:0/289: rename d5/d17/d21/d42/c2c to d5/d17/d26/d30/c59 0 2024-08-19T00:56:14.454 INFO:tasks.workunit.client.1.smithi086.stdout:7/774: rename d3/de/d68/d72/d7e/dca/dcb/fe2 to d3/d34/d44/d58/d4b/da5/daf/de7/df5/f100 0 2024-08-19T00:56:14.457 INFO:tasks.workunit.client.0.smithi017.stdout:7/349: dwrite d3/f5 [0,4194304] 0 2024-08-19T00:56:14.457 INFO:tasks.workunit.client.1.smithi086.stdout:5/772: creat d0/d8/d10/dbb/fec x:0 0 0 2024-08-19T00:56:14.459 INFO:tasks.workunit.client.0.smithi017.stdout:6/305: dwrite d5/d13/f14 [0,4194304] 0 2024-08-19T00:56:14.459 INFO:tasks.workunit.client.0.smithi017.stdout:2/387: dread d2/d7/f21 [0,4194304] 0 2024-08-19T00:56:14.460 INFO:tasks.workunit.client.1.smithi086.stdout:1/866: unlink d4/d7/d2a/d36/db6/lc9 0 2024-08-19T00:56:14.461 INFO:tasks.workunit.client.0.smithi017.stdout:2/388: write d2/d7/d10/d35/d55/f6f [582408,6227] 0 2024-08-19T00:56:14.462 INFO:tasks.workunit.client.1.smithi086.stdout:0/787: dwrite da/d14/d1a/d2e/d39/f69 [0,4194304] 0 2024-08-19T00:56:14.463 INFO:tasks.workunit.client.1.smithi086.stdout:8/750: mknod dc/d17/d86/cf7 0 2024-08-19T00:56:14.464 INFO:tasks.workunit.client.1.smithi086.stdout:0/788: write da/d14/d1a/d2e/f62 [2210836,20790] 0 2024-08-19T00:56:14.465 INFO:tasks.workunit.client.1.smithi086.stdout:9/782: write db/d26/d5c/d87/d37/f4a [4613660,100262] 0 2024-08-19T00:56:14.466 INFO:tasks.workunit.client.1.smithi086.stdout:3/766: creat d3/d18/d19/d37/d3a/fff x:0 0 0 2024-08-19T00:56:14.469 INFO:tasks.workunit.client.0.smithi017.stdout:6/306: symlink d5/d13/d20/l66 0 2024-08-19T00:56:14.470 INFO:tasks.workunit.client.1.smithi086.stdout:0/789: read da/d14/d1a/d2e/d43/fc7 [266394,96039] 0 2024-08-19T00:56:14.470 INFO:tasks.workunit.client.1.smithi086.stdout:7/775: fsync d3/d34/d44/f48 0 2024-08-19T00:56:14.472 INFO:tasks.workunit.client.1.smithi086.stdout:7/776: chown d3 18904 1 2024-08-19T00:56:14.474 INFO:tasks.workunit.client.0.smithi017.stdout:0/290: mkdir d5/d17/d26/d30/d3e/d5a 0 2024-08-19T00:56:14.475 INFO:tasks.workunit.client.0.smithi017.stdout:7/350: unlink d3/l16 0 2024-08-19T00:56:14.476 INFO:tasks.workunit.client.1.smithi086.stdout:4/740: dwrite d2/d18/d33/d42/d72/d78/d2c/db0/fc2 [0,4194304] 0 2024-08-19T00:56:14.477 INFO:tasks.workunit.client.0.smithi017.stdout:6/307: read d5/f42 [47879,8375] 0 2024-08-19T00:56:14.479 INFO:tasks.workunit.client.1.smithi086.stdout:9/783: fsync db/d26/d5c/d87/d30/f7f 0 2024-08-19T00:56:14.479 INFO:tasks.workunit.client.0.smithi017.stdout:4/310: getdents d2/d21/d40/d56 0 2024-08-19T00:56:14.480 INFO:tasks.workunit.client.0.smithi017.stdout:7/351: read d3/dc/df/d1c/f27 [4141101,13750] 0 2024-08-19T00:56:14.481 INFO:tasks.workunit.client.0.smithi017.stdout:4/311: dread d2/d21/f42 [0,4194304] 0 2024-08-19T00:56:14.482 INFO:tasks.workunit.client.1.smithi086.stdout:5/773: symlink d0/d99/dc0/dc2/de2/led 0 2024-08-19T00:56:14.483 INFO:tasks.workunit.client.0.smithi017.stdout:7/352: chown d3/dc/df/d3d/c41 1315825 1 2024-08-19T00:56:14.483 INFO:tasks.workunit.client.0.smithi017.stdout:0/291: mknod d5/d17/c5b 0 2024-08-19T00:56:14.483 INFO:tasks.workunit.client.1.smithi086.stdout:5/774: truncate d0/d2d/fe7 806071 0 2024-08-19T00:56:14.484 INFO:tasks.workunit.client.1.smithi086.stdout:1/867: mknod d4/d10/d90/c11e 0 2024-08-19T00:56:14.485 INFO:tasks.workunit.client.1.smithi086.stdout:1/868: fsync d4/d7/d2a/d36/d61/f114 0 2024-08-19T00:56:14.485 INFO:tasks.workunit.client.1.smithi086.stdout:0/790: mknod da/d14/d1a/d2e/d39/d3b/d4e/dbe/cfb 0 2024-08-19T00:56:14.488 INFO:tasks.workunit.client.1.smithi086.stdout:1/869: truncate d4/d7/d2a/d36/d3a/de5/d7a/f10d 901335 0 2024-08-19T00:56:14.489 INFO:tasks.workunit.client.1.smithi086.stdout:8/751: link dc/d1f/d37/d4f/dac/db8/de7/ff1 dc/d1f/d37/d9f/ff8 0 2024-08-19T00:56:14.490 INFO:tasks.workunit.client.0.smithi017.stdout:4/312: dwrite d2/d11/d24/f4e [0,4194304] 0 2024-08-19T00:56:14.492 INFO:tasks.workunit.client.1.smithi086.stdout:4/741: mknod d2/d18/d33/d42/d72/d78/d25/d30/d5d/cf8 0 2024-08-19T00:56:14.492 INFO:tasks.workunit.client.0.smithi017.stdout:4/313: write d2/d21/f35 [3188353,78750] 0 2024-08-19T00:56:14.497 INFO:tasks.workunit.client.1.smithi086.stdout:9/784: readlink db/l45 0 2024-08-19T00:56:14.498 INFO:tasks.workunit.client.0.smithi017.stdout:7/353: dwrite d3/dc/df/d37/d46/f57 [0,4194304] 0 2024-08-19T00:56:14.502 INFO:tasks.workunit.client.1.smithi086.stdout:6/793: sync 2024-08-19T00:56:14.505 INFO:tasks.workunit.client.0.smithi017.stdout:0/292: rename d5/d17/d21/l4b to d5/d17/d21/d42/l5c 0 2024-08-19T00:56:14.509 INFO:tasks.workunit.client.1.smithi086.stdout:0/791: dread da/d14/d1a/d2e/d43/fc7 [0,4194304] 0 2024-08-19T00:56:14.512 INFO:tasks.workunit.client.0.smithi017.stdout:0/293: dwrite d5/d17/d21/d42/f1d [0,4194304] 0 2024-08-19T00:56:14.514 INFO:tasks.workunit.client.0.smithi017.stdout:0/294: truncate d5/d17/d21/d42/f53 144471 0 2024-08-19T00:56:14.519 INFO:tasks.workunit.client.0.smithi017.stdout:0/295: mkdir d5/d17/d26/d30/d5d 0 2024-08-19T00:56:14.519 INFO:tasks.workunit.client.1.smithi086.stdout:6/794: write f8 [12407872,82460] 0 2024-08-19T00:56:14.520 INFO:tasks.workunit.client.1.smithi086.stdout:3/767: dwrite d3/d26/d2b/d33/f41 [0,4194304] 0 2024-08-19T00:56:14.521 INFO:tasks.workunit.client.0.smithi017.stdout:7/354: unlink d3/dc/df/d1c/d2c/d35/c5e 0 2024-08-19T00:56:14.521 INFO:tasks.workunit.client.0.smithi017.stdout:2/389: dwrite d2/d7/d10/f47 [0,4194304] 0 2024-08-19T00:56:14.522 INFO:tasks.workunit.client.1.smithi086.stdout:3/768: chown d3/d9/c5e 2905 1 2024-08-19T00:56:14.526 INFO:tasks.workunit.client.1.smithi086.stdout:0/792: creat da/d14/d1a/d2e/d39/d3b/ffc x:0 0 0 2024-08-19T00:56:14.528 INFO:tasks.workunit.client.1.smithi086.stdout:0/793: readlink da/d14/d1a/d2e/d39/d3b/d89/l8b 0 2024-08-19T00:56:14.528 INFO:tasks.workunit.client.0.smithi017.stdout:6/308: write d5/f1e [2618546,103565] 0 2024-08-19T00:56:14.529 INFO:tasks.workunit.client.1.smithi086.stdout:7/777: dwrite d3/d34/d44/d58/d4b/d78/f94 [0,4194304] 0 2024-08-19T00:56:14.531 INFO:tasks.workunit.client.0.smithi017.stdout:7/355: dwrite d3/f51 [0,4194304] 0 2024-08-19T00:56:14.531 INFO:tasks.workunit.client.1.smithi086.stdout:0/794: dread - da/d14/d1a/d2e/d30/d76/fde zero size 2024-08-19T00:56:14.532 INFO:tasks.workunit.client.1.smithi086.stdout:5/775: creat d0/d8/fee x:0 0 0 2024-08-19T00:56:14.534 INFO:tasks.workunit.client.0.smithi017.stdout:0/296: getdents d5/d17/d26/d30/d5d 0 2024-08-19T00:56:14.534 INFO:tasks.workunit.client.1.smithi086.stdout:2/798: sync 2024-08-19T00:56:14.535 INFO:tasks.workunit.client.1.smithi086.stdout:2/799: write d8/f1a [2541369,13809] 0 2024-08-19T00:56:14.537 INFO:tasks.workunit.client.1.smithi086.stdout:9/785: dread db/dd/d19/f1f [0,4194304] 0 2024-08-19T00:56:14.540 INFO:tasks.workunit.client.1.smithi086.stdout:1/870: write d4/d7/d2a/d36/d3a/f43 [4092073,1811] 0 2024-08-19T00:56:14.540 INFO:tasks.workunit.client.0.smithi017.stdout:2/390: mkdir d2/d7/d10/d35/d7e 0 2024-08-19T00:56:14.544 INFO:tasks.workunit.client.0.smithi017.stdout:0/297: symlink d5/d17/d2b/l5e 0 2024-08-19T00:56:14.546 INFO:tasks.workunit.client.0.smithi017.stdout:4/314: dwrite d2/d16/f3f [0,4194304] 0 2024-08-19T00:56:14.547 INFO:tasks.workunit.client.0.smithi017.stdout:6/309: mknod d5/d13/d11/c67 0 2024-08-19T00:56:14.548 INFO:tasks.workunit.client.0.smithi017.stdout:6/310: fsync d5/f60 0 2024-08-19T00:56:14.551 INFO:tasks.workunit.client.1.smithi086.stdout:8/752: write dc/d16/dc7/f91 [38565,17341] 0 2024-08-19T00:56:14.554 INFO:tasks.workunit.client.1.smithi086.stdout:4/742: write d2/d18/d33/d42/d72/d2f/dc4/f99 [796081,58958] 0 2024-08-19T00:56:14.556 INFO:tasks.workunit.client.0.smithi017.stdout:0/298: creat d5/d18/d3a/f5f x:0 0 0 2024-08-19T00:56:14.557 INFO:tasks.workunit.client.1.smithi086.stdout:5/776: creat d0/d5f/d60/d57/d80/da0/fef x:0 0 0 2024-08-19T00:56:14.558 INFO:tasks.workunit.client.0.smithi017.stdout:2/391: dwrite d2/d7/f21 [0,4194304] 0 2024-08-19T00:56:14.559 INFO:tasks.workunit.client.1.smithi086.stdout:3/769: write d3/d18/d19/d37/fae [224954,45767] 0 2024-08-19T00:56:14.561 INFO:tasks.workunit.client.1.smithi086.stdout:2/800: creat d8/d2c/d47/f109 x:0 0 0 2024-08-19T00:56:14.566 INFO:tasks.workunit.client.1.smithi086.stdout:2/801: dwrite d8/d24/d32/f4b [0,4194304] 0 2024-08-19T00:56:14.567 INFO:tasks.workunit.client.0.smithi017.stdout:2/392: creat d2/d7/d10/d3b/d69/f7f x:0 0 0 2024-08-19T00:56:14.567 INFO:tasks.workunit.client.1.smithi086.stdout:2/802: stat d8/d24/d32/d61/ffc 0 2024-08-19T00:56:14.568 INFO:tasks.workunit.client.1.smithi086.stdout:2/803: chown d8/d2c/d38/fd4 11 1 2024-08-19T00:56:14.569 INFO:tasks.workunit.client.0.smithi017.stdout:4/315: write d2/d11/d24/f2e [539632,128399] 0 2024-08-19T00:56:14.569 INFO:tasks.workunit.client.0.smithi017.stdout:0/299: symlink d5/d17/d26/l60 0 2024-08-19T00:56:14.570 INFO:tasks.workunit.client.0.smithi017.stdout:0/300: fdatasync d5/fc 0 2024-08-19T00:56:14.570 INFO:tasks.workunit.client.0.smithi017.stdout:4/316: stat d2/d11 0 2024-08-19T00:56:14.572 INFO:tasks.workunit.client.0.smithi017.stdout:4/317: read d2/d16/f5b [1425139,84132] 0 2024-08-19T00:56:14.573 INFO:tasks.workunit.client.0.smithi017.stdout:6/311: creat d5/d13/d11/f68 x:0 0 0 2024-08-19T00:56:14.577 INFO:tasks.workunit.client.0.smithi017.stdout:2/393: dread d2/d7/d10/d35/d55/f6f [0,4194304] 0 2024-08-19T00:56:14.577 INFO:tasks.workunit.client.1.smithi086.stdout:3/770: unlink d3/d18/d27/d49/d3f/f89 0 2024-08-19T00:56:14.578 INFO:tasks.workunit.client.1.smithi086.stdout:1/871: write d4/d7/d2a/d36/d3a/de5/f89 [243936,65815] 0 2024-08-19T00:56:14.580 INFO:tasks.workunit.client.0.smithi017.stdout:4/318: mknod d2/d21/d40/d56/c67 0 2024-08-19T00:56:14.581 INFO:tasks.workunit.client.0.smithi017.stdout:0/301: dwrite d5/d18/f4c [0,4194304] 0 2024-08-19T00:56:14.583 INFO:tasks.workunit.client.0.smithi017.stdout:0/302: truncate d5/d17/d26/d30/f58 453741 0 2024-08-19T00:56:14.584 INFO:tasks.workunit.client.0.smithi017.stdout:6/312: mknod d5/c69 0 2024-08-19T00:56:14.585 INFO:tasks.workunit.client.1.smithi086.stdout:8/753: creat dc/d17/d1e/d55/dbb/dd0/ff9 x:0 0 0 2024-08-19T00:56:14.586 INFO:tasks.workunit.client.1.smithi086.stdout:0/795: creat da/d14/d1a/d2e/d39/ffd x:0 0 0 2024-08-19T00:56:14.589 INFO:tasks.workunit.client.0.smithi017.stdout:4/319: rename d2/d27/f45 to d2/d1a/f68 0 2024-08-19T00:56:14.592 INFO:tasks.workunit.client.1.smithi086.stdout:8/754: dwrite dc/d16/dc7/d2e/d28/f45 [0,4194304] 0 2024-08-19T00:56:14.595 INFO:tasks.workunit.client.0.smithi017.stdout:2/394: dread d2/d7/f6c [0,4194304] 0 2024-08-19T00:56:14.596 INFO:tasks.workunit.client.1.smithi086.stdout:3/771: mknod d3/d26/d60/c100 0 2024-08-19T00:56:14.598 INFO:tasks.workunit.client.1.smithi086.stdout:6/795: rename db/d8e/c91 to db/d37/cfd 0 2024-08-19T00:56:14.599 INFO:tasks.workunit.client.0.smithi017.stdout:0/303: getdents d5/d17/d26/d30/d5d 0 2024-08-19T00:56:14.600 INFO:tasks.workunit.client.1.smithi086.stdout:6/796: fsync db/d34/d4e/fd2 0 2024-08-19T00:56:14.601 INFO:tasks.workunit.client.1.smithi086.stdout:6/797: stat db/d37/d44/f80 0 2024-08-19T00:56:14.602 INFO:tasks.workunit.client.1.smithi086.stdout:2/804: dwrite d8/d84/f81 [0,4194304] 0 2024-08-19T00:56:14.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/320: dwrite d2/d1a/f68 [0,4194304] 0 2024-08-19T00:56:14.603 INFO:tasks.workunit.client.0.smithi017.stdout:2/395: dwrite d2/d7/dd/f2f [0,4194304] 0 2024-08-19T00:56:14.606 INFO:tasks.workunit.client.0.smithi017.stdout:6/313: creat d5/d13/f6a x:0 0 0 2024-08-19T00:56:14.608 INFO:tasks.workunit.client.0.smithi017.stdout:0/304: symlink d5/l61 0 2024-08-19T00:56:14.610 INFO:tasks.workunit.client.1.smithi086.stdout:5/777: dwrite d0/df/d1f/d33/f40 [0,4194304] 0 2024-08-19T00:56:14.610 INFO:tasks.workunit.client.1.smithi086.stdout:4/743: rmdir d2/d18/d33/d42/d72/d78/d25/d30/d5d/dce 0 2024-08-19T00:56:14.612 INFO:tasks.workunit.client.1.smithi086.stdout:8/755: unlink dc/d1f/dd4/leb 0 2024-08-19T00:56:14.612 INFO:tasks.workunit.client.0.smithi017.stdout:0/305: read d5/d17/d26/d30/f33 [262524,95076] 0 2024-08-19T00:56:14.615 INFO:tasks.workunit.client.0.smithi017.stdout:6/314: fsync d5/d13/f6a 0 2024-08-19T00:56:14.615 INFO:tasks.workunit.client.1.smithi086.stdout:0/796: write da/d14/d44/f98 [1675671,100054] 0 2024-08-19T00:56:14.618 INFO:tasks.workunit.client.1.smithi086.stdout:9/786: getdents db/d26/d5c/d87/d30/d31 0 2024-08-19T00:56:14.619 INFO:tasks.workunit.client.0.smithi017.stdout:2/396: mkdir d2/d7/d10/d3b/d80 0 2024-08-19T00:56:14.622 INFO:tasks.workunit.client.0.smithi017.stdout:0/306: dwrite d5/d17/d26/d30/f58 [0,4194304] 0 2024-08-19T00:56:14.625 INFO:tasks.workunit.client.0.smithi017.stdout:4/321: dread d2/f6 [0,4194304] 0 2024-08-19T00:56:14.625 INFO:tasks.workunit.client.1.smithi086.stdout:6/798: unlink db/l1d 0 2024-08-19T00:56:14.626 INFO:tasks.workunit.client.0.smithi017.stdout:2/397: chown d2/d7/d29/f37 121346668 1 2024-08-19T00:56:14.627 INFO:tasks.workunit.client.0.smithi017.stdout:4/322: stat d2/d1a/d20/f52 0 2024-08-19T00:56:14.630 INFO:tasks.workunit.client.0.smithi017.stdout:0/307: mknod d5/d17/c62 0 2024-08-19T00:56:14.631 INFO:tasks.workunit.client.1.smithi086.stdout:8/756: creat dc/d1f/ffa x:0 0 0 2024-08-19T00:56:14.631 INFO:tasks.workunit.client.0.smithi017.stdout:0/308: write d5/f48 [116239,56542] 0 2024-08-19T00:56:14.635 INFO:tasks.workunit.client.0.smithi017.stdout:2/398: mkdir d2/d7/d10/d3b/d80/d81 0 2024-08-19T00:56:14.636 INFO:tasks.workunit.client.0.smithi017.stdout:0/309: creat d5/d17/d26/d30/f63 x:0 0 0 2024-08-19T00:56:14.638 INFO:tasks.workunit.client.1.smithi086.stdout:4/744: dwrite d2/d18/d33/d42/d72/f96 [0,4194304] 0 2024-08-19T00:56:14.639 INFO:tasks.workunit.client.1.smithi086.stdout:5/778: fsync d0/d2d/d43/f45 0 2024-08-19T00:56:14.639 INFO:tasks.workunit.client.0.smithi017.stdout:2/399: truncate d2/d7/d10/f3e 1490027 0 2024-08-19T00:56:14.639 INFO:tasks.workunit.client.0.smithi017.stdout:2/400: chown d2/d7/f28 63015206 1 2024-08-19T00:56:14.639 INFO:tasks.workunit.client.0.smithi017.stdout:6/315: getdents d5/d13/d11/d2c/d51 0 2024-08-19T00:56:14.640 INFO:tasks.workunit.client.0.smithi017.stdout:0/310: mknod d5/d17/d26/d30/c64 0 2024-08-19T00:56:14.642 INFO:tasks.workunit.client.1.smithi086.stdout:8/757: mknod dc/d1f/d37/d4f/dac/db8/d7a/d9b/cfb 0 2024-08-19T00:56:14.644 INFO:tasks.workunit.client.1.smithi086.stdout:7/778: rename d3/de/f17 to d3/de/d68/f101 0 2024-08-19T00:56:14.644 INFO:tasks.workunit.client.0.smithi017.stdout:2/401: creat d2/d7/d10/d19/d48/f82 x:0 0 0 2024-08-19T00:56:14.646 INFO:tasks.workunit.client.1.smithi086.stdout:9/787: dwrite db/d26/d5c/d87/d6d/dbf/fc4 [0,4194304] 0 2024-08-19T00:56:14.646 INFO:tasks.workunit.client.1.smithi086.stdout:2/805: dread d8/d24/f8c [0,4194304] 0 2024-08-19T00:56:14.648 INFO:tasks.workunit.client.0.smithi017.stdout:2/402: creat d2/d7/d29/f83 x:0 0 0 2024-08-19T00:56:14.649 INFO:tasks.workunit.client.1.smithi086.stdout:4/745: creat d2/d18/d33/d42/d72/d78/d25/d55/d4d/ff9 x:0 0 0 2024-08-19T00:56:14.649 INFO:tasks.workunit.client.0.smithi017.stdout:2/403: fsync d2/d7/f43 0 2024-08-19T00:56:14.649 INFO:tasks.workunit.client.1.smithi086.stdout:8/758: creat dc/d1f/dc9/ffc x:0 0 0 2024-08-19T00:56:14.651 INFO:tasks.workunit.client.0.smithi017.stdout:6/316: getdents d5/d13/d11/d4d 0 2024-08-19T00:56:14.651 INFO:tasks.workunit.client.1.smithi086.stdout:5/779: truncate d0/d20/f36 103165 0 2024-08-19T00:56:14.653 INFO:tasks.workunit.client.1.smithi086.stdout:6/799: dread db/d37/d44/f4f [0,4194304] 0 2024-08-19T00:56:14.655 INFO:tasks.workunit.client.0.smithi017.stdout:6/317: creat d5/d13/d11/d4d/f6b x:0 0 0 2024-08-19T00:56:14.655 INFO:tasks.workunit.client.0.smithi017.stdout:6/318: dread - d5/d13/d11/f3b zero size 2024-08-19T00:56:14.656 INFO:tasks.workunit.client.0.smithi017.stdout:2/404: mkdir d2/d7/d10/d35/d84 0 2024-08-19T00:56:14.658 INFO:tasks.workunit.client.0.smithi017.stdout:2/405: fsync d2/d7/d10/d3b/d3c/f3d 0 2024-08-19T00:56:14.658 INFO:tasks.workunit.client.1.smithi086.stdout:7/779: dwrite d3/de/d2d/ff3 [0,4194304] 0 2024-08-19T00:56:14.659 INFO:tasks.workunit.client.0.smithi017.stdout:2/406: write d2/d7/d10/f11 [4348833,20467] 0 2024-08-19T00:56:14.660 INFO:tasks.workunit.client.1.smithi086.stdout:5/780: dread d0/d99/da2/fdd [0,4194304] 0 2024-08-19T00:56:14.660 INFO:tasks.workunit.client.1.smithi086.stdout:4/746: symlink d2/d18/d33/d42/d72/d2f/lfa 0 2024-08-19T00:56:14.661 INFO:tasks.workunit.client.0.smithi017.stdout:6/319: creat d5/d13/d20/d5e/f6c x:0 0 0 2024-08-19T00:56:14.662 INFO:tasks.workunit.client.1.smithi086.stdout:5/781: stat d0/d2d/d43/d4d 0 2024-08-19T00:56:14.663 INFO:tasks.workunit.client.0.smithi017.stdout:6/320: unlink d5/d13/d11/d2c/l63 0 2024-08-19T00:56:14.664 INFO:tasks.workunit.client.1.smithi086.stdout:9/788: dwrite db/d26/d5c/d87/d30/d32/d44/f65 [0,4194304] 0 2024-08-19T00:56:14.665 INFO:tasks.workunit.client.1.smithi086.stdout:7/780: unlink d3/d34/d44/d58/d4b/da5/f56 0 2024-08-19T00:56:14.666 INFO:tasks.workunit.client.0.smithi017.stdout:2/407: truncate d2/d7/d10/d3b/d54/f61 746278 0 2024-08-19T00:56:14.668 INFO:tasks.workunit.client.0.smithi017.stdout:6/321: symlink d5/d13/d11/d2c/d4a/l6d 0 2024-08-19T00:56:14.668 INFO:tasks.workunit.client.1.smithi086.stdout:9/789: fsync db/d26/d5c/d87/d37/f4a 0 2024-08-19T00:56:14.668 INFO:tasks.workunit.client.0.smithi017.stdout:2/408: write d2/d7/d10/d19/f27 [4510672,124585] 0 2024-08-19T00:56:14.669 INFO:tasks.workunit.client.0.smithi017.stdout:6/322: write d5/d13/f1f [2779446,9103] 0 2024-08-19T00:56:14.669 INFO:tasks.workunit.client.1.smithi086.stdout:1/872: sync 2024-08-19T00:56:14.674 INFO:tasks.workunit.client.1.smithi086.stdout:5/782: dwrite d0/df/d1f/d33/fc7 [0,4194304] 0 2024-08-19T00:56:14.675 INFO:tasks.workunit.client.1.smithi086.stdout:5/783: chown d0/df/d1f/fb3 18591 1 2024-08-19T00:56:14.676 INFO:tasks.workunit.client.1.smithi086.stdout:8/759: getdents dc/d16/dc7 0 2024-08-19T00:56:14.678 INFO:tasks.workunit.client.0.smithi017.stdout:6/323: unlink d5/d13/d11/l3d 0 2024-08-19T00:56:14.678 INFO:tasks.workunit.client.0.smithi017.stdout:6/324: chown d5/d13/d11/fa 593326 1 2024-08-19T00:56:14.682 INFO:tasks.workunit.client.1.smithi086.stdout:9/790: truncate f6 500044 0 2024-08-19T00:56:14.683 INFO:tasks.workunit.client.1.smithi086.stdout:3/772: dwrite d3/d26/f7e [4194304,4194304] 0 2024-08-19T00:56:14.684 INFO:tasks.workunit.client.0.smithi017.stdout:6/325: rename d5/d13/f14 to d5/d13/d11/d2c/f6e 0 2024-08-19T00:56:14.686 INFO:tasks.workunit.client.1.smithi086.stdout:6/800: getdents db/d37/df3 0 2024-08-19T00:56:14.687 INFO:tasks.workunit.client.0.smithi017.stdout:6/326: creat d5/d13/d11/d52/f6f x:0 0 0 2024-08-19T00:56:14.688 INFO:tasks.workunit.client.1.smithi086.stdout:1/873: fdatasync d4/d7/d2a/d36/d50/f66 0 2024-08-19T00:56:14.688 INFO:tasks.workunit.client.0.smithi017.stdout:6/327: write d5/d13/d20/f27 [472198,87699] 0 2024-08-19T00:56:14.693 INFO:tasks.workunit.client.0.smithi017.stdout:6/328: read d5/d13/d11/d2c/f30 [64208,128505] 0 2024-08-19T00:56:14.694 INFO:tasks.workunit.client.1.smithi086.stdout:0/797: dwrite da/d14/d44/d49/f5f [0,4194304] 0 2024-08-19T00:56:14.695 INFO:tasks.workunit.client.0.smithi017.stdout:4/323: dwrite d2/d16/f22 [0,4194304] 0 2024-08-19T00:56:14.696 INFO:tasks.workunit.client.1.smithi086.stdout:0/798: chown da/l93 207513 1 2024-08-19T00:56:14.706 INFO:tasks.workunit.client.1.smithi086.stdout:6/801: read db/d37/d28/fa5 [4176299,41438] 0 2024-08-19T00:56:14.707 INFO:tasks.workunit.client.0.smithi017.stdout:4/324: creat d2/d1a/f69 x:0 0 0 2024-08-19T00:56:14.707 INFO:tasks.workunit.client.0.smithi017.stdout:4/325: write d2/d11/d24/f2e [3457666,114014] 0 2024-08-19T00:56:14.710 INFO:tasks.workunit.client.1.smithi086.stdout:5/784: creat d0/d5f/d60/d57/dc3/ff0 x:0 0 0 2024-08-19T00:56:14.711 INFO:tasks.workunit.client.1.smithi086.stdout:1/874: dread d4/d7/d2a/d36/d63/f80 [0,4194304] 0 2024-08-19T00:56:14.711 INFO:tasks.workunit.client.0.smithi017.stdout:0/311: truncate d5/d17/d21/d39/f44 1442337 0 2024-08-19T00:56:14.712 INFO:tasks.workunit.client.1.smithi086.stdout:5/785: write d0/df/d1f/fe3 [405113,564] 0 2024-08-19T00:56:14.713 INFO:tasks.workunit.client.0.smithi017.stdout:6/329: dread d5/d13/f1f [0,4194304] 0 2024-08-19T00:56:14.715 INFO:tasks.workunit.client.1.smithi086.stdout:5/786: chown d0/d8/fee 27 1 2024-08-19T00:56:14.715 INFO:tasks.workunit.client.0.smithi017.stdout:4/326: fsync d2/f6 0 2024-08-19T00:56:14.717 INFO:tasks.workunit.client.0.smithi017.stdout:0/312: rmdir d5/d17/d45/d50 39 2024-08-19T00:56:14.717 INFO:tasks.workunit.client.1.smithi086.stdout:1/875: dread d4/d7/d2a/d6e/d95/db9/deb/fec [0,4194304] 0 2024-08-19T00:56:14.717 INFO:tasks.workunit.client.1.smithi086.stdout:8/760: mknod dc/d1f/d37/d4f/dac/db8/d8f/df4/cfd 0 2024-08-19T00:56:14.719 INFO:tasks.workunit.client.0.smithi017.stdout:1/273: sync 2024-08-19T00:56:14.720 INFO:tasks.workunit.client.1.smithi086.stdout:2/806: dwrite d8/d24/d32/d4d/f7d [0,4194304] 0 2024-08-19T00:56:14.723 INFO:tasks.workunit.client.1.smithi086.stdout:3/773: creat d3/d18/d19/dbc/d5d/f101 x:0 0 0 2024-08-19T00:56:14.723 INFO:tasks.workunit.client.0.smithi017.stdout:0/313: dwrite d5/d17/f57 [0,4194304] 0 2024-08-19T00:56:14.727 INFO:tasks.workunit.client.0.smithi017.stdout:1/274: symlink d4/dc/d17/d1d/l4e 0 2024-08-19T00:56:14.734 INFO:tasks.workunit.client.1.smithi086.stdout:5/787: creat d0/d8/d10/dbb/ff1 x:0 0 0 2024-08-19T00:56:14.734 INFO:tasks.workunit.client.1.smithi086.stdout:0/799: dread da/d14/d1a/d2e/d39/f45 [0,4194304] 0 2024-08-19T00:56:14.736 INFO:tasks.workunit.client.0.smithi017.stdout:0/314: creat d5/d17/d21/d39/f65 x:0 0 0 2024-08-19T00:56:14.736 INFO:tasks.workunit.client.1.smithi086.stdout:7/781: write d3/d34/d44/d58/d4b/d42/f91 [2754315,83313] 0 2024-08-19T00:56:14.737 INFO:tasks.workunit.client.1.smithi086.stdout:1/876: creat d4/d7/d2a/d36/d61/f11f x:0 0 0 2024-08-19T00:56:14.740 INFO:tasks.workunit.client.0.smithi017.stdout:6/330: rename d5/d13/d20/c28 to d5/d13/d11/c70 0 2024-08-19T00:56:14.742 INFO:tasks.workunit.client.1.smithi086.stdout:8/761: dread dc/d16/dc7/d2e/d28/d41/f78 [0,4194304] 0 2024-08-19T00:56:14.743 INFO:tasks.workunit.client.0.smithi017.stdout:1/275: symlink d4/dc/d17/d1d/l4f 0 2024-08-19T00:56:14.745 INFO:tasks.workunit.client.0.smithi017.stdout:2/409: write d2/d7/d10/f3e [78192,77975] 0 2024-08-19T00:56:14.746 INFO:tasks.workunit.client.0.smithi017.stdout:0/315: unlink d5/le 0 2024-08-19T00:56:14.747 INFO:tasks.workunit.client.0.smithi017.stdout:0/316: write d5/f11 [49661,51237] 0 2024-08-19T00:56:14.748 INFO:tasks.workunit.client.0.smithi017.stdout:0/317: write d5/f48 [285408,53060] 0 2024-08-19T00:56:14.748 INFO:tasks.workunit.client.1.smithi086.stdout:8/762: dwrite dc/d17/d1e/d49/ff6 [0,4194304] 0 2024-08-19T00:56:14.749 INFO:tasks.workunit.client.0.smithi017.stdout:6/331: readlink d5/l15 0 2024-08-19T00:56:14.750 INFO:tasks.workunit.client.1.smithi086.stdout:5/788: creat d0/d8/d94/ff2 x:0 0 0 2024-08-19T00:56:14.752 INFO:tasks.workunit.client.0.smithi017.stdout:0/318: dread d5/d18/f4a [0,4194304] 0 2024-08-19T00:56:14.753 INFO:tasks.workunit.client.1.smithi086.stdout:0/800: rename da/d14/d1a/d2e/d39/ffd to da/d14/d1a/d2e/d7e/dd7/ffe 0 2024-08-19T00:56:14.754 INFO:tasks.workunit.client.0.smithi017.stdout:1/276: creat d4/dc/d3b/f50 x:0 0 0 2024-08-19T00:56:14.755 INFO:tasks.workunit.client.1.smithi086.stdout:7/782: chown d3/lad 3750 1 2024-08-19T00:56:14.755 INFO:tasks.workunit.client.0.smithi017.stdout:1/277: write d4/dc/f40 [3915619,56464] 0 2024-08-19T00:56:14.756 INFO:tasks.workunit.client.0.smithi017.stdout:2/410: creat d2/d7/d10/d35/d55/d65/d6b/f85 x:0 0 0 2024-08-19T00:56:14.757 INFO:tasks.workunit.client.1.smithi086.stdout:2/807: mkdir d8/d14/d10a 0 2024-08-19T00:56:14.758 INFO:tasks.workunit.client.1.smithi086.stdout:2/808: dread - d8/d43/d65/da9/fde zero size 2024-08-19T00:56:14.760 INFO:tasks.workunit.client.0.smithi017.stdout:7/356: sync 2024-08-19T00:56:14.760 INFO:tasks.workunit.client.0.smithi017.stdout:3/350: sync 2024-08-19T00:56:14.760 INFO:tasks.workunit.client.0.smithi017.stdout:5/258: sync 2024-08-19T00:56:14.760 INFO:tasks.workunit.client.0.smithi017.stdout:9/322: sync 2024-08-19T00:56:14.760 INFO:tasks.workunit.client.0.smithi017.stdout:8/225: sync 2024-08-19T00:56:14.761 INFO:tasks.workunit.client.0.smithi017.stdout:9/323: chown d0/f18 1207197605 1 2024-08-19T00:56:14.761 INFO:tasks.workunit.client.1.smithi086.stdout:3/774: unlink d3/d18/d61/d85/fbf 0 2024-08-19T00:56:14.764 INFO:tasks.workunit.client.1.smithi086.stdout:8/763: unlink dc/d16/d18/f76 0 2024-08-19T00:56:14.768 INFO:tasks.workunit.client.0.smithi017.stdout:6/332: mknod d5/d13/d11/d2c/d51/c71 0 2024-08-19T00:56:14.769 INFO:tasks.workunit.client.0.smithi017.stdout:6/333: chown d5/d13/d20 612 1 2024-08-19T00:56:14.769 INFO:tasks.workunit.client.1.smithi086.stdout:9/791: truncate f7 7212748 0 2024-08-19T00:56:14.770 INFO:tasks.workunit.client.0.smithi017.stdout:0/319: creat d5/d18/f66 x:0 0 0 2024-08-19T00:56:14.772 INFO:tasks.workunit.client.1.smithi086.stdout:9/792: dread db/d26/d5c/d87/d37/fa4 [0,4194304] 0 2024-08-19T00:56:14.772 INFO:tasks.workunit.client.1.smithi086.stdout:5/789: unlink d0/d8/d94/fe6 0 2024-08-19T00:56:14.773 INFO:tasks.workunit.client.1.smithi086.stdout:9/793: stat db/d26/d5c/d87/d37/c59 0 2024-08-19T00:56:14.773 INFO:tasks.workunit.client.1.smithi086.stdout:5/790: chown d0/d99/dc0/dc2/c7e 0 1 2024-08-19T00:56:14.775 INFO:tasks.workunit.client.1.smithi086.stdout:5/791: write d0/df/d1f/d33/f96 [1336433,104013] 0 2024-08-19T00:56:14.775 INFO:tasks.workunit.client.1.smithi086.stdout:1/877: rename d4/d7/d2a/d6e/d95/db9/deb/fec to d4/d10/de8/f120 0 2024-08-19T00:56:14.777 INFO:tasks.workunit.client.0.smithi017.stdout:1/278: mknod d4/dc/d3b/d3d/c51 0 2024-08-19T00:56:14.777 INFO:tasks.workunit.client.1.smithi086.stdout:1/878: read d4/d7/d2a/f4d [1697615,53766] 0 2024-08-19T00:56:14.778 INFO:tasks.workunit.client.1.smithi086.stdout:1/879: chown d4/d10/l7f 62357030 1 2024-08-19T00:56:14.778 INFO:tasks.workunit.client.1.smithi086.stdout:0/801: rmdir da/d14/d1a/d2e/d39/d3b/d89 39 2024-08-19T00:56:14.779 INFO:tasks.workunit.client.0.smithi017.stdout:1/279: dread d4/dc/f38 [0,4194304] 0 2024-08-19T00:56:14.780 INFO:tasks.workunit.client.0.smithi017.stdout:1/280: write d4/dc/d3b/f4a [924535,97872] 0 2024-08-19T00:56:14.780 INFO:tasks.workunit.client.0.smithi017.stdout:4/327: write d2/f3c [647682,6422] 0 2024-08-19T00:56:14.781 INFO:tasks.workunit.client.1.smithi086.stdout:7/783: rmdir d3/d34/d44/d58/d4b/da5/daf 39 2024-08-19T00:56:14.781 INFO:tasks.workunit.client.0.smithi017.stdout:4/328: stat d2/d11/c49 0 2024-08-19T00:56:14.783 INFO:tasks.workunit.client.1.smithi086.stdout:2/809: symlink d8/d84/d79/l10b 0 2024-08-19T00:56:14.784 INFO:tasks.workunit.client.1.smithi086.stdout:4/747: sync 2024-08-19T00:56:14.788 INFO:tasks.workunit.client.1.smithi086.stdout:8/764: creat dc/d1f/d37/d4f/dac/db8/d8f/ffe x:0 0 0 2024-08-19T00:56:14.789 INFO:tasks.workunit.client.0.smithi017.stdout:5/259: symlink db/d19/l62 0 2024-08-19T00:56:14.789 INFO:tasks.workunit.client.1.smithi086.stdout:8/765: truncate dc/d1f/d37/d4f/dac/db8/d8f/fdc 16218 0 2024-08-19T00:56:14.791 INFO:tasks.workunit.client.0.smithi017.stdout:1/281: truncate d4/dc/d3b/f50 820826 0 2024-08-19T00:56:14.794 INFO:tasks.workunit.client.0.smithi017.stdout:6/334: dread d5/f42 [0,4194304] 0 2024-08-19T00:56:14.795 INFO:tasks.workunit.client.0.smithi017.stdout:4/329: dwrite d2/d21/d53/f5e [0,4194304] 0 2024-08-19T00:56:14.799 INFO:tasks.workunit.client.0.smithi017.stdout:2/411: rmdir d2/d7/d10/d35/d55/d65/d6b 39 2024-08-19T00:56:14.804 INFO:tasks.workunit.client.0.smithi017.stdout:4/330: dwrite d2/d11/d24/f4e [0,4194304] 0 2024-08-19T00:56:14.818 INFO:tasks.workunit.client.1.smithi086.stdout:1/880: creat d4/d1e/d6f/f121 x:0 0 0 2024-08-19T00:56:14.826 INFO:tasks.workunit.client.0.smithi017.stdout:5/260: write db/d19/d1f/f50 [4249714,64139] 0 2024-08-19T00:56:14.827 INFO:tasks.workunit.client.1.smithi086.stdout:3/775: write d3/d18/d27/d49/d3f/d5b/d66/f6a [5221485,51289] 0 2024-08-19T00:56:14.828 INFO:tasks.workunit.client.0.smithi017.stdout:2/412: symlink d2/d7/d44/l86 0 2024-08-19T00:56:14.828 INFO:tasks.workunit.client.1.smithi086.stdout:3/776: write d3/d26/d2b/f6d [5930,13339] 0 2024-08-19T00:56:14.834 INFO:tasks.workunit.client.0.smithi017.stdout:4/331: rmdir d2/d1a 39 2024-08-19T00:56:14.835 INFO:tasks.workunit.client.0.smithi017.stdout:6/335: dread d5/d13/d11/d2c/d51/f62 [0,4194304] 0 2024-08-19T00:56:14.836 INFO:tasks.workunit.client.0.smithi017.stdout:6/336: stat d5/d13/f6a 0 2024-08-19T00:56:14.837 INFO:tasks.workunit.client.1.smithi086.stdout:5/792: mkdir d0/d2d/d4f/df3 0 2024-08-19T00:56:14.838 INFO:tasks.workunit.client.0.smithi017.stdout:0/320: link d5/d17/d21/d42/c4f d5/d17/d21/d39/c67 0 2024-08-19T00:56:14.840 INFO:tasks.workunit.client.0.smithi017.stdout:9/324: dwrite d0/fc [0,4194304] 0 2024-08-19T00:56:14.845 INFO:tasks.workunit.client.0.smithi017.stdout:3/351: rename d5/d15/d53/l54 to d5/da/l64 0 2024-08-19T00:56:14.848 INFO:tasks.workunit.client.1.smithi086.stdout:2/810: mknod d8/c10c 0 2024-08-19T00:56:14.851 INFO:tasks.workunit.client.0.smithi017.stdout:0/321: creat d5/d17/d21/f68 x:0 0 0 2024-08-19T00:56:14.852 INFO:tasks.workunit.client.1.smithi086.stdout:0/802: dwrite da/d14/f99 [0,4194304] 0 2024-08-19T00:56:14.854 INFO:tasks.workunit.client.0.smithi017.stdout:0/322: write d5/d18/f1e [2397013,47636] 0 2024-08-19T00:56:14.855 INFO:tasks.workunit.client.1.smithi086.stdout:0/803: readlink da/d5d/df7/lf9 0 2024-08-19T00:56:14.856 INFO:tasks.workunit.client.1.smithi086.stdout:7/784: dwrite d3/d34/f76 [0,4194304] 0 2024-08-19T00:56:14.856 INFO:tasks.workunit.client.0.smithi017.stdout:4/332: dwrite d2/d1a/d20/f52 [0,4194304] 0 2024-08-19T00:56:14.857 INFO:tasks.workunit.client.1.smithi086.stdout:8/766: write dc/d17/d1e/fa1 [3487630,90197] 0 2024-08-19T00:56:14.857 INFO:tasks.workunit.client.0.smithi017.stdout:0/323: dread - d5/d17/d2b/f43 zero size 2024-08-19T00:56:14.859 INFO:tasks.workunit.client.0.smithi017.stdout:1/282: rename d4/dc/c48 to d4/dc/d19/c52 0 2024-08-19T00:56:14.860 INFO:tasks.workunit.client.1.smithi086.stdout:7/785: write d3/d34/f76 [3999156,104543] 0 2024-08-19T00:56:14.860 INFO:tasks.workunit.client.1.smithi086.stdout:0/804: dread da/d14/d1a/d2e/d30/d76/f9d [0,4194304] 0 2024-08-19T00:56:14.861 INFO:tasks.workunit.client.1.smithi086.stdout:1/881: symlink d4/d7/d2a/d36/d63/l122 0 2024-08-19T00:56:14.862 INFO:tasks.workunit.client.1.smithi086.stdout:0/805: chown da/d14/d1a/d2e/d66/c84 4040 1 2024-08-19T00:56:14.864 INFO:tasks.workunit.client.0.smithi017.stdout:0/324: dread d5/f1c [0,4194304] 0 2024-08-19T00:56:14.868 INFO:tasks.workunit.client.0.smithi017.stdout:1/283: dwrite d4/dc/d3b/f4a [0,4194304] 0 2024-08-19T00:56:14.869 INFO:tasks.workunit.client.1.smithi086.stdout:2/811: write d8/ff [548977,32152] 0 2024-08-19T00:56:14.871 INFO:tasks.workunit.client.0.smithi017.stdout:3/352: dread d5/d11/f14 [0,4194304] 0 2024-08-19T00:56:14.872 INFO:tasks.workunit.client.0.smithi017.stdout:3/353: fdatasync d5/d18/f45 0 2024-08-19T00:56:14.872 INFO:tasks.workunit.client.0.smithi017.stdout:3/354: symlink d5/da/d3c/l65 2 2024-08-19T00:56:14.872 INFO:tasks.workunit.client.1.smithi086.stdout:9/794: link db/l76 db/dd/de2/dee/def/lfa 0 2024-08-19T00:56:14.873 INFO:tasks.workunit.client.0.smithi017.stdout:1/284: dread d4/dc/d3b/f50 [0,4194304] 0 2024-08-19T00:56:14.877 INFO:tasks.workunit.client.1.smithi086.stdout:3/777: dwrite d3/d18/d1a/d51/d9b/fab [0,4194304] 0 2024-08-19T00:56:14.877 INFO:tasks.workunit.client.1.smithi086.stdout:6/802: sync 2024-08-19T00:56:14.880 INFO:tasks.workunit.client.0.smithi017.stdout:1/285: dread d4/dc/d3b/f4a [0,4194304] 0 2024-08-19T00:56:14.881 INFO:tasks.workunit.client.0.smithi017.stdout:4/333: mkdir d2/d1a/d55/d6a 0 2024-08-19T00:56:14.881 INFO:tasks.workunit.client.1.smithi086.stdout:6/803: read db/f2b [3472487,115157] 0 2024-08-19T00:56:14.882 INFO:tasks.workunit.client.1.smithi086.stdout:8/767: dread - dc/d1f/df0/fb6 zero size 2024-08-19T00:56:14.883 INFO:tasks.workunit.client.0.smithi017.stdout:4/334: truncate d2/d11/f36 503101 0 2024-08-19T00:56:14.884 INFO:tasks.workunit.client.1.smithi086.stdout:2/812: dread d8/d43/d65/fb0 [0,4194304] 0 2024-08-19T00:56:14.884 INFO:tasks.workunit.client.1.smithi086.stdout:8/768: fsync dc/d1f/d37/d4f/fee 0 2024-08-19T00:56:14.885 INFO:tasks.workunit.client.1.smithi086.stdout:8/769: readlink dc/d1f/d37/d9f/ld2 0 2024-08-19T00:56:14.887 INFO:tasks.workunit.client.0.smithi017.stdout:0/325: creat d5/d17/f69 x:0 0 0 2024-08-19T00:56:14.888 INFO:tasks.workunit.client.1.smithi086.stdout:0/806: rename da/d14/d55/fef to da/d5d/da9/fff 0 2024-08-19T00:56:14.889 INFO:tasks.workunit.client.0.smithi017.stdout:6/337: creat d5/d13/d11/f72 x:0 0 0 2024-08-19T00:56:14.891 INFO:tasks.workunit.client.0.smithi017.stdout:5/261: truncate db/ff 3398417 0 2024-08-19T00:56:14.892 INFO:tasks.workunit.client.0.smithi017.stdout:5/262: stat db/d19/d57/f61 0 2024-08-19T00:56:14.896 INFO:tasks.workunit.client.0.smithi017.stdout:0/326: dwrite d5/d17/d26/d30/f54 [0,4194304] 0 2024-08-19T00:56:14.899 INFO:tasks.workunit.client.0.smithi017.stdout:3/355: truncate d5/da/d27/f3a 515526 0 2024-08-19T00:56:14.902 INFO:tasks.workunit.client.0.smithi017.stdout:1/286: rmdir d4/dc/d17 39 2024-08-19T00:56:14.902 INFO:tasks.workunit.client.1.smithi086.stdout:7/786: dwrite d3/d34/d44/d58/d4b/da5/f9b [0,4194304] 0 2024-08-19T00:56:14.902 INFO:tasks.workunit.client.1.smithi086.stdout:6/804: symlink db/d37/d44/d5a/lfe 0 2024-08-19T00:56:14.903 INFO:tasks.workunit.client.1.smithi086.stdout:7/787: stat d3/f97 0 2024-08-19T00:56:14.904 INFO:tasks.workunit.client.0.smithi017.stdout:4/335: mkdir d2/d11/d6b 0 2024-08-19T00:56:14.906 INFO:tasks.workunit.client.0.smithi017.stdout:0/327: dwrite d5/d17/d26/d30/f63 [0,4194304] 0 2024-08-19T00:56:14.908 INFO:tasks.workunit.client.0.smithi017.stdout:0/328: chown d5/d17/d21/f55 379142 1 2024-08-19T00:56:14.910 INFO:tasks.workunit.client.0.smithi017.stdout:6/338: write d5/d13/f3e [1381913,93944] 0 2024-08-19T00:56:14.912 INFO:tasks.workunit.client.1.smithi086.stdout:0/807: symlink da/d14/d44/d7b/l100 0 2024-08-19T00:56:14.915 INFO:tasks.workunit.client.0.smithi017.stdout:9/325: creat d0/d33/d22/d5a/f5f x:0 0 0 2024-08-19T00:56:14.916 INFO:tasks.workunit.client.0.smithi017.stdout:9/326: stat d0/c4b 0 2024-08-19T00:56:14.916 INFO:tasks.workunit.client.0.smithi017.stdout:3/356: symlink d5/da/d27/l66 0 2024-08-19T00:56:14.919 INFO:tasks.workunit.client.0.smithi017.stdout:3/357: dread - d5/d11/d61/f63 zero size 2024-08-19T00:56:14.920 INFO:tasks.workunit.client.0.smithi017.stdout:4/336: creat d2/d21/d40/f6c x:0 0 0 2024-08-19T00:56:14.922 INFO:tasks.workunit.client.0.smithi017.stdout:6/339: dwrite d5/d13/d11/f59 [0,4194304] 0 2024-08-19T00:56:14.922 INFO:tasks.workunit.client.1.smithi086.stdout:3/778: getdents d3/d26/d2b/d33/d4a/d78 0 2024-08-19T00:56:14.924 INFO:tasks.workunit.client.0.smithi017.stdout:5/263: mkdir db/d19/d1f/d15/d3e/d40/d49/d63 0 2024-08-19T00:56:14.925 INFO:tasks.workunit.client.1.smithi086.stdout:6/805: dread db/f14 [4194304,4194304] 0 2024-08-19T00:56:14.926 INFO:tasks.workunit.client.1.smithi086.stdout:6/806: fdatasync db/d34/d39/f40 0 2024-08-19T00:56:14.926 INFO:tasks.workunit.client.0.smithi017.stdout:3/358: dread d5/da/fd [0,4194304] 0 2024-08-19T00:56:14.928 INFO:tasks.workunit.client.0.smithi017.stdout:3/359: dread - d5/da/f48 zero size 2024-08-19T00:56:14.929 INFO:tasks.workunit.client.1.smithi086.stdout:2/813: mknod d8/d2c/d38/d80/db4/c10d 0 2024-08-19T00:56:14.929 INFO:tasks.workunit.client.1.smithi086.stdout:2/814: chown d8/d43/d65/f70 718 1 2024-08-19T00:56:14.932 INFO:tasks.workunit.client.0.smithi017.stdout:1/287: truncate d4/f14 197060 0 2024-08-19T00:56:14.933 INFO:tasks.workunit.client.1.smithi086.stdout:0/808: rename da/d14/d55/l9a to da/d14/d1a/d2e/d39/d3b/d4e/dda/dea/l101 0 2024-08-19T00:56:14.934 INFO:tasks.workunit.client.0.smithi017.stdout:5/264: dwrite db/d19/d1f/d15/d1e/f3d [0,4194304] 0 2024-08-19T00:56:14.935 INFO:tasks.workunit.client.1.smithi086.stdout:0/809: stat da/d14/d1a/d2e/d7e/dd7/ffe 0 2024-08-19T00:56:14.936 INFO:tasks.workunit.client.1.smithi086.stdout:3/779: unlink d3/d26/dba/ff9 0 2024-08-19T00:56:14.937 INFO:tasks.workunit.client.1.smithi086.stdout:1/882: truncate d4/d7/d2a/d36/d3a/de5/d7a/f10d 451164 0 2024-08-19T00:56:14.937 INFO:tasks.workunit.client.0.smithi017.stdout:6/340: creat d5/d13/d11/d2c/f73 x:0 0 0 2024-08-19T00:56:14.938 INFO:tasks.workunit.client.1.smithi086.stdout:8/770: dwrite dc/d1f/d37/d4f/dac/db8/d7a/d9b/f71 [0,4194304] 0 2024-08-19T00:56:14.940 INFO:tasks.workunit.client.1.smithi086.stdout:7/788: fsync d3/de/fa6 0 2024-08-19T00:56:14.941 INFO:tasks.workunit.client.1.smithi086.stdout:9/795: truncate db/d26/d5c/d87/d30/d32/d44/d67/f90 5108828 0 2024-08-19T00:56:14.943 INFO:tasks.workunit.client.1.smithi086.stdout:5/793: sync 2024-08-19T00:56:14.943 INFO:tasks.workunit.client.1.smithi086.stdout:4/748: sync 2024-08-19T00:56:14.948 INFO:tasks.workunit.client.1.smithi086.stdout:2/815: dwrite d8/d43/dd5/fff [0,4194304] 0 2024-08-19T00:56:14.950 INFO:tasks.workunit.client.1.smithi086.stdout:0/810: mkdir da/d14/d55/dac/d102 0 2024-08-19T00:56:14.951 INFO:tasks.workunit.client.1.smithi086.stdout:0/811: stat da/d14/f1d 0 2024-08-19T00:56:14.951 INFO:tasks.workunit.client.0.smithi017.stdout:0/329: dwrite d5/f10 [0,4194304] 0 2024-08-19T00:56:14.952 INFO:tasks.workunit.client.0.smithi017.stdout:0/330: readlink d5/l8 0 2024-08-19T00:56:14.953 INFO:tasks.workunit.client.1.smithi086.stdout:0/812: stat da/d14/d44/d49/l58 0 2024-08-19T00:56:14.955 INFO:tasks.workunit.client.1.smithi086.stdout:0/813: write da/d14/d1a/d2e/d39/d3b/f70 [2555860,2300] 0 2024-08-19T00:56:14.956 INFO:tasks.workunit.client.1.smithi086.stdout:3/780: chown d3/d26/d2b/l3d 23 1 2024-08-19T00:56:14.958 INFO:tasks.workunit.client.0.smithi017.stdout:4/337: mkdir d2/d1a/d55/d64/d6d 0 2024-08-19T00:56:14.959 INFO:tasks.workunit.client.1.smithi086.stdout:1/883: creat d4/d7/d2a/d36/d3a/de5/d7a/db4/f123 x:0 0 0 2024-08-19T00:56:14.961 INFO:tasks.workunit.client.0.smithi017.stdout:6/341: readlink d5/l23 0 2024-08-19T00:56:14.963 INFO:tasks.workunit.client.0.smithi017.stdout:9/327: creat d0/f60 x:0 0 0 2024-08-19T00:56:14.964 INFO:tasks.workunit.client.0.smithi017.stdout:9/328: fdatasync d0/fc 0 2024-08-19T00:56:14.964 INFO:tasks.workunit.client.1.smithi086.stdout:8/771: mkdir dc/d16/dc7/dff 0 2024-08-19T00:56:14.968 INFO:tasks.workunit.client.1.smithi086.stdout:7/789: creat d3/de/d68/d7d/f102 x:0 0 0 2024-08-19T00:56:14.969 INFO:tasks.workunit.client.1.smithi086.stdout:5/794: truncate d0/d2d/f32 764722 0 2024-08-19T00:56:14.970 INFO:tasks.workunit.client.0.smithi017.stdout:4/338: rename d2/f29 to d2/d21/d53/d57/f6e 0 2024-08-19T00:56:14.972 INFO:tasks.workunit.client.0.smithi017.stdout:6/342: mknod d5/d13/d11/d4d/c74 0 2024-08-19T00:56:14.974 INFO:tasks.workunit.client.1.smithi086.stdout:2/816: creat d8/d43/d65/f10e x:0 0 0 2024-08-19T00:56:14.977 INFO:tasks.workunit.client.1.smithi086.stdout:3/781: chown d3/d18/d1a/fdd 1 1 2024-08-19T00:56:14.979 INFO:tasks.workunit.client.0.smithi017.stdout:0/331: mknod d5/d17/d26/d30/d3e/d5a/c6a 0 2024-08-19T00:56:14.980 INFO:tasks.workunit.client.0.smithi017.stdout:6/343: dwrite d5/d13/f6a [0,4194304] 0 2024-08-19T00:56:14.984 INFO:tasks.workunit.client.0.smithi017.stdout:4/339: creat d2/d16/f6f x:0 0 0 2024-08-19T00:56:14.987 INFO:tasks.workunit.client.0.smithi017.stdout:0/332: dread d5/d17/d26/d30/f63 [0,4194304] 0 2024-08-19T00:56:14.987 INFO:tasks.workunit.client.0.smithi017.stdout:3/360: link d5/d15/l22 d5/l67 0 2024-08-19T00:56:14.989 INFO:tasks.workunit.client.1.smithi086.stdout:5/795: creat d0/d5f/d60/d5b/ff4 x:0 0 0 2024-08-19T00:56:14.991 INFO:tasks.workunit.client.1.smithi086.stdout:4/749: creat d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd/ffb x:0 0 0 2024-08-19T00:56:14.992 INFO:tasks.workunit.client.1.smithi086.stdout:9/796: dread db/dd/ff [0,4194304] 0 2024-08-19T00:56:14.995 INFO:tasks.workunit.client.1.smithi086.stdout:3/782: creat d3/d9/f102 x:0 0 0 2024-08-19T00:56:14.995 INFO:tasks.workunit.client.0.smithi017.stdout:1/288: dread d4/f14 [0,4194304] 0 2024-08-19T00:56:14.997 INFO:tasks.workunit.client.0.smithi017.stdout:6/344: rename d5/d13/d11/fa to d5/d13/d20/d5e/f75 0 2024-08-19T00:56:14.998 INFO:tasks.workunit.client.0.smithi017.stdout:6/345: chown d5/d13/d11/d4d/c55 34 1 2024-08-19T00:56:15.000 INFO:tasks.workunit.client.1.smithi086.stdout:6/807: getdents db/d37/d28/d7f/d96/dd9 0 2024-08-19T00:56:15.004 INFO:tasks.workunit.client.1.smithi086.stdout:8/772: rename dc/d17/c21 to dc/d17/d86/c100 0 2024-08-19T00:56:15.006 INFO:tasks.workunit.client.1.smithi086.stdout:5/796: creat d0/d2d/d4f/ff5 x:0 0 0 2024-08-19T00:56:15.008 INFO:tasks.workunit.client.1.smithi086.stdout:6/808: dwrite db/d34/d4e/db4/fde [0,4194304] 0 2024-08-19T00:56:15.009 INFO:tasks.workunit.client.0.smithi017.stdout:4/340: rename d2/d1a/d55/d64/d6d to d2/d16/d70 0 2024-08-19T00:56:15.010 INFO:tasks.workunit.client.1.smithi086.stdout:4/750: readlink d2/lb8 0 2024-08-19T00:56:15.012 INFO:tasks.workunit.client.0.smithi017.stdout:6/346: rmdir d5/d13/d11/d2c/d4a/d64 39 2024-08-19T00:56:15.013 INFO:tasks.workunit.client.1.smithi086.stdout:5/797: dwrite d0/df/d1f/d33/fc7 [0,4194304] 0 2024-08-19T00:56:15.013 INFO:tasks.workunit.client.0.smithi017.stdout:1/289: dwrite d4/f14 [0,4194304] 0 2024-08-19T00:56:15.014 INFO:tasks.workunit.client.1.smithi086.stdout:2/817: symlink d8/d43/l10f 0 2024-08-19T00:56:15.014 INFO:tasks.workunit.client.1.smithi086.stdout:5/798: write d0/df/d1f/fb3 [1362097,103756] 0 2024-08-19T00:56:15.016 INFO:tasks.workunit.client.0.smithi017.stdout:0/333: symlink d5/d17/d26/d30/d5d/l6b 0 2024-08-19T00:56:15.016 INFO:tasks.workunit.client.1.smithi086.stdout:5/799: chown d0/d99/dc0/dc2/f87 974784715 1 2024-08-19T00:56:15.023 INFO:tasks.workunit.client.1.smithi086.stdout:0/814: chown da/d14/d1a/d2e/d39/d3b/d89/dc5/fba 16 1 2024-08-19T00:56:15.024 INFO:tasks.workunit.client.1.smithi086.stdout:7/790: rename d3/d34/d44/d58/d4b/da5/daf/de7/df5/f100 to d3/d34/df2/f103 0 2024-08-19T00:56:15.025 INFO:tasks.workunit.client.0.smithi017.stdout:6/347: rmdir d5/d13/d20 39 2024-08-19T00:56:15.026 INFO:tasks.workunit.client.1.smithi086.stdout:1/884: dwrite d4/d10/f51 [0,4194304] 0 2024-08-19T00:56:15.026 INFO:tasks.workunit.client.1.smithi086.stdout:8/773: mknod dc/d1f/c101 0 2024-08-19T00:56:15.027 INFO:tasks.workunit.client.0.smithi017.stdout:1/290: stat d4/dc/d17/d1d/c33 0 2024-08-19T00:56:15.030 INFO:tasks.workunit.client.0.smithi017.stdout:9/329: truncate d0/d33/f30 509683 0 2024-08-19T00:56:15.032 INFO:tasks.workunit.client.1.smithi086.stdout:6/809: rmdir db/d37/d28 39 2024-08-19T00:56:15.033 INFO:tasks.workunit.client.1.smithi086.stdout:7/791: dwrite d3/de/d68/d72/d7e/dca/dcb/fec [0,4194304] 0 2024-08-19T00:56:15.034 INFO:tasks.workunit.client.0.smithi017.stdout:6/348: creat d5/d13/d11/d2c/f76 x:0 0 0 2024-08-19T00:56:15.036 INFO:tasks.workunit.client.0.smithi017.stdout:6/349: write d5/d13/d11/f3b [420464,121495] 0 2024-08-19T00:56:15.037 INFO:tasks.workunit.client.0.smithi017.stdout:1/291: creat d4/dc/d19/f53 x:0 0 0 2024-08-19T00:56:15.038 INFO:tasks.workunit.client.0.smithi017.stdout:9/330: dwrite d0/f60 [0,4194304] 0 2024-08-19T00:56:15.039 INFO:tasks.workunit.client.1.smithi086.stdout:4/751: dwrite d2/d18/d33/d42/d72/d78/d25/d55/d4d/f6a [0,4194304] 0 2024-08-19T00:56:15.079 INFO:tasks.workunit.client.0.smithi017.stdout:0/334: symlink d5/l6c 0 2024-08-19T00:56:15.083 INFO:tasks.workunit.client.0.smithi017.stdout:1/292: dwrite d4/dc/f11 [4194304,4194304] 0 2024-08-19T00:56:15.118 INFO:tasks.workunit.client.0.smithi017.stdout:0/335: mknod d5/d17/d26/d30/c6d 0 2024-08-19T00:56:15.121 INFO:tasks.workunit.client.0.smithi017.stdout:6/350: mkdir d5/d13/d20/d77 0 2024-08-19T00:56:15.122 INFO:tasks.workunit.client.0.smithi017.stdout:4/341: dwrite d2/f12 [4194304,4194304] 0 2024-08-19T00:56:15.123 INFO:tasks.workunit.client.0.smithi017.stdout:0/336: symlink d5/d17/d21/d39/l6e 0 2024-08-19T00:56:15.128 INFO:tasks.workunit.client.0.smithi017.stdout:6/351: unlink d5/d13/f6a 0 2024-08-19T00:56:15.129 INFO:tasks.workunit.client.1.smithi086.stdout:0/815: readlink da/d14/d44/lc9 0 2024-08-19T00:56:15.131 INFO:tasks.workunit.client.0.smithi017.stdout:4/342: rename d2/d21/d40/d56/c67 to d2/d1a/d20/c71 0 2024-08-19T00:56:15.132 INFO:tasks.workunit.client.0.smithi017.stdout:4/343: write d2/d16/f38 [4203809,100710] 0 2024-08-19T00:56:15.132 INFO:tasks.workunit.client.0.smithi017.stdout:4/344: chown d2/d1a/d55/d64 10 1 2024-08-19T00:56:15.133 INFO:tasks.workunit.client.0.smithi017.stdout:0/337: symlink d5/d17/d26/d30/d5d/l6f 0 2024-08-19T00:56:15.139 INFO:tasks.workunit.client.1.smithi086.stdout:7/792: symlink d3/d34/d44/d58/l104 0 2024-08-19T00:56:15.140 INFO:tasks.workunit.client.1.smithi086.stdout:2/818: mknod d8/c110 0 2024-08-19T00:56:15.143 INFO:tasks.workunit.client.0.smithi017.stdout:4/345: link d2/d1a/d20/f3b d2/d11/f72 0 2024-08-19T00:56:15.144 INFO:tasks.workunit.client.0.smithi017.stdout:4/346: fsync d2/d21/d40/d56/f47 0 2024-08-19T00:56:15.144 INFO:tasks.workunit.client.1.smithi086.stdout:7/793: dread d3/d34/d44/d58/d4b/d78/fc9 [0,4194304] 0 2024-08-19T00:56:15.144 INFO:tasks.workunit.client.0.smithi017.stdout:0/338: link d5/fa d5/d18/d3a/f70 0 2024-08-19T00:56:15.149 INFO:tasks.workunit.client.0.smithi017.stdout:4/347: mkdir d2/d1a/d55/d73 0 2024-08-19T00:56:15.151 INFO:tasks.workunit.client.0.smithi017.stdout:6/352: getdents d5/d13/d11/d2c/d51 0 2024-08-19T00:56:15.154 INFO:tasks.workunit.client.0.smithi017.stdout:0/339: link d5/d17/d2b/f43 d5/d17/d26/d30/f71 0 2024-08-19T00:56:15.154 INFO:tasks.workunit.client.0.smithi017.stdout:6/353: creat d5/d13/d11/d2c/f78 x:0 0 0 2024-08-19T00:56:15.157 INFO:tasks.workunit.client.0.smithi017.stdout:4/348: truncate d2/d27/f62 733146 0 2024-08-19T00:56:15.157 INFO:tasks.workunit.client.0.smithi017.stdout:4/349: dread - d2/d11/f63 zero size 2024-08-19T00:56:15.161 INFO:tasks.workunit.client.0.smithi017.stdout:0/340: creat d5/d17/d45/f72 x:0 0 0 2024-08-19T00:56:15.167 INFO:tasks.workunit.client.0.smithi017.stdout:0/341: creat d5/d17/d45/d50/f73 x:0 0 0 2024-08-19T00:56:15.169 INFO:tasks.workunit.client.0.smithi017.stdout:6/354: dread d5/d13/d11/d2c/f46 [0,4194304] 0 2024-08-19T00:56:15.169 INFO:tasks.workunit.client.0.smithi017.stdout:0/342: fdatasync d5/d17/d21/f2d 0 2024-08-19T00:56:15.173 INFO:tasks.workunit.client.0.smithi017.stdout:0/343: rename d5/d17/d2b/f3f to d5/d17/d2b/f74 0 2024-08-19T00:56:15.174 INFO:tasks.workunit.client.0.smithi017.stdout:6/355: symlink d5/d13/d11/d2c/d4a/d64/l79 0 2024-08-19T00:56:15.180 INFO:tasks.workunit.client.1.smithi086.stdout:9/797: link db/d26/d5c/d87/d30/d31/cc3 db/d26/d5c/d87/d30/d58/cfb 0 2024-08-19T00:56:15.181 INFO:tasks.workunit.client.1.smithi086.stdout:3/783: getdents d3/d18/d19/d37/d3a 0 2024-08-19T00:56:15.183 INFO:tasks.workunit.client.1.smithi086.stdout:1/885: creat d4/d7/d2a/d36/d7d/f124 x:0 0 0 2024-08-19T00:56:15.183 INFO:tasks.workunit.client.1.smithi086.stdout:6/810: getdents db/d37/d28/d7f/d96/dd9 0 2024-08-19T00:56:15.184 INFO:tasks.workunit.client.1.smithi086.stdout:1/886: chown d4/d10/d90/d98/fbd 222 1 2024-08-19T00:56:15.184 INFO:tasks.workunit.client.1.smithi086.stdout:4/752: creat d2/d18/d33/d42/ffc x:0 0 0 2024-08-19T00:56:15.185 INFO:tasks.workunit.client.1.smithi086.stdout:1/887: chown d4/d7/d2a/d36/d50/ld4 33968314 1 2024-08-19T00:56:15.185 INFO:tasks.workunit.client.1.smithi086.stdout:8/774: creat dc/d16/dc7/d2e/d28/d2b/d3b/d87/f102 x:0 0 0 2024-08-19T00:56:15.186 INFO:tasks.workunit.client.1.smithi086.stdout:7/794: mknod d3/de/c105 0 2024-08-19T00:56:15.187 INFO:tasks.workunit.client.1.smithi086.stdout:6/811: fsync db/d8e/fbc 0 2024-08-19T00:56:15.189 INFO:tasks.workunit.client.1.smithi086.stdout:2/819: link d8/d24/d32/d4d/d6a/fb2 d8/d43/d77/f111 0 2024-08-19T00:56:15.189 INFO:tasks.workunit.client.1.smithi086.stdout:1/888: chown d4/d7/d2a/d36/d3a/l46 27740 1 2024-08-19T00:56:15.189 INFO:tasks.workunit.client.1.smithi086.stdout:9/798: creat db/dd/de2/dee/def/ffc x:0 0 0 2024-08-19T00:56:15.190 INFO:tasks.workunit.client.1.smithi086.stdout:3/784: mknod d3/d18/d19/d37/c103 0 2024-08-19T00:56:15.190 INFO:tasks.workunit.client.1.smithi086.stdout:6/812: write db/d8e/fd6 [1134345,1605] 0 2024-08-19T00:56:15.191 INFO:tasks.workunit.client.1.smithi086.stdout:7/795: mknod d3/de/d2d/c106 0 2024-08-19T00:56:15.192 INFO:tasks.workunit.client.1.smithi086.stdout:1/889: mkdir d4/d7/d125 0 2024-08-19T00:56:15.193 INFO:tasks.workunit.client.1.smithi086.stdout:8/775: creat dc/d1f/d37/d60/f103 x:0 0 0 2024-08-19T00:56:15.196 INFO:tasks.workunit.client.1.smithi086.stdout:4/753: link d2/d18/d33/d42/d72/d78/d25/fa6 d2/d18/d33/d42/d72/d78/d9e/dc6/ffd 0 2024-08-19T00:56:15.196 INFO:tasks.workunit.client.1.smithi086.stdout:0/816: dread da/fe [0,4194304] 0 2024-08-19T00:56:15.197 INFO:tasks.workunit.client.1.smithi086.stdout:9/799: creat db/d26/d5c/d87/d30/d3f/d43/ffd x:0 0 0 2024-08-19T00:56:15.198 INFO:tasks.workunit.client.1.smithi086.stdout:6/813: creat db/d34/d4e/d68/d99/dce/fff x:0 0 0 2024-08-19T00:56:15.199 INFO:tasks.workunit.client.1.smithi086.stdout:8/776: truncate dc/d16/d18/fa6 29198 0 2024-08-19T00:56:15.199 INFO:tasks.workunit.client.1.smithi086.stdout:2/820: getdents d8/d2c/d38/d80/db4/db7 0 2024-08-19T00:56:15.200 INFO:tasks.workunit.client.1.smithi086.stdout:4/754: symlink d2/d18/d33/d42/d72/d78/de6/lfe 0 2024-08-19T00:56:15.202 INFO:tasks.workunit.client.1.smithi086.stdout:7/796: getdents d3/d34/d44/d58/d4b/da5/daf/de7 0 2024-08-19T00:56:15.204 INFO:tasks.workunit.client.1.smithi086.stdout:8/777: write dc/d16/dc7/d2e/d28/d41/d9a/fdb [709230,93173] 0 2024-08-19T00:56:15.205 INFO:tasks.workunit.client.1.smithi086.stdout:2/821: mknod d8/d2c/d38/d80/db4/c112 0 2024-08-19T00:56:15.208 INFO:tasks.workunit.client.1.smithi086.stdout:2/822: readlink d8/d2c/d38/d80/dca/l105 0 2024-08-19T00:56:15.208 INFO:tasks.workunit.client.1.smithi086.stdout:4/755: symlink d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/lff 0 2024-08-19T00:56:15.209 INFO:tasks.workunit.client.1.smithi086.stdout:7/797: fdatasync d3/d34/d44/d58/d4b/da5/f5d 0 2024-08-19T00:56:15.211 INFO:tasks.workunit.client.1.smithi086.stdout:1/890: dread d4/d7/d2a/f6b [0,4194304] 0 2024-08-19T00:56:15.211 INFO:tasks.workunit.client.1.smithi086.stdout:2/823: chown d8/d2c/d38/d96/f103 1018 1 2024-08-19T00:56:15.213 INFO:tasks.workunit.client.0.smithi017.stdout:4/350: read d2/d21/d40/d56/f47 [1583030,124817] 0 2024-08-19T00:56:15.214 INFO:tasks.workunit.client.0.smithi017.stdout:4/351: write d2/d21/d40/f4c [3284483,98929] 0 2024-08-19T00:56:15.220 INFO:tasks.workunit.client.1.smithi086.stdout:0/817: dread da/d14/d26/f29 [0,4194304] 0 2024-08-19T00:56:15.221 INFO:tasks.workunit.client.1.smithi086.stdout:7/798: creat d3/de/d68/f107 x:0 0 0 2024-08-19T00:56:15.222 INFO:tasks.workunit.client.1.smithi086.stdout:3/785: dread d3/d18/d27/d49/d3f/d5b/fa7 [0,4194304] 0 2024-08-19T00:56:15.222 INFO:tasks.workunit.client.0.smithi017.stdout:4/352: dwrite d2/d11/f59 [0,4194304] 0 2024-08-19T00:56:15.222 INFO:tasks.workunit.client.1.smithi086.stdout:6/814: dread db/f14 [0,4194304] 0 2024-08-19T00:56:15.224 INFO:tasks.workunit.client.1.smithi086.stdout:5/800: dwrite d0/df/f23 [0,4194304] 0 2024-08-19T00:56:15.224 INFO:tasks.workunit.client.1.smithi086.stdout:6/815: stat db/f46 0 2024-08-19T00:56:15.225 INFO:tasks.workunit.client.0.smithi017.stdout:4/353: fdatasync d2/d27/f62 0 2024-08-19T00:56:15.225 INFO:tasks.workunit.client.1.smithi086.stdout:2/824: dread d8/d24/d32/f9d [0,4194304] 0 2024-08-19T00:56:15.227 INFO:tasks.workunit.client.1.smithi086.stdout:5/801: read d0/df/d1f/d33/fc7 [4139707,9920] 0 2024-08-19T00:56:15.229 INFO:tasks.workunit.client.1.smithi086.stdout:7/799: mkdir d3/da1/d108 0 2024-08-19T00:56:15.230 INFO:tasks.workunit.client.1.smithi086.stdout:0/818: creat da/d5d/f103 x:0 0 0 2024-08-19T00:56:15.230 INFO:tasks.workunit.client.1.smithi086.stdout:8/778: dread dc/d1f/d37/d4f/dac/db8/fe6 [0,4194304] 0 2024-08-19T00:56:15.233 INFO:tasks.workunit.client.0.smithi017.stdout:4/354: link d2/d21/d40/d56/f47 d2/d21/d53/f74 0 2024-08-19T00:56:15.233 INFO:tasks.workunit.client.1.smithi086.stdout:2/825: stat d8/d2c/d38/d80/la8 0 2024-08-19T00:56:15.234 INFO:tasks.workunit.client.0.smithi017.stdout:4/355: chown d2/d21/d40/d56/f47 77615 1 2024-08-19T00:56:15.234 INFO:tasks.workunit.client.1.smithi086.stdout:4/756: dread d2/f21 [0,4194304] 0 2024-08-19T00:56:15.235 INFO:tasks.workunit.client.1.smithi086.stdout:7/800: creat d3/d34/df2/f109 x:0 0 0 2024-08-19T00:56:15.240 INFO:tasks.workunit.client.1.smithi086.stdout:3/786: unlink d3/d18/d27/d49/d3f/d5b/d66/f6a 0 2024-08-19T00:56:15.241 INFO:tasks.workunit.client.0.smithi017.stdout:4/356: mknod d2/d21/d53/d5a/c75 0 2024-08-19T00:56:15.243 INFO:tasks.workunit.client.0.smithi017.stdout:4/357: chown d2/d1a/d20/c71 35489 1 2024-08-19T00:56:15.244 INFO:tasks.workunit.client.1.smithi086.stdout:2/826: creat d8/d24/f113 x:0 0 0 2024-08-19T00:56:15.245 INFO:tasks.workunit.client.1.smithi086.stdout:4/757: dread - d2/d18/d33/d42/d72/d78/d25/d30/d5d/f79 zero size 2024-08-19T00:56:15.246 INFO:tasks.workunit.client.1.smithi086.stdout:7/801: rename d3/de/d68/d7d/dd3 to d3/d34/d10a 0 2024-08-19T00:56:15.249 INFO:tasks.workunit.client.1.smithi086.stdout:3/787: mkdir d3/d18/d1a/d51/dad/dee/d104 0 2024-08-19T00:56:15.249 INFO:tasks.workunit.client.1.smithi086.stdout:5/802: mkdir d0/d99/da2/dde/df6 0 2024-08-19T00:56:15.255 INFO:tasks.workunit.client.1.smithi086.stdout:3/788: symlink d3/d9/l105 0 2024-08-19T00:56:15.256 INFO:tasks.workunit.client.1.smithi086.stdout:2/827: dwrite d8/d14/f88 [0,4194304] 0 2024-08-19T00:56:15.257 INFO:tasks.workunit.client.1.smithi086.stdout:0/819: getdents da/d14/d1a/d2e/d39 0 2024-08-19T00:56:15.258 INFO:tasks.workunit.client.1.smithi086.stdout:3/789: mkdir d3/d18/d27/d106 0 2024-08-19T00:56:15.258 INFO:tasks.workunit.client.1.smithi086.stdout:2/828: dread - d8/d43/d77/dcc/f104 zero size 2024-08-19T00:56:15.259 INFO:tasks.workunit.client.1.smithi086.stdout:3/790: fdatasync d3/d18/d19/d37/fae 0 2024-08-19T00:56:15.262 INFO:tasks.workunit.client.1.smithi086.stdout:2/829: chown d8/d2c/d47/ff1 2297 1 2024-08-19T00:56:15.266 INFO:tasks.workunit.client.0.smithi017.stdout:6/356: truncate d5/d13/d20/f27 284682 0 2024-08-19T00:56:15.266 INFO:tasks.workunit.client.1.smithi086.stdout:2/830: stat d8/lc3 0 2024-08-19T00:56:15.267 INFO:tasks.workunit.client.1.smithi086.stdout:3/791: creat d3/d18/d27/d49/d3f/d5b/d8f/f107 x:0 0 0 2024-08-19T00:56:15.268 INFO:tasks.workunit.client.0.smithi017.stdout:6/357: rename d5/d13/d11/c4c to d5/d13/d20/d77/c7a 0 2024-08-19T00:56:15.270 INFO:tasks.workunit.client.1.smithi086.stdout:3/792: dwrite d3/d18/d19/dbc/de1/ff4 [0,4194304] 0 2024-08-19T00:56:15.273 INFO:tasks.workunit.client.1.smithi086.stdout:2/831: getdents d8/d14/d9e 0 2024-08-19T00:56:15.275 INFO:tasks.workunit.client.1.smithi086.stdout:3/793: fsync d3/d18/d61/d85/f8c 0 2024-08-19T00:56:15.276 INFO:tasks.workunit.client.1.smithi086.stdout:4/758: dread d2/d18/d33/d42/d72/d78/d25/d55/d4d/fcf [0,4194304] 0 2024-08-19T00:56:15.276 INFO:tasks.workunit.client.1.smithi086.stdout:3/794: truncate d3/d18/d1a/f34 1878444 0 2024-08-19T00:56:15.277 INFO:tasks.workunit.client.1.smithi086.stdout:2/832: mkdir d8/d84/de0/d114 0 2024-08-19T00:56:15.285 INFO:tasks.workunit.client.1.smithi086.stdout:9/800: write db/f57 [4675125,29643] 0 2024-08-19T00:56:15.285 INFO:tasks.workunit.client.1.smithi086.stdout:2/833: mknod d8/d43/d77/c115 0 2024-08-19T00:56:15.288 INFO:tasks.workunit.client.1.smithi086.stdout:9/801: creat db/ffe x:0 0 0 2024-08-19T00:56:15.289 INFO:tasks.workunit.client.1.smithi086.stdout:9/802: fdatasync db/fb2 0 2024-08-19T00:56:15.290 INFO:tasks.workunit.client.1.smithi086.stdout:3/795: dwrite d3/d18/d19/dbc/db8/dc9/fcf [0,4194304] 0 2024-08-19T00:56:15.295 INFO:tasks.workunit.client.1.smithi086.stdout:3/796: symlink d3/d18/d1a/d51/d75/l108 0 2024-08-19T00:56:15.295 INFO:tasks.workunit.client.1.smithi086.stdout:2/834: link d8/d2c/d38/fd4 d8/d2c/d38/d80/db4/db7/f116 0 2024-08-19T00:56:15.296 INFO:tasks.workunit.client.1.smithi086.stdout:8/779: write dc/d1f/d37/d4f/dac/db8/d8f/fc1 [4083137,122436] 0 2024-08-19T00:56:15.299 INFO:tasks.workunit.client.1.smithi086.stdout:2/835: rmdir d8/d43/d65/da9 39 2024-08-19T00:56:15.300 INFO:tasks.workunit.client.1.smithi086.stdout:5/803: truncate d0/d2d/d43/fb2 1158045 0 2024-08-19T00:56:15.300 INFO:tasks.workunit.client.1.smithi086.stdout:6/816: dwrite db/d37/d28/fa5 [0,4194304] 0 2024-08-19T00:56:15.302 INFO:tasks.workunit.client.1.smithi086.stdout:3/797: fdatasync d3/d18/d61/d85/f8c 0 2024-08-19T00:56:15.302 INFO:tasks.workunit.client.1.smithi086.stdout:2/836: write d8/d2c/d47/d73/fef [818112,85139] 0 2024-08-19T00:56:15.302 INFO:tasks.workunit.client.1.smithi086.stdout:8/780: rmdir dc/d16/d18/d94 39 2024-08-19T00:56:15.303 INFO:tasks.workunit.client.1.smithi086.stdout:5/804: creat d0/d8/d94/ff7 x:0 0 0 2024-08-19T00:56:15.304 INFO:tasks.workunit.client.1.smithi086.stdout:3/798: stat d3/d26/f59 0 2024-08-19T00:56:15.305 INFO:tasks.workunit.client.1.smithi086.stdout:5/805: write d0/d5f/d60/fd0 [54453,393] 0 2024-08-19T00:56:15.309 INFO:tasks.workunit.client.0.smithi017.stdout:6/358: write d5/d13/d11/d2c/f38 [1372418,110569] 0 2024-08-19T00:56:15.310 INFO:tasks.workunit.client.1.smithi086.stdout:8/781: fdatasync dc/d1f/d37/d4f/dac/db8/d7a/d88/f96 0 2024-08-19T00:56:15.311 INFO:tasks.workunit.client.1.smithi086.stdout:3/799: symlink d3/d18/d61/d85/l109 0 2024-08-19T00:56:15.312 INFO:tasks.workunit.client.1.smithi086.stdout:0/820: dwrite da/d14/d1a/d2e/d39/d3b/d4e/dda/fe8 [0,4194304] 0 2024-08-19T00:56:15.313 INFO:tasks.workunit.client.1.smithi086.stdout:2/837: unlink d8/d14/f25 0 2024-08-19T00:56:15.315 INFO:tasks.workunit.client.1.smithi086.stdout:6/817: rename db/d37/d28/d7f/d96/dd9/cdd to db/c100 0 2024-08-19T00:56:15.316 INFO:tasks.workunit.client.1.smithi086.stdout:4/759: write d2/d18/d33/d42/d72/d78/d9e/dc6/ffd [327635,107161] 0 2024-08-19T00:56:15.316 INFO:tasks.workunit.client.1.smithi086.stdout:8/782: read dc/f14 [1180275,112049] 0 2024-08-19T00:56:15.316 INFO:tasks.workunit.client.0.smithi017.stdout:6/359: mkdir d5/d7b 0 2024-08-19T00:56:15.317 INFO:tasks.workunit.client.0.smithi017.stdout:6/360: write d5/d13/d11/d2c/f73 [970271,43226] 0 2024-08-19T00:56:15.318 INFO:tasks.workunit.client.1.smithi086.stdout:4/760: dread - d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/ff2 zero size 2024-08-19T00:56:15.320 INFO:tasks.workunit.client.1.smithi086.stdout:3/800: mkdir d3/d18/d19/d10a 0 2024-08-19T00:56:15.321 INFO:tasks.workunit.client.1.smithi086.stdout:3/801: dread - d3/d18/d27/d49/d3f/d5b/d8f/f107 zero size 2024-08-19T00:56:15.322 INFO:tasks.workunit.client.0.smithi017.stdout:6/361: symlink d5/d13/d20/d77/l7c 0 2024-08-19T00:56:15.323 INFO:tasks.workunit.client.1.smithi086.stdout:2/838: mkdir d8/d24/d32/d61/d117 0 2024-08-19T00:56:15.328 INFO:tasks.workunit.client.1.smithi086.stdout:4/761: unlink d2/d18/d33/c76 0 2024-08-19T00:56:15.328 INFO:tasks.workunit.client.1.smithi086.stdout:9/803: dwrite db/d26/d5c/d87/d30/d58/f5b [4194304,4194304] 0 2024-08-19T00:56:15.333 INFO:tasks.workunit.client.1.smithi086.stdout:8/783: dwrite f8 [0,4194304] 0 2024-08-19T00:56:15.335 INFO:tasks.workunit.client.1.smithi086.stdout:0/821: creat da/d14/d1a/d2e/d39/d3b/f104 x:0 0 0 2024-08-19T00:56:15.341 INFO:tasks.workunit.client.1.smithi086.stdout:8/784: rmdir dc/d1f/d37/d60 39 2024-08-19T00:56:15.342 INFO:tasks.workunit.client.1.smithi086.stdout:8/785: chown dc/d16/d18/c80 10797840 1 2024-08-19T00:56:15.343 INFO:tasks.workunit.client.1.smithi086.stdout:9/804: symlink db/d96/lff 0 2024-08-19T00:56:15.345 INFO:tasks.workunit.client.1.smithi086.stdout:0/822: truncate da/d14/d44/d49/f88 77614 0 2024-08-19T00:56:15.347 INFO:tasks.workunit.client.1.smithi086.stdout:6/818: write db/d34/d39/d76/fb5 [288666,12813] 0 2024-08-19T00:56:15.350 INFO:tasks.workunit.client.1.smithi086.stdout:0/823: readlink da/d14/d1a/l1c 0 2024-08-19T00:56:15.351 INFO:tasks.workunit.client.0.smithi017.stdout:6/362: dwrite d5/d13/f22 [0,4194304] 0 2024-08-19T00:56:15.353 INFO:tasks.workunit.client.1.smithi086.stdout:2/839: getdents d8/d14 0 2024-08-19T00:56:15.355 INFO:tasks.workunit.client.0.smithi017.stdout:6/363: mknod d5/d13/d11/d2c/d4a/d64/c7d 0 2024-08-19T00:56:15.355 INFO:tasks.workunit.client.1.smithi086.stdout:3/802: truncate d3/d18/fe4 4109652 0 2024-08-19T00:56:15.356 INFO:tasks.workunit.client.0.smithi017.stdout:6/364: readlink d5/d13/d11/l4b 0 2024-08-19T00:56:15.356 INFO:tasks.workunit.client.1.smithi086.stdout:6/819: dwrite db/f46 [4194304,4194304] 0 2024-08-19T00:56:15.356 INFO:tasks.workunit.client.1.smithi086.stdout:2/840: chown d8/d43/cc1 1597 1 2024-08-19T00:56:15.357 INFO:tasks.workunit.client.1.smithi086.stdout:4/762: dread d2/d18/d33/d42/d72/d78/d9e/fc7 [0,4194304] 0 2024-08-19T00:56:15.357 INFO:tasks.workunit.client.0.smithi017.stdout:6/365: mkdir d5/d13/d11/d2c/d51/d7e 0 2024-08-19T00:56:15.359 INFO:tasks.workunit.client.1.smithi086.stdout:9/805: mkdir db/d100 0 2024-08-19T00:56:15.359 INFO:tasks.workunit.client.0.smithi017.stdout:6/366: creat d5/d13/d11/d2c/d51/d7e/f7f x:0 0 0 2024-08-19T00:56:15.368 INFO:tasks.workunit.client.1.smithi086.stdout:8/786: dwrite dc/d16/dc7/d2e/d28/d41/f78 [0,4194304] 0 2024-08-19T00:56:15.368 INFO:tasks.workunit.client.1.smithi086.stdout:6/820: creat db/d37/d41/f101 x:0 0 0 2024-08-19T00:56:15.370 INFO:tasks.workunit.client.1.smithi086.stdout:4/763: rename d2/d18/d33/d42/l4f to d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/l100 0 2024-08-19T00:56:15.371 INFO:tasks.workunit.client.1.smithi086.stdout:3/803: dwrite d3/d26/d2b/d33/d4a/d57/db4/fef [0,4194304] 0 2024-08-19T00:56:15.376 INFO:tasks.workunit.client.1.smithi086.stdout:9/806: link db/d26/d5c/d87/d30/d32/d44/f56 db/d26/d5c/d87/d6d/d9f/f101 0 2024-08-19T00:56:15.377 INFO:tasks.workunit.client.1.smithi086.stdout:3/804: write d3/d18/d19/dbc/db8/f21 [2076659,52384] 0 2024-08-19T00:56:15.380 INFO:tasks.workunit.client.1.smithi086.stdout:4/764: unlink d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/f63 0 2024-08-19T00:56:15.382 INFO:tasks.workunit.client.0.smithi017.stdout:7/357: sync 2024-08-19T00:56:15.401 INFO:tasks.workunit.client.0.smithi017.stdout:6/367: dread d5/f39 [0,4194304] 0 2024-08-19T00:56:15.402 INFO:tasks.workunit.client.0.smithi017.stdout:6/368: truncate d5/d13/d20/f3c 1262638 0 2024-08-19T00:56:15.405 INFO:tasks.workunit.client.0.smithi017.stdout:7/358: dwrite d3/dc/df/d1a/f3b [0,4194304] 0 2024-08-19T00:56:15.409 INFO:tasks.workunit.client.0.smithi017.stdout:7/359: rename d3/dc/df/l65 to d3/dc/l67 0 2024-08-19T00:56:15.412 INFO:tasks.workunit.client.0.smithi017.stdout:7/360: write d3/dc/d5f/f63 [907120,118241] 0 2024-08-19T00:56:15.418 INFO:tasks.workunit.client.0.smithi017.stdout:7/361: dread d3/dc/df/d37/d46/f57 [0,4194304] 0 2024-08-19T00:56:15.425 INFO:tasks.workunit.client.0.smithi017.stdout:7/362: dwrite d3/dc/f5b [0,4194304] 0 2024-08-19T00:56:15.426 INFO:tasks.workunit.client.0.smithi017.stdout:6/369: dread d5/d13/f16 [0,4194304] 0 2024-08-19T00:56:15.426 INFO:tasks.workunit.client.0.smithi017.stdout:7/363: chown d3/f12 38 1 2024-08-19T00:56:15.426 INFO:tasks.workunit.client.0.smithi017.stdout:6/370: chown d5/d13/d20/f56 935 1 2024-08-19T00:56:15.431 INFO:tasks.workunit.client.0.smithi017.stdout:7/364: rename d3/dc/f40 to d3/dc/df/d1c/f68 0 2024-08-19T00:56:15.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:15 smithi017 ceph-mon[16627]: pgmap v18: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 71 MiB/s rd, 222 MiB/s wr, 387 op/s 2024-08-19T00:56:15.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:15 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:56:15.434 INFO:tasks.workunit.client.0.smithi017.stdout:6/371: dwrite d5/d13/d11/f53 [0,4194304] 0 2024-08-19T00:56:15.438 INFO:tasks.workunit.client.1.smithi086.stdout:7/802: sync 2024-08-19T00:56:15.438 INFO:tasks.workunit.client.1.smithi086.stdout:1/891: sync 2024-08-19T00:56:15.439 INFO:tasks.workunit.client.0.smithi017.stdout:6/372: dread d5/d13/d11/f59 [0,4194304] 0 2024-08-19T00:56:15.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:15 smithi086 ceph-mon[24511]: pgmap v18: 65 pgs: 65 active+clean; 2.1 GiB data, 6.3 GiB used, 530 GiB / 536 GiB avail; 71 MiB/s rd, 222 MiB/s wr, 387 op/s 2024-08-19T00:56:15.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:15 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:56:15.448 INFO:tasks.workunit.client.1.smithi086.stdout:6/821: dwrite f8 [12582912,4194304] 0 2024-08-19T00:56:15.449 INFO:tasks.workunit.client.1.smithi086.stdout:9/807: mkdir db/d96/d102 0 2024-08-19T00:56:15.450 INFO:tasks.workunit.client.1.smithi086.stdout:8/787: dread dc/d1f/d37/d4f/dac/db8/d7a/d9b/f71 [0,4194304] 0 2024-08-19T00:56:15.452 INFO:tasks.workunit.client.1.smithi086.stdout:9/808: stat db/d26/d5c/d87/f42 0 2024-08-19T00:56:15.454 INFO:tasks.workunit.client.1.smithi086.stdout:4/765: dread d2/d18/d33/d42/d72/d78/f6d [0,4194304] 0 2024-08-19T00:56:15.455 INFO:tasks.workunit.client.1.smithi086.stdout:4/766: chown d2/d18/d33/d42/d72/d78 3857982 1 2024-08-19T00:56:15.466 INFO:tasks.workunit.client.1.smithi086.stdout:1/892: dread d4/d7/d2a/d36/fdf [0,4194304] 0 2024-08-19T00:56:15.532 INFO:tasks.workunit.client.1.smithi086.stdout:3/805: creat d3/d18/d1a/d51/dad/de9/f10b x:0 0 0 2024-08-19T00:56:15.533 INFO:tasks.workunit.client.0.smithi017.stdout:6/373: rename d5/d13/d11/d2c/l49 to d5/d13/d11/d52/l80 0 2024-08-19T00:56:15.533 INFO:tasks.workunit.client.1.smithi086.stdout:6/822: read db/d37/f20 [6167335,18013] 0 2024-08-19T00:56:15.534 INFO:tasks.workunit.client.1.smithi086.stdout:6/823: read - db/d8e/fbc zero size 2024-08-19T00:56:15.539 INFO:tasks.workunit.client.1.smithi086.stdout:5/806: sync 2024-08-19T00:56:15.544 INFO:tasks.workunit.client.1.smithi086.stdout:9/809: dread - db/dd/de2/dee/fbe zero size 2024-08-19T00:56:15.545 INFO:tasks.workunit.client.1.smithi086.stdout:9/810: fdatasync db/d26/d5c/d87/d37/f91 0 2024-08-19T00:56:15.545 INFO:tasks.workunit.client.1.smithi086.stdout:1/893: symlink d4/d1e/d6f/l126 0 2024-08-19T00:56:15.547 INFO:tasks.workunit.client.1.smithi086.stdout:3/806: symlink d3/d18/d27/d49/d3f/l10c 0 2024-08-19T00:56:15.549 INFO:tasks.workunit.client.1.smithi086.stdout:8/788: creat dc/d1f/d37/d4f/dac/db8/d99/f104 x:0 0 0 2024-08-19T00:56:15.551 INFO:tasks.workunit.client.1.smithi086.stdout:7/803: rename d3/c25 to d3/d34/d44/d58/c10b 0 2024-08-19T00:56:15.553 INFO:tasks.workunit.client.0.smithi017.stdout:7/365: mkdir d3/dc/df/d23/d69 0 2024-08-19T00:56:15.554 INFO:tasks.workunit.client.1.smithi086.stdout:1/894: unlink d4/d7/d2a/d36/d3a/f43 0 2024-08-19T00:56:15.555 INFO:tasks.workunit.client.1.smithi086.stdout:8/789: dwrite dc/d1f/d37/d4f/dac/db8/d8f/fc1 [0,4194304] 0 2024-08-19T00:56:15.556 INFO:tasks.workunit.client.1.smithi086.stdout:1/895: dread - d4/d7/d2a/d36/d63/d84/fdd zero size 2024-08-19T00:56:15.557 INFO:tasks.workunit.client.0.smithi017.stdout:6/374: unlink d5/d13/d11/d2c/d4a/l5f 0 2024-08-19T00:56:15.557 INFO:tasks.workunit.client.1.smithi086.stdout:1/896: chown d4/d7/d2a/d6e/d95/db9 4 1 2024-08-19T00:56:15.558 INFO:tasks.workunit.client.1.smithi086.stdout:1/897: readlink d4/d10/d90/lf6 0 2024-08-19T00:56:15.559 INFO:tasks.workunit.client.0.smithi017.stdout:7/366: rmdir d3/dc/d5f 39 2024-08-19T00:56:15.561 INFO:tasks.workunit.client.1.smithi086.stdout:1/898: truncate d4/d7/d2a/d36/d61/f114 173600 0 2024-08-19T00:56:15.561 INFO:tasks.workunit.client.0.smithi017.stdout:6/375: unlink d5/f60 0 2024-08-19T00:56:15.562 INFO:tasks.workunit.client.1.smithi086.stdout:1/899: fdatasync d4/d7/d2a/d36/d63/d84/d8e/fd6 0 2024-08-19T00:56:15.566 INFO:tasks.workunit.client.1.smithi086.stdout:9/811: rename db/dd to db/d26/d5c/d87/d30/d31/d103 0 2024-08-19T00:56:15.570 INFO:tasks.workunit.client.0.smithi017.stdout:6/376: write d5/d13/d11/d2c/f6e [3713964,108230] 0 2024-08-19T00:56:15.571 INFO:tasks.workunit.client.0.smithi017.stdout:6/377: dread - d5/d13/d11/d2c/d51/d7e/f7f zero size 2024-08-19T00:56:15.571 INFO:tasks.workunit.client.0.smithi017.stdout:7/367: mkdir d3/dc/df/d23/d6a 0 2024-08-19T00:56:15.572 INFO:tasks.workunit.client.1.smithi086.stdout:8/790: dread dc/d16/d18/f8c [0,4194304] 0 2024-08-19T00:56:15.572 INFO:tasks.workunit.client.1.smithi086.stdout:3/807: truncate d3/d18/d19/dbc/f65 1072213 0 2024-08-19T00:56:15.573 INFO:tasks.workunit.client.0.smithi017.stdout:6/378: truncate d5/d13/d20/d5e/f75 4992046 0 2024-08-19T00:56:15.575 INFO:tasks.workunit.client.0.smithi017.stdout:7/368: mknod d3/dc/df/d1a/c6b 0 2024-08-19T00:56:15.577 INFO:tasks.workunit.client.1.smithi086.stdout:1/900: truncate d4/f6 3771142 0 2024-08-19T00:56:15.578 INFO:tasks.workunit.client.0.smithi017.stdout:6/379: symlink d5/d13/d11/d52/l81 0 2024-08-19T00:56:15.578 INFO:tasks.workunit.client.0.smithi017.stdout:6/380: chown d5/c69 1814 1 2024-08-19T00:56:15.579 INFO:tasks.workunit.client.1.smithi086.stdout:9/812: read db/d26/d5c/d87/d30/d31/d103/d19/d38/f3c [604786,16169] 0 2024-08-19T00:56:15.581 INFO:tasks.workunit.client.1.smithi086.stdout:4/767: link d2/d18/d33/d42/d72/d78/d25/d30/d5d/f79 d2/f101 0 2024-08-19T00:56:15.583 INFO:tasks.workunit.client.0.smithi017.stdout:6/381: mknod d5/d13/d20/d5e/c82 0 2024-08-19T00:56:15.583 INFO:tasks.workunit.client.1.smithi086.stdout:4/768: fsync d2/d18/d33/d42/d72/d78/d25/d55/d4d/ff9 0 2024-08-19T00:56:15.583 INFO:tasks.workunit.client.0.smithi017.stdout:6/382: readlink d5/d13/d11/l4b 0 2024-08-19T00:56:15.584 INFO:tasks.workunit.client.1.smithi086.stdout:8/791: creat dc/d16/dc7/d2e/d28/d2b/d3b/d87/f105 x:0 0 0 2024-08-19T00:56:15.585 INFO:tasks.workunit.client.1.smithi086.stdout:3/808: truncate d3/d18/d61/f97 57013 0 2024-08-19T00:56:15.586 INFO:tasks.workunit.client.1.smithi086.stdout:9/813: dwrite db/d26/d5c/d87/d30/d32/d44/d67/fb1 [0,4194304] 0 2024-08-19T00:56:15.588 INFO:tasks.workunit.client.0.smithi017.stdout:6/383: creat d5/d13/d11/d2c/d51/d7e/f83 x:0 0 0 2024-08-19T00:56:15.590 INFO:tasks.workunit.client.0.smithi017.stdout:7/369: rename d3/dc/df/d1a/l1b to d3/dc/df/d1c/d2c/l6c 0 2024-08-19T00:56:15.591 INFO:tasks.workunit.client.1.smithi086.stdout:5/807: dwrite d0/d5f/d60/d57/f84 [0,4194304] 0 2024-08-19T00:56:15.592 INFO:tasks.workunit.client.1.smithi086.stdout:4/769: fdatasync d2/d18/d33/d42/d72/d2f/fa8 0 2024-08-19T00:56:15.594 INFO:tasks.workunit.client.1.smithi086.stdout:5/808: chown d0/d8/d10/f2b 246 1 2024-08-19T00:56:15.595 INFO:tasks.workunit.client.0.smithi017.stdout:7/370: dread d3/dc/df/d37/d46/f57 [0,4194304] 0 2024-08-19T00:56:15.596 INFO:tasks.workunit.client.1.smithi086.stdout:3/809: mknod d3/d18/d19/dbc/d5d/c10d 0 2024-08-19T00:56:15.596 INFO:tasks.workunit.client.1.smithi086.stdout:9/814: dread db/f61 [0,4194304] 0 2024-08-19T00:56:15.598 INFO:tasks.workunit.client.0.smithi017.stdout:7/371: dread d3/f12 [0,4194304] 0 2024-08-19T00:56:15.598 INFO:tasks.workunit.client.1.smithi086.stdout:9/815: readlink db/d26/d5c/d87/d30/d58/ldd 0 2024-08-19T00:56:15.602 INFO:tasks.workunit.client.1.smithi086.stdout:4/770: read d2/f1b [7344835,79525] 0 2024-08-19T00:56:15.603 INFO:tasks.workunit.client.1.smithi086.stdout:3/810: dread d3/d18/d19/dbc/db8/dc9/fcf [0,4194304] 0 2024-08-19T00:56:15.604 INFO:tasks.workunit.client.1.smithi086.stdout:9/816: truncate db/d26/d5c/d87/d30/d3f/d43/d4e/d7a/f8c 1440909 0 2024-08-19T00:56:15.606 INFO:tasks.workunit.client.1.smithi086.stdout:8/792: rename dc/d16/dc7/d2e to dc/d16/d18/d106 0 2024-08-19T00:56:15.609 INFO:tasks.workunit.client.1.smithi086.stdout:1/901: write d4/d7/f19 [420293,76967] 0 2024-08-19T00:56:15.609 INFO:tasks.workunit.client.1.smithi086.stdout:9/817: symlink db/d26/d5c/d87/d30/d3f/l104 0 2024-08-19T00:56:15.610 INFO:tasks.workunit.client.1.smithi086.stdout:2/841: sync 2024-08-19T00:56:15.610 INFO:tasks.workunit.client.1.smithi086.stdout:0/824: sync 2024-08-19T00:56:15.611 INFO:tasks.workunit.client.1.smithi086.stdout:4/771: dwrite d2/d18/d33/d42/d72/d78/d2c/f43 [0,4194304] 0 2024-08-19T00:56:15.612 INFO:tasks.workunit.client.1.smithi086.stdout:0/825: chown da/d14/f15 135393613 1 2024-08-19T00:56:15.612 INFO:tasks.workunit.client.1.smithi086.stdout:5/809: rename d0/df/d1f/d33/f3d to d0/d8/d10/dbb/ff8 0 2024-08-19T00:56:15.613 INFO:tasks.workunit.client.1.smithi086.stdout:8/793: rmdir dc/d16/d18/d106/d28/d2b/d3b/d87 39 2024-08-19T00:56:15.613 INFO:tasks.workunit.client.1.smithi086.stdout:7/804: write d3/de/d68/faa [164528,63927] 0 2024-08-19T00:56:15.644 INFO:tasks.workunit.client.1.smithi086.stdout:6/824: sync 2024-08-19T00:56:15.644 INFO:tasks.workunit.client.1.smithi086.stdout:6/825: stat db/d34/d39/d76/dbf/fe4 0 2024-08-19T00:56:15.678 INFO:tasks.workunit.client.0.smithi017.stdout:8/226: sync 2024-08-19T00:56:15.701 INFO:tasks.workunit.client.1.smithi086.stdout:9/818: rename c9 to db/d96/d102/c105 0 2024-08-19T00:56:15.703 INFO:tasks.workunit.client.1.smithi086.stdout:1/902: truncate d4/d7/d2a/d36/fdf 2921683 0 2024-08-19T00:56:15.704 INFO:tasks.workunit.client.1.smithi086.stdout:5/810: unlink d0/df/d1f/d65/l76 0 2024-08-19T00:56:15.705 INFO:tasks.workunit.client.0.smithi017.stdout:8/227: mknod de/d15/c3c 0 2024-08-19T00:56:15.706 INFO:tasks.workunit.client.0.smithi017.stdout:8/228: chown de/d36/f32 6962145 1 2024-08-19T00:56:15.707 INFO:tasks.workunit.client.1.smithi086.stdout:7/805: chown d3/d34/d44/d58/d4b/da5/f5c 0 1 2024-08-19T00:56:15.708 INFO:tasks.workunit.client.1.smithi086.stdout:3/811: write d3/d18/d19/dbc/fa0 [4618503,64527] 0 2024-08-19T00:56:15.709 INFO:tasks.workunit.client.0.smithi017.stdout:8/229: fsync de/f22 0 2024-08-19T00:56:15.710 INFO:tasks.workunit.client.1.smithi086.stdout:0/826: creat da/d14/d1a/d2e/d39/d3b/d4e/dda/f105 x:0 0 0 2024-08-19T00:56:15.712 INFO:tasks.workunit.client.1.smithi086.stdout:8/794: mkdir dc/d16/d18/d106/d28/d41/d9a/d107 0 2024-08-19T00:56:15.712 INFO:tasks.workunit.client.1.smithi086.stdout:8/795: write dc/f11 [6692936,11774] 0 2024-08-19T00:56:15.714 INFO:tasks.workunit.client.1.smithi086.stdout:6/826: creat db/d34/d69/f102 x:0 0 0 2024-08-19T00:56:15.717 INFO:tasks.workunit.client.0.smithi017.stdout:8/230: mkdir de/d15/d39/d3d 0 2024-08-19T00:56:15.718 INFO:tasks.workunit.client.1.smithi086.stdout:2/842: dwrite d8/f1d [0,4194304] 0 2024-08-19T00:56:15.718 INFO:tasks.workunit.client.1.smithi086.stdout:2/843: stat d8/d14/l7c 0 2024-08-19T00:56:15.719 INFO:tasks.workunit.client.1.smithi086.stdout:5/811: rmdir d0/df/d1f/d33 39 2024-08-19T00:56:15.720 INFO:tasks.workunit.client.0.smithi017.stdout:8/231: creat de/d15/d39/f3e x:0 0 0 2024-08-19T00:56:15.723 INFO:tasks.workunit.client.1.smithi086.stdout:7/806: fdatasync d3/d34/f52 0 2024-08-19T00:56:15.725 INFO:tasks.workunit.client.1.smithi086.stdout:3/812: rmdir d3/d18/d19/dbc/db8 39 2024-08-19T00:56:15.727 INFO:tasks.workunit.client.1.smithi086.stdout:8/796: mkdir dc/d1f/dd4/d108 0 2024-08-19T00:56:15.728 INFO:tasks.workunit.client.0.smithi017.stdout:8/232: rename de/c14 to de/c3f 0 2024-08-19T00:56:15.728 INFO:tasks.workunit.client.0.smithi017.stdout:8/233: stat de/f22 0 2024-08-19T00:56:15.730 INFO:tasks.workunit.client.1.smithi086.stdout:2/844: truncate d8/d43/f63 427578 0 2024-08-19T00:56:15.731 INFO:tasks.workunit.client.1.smithi086.stdout:5/812: readlink d0/d8/d10/l3e 0 2024-08-19T00:56:15.733 INFO:tasks.workunit.client.1.smithi086.stdout:5/813: stat d0/d5f/d60/d5b 0 2024-08-19T00:56:15.733 INFO:tasks.workunit.client.1.smithi086.stdout:7/807: unlink d3/de/f15 0 2024-08-19T00:56:15.734 INFO:tasks.workunit.client.0.smithi017.stdout:8/234: getdents de/d15 0 2024-08-19T00:56:15.735 INFO:tasks.workunit.client.0.smithi017.stdout:8/235: write de/d15/f35 [297855,35712] 0 2024-08-19T00:56:15.736 INFO:tasks.workunit.client.1.smithi086.stdout:3/813: dwrite d3/d26/f7e [0,4194304] 0 2024-08-19T00:56:15.736 INFO:tasks.workunit.client.1.smithi086.stdout:5/814: stat d0/d20/c88 0 2024-08-19T00:56:15.736 INFO:tasks.workunit.client.0.smithi017.stdout:8/236: truncate de/d15/f29 464875 0 2024-08-19T00:56:15.737 INFO:tasks.workunit.client.1.smithi086.stdout:9/819: rename db/d26/d5c/d87/d30/l98 to db/d26/d5c/d87/l106 0 2024-08-19T00:56:15.737 INFO:tasks.workunit.client.0.smithi017.stdout:8/237: write de/d15/f3b [176453,27675] 0 2024-08-19T00:56:15.739 INFO:tasks.workunit.client.1.smithi086.stdout:1/903: link d4/d7/d2a/d6e/d95/db9/le2 d4/d7/d2a/d36/d50/d9c/ded/d11c/l127 0 2024-08-19T00:56:15.740 INFO:tasks.workunit.client.1.smithi086.stdout:0/827: dread da/d14/d1a/d2e/d39/d3b/f70 [0,4194304] 0 2024-08-19T00:56:15.740 INFO:tasks.workunit.client.1.smithi086.stdout:3/814: readlink d3/d26/d2b/l74 0 2024-08-19T00:56:15.741 INFO:tasks.workunit.client.1.smithi086.stdout:9/820: chown db/lf3 123008 1 2024-08-19T00:56:15.741 INFO:tasks.workunit.client.1.smithi086.stdout:2/845: symlink d8/d24/d32/d4d/l118 0 2024-08-19T00:56:15.742 INFO:tasks.workunit.client.0.smithi017.stdout:8/238: unlink de/c33 0 2024-08-19T00:56:15.742 INFO:tasks.workunit.client.1.smithi086.stdout:4/772: dwrite d2/d18/d33/d42/d72/d78/d25/d30/d5d/f79 [0,4194304] 0 2024-08-19T00:56:15.743 INFO:tasks.workunit.client.0.smithi017.stdout:8/239: dread de/d15/f29 [0,4194304] 0 2024-08-19T00:56:15.746 INFO:tasks.workunit.client.1.smithi086.stdout:7/808: dread d3/d34/d44/d58/d4b/d78/f5a [0,4194304] 0 2024-08-19T00:56:15.746 INFO:tasks.workunit.client.1.smithi086.stdout:8/797: rename dc/d16/d18/d106/d28/d41/f78 to dc/d16/d18/d106/d28/d2b/f109 0 2024-08-19T00:56:15.748 INFO:tasks.workunit.client.1.smithi086.stdout:5/815: chown d0/d2d/dce/ld3 217693 1 2024-08-19T00:56:15.748 INFO:tasks.workunit.client.1.smithi086.stdout:7/809: chown d3/d34/l3c 452 1 2024-08-19T00:56:15.753 INFO:tasks.workunit.client.1.smithi086.stdout:7/810: dread d3/d34/d44/f48 [0,4194304] 0 2024-08-19T00:56:15.754 INFO:tasks.workunit.client.1.smithi086.stdout:1/904: truncate d4/d7/d2a/f4d 1625135 0 2024-08-19T00:56:15.755 INFO:tasks.workunit.client.0.smithi017.stdout:8/240: dwrite de/d15/f1e [0,4194304] 0 2024-08-19T00:56:15.756 INFO:tasks.workunit.client.1.smithi086.stdout:2/846: rename d8/d43/d65/fb0 to d8/d14/d10a/f119 0 2024-08-19T00:56:15.756 INFO:tasks.workunit.client.0.smithi017.stdout:8/241: chown de/d15/c3c 12 1 2024-08-19T00:56:15.758 INFO:tasks.workunit.client.1.smithi086.stdout:6/827: dread db/d37/d30/f72 [0,4194304] 0 2024-08-19T00:56:15.758 INFO:tasks.workunit.client.1.smithi086.stdout:5/816: mkdir d0/d8/d94/df9 0 2024-08-19T00:56:15.759 INFO:tasks.workunit.client.1.smithi086.stdout:3/815: creat d3/d18/d19/dbc/db8/dc9/f10e x:0 0 0 2024-08-19T00:56:15.760 INFO:tasks.workunit.client.1.smithi086.stdout:2/847: chown d8/d24/d32/d4d/f7d 225174 1 2024-08-19T00:56:15.760 INFO:tasks.workunit.client.0.smithi017.stdout:8/242: creat de/d36/f40 x:0 0 0 2024-08-19T00:56:15.764 INFO:tasks.workunit.client.1.smithi086.stdout:2/848: chown d8/f19 559743 1 2024-08-19T00:56:15.764 INFO:tasks.workunit.client.1.smithi086.stdout:3/816: write d3/d18/d27/d49/de2/ff6 [408523,11190] 0 2024-08-19T00:56:15.765 INFO:tasks.workunit.client.1.smithi086.stdout:7/811: dwrite d3/d34/d44/d58/f55 [0,4194304] 0 2024-08-19T00:56:15.770 INFO:tasks.workunit.client.1.smithi086.stdout:3/817: stat d3/d18/d27/d49/d3f/d54/dfa 0 2024-08-19T00:56:15.770 INFO:tasks.workunit.client.1.smithi086.stdout:5/817: mkdir d0/d20/dfa 0 2024-08-19T00:56:15.772 INFO:tasks.workunit.client.1.smithi086.stdout:4/773: write d2/d18/d33/d42/d72/d78/d25/d30/f97 [934769,130518] 0 2024-08-19T00:56:15.772 INFO:tasks.workunit.client.1.smithi086.stdout:1/905: mkdir d4/d7/d2a/d128 0 2024-08-19T00:56:15.776 INFO:tasks.workunit.client.1.smithi086.stdout:0/828: dread da/d14/d1a/d2e/d39/f69 [0,4194304] 0 2024-08-19T00:56:15.777 INFO:tasks.workunit.client.1.smithi086.stdout:4/774: stat d2/d18/d33/d42/d72/d78/d25/d30/f97 0 2024-08-19T00:56:15.778 INFO:tasks.workunit.client.1.smithi086.stdout:9/821: dread db/d26/d5c/d87/d6d/dbf/fc4 [0,4194304] 0 2024-08-19T00:56:15.779 INFO:tasks.workunit.client.1.smithi086.stdout:3/818: rename d3/d18/d19/d37/d3a/fff to d3/d26/d2b/d33/d4a/f10f 0 2024-08-19T00:56:15.784 INFO:tasks.workunit.client.1.smithi086.stdout:4/775: mknod d2/d18/d33/d42/d72/d2f/dc4/c102 0 2024-08-19T00:56:15.785 INFO:tasks.workunit.client.1.smithi086.stdout:0/829: dwrite da/d5d/f103 [0,4194304] 0 2024-08-19T00:56:15.785 INFO:tasks.workunit.client.0.smithi017.stdout:8/243: dwrite de/d15/f29 [0,4194304] 0 2024-08-19T00:56:15.785 INFO:tasks.workunit.client.1.smithi086.stdout:9/822: creat db/d26/d5c/d87/d30/d3f/f107 x:0 0 0 2024-08-19T00:56:15.786 INFO:tasks.workunit.client.0.smithi017.stdout:8/244: write de/d15/f1e [4200157,115170] 0 2024-08-19T00:56:15.787 INFO:tasks.workunit.client.1.smithi086.stdout:3/819: read d3/d26/d2b/d33/d4a/d57/d8a/fa4 [33904,94006] 0 2024-08-19T00:56:15.790 INFO:tasks.workunit.client.1.smithi086.stdout:2/849: truncate d8/d24/f8c 282934 0 2024-08-19T00:56:15.791 INFO:tasks.workunit.client.1.smithi086.stdout:0/830: unlink da/d14/d26/la7 0 2024-08-19T00:56:15.791 INFO:tasks.workunit.client.1.smithi086.stdout:2/850: readlink d8/d2c/d38/lf8 0 2024-08-19T00:56:15.792 INFO:tasks.workunit.client.1.smithi086.stdout:7/812: truncate d3/f97 3058432 0 2024-08-19T00:56:15.793 INFO:tasks.workunit.client.1.smithi086.stdout:9/823: mkdir db/d26/d5c/d87/d37/d108 0 2024-08-19T00:56:15.794 INFO:tasks.workunit.client.1.smithi086.stdout:4/776: creat d2/d18/d33/d42/d72/d2f/d8e/f103 x:0 0 0 2024-08-19T00:56:15.795 INFO:tasks.workunit.client.1.smithi086.stdout:3/820: symlink d3/d18/d27/d49/d3f/d54/l110 0 2024-08-19T00:56:15.798 INFO:tasks.workunit.client.1.smithi086.stdout:7/813: dread - d3/d34/d44/d58/d4b/da5/fba zero size 2024-08-19T00:56:15.799 INFO:tasks.workunit.client.1.smithi086.stdout:9/824: fdatasync db/d26/d5c/d87/d37/f81 0 2024-08-19T00:56:15.801 INFO:tasks.workunit.client.1.smithi086.stdout:3/821: rmdir d3/d26/d2b 39 2024-08-19T00:56:15.802 INFO:tasks.workunit.client.1.smithi086.stdout:2/851: rmdir d8/d24/d32/d4d/d6a/d100 0 2024-08-19T00:56:15.802 INFO:tasks.workunit.client.1.smithi086.stdout:1/906: dwrite d4/d1e/d6f/fca [0,4194304] 0 2024-08-19T00:56:15.803 INFO:tasks.workunit.client.1.smithi086.stdout:9/825: readlink db/d26/d5c/d68/l7e 0 2024-08-19T00:56:15.804 INFO:tasks.workunit.client.1.smithi086.stdout:4/777: creat d2/d18/d33/d42/d72/d78/d2c/dae/f104 x:0 0 0 2024-08-19T00:56:15.808 INFO:tasks.workunit.client.1.smithi086.stdout:0/831: dwrite da/d14/d1a/d2e/d39/d3b/d89/dc5/fcb [0,4194304] 0 2024-08-19T00:56:15.808 INFO:tasks.workunit.client.1.smithi086.stdout:1/907: chown d4/d7/d2a/d36/d50/ffe 949117 1 2024-08-19T00:56:15.810 INFO:tasks.workunit.client.1.smithi086.stdout:9/826: readlink db/d26/d5c/d87/d30/d3f/d43/d4e/l9a 0 2024-08-19T00:56:15.810 INFO:tasks.workunit.client.1.smithi086.stdout:7/814: getdents d3/de/d68/d72/d7e/dca/dcb/dd0 0 2024-08-19T00:56:15.813 INFO:tasks.workunit.client.1.smithi086.stdout:3/822: truncate d3/d18/d1a/d51/d9b/f4b 153785 0 2024-08-19T00:56:15.815 INFO:tasks.workunit.client.1.smithi086.stdout:3/823: stat d3/d18/d19/d10a 0 2024-08-19T00:56:15.816 INFO:tasks.workunit.client.1.smithi086.stdout:9/827: fsync db/d26/d5c/d87/fc0 0 2024-08-19T00:56:15.817 INFO:tasks.workunit.client.1.smithi086.stdout:3/824: write d3/d18/d27/fe8 [957791,27429] 0 2024-08-19T00:56:15.822 INFO:tasks.workunit.client.1.smithi086.stdout:3/825: chown d3/d18/d1a/ce6 98 1 2024-08-19T00:56:15.822 INFO:tasks.workunit.client.1.smithi086.stdout:1/908: dwrite d4/d7/d2a/d36/d3a/d41/ff1 [0,4194304] 0 2024-08-19T00:56:15.822 INFO:tasks.workunit.client.1.smithi086.stdout:7/815: read d3/d5b/f6c [11260372,92702] 0 2024-08-19T00:56:15.824 INFO:tasks.workunit.client.0.smithi017.stdout:2/413: sync 2024-08-19T00:56:15.824 INFO:tasks.workunit.client.0.smithi017.stdout:5/265: sync 2024-08-19T00:56:15.824 INFO:tasks.workunit.client.0.smithi017.stdout:3/361: sync 2024-08-19T00:56:15.824 INFO:tasks.workunit.client.1.smithi086.stdout:1/909: readlink d4/d1e/l29 0 2024-08-19T00:56:15.825 INFO:tasks.workunit.client.0.smithi017.stdout:3/362: dread - d5/d11/f62 zero size 2024-08-19T00:56:15.826 INFO:tasks.workunit.client.0.smithi017.stdout:2/414: chown d2/d7/dd/l50 78904768 1 2024-08-19T00:56:15.829 INFO:tasks.workunit.client.0.smithi017.stdout:3/363: read d5/ff [6789990,13889] 0 2024-08-19T00:56:15.832 INFO:tasks.workunit.client.1.smithi086.stdout:2/852: dwrite d8/d24/d32/f4f [0,4194304] 0 2024-08-19T00:56:15.833 INFO:tasks.workunit.client.0.smithi017.stdout:5/266: dwrite db/d19/d33/f5b [0,4194304] 0 2024-08-19T00:56:15.834 INFO:tasks.workunit.client.0.smithi017.stdout:5/267: chown db/d19/d1f/d15/d3e 15361441 1 2024-08-19T00:56:15.835 INFO:tasks.workunit.client.1.smithi086.stdout:2/853: stat d8/d14/d9e/fb8 0 2024-08-19T00:56:15.836 INFO:tasks.workunit.client.1.smithi086.stdout:3/826: dwrite d3/d18/d19/dbc/fa0 [0,4194304] 0 2024-08-19T00:56:15.836 INFO:tasks.workunit.client.0.smithi017.stdout:3/364: mkdir d5/da/d3c/d4f/d68 0 2024-08-19T00:56:15.837 INFO:tasks.workunit.client.1.smithi086.stdout:4/778: dread d2/d18/d33/d42/d72/d78/d25/f35 [0,4194304] 0 2024-08-19T00:56:15.840 INFO:tasks.workunit.client.0.smithi017.stdout:2/415: truncate d2/f33 306800 0 2024-08-19T00:56:15.846 INFO:tasks.workunit.client.0.smithi017.stdout:3/365: dwrite d5/da/d27/f4c [0,4194304] 0 2024-08-19T00:56:15.848 INFO:tasks.workunit.client.0.smithi017.stdout:3/366: read d5/da/d27/f4c [2074774,130106] 0 2024-08-19T00:56:15.851 INFO:tasks.workunit.client.1.smithi086.stdout:3/827: symlink d3/d18/d19/d62/d46/l111 0 2024-08-19T00:56:15.853 INFO:tasks.workunit.client.1.smithi086.stdout:9/828: link db/d26/d5c/d87/d30/d58/cb0 db/d26/d5c/d87/d6d/dbf/c109 0 2024-08-19T00:56:15.853 INFO:tasks.workunit.client.1.smithi086.stdout:7/816: dwrite d3/de/fd5 [0,4194304] 0 2024-08-19T00:56:15.854 INFO:tasks.workunit.client.0.smithi017.stdout:2/416: symlink d2/d7/d10/d3b/d69/d7a/l87 0 2024-08-19T00:56:15.856 INFO:tasks.workunit.client.0.smithi017.stdout:3/367: rmdir d5/da/d27 39 2024-08-19T00:56:15.857 INFO:tasks.workunit.client.1.smithi086.stdout:1/910: link d4/d7/d2a/c83 d4/d7/d2a/d6e/d95/db9/deb/c129 0 2024-08-19T00:56:15.858 INFO:tasks.workunit.client.1.smithi086.stdout:2/854: symlink d8/d43/d65/da9/l11a 0 2024-08-19T00:56:15.859 INFO:tasks.workunit.client.1.smithi086.stdout:1/911: read d4/d7/d2a/d36/d3a/d41/ff1 [2192875,119619] 0 2024-08-19T00:56:15.861 INFO:tasks.workunit.client.1.smithi086.stdout:2/855: write d8/d2c/d47/d73/fea [571225,24930] 0 2024-08-19T00:56:15.862 INFO:tasks.workunit.client.1.smithi086.stdout:3/828: truncate d3/d9/fb2 4155825 0 2024-08-19T00:56:15.863 INFO:tasks.workunit.client.0.smithi017.stdout:3/368: mknod d5/da/c69 0 2024-08-19T00:56:15.867 INFO:tasks.workunit.client.0.smithi017.stdout:2/417: rename d2/d7/d10/d35/d55/d65/d6b/f85 to d2/d7/d10/d3b/d3c/f88 0 2024-08-19T00:56:15.869 INFO:tasks.workunit.client.0.smithi017.stdout:3/369: readlink d5/l26 0 2024-08-19T00:56:15.870 INFO:tasks.workunit.client.1.smithi086.stdout:7/817: mkdir d3/d34/d44/d58/d4b/da5/daf/de7/df5/d96/dfb/d10c 0 2024-08-19T00:56:15.871 INFO:tasks.workunit.client.0.smithi017.stdout:2/418: symlink d2/d7/d10/d3b/d69/l89 0 2024-08-19T00:56:15.872 INFO:tasks.workunit.client.0.smithi017.stdout:2/419: stat d2/d7/d10/d3b/d69/l89 0 2024-08-19T00:56:15.873 INFO:tasks.workunit.client.0.smithi017.stdout:2/420: chown d2/d7/d10/d35/c36 0 1 2024-08-19T00:56:15.874 INFO:tasks.workunit.client.0.smithi017.stdout:2/421: fdatasync d2/d7/d10/d35/d55/f71 0 2024-08-19T00:56:15.875 INFO:tasks.workunit.client.0.smithi017.stdout:2/422: stat d2/d7/dd/l50 0 2024-08-19T00:56:15.876 INFO:tasks.workunit.client.0.smithi017.stdout:2/423: fdatasync d2/d7/d10/d3b/d3c/f3d 0 2024-08-19T00:56:15.876 INFO:tasks.workunit.client.1.smithi086.stdout:1/912: unlink d4/d7/d2a/d36/d63/f78 0 2024-08-19T00:56:15.879 INFO:tasks.workunit.client.0.smithi017.stdout:3/370: rename d5/l67 to d5/d15/d53/l6a 0 2024-08-19T00:56:15.880 INFO:tasks.workunit.client.1.smithi086.stdout:3/829: dread d3/d18/d19/dbc/f65 [0,4194304] 0 2024-08-19T00:56:15.888 INFO:tasks.workunit.client.1.smithi086.stdout:1/913: unlink d4/d7/d2a/d6e/d95/l9a 0 2024-08-19T00:56:15.889 INFO:tasks.workunit.client.1.smithi086.stdout:1/914: write d4/d7/d2a/d36/d61/f102 [884544,104197] 0 2024-08-19T00:56:15.890 INFO:tasks.workunit.client.0.smithi017.stdout:3/371: dwrite d5/d11/f2a [0,4194304] 0 2024-08-19T00:56:15.892 INFO:tasks.workunit.client.1.smithi086.stdout:1/915: chown d4/d7/d2a/d36/d7d/d88/fcc 4808636 1 2024-08-19T00:56:15.895 INFO:tasks.workunit.client.0.smithi017.stdout:3/372: chown d5/d15/f21 0 1 2024-08-19T00:56:15.897 INFO:tasks.workunit.client.1.smithi086.stdout:8/798: sync 2024-08-19T00:56:15.898 INFO:tasks.workunit.client.1.smithi086.stdout:1/916: rename d4/d7/d2a/d36/d3a/de5/f8f to d4/d7/d2a/d36/d50/d9c/f12a 0 2024-08-19T00:56:15.907 INFO:tasks.workunit.client.0.smithi017.stdout:2/424: rename d2/d7/d10/d35/d55/d65 to d2/d7/d10/d3b/d3c/d8a 0 2024-08-19T00:56:15.907 INFO:tasks.workunit.client.1.smithi086.stdout:9/829: dwrite db/d26/d5c/d87/f42 [0,4194304] 0 2024-08-19T00:56:15.908 INFO:tasks.workunit.client.0.smithi017.stdout:2/425: readlink d2/d7/d10/d19/d48/l62 0 2024-08-19T00:56:15.911 INFO:tasks.workunit.client.0.smithi017.stdout:3/373: rename d5/d18/l1c to d5/d32/l6b 0 2024-08-19T00:56:15.912 INFO:tasks.workunit.client.1.smithi086.stdout:9/830: creat db/d26/d5c/d87/d6d/deb/f10a x:0 0 0 2024-08-19T00:56:15.914 INFO:tasks.workunit.client.1.smithi086.stdout:9/831: write db/d26/f93 [124108,58233] 0 2024-08-19T00:56:15.915 INFO:tasks.workunit.client.0.smithi017.stdout:2/426: dread d2/d7/d10/d19/f41 [0,4194304] 0 2024-08-19T00:56:15.915 INFO:tasks.workunit.client.0.smithi017.stdout:3/374: chown d5/d18/c36 138944813 1 2024-08-19T00:56:15.918 INFO:tasks.workunit.client.1.smithi086.stdout:2/856: dwrite d8/d24/d32/d61/fc7 [0,4194304] 0 2024-08-19T00:56:15.919 INFO:tasks.workunit.client.1.smithi086.stdout:7/818: write d3/de/d68/d72/fe8 [3993625,370] 0 2024-08-19T00:56:15.927 INFO:tasks.workunit.client.0.smithi017.stdout:3/375: dwrite d5/d11/f14 [4194304,4194304] 0 2024-08-19T00:56:15.930 INFO:tasks.workunit.client.1.smithi086.stdout:1/917: write d4/d7/d2a/d36/d50/d9c/f9e [4061520,114410] 0 2024-08-19T00:56:15.930 INFO:tasks.workunit.client.1.smithi086.stdout:3/830: dwrite d3/d18/d27/d49/f35 [0,4194304] 0 2024-08-19T00:56:15.930 INFO:tasks.workunit.client.1.smithi086.stdout:2/857: truncate d8/d14/d10a/f119 862149 0 2024-08-19T00:56:15.933 INFO:tasks.workunit.client.0.smithi017.stdout:3/376: write d5/da/d27/d28/f37 [648735,121265] 0 2024-08-19T00:56:15.934 INFO:tasks.workunit.client.0.smithi017.stdout:2/427: getdents d2/d7/d10/d3b/d3c/d8a/d6b 0 2024-08-19T00:56:15.934 INFO:tasks.workunit.client.0.smithi017.stdout:3/377: rename d5/da/d3c/d4f to d5/da/d3c/d4f/d6c 22 2024-08-19T00:56:15.935 INFO:tasks.workunit.client.1.smithi086.stdout:1/918: stat d4/d7/d2a/d36/d3a/de5/d7a/db4/df0/f112 0 2024-08-19T00:56:15.939 INFO:tasks.workunit.client.0.smithi017.stdout:3/378: stat d5/d15/l22 0 2024-08-19T00:56:15.939 INFO:tasks.workunit.client.1.smithi086.stdout:7/819: mkdir d3/da1/d108/d10d 0 2024-08-19T00:56:15.940 INFO:tasks.workunit.client.0.smithi017.stdout:3/379: chown d5/d15/l22 767103541 1 2024-08-19T00:56:15.942 INFO:tasks.workunit.client.1.smithi086.stdout:8/799: dwrite dc/d16/d18/d106/d28/d2b/f38 [0,4194304] 0 2024-08-19T00:56:15.943 INFO:tasks.workunit.client.0.smithi017.stdout:2/428: dwrite d2/d7/d10/d35/d45/d58/f67 [0,4194304] 0 2024-08-19T00:56:15.943 INFO:tasks.workunit.client.1.smithi086.stdout:9/832: dread db/d26/d5c/d87/d6d/fe3 [0,4194304] 0 2024-08-19T00:56:15.943 INFO:tasks.workunit.client.1.smithi086.stdout:1/919: chown d4/d7/d2a/d36/d3a/d41/c44 3 1 2024-08-19T00:56:15.944 INFO:tasks.workunit.client.1.smithi086.stdout:2/858: creat d8/d24/d32/d4d/d6a/dfe/f11b x:0 0 0 2024-08-19T00:56:15.946 INFO:tasks.workunit.client.1.smithi086.stdout:6/828: sync 2024-08-19T00:56:15.946 INFO:tasks.workunit.client.0.smithi017.stdout:3/380: rmdir d5/da/d3c/d4f 39 2024-08-19T00:56:15.950 INFO:tasks.workunit.client.0.smithi017.stdout:3/381: unlink d5/da/d27/d28/c38 0 2024-08-19T00:56:15.951 INFO:tasks.workunit.client.1.smithi086.stdout:2/859: write d8/d2c/d47/d73/fef [268154,9649] 0 2024-08-19T00:56:15.951 INFO:tasks.workunit.client.1.smithi086.stdout:7/820: dwrite d3/d34/f76 [0,4194304] 0 2024-08-19T00:56:15.953 INFO:tasks.workunit.client.1.smithi086.stdout:7/821: chown d3/d34/d44/d58/d4b/d78/l99 694 1 2024-08-19T00:56:15.953 INFO:tasks.workunit.client.1.smithi086.stdout:1/920: symlink d4/d7/d2a/d36/d50/d9c/l12b 0 2024-08-19T00:56:15.954 INFO:tasks.workunit.client.1.smithi086.stdout:7/822: chown d3 51169 1 2024-08-19T00:56:15.958 INFO:tasks.workunit.client.0.smithi017.stdout:3/382: creat d5/da/d27/f6d x:0 0 0 2024-08-19T00:56:15.961 INFO:tasks.workunit.client.1.smithi086.stdout:7/823: dwrite d3/d34/f89 [0,4194304] 0 2024-08-19T00:56:15.961 INFO:tasks.workunit.client.1.smithi086.stdout:9/833: symlink db/d26/d5c/d87/d30/d31/d103/de2/dee/def/l10b 0 2024-08-19T00:56:15.962 INFO:tasks.workunit.client.0.smithi017.stdout:3/383: rmdir d5/da 39 2024-08-19T00:56:15.968 INFO:tasks.workunit.client.1.smithi086.stdout:6/829: unlink db/d37/d41/fed 0 2024-08-19T00:56:15.969 INFO:tasks.workunit.client.0.smithi017.stdout:3/384: dwrite d5/d18/f45 [0,4194304] 0 2024-08-19T00:56:15.969 INFO:tasks.workunit.client.1.smithi086.stdout:9/834: truncate db/d26/f49 2460895 0 2024-08-19T00:56:15.970 INFO:tasks.workunit.client.1.smithi086.stdout:6/830: dread - db/d37/d44/d5a/d8f/ff6 zero size 2024-08-19T00:56:15.974 INFO:tasks.workunit.client.1.smithi086.stdout:1/921: mkdir d4/d7/d2a/d36/d50/d116/d12c 0 2024-08-19T00:56:15.977 INFO:tasks.workunit.client.0.smithi017.stdout:2/429: truncate d2/d7/d10/d3b/d3c/f40 1834641 0 2024-08-19T00:56:15.977 INFO:tasks.workunit.client.0.smithi017.stdout:6/384: sync 2024-08-19T00:56:15.977 INFO:tasks.workunit.client.0.smithi017.stdout:1/293: sync 2024-08-19T00:56:15.977 INFO:tasks.workunit.client.0.smithi017.stdout:4/358: sync 2024-08-19T00:56:15.977 INFO:tasks.workunit.client.0.smithi017.stdout:9/331: sync 2024-08-19T00:56:15.977 INFO:tasks.workunit.client.0.smithi017.stdout:7/372: sync 2024-08-19T00:56:15.978 INFO:tasks.workunit.client.1.smithi086.stdout:6/831: mkdir db/d34/d103 0 2024-08-19T00:56:15.978 INFO:tasks.workunit.client.0.smithi017.stdout:0/344: sync 2024-08-19T00:56:15.978 INFO:tasks.workunit.client.0.smithi017.stdout:2/430: fdatasync d2/d7/d29/f83 0 2024-08-19T00:56:15.979 INFO:tasks.workunit.client.1.smithi086.stdout:8/800: getdents dc/d1f/d37/d4f/dac/db8/d7a/d9b 0 2024-08-19T00:56:15.980 INFO:tasks.workunit.client.1.smithi086.stdout:9/835: unlink db/d26/d5c/d87/d6d/ccd 0 2024-08-19T00:56:15.980 INFO:tasks.workunit.client.0.smithi017.stdout:2/431: stat d2/d7/d10/d3b/d3c/l59 0 2024-08-19T00:56:15.981 INFO:tasks.workunit.client.1.smithi086.stdout:3/831: dread d3/d18/d27/d49/fc0 [0,4194304] 0 2024-08-19T00:56:15.983 INFO:tasks.workunit.client.0.smithi017.stdout:0/345: mknod d5/d17/d45/d50/c75 0 2024-08-19T00:56:15.984 INFO:tasks.workunit.client.0.smithi017.stdout:0/346: dread - d5/d17/d21/f68 zero size 2024-08-19T00:56:15.985 INFO:tasks.workunit.client.1.smithi086.stdout:7/824: dread d3/d34/d44/d58/d4b/da5/f67 [0,4194304] 0 2024-08-19T00:56:15.985 INFO:tasks.workunit.client.0.smithi017.stdout:7/373: mknod d3/dc/c6d 0 2024-08-19T00:56:15.986 INFO:tasks.workunit.client.0.smithi017.stdout:0/347: truncate d5/d18/f4c 4843339 0 2024-08-19T00:56:15.987 INFO:tasks.workunit.client.0.smithi017.stdout:0/348: stat d5/d17/d2b/l5e 0 2024-08-19T00:56:15.989 INFO:tasks.workunit.client.1.smithi086.stdout:3/832: creat d3/d18/d27/d49/d3f/d54/f112 x:0 0 0 2024-08-19T00:56:15.991 INFO:tasks.workunit.client.0.smithi017.stdout:9/332: unlink d0/d33/l3f 0 2024-08-19T00:56:15.992 INFO:tasks.workunit.client.0.smithi017.stdout:4/359: mknod d2/d1a/d55/d73/c76 0 2024-08-19T00:56:15.995 INFO:tasks.workunit.client.0.smithi017.stdout:7/374: creat d3/dc/df/d37/d46/f6e x:0 0 0 2024-08-19T00:56:16.000 INFO:tasks.workunit.client.0.smithi017.stdout:0/349: symlink d5/d17/d21/d39/l76 0 2024-08-19T00:56:16.001 INFO:tasks.workunit.client.0.smithi017.stdout:0/350: chown d5/d17 557664 1 2024-08-19T00:56:16.003 INFO:tasks.workunit.client.0.smithi017.stdout:3/385: dread d5/d15/d1b/f39 [0,4194304] 0 2024-08-19T00:56:16.004 INFO:tasks.workunit.client.1.smithi086.stdout:0/832: sync 2024-08-19T00:56:16.004 INFO:tasks.workunit.client.1.smithi086.stdout:5/818: sync 2024-08-19T00:56:16.004 INFO:tasks.workunit.client.1.smithi086.stdout:4/779: sync 2024-08-19T00:56:16.005 INFO:tasks.workunit.client.1.smithi086.stdout:1/922: getdents d4/d10/d90/d98 0 2024-08-19T00:56:16.006 INFO:tasks.workunit.client.0.smithi017.stdout:4/360: rename d2/d11/d6b to d2/d16/d77 0 2024-08-19T00:56:16.008 INFO:tasks.workunit.client.1.smithi086.stdout:2/860: dwrite d8/d43/d77/fbe [0,4194304] 0 2024-08-19T00:56:16.008 INFO:tasks.workunit.client.1.smithi086.stdout:5/819: chown d0/d8/d72/l7f 10 1 2024-08-19T00:56:16.008 INFO:tasks.workunit.client.1.smithi086.stdout:3/833: dread d3/d26/f73 [0,4194304] 0 2024-08-19T00:56:16.009 INFO:tasks.workunit.client.1.smithi086.stdout:4/780: chown d2/d18/d33/d42/d72/f96 11449 1 2024-08-19T00:56:16.009 INFO:tasks.workunit.client.0.smithi017.stdout:4/361: write d2/d1a/f69 [771119,129478] 0 2024-08-19T00:56:16.009 INFO:tasks.workunit.client.0.smithi017.stdout:9/333: dread d0/d33/f4d [0,4194304] 0 2024-08-19T00:56:16.011 INFO:tasks.workunit.client.1.smithi086.stdout:2/861: write d8/d43/d65/da9/fde [675615,116344] 0 2024-08-19T00:56:16.012 INFO:tasks.workunit.client.0.smithi017.stdout:4/362: write d2/d11/f63 [806737,73728] 0 2024-08-19T00:56:16.013 INFO:tasks.workunit.client.1.smithi086.stdout:7/825: dread d3/de/d2d/f32 [0,4194304] 0 2024-08-19T00:56:16.013 INFO:tasks.workunit.client.1.smithi086.stdout:2/862: fsync d8/d84/de0/ff4 0 2024-08-19T00:56:16.019 INFO:tasks.workunit.client.0.smithi017.stdout:7/375: rename d3/dc/df/d1a/f60 to d3/dc/df/d23/d69/f6f 0 2024-08-19T00:56:16.020 INFO:tasks.workunit.client.0.smithi017.stdout:7/376: dread - d3/dc/df/d1c/f68 zero size 2024-08-19T00:56:16.022 INFO:tasks.workunit.client.1.smithi086.stdout:3/834: mknod d3/d18/d19/d37/d3a/c113 0 2024-08-19T00:56:16.023 INFO:tasks.workunit.client.1.smithi086.stdout:6/832: write db/d37/d44/d5a/d78/f92 [558097,97424] 0 2024-08-19T00:56:16.023 INFO:tasks.workunit.client.0.smithi017.stdout:9/334: unlink d0/f48 0 2024-08-19T00:56:16.025 INFO:tasks.workunit.client.1.smithi086.stdout:4/781: readlink d2/d18/d33/d42/d72/l44 0 2024-08-19T00:56:16.025 INFO:tasks.workunit.client.1.smithi086.stdout:8/801: dwrite dc/d16/d18/d106/d28/d2b/d3b/f58 [0,4194304] 0 2024-08-19T00:56:16.026 INFO:tasks.workunit.client.0.smithi017.stdout:3/386: mkdir d5/da/d27/d6e 0 2024-08-19T00:56:16.028 INFO:tasks.workunit.client.1.smithi086.stdout:5/820: dwrite d0/d99/dc0/dc2/f79 [0,4194304] 0 2024-08-19T00:56:16.029 INFO:tasks.workunit.client.0.smithi017.stdout:1/294: truncate d4/d1c/f46 3648516 0 2024-08-19T00:56:16.032 INFO:tasks.workunit.client.1.smithi086.stdout:7/826: mkdir d3/d34/d44/d58/d4b/dcd/d10e 0 2024-08-19T00:56:16.032 INFO:tasks.workunit.client.0.smithi017.stdout:2/432: truncate d2/d7/d10/f11 2732744 0 2024-08-19T00:56:16.033 INFO:tasks.workunit.client.1.smithi086.stdout:9/836: dwrite db/f52 [0,4194304] 0 2024-08-19T00:56:16.034 INFO:tasks.workunit.client.1.smithi086.stdout:2/863: symlink d8/d43/d77/dcc/l11c 0 2024-08-19T00:56:16.036 INFO:tasks.workunit.client.1.smithi086.stdout:0/833: write da/d14/d1a/d2e/d66/fce [259462,60783] 0 2024-08-19T00:56:16.038 INFO:tasks.workunit.client.1.smithi086.stdout:6/833: rmdir db/d34/d4e/db4 39 2024-08-19T00:56:16.039 INFO:tasks.workunit.client.1.smithi086.stdout:6/834: fsync db/d37/d44/d5a/d8f/fd1 0 2024-08-19T00:56:16.047 INFO:tasks.workunit.client.0.smithi017.stdout:7/377: dwrite d3/dc/d5f/f63 [0,4194304] 0 2024-08-19T00:56:16.047 INFO:tasks.workunit.client.1.smithi086.stdout:4/782: rename d2/d18/d33/l94 to d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd/l105 0 2024-08-19T00:56:16.048 INFO:tasks.workunit.client.0.smithi017.stdout:7/378: chown d3/f12 1 1 2024-08-19T00:56:16.049 INFO:tasks.workunit.client.0.smithi017.stdout:1/295: rmdir d4/d1c 39 2024-08-19T00:56:16.051 INFO:tasks.workunit.client.0.smithi017.stdout:1/296: stat d4/dc/ce 0 2024-08-19T00:56:16.055 INFO:tasks.workunit.client.0.smithi017.stdout:0/351: truncate d5/d17/d21/d42/f1d 1191867 0 2024-08-19T00:56:16.060 INFO:tasks.workunit.client.0.smithi017.stdout:3/387: truncate d5/d15/d1b/f20 1927220 0 2024-08-19T00:56:16.060 INFO:tasks.workunit.client.1.smithi086.stdout:2/864: creat d8/d84/f11d x:0 0 0 2024-08-19T00:56:16.060 INFO:tasks.workunit.client.1.smithi086.stdout:1/923: creat d4/d7/d2a/d36/d7d/f12d x:0 0 0 2024-08-19T00:56:16.061 INFO:tasks.workunit.client.1.smithi086.stdout:2/865: chown d8/d84/de0 275346428 1 2024-08-19T00:56:16.064 INFO:tasks.workunit.client.0.smithi017.stdout:4/363: creat d2/f78 x:0 0 0 2024-08-19T00:56:16.065 INFO:tasks.workunit.client.0.smithi017.stdout:4/364: write d2/d1a/f3d [130834,99126] 0 2024-08-19T00:56:16.066 INFO:tasks.workunit.client.0.smithi017.stdout:7/379: mknod d3/dc/df/d37/d39/c70 0 2024-08-19T00:56:16.067 INFO:tasks.workunit.client.0.smithi017.stdout:7/380: write d3/dc/f5b [453267,30063] 0 2024-08-19T00:56:16.070 INFO:tasks.workunit.client.1.smithi086.stdout:7/827: unlink d3/d34/d44/d58/d4b/c1f 0 2024-08-19T00:56:16.071 INFO:tasks.workunit.client.1.smithi086.stdout:4/783: mknod d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/c106 0 2024-08-19T00:56:16.075 INFO:tasks.workunit.client.0.smithi017.stdout:4/365: creat d2/d1a/d55/f79 x:0 0 0 2024-08-19T00:56:16.075 INFO:tasks.workunit.client.1.smithi086.stdout:9/837: write db/f61 [404733,109719] 0 2024-08-19T00:56:16.080 INFO:tasks.workunit.client.0.smithi017.stdout:7/381: rmdir d3/d3c 39 2024-08-19T00:56:16.080 INFO:tasks.workunit.client.0.smithi017.stdout:9/335: dread d0/d58/f3e [0,4194304] 0 2024-08-19T00:56:16.081 INFO:tasks.workunit.client.0.smithi017.stdout:7/382: chown d3/dc/df/l47 5938597 1 2024-08-19T00:56:16.082 INFO:tasks.workunit.client.0.smithi017.stdout:0/352: mkdir d5/d17/d45/d77 0 2024-08-19T00:56:16.086 INFO:tasks.workunit.client.1.smithi086.stdout:0/834: dwrite da/d14/d44/d49/f63 [0,4194304] 0 2024-08-19T00:56:16.087 INFO:tasks.workunit.client.0.smithi017.stdout:4/366: rename d2/c5f to d2/d1a/d55/d64/c7a 0 2024-08-19T00:56:16.088 INFO:tasks.workunit.client.0.smithi017.stdout:0/353: dwrite d5/f16 [0,4194304] 0 2024-08-19T00:56:16.089 INFO:tasks.workunit.client.0.smithi017.stdout:2/433: getdents d2/d7/dd 0 2024-08-19T00:56:16.094 INFO:tasks.workunit.client.0.smithi017.stdout:1/297: write d4/d1c/f32 [2221839,69079] 0 2024-08-19T00:56:16.096 INFO:tasks.workunit.client.0.smithi017.stdout:1/298: chown d4/dc/d17/d1d/c35 1674 1 2024-08-19T00:56:16.099 INFO:tasks.workunit.client.0.smithi017.stdout:9/336: symlink d0/d33/d22/d5a/l61 0 2024-08-19T00:56:16.103 INFO:tasks.workunit.client.0.smithi017.stdout:1/299: dwrite d4/dc/f40 [0,4194304] 0 2024-08-19T00:56:16.106 INFO:tasks.workunit.client.0.smithi017.stdout:4/367: creat d2/d1a/d55/d73/f7b x:0 0 0 2024-08-19T00:56:16.107 INFO:tasks.workunit.client.0.smithi017.stdout:4/368: fsync d2/d11/d24/f2e 0 2024-08-19T00:56:16.109 INFO:tasks.workunit.client.0.smithi017.stdout:2/434: fdatasync d2/d7/d10/d19/f7b 0 2024-08-19T00:56:16.111 INFO:tasks.workunit.client.0.smithi017.stdout:7/383: truncate d3/dc/f1f 2662050 0 2024-08-19T00:56:16.114 INFO:tasks.workunit.client.0.smithi017.stdout:2/435: dread d2/d7/d10/d35/d45/d58/f67 [0,4194304] 0 2024-08-19T00:56:16.115 INFO:tasks.workunit.client.0.smithi017.stdout:2/436: write d2/d7/f43 [5822542,115587] 0 2024-08-19T00:56:16.117 INFO:tasks.workunit.client.0.smithi017.stdout:2/437: write d2/d7/d10/f25 [3647949,125394] 0 2024-08-19T00:56:16.117 INFO:tasks.workunit.client.0.smithi017.stdout:3/388: getdents d5/da/d27/d28 0 2024-08-19T00:56:16.137 INFO:tasks.workunit.client.0.smithi017.stdout:8/245: sync 2024-08-19T00:56:16.137 INFO:tasks.workunit.client.0.smithi017.stdout:5/268: sync 2024-08-19T00:56:16.153 INFO:tasks.workunit.client.0.smithi017.stdout:1/300: mkdir d4/dc/d3b/d3d/d54 0 2024-08-19T00:56:16.155 INFO:tasks.workunit.client.0.smithi017.stdout:0/354: write d5/d17/d26/d30/f63 [322054,106429] 0 2024-08-19T00:56:16.155 INFO:tasks.workunit.client.0.smithi017.stdout:1/301: write d4/d1c/f32 [1066574,3138] 0 2024-08-19T00:56:16.156 INFO:tasks.workunit.client.0.smithi017.stdout:1/302: stat d4/dc/d3b/d45/f4d 0 2024-08-19T00:56:16.157 INFO:tasks.workunit.client.0.smithi017.stdout:1/303: fdatasync d4/dc/d19/f44 0 2024-08-19T00:56:16.158 INFO:tasks.workunit.client.0.smithi017.stdout:1/304: stat d4/dc/d3b/d3d 0 2024-08-19T00:56:16.162 INFO:tasks.workunit.client.0.smithi017.stdout:2/438: creat d2/d7/d10/d3b/d69/f8b x:0 0 0 2024-08-19T00:56:16.164 INFO:tasks.workunit.client.0.smithi017.stdout:8/246: rmdir de 39 2024-08-19T00:56:16.166 INFO:tasks.workunit.client.0.smithi017.stdout:5/269: stat db/d19/d1f/d15/d30/l4e 0 2024-08-19T00:56:16.167 INFO:tasks.workunit.client.0.smithi017.stdout:5/270: dread - db/d19/d1f/d15/f5a zero size 2024-08-19T00:56:16.171 INFO:tasks.workunit.client.0.smithi017.stdout:4/369: symlink d2/l7c 0 2024-08-19T00:56:16.174 INFO:tasks.workunit.client.0.smithi017.stdout:9/337: link d0/d33/d22/f2f d0/d33/d22/f62 0 2024-08-19T00:56:16.177 INFO:tasks.workunit.client.0.smithi017.stdout:3/389: fdatasync d5/da/d27/f3a 0 2024-08-19T00:56:16.180 INFO:tasks.workunit.client.0.smithi017.stdout:9/338: dwrite d0/f18 [4194304,4194304] 0 2024-08-19T00:56:16.184 INFO:tasks.workunit.client.0.smithi017.stdout:8/247: dread de/d15/f3b [0,4194304] 0 2024-08-19T00:56:16.186 INFO:tasks.workunit.client.1.smithi086.stdout:6/835: symlink db/d37/d28/d7f/d96/dc2/dfa/l104 0 2024-08-19T00:56:16.187 INFO:tasks.workunit.client.0.smithi017.stdout:0/355: dwrite d5/d18/d3a/f70 [4194304,4194304] 0 2024-08-19T00:56:16.188 INFO:tasks.workunit.client.1.smithi086.stdout:1/924: dread d4/d7/d2a/f4d [0,4194304] 0 2024-08-19T00:56:16.189 INFO:tasks.workunit.client.1.smithi086.stdout:8/802: creat dc/d1f/d37/d4f/dac/db8/d7a/f10a x:0 0 0 2024-08-19T00:56:16.189 INFO:tasks.workunit.client.0.smithi017.stdout:0/356: chown d5/l61 7648670 1 2024-08-19T00:56:16.190 INFO:tasks.workunit.client.1.smithi086.stdout:5/821: link d0/d5f/f6f d0/d5f/d60/d57/d80/d9e/ffb 0 2024-08-19T00:56:16.191 INFO:tasks.workunit.client.0.smithi017.stdout:0/357: write d5/fc [2259803,70936] 0 2024-08-19T00:56:16.191 INFO:tasks.workunit.client.1.smithi086.stdout:5/822: readlink d0/d8/lc 0 2024-08-19T00:56:16.192 INFO:tasks.workunit.client.1.smithi086.stdout:7/828: rmdir d3/d34/d44/d58/d4b/da5/daf/de7/df5 39 2024-08-19T00:56:16.192 INFO:tasks.workunit.client.1.smithi086.stdout:5/823: write d0/df/d1f/f27 [1664086,103710] 0 2024-08-19T00:56:16.201 INFO:tasks.workunit.client.1.smithi086.stdout:2/866: symlink d8/d43/d77/l11e 0 2024-08-19T00:56:16.201 INFO:tasks.workunit.client.1.smithi086.stdout:2/867: readlink d8/d14/l7c 0 2024-08-19T00:56:16.201 INFO:tasks.workunit.client.0.smithi017.stdout:4/370: dwrite d2/d11/f72 [0,4194304] 0 2024-08-19T00:56:16.203 INFO:tasks.workunit.client.1.smithi086.stdout:2/868: write d8/d24/d32/d4d/d6a/fc6 [141333,116760] 0 2024-08-19T00:56:16.203 INFO:tasks.workunit.client.1.smithi086.stdout:6/836: mknod db/d34/d4e/d68/d99/c105 0 2024-08-19T00:56:16.203 INFO:tasks.workunit.client.0.smithi017.stdout:8/248: creat de/d15/d39/f41 x:0 0 0 2024-08-19T00:56:16.205 INFO:tasks.workunit.client.0.smithi017.stdout:8/249: write de/d36/f32 [485304,37741] 0 2024-08-19T00:56:16.206 INFO:tasks.workunit.client.1.smithi086.stdout:5/824: mknod d0/df/d1f/d65/cfc 0 2024-08-19T00:56:16.208 INFO:tasks.workunit.client.1.smithi086.stdout:3/835: sync 2024-08-19T00:56:16.209 INFO:tasks.workunit.client.1.smithi086.stdout:7/829: creat d3/d34/d44/d58/f10f x:0 0 0 2024-08-19T00:56:16.209 INFO:tasks.workunit.client.0.smithi017.stdout:3/390: symlink d5/da/d3c/d4f/l6f 0 2024-08-19T00:56:16.210 INFO:tasks.workunit.client.0.smithi017.stdout:2/439: link d2/d7/d29/f37 d2/d7/d10/d35/d7e/f8c 0 2024-08-19T00:56:16.211 INFO:tasks.workunit.client.1.smithi086.stdout:9/838: mknod db/d26/d5c/d87/c10c 0 2024-08-19T00:56:16.212 INFO:tasks.workunit.client.0.smithi017.stdout:2/440: write d2/d7/d10/d3b/d69/f7f [801135,113102] 0 2024-08-19T00:56:16.214 INFO:tasks.workunit.client.0.smithi017.stdout:2/441: read d2/d7/dd/f1c [1376667,40230] 0 2024-08-19T00:56:16.214 INFO:tasks.workunit.client.1.smithi086.stdout:8/803: dread dc/d16/d18/d106/d28/f69 [0,4194304] 0 2024-08-19T00:56:16.215 INFO:tasks.workunit.client.0.smithi017.stdout:9/339: truncate d0/f14 3353173 0 2024-08-19T00:56:16.218 INFO:tasks.workunit.client.0.smithi017.stdout:5/271: creat db/d19/d1f/d15/f64 x:0 0 0 2024-08-19T00:56:16.219 INFO:tasks.workunit.client.0.smithi017.stdout:9/340: dread d0/f60 [0,4194304] 0 2024-08-19T00:56:16.220 INFO:tasks.workunit.client.1.smithi086.stdout:5/825: rename d0/d2d/d43/d4d to d0/df/d1f/d65/dfd 0 2024-08-19T00:56:16.220 INFO:tasks.workunit.client.0.smithi017.stdout:9/341: readlink d0/d33/d22/l43 0 2024-08-19T00:56:16.221 INFO:tasks.workunit.client.0.smithi017.stdout:1/305: getdents d4/dc/d17 0 2024-08-19T00:56:16.222 INFO:tasks.workunit.client.1.smithi086.stdout:3/836: creat d3/d18/d1a/d51/d75/f114 x:0 0 0 2024-08-19T00:56:16.223 INFO:tasks.workunit.client.0.smithi017.stdout:1/306: write d4/dc/f11 [5745195,59064] 0 2024-08-19T00:56:16.223 INFO:tasks.workunit.client.0.smithi017.stdout:8/250: mknod de/d36/d2e/c42 0 2024-08-19T00:56:16.223 INFO:tasks.workunit.client.0.smithi017.stdout:8/251: fdatasync de/f34 0 2024-08-19T00:56:16.224 INFO:tasks.workunit.client.1.smithi086.stdout:7/830: mknod d3/d34/d44/d58/d4b/dcd/c110 0 2024-08-19T00:56:16.225 INFO:tasks.workunit.client.1.smithi086.stdout:9/839: mknod db/d96/da7/c10d 0 2024-08-19T00:56:16.227 INFO:tasks.workunit.client.1.smithi086.stdout:5/826: dwrite d0/d8/d10/dbb/fec [0,4194304] 0 2024-08-19T00:56:16.228 INFO:tasks.workunit.client.1.smithi086.stdout:9/840: chown db/d26/d5c/d87/d30/d31/d103/d19/f33 140439074 1 2024-08-19T00:56:16.228 INFO:tasks.workunit.client.1.smithi086.stdout:5/827: chown d0/df/d1f/d65/dfd 101141739 1 2024-08-19T00:56:16.229 INFO:tasks.workunit.client.1.smithi086.stdout:8/804: rmdir dc/d1f/df0 39 2024-08-19T00:56:16.230 INFO:tasks.workunit.client.0.smithi017.stdout:0/358: dread d5/fa [0,4194304] 0 2024-08-19T00:56:16.231 INFO:tasks.workunit.client.0.smithi017.stdout:8/252: dwrite de/d15/f2b [0,4194304] 0 2024-08-19T00:56:16.232 INFO:tasks.workunit.client.1.smithi086.stdout:2/869: mknod d8/d14/dae/ddc/c11f 0 2024-08-19T00:56:16.233 INFO:tasks.workunit.client.0.smithi017.stdout:5/272: chown db/c22 556407 1 2024-08-19T00:56:16.233 INFO:tasks.workunit.client.1.smithi086.stdout:1/925: link d4/d7/d2a/d6e/d95/db9/deb/l11a d4/d7/d125/l12e 0 2024-08-19T00:56:16.234 INFO:tasks.workunit.client.1.smithi086.stdout:2/870: truncate d8/d2c/d38/fe6 563875 0 2024-08-19T00:56:16.235 INFO:tasks.workunit.client.1.smithi086.stdout:4/784: getdents d2/d18/dbd 0 2024-08-19T00:56:16.237 INFO:tasks.workunit.client.1.smithi086.stdout:8/805: dwrite dc/d16/d18/d106/d28/d2b/f64 [0,4194304] 0 2024-08-19T00:56:16.240 INFO:tasks.workunit.client.1.smithi086.stdout:4/785: write d2/d18/d33/d42/d72/d2f/d8e/f103 [929984,49763] 0 2024-08-19T00:56:16.247 INFO:tasks.workunit.client.0.smithi017.stdout:1/307: dread d4/dc/f18 [0,4194304] 0 2024-08-19T00:56:16.249 INFO:tasks.workunit.client.1.smithi086.stdout:9/841: mkdir db/d26/d5c/d87/d30/d31/d103/d19/d18/d10e 0 2024-08-19T00:56:16.252 INFO:tasks.workunit.client.0.smithi017.stdout:2/442: fsync d2/f33 0 2024-08-19T00:56:16.252 INFO:tasks.workunit.client.1.smithi086.stdout:9/842: read db/d26/d5c/d87/d37/f81 [2268855,34978] 0 2024-08-19T00:56:16.252 INFO:tasks.workunit.client.0.smithi017.stdout:2/443: chown d2/d7/d10/d3b/d69 182973 1 2024-08-19T00:56:16.254 INFO:tasks.workunit.client.1.smithi086.stdout:2/871: rename d8/d14/d9e to d8/d2c/d38/d80/db4/db7/d120 0 2024-08-19T00:56:16.254 INFO:tasks.workunit.client.1.smithi086.stdout:6/837: dwrite db/d37/d30/f33 [4194304,4194304] 0 2024-08-19T00:56:16.257 INFO:tasks.workunit.client.1.smithi086.stdout:8/806: creat dc/d1f/d37/d9f/f10b x:0 0 0 2024-08-19T00:56:16.257 INFO:tasks.workunit.client.1.smithi086.stdout:7/831: write d3/d34/d44/d58/d4b/da5/f5d [3592895,2773] 0 2024-08-19T00:56:16.261 INFO:tasks.workunit.client.0.smithi017.stdout:2/444: dwrite d2/d7/d10/d3b/d54/f4f [0,4194304] 0 2024-08-19T00:56:16.261 INFO:tasks.workunit.client.0.smithi017.stdout:5/273: write db/f24 [8148077,46664] 0 2024-08-19T00:56:16.262 INFO:tasks.workunit.client.1.smithi086.stdout:6/838: dwrite db/d34/d4e/fd2 [0,4194304] 0 2024-08-19T00:56:16.262 INFO:tasks.workunit.client.1.smithi086.stdout:6/839: readlink db/d34/d4e/laf 0 2024-08-19T00:56:16.265 INFO:tasks.workunit.client.0.smithi017.stdout:0/359: dread d5/f1c [0,4194304] 0 2024-08-19T00:56:16.266 INFO:tasks.workunit.client.0.smithi017.stdout:9/342: mknod d0/d33/d22/d52/c63 0 2024-08-19T00:56:16.268 INFO:tasks.workunit.client.1.smithi086.stdout:9/843: creat db/d26/d5c/d87/d30/d31/d103/f10f x:0 0 0 2024-08-19T00:56:16.273 INFO:tasks.workunit.client.0.smithi017.stdout:2/445: dwrite d2/d7/d10/d3b/d69/f8b [0,4194304] 0 2024-08-19T00:56:16.275 INFO:tasks.workunit.client.1.smithi086.stdout:3/837: creat d3/d18/d27/d49/d3f/d5b/f115 x:0 0 0 2024-08-19T00:56:16.275 INFO:tasks.workunit.client.0.smithi017.stdout:2/446: truncate d2/d7/d10/d3b/d54/f5b 216158 0 2024-08-19T00:56:16.277 INFO:tasks.workunit.client.1.smithi086.stdout:7/832: truncate d3/d34/d44/d58/d4b/d42/fb4 96164 0 2024-08-19T00:56:16.278 INFO:tasks.workunit.client.0.smithi017.stdout:4/371: getdents d2/d11/d24 0 2024-08-19T00:56:16.280 INFO:tasks.workunit.client.0.smithi017.stdout:5/274: mknod db/d19/d57/c65 0 2024-08-19T00:56:16.282 INFO:tasks.workunit.client.0.smithi017.stdout:0/360: mkdir d5/d18/d78 0 2024-08-19T00:56:16.283 INFO:tasks.workunit.client.0.smithi017.stdout:9/343: stat d0/d33/c12 0 2024-08-19T00:56:16.285 INFO:tasks.workunit.client.1.smithi086.stdout:2/872: unlink d8/d43/d77/c7f 0 2024-08-19T00:56:16.286 INFO:tasks.workunit.client.1.smithi086.stdout:8/807: symlink dc/d16/d18/d94/l10c 0 2024-08-19T00:56:16.287 INFO:tasks.workunit.client.0.smithi017.stdout:4/372: dread d2/d1a/f3d [0,4194304] 0 2024-08-19T00:56:16.290 INFO:tasks.workunit.client.1.smithi086.stdout:7/833: creat d3/d34/d44/d58/f111 x:0 0 0 2024-08-19T00:56:16.291 INFO:tasks.workunit.client.0.smithi017.stdout:5/275: rmdir db/d19 39 2024-08-19T00:56:16.292 INFO:tasks.workunit.client.1.smithi086.stdout:1/926: truncate d4/d7/d2a/d36/d3a/de5/f81 675332 0 2024-08-19T00:56:16.293 INFO:tasks.workunit.client.1.smithi086.stdout:1/927: chown d4/d7/d2a/d36/d3a/fa4 713108862 1 2024-08-19T00:56:16.293 INFO:tasks.workunit.client.0.smithi017.stdout:4/373: dwrite d2/f3c [0,4194304] 0 2024-08-19T00:56:16.294 INFO:tasks.workunit.client.0.smithi017.stdout:4/374: write d2/d21/d40/f4c [1489160,15534] 0 2024-08-19T00:56:16.294 INFO:tasks.workunit.client.0.smithi017.stdout:0/361: unlink d5/c6 0 2024-08-19T00:56:16.295 INFO:tasks.workunit.client.1.smithi086.stdout:2/873: rename d8/d2c/d38/d96/f103 to d8/d84/de0/d114/f121 0 2024-08-19T00:56:16.296 INFO:tasks.workunit.client.0.smithi017.stdout:0/362: dread - d5/d17/f69 zero size 2024-08-19T00:56:16.296 INFO:tasks.workunit.client.0.smithi017.stdout:8/253: truncate de/d15/f2b 836846 0 2024-08-19T00:56:16.297 INFO:tasks.workunit.client.0.smithi017.stdout:8/254: chown de/d36/f32 0 1 2024-08-19T00:56:16.298 INFO:tasks.workunit.client.0.smithi017.stdout:0/363: truncate d5/d17/d2b/f43 953674 0 2024-08-19T00:56:16.300 INFO:tasks.workunit.client.0.smithi017.stdout:3/391: link d5/d32/l6b d5/d15/l70 0 2024-08-19T00:56:16.302 INFO:tasks.workunit.client.1.smithi086.stdout:7/834: write d3/de/f66 [4246253,46229] 0 2024-08-19T00:56:16.303 INFO:tasks.workunit.client.1.smithi086.stdout:9/844: creat db/d26/d5c/d87/d30/f110 x:0 0 0 2024-08-19T00:56:16.306 INFO:tasks.workunit.client.1.smithi086.stdout:0/835: sync 2024-08-19T00:56:16.307 INFO:tasks.workunit.client.0.smithi017.stdout:4/375: rmdir d2/d1a/d55/d64 39 2024-08-19T00:56:16.307 INFO:tasks.workunit.client.1.smithi086.stdout:1/928: truncate d4/d7/d2a/d36/f6a 604145 0 2024-08-19T00:56:16.307 INFO:tasks.workunit.client.1.smithi086.stdout:4/786: dwrite d2/d18/d33/d42/d72/d8f/fd2 [0,4194304] 0 2024-08-19T00:56:16.308 INFO:tasks.workunit.client.0.smithi017.stdout:9/344: truncate d0/d33/f29 1380593 0 2024-08-19T00:56:16.309 INFO:tasks.workunit.client.1.smithi086.stdout:6/840: dwrite db/d34/d4e/fcd [0,4194304] 0 2024-08-19T00:56:16.310 INFO:tasks.workunit.client.1.smithi086.stdout:8/808: unlink dc/d1f/d37/d60/f103 0 2024-08-19T00:56:16.315 INFO:tasks.workunit.client.0.smithi017.stdout:5/276: dread - db/d19/d33/f42 zero size 2024-08-19T00:56:16.317 INFO:tasks.workunit.client.1.smithi086.stdout:6/841: dwrite db/d37/d44/d5a/fbb [0,4194304] 0 2024-08-19T00:56:16.317 INFO:tasks.workunit.client.0.smithi017.stdout:5/277: write db/d19/d1f/f50 [4627439,15300] 0 2024-08-19T00:56:16.320 INFO:tasks.workunit.client.1.smithi086.stdout:2/874: fsync d8/d43/fa1 0 2024-08-19T00:56:16.321 INFO:tasks.workunit.client.0.smithi017.stdout:3/392: dwrite d5/da/d27/f4c [0,4194304] 0 2024-08-19T00:56:16.321 INFO:tasks.workunit.client.1.smithi086.stdout:2/875: chown d8/d2c/d47 118294 1 2024-08-19T00:56:16.323 INFO:tasks.workunit.client.0.smithi017.stdout:3/393: write d5/da/d27/f6d [803446,53904] 0 2024-08-19T00:56:16.324 INFO:tasks.workunit.client.0.smithi017.stdout:0/364: mknod d5/c79 0 2024-08-19T00:56:16.324 INFO:tasks.workunit.client.0.smithi017.stdout:2/447: link d2/d7/d10/d35/d55/l64 d2/d7/d10/d3b/l8d 0 2024-08-19T00:56:16.325 INFO:tasks.workunit.client.0.smithi017.stdout:3/394: stat d5/d11/f3e 0 2024-08-19T00:56:16.325 INFO:tasks.workunit.client.0.smithi017.stdout:0/365: write d5/d18/f66 [341636,14664] 0 2024-08-19T00:56:16.330 INFO:tasks.workunit.client.0.smithi017.stdout:4/376: dread d2/d16/f22 [0,4194304] 0 2024-08-19T00:56:16.331 INFO:tasks.workunit.client.0.smithi017.stdout:4/377: read d2/f12 [4973974,22563] 0 2024-08-19T00:56:16.331 INFO:tasks.workunit.client.1.smithi086.stdout:3/838: getdents d3 0 2024-08-19T00:56:16.332 INFO:tasks.workunit.client.1.smithi086.stdout:3/839: fsync d3/d18/d19/dbc/de1/ff4 0 2024-08-19T00:56:16.333 INFO:tasks.workunit.client.1.smithi086.stdout:4/787: dread d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/fbf [0,4194304] 0 2024-08-19T00:56:16.334 INFO:tasks.workunit.client.0.smithi017.stdout:2/448: creat d2/d7/d10/d19/d48/f8e x:0 0 0 2024-08-19T00:56:16.342 INFO:tasks.workunit.client.0.smithi017.stdout:0/366: dread d5/f11 [0,4194304] 0 2024-08-19T00:56:16.342 INFO:tasks.workunit.client.0.smithi017.stdout:8/255: dread de/d15/f2b [0,4194304] 0 2024-08-19T00:56:16.346 INFO:tasks.workunit.client.0.smithi017.stdout:4/378: unlink d2/d1a/d20/c71 0 2024-08-19T00:56:16.349 INFO:tasks.workunit.client.0.smithi017.stdout:3/395: symlink d5/l71 0 2024-08-19T00:56:16.351 INFO:tasks.workunit.client.0.smithi017.stdout:2/449: creat d2/d7/d10/d3b/d80/f8f x:0 0 0 2024-08-19T00:56:16.352 INFO:tasks.workunit.client.1.smithi086.stdout:7/835: write d3/d34/d44/d58/d4b/f61 [2049834,6625] 0 2024-08-19T00:56:16.353 INFO:tasks.workunit.client.1.smithi086.stdout:3/840: fdatasync d3/d18/f2c 0 2024-08-19T00:56:16.355 INFO:tasks.workunit.client.0.smithi017.stdout:5/278: creat db/f66 x:0 0 0 2024-08-19T00:56:16.356 INFO:tasks.workunit.client.0.smithi017.stdout:3/396: dwrite d5/d11/f16 [0,4194304] 0 2024-08-19T00:56:16.356 INFO:tasks.workunit.client.1.smithi086.stdout:5/828: sync 2024-08-19T00:56:16.357 INFO:tasks.workunit.client.1.smithi086.stdout:4/788: mknod d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/d85/c107 0 2024-08-19T00:56:16.357 INFO:tasks.workunit.client.0.smithi017.stdout:5/279: write db/f2e [3047527,32046] 0 2024-08-19T00:56:16.358 INFO:tasks.workunit.client.1.smithi086.stdout:9/845: dwrite db/d26/d5c/d87/d30/f9c [0,4194304] 0 2024-08-19T00:56:16.358 INFO:tasks.workunit.client.0.smithi017.stdout:8/256: rmdir de 39 2024-08-19T00:56:16.358 INFO:tasks.workunit.client.0.smithi017.stdout:5/280: write db/d19/d1f/f60 [600374,18834] 0 2024-08-19T00:56:16.360 INFO:tasks.workunit.client.1.smithi086.stdout:9/846: read db/d26/d5c/d87/d30/d3f/f8a [7403709,13021] 0 2024-08-19T00:56:16.361 INFO:tasks.workunit.client.1.smithi086.stdout:2/876: symlink d8/d2c/d38/l122 0 2024-08-19T00:56:16.361 INFO:tasks.workunit.client.0.smithi017.stdout:9/345: write d0/f5b [14489,14018] 0 2024-08-19T00:56:16.363 INFO:tasks.workunit.client.1.smithi086.stdout:1/929: creat d4/d7/d2a/d36/f12f x:0 0 0 2024-08-19T00:56:16.364 INFO:tasks.workunit.client.1.smithi086.stdout:1/930: readlink d4/d7/d2a/d6e/d95/db9/lfa 0 2024-08-19T00:56:16.366 INFO:tasks.workunit.client.1.smithi086.stdout:1/931: dread d4/d7/d2a/d36/d61/f114 [0,4194304] 0 2024-08-19T00:56:16.368 INFO:tasks.workunit.client.1.smithi086.stdout:8/809: creat dc/d17/d1e/f10d x:0 0 0 2024-08-19T00:56:16.369 INFO:tasks.workunit.client.1.smithi086.stdout:8/810: readlink dc/d1f/d37/d4f/dac/db8/d7a/d9b/l3e 0 2024-08-19T00:56:16.370 INFO:tasks.workunit.client.1.smithi086.stdout:8/811: write dc/d17/d1e/f10d [301500,49025] 0 2024-08-19T00:56:16.376 INFO:tasks.workunit.client.1.smithi086.stdout:5/829: creat d0/d5f/d60/d5b/ffe x:0 0 0 2024-08-19T00:56:16.377 INFO:tasks.workunit.client.1.smithi086.stdout:6/842: creat db/d37/d41/f106 x:0 0 0 2024-08-19T00:56:16.378 INFO:tasks.workunit.client.0.smithi017.stdout:9/346: unlink d0/fc 0 2024-08-19T00:56:16.381 INFO:tasks.workunit.client.0.smithi017.stdout:6/385: sync 2024-08-19T00:56:16.382 INFO:tasks.workunit.client.1.smithi086.stdout:9/847: mknod db/d26/d5c/d87/d30/d32/d44/d67/c111 0 2024-08-19T00:56:16.384 INFO:tasks.workunit.client.1.smithi086.stdout:2/877: symlink d8/d24/d32/d4d/d6a/l123 0 2024-08-19T00:56:16.384 INFO:tasks.workunit.client.0.smithi017.stdout:4/379: dwrite d2/d21/d40/d56/f47 [0,4194304] 0 2024-08-19T00:56:16.384 INFO:tasks.workunit.client.1.smithi086.stdout:9/848: dread db/d26/d5c/d87/d30/d32/d44/f69 [4194304,4194304] 0 2024-08-19T00:56:16.386 INFO:tasks.workunit.client.0.smithi017.stdout:8/257: symlink de/d36/l43 0 2024-08-19T00:56:16.389 INFO:tasks.workunit.client.1.smithi086.stdout:0/836: link da/d14/f17 da/d14/d1a/d2e/d39/d3b/f106 0 2024-08-19T00:56:16.390 INFO:tasks.workunit.client.0.smithi017.stdout:2/450: write d2/d7/d10/d3b/d3c/f40 [1842559,91952] 0 2024-08-19T00:56:16.390 INFO:tasks.workunit.client.1.smithi086.stdout:9/849: dwrite db/d26/d5c/d87/d30/d31/d103/f10f [0,4194304] 0 2024-08-19T00:56:16.393 INFO:tasks.workunit.client.0.smithi017.stdout:9/347: chown d0/d33/f17 175892683 1 2024-08-19T00:56:16.394 INFO:tasks.workunit.client.0.smithi017.stdout:9/348: write d0/f34 [116227,82313] 0 2024-08-19T00:56:16.394 INFO:tasks.workunit.client.1.smithi086.stdout:7/836: mkdir d3/de/d112 0 2024-08-19T00:56:16.395 INFO:tasks.workunit.client.0.smithi017.stdout:6/386: creat d5/d13/d11/d2c/d51/f84 x:0 0 0 2024-08-19T00:56:16.398 INFO:tasks.workunit.client.0.smithi017.stdout:0/367: getdents d5 0 2024-08-19T00:56:16.398 INFO:tasks.workunit.client.1.smithi086.stdout:3/841: mknod d3/d26/d2b/d33/db9/c116 0 2024-08-19T00:56:16.398 INFO:tasks.workunit.client.1.smithi086.stdout:3/842: chown d3 2679265 1 2024-08-19T00:56:16.399 INFO:tasks.workunit.client.0.smithi017.stdout:0/368: write d5/d18/d3a/f5f [498368,43214] 0 2024-08-19T00:56:16.400 INFO:tasks.workunit.client.0.smithi017.stdout:0/369: write d5/d17/f57 [2888488,29338] 0 2024-08-19T00:56:16.400 INFO:tasks.workunit.client.0.smithi017.stdout:4/380: rmdir d2/d11/d24 39 2024-08-19T00:56:16.401 INFO:tasks.workunit.client.0.smithi017.stdout:4/381: chown d2/d1a/d55/d6a 381159265 1 2024-08-19T00:56:16.401 INFO:tasks.workunit.client.1.smithi086.stdout:9/850: read db/fb2 [28704,92331] 0 2024-08-19T00:56:16.402 INFO:tasks.workunit.client.0.smithi017.stdout:4/382: chown d2/f7 4079 1 2024-08-19T00:56:16.403 INFO:tasks.workunit.client.0.smithi017.stdout:0/370: read d5/d17/d26/d30/f38 [446322,18843] 0 2024-08-19T00:56:16.403 INFO:tasks.workunit.client.0.smithi017.stdout:8/258: rename de/d15/c1b to de/d15/d39/c44 0 2024-08-19T00:56:16.403 INFO:tasks.workunit.client.0.smithi017.stdout:9/349: rename d0/d33/d22/d5a to d0/d33/d22/d5a/d64 22 2024-08-19T00:56:16.405 INFO:tasks.workunit.client.0.smithi017.stdout:5/281: creat db/f67 x:0 0 0 2024-08-19T00:56:16.405 INFO:tasks.workunit.client.0.smithi017.stdout:0/371: chown d5/d17/d26/d30/c47 43915 1 2024-08-19T00:56:16.405 INFO:tasks.workunit.client.1.smithi086.stdout:2/878: rmdir d8/d43/d65/da9 39 2024-08-19T00:56:16.406 INFO:tasks.workunit.client.0.smithi017.stdout:0/372: chown d5/d17/d26/d30/c6d 5060 1 2024-08-19T00:56:16.406 INFO:tasks.workunit.client.0.smithi017.stdout:3/397: link d5/d15/d1b/f39 d5/da/f72 0 2024-08-19T00:56:16.407 INFO:tasks.workunit.client.1.smithi086.stdout:1/932: dwrite d4/d7/d2a/d36/d3a/d41/ff1 [0,4194304] 0 2024-08-19T00:56:16.407 INFO:tasks.workunit.client.0.smithi017.stdout:0/373: write d5/d17/d45/d50/f73 [522881,124338] 0 2024-08-19T00:56:16.408 INFO:tasks.workunit.client.0.smithi017.stdout:3/398: truncate d5/da/f48 742261 0 2024-08-19T00:56:16.409 INFO:tasks.workunit.client.0.smithi017.stdout:3/399: readlink d5/da/d27/l66 0 2024-08-19T00:56:16.411 INFO:tasks.workunit.client.0.smithi017.stdout:4/383: rename d2/f3c to d2/d21/d40/d56/f7d 0 2024-08-19T00:56:16.411 INFO:tasks.workunit.client.0.smithi017.stdout:3/400: truncate d5/da/d27/d28/f37 1814795 0 2024-08-19T00:56:16.414 INFO:tasks.workunit.client.0.smithi017.stdout:2/451: creat d2/d7/d10/d35/d7e/f90 x:0 0 0 2024-08-19T00:56:16.417 INFO:tasks.workunit.client.0.smithi017.stdout:5/282: fsync db/d19/d1f/d15/d1e/f27 0 2024-08-19T00:56:16.420 INFO:tasks.workunit.client.0.smithi017.stdout:6/387: unlink d5/d13/d11/d52/l80 0 2024-08-19T00:56:16.421 INFO:tasks.workunit.client.1.smithi086.stdout:5/830: mkdir d0/d8/d94/df9/dff 0 2024-08-19T00:56:16.422 INFO:tasks.workunit.client.0.smithi017.stdout:0/374: creat d5/d17/d2b/f7a x:0 0 0 2024-08-19T00:56:16.423 INFO:tasks.workunit.client.1.smithi086.stdout:6/843: link db/f13 db/d37/d44/d5a/d8f/f107 0 2024-08-19T00:56:16.427 INFO:tasks.workunit.client.1.smithi086.stdout:3/843: write d3/d18/d27/d49/d3f/d5b/fa7 [1299695,53573] 0 2024-08-19T00:56:16.428 INFO:tasks.workunit.client.1.smithi086.stdout:2/879: creat d8/d24/f124 x:0 0 0 2024-08-19T00:56:16.429 INFO:tasks.workunit.client.0.smithi017.stdout:2/452: symlink d2/d7/d10/d3b/d80/l91 0 2024-08-19T00:56:16.430 INFO:tasks.workunit.client.1.smithi086.stdout:0/837: truncate da/d14/d44/d49/f91 214434 0 2024-08-19T00:56:16.432 INFO:tasks.workunit.client.1.smithi086.stdout:8/812: dwrite dc/f75 [0,4194304] 0 2024-08-19T00:56:16.432 INFO:tasks.workunit.client.0.smithi017.stdout:6/388: creat d5/d13/d11/d4d/f85 x:0 0 0 2024-08-19T00:56:16.433 INFO:tasks.workunit.client.1.smithi086.stdout:7/837: mkdir d3/de/d113 0 2024-08-19T00:56:16.434 INFO:tasks.workunit.client.0.smithi017.stdout:0/375: creat d5/d18/f7b x:0 0 0 2024-08-19T00:56:16.435 INFO:tasks.workunit.client.0.smithi017.stdout:0/376: readlink d5/d17/d21/d39/l6e 0 2024-08-19T00:56:16.436 INFO:tasks.workunit.client.0.smithi017.stdout:4/384: mknod d2/d11/c7e 0 2024-08-19T00:56:16.438 INFO:tasks.workunit.client.0.smithi017.stdout:8/259: truncate de/f12 8180955 0 2024-08-19T00:56:16.439 INFO:tasks.workunit.client.0.smithi017.stdout:8/260: dread - de/d15/d39/f3e zero size 2024-08-19T00:56:16.439 INFO:tasks.workunit.client.1.smithi086.stdout:5/831: mknod d0/d8/d94/df9/c100 0 2024-08-19T00:56:16.440 INFO:tasks.workunit.client.0.smithi017.stdout:0/377: dread d5/fa [0,4194304] 0 2024-08-19T00:56:16.443 INFO:tasks.workunit.client.0.smithi017.stdout:6/389: mkdir d5/d13/d11/d2c/d4a/d64/d86 0 2024-08-19T00:56:16.444 INFO:tasks.workunit.client.1.smithi086.stdout:6/844: dread db/d8e/fb0 [0,4194304] 0 2024-08-19T00:56:16.444 INFO:tasks.workunit.client.1.smithi086.stdout:4/789: getdents d2/d18/d33/d42/d72/d78/d9e 0 2024-08-19T00:56:16.444 INFO:tasks.workunit.client.0.smithi017.stdout:6/390: stat d5/d13/d20/d5e/f75 0 2024-08-19T00:56:16.446 INFO:tasks.workunit.client.0.smithi017.stdout:9/350: rename d0/d58/f55 to d0/f65 0 2024-08-19T00:56:16.446 INFO:tasks.workunit.client.0.smithi017.stdout:9/351: dread - d0/d33/d22/f42 zero size 2024-08-19T00:56:16.447 INFO:tasks.workunit.client.0.smithi017.stdout:9/352: dread - d0/d33/d22/f42 zero size 2024-08-19T00:56:16.447 INFO:tasks.workunit.client.0.smithi017.stdout:4/385: creat d2/d21/d40/f7f x:0 0 0 2024-08-19T00:56:16.448 INFO:tasks.workunit.client.0.smithi017.stdout:9/353: chown d0/d33/d22 21540 1 2024-08-19T00:56:16.450 INFO:tasks.workunit.client.0.smithi017.stdout:8/261: creat de/d15/f45 x:0 0 0 2024-08-19T00:56:16.453 INFO:tasks.workunit.client.0.smithi017.stdout:0/378: symlink d5/d17/d21/l7c 0 2024-08-19T00:56:16.453 INFO:tasks.workunit.client.0.smithi017.stdout:4/386: dread d2/d27/f62 [0,4194304] 0 2024-08-19T00:56:16.457 INFO:tasks.workunit.client.0.smithi017.stdout:2/453: creat d2/d7/d10/d3b/d80/d81/f92 x:0 0 0 2024-08-19T00:56:16.460 INFO:tasks.workunit.client.0.smithi017.stdout:9/354: readlink d0/d33/d22/l50 0 2024-08-19T00:56:16.461 INFO:tasks.workunit.client.0.smithi017.stdout:9/355: chown d0/d58 50 1 2024-08-19T00:56:16.467 INFO:tasks.workunit.client.1.smithi086.stdout:5/832: dwrite d0/d2d/d43/d91/fbd [0,4194304] 0 2024-08-19T00:56:16.467 INFO:tasks.workunit.client.0.smithi017.stdout:4/387: write d2/f4b [1486753,74891] 0 2024-08-19T00:56:16.470 INFO:tasks.workunit.client.1.smithi086.stdout:1/933: rename d4/d7/d2a/d36/d3a/de5/c119 to d4/d7/d2a/d36/d3a/de5/d7a/db4/df0/c130 0 2024-08-19T00:56:16.470 INFO:tasks.workunit.client.0.smithi017.stdout:4/388: readlink d2/d21/d53/l66 0 2024-08-19T00:56:16.470 INFO:tasks.workunit.client.0.smithi017.stdout:4/389: fsync d2/d1a/d20/f52 0 2024-08-19T00:56:16.471 INFO:tasks.workunit.client.1.smithi086.stdout:6/845: creat db/d34/d4e/d68/d99/dce/f108 x:0 0 0 2024-08-19T00:56:16.481 INFO:tasks.workunit.client.0.smithi017.stdout:4/390: creat d2/d16/d70/f80 x:0 0 0 2024-08-19T00:56:16.484 INFO:tasks.workunit.client.1.smithi086.stdout:2/880: creat d8/d2c/d38/f125 x:0 0 0 2024-08-19T00:56:16.485 INFO:tasks.workunit.client.0.smithi017.stdout:6/391: link d5/c47 d5/d13/d20/d5e/c87 0 2024-08-19T00:56:16.486 INFO:tasks.workunit.client.1.smithi086.stdout:0/838: creat da/d14/d1a/d2e/d39/d3b/f107 x:0 0 0 2024-08-19T00:56:16.486 INFO:tasks.workunit.client.1.smithi086.stdout:1/934: chown d4/d7/d2a/d6e/ca3 676453 1 2024-08-19T00:56:16.487 INFO:tasks.workunit.client.0.smithi017.stdout:3/401: rename d5/da/l64 to d5/d15/l73 0 2024-08-19T00:56:16.488 INFO:tasks.workunit.client.0.smithi017.stdout:0/379: truncate d5/d17/d26/d30/f33 3788971 0 2024-08-19T00:56:16.489 INFO:tasks.workunit.client.1.smithi086.stdout:2/881: chown d8/d24/d32 1 1 2024-08-19T00:56:16.490 INFO:tasks.workunit.client.0.smithi017.stdout:9/356: creat d0/d58/f66 x:0 0 0 2024-08-19T00:56:16.491 INFO:tasks.workunit.client.1.smithi086.stdout:9/851: dwrite f6 [0,4194304] 0 2024-08-19T00:56:16.491 INFO:tasks.workunit.client.1.smithi086.stdout:8/813: getdents dc/d16/d18/d94 0 2024-08-19T00:56:16.492 INFO:tasks.workunit.client.1.smithi086.stdout:3/844: dwrite d3/d18/d19/dbc/db8/f44 [0,4194304] 0 2024-08-19T00:56:16.494 INFO:tasks.workunit.client.0.smithi017.stdout:8/262: rename de/l2f to de/d15/d39/d3d/l46 0 2024-08-19T00:56:16.494 INFO:tasks.workunit.client.1.smithi086.stdout:4/790: dwrite d2/d18/d33/d42/d72/d2f/dc4/d81/fbe [0,4194304] 0 2024-08-19T00:56:16.495 INFO:tasks.workunit.client.1.smithi086.stdout:6/846: mkdir db/d34/d4e/d68/d89/d109 0 2024-08-19T00:56:16.497 INFO:tasks.workunit.client.1.smithi086.stdout:1/935: dread - d4/d7/d2a/d36/d50/ffe zero size 2024-08-19T00:56:16.497 INFO:tasks.workunit.client.1.smithi086.stdout:5/833: dwrite d0/df/d1f/d65/faa [4194304,4194304] 0 2024-08-19T00:56:16.499 INFO:tasks.workunit.client.0.smithi017.stdout:3/402: dwrite d5/d11/d61/f63 [0,4194304] 0 2024-08-19T00:56:16.499 INFO:tasks.workunit.client.1.smithi086.stdout:4/791: chown d2/d18/d33/d42/d72/d78/f3c 216212 1 2024-08-19T00:56:16.500 INFO:tasks.workunit.client.1.smithi086.stdout:3/845: chown d3/d18/d19/d37/ff0 121 1 2024-08-19T00:56:16.501 INFO:tasks.workunit.client.0.smithi017.stdout:3/403: fsync d5/d11/f2a 0 2024-08-19T00:56:16.502 INFO:tasks.workunit.client.0.smithi017.stdout:9/357: symlink d0/d33/d22/d5e/l67 0 2024-08-19T00:56:16.502 INFO:tasks.workunit.client.0.smithi017.stdout:4/391: dread d2/d11/d24/f2e [0,4194304] 0 2024-08-19T00:56:16.503 INFO:tasks.workunit.client.0.smithi017.stdout:3/404: write d5/da/f48 [354901,100887] 0 2024-08-19T00:56:16.504 INFO:tasks.workunit.client.0.smithi017.stdout:4/392: chown d2/d16/f6f 19 1 2024-08-19T00:56:16.504 INFO:tasks.workunit.client.1.smithi086.stdout:8/814: fsync dc/d1f/d37/d4f/dac/db8/d7a/d9b/f71 0 2024-08-19T00:56:16.508 INFO:tasks.workunit.client.1.smithi086.stdout:2/882: dread d8/d24/d32/f41 [0,4194304] 0 2024-08-19T00:56:16.513 INFO:tasks.workunit.client.1.smithi086.stdout:4/792: readlink d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd/l105 0 2024-08-19T00:56:16.514 INFO:tasks.workunit.client.1.smithi086.stdout:9/852: mknod db/d26/d5c/d87/d30/d31/d103/d19/d18/d10e/c112 0 2024-08-19T00:56:16.514 INFO:tasks.workunit.client.1.smithi086.stdout:9/853: symlink db/d26/d5c/d87/d30/d3f/d43/d4e/l113 2 2024-08-19T00:56:16.515 INFO:tasks.workunit.client.1.smithi086.stdout:6/847: symlink db/d37/d28/d7f/d96/ddb/l10a 0 2024-08-19T00:56:16.516 INFO:tasks.workunit.client.0.smithi017.stdout:4/393: creat d2/d1a/d55/d73/f81 x:0 0 0 2024-08-19T00:56:16.517 INFO:tasks.workunit.client.1.smithi086.stdout:6/848: truncate db/d34/d4e/d68/d99/dce/f108 315138 0 2024-08-19T00:56:16.517 INFO:tasks.workunit.client.0.smithi017.stdout:4/394: write d2/d1a/d20/f52 [1661504,15637] 0 2024-08-19T00:56:16.518 INFO:tasks.workunit.client.0.smithi017.stdout:9/358: symlink d0/l68 0 2024-08-19T00:56:16.520 INFO:tasks.workunit.client.0.smithi017.stdout:2/454: rename d2/d7/d10/f11 to d2/d7/f93 0 2024-08-19T00:56:16.521 INFO:tasks.workunit.client.1.smithi086.stdout:2/883: symlink d8/d24/d32/d4d/d6a/dfe/l126 0 2024-08-19T00:56:16.523 INFO:tasks.workunit.client.1.smithi086.stdout:4/793: dread - d2/d18/d33/d42/d72/fec zero size 2024-08-19T00:56:16.524 INFO:tasks.workunit.client.0.smithi017.stdout:9/359: mkdir d0/d33/d22/d45/d69 0 2024-08-19T00:56:16.524 INFO:tasks.workunit.client.1.smithi086.stdout:8/815: symlink dc/d1f/dd4/d108/l10e 0 2024-08-19T00:56:16.525 INFO:tasks.workunit.client.0.smithi017.stdout:0/380: rename d5/l61 to d5/d17/d2b/l7d 0 2024-08-19T00:56:16.527 INFO:tasks.workunit.client.0.smithi017.stdout:3/405: link d5/da/d27/f3a d5/da/f74 0 2024-08-19T00:56:16.528 INFO:tasks.workunit.client.1.smithi086.stdout:5/834: rename d0/d8/d10/dbb/ff8 to d0/df/d1f/d33/dea/f101 0 2024-08-19T00:56:16.529 INFO:tasks.workunit.client.1.smithi086.stdout:2/884: symlink d8/d43/dd5/l127 0 2024-08-19T00:56:16.531 INFO:tasks.workunit.client.0.smithi017.stdout:2/455: rename d2/d7/d44/f57 to d2/d7/d10/d35/d84/f94 0 2024-08-19T00:56:16.531 INFO:tasks.workunit.client.0.smithi017.stdout:9/360: read d0/d33/f1b [5017847,20085] 0 2024-08-19T00:56:16.532 INFO:tasks.workunit.client.1.smithi086.stdout:4/794: symlink d2/d18/d33/d42/d72/d78/d25/l108 0 2024-08-19T00:56:16.533 INFO:tasks.workunit.client.0.smithi017.stdout:4/395: link d2/d21/d53/d5a/c75 d2/d16/d70/c82 0 2024-08-19T00:56:16.535 INFO:tasks.workunit.client.1.smithi086.stdout:6/849: mkdir db/d37/d30/d10b 0 2024-08-19T00:56:16.539 INFO:tasks.workunit.client.1.smithi086.stdout:2/885: mkdir d8/d24/d32/d4d/d128 0 2024-08-19T00:56:16.540 INFO:tasks.workunit.client.1.smithi086.stdout:9/854: dread db/d26/d5c/d87/fc0 [0,4194304] 0 2024-08-19T00:56:16.540 INFO:tasks.workunit.client.0.smithi017.stdout:2/456: unlink d2/d7/d10/d35/d45/d58/l6e 0 2024-08-19T00:56:16.541 INFO:tasks.workunit.client.1.smithi086.stdout:2/886: dread - d8/d2c/d38/d80/dca/df9/f106 zero size 2024-08-19T00:56:16.543 INFO:tasks.workunit.client.0.smithi017.stdout:9/361: truncate d0/d58/f3e 1385278 0 2024-08-19T00:56:16.543 INFO:tasks.workunit.client.0.smithi017.stdout:8/263: truncate de/d36/f32 470763 0 2024-08-19T00:56:16.545 INFO:tasks.workunit.client.0.smithi017.stdout:8/264: read de/d15/f2b [270569,34809] 0 2024-08-19T00:56:16.545 INFO:tasks.workunit.client.0.smithi017.stdout:9/362: write d0/d33/d22/f44 [410530,63731] 0 2024-08-19T00:56:16.546 INFO:tasks.workunit.client.1.smithi086.stdout:8/816: dread dc/d16/d18/d106/f3f [0,4194304] 0 2024-08-19T00:56:16.546 INFO:tasks.workunit.client.0.smithi017.stdout:4/396: symlink d2/d27/l83 0 2024-08-19T00:56:16.546 INFO:tasks.workunit.client.0.smithi017.stdout:4/397: readlink d2/d21/d53/l66 0 2024-08-19T00:56:16.547 INFO:tasks.workunit.client.1.smithi086.stdout:1/936: write d4/d7/d2a/d36/d3a/de5/f81 [534623,12393] 0 2024-08-19T00:56:16.552 INFO:tasks.workunit.client.1.smithi086.stdout:6/850: dread db/d37/d28/d7f/f88 [0,4194304] 0 2024-08-19T00:56:16.554 INFO:tasks.workunit.client.0.smithi017.stdout:4/398: dwrite d2/d1a/d20/f54 [0,4194304] 0 2024-08-19T00:56:16.557 INFO:tasks.workunit.client.1.smithi086.stdout:3/846: dwrite d3/d18/d19/d37/f93 [0,4194304] 0 2024-08-19T00:56:16.562 INFO:tasks.workunit.client.0.smithi017.stdout:2/457: dread d2/d7/d29/f5d [0,4194304] 0 2024-08-19T00:56:16.565 INFO:tasks.workunit.client.1.smithi086.stdout:1/937: fdatasync d4/d7/f5e 0 2024-08-19T00:56:16.568 INFO:tasks.workunit.client.0.smithi017.stdout:3/406: write d5/d15/f21 [1243074,13360] 0 2024-08-19T00:56:16.569 INFO:tasks.workunit.client.0.smithi017.stdout:3/407: write d5/d15/f21 [1364004,22086] 0 2024-08-19T00:56:16.570 INFO:tasks.workunit.client.0.smithi017.stdout:3/408: chown d5/d11/f62 725760 1 2024-08-19T00:56:16.572 INFO:tasks.workunit.client.1.smithi086.stdout:4/795: write d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/fbf [550010,66949] 0 2024-08-19T00:56:16.575 INFO:tasks.workunit.client.1.smithi086.stdout:3/847: creat d3/d18/d27/d49/d3f/d5b/d66/f117 x:0 0 0 2024-08-19T00:56:16.577 INFO:tasks.workunit.client.0.smithi017.stdout:8/265: creat de/f47 x:0 0 0 2024-08-19T00:56:16.577 INFO:tasks.workunit.client.1.smithi086.stdout:2/887: truncate d8/d14/f75 571899 0 2024-08-19T00:56:16.579 INFO:tasks.workunit.client.1.smithi086.stdout:9/855: write db/d26/d5c/d87/d30/d31/d103/d19/d38/f53 [981284,54714] 0 2024-08-19T00:56:16.581 INFO:tasks.workunit.client.1.smithi086.stdout:1/938: truncate d4/d7/d2a/d36/d3a/d41/f4b 8069759 0 2024-08-19T00:56:16.582 INFO:tasks.workunit.client.1.smithi086.stdout:6/851: getdents db/d34/d4e/d68/d89/d109 0 2024-08-19T00:56:16.582 INFO:tasks.workunit.client.0.smithi017.stdout:0/381: mknod d5/d17/d26/d30/c7e 0 2024-08-19T00:56:16.585 INFO:tasks.workunit.client.0.smithi017.stdout:9/363: dwrite d0/d33/d22/f62 [0,4194304] 0 2024-08-19T00:56:16.585 INFO:tasks.workunit.client.1.smithi086.stdout:6/852: chown db/lf 23132 1 2024-08-19T00:56:16.585 INFO:tasks.workunit.client.1.smithi086.stdout:3/848: dwrite d3/d18/d19/f55 [0,4194304] 0 2024-08-19T00:56:16.586 INFO:tasks.workunit.client.0.smithi017.stdout:8/266: chown de/f12 25621 1 2024-08-19T00:56:16.586 INFO:tasks.workunit.client.0.smithi017.stdout:8/267: chown l3 591 1 2024-08-19T00:56:16.587 INFO:tasks.workunit.client.1.smithi086.stdout:5/835: dwrite d0/d2d/f32 [0,4194304] 0 2024-08-19T00:56:16.588 INFO:tasks.workunit.client.0.smithi017.stdout:4/399: rmdir d2/d16/d77 0 2024-08-19T00:56:16.588 INFO:tasks.workunit.client.1.smithi086.stdout:4/796: creat d2/d18/d33/d42/d72/d78/d25/d30/d5d/da2/f109 x:0 0 0 2024-08-19T00:56:16.591 INFO:tasks.workunit.client.1.smithi086.stdout:2/888: rename d8/d2c/d38/d80/db4/db7/d120/faf to d8/d43/dd5/f129 0 2024-08-19T00:56:16.592 INFO:tasks.workunit.client.1.smithi086.stdout:4/797: chown d2/d18/d33/d42/d72/d8f/lab 53 1 2024-08-19T00:56:16.596 INFO:tasks.workunit.client.1.smithi086.stdout:8/817: dwrite dc/d16/d18/d106/d28/d41/d9a/f9e [0,4194304] 0 2024-08-19T00:56:16.597 INFO:tasks.workunit.client.0.smithi017.stdout:3/409: symlink d5/da/l75 0 2024-08-19T00:56:16.602 INFO:tasks.workunit.client.0.smithi017.stdout:9/364: creat d0/d33/d22/d40/f6a x:0 0 0 2024-08-19T00:56:16.602 INFO:tasks.workunit.client.0.smithi017.stdout:2/458: dread d2/d7/d10/d35/d7e/f8c [0,4194304] 0 2024-08-19T00:56:16.602 INFO:tasks.workunit.client.1.smithi086.stdout:4/798: fsync d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd/fe5 0 2024-08-19T00:56:16.602 INFO:tasks.workunit.client.1.smithi086.stdout:8/818: read dc/d16/d18/d106/d28/d41/d9a/f9e [1072771,115962] 0 2024-08-19T00:56:16.602 INFO:tasks.workunit.client.1.smithi086.stdout:1/939: dwrite d4/d7/d2a/d36/d3a/de5/d7a/ffd [0,4194304] 0 2024-08-19T00:56:16.604 INFO:tasks.workunit.client.1.smithi086.stdout:3/849: fsync d3/d18/d61/f7a 0 2024-08-19T00:56:16.606 INFO:tasks.workunit.client.1.smithi086.stdout:7/838: sync 2024-08-19T00:56:16.606 INFO:tasks.workunit.client.0.smithi017.stdout:8/268: rmdir de 39 2024-08-19T00:56:16.607 INFO:tasks.workunit.client.1.smithi086.stdout:1/940: chown d4/d7/d2a/d36/d63/d84 377019 1 2024-08-19T00:56:16.607 INFO:tasks.workunit.client.1.smithi086.stdout:7/839: read d3/de/fd5 [3656819,69905] 0 2024-08-19T00:56:16.609 INFO:tasks.workunit.client.1.smithi086.stdout:5/836: mknod d0/d2d/d43/d91/c102 0 2024-08-19T00:56:16.610 INFO:tasks.workunit.client.1.smithi086.stdout:3/850: read d3/d26/d2b/d33/d4a/d57/db4/fef [3615284,54759] 0 2024-08-19T00:56:16.610 INFO:tasks.workunit.client.1.smithi086.stdout:6/853: dread db/d37/d30/f85 [0,4194304] 0 2024-08-19T00:56:16.624 INFO:tasks.workunit.client.0.smithi017.stdout:4/400: dread d2/d21/d40/f4c [0,4194304] 0 2024-08-19T00:56:16.636 INFO:tasks.workunit.client.0.smithi017.stdout:0/382: fdatasync d5/f1c 0 2024-08-19T00:56:16.638 INFO:tasks.workunit.client.1.smithi086.stdout:9/856: dread db/d26/d5c/d87/d30/d3f/f8a [4194304,4194304] 0 2024-08-19T00:56:16.639 INFO:tasks.workunit.client.0.smithi017.stdout:3/410: creat d5/d11/d61/f76 x:0 0 0 2024-08-19T00:56:16.640 INFO:tasks.workunit.client.0.smithi017.stdout:3/411: dread - d5/f60 zero size 2024-08-19T00:56:16.644 INFO:tasks.workunit.client.0.smithi017.stdout:9/365: rename d0/d33/d22/d40/f6a to d0/d33/d22/d5a/f6b 0 2024-08-19T00:56:16.646 INFO:tasks.workunit.client.0.smithi017.stdout:0/383: dwrite d5/d17/d21/f68 [0,4194304] 0 2024-08-19T00:56:16.646 INFO:tasks.workunit.client.1.smithi086.stdout:4/799: rename d2/d18/d33/f5e to d2/d18/d33/d42/d72/d78/d25/d30/d5d/f10a 0 2024-08-19T00:56:16.650 INFO:tasks.workunit.client.0.smithi017.stdout:2/459: dwrite d2/d7/d10/d19/f41 [0,4194304] 0 2024-08-19T00:56:16.652 INFO:tasks.workunit.client.0.smithi017.stdout:9/366: dread d0/d33/f30 [0,4194304] 0 2024-08-19T00:56:16.653 INFO:tasks.workunit.client.0.smithi017.stdout:4/401: mkdir d2/d21/d40/d84 0 2024-08-19T00:56:16.656 INFO:tasks.workunit.client.1.smithi086.stdout:7/840: mknod d3/d34/d44/d58/d4b/da5/daf/c114 0 2024-08-19T00:56:16.660 INFO:tasks.workunit.client.1.smithi086.stdout:3/851: creat d3/d18/d27/d49/d3f/d54/f118 x:0 0 0 2024-08-19T00:56:16.663 INFO:tasks.workunit.client.1.smithi086.stdout:8/819: dwrite dc/d17/d86/fb4 [0,4194304] 0 2024-08-19T00:56:16.664 INFO:tasks.workunit.client.1.smithi086.stdout:8/820: read dc/d16/d18/d106/d28/d2b/f64 [2758988,80718] 0 2024-08-19T00:56:16.665 INFO:tasks.workunit.client.1.smithi086.stdout:0/839: sync 2024-08-19T00:56:16.666 INFO:tasks.workunit.client.0.smithi017.stdout:0/384: write d5/d18/f66 [638850,124465] 0 2024-08-19T00:56:16.668 INFO:tasks.workunit.client.0.smithi017.stdout:8/269: creat de/d36/f48 x:0 0 0 2024-08-19T00:56:16.668 INFO:tasks.workunit.client.1.smithi086.stdout:9/857: creat db/d26/d5c/d87/d30/d58/f114 x:0 0 0 2024-08-19T00:56:16.673 INFO:tasks.workunit.client.0.smithi017.stdout:4/402: rmdir d2/d16/d70 39 2024-08-19T00:56:16.674 INFO:tasks.workunit.client.1.smithi086.stdout:4/800: chown d2/d18/d33/d42/d72/c3f 21 1 2024-08-19T00:56:16.675 INFO:tasks.workunit.client.1.smithi086.stdout:4/801: chown d2/d18/d33/d42/d72/d78/d25/d55 51161 1 2024-08-19T00:56:16.675 INFO:tasks.workunit.client.0.smithi017.stdout:3/412: rename c4 to d5/d15/d1b/c77 0 2024-08-19T00:56:16.675 INFO:tasks.workunit.client.0.smithi017.stdout:8/270: rename de to de/d15/d39/d49 22 2024-08-19T00:56:16.679 INFO:tasks.workunit.client.1.smithi086.stdout:7/841: rmdir d3 39 2024-08-19T00:56:16.679 INFO:tasks.workunit.client.0.smithi017.stdout:0/385: write d5/f16 [1143908,100082] 0 2024-08-19T00:56:16.681 INFO:tasks.workunit.client.1.smithi086.stdout:2/889: truncate d8/d14/d10a/f119 118394 0 2024-08-19T00:56:16.682 INFO:tasks.workunit.client.0.smithi017.stdout:9/367: unlink d0/d33/f2e 0 2024-08-19T00:56:16.686 INFO:tasks.workunit.client.0.smithi017.stdout:3/413: creat d5/da/d27/f78 x:0 0 0 2024-08-19T00:56:16.686 INFO:tasks.workunit.client.0.smithi017.stdout:3/414: fsync f2 0 2024-08-19T00:56:16.688 INFO:tasks.workunit.client.0.smithi017.stdout:3/415: truncate d5/d18/f45 9200587 0 2024-08-19T00:56:16.691 INFO:tasks.workunit.client.1.smithi086.stdout:3/852: dwrite d3/d9/f39 [0,4194304] 0 2024-08-19T00:56:16.693 INFO:tasks.workunit.client.1.smithi086.stdout:5/837: truncate d0/d8/d10/dbb/fec 2787107 0 2024-08-19T00:56:16.694 INFO:tasks.workunit.client.0.smithi017.stdout:4/403: mknod d2/d16/c85 0 2024-08-19T00:56:16.695 INFO:tasks.workunit.client.1.smithi086.stdout:6/854: truncate db/d34/d4e/d68/d99/dce/f108 29537 0 2024-08-19T00:56:16.696 INFO:tasks.workunit.client.1.smithi086.stdout:0/840: fdatasync da/d14/d1a/d2e/d7e/dd7/ffe 0 2024-08-19T00:56:16.699 INFO:tasks.workunit.client.1.smithi086.stdout:4/802: rmdir d2/d18/dbd 39 2024-08-19T00:56:16.700 INFO:tasks.workunit.client.0.smithi017.stdout:3/416: creat d5/d15/d1b/f79 x:0 0 0 2024-08-19T00:56:16.700 INFO:tasks.workunit.client.0.smithi017.stdout:7/384: sync 2024-08-19T00:56:16.702 INFO:tasks.workunit.client.0.smithi017.stdout:2/460: getdents d2/d7/d10/d19/d48 0 2024-08-19T00:56:16.702 INFO:tasks.workunit.client.1.smithi086.stdout:1/941: write d4/d7/d2a/d36/d3a/d41/f4b [7689772,62186] 0 2024-08-19T00:56:16.703 INFO:tasks.workunit.client.0.smithi017.stdout:3/417: chown d5/d15/d53/l6a 18 1 2024-08-19T00:56:16.704 INFO:tasks.workunit.client.0.smithi017.stdout:0/386: dread d5/d17/d26/d30/f38 [0,4194304] 0 2024-08-19T00:56:16.705 INFO:tasks.workunit.client.0.smithi017.stdout:4/404: dwrite d2/d11/d24/f2e [0,4194304] 0 2024-08-19T00:56:16.706 INFO:tasks.workunit.client.0.smithi017.stdout:3/418: fdatasync d5/d15/f21 0 2024-08-19T00:56:16.706 INFO:tasks.workunit.client.0.smithi017.stdout:0/387: chown d5/d18/f4c 6111948 1 2024-08-19T00:56:16.707 INFO:tasks.workunit.client.1.smithi086.stdout:4/803: dwrite d2/d18/d33/d42/d72/d78/d25/d55/d6c/ff7 [0,4194304] 0 2024-08-19T00:56:16.708 INFO:tasks.workunit.client.1.smithi086.stdout:4/804: read d2/d18/d33/d42/d72/d78/f6d [154928,44102] 0 2024-08-19T00:56:16.713 INFO:tasks.workunit.client.0.smithi017.stdout:7/385: mknod d3/dc/d5f/c71 0 2024-08-19T00:56:16.714 INFO:tasks.workunit.client.1.smithi086.stdout:3/853: mknod d3/d18/d27/d49/d3f/d5b/d8f/c119 0 2024-08-19T00:56:16.714 INFO:tasks.workunit.client.0.smithi017.stdout:7/386: chown d3/dc/f5b 3391493 1 2024-08-19T00:56:16.716 INFO:tasks.workunit.client.0.smithi017.stdout:4/405: fsync d2/f12 0 2024-08-19T00:56:16.717 INFO:tasks.workunit.client.0.smithi017.stdout:8/271: link de/d15/c26 de/c4a 0 2024-08-19T00:56:16.717 INFO:tasks.workunit.client.0.smithi017.stdout:4/406: readlink d2/d1a/lf 0 2024-08-19T00:56:16.717 INFO:tasks.workunit.client.0.smithi017.stdout:8/272: fsync de/f37 0 2024-08-19T00:56:16.718 INFO:tasks.workunit.client.0.smithi017.stdout:0/388: symlink d5/d17/d26/d30/d3e/l7f 0 2024-08-19T00:56:16.719 INFO:tasks.workunit.client.0.smithi017.stdout:0/389: chown d5/d17/d21/f2d 86366 1 2024-08-19T00:56:16.721 INFO:tasks.workunit.client.1.smithi086.stdout:0/841: mkdir da/d14/d1a/d2e/d39/d108 0 2024-08-19T00:56:16.721 INFO:tasks.workunit.client.0.smithi017.stdout:9/368: getdents d0/d58/d49 0 2024-08-19T00:56:16.722 INFO:tasks.workunit.client.0.smithi017.stdout:9/369: read - d0/d58/f66 zero size 2024-08-19T00:56:16.722 INFO:tasks.workunit.client.0.smithi017.stdout:7/387: rmdir d3/dc/df/d32 39 2024-08-19T00:56:16.724 INFO:tasks.workunit.client.0.smithi017.stdout:2/461: dread d2/d7/f93 [0,4194304] 0 2024-08-19T00:56:16.727 INFO:tasks.workunit.client.0.smithi017.stdout:4/407: creat d2/d1a/d20/f86 x:0 0 0 2024-08-19T00:56:16.728 INFO:tasks.workunit.client.0.smithi017.stdout:8/273: creat de/d15/d39/d3d/f4b x:0 0 0 2024-08-19T00:56:16.733 INFO:tasks.workunit.client.0.smithi017.stdout:9/370: symlink d0/d33/d22/d45/l6c 0 2024-08-19T00:56:16.735 INFO:tasks.workunit.client.0.smithi017.stdout:7/388: write d3/dc/df/d37/d46/f57 [3837539,114008] 0 2024-08-19T00:56:16.739 INFO:tasks.workunit.client.1.smithi086.stdout:3/854: rmdir d3/d18/d27 39 2024-08-19T00:56:16.739 INFO:tasks.workunit.client.1.smithi086.stdout:9/858: dwrite db/d26/d5c/d87/d6d/d9f/f101 [0,4194304] 0 2024-08-19T00:56:16.740 INFO:tasks.workunit.client.1.smithi086.stdout:1/942: dwrite d4/d7/f3d [0,4194304] 0 2024-08-19T00:56:16.740 INFO:tasks.workunit.client.0.smithi017.stdout:2/462: creat d2/d7/d10/d35/d45/f95 x:0 0 0 2024-08-19T00:56:16.740 INFO:tasks.workunit.client.1.smithi086.stdout:9/859: chown db/f61 531912424 1 2024-08-19T00:56:16.741 INFO:tasks.workunit.client.1.smithi086.stdout:5/838: symlink d0/d8/l103 0 2024-08-19T00:56:16.741 INFO:tasks.workunit.client.1.smithi086.stdout:7/842: dread d3/d34/f52 [0,4194304] 0 2024-08-19T00:56:16.743 INFO:tasks.workunit.client.1.smithi086.stdout:5/839: write d0/d8/fee [493181,51921] 0 2024-08-19T00:56:16.745 INFO:tasks.workunit.client.1.smithi086.stdout:8/821: link dc/d1f/d37/d4f/dac/db8/d7a/d9b/cfb dc/d1f/d37/d4f/dac/de3/c10f 0 2024-08-19T00:56:16.745 INFO:tasks.workunit.client.0.smithi017.stdout:3/419: link d5/da/d3c/l55 d5/d11/d61/l7a 0 2024-08-19T00:56:16.747 INFO:tasks.workunit.client.1.smithi086.stdout:5/840: write d0/d5f/d60/d57/f84 [2840523,14951] 0 2024-08-19T00:56:16.747 INFO:tasks.workunit.client.1.smithi086.stdout:0/842: truncate da/d14/d1a/d2e/f51 1698170 0 2024-08-19T00:56:16.748 INFO:tasks.workunit.client.1.smithi086.stdout:5/841: chown d0/d5f/d60/fd0 320 1 2024-08-19T00:56:16.749 INFO:tasks.workunit.client.1.smithi086.stdout:5/842: chown d0/df/d1f/d33/dea 80 1 2024-08-19T00:56:16.749 INFO:tasks.workunit.client.1.smithi086.stdout:5/843: chown d0/f17 7 1 2024-08-19T00:56:16.749 INFO:tasks.workunit.client.1.smithi086.stdout:0/843: read da/d14/f2d [1195365,939] 0 2024-08-19T00:56:16.750 INFO:tasks.workunit.client.0.smithi017.stdout:7/389: symlink d3/dc/d5f/l72 0 2024-08-19T00:56:16.750 INFO:tasks.workunit.client.1.smithi086.stdout:5/844: write d0/df/d1f/d33/f34 [763484,92944] 0 2024-08-19T00:56:16.751 INFO:tasks.workunit.client.0.smithi017.stdout:2/463: fdatasync d2/d7/dd/f15 0 2024-08-19T00:56:16.754 INFO:tasks.workunit.client.0.smithi017.stdout:4/408: mkdir d2/d87 0 2024-08-19T00:56:16.755 INFO:tasks.workunit.client.1.smithi086.stdout:1/943: fdatasync d4/f14 0 2024-08-19T00:56:16.756 INFO:tasks.workunit.client.1.smithi086.stdout:1/944: stat d4/d7/f37 0 2024-08-19T00:56:16.758 INFO:tasks.workunit.client.1.smithi086.stdout:6/855: creat db/d37/d28/d7f/f10c x:0 0 0 2024-08-19T00:56:16.760 INFO:tasks.workunit.client.0.smithi017.stdout:0/390: creat d5/d17/d26/f80 x:0 0 0 2024-08-19T00:56:16.762 INFO:tasks.workunit.client.0.smithi017.stdout:4/409: dwrite d2/d1a/d55/f79 [0,4194304] 0 2024-08-19T00:56:16.763 INFO:tasks.workunit.client.0.smithi017.stdout:7/390: mkdir d3/dc/df/d37/d46/d73 0 2024-08-19T00:56:16.764 INFO:tasks.workunit.client.1.smithi086.stdout:9/860: truncate db/d26/d5c/d87/d30/d3f/d43/f5f 183790 0 2024-08-19T00:56:16.770 INFO:tasks.workunit.client.0.smithi017.stdout:8/274: write de/d36/f32 [186664,54132] 0 2024-08-19T00:56:16.770 INFO:tasks.workunit.client.0.smithi017.stdout:8/275: readlink l3 0 2024-08-19T00:56:16.772 INFO:tasks.workunit.client.1.smithi086.stdout:4/805: dwrite d2/d18/d33/d42/d72/d78/d25/d30/ff6 [0,4194304] 0 2024-08-19T00:56:16.773 INFO:tasks.workunit.client.0.smithi017.stdout:3/420: truncate d5/d15/f21 274958 0 2024-08-19T00:56:16.773 INFO:tasks.workunit.client.0.smithi017.stdout:9/371: write d0/d33/f29 [610095,68483] 0 2024-08-19T00:56:16.774 INFO:tasks.workunit.client.1.smithi086.stdout:2/890: link d8/d2c/d47/d73/cc9 d8/d24/d32/d4d/d6a/db1/c12a 0 2024-08-19T00:56:16.779 INFO:tasks.workunit.client.0.smithi017.stdout:0/391: unlink d5/d17/d26/c46 0 2024-08-19T00:56:16.779 INFO:tasks.workunit.client.0.smithi017.stdout:8/276: dwrite de/f37 [0,4194304] 0 2024-08-19T00:56:16.782 INFO:tasks.workunit.client.1.smithi086.stdout:3/855: mknod d3/d26/d2b/d33/d4a/d78/c11a 0 2024-08-19T00:56:16.782 INFO:tasks.workunit.client.1.smithi086.stdout:8/822: write dc/d1f/d37/d4f/dac/db8/de7/ff1 [904348,23015] 0 2024-08-19T00:56:16.784 INFO:tasks.workunit.client.1.smithi086.stdout:1/945: creat d4/d7/d2a/d36/d63/d84/d8e/f131 x:0 0 0 2024-08-19T00:56:16.788 INFO:tasks.workunit.client.1.smithi086.stdout:0/844: dwrite da/f36 [0,4194304] 0 2024-08-19T00:56:16.790 INFO:tasks.workunit.client.0.smithi017.stdout:9/372: creat d0/d58/d49/f6d x:0 0 0 2024-08-19T00:56:16.793 INFO:tasks.workunit.client.0.smithi017.stdout:3/421: creat d5/d15/d1b/f7b x:0 0 0 2024-08-19T00:56:16.794 INFO:tasks.workunit.client.0.smithi017.stdout:8/277: creat de/d15/d39/f4c x:0 0 0 2024-08-19T00:56:16.797 INFO:tasks.workunit.client.0.smithi017.stdout:0/392: mkdir d5/d17/d26/d30/d3e/d81 0 2024-08-19T00:56:16.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/410: mknod d2/d21/d40/d84/c88 0 2024-08-19T00:56:16.801 INFO:tasks.workunit.client.0.smithi017.stdout:2/464: truncate d2/d7/d10/f25 1532078 0 2024-08-19T00:56:16.804 INFO:tasks.workunit.client.1.smithi086.stdout:5/845: getdents d0/d8/d94/df9/dff 0 2024-08-19T00:56:16.805 INFO:tasks.workunit.client.1.smithi086.stdout:6/856: dwrite db/d37/d44/d5a/d8f/f107 [0,4194304] 0 2024-08-19T00:56:16.806 INFO:tasks.workunit.client.0.smithi017.stdout:8/278: unlink de/d36/l38 0 2024-08-19T00:56:16.806 INFO:tasks.workunit.client.0.smithi017.stdout:4/411: dwrite d2/d11/f63 [0,4194304] 0 2024-08-19T00:56:16.807 INFO:tasks.workunit.client.0.smithi017.stdout:1/308: sync 2024-08-19T00:56:16.808 INFO:tasks.workunit.client.0.smithi017.stdout:8/279: write de/f47 [449112,101302] 0 2024-08-19T00:56:16.809 INFO:tasks.workunit.client.0.smithi017.stdout:0/393: creat d5/d18/f82 x:0 0 0 2024-08-19T00:56:16.816 INFO:tasks.workunit.client.0.smithi017.stdout:2/465: write d2/d7/f6c [1022687,5424] 0 2024-08-19T00:56:16.816 INFO:tasks.workunit.client.1.smithi086.stdout:1/946: creat d4/d7/d2a/d36/d63/d84/d8e/f132 x:0 0 0 2024-08-19T00:56:16.816 INFO:tasks.workunit.client.1.smithi086.stdout:8/823: dwrite dc/d16/d18/d106/d28/d2b/f79 [0,4194304] 0 2024-08-19T00:56:16.818 INFO:tasks.workunit.client.1.smithi086.stdout:8/824: chown dc/d16/d18/d106/d28/d41/f59 12 1 2024-08-19T00:56:16.818 INFO:tasks.workunit.client.0.smithi017.stdout:7/391: rename d3/dc/df/d1c/d2c/d2f/l45 to d3/d3c/l74 0 2024-08-19T00:56:16.819 INFO:tasks.workunit.client.1.smithi086.stdout:8/825: stat dc/d17/d1e/d55/l7d 0 2024-08-19T00:56:16.820 INFO:tasks.workunit.client.1.smithi086.stdout:8/826: write dc/d1f/d37/d4f/fee [832974,124966] 0 2024-08-19T00:56:16.821 INFO:tasks.workunit.client.1.smithi086.stdout:7/843: creat d3/d34/d44/d58/d4b/da5/daf/de7/df5/f115 x:0 0 0 2024-08-19T00:56:16.821 INFO:tasks.workunit.client.0.smithi017.stdout:1/309: dwrite d4/dc/d19/f53 [0,4194304] 0 2024-08-19T00:56:16.822 INFO:tasks.workunit.client.1.smithi086.stdout:0/845: fdatasync da/d14/d1a/d2e/d30/d76/f7d 0 2024-08-19T00:56:16.825 INFO:tasks.workunit.client.0.smithi017.stdout:8/280: fdatasync f0 0 2024-08-19T00:56:16.830 INFO:tasks.workunit.client.0.smithi017.stdout:3/422: rename d5/da/d27/d28/c29 to d5/da/d3c/d4f/c7c 0 2024-08-19T00:56:16.831 INFO:tasks.workunit.client.1.smithi086.stdout:1/947: dread d4/d1e/d6f/f74 [0,4194304] 0 2024-08-19T00:56:16.834 INFO:tasks.workunit.client.1.smithi086.stdout:5/846: creat d0/d2d/d4f/f104 x:0 0 0 2024-08-19T00:56:16.835 INFO:tasks.workunit.client.1.smithi086.stdout:5/847: dread - d0/d8/d94/ff2 zero size 2024-08-19T00:56:16.835 INFO:tasks.workunit.client.0.smithi017.stdout:9/373: link d0/d33/d22/d5a/l61 d0/d33/d22/d5a/l6e 0 2024-08-19T00:56:16.837 INFO:tasks.workunit.client.0.smithi017.stdout:3/423: dwrite d5/ff [4194304,4194304] 0 2024-08-19T00:56:16.839 INFO:tasks.workunit.client.0.smithi017.stdout:1/310: fsync d4/dc/f18 0 2024-08-19T00:56:16.848 INFO:tasks.workunit.client.1.smithi086.stdout:0/846: mknod da/d97/c109 0 2024-08-19T00:56:16.849 INFO:tasks.workunit.client.1.smithi086.stdout:9/861: write db/d26/d5c/d87/d30/d58/f95 [1332363,76573] 0 2024-08-19T00:56:16.851 INFO:tasks.workunit.client.1.smithi086.stdout:4/806: write d2/f45 [1351467,197] 0 2024-08-19T00:56:16.851 INFO:tasks.workunit.client.0.smithi017.stdout:1/311: dread d4/dc/d17/d1d/f1e [0,4194304] 0 2024-08-19T00:56:16.854 INFO:tasks.workunit.client.1.smithi086.stdout:1/948: creat d4/d7/d2a/d36/d50/d9c/ded/d11c/f133 x:0 0 0 2024-08-19T00:56:16.855 INFO:tasks.workunit.client.1.smithi086.stdout:5/848: symlink d0/d5f/d60/d57/d80/da3/l105 0 2024-08-19T00:56:16.856 INFO:tasks.workunit.client.0.smithi017.stdout:4/412: creat d2/d1a/d55/f89 x:0 0 0 2024-08-19T00:56:16.857 INFO:tasks.workunit.client.1.smithi086.stdout:3/856: getdents d3/d18/d27/d106 0 2024-08-19T00:56:16.858 INFO:tasks.workunit.client.0.smithi017.stdout:0/394: rename d5/d17/d26/l37 to d5/d18/d3a/l83 0 2024-08-19T00:56:16.858 INFO:tasks.workunit.client.0.smithi017.stdout:9/374: mkdir d0/d33/d6f 0 2024-08-19T00:56:16.859 INFO:tasks.workunit.client.0.smithi017.stdout:0/395: fsync d5/d17/d26/d30/f58 0 2024-08-19T00:56:16.860 INFO:tasks.workunit.client.1.smithi086.stdout:5/849: fsync d0/d5f/d60/d5b/ffe 0 2024-08-19T00:56:16.860 INFO:tasks.workunit.client.1.smithi086.stdout:0/847: creat da/d14/d55/dac/f10a x:0 0 0 2024-08-19T00:56:16.861 INFO:tasks.workunit.client.0.smithi017.stdout:1/312: mkdir d4/dc/d3b/d55 0 2024-08-19T00:56:16.862 INFO:tasks.workunit.client.1.smithi086.stdout:9/862: dwrite db/d26/d5c/d68/f6f [4194304,4194304] 0 2024-08-19T00:56:16.864 INFO:tasks.workunit.client.1.smithi086.stdout:7/844: creat d3/d34/d44/d58/d4b/f116 x:0 0 0 2024-08-19T00:56:16.865 INFO:tasks.workunit.client.1.smithi086.stdout:2/891: dwrite d8/d14/d10a/f119 [0,4194304] 0 2024-08-19T00:56:16.865 INFO:tasks.workunit.client.0.smithi017.stdout:2/466: write d2/d7/d10/d3b/d54/f61 [739389,80305] 0 2024-08-19T00:56:16.866 INFO:tasks.workunit.client.1.smithi086.stdout:8/827: dread dc/d16/d18/d106/d28/d2b/d3b/f8e [8388608,4194304] 0 2024-08-19T00:56:16.868 INFO:tasks.workunit.client.1.smithi086.stdout:7/845: chown d3/d34/d44/d58/fa9 143418592 1 2024-08-19T00:56:16.868 INFO:tasks.workunit.client.1.smithi086.stdout:4/807: dwrite d2/d18/d33/d42/d72/d78/d25/d55/f38 [0,4194304] 0 2024-08-19T00:56:16.869 INFO:tasks.workunit.client.1.smithi086.stdout:8/828: readlink dc/d16/d18/d94/l10c 0 2024-08-19T00:56:16.869 INFO:tasks.workunit.client.0.smithi017.stdout:8/281: creat de/f4d x:0 0 0 2024-08-19T00:56:16.871 INFO:tasks.workunit.client.0.smithi017.stdout:8/282: write de/f4d [699743,16267] 0 2024-08-19T00:56:16.871 INFO:tasks.workunit.client.1.smithi086.stdout:2/892: truncate d8/d14/f22 9549866 0 2024-08-19T00:56:16.872 INFO:tasks.workunit.client.1.smithi086.stdout:6/857: dwrite db/f2b [0,4194304] 0 2024-08-19T00:56:16.877 INFO:tasks.workunit.client.0.smithi017.stdout:7/392: rename d3/dc/df/d37/d39/l4c to d3/dc/d5f/l75 0 2024-08-19T00:56:16.878 INFO:tasks.workunit.client.1.smithi086.stdout:5/850: rmdir d0/d99/da2 39 2024-08-19T00:56:16.881 INFO:tasks.workunit.client.1.smithi086.stdout:9/863: unlink db/ced 0 2024-08-19T00:56:16.886 INFO:tasks.workunit.client.1.smithi086.stdout:1/949: write d4/d7/d2a/d36/d3a/de5/d7a/db4/f100 [5102672,8493] 0 2024-08-19T00:56:16.887 INFO:tasks.workunit.client.0.smithi017.stdout:3/424: creat d5/da/f7d x:0 0 0 2024-08-19T00:56:16.887 INFO:tasks.workunit.client.1.smithi086.stdout:3/857: dread d3/d18/d1a/f34 [0,4194304] 0 2024-08-19T00:56:16.888 INFO:tasks.workunit.client.0.smithi017.stdout:1/313: truncate d4/dc/d19/f41 516594 0 2024-08-19T00:56:16.889 INFO:tasks.workunit.client.1.smithi086.stdout:7/846: mkdir d3/d34/df2/d117 0 2024-08-19T00:56:16.892 INFO:tasks.workunit.client.0.smithi017.stdout:0/396: dread d5/f48 [0,4194304] 0 2024-08-19T00:56:16.893 INFO:tasks.workunit.client.0.smithi017.stdout:8/283: creat de/d15/d39/d3d/f4e x:0 0 0 2024-08-19T00:56:16.894 INFO:tasks.workunit.client.0.smithi017.stdout:8/284: write de/d15/f35 [993410,60911] 0 2024-08-19T00:56:16.895 INFO:tasks.workunit.client.1.smithi086.stdout:4/808: mknod d2/d18/d33/d42/d72/d2f/d8e/c10b 0 2024-08-19T00:56:16.895 INFO:tasks.workunit.client.1.smithi086.stdout:1/950: dwrite d4/d7/f9b [4194304,4194304] 0 2024-08-19T00:56:16.895 INFO:tasks.workunit.client.0.smithi017.stdout:7/393: symlink d3/d3c/l76 0 2024-08-19T00:56:16.896 INFO:tasks.workunit.client.0.smithi017.stdout:7/394: stat d3/d3c/l76 0 2024-08-19T00:56:16.897 INFO:tasks.workunit.client.1.smithi086.stdout:6/858: unlink db/d37/d28/le3 0 2024-08-19T00:56:16.898 INFO:tasks.workunit.client.1.smithi086.stdout:1/951: fdatasync d4/d1e/d6f/fca 0 2024-08-19T00:56:16.899 INFO:tasks.workunit.client.0.smithi017.stdout:4/413: truncate d2/d1a/f65 1308722 0 2024-08-19T00:56:16.899 INFO:tasks.workunit.client.1.smithi086.stdout:3/858: dwrite d3/d18/d27/d49/d3f/d5b/d8f/ffd [0,4194304] 0 2024-08-19T00:56:16.900 INFO:tasks.workunit.client.1.smithi086.stdout:6/859: readlink db/d34/d39/d76/le8 0 2024-08-19T00:56:16.903 INFO:tasks.workunit.client.1.smithi086.stdout:9/864: unlink db/d26/d5c/d87/d30/d3f/d43/d4e/l9a 0 2024-08-19T00:56:16.903 INFO:tasks.workunit.client.1.smithi086.stdout:1/952: chown d4/d7/d2a/d36/d3a/de5/d7a/db4/df0/l10f 515694 1 2024-08-19T00:56:16.906 INFO:tasks.workunit.client.0.smithi017.stdout:1/314: read d4/dc/f42 [582533,86659] 0 2024-08-19T00:56:16.906 INFO:tasks.workunit.client.1.smithi086.stdout:4/809: dwrite d2/d18/d33/d42/d72/d78/d2c/dae/f104 [0,4194304] 0 2024-08-19T00:56:16.908 INFO:tasks.workunit.client.0.smithi017.stdout:9/375: write d0/d33/f39 [538814,106780] 0 2024-08-19T00:56:16.909 INFO:tasks.workunit.client.1.smithi086.stdout:0/848: creat da/d14/d1a/dc8/f10b x:0 0 0 2024-08-19T00:56:16.909 INFO:tasks.workunit.client.1.smithi086.stdout:4/810: read d2/f1b [3328217,19081] 0 2024-08-19T00:56:16.910 INFO:tasks.workunit.client.1.smithi086.stdout:0/849: fsync da/d14/f15 0 2024-08-19T00:56:16.911 INFO:tasks.workunit.client.0.smithi017.stdout:0/397: rename d5/d17/d21/d42/f53 to d5/d17/d26/d30/d3e/d5a/f84 0 2024-08-19T00:56:16.912 INFO:tasks.workunit.client.1.smithi086.stdout:7/847: rmdir d3 39 2024-08-19T00:56:16.913 INFO:tasks.workunit.client.0.smithi017.stdout:8/285: mkdir de/d15/d4f 0 2024-08-19T00:56:16.913 INFO:tasks.workunit.client.1.smithi086.stdout:4/811: dread d2/d18/d33/d42/d72/d78/f6d [0,4194304] 0 2024-08-19T00:56:16.914 INFO:tasks.workunit.client.1.smithi086.stdout:2/893: mkdir d8/d14/dae/ddc/d12b 0 2024-08-19T00:56:16.914 INFO:tasks.workunit.client.0.smithi017.stdout:8/286: write de/f37 [4504886,3597] 0 2024-08-19T00:56:16.915 INFO:tasks.workunit.client.0.smithi017.stdout:7/395: symlink d3/dc/d5f/l77 0 2024-08-19T00:56:16.916 INFO:tasks.workunit.client.1.smithi086.stdout:1/953: dwrite d4/d7/d2a/d36/d3a/de5/d7a/db4/f100 [4194304,4194304] 0 2024-08-19T00:56:16.921 INFO:tasks.workunit.client.0.smithi017.stdout:8/287: dwrite de/d36/f32 [0,4194304] 0 2024-08-19T00:56:16.922 INFO:tasks.workunit.client.1.smithi086.stdout:6/860: creat db/d37/d28/d7f/d96/f10d x:0 0 0 2024-08-19T00:56:16.923 INFO:tasks.workunit.client.0.smithi017.stdout:1/315: readlink d4/dc/l1b 0 2024-08-19T00:56:16.928 INFO:tasks.workunit.client.0.smithi017.stdout:0/398: creat d5/d17/d21/d39/f85 x:0 0 0 2024-08-19T00:56:16.929 INFO:tasks.workunit.client.1.smithi086.stdout:0/850: dread da/d14/d1a/d2e/f51 [0,4194304] 0 2024-08-19T00:56:16.930 INFO:tasks.workunit.client.1.smithi086.stdout:8/829: creat dc/d1f/d37/d4f/dac/db8/f110 x:0 0 0 2024-08-19T00:56:16.931 INFO:tasks.workunit.client.1.smithi086.stdout:8/830: readlink dc/d17/d1e/d49/l5e 0 2024-08-19T00:56:16.934 INFO:tasks.workunit.client.1.smithi086.stdout:0/851: dread da/d14/d44/d49/f63 [0,4194304] 0 2024-08-19T00:56:16.934 INFO:tasks.workunit.client.0.smithi017.stdout:8/288: dwrite de/d15/d39/d3d/f4b [0,4194304] 0 2024-08-19T00:56:16.936 INFO:tasks.workunit.client.1.smithi086.stdout:1/954: dread d4/d7/d2a/d36/d7d/fe4 [0,4194304] 0 2024-08-19T00:56:16.937 INFO:tasks.workunit.client.0.smithi017.stdout:8/289: readlink de/d15/l3a 0 2024-08-19T00:56:16.938 INFO:tasks.workunit.client.0.smithi017.stdout:9/376: dwrite d0/d33/d22/d5a/f6b [0,4194304] 0 2024-08-19T00:56:16.942 INFO:tasks.workunit.client.0.smithi017.stdout:7/396: mknod d3/dc/df/c78 0 2024-08-19T00:56:16.944 INFO:tasks.workunit.client.0.smithi017.stdout:7/397: fsync d3/dc/d5f/f63 0 2024-08-19T00:56:16.947 INFO:tasks.workunit.client.0.smithi017.stdout:0/399: dread d5/d18/f4c [0,4194304] 0 2024-08-19T00:56:16.948 INFO:tasks.workunit.client.0.smithi017.stdout:4/414: creat d2/d21/f8a x:0 0 0 2024-08-19T00:56:16.949 INFO:tasks.workunit.client.1.smithi086.stdout:7/848: fdatasync d3/ff 0 2024-08-19T00:56:16.951 INFO:tasks.workunit.client.0.smithi017.stdout:8/290: chown de/d15/c17 25192 1 2024-08-19T00:56:16.953 INFO:tasks.workunit.client.0.smithi017.stdout:9/377: dread d0/f34 [0,4194304] 0 2024-08-19T00:56:16.954 INFO:tasks.workunit.client.1.smithi086.stdout:2/894: getdents d8/d84/d101 0 2024-08-19T00:56:16.954 INFO:tasks.workunit.client.1.smithi086.stdout:5/851: write d0/d5f/d60/d57/f58 [1370151,57254] 0 2024-08-19T00:56:16.956 INFO:tasks.workunit.client.1.smithi086.stdout:5/852: readlink d0/d2d/l8d 0 2024-08-19T00:56:16.957 INFO:tasks.workunit.client.0.smithi017.stdout:3/425: truncate d5/da/d3c/d4f/f52 960121 0 2024-08-19T00:56:16.957 INFO:tasks.workunit.client.1.smithi086.stdout:3/859: dwrite d3/d18/f1c [4194304,4194304] 0 2024-08-19T00:56:16.963 INFO:tasks.workunit.client.0.smithi017.stdout:9/378: dwrite d0/d33/d22/f42 [0,4194304] 0 2024-08-19T00:56:16.964 INFO:tasks.workunit.client.1.smithi086.stdout:0/852: fdatasync da/d14/f17 0 2024-08-19T00:56:16.964 INFO:tasks.workunit.client.1.smithi086.stdout:0/853: stat da/d14/la0 0 2024-08-19T00:56:16.973 INFO:tasks.workunit.client.1.smithi086.stdout:8/831: dread dc/f62 [0,4194304] 0 2024-08-19T00:56:16.975 INFO:tasks.workunit.client.0.smithi017.stdout:4/415: mkdir d2/d21/d40/d8b 0 2024-08-19T00:56:16.975 INFO:tasks.workunit.client.0.smithi017.stdout:9/379: dwrite d0/d33/d22/f2f [0,4194304] 0 2024-08-19T00:56:16.975 INFO:tasks.workunit.client.0.smithi017.stdout:0/400: creat d5/d17/d21/d42/f86 x:0 0 0 2024-08-19T00:56:16.975 INFO:tasks.workunit.client.0.smithi017.stdout:1/316: dread d4/dc/f34 [0,4194304] 0 2024-08-19T00:56:16.975 INFO:tasks.workunit.client.0.smithi017.stdout:7/398: dread d3/dc/df/d37/f66 [0,4194304] 0 2024-08-19T00:56:16.976 INFO:tasks.workunit.client.1.smithi086.stdout:1/955: creat d4/d7/d2a/d36/d61/f134 x:0 0 0 2024-08-19T00:56:16.976 INFO:tasks.workunit.client.1.smithi086.stdout:7/849: dread d3/d34/d44/d58/d4b/f6d [0,4194304] 0 2024-08-19T00:56:16.978 INFO:tasks.workunit.client.0.smithi017.stdout:7/399: chown d3/f4 26136 1 2024-08-19T00:56:16.979 INFO:tasks.workunit.client.1.smithi086.stdout:9/865: link db/d26/d5c/le0 db/d26/d5c/d87/d6d/deb/l115 0 2024-08-19T00:56:16.983 INFO:tasks.workunit.client.0.smithi017.stdout:3/426: symlink d5/da/d3c/d4f/l7e 0 2024-08-19T00:56:16.986 INFO:tasks.workunit.client.0.smithi017.stdout:8/291: dwrite de/d15/f2b [0,4194304] 0 2024-08-19T00:56:16.988 INFO:tasks.workunit.client.1.smithi086.stdout:6/861: dwrite db/d34/d69/fd3 [0,4194304] 0 2024-08-19T00:56:16.993 INFO:tasks.workunit.client.1.smithi086.stdout:5/853: mkdir d0/d99/dc0/d106 0 2024-08-19T00:56:16.994 INFO:tasks.workunit.client.1.smithi086.stdout:5/854: chown d0/d8/d73 28487 1 2024-08-19T00:56:16.996 INFO:tasks.workunit.client.0.smithi017.stdout:8/292: dread de/f47 [0,4194304] 0 2024-08-19T00:56:17.002 INFO:tasks.workunit.client.1.smithi086.stdout:0/854: rename da/d14/d1a to da/d14/d55/d10c 0 2024-08-19T00:56:17.004 INFO:tasks.workunit.client.0.smithi017.stdout:1/317: symlink d4/dc/d3b/d3d/l56 0 2024-08-19T00:56:17.005 INFO:tasks.workunit.client.1.smithi086.stdout:8/832: creat dc/d17/d86/f111 x:0 0 0 2024-08-19T00:56:17.006 INFO:tasks.workunit.client.1.smithi086.stdout:8/833: readlink dc/d1f/dd4/d108/l10e 0 2024-08-19T00:56:17.006 INFO:tasks.workunit.client.1.smithi086.stdout:8/834: stat dc/d17/d1e/d55/c5d 0 2024-08-19T00:56:17.006 INFO:tasks.workunit.client.0.smithi017.stdout:4/416: creat d2/d1a/d20/f8c x:0 0 0 2024-08-19T00:56:17.007 INFO:tasks.workunit.client.0.smithi017.stdout:7/400: fsync d3/dc/df/d37/f66 0 2024-08-19T00:56:17.013 INFO:tasks.workunit.client.1.smithi086.stdout:7/850: dread d3/d34/d44/f37 [0,4194304] 0 2024-08-19T00:56:17.015 INFO:tasks.workunit.client.0.smithi017.stdout:7/401: dwrite d3/dc/df/d1a/f3b [0,4194304] 0 2024-08-19T00:56:17.019 INFO:tasks.workunit.client.0.smithi017.stdout:8/293: mknod de/d15/d39/d3d/c50 0 2024-08-19T00:56:17.019 INFO:tasks.workunit.client.0.smithi017.stdout:8/294: chown de/f12 26323489 1 2024-08-19T00:56:17.019 INFO:tasks.workunit.client.1.smithi086.stdout:7/851: dwrite d3/d34/d44/d58/d4b/da5/daf/de7/df5/f86 [4194304,4194304] 0 2024-08-19T00:56:17.023 INFO:tasks.workunit.client.0.smithi017.stdout:1/318: dread d4/f14 [0,4194304] 0 2024-08-19T00:56:17.026 INFO:tasks.workunit.client.1.smithi086.stdout:4/812: getdents d2/d18/d33/d42/d72/d2f/dc4/d81/d8a 0 2024-08-19T00:56:17.028 INFO:tasks.workunit.client.1.smithi086.stdout:0/855: mkdir da/d14/d55/d10c/d2e/d7e/dd7/d10d 0 2024-08-19T00:56:17.029 INFO:tasks.workunit.client.1.smithi086.stdout:0/856: stat da/d14/d44/df0/fd6 0 2024-08-19T00:56:17.033 INFO:tasks.workunit.client.1.smithi086.stdout:8/835: creat dc/d1f/d37/d4f/dac/db8/d8f/df4/f112 x:0 0 0 2024-08-19T00:56:17.035 INFO:tasks.workunit.client.0.smithi017.stdout:3/427: fdatasync d5/da/f74 0 2024-08-19T00:56:17.038 INFO:tasks.workunit.client.1.smithi086.stdout:6/862: symlink db/d37/d28/d7f/l10e 0 2024-08-19T00:56:17.039 INFO:tasks.workunit.client.1.smithi086.stdout:6/863: chown db/d34/d69/fd0 1098 1 2024-08-19T00:56:17.039 INFO:tasks.workunit.client.0.smithi017.stdout:9/380: rmdir d0/d33/d6f 0 2024-08-19T00:56:17.040 INFO:tasks.workunit.client.0.smithi017.stdout:9/381: read d0/d33/f39 [688274,81343] 0 2024-08-19T00:56:17.040 INFO:tasks.workunit.client.0.smithi017.stdout:7/402: mknod d3/dc/df/d1a/c79 0 2024-08-19T00:56:17.041 INFO:tasks.workunit.client.0.smithi017.stdout:7/403: chown d3/dc/df/d23/d69 7287395 1 2024-08-19T00:56:17.044 INFO:tasks.workunit.client.1.smithi086.stdout:2/895: dwrite d8/f1e [0,4194304] 0 2024-08-19T00:56:17.044 INFO:tasks.workunit.client.1.smithi086.stdout:7/852: symlink d3/de/d68/d72/l118 0 2024-08-19T00:56:17.045 INFO:tasks.workunit.client.0.smithi017.stdout:1/319: symlink d4/d1c/d1f/l57 0 2024-08-19T00:56:17.046 INFO:tasks.workunit.client.0.smithi017.stdout:0/401: write d5/f48 [202623,52422] 0 2024-08-19T00:56:17.049 INFO:tasks.workunit.client.0.smithi017.stdout:4/417: getdents d2/d11/d24 0 2024-08-19T00:56:17.053 INFO:tasks.workunit.client.0.smithi017.stdout:3/428: rename d5/da/d27/l57 to d5/da/d27/d6e/l7f 0 2024-08-19T00:56:17.055 INFO:tasks.workunit.client.1.smithi086.stdout:1/956: write d4/d7/d2a/f6b [2935967,9596] 0 2024-08-19T00:56:17.056 INFO:tasks.workunit.client.1.smithi086.stdout:9/866: write db/d96/da7/f85 [1801338,98106] 0 2024-08-19T00:56:17.056 INFO:tasks.workunit.client.0.smithi017.stdout:9/382: mkdir d0/d58/d49/d70 0 2024-08-19T00:56:17.057 INFO:tasks.workunit.client.0.smithi017.stdout:9/383: read d0/f3a [263720,57446] 0 2024-08-19T00:56:17.058 INFO:tasks.workunit.client.1.smithi086.stdout:2/896: creat d8/d24/d32/f12c x:0 0 0 2024-08-19T00:56:17.065 INFO:tasks.workunit.client.1.smithi086.stdout:3/860: getdents d3/d18/d27/d49/d3f 0 2024-08-19T00:56:17.065 INFO:tasks.workunit.client.1.smithi086.stdout:4/813: symlink d2/l10c 0 2024-08-19T00:56:17.065 INFO:tasks.workunit.client.0.smithi017.stdout:0/402: creat d5/d17/d21/d42/f87 x:0 0 0 2024-08-19T00:56:17.067 INFO:tasks.workunit.client.1.smithi086.stdout:1/957: dwrite d4/d7/d2a/d6e/d95/db9/fe9 [0,4194304] 0 2024-08-19T00:56:17.069 INFO:tasks.workunit.client.1.smithi086.stdout:5/855: link d0/d99/cb1 d0/d99/dc0/dc2/de2/c107 0 2024-08-19T00:56:17.070 INFO:tasks.workunit.client.0.smithi017.stdout:3/429: creat d5/da/d27/d28/f80 x:0 0 0 2024-08-19T00:56:17.071 INFO:tasks.workunit.client.0.smithi017.stdout:3/430: dread - d5/da/d3c/f50 zero size 2024-08-19T00:56:17.073 INFO:tasks.workunit.client.1.smithi086.stdout:9/867: mknod db/d26/d5c/d87/d30/d31/d103/de2/dee/c116 0 2024-08-19T00:56:17.074 INFO:tasks.workunit.client.0.smithi017.stdout:3/431: dread d5/da/d27/f3a [0,4194304] 0 2024-08-19T00:56:17.075 INFO:tasks.workunit.client.1.smithi086.stdout:7/853: symlink d3/de/d113/l119 0 2024-08-19T00:56:17.075 INFO:tasks.workunit.client.0.smithi017.stdout:9/384: dread d0/d33/f30 [0,4194304] 0 2024-08-19T00:56:17.076 INFO:tasks.workunit.client.0.smithi017.stdout:8/295: creat de/f51 x:0 0 0 2024-08-19T00:56:17.076 INFO:tasks.workunit.client.1.smithi086.stdout:8/836: dwrite dc/d16/d18/d106/d28/d2b/d3b/f3c [0,4194304] 0 2024-08-19T00:56:17.076 INFO:tasks.workunit.client.1.smithi086.stdout:9/868: read db/f52 [4143949,126216] 0 2024-08-19T00:56:17.076 INFO:tasks.workunit.client.1.smithi086.stdout:2/897: rmdir d8/d84/de0/d114 39 2024-08-19T00:56:17.077 INFO:tasks.workunit.client.0.smithi017.stdout:7/404: symlink d3/dc/df/d37/d46/d73/l7a 0 2024-08-19T00:56:17.078 INFO:tasks.workunit.client.1.smithi086.stdout:9/869: truncate db/d26/d5c/d87/d30/d32/d44/dc1/ff5 645925 0 2024-08-19T00:56:17.080 INFO:tasks.workunit.client.0.smithi017.stdout:0/403: write d5/fc [777395,72966] 0 2024-08-19T00:56:17.084 INFO:tasks.workunit.client.0.smithi017.stdout:3/432: mknod d5/d18/c81 0 2024-08-19T00:56:17.088 INFO:tasks.workunit.client.0.smithi017.stdout:3/433: dread d5/da/fd [0,4194304] 0 2024-08-19T00:56:17.090 INFO:tasks.workunit.client.0.smithi017.stdout:5/283: sync 2024-08-19T00:56:17.090 INFO:tasks.workunit.client.0.smithi017.stdout:6/392: sync 2024-08-19T00:56:17.091 INFO:tasks.workunit.client.0.smithi017.stdout:2/467: sync 2024-08-19T00:56:17.091 INFO:tasks.workunit.client.0.smithi017.stdout:6/393: fdatasync f2 0 2024-08-19T00:56:17.092 INFO:tasks.workunit.client.0.smithi017.stdout:2/468: chown d2/d7/d10/d3b/d3c/d8a 350363 1 2024-08-19T00:56:17.094 INFO:tasks.workunit.client.0.smithi017.stdout:5/284: write db/d19/d1f/d15/d1e/f3d [2962548,63381] 0 2024-08-19T00:56:17.100 INFO:tasks.workunit.client.0.smithi017.stdout:2/469: dwrite d2/f77 [0,4194304] 0 2024-08-19T00:56:17.101 INFO:tasks.workunit.client.0.smithi017.stdout:1/320: write d4/d1c/f46 [4328128,89652] 0 2024-08-19T00:56:17.104 INFO:tasks.workunit.client.0.smithi017.stdout:1/321: read d4/dc/d3b/f4a [2138225,46012] 0 2024-08-19T00:56:17.105 INFO:tasks.workunit.client.0.smithi017.stdout:4/418: truncate d2/d11/f36 494216 0 2024-08-19T00:56:17.107 INFO:tasks.workunit.client.0.smithi017.stdout:6/394: rmdir d5/d13/d11/d2c/d4a/d64 39 2024-08-19T00:56:17.107 INFO:tasks.workunit.client.0.smithi017.stdout:7/405: dread d3/dc/f1f [0,4194304] 0 2024-08-19T00:56:17.108 INFO:tasks.workunit.client.0.smithi017.stdout:6/395: fsync d5/d13/d11/d2c/d51/f84 0 2024-08-19T00:56:17.109 INFO:tasks.workunit.client.0.smithi017.stdout:7/406: chown d3/dc/df/d1c/d2c/d35/l38 3 1 2024-08-19T00:56:17.111 INFO:tasks.workunit.client.0.smithi017.stdout:0/404: creat d5/d18/d78/f88 x:0 0 0 2024-08-19T00:56:17.116 INFO:tasks.workunit.client.0.smithi017.stdout:0/405: dwrite d5/d17/d21/f68 [0,4194304] 0 2024-08-19T00:56:17.118 INFO:tasks.workunit.client.0.smithi017.stdout:8/296: creat de/f52 x:0 0 0 2024-08-19T00:56:17.124 INFO:tasks.workunit.client.0.smithi017.stdout:9/385: creat d0/d33/f71 x:0 0 0 2024-08-19T00:56:17.132 INFO:tasks.workunit.client.0.smithi017.stdout:8/297: dwrite de/d15/d39/f4c [0,4194304] 0 2024-08-19T00:56:17.132 INFO:tasks.workunit.client.0.smithi017.stdout:3/434: dwrite d5/d11/f3e [0,4194304] 0 2024-08-19T00:56:17.135 INFO:tasks.workunit.client.0.smithi017.stdout:7/407: rename d3/dc/df/c78 to d3/dc/df/d1c/d2c/d2f/c7b 0 2024-08-19T00:56:17.139 INFO:tasks.workunit.client.0.smithi017.stdout:8/298: chown de/c13 0 1 2024-08-19T00:56:17.142 INFO:tasks.workunit.client.0.smithi017.stdout:1/322: dwrite d4/f14 [4194304,4194304] 0 2024-08-19T00:56:17.145 INFO:tasks.workunit.client.0.smithi017.stdout:0/406: dread d5/d17/d26/d30/f58 [0,4194304] 0 2024-08-19T00:56:17.150 INFO:tasks.workunit.client.0.smithi017.stdout:3/435: dwrite d5/d11/f62 [0,4194304] 0 2024-08-19T00:56:17.151 INFO:tasks.workunit.client.0.smithi017.stdout:9/386: mknod d0/d33/d22/d5e/c72 0 2024-08-19T00:56:17.152 INFO:tasks.workunit.client.0.smithi017.stdout:4/419: creat d2/d21/d40/d8b/f8d x:0 0 0 2024-08-19T00:56:17.155 INFO:tasks.workunit.client.0.smithi017.stdout:4/420: dread - d2/d21/d40/d8b/f8d zero size 2024-08-19T00:56:17.156 INFO:tasks.workunit.client.0.smithi017.stdout:6/396: symlink d5/d13/d11/d2c/d4a/d64/l88 0 2024-08-19T00:56:17.157 INFO:tasks.workunit.client.0.smithi017.stdout:5/285: creat db/d19/d1f/f68 x:0 0 0 2024-08-19T00:56:17.163 INFO:tasks.workunit.client.0.smithi017.stdout:7/408: dread d3/dc/df/d23/f24 [0,4194304] 0 2024-08-19T00:56:17.164 INFO:tasks.workunit.client.0.smithi017.stdout:7/409: readlink d3/d3c/l76 0 2024-08-19T00:56:17.167 INFO:tasks.workunit.client.0.smithi017.stdout:2/470: creat d2/d7/f96 x:0 0 0 2024-08-19T00:56:17.173 INFO:tasks.workunit.client.0.smithi017.stdout:2/471: dwrite d2/d7/dd/f1c [0,4194304] 0 2024-08-19T00:56:17.185 INFO:tasks.workunit.client.0.smithi017.stdout:4/421: dwrite d2/d21/d40/f4c [0,4194304] 0 2024-08-19T00:56:17.185 INFO:tasks.workunit.client.0.smithi017.stdout:0/407: write d5/d18/f4c [475916,22123] 0 2024-08-19T00:56:17.190 INFO:tasks.workunit.client.0.smithi017.stdout:0/408: read d5/d18/d3a/f5f [473529,97712] 0 2024-08-19T00:56:17.191 INFO:tasks.workunit.client.0.smithi017.stdout:3/436: mknod d5/c82 0 2024-08-19T00:56:17.198 INFO:tasks.workunit.client.0.smithi017.stdout:6/397: unlink d5/fb 0 2024-08-19T00:56:17.198 INFO:tasks.workunit.client.0.smithi017.stdout:9/387: dwrite d0/d33/f30 [0,4194304] 0 2024-08-19T00:56:17.201 INFO:tasks.workunit.client.0.smithi017.stdout:8/299: creat de/f53 x:0 0 0 2024-08-19T00:56:17.208 INFO:tasks.workunit.client.1.smithi086.stdout:4/814: creat d2/d18/d33/d42/d72/d8f/f10d x:0 0 0 2024-08-19T00:56:17.209 INFO:tasks.workunit.client.0.smithi017.stdout:2/472: dread d2/fa [8388608,4194304] 0 2024-08-19T00:56:17.211 INFO:tasks.workunit.client.1.smithi086.stdout:6/864: creat db/d37/f10f x:0 0 0 2024-08-19T00:56:17.211 INFO:tasks.workunit.client.0.smithi017.stdout:0/409: dwrite d5/d17/d21/f2d [4194304,4194304] 0 2024-08-19T00:56:17.212 INFO:tasks.workunit.client.0.smithi017.stdout:1/323: dwrite d4/dc/d19/f41 [0,4194304] 0 2024-08-19T00:56:17.213 INFO:tasks.workunit.client.0.smithi017.stdout:7/410: dread d3/dc/df/d32/f54 [4194304,4194304] 0 2024-08-19T00:56:17.216 INFO:tasks.workunit.client.0.smithi017.stdout:6/398: mkdir d5/d13/d20/d89 0 2024-08-19T00:56:17.217 INFO:tasks.workunit.client.0.smithi017.stdout:4/422: symlink d2/d21/l8e 0 2024-08-19T00:56:17.218 INFO:tasks.workunit.client.0.smithi017.stdout:4/423: write d2/f7 [2901670,25230] 0 2024-08-19T00:56:17.221 INFO:tasks.workunit.client.1.smithi086.stdout:2/898: fdatasync d8/d43/f5a 0 2024-08-19T00:56:17.222 INFO:tasks.workunit.client.0.smithi017.stdout:9/388: symlink d0/d33/d22/d5e/l73 0 2024-08-19T00:56:17.225 INFO:tasks.workunit.client.1.smithi086.stdout:9/870: truncate db/d26/d5c/d87/d30/d31/d103/d19/d18/f25 937636 0 2024-08-19T00:56:17.228 INFO:tasks.workunit.client.1.smithi086.stdout:4/815: fdatasync d2/d18/d33/d42/d72/d2f/fc5 0 2024-08-19T00:56:17.230 INFO:tasks.workunit.client.0.smithi017.stdout:0/410: mknod d5/d18/c89 0 2024-08-19T00:56:17.231 INFO:tasks.workunit.client.0.smithi017.stdout:5/286: link db/d19/d1f/d15/d1e/f3f db/d19/d1f/d15/d3e/d40/d49/f69 0 2024-08-19T00:56:17.233 INFO:tasks.workunit.client.1.smithi086.stdout:6/865: rename db/d37/f24 to db/d37/d41/dad/f110 0 2024-08-19T00:56:17.233 INFO:tasks.workunit.client.0.smithi017.stdout:1/324: truncate d4/fd 3728740 0 2024-08-19T00:56:17.309 INFO:tasks.workunit.client.0.smithi017.stdout:7/411: mknod d3/dc/df/d1a/c7c 0 2024-08-19T00:56:17.310 INFO:tasks.workunit.client.0.smithi017.stdout:6/399: write d5/d13/f1f [4658472,84231] 0 2024-08-19T00:56:17.313 INFO:tasks.workunit.client.1.smithi086.stdout:8/837: mkdir dc/d1f/d113 0 2024-08-19T00:56:17.354 INFO:tasks.workunit.client.1.smithi086.stdout:5/856: write d0/f17 [4514551,120886] 0 2024-08-19T00:56:17.356 INFO:tasks.workunit.client.0.smithi017.stdout:3/437: link d5/da/c69 d5/da/d27/d28/c83 0 2024-08-19T00:56:17.357 INFO:tasks.workunit.client.1.smithi086.stdout:7/854: symlink d3/d34/d44/d58/d4b/da5/daf/de7/df5/d96/dfb/d10c/l11a 0 2024-08-19T00:56:17.358 INFO:tasks.workunit.client.0.smithi017.stdout:2/473: mkdir d2/d7/d10/d3b/d97 0 2024-08-19T00:56:17.359 INFO:tasks.workunit.client.1.smithi086.stdout:2/899: dread d8/d2c/d47/f58 [0,4194304] 0 2024-08-19T00:56:17.359 INFO:tasks.workunit.client.1.smithi086.stdout:0/857: getdents da/d14/d55/d10c/d2e/d39 0 2024-08-19T00:56:17.360 INFO:tasks.workunit.client.1.smithi086.stdout:0/858: dread - da/d14/d55/d10c/d2e/d7e/dd7/ffe zero size 2024-08-19T00:56:17.364 INFO:tasks.workunit.client.0.smithi017.stdout:5/287: rename db/d19/d1f/d15/c51 to db/d19/c6a 0 2024-08-19T00:56:17.366 INFO:tasks.workunit.client.0.smithi017.stdout:1/325: chown d4/dc/d19/c43 3052 1 2024-08-19T00:56:17.366 INFO:tasks.workunit.client.0.smithi017.stdout:1/326: stat d4/l39 0 2024-08-19T00:56:17.367 INFO:tasks.workunit.client.0.smithi017.stdout:1/327: chown d4/dc/d19/f44 48 1 2024-08-19T00:56:17.370 INFO:tasks.workunit.client.1.smithi086.stdout:3/861: link d3/d18/d19/d37/c103 d3/d18/d19/d10a/c11b 0 2024-08-19T00:56:17.375 INFO:tasks.workunit.client.0.smithi017.stdout:4/424: mkdir d2/d1a/d55/d8f 0 2024-08-19T00:56:17.376 INFO:tasks.workunit.client.1.smithi086.stdout:1/958: creat d4/d7/d2a/d36/d7d/f135 x:0 0 0 2024-08-19T00:56:17.378 INFO:tasks.workunit.client.0.smithi017.stdout:9/389: creat d0/d58/d49/d5d/f74 x:0 0 0 2024-08-19T00:56:17.379 INFO:tasks.workunit.client.1.smithi086.stdout:8/838: creat dc/d16/d18/d106/d28/d41/d9a/f114 x:0 0 0 2024-08-19T00:56:17.381 INFO:tasks.workunit.client.0.smithi017.stdout:7/412: dread d3/dc/df/d1c/d2c/d35/f59 [0,4194304] 0 2024-08-19T00:56:17.381 INFO:tasks.workunit.client.0.smithi017.stdout:3/438: readlink d5/d15/l73 0 2024-08-19T00:56:17.382 INFO:tasks.workunit.client.1.smithi086.stdout:5/857: rename d0/d8/d72 to d0/d8/d94/df9/d108 0 2024-08-19T00:56:17.383 INFO:tasks.workunit.client.0.smithi017.stdout:2/474: mknod d2/d7/d10/d3b/d69/c98 0 2024-08-19T00:56:17.385 INFO:tasks.workunit.client.0.smithi017.stdout:2/475: truncate d2/d7/d10/d19/d48/f82 758162 0 2024-08-19T00:56:17.387 INFO:tasks.workunit.client.1.smithi086.stdout:2/900: symlink d8/d43/dd5/l12d 0 2024-08-19T00:56:17.390 INFO:tasks.workunit.client.1.smithi086.stdout:0/859: creat da/d97/f10e x:0 0 0 2024-08-19T00:56:17.392 INFO:tasks.workunit.client.1.smithi086.stdout:0/860: chown l5 5830 1 2024-08-19T00:56:17.392 INFO:tasks.workunit.client.1.smithi086.stdout:4/816: dwrite d2/d18/d33/d42/d72/d2f/fb4 [0,4194304] 0 2024-08-19T00:56:17.392 INFO:tasks.workunit.client.1.smithi086.stdout:9/871: mkdir db/d26/d5c/d87/d30/d3f/d43/d4e/d117 0 2024-08-19T00:56:17.394 INFO:tasks.workunit.client.0.smithi017.stdout:0/411: truncate d5/d18/f66 242003 0 2024-08-19T00:56:17.395 INFO:tasks.workunit.client.0.smithi017.stdout:0/412: chown d5/d18/f56 448 1 2024-08-19T00:56:17.397 INFO:tasks.workunit.client.1.smithi086.stdout:2/901: dwrite d8/d84/f81 [4194304,4194304] 0 2024-08-19T00:56:17.397 INFO:tasks.workunit.client.1.smithi086.stdout:4/817: write d2/d18/d33/d42/d72/d78/d25/d30/f97 [1851932,116704] 0 2024-08-19T00:56:17.397 INFO:tasks.workunit.client.0.smithi017.stdout:1/328: write d4/dc/d17/d1d/f3c [1037497,48970] 0 2024-08-19T00:56:17.397 INFO:tasks.workunit.client.0.smithi017.stdout:7/413: read d3/dc/f48 [404331,34108] 0 2024-08-19T00:56:17.398 INFO:tasks.workunit.client.1.smithi086.stdout:8/839: dread dc/d16/d18/d106/d28/d2b/f109 [0,4194304] 0 2024-08-19T00:56:17.400 INFO:tasks.workunit.client.0.smithi017.stdout:6/400: write d5/f18 [1523777,55359] 0 2024-08-19T00:56:17.400 INFO:tasks.workunit.client.0.smithi017.stdout:7/414: chown d3/dc/df/d37/f66 26746 1 2024-08-19T00:56:17.400 INFO:tasks.workunit.client.1.smithi086.stdout:8/840: chown dc/d1f/d37/la3 22 1 2024-08-19T00:56:17.402 INFO:tasks.workunit.client.1.smithi086.stdout:1/959: mkdir d4/d7/d2a/d36/d50/d136 0 2024-08-19T00:56:17.402 INFO:tasks.workunit.client.1.smithi086.stdout:2/902: read d8/d2c/d47/f93 [88160,129216] 0 2024-08-19T00:56:17.403 INFO:tasks.workunit.client.0.smithi017.stdout:2/476: symlink d2/d7/d10/d3b/d69/d7a/l99 0 2024-08-19T00:56:17.406 INFO:tasks.workunit.client.1.smithi086.stdout:7/855: mkdir d3/d5b/d11b 0 2024-08-19T00:56:17.411 INFO:tasks.workunit.client.1.smithi086.stdout:6/866: truncate db/f13 3758518 0 2024-08-19T00:56:17.414 INFO:tasks.workunit.client.1.smithi086.stdout:9/872: dread db/d26/d5c/d87/d37/f48 [0,4194304] 0 2024-08-19T00:56:17.415 INFO:tasks.workunit.client.1.smithi086.stdout:2/903: mkdir d8/d14/dae/d12e 0 2024-08-19T00:56:17.416 INFO:tasks.workunit.client.1.smithi086.stdout:2/904: fsync d8/f19 0 2024-08-19T00:56:17.416 INFO:tasks.workunit.client.0.smithi017.stdout:6/401: creat d5/d13/d11/d2c/d51/f8a x:0 0 0 2024-08-19T00:56:17.418 INFO:tasks.workunit.client.0.smithi017.stdout:2/477: readlink d2/d7/d10/d35/d55/l64 0 2024-08-19T00:56:17.419 INFO:tasks.workunit.client.0.smithi017.stdout:2/478: fdatasync d2/d7/d10/d3b/d80/f8f 0 2024-08-19T00:56:17.420 INFO:tasks.workunit.client.0.smithi017.stdout:4/425: link d2/d21/d40/l5c d2/d21/d40/d84/l90 0 2024-08-19T00:56:17.421 INFO:tasks.workunit.client.0.smithi017.stdout:0/413: dread d5/f1c [0,4194304] 0 2024-08-19T00:56:17.422 INFO:tasks.workunit.client.0.smithi017.stdout:4/426: write d2/d1a/f68 [3946105,56933] 0 2024-08-19T00:56:17.423 INFO:tasks.workunit.client.0.smithi017.stdout:4/427: chown d2/d21/d40/f7f 31 1 2024-08-19T00:56:17.423 INFO:tasks.workunit.client.0.smithi017.stdout:0/414: truncate d5/d17/d26/f80 447905 0 2024-08-19T00:56:17.424 INFO:tasks.workunit.client.0.smithi017.stdout:4/428: chown d2/d16 945 1 2024-08-19T00:56:17.424 INFO:tasks.workunit.client.1.smithi086.stdout:4/818: link d2/d18/d33/d42/d72/d78/d25/fa6 d2/d18/d33/d42/d72/d78/d25/d55/d4d/f10e 0 2024-08-19T00:56:17.426 INFO:tasks.workunit.client.1.smithi086.stdout:9/873: rmdir db/d96/da7 39 2024-08-19T00:56:17.432 INFO:tasks.workunit.client.0.smithi017.stdout:3/439: write d5/d15/d1b/f20 [1620071,33031] 0 2024-08-19T00:56:17.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:17 smithi017 ceph-mon[16627]: pgmap v19: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 110 MiB/s rd, 317 MiB/s wr, 594 op/s 2024-08-19T00:56:17.433 INFO:tasks.workunit.client.1.smithi086.stdout:5/858: creat d0/df/f109 x:0 0 0 2024-08-19T00:56:17.436 INFO:tasks.workunit.client.1.smithi086.stdout:6/867: mknod db/d37/d30/c111 0 2024-08-19T00:56:17.437 INFO:tasks.workunit.client.1.smithi086.stdout:6/868: read - db/d37/d28/d7f/d96/f10d zero size 2024-08-19T00:56:17.438 INFO:tasks.workunit.client.0.smithi017.stdout:9/390: getdents d0/d58/d49 0 2024-08-19T00:56:17.439 INFO:tasks.workunit.client.1.smithi086.stdout:8/841: creat dc/d16/d18/d106/f115 x:0 0 0 2024-08-19T00:56:17.440 INFO:tasks.workunit.client.0.smithi017.stdout:0/415: symlink d5/d17/d26/d30/d3e/l8a 0 2024-08-19T00:56:17.443 INFO:tasks.workunit.client.1.smithi086.stdout:9/874: rmdir db/d26/d5c/d87/d30/d31/d103/d19/d18 39 2024-08-19T00:56:17.443 INFO:tasks.workunit.client.0.smithi017.stdout:1/329: write d4/fd [1762871,129873] 0 2024-08-19T00:56:17.445 INFO:tasks.workunit.client.0.smithi017.stdout:1/330: write d4/dc/d19/f41 [1160278,3297] 0 2024-08-19T00:56:17.445 INFO:tasks.workunit.client.0.smithi017.stdout:7/415: rename d3/dc/df/d32 to d3/dc/df/d7d 0 2024-08-19T00:56:17.446 INFO:tasks.workunit.client.1.smithi086.stdout:1/960: link d4/d1e/f54 d4/d7/d2a/d36/d63/d84/d8e/f137 0 2024-08-19T00:56:17.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:17 smithi086 ceph-mon[24511]: pgmap v19: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 110 MiB/s rd, 317 MiB/s wr, 594 op/s 2024-08-19T00:56:17.446 INFO:tasks.workunit.client.0.smithi017.stdout:7/416: readlink d3/dc/d5f/l77 0 2024-08-19T00:56:17.448 INFO:tasks.workunit.client.0.smithi017.stdout:6/402: link d5/d13/d20/f32 d5/d7b/f8b 0 2024-08-19T00:56:17.450 INFO:tasks.workunit.client.0.smithi017.stdout:2/479: creat d2/d7/d10/d3b/d97/f9a x:0 0 0 2024-08-19T00:56:17.451 INFO:tasks.workunit.client.1.smithi086.stdout:6/869: read db/d37/f21 [1122155,75387] 0 2024-08-19T00:56:17.454 INFO:tasks.workunit.client.1.smithi086.stdout:1/961: creat d4/d7/d2a/d6e/d95/f138 x:0 0 0 2024-08-19T00:56:17.455 INFO:tasks.workunit.client.1.smithi086.stdout:4/819: dread d2/d18/d33/d42/d72/d78/d25/f3a [0,4194304] 0 2024-08-19T00:56:17.455 INFO:tasks.workunit.client.1.smithi086.stdout:1/962: fdatasync d4/d7/d2a/d6e/d95/f138 0 2024-08-19T00:56:17.455 INFO:tasks.workunit.client.1.smithi086.stdout:5/859: symlink d0/l10a 0 2024-08-19T00:56:17.456 INFO:tasks.workunit.client.0.smithi017.stdout:1/331: symlink d4/dc/d3b/d45/l58 0 2024-08-19T00:56:17.456 INFO:tasks.workunit.client.1.smithi086.stdout:2/905: link d8/d24/d32/c85 d8/d24/d32/d4d/d6a/db1/dcf/c12f 0 2024-08-19T00:56:17.457 INFO:tasks.workunit.client.0.smithi017.stdout:9/391: dwrite d0/f60 [4194304,4194304] 0 2024-08-19T00:56:17.458 INFO:tasks.workunit.client.1.smithi086.stdout:8/842: mkdir dc/d1f/d37/d4f/dac/db8/d7a/d88/dcd/d116 0 2024-08-19T00:56:17.461 INFO:tasks.workunit.client.0.smithi017.stdout:6/403: mknod d5/d13/d11/d52/c8c 0 2024-08-19T00:56:17.461 INFO:tasks.workunit.client.0.smithi017.stdout:2/480: creat d2/d7/d10/d3b/d3c/f9b x:0 0 0 2024-08-19T00:56:17.463 INFO:tasks.workunit.client.1.smithi086.stdout:9/875: rename db/d26/d5c/d87/d30/d3f/d43/f5f to db/d26/d5c/d87/d30/d31/f118 0 2024-08-19T00:56:17.464 INFO:tasks.workunit.client.0.smithi017.stdout:9/392: chown d0/d33/d22/d40 671438635 1 2024-08-19T00:56:17.465 INFO:tasks.workunit.client.0.smithi017.stdout:0/416: symlink d5/l8b 0 2024-08-19T00:56:17.466 INFO:tasks.workunit.client.1.smithi086.stdout:1/963: rmdir d4/d7/d2a/d36/d61 39 2024-08-19T00:56:17.467 INFO:tasks.workunit.client.0.smithi017.stdout:2/481: truncate d2/d7/d10/f3e 1683652 0 2024-08-19T00:56:17.469 INFO:tasks.workunit.client.0.smithi017.stdout:4/429: rename d2/d1a/f3d to d2/d21/f91 0 2024-08-19T00:56:17.471 INFO:tasks.workunit.client.1.smithi086.stdout:1/964: dread d4/d10/ff9 [0,4194304] 0 2024-08-19T00:56:17.472 INFO:tasks.workunit.client.0.smithi017.stdout:1/332: dwrite d4/dc/d19/f41 [0,4194304] 0 2024-08-19T00:56:17.473 INFO:tasks.workunit.client.1.smithi086.stdout:2/906: mknod d8/d14/dae/c130 0 2024-08-19T00:56:17.475 INFO:tasks.workunit.client.1.smithi086.stdout:2/907: truncate d8/d14/fed 77717 0 2024-08-19T00:56:17.476 INFO:tasks.workunit.client.0.smithi017.stdout:6/404: dwrite d5/d13/d11/d4d/f6b [0,4194304] 0 2024-08-19T00:56:17.477 INFO:tasks.workunit.client.0.smithi017.stdout:1/333: chown d4/dc/d17/c21 0 1 2024-08-19T00:56:17.479 INFO:tasks.workunit.client.1.smithi086.stdout:6/870: rename db/d37/d28/d7f/d96/dc2/dfa to db/d34/d4e/d68/d99/d112 0 2024-08-19T00:56:17.480 INFO:tasks.workunit.client.0.smithi017.stdout:2/482: dwrite d2/d7/d10/d3b/f3f [0,4194304] 0 2024-08-19T00:56:17.494 INFO:tasks.workunit.client.1.smithi086.stdout:2/908: dread d8/d14/dae/ff5 [0,4194304] 0 2024-08-19T00:56:17.497 INFO:tasks.workunit.client.1.smithi086.stdout:8/843: rename dc/d16/d18/c80 to dc/d1f/d37/d4f/dac/c117 0 2024-08-19T00:56:17.498 INFO:tasks.workunit.client.1.smithi086.stdout:8/844: chown dc/d16/d18/d106/d28/d2b/d3b/l67 143 1 2024-08-19T00:56:17.500 INFO:tasks.workunit.client.1.smithi086.stdout:9/876: mknod db/d26/d5c/d87/d30/d31/d103/d19/d18/db9/c119 0 2024-08-19T00:56:17.501 INFO:tasks.workunit.client.0.smithi017.stdout:6/405: mknod d5/d13/d20/d5e/c8d 0 2024-08-19T00:56:17.502 INFO:tasks.workunit.client.1.smithi086.stdout:1/965: write d4/d7/d2a/d36/d63/d84/d8e/f137 [1041295,84197] 0 2024-08-19T00:56:17.503 INFO:tasks.workunit.client.0.smithi017.stdout:1/334: symlink d4/dc/d17/d1d/l59 0 2024-08-19T00:56:17.503 INFO:tasks.workunit.client.1.smithi086.stdout:5/860: link d0/d5f/c7c d0/d2d/d43/d91/c10b 0 2024-08-19T00:56:17.504 INFO:tasks.workunit.client.1.smithi086.stdout:5/861: write d0/df/d1f/fb3 [4145043,115548] 0 2024-08-19T00:56:17.505 INFO:tasks.workunit.client.0.smithi017.stdout:2/483: creat d2/d7/d10/d19/d48/f9c x:0 0 0 2024-08-19T00:56:17.505 INFO:tasks.workunit.client.1.smithi086.stdout:5/862: chown d0/df/d1f/d33/fc7 35 1 2024-08-19T00:56:17.506 INFO:tasks.workunit.client.0.smithi017.stdout:4/430: symlink d2/l92 0 2024-08-19T00:56:17.507 INFO:tasks.workunit.client.1.smithi086.stdout:4/820: link d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/c98 d2/d18/d33/d42/d72/d78/d2c/db0/c10f 0 2024-08-19T00:56:17.508 INFO:tasks.workunit.client.0.smithi017.stdout:2/484: fsync d2/d7/d10/d19/d48/f8e 0 2024-08-19T00:56:17.511 INFO:tasks.workunit.client.0.smithi017.stdout:1/335: creat d4/dc/d3b/d3d/f5a x:0 0 0 2024-08-19T00:56:17.511 INFO:tasks.workunit.client.0.smithi017.stdout:6/406: dwrite d5/d13/f3e [0,4194304] 0 2024-08-19T00:56:17.513 INFO:tasks.workunit.client.0.smithi017.stdout:7/417: rename d3/dc/df/d1c/l34 to d3/dc/l7e 0 2024-08-19T00:56:17.514 INFO:tasks.workunit.client.0.smithi017.stdout:1/336: dread - d4/dc/d3b/d45/f4d zero size 2024-08-19T00:56:17.515 INFO:tasks.workunit.client.1.smithi086.stdout:6/871: dread db/d37/d44/d5a/fbb [4194304,4194304] 0 2024-08-19T00:56:17.515 INFO:tasks.workunit.client.0.smithi017.stdout:4/431: symlink d2/d21/d53/d57/l93 0 2024-08-19T00:56:17.516 INFO:tasks.workunit.client.0.smithi017.stdout:0/417: dwrite d5/d18/d3a/f70 [4194304,4194304] 0 2024-08-19T00:56:17.517 INFO:tasks.workunit.client.0.smithi017.stdout:4/432: write d2/f78 [515954,48308] 0 2024-08-19T00:56:17.520 INFO:tasks.workunit.client.0.smithi017.stdout:7/418: chown d3/dc/l67 29 1 2024-08-19T00:56:17.521 INFO:tasks.workunit.client.1.smithi086.stdout:4/821: symlink d2/d18/d33/d42/d72/d78/l110 0 2024-08-19T00:56:17.522 INFO:tasks.workunit.client.0.smithi017.stdout:1/337: creat d4/dc/d17/d1d/f5b x:0 0 0 2024-08-19T00:56:17.524 INFO:tasks.workunit.client.0.smithi017.stdout:0/418: chown d5/d17/d26/d30/d3e/l7f 0 1 2024-08-19T00:56:17.525 INFO:tasks.workunit.client.1.smithi086.stdout:9/877: symlink db/d26/d5c/d87/l11a 0 2024-08-19T00:56:17.526 INFO:tasks.workunit.client.0.smithi017.stdout:0/419: write d5/d17/d21/d42/f87 [643303,121098] 0 2024-08-19T00:56:17.528 INFO:tasks.workunit.client.1.smithi086.stdout:6/872: unlink db/d37/f20 0 2024-08-19T00:56:17.529 INFO:tasks.workunit.client.1.smithi086.stdout:6/873: dread - db/d37/d28/d7f/d96/dc2/ff7 zero size 2024-08-19T00:56:17.531 INFO:tasks.workunit.client.0.smithi017.stdout:0/420: dread d5/d17/d21/f2d [4194304,4194304] 0 2024-08-19T00:56:17.531 INFO:tasks.workunit.client.1.smithi086.stdout:9/878: dwrite db/d26/d5c/d87/d30/d31/d103/d19/d18/fad [0,4194304] 0 2024-08-19T00:56:17.531 INFO:tasks.workunit.client.0.smithi017.stdout:0/421: chown d5/d17/d26/d30/f63 1587076721 1 2024-08-19T00:56:17.534 INFO:tasks.workunit.client.1.smithi086.stdout:2/909: creat d8/d43/d65/f131 x:0 0 0 2024-08-19T00:56:17.535 INFO:tasks.workunit.client.1.smithi086.stdout:2/910: fsync d8/f19 0 2024-08-19T00:56:17.535 INFO:tasks.workunit.client.0.smithi017.stdout:1/338: mknod d4/dc/d3b/d45/c5c 0 2024-08-19T00:56:17.537 INFO:tasks.workunit.client.1.smithi086.stdout:5/863: write d0/d8/d94/df9/d108/f8a [1463332,10908] 0 2024-08-19T00:56:17.539 INFO:tasks.workunit.client.1.smithi086.stdout:8/845: link dc/d1f/d37/d4f/dac/db8/d7a/d9b/f3d dc/d16/d18/f118 0 2024-08-19T00:56:17.541 INFO:tasks.workunit.client.1.smithi086.stdout:2/911: dwrite d8/d2c/d38/fd9 [0,4194304] 0 2024-08-19T00:56:17.543 INFO:tasks.workunit.client.0.smithi017.stdout:2/485: getdents d2/d7/d10/d3b/d69/d7a 0 2024-08-19T00:56:17.544 INFO:tasks.workunit.client.1.smithi086.stdout:6/874: rename db/d37/d30/f72 to db/d34/d4e/d68/d89/f113 0 2024-08-19T00:56:17.546 INFO:tasks.workunit.client.1.smithi086.stdout:9/879: symlink db/d26/d5c/d87/d30/d58/l11b 0 2024-08-19T00:56:17.547 INFO:tasks.workunit.client.0.smithi017.stdout:2/486: dread d2/d7/d29/f5d [0,4194304] 0 2024-08-19T00:56:17.548 INFO:tasks.workunit.client.1.smithi086.stdout:8/846: dwrite dc/d1f/d37/d9f/fc2 [4194304,4194304] 0 2024-08-19T00:56:17.548 INFO:tasks.workunit.client.0.smithi017.stdout:0/422: rename d5/d18/d3a/f70 to d5/d17/d26/d30/d3e/d81/f8c 0 2024-08-19T00:56:17.554 INFO:tasks.workunit.client.0.smithi017.stdout:6/407: getdents d5/d13/d11 0 2024-08-19T00:56:17.555 INFO:tasks.workunit.client.0.smithi017.stdout:6/408: readlink d5/d13/d20/l5d 0 2024-08-19T00:56:17.556 INFO:tasks.workunit.client.0.smithi017.stdout:6/409: chown d5/d13/d11/d2c 9055 1 2024-08-19T00:56:17.559 INFO:tasks.workunit.client.0.smithi017.stdout:1/339: symlink d4/d1c/l5d 0 2024-08-19T00:56:17.561 INFO:tasks.workunit.client.1.smithi086.stdout:4/822: dread d2/d18/d33/d42/d72/f37 [0,4194304] 0 2024-08-19T00:56:17.563 INFO:tasks.workunit.client.0.smithi017.stdout:2/487: creat d2/d7/d10/d3b/d3c/d8a/d6b/f9d x:0 0 0 2024-08-19T00:56:17.563 INFO:tasks.workunit.client.1.smithi086.stdout:6/875: dwrite db/d34/d4e/db4/fde [0,4194304] 0 2024-08-19T00:56:17.564 INFO:tasks.workunit.client.0.smithi017.stdout:0/423: symlink d5/d17/d26/d30/d3e/d81/l8d 0 2024-08-19T00:56:17.564 INFO:tasks.workunit.client.1.smithi086.stdout:4/823: chown d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/fd3 3 1 2024-08-19T00:56:17.565 INFO:tasks.workunit.client.1.smithi086.stdout:2/912: symlink d8/l132 0 2024-08-19T00:56:17.566 INFO:tasks.workunit.client.1.smithi086.stdout:4/824: write d2/d18/d33/d42/d72/d78/d2c/db0/fc2 [1485997,80377] 0 2024-08-19T00:56:17.566 INFO:tasks.workunit.client.0.smithi017.stdout:4/433: getdents d2/d1a/d55/d73 0 2024-08-19T00:56:17.568 INFO:tasks.workunit.client.0.smithi017.stdout:7/419: write d3/dc/df/d1a/f4a [465032,3371] 0 2024-08-19T00:56:17.570 INFO:tasks.workunit.client.0.smithi017.stdout:6/410: creat d5/d13/d20/f8e x:0 0 0 2024-08-19T00:56:17.572 INFO:tasks.workunit.client.0.smithi017.stdout:1/340: rename d4/dc/d3b/d3d/c51 to d4/dc/d17/d1d/c5e 0 2024-08-19T00:56:17.574 INFO:tasks.workunit.client.1.smithi086.stdout:8/847: unlink dc/d16/dc7/f91 0 2024-08-19T00:56:17.576 INFO:tasks.workunit.client.0.smithi017.stdout:1/341: dread - d4/dc/d3b/d45/f4d zero size 2024-08-19T00:56:17.577 INFO:tasks.workunit.client.1.smithi086.stdout:5/864: creat d0/d2d/d43/f10c x:0 0 0 2024-08-19T00:56:17.578 INFO:tasks.workunit.client.0.smithi017.stdout:0/424: dwrite d5/d17/f69 [0,4194304] 0 2024-08-19T00:56:17.578 INFO:tasks.workunit.client.1.smithi086.stdout:1/966: write d4/d7/d2a/d36/d61/f101 [3644136,8197] 0 2024-08-19T00:56:17.578 INFO:tasks.workunit.client.1.smithi086.stdout:5/865: chown d0/d5f/d60/d57/d80/da3/lb5 63009 1 2024-08-19T00:56:17.579 INFO:tasks.workunit.client.0.smithi017.stdout:2/488: dwrite d2/d7/d10/d35/d7e/f90 [0,4194304] 0 2024-08-19T00:56:17.579 INFO:tasks.workunit.client.1.smithi086.stdout:5/866: write d0/d2d/d43/f10c [64866,5862] 0 2024-08-19T00:56:17.585 INFO:tasks.workunit.client.1.smithi086.stdout:4/825: creat d2/d18/d33/d42/d72/d2f/f111 x:0 0 0 2024-08-19T00:56:17.587 INFO:tasks.workunit.client.0.smithi017.stdout:6/411: mkdir d5/d13/d20/d5e/d8f 0 2024-08-19T00:56:17.589 INFO:tasks.workunit.client.0.smithi017.stdout:2/489: dwrite d2/d7/d10/d3b/d69/f7f [0,4194304] 0 2024-08-19T00:56:17.591 INFO:tasks.workunit.client.0.smithi017.stdout:4/434: creat d2/d1a/d55/d64/f94 x:0 0 0 2024-08-19T00:56:17.592 INFO:tasks.workunit.client.0.smithi017.stdout:6/412: write d5/d13/d20/f3c [1975543,106100] 0 2024-08-19T00:56:17.594 INFO:tasks.workunit.client.0.smithi017.stdout:6/413: stat d5/d13/c25 0 2024-08-19T00:56:17.594 INFO:tasks.workunit.client.0.smithi017.stdout:0/425: write d5/f10 [4064262,99602] 0 2024-08-19T00:56:17.595 INFO:tasks.workunit.client.1.smithi086.stdout:9/880: dwrite db/d26/d5c/d87/d37/fa4 [0,4194304] 0 2024-08-19T00:56:17.596 INFO:tasks.workunit.client.0.smithi017.stdout:1/342: mknod d4/dc/d3b/d45/c5f 0 2024-08-19T00:56:17.600 INFO:tasks.workunit.client.1.smithi086.stdout:1/967: dwrite d4/f5c [4194304,4194304] 0 2024-08-19T00:56:17.607 INFO:tasks.workunit.client.0.smithi017.stdout:4/435: dwrite d2/d11/f72 [0,4194304] 0 2024-08-19T00:56:17.610 INFO:tasks.workunit.client.0.smithi017.stdout:4/436: write d2/d21/d53/f74 [772292,39464] 0 2024-08-19T00:56:17.614 INFO:tasks.workunit.client.0.smithi017.stdout:1/343: dwrite d4/dc/d17/d1d/f5b [0,4194304] 0 2024-08-19T00:56:17.654 INFO:tasks.workunit.client.1.smithi086.stdout:3/862: sync 2024-08-19T00:56:17.655 INFO:tasks.workunit.client.1.smithi086.stdout:3/863: dread - d3/d18/d1a/d51/dad/dee/ff2 zero size 2024-08-19T00:56:17.683 INFO:tasks.workunit.client.1.smithi086.stdout:2/913: write d8/d2c/d67/f6f [312702,129510] 0 2024-08-19T00:56:17.689 INFO:tasks.workunit.client.0.smithi017.stdout:7/420: dwrite d3/dc/df/d23/f24 [0,4194304] 0 2024-08-19T00:56:17.690 INFO:tasks.workunit.client.0.smithi017.stdout:0/426: creat d5/d17/d26/d30/d3e/d81/f8e x:0 0 0 2024-08-19T00:56:17.691 INFO:tasks.workunit.client.1.smithi086.stdout:2/914: mkdir d8/d2c/d38/d80/d133 0 2024-08-19T00:56:17.695 INFO:tasks.workunit.client.1.smithi086.stdout:8/848: dwrite dc/d1f/d37/d4f/dac/db8/d7a/d9b/f3d [8388608,4194304] 0 2024-08-19T00:56:17.697 INFO:tasks.workunit.client.0.smithi017.stdout:0/427: dwrite d5/d17/d21/d42/f87 [0,4194304] 0 2024-08-19T00:56:17.699 INFO:tasks.workunit.client.0.smithi017.stdout:0/428: read d5/d18/f4c [953280,47468] 0 2024-08-19T00:56:17.704 INFO:tasks.workunit.client.0.smithi017.stdout:4/437: mkdir d2/d21/d40/d56/d95 0 2024-08-19T00:56:17.711 INFO:tasks.workunit.client.0.smithi017.stdout:6/414: mkdir d5/d13/d11/d2c/d4a/d64/d86/d90 0 2024-08-19T00:56:17.713 INFO:tasks.workunit.client.1.smithi086.stdout:8/849: mknod dc/d17/d1e/d55/dbb/c119 0 2024-08-19T00:56:17.713 INFO:tasks.workunit.client.0.smithi017.stdout:6/415: write d5/d13/d11/d2c/d51/d7e/f83 [788380,49009] 0 2024-08-19T00:56:17.714 INFO:tasks.workunit.client.1.smithi086.stdout:8/850: stat dc/d1f/d37/d4f/dac/db8/d7a/d88/db2 0 2024-08-19T00:56:17.715 INFO:tasks.workunit.client.0.smithi017.stdout:6/416: write d5/d13/d20/d5e/f6c [891253,76480] 0 2024-08-19T00:56:17.721 INFO:tasks.workunit.client.0.smithi017.stdout:7/421: dwrite d3/dc/df/d7d/f54 [4194304,4194304] 0 2024-08-19T00:56:17.726 INFO:tasks.workunit.client.1.smithi086.stdout:8/851: getdents dc/d16/d18/d106/d28/d41/d9a/d107 0 2024-08-19T00:56:17.729 INFO:tasks.workunit.client.0.smithi017.stdout:4/438: creat d2/d21/d53/d5a/f96 x:0 0 0 2024-08-19T00:56:17.730 INFO:tasks.workunit.client.0.smithi017.stdout:6/417: mknod d5/d13/d11/d2c/c91 0 2024-08-19T00:56:17.732 INFO:tasks.workunit.client.1.smithi086.stdout:8/852: dwrite dc/d1f/d37/d4f/dac/db8/d7a/f10a [0,4194304] 0 2024-08-19T00:56:17.735 INFO:tasks.workunit.client.1.smithi086.stdout:0/861: sync 2024-08-19T00:56:17.735 INFO:tasks.workunit.client.1.smithi086.stdout:7/856: sync 2024-08-19T00:56:17.739 INFO:tasks.workunit.client.0.smithi017.stdout:1/344: creat d4/f60 x:0 0 0 2024-08-19T00:56:17.743 INFO:tasks.workunit.client.0.smithi017.stdout:6/418: creat d5/d13/d11/d2c/f92 x:0 0 0 2024-08-19T00:56:17.746 INFO:tasks.workunit.client.0.smithi017.stdout:0/429: creat d5/d17/d45/f8f x:0 0 0 2024-08-19T00:56:17.747 INFO:tasks.workunit.client.1.smithi086.stdout:7/857: creat d3/de/d112/f11c x:0 0 0 2024-08-19T00:56:17.751 INFO:tasks.workunit.client.1.smithi086.stdout:8/853: rmdir dc/d16/d18/d106/d28/d41/d9a/d107 0 2024-08-19T00:56:17.753 INFO:tasks.workunit.client.1.smithi086.stdout:7/858: unlink d3/de/d68/d72/ldd 0 2024-08-19T00:56:17.754 INFO:tasks.workunit.client.0.smithi017.stdout:1/345: mknod d4/dc/c61 0 2024-08-19T00:56:17.755 INFO:tasks.workunit.client.1.smithi086.stdout:8/854: rmdir dc/d1f/d37/d4f/dac/db8/d8f 39 2024-08-19T00:56:17.758 INFO:tasks.workunit.client.0.smithi017.stdout:1/346: mkdir d4/dc/d3b/d55/d62 0 2024-08-19T00:56:17.760 INFO:tasks.workunit.client.0.smithi017.stdout:1/347: unlink d4/d1c/c27 0 2024-08-19T00:56:17.761 INFO:tasks.workunit.client.1.smithi086.stdout:8/855: dwrite dc/d1f/d37/d4f/dac/db8/d8f/fc1 [0,4194304] 0 2024-08-19T00:56:17.764 INFO:tasks.workunit.client.1.smithi086.stdout:8/856: truncate dc/d17/d1e/d55/dbb/dd0/ff9 639852 0 2024-08-19T00:56:17.768 INFO:tasks.workunit.client.1.smithi086.stdout:8/857: unlink dc/d16/d18/d106/d28/d41/ld9 0 2024-08-19T00:56:17.769 INFO:tasks.workunit.client.1.smithi086.stdout:8/858: chown dc/d16/d18/d106/f3f 6 1 2024-08-19T00:56:17.777 INFO:tasks.workunit.client.0.smithi017.stdout:4/439: rename d2/d11/f36 to d2/d16/d70/f97 0 2024-08-19T00:56:17.788 INFO:tasks.workunit.client.1.smithi086.stdout:8/859: dread dc/d16/d18/d106/d28/d41/f59 [4194304,4194304] 0 2024-08-19T00:56:17.802 INFO:tasks.workunit.client.1.smithi086.stdout:1/968: dwrite d4/d7/d2a/f2b [0,4194304] 0 2024-08-19T00:56:17.803 INFO:tasks.workunit.client.1.smithi086.stdout:1/969: chown d4/d7/d2a/d36/d63/d9f/cdb 0 1 2024-08-19T00:56:17.804 INFO:tasks.workunit.client.1.smithi086.stdout:3/864: truncate d3/d26/f7e 2197623 0 2024-08-19T00:56:17.805 INFO:tasks.workunit.client.1.smithi086.stdout:3/865: fsync d3/d26/d2b/f6d 0 2024-08-19T00:56:17.809 INFO:tasks.workunit.client.1.smithi086.stdout:9/881: rename db/d26/d5c/d87/d30/d31/d103/de2/dee/def/ffc to db/d26/d5c/d87/f11c 0 2024-08-19T00:56:17.811 INFO:tasks.workunit.client.1.smithi086.stdout:1/970: dwrite d4/d7/d2a/d36/d63/d84/fdd [0,4194304] 0 2024-08-19T00:56:17.814 INFO:tasks.workunit.client.1.smithi086.stdout:9/882: mknod db/d26/d5c/d87/d6d/dbf/c11d 0 2024-08-19T00:56:17.818 INFO:tasks.workunit.client.1.smithi086.stdout:2/915: dwrite d8/d84/fcb [0,4194304] 0 2024-08-19T00:56:17.820 INFO:tasks.workunit.client.0.smithi017.stdout:6/419: mkdir d5/d13/d11/d93 0 2024-08-19T00:56:17.822 INFO:tasks.workunit.client.1.smithi086.stdout:1/971: dwrite d4/f5c [8388608,4194304] 0 2024-08-19T00:56:17.825 INFO:tasks.workunit.client.0.smithi017.stdout:1/348: getdents d4 0 2024-08-19T00:56:17.826 INFO:tasks.workunit.client.0.smithi017.stdout:7/422: dwrite d3/dc/df/d1c/f55 [0,4194304] 0 2024-08-19T00:56:17.826 INFO:tasks.workunit.client.1.smithi086.stdout:2/916: dwrite d8/d24/d32/d61/fc7 [0,4194304] 0 2024-08-19T00:56:17.831 INFO:tasks.workunit.client.1.smithi086.stdout:1/972: mknod d4/d7/d2a/d36/d50/d116/d12c/c139 0 2024-08-19T00:56:17.831 INFO:tasks.workunit.client.0.smithi017.stdout:7/423: truncate d3/dc/df/d1c/f27 1401560 0 2024-08-19T00:56:17.832 INFO:tasks.workunit.client.0.smithi017.stdout:7/424: readlink d3/dc/d5f/l77 0 2024-08-19T00:56:17.833 INFO:tasks.workunit.client.1.smithi086.stdout:2/917: mknod d8/d2c/d38/d80/d133/c134 0 2024-08-19T00:56:17.834 INFO:tasks.workunit.client.1.smithi086.stdout:0/862: dwrite da/d14/d44/d7b/fb5 [0,4194304] 0 2024-08-19T00:56:17.838 INFO:tasks.workunit.client.0.smithi017.stdout:7/425: write d3/dc/df/d1c/f68 [640672,92846] 0 2024-08-19T00:56:17.839 INFO:tasks.workunit.client.1.smithi086.stdout:1/973: unlink d4/d7/d2a/d36/d63/d84/d8e/lba 0 2024-08-19T00:56:17.841 INFO:tasks.workunit.client.1.smithi086.stdout:4/826: sync 2024-08-19T00:56:17.841 INFO:tasks.workunit.client.1.smithi086.stdout:5/867: sync 2024-08-19T00:56:17.841 INFO:tasks.workunit.client.1.smithi086.stdout:6/876: sync 2024-08-19T00:56:17.843 INFO:tasks.workunit.client.1.smithi086.stdout:2/918: fdatasync d8/f60 0 2024-08-19T00:56:17.846 INFO:tasks.workunit.client.1.smithi086.stdout:5/868: truncate d0/df/d1f/fd5 156623 0 2024-08-19T00:56:17.846 INFO:tasks.workunit.client.1.smithi086.stdout:6/877: chown db/d37/d41/da7/f65 7872768 1 2024-08-19T00:56:17.847 INFO:tasks.workunit.client.1.smithi086.stdout:0/863: mknod da/d14/d55/d10c/d2e/d39/d3b/d89/dc5/c10f 0 2024-08-19T00:56:17.848 INFO:tasks.workunit.client.1.smithi086.stdout:1/974: truncate d4/d7/d2a/d36/d3a/fa4 1130351 0 2024-08-19T00:56:17.849 INFO:tasks.workunit.client.1.smithi086.stdout:2/919: stat d8/d2c/c44 0 2024-08-19T00:56:17.850 INFO:tasks.workunit.client.1.smithi086.stdout:4/827: fsync d2/d18/d33/d42/d72/ff 0 2024-08-19T00:56:17.851 INFO:tasks.workunit.client.1.smithi086.stdout:5/869: unlink d0/d99/dc0/dc2/c75 0 2024-08-19T00:56:17.852 INFO:tasks.workunit.client.1.smithi086.stdout:6/878: creat db/d34/d4e/d68/d99/dce/f114 x:0 0 0 2024-08-19T00:56:17.853 INFO:tasks.workunit.client.1.smithi086.stdout:0/864: rmdir da/d14/d55/d10c/d2e/d7e/dd7 39 2024-08-19T00:56:17.855 INFO:tasks.workunit.client.1.smithi086.stdout:1/975: symlink d4/d7/d2a/d36/d50/d9c/ded/d11c/l13a 0 2024-08-19T00:56:17.856 INFO:tasks.workunit.client.1.smithi086.stdout:4/828: mknod d2/d18/d33/d42/d72/d78/d2c/c112 0 2024-08-19T00:56:17.863 INFO:tasks.workunit.client.1.smithi086.stdout:4/829: read d2/d18/d33/d42/d72/d78/d25/d30/d5d/f10a [760633,86338] 0 2024-08-19T00:56:17.864 INFO:tasks.workunit.client.1.smithi086.stdout:1/976: getdents d4/d7/d125 0 2024-08-19T00:56:17.865 INFO:tasks.workunit.client.1.smithi086.stdout:7/859: sync 2024-08-19T00:56:17.866 INFO:tasks.workunit.client.0.smithi017.stdout:0/430: rename d5/d18/f4c to d5/d17/d26/d30/d3e/f90 0 2024-08-19T00:56:17.866 INFO:tasks.workunit.client.0.smithi017.stdout:8/300: sync 2024-08-19T00:56:17.867 INFO:tasks.workunit.client.1.smithi086.stdout:6/879: dread f3 [0,4194304] 0 2024-08-19T00:56:17.867 INFO:tasks.workunit.client.0.smithi017.stdout:4/440: dwrite d2/d21/f91 [0,4194304] 0 2024-08-19T00:56:17.867 INFO:tasks.workunit.client.1.smithi086.stdout:4/830: mknod d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/d85/c113 0 2024-08-19T00:56:17.868 INFO:tasks.workunit.client.0.smithi017.stdout:4/441: chown d2/c5 18 1 2024-08-19T00:56:17.868 INFO:tasks.workunit.client.1.smithi086.stdout:7/860: dread - d3/d34/d44/d58/d4b/da5/daf/de7/df5/fbe zero size 2024-08-19T00:56:17.869 INFO:tasks.workunit.client.0.smithi017.stdout:4/442: stat d2/d27 0 2024-08-19T00:56:17.870 INFO:tasks.workunit.client.1.smithi086.stdout:8/860: dwrite dc/d16/d18/d106/d28/d41/f59 [0,4194304] 0 2024-08-19T00:56:17.871 INFO:tasks.workunit.client.0.smithi017.stdout:8/301: rmdir de 39 2024-08-19T00:56:17.873 INFO:tasks.workunit.client.1.smithi086.stdout:5/870: creat d0/d2d/f10d x:0 0 0 2024-08-19T00:56:17.881 INFO:tasks.workunit.client.1.smithi086.stdout:7/861: creat d3/de/d68/d72/f11d x:0 0 0 2024-08-19T00:56:17.882 INFO:tasks.workunit.client.1.smithi086.stdout:1/977: dread d4/d7/d2a/d36/d3a/d41/f4b [4194304,4194304] 0 2024-08-19T00:56:17.884 INFO:tasks.workunit.client.0.smithi017.stdout:8/302: dwrite de/d15/f45 [0,4194304] 0 2024-08-19T00:56:17.888 INFO:tasks.workunit.client.1.smithi086.stdout:5/871: symlink d0/d99/dc0/l10e 0 2024-08-19T00:56:17.889 INFO:tasks.workunit.client.0.smithi017.stdout:1/349: rename d4/dc/l3f to d4/d1c/l63 0 2024-08-19T00:56:17.889 INFO:tasks.workunit.client.0.smithi017.stdout:7/426: rename d3/dc/df/d1c to d3/dc/df/d1c/d2c/d35/d7f 22 2024-08-19T00:56:17.891 INFO:tasks.workunit.client.1.smithi086.stdout:4/831: mkdir d2/d18/d33/d114 0 2024-08-19T00:56:17.891 INFO:tasks.workunit.client.0.smithi017.stdout:2/490: link d2/d7/d10/l1b d2/d7/d10/l9e 0 2024-08-19T00:56:17.893 INFO:tasks.workunit.client.1.smithi086.stdout:3/866: dwrite d3/d18/fe4 [0,4194304] 0 2024-08-19T00:56:17.898 INFO:tasks.workunit.client.1.smithi086.stdout:1/978: rename d4/d7/d2a/d36/d3a/f91 to d4/d7/d2a/d36/d50/d9c/ded/d11c/f13b 0 2024-08-19T00:56:17.900 INFO:tasks.workunit.client.0.smithi017.stdout:7/427: unlink d3/dc/df/d1a/c29 0 2024-08-19T00:56:17.901 INFO:tasks.workunit.client.1.smithi086.stdout:9/883: dwrite db/d26/d5c/d87/d30/d31/d103/de2/dee/fb6 [0,4194304] 0 2024-08-19T00:56:17.905 INFO:tasks.workunit.client.1.smithi086.stdout:5/872: fdatasync d0/d5f/f6f 0 2024-08-19T00:56:17.906 INFO:tasks.workunit.client.1.smithi086.stdout:3/867: rmdir d3/d18/d1a/d51 39 2024-08-19T00:56:17.907 INFO:tasks.workunit.client.0.smithi017.stdout:6/420: readlink d5/d13/d11/d2c/d4a/l6d 0 2024-08-19T00:56:17.907 INFO:tasks.workunit.client.1.smithi086.stdout:5/873: write d0/d2d/d43/d91/fbd [1631730,98482] 0 2024-08-19T00:56:17.908 INFO:tasks.workunit.client.1.smithi086.stdout:7/862: fdatasync d3/d5b/fb1 0 2024-08-19T00:56:17.909 INFO:tasks.workunit.client.0.smithi017.stdout:7/428: dwrite d3/f5 [4194304,4194304] 0 2024-08-19T00:56:17.910 INFO:tasks.workunit.client.0.smithi017.stdout:7/429: readlink d3/lb 0 2024-08-19T00:56:17.912 INFO:tasks.workunit.client.0.smithi017.stdout:7/430: truncate d3/dc/df/d1c/f55 4999614 0 2024-08-19T00:56:17.912 INFO:tasks.workunit.client.0.smithi017.stdout:7/431: chown d3/dc/df/d1a 8702 1 2024-08-19T00:56:17.914 INFO:tasks.workunit.client.1.smithi086.stdout:7/863: read d3/d34/d44/d58/d4b/da5/daf/de7/df5/f8e [1988943,48035] 0 2024-08-19T00:56:17.918 INFO:tasks.workunit.client.1.smithi086.stdout:9/884: symlink db/d96/de1/l11e 0 2024-08-19T00:56:17.919 INFO:tasks.workunit.client.0.smithi017.stdout:8/303: creat de/f54 x:0 0 0 2024-08-19T00:56:17.920 INFO:tasks.workunit.client.0.smithi017.stdout:8/304: chown de/d15/d39/d3d/c50 1881 1 2024-08-19T00:56:17.922 INFO:tasks.workunit.client.1.smithi086.stdout:0/865: write da/d14/d55/d10c/d2e/f35 [4050859,31935] 0 2024-08-19T00:56:17.923 INFO:tasks.workunit.client.0.smithi017.stdout:7/432: mkdir d3/dc/df/d37/d46/d73/d80 0 2024-08-19T00:56:17.923 INFO:tasks.workunit.client.1.smithi086.stdout:2/920: write d8/d14/f75 [1147558,121789] 0 2024-08-19T00:56:17.924 INFO:tasks.workunit.client.1.smithi086.stdout:9/885: dwrite db/d26/f93 [0,4194304] 0 2024-08-19T00:56:17.925 INFO:tasks.workunit.client.0.smithi017.stdout:6/421: getdents d5/d13/d11/d93 0 2024-08-19T00:56:17.925 INFO:tasks.workunit.client.1.smithi086.stdout:9/886: chown db/d96/d102 976030 1 2024-08-19T00:56:17.927 INFO:tasks.workunit.client.1.smithi086.stdout:5/874: read d0/d5f/d60/d57/f92 [629269,126782] 0 2024-08-19T00:56:17.929 INFO:tasks.workunit.client.0.smithi017.stdout:8/305: dread de/d15/f3b [0,4194304] 0 2024-08-19T00:56:17.931 INFO:tasks.workunit.client.0.smithi017.stdout:8/306: fdatasync de/d15/f1e 0 2024-08-19T00:56:17.935 INFO:tasks.workunit.client.0.smithi017.stdout:7/433: fsync d3/dc/f52 0 2024-08-19T00:56:17.936 INFO:tasks.workunit.client.1.smithi086.stdout:3/868: getdents d3/d18/d27/d106 0 2024-08-19T00:56:17.938 INFO:tasks.workunit.client.0.smithi017.stdout:0/431: truncate d5/d17/f57 2742008 0 2024-08-19T00:56:17.939 INFO:tasks.workunit.client.1.smithi086.stdout:6/880: dwrite db/d37/d41/da7/f65 [0,4194304] 0 2024-08-19T00:56:17.939 INFO:tasks.workunit.client.0.smithi017.stdout:0/432: readlink d5/d17/l2e 0 2024-08-19T00:56:17.940 INFO:tasks.workunit.client.1.smithi086.stdout:8/861: write dc/d1f/d37/d4f/dac/db8/d8f/faf [292250,34508] 0 2024-08-19T00:56:17.940 INFO:tasks.workunit.client.0.smithi017.stdout:0/433: fdatasync d5/d17/d45/f72 0 2024-08-19T00:56:17.946 INFO:tasks.workunit.client.1.smithi086.stdout:9/887: mkdir db/d26/d5c/d87/d30/d31/d103/d19/d18/d11f 0 2024-08-19T00:56:17.947 INFO:tasks.workunit.client.0.smithi017.stdout:8/307: dread de/f12 [4194304,4194304] 0 2024-08-19T00:56:17.950 INFO:tasks.workunit.client.0.smithi017.stdout:6/422: link d5/d13/d20/f48 d5/d13/d11/d52/f94 0 2024-08-19T00:56:17.951 INFO:tasks.workunit.client.1.smithi086.stdout:2/921: dread d8/d24/d32/d4d/d6a/fb2 [0,4194304] 0 2024-08-19T00:56:17.952 INFO:tasks.workunit.client.1.smithi086.stdout:5/875: creat d0/d2d/dce/f10f x:0 0 0 2024-08-19T00:56:17.957 INFO:tasks.workunit.client.1.smithi086.stdout:7/864: mknod d3/da1/d108/d10d/c11e 0 2024-08-19T00:56:17.957 INFO:tasks.workunit.client.0.smithi017.stdout:1/350: truncate d4/d1c/f32 408830 0 2024-08-19T00:56:17.958 INFO:tasks.workunit.client.1.smithi086.stdout:7/865: dread - d3/d34/d44/d58/d4b/dcd/ffd zero size 2024-08-19T00:56:17.960 INFO:tasks.workunit.client.1.smithi086.stdout:1/979: write d4/d7/d2a/d36/d7d/d88/f87 [301457,70882] 0 2024-08-19T00:56:17.962 INFO:tasks.workunit.client.1.smithi086.stdout:0/866: creat da/d14/d55/d10c/d2e/d39/dc3/f110 x:0 0 0 2024-08-19T00:56:17.963 INFO:tasks.workunit.client.1.smithi086.stdout:8/862: dread dc/d16/d18/f8c [0,4194304] 0 2024-08-19T00:56:17.964 INFO:tasks.workunit.client.0.smithi017.stdout:0/434: link d5/d17/d26/d30/d3e/d81/f8e d5/d17/d26/d30/d3e/f91 0 2024-08-19T00:56:17.964 INFO:tasks.workunit.client.0.smithi017.stdout:6/423: dread d5/d13/d11/d4d/f6b [0,4194304] 0 2024-08-19T00:56:17.965 INFO:tasks.workunit.client.1.smithi086.stdout:3/869: write d3/d18/d19/d37/ff0 [343403,23659] 0 2024-08-19T00:56:17.965 INFO:tasks.workunit.client.1.smithi086.stdout:8/863: read dc/d17/d1e/d49/ff6 [3522069,122303] 0 2024-08-19T00:56:17.966 INFO:tasks.workunit.client.1.smithi086.stdout:3/870: write d3/d18/d19/dbc/f65 [605439,61635] 0 2024-08-19T00:56:17.967 INFO:tasks.workunit.client.1.smithi086.stdout:6/881: mknod db/d34/d69/c115 0 2024-08-19T00:56:17.967 INFO:tasks.workunit.client.1.smithi086.stdout:3/871: chown d3/d26/d2b/fb1 0 1 2024-08-19T00:56:17.968 INFO:tasks.workunit.client.1.smithi086.stdout:6/882: write db/d37/df3/ff9 [640358,11059] 0 2024-08-19T00:56:17.969 INFO:tasks.workunit.client.0.smithi017.stdout:1/351: rmdir d4/dc 39 2024-08-19T00:56:17.969 INFO:tasks.workunit.client.1.smithi086.stdout:3/872: truncate d3/d18/d27/d49/d3f/d5b/d8f/f107 732418 0 2024-08-19T00:56:17.971 INFO:tasks.workunit.client.1.smithi086.stdout:2/922: unlink d8/d24/l4c 0 2024-08-19T00:56:17.973 INFO:tasks.workunit.client.1.smithi086.stdout:5/876: creat d0/d99/dc0/f110 x:0 0 0 2024-08-19T00:56:17.974 INFO:tasks.workunit.client.0.smithi017.stdout:0/435: rmdir d5/d18/d78 39 2024-08-19T00:56:17.976 INFO:tasks.workunit.client.1.smithi086.stdout:7/866: read d3/f38 [772596,89681] 0 2024-08-19T00:56:17.977 INFO:tasks.workunit.client.1.smithi086.stdout:7/867: write d3/d34/ffe [978396,113734] 0 2024-08-19T00:56:17.979 INFO:tasks.workunit.client.0.smithi017.stdout:7/434: unlink d3/dc/df/d1c/f27 0 2024-08-19T00:56:17.981 INFO:tasks.workunit.client.1.smithi086.stdout:1/980: unlink d4/d1e/d6f/f97 0 2024-08-19T00:56:17.983 INFO:tasks.workunit.client.0.smithi017.stdout:6/424: dwrite d5/d13/d11/f37 [0,4194304] 0 2024-08-19T00:56:17.983 INFO:tasks.workunit.client.0.smithi017.stdout:6/425: read d5/d13/f3e [3598198,16412] 0 2024-08-19T00:56:17.995 INFO:tasks.workunit.client.0.smithi017.stdout:7/435: fsync d3/dc/df/d1c/d2c/d2f/f56 0 2024-08-19T00:56:17.997 INFO:tasks.workunit.client.1.smithi086.stdout:9/888: mkdir db/d26/d5c/d87/d30/d3f/d43/d4e/d120 0 2024-08-19T00:56:17.998 INFO:tasks.workunit.client.1.smithi086.stdout:9/889: fdatasync db/d26/d5c/d87/d30/d3f/d43/ffd 0 2024-08-19T00:56:17.998 INFO:tasks.workunit.client.0.smithi017.stdout:0/436: dwrite d5/d17/d26/d30/d3e/d5a/f84 [0,4194304] 0 2024-08-19T00:56:17.999 INFO:tasks.workunit.client.1.smithi086.stdout:9/890: write db/d26/d5c/d87/d30/d31/f6c [123324,117738] 0 2024-08-19T00:56:17.999 INFO:tasks.workunit.client.1.smithi086.stdout:3/873: truncate d3/d26/d2b/d33/d4a/d57/d8a/fa4 347232 0 2024-08-19T00:56:18.000 INFO:tasks.workunit.client.0.smithi017.stdout:0/437: dread - d5/d18/f7b zero size 2024-08-19T00:56:18.002 INFO:tasks.workunit.client.0.smithi017.stdout:8/308: dwrite de/d15/f3b [0,4194304] 0 2024-08-19T00:56:18.003 INFO:tasks.workunit.client.0.smithi017.stdout:1/352: write d4/dc/d19/f44 [1873714,26271] 0 2024-08-19T00:56:18.004 INFO:tasks.workunit.client.1.smithi086.stdout:2/923: rename d8/d24/d32/d4d/d6a/db1/dcf to d8/d24/d32/d4d/d6a/db1/d135 0 2024-08-19T00:56:18.004 INFO:tasks.workunit.client.0.smithi017.stdout:0/438: fdatasync d5/d17/d21/d39/f85 0 2024-08-19T00:56:18.005 INFO:tasks.workunit.client.1.smithi086.stdout:9/891: dwrite db/d26/d5c/d68/f6f [4194304,4194304] 0 2024-08-19T00:56:18.006 INFO:tasks.workunit.client.0.smithi017.stdout:6/426: mkdir d5/d13/d20/d5e/d95 0 2024-08-19T00:56:18.013 INFO:tasks.workunit.client.1.smithi086.stdout:5/877: dread d0/d8/d94/df9/d108/f9c [0,4194304] 0 2024-08-19T00:56:18.016 INFO:tasks.workunit.client.0.smithi017.stdout:6/427: dwrite d5/d13/d11/d52/f6f [0,4194304] 0 2024-08-19T00:56:18.017 INFO:tasks.workunit.client.0.smithi017.stdout:6/428: dread - d5/d13/d11/d52/f5a zero size 2024-08-19T00:56:18.019 INFO:tasks.workunit.client.0.smithi017.stdout:7/436: write d3/dc/df/d23/d69/f6f [3444272,96049] 0 2024-08-19T00:56:18.021 INFO:tasks.workunit.client.0.smithi017.stdout:7/437: fsync d3/dc/df/d1c/f55 0 2024-08-19T00:56:18.022 INFO:tasks.workunit.client.0.smithi017.stdout:0/439: rename d5/d17/l2e to d5/d17/l92 0 2024-08-19T00:56:18.025 INFO:tasks.workunit.client.0.smithi017.stdout:7/438: fsync d3/dc/df/d37/d46/f57 0 2024-08-19T00:56:18.026 INFO:tasks.workunit.client.1.smithi086.stdout:3/874: mkdir d3/d18/d19/d62/d46/d11c 0 2024-08-19T00:56:18.030 INFO:tasks.workunit.client.1.smithi086.stdout:2/924: write d8/d2c/d38/d80/db4/fbd [3713267,103151] 0 2024-08-19T00:56:18.033 INFO:tasks.workunit.client.0.smithi017.stdout:0/440: dwrite d5/d17/f69 [4194304,4194304] 0 2024-08-19T00:56:18.034 INFO:tasks.workunit.client.1.smithi086.stdout:4/832: sync 2024-08-19T00:56:18.035 INFO:tasks.workunit.client.0.smithi017.stdout:7/439: dwrite d3/dc/df/d1c/f68 [0,4194304] 0 2024-08-19T00:56:18.037 INFO:tasks.workunit.client.1.smithi086.stdout:1/981: symlink d4/d7/d2a/d36/d7d/l13c 0 2024-08-19T00:56:18.042 INFO:tasks.workunit.client.0.smithi017.stdout:6/429: creat d5/d13/d20/d5e/d95/f96 x:0 0 0 2024-08-19T00:56:18.044 INFO:tasks.workunit.client.0.smithi017.stdout:6/430: chown d5/d13/d11/d2c/d4a/d64/d86/d90 1079631 1 2024-08-19T00:56:18.044 INFO:tasks.workunit.client.1.smithi086.stdout:0/867: rename da/d14/d55/d10c/d2e/d39/d3b/d4e/dda/fe8 to da/d14/d55/d10c/d2e/f111 0 2024-08-19T00:56:18.045 INFO:tasks.workunit.client.0.smithi017.stdout:6/431: chown d5/d13/d11/d2c/d51/f84 7 1 2024-08-19T00:56:18.046 INFO:tasks.workunit.client.0.smithi017.stdout:6/432: stat d5/d13/f3e 0 2024-08-19T00:56:18.046 INFO:tasks.workunit.client.1.smithi086.stdout:1/982: dwrite d4/d7/d2a/d36/d61/f102 [0,4194304] 0 2024-08-19T00:56:18.046 INFO:tasks.workunit.client.1.smithi086.stdout:8/864: creat dc/d1f/d37/d4f/dac/db8/f11a x:0 0 0 2024-08-19T00:56:18.048 INFO:tasks.workunit.client.1.smithi086.stdout:7/868: write d3/d34/d44/d58/d4b/da5/daf/de7/df5/f8e [3901969,103172] 0 2024-08-19T00:56:18.049 INFO:tasks.workunit.client.0.smithi017.stdout:0/441: rename d5/d17/d26/d30/d5d/l6f to d5/d18/d3a/l93 0 2024-08-19T00:56:18.052 INFO:tasks.workunit.client.1.smithi086.stdout:9/892: creat db/d26/d5c/d87/d30/d31/d103/d19/d18/d11f/f121 x:0 0 0 2024-08-19T00:56:18.053 INFO:tasks.workunit.client.0.smithi017.stdout:8/309: link de/c4a de/d15/d39/d3d/c55 0 2024-08-19T00:56:18.057 INFO:tasks.workunit.client.1.smithi086.stdout:3/875: dwrite d3/d18/d1a/d51/d9b/fab [0,4194304] 0 2024-08-19T00:56:18.057 INFO:tasks.workunit.client.0.smithi017.stdout:0/442: truncate d5/f48 542797 0 2024-08-19T00:56:18.058 INFO:tasks.workunit.client.0.smithi017.stdout:7/440: mkdir d3/dc/df/d37/d46/d73/d80/d81 0 2024-08-19T00:56:18.060 INFO:tasks.workunit.client.1.smithi086.stdout:2/925: rename d8/d43/d77/dcc/f104 to d8/d2c/d47/d73/f136 0 2024-08-19T00:56:18.060 INFO:tasks.workunit.client.0.smithi017.stdout:8/310: truncate de/f12 1890864 0 2024-08-19T00:56:18.061 INFO:tasks.workunit.client.0.smithi017.stdout:8/311: write de/f54 [626512,94057] 0 2024-08-19T00:56:18.062 INFO:tasks.workunit.client.1.smithi086.stdout:0/868: creat da/d5d/da9/f112 x:0 0 0 2024-08-19T00:56:18.063 INFO:tasks.workunit.client.0.smithi017.stdout:8/312: truncate de/f53 799327 0 2024-08-19T00:56:18.063 INFO:tasks.workunit.client.0.smithi017.stdout:6/433: link d5/d13/d11/d2c/f38 d5/d13/d20/d5e/d8f/f97 0 2024-08-19T00:56:18.064 INFO:tasks.workunit.client.1.smithi086.stdout:8/865: rmdir dc/d1f/d37 39 2024-08-19T00:56:18.067 INFO:tasks.workunit.client.1.smithi086.stdout:6/883: sync 2024-08-19T00:56:18.069 INFO:tasks.workunit.client.0.smithi017.stdout:8/313: dread de/d15/d39/f4c [0,4194304] 0 2024-08-19T00:56:18.073 INFO:tasks.workunit.client.1.smithi086.stdout:5/878: rename d0/d99/da2/dde/df6 to d0/d5f/d60/d5b/d111 0 2024-08-19T00:56:18.074 INFO:tasks.workunit.client.0.smithi017.stdout:8/314: write de/d15/d39/f4c [3772851,31340] 0 2024-08-19T00:56:18.077 INFO:tasks.workunit.client.0.smithi017.stdout:6/434: creat d5/d13/d11/d2c/d4a/d64/d86/d90/f98 x:0 0 0 2024-08-19T00:56:18.078 INFO:tasks.workunit.client.0.smithi017.stdout:8/315: symlink de/d15/d39/l56 0 2024-08-19T00:56:18.079 INFO:tasks.workunit.client.0.smithi017.stdout:8/316: write de/d15/d39/f4c [1182237,60570] 0 2024-08-19T00:56:18.082 INFO:tasks.workunit.client.0.smithi017.stdout:6/435: mkdir d5/d13/d20/d77/d99 0 2024-08-19T00:56:18.083 INFO:tasks.workunit.client.0.smithi017.stdout:6/436: dread - d5/d13/d11/d2c/d51/f8a zero size 2024-08-19T00:56:18.085 INFO:tasks.workunit.client.0.smithi017.stdout:6/437: write d5/d13/d20/f3c [2844480,95662] 0 2024-08-19T00:56:18.086 INFO:tasks.workunit.client.0.smithi017.stdout:6/438: chown d5/d7b/f8b 21 1 2024-08-19T00:56:18.086 INFO:tasks.workunit.client.0.smithi017.stdout:8/317: fdatasync de/f47 0 2024-08-19T00:56:18.087 INFO:tasks.workunit.client.1.smithi086.stdout:6/884: dread f8 [8388608,4194304] 0 2024-08-19T00:56:18.087 INFO:tasks.workunit.client.0.smithi017.stdout:8/318: chown de/d15/d39/f3e 459446 1 2024-08-19T00:56:18.089 INFO:tasks.workunit.client.1.smithi086.stdout:9/893: dread db/d26/d5c/d87/d30/d32/d44/d67/fb1 [0,4194304] 0 2024-08-19T00:56:18.091 INFO:tasks.workunit.client.0.smithi017.stdout:7/441: dread d3/f5 [0,4194304] 0 2024-08-19T00:56:18.093 INFO:tasks.workunit.client.1.smithi086.stdout:6/885: dwrite db/d34/d69/f102 [0,4194304] 0 2024-08-19T00:56:18.095 INFO:tasks.workunit.client.0.smithi017.stdout:3/440: sync 2024-08-19T00:56:18.095 INFO:tasks.workunit.client.0.smithi017.stdout:5/288: sync 2024-08-19T00:56:18.095 INFO:tasks.workunit.client.0.smithi017.stdout:9/393: sync 2024-08-19T00:56:18.096 INFO:tasks.workunit.client.0.smithi017.stdout:5/289: stat db/d19/d1f/d15/d1e/l2d 0 2024-08-19T00:56:18.098 INFO:tasks.workunit.client.1.smithi086.stdout:4/833: dwrite d2/d18/d33/d42/d72/d78/d2c/f2e [4194304,4194304] 0 2024-08-19T00:56:18.098 INFO:tasks.workunit.client.0.smithi017.stdout:7/442: mknod d3/dc/df/d37/d46/d73/d80/c82 0 2024-08-19T00:56:18.102 INFO:tasks.workunit.client.0.smithi017.stdout:6/439: mknod d5/d13/d11/d93/c9a 0 2024-08-19T00:56:18.102 INFO:tasks.workunit.client.0.smithi017.stdout:9/394: dread d0/d33/d22/f62 [0,4194304] 0 2024-08-19T00:56:18.107 INFO:tasks.workunit.client.0.smithi017.stdout:0/443: truncate d5/d18/f1e 634614 0 2024-08-19T00:56:18.108 INFO:tasks.workunit.client.0.smithi017.stdout:8/319: truncate de/f34 242210 0 2024-08-19T00:56:18.115 INFO:tasks.workunit.client.0.smithi017.stdout:5/290: dread db/d19/d1f/d15/d3e/d40/f44 [0,4194304] 0 2024-08-19T00:56:18.115 INFO:tasks.workunit.client.0.smithi017.stdout:8/320: dwrite de/f37 [0,4194304] 0 2024-08-19T00:56:18.127 INFO:tasks.workunit.client.0.smithi017.stdout:3/441: symlink d5/l84 0 2024-08-19T00:56:18.131 INFO:tasks.workunit.client.0.smithi017.stdout:7/443: mkdir d3/dc/df/d1c/d2c/d83 0 2024-08-19T00:56:18.133 INFO:tasks.workunit.client.0.smithi017.stdout:6/440: dread d5/d13/d11/f53 [0,4194304] 0 2024-08-19T00:56:18.145 INFO:tasks.workunit.client.0.smithi017.stdout:3/442: creat d5/d11/f85 x:0 0 0 2024-08-19T00:56:18.147 INFO:tasks.workunit.client.0.smithi017.stdout:7/444: rmdir d3/dc/df/d7d 39 2024-08-19T00:56:18.153 INFO:tasks.workunit.client.0.smithi017.stdout:3/443: dwrite d5/da/f2b [4194304,4194304] 0 2024-08-19T00:56:18.155 INFO:tasks.workunit.client.0.smithi017.stdout:8/321: write de/f22 [572301,84067] 0 2024-08-19T00:56:18.156 INFO:tasks.workunit.client.0.smithi017.stdout:3/444: write d5/d15/d1b/f79 [947633,28452] 0 2024-08-19T00:56:18.164 INFO:tasks.workunit.client.0.smithi017.stdout:6/441: fdatasync d5/d13/d20/f27 0 2024-08-19T00:56:18.167 INFO:tasks.workunit.client.0.smithi017.stdout:9/395: getdents d0/d33/d22 0 2024-08-19T00:56:18.170 INFO:tasks.workunit.client.1.smithi086.stdout:7/869: rename d3/d34/d44/d58/d4b/dcd/d10e to d3/da1/d108/d11f 0 2024-08-19T00:56:18.172 INFO:tasks.workunit.client.0.smithi017.stdout:0/444: link d5/d17/d21/d42/c1f d5/d17/d21/d42/c94 0 2024-08-19T00:56:18.173 INFO:tasks.workunit.client.1.smithi086.stdout:5/879: mknod d0/d5f/c112 0 2024-08-19T00:56:18.175 INFO:tasks.workunit.client.0.smithi017.stdout:5/291: dwrite db/d19/d1f/d15/d3e/d40/d49/f69 [0,4194304] 0 2024-08-19T00:56:18.175 INFO:tasks.workunit.client.1.smithi086.stdout:8/866: mkdir dc/d1f/d37/d4f/d11b 0 2024-08-19T00:56:18.186 INFO:tasks.workunit.client.0.smithi017.stdout:8/322: rename de/d15/c26 to de/d15/d39/c57 0 2024-08-19T00:56:18.187 INFO:tasks.workunit.client.0.smithi017.stdout:6/442: dwrite d5/d13/d11/f72 [0,4194304] 0 2024-08-19T00:56:18.188 INFO:tasks.workunit.client.1.smithi086.stdout:4/834: mkdir d2/d18/d33/d42/d72/d78/d25/d55/de1/d115 0 2024-08-19T00:56:18.189 INFO:tasks.workunit.client.0.smithi017.stdout:6/443: chown d5/d13/d20/d5e/f6c 12 1 2024-08-19T00:56:18.197 INFO:tasks.workunit.client.0.smithi017.stdout:8/323: creat de/d36/f58 x:0 0 0 2024-08-19T00:56:18.197 INFO:tasks.workunit.client.0.smithi017.stdout:8/324: fsync de/d15/f1e 0 2024-08-19T00:56:18.198 INFO:tasks.workunit.client.1.smithi086.stdout:0/869: creat da/d14/f113 x:0 0 0 2024-08-19T00:56:18.201 INFO:tasks.workunit.client.0.smithi017.stdout:5/292: creat db/d19/d1f/d15/d1e/d5f/f6b x:0 0 0 2024-08-19T00:56:18.205 INFO:tasks.workunit.client.1.smithi086.stdout:4/835: dread d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/faa [0,4194304] 0 2024-08-19T00:56:18.206 INFO:tasks.workunit.client.1.smithi086.stdout:4/836: read d2/d18/d33/d42/d72/d78/d25/f35 [664977,18951] 0 2024-08-19T00:56:18.234 INFO:tasks.workunit.client.1.smithi086.stdout:1/983: getdents d4/d7/d2a/d36/d50/d9c/ded/d11c 0 2024-08-19T00:56:18.234 INFO:tasks.workunit.client.0.smithi017.stdout:8/325: creat de/d15/d39/f59 x:0 0 0 2024-08-19T00:56:18.234 INFO:tasks.workunit.client.1.smithi086.stdout:3/876: getdents d3/d26/d2b/d33/d4a 0 2024-08-19T00:56:18.235 INFO:tasks.workunit.client.0.smithi017.stdout:3/445: link d5/da/d3c/d4f/c7c d5/d32/c86 0 2024-08-19T00:56:18.236 INFO:tasks.workunit.client.1.smithi086.stdout:5/880: write d0/d2d/d43/f45 [4327078,103639] 0 2024-08-19T00:56:18.237 INFO:tasks.workunit.client.0.smithi017.stdout:6/444: write d5/d13/d11/d4d/f6b [317711,91224] 0 2024-08-19T00:56:18.238 INFO:tasks.workunit.client.1.smithi086.stdout:7/870: mkdir d3/d34/df2/d117/d120 0 2024-08-19T00:56:18.239 INFO:tasks.workunit.client.1.smithi086.stdout:7/871: chown d3/d34/d44/d58/d4b/d42 2 1 2024-08-19T00:56:18.240 INFO:tasks.workunit.client.1.smithi086.stdout:0/870: fdatasync da/d14/d44/df0/fe6 0 2024-08-19T00:56:18.241 INFO:tasks.workunit.client.1.smithi086.stdout:6/886: write db/f13 [4776640,41292] 0 2024-08-19T00:56:18.242 INFO:tasks.workunit.client.0.smithi017.stdout:7/445: getdents d3/dc/df/d7d 0 2024-08-19T00:56:18.242 INFO:tasks.workunit.client.1.smithi086.stdout:6/887: write db/d37/d28/d7f/f10c [542594,49083] 0 2024-08-19T00:56:18.246 INFO:tasks.workunit.client.0.smithi017.stdout:6/445: dwrite d5/d13/d20/f56 [0,4194304] 0 2024-08-19T00:56:18.251 INFO:tasks.workunit.client.1.smithi086.stdout:2/926: rename d8/c10c to d8/d43/d77/c137 0 2024-08-19T00:56:18.252 INFO:tasks.workunit.client.1.smithi086.stdout:2/927: write d8/d84/ff3 [952698,55273] 0 2024-08-19T00:56:18.252 INFO:tasks.workunit.client.1.smithi086.stdout:5/881: mkdir d0/d2d/dce/d113 0 2024-08-19T00:56:18.254 INFO:tasks.workunit.client.1.smithi086.stdout:4/837: write d2/f1b [5196416,46504] 0 2024-08-19T00:56:18.255 INFO:tasks.workunit.client.1.smithi086.stdout:7/872: unlink d3/de/fd5 0 2024-08-19T00:56:18.255 INFO:tasks.workunit.client.0.smithi017.stdout:5/293: dread db/f10 [0,4194304] 0 2024-08-19T00:56:18.257 INFO:tasks.workunit.client.0.smithi017.stdout:6/446: rename d5/d13/d11/d52/f6f to d5/d13/d20/d5e/d95/f9b 0 2024-08-19T00:56:18.257 INFO:tasks.workunit.client.0.smithi017.stdout:9/396: getdents d0/d33/d22 0 2024-08-19T00:56:18.258 INFO:tasks.workunit.client.0.smithi017.stdout:9/397: truncate d0/f65 831176 0 2024-08-19T00:56:18.258 INFO:tasks.workunit.client.1.smithi086.stdout:8/867: sync 2024-08-19T00:56:18.259 INFO:tasks.workunit.client.1.smithi086.stdout:0/871: chown da/d14/d26/l2a 54599399 1 2024-08-19T00:56:18.261 INFO:tasks.workunit.client.1.smithi086.stdout:6/888: unlink db/d37/d41/da7/cc8 0 2024-08-19T00:56:18.261 INFO:tasks.workunit.client.0.smithi017.stdout:3/446: dread d5/d11/f14 [0,4194304] 0 2024-08-19T00:56:18.261 INFO:tasks.workunit.client.0.smithi017.stdout:7/446: truncate d3/dc/df/d37/d46/f57 1164634 0 2024-08-19T00:56:18.262 INFO:tasks.workunit.client.1.smithi086.stdout:9/894: link db/d26/d5c/d87/d6d/deb/l115 db/daf/l122 0 2024-08-19T00:56:18.262 INFO:tasks.workunit.client.1.smithi086.stdout:7/873: dwrite d3/d34/d44/d58/d4b/d78/fc9 [0,4194304] 0 2024-08-19T00:56:18.264 INFO:tasks.workunit.client.1.smithi086.stdout:1/984: rename d4/d1e/d6f/l70 to d4/d7/d2a/d36/d63/d84/dda/l13d 0 2024-08-19T00:56:18.267 INFO:tasks.workunit.client.0.smithi017.stdout:9/398: symlink d0/d33/d22/d5e/l75 0 2024-08-19T00:56:18.267 INFO:tasks.workunit.client.1.smithi086.stdout:5/882: symlink d0/df/d1f/d33/l114 0 2024-08-19T00:56:18.268 INFO:tasks.workunit.client.1.smithi086.stdout:1/985: read d4/d7/d2a/d36/f45 [928732,86999] 0 2024-08-19T00:56:18.270 INFO:tasks.workunit.client.1.smithi086.stdout:4/838: creat d2/d18/d33/d42/d72/d78/d25/f116 x:0 0 0 2024-08-19T00:56:18.270 INFO:tasks.workunit.client.1.smithi086.stdout:2/928: read d8/d2c/d38/d80/db4/db7/f116 [201104,35737] 0 2024-08-19T00:56:18.272 INFO:tasks.workunit.client.1.smithi086.stdout:9/895: dwrite db/d26/d5c/d87/d30/d32/d44/f65 [4194304,4194304] 0 2024-08-19T00:56:18.276 INFO:tasks.workunit.client.1.smithi086.stdout:0/872: symlink da/d14/d55/d10c/dc8/l114 0 2024-08-19T00:56:18.278 INFO:tasks.workunit.client.0.smithi017.stdout:7/447: truncate d3/dc/d5f/f63 2804730 0 2024-08-19T00:56:18.279 INFO:tasks.workunit.client.1.smithi086.stdout:9/896: dwrite db/d26/d5c/d87/d30/d3f/fe9 [0,4194304] 0 2024-08-19T00:56:18.281 INFO:tasks.workunit.client.1.smithi086.stdout:9/897: write db/d26/d5c/d87/d6d/deb/f10a [211935,119494] 0 2024-08-19T00:56:18.281 INFO:tasks.workunit.client.0.smithi017.stdout:9/399: rename d0/d33/d22/d5a/f6b to d0/d58/d49/f76 0 2024-08-19T00:56:18.284 INFO:tasks.workunit.client.1.smithi086.stdout:7/874: mknod d3/d34/df2/c121 0 2024-08-19T00:56:18.287 INFO:tasks.workunit.client.1.smithi086.stdout:3/877: rename d3/d18/d19/d62/d46/fe5 to d3/d18/d19/d10a/f11d 0 2024-08-19T00:56:18.288 INFO:tasks.workunit.client.0.smithi017.stdout:6/447: write d5/f1a [448521,49267] 0 2024-08-19T00:56:18.289 INFO:tasks.workunit.client.1.smithi086.stdout:5/883: mknod d0/df/d1f/d65/dfd/c115 0 2024-08-19T00:56:18.290 INFO:tasks.workunit.client.1.smithi086.stdout:5/884: fdatasync d0/d8/d94/ff7 0 2024-08-19T00:56:18.291 INFO:tasks.workunit.client.1.smithi086.stdout:2/929: symlink d8/d24/d32/l138 0 2024-08-19T00:56:18.294 INFO:tasks.workunit.client.1.smithi086.stdout:2/930: read d8/d43/f5a [2775398,68099] 0 2024-08-19T00:56:18.295 INFO:tasks.workunit.client.1.smithi086.stdout:3/878: dwrite d3/d18/d1a/d51/dad/de9/f10b [0,4194304] 0 2024-08-19T00:56:18.295 INFO:tasks.workunit.client.0.smithi017.stdout:7/448: rename d3/dc/df/c13 to d3/dc/df/d7d/c84 0 2024-08-19T00:56:18.297 INFO:tasks.workunit.client.1.smithi086.stdout:4/839: fdatasync d2/d18/d33/d42/d72/d2f/fc5 0 2024-08-19T00:56:18.298 INFO:tasks.workunit.client.0.smithi017.stdout:9/400: creat d0/d33/d22/d40/f77 x:0 0 0 2024-08-19T00:56:18.299 INFO:tasks.workunit.client.0.smithi017.stdout:5/294: getdents db/d19/d1f/d15/d3e 0 2024-08-19T00:56:18.300 INFO:tasks.workunit.client.0.smithi017.stdout:5/295: fsync db/d19/d1f/d15/f64 0 2024-08-19T00:56:18.301 INFO:tasks.workunit.client.1.smithi086.stdout:8/868: mknod dc/d16/d18/d106/d28/c11c 0 2024-08-19T00:56:18.302 INFO:tasks.workunit.client.1.smithi086.stdout:1/986: write d4/d7/d2a/d36/d63/d84/d8e/ff5 [852755,94523] 0 2024-08-19T00:56:18.304 INFO:tasks.workunit.client.1.smithi086.stdout:1/987: write d4/d7/f9b [5406088,32234] 0 2024-08-19T00:56:18.306 INFO:tasks.workunit.client.0.smithi017.stdout:7/449: rename d3/dc/d5f/l72 to d3/dc/df/d37/d46/l85 0 2024-08-19T00:56:18.308 INFO:tasks.workunit.client.0.smithi017.stdout:5/296: dwrite db/d19/d1f/d15/d1e/d5f/f6b [0,4194304] 0 2024-08-19T00:56:18.308 INFO:tasks.workunit.client.1.smithi086.stdout:0/873: rename da/d14/d55/d10c/d2e/d39 to da/d115 0 2024-08-19T00:56:18.311 INFO:tasks.workunit.client.0.smithi017.stdout:6/448: creat d5/d13/d20/d89/f9c x:0 0 0 2024-08-19T00:56:18.314 INFO:tasks.workunit.client.1.smithi086.stdout:2/931: creat d8/d24/d32/f139 x:0 0 0 2024-08-19T00:56:18.317 INFO:tasks.workunit.client.1.smithi086.stdout:3/879: fsync d3/d18/d27/d49/fc0 0 2024-08-19T00:56:18.321 INFO:tasks.workunit.client.1.smithi086.stdout:4/840: mknod d2/d18/d33/d42/d72/d78/d25/d30/d5d/c117 0 2024-08-19T00:56:18.323 INFO:tasks.workunit.client.0.smithi017.stdout:6/449: unlink d5/d13/d11/d2c/d51/f62 0 2024-08-19T00:56:18.324 INFO:tasks.workunit.client.1.smithi086.stdout:9/898: creat db/d96/da7/f123 x:0 0 0 2024-08-19T00:56:18.324 INFO:tasks.workunit.client.1.smithi086.stdout:5/885: write d0/d8/d94/df9/d108/f9c [451875,24081] 0 2024-08-19T00:56:18.325 INFO:tasks.workunit.client.0.smithi017.stdout:7/450: dread d3/f2e [4194304,4194304] 0 2024-08-19T00:56:18.326 INFO:tasks.workunit.client.1.smithi086.stdout:8/869: fsync dc/d16/d18/d106/d28/d41/d9a/f9e 0 2024-08-19T00:56:18.329 INFO:tasks.workunit.client.1.smithi086.stdout:1/988: symlink d4/d7/d2a/d36/d63/d84/dda/l13e 0 2024-08-19T00:56:18.331 INFO:tasks.workunit.client.1.smithi086.stdout:1/989: dread - d4/d7/d2a/d36/d3a/de5/d7a/db4/df0/f112 zero size 2024-08-19T00:56:18.333 INFO:tasks.workunit.client.0.smithi017.stdout:6/450: rmdir d5/d13 39 2024-08-19T00:56:18.335 INFO:tasks.workunit.client.0.smithi017.stdout:9/401: getdents d0/d33/d22/d5a 0 2024-08-19T00:56:18.339 INFO:tasks.workunit.client.1.smithi086.stdout:3/880: creat d3/d18/d1a/d51/d9b/f11e x:0 0 0 2024-08-19T00:56:18.340 INFO:tasks.workunit.client.0.smithi017.stdout:5/297: dwrite db/d19/d1f/d15/d1e/f37 [0,4194304] 0 2024-08-19T00:56:18.341 INFO:tasks.workunit.client.0.smithi017.stdout:9/402: mknod d0/d33/d22/d5e/c78 0 2024-08-19T00:56:18.343 INFO:tasks.workunit.client.1.smithi086.stdout:2/932: dwrite d8/f60 [0,4194304] 0 2024-08-19T00:56:18.347 INFO:tasks.workunit.client.0.smithi017.stdout:5/298: symlink db/d19/d1f/d15/d3e/d40/l6c 0 2024-08-19T00:56:18.349 INFO:tasks.workunit.client.1.smithi086.stdout:8/870: truncate f3 418527 0 2024-08-19T00:56:18.350 INFO:tasks.workunit.client.1.smithi086.stdout:6/889: sync 2024-08-19T00:56:18.350 INFO:tasks.workunit.client.0.smithi017.stdout:9/403: dwrite d0/d33/f30 [4194304,4194304] 0 2024-08-19T00:56:18.352 INFO:tasks.workunit.client.0.smithi017.stdout:5/299: stat db/c48 0 2024-08-19T00:56:18.353 INFO:tasks.workunit.client.1.smithi086.stdout:4/841: creat d2/d18/d33/d42/d72/d78/d9e/dc6/f118 x:0 0 0 2024-08-19T00:56:18.356 INFO:tasks.workunit.client.1.smithi086.stdout:9/899: symlink db/d26/d5c/d87/d30/l124 0 2024-08-19T00:56:18.357 INFO:tasks.workunit.client.1.smithi086.stdout:0/874: creat da/d14/d55/d10c/f116 x:0 0 0 2024-08-19T00:56:18.359 INFO:tasks.workunit.client.0.smithi017.stdout:9/404: rename d0/f14 to d0/d33/d22/d52/f79 0 2024-08-19T00:56:18.361 INFO:tasks.workunit.client.0.smithi017.stdout:5/300: dwrite db/f66 [0,4194304] 0 2024-08-19T00:56:18.363 INFO:tasks.workunit.client.0.smithi017.stdout:9/405: dread d0/f65 [0,4194304] 0 2024-08-19T00:56:18.363 INFO:tasks.workunit.client.1.smithi086.stdout:5/886: dwrite d0/d5f/d60/d57/d80/d9e/ffb [0,4194304] 0 2024-08-19T00:56:18.364 INFO:tasks.workunit.client.1.smithi086.stdout:5/887: chown d0/d20/c56 690244 1 2024-08-19T00:56:18.364 INFO:tasks.workunit.client.1.smithi086.stdout:5/888: stat d0/d2d/l8d 0 2024-08-19T00:56:18.365 INFO:tasks.workunit.client.0.smithi017.stdout:5/301: dread - db/d19/d33/f42 zero size 2024-08-19T00:56:18.365 INFO:tasks.workunit.client.0.smithi017.stdout:7/451: dwrite d3/dc/d5f/f63 [0,4194304] 0 2024-08-19T00:56:18.365 INFO:tasks.workunit.client.0.smithi017.stdout:6/451: truncate d5/d13/d20/f56 3320978 0 2024-08-19T00:56:18.366 INFO:tasks.workunit.client.0.smithi017.stdout:9/406: fsync d0/d33/d22/d5a/f5f 0 2024-08-19T00:56:18.366 INFO:tasks.workunit.client.1.smithi086.stdout:3/881: getdents d3/d18/d27/d106 0 2024-08-19T00:56:18.368 INFO:tasks.workunit.client.0.smithi017.stdout:9/407: read d0/d33/d22/d45/f54 [2904866,21019] 0 2024-08-19T00:56:18.368 INFO:tasks.workunit.client.1.smithi086.stdout:2/933: mkdir d8/d2c/d13a 0 2024-08-19T00:56:18.369 INFO:tasks.workunit.client.0.smithi017.stdout:5/302: rmdir db/d19 39 2024-08-19T00:56:18.371 INFO:tasks.workunit.client.1.smithi086.stdout:0/875: symlink da/d14/d44/d49/l117 0 2024-08-19T00:56:18.373 INFO:tasks.workunit.client.1.smithi086.stdout:7/875: rename d3/de/d2d/c106 to d3/d34/d44/c122 0 2024-08-19T00:56:18.374 INFO:tasks.workunit.client.0.smithi017.stdout:9/408: creat d0/d33/d22/d52/f7a x:0 0 0 2024-08-19T00:56:18.375 INFO:tasks.workunit.client.1.smithi086.stdout:7/876: dread - d3/d34/d44/d58/d4b/da5/daf/de7/df5/fbe zero size 2024-08-19T00:56:18.375 INFO:tasks.workunit.client.0.smithi017.stdout:7/452: creat d3/dc/df/d1c/d2c/d83/f86 x:0 0 0 2024-08-19T00:56:18.376 INFO:tasks.workunit.client.0.smithi017.stdout:7/453: chown d3/dc/df/d23/d69 105992215 1 2024-08-19T00:56:18.377 INFO:tasks.workunit.client.1.smithi086.stdout:5/889: symlink d0/d5f/l116 0 2024-08-19T00:56:18.378 INFO:tasks.workunit.client.0.smithi017.stdout:7/454: chown d3/f4 70 1 2024-08-19T00:56:18.382 INFO:tasks.workunit.client.1.smithi086.stdout:3/882: unlink d3/d18/d1a/d51/d9b/f11e 0 2024-08-19T00:56:18.384 INFO:tasks.workunit.client.0.smithi017.stdout:5/303: fdatasync db/d19/d33/f53 0 2024-08-19T00:56:18.386 INFO:tasks.workunit.client.0.smithi017.stdout:5/304: chown db/d19/d1f/d15/c16 3 1 2024-08-19T00:56:18.386 INFO:tasks.workunit.client.0.smithi017.stdout:7/455: mkdir d3/dc/df/d1c/d2c/d35/d87 0 2024-08-19T00:56:18.387 INFO:tasks.workunit.client.0.smithi017.stdout:5/305: dread - db/d19/d1f/d15/f64 zero size 2024-08-19T00:56:18.388 INFO:tasks.workunit.client.1.smithi086.stdout:6/890: dwrite db/d37/f21 [0,4194304] 0 2024-08-19T00:56:18.388 INFO:tasks.workunit.client.1.smithi086.stdout:2/934: truncate d8/d43/d65/f70 2599681 0 2024-08-19T00:56:18.388 INFO:tasks.workunit.client.0.smithi017.stdout:9/409: truncate d0/d33/f17 2343920 0 2024-08-19T00:56:18.389 INFO:tasks.workunit.client.0.smithi017.stdout:9/410: read d0/f65 [621558,12115] 0 2024-08-19T00:56:18.391 INFO:tasks.workunit.client.0.smithi017.stdout:9/411: dread - d0/d33/d22/d52/f7a zero size 2024-08-19T00:56:18.392 INFO:tasks.workunit.client.1.smithi086.stdout:8/871: dwrite dc/d1f/d37/f74 [0,4194304] 0 2024-08-19T00:56:18.393 INFO:tasks.workunit.client.1.smithi086.stdout:8/872: fdatasync dc/d1f/d37/d4f/fee 0 2024-08-19T00:56:18.397 INFO:tasks.workunit.client.1.smithi086.stdout:4/842: creat d2/d18/d33/f119 x:0 0 0 2024-08-19T00:56:18.399 INFO:tasks.workunit.client.0.smithi017.stdout:9/412: mkdir d0/d33/d22/d45/d69/d7b 0 2024-08-19T00:56:18.401 INFO:tasks.workunit.client.1.smithi086.stdout:9/900: rmdir db/d26/d5c/d87/d37/d108 0 2024-08-19T00:56:18.401 INFO:tasks.workunit.client.1.smithi086.stdout:3/883: dwrite d3/d18/d27/d49/f32 [0,4194304] 0 2024-08-19T00:56:18.402 INFO:tasks.workunit.client.0.smithi017.stdout:5/306: creat db/d19/d1f/f6d x:0 0 0 2024-08-19T00:56:18.404 INFO:tasks.workunit.client.0.smithi017.stdout:9/413: symlink d0/d33/d22/l7c 0 2024-08-19T00:56:18.405 INFO:tasks.workunit.client.1.smithi086.stdout:0/876: getdents da/d14/d55/dac/d102 0 2024-08-19T00:56:18.407 INFO:tasks.workunit.client.0.smithi017.stdout:5/307: dread - db/d19/d1f/d15/d30/f46 zero size 2024-08-19T00:56:18.408 INFO:tasks.workunit.client.1.smithi086.stdout:2/935: symlink d8/d24/d32/l13b 0 2024-08-19T00:56:18.412 INFO:tasks.workunit.client.0.smithi017.stdout:9/414: dwrite d0/d33/d22/d52/f7a [0,4194304] 0 2024-08-19T00:56:18.413 INFO:tasks.workunit.client.0.smithi017.stdout:9/415: readlink d0/d33/d22/l7c 0 2024-08-19T00:56:18.416 INFO:tasks.workunit.client.0.smithi017.stdout:5/308: creat db/d19/d1f/d15/d3e/d40/f6e x:0 0 0 2024-08-19T00:56:18.418 INFO:tasks.workunit.client.0.smithi017.stdout:5/309: stat db/d19/d1f/d15/d3e/l4f 0 2024-08-19T00:56:18.418 INFO:tasks.workunit.client.1.smithi086.stdout:4/843: write d2/d18/d33/d42/d72/d78/d2c/ff3 [372339,16107] 0 2024-08-19T00:56:18.420 INFO:tasks.workunit.client.1.smithi086.stdout:9/901: mknod db/d26/d5c/d87/d30/d58/c125 0 2024-08-19T00:56:18.422 INFO:tasks.workunit.client.1.smithi086.stdout:4/844: write d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd/ffb [292890,50430] 0 2024-08-19T00:56:18.422 INFO:tasks.workunit.client.1.smithi086.stdout:3/884: dread d3/d26/f73 [0,4194304] 0 2024-08-19T00:56:18.423 INFO:tasks.workunit.client.1.smithi086.stdout:1/990: rename d4/d1e/f54 to d4/d7/d2a/d36/d7d/f13f 0 2024-08-19T00:56:18.424 INFO:tasks.workunit.client.0.smithi017.stdout:9/416: mknod d0/c7d 0 2024-08-19T00:56:18.425 INFO:tasks.workunit.client.0.smithi017.stdout:7/456: dwrite d3/dc/f52 [0,4194304] 0 2024-08-19T00:56:18.426 INFO:tasks.workunit.client.1.smithi086.stdout:9/902: truncate db/d96/da7/f123 827094 0 2024-08-19T00:56:18.426 INFO:tasks.workunit.client.0.smithi017.stdout:9/417: write d0/d33/f30 [2363942,78056] 0 2024-08-19T00:56:18.427 INFO:tasks.workunit.client.1.smithi086.stdout:2/936: unlink d8/d43/f63 0 2024-08-19T00:56:18.428 INFO:tasks.workunit.client.1.smithi086.stdout:1/991: read d4/d7/d2a/d36/d7d/fe4 [96343,90269] 0 2024-08-19T00:56:18.433 INFO:tasks.workunit.client.1.smithi086.stdout:8/873: creat dc/d16/d18/d106/d28/d2b/d3b/d87/de2/f11d x:0 0 0 2024-08-19T00:56:18.435 INFO:tasks.workunit.client.0.smithi017.stdout:7/457: dwrite d3/dc/d5f/f63 [0,4194304] 0 2024-08-19T00:56:18.438 INFO:tasks.workunit.client.1.smithi086.stdout:6/891: rename db/d34/l81 to db/d37/d28/d7f/d96/dc2/l116 0 2024-08-19T00:56:18.439 INFO:tasks.workunit.client.1.smithi086.stdout:3/885: symlink d3/d26/dba/l11f 0 2024-08-19T00:56:18.441 INFO:tasks.workunit.client.1.smithi086.stdout:5/890: write d0/d20/f36 [522473,61183] 0 2024-08-19T00:56:18.443 INFO:tasks.workunit.client.1.smithi086.stdout:0/877: dread da/d14/d55/d10c/d2e/f111 [0,4194304] 0 2024-08-19T00:56:18.449 INFO:tasks.workunit.client.1.smithi086.stdout:8/874: unlink dc/d1f/d37/ce5 0 2024-08-19T00:56:18.449 INFO:tasks.workunit.client.1.smithi086.stdout:0/878: dwrite da/d5d/f103 [4194304,4194304] 0 2024-08-19T00:56:18.450 INFO:tasks.workunit.client.1.smithi086.stdout:9/903: rename db/d26/d5c/d87/d30/d31/d103/de2/dee/c116 to db/d26/d5c/d87/d30/d31/d103/de2/c126 0 2024-08-19T00:56:18.451 INFO:tasks.workunit.client.0.smithi017.stdout:9/418: getdents d0/d33/d22/d5e 0 2024-08-19T00:56:18.452 INFO:tasks.workunit.client.1.smithi086.stdout:8/875: write dc/d16/d18/d106/d28/d2b/f6e [5636949,13867] 0 2024-08-19T00:56:18.452 INFO:tasks.workunit.client.0.smithi017.stdout:9/419: readlink d0/d33/d22/d5e/l73 0 2024-08-19T00:56:18.452 INFO:tasks.workunit.client.1.smithi086.stdout:8/876: chown dc/d16/l30 12009541 1 2024-08-19T00:56:18.453 INFO:tasks.workunit.client.1.smithi086.stdout:6/892: fsync db/d34/f9a 0 2024-08-19T00:56:18.453 INFO:tasks.workunit.client.0.smithi017.stdout:9/420: chown d0/d58/d49/d5d/f74 15 1 2024-08-19T00:56:18.454 INFO:tasks.workunit.client.1.smithi086.stdout:8/877: chown dc/d17/dd3/ff5 62 1 2024-08-19T00:56:18.456 INFO:tasks.workunit.client.1.smithi086.stdout:5/891: creat d0/df/d1f/d33/f117 x:0 0 0 2024-08-19T00:56:18.456 INFO:tasks.workunit.client.1.smithi086.stdout:6/893: truncate db/d34/d4e/d68/d99/dce/f114 715860 0 2024-08-19T00:56:18.456 INFO:tasks.workunit.client.0.smithi017.stdout:4/443: sync 2024-08-19T00:56:18.456 INFO:tasks.workunit.client.0.smithi017.stdout:2/491: sync 2024-08-19T00:56:18.457 INFO:tasks.workunit.client.1.smithi086.stdout:6/894: chown db/d8e/fd6 384575669 1 2024-08-19T00:56:18.457 INFO:tasks.workunit.client.0.smithi017.stdout:7/458: write d3/dc/f52 [4358367,100952] 0 2024-08-19T00:56:18.457 INFO:tasks.workunit.client.0.smithi017.stdout:5/310: dread db/f24 [0,4194304] 0 2024-08-19T00:56:18.459 INFO:tasks.workunit.client.0.smithi017.stdout:4/444: write d2/d21/f8a [215398,42897] 0 2024-08-19T00:56:18.465 INFO:tasks.workunit.client.0.smithi017.stdout:7/459: mkdir d3/d3c/d88 0 2024-08-19T00:56:18.467 INFO:tasks.workunit.client.1.smithi086.stdout:7/877: sync 2024-08-19T00:56:18.468 INFO:tasks.workunit.client.0.smithi017.stdout:5/311: creat db/d19/d1f/d15/d3e/f6f x:0 0 0 2024-08-19T00:56:18.468 INFO:tasks.workunit.client.0.smithi017.stdout:7/460: read d3/dc/df/d1a/f4a [199910,84194] 0 2024-08-19T00:56:18.469 INFO:tasks.workunit.client.1.smithi086.stdout:4/845: write d2/d18/d33/d42/d72/d78/d25/d55/d6c/f9c [659240,34102] 0 2024-08-19T00:56:18.469 INFO:tasks.workunit.client.0.smithi017.stdout:4/445: mknod d2/d21/d53/c98 0 2024-08-19T00:56:18.470 INFO:tasks.workunit.client.1.smithi086.stdout:1/992: write d4/d10/d90/d98/fbd [2667478,54277] 0 2024-08-19T00:56:18.472 INFO:tasks.workunit.client.0.smithi017.stdout:2/492: dwrite d2/d7/d29/f68 [0,4194304] 0 2024-08-19T00:56:18.474 INFO:tasks.workunit.client.0.smithi017.stdout:2/493: chown d2/d7/d10/d3b/d69/d7a/l99 1048219 1 2024-08-19T00:56:18.474 INFO:tasks.workunit.client.1.smithi086.stdout:9/904: rename db/d26/d5c/d87/l11a to db/d96/de1/l127 0 2024-08-19T00:56:18.475 INFO:tasks.workunit.client.1.smithi086.stdout:3/886: write d3/d18/d1a/fdd [1709500,31029] 0 2024-08-19T00:56:18.477 INFO:tasks.workunit.client.1.smithi086.stdout:8/878: mkdir dc/d16/d18/d106/d28/d41/d11e 0 2024-08-19T00:56:18.478 INFO:tasks.workunit.client.0.smithi017.stdout:5/312: dwrite db/d19/d1f/d15/d1e/f3f [0,4194304] 0 2024-08-19T00:56:18.480 INFO:tasks.workunit.client.0.smithi017.stdout:9/421: truncate d0/d58/d49/f76 1898409 0 2024-08-19T00:56:18.481 INFO:tasks.workunit.client.0.smithi017.stdout:9/422: fdatasync d0/d33/f71 0 2024-08-19T00:56:18.483 INFO:tasks.workunit.client.0.smithi017.stdout:9/423: chown d0/d33/d22/l24 0 1 2024-08-19T00:56:18.484 INFO:tasks.workunit.client.0.smithi017.stdout:5/313: dread db/d19/d1f/d15/d3e/d40/d49/f69 [0,4194304] 0 2024-08-19T00:56:18.486 INFO:tasks.workunit.client.0.smithi017.stdout:5/314: truncate db/d19/d1f/f68 802728 0 2024-08-19T00:56:18.488 INFO:tasks.workunit.client.1.smithi086.stdout:4/846: creat d2/d18/d33/d42/d72/d78/d25/d30/d5d/da2/f11a x:0 0 0 2024-08-19T00:56:18.490 INFO:tasks.workunit.client.1.smithi086.stdout:0/879: rename da/d14/l47 to da/d115/d3b/d4e/dda/dea/l118 0 2024-08-19T00:56:18.491 INFO:tasks.workunit.client.0.smithi017.stdout:7/461: readlink d3/dc/d5f/l75 0 2024-08-19T00:56:18.492 INFO:tasks.workunit.client.0.smithi017.stdout:4/446: write d2/d11/f14 [1267282,99525] 0 2024-08-19T00:56:18.493 INFO:tasks.workunit.client.1.smithi086.stdout:4/847: dwrite d2/d18/d33/d42/d72/d78/d25/f58 [0,4194304] 0 2024-08-19T00:56:18.496 INFO:tasks.workunit.client.1.smithi086.stdout:8/879: readlink dc/d17/d86/lb0 0 2024-08-19T00:56:18.497 INFO:tasks.workunit.client.1.smithi086.stdout:4/848: stat d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/f74 0 2024-08-19T00:56:18.502 INFO:tasks.workunit.client.1.smithi086.stdout:6/895: truncate db/d34/d4e/d68/d99/dce/f108 619990 0 2024-08-19T00:56:18.503 INFO:tasks.workunit.client.0.smithi017.stdout:2/494: dwrite d2/d7/d10/d35/d55/f6f [0,4194304] 0 2024-08-19T00:56:18.504 INFO:tasks.workunit.client.1.smithi086.stdout:7/878: mknod d3/d5b/c123 0 2024-08-19T00:56:18.505 INFO:tasks.workunit.client.1.smithi086.stdout:7/879: chown d3/d34/d44/f37 947 1 2024-08-19T00:56:18.506 INFO:tasks.workunit.client.0.smithi017.stdout:5/315: creat db/d19/d1f/d15/d3e/f70 x:0 0 0 2024-08-19T00:56:18.508 INFO:tasks.workunit.client.0.smithi017.stdout:7/462: rename d3/dc/df/d1c/d2c/f61 to d3/dc/d5f/f89 0 2024-08-19T00:56:18.510 INFO:tasks.workunit.client.1.smithi086.stdout:2/937: truncate d8/d14/f2f 6944256 0 2024-08-19T00:56:18.510 INFO:tasks.workunit.client.0.smithi017.stdout:4/447: unlink d2/d27/l83 0 2024-08-19T00:56:18.512 INFO:tasks.workunit.client.1.smithi086.stdout:0/880: creat da/d115/d3b/d4e/f119 x:0 0 0 2024-08-19T00:56:18.514 INFO:tasks.workunit.client.1.smithi086.stdout:3/887: fsync d3/d18/d19/dbc/fb6 0 2024-08-19T00:56:18.515 INFO:tasks.workunit.client.1.smithi086.stdout:3/888: dread - d3/d18/d19/dbc/db8/dc9/f10e zero size 2024-08-19T00:56:18.516 INFO:tasks.workunit.client.1.smithi086.stdout:3/889: truncate d3/d9/f102 7969 0 2024-08-19T00:56:18.517 INFO:tasks.workunit.client.1.smithi086.stdout:8/880: mknod dc/d1f/dc9/c11f 0 2024-08-19T00:56:18.518 INFO:tasks.workunit.client.1.smithi086.stdout:9/905: write db/d26/d5c/d87/d30/d31/d103/d19/d18/fd6 [736914,6729] 0 2024-08-19T00:56:18.518 INFO:tasks.workunit.client.0.smithi017.stdout:2/495: write d2/fa [123517,55378] 0 2024-08-19T00:56:18.520 INFO:tasks.workunit.client.0.smithi017.stdout:5/316: creat db/d19/d1f/d15/d3e/d40/f71 x:0 0 0 2024-08-19T00:56:18.521 INFO:tasks.workunit.client.1.smithi086.stdout:5/892: write d0/d2d/d43/d91/f98 [1306900,33606] 0 2024-08-19T00:56:18.526 INFO:tasks.workunit.client.0.smithi017.stdout:2/496: dwrite d2/d7/d10/f3e [0,4194304] 0 2024-08-19T00:56:18.527 INFO:tasks.workunit.client.0.smithi017.stdout:7/463: mknod d3/c8a 0 2024-08-19T00:56:18.528 INFO:tasks.workunit.client.0.smithi017.stdout:9/424: dwrite d0/d33/f1b [4194304,4194304] 0 2024-08-19T00:56:18.528 INFO:tasks.workunit.client.1.smithi086.stdout:0/881: creat da/d5d/f11a x:0 0 0 2024-08-19T00:56:18.528 INFO:tasks.workunit.client.1.smithi086.stdout:0/882: chown da/d14/ce2 789359 1 2024-08-19T00:56:18.538 INFO:tasks.workunit.client.0.smithi017.stdout:1/353: sync 2024-08-19T00:56:18.539 INFO:tasks.workunit.client.0.smithi017.stdout:2/497: mkdir d2/d7/d10/d9f 0 2024-08-19T00:56:18.544 INFO:tasks.workunit.client.0.smithi017.stdout:4/448: truncate d2/d21/d53/f5e 3279770 0 2024-08-19T00:56:18.546 INFO:tasks.workunit.client.1.smithi086.stdout:1/993: rename d4/d10/d90/ld3 to d4/l140 0 2024-08-19T00:56:18.546 INFO:tasks.workunit.client.1.smithi086.stdout:2/938: rename d8 to d8/d14/dae/d12e/d13c 22 2024-08-19T00:56:18.547 INFO:tasks.workunit.client.0.smithi017.stdout:7/464: creat d3/d3c/d88/f8b x:0 0 0 2024-08-19T00:56:18.550 INFO:tasks.workunit.client.0.smithi017.stdout:1/354: mknod d4/dc/c64 0 2024-08-19T00:56:18.550 INFO:tasks.workunit.client.0.smithi017.stdout:2/498: mkdir d2/d7/d10/d35/da0 0 2024-08-19T00:56:18.551 INFO:tasks.workunit.client.0.smithi017.stdout:4/449: dwrite d2/d1a/d55/d73/f81 [0,4194304] 0 2024-08-19T00:56:18.553 INFO:tasks.workunit.client.1.smithi086.stdout:1/994: dwrite d4/d7/d2a/d36/d50/d9c/ded/d11c/f133 [0,4194304] 0 2024-08-19T00:56:18.553 INFO:tasks.workunit.client.0.smithi017.stdout:9/425: rename d0/d33/d22/d52/c63 to d0/d33/c7e 0 2024-08-19T00:56:18.553 INFO:tasks.workunit.client.1.smithi086.stdout:7/880: creat d3/d34/d44/d58/d4b/da5/f124 x:0 0 0 2024-08-19T00:56:18.556 INFO:tasks.workunit.client.1.smithi086.stdout:3/890: rename d3/d18/d1a/fdd to d3/d26/d2b/d33/d4a/f120 0 2024-08-19T00:56:18.559 INFO:tasks.workunit.client.0.smithi017.stdout:4/450: dwrite d2/d16/d70/f80 [0,4194304] 0 2024-08-19T00:56:18.562 INFO:tasks.workunit.client.1.smithi086.stdout:8/881: link dc/d1f/d37/la3 dc/d1f/d37/d9f/l120 0 2024-08-19T00:56:18.564 INFO:tasks.workunit.client.1.smithi086.stdout:4/849: dwrite d2/d18/dbd/fd9 [0,4194304] 0 2024-08-19T00:56:18.564 INFO:tasks.workunit.client.1.smithi086.stdout:6/896: truncate db/d34/d4e/fd2 4192177 0 2024-08-19T00:56:18.566 INFO:tasks.workunit.client.1.smithi086.stdout:9/906: dread f7 [4194304,4194304] 0 2024-08-19T00:56:18.566 INFO:tasks.workunit.client.0.smithi017.stdout:1/355: creat d4/dc/d17/d1d/f65 x:0 0 0 2024-08-19T00:56:18.570 INFO:tasks.workunit.client.0.smithi017.stdout:2/499: write d2/d7/d10/d35/d84/f94 [2321608,30945] 0 2024-08-19T00:56:18.572 INFO:tasks.workunit.client.0.smithi017.stdout:7/465: mkdir d3/dc/df/d23/d8c 0 2024-08-19T00:56:18.574 INFO:tasks.workunit.client.1.smithi086.stdout:0/883: dread da/d14/d55/d10c/f54 [0,4194304] 0 2024-08-19T00:56:18.575 INFO:tasks.workunit.client.0.smithi017.stdout:9/426: mknod d0/d58/d49/c7f 0 2024-08-19T00:56:18.576 INFO:tasks.workunit.client.0.smithi017.stdout:9/427: chown d0/d58/d49/f6d 206069111 1 2024-08-19T00:56:18.576 INFO:tasks.workunit.client.1.smithi086.stdout:7/881: mkdir d3/d34/df2/d125 0 2024-08-19T00:56:18.578 INFO:tasks.workunit.client.1.smithi086.stdout:7/882: write d3/d34/d44/d58/d4b/da5/daf/de7/df5/f86 [3496937,75608] 0 2024-08-19T00:56:18.579 INFO:tasks.workunit.client.0.smithi017.stdout:5/317: link db/d19/d1f/l32 db/l72 0 2024-08-19T00:56:18.582 INFO:tasks.workunit.client.0.smithi017.stdout:4/451: unlink d2/d1a/d55/d73/c76 0 2024-08-19T00:56:18.583 INFO:tasks.workunit.client.1.smithi086.stdout:2/939: symlink d8/d2c/d38/d80/dca/dd6/l13d 0 2024-08-19T00:56:18.585 INFO:tasks.workunit.client.0.smithi017.stdout:2/500: symlink d2/d7/d10/la1 0 2024-08-19T00:56:18.587 INFO:tasks.workunit.client.1.smithi086.stdout:8/882: rename dc/d17/d1e/d55/c5d to dc/d16/d18/d106/d83/c121 0 2024-08-19T00:56:18.588 INFO:tasks.workunit.client.1.smithi086.stdout:8/883: chown dc/d16/d18/d106/d28/d2b/fa5 110 1 2024-08-19T00:56:18.589 INFO:tasks.workunit.client.1.smithi086.stdout:8/884: stat dc/d1f/d37/d4f/dac/fbd 0 2024-08-19T00:56:18.589 INFO:tasks.workunit.client.1.smithi086.stdout:6/897: symlink db/d37/d44/d5a/d78/l117 0 2024-08-19T00:56:18.590 INFO:tasks.workunit.client.0.smithi017.stdout:4/452: dwrite d2/d27/f62 [0,4194304] 0 2024-08-19T00:56:18.590 INFO:tasks.workunit.client.0.smithi017.stdout:4/453: stat d2/f61 0 2024-08-19T00:56:18.593 INFO:tasks.workunit.client.0.smithi017.stdout:5/318: rmdir db/d19/d1f/d15 39 2024-08-19T00:56:18.597 INFO:tasks.workunit.client.1.smithi086.stdout:3/891: dread d3/d9/f13 [0,4194304] 0 2024-08-19T00:56:18.599 INFO:tasks.workunit.client.1.smithi086.stdout:5/893: getdents d0/df/d1f/d65 0 2024-08-19T00:56:18.600 INFO:tasks.workunit.client.0.smithi017.stdout:2/501: mkdir d2/d7/d10/d3b/d80/da2 0 2024-08-19T00:56:18.601 INFO:tasks.workunit.client.1.smithi086.stdout:0/884: mknod da/d5d/df7/c11b 0 2024-08-19T00:56:18.602 INFO:tasks.workunit.client.0.smithi017.stdout:9/428: symlink d0/d58/l80 0 2024-08-19T00:56:18.603 INFO:tasks.workunit.client.0.smithi017.stdout:9/429: truncate d0/f65 1167414 0 2024-08-19T00:56:18.604 INFO:tasks.workunit.client.0.smithi017.stdout:4/454: mkdir d2/d21/d40/d56/d99 0 2024-08-19T00:56:18.605 INFO:tasks.workunit.client.1.smithi086.stdout:3/892: dwrite d3/d18/d19/dbc/fa0 [0,4194304] 0 2024-08-19T00:56:18.607 INFO:tasks.workunit.client.1.smithi086.stdout:2/940: symlink d8/d24/d32/d4d/d6a/l13e 0 2024-08-19T00:56:18.609 INFO:tasks.workunit.client.1.smithi086.stdout:2/941: read - d8/d43/fac zero size 2024-08-19T00:56:18.610 INFO:tasks.workunit.client.1.smithi086.stdout:8/885: mkdir dc/d17/d1e/d55/d122 0 2024-08-19T00:56:18.613 INFO:tasks.workunit.client.1.smithi086.stdout:0/885: dwrite da/d14/d55/d10c/d2e/d30/d76/fde [0,4194304] 0 2024-08-19T00:56:18.613 INFO:tasks.workunit.client.1.smithi086.stdout:1/995: dwrite d4/d7/d2a/d36/d63/f80 [0,4194304] 0 2024-08-19T00:56:18.614 INFO:tasks.workunit.client.0.smithi017.stdout:9/430: truncate d0/d33/d22/f2f 1200886 0 2024-08-19T00:56:18.614 INFO:tasks.workunit.client.0.smithi017.stdout:9/431: stat d0/d58/f66 0 2024-08-19T00:56:18.615 INFO:tasks.workunit.client.1.smithi086.stdout:4/850: write d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/faa [334805,123138] 0 2024-08-19T00:56:18.616 INFO:tasks.workunit.client.0.smithi017.stdout:1/356: write d4/d1c/f2a [1185298,60697] 0 2024-08-19T00:56:18.616 INFO:tasks.workunit.client.1.smithi086.stdout:0/886: read da/d115/f85 [1359474,35113] 0 2024-08-19T00:56:18.617 INFO:tasks.workunit.client.1.smithi086.stdout:9/907: mkdir db/d26/d5c/d87/d30/d128 0 2024-08-19T00:56:18.618 INFO:tasks.workunit.client.0.smithi017.stdout:7/466: dwrite d3/dc/df/d1c/d2c/d2f/f56 [0,4194304] 0 2024-08-19T00:56:18.619 INFO:tasks.workunit.client.0.smithi017.stdout:2/502: symlink d2/d7/la3 0 2024-08-19T00:56:18.625 INFO:tasks.workunit.client.1.smithi086.stdout:5/894: creat d0/df/d1f/d65/dfd/f118 x:0 0 0 2024-08-19T00:56:18.626 INFO:tasks.workunit.client.1.smithi086.stdout:7/883: fdatasync d3/de/d2d/f31 0 2024-08-19T00:56:18.627 INFO:tasks.workunit.client.1.smithi086.stdout:3/893: creat d3/d18/d19/dbc/de1/f121 x:0 0 0 2024-08-19T00:56:18.629 INFO:tasks.workunit.client.0.smithi017.stdout:1/357: rename d4/dc/d17/d1d/l59 to d4/d1c/d1f/l66 0 2024-08-19T00:56:18.630 INFO:tasks.workunit.client.0.smithi017.stdout:2/503: dwrite d2/d7/d10/d3b/d69/f70 [0,4194304] 0 2024-08-19T00:56:18.630 INFO:tasks.workunit.client.1.smithi086.stdout:0/887: dwrite da/d14/d44/f98 [0,4194304] 0 2024-08-19T00:56:18.633 INFO:tasks.workunit.client.0.smithi017.stdout:2/504: read d2/d7/f21 [1525702,25716] 0 2024-08-19T00:56:18.633 INFO:tasks.workunit.client.1.smithi086.stdout:6/898: mknod db/d8e/dcb/c118 0 2024-08-19T00:56:18.634 INFO:tasks.workunit.client.0.smithi017.stdout:7/467: mknod d3/dc/df/d1c/d2c/d2f/c8d 0 2024-08-19T00:56:18.635 INFO:tasks.workunit.client.1.smithi086.stdout:6/899: dread - db/d37/d41/f106 zero size 2024-08-19T00:56:18.636 INFO:tasks.workunit.client.1.smithi086.stdout:6/900: write db/f46 [653830,107997] 0 2024-08-19T00:56:18.639 INFO:tasks.workunit.client.1.smithi086.stdout:2/942: mkdir d8/d24/d32/d4d/d6a/db1/d13f 0 2024-08-19T00:56:18.643 INFO:tasks.workunit.client.0.smithi017.stdout:2/505: dwrite d2/d7/d10/d3b/d69/f70 [0,4194304] 0 2024-08-19T00:56:18.645 INFO:tasks.workunit.client.1.smithi086.stdout:4/851: dread d2/f21 [0,4194304] 0 2024-08-19T00:56:18.650 INFO:tasks.workunit.client.1.smithi086.stdout:9/908: creat db/d26/d5c/d87/d30/d31/d103/d19/d18/db9/f129 x:0 0 0 2024-08-19T00:56:18.651 INFO:tasks.workunit.client.0.smithi017.stdout:5/319: write db/d19/d1f/f1c [1480555,32757] 0 2024-08-19T00:56:18.654 INFO:tasks.workunit.client.0.smithi017.stdout:1/358: creat d4/dc/d3b/d3d/d54/f67 x:0 0 0 2024-08-19T00:56:18.655 INFO:tasks.workunit.client.1.smithi086.stdout:9/909: dread db/d26/d5c/d87/d30/d31/d103/d19/d18/fd6 [0,4194304] 0 2024-08-19T00:56:18.657 INFO:tasks.workunit.client.1.smithi086.stdout:5/895: dread d0/d2d/f32 [0,4194304] 0 2024-08-19T00:56:18.661 INFO:tasks.workunit.client.0.smithi017.stdout:2/506: rename d2/d7/d10/d19/l6 to d2/d7/d10/d35/d45/d58/la4 0 2024-08-19T00:56:18.662 INFO:tasks.workunit.client.1.smithi086.stdout:2/943: mkdir d8/d2c/d38/d80/d140 0 2024-08-19T00:56:18.663 INFO:tasks.workunit.client.1.smithi086.stdout:6/901: dread db/d37/d30/f33 [4194304,4194304] 0 2024-08-19T00:56:18.663 INFO:tasks.workunit.client.0.smithi017.stdout:5/320: unlink db/l29 0 2024-08-19T00:56:18.664 INFO:tasks.workunit.client.1.smithi086.stdout:5/896: dwrite d0/d5f/d60/d57/f84 [0,4194304] 0 2024-08-19T00:56:18.664 INFO:tasks.workunit.client.1.smithi086.stdout:5/897: readlink d0/d99/dc0/dc2/l89 0 2024-08-19T00:56:18.665 INFO:tasks.workunit.client.0.smithi017.stdout:5/321: chown db/d19/d33/c4d 54853 1 2024-08-19T00:56:18.665 INFO:tasks.workunit.client.1.smithi086.stdout:1/996: unlink d4/d7/d2a/d36/d3a/de5/d7a/ca9 0 2024-08-19T00:56:18.665 INFO:tasks.workunit.client.1.smithi086.stdout:5/898: fdatasync d0/df/d1f/d65/dfd/f54 0 2024-08-19T00:56:18.666 INFO:tasks.workunit.client.0.smithi017.stdout:1/359: truncate d4/ff 2387411 0 2024-08-19T00:56:18.668 INFO:tasks.workunit.client.1.smithi086.stdout:4/852: write d2/d18/d33/d42/d72/d2f/fdd [8819566,48825] 0 2024-08-19T00:56:18.668 INFO:tasks.workunit.client.0.smithi017.stdout:2/507: dwrite d2/d7/d10/d19/f7b [0,4194304] 0 2024-08-19T00:56:18.668 INFO:tasks.workunit.client.0.smithi017.stdout:1/360: fdatasync d4/dc/d3b/d3d/d54/f67 0 2024-08-19T00:56:18.669 INFO:tasks.workunit.client.1.smithi086.stdout:4/853: fsync d2/d18/d33/d42/d72/d78/d2c/ff3 0 2024-08-19T00:56:18.674 INFO:tasks.workunit.client.1.smithi086.stdout:7/884: rename d3/de/d2d/f32 to d3/d34/d44/d58/f126 0 2024-08-19T00:56:18.676 INFO:tasks.workunit.client.0.smithi017.stdout:1/361: write d4/f13 [8177563,33912] 0 2024-08-19T00:56:18.677 INFO:tasks.workunit.client.1.smithi086.stdout:9/910: mknod db/d96/de1/c12a 0 2024-08-19T00:56:18.677 INFO:tasks.workunit.client.0.smithi017.stdout:4/455: truncate d2/d16/d70/f80 2708490 0 2024-08-19T00:56:18.678 INFO:tasks.workunit.client.0.smithi017.stdout:4/456: readlink d2/d21/d53/d57/l93 0 2024-08-19T00:56:18.680 INFO:tasks.workunit.client.0.smithi017.stdout:5/322: creat db/d19/d1f/d15/d1e/d5f/f73 x:0 0 0 2024-08-19T00:56:18.681 INFO:tasks.workunit.client.0.smithi017.stdout:5/323: readlink db/d19/l62 0 2024-08-19T00:56:18.681 INFO:tasks.workunit.client.0.smithi017.stdout:1/362: mknod d4/dc/d3b/d3d/c68 0 2024-08-19T00:56:18.684 INFO:tasks.workunit.client.0.smithi017.stdout:5/324: fsync db/d19/d1f/d15/d3e/d40/f71 0 2024-08-19T00:56:18.685 INFO:tasks.workunit.client.1.smithi086.stdout:2/944: fsync d8/d43/fa1 0 2024-08-19T00:56:18.686 INFO:tasks.workunit.client.0.smithi017.stdout:7/468: dread d3/dc/df/d1c/f3e [4194304,4194304] 0 2024-08-19T00:56:18.686 INFO:tasks.workunit.client.1.smithi086.stdout:2/945: write d8/d2c/d67/f6f [834219,41584] 0 2024-08-19T00:56:18.687 INFO:tasks.workunit.client.0.smithi017.stdout:5/325: write db/f2e [1177236,8978] 0 2024-08-19T00:56:18.687 INFO:tasks.workunit.client.0.smithi017.stdout:4/457: dwrite d2/d16/f38 [0,4194304] 0 2024-08-19T00:56:18.687 INFO:tasks.workunit.client.1.smithi086.stdout:2/946: chown d8/d24/d32/f139 11744354 1 2024-08-19T00:56:18.687 INFO:tasks.workunit.client.1.smithi086.stdout:6/902: truncate db/d37/d44/f80 1330756 0 2024-08-19T00:56:18.689 INFO:tasks.workunit.client.1.smithi086.stdout:2/947: chown d8/d2c/d38/d80/dca/df9/ffa 81 1 2024-08-19T00:56:18.689 INFO:tasks.workunit.client.1.smithi086.stdout:6/903: write db/d34/d4e/fcd [2650173,27950] 0 2024-08-19T00:56:18.690 INFO:tasks.workunit.client.0.smithi017.stdout:4/458: dread - d2/d1a/d55/d64/f94 zero size 2024-08-19T00:56:18.692 INFO:tasks.workunit.client.0.smithi017.stdout:2/508: creat d2/d7/fa5 x:0 0 0 2024-08-19T00:56:18.694 INFO:tasks.workunit.client.0.smithi017.stdout:4/459: write d2/d1a/d55/d64/f94 [93467,103923] 0 2024-08-19T00:56:18.696 INFO:tasks.workunit.client.1.smithi086.stdout:1/997: unlink d4/d7/d2a/d36/d50/ld4 0 2024-08-19T00:56:18.696 INFO:tasks.workunit.client.0.smithi017.stdout:1/363: dwrite d4/dc/d3b/f4a [0,4194304] 0 2024-08-19T00:56:18.704 INFO:tasks.workunit.client.0.smithi017.stdout:7/469: mknod d3/dc/df/d1c/d2c/d83/c8e 0 2024-08-19T00:56:18.708 INFO:tasks.workunit.client.1.smithi086.stdout:0/888: rename da/d5d/f95 to da/d14/d44/d49/f11c 0 2024-08-19T00:56:18.709 INFO:tasks.workunit.client.0.smithi017.stdout:4/460: truncate d2/f12 7326241 0 2024-08-19T00:56:18.709 INFO:tasks.workunit.client.1.smithi086.stdout:3/894: write d3/d18/d19/d37/f84 [2065465,52270] 0 2024-08-19T00:56:18.710 INFO:tasks.workunit.client.1.smithi086.stdout:3/895: stat d3/d18/d19/dbc/db8/f21 0 2024-08-19T00:56:18.710 INFO:tasks.workunit.client.0.smithi017.stdout:4/461: rename d2/d21/d40 to d2/d21/d40/d9a 22 2024-08-19T00:56:18.710 INFO:tasks.workunit.client.1.smithi086.stdout:9/911: symlink db/d26/d5c/d87/d30/d31/d103/d19/d38/l12b 0 2024-08-19T00:56:18.711 INFO:tasks.workunit.client.0.smithi017.stdout:4/462: dread - d2/d16/f6f zero size 2024-08-19T00:56:18.713 INFO:tasks.workunit.client.0.smithi017.stdout:1/364: rmdir d4/dc/d3b/d3d/d54 39 2024-08-19T00:56:18.716 INFO:tasks.workunit.client.1.smithi086.stdout:9/912: dwrite db/d26/d5c/d87/d6d/deb/f10a [0,4194304] 0 2024-08-19T00:56:18.721 INFO:tasks.workunit.client.1.smithi086.stdout:2/948: write d8/d14/f88 [332441,114395] 0 2024-08-19T00:56:18.725 INFO:tasks.workunit.client.1.smithi086.stdout:3/896: dread d3/d18/d19/dbc/f65 [0,4194304] 0 2024-08-19T00:56:18.729 INFO:tasks.workunit.client.0.smithi017.stdout:1/365: creat d4/dc/d3b/d55/f69 x:0 0 0 2024-08-19T00:56:18.731 INFO:tasks.workunit.client.0.smithi017.stdout:5/326: creat db/d19/d1f/f74 x:0 0 0 2024-08-19T00:56:18.733 INFO:tasks.workunit.client.1.smithi086.stdout:4/854: rename d2/d18/d33/d42/d72/d78/d25/l108 to d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/l11b 0 2024-08-19T00:56:18.734 INFO:tasks.workunit.client.1.smithi086.stdout:8/886: sync 2024-08-19T00:56:18.735 INFO:tasks.workunit.client.1.smithi086.stdout:8/887: fdatasync dc/d1f/dc9/ffc 0 2024-08-19T00:56:18.738 INFO:tasks.workunit.client.1.smithi086.stdout:5/899: write d0/d5f/d60/d57/d80/da3/fba [1674242,12093] 0 2024-08-19T00:56:18.738 INFO:tasks.workunit.client.0.smithi017.stdout:1/366: mkdir d4/dc/d3b/d55/d6a 0 2024-08-19T00:56:18.739 INFO:tasks.workunit.client.1.smithi086.stdout:2/949: dread d8/d24/d32/f4f [0,4194304] 0 2024-08-19T00:56:18.740 INFO:tasks.workunit.client.0.smithi017.stdout:1/367: truncate d4/dc/d17/d1d/f65 814819 0 2024-08-19T00:56:18.741 INFO:tasks.workunit.client.0.smithi017.stdout:5/327: truncate fa 3952436 0 2024-08-19T00:56:18.741 INFO:tasks.workunit.client.0.smithi017.stdout:1/368: chown d4/f13 3 1 2024-08-19T00:56:18.742 INFO:tasks.workunit.client.0.smithi017.stdout:5/328: fsync db/d19/d1f/d15/d3e/d40/f6e 0 2024-08-19T00:56:18.744 INFO:tasks.workunit.client.1.smithi086.stdout:6/904: mknod db/d37/d30/c119 0 2024-08-19T00:56:18.746 INFO:tasks.workunit.client.0.smithi017.stdout:1/369: fdatasync d4/dc/f18 0 2024-08-19T00:56:18.748 INFO:tasks.workunit.client.1.smithi086.stdout:7/885: rename d3/de/d68/d7d/f102 to d3/d34/d44/d58/d4b/da5/daf/f127 0 2024-08-19T00:56:18.749 INFO:tasks.workunit.client.1.smithi086.stdout:4/855: mkdir d2/d18/d33/d42/d72/d78/d2c/d11c 0 2024-08-19T00:56:18.749 INFO:tasks.workunit.client.0.smithi017.stdout:5/329: dwrite db/d19/d1f/d15/d3e/d40/f71 [0,4194304] 0 2024-08-19T00:56:18.750 INFO:tasks.workunit.client.1.smithi086.stdout:6/905: dwrite db/f2b [4194304,4194304] 0 2024-08-19T00:56:18.750 INFO:tasks.workunit.client.0.smithi017.stdout:7/470: write d3/dc/df/d1a/f4a [1257558,44919] 0 2024-08-19T00:56:18.753 INFO:tasks.workunit.client.0.smithi017.stdout:2/509: truncate d2/d7/dd/f2f 3693348 0 2024-08-19T00:56:18.753 INFO:tasks.workunit.client.1.smithi086.stdout:4/856: read d2/d18/d33/d42/d72/ff [300262,56299] 0 2024-08-19T00:56:18.755 INFO:tasks.workunit.client.1.smithi086.stdout:4/857: chown d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/d85/fb5 0 1 2024-08-19T00:56:18.757 INFO:tasks.workunit.client.1.smithi086.stdout:8/888: creat dc/d1f/d37/d4f/dac/db8/d99/f123 x:0 0 0 2024-08-19T00:56:18.757 INFO:tasks.workunit.client.0.smithi017.stdout:1/370: dread d4/dc/d17/d1d/f3c [0,4194304] 0 2024-08-19T00:56:18.760 INFO:tasks.workunit.client.0.smithi017.stdout:7/471: write d3/f2e [1304569,99496] 0 2024-08-19T00:56:18.761 INFO:tasks.workunit.client.1.smithi086.stdout:1/998: dwrite d4/d7/d2a/d36/d50/d9c/ded/d11c/f13b [0,4194304] 0 2024-08-19T00:56:18.765 INFO:tasks.workunit.client.0.smithi017.stdout:5/330: creat db/d19/d1f/d15/d30/f75 x:0 0 0 2024-08-19T00:56:18.765 INFO:tasks.workunit.client.1.smithi086.stdout:6/906: dread db/d34/d39/d76/fb5 [0,4194304] 0 2024-08-19T00:56:18.766 INFO:tasks.workunit.client.0.smithi017.stdout:2/510: dwrite d2/d7/d10/d3b/d69/f70 [0,4194304] 0 2024-08-19T00:56:18.770 INFO:tasks.workunit.client.1.smithi086.stdout:2/950: unlink d8/d24/d32/d4d/d6a/db1/cfb 0 2024-08-19T00:56:18.771 INFO:tasks.workunit.client.1.smithi086.stdout:2/951: readlink d8/d43/d77/dcc/l11c 0 2024-08-19T00:56:18.773 INFO:tasks.workunit.client.0.smithi017.stdout:1/371: dwrite d4/d1c/f2a [0,4194304] 0 2024-08-19T00:56:18.776 INFO:tasks.workunit.client.1.smithi086.stdout:9/913: write db/d26/d5c/d87/d37/fdf [93522,103104] 0 2024-08-19T00:56:18.779 INFO:tasks.workunit.client.0.smithi017.stdout:2/511: dwrite d2/d7/fa5 [0,4194304] 0 2024-08-19T00:56:18.780 INFO:tasks.workunit.client.1.smithi086.stdout:1/999: dread d4/d7/d2a/f6b [0,4194304] 0 2024-08-19T00:56:18.780 INFO:tasks.workunit.client.1.smithi086.stdout:3/897: rename d3/d26/f73 to d3/d18/d19/dbc/d5d/f122 0 2024-08-19T00:56:18.781 INFO:tasks.workunit.client.0.smithi017.stdout:7/472: rmdir d3/dc/df/d37/d46/d73/d80 39 2024-08-19T00:56:18.782 INFO:tasks.workunit.client.1.smithi086.stdout:3/898: chown d3/d26/cc5 0 1 2024-08-19T00:56:18.783 INFO:tasks.workunit.client.1.smithi086.stdout:3/899: stat d3/d26/d60/lac 0 2024-08-19T00:56:18.783 INFO:tasks.workunit.client.0.smithi017.stdout:7/473: fdatasync d3/dc/df/d1c/d2c/d83/f86 0 2024-08-19T00:56:18.784 INFO:tasks.workunit.client.1.smithi086.stdout:7/886: symlink d3/da1/d108/l128 0 2024-08-19T00:56:18.788 INFO:tasks.workunit.client.1.smithi086.stdout:0/889: link da/d115/d3b/f106 da/d5d/df7/f11d 0 2024-08-19T00:56:18.789 INFO:tasks.workunit.client.1.smithi086.stdout:0/890: chown da/d5d/da9/d6a/ccd 6171830 1 2024-08-19T00:56:18.793 INFO:tasks.workunit.client.1.smithi086.stdout:8/889: truncate dc/f51 1138963 0 2024-08-19T00:56:18.794 INFO:tasks.workunit.client.0.smithi017.stdout:2/512: creat d2/d7/d10/d3b/d80/d81/fa6 x:0 0 0 2024-08-19T00:56:18.796 INFO:tasks.workunit.client.1.smithi086.stdout:5/900: link d0/df/d1f/d65/faa d0/d8/d10/f119 0 2024-08-19T00:56:18.798 INFO:tasks.workunit.client.0.smithi017.stdout:7/474: readlink d3/dc/df/d1c/d2c/l6c 0 2024-08-19T00:56:18.802 INFO:tasks.workunit.client.0.smithi017.stdout:2/513: dwrite d2/d7/d10/d3b/d3c/f40 [0,4194304] 0 2024-08-19T00:56:18.802 INFO:tasks.workunit.client.0.smithi017.stdout:4/463: read d2/d16/d70/f80 [1790652,21587] 0 2024-08-19T00:56:18.803 INFO:tasks.workunit.client.1.smithi086.stdout:2/952: creat d8/d2c/d47/d73/f141 x:0 0 0 2024-08-19T00:56:18.803 INFO:tasks.workunit.client.1.smithi086.stdout:2/953: chown d8/d14 7956 1 2024-08-19T00:56:18.804 INFO:tasks.workunit.client.0.smithi017.stdout:1/372: mknod d4/c6b 0 2024-08-19T00:56:18.805 INFO:tasks.workunit.client.1.smithi086.stdout:9/914: symlink db/d96/d102/l12c 0 2024-08-19T00:56:18.806 INFO:tasks.workunit.client.0.smithi017.stdout:4/464: dread d2/d1a/d55/d64/f94 [0,4194304] 0 2024-08-19T00:56:18.807 INFO:tasks.workunit.client.1.smithi086.stdout:7/887: symlink d3/de/d68/d72/l129 0 2024-08-19T00:56:18.809 INFO:tasks.workunit.client.0.smithi017.stdout:7/475: rmdir d3/dc/df/d23 39 2024-08-19T00:56:18.815 INFO:tasks.workunit.client.1.smithi086.stdout:0/891: creat da/d5d/da9/f11e x:0 0 0 2024-08-19T00:56:18.816 INFO:tasks.workunit.client.1.smithi086.stdout:0/892: fdatasync da/d5d/ff4 0 2024-08-19T00:56:18.817 INFO:tasks.workunit.client.0.smithi017.stdout:5/331: dwrite db/d19/d1f/d15/d30/f46 [0,4194304] 0 2024-08-19T00:56:18.819 INFO:tasks.workunit.client.0.smithi017.stdout:2/514: dread d2/d7/d10/d3b/d69/f7f [0,4194304] 0 2024-08-19T00:56:18.819 INFO:tasks.workunit.client.0.smithi017.stdout:5/332: write db/d19/d1f/d15/f5a [338181,125230] 0 2024-08-19T00:56:18.821 INFO:tasks.workunit.client.1.smithi086.stdout:0/893: dwrite da/d5d/da9/f112 [0,4194304] 0 2024-08-19T00:56:18.826 INFO:tasks.workunit.client.1.smithi086.stdout:6/907: truncate db/d37/d44/d5a/d8f/fd1 239723 0 2024-08-19T00:56:18.828 INFO:tasks.workunit.client.0.smithi017.stdout:1/373: getdents d4/dc/d3b/d55/d6a 0 2024-08-19T00:56:18.828 INFO:tasks.workunit.client.1.smithi086.stdout:6/908: chown db/d34/d4e/d68 2 1 2024-08-19T00:56:18.829 INFO:tasks.workunit.client.1.smithi086.stdout:6/909: stat db/d37/d41/dad/lb1 0 2024-08-19T00:56:18.830 INFO:tasks.workunit.client.1.smithi086.stdout:9/915: mkdir db/d26/d5c/d68/d12d 0 2024-08-19T00:56:18.832 INFO:tasks.workunit.client.1.smithi086.stdout:7/888: mknod d3/d34/d44/d58/d4b/d42/c12a 0 2024-08-19T00:56:18.832 INFO:tasks.workunit.client.1.smithi086.stdout:4/858: truncate d2/d18/d33/d42/d72/d78/d2c/db0/fc2 520933 0 2024-08-19T00:56:18.833 INFO:tasks.workunit.client.0.smithi017.stdout:4/465: symlink d2/d16/l9b 0 2024-08-19T00:56:18.835 INFO:tasks.workunit.client.0.smithi017.stdout:7/476: symlink d3/l8f 0 2024-08-19T00:56:18.837 INFO:tasks.workunit.client.0.smithi017.stdout:5/333: creat db/d19/d1f/d15/d3e/d40/d49/f76 x:0 0 0 2024-08-19T00:56:18.838 INFO:tasks.workunit.client.0.smithi017.stdout:2/515: dwrite d2/d7/d29/f31 [0,4194304] 0 2024-08-19T00:56:18.839 INFO:tasks.workunit.client.1.smithi086.stdout:8/890: creat dc/d1f/d113/f124 x:0 0 0 2024-08-19T00:56:18.843 INFO:tasks.workunit.client.1.smithi086.stdout:5/901: creat d0/d20/dfa/f11a x:0 0 0 2024-08-19T00:56:18.846 INFO:tasks.workunit.client.1.smithi086.stdout:2/954: creat d8/d84/de0/d114/f142 x:0 0 0 2024-08-19T00:56:18.849 INFO:tasks.workunit.client.1.smithi086.stdout:6/910: creat db/d37/d41/da7/f11a x:0 0 0 2024-08-19T00:56:18.850 INFO:tasks.workunit.client.1.smithi086.stdout:6/911: stat db/d34/d69/f7d 0 2024-08-19T00:56:18.850 INFO:tasks.workunit.client.1.smithi086.stdout:9/916: truncate db/d26/d5c/d87/f54 1520841 0 2024-08-19T00:56:18.851 INFO:tasks.workunit.client.1.smithi086.stdout:5/902: dwrite d0/df/d1f/d65/dfd/f118 [0,4194304] 0 2024-08-19T00:56:18.854 INFO:tasks.workunit.client.1.smithi086.stdout:7/889: symlink d3/d34/d44/d58/d4b/dcd/l12b 0 2024-08-19T00:56:18.855 INFO:tasks.workunit.client.0.smithi017.stdout:1/374: rename d4/dc/d17/d1d/l4e to d4/dc/l6c 0 2024-08-19T00:56:18.856 INFO:tasks.workunit.client.1.smithi086.stdout:7/890: truncate d3/d34/d44/d58/d4b/f116 184156 0 2024-08-19T00:56:18.857 INFO:tasks.workunit.client.1.smithi086.stdout:7/891: fdatasync d3/d34/d44/d58/d4b/f116 0 2024-08-19T00:56:18.858 INFO:tasks.workunit.client.1.smithi086.stdout:4/859: creat d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/f11d x:0 0 0 2024-08-19T00:56:18.858 INFO:tasks.workunit.client.1.smithi086.stdout:7/892: write d3/de/f66 [581234,42050] 0 2024-08-19T00:56:18.859 INFO:tasks.workunit.client.1.smithi086.stdout:3/900: link d3/d18/d19/d37/d3a/l92 d3/d18/d27/d49/d3f/d54/dfa/l123 0 2024-08-19T00:56:18.861 INFO:tasks.workunit.client.0.smithi017.stdout:7/477: rename d3/dc/df/d1c/d2c/d35 to d3/dc/df/d3d/d90 0 2024-08-19T00:56:18.864 INFO:tasks.workunit.client.1.smithi086.stdout:0/894: write da/d5d/f96 [5697,122201] 0 2024-08-19T00:56:18.865 INFO:tasks.workunit.client.0.smithi017.stdout:7/478: mknod d3/dc/df/d7d/c91 0 2024-08-19T00:56:18.867 INFO:tasks.workunit.client.0.smithi017.stdout:2/516: truncate d2/d7/f28 1800006 0 2024-08-19T00:56:18.869 INFO:tasks.workunit.client.0.smithi017.stdout:1/375: symlink d4/dc/d3b/d3d/d54/l6d 0 2024-08-19T00:56:18.870 INFO:tasks.workunit.client.0.smithi017.stdout:1/376: chown d4/f13 239 1 2024-08-19T00:56:18.871 INFO:tasks.workunit.client.0.smithi017.stdout:7/479: unlink d3/c8a 0 2024-08-19T00:56:18.872 INFO:tasks.workunit.client.0.smithi017.stdout:4/466: dwrite d2/d16/d70/f97 [0,4194304] 0 2024-08-19T00:56:18.873 INFO:tasks.workunit.client.0.smithi017.stdout:4/467: fsync d2/d16/f38 0 2024-08-19T00:56:18.879 INFO:tasks.workunit.client.0.smithi017.stdout:1/377: dwrite d4/d1c/f25 [0,4194304] 0 2024-08-19T00:56:18.879 INFO:tasks.workunit.client.0.smithi017.stdout:2/517: unlink d2/d7/d10/d3b/d69/f8b 0 2024-08-19T00:56:18.881 INFO:tasks.workunit.client.0.smithi017.stdout:2/518: read d2/d7/d10/d3b/d69/f70 [902036,100782] 0 2024-08-19T00:56:18.884 INFO:tasks.workunit.client.1.smithi086.stdout:5/903: rename d0/df to d0/d2d/d4f/df3/d11b 0 2024-08-19T00:56:18.889 INFO:tasks.workunit.client.0.smithi017.stdout:7/480: truncate d3/dc/f48 1341534 0 2024-08-19T00:56:18.890 INFO:tasks.workunit.client.0.smithi017.stdout:7/481: readlink d3/dc/df/d1c/l22 0 2024-08-19T00:56:18.890 INFO:tasks.workunit.client.1.smithi086.stdout:2/955: dwrite d8/d24/fc2 [0,4194304] 0 2024-08-19T00:56:18.891 INFO:tasks.workunit.client.0.smithi017.stdout:7/482: chown d3/dc/df/d1c/d2c 1 1 2024-08-19T00:56:18.893 INFO:tasks.workunit.client.1.smithi086.stdout:3/901: symlink d3/d26/d2b/d33/d4a/d57/db4/l124 0 2024-08-19T00:56:18.897 INFO:tasks.workunit.client.0.smithi017.stdout:1/378: rmdir d4/dc/d3b 39 2024-08-19T00:56:18.898 INFO:tasks.workunit.client.1.smithi086.stdout:0/895: mkdir da/d14/d55/d11f 0 2024-08-19T00:56:18.900 INFO:tasks.workunit.client.0.smithi017.stdout:2/519: unlink d2/d7/l16 0 2024-08-19T00:56:18.902 INFO:tasks.workunit.client.0.smithi017.stdout:7/483: mkdir d3/dc/df/d3d/d92 0 2024-08-19T00:56:18.905 INFO:tasks.workunit.client.1.smithi086.stdout:9/917: mknod db/d100/c12e 0 2024-08-19T00:56:18.906 INFO:tasks.workunit.client.1.smithi086.stdout:7/893: write d3/d34/d44/d58/d4b/da5/daf/de7/df5/d96/fb9 [845903,74826] 0 2024-08-19T00:56:18.906 INFO:tasks.workunit.client.0.smithi017.stdout:2/520: symlink d2/d7/d10/la7 0 2024-08-19T00:56:18.907 INFO:tasks.workunit.client.1.smithi086.stdout:7/894: fdatasync d3/d34/d44/d58/d4b/fbd 0 2024-08-19T00:56:18.908 INFO:tasks.workunit.client.1.smithi086.stdout:6/912: rename db/d37/d28/d7f/d96/dc2 to db/d37/d41/dad/d11b 0 2024-08-19T00:56:18.909 INFO:tasks.workunit.client.1.smithi086.stdout:5/904: symlink d0/d2d/d4f/df3/l11c 0 2024-08-19T00:56:18.910 INFO:tasks.workunit.client.0.smithi017.stdout:4/468: creat d2/d11/f9c x:0 0 0 2024-08-19T00:56:18.910 INFO:tasks.workunit.client.1.smithi086.stdout:5/905: write d0/d2d/d43/d91/fbd [5108217,67303] 0 2024-08-19T00:56:18.911 INFO:tasks.workunit.client.0.smithi017.stdout:4/469: fsync d2/d1a/d20/f8c 0 2024-08-19T00:56:18.912 INFO:tasks.workunit.client.1.smithi086.stdout:5/906: write d0/d2d/d4f/df3/d11b/d1f/d33/f34 [4693889,99208] 0 2024-08-19T00:56:18.913 INFO:tasks.workunit.client.1.smithi086.stdout:6/913: dread db/d8e/fd6 [0,4194304] 0 2024-08-19T00:56:18.914 INFO:tasks.workunit.client.0.smithi017.stdout:2/521: symlink d2/d7/d10/d3b/d54/la8 0 2024-08-19T00:56:18.917 INFO:tasks.workunit.client.0.smithi017.stdout:7/484: mkdir d3/dc/df/d37/d93 0 2024-08-19T00:56:18.918 INFO:tasks.workunit.client.1.smithi086.stdout:9/918: mkdir db/d26/d5c/d87/d6d/d9f/d12f 0 2024-08-19T00:56:18.918 INFO:tasks.workunit.client.0.smithi017.stdout:7/485: read d3/dc/d5f/f63 [108875,879] 0 2024-08-19T00:56:18.918 INFO:tasks.workunit.client.0.smithi017.stdout:4/470: mkdir d2/d21/d53/d57/d9d 0 2024-08-19T00:56:18.918 INFO:tasks.workunit.client.0.smithi017.stdout:4/471: chown d2/d1a/f69 12742309 1 2024-08-19T00:56:18.920 INFO:tasks.workunit.client.0.smithi017.stdout:1/379: mknod d4/dc/d3b/d3d/c6e 0 2024-08-19T00:56:18.921 INFO:tasks.workunit.client.0.smithi017.stdout:1/380: write d4/d1c/f25 [9753639,10643] 0 2024-08-19T00:56:18.922 INFO:tasks.workunit.client.1.smithi086.stdout:4/860: rename d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd/fe5 to d2/d18/d33/d42/d72/d78/d2c/dae/f11e 0 2024-08-19T00:56:18.924 INFO:tasks.workunit.client.0.smithi017.stdout:2/522: creat d2/d7/d10/d35/d45/fa9 x:0 0 0 2024-08-19T00:56:18.929 INFO:tasks.workunit.client.0.smithi017.stdout:4/472: symlink d2/d1a/d55/d73/l9e 0 2024-08-19T00:56:18.929 INFO:tasks.workunit.client.1.smithi086.stdout:9/919: dread db/daf/fd8 [0,4194304] 0 2024-08-19T00:56:18.930 INFO:tasks.workunit.client.1.smithi086.stdout:3/902: mknod d3/d18/d19/dbc/db8/dc9/dd4/c125 0 2024-08-19T00:56:18.931 INFO:tasks.workunit.client.1.smithi086.stdout:8/891: getdents dc/d16/d18/d106/d28/d2b/d3b 0 2024-08-19T00:56:18.931 INFO:tasks.workunit.client.0.smithi017.stdout:1/381: creat d4/dc/d3b/d55/f6f x:0 0 0 2024-08-19T00:56:18.932 INFO:tasks.workunit.client.1.smithi086.stdout:5/907: symlink d0/d20/l11d 0 2024-08-19T00:56:18.934 INFO:tasks.workunit.client.1.smithi086.stdout:6/914: creat db/d37/d41/dad/d11b/de9/f11c x:0 0 0 2024-08-19T00:56:18.935 INFO:tasks.workunit.client.1.smithi086.stdout:0/896: unlink da/c1f 0 2024-08-19T00:56:18.940 INFO:tasks.workunit.client.0.smithi017.stdout:4/473: rename d2/d16/d70/f97 to d2/d21/d53/d57/f9f 0 2024-08-19T00:56:18.940 INFO:tasks.workunit.client.0.smithi017.stdout:4/474: write d2/d16/f1f [1906892,31061] 0 2024-08-19T00:56:18.942 INFO:tasks.workunit.client.1.smithi086.stdout:2/956: rename d8/d2c/c44 to d8/d24/d32/d4d/d128/c143 0 2024-08-19T00:56:18.942 INFO:tasks.workunit.client.1.smithi086.stdout:2/957: fdatasync d8/f1e 0 2024-08-19T00:56:18.945 INFO:tasks.workunit.client.0.smithi017.stdout:7/486: creat d3/dc/df/d37/f94 x:0 0 0 2024-08-19T00:56:18.946 INFO:tasks.workunit.client.0.smithi017.stdout:7/487: chown d3/dc/df 40103 1 2024-08-19T00:56:18.948 INFO:tasks.workunit.client.1.smithi086.stdout:9/920: truncate db/d26/d5c/d87/fc0 2351677 0 2024-08-19T00:56:18.950 INFO:tasks.workunit.client.1.smithi086.stdout:8/892: unlink dc/d1f/fe8 0 2024-08-19T00:56:18.951 INFO:tasks.workunit.client.1.smithi086.stdout:3/903: truncate d3/d18/d19/dbc/f65 4881743 0 2024-08-19T00:56:18.952 INFO:tasks.workunit.client.1.smithi086.stdout:3/904: fsync d3/d18/d27/d49/d3f/d5b/d66/fd9 0 2024-08-19T00:56:18.959 INFO:tasks.workunit.client.0.smithi017.stdout:7/488: dread d3/dc/f48 [0,4194304] 0 2024-08-19T00:56:18.962 INFO:tasks.workunit.client.0.smithi017.stdout:1/382: creat d4/d1c/f70 x:0 0 0 2024-08-19T00:56:18.967 INFO:tasks.workunit.client.0.smithi017.stdout:7/489: dwrite d3/dc/df/d37/d46/f6e [0,4194304] 0 2024-08-19T00:56:18.969 INFO:tasks.workunit.client.0.smithi017.stdout:7/490: write d3/dc/df/d1c/d2c/d2f/f56 [4031876,45975] 0 2024-08-19T00:56:18.969 INFO:tasks.workunit.client.1.smithi086.stdout:7/895: rename d3/d34/cae to d3/de/d68/d7d/c12c 0 2024-08-19T00:56:18.973 INFO:tasks.workunit.client.1.smithi086.stdout:2/958: creat d8/d84/d79/f144 x:0 0 0 2024-08-19T00:56:18.973 INFO:tasks.workunit.client.1.smithi086.stdout:0/897: dread da/d14/d44/d49/f63 [0,4194304] 0 2024-08-19T00:56:18.974 INFO:tasks.workunit.client.1.smithi086.stdout:2/959: dread - d8/d84/d79/f144 zero size 2024-08-19T00:56:18.975 INFO:tasks.workunit.client.1.smithi086.stdout:0/898: chown da/d14/d44/d49/l117 2116 1 2024-08-19T00:56:18.976 INFO:tasks.workunit.client.1.smithi086.stdout:4/861: mknod d2/d18/d33/d114/c11f 0 2024-08-19T00:56:18.977 INFO:tasks.workunit.client.1.smithi086.stdout:4/862: stat d2/d18/d33/d42/d72/d78/d9e/dc6/ffd 0 2024-08-19T00:56:18.977 INFO:tasks.workunit.client.0.smithi017.stdout:2/523: rename d2/d7/d10/d35/l7d to d2/d7/d10/d3b/d54/laa 0 2024-08-19T00:56:18.978 INFO:tasks.workunit.client.1.smithi086.stdout:9/921: fdatasync db/d26/d5c/d87/d30/d3f/f8b 0 2024-08-19T00:56:18.979 INFO:tasks.workunit.client.0.smithi017.stdout:2/524: write d2/d7/dd/f1c [3873379,68558] 0 2024-08-19T00:56:18.980 INFO:tasks.workunit.client.0.smithi017.stdout:4/475: getdents d2/d1a/d20 0 2024-08-19T00:56:18.984 INFO:tasks.workunit.client.1.smithi086.stdout:3/905: read d3/d18/d19/d62/d46/f6e [954078,1847] 0 2024-08-19T00:56:18.986 INFO:tasks.workunit.client.1.smithi086.stdout:6/915: symlink db/d37/d30/l11d 0 2024-08-19T00:56:18.988 INFO:tasks.workunit.client.0.smithi017.stdout:1/383: write d4/dc/f34 [4031077,99100] 0 2024-08-19T00:56:18.991 INFO:tasks.workunit.client.1.smithi086.stdout:7/896: mkdir d3/d34/d44/d58/d4b/d78/d9a/d12d 0 2024-08-19T00:56:18.993 INFO:tasks.workunit.client.0.smithi017.stdout:7/491: write d3/dc/df/d37/d46/f6e [5204126,37204] 0 2024-08-19T00:56:18.994 INFO:tasks.workunit.client.1.smithi086.stdout:2/960: mkdir d8/d14/dae/ddc/d145 0 2024-08-19T00:56:18.996 INFO:tasks.workunit.client.0.smithi017.stdout:2/525: fdatasync d2/d7/d10/f25 0 2024-08-19T00:56:18.999 INFO:tasks.workunit.client.1.smithi086.stdout:4/863: fdatasync d2/d18/d33/d42/d72/d78/d25/fa6 0 2024-08-19T00:56:19.000 INFO:tasks.workunit.client.0.smithi017.stdout:4/476: dread d2/d11/f59 [0,4194304] 0 2024-08-19T00:56:19.000 INFO:tasks.workunit.client.1.smithi086.stdout:4/864: read - d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/f11d zero size 2024-08-19T00:56:19.002 INFO:tasks.workunit.client.0.smithi017.stdout:7/492: rename d3/dc/l67 to d3/dc/df/d1a/l95 0 2024-08-19T00:56:19.004 INFO:tasks.workunit.client.0.smithi017.stdout:1/384: write d4/dc/f42 [11448,10230] 0 2024-08-19T00:56:19.007 INFO:tasks.workunit.client.1.smithi086.stdout:5/908: creat d0/d8/f11e x:0 0 0 2024-08-19T00:56:19.008 INFO:tasks.workunit.client.1.smithi086.stdout:3/906: truncate d3/d18/d27/fbb 1126463 0 2024-08-19T00:56:19.009 INFO:tasks.workunit.client.1.smithi086.stdout:6/916: creat db/d34/d69/f11e x:0 0 0 2024-08-19T00:56:19.010 INFO:tasks.workunit.client.1.smithi086.stdout:6/917: chown db/f7e 8590559 1 2024-08-19T00:56:19.010 INFO:tasks.workunit.client.0.smithi017.stdout:1/385: readlink d4/l5 0 2024-08-19T00:56:19.010 INFO:tasks.workunit.client.1.smithi086.stdout:7/897: fsync d3/de/f2b 0 2024-08-19T00:56:19.012 INFO:tasks.workunit.client.0.smithi017.stdout:2/526: dread - d2/d7/d10/d35/d45/f95 zero size 2024-08-19T00:56:19.012 INFO:tasks.workunit.client.1.smithi086.stdout:2/961: unlink d8/d2c/d38/d80/dca/dd6/l13d 0 2024-08-19T00:56:19.012 INFO:tasks.workunit.client.1.smithi086.stdout:9/922: dread db/d26/f49 [0,4194304] 0 2024-08-19T00:56:19.013 INFO:tasks.workunit.client.1.smithi086.stdout:2/962: chown d8/d24/cf6 652 1 2024-08-19T00:56:19.013 INFO:tasks.workunit.client.0.smithi017.stdout:4/477: creat d2/d1a/d55/d8f/fa0 x:0 0 0 2024-08-19T00:56:19.013 INFO:tasks.workunit.client.1.smithi086.stdout:9/923: write db/d26/d5c/d87/d30/d3f/fe9 [2694980,105309] 0 2024-08-19T00:56:19.014 INFO:tasks.workunit.client.1.smithi086.stdout:2/963: chown d8/d24/d32/d61/ffc 251 1 2024-08-19T00:56:19.014 INFO:tasks.workunit.client.0.smithi017.stdout:4/478: fsync d2/d1a/d20/f52 0 2024-08-19T00:56:19.014 INFO:tasks.workunit.client.0.smithi017.stdout:7/493: dwrite d3/dc/df/d23/d69/f6f [4194304,4194304] 0 2024-08-19T00:56:19.019 INFO:tasks.workunit.client.1.smithi086.stdout:5/909: rename d0/d2d/c78 to d0/d5f/d60/d57/d80/da0/c11f 0 2024-08-19T00:56:19.020 INFO:tasks.workunit.client.1.smithi086.stdout:3/907: creat d3/d18/d27/f126 x:0 0 0 2024-08-19T00:56:19.020 INFO:tasks.workunit.client.0.smithi017.stdout:4/479: mkdir d2/d1a/da1 0 2024-08-19T00:56:19.023 INFO:tasks.workunit.client.1.smithi086.stdout:7/898: fdatasync d3/d34/d44/d58/d4b/d78/fdf 0 2024-08-19T00:56:19.024 INFO:tasks.workunit.client.0.smithi017.stdout:1/386: rename d4/dc/d3b/d55/f6f to d4/dc/f71 0 2024-08-19T00:56:19.024 INFO:tasks.workunit.client.0.smithi017.stdout:0/445: sync 2024-08-19T00:56:19.025 INFO:tasks.workunit.client.0.smithi017.stdout:1/387: write d4/dc/f40 [4150537,56522] 0 2024-08-19T00:56:19.026 INFO:tasks.workunit.client.0.smithi017.stdout:0/446: readlink d5/d17/d21/d39/l76 0 2024-08-19T00:56:19.028 INFO:tasks.workunit.client.1.smithi086.stdout:9/924: mknod db/d96/de1/c130 0 2024-08-19T00:56:19.029 INFO:tasks.workunit.client.1.smithi086.stdout:0/899: creat da/d5d/da9/f120 x:0 0 0 2024-08-19T00:56:19.030 INFO:tasks.workunit.client.1.smithi086.stdout:2/964: creat d8/d24/d32/d4d/d6a/f146 x:0 0 0 2024-08-19T00:56:19.034 INFO:tasks.workunit.client.0.smithi017.stdout:0/447: symlink d5/d17/d21/d39/l95 0 2024-08-19T00:56:19.035 INFO:tasks.workunit.client.1.smithi086.stdout:8/893: getdents dc/d16 0 2024-08-19T00:56:19.037 INFO:tasks.workunit.client.0.smithi017.stdout:1/388: rename d4/dc/l1b to d4/dc/d17/l72 0 2024-08-19T00:56:19.039 INFO:tasks.workunit.client.1.smithi086.stdout:6/918: symlink db/d37/d30/l11f 0 2024-08-19T00:56:19.040 INFO:tasks.workunit.client.1.smithi086.stdout:6/919: fsync db/f2b 0 2024-08-19T00:56:19.041 INFO:tasks.workunit.client.1.smithi086.stdout:3/908: write d3/d18/d27/d49/d3f/d5b/fa1 [171284,71699] 0 2024-08-19T00:56:19.041 INFO:tasks.workunit.client.1.smithi086.stdout:7/899: dread d3/de/d68/fb6 [0,4194304] 0 2024-08-19T00:56:19.041 INFO:tasks.workunit.client.0.smithi017.stdout:0/448: creat d5/d17/d45/d50/f96 x:0 0 0 2024-08-19T00:56:19.042 INFO:tasks.workunit.client.1.smithi086.stdout:3/909: write d3/d18/d19/dbc/d5d/f101 [189367,3666] 0 2024-08-19T00:56:19.043 INFO:tasks.workunit.client.0.smithi017.stdout:0/449: write d5/d17/d21/f55 [2578547,10843] 0 2024-08-19T00:56:19.045 INFO:tasks.workunit.client.0.smithi017.stdout:1/389: symlink d4/dc/d19/l73 0 2024-08-19T00:56:19.047 INFO:tasks.workunit.client.1.smithi086.stdout:9/925: creat db/daf/f131 x:0 0 0 2024-08-19T00:56:19.047 INFO:tasks.workunit.client.0.smithi017.stdout:7/494: link d3/dc/df/d1c/d2c/d2f/c7b d3/dc/df/d37/d46/c96 0 2024-08-19T00:56:19.051 INFO:tasks.workunit.client.0.smithi017.stdout:0/450: symlink d5/d18/d3a/l97 0 2024-08-19T00:56:19.053 INFO:tasks.workunit.client.1.smithi086.stdout:0/900: dwrite da/d14/d44/d49/f5f [4194304,4194304] 0 2024-08-19T00:56:19.053 INFO:tasks.workunit.client.1.smithi086.stdout:0/901: readlink da/d14/ldb 0 2024-08-19T00:56:19.054 INFO:tasks.workunit.client.0.smithi017.stdout:7/495: rename d3/dc/df/d37/f66 to d3/dc/df/d1c/f97 0 2024-08-19T00:56:19.056 INFO:tasks.workunit.client.1.smithi086.stdout:4/865: write d2/d18/d33/d42/d72/f13 [3649854,17194] 0 2024-08-19T00:56:19.060 INFO:tasks.workunit.client.0.smithi017.stdout:4/480: dwrite d2/d21/d53/f5e [0,4194304] 0 2024-08-19T00:56:19.060 INFO:tasks.workunit.client.1.smithi086.stdout:0/902: dwrite da/d115/d3b/ffc [0,4194304] 0 2024-08-19T00:56:19.061 INFO:tasks.workunit.client.0.smithi017.stdout:4/481: chown d2/d1a/d20/f54 12 1 2024-08-19T00:56:19.066 INFO:tasks.workunit.client.0.smithi017.stdout:7/496: rename d3/f4 to d3/dc/df/d23/d69/f98 0 2024-08-19T00:56:19.069 INFO:tasks.workunit.client.0.smithi017.stdout:1/390: link d4/dc/c64 d4/dc/d3b/c74 0 2024-08-19T00:56:19.161 INFO:tasks.workunit.client.1.smithi086.stdout:6/920: rename db/d37/d41/dad/ce6 to db/d34/d39/d76/dbf/c120 0 2024-08-19T00:56:19.163 INFO:tasks.workunit.client.1.smithi086.stdout:7/900: symlink d3/d34/d44/d58/d4b/da5/ded/l12e 0 2024-08-19T00:56:19.164 INFO:tasks.workunit.client.0.smithi017.stdout:4/482: rename d2/d27/f62 to d2/d21/d53/d57/fa2 0 2024-08-19T00:56:19.165 INFO:tasks.workunit.client.0.smithi017.stdout:9/432: sync 2024-08-19T00:56:19.166 INFO:tasks.workunit.client.0.smithi017.stdout:6/452: sync 2024-08-19T00:56:19.166 INFO:tasks.workunit.client.0.smithi017.stdout:8/326: sync 2024-08-19T00:56:19.166 INFO:tasks.workunit.client.0.smithi017.stdout:3/447: sync 2024-08-19T00:56:19.168 INFO:tasks.workunit.client.1.smithi086.stdout:2/965: mkdir d8/d14/d147 0 2024-08-19T00:56:19.169 INFO:tasks.workunit.client.1.smithi086.stdout:5/910: truncate d0/d8/d94/df9/d108/f8a 1215460 0 2024-08-19T00:56:19.170 INFO:tasks.workunit.client.1.smithi086.stdout:8/894: dwrite dc/d17/d1e/d55/dbb/fd7 [0,4194304] 0 2024-08-19T00:56:19.178 INFO:tasks.workunit.client.0.smithi017.stdout:0/451: link d5/d17/d21/d39/l6e d5/d17/d21/d39/l98 0 2024-08-19T00:56:19.179 INFO:tasks.workunit.client.1.smithi086.stdout:4/866: mknod d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/c120 0 2024-08-19T00:56:19.180 INFO:tasks.workunit.client.0.smithi017.stdout:6/453: fdatasync d5/d13/f1b 0 2024-08-19T00:56:19.181 INFO:tasks.workunit.client.0.smithi017.stdout:3/448: dwrite d5/d15/d1b/f58 [0,4194304] 0 2024-08-19T00:56:19.182 INFO:tasks.workunit.client.0.smithi017.stdout:3/449: readlink d5/da/d27/l66 0 2024-08-19T00:56:19.183 INFO:tasks.workunit.client.0.smithi017.stdout:3/450: write d5/da/f2b [451117,81532] 0 2024-08-19T00:56:19.186 INFO:tasks.workunit.client.0.smithi017.stdout:8/327: creat de/d15/d39/d3d/f5a x:0 0 0 2024-08-19T00:56:19.187 INFO:tasks.workunit.client.0.smithi017.stdout:8/328: chown de/d15/l3a 232675 1 2024-08-19T00:56:19.190 INFO:tasks.workunit.client.0.smithi017.stdout:8/329: readlink de/d36/d2e/l31 0 2024-08-19T00:56:19.194 INFO:tasks.workunit.client.0.smithi017.stdout:1/391: dwrite d4/dc/d3b/f50 [0,4194304] 0 2024-08-19T00:56:19.194 INFO:tasks.workunit.client.0.smithi017.stdout:8/330: write de/f53 [1564513,6255] 0 2024-08-19T00:56:19.195 INFO:tasks.workunit.client.0.smithi017.stdout:4/483: mkdir d2/d21/d40/d56/d99/da3 0 2024-08-19T00:56:19.204 INFO:tasks.workunit.client.0.smithi017.stdout:6/454: mkdir d5/d13/d11/d2c/d9d 0 2024-08-19T00:56:19.207 INFO:tasks.workunit.client.0.smithi017.stdout:8/331: dwrite de/d15/f29 [0,4194304] 0 2024-08-19T00:56:19.208 INFO:tasks.workunit.client.0.smithi017.stdout:9/433: rename d0/d33/d22/f62 to d0/d33/d22/d52/f81 0 2024-08-19T00:56:19.219 INFO:tasks.workunit.client.0.smithi017.stdout:7/497: link d3/dc/f52 d3/dc/df/d37/d46/d73/d80/d81/f99 0 2024-08-19T00:56:19.222 INFO:tasks.workunit.client.0.smithi017.stdout:1/392: fsync d4/f60 0 2024-08-19T00:56:19.229 INFO:tasks.workunit.client.0.smithi017.stdout:0/452: dwrite d5/d17/d2b/f43 [0,4194304] 0 2024-08-19T00:56:19.231 INFO:tasks.workunit.client.0.smithi017.stdout:6/455: mknod d5/d13/d11/d4d/c9e 0 2024-08-19T00:56:19.231 INFO:tasks.workunit.client.0.smithi017.stdout:6/456: dread - d5/d13/d11/d2c/f92 zero size 2024-08-19T00:56:19.233 INFO:tasks.workunit.client.0.smithi017.stdout:3/451: symlink d5/da/d3c/l87 0 2024-08-19T00:56:19.236 INFO:tasks.workunit.client.0.smithi017.stdout:8/332: symlink de/d15/l5b 0 2024-08-19T00:56:19.240 INFO:tasks.workunit.client.0.smithi017.stdout:6/457: dwrite d5/d13/f22 [0,4194304] 0 2024-08-19T00:56:19.243 INFO:tasks.workunit.client.0.smithi017.stdout:7/498: creat d3/dc/df/d7d/f9a x:0 0 0 2024-08-19T00:56:19.245 INFO:tasks.workunit.client.0.smithi017.stdout:7/499: chown d3/dc/df/l15 127 1 2024-08-19T00:56:19.255 INFO:tasks.workunit.client.0.smithi017.stdout:9/434: unlink d0/d33/d22/d52/f79 0 2024-08-19T00:56:19.257 INFO:tasks.workunit.client.0.smithi017.stdout:8/333: dwrite de/d15/d39/f59 [0,4194304] 0 2024-08-19T00:56:19.259 INFO:tasks.workunit.client.0.smithi017.stdout:3/452: read d5/d15/d1b/f39 [1375896,81874] 0 2024-08-19T00:56:19.260 INFO:tasks.workunit.client.0.smithi017.stdout:7/500: dwrite d3/d3c/d88/f8b [0,4194304] 0 2024-08-19T00:56:19.260 INFO:tasks.workunit.client.0.smithi017.stdout:9/435: dread d0/f3a [0,4194304] 0 2024-08-19T00:56:19.262 INFO:tasks.workunit.client.0.smithi017.stdout:1/393: dwrite d4/f10 [0,4194304] 0 2024-08-19T00:56:19.264 INFO:tasks.workunit.client.0.smithi017.stdout:9/436: write d0/d33/d22/f42 [2285743,9759] 0 2024-08-19T00:56:19.265 INFO:tasks.workunit.client.1.smithi086.stdout:3/910: rename d3/d18/d1a/ce6 to d3/d18/d19/dbc/db8/dc9/dd4/c127 0 2024-08-19T00:56:19.266 INFO:tasks.workunit.client.1.smithi086.stdout:3/911: chown d3/d26/dba 1643901 1 2024-08-19T00:56:19.267 INFO:tasks.workunit.client.0.smithi017.stdout:0/453: write d5/f11 [1694151,54205] 0 2024-08-19T00:56:19.271 INFO:tasks.workunit.client.1.smithi086.stdout:7/901: unlink d3/d34/d44/d58/d4b/da5/f5c 0 2024-08-19T00:56:19.274 INFO:tasks.workunit.client.1.smithi086.stdout:9/926: creat db/d26/d5c/d87/d30/d32/d44/dc1/dec/f132 x:0 0 0 2024-08-19T00:56:19.276 INFO:tasks.workunit.client.0.smithi017.stdout:4/484: dwrite d2/d21/d53/d57/f6e [0,4194304] 0 2024-08-19T00:56:19.278 INFO:tasks.workunit.client.1.smithi086.stdout:7/902: dwrite d3/d34/d44/d58/d4b/da5/f9b [4194304,4194304] 0 2024-08-19T00:56:19.280 INFO:tasks.workunit.client.1.smithi086.stdout:5/911: creat d0/d5f/d60/f120 x:0 0 0 2024-08-19T00:56:19.281 INFO:tasks.workunit.client.0.smithi017.stdout:7/501: creat d3/dc/df/d7d/f9b x:0 0 0 2024-08-19T00:56:19.284 INFO:tasks.workunit.client.1.smithi086.stdout:4/867: write d2/d18/d33/d42/d72/f16 [6624607,49797] 0 2024-08-19T00:56:19.284 INFO:tasks.workunit.client.1.smithi086.stdout:0/903: mkdir da/d115/d108/d121 0 2024-08-19T00:56:19.286 INFO:tasks.workunit.client.0.smithi017.stdout:9/437: unlink d0/d33/d22/d5e/c72 0 2024-08-19T00:56:19.286 INFO:tasks.workunit.client.1.smithi086.stdout:9/927: dwrite db/d26/d5c/d87/d30/d32/d44/dc1/dec/f132 [0,4194304] 0 2024-08-19T00:56:19.288 INFO:tasks.workunit.client.1.smithi086.stdout:4/868: chown d2/d18/d33/d42/d72/f16 53499922 1 2024-08-19T00:56:19.288 INFO:tasks.workunit.client.1.smithi086.stdout:9/928: stat db/d26/d5c/d87/d6d/deb/f10a 0 2024-08-19T00:56:19.289 INFO:tasks.workunit.client.1.smithi086.stdout:2/966: rename d8/d14/dae/cbf to d8/d14/dae/ddc/d12b/c148 0 2024-08-19T00:56:19.291 INFO:tasks.workunit.client.0.smithi017.stdout:6/458: creat d5/d13/d11/f9f x:0 0 0 2024-08-19T00:56:19.293 INFO:tasks.workunit.client.1.smithi086.stdout:6/921: mkdir db/d37/d28/d121 0 2024-08-19T00:56:19.294 INFO:tasks.workunit.client.0.smithi017.stdout:8/334: creat de/d15/d4f/f5c x:0 0 0 2024-08-19T00:56:19.294 INFO:tasks.workunit.client.1.smithi086.stdout:6/922: chown db/d37/d41/dad/d11b/lc3 27177 1 2024-08-19T00:56:19.295 INFO:tasks.workunit.client.0.smithi017.stdout:9/438: dwrite d0/d33/d22/f42 [0,4194304] 0 2024-08-19T00:56:19.297 INFO:tasks.workunit.client.1.smithi086.stdout:3/912: write d3/d18/d19/dbc/db8/dc1/ff7 [413893,100496] 0 2024-08-19T00:56:19.298 INFO:tasks.workunit.client.0.smithi017.stdout:9/439: write d0/d58/f66 [227716,111730] 0 2024-08-19T00:56:19.299 INFO:tasks.workunit.client.1.smithi086.stdout:7/903: fsync d3/de/fe1 0 2024-08-19T00:56:19.300 INFO:tasks.workunit.client.1.smithi086.stdout:7/904: dread - d3/d5b/fb1 zero size 2024-08-19T00:56:19.300 INFO:tasks.workunit.client.0.smithi017.stdout:1/394: getdents d4/dc/d3b/d55/d6a 0 2024-08-19T00:56:19.300 INFO:tasks.workunit.client.1.smithi086.stdout:7/905: stat d3/de/d68 0 2024-08-19T00:56:19.301 INFO:tasks.workunit.client.1.smithi086.stdout:7/906: readlink d3/de/d68/d72/l118 0 2024-08-19T00:56:19.302 INFO:tasks.workunit.client.0.smithi017.stdout:7/502: unlink d3/dc/d5f/l77 0 2024-08-19T00:56:19.302 INFO:tasks.workunit.client.0.smithi017.stdout:0/454: symlink d5/d17/d26/l99 0 2024-08-19T00:56:19.304 INFO:tasks.workunit.client.1.smithi086.stdout:7/907: dread d3/d34/d44/d58/d4b/fbd [0,4194304] 0 2024-08-19T00:56:19.306 INFO:tasks.workunit.client.1.smithi086.stdout:5/912: unlink d0/d2d/d4f/df3/d11b/d1f/d65/dfd/f118 0 2024-08-19T00:56:19.306 INFO:tasks.workunit.client.0.smithi017.stdout:6/459: readlink d5/d13/d11/l61 0 2024-08-19T00:56:19.307 INFO:tasks.workunit.client.0.smithi017.stdout:3/453: dread d5/d11/f16 [0,4194304] 0 2024-08-19T00:56:19.308 INFO:tasks.workunit.client.0.smithi017.stdout:4/485: mknod d2/d21/ca4 0 2024-08-19T00:56:19.311 INFO:tasks.workunit.client.1.smithi086.stdout:7/908: dwrite d3/d34/d44/d58/d4b/d78/fc9 [4194304,4194304] 0 2024-08-19T00:56:19.313 INFO:tasks.workunit.client.1.smithi086.stdout:6/923: fdatasync f3 0 2024-08-19T00:56:19.314 INFO:tasks.workunit.client.1.smithi086.stdout:7/909: dread - d3/de/d68/d72/d7e/dca/fd2 zero size 2024-08-19T00:56:19.314 INFO:tasks.workunit.client.1.smithi086.stdout:6/924: dread - db/d37/d44/d5a/d8f/ff6 zero size 2024-08-19T00:56:19.315 INFO:tasks.workunit.client.0.smithi017.stdout:3/454: mknod d5/da/d27/c88 0 2024-08-19T00:56:19.316 INFO:tasks.workunit.client.0.smithi017.stdout:3/455: write d5/d11/f62 [2664920,30415] 0 2024-08-19T00:56:19.318 INFO:tasks.workunit.client.0.smithi017.stdout:4/486: creat d2/d21/d40/d56/fa5 x:0 0 0 2024-08-19T00:56:19.322 INFO:tasks.workunit.client.0.smithi017.stdout:7/503: symlink d3/dc/df/d3d/d90/d87/l9c 0 2024-08-19T00:56:19.324 INFO:tasks.workunit.client.0.smithi017.stdout:6/460: symlink d5/d13/d11/d2c/d4a/d64/d86/d90/la0 0 2024-08-19T00:56:19.327 INFO:tasks.workunit.client.0.smithi017.stdout:4/487: dwrite d2/d16/f38 [0,4194304] 0 2024-08-19T00:56:19.327 INFO:tasks.workunit.client.0.smithi017.stdout:3/456: rename d5/d18/c42 to d5/da/d27/c89 0 2024-08-19T00:56:19.329 INFO:tasks.workunit.client.0.smithi017.stdout:3/457: rename d5 to d5/da/d3c/d4f/d8a 22 2024-08-19T00:56:19.331 INFO:tasks.workunit.client.0.smithi017.stdout:1/395: unlink d4/dc/d17/d1d/l4f 0 2024-08-19T00:56:19.332 INFO:tasks.workunit.client.0.smithi017.stdout:1/396: write d4/dc/f40 [335392,28228] 0 2024-08-19T00:56:19.334 INFO:tasks.workunit.client.1.smithi086.stdout:3/913: fsync d3/d18/d1a/d51/d9b/f4b 0 2024-08-19T00:56:19.335 INFO:tasks.workunit.client.1.smithi086.stdout:3/914: fsync d3/d18/d19/dbc/db8/dc9/f10e 0 2024-08-19T00:56:19.336 INFO:tasks.workunit.client.0.smithi017.stdout:0/455: creat d5/d17/d26/f9a x:0 0 0 2024-08-19T00:56:19.336 INFO:tasks.workunit.client.1.smithi086.stdout:8/895: getdents dc/d17/d1e/d49 0 2024-08-19T00:56:19.337 INFO:tasks.workunit.client.1.smithi086.stdout:8/896: chown dc/d17/d1e/d55/dbb/fbe 829876 1 2024-08-19T00:56:19.337 INFO:tasks.workunit.client.0.smithi017.stdout:7/504: creat d3/dc/df/d37/d46/f9d x:0 0 0 2024-08-19T00:56:19.340 INFO:tasks.workunit.client.0.smithi017.stdout:1/397: dwrite d4/d1c/f70 [0,4194304] 0 2024-08-19T00:56:19.343 INFO:tasks.workunit.client.0.smithi017.stdout:4/488: mkdir d2/d1a/d55/d73/da6 0 2024-08-19T00:56:19.344 INFO:tasks.workunit.client.1.smithi086.stdout:5/913: truncate d0/d8/d10/dbb/fec 2256766 0 2024-08-19T00:56:19.346 INFO:tasks.workunit.client.1.smithi086.stdout:0/904: write da/d14/d55/f79 [4666423,44190] 0 2024-08-19T00:56:19.347 INFO:tasks.workunit.client.0.smithi017.stdout:4/489: write d2/d1a/d55/d8f/fa0 [67667,27767] 0 2024-08-19T00:56:19.349 INFO:tasks.workunit.client.0.smithi017.stdout:9/440: write d0/d33/f4d [1612327,15870] 0 2024-08-19T00:56:19.349 INFO:tasks.workunit.client.0.smithi017.stdout:1/398: dwrite d4/dc/f40 [4194304,4194304] 0 2024-08-19T00:56:19.354 INFO:tasks.workunit.client.1.smithi086.stdout:2/967: dwrite d8/d2c/ffd [0,4194304] 0 2024-08-19T00:56:19.355 INFO:tasks.workunit.client.0.smithi017.stdout:6/461: creat d5/d13/d20/d5e/d8f/fa1 x:0 0 0 2024-08-19T00:56:19.358 INFO:tasks.workunit.client.1.smithi086.stdout:6/925: mkdir db/d37/d44/d5a/d78/ddc/d122 0 2024-08-19T00:56:19.360 INFO:tasks.workunit.client.1.smithi086.stdout:5/914: rmdir d0/d20 39 2024-08-19T00:56:19.361 INFO:tasks.workunit.client.1.smithi086.stdout:5/915: chown d0/d99/dc0/l10e 1027762 1 2024-08-19T00:56:19.362 INFO:tasks.workunit.client.1.smithi086.stdout:4/869: getdents d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/de0 0 2024-08-19T00:56:19.366 INFO:tasks.workunit.client.1.smithi086.stdout:9/929: link db/d26/d5c/d87/d6d/d9f/lf7 db/d26/d5c/d87/d30/d128/l133 0 2024-08-19T00:56:19.368 INFO:tasks.workunit.client.1.smithi086.stdout:7/910: dwrite d3/d34/d44/d58/d4b/f7c [0,4194304] 0 2024-08-19T00:56:19.369 INFO:tasks.workunit.client.0.smithi017.stdout:1/399: write d4/dc/d17/d1d/f3c [408726,4835] 0 2024-08-19T00:56:19.374 INFO:tasks.workunit.client.0.smithi017.stdout:3/458: rename d5/d15/d53/l6a to d5/l8b 0 2024-08-19T00:56:19.375 INFO:tasks.workunit.client.1.smithi086.stdout:6/926: chown db/d37/c25 25946 1 2024-08-19T00:56:19.376 INFO:tasks.workunit.client.0.smithi017.stdout:5/334: sync 2024-08-19T00:56:19.376 INFO:tasks.workunit.client.0.smithi017.stdout:2/527: sync 2024-08-19T00:56:19.376 INFO:tasks.workunit.client.0.smithi017.stdout:9/441: truncate d0/d33/d22/d52/f81 1246597 0 2024-08-19T00:56:19.377 INFO:tasks.workunit.client.1.smithi086.stdout:4/870: read d2/f26 [5812320,22047] 0 2024-08-19T00:56:19.378 INFO:tasks.workunit.client.0.smithi017.stdout:9/442: dread - d0/d33/d22/d5a/f5f zero size 2024-08-19T00:56:19.378 INFO:tasks.workunit.client.1.smithi086.stdout:0/905: mkdir da/d14/d55/d10c/d2e/d7e/d122 0 2024-08-19T00:56:19.379 INFO:tasks.workunit.client.0.smithi017.stdout:9/443: chown d0/d33/d22/d5e/l75 15 1 2024-08-19T00:56:19.380 INFO:tasks.workunit.client.0.smithi017.stdout:3/459: rmdir d5/da 39 2024-08-19T00:56:19.381 INFO:tasks.workunit.client.0.smithi017.stdout:3/460: chown d5/c4e 6112 1 2024-08-19T00:56:19.382 INFO:tasks.workunit.client.0.smithi017.stdout:1/400: mkdir d4/d1c/d75 0 2024-08-19T00:56:19.382 INFO:tasks.workunit.client.0.smithi017.stdout:1/401: stat d4/d1c/l31 0 2024-08-19T00:56:19.384 INFO:tasks.workunit.client.0.smithi017.stdout:2/528: mkdir d2/d7/d10/d19/d48/dab 0 2024-08-19T00:56:19.385 INFO:tasks.workunit.client.1.smithi086.stdout:3/915: creat d3/d18/f128 x:0 0 0 2024-08-19T00:56:19.387 INFO:tasks.workunit.client.0.smithi017.stdout:5/335: creat db/d19/d1f/d15/d3e/d40/f77 x:0 0 0 2024-08-19T00:56:19.387 INFO:tasks.workunit.client.0.smithi017.stdout:6/462: rmdir d5 39 2024-08-19T00:56:19.389 INFO:tasks.workunit.client.0.smithi017.stdout:7/505: link d3/dc/df/c5a d3/dc/df/c9e 0 2024-08-19T00:56:19.390 INFO:tasks.workunit.client.0.smithi017.stdout:1/402: dwrite d4/dc/d3b/d3d/d54/f67 [0,4194304] 0 2024-08-19T00:56:19.391 INFO:tasks.workunit.client.1.smithi086.stdout:6/927: dread db/d37/d28/fa5 [0,4194304] 0 2024-08-19T00:56:19.392 INFO:tasks.workunit.client.0.smithi017.stdout:1/403: read d4/d1c/f70 [3423365,32299] 0 2024-08-19T00:56:19.393 INFO:tasks.workunit.client.1.smithi086.stdout:5/916: unlink d0/d99/cd4 0 2024-08-19T00:56:19.395 INFO:tasks.workunit.client.0.smithi017.stdout:4/490: dread d2/d1a/d55/f79 [0,4194304] 0 2024-08-19T00:56:19.396 INFO:tasks.workunit.client.0.smithi017.stdout:3/461: fsync d5/da/d27/f78 0 2024-08-19T00:56:19.399 INFO:tasks.workunit.client.0.smithi017.stdout:6/463: readlink d5/d13/d11/d2c/d4a/d64/l65 0 2024-08-19T00:56:19.401 INFO:tasks.workunit.client.0.smithi017.stdout:0/456: dwrite d5/f1c [0,4194304] 0 2024-08-19T00:56:19.402 INFO:tasks.workunit.client.0.smithi017.stdout:0/457: chown d5 462878 1 2024-08-19T00:56:19.402 INFO:tasks.workunit.client.1.smithi086.stdout:0/906: dread da/d115/d3b/d4e/fb0 [0,4194304] 0 2024-08-19T00:56:19.402 INFO:tasks.workunit.client.0.smithi017.stdout:6/464: truncate d5/d13/d20/d89/f9c 543373 0 2024-08-19T00:56:19.403 INFO:tasks.workunit.client.1.smithi086.stdout:4/871: creat d2/d18/d33/d42/d72/d78/f121 x:0 0 0 2024-08-19T00:56:19.403 INFO:tasks.workunit.client.0.smithi017.stdout:5/336: rmdir db/d19/d57 39 2024-08-19T00:56:19.404 INFO:tasks.workunit.client.0.smithi017.stdout:5/337: chown db/d19/d1f/d15/l54 1398393512 1 2024-08-19T00:56:19.405 INFO:tasks.workunit.client.1.smithi086.stdout:7/911: write d3/d34/f52 [3122679,3547] 0 2024-08-19T00:56:19.405 INFO:tasks.workunit.client.0.smithi017.stdout:0/458: write d5/d18/f56 [598621,6451] 0 2024-08-19T00:56:19.405 INFO:tasks.workunit.client.1.smithi086.stdout:7/912: chown d3/d34/df2/f103 3018 1 2024-08-19T00:56:19.407 INFO:tasks.workunit.client.0.smithi017.stdout:0/459: chown d5/d17/d26/d30/d3e/f91 52881055 1 2024-08-19T00:56:19.409 INFO:tasks.workunit.client.1.smithi086.stdout:3/916: unlink d3/d18/d27/d49/d3f/d54/f118 0 2024-08-19T00:56:19.410 INFO:tasks.workunit.client.0.smithi017.stdout:2/529: symlink d2/d7/d10/d3b/d3c/d8a/lac 0 2024-08-19T00:56:19.410 INFO:tasks.workunit.client.1.smithi086.stdout:8/897: getdents dc/d16/d18/d106/d83 0 2024-08-19T00:56:19.411 INFO:tasks.workunit.client.1.smithi086.stdout:7/913: dwrite d3/ff [4194304,4194304] 0 2024-08-19T00:56:19.412 INFO:tasks.workunit.client.1.smithi086.stdout:8/898: chown dc/d17/d86/f111 560794 1 2024-08-19T00:56:19.412 INFO:tasks.workunit.client.1.smithi086.stdout:7/914: dread - d3/d34/d44/d58/d4b/d42/fbf zero size 2024-08-19T00:56:19.413 INFO:tasks.workunit.client.1.smithi086.stdout:2/968: link d8/d2c/d38/d80/db4/db7/f116 d8/d2c/d47/f149 0 2024-08-19T00:56:19.413 INFO:tasks.workunit.client.1.smithi086.stdout:8/899: fsync dc/d16/d18/d106/f8a 0 2024-08-19T00:56:19.415 INFO:tasks.workunit.client.1.smithi086.stdout:8/900: fdatasync dc/d1f/d37/d9f/ff8 0 2024-08-19T00:56:19.416 INFO:tasks.workunit.client.0.smithi017.stdout:3/462: creat d5/d18/f8c x:0 0 0 2024-08-19T00:56:19.417 INFO:tasks.workunit.client.1.smithi086.stdout:7/915: write d3/d34/d44/d58/d4b/dcd/ffd [968833,110150] 0 2024-08-19T00:56:19.419 INFO:tasks.workunit.client.1.smithi086.stdout:7/916: fsync d3/de/d68/d72/d7e/dca/dcb/fec 0 2024-08-19T00:56:19.419 INFO:tasks.workunit.client.1.smithi086.stdout:8/901: truncate dc/d16/d18/d106/d28/d2b/d3b/d87/de2/f11d 902771 0 2024-08-19T00:56:19.420 INFO:tasks.workunit.client.1.smithi086.stdout:7/917: dread - d3/d34/d44/d58/f111 zero size 2024-08-19T00:56:19.423 INFO:tasks.workunit.client.0.smithi017.stdout:7/506: creat d3/dc/df/d37/d93/f9f x:0 0 0 2024-08-19T00:56:19.423 INFO:tasks.workunit.client.0.smithi017.stdout:3/463: dwrite d5/da/d27/d28/f37 [0,4194304] 0 2024-08-19T00:56:19.424 INFO:tasks.workunit.client.0.smithi017.stdout:3/464: fdatasync d5/da/f2b 0 2024-08-19T00:56:19.425 INFO:tasks.workunit.client.0.smithi017.stdout:5/338: mknod db/d19/d1f/d15/d3e/d40/d49/c78 0 2024-08-19T00:56:19.427 INFO:tasks.workunit.client.1.smithi086.stdout:4/872: creat d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/f122 x:0 0 0 2024-08-19T00:56:19.427 INFO:tasks.workunit.client.0.smithi017.stdout:0/460: unlink d5/d17/d26/d30/d3e/f90 0 2024-08-19T00:56:19.429 INFO:tasks.workunit.client.1.smithi086.stdout:6/928: dwrite db/d34/d39/d76/f7b [0,4194304] 0 2024-08-19T00:56:19.430 INFO:tasks.workunit.client.0.smithi017.stdout:1/404: rename d4/ff to d4/dc/d3b/d55/f76 0 2024-08-19T00:56:19.432 INFO:tasks.workunit.client.1.smithi086.stdout:3/917: creat d3/d18/d27/d49/d3f/d54/f129 x:0 0 0 2024-08-19T00:56:19.433 INFO:tasks.workunit.client.0.smithi017.stdout:6/465: symlink d5/d13/d11/d52/la2 0 2024-08-19T00:56:19.435 INFO:tasks.workunit.client.0.smithi017.stdout:7/507: mkdir d3/dc/df/d37/d93/da0 0 2024-08-19T00:56:19.438 INFO:tasks.workunit.client.0.smithi017.stdout:0/461: mkdir d5/d17/d21/d42/d9b 0 2024-08-19T00:56:19.439 INFO:tasks.workunit.client.0.smithi017.stdout:0/462: chown d5/f11 357741 1 2024-08-19T00:56:19.445 INFO:tasks.workunit.client.0.smithi017.stdout:4/491: rename d2/d11/c49 to d2/d1a/d20/ca7 0 2024-08-19T00:56:19.446 INFO:tasks.workunit.client.1.smithi086.stdout:8/902: creat dc/d16/d18/d94/f125 x:0 0 0 2024-08-19T00:56:19.446 INFO:tasks.workunit.client.0.smithi017.stdout:4/492: write d2/d1a/d55/f89 [726115,8494] 0 2024-08-19T00:56:19.449 INFO:tasks.workunit.client.0.smithi017.stdout:4/493: fdatasync d2/d1a/d55/d73/f81 0 2024-08-19T00:56:19.452 INFO:tasks.workunit.client.1.smithi086.stdout:9/930: getdents db/d26/d5c 0 2024-08-19T00:56:19.453 INFO:tasks.workunit.client.0.smithi017.stdout:0/463: mknod d5/d17/d45/d50/c9c 0 2024-08-19T00:56:19.453 INFO:tasks.workunit.client.0.smithi017.stdout:4/494: dread d2/d1a/f69 [0,4194304] 0 2024-08-19T00:56:19.454 INFO:tasks.workunit.client.1.smithi086.stdout:3/918: dread d3/d26/d2b/d33/d4a/f120 [0,4194304] 0 2024-08-19T00:56:19.456 INFO:tasks.workunit.client.1.smithi086.stdout:4/873: truncate d2/d18/d33/d42/d72/d78/d25/fa6 701531 0 2024-08-19T00:56:19.457 INFO:tasks.workunit.client.1.smithi086.stdout:4/874: write d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/f122 [949479,115229] 0 2024-08-19T00:56:19.457 INFO:tasks.workunit.client.0.smithi017.stdout:3/465: rename d5/da/d3c/d4f/l6f to d5/d11/d61/l8d 0 2024-08-19T00:56:19.458 INFO:tasks.workunit.client.0.smithi017.stdout:3/466: read d5/da/d27/f3a [307563,15342] 0 2024-08-19T00:56:19.459 INFO:tasks.workunit.client.0.smithi017.stdout:3/467: readlink d5/d32/l4b 0 2024-08-19T00:56:19.461 INFO:tasks.workunit.client.1.smithi086.stdout:7/918: mknod d3/d34/d44/d58/d4b/d78/d9a/d12d/c12f 0 2024-08-19T00:56:19.462 INFO:tasks.workunit.client.1.smithi086.stdout:7/919: fdatasync d3/d34/d44/d58/d4b/da5/f9b 0 2024-08-19T00:56:19.463 INFO:tasks.workunit.client.1.smithi086.stdout:2/969: dwrite d8/d43/d65/f9b [0,4194304] 0 2024-08-19T00:56:19.463 INFO:tasks.workunit.client.1.smithi086.stdout:7/920: stat d3/da1/d108 0 2024-08-19T00:56:19.465 INFO:tasks.workunit.client.1.smithi086.stdout:0/907: creat da/d14/d55/d10c/d2e/f123 x:0 0 0 2024-08-19T00:56:19.468 INFO:tasks.workunit.client.0.smithi017.stdout:0/464: mknod d5/d17/d26/d30/d5d/c9d 0 2024-08-19T00:56:19.468 INFO:tasks.workunit.client.1.smithi086.stdout:6/929: mknod db/d37/d41/dad/db7/c123 0 2024-08-19T00:56:19.469 INFO:tasks.workunit.client.0.smithi017.stdout:6/466: write d5/d13/d20/f58 [636018,81427] 0 2024-08-19T00:56:19.469 INFO:tasks.workunit.client.0.smithi017.stdout:5/339: write db/f2a [354473,75693] 0 2024-08-19T00:56:19.469 INFO:tasks.workunit.client.0.smithi017.stdout:4/495: mkdir d2/d21/d53/da8 0 2024-08-19T00:56:19.470 INFO:tasks.workunit.client.1.smithi086.stdout:5/917: dwrite d0/d2d/d4f/f74 [0,4194304] 0 2024-08-19T00:56:19.472 INFO:tasks.workunit.client.1.smithi086.stdout:3/919: chown d3/d18/d19/d10a/f11d 23 1 2024-08-19T00:56:19.472 INFO:tasks.workunit.client.0.smithi017.stdout:0/465: write d5/d18/f56 [752567,29989] 0 2024-08-19T00:56:19.474 INFO:tasks.workunit.client.0.smithi017.stdout:1/405: rename d4/dc/d3b/c3e to d4/dc/d3b/d55/d6a/c77 0 2024-08-19T00:56:19.474 INFO:tasks.workunit.client.1.smithi086.stdout:7/921: dwrite d3/d34/df2/f109 [0,4194304] 0 2024-08-19T00:56:19.474 INFO:tasks.workunit.client.1.smithi086.stdout:3/920: chown d3/d18/f128 113927967 1 2024-08-19T00:56:19.475 INFO:tasks.workunit.client.0.smithi017.stdout:3/468: rmdir d5/da/d27/d28 39 2024-08-19T00:56:19.476 INFO:tasks.workunit.client.0.smithi017.stdout:2/530: dwrite d2/d7/f43 [0,4194304] 0 2024-08-19T00:56:19.476 INFO:tasks.workunit.client.0.smithi017.stdout:0/466: write d5/d17/d21/d39/f85 [781873,37245] 0 2024-08-19T00:56:19.479 INFO:tasks.workunit.client.1.smithi086.stdout:6/930: dwrite db/d37/d28/d7f/d96/f10d [0,4194304] 0 2024-08-19T00:56:19.482 INFO:tasks.workunit.client.1.smithi086.stdout:8/903: mkdir dc/d17/d1e/d55/d122/d126 0 2024-08-19T00:56:19.482 INFO:tasks.workunit.client.1.smithi086.stdout:2/970: unlink d8/d2c/d38/d80/db4/db7/fe3 0 2024-08-19T00:56:19.484 INFO:tasks.workunit.client.1.smithi086.stdout:0/908: creat da/d97/f124 x:0 0 0 2024-08-19T00:56:19.485 INFO:tasks.workunit.client.1.smithi086.stdout:9/931: mknod db/d96/c134 0 2024-08-19T00:56:19.488 INFO:tasks.workunit.client.1.smithi086.stdout:9/932: truncate db/d26/d5c/d87/d30/d3f/fe9 4381504 0 2024-08-19T00:56:19.490 INFO:tasks.workunit.client.0.smithi017.stdout:0/467: dwrite d5/f10 [0,4194304] 0 2024-08-19T00:56:19.492 INFO:tasks.workunit.client.1.smithi086.stdout:4/875: mkdir d2/d123 0 2024-08-19T00:56:19.492 INFO:tasks.workunit.client.1.smithi086.stdout:0/909: dwrite da/d115/d3b/d4e/dda/f105 [0,4194304] 0 2024-08-19T00:56:19.495 INFO:tasks.workunit.client.1.smithi086.stdout:4/876: rename d2/d18/d33/d42/d72/d78/d2c/d11c to d2/d18/d33/d42/d72/d78/d2c/d11c/d124 22 2024-08-19T00:56:19.505 INFO:tasks.workunit.client.0.smithi017.stdout:4/496: dread d2/d1a/f68 [0,4194304] 0 2024-08-19T00:56:19.507 INFO:tasks.workunit.client.1.smithi086.stdout:8/904: symlink dc/d1f/dc9/l127 0 2024-08-19T00:56:19.511 INFO:tasks.workunit.client.0.smithi017.stdout:5/340: rmdir db 39 2024-08-19T00:56:19.513 INFO:tasks.workunit.client.1.smithi086.stdout:5/918: creat d0/d20/dfa/f121 x:0 0 0 2024-08-19T00:56:19.516 INFO:tasks.workunit.client.1.smithi086.stdout:0/910: creat da/d115/d3b/d4e/dbe/f125 x:0 0 0 2024-08-19T00:56:19.517 INFO:tasks.workunit.client.1.smithi086.stdout:4/877: readlink d2/d18/d33/d42/d72/l4b 0 2024-08-19T00:56:19.518 INFO:tasks.workunit.client.0.smithi017.stdout:6/467: creat d5/d13/d11/d2c/d51/fa3 x:0 0 0 2024-08-19T00:56:19.518 INFO:tasks.workunit.client.1.smithi086.stdout:4/878: chown d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/d85/c113 0 1 2024-08-19T00:56:19.518 INFO:tasks.workunit.client.1.smithi086.stdout:6/931: symlink db/d37/d30/d10b/l124 0 2024-08-19T00:56:19.519 INFO:tasks.workunit.client.1.smithi086.stdout:6/932: chown db/d34/d4e/d68/c7c 1 1 2024-08-19T00:56:19.523 INFO:tasks.workunit.client.1.smithi086.stdout:8/905: mknod dc/d17/d1e/d55/d122/c128 0 2024-08-19T00:56:19.523 INFO:tasks.workunit.client.1.smithi086.stdout:8/906: readlink dc/d16/d18/d94/l10c 0 2024-08-19T00:56:19.524 INFO:tasks.workunit.client.0.smithi017.stdout:7/508: getdents d3/dc/df/d1c/d2c 0 2024-08-19T00:56:19.524 INFO:tasks.workunit.client.1.smithi086.stdout:9/933: mknod db/d26/c135 0 2024-08-19T00:56:19.526 INFO:tasks.workunit.client.1.smithi086.stdout:5/919: mknod d0/d5f/d60/d57/d80/da3/c122 0 2024-08-19T00:56:19.526 INFO:tasks.workunit.client.1.smithi086.stdout:5/920: chown d0/d2d/d43 12 1 2024-08-19T00:56:19.528 INFO:tasks.workunit.client.0.smithi017.stdout:0/468: mknod d5/d17/d26/d30/d5d/c9e 0 2024-08-19T00:56:19.528 INFO:tasks.workunit.client.1.smithi086.stdout:3/921: write d3/d26/f7e [2076850,105320] 0 2024-08-19T00:56:19.529 INFO:tasks.workunit.client.1.smithi086.stdout:0/911: read - da/d5d/f75 zero size 2024-08-19T00:56:19.531 INFO:tasks.workunit.client.1.smithi086.stdout:4/879: creat d2/d18/d33/d42/d72/d78/de6/f125 x:0 0 0 2024-08-19T00:56:19.533 INFO:tasks.workunit.client.1.smithi086.stdout:6/933: rmdir db/d37/d41/dad/db7 39 2024-08-19T00:56:19.537 INFO:tasks.workunit.client.0.smithi017.stdout:6/468: chown d5/d13/d11/f59 504974 1 2024-08-19T00:56:19.538 INFO:tasks.workunit.client.0.smithi017.stdout:6/469: truncate d5/d13/d11/d2c/f73 1700392 0 2024-08-19T00:56:19.538 INFO:tasks.workunit.client.1.smithi086.stdout:2/971: dwrite d8/d14/f72 [4194304,4194304] 0 2024-08-19T00:56:19.539 INFO:tasks.workunit.client.0.smithi017.stdout:1/406: unlink d4/d1c/d1f/l66 0 2024-08-19T00:56:19.540 INFO:tasks.workunit.client.0.smithi017.stdout:2/531: write d2/d7/d29/f34 [4120907,30440] 0 2024-08-19T00:56:19.540 INFO:tasks.workunit.client.0.smithi017.stdout:7/509: readlink d3/dc/df/d37/l5d 0 2024-08-19T00:56:19.541 INFO:tasks.workunit.client.1.smithi086.stdout:9/934: fsync db/d26/d5c/d87/d30/d3f/f71 0 2024-08-19T00:56:19.542 INFO:tasks.workunit.client.1.smithi086.stdout:5/921: symlink d0/d2d/d4f/df3/d11b/d1f/d65/dfd/l123 0 2024-08-19T00:56:19.543 INFO:tasks.workunit.client.0.smithi017.stdout:4/497: creat d2/d21/d53/d57/d9d/fa9 x:0 0 0 2024-08-19T00:56:19.544 INFO:tasks.workunit.client.1.smithi086.stdout:3/922: chown d3/d18/d1a/d51/l63 246 1 2024-08-19T00:56:19.544 INFO:tasks.workunit.client.0.smithi017.stdout:5/341: creat db/d19/d1f/d15/d3e/f79 x:0 0 0 2024-08-19T00:56:19.546 INFO:tasks.workunit.client.0.smithi017.stdout:6/470: unlink d5/d13/d20/d89/f9c 0 2024-08-19T00:56:19.547 INFO:tasks.workunit.client.1.smithi086.stdout:7/922: link d3/de/d68/d72/d7e/ce5 d3/de/d68/d7d/c130 0 2024-08-19T00:56:19.547 INFO:tasks.workunit.client.1.smithi086.stdout:2/972: dwrite d8/d24/d32/d4d/d6a/f108 [0,4194304] 0 2024-08-19T00:56:19.549 INFO:tasks.workunit.client.0.smithi017.stdout:3/469: rename d5/d18/f45 to d5/da/d3c/f8e 0 2024-08-19T00:56:19.551 INFO:tasks.workunit.client.0.smithi017.stdout:2/532: creat d2/d7/d10/d3b/d69/fad x:0 0 0 2024-08-19T00:56:19.553 INFO:tasks.workunit.client.1.smithi086.stdout:0/912: mknod da/d14/d26/c126 0 2024-08-19T00:56:19.554 INFO:tasks.workunit.client.0.smithi017.stdout:7/510: symlink d3/dc/df/d37/d39/la1 0 2024-08-19T00:56:19.556 INFO:tasks.workunit.client.0.smithi017.stdout:0/469: getdents d5/d17/d45/d77 0 2024-08-19T00:56:19.557 INFO:tasks.workunit.client.0.smithi017.stdout:3/470: dwrite d5/d11/f3e [4194304,4194304] 0 2024-08-19T00:56:19.558 INFO:tasks.workunit.client.1.smithi086.stdout:4/880: unlink d2/d18/d33/c5b 0 2024-08-19T00:56:19.558 INFO:tasks.workunit.client.1.smithi086.stdout:6/934: write db/d37/d44/d5a/d78/fe2 [3052721,26265] 0 2024-08-19T00:56:19.559 INFO:tasks.workunit.client.0.smithi017.stdout:3/471: fsync d5/d15/d1b/f58 0 2024-08-19T00:56:19.560 INFO:tasks.workunit.client.0.smithi017.stdout:4/498: write d2/d21/d53/d57/f9f [4896768,130212] 0 2024-08-19T00:56:19.565 INFO:tasks.workunit.client.0.smithi017.stdout:1/407: mkdir d4/d78 0 2024-08-19T00:56:19.567 INFO:tasks.workunit.client.1.smithi086.stdout:7/923: creat d3/de/d113/f131 x:0 0 0 2024-08-19T00:56:19.568 INFO:tasks.workunit.client.0.smithi017.stdout:6/471: creat d5/d13/d20/d89/fa4 x:0 0 0 2024-08-19T00:56:19.568 INFO:tasks.workunit.client.1.smithi086.stdout:7/924: write d3/de/d68/f107 [264157,117090] 0 2024-08-19T00:56:19.569 INFO:tasks.workunit.client.1.smithi086.stdout:7/925: write d3/d34/d44/d58/d4b/dcd/ffd [1271573,40527] 0 2024-08-19T00:56:19.570 INFO:tasks.workunit.client.1.smithi086.stdout:2/973: unlink d8/d2c/d38/d80/c9c 0 2024-08-19T00:56:19.571 INFO:tasks.workunit.client.1.smithi086.stdout:2/974: write d8/d84/d79/f144 [450217,55958] 0 2024-08-19T00:56:19.572 INFO:tasks.workunit.client.1.smithi086.stdout:9/935: truncate db/d26/d5c/d87/d30/d58/fc6 2253049 0 2024-08-19T00:56:19.572 INFO:tasks.workunit.client.1.smithi086.stdout:2/975: chown d8/d2c/d67/l90 7389317 1 2024-08-19T00:56:19.573 INFO:tasks.workunit.client.0.smithi017.stdout:2/533: mknod d2/d7/d10/d3b/d80/cae 0 2024-08-19T00:56:19.576 INFO:tasks.workunit.client.1.smithi086.stdout:0/913: mknod da/d115/d3b/d4e/dbe/c127 0 2024-08-19T00:56:19.578 INFO:tasks.workunit.client.0.smithi017.stdout:7/511: dread d3/dc/df/d1c/f97 [0,4194304] 0 2024-08-19T00:56:19.578 INFO:tasks.workunit.client.0.smithi017.stdout:0/470: read d5/d17/f57 [887731,105041] 0 2024-08-19T00:56:19.581 INFO:tasks.workunit.client.1.smithi086.stdout:3/923: dwrite d3/d18/d19/d62/f9c [0,4194304] 0 2024-08-19T00:56:19.582 INFO:tasks.workunit.client.1.smithi086.stdout:0/914: dread da/d14/d44/d49/f11c [4194304,4194304] 0 2024-08-19T00:56:19.583 INFO:tasks.workunit.client.0.smithi017.stdout:5/342: creat db/d19/d57/f7a x:0 0 0 2024-08-19T00:56:19.583 INFO:tasks.workunit.client.1.smithi086.stdout:3/924: stat d3/d18/d27/d49/d3f/d5b/d8f/c99 0 2024-08-19T00:56:19.586 INFO:tasks.workunit.client.0.smithi017.stdout:1/408: rmdir d4/dc/d17/d1d 39 2024-08-19T00:56:19.588 INFO:tasks.workunit.client.1.smithi086.stdout:7/926: creat d3/d34/d44/d58/d4b/d78/d9a/f132 x:0 0 0 2024-08-19T00:56:19.590 INFO:tasks.workunit.client.0.smithi017.stdout:6/472: creat d5/d13/d20/fa5 x:0 0 0 2024-08-19T00:56:19.591 INFO:tasks.workunit.client.1.smithi086.stdout:9/936: fdatasync db/d26/d5c/d87/d30/d31/fe5 0 2024-08-19T00:56:19.592 INFO:tasks.workunit.client.0.smithi017.stdout:2/534: write d2/d7/d10/d3b/d3c/f88 [862694,22090] 0 2024-08-19T00:56:19.592 INFO:tasks.workunit.client.1.smithi086.stdout:4/881: dwrite d2/d18/d33/d42/d72/d2f/f82 [0,4194304] 0 2024-08-19T00:56:19.593 INFO:tasks.workunit.client.1.smithi086.stdout:8/907: getdents dc/d1f/dc9 0 2024-08-19T00:56:19.595 INFO:tasks.workunit.client.1.smithi086.stdout:6/935: creat db/d34/d103/f125 x:0 0 0 2024-08-19T00:56:19.595 INFO:tasks.workunit.client.0.smithi017.stdout:1/409: dwrite d4/d1c/f2a [0,4194304] 0 2024-08-19T00:56:19.595 INFO:tasks.workunit.client.1.smithi086.stdout:8/908: write dc/d1f/d37/d4f/dac/db8/d99/f123 [754711,80564] 0 2024-08-19T00:56:19.596 INFO:tasks.workunit.client.0.smithi017.stdout:2/535: read d2/d7/d10/f47 [1545339,99747] 0 2024-08-19T00:56:19.597 INFO:tasks.workunit.client.0.smithi017.stdout:0/471: creat d5/d17/d2b/f9f x:0 0 0 2024-08-19T00:56:19.598 INFO:tasks.workunit.client.0.smithi017.stdout:1/410: write d4/dc/f34 [167431,39830] 0 2024-08-19T00:56:19.599 INFO:tasks.workunit.client.0.smithi017.stdout:3/472: symlink d5/da/d3c/l8f 0 2024-08-19T00:56:19.600 INFO:tasks.workunit.client.1.smithi086.stdout:5/922: link d0/d8/d10/l1c d0/d5f/d60/l124 0 2024-08-19T00:56:19.601 INFO:tasks.workunit.client.1.smithi086.stdout:5/923: chown d0/d8/d10/l31 1 1 2024-08-19T00:56:19.603 INFO:tasks.workunit.client.1.smithi086.stdout:5/924: fdatasync d0/d5f/d60/d57/d80/da3/fba 0 2024-08-19T00:56:19.603 INFO:tasks.workunit.client.0.smithi017.stdout:0/472: truncate d5/d17/d21/d42/f86 1010371 0 2024-08-19T00:56:19.603 INFO:tasks.workunit.client.0.smithi017.stdout:4/499: creat d2/d21/d40/d56/d99/da3/faa x:0 0 0 2024-08-19T00:56:19.604 INFO:tasks.workunit.client.0.smithi017.stdout:0/473: chown d5/d17/d26/d30/d5d 0 1 2024-08-19T00:56:19.607 INFO:tasks.workunit.client.1.smithi086.stdout:3/925: creat d3/d18/d19/dbc/db8/f12a x:0 0 0 2024-08-19T00:56:19.609 INFO:tasks.workunit.client.1.smithi086.stdout:7/927: creat d3/d34/d44/d58/d4b/da5/ded/f133 x:0 0 0 2024-08-19T00:56:19.610 INFO:tasks.workunit.client.0.smithi017.stdout:6/473: dread f2 [4194304,4194304] 0 2024-08-19T00:56:19.610 INFO:tasks.workunit.client.0.smithi017.stdout:7/512: rename d3/dc/c19 to d3/dc/df/d1c/d2c/d83/ca2 0 2024-08-19T00:56:19.611 INFO:tasks.workunit.client.1.smithi086.stdout:2/976: mknod d8/d24/d32/d4d/d6a/db1/d13f/c14a 0 2024-08-19T00:56:19.613 INFO:tasks.workunit.client.1.smithi086.stdout:2/977: read d8/d2c/d67/f6f [2864992,2831] 0 2024-08-19T00:56:19.614 INFO:tasks.workunit.client.1.smithi086.stdout:2/978: dread - d8/d2c/d47/f109 zero size 2024-08-19T00:56:19.615 INFO:tasks.workunit.client.1.smithi086.stdout:4/882: unlink d2/lf4 0 2024-08-19T00:56:19.615 INFO:tasks.workunit.client.0.smithi017.stdout:1/411: dread d4/dc/d17/d1d/f3c [0,4194304] 0 2024-08-19T00:56:19.616 INFO:tasks.workunit.client.0.smithi017.stdout:1/412: chown d4/dc/d3b/d45/c5c 742 1 2024-08-19T00:56:19.616 INFO:tasks.workunit.client.1.smithi086.stdout:9/937: unlink db/d26/d5c/d87/d30/d31/d103/d19/d38/c89 0 2024-08-19T00:56:19.617 INFO:tasks.workunit.client.0.smithi017.stdout:1/413: chown d4/d1c/f46 3 1 2024-08-19T00:56:19.618 INFO:tasks.workunit.client.0.smithi017.stdout:1/414: write d4/d1c/f46 [1099486,38270] 0 2024-08-19T00:56:19.618 INFO:tasks.workunit.client.0.smithi017.stdout:4/500: creat d2/d21/d40/d84/fab x:0 0 0 2024-08-19T00:56:19.619 INFO:tasks.workunit.client.0.smithi017.stdout:0/474: chown d5/d18/f66 336101652 1 2024-08-19T00:56:19.622 INFO:tasks.workunit.client.0.smithi017.stdout:6/474: creat d5/d13/d11/d2c/d51/fa6 x:0 0 0 2024-08-19T00:56:19.625 INFO:tasks.workunit.client.1.smithi086.stdout:0/915: mkdir da/d14/d55/d10c/d2e/d7e/dd7/d128 0 2024-08-19T00:56:19.625 INFO:tasks.workunit.client.0.smithi017.stdout:1/415: dwrite d4/dc/d19/f41 [4194304,4194304] 0 2024-08-19T00:56:19.626 INFO:tasks.workunit.client.1.smithi086.stdout:0/916: write da/d14/d55/d10c/d2e/d43/fc7 [2352584,28699] 0 2024-08-19T00:56:19.626 INFO:tasks.workunit.client.0.smithi017.stdout:3/473: mknod d5/d15/c90 0 2024-08-19T00:56:19.626 INFO:tasks.workunit.client.0.smithi017.stdout:1/416: chown d4/f13 2 1 2024-08-19T00:56:19.628 INFO:tasks.workunit.client.1.smithi086.stdout:3/926: creat d3/d18/d19/dbc/de1/f12b x:0 0 0 2024-08-19T00:56:19.633 INFO:tasks.workunit.client.0.smithi017.stdout:2/536: mkdir d2/d7/d10/d3b/d80/da2/daf 0 2024-08-19T00:56:19.634 INFO:tasks.workunit.client.0.smithi017.stdout:2/537: fsync d2/d7/d10/d19/d48/f9c 0 2024-08-19T00:56:19.641 INFO:tasks.workunit.client.1.smithi086.stdout:6/936: symlink db/d37/d28/d121/l126 0 2024-08-19T00:56:19.641 INFO:tasks.workunit.client.0.smithi017.stdout:4/501: mknod d2/d21/d40/d8b/cac 0 2024-08-19T00:56:19.642 INFO:tasks.workunit.client.1.smithi086.stdout:5/925: write d0/d99/fad [610307,24987] 0 2024-08-19T00:56:19.642 INFO:tasks.workunit.client.0.smithi017.stdout:4/502: readlink d2/d16/l17 0 2024-08-19T00:56:19.643 INFO:tasks.workunit.client.1.smithi086.stdout:9/938: unlink db/d26/d5c/d87/d30/d31/d103/de2/dee/def/l10b 0 2024-08-19T00:56:19.646 INFO:tasks.workunit.client.0.smithi017.stdout:6/475: unlink d5/d13/f16 0 2024-08-19T00:56:19.647 INFO:tasks.workunit.client.1.smithi086.stdout:7/928: write d3/d34/d44/d58/d4b/da5/daf/de7/df5/fbe [73746,105064] 0 2024-08-19T00:56:19.648 INFO:tasks.workunit.client.0.smithi017.stdout:7/513: link d3/dc/df/d7d/f9b d3/dc/df/d3d/d90/d87/fa3 0 2024-08-19T00:56:19.649 INFO:tasks.workunit.client.0.smithi017.stdout:7/514: readlink d3/dc/df/d1a/l20 0 2024-08-19T00:56:19.651 INFO:tasks.workunit.client.0.smithi017.stdout:5/343: truncate db/d19/d1f/f50 2158971 0 2024-08-19T00:56:19.652 INFO:tasks.workunit.client.1.smithi086.stdout:0/917: mkdir da/d14/d55/d10c/dc8/d129 0 2024-08-19T00:56:19.652 INFO:tasks.workunit.client.0.smithi017.stdout:5/344: fsync db/d19/d1f/d15/d3e/d40/d49/f76 0 2024-08-19T00:56:19.653 INFO:tasks.workunit.client.0.smithi017.stdout:1/417: creat d4/dc/d19/f79 x:0 0 0 2024-08-19T00:56:19.653 INFO:tasks.workunit.client.1.smithi086.stdout:2/979: write d8/f40 [1587232,41543] 0 2024-08-19T00:56:19.654 INFO:tasks.workunit.client.1.smithi086.stdout:3/927: symlink d3/d18/d27/l12c 0 2024-08-19T00:56:19.655 INFO:tasks.workunit.client.1.smithi086.stdout:9/939: dread db/d26/d5c/d87/d30/d3f/f71 [0,4194304] 0 2024-08-19T00:56:19.657 INFO:tasks.workunit.client.1.smithi086.stdout:9/940: chown db/d26/d5c/d87/d6d/c8d 0 1 2024-08-19T00:56:19.659 INFO:tasks.workunit.client.1.smithi086.stdout:4/883: dwrite d2/d18/d33/f65 [0,4194304] 0 2024-08-19T00:56:19.662 INFO:tasks.workunit.client.1.smithi086.stdout:5/926: rename d0/d2d/d4f/df3 to d0/d99/dc0/d125 0 2024-08-19T00:56:19.664 INFO:tasks.workunit.client.0.smithi017.stdout:6/476: chown d5/d13/d11/d4d 5117707 1 2024-08-19T00:56:19.665 INFO:tasks.workunit.client.1.smithi086.stdout:4/884: dwrite d2/f1b [4194304,4194304] 0 2024-08-19T00:56:19.668 INFO:tasks.workunit.client.1.smithi086.stdout:4/885: chown d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/ld1 186032 1 2024-08-19T00:56:19.672 INFO:tasks.workunit.client.1.smithi086.stdout:3/928: mknod d3/d18/d19/dbc/de1/c12d 0 2024-08-19T00:56:19.672 INFO:tasks.workunit.client.1.smithi086.stdout:4/886: chown d2/d18/d33/d42/d72/d2f 266469592 1 2024-08-19T00:56:19.672 INFO:tasks.workunit.client.1.smithi086.stdout:5/927: dwrite d0/d5f/d60/d57/f58 [0,4194304] 0 2024-08-19T00:56:19.672 INFO:tasks.workunit.client.0.smithi017.stdout:0/475: truncate d5/f10 3209161 0 2024-08-19T00:56:19.674 INFO:tasks.workunit.client.1.smithi086.stdout:5/928: chown d0/d99/dc0/d125/d11b/d1f/c21 591854 1 2024-08-19T00:56:19.675 INFO:tasks.workunit.client.1.smithi086.stdout:5/929: fsync d0/d2d/f10d 0 2024-08-19T00:56:19.677 INFO:tasks.workunit.client.1.smithi086.stdout:9/941: unlink db/d96/lff 0 2024-08-19T00:56:19.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:19 smithi017 ceph-mon[16627]: pgmap v20: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 76 MiB/s rd, 206 MiB/s wr, 395 op/s 2024-08-19T00:56:19.684 INFO:tasks.workunit.client.0.smithi017.stdout:7/515: mknod d3/dc/ca4 0 2024-08-19T00:56:19.684 INFO:tasks.workunit.client.1.smithi086.stdout:8/909: link dc/d16/d18/cd1 dc/d16/d18/d106/c129 0 2024-08-19T00:56:19.685 INFO:tasks.workunit.client.0.smithi017.stdout:3/474: dwrite d5/da/d3c/d4f/f52 [0,4194304] 0 2024-08-19T00:56:19.687 INFO:tasks.workunit.client.0.smithi017.stdout:5/345: mkdir db/d19/d1f/d15/d3e/d40/d49/d63/d7b 0 2024-08-19T00:56:19.689 INFO:tasks.workunit.client.1.smithi086.stdout:4/887: stat d2/ce2 0 2024-08-19T00:56:19.693 INFO:tasks.workunit.client.1.smithi086.stdout:9/942: creat db/d100/f136 x:0 0 0 2024-08-19T00:56:19.694 INFO:tasks.workunit.client.0.smithi017.stdout:4/503: creat d2/d1a/d55/fad x:0 0 0 2024-08-19T00:56:19.695 INFO:tasks.workunit.client.1.smithi086.stdout:7/929: creat d3/d34/d44/d58/d4b/da5/f134 x:0 0 0 2024-08-19T00:56:19.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:19 smithi086 ceph-mon[24511]: pgmap v20: 65 pgs: 65 active+clean; 2.6 GiB data, 7.6 GiB used, 529 GiB / 536 GiB avail; 76 MiB/s rd, 206 MiB/s wr, 395 op/s 2024-08-19T00:56:19.696 INFO:tasks.workunit.client.1.smithi086.stdout:7/930: chown d3/d34/d44/d58/d4b/f7c 65268281 1 2024-08-19T00:56:19.696 INFO:tasks.workunit.client.1.smithi086.stdout:8/910: symlink dc/d1f/d37/d4f/dac/db8/d7a/d88/db2/l12a 0 2024-08-19T00:56:19.698 INFO:tasks.workunit.client.1.smithi086.stdout:8/911: write dc/d1f/dc9/ffc [857252,95698] 0 2024-08-19T00:56:19.700 INFO:tasks.workunit.client.1.smithi086.stdout:9/943: symlink db/d26/d5c/d87/d30/d3f/d43/d4e/d7a/l137 0 2024-08-19T00:56:19.700 INFO:tasks.workunit.client.0.smithi017.stdout:7/516: truncate d3/dc/d5f/f63 3913071 0 2024-08-19T00:56:19.702 INFO:tasks.workunit.client.1.smithi086.stdout:7/931: rename d3/d34/d44/d58/d4b/d78/d9a/ffa to d3/d34/d10a/f135 0 2024-08-19T00:56:19.704 INFO:tasks.workunit.client.0.smithi017.stdout:0/476: mknod d5/ca0 0 2024-08-19T00:56:19.705 INFO:tasks.workunit.client.1.smithi086.stdout:5/930: dwrite d0/fa [0,4194304] 0 2024-08-19T00:56:19.706 INFO:tasks.workunit.client.0.smithi017.stdout:2/538: link d2/d7/d10/d19/d48/f9c d2/d7/d10/d35/d55/fb0 0 2024-08-19T00:56:19.707 INFO:tasks.workunit.client.1.smithi086.stdout:4/888: dread d2/d18/d33/d42/d72/d78/d25/f35 [0,4194304] 0 2024-08-19T00:56:19.707 INFO:tasks.workunit.client.1.smithi086.stdout:9/944: dread db/d26/d5c/d87/d30/f7f [0,4194304] 0 2024-08-19T00:56:19.708 INFO:tasks.workunit.client.1.smithi086.stdout:5/931: write d0/d99/dc0/dc2/f79 [2538127,2577] 0 2024-08-19T00:56:19.708 INFO:tasks.workunit.client.0.smithi017.stdout:2/539: truncate d2/d7/d10/d3b/d3c/f9b 28872 0 2024-08-19T00:56:19.710 INFO:tasks.workunit.client.1.smithi086.stdout:3/929: dread d3/d18/d27/d49/d3f/d5b/f70 [0,4194304] 0 2024-08-19T00:56:19.715 INFO:tasks.workunit.client.0.smithi017.stdout:7/517: mknod d3/dc/df/d3d/ca5 0 2024-08-19T00:56:19.716 INFO:tasks.workunit.client.1.smithi086.stdout:3/930: dwrite d3/d18/d27/d49/d3f/d5b/fa1 [0,4194304] 0 2024-08-19T00:56:19.718 INFO:tasks.workunit.client.0.smithi017.stdout:5/346: dwrite db/f10 [0,4194304] 0 2024-08-19T00:56:19.721 INFO:tasks.workunit.client.0.smithi017.stdout:0/477: creat d5/d17/d21/d39/fa1 x:0 0 0 2024-08-19T00:56:19.722 INFO:tasks.workunit.client.1.smithi086.stdout:7/932: dwrite d3/d34/d44/d58/d4b/d78/fdf [0,4194304] 0 2024-08-19T00:56:19.725 INFO:tasks.workunit.client.1.smithi086.stdout:4/889: rmdir d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd 39 2024-08-19T00:56:19.726 INFO:tasks.workunit.client.0.smithi017.stdout:4/504: mkdir d2/d21/d40/d56/d95/dae 0 2024-08-19T00:56:19.728 INFO:tasks.workunit.client.0.smithi017.stdout:2/540: rmdir d2/d7/d10/d35/d45 39 2024-08-19T00:56:19.731 INFO:tasks.workunit.client.0.smithi017.stdout:6/477: getdents d5/d13/d11/d2c/d4a/d64/d86/d90 0 2024-08-19T00:56:19.731 INFO:tasks.workunit.client.0.smithi017.stdout:2/541: chown d2/d7/d10/d3b/d80/cae 16 1 2024-08-19T00:56:19.732 INFO:tasks.workunit.client.1.smithi086.stdout:5/932: creat d0/d99/dc0/d125/d11b/d1f/d33/dea/f126 x:0 0 0 2024-08-19T00:56:19.734 INFO:tasks.workunit.client.0.smithi017.stdout:3/475: creat d5/d15/f91 x:0 0 0 2024-08-19T00:56:19.735 INFO:tasks.workunit.client.1.smithi086.stdout:9/945: write f7 [7373799,58370] 0 2024-08-19T00:56:19.738 INFO:tasks.workunit.client.0.smithi017.stdout:6/478: dread - d5/d13/d11/d2c/d4a/d64/d86/d90/f98 zero size 2024-08-19T00:56:19.738 INFO:tasks.workunit.client.0.smithi017.stdout:4/505: dwrite d2/d11/f14 [4194304,4194304] 0 2024-08-19T00:56:19.738 INFO:tasks.workunit.client.1.smithi086.stdout:8/912: rename dc/d1f/d37/d4f/dac/db8/d99/f123 to dc/d16/d18/f12b 0 2024-08-19T00:56:19.738 INFO:tasks.workunit.client.1.smithi086.stdout:9/946: write db/d26/d5c/d87/d30/d32/d44/dc1/dec/f132 [1751729,31319] 0 2024-08-19T00:56:19.738 INFO:tasks.workunit.client.1.smithi086.stdout:8/913: dread - dc/d1f/d37/d4f/dac/db8/d7a/d9b/f6f zero size 2024-08-19T00:56:19.739 INFO:tasks.workunit.client.0.smithi017.stdout:7/518: truncate d3/d3c/f43 1251193 0 2024-08-19T00:56:19.740 INFO:tasks.workunit.client.0.smithi017.stdout:3/476: truncate d5/d15/d1b/f79 1840882 0 2024-08-19T00:56:19.742 INFO:tasks.workunit.client.0.smithi017.stdout:0/478: rename d5/d17/d2b/f9f to d5/d17/d45/d77/fa2 0 2024-08-19T00:56:19.744 INFO:tasks.workunit.client.0.smithi017.stdout:0/479: fsync d5/d17/d26/d30/d3e/d5a/f84 0 2024-08-19T00:56:19.745 INFO:tasks.workunit.client.1.smithi086.stdout:5/933: creat d0/d5f/d60/d57/d80/da0/f127 x:0 0 0 2024-08-19T00:56:19.746 INFO:tasks.workunit.client.1.smithi086.stdout:5/934: dread - d0/d5f/d60/d57/d80/da0/f127 zero size 2024-08-19T00:56:19.746 INFO:tasks.workunit.client.1.smithi086.stdout:5/935: readlink d0/d5f/l116 0 2024-08-19T00:56:19.747 INFO:tasks.workunit.client.0.smithi017.stdout:4/506: chown d2/d16/f3f 209010686 1 2024-08-19T00:56:19.748 INFO:tasks.workunit.client.0.smithi017.stdout:6/479: dwrite d5/d13/d20/d5e/d95/f96 [0,4194304] 0 2024-08-19T00:56:19.749 INFO:tasks.workunit.client.0.smithi017.stdout:4/507: dread - d2/d21/d40/d84/fab zero size 2024-08-19T00:56:19.750 INFO:tasks.workunit.client.0.smithi017.stdout:4/508: readlink d2/d21/d53/l66 0 2024-08-19T00:56:19.751 INFO:tasks.workunit.client.1.smithi086.stdout:3/931: fdatasync d3/d18/d61/f97 0 2024-08-19T00:56:19.752 INFO:tasks.workunit.client.1.smithi086.stdout:4/890: fdatasync d2/d18/d33/d42/d72/d78/d9e/dc6/ffd 0 2024-08-19T00:56:19.755 INFO:tasks.workunit.client.0.smithi017.stdout:6/480: dread d5/d13/d20/d5e/d95/f96 [0,4194304] 0 2024-08-19T00:56:19.755 INFO:tasks.workunit.client.1.smithi086.stdout:9/947: mknod db/d26/d5c/d87/c138 0 2024-08-19T00:56:19.758 INFO:tasks.workunit.client.0.smithi017.stdout:2/542: creat d2/d7/d10/d35/d7e/fb1 x:0 0 0 2024-08-19T00:56:19.759 INFO:tasks.workunit.client.0.smithi017.stdout:0/480: mkdir d5/d17/d26/d30/da3 0 2024-08-19T00:56:19.761 INFO:tasks.workunit.client.0.smithi017.stdout:0/481: dread - d5/d17/d26/d30/d3e/f91 zero size 2024-08-19T00:56:19.761 INFO:tasks.workunit.client.0.smithi017.stdout:5/347: link db/d19/d1f/d15/d1e/l2d db/d19/d1f/d15/d30/l7c 0 2024-08-19T00:56:19.763 INFO:tasks.workunit.client.1.smithi086.stdout:8/914: write dc/d17/dd3/ff5 [3547,57966] 0 2024-08-19T00:56:19.764 INFO:tasks.workunit.client.1.smithi086.stdout:8/915: write dc/d1f/d37/d4f/dac/db8/fe6 [2878804,103210] 0 2024-08-19T00:56:19.765 INFO:tasks.workunit.client.1.smithi086.stdout:4/891: mknod d2/d18/d33/d42/d72/d78/d25/d55/de1/d115/c126 0 2024-08-19T00:56:19.767 INFO:tasks.workunit.client.1.smithi086.stdout:9/948: symlink db/d26/d5c/d87/d30/l139 0 2024-08-19T00:56:19.769 INFO:tasks.workunit.client.0.smithi017.stdout:5/348: dwrite db/d19/d1f/d15/d3e/d40/f6e [0,4194304] 0 2024-08-19T00:56:19.771 INFO:tasks.workunit.client.1.smithi086.stdout:4/892: dwrite d2/d18/d33/d42/d72/d8f/f10d [0,4194304] 0 2024-08-19T00:56:19.771 INFO:tasks.workunit.client.0.smithi017.stdout:4/509: rename d2/d21/d40/d84/fab to d2/d1a/d55/d73/da6/faf 0 2024-08-19T00:56:19.774 INFO:tasks.workunit.client.0.smithi017.stdout:6/481: creat d5/d13/d11/d2c/fa7 x:0 0 0 2024-08-19T00:56:19.774 INFO:tasks.workunit.client.0.smithi017.stdout:4/510: read d2/d21/d40/d56/f47 [1709063,58941] 0 2024-08-19T00:56:19.776 INFO:tasks.workunit.client.1.smithi086.stdout:4/893: dread - d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/fe4 zero size 2024-08-19T00:56:19.777 INFO:tasks.workunit.client.1.smithi086.stdout:5/936: write d0/d99/dc0/d125/d11b/f1a [6840523,45807] 0 2024-08-19T00:56:19.778 INFO:tasks.workunit.client.1.smithi086.stdout:4/894: chown d2/d18/d33/d42/d72/d78 294 1 2024-08-19T00:56:19.779 INFO:tasks.workunit.client.1.smithi086.stdout:8/916: mknod dc/d1f/c12c 0 2024-08-19T00:56:19.782 INFO:tasks.workunit.client.1.smithi086.stdout:5/937: creat d0/d2d/d43/d91/f128 x:0 0 0 2024-08-19T00:56:19.786 INFO:tasks.workunit.client.1.smithi086.stdout:8/917: rename dc/d1f/d37/d4f/dac/db8/d7a/d9b/f3d to dc/d16/d18/df2/f12d 0 2024-08-19T00:56:19.790 INFO:tasks.workunit.client.0.smithi017.stdout:5/349: mknod db/d19/d1f/d15/d3e/d40/d49/d63/c7d 0 2024-08-19T00:56:19.790 INFO:tasks.workunit.client.1.smithi086.stdout:8/918: creat dc/d17/d86/f12e x:0 0 0 2024-08-19T00:56:19.791 INFO:tasks.workunit.client.1.smithi086.stdout:5/938: creat d0/d5f/d60/d57/d80/da3/db7/f129 x:0 0 0 2024-08-19T00:56:19.793 INFO:tasks.workunit.client.1.smithi086.stdout:8/919: mknod dc/d16/dc7/dff/c12f 0 2024-08-19T00:56:19.794 INFO:tasks.workunit.client.0.smithi017.stdout:4/511: creat d2/d16/d70/fb0 x:0 0 0 2024-08-19T00:56:19.794 INFO:tasks.workunit.client.1.smithi086.stdout:8/920: chown dc/d1f/d37/d4f/dac/db8/d8f/fc1 5800072 1 2024-08-19T00:56:19.794 INFO:tasks.workunit.client.0.smithi017.stdout:4/512: readlink d2/d16/l9b 0 2024-08-19T00:56:19.795 INFO:tasks.workunit.client.0.smithi017.stdout:2/543: getdents d2/d7/dd 0 2024-08-19T00:56:19.796 INFO:tasks.workunit.client.0.smithi017.stdout:0/482: mkdir d5/da4 0 2024-08-19T00:56:19.798 INFO:tasks.workunit.client.0.smithi017.stdout:3/477: getdents d5/d18 0 2024-08-19T00:56:19.800 INFO:tasks.workunit.client.1.smithi086.stdout:5/939: creat d0/d2d/d43/f12a x:0 0 0 2024-08-19T00:56:19.801 INFO:tasks.workunit.client.1.smithi086.stdout:5/940: chown d0/d99/dc0/d106 100931228 1 2024-08-19T00:56:19.803 INFO:tasks.workunit.client.1.smithi086.stdout:5/941: write d0/d99/dc0/d125/d11b/d1f/d65/dfd/f54 [3870760,44613] 0 2024-08-19T00:56:19.804 INFO:tasks.workunit.client.0.smithi017.stdout:7/519: getdents d3/dc/df/d3d/d90 0 2024-08-19T00:56:19.806 INFO:tasks.workunit.client.1.smithi086.stdout:4/895: dwrite d2/d18/d33/d42/d72/d78/f3c [0,4194304] 0 2024-08-19T00:56:19.809 INFO:tasks.workunit.client.0.smithi017.stdout:0/483: creat d5/d18/d3a/fa5 x:0 0 0 2024-08-19T00:56:19.809 INFO:tasks.workunit.client.0.smithi017.stdout:6/482: dread d5/d13/d11/f5c [0,4194304] 0 2024-08-19T00:56:19.812 INFO:tasks.workunit.client.0.smithi017.stdout:7/520: dwrite d3/dc/df/d1a/f4a [0,4194304] 0 2024-08-19T00:56:19.812 INFO:tasks.workunit.client.0.smithi017.stdout:0/484: chown d5/d17/d26/d30/d5d/l6b 1068 1 2024-08-19T00:56:19.817 INFO:tasks.workunit.client.1.smithi086.stdout:4/896: rmdir d2/d18/d33 39 2024-08-19T00:56:19.818 INFO:tasks.workunit.client.0.smithi017.stdout:8/335: sync 2024-08-19T00:56:19.821 INFO:tasks.workunit.client.0.smithi017.stdout:5/350: creat db/d19/d1f/d15/d3e/d40/d49/d63/d7b/f7e x:0 0 0 2024-08-19T00:56:19.824 INFO:tasks.workunit.client.0.smithi017.stdout:5/351: write db/d19/d1f/d15/d3e/d40/d49/d63/d7b/f7e [244570,42970] 0 2024-08-19T00:56:19.825 INFO:tasks.workunit.client.1.smithi086.stdout:5/942: creat d0/d99/dc0/d125/d11b/d1f/f12b x:0 0 0 2024-08-19T00:56:19.827 INFO:tasks.workunit.client.0.smithi017.stdout:4/513: link d2/d11/f59 d2/d1a/d55/d73/fb1 0 2024-08-19T00:56:19.827 INFO:tasks.workunit.client.0.smithi017.stdout:8/336: dwrite de/d15/d39/f59 [4194304,4194304] 0 2024-08-19T00:56:19.829 INFO:tasks.workunit.client.1.smithi086.stdout:4/897: rename d2/d18/d33/d42/d72/d2f/d8e/c10b to d2/d18/d33/d42/d72/d78/d9e/dc6/c127 0 2024-08-19T00:56:19.830 INFO:tasks.workunit.client.0.smithi017.stdout:2/544: creat d2/d7/d10/d35/d45/d58/fb2 x:0 0 0 2024-08-19T00:56:19.831 INFO:tasks.workunit.client.0.smithi017.stdout:2/545: chown d2/d7/d10/d3b/d54/la8 10822 1 2024-08-19T00:56:19.832 INFO:tasks.workunit.client.1.smithi086.stdout:4/898: write d2/d18/d33/d42/d72/d8f/fd2 [2701498,13363] 0 2024-08-19T00:56:19.833 INFO:tasks.workunit.client.1.smithi086.stdout:4/899: chown d2/d18 3 1 2024-08-19T00:56:19.835 INFO:tasks.workunit.client.0.smithi017.stdout:3/478: mkdir d5/d15/d92 0 2024-08-19T00:56:19.836 INFO:tasks.workunit.client.1.smithi086.stdout:8/921: dwrite dc/f51 [0,4194304] 0 2024-08-19T00:56:19.839 INFO:tasks.workunit.client.0.smithi017.stdout:2/546: dread d2/d7/f43 [0,4194304] 0 2024-08-19T00:56:19.842 INFO:tasks.workunit.client.0.smithi017.stdout:2/547: write d2/d7/d10/d3b/d80/f8f [567530,108822] 0 2024-08-19T00:56:19.842 INFO:tasks.workunit.client.0.smithi017.stdout:6/483: mkdir d5/d13/d11/d2c/d4a/da8 0 2024-08-19T00:56:19.844 INFO:tasks.workunit.client.1.smithi086.stdout:8/922: rmdir dc/d1f/d37 39 2024-08-19T00:56:19.844 INFO:tasks.workunit.client.0.smithi017.stdout:6/484: chown d5/d13/d20/d5e/d8f/f97 1294496 1 2024-08-19T00:56:19.847 INFO:tasks.workunit.client.0.smithi017.stdout:4/514: mkdir d2/d87/db2 0 2024-08-19T00:56:19.853 INFO:tasks.workunit.client.1.smithi086.stdout:5/943: dread d0/d5f/f6f [0,4194304] 0 2024-08-19T00:56:19.853 INFO:tasks.workunit.client.1.smithi086.stdout:4/900: getdents d2/d18/d33/d42/d72/d78/d25/d30/d5d 0 2024-08-19T00:56:19.854 INFO:tasks.workunit.client.0.smithi017.stdout:0/485: write d5/d18/f66 [120896,129091] 0 2024-08-19T00:56:19.856 INFO:tasks.workunit.client.0.smithi017.stdout:6/485: rmdir d5/d13/d11/d2c/d51/d7e 39 2024-08-19T00:56:19.857 INFO:tasks.workunit.client.0.smithi017.stdout:8/337: write f0 [2676765,56444] 0 2024-08-19T00:56:19.857 INFO:tasks.workunit.client.0.smithi017.stdout:8/338: stat de/d15/f2b 0 2024-08-19T00:56:19.858 INFO:tasks.workunit.client.1.smithi086.stdout:4/901: truncate d2/d18/d33/d42/d72/ff 282821 0 2024-08-19T00:56:19.859 INFO:tasks.workunit.client.0.smithi017.stdout:4/515: creat d2/d21/d40/d56/d99/da3/fb3 x:0 0 0 2024-08-19T00:56:19.860 INFO:tasks.workunit.client.0.smithi017.stdout:0/486: readlink d5/d17/d21/d42/l5c 0 2024-08-19T00:56:19.862 INFO:tasks.workunit.client.1.smithi086.stdout:4/902: creat d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/f128 x:0 0 0 2024-08-19T00:56:19.862 INFO:tasks.workunit.client.1.smithi086.stdout:8/923: write dc/d16/d18/d106/d28/f92 [999516,15514] 0 2024-08-19T00:56:19.862 INFO:tasks.workunit.client.1.smithi086.stdout:5/944: getdents d0/d99/dc0/d125/d11b/d1f/d65 0 2024-08-19T00:56:19.863 INFO:tasks.workunit.client.0.smithi017.stdout:3/479: creat d5/da/d3c/f93 x:0 0 0 2024-08-19T00:56:19.864 INFO:tasks.workunit.client.1.smithi086.stdout:8/924: dread - dc/d16/d18/d106/d28/d2b/d3b/d87/f102 zero size 2024-08-19T00:56:19.864 INFO:tasks.workunit.client.1.smithi086.stdout:4/903: write d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/fbf [644701,9489] 0 2024-08-19T00:56:19.865 INFO:tasks.workunit.client.0.smithi017.stdout:8/339: unlink de/d15/d39/f4c 0 2024-08-19T00:56:19.866 INFO:tasks.workunit.client.1.smithi086.stdout:5/945: mkdir d0/d5f/d60/d5b/d111/d12c 0 2024-08-19T00:56:19.869 INFO:tasks.workunit.client.0.smithi017.stdout:0/487: read d5/d17/d21/d42/f1d [445145,128320] 0 2024-08-19T00:56:19.870 INFO:tasks.workunit.client.1.smithi086.stdout:8/925: read - dc/d1f/d37/d4f/dac/db8/f11a zero size 2024-08-19T00:56:19.871 INFO:tasks.workunit.client.0.smithi017.stdout:3/480: creat d5/da/d3c/d4f/f94 x:0 0 0 2024-08-19T00:56:19.871 INFO:tasks.workunit.client.0.smithi017.stdout:0/488: fdatasync d5/d17/d26/f80 0 2024-08-19T00:56:19.872 INFO:tasks.workunit.client.1.smithi086.stdout:5/946: dwrite d0/d99/da2/fdd [0,4194304] 0 2024-08-19T00:56:19.872 INFO:tasks.workunit.client.0.smithi017.stdout:4/516: dwrite d2/d21/d53/d57/fa2 [0,4194304] 0 2024-08-19T00:56:19.874 INFO:tasks.workunit.client.1.smithi086.stdout:8/926: mkdir dc/d16/d18/d106/d28/d2b/d3b/d87/de2/d130 0 2024-08-19T00:56:19.874 INFO:tasks.workunit.client.0.smithi017.stdout:3/481: dread - d5/f60 zero size 2024-08-19T00:56:19.874 INFO:tasks.workunit.client.0.smithi017.stdout:2/548: link d2/l5 d2/d7/d10/d3b/d69/lb3 0 2024-08-19T00:56:19.881 INFO:tasks.workunit.client.0.smithi017.stdout:2/549: truncate d2/d7/d10/d3b/d97/f9a 178381 0 2024-08-19T00:56:19.881 INFO:tasks.workunit.client.0.smithi017.stdout:2/550: stat d2/d7/d10/d3b 0 2024-08-19T00:56:19.882 INFO:tasks.workunit.client.0.smithi017.stdout:8/340: unlink de/d15/d39/c57 0 2024-08-19T00:56:19.882 INFO:tasks.workunit.client.0.smithi017.stdout:4/517: mknod d2/d21/d40/d56/d99/da3/cb4 0 2024-08-19T00:56:19.883 INFO:tasks.workunit.client.0.smithi017.stdout:8/341: chown f0 2142829889 1 2024-08-19T00:56:19.884 INFO:tasks.workunit.client.0.smithi017.stdout:2/551: chown d2/d7/d29/f31 80983 1 2024-08-19T00:56:19.884 INFO:tasks.workunit.client.0.smithi017.stdout:4/518: chown d2/d21/d40/d56/f47 172 1 2024-08-19T00:56:19.885 INFO:tasks.workunit.client.0.smithi017.stdout:0/489: rename d5/d18/f66 to d5/d17/d26/d30/da3/fa6 0 2024-08-19T00:56:19.890 INFO:tasks.workunit.client.0.smithi017.stdout:8/342: unlink de/d15/l3a 0 2024-08-19T00:56:19.895 INFO:tasks.workunit.client.0.smithi017.stdout:8/343: unlink de/d15/d39/d3d/f5a 0 2024-08-19T00:56:19.897 INFO:tasks.workunit.client.0.smithi017.stdout:0/490: symlink d5/d18/d78/la7 0 2024-08-19T00:56:19.901 INFO:tasks.workunit.client.0.smithi017.stdout:2/552: creat d2/d7/d10/d3b/fb4 x:0 0 0 2024-08-19T00:56:19.901 INFO:tasks.workunit.client.0.smithi017.stdout:4/519: write d2/d21/f42 [106345,45387] 0 2024-08-19T00:56:19.904 INFO:tasks.workunit.client.0.smithi017.stdout:3/482: truncate d5/d11/f62 2927834 0 2024-08-19T00:56:19.905 INFO:tasks.workunit.client.0.smithi017.stdout:0/491: dread d5/d18/d3a/f5f [0,4194304] 0 2024-08-19T00:56:19.906 INFO:tasks.workunit.client.0.smithi017.stdout:4/520: unlink d2/d21/d53/d57/l93 0 2024-08-19T00:56:19.909 INFO:tasks.workunit.client.0.smithi017.stdout:2/553: rename d2/d7/d44/l86 to d2/d7/d10/d3b/d97/lb5 0 2024-08-19T00:56:19.911 INFO:tasks.workunit.client.0.smithi017.stdout:8/344: link de/f37 de/f5d 0 2024-08-19T00:56:19.912 INFO:tasks.workunit.client.0.smithi017.stdout:8/345: read de/d36/f32 [3103569,20588] 0 2024-08-19T00:56:19.913 INFO:tasks.workunit.client.0.smithi017.stdout:3/483: fdatasync d5/da/d27/d28/f37 0 2024-08-19T00:56:19.913 INFO:tasks.workunit.client.0.smithi017.stdout:4/521: dread d2/d16/f1f [0,4194304] 0 2024-08-19T00:56:19.914 INFO:tasks.workunit.client.0.smithi017.stdout:8/346: dread - de/f51 zero size 2024-08-19T00:56:19.926 INFO:tasks.workunit.client.0.smithi017.stdout:0/492: creat d5/d18/fa8 x:0 0 0 2024-08-19T00:56:19.927 INFO:tasks.workunit.client.1.smithi086.stdout:5/947: mkdir d0/d5f/d60/d57/d80/da3/d12d 0 2024-08-19T00:56:19.927 INFO:tasks.workunit.client.1.smithi086.stdout:5/948: readlink d0/d99/dc0/l10e 0 2024-08-19T00:56:19.928 INFO:tasks.workunit.client.0.smithi017.stdout:2/554: rename d2/d7/d10/l7c to d2/d7/d10/d3b/d3c/d8a/lb6 0 2024-08-19T00:56:19.928 INFO:tasks.workunit.client.1.smithi086.stdout:5/949: dread - d0/d99/dc0/d125/d11b/d1f/d33/f117 zero size 2024-08-19T00:56:19.929 INFO:tasks.workunit.client.0.smithi017.stdout:4/522: rmdir d2/d1a/d55/d6a 0 2024-08-19T00:56:19.929 INFO:tasks.workunit.client.0.smithi017.stdout:8/347: dwrite de/f47 [0,4194304] 0 2024-08-19T00:56:19.933 INFO:tasks.workunit.client.1.smithi086.stdout:8/927: fsync dc/d1f/d37/d4f/dac/fbd 0 2024-08-19T00:56:19.935 INFO:tasks.workunit.client.0.smithi017.stdout:0/493: creat d5/d17/d26/d30/fa9 x:0 0 0 2024-08-19T00:56:19.935 INFO:tasks.workunit.client.1.smithi086.stdout:5/950: dread d0/d8/fee [0,4194304] 0 2024-08-19T00:56:19.935 INFO:tasks.workunit.client.1.smithi086.stdout:4/904: dread d2/d18/d33/d42/d72/f14 [0,4194304] 0 2024-08-19T00:56:19.936 INFO:tasks.workunit.client.1.smithi086.stdout:5/951: dread - d0/d20/dfa/f121 zero size 2024-08-19T00:56:19.936 INFO:tasks.workunit.client.0.smithi017.stdout:3/484: dwrite d5/d11/f34 [8388608,4194304] 0 2024-08-19T00:56:19.944 INFO:tasks.workunit.client.0.smithi017.stdout:0/494: read d5/f10 [485904,57472] 0 2024-08-19T00:56:19.944 INFO:tasks.workunit.client.0.smithi017.stdout:8/348: truncate de/f34 208196 0 2024-08-19T00:56:19.946 INFO:tasks.workunit.client.0.smithi017.stdout:0/495: dread d5/d17/d21/d42/f86 [0,4194304] 0 2024-08-19T00:56:19.947 INFO:tasks.workunit.client.0.smithi017.stdout:3/485: creat d5/da/f95 x:0 0 0 2024-08-19T00:56:19.947 INFO:tasks.workunit.client.0.smithi017.stdout:4/523: getdents d2/d21/d40/d56/d99/da3 0 2024-08-19T00:56:19.950 INFO:tasks.workunit.client.0.smithi017.stdout:3/486: creat d5/da/d27/d28/f96 x:0 0 0 2024-08-19T00:56:19.952 INFO:tasks.workunit.client.0.smithi017.stdout:0/496: write d5/fa [3440345,93211] 0 2024-08-19T00:56:19.953 INFO:tasks.workunit.client.0.smithi017.stdout:4/524: mkdir d2/d87/db2/db5 0 2024-08-19T00:56:19.954 INFO:tasks.workunit.client.0.smithi017.stdout:3/487: unlink d5/da/d3c/d4f/l7e 0 2024-08-19T00:56:19.957 INFO:tasks.workunit.client.0.smithi017.stdout:4/525: creat d2/d1a/d20/fb6 x:0 0 0 2024-08-19T00:56:19.957 INFO:tasks.workunit.client.0.smithi017.stdout:8/349: dwrite de/d15/d39/d3d/f4b [4194304,4194304] 0 2024-08-19T00:56:19.958 INFO:tasks.workunit.client.0.smithi017.stdout:0/497: readlink d5/d17/d21/d39/l98 0 2024-08-19T00:56:19.960 INFO:tasks.workunit.client.0.smithi017.stdout:0/498: chown d5/d17/d21 14798102 1 2024-08-19T00:56:19.961 INFO:tasks.workunit.client.0.smithi017.stdout:3/488: rename d5/da/d3c/l87 to d5/d15/l97 0 2024-08-19T00:56:19.962 INFO:tasks.workunit.client.0.smithi017.stdout:2/555: write d2/f1a [846250,105353] 0 2024-08-19T00:56:19.962 INFO:tasks.workunit.client.1.smithi086.stdout:6/937: sync 2024-08-19T00:56:19.963 INFO:tasks.workunit.client.0.smithi017.stdout:4/526: symlink d2/d1a/d55/d8f/lb7 0 2024-08-19T00:56:19.967 INFO:tasks.workunit.client.0.smithi017.stdout:0/499: rmdir d5/d18/d3a 39 2024-08-19T00:56:19.967 INFO:tasks.workunit.client.0.smithi017.stdout:2/556: write d2/d7/d10/d3b/d3c/d8a/d6b/f9d [4364,34360] 0 2024-08-19T00:56:19.969 INFO:tasks.workunit.client.1.smithi086.stdout:6/938: dread db/d8e/fd6 [0,4194304] 0 2024-08-19T00:56:19.970 INFO:tasks.workunit.client.1.smithi086.stdout:6/939: fsync db/f46 0 2024-08-19T00:56:19.971 INFO:tasks.workunit.client.0.smithi017.stdout:4/527: creat d2/d21/d40/d8b/fb8 x:0 0 0 2024-08-19T00:56:19.971 INFO:tasks.workunit.client.0.smithi017.stdout:3/489: dwrite d5/da/d27/f4c [0,4194304] 0 2024-08-19T00:56:19.972 INFO:tasks.workunit.client.1.smithi086.stdout:8/928: dwrite dc/d1f/d37/f72 [4194304,4194304] 0 2024-08-19T00:56:19.972 INFO:tasks.workunit.client.0.smithi017.stdout:8/350: symlink de/d15/d39/d3d/l5e 0 2024-08-19T00:56:19.973 INFO:tasks.workunit.client.1.smithi086.stdout:6/940: chown db/d37/d41/dad/lb1 64059 1 2024-08-19T00:56:19.973 INFO:tasks.workunit.client.1.smithi086.stdout:5/952: dread d0/d8/d10/f2b [0,4194304] 0 2024-08-19T00:56:19.973 INFO:tasks.workunit.client.0.smithi017.stdout:0/500: symlink d5/d17/d26/d30/d3e/d5a/laa 0 2024-08-19T00:56:19.974 INFO:tasks.workunit.client.1.smithi086.stdout:8/929: stat dc/d1f/d37/d4f/d11b 0 2024-08-19T00:56:19.976 INFO:tasks.workunit.client.1.smithi086.stdout:6/941: write db/d37/d44/d5a/d78/f92 [1531939,111083] 0 2024-08-19T00:56:19.977 INFO:tasks.workunit.client.0.smithi017.stdout:2/557: mkdir d2/d7/d10/d3b/d80/da2/db7 0 2024-08-19T00:56:19.986 INFO:tasks.workunit.client.0.smithi017.stdout:3/490: creat d5/da/d27/d28/f98 x:0 0 0 2024-08-19T00:56:19.987 INFO:tasks.workunit.client.1.smithi086.stdout:8/930: dread dc/d1f/d37/d4f/dac/db8/d7a/d88/f96 [0,4194304] 0 2024-08-19T00:56:19.987 INFO:tasks.workunit.client.0.smithi017.stdout:0/501: creat d5/d17/d26/d30/d3e/d81/fab x:0 0 0 2024-08-19T00:56:19.988 INFO:tasks.workunit.client.1.smithi086.stdout:6/942: mkdir db/d37/d28/d7f/d96/d127 0 2024-08-19T00:56:19.990 INFO:tasks.workunit.client.0.smithi017.stdout:4/528: mknod d2/d21/cb9 0 2024-08-19T00:56:19.990 INFO:tasks.workunit.client.0.smithi017.stdout:8/351: dwrite de/d36/f32 [0,4194304] 0 2024-08-19T00:56:19.990 INFO:tasks.workunit.client.1.smithi086.stdout:6/943: write db/d34/d4e/fcd [660285,36125] 0 2024-08-19T00:56:19.991 INFO:tasks.workunit.client.1.smithi086.stdout:5/953: symlink d0/d99/dc0/d125/d11b/d1f/d33/de9/l12e 0 2024-08-19T00:56:19.992 INFO:tasks.workunit.client.0.smithi017.stdout:8/352: chown de/d15/d39/f41 104877999 1 2024-08-19T00:56:19.992 INFO:tasks.workunit.client.0.smithi017.stdout:2/558: symlink d2/d7/d10/d3b/d80/d81/lb8 0 2024-08-19T00:56:19.992 INFO:tasks.workunit.client.0.smithi017.stdout:2/559: chown d2 0 1 2024-08-19T00:56:19.993 INFO:tasks.workunit.client.1.smithi086.stdout:8/931: dread dc/d16/d18/f12b [0,4194304] 0 2024-08-19T00:56:19.995 INFO:tasks.workunit.client.0.smithi017.stdout:4/529: creat d2/d21/d40/d56/d99/da3/fba x:0 0 0 2024-08-19T00:56:19.997 INFO:tasks.workunit.client.0.smithi017.stdout:8/353: unlink de/d36/f32 0 2024-08-19T00:56:19.999 INFO:tasks.workunit.client.0.smithi017.stdout:2/560: write d2/d7/d10/d3b/d69/f7f [1875880,100871] 0 2024-08-19T00:56:20.001 INFO:tasks.workunit.client.0.smithi017.stdout:2/561: dread - d2/d7/d10/d3b/d80/d81/f92 zero size 2024-08-19T00:56:20.002 INFO:tasks.workunit.client.1.smithi086.stdout:6/944: dread db/d37/d41/da7/f8d [0,4194304] 0 2024-08-19T00:56:20.005 INFO:tasks.workunit.client.0.smithi017.stdout:4/530: mkdir d2/d21/d40/d56/dbb 0 2024-08-19T00:56:20.006 INFO:tasks.workunit.client.0.smithi017.stdout:8/354: mknod de/d36/c5f 0 2024-08-19T00:56:20.008 INFO:tasks.workunit.client.1.smithi086.stdout:6/945: mkdir db/d34/d4e/d68/d89/d128 0 2024-08-19T00:56:20.009 INFO:tasks.workunit.client.0.smithi017.stdout:2/562: fsync d2/d7/d10/d19/d48/f9c 0 2024-08-19T00:56:20.011 INFO:tasks.workunit.client.0.smithi017.stdout:2/563: dread d2/d7/d10/d3b/d97/f9a [0,4194304] 0 2024-08-19T00:56:20.013 INFO:tasks.workunit.client.0.smithi017.stdout:8/355: dread de/f22 [0,4194304] 0 2024-08-19T00:56:20.014 INFO:tasks.workunit.client.0.smithi017.stdout:8/356: chown de/d15/l1c 37 1 2024-08-19T00:56:20.015 INFO:tasks.workunit.client.0.smithi017.stdout:2/564: rename d2/d7/d10/d3b/d3c/l59 to d2/d7/d10/d35/d7e/lb9 0 2024-08-19T00:56:20.018 INFO:tasks.workunit.client.0.smithi017.stdout:2/565: read d2/d7/f43 [2905135,120498] 0 2024-08-19T00:56:20.020 INFO:tasks.workunit.client.1.smithi086.stdout:8/932: dread dc/d16/d18/d106/f8a [0,4194304] 0 2024-08-19T00:56:20.021 INFO:tasks.workunit.client.1.smithi086.stdout:8/933: stat dc/d1f/d37/d4f/l7e 0 2024-08-19T00:56:20.024 INFO:tasks.workunit.client.1.smithi086.stdout:6/946: dread db/d34/d4e/d68/f84 [0,4194304] 0 2024-08-19T00:56:20.026 INFO:tasks.workunit.client.1.smithi086.stdout:5/954: dwrite d0/d99/dc0/d125/d11b/d1f/d65/fb8 [0,4194304] 0 2024-08-19T00:56:20.026 INFO:tasks.workunit.client.0.smithi017.stdout:0/502: dwrite d5/d18/f23 [0,4194304] 0 2024-08-19T00:56:20.029 INFO:tasks.workunit.client.0.smithi017.stdout:2/566: truncate d2/f1a 797396 0 2024-08-19T00:56:20.029 INFO:tasks.workunit.client.0.smithi017.stdout:8/357: write de/f5d [669525,96966] 0 2024-08-19T00:56:20.029 INFO:tasks.workunit.client.1.smithi086.stdout:5/955: chown d0/d99/dc0/d125/d11b/d1f/c93 353000 1 2024-08-19T00:56:20.030 INFO:tasks.workunit.client.1.smithi086.stdout:6/947: write db/d34/d39/d76/fb2 [4381799,25909] 0 2024-08-19T00:56:20.031 INFO:tasks.workunit.client.0.smithi017.stdout:0/503: write d5/d17/d2b/f74 [250370,110021] 0 2024-08-19T00:56:20.032 INFO:tasks.workunit.client.0.smithi017.stdout:2/567: write d2/d7/d10/d3b/d54/f5b [1219310,28258] 0 2024-08-19T00:56:20.032 INFO:tasks.workunit.client.1.smithi086.stdout:5/956: mkdir d0/d5f/d60/d57/d80/d12f 0 2024-08-19T00:56:20.033 INFO:tasks.workunit.client.0.smithi017.stdout:8/358: symlink de/d15/d39/d3d/l60 0 2024-08-19T00:56:20.034 INFO:tasks.workunit.client.1.smithi086.stdout:0/918: sync 2024-08-19T00:56:20.034 INFO:tasks.workunit.client.1.smithi086.stdout:6/948: fsync db/d8e/fbc 0 2024-08-19T00:56:20.035 INFO:tasks.workunit.client.1.smithi086.stdout:0/919: stat da/d115/cc0 0 2024-08-19T00:56:20.037 INFO:tasks.workunit.client.0.smithi017.stdout:8/359: creat de/d36/d2e/f61 x:0 0 0 2024-08-19T00:56:20.039 INFO:tasks.workunit.client.1.smithi086.stdout:5/957: dread d0/d99/dc0/d125/d11b/d1f/d33/f34 [4194304,4194304] 0 2024-08-19T00:56:20.040 INFO:tasks.workunit.client.1.smithi086.stdout:6/949: fdatasync db/d37/d41/f6b 0 2024-08-19T00:56:20.041 INFO:tasks.workunit.client.1.smithi086.stdout:8/934: dread dc/f14 [0,4194304] 0 2024-08-19T00:56:20.042 INFO:tasks.workunit.client.1.smithi086.stdout:8/935: truncate dc/d17/d86/fb4 4472278 0 2024-08-19T00:56:20.042 INFO:tasks.workunit.client.1.smithi086.stdout:0/920: creat da/d14/d55/d10c/d2e/d7e/dd7/f12a x:0 0 0 2024-08-19T00:56:20.043 INFO:tasks.workunit.client.1.smithi086.stdout:0/921: chown da/d14/d44/d7b/ce7 13 1 2024-08-19T00:56:20.043 INFO:tasks.workunit.client.0.smithi017.stdout:8/360: mkdir de/d15/d62 0 2024-08-19T00:56:20.044 INFO:tasks.workunit.client.1.smithi086.stdout:0/922: dread - da/d115/dc3/f110 zero size 2024-08-19T00:56:20.044 INFO:tasks.workunit.client.1.smithi086.stdout:0/923: chown da/cb 26 1 2024-08-19T00:56:20.046 INFO:tasks.workunit.client.1.smithi086.stdout:6/950: creat db/d34/f129 x:0 0 0 2024-08-19T00:56:20.047 INFO:tasks.workunit.client.0.smithi017.stdout:8/361: creat de/d36/f63 x:0 0 0 2024-08-19T00:56:20.047 INFO:tasks.workunit.client.0.smithi017.stdout:8/362: chown de/d15/d39/l56 354 1 2024-08-19T00:56:20.048 INFO:tasks.workunit.client.1.smithi086.stdout:5/958: dread - d0/d8/d94/fd2 zero size 2024-08-19T00:56:20.049 INFO:tasks.workunit.client.0.smithi017.stdout:0/504: link d5/d17/d21/d42/c25 d5/d17/d26/cac 0 2024-08-19T00:56:20.050 INFO:tasks.workunit.client.1.smithi086.stdout:0/924: rename da/d14/d26/fd4 to da/d14/d55/d10c/d2e/d30/d76/f12b 0 2024-08-19T00:56:20.051 INFO:tasks.workunit.client.0.smithi017.stdout:2/568: link d2/l1f d2/d7/d10/d35/lba 0 2024-08-19T00:56:20.052 INFO:tasks.workunit.client.1.smithi086.stdout:6/951: creat db/d37/d44/d5a/f12a x:0 0 0 2024-08-19T00:56:20.055 INFO:tasks.workunit.client.0.smithi017.stdout:0/505: fdatasync d5/d17/d45/d77/fa2 0 2024-08-19T00:56:20.056 INFO:tasks.workunit.client.0.smithi017.stdout:2/569: rmdir d2 39 2024-08-19T00:56:20.058 INFO:tasks.workunit.client.1.smithi086.stdout:0/925: fdatasync da/d14/d44/df0/fd6 0 2024-08-19T00:56:20.059 INFO:tasks.workunit.client.1.smithi086.stdout:6/952: symlink db/d37/d28/d7f/d96/dd9/l12b 0 2024-08-19T00:56:20.059 INFO:tasks.workunit.client.0.smithi017.stdout:8/363: dread de/d15/f2b [0,4194304] 0 2024-08-19T00:56:20.062 INFO:tasks.workunit.client.1.smithi086.stdout:5/959: mknod d0/d2d/dce/d113/c130 0 2024-08-19T00:56:20.065 INFO:tasks.workunit.client.0.smithi017.stdout:8/364: dread de/f34 [0,4194304] 0 2024-08-19T00:56:20.067 INFO:tasks.workunit.client.0.smithi017.stdout:2/570: mkdir d2/d7/dbb 0 2024-08-19T00:56:20.069 INFO:tasks.workunit.client.0.smithi017.stdout:0/506: link d5/d17/d26/d30/d3e/d5a/f84 d5/d17/d45/fad 0 2024-08-19T00:56:20.069 INFO:tasks.workunit.client.1.smithi086.stdout:8/936: dwrite f3 [0,4194304] 0 2024-08-19T00:56:20.070 INFO:tasks.workunit.client.1.smithi086.stdout:3/932: sync 2024-08-19T00:56:20.070 INFO:tasks.workunit.client.1.smithi086.stdout:9/949: sync 2024-08-19T00:56:20.070 INFO:tasks.workunit.client.1.smithi086.stdout:2/980: sync 2024-08-19T00:56:20.070 INFO:tasks.workunit.client.1.smithi086.stdout:7/933: sync 2024-08-19T00:56:20.070 INFO:tasks.workunit.client.1.smithi086.stdout:4/905: sync 2024-08-19T00:56:20.070 INFO:tasks.workunit.client.0.smithi017.stdout:2/571: chown d2/d7/d10/c32 3612602 1 2024-08-19T00:56:20.073 INFO:tasks.workunit.client.0.smithi017.stdout:8/365: dwrite de/f52 [0,4194304] 0 2024-08-19T00:56:20.073 INFO:tasks.workunit.client.1.smithi086.stdout:0/926: creat da/d14/d26/f12c x:0 0 0 2024-08-19T00:56:20.073 INFO:tasks.workunit.client.1.smithi086.stdout:8/937: fsync dc/d16/d18/d106/d28/d2b/d3b/f3c 0 2024-08-19T00:56:20.074 INFO:tasks.workunit.client.0.smithi017.stdout:8/366: fdatasync de/d15/f45 0 2024-08-19T00:56:20.082 INFO:tasks.workunit.client.1.smithi086.stdout:5/960: creat d0/d99/dc0/d125/d11b/d1f/f131 x:0 0 0 2024-08-19T00:56:20.082 INFO:tasks.workunit.client.1.smithi086.stdout:4/906: read - d2/d18/d33/d42/d72/d78/d25/d55/d4d/ff9 zero size 2024-08-19T00:56:20.083 INFO:tasks.workunit.client.0.smithi017.stdout:8/367: link de/f51 de/d15/d39/f64 0 2024-08-19T00:56:20.083 INFO:tasks.workunit.client.1.smithi086.stdout:3/933: mknod d3/d18/d19/d62/d46/c12e 0 2024-08-19T00:56:20.084 INFO:tasks.workunit.client.1.smithi086.stdout:6/953: truncate db/d37/d44/d5a/d78/fe2 7487889 0 2024-08-19T00:56:20.086 INFO:tasks.workunit.client.0.smithi017.stdout:8/368: creat de/d15/f65 x:0 0 0 2024-08-19T00:56:20.091 INFO:tasks.workunit.client.1.smithi086.stdout:9/950: write db/f39 [9080922,129960] 0 2024-08-19T00:56:20.092 INFO:tasks.workunit.client.1.smithi086.stdout:9/951: stat db/d26/d5c/d87/d30/d31/d103 0 2024-08-19T00:56:20.106 INFO:tasks.workunit.client.0.smithi017.stdout:8/369: dwrite de/f12 [0,4194304] 0 2024-08-19T00:56:20.107 INFO:tasks.workunit.client.0.smithi017.stdout:8/370: write de/f5d [2709960,62450] 0 2024-08-19T00:56:20.111 INFO:tasks.workunit.client.0.smithi017.stdout:8/371: readlink de/d15/d39/d3d/l46 0 2024-08-19T00:56:20.119 INFO:tasks.workunit.client.1.smithi086.stdout:0/927: unlink da/d14/la0 0 2024-08-19T00:56:20.122 INFO:tasks.workunit.client.1.smithi086.stdout:7/934: truncate d3/f97 2017289 0 2024-08-19T00:56:20.123 INFO:tasks.workunit.client.1.smithi086.stdout:3/934: fsync d3/d18/d19/dbc/fb6 0 2024-08-19T00:56:20.124 INFO:tasks.workunit.client.1.smithi086.stdout:3/935: chown d3/d26/f59 1 1 2024-08-19T00:56:20.124 INFO:tasks.workunit.client.0.smithi017.stdout:9/444: sync 2024-08-19T00:56:20.125 INFO:tasks.workunit.client.1.smithi086.stdout:2/981: creat d8/d43/d77/f14b x:0 0 0 2024-08-19T00:56:20.126 INFO:tasks.workunit.client.0.smithi017.stdout:9/445: symlink d0/l82 0 2024-08-19T00:56:20.126 INFO:tasks.workunit.client.1.smithi086.stdout:2/982: write d8/d43/d65/f9b [2217670,101428] 0 2024-08-19T00:56:20.127 INFO:tasks.workunit.client.1.smithi086.stdout:4/907: mkdir d2/d18/d129 0 2024-08-19T00:56:20.132 INFO:tasks.workunit.client.0.smithi017.stdout:9/446: dwrite d0/d33/d22/d52/f7a [0,4194304] 0 2024-08-19T00:56:20.133 INFO:tasks.workunit.client.1.smithi086.stdout:0/928: mkdir da/d5d/df7/d12d 0 2024-08-19T00:56:20.134 INFO:tasks.workunit.client.1.smithi086.stdout:5/961: creat d0/d2d/f132 x:0 0 0 2024-08-19T00:56:20.136 INFO:tasks.workunit.client.0.smithi017.stdout:9/447: stat d0/d58/c38 0 2024-08-19T00:56:20.138 INFO:tasks.workunit.client.0.smithi017.stdout:8/372: truncate de/f47 3566726 0 2024-08-19T00:56:20.139 INFO:tasks.workunit.client.1.smithi086.stdout:7/935: unlink d3/da1/lf1 0 2024-08-19T00:56:20.141 INFO:tasks.workunit.client.1.smithi086.stdout:6/954: rename db/d34/d4e/db4/fba to db/d37/d30/f12c 0 2024-08-19T00:56:20.143 INFO:tasks.workunit.client.1.smithi086.stdout:8/938: write dc/d16/d18/d106/fb1 [762805,5802] 0 2024-08-19T00:56:20.144 INFO:tasks.workunit.client.1.smithi086.stdout:2/983: dwrite d8/d84/de0/d114/f121 [0,4194304] 0 2024-08-19T00:56:20.146 INFO:tasks.workunit.client.0.smithi017.stdout:8/373: mknod de/d15/d39/d3d/c66 0 2024-08-19T00:56:20.147 INFO:tasks.workunit.client.0.smithi017.stdout:8/374: dread - de/d15/d4f/f5c zero size 2024-08-19T00:56:20.150 INFO:tasks.workunit.client.1.smithi086.stdout:5/962: symlink d0/d99/dc0/dc2/l133 0 2024-08-19T00:56:20.150 INFO:tasks.workunit.client.1.smithi086.stdout:7/936: chown d3/de/lb8 889 1 2024-08-19T00:56:20.152 INFO:tasks.workunit.client.1.smithi086.stdout:2/984: dwrite d8/d43/d65/f131 [0,4194304] 0 2024-08-19T00:56:20.152 INFO:tasks.workunit.client.0.smithi017.stdout:8/375: unlink de/d36/f63 0 2024-08-19T00:56:20.153 INFO:tasks.workunit.client.1.smithi086.stdout:7/937: write d3/d34/d44/d58/d4b/d78/d9a/fe3 [538731,38138] 0 2024-08-19T00:56:20.156 INFO:tasks.workunit.client.1.smithi086.stdout:4/908: rename d2/d18/d33/d42/d72/d78/d25/d55/d4d/ldc to d2/d18/d33/d42/d72/d78/d9e/l12a 0 2024-08-19T00:56:20.157 INFO:tasks.workunit.client.0.smithi017.stdout:8/376: creat de/d36/d2e/f67 x:0 0 0 2024-08-19T00:56:20.159 INFO:tasks.workunit.client.1.smithi086.stdout:4/909: stat d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/fbf 0 2024-08-19T00:56:20.159 INFO:tasks.workunit.client.1.smithi086.stdout:9/952: getdents db/d26/d5c/d87/d30/d58 0 2024-08-19T00:56:20.162 INFO:tasks.workunit.client.0.smithi017.stdout:8/377: write de/d15/d39/d3d/f4e [956717,108370] 0 2024-08-19T00:56:20.162 INFO:tasks.workunit.client.1.smithi086.stdout:3/936: dwrite d3/d18/f22 [8388608,4194304] 0 2024-08-19T00:56:20.165 INFO:tasks.workunit.client.1.smithi086.stdout:6/955: dread db/d34/d39/d76/fb5 [0,4194304] 0 2024-08-19T00:56:20.167 INFO:tasks.workunit.client.1.smithi086.stdout:6/956: write db/d37/d44/d5a/d8f/f107 [5496339,96112] 0 2024-08-19T00:56:20.167 INFO:tasks.workunit.client.1.smithi086.stdout:9/953: dwrite db/d96/fb4 [0,4194304] 0 2024-08-19T00:56:20.169 INFO:tasks.workunit.client.0.smithi017.stdout:9/448: dwrite d0/d33/d22/f4c [0,4194304] 0 2024-08-19T00:56:20.175 INFO:tasks.workunit.client.1.smithi086.stdout:9/954: dwrite db/d96/fb4 [4194304,4194304] 0 2024-08-19T00:56:20.176 INFO:tasks.workunit.client.1.smithi086.stdout:2/985: truncate d8/d43/fd0 831808 0 2024-08-19T00:56:20.177 INFO:tasks.workunit.client.0.smithi017.stdout:9/449: dwrite d0/d33/f1b [0,4194304] 0 2024-08-19T00:56:20.182 INFO:tasks.workunit.client.0.smithi017.stdout:9/450: chown d0/d33/c37 20 1 2024-08-19T00:56:20.183 INFO:tasks.workunit.client.0.smithi017.stdout:9/451: chown d0/c7d 370918622 1 2024-08-19T00:56:20.185 INFO:tasks.workunit.client.1.smithi086.stdout:4/910: symlink d2/d18/d33/d42/d72/d78/d25/d30/d5d/l12b 0 2024-08-19T00:56:20.187 INFO:tasks.workunit.client.1.smithi086.stdout:3/937: mkdir d3/d18/d19/d62/d46/d12f 0 2024-08-19T00:56:20.187 INFO:tasks.workunit.client.1.smithi086.stdout:4/911: write d2/d18/d33/d42/d72/d78/d2c/ff3 [792858,81334] 0 2024-08-19T00:56:20.187 INFO:tasks.workunit.client.0.smithi017.stdout:9/452: symlink d0/d33/d22/d45/l83 0 2024-08-19T00:56:20.189 INFO:tasks.workunit.client.0.smithi017.stdout:8/378: write de/f47 [3983060,20419] 0 2024-08-19T00:56:20.190 INFO:tasks.workunit.client.0.smithi017.stdout:8/379: read de/f22 [127717,45651] 0 2024-08-19T00:56:20.191 INFO:tasks.workunit.client.0.smithi017.stdout:9/453: dread - d0/d33/d22/d40/f4e zero size 2024-08-19T00:56:20.192 INFO:tasks.workunit.client.0.smithi017.stdout:9/454: chown d0/d33/d22/d40/f77 475912130 1 2024-08-19T00:56:20.193 INFO:tasks.workunit.client.1.smithi086.stdout:9/955: mkdir db/d26/d5c/d87/d6d/dbf/d13a 0 2024-08-19T00:56:20.194 INFO:tasks.workunit.client.0.smithi017.stdout:8/380: mkdir de/d15/d4f/d68 0 2024-08-19T00:56:20.194 INFO:tasks.workunit.client.0.smithi017.stdout:9/455: truncate d0/d58/d49/f4f 789678 0 2024-08-19T00:56:20.195 INFO:tasks.workunit.client.1.smithi086.stdout:8/939: creat dc/d1f/d37/f131 x:0 0 0 2024-08-19T00:56:20.195 INFO:tasks.workunit.client.1.smithi086.stdout:0/929: getdents da/d14/d55 0 2024-08-19T00:56:20.196 INFO:tasks.workunit.client.0.smithi017.stdout:8/381: write de/d36/f48 [900979,15839] 0 2024-08-19T00:56:20.196 INFO:tasks.workunit.client.0.smithi017.stdout:9/456: fsync d0/d33/f39 0 2024-08-19T00:56:20.196 INFO:tasks.workunit.client.1.smithi086.stdout:0/930: chown da/d14/d26/f8d 12613 1 2024-08-19T00:56:20.197 INFO:tasks.workunit.client.1.smithi086.stdout:4/912: rename d2 to d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/d12c 22 2024-08-19T00:56:20.198 INFO:tasks.workunit.client.1.smithi086.stdout:5/963: write d0/d99/dc0/dc2/fb9 [233043,75876] 0 2024-08-19T00:56:20.198 INFO:tasks.workunit.client.0.smithi017.stdout:8/382: write de/d15/f35 [1000287,102282] 0 2024-08-19T00:56:20.199 INFO:tasks.workunit.client.1.smithi086.stdout:5/964: chown d0/d99/dc0 11538 1 2024-08-19T00:56:20.199 INFO:tasks.workunit.client.1.smithi086.stdout:9/956: write db/d26/d5c/d87/d6d/fe3 [2916848,53613] 0 2024-08-19T00:56:20.201 INFO:tasks.workunit.client.0.smithi017.stdout:9/457: rmdir d0/d58/d49/d5d 39 2024-08-19T00:56:20.203 INFO:tasks.workunit.client.0.smithi017.stdout:8/383: stat de/d15/c18 0 2024-08-19T00:56:20.204 INFO:tasks.workunit.client.1.smithi086.stdout:9/957: dread db/d96/fb4 [4194304,4194304] 0 2024-08-19T00:56:20.234 INFO:tasks.workunit.client.0.smithi017.stdout:9/458: mkdir d0/d84 0 2024-08-19T00:56:20.235 INFO:tasks.workunit.client.1.smithi086.stdout:7/938: dwrite d3/d34/d44/d58/d4b/da5/fba [0,4194304] 0 2024-08-19T00:56:20.240 INFO:tasks.workunit.client.0.smithi017.stdout:9/459: dwrite d0/d33/d22/f4c [0,4194304] 0 2024-08-19T00:56:20.270 INFO:tasks.workunit.client.1.smithi086.stdout:3/938: getdents d3/d9 0 2024-08-19T00:56:20.271 INFO:tasks.workunit.client.1.smithi086.stdout:5/965: rmdir d0/d99/dc0/d125/d11b/d1f/d33 39 2024-08-19T00:56:20.272 INFO:tasks.workunit.client.1.smithi086.stdout:6/957: write db/d8e/fbc [430301,100181] 0 2024-08-19T00:56:20.273 INFO:tasks.workunit.client.1.smithi086.stdout:8/940: link dc/d16/d18/d106/d28/d2b/c68 dc/d1f/d37/d4f/dac/db8/d8f/c132 0 2024-08-19T00:56:20.274 INFO:tasks.workunit.client.1.smithi086.stdout:8/941: chown dc/d1f/d37/d4f/cea 2062801864 1 2024-08-19T00:56:20.276 INFO:tasks.workunit.client.0.smithi017.stdout:8/384: getdents de/d15/d39 0 2024-08-19T00:56:20.278 INFO:tasks.workunit.client.1.smithi086.stdout:2/986: dwrite d8/d2c/d67/f6f [0,4194304] 0 2024-08-19T00:56:20.279 INFO:tasks.workunit.client.1.smithi086.stdout:2/987: readlink d8/d24/d32/d4d/d6a/le5 0 2024-08-19T00:56:20.279 INFO:tasks.workunit.client.0.smithi017.stdout:8/385: creat de/d36/f69 x:0 0 0 2024-08-19T00:56:20.280 INFO:tasks.workunit.client.1.smithi086.stdout:0/931: link da/f10 da/d14/d44/d7b/f12e 0 2024-08-19T00:56:20.281 INFO:tasks.workunit.client.0.smithi017.stdout:8/386: truncate de/d36/d2e/f67 178083 0 2024-08-19T00:56:20.281 INFO:tasks.workunit.client.0.smithi017.stdout:8/387: chown de/d15/d39/f59 3944905 1 2024-08-19T00:56:20.285 INFO:tasks.workunit.client.1.smithi086.stdout:7/939: mknod d3/da1/d108/d10d/c136 0 2024-08-19T00:56:20.287 INFO:tasks.workunit.client.1.smithi086.stdout:2/988: dwrite d8/d24/d32/d4d/d6a/dfe/f11b [0,4194304] 0 2024-08-19T00:56:20.287 INFO:tasks.workunit.client.1.smithi086.stdout:2/989: fsync d8/d2c/ffd 0 2024-08-19T00:56:20.288 INFO:tasks.workunit.client.1.smithi086.stdout:5/966: mkdir d0/d99/dc0/dc2/d134 0 2024-08-19T00:56:20.289 INFO:tasks.workunit.client.1.smithi086.stdout:6/958: truncate db/d37/d44/d5a/d78/fee 4313769 0 2024-08-19T00:56:20.289 INFO:tasks.workunit.client.0.smithi017.stdout:8/388: dwrite de/d15/d39/d3d/f4e [0,4194304] 0 2024-08-19T00:56:20.291 INFO:tasks.workunit.client.1.smithi086.stdout:8/942: symlink dc/d1f/d37/d60/l133 0 2024-08-19T00:56:20.293 INFO:tasks.workunit.client.1.smithi086.stdout:7/940: dwrite d3/d34/ffe [0,4194304] 0 2024-08-19T00:56:20.293 INFO:tasks.workunit.client.1.smithi086.stdout:4/913: link d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/f11d d2/f12d 0 2024-08-19T00:56:20.294 INFO:tasks.workunit.client.0.smithi017.stdout:8/389: creat de/d36/f6a x:0 0 0 2024-08-19T00:56:20.300 INFO:tasks.workunit.client.1.smithi086.stdout:3/939: mknod d3/d18/d27/d49/d3f/d54/dfa/c130 0 2024-08-19T00:56:20.301 INFO:tasks.workunit.client.1.smithi086.stdout:7/941: dwrite d3/d34/d44/d58/d4b/da5/daf/de7/df5/fbe [0,4194304] 0 2024-08-19T00:56:20.302 INFO:tasks.workunit.client.0.smithi017.stdout:8/390: dwrite de/d15/d39/d3d/f4b [4194304,4194304] 0 2024-08-19T00:56:20.304 INFO:tasks.workunit.client.1.smithi086.stdout:3/940: read d3/d18/f2c [2434637,112716] 0 2024-08-19T00:56:20.305 INFO:tasks.workunit.client.1.smithi086.stdout:2/990: mkdir d8/d14/dae/ddc/d12b/d14c 0 2024-08-19T00:56:20.307 INFO:tasks.workunit.client.1.smithi086.stdout:8/943: mkdir dc/d16/d18/d106/d28/d41/d134 0 2024-08-19T00:56:20.312 INFO:tasks.workunit.client.0.smithi017.stdout:8/391: rename de/d15/c2c to de/d15/d62/c6b 0 2024-08-19T00:56:20.314 INFO:tasks.workunit.client.0.smithi017.stdout:8/392: dread de/f34 [0,4194304] 0 2024-08-19T00:56:20.317 INFO:tasks.workunit.client.1.smithi086.stdout:4/914: rename d2/d18/d33/d42/d72/d78/d25/d30/d5d/da2/f109 to d2/d18/d33/d42/d72/d2f/dc4/f12e 0 2024-08-19T00:56:20.320 INFO:tasks.workunit.client.1.smithi086.stdout:7/942: creat d3/de/d68/d7d/f137 x:0 0 0 2024-08-19T00:56:20.321 INFO:tasks.workunit.client.0.smithi017.stdout:8/393: dwrite f0 [4194304,4194304] 0 2024-08-19T00:56:20.322 INFO:tasks.workunit.client.0.smithi017.stdout:8/394: dread - de/d36/f69 zero size 2024-08-19T00:56:20.322 INFO:tasks.workunit.client.1.smithi086.stdout:3/941: write d3/d26/f59 [1356105,55209] 0 2024-08-19T00:56:20.322 INFO:tasks.workunit.client.0.smithi017.stdout:8/395: chown de/d15/f45 134643239 1 2024-08-19T00:56:20.323 INFO:tasks.workunit.client.1.smithi086.stdout:2/991: creat d8/d2c/d47/f14d x:0 0 0 2024-08-19T00:56:20.323 INFO:tasks.workunit.client.0.smithi017.stdout:8/396: dread - de/d36/f40 zero size 2024-08-19T00:56:20.324 INFO:tasks.workunit.client.0.smithi017.stdout:8/397: readlink de/d15/l1a 0 2024-08-19T00:56:20.324 INFO:tasks.workunit.client.1.smithi086.stdout:8/944: mkdir dc/d1f/d37/d4f/dac/db8/d8f/df4/d135 0 2024-08-19T00:56:20.325 INFO:tasks.workunit.client.1.smithi086.stdout:2/992: stat d8/d2c/d47/d73/f136 0 2024-08-19T00:56:20.326 INFO:tasks.workunit.client.1.smithi086.stdout:9/958: link db/d26/d5c/d87/l106 db/d26/d5c/d87/d30/d31/d103/d19/d18/l13b 0 2024-08-19T00:56:20.329 INFO:tasks.workunit.client.1.smithi086.stdout:0/932: dwrite da/d5d/f75 [0,4194304] 0 2024-08-19T00:56:20.330 INFO:tasks.workunit.client.0.smithi017.stdout:8/398: mknod de/d15/d39/c6c 0 2024-08-19T00:56:20.331 INFO:tasks.workunit.client.1.smithi086.stdout:0/933: chown da/d14/d55/dac/d102 60 1 2024-08-19T00:56:20.335 INFO:tasks.workunit.client.0.smithi017.stdout:8/399: rename de/d15/d39/f64 to de/d15/d39/f6d 0 2024-08-19T00:56:20.335 INFO:tasks.workunit.client.1.smithi086.stdout:6/959: dread db/d37/d41/da7/f97 [4194304,4194304] 0 2024-08-19T00:56:20.336 INFO:tasks.workunit.client.1.smithi086.stdout:6/960: stat db/d37/d44/d5a/d78/ddc 0 2024-08-19T00:56:20.336 INFO:tasks.workunit.client.1.smithi086.stdout:5/967: dwrite d0/d8/fee [0,4194304] 0 2024-08-19T00:56:20.337 INFO:tasks.workunit.client.1.smithi086.stdout:9/959: creat db/daf/f13c x:0 0 0 2024-08-19T00:56:20.340 INFO:tasks.workunit.client.0.smithi017.stdout:8/400: creat de/d15/d4f/f6e x:0 0 0 2024-08-19T00:56:20.344 INFO:tasks.workunit.client.1.smithi086.stdout:8/945: mkdir dc/d16/d18/d106/d28/d41/d11e/d136 0 2024-08-19T00:56:20.345 INFO:tasks.workunit.client.1.smithi086.stdout:6/961: dwrite db/d34/f129 [0,4194304] 0 2024-08-19T00:56:20.346 INFO:tasks.workunit.client.1.smithi086.stdout:2/993: creat d8/f14e x:0 0 0 2024-08-19T00:56:20.348 INFO:tasks.workunit.client.1.smithi086.stdout:2/994: stat d8/d43/d77 0 2024-08-19T00:56:20.348 INFO:tasks.workunit.client.0.smithi017.stdout:8/401: dwrite de/d36/f69 [0,4194304] 0 2024-08-19T00:56:20.348 INFO:tasks.workunit.client.1.smithi086.stdout:9/960: symlink db/d26/d5c/d87/d30/d3f/d43/d4e/d117/l13d 0 2024-08-19T00:56:20.354 INFO:tasks.workunit.client.1.smithi086.stdout:8/946: dwrite dc/d16/d18/d106/d28/d2b/d3b/f3c [0,4194304] 0 2024-08-19T00:56:20.357 INFO:tasks.workunit.client.1.smithi086.stdout:6/962: mkdir db/d37/d44/d12d 0 2024-08-19T00:56:20.360 INFO:tasks.workunit.client.1.smithi086.stdout:2/995: creat d8/d2c/d38/d80/db4/db7/d120/f14f x:0 0 0 2024-08-19T00:56:20.360 INFO:tasks.workunit.client.1.smithi086.stdout:7/943: dread d3/de/d68/d72/fbb [0,4194304] 0 2024-08-19T00:56:20.363 INFO:tasks.workunit.client.0.smithi017.stdout:8/402: rename de/d15/c25 to de/d15/d39/c6f 0 2024-08-19T00:56:20.363 INFO:tasks.workunit.client.0.smithi017.stdout:8/403: stat de/f37 0 2024-08-19T00:56:20.364 INFO:tasks.workunit.client.0.smithi017.stdout:8/404: stat de/d15/l5b 0 2024-08-19T00:56:20.364 INFO:tasks.workunit.client.1.smithi086.stdout:4/915: dread d2/d18/d33/f92 [0,4194304] 0 2024-08-19T00:56:20.364 INFO:tasks.workunit.client.1.smithi086.stdout:7/944: chown d3/d34/d44/f48 3440704 1 2024-08-19T00:56:20.365 INFO:tasks.workunit.client.1.smithi086.stdout:8/947: dwrite f8 [4194304,4194304] 0 2024-08-19T00:56:20.366 INFO:tasks.workunit.client.1.smithi086.stdout:7/945: chown d3/de/d68/d7d/ff9 28979 1 2024-08-19T00:56:20.366 INFO:tasks.workunit.client.1.smithi086.stdout:7/946: chown d3/d34/f89 6813 1 2024-08-19T00:56:20.367 INFO:tasks.workunit.client.1.smithi086.stdout:7/947: dread - d3/d5b/fb1 zero size 2024-08-19T00:56:20.369 INFO:tasks.workunit.client.0.smithi017.stdout:8/405: creat de/d15/f70 x:0 0 0 2024-08-19T00:56:20.370 INFO:tasks.workunit.client.0.smithi017.stdout:8/406: dread - de/d15/f70 zero size 2024-08-19T00:56:20.370 INFO:tasks.workunit.client.1.smithi086.stdout:7/948: truncate d3/d34/d44/d58/d4b/da5/daf/de7/df5/f115 999821 0 2024-08-19T00:56:20.371 INFO:tasks.workunit.client.1.smithi086.stdout:6/963: symlink db/d34/l12e 0 2024-08-19T00:56:20.375 INFO:tasks.workunit.client.0.smithi017.stdout:8/407: mkdir de/d36/d2e/d71 0 2024-08-19T00:56:20.376 INFO:tasks.workunit.client.1.smithi086.stdout:3/942: dwrite d3/d18/d27/d49/d3f/d5b/f70 [0,4194304] 0 2024-08-19T00:56:20.376 INFO:tasks.workunit.client.1.smithi086.stdout:8/948: creat dc/d1f/dd4/f137 x:0 0 0 2024-08-19T00:56:20.380 INFO:tasks.workunit.client.1.smithi086.stdout:9/961: creat db/d26/d5c/d68/d12d/f13e x:0 0 0 2024-08-19T00:56:20.380 INFO:tasks.workunit.client.1.smithi086.stdout:8/949: read dc/f75 [1061244,81771] 0 2024-08-19T00:56:20.383 INFO:tasks.workunit.client.1.smithi086.stdout:4/916: symlink d2/l12f 0 2024-08-19T00:56:20.384 INFO:tasks.workunit.client.0.smithi017.stdout:8/408: creat de/d15/d39/d3d/f72 x:0 0 0 2024-08-19T00:56:20.385 INFO:tasks.workunit.client.1.smithi086.stdout:3/943: rmdir d3/d26/d2b 39 2024-08-19T00:56:20.385 INFO:tasks.workunit.client.0.smithi017.stdout:8/409: chown de/d36/f58 490 1 2024-08-19T00:56:20.387 INFO:tasks.workunit.client.0.smithi017.stdout:8/410: mknod de/c73 0 2024-08-19T00:56:20.388 INFO:tasks.workunit.client.1.smithi086.stdout:8/950: write dc/d1f/d37/d4f/dac/db8/d8f/fc1 [3664202,76730] 0 2024-08-19T00:56:20.388 INFO:tasks.workunit.client.1.smithi086.stdout:5/968: dwrite d0/d8/d10/f2b [0,4194304] 0 2024-08-19T00:56:20.390 INFO:tasks.workunit.client.1.smithi086.stdout:0/934: dwrite da/d14/d26/f71 [0,4194304] 0 2024-08-19T00:56:20.391 INFO:tasks.workunit.client.0.smithi017.stdout:8/411: mkdir de/d36/d74 0 2024-08-19T00:56:20.392 INFO:tasks.workunit.client.1.smithi086.stdout:8/951: fdatasync dc/d16/d18/d94/f125 0 2024-08-19T00:56:20.394 INFO:tasks.workunit.client.1.smithi086.stdout:4/917: creat d2/d18/d33/d42/d72/d78/d2c/dae/f130 x:0 0 0 2024-08-19T00:56:20.395 INFO:tasks.workunit.client.1.smithi086.stdout:7/949: link d3/d34/d44/d58/d4b/da5/l47 d3/de/d68/l138 0 2024-08-19T00:56:20.396 INFO:tasks.workunit.client.1.smithi086.stdout:5/969: chown d0/d99/dc0/d106 4 1 2024-08-19T00:56:20.396 INFO:tasks.workunit.client.1.smithi086.stdout:6/964: getdents db/d34/d39/d76/dbf 0 2024-08-19T00:56:20.398 INFO:tasks.workunit.client.0.smithi017.stdout:8/412: dwrite de/d15/d4f/f6e [0,4194304] 0 2024-08-19T00:56:20.398 INFO:tasks.workunit.client.1.smithi086.stdout:9/962: dwrite db/d26/d5c/d87/f42 [0,4194304] 0 2024-08-19T00:56:20.402 INFO:tasks.workunit.client.0.smithi017.stdout:8/413: mkdir de/d15/d62/d75 0 2024-08-19T00:56:20.403 INFO:tasks.workunit.client.1.smithi086.stdout:3/944: getdents d3/d18/d1a/d51/d9b 0 2024-08-19T00:56:20.405 INFO:tasks.workunit.client.1.smithi086.stdout:0/935: dwrite da/d97/f10e [0,4194304] 0 2024-08-19T00:56:20.409 INFO:tasks.workunit.client.1.smithi086.stdout:3/945: write d3/d9/f39 [4381841,45009] 0 2024-08-19T00:56:20.410 INFO:tasks.workunit.client.0.smithi017.stdout:8/414: symlink de/l76 0 2024-08-19T00:56:20.411 INFO:tasks.workunit.client.0.smithi017.stdout:8/415: write de/d15/d39/f3e [898482,116887] 0 2024-08-19T00:56:20.412 INFO:tasks.workunit.client.1.smithi086.stdout:8/952: dwrite dc/d16/d18/d106/d28/d2b/d3b/f58 [0,4194304] 0 2024-08-19T00:56:20.412 INFO:tasks.workunit.client.0.smithi017.stdout:8/416: chown de/d15/d62 91 1 2024-08-19T00:56:20.413 INFO:tasks.workunit.client.0.smithi017.stdout:8/417: read - de/d15/f70 zero size 2024-08-19T00:56:20.414 INFO:tasks.workunit.client.0.smithi017.stdout:8/418: readlink de/d36/d2e/l31 0 2024-08-19T00:56:20.415 INFO:tasks.workunit.client.1.smithi086.stdout:6/965: dwrite db/d34/f129 [0,4194304] 0 2024-08-19T00:56:20.416 INFO:tasks.workunit.client.1.smithi086.stdout:7/950: creat d3/d34/d44/d58/d4b/f139 x:0 0 0 2024-08-19T00:56:20.418 INFO:tasks.workunit.client.0.smithi017.stdout:8/419: symlink de/d15/l77 0 2024-08-19T00:56:20.421 INFO:tasks.workunit.client.1.smithi086.stdout:6/966: chown db/d37/d30/l11d 0 1 2024-08-19T00:56:20.422 INFO:tasks.workunit.client.1.smithi086.stdout:3/946: creat d3/d18/d1a/d51/dad/dee/d104/f131 x:0 0 0 2024-08-19T00:56:20.423 INFO:tasks.workunit.client.0.smithi017.stdout:8/420: rename f0 to de/d15/d39/f78 0 2024-08-19T00:56:20.424 INFO:tasks.workunit.client.1.smithi086.stdout:3/947: write d3/d18/d27/d49/d3f/d5b/f115 [30536,110993] 0 2024-08-19T00:56:20.425 INFO:tasks.workunit.client.1.smithi086.stdout:7/951: creat d3/de/d68/d72/d7e/dca/f13a x:0 0 0 2024-08-19T00:56:20.426 INFO:tasks.workunit.client.0.smithi017.stdout:8/421: unlink c8 0 2024-08-19T00:56:20.429 INFO:tasks.workunit.client.1.smithi086.stdout:6/967: mknod db/d34/d4e/d68/d99/d112/c12f 0 2024-08-19T00:56:20.431 INFO:tasks.workunit.client.1.smithi086.stdout:8/953: dread dc/d16/d18/fb5 [0,4194304] 0 2024-08-19T00:56:20.433 INFO:tasks.workunit.client.1.smithi086.stdout:3/948: mkdir d3/d18/d19/dbc/de1/d132 0 2024-08-19T00:56:20.434 INFO:tasks.workunit.client.1.smithi086.stdout:7/952: dwrite d3/de/d113/f131 [0,4194304] 0 2024-08-19T00:56:20.436 INFO:tasks.workunit.client.0.smithi017.stdout:8/422: rmdir de/d15/d39/d3d 39 2024-08-19T00:56:20.437 INFO:tasks.workunit.client.1.smithi086.stdout:2/996: write d8/d84/f81 [7336917,5805] 0 2024-08-19T00:56:20.437 INFO:tasks.workunit.client.0.smithi017.stdout:8/423: write de/d15/f29 [1811801,54191] 0 2024-08-19T00:56:20.441 INFO:tasks.workunit.client.1.smithi086.stdout:2/997: dread - d8/d2c/d38/d80/fce zero size 2024-08-19T00:56:20.443 INFO:tasks.workunit.client.1.smithi086.stdout:7/953: rename d3/d34/d44/d58/d4b/da5/daf/de7/df5/fbe to d3/d34/d44/d58/d4b/da5/f13b 0 2024-08-19T00:56:20.444 INFO:tasks.workunit.client.0.smithi017.stdout:8/424: rmdir de/d36/d2e/d71 0 2024-08-19T00:56:20.446 INFO:tasks.workunit.client.1.smithi086.stdout:2/998: truncate d8/d24/f8c 140387 0 2024-08-19T00:56:20.446 INFO:tasks.workunit.client.1.smithi086.stdout:2/999: chown d8/d24/d32/d4d/d6a/f108 5392078 1 2024-08-19T00:56:20.455 INFO:tasks.workunit.client.1.smithi086.stdout:5/970: dread d0/d99/dc0/dc2/fb0 [0,4194304] 0 2024-08-19T00:56:20.458 INFO:tasks.workunit.client.1.smithi086.stdout:5/971: mkdir d0/d8/d94/df9/d108/d135 0 2024-08-19T00:56:20.460 INFO:tasks.workunit.client.1.smithi086.stdout:5/972: mknod d0/d5f/d60/d57/d80/da0/c136 0 2024-08-19T00:56:20.463 INFO:tasks.workunit.client.1.smithi086.stdout:5/973: truncate d0/d99/dc0/d125/d11b/d1f/f28 724929 0 2024-08-19T00:56:20.464 INFO:tasks.workunit.client.1.smithi086.stdout:5/974: write d0/d2d/d43/d91/f128 [507823,124713] 0 2024-08-19T00:56:20.466 INFO:tasks.workunit.client.1.smithi086.stdout:5/975: fdatasync d0/d8/d94/fd2 0 2024-08-19T00:56:20.468 INFO:tasks.workunit.client.1.smithi086.stdout:5/976: chown d0/d8/f86 3654170 1 2024-08-19T00:56:20.468 INFO:tasks.workunit.client.1.smithi086.stdout:9/963: write db/d96/fd3 [4713590,45198] 0 2024-08-19T00:56:20.468 INFO:tasks.workunit.client.1.smithi086.stdout:0/936: write da/d14/d55/d10c/d2e/d30/f4c [4889931,35313] 0 2024-08-19T00:56:20.472 INFO:tasks.workunit.client.1.smithi086.stdout:5/977: dread d0/d99/dc0/dc2/fb0 [0,4194304] 0 2024-08-19T00:56:20.474 INFO:tasks.workunit.client.1.smithi086.stdout:7/954: dread d3/d34/d44/d58/d4b/da5/daf/de7/df5/f8e [0,4194304] 0 2024-08-19T00:56:20.476 INFO:tasks.workunit.client.1.smithi086.stdout:5/978: mknod d0/d99/dc0/d125/d11b/d1f/d65/c137 0 2024-08-19T00:56:20.480 INFO:tasks.workunit.client.1.smithi086.stdout:7/955: creat d3/d34/df2/f13c x:0 0 0 2024-08-19T00:56:20.482 INFO:tasks.workunit.client.1.smithi086.stdout:8/954: dwrite dc/d17/d1e/fa1 [0,4194304] 0 2024-08-19T00:56:20.482 INFO:tasks.workunit.client.1.smithi086.stdout:6/968: dwrite db/d37/d44/d5a/d8f/fd1 [0,4194304] 0 2024-08-19T00:56:20.485 INFO:tasks.workunit.client.1.smithi086.stdout:9/964: creat db/d26/d5c/d87/d30/f13f x:0 0 0 2024-08-19T00:56:20.488 INFO:tasks.workunit.client.1.smithi086.stdout:7/956: fdatasync d3/de/d68/fb6 0 2024-08-19T00:56:20.489 INFO:tasks.workunit.client.1.smithi086.stdout:8/955: dread dc/d16/d18/d106/d28/f92 [0,4194304] 0 2024-08-19T00:56:20.492 INFO:tasks.workunit.client.1.smithi086.stdout:7/957: chown d3/d34/d44/d58/d4b/da5/ded/f133 30287 1 2024-08-19T00:56:20.494 INFO:tasks.workunit.client.1.smithi086.stdout:5/979: dread d0/d99/dc0/d125/d11b/d1f/fe3 [0,4194304] 0 2024-08-19T00:56:20.495 INFO:tasks.workunit.client.1.smithi086.stdout:0/937: dwrite da/f56 [0,4194304] 0 2024-08-19T00:56:20.497 INFO:tasks.workunit.client.1.smithi086.stdout:8/956: truncate dc/d1f/fbc 431867 0 2024-08-19T00:56:20.501 INFO:tasks.workunit.client.1.smithi086.stdout:0/938: fdatasync da/d14/d55/d10c/d2e/d30/d76/fb8 0 2024-08-19T00:56:20.502 INFO:tasks.workunit.client.1.smithi086.stdout:6/969: link db/f3e db/d37/d44/d5a/d78/ddc/f130 0 2024-08-19T00:56:20.505 INFO:tasks.workunit.client.1.smithi086.stdout:5/980: symlink d0/d8/d94/df9/dff/l138 0 2024-08-19T00:56:20.507 INFO:tasks.workunit.client.1.smithi086.stdout:7/958: rename d3/d34/c87 to d3/de/d68/c13d 0 2024-08-19T00:56:20.508 INFO:tasks.workunit.client.1.smithi086.stdout:5/981: dread d0/d99/da2/fdd [0,4194304] 0 2024-08-19T00:56:20.509 INFO:tasks.workunit.client.1.smithi086.stdout:8/957: creat dc/d16/dc7/f138 x:0 0 0 2024-08-19T00:56:20.509 INFO:tasks.workunit.client.1.smithi086.stdout:5/982: readlink d0/d5f/d60/d57/d80/da3/l105 0 2024-08-19T00:56:20.519 INFO:tasks.workunit.client.0.smithi017.stdout:1/418: sync 2024-08-19T00:56:20.520 INFO:tasks.workunit.client.0.smithi017.stdout:1/419: mknod d4/d1c/d1f/c7a 0 2024-08-19T00:56:20.521 INFO:tasks.workunit.client.0.smithi017.stdout:1/420: creat d4/dc/d3b/d45/f7b x:0 0 0 2024-08-19T00:56:20.522 INFO:tasks.workunit.client.0.smithi017.stdout:1/421: chown d4/dc 216469618 1 2024-08-19T00:56:20.522 INFO:tasks.workunit.client.0.smithi017.stdout:1/422: fdatasync d4/d1c/f25 0 2024-08-19T00:56:20.522 INFO:tasks.workunit.client.0.smithi017.stdout:1/423: readlink d4/dc/d3b/d45/l58 0 2024-08-19T00:56:20.531 INFO:tasks.workunit.client.0.smithi017.stdout:1/424: dwrite d4/dc/d3b/d55/f76 [0,4194304] 0 2024-08-19T00:56:20.531 INFO:tasks.workunit.client.1.smithi086.stdout:0/939: rename da/d14/d26/f33 to da/d14/d44/f12f 0 2024-08-19T00:56:20.533 INFO:tasks.workunit.client.1.smithi086.stdout:0/940: chown da/d14/d55/d10c/d2e/d7e/dd7/d128 5 1 2024-08-19T00:56:20.535 INFO:tasks.workunit.client.1.smithi086.stdout:8/958: truncate dc/d16/d18/fa6 327369 0 2024-08-19T00:56:20.541 INFO:tasks.workunit.client.0.smithi017.stdout:1/425: truncate d4/dc/f11 2397605 0 2024-08-19T00:56:20.542 INFO:tasks.workunit.client.0.smithi017.stdout:1/426: symlink d4/dc/d19/l7c 0 2024-08-19T00:56:20.543 INFO:tasks.workunit.client.0.smithi017.stdout:1/427: readlink d4/l37 0 2024-08-19T00:56:20.548 INFO:tasks.workunit.client.0.smithi017.stdout:1/428: dwrite d4/dc/d19/f44 [0,4194304] 0 2024-08-19T00:56:20.554 INFO:tasks.workunit.client.0.smithi017.stdout:1/429: rename d4/dc/d19/f44 to d4/dc/d3b/d3d/f7d 0 2024-08-19T00:56:20.556 INFO:tasks.workunit.client.0.smithi017.stdout:1/430: symlink d4/dc/d3b/d45/l7e 0 2024-08-19T00:56:20.556 INFO:tasks.workunit.client.0.smithi017.stdout:1/431: write d4/d1c/f2a [1997966,56196] 0 2024-08-19T00:56:20.558 INFO:tasks.workunit.client.0.smithi017.stdout:1/432: chown d4/dc/d3b/c74 834516 1 2024-08-19T00:56:20.562 INFO:tasks.workunit.client.0.smithi017.stdout:1/433: rename d4/dc/d3b/d55/f69 to d4/dc/d3b/d3d/f7f 0 2024-08-19T00:56:20.564 INFO:tasks.workunit.client.0.smithi017.stdout:1/434: creat d4/dc/d3b/f80 x:0 0 0 2024-08-19T00:56:20.565 INFO:tasks.workunit.client.0.smithi017.stdout:1/435: mknod d4/dc/d19/c81 0 2024-08-19T00:56:20.567 INFO:tasks.workunit.client.0.smithi017.stdout:1/436: mknod d4/dc/d3b/d55/d62/c82 0 2024-08-19T00:56:20.568 INFO:tasks.workunit.client.0.smithi017.stdout:1/437: mkdir d4/dc/d3b/d3d/d83 0 2024-08-19T00:56:20.570 INFO:tasks.workunit.client.0.smithi017.stdout:1/438: mknod d4/dc/d3b/d55/d62/c84 0 2024-08-19T00:56:20.570 INFO:tasks.workunit.client.0.smithi017.stdout:1/439: chown d4/d1c/d1f 12525 1 2024-08-19T00:56:20.589 INFO:tasks.workunit.client.1.smithi086.stdout:4/918: sync 2024-08-19T00:56:20.590 INFO:tasks.workunit.client.1.smithi086.stdout:5/983: mkdir d0/d99/dc0/dc2/de2/d139 0 2024-08-19T00:56:20.590 INFO:tasks.workunit.client.1.smithi086.stdout:9/965: dwrite db/d26/d5c/d87/f54 [0,4194304] 0 2024-08-19T00:56:20.591 INFO:tasks.workunit.client.1.smithi086.stdout:7/959: truncate d3/d34/d44/d58/d4b/d78/d9a/fe3 1025256 0 2024-08-19T00:56:20.592 INFO:tasks.workunit.client.1.smithi086.stdout:9/966: stat db/f61 0 2024-08-19T00:56:20.594 INFO:tasks.workunit.client.1.smithi086.stdout:8/959: creat dc/d16/dc7/dff/f139 x:0 0 0 2024-08-19T00:56:20.600 INFO:tasks.workunit.client.1.smithi086.stdout:9/967: mkdir db/d26/d5c/d87/d30/d31/d103/de2/d140 0 2024-08-19T00:56:20.601 INFO:tasks.workunit.client.1.smithi086.stdout:8/960: mknod dc/d16/d18/d106/d28/d2b/d3b/c13a 0 2024-08-19T00:56:20.602 INFO:tasks.workunit.client.1.smithi086.stdout:0/941: dwrite da/d5d/ff4 [0,4194304] 0 2024-08-19T00:56:20.602 INFO:tasks.workunit.client.1.smithi086.stdout:5/984: dread d0/d5f/f6f [0,4194304] 0 2024-08-19T00:56:20.605 INFO:tasks.workunit.client.1.smithi086.stdout:4/919: dwrite d2/d18/d33/d42/d72/d8f/fd2 [0,4194304] 0 2024-08-19T00:56:20.605 INFO:tasks.workunit.client.1.smithi086.stdout:0/942: chown da/d14/d44/df0 1187058 1 2024-08-19T00:56:20.609 INFO:tasks.workunit.client.1.smithi086.stdout:5/985: write d0/d5f/d60/d57/d80/da3/db7/f129 [256945,30088] 0 2024-08-19T00:56:20.609 INFO:tasks.workunit.client.1.smithi086.stdout:8/961: creat dc/d1f/d37/d4f/d11b/f13b x:0 0 0 2024-08-19T00:56:20.614 INFO:tasks.workunit.client.1.smithi086.stdout:5/986: write d0/d8/f86 [1083351,23573] 0 2024-08-19T00:56:20.614 INFO:tasks.workunit.client.1.smithi086.stdout:9/968: truncate db/d26/d5c/d87/d30/d32/fea 263701 0 2024-08-19T00:56:20.616 INFO:tasks.workunit.client.1.smithi086.stdout:5/987: readlink d0/d8/d10/l1c 0 2024-08-19T00:56:20.623 INFO:tasks.workunit.client.1.smithi086.stdout:7/960: dread d3/de/d68/d7d/fa7 [4194304,4194304] 0 2024-08-19T00:56:20.623 INFO:tasks.workunit.client.1.smithi086.stdout:5/988: rename d0/d5f/d60/d57/f92 to d0/d8/d10/dbb/f13a 0 2024-08-19T00:56:20.625 INFO:tasks.workunit.client.1.smithi086.stdout:8/962: dwrite dc/d1f/d37/d4f/dac/db8/f110 [0,4194304] 0 2024-08-19T00:56:20.629 INFO:tasks.workunit.client.1.smithi086.stdout:4/920: dread d2/d18/d33/d42/d72/f37 [0,4194304] 0 2024-08-19T00:56:20.630 INFO:tasks.workunit.client.1.smithi086.stdout:5/989: link d0/d20/c56 d0/d2d/dce/de1/c13b 0 2024-08-19T00:56:20.633 INFO:tasks.workunit.client.1.smithi086.stdout:4/921: mknod d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/de0/c131 0 2024-08-19T00:56:20.634 INFO:tasks.workunit.client.1.smithi086.stdout:4/922: read - d2/d18/d33/d42/ffc zero size 2024-08-19T00:56:20.635 INFO:tasks.workunit.client.1.smithi086.stdout:7/961: link d3/d34/d44/d58/d4b/c80 d3/de/c13e 0 2024-08-19T00:56:20.636 INFO:tasks.workunit.client.1.smithi086.stdout:5/990: creat d0/d8/d94/df9/d108/f13c x:0 0 0 2024-08-19T00:56:20.641 INFO:tasks.workunit.client.1.smithi086.stdout:8/963: mknod dc/d16/d18/d106/d28/d2b/d3b/d87/c13c 0 2024-08-19T00:56:20.642 INFO:tasks.workunit.client.1.smithi086.stdout:7/962: creat d3/d34/df2/d125/f13f x:0 0 0 2024-08-19T00:56:20.643 INFO:tasks.workunit.client.1.smithi086.stdout:0/943: truncate da/d5d/f103 1608586 0 2024-08-19T00:56:20.643 INFO:tasks.workunit.client.1.smithi086.stdout:4/923: dwrite d2/d18/d33/d42/d72/d78/f121 [0,4194304] 0 2024-08-19T00:56:20.643 INFO:tasks.workunit.client.1.smithi086.stdout:3/949: sync 2024-08-19T00:56:20.646 INFO:tasks.workunit.client.1.smithi086.stdout:0/944: stat da/d14/d55/d10c/f52 0 2024-08-19T00:56:20.647 INFO:tasks.workunit.client.1.smithi086.stdout:8/964: creat dc/d17/d86/f13d x:0 0 0 2024-08-19T00:56:20.648 INFO:tasks.workunit.client.1.smithi086.stdout:7/963: readlink d3/de/d2d/lb0 0 2024-08-19T00:56:20.648 INFO:tasks.workunit.client.1.smithi086.stdout:9/969: dread db/d26/d5c/d87/d6d/fe3 [0,4194304] 0 2024-08-19T00:56:20.649 INFO:tasks.workunit.client.1.smithi086.stdout:0/945: read da/d14/d26/f29 [2960864,124004] 0 2024-08-19T00:56:20.656 INFO:tasks.workunit.client.1.smithi086.stdout:3/950: mknod d3/d26/d2b/c133 0 2024-08-19T00:56:20.658 INFO:tasks.workunit.client.1.smithi086.stdout:4/924: dwrite d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd/ffb [0,4194304] 0 2024-08-19T00:56:20.659 INFO:tasks.workunit.client.1.smithi086.stdout:7/964: mknod d3/de/d68/c140 0 2024-08-19T00:56:20.661 INFO:tasks.workunit.client.1.smithi086.stdout:0/946: mkdir da/d5d/d130 0 2024-08-19T00:56:20.662 INFO:tasks.workunit.client.1.smithi086.stdout:8/965: mkdir dc/d1f/d37/d4f/dac/db8/d8f/df4/d135/d13e 0 2024-08-19T00:56:20.663 INFO:tasks.workunit.client.1.smithi086.stdout:3/951: mkdir d3/d26/d2b/d134 0 2024-08-19T00:56:20.664 INFO:tasks.workunit.client.1.smithi086.stdout:4/925: rmdir d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd 39 2024-08-19T00:56:20.669 INFO:tasks.workunit.client.1.smithi086.stdout:5/991: dwrite d0/d99/dc0/d125/d11b/fae [0,4194304] 0 2024-08-19T00:56:20.669 INFO:tasks.workunit.client.1.smithi086.stdout:3/952: creat d3/d18/d19/f135 x:0 0 0 2024-08-19T00:56:20.670 INFO:tasks.workunit.client.1.smithi086.stdout:4/926: dread - d2/d18/d33/d42/d72/d78/d25/f9d zero size 2024-08-19T00:56:20.672 INFO:tasks.workunit.client.1.smithi086.stdout:9/970: dwrite db/fa5 [0,4194304] 0 2024-08-19T00:56:20.674 INFO:tasks.workunit.client.1.smithi086.stdout:8/966: rename dc/d16/d18/d106/c5a to dc/d16/d18/c13f 0 2024-08-19T00:56:20.675 INFO:tasks.workunit.client.1.smithi086.stdout:3/953: fdatasync d3/d18/d61/d85/f8c 0 2024-08-19T00:56:20.681 INFO:tasks.workunit.client.1.smithi086.stdout:9/971: write db/d26/d5c/d87/d30/d3f/d43/f50 [4758957,91586] 0 2024-08-19T00:56:20.681 INFO:tasks.workunit.client.1.smithi086.stdout:5/992: dwrite d0/d8/d94/df9/d108/f9c [0,4194304] 0 2024-08-19T00:56:20.682 INFO:tasks.workunit.client.1.smithi086.stdout:3/954: mkdir d3/d26/dba/d136 0 2024-08-19T00:56:20.684 INFO:tasks.workunit.client.1.smithi086.stdout:0/947: rename da/d14/d55/d10c/d2e/d7e/cd2 to da/d115/d3b/d89/c131 0 2024-08-19T00:56:20.688 INFO:tasks.workunit.client.1.smithi086.stdout:4/927: getdents d2/d18 0 2024-08-19T00:56:20.688 INFO:tasks.workunit.client.1.smithi086.stdout:0/948: stat da/d5d 0 2024-08-19T00:56:20.689 INFO:tasks.workunit.client.1.smithi086.stdout:3/955: rmdir d3/d18/d19/dbc/de1 39 2024-08-19T00:56:20.690 INFO:tasks.workunit.client.1.smithi086.stdout:5/993: mknod d0/d2d/dce/c13d 0 2024-08-19T00:56:20.690 INFO:tasks.workunit.client.1.smithi086.stdout:7/965: rename d3/d34/d44/d58/d4b/da5/daf/de7/df5/f8e to d3/d34/d44/d58/d4b/d78/f141 0 2024-08-19T00:56:20.691 INFO:tasks.workunit.client.1.smithi086.stdout:3/956: dread - d3/d18/d27/f126 zero size 2024-08-19T00:56:20.692 INFO:tasks.workunit.client.1.smithi086.stdout:8/967: dwrite dc/d1f/d37/d4f/dac/db8/d99/f104 [0,4194304] 0 2024-08-19T00:56:20.692 INFO:tasks.workunit.client.1.smithi086.stdout:6/970: sync 2024-08-19T00:56:20.693 INFO:tasks.workunit.client.1.smithi086.stdout:0/949: truncate da/fe 1808073 0 2024-08-19T00:56:20.695 INFO:tasks.workunit.client.1.smithi086.stdout:7/966: dread d3/d34/d44/d58/d4b/f116 [0,4194304] 0 2024-08-19T00:56:20.700 INFO:tasks.workunit.client.1.smithi086.stdout:8/968: dread - dc/d16/d18/df2/fe9 zero size 2024-08-19T00:56:20.703 INFO:tasks.workunit.client.1.smithi086.stdout:8/969: stat dc/d1f/d37/d4f/dac/db8/d8f 0 2024-08-19T00:56:20.704 INFO:tasks.workunit.client.1.smithi086.stdout:3/957: link d3/l7 d3/d26/d2b/d33/d4a/d78/l137 0 2024-08-19T00:56:20.704 INFO:tasks.workunit.client.1.smithi086.stdout:6/971: dwrite db/d37/d41/dad/d11b/ff7 [0,4194304] 0 2024-08-19T00:56:20.705 INFO:tasks.workunit.client.1.smithi086.stdout:8/970: chown dc/d17/d86/f12e 29148 1 2024-08-19T00:56:20.705 INFO:tasks.workunit.client.1.smithi086.stdout:3/958: stat d3/d18/d19/d37/l45 0 2024-08-19T00:56:20.707 INFO:tasks.workunit.client.1.smithi086.stdout:3/959: write d3/d26/d2b/f6d [731795,52039] 0 2024-08-19T00:56:20.707 INFO:tasks.workunit.client.1.smithi086.stdout:0/950: rename da/d14/d26/l2a to da/d14/d55/d10c/d2e/d7e/l132 0 2024-08-19T00:56:20.708 INFO:tasks.workunit.client.1.smithi086.stdout:9/972: truncate db/d96/da7/f123 180048 0 2024-08-19T00:56:20.709 INFO:tasks.workunit.client.1.smithi086.stdout:3/960: chown d3/d26/d2b/c133 6 1 2024-08-19T00:56:20.711 INFO:tasks.workunit.client.1.smithi086.stdout:6/972: mkdir db/d34/d4e/d68/d99/de1/d131 0 2024-08-19T00:56:20.711 INFO:tasks.workunit.client.1.smithi086.stdout:9/973: write db/d26/d5c/d87/d30/d3f/d43/ffd [138713,35801] 0 2024-08-19T00:56:20.714 INFO:tasks.workunit.client.1.smithi086.stdout:5/994: write d0/d8/d73/fd1 [836795,749] 0 2024-08-19T00:56:20.714 INFO:tasks.workunit.client.1.smithi086.stdout:3/961: creat d3/d18/d27/d49/d3f/d5b/d66/f138 x:0 0 0 2024-08-19T00:56:20.715 INFO:tasks.workunit.client.1.smithi086.stdout:6/973: mkdir db/d34/d4e/d68/d89/d132 0 2024-08-19T00:56:20.717 INFO:tasks.workunit.client.1.smithi086.stdout:9/974: dread - db/d26/d5c/d87/d6d/deb/ff8 zero size 2024-08-19T00:56:20.721 INFO:tasks.workunit.client.1.smithi086.stdout:8/971: write dc/d1f/ffa [248477,103839] 0 2024-08-19T00:56:20.723 INFO:tasks.workunit.client.1.smithi086.stdout:6/974: creat db/d37/d41/dad/d11b/de9/f133 x:0 0 0 2024-08-19T00:56:20.723 INFO:tasks.workunit.client.1.smithi086.stdout:4/928: dwrite d2/f69 [0,4194304] 0 2024-08-19T00:56:20.726 INFO:tasks.workunit.client.1.smithi086.stdout:5/995: getdents d0/d8/d94/df9/d108/d135 0 2024-08-19T00:56:20.727 INFO:tasks.workunit.client.1.smithi086.stdout:0/951: write da/d14/f17 [5127887,60185] 0 2024-08-19T00:56:20.728 INFO:tasks.workunit.client.1.smithi086.stdout:7/967: dwrite d3/d34/d44/d58/d4b/d42/fbf [0,4194304] 0 2024-08-19T00:56:20.731 INFO:tasks.workunit.client.1.smithi086.stdout:8/972: mkdir dc/d1f/d37/d4f/dac/db8/d8f/df4/d135/d140 0 2024-08-19T00:56:20.734 INFO:tasks.workunit.client.1.smithi086.stdout:3/962: link d3/d18/d19/dbc/de1/f12b d3/d18/d61/d85/f139 0 2024-08-19T00:56:20.736 INFO:tasks.workunit.client.1.smithi086.stdout:4/929: read d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/f122 [891299,21380] 0 2024-08-19T00:56:20.738 INFO:tasks.workunit.client.1.smithi086.stdout:9/975: dwrite db/d26/d5c/d87/d30/d32/d44/dc1/ff5 [0,4194304] 0 2024-08-19T00:56:20.800 INFO:tasks.workunit.client.1.smithi086.stdout:6/975: symlink db/d34/d4e/d68/d99/de1/l134 0 2024-08-19T00:56:20.800 INFO:tasks.workunit.client.1.smithi086.stdout:3/963: rmdir d3/d26/d2b 39 2024-08-19T00:56:20.801 INFO:tasks.workunit.client.1.smithi086.stdout:6/976: chown db/d37/d28/d7f/d96/dd9/l12b 200224 1 2024-08-19T00:56:20.801 INFO:tasks.workunit.client.1.smithi086.stdout:6/977: fsync db/d37/d41/f106 0 2024-08-19T00:56:20.802 INFO:tasks.workunit.client.1.smithi086.stdout:8/973: readlink dc/d16/d18/d106/d28/d41/lec 0 2024-08-19T00:56:20.803 INFO:tasks.workunit.client.1.smithi086.stdout:7/968: write d3/de/d68/d72/d7e/dca/fd2 [578835,53444] 0 2024-08-19T00:56:20.805 INFO:tasks.workunit.client.1.smithi086.stdout:3/964: mknod d3/d18/d19/d10a/c13a 0 2024-08-19T00:56:20.805 INFO:tasks.workunit.client.1.smithi086.stdout:0/952: getdents da/d14/d55/d10c/d2e/d7e/dd7/d10d 0 2024-08-19T00:56:20.806 INFO:tasks.workunit.client.1.smithi086.stdout:4/930: symlink d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd/l132 0 2024-08-19T00:56:20.807 INFO:tasks.workunit.client.1.smithi086.stdout:7/969: mkdir d3/d34/df2/d117/d142 0 2024-08-19T00:56:20.807 INFO:tasks.workunit.client.1.smithi086.stdout:0/953: truncate da/d14/d44/f98 4759602 0 2024-08-19T00:56:20.808 INFO:tasks.workunit.client.1.smithi086.stdout:8/974: rename dc/d1f/d37/f72 to dc/d17/d1e/d55/dbb/f141 0 2024-08-19T00:56:20.810 INFO:tasks.workunit.client.1.smithi086.stdout:3/965: dread d3/d18/d19/d37/fae [0,4194304] 0 2024-08-19T00:56:20.810 INFO:tasks.workunit.client.1.smithi086.stdout:5/996: getdents d0/d99/da2/dde 0 2024-08-19T00:56:20.811 INFO:tasks.workunit.client.1.smithi086.stdout:8/975: write dc/d17/d86/f12e [828518,43990] 0 2024-08-19T00:56:20.813 INFO:tasks.workunit.client.1.smithi086.stdout:9/976: getdents db/d26/d5c/d87/d6d/dbf 0 2024-08-19T00:56:20.815 INFO:tasks.workunit.client.1.smithi086.stdout:0/954: symlink da/d14/d55/d10c/d2e/d7e/dd7/d128/l133 0 2024-08-19T00:56:20.815 INFO:tasks.workunit.client.1.smithi086.stdout:8/976: chown dc/d17/d1e/d55/dbb 1147405 1 2024-08-19T00:56:20.815 INFO:tasks.workunit.client.1.smithi086.stdout:7/970: dread d3/de/f59 [0,4194304] 0 2024-08-19T00:56:20.817 INFO:tasks.workunit.client.1.smithi086.stdout:3/966: creat d3/d26/d2b/d33/f13b x:0 0 0 2024-08-19T00:56:20.818 INFO:tasks.workunit.client.1.smithi086.stdout:4/931: dwrite d2/d18/d33/d42/d72/d78/d25/d30/d5d/f79 [0,4194304] 0 2024-08-19T00:56:20.818 INFO:tasks.workunit.client.1.smithi086.stdout:6/978: truncate db/d37/d28/fc0 792379 0 2024-08-19T00:56:20.819 INFO:tasks.workunit.client.1.smithi086.stdout:8/977: symlink dc/d16/dc7/dff/l142 0 2024-08-19T00:56:20.821 INFO:tasks.workunit.client.1.smithi086.stdout:0/955: dread da/d5d/f96 [0,4194304] 0 2024-08-19T00:56:20.822 INFO:tasks.workunit.client.1.smithi086.stdout:8/978: fsync dc/d17/d86/f13d 0 2024-08-19T00:56:20.822 INFO:tasks.workunit.client.1.smithi086.stdout:6/979: dread - db/d37/d44/d5a/f12a zero size 2024-08-19T00:56:20.823 INFO:tasks.workunit.client.1.smithi086.stdout:0/956: stat da/d14/f15 0 2024-08-19T00:56:20.824 INFO:tasks.workunit.client.1.smithi086.stdout:5/997: dwrite d0/d2d/d43/d91/f98 [0,4194304] 0 2024-08-19T00:56:20.826 INFO:tasks.workunit.client.1.smithi086.stdout:7/971: link d3/d34/d44/d58/d4b/da5/f134 d3/de/d113/f143 0 2024-08-19T00:56:20.828 INFO:tasks.workunit.client.1.smithi086.stdout:4/932: symlink d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/l133 0 2024-08-19T00:56:20.832 INFO:tasks.workunit.client.1.smithi086.stdout:8/979: rename dc/d17/d1e/d49 to dc/d1f/d37/d4f/dac/db8/d7a/d9b/d143 0 2024-08-19T00:56:20.833 INFO:tasks.workunit.client.1.smithi086.stdout:7/972: mknod d3/d34/d44/d58/d4b/da5/daf/de7/df5/d96/dfb/d10c/c144 0 2024-08-19T00:56:20.834 INFO:tasks.workunit.client.1.smithi086.stdout:4/933: creat d2/d18/d33/d42/d72/d78/d25/d30/d5d/da2/f134 x:0 0 0 2024-08-19T00:56:20.835 INFO:tasks.workunit.client.1.smithi086.stdout:4/934: chown d2/d18/d33/d42/d72/d78/d9e/fc7 0 1 2024-08-19T00:56:20.836 INFO:tasks.workunit.client.1.smithi086.stdout:4/935: write d2/d18/f28 [4604246,54218] 0 2024-08-19T00:56:20.837 INFO:tasks.workunit.client.1.smithi086.stdout:5/998: rename d0/d2d/f32 to d0/d5f/d60/d57/f13e 0 2024-08-19T00:56:20.840 INFO:tasks.workunit.client.1.smithi086.stdout:4/936: mkdir d2/d18/d33/d42/d72/d78/d9e/d135 0 2024-08-19T00:56:20.840 INFO:tasks.workunit.client.1.smithi086.stdout:8/980: getdents dc/d1f/d37/d4f/dac/db8/d7a/d88/dcd/d116 0 2024-08-19T00:56:20.841 INFO:tasks.workunit.client.1.smithi086.stdout:7/973: getdents d3/d5b/d11b 0 2024-08-19T00:56:20.841 INFO:tasks.workunit.client.1.smithi086.stdout:5/999: mkdir d0/d99/dc0/d125/d11b/d13f 0 2024-08-19T00:56:20.842 INFO:tasks.workunit.client.1.smithi086.stdout:4/937: creat d2/d18/dbd/f136 x:0 0 0 2024-08-19T00:56:20.842 INFO:tasks.workunit.client.1.smithi086.stdout:3/967: dread d3/d18/f1c [0,4194304] 0 2024-08-19T00:56:20.845 INFO:tasks.workunit.client.1.smithi086.stdout:3/968: creat d3/d18/d61/f13c x:0 0 0 2024-08-19T00:56:20.846 INFO:tasks.workunit.client.1.smithi086.stdout:3/969: readlink d3/d18/d27/d76/l86 0 2024-08-19T00:56:20.848 INFO:tasks.workunit.client.1.smithi086.stdout:7/974: truncate d3/d34/d44/d58/d4b/d78/f5a 894838 0 2024-08-19T00:56:20.849 INFO:tasks.workunit.client.1.smithi086.stdout:8/981: dwrite dc/d1f/d37/d4f/dac/db8/d8f/fc1 [0,4194304] 0 2024-08-19T00:56:20.849 INFO:tasks.workunit.client.1.smithi086.stdout:3/970: fsync d3/d9/fc7 0 2024-08-19T00:56:20.852 INFO:tasks.workunit.client.1.smithi086.stdout:0/957: truncate da/d5d/df7/f11d 2539524 0 2024-08-19T00:56:20.852 INFO:tasks.workunit.client.1.smithi086.stdout:3/971: dread - d3/d18/d19/d10a/f11d zero size 2024-08-19T00:56:20.854 INFO:tasks.workunit.client.1.smithi086.stdout:8/982: write dc/d1f/d37/d4f/dac/db8/d7a/d9b/f71 [3980684,2460] 0 2024-08-19T00:56:20.855 INFO:tasks.workunit.client.1.smithi086.stdout:4/938: write d2/d18/d33/d42/d72/d78/d25/f7e [2167822,64450] 0 2024-08-19T00:56:20.858 INFO:tasks.workunit.client.1.smithi086.stdout:7/975: dwrite d3/ff [0,4194304] 0 2024-08-19T00:56:20.860 INFO:tasks.workunit.client.1.smithi086.stdout:0/958: truncate da/d14/d44/df0/fd6 829221 0 2024-08-19T00:56:20.863 INFO:tasks.workunit.client.1.smithi086.stdout:3/972: rename d3/d18/d1a/l1b to d3/d18/d1a/d51/d75/l13d 0 2024-08-19T00:56:20.864 INFO:tasks.workunit.client.1.smithi086.stdout:4/939: unlink d2/d18/d33/d42/d72/d78/de6/lfe 0 2024-08-19T00:56:20.865 INFO:tasks.workunit.client.1.smithi086.stdout:7/976: mkdir d3/da1/d108/d10d/d145 0 2024-08-19T00:56:20.868 INFO:tasks.workunit.client.1.smithi086.stdout:8/983: rename dc/d1f/d37/d4f/dac/de3 to dc/d1f/dd4/d108/d144 0 2024-08-19T00:56:20.869 INFO:tasks.workunit.client.1.smithi086.stdout:3/973: mknod d3/d18/d1a/d51/c13e 0 2024-08-19T00:56:20.870 INFO:tasks.workunit.client.1.smithi086.stdout:4/940: mknod d2/d18/d33/d114/c137 0 2024-08-19T00:56:20.870 INFO:tasks.workunit.client.1.smithi086.stdout:7/977: fdatasync d3/de/d68/d7d/fa7 0 2024-08-19T00:56:20.872 INFO:tasks.workunit.client.1.smithi086.stdout:3/974: write d3/d18/d19/f55 [4234091,87962] 0 2024-08-19T00:56:20.872 INFO:tasks.workunit.client.1.smithi086.stdout:8/984: stat dc/d16/d18/d106/d28/d2b/d3b/c73 0 2024-08-19T00:56:20.872 INFO:tasks.workunit.client.1.smithi086.stdout:0/959: dwrite da/d5d/da9/f11e [0,4194304] 0 2024-08-19T00:56:20.874 INFO:tasks.workunit.client.1.smithi086.stdout:3/975: chown d3/d18/d1a/d51 916325 1 2024-08-19T00:56:20.877 INFO:tasks.workunit.client.1.smithi086.stdout:3/976: fdatasync d3/d18/d19/dbc/fa0 0 2024-08-19T00:56:20.880 INFO:tasks.workunit.client.1.smithi086.stdout:7/978: symlink d3/d34/d44/d58/d4b/da5/daf/de7/df5/d96/dfb/d10c/l146 0 2024-08-19T00:56:20.881 INFO:tasks.workunit.client.1.smithi086.stdout:0/960: creat da/d5d/df7/d12d/f134 x:0 0 0 2024-08-19T00:56:20.891 INFO:tasks.workunit.client.1.smithi086.stdout:8/985: truncate dc/d16/d18/d106/d83/fcc 2939554 0 2024-08-19T00:56:20.892 INFO:tasks.workunit.client.1.smithi086.stdout:3/977: write d3/d18/d19/dbc/ff3 [906432,119882] 0 2024-08-19T00:56:20.892 INFO:tasks.workunit.client.1.smithi086.stdout:0/961: write da/d14/d55/d10c/d2e/d30/d76/f9d [239857,125172] 0 2024-08-19T00:56:20.893 INFO:tasks.workunit.client.1.smithi086.stdout:7/979: rename d3/d5b/ldc to d3/d34/df2/d117/d142/l147 0 2024-08-19T00:56:20.894 INFO:tasks.workunit.client.1.smithi086.stdout:0/962: truncate da/d14/d26/f12c 282941 0 2024-08-19T00:56:20.894 INFO:tasks.workunit.client.1.smithi086.stdout:4/941: truncate d2/d18/d33/d42/d72/d78/d2c/f43 3625444 0 2024-08-19T00:56:20.896 INFO:tasks.workunit.client.1.smithi086.stdout:7/980: unlink d3/d34/d44/d58/d4b/da5/f134 0 2024-08-19T00:56:20.942 INFO:tasks.workunit.client.0.smithi017.stdout:7/521: sync 2024-08-19T00:56:20.942 INFO:tasks.workunit.client.1.smithi086.stdout:0/963: dread - da/d14/d55/d10c/d2e/d43/ff1 zero size 2024-08-19T00:56:20.942 INFO:tasks.workunit.client.1.smithi086.stdout:4/942: creat d2/d18/d33/d42/d72/d78/d25/d30/d5d/d90/f138 x:0 0 0 2024-08-19T00:56:20.943 INFO:tasks.workunit.client.1.smithi086.stdout:8/986: dwrite dc/f14 [4194304,4194304] 0 2024-08-19T00:56:20.943 INFO:tasks.workunit.client.1.smithi086.stdout:7/981: chown d3/f38 230036214 1 2024-08-19T00:56:20.943 INFO:tasks.workunit.client.1.smithi086.stdout:0/964: stat da/d97/lb3 0 2024-08-19T00:56:20.944 INFO:tasks.workunit.client.0.smithi017.stdout:7/522: rename d3/dc/df/d7d/c91 to d3/dc/df/d1c/d2c/d2f/ca6 0 2024-08-19T00:56:20.947 INFO:tasks.workunit.client.0.smithi017.stdout:7/523: mkdir d3/dc/df/d37/d93/da7 0 2024-08-19T00:56:20.947 INFO:tasks.workunit.client.1.smithi086.stdout:0/965: fdatasync da/d5d/f96 0 2024-08-19T00:56:20.948 INFO:tasks.workunit.client.0.smithi017.stdout:7/524: truncate d3/dc/df/d37/d93/f9f 104281 0 2024-08-19T00:56:20.949 INFO:tasks.workunit.client.0.smithi017.stdout:7/525: fsync d3/d3c/d88/f8b 0 2024-08-19T00:56:20.951 INFO:tasks.workunit.client.1.smithi086.stdout:7/982: dwrite d3/d34/f89 [0,4194304] 0 2024-08-19T00:56:20.954 INFO:tasks.workunit.client.1.smithi086.stdout:4/943: getdents d2/d18/d33 0 2024-08-19T00:56:20.958 INFO:tasks.workunit.client.0.smithi017.stdout:7/526: unlink d3/dc/d5f/f63 0 2024-08-19T00:56:20.961 INFO:tasks.workunit.client.1.smithi086.stdout:8/987: getdents dc/d1f/dd4/d108 0 2024-08-19T00:56:20.963 INFO:tasks.workunit.client.1.smithi086.stdout:7/983: rmdir d3/de/d112 39 2024-08-19T00:56:20.966 INFO:tasks.workunit.client.1.smithi086.stdout:4/944: creat d2/d18/d33/d42/d72/d78/d25/d30/d5d/f139 x:0 0 0 2024-08-19T00:56:20.969 INFO:tasks.workunit.client.1.smithi086.stdout:0/966: creat da/d14/d55/d10c/ddc/f135 x:0 0 0 2024-08-19T00:56:20.971 INFO:tasks.workunit.client.1.smithi086.stdout:8/988: dread dc/d16/d18/d106/d28/d2b/f5f [0,4194304] 0 2024-08-19T00:56:20.971 INFO:tasks.workunit.client.1.smithi086.stdout:4/945: mknod d2/d18/d33/c13a 0 2024-08-19T00:56:20.973 INFO:tasks.workunit.client.1.smithi086.stdout:8/989: truncate dc/d1f/d37/f131 156390 0 2024-08-19T00:56:20.975 INFO:tasks.workunit.client.1.smithi086.stdout:0/967: rename da/d14/d55/d10c/d2e/d7e/l132 to da/d14/d55/d10c/d2e/d7e/d122/l136 0 2024-08-19T00:56:20.975 INFO:tasks.workunit.client.1.smithi086.stdout:9/977: sync 2024-08-19T00:56:20.976 INFO:tasks.workunit.client.1.smithi086.stdout:7/984: dread d3/d34/f52 [0,4194304] 0 2024-08-19T00:56:20.977 INFO:tasks.workunit.client.1.smithi086.stdout:8/990: creat dc/d16/d18/d106/d28/d2b/d3b/d87/de2/f145 x:0 0 0 2024-08-19T00:56:20.977 INFO:tasks.workunit.client.1.smithi086.stdout:9/978: read - db/d26/d5c/d87/d30/d58/fc7 zero size 2024-08-19T00:56:20.979 INFO:tasks.workunit.client.1.smithi086.stdout:8/991: write dc/d16/d18/d106/d28/d2b/d3b/d87/f102 [470817,63123] 0 2024-08-19T00:56:20.981 INFO:tasks.workunit.client.1.smithi086.stdout:9/979: symlink db/d26/d5c/d87/d6d/l141 0 2024-08-19T00:56:20.982 INFO:tasks.workunit.client.1.smithi086.stdout:0/968: dread da/d14/d26/f48 [0,4194304] 0 2024-08-19T00:56:20.982 INFO:tasks.workunit.client.1.smithi086.stdout:8/992: creat dc/d16/d18/d106/d28/d41/d11e/f146 x:0 0 0 2024-08-19T00:56:20.982 INFO:tasks.workunit.client.1.smithi086.stdout:7/985: dread d3/d34/d44/d58/d4b/d78/f5a [0,4194304] 0 2024-08-19T00:56:20.985 INFO:tasks.workunit.client.1.smithi086.stdout:8/993: chown dc/d16/dc7/caa 4 1 2024-08-19T00:56:20.989 INFO:tasks.workunit.client.1.smithi086.stdout:0/969: symlink da/d115/d3b/d89/l137 0 2024-08-19T00:56:20.992 INFO:tasks.workunit.client.1.smithi086.stdout:4/946: rmdir d2/d18/d33/d42/d72/d78/d25/d30 39 2024-08-19T00:56:20.997 INFO:tasks.workunit.client.1.smithi086.stdout:8/994: rename dc/d1f/d37/d4f/dac/db8/d7a/d88/fd6 to dc/d17/d1e/f147 0 2024-08-19T00:56:21.000 INFO:tasks.workunit.client.1.smithi086.stdout:0/970: dread da/d5d/feb [0,4194304] 0 2024-08-19T00:56:21.000 INFO:tasks.workunit.client.1.smithi086.stdout:4/947: link d2/d18/d33/d42/d72/d78/d2c/dae/f130 d2/d18/d33/d42/d72/d78/d25/d55/d6c/f13b 0 2024-08-19T00:56:21.001 INFO:tasks.workunit.client.1.smithi086.stdout:8/995: creat dc/d16/d18/df2/f148 x:0 0 0 2024-08-19T00:56:21.002 INFO:tasks.workunit.client.1.smithi086.stdout:4/948: fdatasync d2/d18/d33/d42/d72/d78/d25/d55/d4d/fcf 0 2024-08-19T00:56:21.002 INFO:tasks.workunit.client.1.smithi086.stdout:0/971: creat da/d97/f138 x:0 0 0 2024-08-19T00:56:21.003 INFO:tasks.workunit.client.1.smithi086.stdout:9/980: write db/d26/d5c/d87/f11c [658258,16725] 0 2024-08-19T00:56:21.004 INFO:tasks.workunit.client.1.smithi086.stdout:7/986: write d3/d34/d44/d58/d4b/d78/d9a/fe3 [1492355,49468] 0 2024-08-19T00:56:21.006 INFO:tasks.workunit.client.1.smithi086.stdout:4/949: creat d2/d18/d33/d42/d72/d78/d2c/f13c x:0 0 0 2024-08-19T00:56:21.008 INFO:tasks.workunit.client.1.smithi086.stdout:0/972: rename da/d14/d55/d10c/d2e/d43/le1 to da/d14/d44/df0/l139 0 2024-08-19T00:56:21.011 INFO:tasks.workunit.client.1.smithi086.stdout:8/996: rename dc/d1f/d37/d4f/dac/db8/d7a/d88/db2/ldf to dc/d1f/d37/d4f/dac/db8/d7a/d88/l149 0 2024-08-19T00:56:21.013 INFO:tasks.workunit.client.1.smithi086.stdout:4/950: symlink d2/d18/d33/d42/d72/d78/d25/d30/d5d/da2/l13d 0 2024-08-19T00:56:21.013 INFO:tasks.workunit.client.1.smithi086.stdout:6/980: sync 2024-08-19T00:56:21.013 INFO:tasks.workunit.client.1.smithi086.stdout:0/973: getdents da/d14/d55/d11f 0 2024-08-19T00:56:21.015 INFO:tasks.workunit.client.1.smithi086.stdout:8/997: creat dc/d16/d18/d106/d28/d41/d11e/d136/f14a x:0 0 0 2024-08-19T00:56:21.015 INFO:tasks.workunit.client.1.smithi086.stdout:7/987: dread d3/f97 [0,4194304] 0 2024-08-19T00:56:21.017 INFO:tasks.workunit.client.1.smithi086.stdout:4/951: mknod d2/d18/d33/d42/d72/d78/d9e/dc6/c13e 0 2024-08-19T00:56:21.017 INFO:tasks.workunit.client.1.smithi086.stdout:8/998: chown dc/d16/d18/d106/d28/d41/la7 73 1 2024-08-19T00:56:21.018 INFO:tasks.workunit.client.1.smithi086.stdout:6/981: creat db/d37/d44/d5a/d78/ddc/d122/f135 x:0 0 0 2024-08-19T00:56:21.019 INFO:tasks.workunit.client.1.smithi086.stdout:0/974: getdents da/d14/d44/df0 0 2024-08-19T00:56:21.019 INFO:tasks.workunit.client.1.smithi086.stdout:7/988: chown d3/d34/d44/d58/d4b/da5/daf/lc2 20 1 2024-08-19T00:56:21.022 INFO:tasks.workunit.client.1.smithi086.stdout:9/981: dwrite db/d26/d5c/d87/d30/d31/d103/d19/d18/fcb [0,4194304] 0 2024-08-19T00:56:21.023 INFO:tasks.workunit.client.0.smithi017.stdout:7/527: rename d3/dc/df/d3d/d90/d87/fa3 to d3/dc/df/d37/d46/d73/fa8 0 2024-08-19T00:56:21.027 INFO:tasks.workunit.client.1.smithi086.stdout:6/982: mkdir db/d37/d41/d136 0 2024-08-19T00:56:21.027 INFO:tasks.workunit.client.1.smithi086.stdout:0/975: dwrite da/d115/d3b/ffc [0,4194304] 0 2024-08-19T00:56:21.033 INFO:tasks.workunit.client.1.smithi086.stdout:4/952: rename d2/d18/d33/d42/d72/d78/d25/d30/ced to d2/d18/c13f 0 2024-08-19T00:56:21.034 INFO:tasks.workunit.client.1.smithi086.stdout:9/982: mkdir db/d96/da7/d142 0 2024-08-19T00:56:21.035 INFO:tasks.workunit.client.1.smithi086.stdout:8/999: creat dc/d1f/d37/d4f/dac/db8/d7a/d9b/dbf/f14b x:0 0 0 2024-08-19T00:56:21.036 INFO:tasks.workunit.client.1.smithi086.stdout:7/989: creat d3/da1/d108/d10d/d145/f148 x:0 0 0 2024-08-19T00:56:21.040 INFO:tasks.workunit.client.1.smithi086.stdout:0/976: creat da/d14/d26/f13a x:0 0 0 2024-08-19T00:56:21.041 INFO:tasks.workunit.client.0.smithi017.stdout:7/528: write d3/dc/df/d3d/d90/f59 [1074141,91026] 0 2024-08-19T00:56:21.042 INFO:tasks.workunit.client.0.smithi017.stdout:5/352: sync 2024-08-19T00:56:21.042 INFO:tasks.workunit.client.0.smithi017.stdout:6/486: sync 2024-08-19T00:56:21.043 INFO:tasks.workunit.client.1.smithi086.stdout:6/983: link db/lf db/d37/d41/d136/l137 0 2024-08-19T00:56:21.044 INFO:tasks.workunit.client.0.smithi017.stdout:7/529: creat d3/dc/df/d3d/d90/fa9 x:0 0 0 2024-08-19T00:56:21.045 INFO:tasks.workunit.client.0.smithi017.stdout:7/530: chown d3/dc/df/d3d/d90/l62 1 1 2024-08-19T00:56:21.045 INFO:tasks.workunit.client.0.smithi017.stdout:6/487: creat d5/d13/d11/d52/fa9 x:0 0 0 2024-08-19T00:56:21.046 INFO:tasks.workunit.client.1.smithi086.stdout:6/984: creat db/d37/d44/d5a/d8f/f138 x:0 0 0 2024-08-19T00:56:21.049 INFO:tasks.workunit.client.1.smithi086.stdout:6/985: rmdir db/d34/d4e/d68/d89 39 2024-08-19T00:56:21.051 INFO:tasks.workunit.client.0.smithi017.stdout:5/353: rename db/f67 to db/d19/d1f/d15/f7f 0 2024-08-19T00:56:21.053 INFO:tasks.workunit.client.0.smithi017.stdout:7/531: dwrite d3/dc/df/d23/d69/f6f [8388608,4194304] 0 2024-08-19T00:56:21.053 INFO:tasks.workunit.client.1.smithi086.stdout:9/983: write db/d26/d5c/d87/d30/d31/d103/fe6 [527462,43353] 0 2024-08-19T00:56:21.054 INFO:tasks.workunit.client.0.smithi017.stdout:7/532: stat d3/dc/df/d3d/d92 0 2024-08-19T00:56:21.055 INFO:tasks.workunit.client.0.smithi017.stdout:6/488: creat d5/d13/d11/d2c/d4a/faa x:0 0 0 2024-08-19T00:56:21.056 INFO:tasks.workunit.client.1.smithi086.stdout:4/953: write d2/d18/d33/d42/d72/dd0/fda [54525,87972] 0 2024-08-19T00:56:21.057 INFO:tasks.workunit.client.1.smithi086.stdout:9/984: symlink db/d26/d5c/d87/d30/d32/d44/d67/l143 0 2024-08-19T00:56:21.057 INFO:tasks.workunit.client.1.smithi086.stdout:7/990: write d3/d34/d44/fce [1950511,3349] 0 2024-08-19T00:56:21.058 INFO:tasks.workunit.client.0.smithi017.stdout:7/533: mkdir d3/dc/df/daa 0 2024-08-19T00:56:21.059 INFO:tasks.workunit.client.0.smithi017.stdout:6/489: creat d5/d13/d20/d77/fab x:0 0 0 2024-08-19T00:56:21.060 INFO:tasks.workunit.client.1.smithi086.stdout:9/985: chown db/d26/d5c/d87/d30/d32/ldb 508393768 1 2024-08-19T00:56:21.062 INFO:tasks.workunit.client.1.smithi086.stdout:7/991: read - d3/de/d112/f11c zero size 2024-08-19T00:56:21.063 INFO:tasks.workunit.client.0.smithi017.stdout:7/534: mkdir d3/dab 0 2024-08-19T00:56:21.064 INFO:tasks.workunit.client.1.smithi086.stdout:4/954: truncate d2/d18/d33/f92 3779241 0 2024-08-19T00:56:21.066 INFO:tasks.workunit.client.1.smithi086.stdout:7/992: fsync d3/fe9 0 2024-08-19T00:56:21.067 INFO:tasks.workunit.client.1.smithi086.stdout:6/986: dread db/d37/d41/f6b [0,4194304] 0 2024-08-19T00:56:21.067 INFO:tasks.workunit.client.1.smithi086.stdout:4/955: symlink d2/d18/d33/d42/d72/d78/d25/d55/de1/l140 0 2024-08-19T00:56:21.068 INFO:tasks.workunit.client.1.smithi086.stdout:6/987: chown db/d34/d69/fd0 0 1 2024-08-19T00:56:21.069 INFO:tasks.workunit.client.1.smithi086.stdout:7/993: chown d3/de/d2d/cd4 4 1 2024-08-19T00:56:21.069 INFO:tasks.workunit.client.1.smithi086.stdout:6/988: write db/d34/d39/d76/fb2 [1035797,16726] 0 2024-08-19T00:56:21.070 INFO:tasks.workunit.client.0.smithi017.stdout:7/535: creat d3/dc/df/d37/fac x:0 0 0 2024-08-19T00:56:21.074 INFO:tasks.workunit.client.1.smithi086.stdout:6/989: mkdir db/d37/d28/d7f/d96/dd9/d139 0 2024-08-19T00:56:21.074 INFO:tasks.workunit.client.0.smithi017.stdout:6/490: dread d5/d13/d11/f53 [0,4194304] 0 2024-08-19T00:56:21.077 INFO:tasks.workunit.client.1.smithi086.stdout:7/994: symlink d3/d34/d44/d58/d4b/da5/daf/de7/df5/l149 0 2024-08-19T00:56:21.079 INFO:tasks.workunit.client.0.smithi017.stdout:6/491: rename d5/d13/d11/d2c/f92 to d5/d13/d20/d77/d99/fac 0 2024-08-19T00:56:21.081 INFO:tasks.workunit.client.1.smithi086.stdout:6/990: rename db/d34/d39/f40 to db/d34/d4e/d68/d99/d112/f13a 0 2024-08-19T00:56:21.087 INFO:tasks.workunit.client.1.smithi086.stdout:7/995: creat d3/d34/d10a/f14a x:0 0 0 2024-08-19T00:56:21.088 INFO:tasks.workunit.client.1.smithi086.stdout:6/991: stat db/d34/d4e/d68/d99/fec 0 2024-08-19T00:56:21.092 INFO:tasks.workunit.client.0.smithi017.stdout:7/536: dwrite d3/dc/f1f [0,4194304] 0 2024-08-19T00:56:21.093 INFO:tasks.workunit.client.1.smithi086.stdout:9/986: dwrite db/d96/da7/f123 [0,4194304] 0 2024-08-19T00:56:21.094 INFO:tasks.workunit.client.1.smithi086.stdout:4/956: dwrite d2/d18/d33/d42/d72/d78/d25/fa6 [0,4194304] 0 2024-08-19T00:56:21.097 INFO:tasks.workunit.client.0.smithi017.stdout:6/492: truncate d5/d13/f22 2305493 0 2024-08-19T00:56:21.100 INFO:tasks.workunit.client.0.smithi017.stdout:7/537: dwrite d3/dc/df/d3d/d90/f59 [0,4194304] 0 2024-08-19T00:56:21.109 INFO:tasks.workunit.client.0.smithi017.stdout:6/493: symlink d5/d13/d11/d2c/d9d/lad 0 2024-08-19T00:56:21.116 INFO:tasks.workunit.client.0.smithi017.stdout:6/494: dwrite d5/d13/d20/f3c [0,4194304] 0 2024-08-19T00:56:21.121 INFO:tasks.workunit.client.0.smithi017.stdout:6/495: unlink d5/d13/d11/d2c/d4a/faa 0 2024-08-19T00:56:21.121 INFO:tasks.workunit.client.0.smithi017.stdout:6/496: stat d5/d13/d20/f32 0 2024-08-19T00:56:21.128 INFO:tasks.workunit.client.1.smithi086.stdout:4/957: dread d2/d18/d33/d42/d72/d78/d2c/f2e [4194304,4194304] 0 2024-08-19T00:56:21.128 INFO:tasks.workunit.client.1.smithi086.stdout:7/996: creat d3/d34/d44/d58/d4b/da5/daf/de7/df5/d96/f14b x:0 0 0 2024-08-19T00:56:21.130 INFO:tasks.workunit.client.1.smithi086.stdout:9/987: chown db/d26/d5c/d87/d30/d58/cb0 32745 1 2024-08-19T00:56:21.132 INFO:tasks.workunit.client.1.smithi086.stdout:7/997: unlink d3/de/d68/d7d/fa7 0 2024-08-19T00:56:21.136 INFO:tasks.workunit.client.1.smithi086.stdout:6/992: mknod db/d34/d4e/d68/d89/d128/c13b 0 2024-08-19T00:56:21.136 INFO:tasks.workunit.client.1.smithi086.stdout:6/993: stat db/d34/d4e/d68/d99/dce 0 2024-08-19T00:56:21.137 INFO:tasks.workunit.client.1.smithi086.stdout:6/994: dread - db/d37/d41/dad/d11b/de9/f11c zero size 2024-08-19T00:56:21.138 INFO:tasks.workunit.client.1.smithi086.stdout:7/998: symlink d3/d34/df2/d117/l14c 0 2024-08-19T00:56:21.140 INFO:tasks.workunit.client.1.smithi086.stdout:6/995: truncate db/f14 3363683 0 2024-08-19T00:56:21.142 INFO:tasks.workunit.client.1.smithi086.stdout:7/999: symlink d3/d34/d44/d58/d4b/l14d 0 2024-08-19T00:56:21.142 INFO:tasks.workunit.client.0.smithi017.stdout:7/538: write d3/dc/df/d7d/f9b [947187,92722] 0 2024-08-19T00:56:21.143 INFO:tasks.workunit.client.1.smithi086.stdout:3/978: sync 2024-08-19T00:56:21.146 INFO:tasks.workunit.client.1.smithi086.stdout:4/958: dread d2/f1b [4194304,4194304] 0 2024-08-19T00:56:21.152 INFO:tasks.workunit.client.0.smithi017.stdout:6/497: write d5/d13/d11/d2c/f76 [256207,3547] 0 2024-08-19T00:56:21.155 INFO:tasks.workunit.client.1.smithi086.stdout:3/979: dread d3/d18/d19/dbc/db8/f44 [0,4194304] 0 2024-08-19T00:56:21.157 INFO:tasks.workunit.client.0.smithi017.stdout:6/498: rename d5/d13/d20/d5e/d95/f9b to d5/d13/d11/d2c/d51/d7e/fae 0 2024-08-19T00:56:21.158 INFO:tasks.workunit.client.1.smithi086.stdout:3/980: creat d3/d18/d19/dbc/db8/f13f x:0 0 0 2024-08-19T00:56:21.160 INFO:tasks.workunit.client.1.smithi086.stdout:3/981: write d3/d18/d27/d49/d3f/d5b/d8f/ffd [225162,117987] 0 2024-08-19T00:56:21.162 INFO:tasks.workunit.client.1.smithi086.stdout:0/977: sync 2024-08-19T00:56:21.162 INFO:tasks.workunit.client.1.smithi086.stdout:9/988: dwrite db/f57 [4194304,4194304] 0 2024-08-19T00:56:21.164 INFO:tasks.workunit.client.1.smithi086.stdout:6/996: write db/d34/d39/d76/fb5 [516985,96272] 0 2024-08-19T00:56:21.164 INFO:tasks.workunit.client.0.smithi017.stdout:7/539: write d3/dc/df/d1c/f3e [2799861,107762] 0 2024-08-19T00:56:21.165 INFO:tasks.workunit.client.1.smithi086.stdout:4/959: truncate d2/d18/d33/d42/d72/d78/d25/d30/ff6 2242007 0 2024-08-19T00:56:21.165 INFO:tasks.workunit.client.1.smithi086.stdout:9/989: dread - db/d26/d5c/d87/d30/d58/fc7 zero size 2024-08-19T00:56:21.166 INFO:tasks.workunit.client.1.smithi086.stdout:6/997: read db/d37/d28/d7f/d96/f10d [2140761,701] 0 2024-08-19T00:56:21.167 INFO:tasks.workunit.client.0.smithi017.stdout:7/540: mknod d3/d3c/cad 0 2024-08-19T00:56:21.168 INFO:tasks.workunit.client.0.smithi017.stdout:7/541: write d3/d3c/d88/f8b [4902414,50824] 0 2024-08-19T00:56:21.174 INFO:tasks.workunit.client.1.smithi086.stdout:6/998: mkdir db/d37/d28/d7f/d96/ddb/d13c 0 2024-08-19T00:56:21.175 INFO:tasks.workunit.client.1.smithi086.stdout:9/990: symlink db/d26/d5c/d87/d30/d3f/d43/d4e/d117/l144 0 2024-08-19T00:56:21.175 INFO:tasks.workunit.client.1.smithi086.stdout:6/999: write db/d34/d69/f102 [2719035,104835] 0 2024-08-19T00:56:21.179 INFO:tasks.workunit.client.0.smithi017.stdout:7/542: creat d3/dc/df/d23/fae x:0 0 0 2024-08-19T00:56:21.180 INFO:tasks.workunit.client.1.smithi086.stdout:4/960: fdatasync d2/d18/d33/f92 0 2024-08-19T00:56:21.181 INFO:tasks.workunit.client.0.smithi017.stdout:7/543: write d3/dc/df/d1c/d2c/d83/f86 [331872,130445] 0 2024-08-19T00:56:21.184 INFO:tasks.workunit.client.0.smithi017.stdout:7/544: creat d3/dc/df/d37/d93/faf x:0 0 0 2024-08-19T00:56:21.185 INFO:tasks.workunit.client.1.smithi086.stdout:0/978: dwrite da/d14/d55/d10c/d2e/d66/fce [0,4194304] 0 2024-08-19T00:56:21.185 INFO:tasks.workunit.client.1.smithi086.stdout:3/982: dread d3/d18/d19/dbc/d5d/f122 [0,4194304] 0 2024-08-19T00:56:21.186 INFO:tasks.workunit.client.0.smithi017.stdout:7/545: mknod d3/dc/df/d37/d46/d73/d80/cb0 0 2024-08-19T00:56:21.187 INFO:tasks.workunit.client.1.smithi086.stdout:3/983: readlink d3/d26/d2b/d33/d4a/d57/d8a/la5 0 2024-08-19T00:56:21.187 INFO:tasks.workunit.client.1.smithi086.stdout:3/984: chown d3/d18/d19/d37/d3a 39285 1 2024-08-19T00:56:21.188 INFO:tasks.workunit.client.1.smithi086.stdout:0/979: unlink da/d14/d44/d49/f5f 0 2024-08-19T00:56:21.189 INFO:tasks.workunit.client.1.smithi086.stdout:0/980: write da/d14/d26/f13a [31984,113377] 0 2024-08-19T00:56:21.190 INFO:tasks.workunit.client.1.smithi086.stdout:3/985: fsync d3/d18/d27/f83 0 2024-08-19T00:56:21.192 INFO:tasks.workunit.client.1.smithi086.stdout:0/981: creat da/f13b x:0 0 0 2024-08-19T00:56:21.194 INFO:tasks.workunit.client.1.smithi086.stdout:0/982: write da/d14/d55/d10c/d2e/f35 [4269447,122175] 0 2024-08-19T00:56:21.195 INFO:tasks.workunit.client.0.smithi017.stdout:7/546: dwrite d3/dc/df/d23/f24 [0,4194304] 0 2024-08-19T00:56:21.195 INFO:tasks.workunit.client.1.smithi086.stdout:0/983: truncate da/d14/f113 868652 0 2024-08-19T00:56:21.201 INFO:tasks.workunit.client.1.smithi086.stdout:0/984: rename da/d14/d55/d10c/d2e/f35 to da/d14/d55/d10c/d2e/d30/d76/df2/f13c 0 2024-08-19T00:56:21.202 INFO:tasks.workunit.client.0.smithi017.stdout:7/547: dwrite d3/dc/df/d1c/f55 [4194304,4194304] 0 2024-08-19T00:56:21.203 INFO:tasks.workunit.client.1.smithi086.stdout:4/961: write d2/d18/d33/d42/d72/d8f/fcc [613287,88894] 0 2024-08-19T00:56:21.204 INFO:tasks.workunit.client.1.smithi086.stdout:9/991: dwrite db/d26/d5c/d87/d37/fab [0,4194304] 0 2024-08-19T00:56:21.206 INFO:tasks.workunit.client.1.smithi086.stdout:4/962: write d2/d18/d33/d42/d72/d78/d25/d55/d4d/ff9 [239965,19016] 0 2024-08-19T00:56:21.213 INFO:tasks.workunit.client.1.smithi086.stdout:3/986: write d3/d26/fbd [54331,111379] 0 2024-08-19T00:56:21.217 INFO:tasks.workunit.client.0.smithi017.stdout:7/548: getdents d3/dc/df/d3d/d90 0 2024-08-19T00:56:21.218 INFO:tasks.workunit.client.1.smithi086.stdout:4/963: dwrite d2/d18/d33/d42/d72/d78/f121 [0,4194304] 0 2024-08-19T00:56:21.218 INFO:tasks.workunit.client.1.smithi086.stdout:9/992: dwrite db/d26/d5c/d87/d30/d3f/f8a [8388608,4194304] 0 2024-08-19T00:56:21.219 INFO:tasks.workunit.client.0.smithi017.stdout:7/549: write d3/dc/df/d7d/f9b [1060149,21609] 0 2024-08-19T00:56:21.219 INFO:tasks.workunit.client.0.smithi017.stdout:3/491: sync 2024-08-19T00:56:21.219 INFO:tasks.workunit.client.0.smithi017.stdout:4/531: sync 2024-08-19T00:56:21.220 INFO:tasks.workunit.client.1.smithi086.stdout:3/987: read d3/d18/d19/d62/d46/f6e [1193898,97804] 0 2024-08-19T00:56:21.220 INFO:tasks.workunit.client.0.smithi017.stdout:4/532: fsync d2/d16/f6f 0 2024-08-19T00:56:21.221 INFO:tasks.workunit.client.1.smithi086.stdout:0/985: write da/d115/d3b/d4e/fb0 [1524595,27918] 0 2024-08-19T00:56:21.221 INFO:tasks.workunit.client.0.smithi017.stdout:3/492: read d5/da/d27/d28/f37 [672197,121851] 0 2024-08-19T00:56:21.225 INFO:tasks.workunit.client.0.smithi017.stdout:7/550: symlink d3/dc/df/d37/lb1 0 2024-08-19T00:56:21.228 INFO:tasks.workunit.client.1.smithi086.stdout:9/993: dwrite db/d26/d5c/d87/d37/fab [0,4194304] 0 2024-08-19T00:56:21.229 INFO:tasks.workunit.client.1.smithi086.stdout:3/988: fsync d3/d18/d19/d37/f7f 0 2024-08-19T00:56:21.230 INFO:tasks.workunit.client.0.smithi017.stdout:7/551: unlink d3/dc/df/d37/d93/faf 0 2024-08-19T00:56:21.231 INFO:tasks.workunit.client.1.smithi086.stdout:3/989: stat d3/d18/d27/d49/d3f/d5b/d8f 0 2024-08-19T00:56:21.231 INFO:tasks.workunit.client.0.smithi017.stdout:4/533: dread d2/d1a/d55/d64/f94 [0,4194304] 0 2024-08-19T00:56:21.232 INFO:tasks.workunit.client.0.smithi017.stdout:3/493: mkdir d5/da/d3c/d4f/d68/d99 0 2024-08-19T00:56:21.232 INFO:tasks.workunit.client.0.smithi017.stdout:3/494: chown d5/da 0 1 2024-08-19T00:56:21.234 INFO:tasks.workunit.client.0.smithi017.stdout:3/495: write d5/da/d3c/f50 [1019442,5021] 0 2024-08-19T00:56:21.234 INFO:tasks.workunit.client.1.smithi086.stdout:9/994: fsync db/d26/d5c/d87/d30/d3f/f107 0 2024-08-19T00:56:21.235 INFO:tasks.workunit.client.0.smithi017.stdout:7/552: fdatasync d3/dc/df/d1c/f97 0 2024-08-19T00:56:21.236 INFO:tasks.workunit.client.1.smithi086.stdout:9/995: write db/d26/d5c/d87/d30/d58/f95 [96252,12592] 0 2024-08-19T00:56:21.236 INFO:tasks.workunit.client.1.smithi086.stdout:3/990: symlink d3/d18/d19/dbc/de1/l140 0 2024-08-19T00:56:21.239 INFO:tasks.workunit.client.0.smithi017.stdout:4/534: mkdir d2/d87/dbc 0 2024-08-19T00:56:21.243 INFO:tasks.workunit.client.1.smithi086.stdout:3/991: mknod d3/d18/d1a/c141 0 2024-08-19T00:56:21.243 INFO:tasks.workunit.client.0.smithi017.stdout:3/496: symlink d5/da/d27/l9a 0 2024-08-19T00:56:21.243 INFO:tasks.workunit.client.1.smithi086.stdout:3/992: readlink d3/d18/d27/d49/d3f/l10c 0 2024-08-19T00:56:21.244 INFO:tasks.workunit.client.0.smithi017.stdout:7/553: mkdir d3/dc/df/d23/d6a/db2 0 2024-08-19T00:56:21.245 INFO:tasks.workunit.client.1.smithi086.stdout:9/996: dread db/d26/d5c/d87/d30/d31/d103/d19/d38/f53 [0,4194304] 0 2024-08-19T00:56:21.246 INFO:tasks.workunit.client.1.smithi086.stdout:0/986: write da/d14/d55/d10c/f52 [461126,67978] 0 2024-08-19T00:56:21.246 INFO:tasks.workunit.client.0.smithi017.stdout:4/535: dwrite d2/d1a/d20/f52 [4194304,4194304] 0 2024-08-19T00:56:21.247 INFO:tasks.workunit.client.1.smithi086.stdout:0/987: chown da/d115/d3b/d4e/fd5 19290 1 2024-08-19T00:56:21.248 INFO:tasks.workunit.client.0.smithi017.stdout:4/536: stat d2/d21/d40/f7f 0 2024-08-19T00:56:21.248 INFO:tasks.workunit.client.0.smithi017.stdout:7/554: unlink d3/f5 0 2024-08-19T00:56:21.248 INFO:tasks.workunit.client.1.smithi086.stdout:9/997: truncate db/d26/d5c/d87/d30/d31/d103/d19/d18/d11f/f121 499454 0 2024-08-19T00:56:21.253 INFO:tasks.workunit.client.1.smithi086.stdout:0/988: creat da/d14/d55/f13d x:0 0 0 2024-08-19T00:56:21.255 INFO:tasks.workunit.client.1.smithi086.stdout:0/989: read da/d14/f15 [865179,118895] 0 2024-08-19T00:56:21.256 INFO:tasks.workunit.client.1.smithi086.stdout:9/998: creat db/d26/d5c/d68/f145 x:0 0 0 2024-08-19T00:56:21.256 INFO:tasks.workunit.client.0.smithi017.stdout:7/555: dwrite d3/dc/df/d7d/f9a [0,4194304] 0 2024-08-19T00:56:21.257 INFO:tasks.workunit.client.0.smithi017.stdout:3/497: creat d5/da/d3c/d4f/d68/d99/f9b x:0 0 0 2024-08-19T00:56:21.258 INFO:tasks.workunit.client.0.smithi017.stdout:3/498: readlink d5/da/d3c/l8f 0 2024-08-19T00:56:21.259 INFO:tasks.workunit.client.0.smithi017.stdout:3/499: chown d5/d11/d61/f63 51 1 2024-08-19T00:56:21.261 INFO:tasks.workunit.client.1.smithi086.stdout:0/990: dwrite da/d14/d55/d10c/d2e/d30/f4c [4194304,4194304] 0 2024-08-19T00:56:21.266 INFO:tasks.workunit.client.0.smithi017.stdout:7/556: dread d3/dc/df/d7d/f9b [0,4194304] 0 2024-08-19T00:56:21.269 INFO:tasks.workunit.client.1.smithi086.stdout:3/993: dread d3/d18/d19/d37/f84 [0,4194304] 0 2024-08-19T00:56:21.271 INFO:tasks.workunit.client.0.smithi017.stdout:3/500: dwrite d5/da/d27/d28/f80 [0,4194304] 0 2024-08-19T00:56:21.271 INFO:tasks.workunit.client.0.smithi017.stdout:7/557: mkdir d3/dc/df/d23/d6a/db3 0 2024-08-19T00:56:21.274 INFO:tasks.workunit.client.1.smithi086.stdout:0/991: write da/d115/f69 [5145640,94795] 0 2024-08-19T00:56:21.276 INFO:tasks.workunit.client.0.smithi017.stdout:3/501: creat d5/da/d27/d6e/f9c x:0 0 0 2024-08-19T00:56:21.276 INFO:tasks.workunit.client.0.smithi017.stdout:4/537: dwrite d2/d11/d24/f4e [0,4194304] 0 2024-08-19T00:56:21.278 INFO:tasks.workunit.client.0.smithi017.stdout:7/558: creat d3/dc/df/d23/d69/fb4 x:0 0 0 2024-08-19T00:56:21.282 INFO:tasks.workunit.client.0.smithi017.stdout:4/538: unlink d2/d21/d53/d57/f6e 0 2024-08-19T00:56:21.284 INFO:tasks.workunit.client.0.smithi017.stdout:7/559: mkdir d3/dc/df/d3d/d90/d87/db5 0 2024-08-19T00:56:21.287 INFO:tasks.workunit.client.0.smithi017.stdout:3/502: link d5/da/d27/d28/c83 d5/da/d3c/c9d 0 2024-08-19T00:56:21.289 INFO:tasks.workunit.client.0.smithi017.stdout:7/560: rename d3/dc/df/d3d/d90/d87/db5 to d3/dc/df/d23/d6a/db6 0 2024-08-19T00:56:21.290 INFO:tasks.workunit.client.0.smithi017.stdout:4/539: dwrite d2/d21/d40/d56/d99/da3/fb3 [0,4194304] 0 2024-08-19T00:56:21.292 INFO:tasks.workunit.client.0.smithi017.stdout:4/540: read d2/d1a/d55/d64/f94 [81464,92140] 0 2024-08-19T00:56:21.295 INFO:tasks.workunit.client.0.smithi017.stdout:4/541: creat d2/d87/db2/fbd x:0 0 0 2024-08-19T00:56:21.299 INFO:tasks.workunit.client.1.smithi086.stdout:3/994: truncate d3/d9/f39 166269 0 2024-08-19T00:56:21.303 INFO:tasks.workunit.client.0.smithi017.stdout:3/503: write d5/d11/f62 [1724947,87382] 0 2024-08-19T00:56:21.304 INFO:tasks.workunit.client.1.smithi086.stdout:0/992: dread da/d14/d55/d10c/d2e/d43/fc7 [0,4194304] 0 2024-08-19T00:56:21.304 INFO:tasks.workunit.client.0.smithi017.stdout:3/504: write d5/ff [7363047,90014] 0 2024-08-19T00:56:21.307 INFO:tasks.workunit.client.0.smithi017.stdout:3/505: rmdir d5/d15 39 2024-08-19T00:56:21.310 INFO:tasks.workunit.client.0.smithi017.stdout:7/561: dwrite d3/d3c/f43 [0,4194304] 0 2024-08-19T00:56:21.313 INFO:tasks.workunit.client.0.smithi017.stdout:7/562: fdatasync d3/dc/df/d37/d46/f9d 0 2024-08-19T00:56:21.315 INFO:tasks.workunit.client.1.smithi086.stdout:3/995: dread d3/d26/d2b/d33/f41 [0,4194304] 0 2024-08-19T00:56:21.315 INFO:tasks.workunit.client.1.smithi086.stdout:0/993: truncate da/d5d/da9/fff 400923 0 2024-08-19T00:56:21.318 INFO:tasks.workunit.client.1.smithi086.stdout:3/996: symlink d3/d26/d2b/d33/d4a/l142 0 2024-08-19T00:56:21.319 INFO:tasks.workunit.client.1.smithi086.stdout:3/997: chown d3/d18/d1a/d51/dad/de9 0 1 2024-08-19T00:56:21.319 INFO:tasks.workunit.client.1.smithi086.stdout:0/994: write da/f60 [2024346,44543] 0 2024-08-19T00:56:21.320 INFO:tasks.workunit.client.0.smithi017.stdout:7/563: rmdir d3/dc/df/d23/d6a/db3 0 2024-08-19T00:56:21.323 INFO:tasks.workunit.client.1.smithi086.stdout:0/995: unlink da/d115/d3b/d4e/fb0 0 2024-08-19T00:56:21.323 INFO:tasks.workunit.client.0.smithi017.stdout:3/506: dwrite d5/da/f72 [0,4194304] 0 2024-08-19T00:56:21.324 INFO:tasks.workunit.client.0.smithi017.stdout:3/507: write d5/d11/f85 [753653,52288] 0 2024-08-19T00:56:21.325 INFO:tasks.workunit.client.0.smithi017.stdout:7/564: symlink d3/dc/df/d23/d6a/lb7 0 2024-08-19T00:56:21.327 INFO:tasks.workunit.client.0.smithi017.stdout:4/542: dread d2/d1a/d55/d73/f81 [0,4194304] 0 2024-08-19T00:56:21.328 INFO:tasks.workunit.client.0.smithi017.stdout:4/543: write d2/d21/d53/d57/d9d/fa9 [637351,77493] 0 2024-08-19T00:56:21.329 INFO:tasks.workunit.client.0.smithi017.stdout:3/508: mkdir d5/da/d3c/d4f/d68/d9e 0 2024-08-19T00:56:21.329 INFO:tasks.workunit.client.1.smithi086.stdout:0/996: dwrite da/d97/f124 [0,4194304] 0 2024-08-19T00:56:21.333 INFO:tasks.workunit.client.0.smithi017.stdout:7/565: creat d3/dc/d5f/fb8 x:0 0 0 2024-08-19T00:56:21.334 INFO:tasks.workunit.client.0.smithi017.stdout:9/460: sync 2024-08-19T00:56:21.334 INFO:tasks.workunit.client.0.smithi017.stdout:0/507: sync 2024-08-19T00:56:21.334 INFO:tasks.workunit.client.0.smithi017.stdout:8/425: sync 2024-08-19T00:56:21.334 INFO:tasks.workunit.client.0.smithi017.stdout:1/440: sync 2024-08-19T00:56:21.334 INFO:tasks.workunit.client.0.smithi017.stdout:2/572: sync 2024-08-19T00:56:21.334 INFO:tasks.workunit.client.0.smithi017.stdout:5/354: sync 2024-08-19T00:56:21.335 INFO:tasks.workunit.client.0.smithi017.stdout:4/544: mkdir d2/d11/d24/dbe 0 2024-08-19T00:56:21.337 INFO:tasks.workunit.client.1.smithi086.stdout:0/997: rename da/d115/d3b/d4e/dbe/f125 to da/d14/d55/d10c/ddc/f13e 0 2024-08-19T00:56:21.340 INFO:tasks.workunit.client.0.smithi017.stdout:7/566: mkdir d3/dc/df/d1a/db9 0 2024-08-19T00:56:21.340 INFO:tasks.workunit.client.0.smithi017.stdout:4/545: read d2/f7 [5444270,104815] 0 2024-08-19T00:56:21.341 INFO:tasks.workunit.client.0.smithi017.stdout:3/509: dwrite d5/f60 [0,4194304] 0 2024-08-19T00:56:21.341 INFO:tasks.workunit.client.0.smithi017.stdout:2/573: fsync d2/d7/d10/d3b/d3c/f40 0 2024-08-19T00:56:21.344 INFO:tasks.workunit.client.0.smithi017.stdout:0/508: rmdir d5/d17 39 2024-08-19T00:56:21.346 INFO:tasks.workunit.client.0.smithi017.stdout:9/461: mkdir d0/d33/d22/d85 0 2024-08-19T00:56:21.350 INFO:tasks.workunit.client.0.smithi017.stdout:8/426: rename de/d36/d2e to de/d15/d79 0 2024-08-19T00:56:21.352 INFO:tasks.workunit.client.0.smithi017.stdout:4/546: rmdir d2/d21/d53/d57/d9d 39 2024-08-19T00:56:21.353 INFO:tasks.workunit.client.0.smithi017.stdout:2/574: symlink d2/d7/d10/d3b/d3c/lbc 0 2024-08-19T00:56:21.357 INFO:tasks.workunit.client.0.smithi017.stdout:2/575: fsync d2/d7/d10/d35/d55/f6f 0 2024-08-19T00:56:21.357 INFO:tasks.workunit.client.0.smithi017.stdout:4/547: fdatasync d2/f7 0 2024-08-19T00:56:21.358 INFO:tasks.workunit.client.0.smithi017.stdout:7/567: getdents d3/dc/df/d23/d8c 0 2024-08-19T00:56:21.361 INFO:tasks.workunit.client.0.smithi017.stdout:8/427: dwrite de/d15/d39/f41 [0,4194304] 0 2024-08-19T00:56:21.361 INFO:tasks.workunit.client.0.smithi017.stdout:1/441: getdents d4 0 2024-08-19T00:56:21.362 INFO:tasks.workunit.client.0.smithi017.stdout:8/428: stat de 0 2024-08-19T00:56:21.363 INFO:tasks.workunit.client.0.smithi017.stdout:9/462: link d0/d33/d22/d45/f54 d0/d33/d22/d52/f86 0 2024-08-19T00:56:21.365 INFO:tasks.workunit.client.0.smithi017.stdout:3/510: rmdir d5/d15/d53 0 2024-08-19T00:56:21.369 INFO:tasks.workunit.client.0.smithi017.stdout:2/576: creat d2/d7/dd/fbd x:0 0 0 2024-08-19T00:56:21.369 INFO:tasks.workunit.client.0.smithi017.stdout:1/442: symlink d4/dc/d19/l85 0 2024-08-19T00:56:21.370 INFO:tasks.workunit.client.0.smithi017.stdout:7/568: truncate d3/dc/df/d23/fae 64504 0 2024-08-19T00:56:21.371 INFO:tasks.workunit.client.0.smithi017.stdout:2/577: chown d2/d7/d10/d3b/d80/da2 665057 1 2024-08-19T00:56:21.372 INFO:tasks.workunit.client.0.smithi017.stdout:9/463: dread d0/d58/d49/f4f [0,4194304] 0 2024-08-19T00:56:21.373 INFO:tasks.workunit.client.0.smithi017.stdout:0/509: dwrite d5/d17/d26/d30/da3/fa6 [0,4194304] 0 2024-08-19T00:56:21.373 INFO:tasks.workunit.client.0.smithi017.stdout:3/511: chown d5/da/c17 359755 1 2024-08-19T00:56:21.375 INFO:tasks.workunit.client.0.smithi017.stdout:0/510: readlink d5/d17/d21/d39/l76 0 2024-08-19T00:56:21.378 INFO:tasks.workunit.client.0.smithi017.stdout:4/548: link d2/d1a/d20/f8c d2/d87/dbc/fbf 0 2024-08-19T00:56:21.378 INFO:tasks.workunit.client.0.smithi017.stdout:5/355: write db/d19/d33/f42 [441607,4001] 0 2024-08-19T00:56:21.383 INFO:tasks.workunit.client.0.smithi017.stdout:5/356: write db/d19/d33/f42 [1384897,61825] 0 2024-08-19T00:56:21.386 INFO:tasks.workunit.client.0.smithi017.stdout:9/464: symlink d0/d33/d22/l87 0 2024-08-19T00:56:21.387 INFO:tasks.workunit.client.0.smithi017.stdout:0/511: dwrite d5/d17/d26/d30/da3/fa6 [0,4194304] 0 2024-08-19T00:56:21.390 INFO:tasks.workunit.client.0.smithi017.stdout:4/549: symlink d2/d21/d40/d56/lc0 0 2024-08-19T00:56:21.393 INFO:tasks.workunit.client.0.smithi017.stdout:6/499: sync 2024-08-19T00:56:21.393 INFO:tasks.workunit.client.0.smithi017.stdout:5/357: unlink db/d19/d1f/d15/d30/f36 0 2024-08-19T00:56:21.395 INFO:tasks.workunit.client.0.smithi017.stdout:7/569: write d3/f51 [2201546,15908] 0 2024-08-19T00:56:21.396 INFO:tasks.workunit.client.0.smithi017.stdout:9/465: readlink d0/d33/d22/d5a/l6e 0 2024-08-19T00:56:21.398 INFO:tasks.workunit.client.0.smithi017.stdout:8/429: truncate de/d15/f29 4029590 0 2024-08-19T00:56:21.399 INFO:tasks.workunit.client.0.smithi017.stdout:1/443: creat d4/dc/d3b/d3d/f86 x:0 0 0 2024-08-19T00:56:21.401 INFO:tasks.workunit.client.0.smithi017.stdout:3/512: creat d5/da/d27/f9f x:0 0 0 2024-08-19T00:56:21.403 INFO:tasks.workunit.client.0.smithi017.stdout:6/500: creat d5/d13/d11/d2c/d4a/d64/d86/faf x:0 0 0 2024-08-19T00:56:21.404 INFO:tasks.workunit.client.0.smithi017.stdout:5/358: readlink db/d19/d1f/l32 0 2024-08-19T00:56:21.405 INFO:tasks.workunit.client.0.smithi017.stdout:2/578: rename d2/d7/d29/f83 to d2/d7/d10/d3b/d3c/d8a/fbe 0 2024-08-19T00:56:21.407 INFO:tasks.workunit.client.0.smithi017.stdout:4/550: mkdir d2/dc1 0 2024-08-19T00:56:21.410 INFO:tasks.workunit.client.0.smithi017.stdout:1/444: dwrite d4/dc/d3b/d3d/d54/f67 [0,4194304] 0 2024-08-19T00:56:21.410 INFO:tasks.workunit.client.0.smithi017.stdout:4/551: dread - d2/d87/db2/fbd zero size 2024-08-19T00:56:21.413 INFO:tasks.workunit.client.0.smithi017.stdout:7/570: getdents d3/dc/df/daa 0 2024-08-19T00:56:21.414 INFO:tasks.workunit.client.0.smithi017.stdout:8/430: rename de/l76 to de/d36/l7a 0 2024-08-19T00:56:21.416 INFO:tasks.workunit.client.0.smithi017.stdout:7/571: write d3/dc/df/d37/d46/f9d [126972,127660] 0 2024-08-19T00:56:21.416 INFO:tasks.workunit.client.1.smithi086.stdout:4/964: sync 2024-08-19T00:56:21.417 INFO:tasks.workunit.client.1.smithi086.stdout:9/999: sync 2024-08-19T00:56:21.418 INFO:tasks.workunit.client.1.smithi086.stdout:4/965: write d2/d18/dbd/f136 [538603,33872] 0 2024-08-19T00:56:21.418 INFO:tasks.workunit.client.0.smithi017.stdout:7/572: write d3/dc/df/d1c/f55 [4039343,68847] 0 2024-08-19T00:56:21.419 INFO:tasks.workunit.client.0.smithi017.stdout:5/359: mkdir db/d19/d1f/d15/d3e/d40/d49/d63/d80 0 2024-08-19T00:56:21.420 INFO:tasks.workunit.client.0.smithi017.stdout:3/513: symlink d5/d15/d92/la0 0 2024-08-19T00:56:21.420 INFO:tasks.workunit.client.0.smithi017.stdout:9/466: rmdir d0/d5c 0 2024-08-19T00:56:21.426 INFO:tasks.workunit.client.1.smithi086.stdout:4/966: creat d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/d85/f141 x:0 0 0 2024-08-19T00:56:21.426 INFO:tasks.workunit.client.0.smithi017.stdout:1/445: chown d4/dc/d17/d1d/c5e 16724556 1 2024-08-19T00:56:21.429 INFO:tasks.workunit.client.0.smithi017.stdout:2/579: rename d2/d7/d10/d3b/d69 to d2/d7/d10/d35/d45/d58/dbf 0 2024-08-19T00:56:21.432 INFO:tasks.workunit.client.0.smithi017.stdout:7/573: symlink d3/dc/df/d7d/lba 0 2024-08-19T00:56:21.434 INFO:tasks.workunit.client.0.smithi017.stdout:3/514: dread d5/da/d27/d28/f80 [0,4194304] 0 2024-08-19T00:56:21.434 INFO:tasks.workunit.client.1.smithi086.stdout:4/967: mknod d2/d18/d33/d42/d72/d78/d25/c142 0 2024-08-19T00:56:21.435 INFO:tasks.workunit.client.0.smithi017.stdout:7/574: fsync d3/dc/d5f/f89 0 2024-08-19T00:56:21.435 INFO:tasks.workunit.client.0.smithi017.stdout:0/512: dread d5/d17/d21/f2d [4194304,4194304] 0 2024-08-19T00:56:21.436 INFO:tasks.workunit.client.0.smithi017.stdout:9/467: dwrite d0/d33/d22/d5a/f5f [0,4194304] 0 2024-08-19T00:56:21.437 INFO:tasks.workunit.client.0.smithi017.stdout:1/446: truncate d4/dc/d19/f79 650655 0 2024-08-19T00:56:21.439 INFO:tasks.workunit.client.0.smithi017.stdout:7/575: fdatasync d3/dc/df/d3d/d90/f59 0 2024-08-19T00:56:21.445 INFO:tasks.workunit.client.0.smithi017.stdout:7/576: read d3/dc/df/d37/d46/d73/d80/d81/f99 [13384,123924] 0 2024-08-19T00:56:21.446 INFO:tasks.workunit.client.0.smithi017.stdout:4/552: link d2/d11/c7e d2/d21/d40/d56/cc2 0 2024-08-19T00:56:21.447 INFO:tasks.workunit.client.0.smithi017.stdout:6/501: dread d5/d13/d11/f3f [0,4194304] 0 2024-08-19T00:56:21.448 INFO:tasks.workunit.client.1.smithi086.stdout:4/968: creat d2/d18/d33/d114/f143 x:0 0 0 2024-08-19T00:56:21.449 INFO:tasks.workunit.client.0.smithi017.stdout:1/447: dwrite d4/dc/d17/d1d/f1e [0,4194304] 0 2024-08-19T00:56:21.450 INFO:tasks.workunit.client.0.smithi017.stdout:2/580: truncate d2/d7/fc 2406497 0 2024-08-19T00:56:21.454 INFO:tasks.workunit.client.0.smithi017.stdout:3/515: symlink d5/d11/d61/la1 0 2024-08-19T00:56:21.454 INFO:tasks.workunit.client.1.smithi086.stdout:4/969: dwrite d2/d18/d33/d42/d72/d78/d25/d55/d4d/ff9 [0,4194304] 0 2024-08-19T00:56:21.454 INFO:tasks.workunit.client.0.smithi017.stdout:3/516: fsync d5/d15/d1b/f20 0 2024-08-19T00:56:21.455 INFO:tasks.workunit.client.0.smithi017.stdout:9/468: creat d0/d33/d22/d5a/f88 x:0 0 0 2024-08-19T00:56:21.458 INFO:tasks.workunit.client.0.smithi017.stdout:4/553: creat d2/d1a/d55/d8f/fc3 x:0 0 0 2024-08-19T00:56:21.459 INFO:tasks.workunit.client.1.smithi086.stdout:4/970: dread d2/d18/d33/d42/d72/f37 [4194304,4194304] 0 2024-08-19T00:56:21.459 INFO:tasks.workunit.client.0.smithi017.stdout:6/502: creat d5/d13/d11/d93/fb0 x:0 0 0 2024-08-19T00:56:21.460 INFO:tasks.workunit.client.0.smithi017.stdout:0/513: symlink d5/d17/d26/lae 0 2024-08-19T00:56:21.461 INFO:tasks.workunit.client.0.smithi017.stdout:7/577: dwrite d3/dc/df/d1c/f68 [0,4194304] 0 2024-08-19T00:56:21.463 INFO:tasks.workunit.client.0.smithi017.stdout:4/554: fsync d2/d1a/d55/d73/f7b 0 2024-08-19T00:56:21.463 INFO:tasks.workunit.client.0.smithi017.stdout:6/503: dread - d5/d13/d11/d2c/d51/d7e/f7f zero size 2024-08-19T00:56:21.463 INFO:tasks.workunit.client.0.smithi017.stdout:3/517: mknod d5/d15/d1b/ca2 0 2024-08-19T00:56:21.467 INFO:tasks.workunit.client.0.smithi017.stdout:4/555: fdatasync d2/d21/d40/d56/fa5 0 2024-08-19T00:56:21.468 INFO:tasks.workunit.client.1.smithi086.stdout:4/971: creat d2/d18/d33/d42/d72/d78/d25/d55/d6c/f144 x:0 0 0 2024-08-19T00:56:21.470 INFO:tasks.workunit.client.0.smithi017.stdout:3/518: write d5/da/d3c/d4f/f94 [895048,109057] 0 2024-08-19T00:56:21.473 INFO:tasks.workunit.client.1.smithi086.stdout:4/972: truncate d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/f74 4846126 0 2024-08-19T00:56:21.476 INFO:tasks.workunit.client.0.smithi017.stdout:4/556: chown d2/d11/d24/f4e 1146766918 1 2024-08-19T00:56:21.477 INFO:tasks.workunit.client.0.smithi017.stdout:6/504: rename d5/d7b/f8b to d5/d13/d20/d89/fb1 0 2024-08-19T00:56:21.477 INFO:tasks.workunit.client.0.smithi017.stdout:7/578: creat d3/dc/df/d23/d6a/db6/fbb x:0 0 0 2024-08-19T00:56:21.477 INFO:tasks.workunit.client.1.smithi086.stdout:0/998: sync 2024-08-19T00:56:21.478 INFO:tasks.workunit.client.1.smithi086.stdout:3/998: sync 2024-08-19T00:56:21.479 INFO:tasks.workunit.client.0.smithi017.stdout:0/514: dwrite d5/f48 [0,4194304] 0 2024-08-19T00:56:21.479 INFO:tasks.workunit.client.0.smithi017.stdout:7/579: fsync d3/dc/d5f/f89 0 2024-08-19T00:56:21.479 INFO:tasks.workunit.client.0.smithi017.stdout:1/448: creat d4/dc/d3b/d3d/f87 x:0 0 0 2024-08-19T00:56:21.481 INFO:tasks.workunit.client.0.smithi017.stdout:4/557: write d2/d21/d53/d57/f9f [3707327,33015] 0 2024-08-19T00:56:21.483 INFO:tasks.workunit.client.1.smithi086.stdout:3/999: mkdir d3/d18/d1a/d51/d9b/d143 0 2024-08-19T00:56:21.487 INFO:tasks.workunit.client.1.smithi086.stdout:0/999: read da/d14/d44/d49/fbc [84430,27424] 0 2024-08-19T00:56:21.494 INFO:tasks.workunit.client.0.smithi017.stdout:2/581: link d2/d7/d10/d3b/d80/d81/lb8 d2/d7/d10/lc0 0 2024-08-19T00:56:21.495 INFO:tasks.workunit.client.0.smithi017.stdout:3/519: creat d5/da/d27/d6e/fa3 x:0 0 0 2024-08-19T00:56:21.497 INFO:tasks.workunit.client.0.smithi017.stdout:3/520: chown d5/d15/d1b/f39 73 1 2024-08-19T00:56:21.497 INFO:tasks.workunit.client.0.smithi017.stdout:7/580: symlink d3/d3c/d88/lbc 0 2024-08-19T00:56:21.502 INFO:tasks.workunit.client.0.smithi017.stdout:9/469: dwrite d0/f3a [0,4194304] 0 2024-08-19T00:56:21.503 INFO:tasks.workunit.client.0.smithi017.stdout:2/582: creat d2/d7/d10/d3b/d54/fc1 x:0 0 0 2024-08-19T00:56:21.503 INFO:tasks.workunit.client.0.smithi017.stdout:1/449: mknod d4/dc/d3b/d3d/c88 0 2024-08-19T00:56:21.506 INFO:tasks.workunit.client.0.smithi017.stdout:2/583: dread d2/d7/f28 [0,4194304] 0 2024-08-19T00:56:21.509 INFO:tasks.workunit.client.0.smithi017.stdout:2/584: dread d2/d7/d10/d19/d48/f82 [0,4194304] 0 2024-08-19T00:56:21.510 INFO:tasks.workunit.client.0.smithi017.stdout:3/521: mkdir d5/da/d3c/d4f/da4 0 2024-08-19T00:56:21.511 INFO:tasks.workunit.client.0.smithi017.stdout:3/522: write d5/da/d27/f9f [198162,117790] 0 2024-08-19T00:56:21.512 INFO:tasks.workunit.client.0.smithi017.stdout:7/581: unlink d3/dc/df/d3d/ca5 0 2024-08-19T00:56:21.513 INFO:tasks.workunit.client.0.smithi017.stdout:7/582: chown d3/dc/d5f 30 1 2024-08-19T00:56:21.513 INFO:tasks.workunit.client.0.smithi017.stdout:3/523: dread - d5/da/d3c/f93 zero size 2024-08-19T00:56:21.515 INFO:tasks.workunit.client.0.smithi017.stdout:1/450: creat d4/dc/d3b/d55/d6a/f89 x:0 0 0 2024-08-19T00:56:21.517 INFO:tasks.workunit.client.0.smithi017.stdout:1/451: write d4/dc/f42 [538820,49676] 0 2024-08-19T00:56:21.518 INFO:tasks.workunit.client.0.smithi017.stdout:9/470: mknod d0/d33/c89 0 2024-08-19T00:56:21.522 INFO:tasks.workunit.client.0.smithi017.stdout:2/585: symlink d2/d7/d10/d3b/d80/da2/daf/lc2 0 2024-08-19T00:56:21.523 INFO:tasks.workunit.client.0.smithi017.stdout:1/452: creat d4/dc/d3b/d55/d62/f8a x:0 0 0 2024-08-19T00:56:21.525 INFO:tasks.workunit.client.0.smithi017.stdout:1/453: write d4/dc/d3b/f50 [1136285,37946] 0 2024-08-19T00:56:21.525 INFO:tasks.workunit.client.0.smithi017.stdout:7/583: getdents d3/dab 0 2024-08-19T00:56:21.530 INFO:tasks.workunit.client.0.smithi017.stdout:1/454: symlink d4/d1c/d1f/l8b 0 2024-08-19T00:56:21.530 INFO:tasks.workunit.client.0.smithi017.stdout:1/455: readlink d4/dc/d3b/d45/l58 0 2024-08-19T00:56:21.531 INFO:tasks.workunit.client.0.smithi017.stdout:7/584: readlink d3/dc/l7e 0 2024-08-19T00:56:21.532 INFO:tasks.workunit.client.0.smithi017.stdout:1/456: read - d4/dc/d3b/d3d/f86 zero size 2024-08-19T00:56:21.532 INFO:tasks.workunit.client.0.smithi017.stdout:4/558: truncate d2/d1a/d55/f79 4070601 0 2024-08-19T00:56:21.533 INFO:tasks.workunit.client.0.smithi017.stdout:7/585: stat d3/dc/l49 0 2024-08-19T00:56:21.534 INFO:tasks.workunit.client.1.smithi086.stdout:4/973: dwrite d2/d18/d33/d42/d72/d2f/fc1 [0,4194304] 0 2024-08-19T00:56:21.537 INFO:tasks.workunit.client.0.smithi017.stdout:2/586: getdents d2/d7/d10 0 2024-08-19T00:56:21.538 INFO:tasks.workunit.client.0.smithi017.stdout:2/587: chown d2/d7/d10/d19/f41 11562862 1 2024-08-19T00:56:21.539 INFO:tasks.workunit.client.1.smithi086.stdout:4/974: mknod d2/d18/d33/d114/c145 0 2024-08-19T00:56:21.540 INFO:tasks.workunit.client.0.smithi017.stdout:4/559: creat d2/d21/d53/d57/d9d/fc4 x:0 0 0 2024-08-19T00:56:21.542 INFO:tasks.workunit.client.1.smithi086.stdout:4/975: dread d2/d18/d33/d42/d72/d78/f121 [0,4194304] 0 2024-08-19T00:56:21.544 INFO:tasks.workunit.client.1.smithi086.stdout:4/976: write d2/d18/d33/d42/d72/d78/d25/d30/d5d/da2/f134 [579364,106761] 0 2024-08-19T00:56:21.544 INFO:tasks.workunit.client.0.smithi017.stdout:3/524: write d5/da/f3f [2162591,113827] 0 2024-08-19T00:56:21.546 INFO:tasks.workunit.client.0.smithi017.stdout:1/457: getdents d4/dc/d3b/d55/d62 0 2024-08-19T00:56:21.546 INFO:tasks.workunit.client.0.smithi017.stdout:7/586: link d3/dc/f48 d3/dc/df/d37/d46/fbd 0 2024-08-19T00:56:21.548 INFO:tasks.workunit.client.0.smithi017.stdout:1/458: write d4/f10 [522842,40664] 0 2024-08-19T00:56:21.549 INFO:tasks.workunit.client.0.smithi017.stdout:2/588: link d2/d7/d10/d3b/d54/f5b d2/d7/d10/d3b/d3c/fc3 0 2024-08-19T00:56:21.550 INFO:tasks.workunit.client.0.smithi017.stdout:7/587: stat d3/dc/df/d1a/c6b 0 2024-08-19T00:56:21.550 INFO:tasks.workunit.client.1.smithi086.stdout:4/977: dwrite d2/d18/d33/d42/d72/d78/d25/f7e [0,4194304] 0 2024-08-19T00:56:21.550 INFO:tasks.workunit.client.0.smithi017.stdout:9/471: dwrite d0/d58/d49/f76 [0,4194304] 0 2024-08-19T00:56:21.553 INFO:tasks.workunit.client.0.smithi017.stdout:3/525: mknod d5/d15/d1b/ca5 0 2024-08-19T00:56:21.554 INFO:tasks.workunit.client.0.smithi017.stdout:2/589: chown d2/d7/d10/d19/f20 330 1 2024-08-19T00:56:21.556 INFO:tasks.workunit.client.1.smithi086.stdout:4/978: read - d2/d18/d33/d42/d72/d2f/dc4/fd7 zero size 2024-08-19T00:56:21.557 INFO:tasks.workunit.client.0.smithi017.stdout:1/459: creat d4/dc/d3b/d55/d6a/f8c x:0 0 0 2024-08-19T00:56:21.559 INFO:tasks.workunit.client.0.smithi017.stdout:7/588: dread d3/d3c/f43 [0,4194304] 0 2024-08-19T00:56:21.559 INFO:tasks.workunit.client.0.smithi017.stdout:9/472: write d0/d58/d49/f4f [446750,86830] 0 2024-08-19T00:56:21.561 INFO:tasks.workunit.client.0.smithi017.stdout:3/526: chown d5/da/d27/d28/c83 3664 1 2024-08-19T00:56:21.563 INFO:tasks.workunit.client.0.smithi017.stdout:3/527: dread - d5/da/d27/f78 zero size 2024-08-19T00:56:21.566 INFO:tasks.workunit.client.0.smithi017.stdout:7/589: chown d3/dc/df/d23/d6a/db2 1190 1 2024-08-19T00:56:21.567 INFO:tasks.workunit.client.0.smithi017.stdout:1/460: creat d4/dc/d3b/d45/f8d x:0 0 0 2024-08-19T00:56:21.569 INFO:tasks.workunit.client.0.smithi017.stdout:7/590: chown d3/dc/df/d7d/f9b 5410643 1 2024-08-19T00:56:21.569 INFO:tasks.workunit.client.0.smithi017.stdout:3/528: dread d5/d11/f85 [0,4194304] 0 2024-08-19T00:56:21.571 INFO:tasks.workunit.client.0.smithi017.stdout:9/473: dwrite d0/d33/d22/f44 [0,4194304] 0 2024-08-19T00:56:21.572 INFO:tasks.workunit.client.0.smithi017.stdout:3/529: write d5/d15/d1b/f58 [303389,27889] 0 2024-08-19T00:56:21.572 INFO:tasks.workunit.client.0.smithi017.stdout:9/474: write d0/d33/f4d [1582239,2389] 0 2024-08-19T00:56:21.573 INFO:tasks.workunit.client.0.smithi017.stdout:1/461: rename d4/dc/c2f to d4/dc/d17/c8e 0 2024-08-19T00:56:21.575 INFO:tasks.workunit.client.0.smithi017.stdout:1/462: write d4/dc/d19/f41 [7399258,108282] 0 2024-08-19T00:56:21.577 INFO:tasks.workunit.client.0.smithi017.stdout:7/591: getdents d3/dc/df/d23/d8c 0 2024-08-19T00:56:21.578 INFO:tasks.workunit.client.0.smithi017.stdout:9/475: symlink d0/d33/l8a 0 2024-08-19T00:56:21.580 INFO:tasks.workunit.client.0.smithi017.stdout:1/463: read d4/dc/f40 [2383173,99034] 0 2024-08-19T00:56:21.580 INFO:tasks.workunit.client.0.smithi017.stdout:3/530: dwrite d5/da/d27/f4c [0,4194304] 0 2024-08-19T00:56:21.581 INFO:tasks.workunit.client.1.smithi086.stdout:4/979: write d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/f7f [383195,23152] 0 2024-08-19T00:56:21.582 INFO:tasks.workunit.client.0.smithi017.stdout:2/590: write d2/d7/f6a [5226024,63577] 0 2024-08-19T00:56:21.582 INFO:tasks.workunit.client.0.smithi017.stdout:1/464: write d4/fd [2920317,100608] 0 2024-08-19T00:56:21.583 INFO:tasks.workunit.client.0.smithi017.stdout:1/465: stat d4/d1c/d1f 0 2024-08-19T00:56:21.584 INFO:tasks.workunit.client.0.smithi017.stdout:3/531: chown d5/d15/l73 37688048 1 2024-08-19T00:56:21.584 INFO:tasks.workunit.client.1.smithi086.stdout:4/980: symlink d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/l146 0 2024-08-19T00:56:21.587 INFO:tasks.workunit.client.0.smithi017.stdout:3/532: unlink d5/da/l75 0 2024-08-19T00:56:21.588 INFO:tasks.workunit.client.1.smithi086.stdout:4/981: mkdir d2/d123/d147 0 2024-08-19T00:56:21.589 INFO:tasks.workunit.client.0.smithi017.stdout:1/466: mknod d4/dc/d17/d1d/c8f 0 2024-08-19T00:56:21.591 INFO:tasks.workunit.client.0.smithi017.stdout:3/533: symlink d5/da/d3c/la6 0 2024-08-19T00:56:21.592 INFO:tasks.workunit.client.0.smithi017.stdout:2/591: getdents d2/d7/d10/d3b/d80 0 2024-08-19T00:56:21.593 INFO:tasks.workunit.client.1.smithi086.stdout:4/982: mkdir d2/d18/d33/d42/d72/d78/d25/d55/d4d/d148 0 2024-08-19T00:56:21.594 INFO:tasks.workunit.client.1.smithi086.stdout:4/983: readlink d2/d18/d33/d42/d72/d2f/l9f 0 2024-08-19T00:56:21.594 INFO:tasks.workunit.client.0.smithi017.stdout:1/467: mknod d4/dc/d3b/d55/d62/c90 0 2024-08-19T00:56:21.594 INFO:tasks.workunit.client.1.smithi086.stdout:4/984: chown d2/d18/d33/d42/d72/dd0/fda 62926 1 2024-08-19T00:56:21.595 INFO:tasks.workunit.client.0.smithi017.stdout:3/534: write d5/d11/f85 [774826,105606] 0 2024-08-19T00:56:21.596 INFO:tasks.workunit.client.0.smithi017.stdout:2/592: readlink d2/d7/d10/d3b/d80/d81/lb8 0 2024-08-19T00:56:21.600 INFO:tasks.workunit.client.1.smithi086.stdout:4/985: creat d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/dcd/f149 x:0 0 0 2024-08-19T00:56:21.602 INFO:tasks.workunit.client.0.smithi017.stdout:3/535: dwrite d5/da/d27/d28/f98 [0,4194304] 0 2024-08-19T00:56:21.604 INFO:tasks.workunit.client.0.smithi017.stdout:9/476: write d0/d33/d22/d40/f4e [429597,24455] 0 2024-08-19T00:56:21.604 INFO:tasks.workunit.client.1.smithi086.stdout:4/986: dread d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/f7f [0,4194304] 0 2024-08-19T00:56:21.605 INFO:tasks.workunit.client.1.smithi086.stdout:4/987: readlink d2/d18/d33/d42/d72/d2f/dc4/l77 0 2024-08-19T00:56:21.606 INFO:tasks.workunit.client.0.smithi017.stdout:1/468: getdents d4/dc/d3b/d45 0 2024-08-19T00:56:21.606 INFO:tasks.workunit.client.1.smithi086.stdout:4/988: dread - d2/d18/d33/d42/d72/d78/d25/d55/d6c/f13b zero size 2024-08-19T00:56:21.611 INFO:tasks.workunit.client.0.smithi017.stdout:9/477: dread d0/f65 [0,4194304] 0 2024-08-19T00:56:21.615 INFO:tasks.workunit.client.0.smithi017.stdout:3/536: dwrite d5/ff [4194304,4194304] 0 2024-08-19T00:56:21.615 INFO:tasks.workunit.client.1.smithi086.stdout:4/989: symlink d2/d18/d33/d42/d72/d78/de6/l14a 0 2024-08-19T00:56:21.618 INFO:tasks.workunit.client.0.smithi017.stdout:1/469: dwrite d4/d1c/f2a [0,4194304] 0 2024-08-19T00:56:21.619 INFO:tasks.workunit.client.0.smithi017.stdout:9/478: unlink d0/d33/d22/l50 0 2024-08-19T00:56:21.619 INFO:tasks.workunit.client.0.smithi017.stdout:1/470: write d4/dc/d3b/d55/f76 [2820438,47273] 0 2024-08-19T00:56:21.620 INFO:tasks.workunit.client.0.smithi017.stdout:2/593: dread d2/d7/d10/d35/d45/d58/f67 [0,4194304] 0 2024-08-19T00:56:21.622 INFO:tasks.workunit.client.0.smithi017.stdout:2/594: chown d2/d7/d44 1063665693 1 2024-08-19T00:56:21.622 INFO:tasks.workunit.client.0.smithi017.stdout:9/479: symlink d0/d33/d22/d40/l8b 0 2024-08-19T00:56:21.623 INFO:tasks.workunit.client.0.smithi017.stdout:1/471: creat d4/dc/d3b/d45/f91 x:0 0 0 2024-08-19T00:56:21.624 INFO:tasks.workunit.client.0.smithi017.stdout:9/480: fdatasync d0/d33/f29 0 2024-08-19T00:56:21.624 INFO:tasks.workunit.client.0.smithi017.stdout:3/537: read d5/d11/f14 [3883110,91954] 0 2024-08-19T00:56:21.625 INFO:tasks.workunit.client.1.smithi086.stdout:4/990: dread d2/d18/d33/d42/d72/d2f/dc4/d81/d8a/de0/fc3 [0,4194304] 0 2024-08-19T00:56:21.625 INFO:tasks.workunit.client.0.smithi017.stdout:2/595: fdatasync d2/d7/dd/f2a 0 2024-08-19T00:56:21.626 INFO:tasks.workunit.client.0.smithi017.stdout:3/538: chown d5/da/d27/d28/f37 1133241 1 2024-08-19T00:56:21.626 INFO:tasks.workunit.client.0.smithi017.stdout:1/472: rmdir d4/dc/d3b/d3d/d54 39 2024-08-19T00:56:21.627 INFO:tasks.workunit.client.0.smithi017.stdout:1/473: fsync d4/dc/d3b/f50 0 2024-08-19T00:56:21.627 INFO:tasks.workunit.client.0.smithi017.stdout:1/474: stat d4/dc/c61 0 2024-08-19T00:56:21.628 INFO:tasks.workunit.client.1.smithi086.stdout:4/991: write d2/d18/d33/d42/d72/d78/d25/d30/d5d/f79 [414016,90970] 0 2024-08-19T00:56:21.629 INFO:tasks.workunit.client.1.smithi086.stdout:4/992: readlink d2/d18/d33/d42/d72/d78/l95 0 2024-08-19T00:56:21.630 INFO:tasks.workunit.client.0.smithi017.stdout:1/475: creat d4/dc/d3b/d45/f92 x:0 0 0 2024-08-19T00:56:21.635 INFO:tasks.workunit.client.1.smithi086.stdout:4/993: getdents d2/d18/d33/d42/d72/d8f 0 2024-08-19T00:56:21.638 INFO:tasks.workunit.client.0.smithi017.stdout:2/596: dread d2/d7/f21 [0,4194304] 0 2024-08-19T00:56:21.640 INFO:tasks.workunit.client.0.smithi017.stdout:2/597: creat d2/d7/d10/d3b/d80/d81/fc4 x:0 0 0 2024-08-19T00:56:21.647 INFO:tasks.workunit.client.0.smithi017.stdout:3/539: write d5/d15/d1b/f44 [3418277,50409] 0 2024-08-19T00:56:21.648 INFO:tasks.workunit.client.1.smithi086.stdout:4/994: write d2/d18/d33/d42/d72/d2f/fc5 [2127183,77858] 0 2024-08-19T00:56:21.650 INFO:tasks.workunit.client.0.smithi017.stdout:2/598: getdents d2/d7/d10/d3b/d80/d81 0 2024-08-19T00:56:21.650 INFO:tasks.workunit.client.0.smithi017.stdout:3/540: creat d5/da/d27/fa7 x:0 0 0 2024-08-19T00:56:21.654 INFO:tasks.workunit.client.0.smithi017.stdout:3/541: rmdir d5/da/d3c/d4f/da4 0 2024-08-19T00:56:21.657 INFO:tasks.workunit.client.1.smithi086.stdout:4/995: dwrite d2/d18/d33/d42/d72/d78/d9e/fc7 [0,4194304] 0 2024-08-19T00:56:21.660 INFO:tasks.workunit.client.0.smithi017.stdout:3/542: dwrite d5/d11/d61/f76 [0,4194304] 0 2024-08-19T00:56:21.665 INFO:tasks.workunit.client.1.smithi086.stdout:4/996: rename d2/d18/d33/d42/d72/d78/d25/d55/d6c/d7d/d73/c120 to d2/d18/d33/d42/d72/d2f/dc4/d81/c14b 0 2024-08-19T00:56:21.668 INFO:tasks.workunit.client.0.smithi017.stdout:1/476: dread d4/f13 [0,4194304] 0 2024-08-19T00:56:21.673 INFO:tasks.workunit.client.0.smithi017.stdout:3/543: dwrite d5/da/d3c/f93 [0,4194304] 0 2024-08-19T00:56:21.674 INFO:tasks.workunit.client.0.smithi017.stdout:3/544: write d5/da/f3f [3507750,3158] 0 2024-08-19T00:56:21.676 INFO:tasks.workunit.client.0.smithi017.stdout:1/477: link d4/dc/d3b/d3d/c68 d4/dc/d3b/d55/d62/c93 0 2024-08-19T00:56:21.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:21 smithi017 ceph-mon[16627]: pgmap v21: 65 pgs: 65 active+clean; 2.7 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 85 MiB/s rd, 234 MiB/s wr, 429 op/s 2024-08-19T00:56:21.683 INFO:tasks.workunit.client.1.smithi086.stdout:4/997: dwrite d2/d18/d33/d42/d72/d78/d25/d55/f4a [4194304,4194304] 0 2024-08-19T00:56:21.688 INFO:tasks.workunit.client.1.smithi086.stdout:4/998: creat d2/d18/d33/d42/d72/d78/d25/f14c x:0 0 0 2024-08-19T00:56:21.689 INFO:tasks.workunit.client.1.smithi086.stdout:4/999: stat d2/d18/d33/d42/d72/d2f/dc4/d81/ce9 0 2024-08-19T00:56:21.692 INFO:tasks.workunit.client.1.smithi086.stderr:+ rm -rf -- ./tmp.g6vnd3v2ps 2024-08-19T00:56:21.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:21 smithi086 ceph-mon[24511]: pgmap v21: 65 pgs: 65 active+clean; 2.7 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail; 85 MiB/s rd, 234 MiB/s wr, 429 op/s 2024-08-19T00:56:21.703 INFO:tasks.workunit.client.0.smithi017.stdout:3/545: truncate d5/da/d27/d28/f80 524944 0 2024-08-19T00:56:21.704 INFO:tasks.workunit.client.0.smithi017.stdout:3/546: creat d5/d15/d92/fa8 x:0 0 0 2024-08-19T00:56:21.709 INFO:tasks.workunit.client.0.smithi017.stdout:1/478: dread d4/dc/d17/d1d/f5b [0,4194304] 0 2024-08-19T00:56:21.710 INFO:tasks.workunit.client.0.smithi017.stdout:3/547: dwrite d5/da/d27/fa7 [0,4194304] 0 2024-08-19T00:56:21.712 INFO:tasks.workunit.client.0.smithi017.stdout:3/548: rename d5/da/d3c to d5/da/d3c/d4f/da9 22 2024-08-19T00:56:21.712 INFO:tasks.workunit.client.0.smithi017.stdout:1/479: rmdir d4/d1c/d1f 39 2024-08-19T00:56:21.714 INFO:tasks.workunit.client.0.smithi017.stdout:3/549: creat d5/d18/faa x:0 0 0 2024-08-19T00:56:21.719 INFO:tasks.workunit.client.0.smithi017.stdout:3/550: mkdir d5/d18/dab 0 2024-08-19T00:56:21.720 INFO:tasks.workunit.client.0.smithi017.stdout:1/480: creat d4/d1c/d1f/f94 x:0 0 0 2024-08-19T00:56:21.723 INFO:tasks.workunit.client.0.smithi017.stdout:3/551: creat d5/d11/d61/fac x:0 0 0 2024-08-19T00:56:21.723 INFO:tasks.workunit.client.0.smithi017.stdout:3/552: stat d5/d11 0 2024-08-19T00:56:21.727 INFO:tasks.workunit.client.0.smithi017.stdout:1/481: dwrite d4/d1c/f46 [4194304,4194304] 0 2024-08-19T00:56:21.750 INFO:tasks.workunit.client.0.smithi017.stdout:1/482: dread d4/f13 [8388608,4194304] 0 2024-08-19T00:56:21.751 INFO:tasks.workunit.client.0.smithi017.stdout:1/483: write d4/dc/d3b/d45/f4d [514946,73760] 0 2024-08-19T00:56:21.752 INFO:tasks.workunit.client.0.smithi017.stdout:1/484: truncate d4/dc/f42 1487382 0 2024-08-19T00:56:21.863 INFO:tasks.workunit.client.0.smithi017.stdout:1/485: write d4/dc/f40 [7963895,45065] 0 2024-08-19T00:56:21.863 INFO:tasks.workunit.client.0.smithi017.stdout:3/553: getdents d5/d15/d1b 0 2024-08-19T00:56:21.865 INFO:tasks.workunit.client.0.smithi017.stdout:3/554: mknod d5/d11/cad 0 2024-08-19T00:56:21.866 INFO:tasks.workunit.client.0.smithi017.stdout:3/555: read - d5/d15/d1b/f7b zero size 2024-08-19T00:56:21.867 INFO:tasks.workunit.client.0.smithi017.stdout:1/486: mkdir d4/dc/d3b/d3d/d83/d95 0 2024-08-19T00:56:21.867 INFO:tasks.workunit.client.0.smithi017.stdout:1/487: fsync d4/f60 0 2024-08-19T00:56:21.868 INFO:tasks.workunit.client.0.smithi017.stdout:1/488: write d4/dc/d3b/d55/f76 [3494515,116873] 0 2024-08-19T00:56:21.873 INFO:tasks.workunit.client.0.smithi017.stdout:1/489: dread d4/dc/f42 [0,4194304] 0 2024-08-19T00:56:21.885 INFO:tasks.workunit.client.0.smithi017.stdout:1/490: write d4/dc/f11 [1210114,49017] 0 2024-08-19T00:56:21.887 INFO:tasks.workunit.client.0.smithi017.stdout:1/491: stat d4/dc/d3b/d3d/d54/f67 0 2024-08-19T00:56:21.890 INFO:tasks.workunit.client.0.smithi017.stdout:1/492: creat d4/dc/d3b/d55/d62/f96 x:0 0 0 2024-08-19T00:56:21.893 INFO:tasks.workunit.client.0.smithi017.stdout:1/493: mknod d4/d1c/d75/c97 0 2024-08-19T00:56:21.899 INFO:tasks.workunit.client.0.smithi017.stdout:1/494: dwrite d4/dc/f40 [4194304,4194304] 0 2024-08-19T00:56:21.901 INFO:tasks.workunit.client.0.smithi017.stdout:1/495: write d4/dc/d19/f79 [1391847,75209] 0 2024-08-19T00:56:21.903 INFO:tasks.workunit.client.0.smithi017.stdout:1/496: stat d4/dc/d3b/d3d/d83/d95 0 2024-08-19T00:56:21.907 INFO:tasks.workunit.client.0.smithi017.stdout:1/497: symlink d4/d78/l98 0 2024-08-19T00:56:21.909 INFO:tasks.workunit.client.0.smithi017.stdout:1/498: chown d4/dc/d3b/d3d/c68 396910 1 2024-08-19T00:56:21.915 INFO:tasks.workunit.client.0.smithi017.stdout:1/499: dwrite d4/dc/d3b/d3d/d54/f67 [0,4194304] 0 2024-08-19T00:56:21.918 INFO:tasks.workunit.client.0.smithi017.stdout:1/500: stat d4/d1c/f32 0 2024-08-19T00:56:21.925 INFO:tasks.workunit.client.0.smithi017.stdout:1/501: dwrite d4/dc/d3b/d45/f8d [0,4194304] 0 2024-08-19T00:56:21.927 INFO:tasks.workunit.client.0.smithi017.stdout:1/502: write d4/d1c/f2a [3171830,55307] 0 2024-08-19T00:56:21.927 INFO:tasks.workunit.client.0.smithi017.stdout:1/503: chown d4/d78 39 1 2024-08-19T00:56:21.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/504: fdatasync d4/dc/d3b/f50 0 2024-08-19T00:56:21.930 INFO:tasks.workunit.client.0.smithi017.stdout:1/505: creat d4/d1c/d1f/f99 x:0 0 0 2024-08-19T00:56:21.935 INFO:tasks.workunit.client.0.smithi017.stdout:1/506: link d4/d1c/d1f/l8b d4/dc/d3b/d45/l9a 0 2024-08-19T00:56:21.937 INFO:tasks.workunit.client.0.smithi017.stdout:1/507: dread d4/dc/d17/d1d/f65 [0,4194304] 0 2024-08-19T00:56:21.938 INFO:tasks.workunit.client.0.smithi017.stdout:1/508: chown d4/dc/f42 12 1 2024-08-19T00:56:21.946 INFO:tasks.workunit.client.0.smithi017.stdout:1/509: dwrite d4/dc/d17/d1d/f5b [4194304,4194304] 0 2024-08-19T00:56:21.947 INFO:tasks.workunit.client.0.smithi017.stdout:1/510: fsync d4/dc/d3b/d3d/f87 0 2024-08-19T00:56:21.951 INFO:tasks.workunit.client.0.smithi017.stdout:1/511: mknod d4/d1c/c9b 0 2024-08-19T00:56:21.954 INFO:tasks.workunit.client.0.smithi017.stdout:1/512: mkdir d4/d1c/d75/d9c 0 2024-08-19T00:56:21.957 INFO:tasks.workunit.client.0.smithi017.stdout:1/513: readlink d4/d1c/d1f/l8b 0 2024-08-19T00:56:21.962 INFO:tasks.workunit.client.0.smithi017.stdout:1/514: rename d4/dc/d3b/d55/d6a to d4/dc/d3b/d9d 0 2024-08-19T00:56:21.971 INFO:tasks.workunit.client.0.smithi017.stdout:1/515: getdents d4/dc/d17/d1d 0 2024-08-19T00:56:21.973 INFO:tasks.workunit.client.0.smithi017.stdout:1/516: write d4/dc/d3b/d9d/f89 [675646,5329] 0 2024-08-19T00:56:21.980 INFO:tasks.workunit.client.0.smithi017.stdout:1/517: write d4/dc/d17/d1d/f65 [511400,68327] 0 2024-08-19T00:56:21.982 INFO:tasks.workunit.client.0.smithi017.stdout:1/518: truncate d4/dc/f38 301398 0 2024-08-19T00:56:21.984 INFO:tasks.workunit.client.0.smithi017.stdout:1/519: symlink d4/dc/d3b/d9d/l9e 0 2024-08-19T00:56:21.986 INFO:tasks.workunit.client.0.smithi017.stdout:1/520: unlink d4/dc/d19/l7c 0 2024-08-19T00:56:21.987 INFO:tasks.workunit.client.0.smithi017.stdout:1/521: dread - d4/f60 zero size 2024-08-19T00:56:21.987 INFO:tasks.workunit.client.0.smithi017.stdout:1/522: write d4/dc/d19/f53 [4422006,21878] 0 2024-08-19T00:56:21.990 INFO:tasks.workunit.client.0.smithi017.stdout:8/431: sync 2024-08-19T00:56:21.994 INFO:tasks.workunit.client.0.smithi017.stdout:8/432: rename de/f12 to de/d36/f7b 0 2024-08-19T00:56:21.997 INFO:tasks.workunit.client.0.smithi017.stdout:8/433: readlink de/d36/l7a 0 2024-08-19T00:56:21.998 INFO:tasks.workunit.client.0.smithi017.stdout:1/523: truncate d4/dc/d19/f53 1216933 0 2024-08-19T00:56:21.999 INFO:tasks.workunit.client.0.smithi017.stdout:1/524: chown d4/dc/d3b/d3d/d83/d95 1 1 2024-08-19T00:56:22.002 INFO:tasks.workunit.client.0.smithi017.stdout:8/434: write de/d15/d39/f78 [2497475,4906] 0 2024-08-19T00:56:22.002 INFO:tasks.workunit.client.0.smithi017.stdout:1/525: rmdir d4/dc/d17 39 2024-08-19T00:56:22.003 INFO:tasks.workunit.client.0.smithi017.stdout:1/526: readlink d4/dc/d3b/d45/l58 0 2024-08-19T00:56:22.004 INFO:tasks.workunit.client.0.smithi017.stdout:1/527: chown d4/dc/d3b/d3d/d83/d95 13 1 2024-08-19T00:56:22.007 INFO:tasks.workunit.client.0.smithi017.stdout:1/528: symlink d4/d1c/d75/l9f 0 2024-08-19T00:56:22.018 INFO:tasks.workunit.client.0.smithi017.stdout:1/529: dread d4/f14 [0,4194304] 0 2024-08-19T00:56:22.021 INFO:tasks.workunit.client.0.smithi017.stdout:1/530: creat d4/d1c/d75/d9c/fa0 x:0 0 0 2024-08-19T00:56:22.024 INFO:tasks.workunit.client.0.smithi017.stdout:1/531: dread d4/dc/f42 [0,4194304] 0 2024-08-19T00:56:22.025 INFO:tasks.workunit.client.0.smithi017.stdout:1/532: chown d4/l5 352 1 2024-08-19T00:56:22.028 INFO:tasks.workunit.client.0.smithi017.stdout:1/533: rename d4/dc/d3b/d45/l58 to d4/dc/d3b/d3d/d83/la1 0 2024-08-19T00:56:22.033 INFO:tasks.workunit.client.0.smithi017.stdout:1/534: dwrite d4/f14 [0,4194304] 0 2024-08-19T00:56:22.037 INFO:tasks.workunit.client.0.smithi017.stdout:1/535: mknod d4/dc/d3b/d55/ca2 0 2024-08-19T00:56:22.047 INFO:tasks.workunit.client.0.smithi017.stdout:1/536: write d4/d1c/f32 [1162727,91811] 0 2024-08-19T00:56:22.047 INFO:tasks.workunit.client.0.smithi017.stdout:1/537: readlink d4/d1c/l5d 0 2024-08-19T00:56:22.055 INFO:tasks.workunit.client.0.smithi017.stdout:1/538: truncate d4/dc/f11 2024453 0 2024-08-19T00:56:22.057 INFO:tasks.workunit.client.0.smithi017.stdout:1/539: stat d4/dc/d17/d1d/f3c 0 2024-08-19T00:56:22.074 INFO:tasks.workunit.client.0.smithi017.stdout:1/540: dread d4/dc/d3b/d3d/f7d [0,4194304] 0 2024-08-19T00:56:22.075 INFO:tasks.workunit.client.0.smithi017.stdout:1/541: read - d4/dc/d3b/d3d/f87 zero size 2024-08-19T00:56:22.080 INFO:tasks.workunit.client.0.smithi017.stdout:1/542: unlink d4/dc/f34 0 2024-08-19T00:56:22.081 INFO:tasks.workunit.client.0.smithi017.stdout:1/543: write d4/dc/d17/d1d/f1e [609357,42149] 0 2024-08-19T00:56:22.091 INFO:tasks.workunit.client.0.smithi017.stdout:1/544: rename d4/dc/d19/c43 to d4/dc/d17/ca3 0 2024-08-19T00:56:22.093 INFO:tasks.workunit.client.0.smithi017.stdout:1/545: mkdir d4/dc/d3b/d3d/d54/da4 0 2024-08-19T00:56:22.096 INFO:tasks.workunit.client.0.smithi017.stdout:1/546: dread d4/dc/d3b/d3d/f7d [0,4194304] 0 2024-08-19T00:56:22.097 INFO:tasks.workunit.client.0.smithi017.stdout:1/547: chown d4/dc/d3b/f50 523451 1 2024-08-19T00:56:22.106 INFO:tasks.workunit.client.0.smithi017.stdout:1/548: dread d4/dc/d19/f41 [4194304,4194304] 0 2024-08-19T00:56:22.108 INFO:tasks.workunit.client.0.smithi017.stdout:1/549: mkdir d4/d1c/d1f/da5 0 2024-08-19T00:56:22.111 INFO:tasks.workunit.client.0.smithi017.stdout:1/550: mkdir d4/dc/d3b/d3d/d54/da4/da6 0 2024-08-19T00:56:22.112 INFO:tasks.workunit.client.0.smithi017.stdout:1/551: rename d4/dc to d4/dc/d3b/d3d/d83/da7 22 2024-08-19T00:56:22.117 INFO:tasks.workunit.client.0.smithi017.stdout:1/552: dwrite d4/f13 [4194304,4194304] 0 2024-08-19T00:56:22.126 INFO:tasks.workunit.client.0.smithi017.stdout:1/553: rename d4/dc/d3b/d55 to d4/dc/d3b/d3d/da8 0 2024-08-19T00:56:22.142 INFO:tasks.workunit.client.0.smithi017.stdout:6/505: sync 2024-08-19T00:56:22.143 INFO:tasks.workunit.client.0.smithi017.stdout:5/360: sync 2024-08-19T00:56:22.146 INFO:tasks.workunit.client.0.smithi017.stdout:6/506: rename d5/d13/d20/f3c to d5/d13/d11/d52/fb2 0 2024-08-19T00:56:22.147 INFO:tasks.workunit.client.0.smithi017.stdout:1/554: dread d4/dc/d3b/f4a [0,4194304] 0 2024-08-19T00:56:22.148 INFO:tasks.workunit.client.0.smithi017.stdout:5/361: mknod db/d19/c81 0 2024-08-19T00:56:22.151 INFO:tasks.workunit.client.0.smithi017.stdout:6/507: fdatasync d5/d13/d11/d52/f94 0 2024-08-19T00:56:22.152 INFO:tasks.workunit.client.0.smithi017.stdout:1/555: rmdir d4/dc/d3b/d45 39 2024-08-19T00:56:22.156 INFO:tasks.workunit.client.0.smithi017.stdout:5/362: fdatasync fa 0 2024-08-19T00:56:22.157 INFO:tasks.workunit.client.0.smithi017.stdout:1/556: symlink d4/dc/d3b/d3d/la9 0 2024-08-19T00:56:22.159 INFO:tasks.workunit.client.0.smithi017.stdout:5/363: rename db/d19/d1f/d15/d3e/l4c to db/d19/d1f/d15/d3e/d40/l82 0 2024-08-19T00:56:22.160 INFO:tasks.workunit.client.0.smithi017.stdout:1/557: chown d4/dc/c15 3432 1 2024-08-19T00:56:22.161 INFO:tasks.workunit.client.0.smithi017.stdout:5/364: rmdir db 39 2024-08-19T00:56:22.164 INFO:tasks.workunit.client.0.smithi017.stdout:1/558: symlink d4/dc/d17/d1d/laa 0 2024-08-19T00:56:22.164 INFO:tasks.workunit.client.0.smithi017.stdout:5/365: unlink db/c22 0 2024-08-19T00:56:22.242 INFO:tasks.workunit.client.0.smithi017.stdout:6/508: write d5/d13/d11/d4d/f5b [570778,121482] 0 2024-08-19T00:56:22.244 INFO:tasks.workunit.client.0.smithi017.stdout:6/509: mknod d5/d13/d20/d5e/d8f/cb3 0 2024-08-19T00:56:22.245 INFO:tasks.workunit.client.0.smithi017.stdout:1/559: truncate d4/dc/f40 3787559 0 2024-08-19T00:56:22.246 INFO:tasks.workunit.client.0.smithi017.stdout:6/510: dread - d5/d13/d11/d2c/d51/f84 zero size 2024-08-19T00:56:22.247 INFO:tasks.workunit.client.0.smithi017.stdout:1/560: readlink d4/dc/l6c 0 2024-08-19T00:56:22.249 INFO:tasks.workunit.client.0.smithi017.stdout:5/366: dread db/f56 [0,4194304] 0 2024-08-19T00:56:22.249 INFO:tasks.workunit.client.0.smithi017.stdout:5/367: fdatasync db/f10 0 2024-08-19T00:56:22.252 INFO:tasks.workunit.client.0.smithi017.stdout:5/368: dread - db/d19/d1f/d15/d3e/f6f zero size 2024-08-19T00:56:22.252 INFO:tasks.workunit.client.0.smithi017.stdout:6/511: link d5/d13/f1f d5/d13/d11/d2c/d4a/da8/fb4 0 2024-08-19T00:56:22.254 INFO:tasks.workunit.client.0.smithi017.stdout:6/512: fdatasync d5/f42 0 2024-08-19T00:56:22.255 INFO:tasks.workunit.client.0.smithi017.stdout:1/561: dwrite d4/dc/d19/f41 [4194304,4194304] 0 2024-08-19T00:56:22.256 INFO:tasks.workunit.client.0.smithi017.stdout:5/369: mkdir db/d19/d1f/d15/d3e/d40/d83 0 2024-08-19T00:56:22.265 INFO:tasks.workunit.client.0.smithi017.stdout:1/562: dwrite d4/dc/d3b/d3d/da8/d62/f8a [0,4194304] 0 2024-08-19T00:56:22.266 INFO:tasks.workunit.client.0.smithi017.stdout:5/370: creat db/d19/d1f/d15/d3e/d40/f84 x:0 0 0 2024-08-19T00:56:22.271 INFO:tasks.workunit.client.0.smithi017.stdout:5/371: creat db/d19/d57/f85 x:0 0 0 2024-08-19T00:56:22.273 INFO:tasks.workunit.client.0.smithi017.stdout:1/563: symlink d4/d1c/lab 0 2024-08-19T00:56:22.274 INFO:tasks.workunit.client.0.smithi017.stdout:6/513: write d5/d13/d11/d2c/f46 [4337551,89019] 0 2024-08-19T00:56:22.276 INFO:tasks.workunit.client.0.smithi017.stdout:7/592: sync 2024-08-19T00:56:22.276 INFO:tasks.workunit.client.0.smithi017.stdout:0/515: sync 2024-08-19T00:56:22.276 INFO:tasks.workunit.client.0.smithi017.stdout:4/560: sync 2024-08-19T00:56:22.279 INFO:tasks.workunit.client.0.smithi017.stdout:5/372: rename db/d19/d1f/d15/d30/f75 to db/d19/d1f/d15/d3e/d40/d49/f86 0 2024-08-19T00:56:22.284 INFO:tasks.workunit.client.0.smithi017.stdout:7/593: dwrite d3/dc/df/d1c/d2c/d83/f86 [0,4194304] 0 2024-08-19T00:56:22.292 INFO:tasks.workunit.client.0.smithi017.stdout:6/514: symlink d5/lb5 0 2024-08-19T00:56:22.300 INFO:tasks.workunit.client.0.smithi017.stdout:4/561: dread d2/d11/f72 [0,4194304] 0 2024-08-19T00:56:22.303 INFO:tasks.workunit.client.0.smithi017.stdout:1/564: link d4/dc/f11 d4/dc/d19/fac 0 2024-08-19T00:56:22.306 INFO:tasks.workunit.client.0.smithi017.stdout:4/562: creat d2/d21/d53/d57/d9d/fc5 x:0 0 0 2024-08-19T00:56:22.306 INFO:tasks.workunit.client.0.smithi017.stdout:0/516: dwrite d5/d17/f22 [0,4194304] 0 2024-08-19T00:56:22.306 INFO:tasks.workunit.client.0.smithi017.stdout:5/373: link db/d19/d33/f53 db/d19/d1f/d15/d3e/d40/d49/d63/d80/f87 0 2024-08-19T00:56:22.309 INFO:tasks.workunit.client.0.smithi017.stdout:6/515: write d5/d13/d20/d5e/f75 [3414077,105851] 0 2024-08-19T00:56:22.310 INFO:tasks.workunit.client.0.smithi017.stdout:7/594: creat d3/dc/df/d23/fbe x:0 0 0 2024-08-19T00:56:22.311 INFO:tasks.workunit.client.0.smithi017.stdout:7/595: fdatasync d3/dc/df/d23/f24 0 2024-08-19T00:56:22.313 INFO:tasks.workunit.client.0.smithi017.stdout:7/596: chown d3/dc/df/d3d/d90/l62 4 1 2024-08-19T00:56:22.315 INFO:tasks.workunit.client.0.smithi017.stdout:4/563: mkdir d2/d11/d24/dc6 0 2024-08-19T00:56:22.321 INFO:tasks.workunit.client.0.smithi017.stdout:5/374: rename db/d19/d1f/d15/d30/f41 to db/d19/d1f/d15/d1e/f88 0 2024-08-19T00:56:22.321 INFO:tasks.workunit.client.0.smithi017.stdout:4/564: dwrite d2/d16/f6f [0,4194304] 0 2024-08-19T00:56:22.324 INFO:tasks.workunit.client.0.smithi017.stdout:6/516: mknod d5/d13/d20/d5e/cb6 0 2024-08-19T00:56:22.331 INFO:tasks.workunit.client.0.smithi017.stdout:5/375: dwrite db/d19/d1f/d15/d3e/f6f [0,4194304] 0 2024-08-19T00:56:22.337 INFO:tasks.workunit.client.0.smithi017.stdout:7/597: dread d3/dc/df/d37/d46/fbd [0,4194304] 0 2024-08-19T00:56:22.347 INFO:tasks.workunit.client.0.smithi017.stdout:1/565: truncate d4/dc/d3b/d3d/da8/f76 1739386 0 2024-08-19T00:56:22.349 INFO:tasks.workunit.client.0.smithi017.stdout:5/376: creat db/d19/d1f/d15/f89 x:0 0 0 2024-08-19T00:56:22.351 INFO:tasks.workunit.client.0.smithi017.stdout:0/517: link d5/d17/d21/d42/l3c d5/d17/d45/laf 0 2024-08-19T00:56:22.352 INFO:tasks.workunit.client.0.smithi017.stdout:4/565: dread d2/d16/f22 [4194304,4194304] 0 2024-08-19T00:56:22.352 INFO:tasks.workunit.client.0.smithi017.stdout:7/598: rmdir d3/dc/df/d23/d8c 0 2024-08-19T00:56:22.353 INFO:tasks.workunit.client.0.smithi017.stdout:9/481: sync 2024-08-19T00:56:22.357 INFO:tasks.workunit.client.0.smithi017.stdout:1/566: mkdir d4/dc/d17/dad 0 2024-08-19T00:56:22.360 INFO:tasks.workunit.client.0.smithi017.stdout:6/517: dread d5/f36 [0,4194304] 0 2024-08-19T00:56:22.360 INFO:tasks.workunit.client.0.smithi017.stdout:0/518: fdatasync d5/d17/d21/d39/f44 0 2024-08-19T00:56:22.363 INFO:tasks.workunit.client.0.smithi017.stdout:1/567: creat d4/dc/d3b/d3d/da8/fae x:0 0 0 2024-08-19T00:56:22.364 INFO:tasks.workunit.client.0.smithi017.stdout:0/519: dread d5/d17/d2b/f74 [0,4194304] 0 2024-08-19T00:56:22.367 INFO:tasks.workunit.client.0.smithi017.stdout:6/518: symlink d5/d13/d11/d4d/lb7 0 2024-08-19T00:56:22.370 INFO:tasks.workunit.client.0.smithi017.stdout:0/520: dread d5/d17/d21/d39/f44 [0,4194304] 0 2024-08-19T00:56:22.373 INFO:tasks.workunit.client.0.smithi017.stdout:5/377: rename db/d19/d1f/f50 to db/d19/d1f/d15/f8a 0 2024-08-19T00:56:22.375 INFO:tasks.workunit.client.0.smithi017.stdout:7/599: truncate d3/dc/df/d1c/f3e 5457322 0 2024-08-19T00:56:22.376 INFO:tasks.workunit.client.0.smithi017.stdout:6/519: creat d5/d13/d11/d52/fb8 x:0 0 0 2024-08-19T00:56:22.377 INFO:tasks.workunit.client.0.smithi017.stdout:6/520: write d5/d13/d11/d2c/d51/fa3 [102306,125198] 0 2024-08-19T00:56:22.379 INFO:tasks.workunit.client.0.smithi017.stdout:5/378: chown db/ff 2 1 2024-08-19T00:56:22.383 INFO:tasks.workunit.client.0.smithi017.stdout:9/482: rename d0/d33/l21 to d0/d33/d22/d40/l8c 0 2024-08-19T00:56:22.385 INFO:tasks.workunit.client.0.smithi017.stdout:1/568: fdatasync d4/dc/d3b/d3d/da8/f76 0 2024-08-19T00:56:22.389 INFO:tasks.workunit.client.0.smithi017.stdout:6/521: dwrite d5/d13/d11/f59 [4194304,4194304] 0 2024-08-19T00:56:22.389 INFO:tasks.workunit.client.0.smithi017.stdout:7/600: symlink d3/dc/df/lbf 0 2024-08-19T00:56:22.391 INFO:tasks.workunit.client.0.smithi017.stdout:7/601: write d3/dc/df/d37/fac [90312,40575] 0 2024-08-19T00:56:22.396 INFO:tasks.workunit.client.0.smithi017.stdout:2/599: sync 2024-08-19T00:56:22.396 INFO:tasks.workunit.client.0.smithi017.stdout:3/556: sync 2024-08-19T00:56:22.396 INFO:tasks.workunit.client.0.smithi017.stdout:8/435: sync 2024-08-19T00:56:22.396 INFO:tasks.workunit.client.0.smithi017.stdout:9/483: rmdir d0/d33 39 2024-08-19T00:56:22.397 INFO:tasks.workunit.client.0.smithi017.stdout:5/379: write db/d19/d1f/d15/d1e/f3f [115914,58840] 0 2024-08-19T00:56:22.399 INFO:tasks.workunit.client.0.smithi017.stdout:3/557: truncate d5/ff 9005117 0 2024-08-19T00:56:22.400 INFO:tasks.workunit.client.0.smithi017.stdout:3/558: write d5/da/f2b [3752539,38549] 0 2024-08-19T00:56:22.403 INFO:tasks.workunit.client.0.smithi017.stdout:7/602: creat d3/d3c/d88/fc0 x:0 0 0 2024-08-19T00:56:22.406 INFO:tasks.workunit.client.0.smithi017.stdout:4/566: rename d2/d1a/d55/d64/c7a to d2/d21/d53/cc7 0 2024-08-19T00:56:22.412 INFO:tasks.workunit.client.0.smithi017.stdout:1/569: mknod d4/dc/d17/dad/caf 0 2024-08-19T00:56:22.413 INFO:tasks.workunit.client.0.smithi017.stdout:5/380: fsync db/d19/d1f/d15/d1e/f37 0 2024-08-19T00:56:22.415 INFO:tasks.workunit.client.0.smithi017.stdout:6/522: mknod d5/d13/d11/d2c/d4a/cb9 0 2024-08-19T00:56:22.416 INFO:tasks.workunit.client.0.smithi017.stdout:7/603: rmdir d3/dc/df/d1c/d2c 39 2024-08-19T00:56:22.419 INFO:tasks.workunit.client.0.smithi017.stdout:0/521: rename d5/d17/d26/d30/da3 to d5/d17/d26/d30/d5d/db0 0 2024-08-19T00:56:22.419 INFO:tasks.workunit.client.0.smithi017.stdout:6/523: dread d5/d13/d11/d2c/d4a/da8/fb4 [4194304,4194304] 0 2024-08-19T00:56:22.421 INFO:tasks.workunit.client.0.smithi017.stdout:6/524: readlink d5/d13/d11/l61 0 2024-08-19T00:56:22.421 INFO:tasks.workunit.client.0.smithi017.stdout:2/600: dread d2/d7/dd/f15 [0,4194304] 0 2024-08-19T00:56:22.427 INFO:tasks.workunit.client.0.smithi017.stdout:0/522: dwrite d5/d17/d45/f8f [0,4194304] 0 2024-08-19T00:56:22.428 INFO:tasks.workunit.client.0.smithi017.stdout:7/604: creat d3/dc/df/d1a/fc1 x:0 0 0 2024-08-19T00:56:22.429 INFO:tasks.workunit.client.0.smithi017.stdout:4/567: write d2/d1a/d20/f8c [759869,43695] 0 2024-08-19T00:56:22.431 INFO:tasks.workunit.client.0.smithi017.stdout:9/484: truncate d0/f65 1042145 0 2024-08-19T00:56:22.434 INFO:tasks.workunit.client.0.smithi017.stdout:8/436: link de/d15/l1c de/d15/d79/l7c 0 2024-08-19T00:56:22.437 INFO:tasks.workunit.client.0.smithi017.stdout:3/559: creat d5/da/d3c/fae x:0 0 0 2024-08-19T00:56:22.438 INFO:tasks.workunit.client.0.smithi017.stdout:3/560: chown d5/da/f48 11494 1 2024-08-19T00:56:22.439 INFO:tasks.workunit.client.0.smithi017.stdout:6/525: mkdir d5/d13/d11/d2c/d4a/d64/d86/d90/dba 0 2024-08-19T00:56:22.440 INFO:tasks.workunit.client.0.smithi017.stdout:0/523: fsync d5/d17/f1a 0 2024-08-19T00:56:22.450 INFO:tasks.workunit.client.0.smithi017.stdout:3/561: mknod d5/da/d3c/d4f/d68/caf 0 2024-08-19T00:56:22.451 INFO:tasks.workunit.client.0.smithi017.stdout:6/526: unlink d5/d13/d11/d4d/f4e 0 2024-08-19T00:56:22.454 INFO:tasks.workunit.client.0.smithi017.stdout:7/605: mknod d3/dc/df/d37/d46/d73/d80/d81/cc2 0 2024-08-19T00:56:22.455 INFO:tasks.workunit.client.0.smithi017.stdout:7/606: write d3/dc/df/d37/d46/f9d [895745,11679] 0 2024-08-19T00:56:22.456 INFO:tasks.workunit.client.0.smithi017.stdout:1/570: rename d4/dc/d3b/d3d/d54/f67 to d4/dc/d3b/fb0 0 2024-08-19T00:56:22.457 INFO:tasks.workunit.client.0.smithi017.stdout:9/485: symlink d0/d33/d22/d5e/l8d 0 2024-08-19T00:56:22.457 INFO:tasks.workunit.client.0.smithi017.stdout:1/571: write d4/f10 [1716407,9451] 0 2024-08-19T00:56:22.460 INFO:tasks.workunit.client.0.smithi017.stdout:3/562: mknod d5/d11/cb0 0 2024-08-19T00:56:22.460 INFO:tasks.workunit.client.0.smithi017.stdout:3/563: readlink d5/da/d27/l9a 0 2024-08-19T00:56:22.461 INFO:tasks.workunit.client.0.smithi017.stdout:5/381: link db/d19/d33/c4d db/d19/d1f/d15/c8b 0 2024-08-19T00:56:22.462 INFO:tasks.workunit.client.0.smithi017.stdout:0/524: creat d5/da4/fb1 x:0 0 0 2024-08-19T00:56:22.466 INFO:tasks.workunit.client.0.smithi017.stdout:4/568: rename d2/d1a/d20/f54 to d2/dc1/fc8 0 2024-08-19T00:56:22.467 INFO:tasks.workunit.client.0.smithi017.stdout:2/601: getdents d2/d7/d10/d35/d55 0 2024-08-19T00:56:22.467 INFO:tasks.workunit.client.0.smithi017.stdout:4/569: stat d2/d21/d40/d56/d99 0 2024-08-19T00:56:22.468 INFO:tasks.workunit.client.0.smithi017.stdout:4/570: fsync d2/d11/d24/f2e 0 2024-08-19T00:56:22.471 INFO:tasks.workunit.client.0.smithi017.stdout:1/572: truncate d4/dc/d3b/d45/f91 384176 0 2024-08-19T00:56:22.471 INFO:tasks.workunit.client.0.smithi017.stdout:1/573: stat d4/dc 0 2024-08-19T00:56:22.471 INFO:tasks.workunit.client.0.smithi017.stdout:8/437: link de/d15/d79/c42 de/d15/d62/c7d 0 2024-08-19T00:56:22.473 INFO:tasks.workunit.client.0.smithi017.stdout:3/564: creat d5/da/d27/d6e/fb1 x:0 0 0 2024-08-19T00:56:22.476 INFO:tasks.workunit.client.0.smithi017.stdout:5/382: unlink db/d19/d1f/d15/d1e/c35 0 2024-08-19T00:56:22.481 INFO:tasks.workunit.client.0.smithi017.stdout:0/525: stat d5/d17/l92 0 2024-08-19T00:56:22.483 INFO:tasks.workunit.client.0.smithi017.stdout:8/438: dwrite de/d15/d79/f67 [0,4194304] 0 2024-08-19T00:56:22.485 INFO:tasks.workunit.client.0.smithi017.stdout:5/383: chown db/d19/d1f/d15/d30/l58 22032 1 2024-08-19T00:56:22.513 INFO:tasks.workunit.client.0.smithi017.stdout:4/571: dwrite d2/d21/d40/f6c [0,4194304] 0 2024-08-19T00:56:22.526 INFO:tasks.workunit.client.0.smithi017.stdout:8/439: write de/d15/d39/d3d/f4b [7990622,10059] 0 2024-08-19T00:56:22.527 INFO:tasks.workunit.client.0.smithi017.stdout:6/527: rename d5/d13/d11/c21 to d5/d13/d20/d5e/d95/cbb 0 2024-08-19T00:56:22.528 INFO:tasks.workunit.client.0.smithi017.stdout:8/440: write de/d36/f58 [451899,74604] 0 2024-08-19T00:56:22.528 INFO:tasks.workunit.client.0.smithi017.stdout:7/607: rename d3/dc to d3/dc/df/d23/d6a/db2/dc3 22 2024-08-19T00:56:22.529 INFO:tasks.workunit.client.0.smithi017.stdout:8/441: fdatasync de/d36/f6a 0 2024-08-19T00:56:22.532 INFO:tasks.workunit.client.0.smithi017.stdout:8/442: truncate de/d15/d79/f61 357953 0 2024-08-19T00:56:22.532 INFO:tasks.workunit.client.0.smithi017.stdout:7/608: write d3/dc/df/d1c/f55 [6804646,59426] 0 2024-08-19T00:56:22.533 INFO:tasks.workunit.client.0.smithi017.stdout:2/602: mkdir d2/dc5 0 2024-08-19T00:56:22.534 INFO:tasks.workunit.client.0.smithi017.stdout:5/384: creat db/d19/d1f/d15/d3e/d40/d49/d63/f8c x:0 0 0 2024-08-19T00:56:22.535 INFO:tasks.workunit.client.0.smithi017.stdout:3/565: mknod d5/da/cb2 0 2024-08-19T00:56:22.536 INFO:tasks.workunit.client.0.smithi017.stdout:1/574: truncate d4/dc/d19/fac 1884350 0 2024-08-19T00:56:22.538 INFO:tasks.workunit.client.0.smithi017.stdout:3/566: fdatasync d5/da/d27/f4c 0 2024-08-19T00:56:22.542 INFO:tasks.workunit.client.0.smithi017.stdout:9/486: getdents d0 0 2024-08-19T00:56:22.546 INFO:tasks.workunit.client.0.smithi017.stdout:4/572: dread d2/d1a/f69 [0,4194304] 0 2024-08-19T00:56:22.546 INFO:tasks.workunit.client.0.smithi017.stdout:8/443: mkdir de/d15/d62/d7e 0 2024-08-19T00:56:22.552 INFO:tasks.workunit.client.0.smithi017.stdout:1/575: mkdir d4/dc/d3b/d3d/da8/d62/db1 0 2024-08-19T00:56:22.554 INFO:tasks.workunit.client.0.smithi017.stdout:2/603: dread d2/d7/f6a [0,4194304] 0 2024-08-19T00:56:22.557 INFO:tasks.workunit.client.0.smithi017.stdout:3/567: creat d5/d32/fb3 x:0 0 0 2024-08-19T00:56:22.558 INFO:tasks.workunit.client.0.smithi017.stdout:8/444: dwrite de/d15/f1e [4194304,4194304] 0 2024-08-19T00:56:22.564 INFO:tasks.workunit.client.0.smithi017.stdout:9/487: dread d0/d33/d22/f42 [0,4194304] 0 2024-08-19T00:56:22.565 INFO:tasks.workunit.client.0.smithi017.stdout:0/526: dwrite d5/d17/d26/d30/f38 [4194304,4194304] 0 2024-08-19T00:56:22.570 INFO:tasks.workunit.client.0.smithi017.stdout:5/385: mkdir db/d19/d8d 0 2024-08-19T00:56:22.575 INFO:tasks.workunit.client.0.smithi017.stdout:2/604: symlink d2/d7/d10/d19/d48/lc6 0 2024-08-19T00:56:22.577 INFO:tasks.workunit.client.0.smithi017.stdout:8/445: rename de/d15/d39/c6c to de/d15/d4f/d68/c7f 0 2024-08-19T00:56:22.579 INFO:tasks.workunit.client.0.smithi017.stdout:7/609: rmdir d3/dc/df/d37/d93/da0 0 2024-08-19T00:56:22.579 INFO:tasks.workunit.client.0.smithi017.stdout:4/573: getdents d2/d21/d53/da8 0 2024-08-19T00:56:22.580 INFO:tasks.workunit.client.0.smithi017.stdout:5/386: symlink db/d19/d1f/d15/d3e/d40/d49/l8e 0 2024-08-19T00:56:22.582 INFO:tasks.workunit.client.0.smithi017.stdout:6/528: getdents d5/d13/d11/d2c/d51 0 2024-08-19T00:56:22.584 INFO:tasks.workunit.client.0.smithi017.stdout:9/488: rename d0/d33/d22/d52 to d0/d33/d22/d45/d8e 0 2024-08-19T00:56:22.584 INFO:tasks.workunit.client.0.smithi017.stdout:8/446: rmdir de/d15/d39 39 2024-08-19T00:56:22.586 INFO:tasks.workunit.client.0.smithi017.stdout:7/610: mknod d3/dc/df/d3d/cc4 0 2024-08-19T00:56:22.587 INFO:tasks.workunit.client.0.smithi017.stdout:4/574: symlink d2/d1a/lc9 0 2024-08-19T00:56:22.587 INFO:tasks.workunit.client.0.smithi017.stdout:7/611: dread - d3/dc/df/d1a/fc1 zero size 2024-08-19T00:56:22.589 INFO:tasks.workunit.client.0.smithi017.stdout:7/612: chown d3/dc/df/d3d 1904246 1 2024-08-19T00:56:22.590 INFO:tasks.workunit.client.0.smithi017.stdout:5/387: fsync db/d19/d1f/d15/f52 0 2024-08-19T00:56:22.593 INFO:tasks.workunit.client.0.smithi017.stdout:9/489: dread d0/d33/f29 [0,4194304] 0 2024-08-19T00:56:22.595 INFO:tasks.workunit.client.0.smithi017.stdout:8/447: chown de/d15/d39/d3d/f4b 4788892 1 2024-08-19T00:56:22.596 INFO:tasks.workunit.client.0.smithi017.stdout:7/613: mknod d3/dc/df/d3d/cc5 0 2024-08-19T00:56:22.597 INFO:tasks.workunit.client.0.smithi017.stdout:7/614: write d3/dc/df/d37/d93/f9f [894761,84535] 0 2024-08-19T00:56:22.682 INFO:tasks.workunit.client.0.smithi017.stdout:3/568: getdents d5/d15 0 2024-08-19T00:56:22.682 INFO:tasks.workunit.client.0.smithi017.stdout:3/569: dread - d5/d15/d1b/f7b zero size 2024-08-19T00:56:22.684 INFO:tasks.workunit.client.0.smithi017.stdout:2/605: write d2/f33 [1185103,39083] 0 2024-08-19T00:56:22.691 INFO:tasks.workunit.client.0.smithi017.stdout:5/388: mknod db/d19/d1f/d15/d3e/d40/c8f 0 2024-08-19T00:56:22.691 INFO:tasks.workunit.client.0.smithi017.stdout:5/389: fsync db/f66 0 2024-08-19T00:56:22.692 INFO:tasks.workunit.client.0.smithi017.stdout:0/527: getdents d5/d17/d21 0 2024-08-19T00:56:22.693 INFO:tasks.workunit.client.0.smithi017.stdout:6/529: write d5/d13/d20/d89/fb1 [738334,5670] 0 2024-08-19T00:56:22.695 INFO:tasks.workunit.client.0.smithi017.stdout:9/490: rename d0/d33/d22/d5e/c78 to d0/d33/d22/d5e/c8f 0 2024-08-19T00:56:22.699 INFO:tasks.workunit.client.0.smithi017.stdout:7/615: chown d3/dc/df/d37/l4b 27 1 2024-08-19T00:56:22.702 INFO:tasks.workunit.client.0.smithi017.stdout:6/530: dwrite d5/d13/d11/d2c/d51/f8a [0,4194304] 0 2024-08-19T00:56:22.705 INFO:tasks.workunit.client.0.smithi017.stdout:6/531: dread - d5/d13/d11/f9f zero size 2024-08-19T00:56:22.706 INFO:tasks.workunit.client.0.smithi017.stdout:0/528: mknod d5/d17/d21/d39/cb2 0 2024-08-19T00:56:22.708 INFO:tasks.workunit.client.0.smithi017.stdout:8/448: mkdir de/d36/d74/d80 0 2024-08-19T00:56:22.709 INFO:tasks.workunit.client.0.smithi017.stdout:5/390: read db/d19/d1f/d15/f8a [474593,65102] 0 2024-08-19T00:56:22.713 INFO:tasks.workunit.client.0.smithi017.stdout:7/616: dwrite d3/dc/f1f [4194304,4194304] 0 2024-08-19T00:56:22.714 INFO:tasks.workunit.client.0.smithi017.stdout:1/576: dread d4/dc/f11 [0,4194304] 0 2024-08-19T00:56:22.718 INFO:tasks.workunit.client.0.smithi017.stdout:9/491: creat d0/d58/d49/d70/f90 x:0 0 0 2024-08-19T00:56:22.719 INFO:tasks.workunit.client.0.smithi017.stdout:9/492: chown d0/d33/c37 4 1 2024-08-19T00:56:22.722 INFO:tasks.workunit.client.0.smithi017.stdout:5/391: creat db/d19/d1f/d15/d3e/d40/d49/d63/f90 x:0 0 0 2024-08-19T00:56:22.734 INFO:tasks.workunit.client.0.smithi017.stdout:5/392: dwrite db/d19/d1f/d15/d3e/d40/d49/d63/d7b/f7e [0,4194304] 0 2024-08-19T00:56:22.737 INFO:tasks.workunit.client.0.smithi017.stdout:8/449: dread de/d15/f3b [0,4194304] 0 2024-08-19T00:56:22.738 INFO:tasks.workunit.client.0.smithi017.stdout:7/617: rmdir d3/dc/df/d1c/d2c 39 2024-08-19T00:56:22.740 INFO:tasks.workunit.client.0.smithi017.stdout:7/618: chown d3/dc/df/d37/d46/d73/d80 76583 1 2024-08-19T00:56:22.742 INFO:tasks.workunit.client.0.smithi017.stdout:9/493: dread d0/d33/d22/d5a/f5f [0,4194304] 0 2024-08-19T00:56:22.743 INFO:tasks.workunit.client.0.smithi017.stdout:9/494: chown d0/f60 222 1 2024-08-19T00:56:22.744 INFO:tasks.workunit.client.0.smithi017.stdout:9/495: write d0/d58/f66 [191888,22025] 0 2024-08-19T00:56:22.745 INFO:tasks.workunit.client.0.smithi017.stdout:5/393: rmdir db/d19/d1f/d15/d3e/d40/d49/d63/d80 39 2024-08-19T00:56:22.746 INFO:tasks.workunit.client.0.smithi017.stdout:5/394: fdatasync db/d19/d57/f7a 0 2024-08-19T00:56:22.747 INFO:tasks.workunit.client.0.smithi017.stdout:5/395: chown db/c48 527215498 1 2024-08-19T00:56:22.749 INFO:tasks.workunit.client.0.smithi017.stdout:5/396: chown db/d19/d1f/d15/d3e/f6f 1296 1 2024-08-19T00:56:22.750 INFO:tasks.workunit.client.0.smithi017.stdout:5/397: chown db/d19/d1f/d15/d1e/f37 891451212 1 2024-08-19T00:56:22.751 INFO:tasks.workunit.client.0.smithi017.stdout:6/532: getdents d5/d13/d11/d2c/d4a 0 2024-08-19T00:56:22.753 INFO:tasks.workunit.client.0.smithi017.stdout:5/398: write db/d19/d1f/d15/f64 [136988,50256] 0 2024-08-19T00:56:22.755 INFO:tasks.workunit.client.0.smithi017.stdout:7/619: dread d3/f2e [4194304,4194304] 0 2024-08-19T00:56:22.762 INFO:tasks.workunit.client.0.smithi017.stdout:8/450: creat de/f81 x:0 0 0 2024-08-19T00:56:22.765 INFO:tasks.workunit.client.0.smithi017.stdout:0/529: rename d5/d17/d21/d42/f1d to d5/d17/d45/fb3 0 2024-08-19T00:56:22.768 INFO:tasks.workunit.client.0.smithi017.stdout:6/533: dread d5/d13/d11/f53 [0,4194304] 0 2024-08-19T00:56:22.771 INFO:tasks.workunit.client.0.smithi017.stdout:6/534: creat d5/d13/d11/d52/fbc x:0 0 0 2024-08-19T00:56:22.776 INFO:tasks.workunit.client.0.smithi017.stdout:8/451: dread de/d36/f7b [0,4194304] 0 2024-08-19T00:56:22.778 INFO:tasks.workunit.client.0.smithi017.stdout:8/452: chown de/f5d 220336 1 2024-08-19T00:56:22.778 INFO:tasks.workunit.client.0.smithi017.stdout:8/453: chown de/d36/f7b 96690133 1 2024-08-19T00:56:22.783 INFO:tasks.workunit.client.0.smithi017.stdout:8/454: link de/d15/l77 de/d15/d39/d3d/l82 0 2024-08-19T00:56:22.787 INFO:tasks.workunit.client.0.smithi017.stdout:8/455: creat de/d15/f83 x:0 0 0 2024-08-19T00:56:22.789 INFO:tasks.workunit.client.0.smithi017.stdout:8/456: mkdir de/d15/d4f/d68/d84 0 2024-08-19T00:56:22.791 INFO:tasks.workunit.client.0.smithi017.stdout:8/457: rename de/f22 to de/d15/d79/f85 0 2024-08-19T00:56:22.795 INFO:tasks.workunit.client.0.smithi017.stdout:8/458: symlink de/d15/l86 0 2024-08-19T00:56:22.798 INFO:tasks.workunit.client.0.smithi017.stdout:8/459: symlink de/d15/d39/d3d/l87 0 2024-08-19T00:56:22.800 INFO:tasks.workunit.client.0.smithi017.stdout:8/460: mknod de/d15/d62/d75/c88 0 2024-08-19T00:56:22.807 INFO:tasks.workunit.client.0.smithi017.stdout:8/461: dwrite de/f53 [0,4194304] 0 2024-08-19T00:56:22.810 INFO:tasks.workunit.client.0.smithi017.stdout:8/462: creat de/d15/d79/f89 x:0 0 0 2024-08-19T00:56:22.811 INFO:tasks.workunit.client.0.smithi017.stdout:8/463: chown de/d36 95 1 2024-08-19T00:56:22.811 INFO:tasks.workunit.client.0.smithi017.stdout:8/464: dread - de/d15/f65 zero size 2024-08-19T00:56:22.818 INFO:tasks.workunit.client.0.smithi017.stdout:8/465: dwrite de/f53 [0,4194304] 0 2024-08-19T00:56:22.821 INFO:tasks.workunit.client.0.smithi017.stdout:8/466: stat de/d15/d39/d3d/c55 0 2024-08-19T00:56:22.828 INFO:tasks.workunit.client.0.smithi017.stdout:6/535: symlink d5/d13/d20/lbd 0 2024-08-19T00:56:22.830 INFO:tasks.workunit.client.0.smithi017.stdout:8/467: dwrite de/d36/f7b [0,4194304] 0 2024-08-19T00:56:22.832 INFO:tasks.workunit.client.0.smithi017.stdout:6/536: readlink d5/d13/d11/d2c/d4a/d64/d86/d90/la0 0 2024-08-19T00:56:22.833 INFO:tasks.workunit.client.0.smithi017.stdout:8/468: truncate de/f52 4529092 0 2024-08-19T00:56:22.836 INFO:tasks.workunit.client.0.smithi017.stdout:8/469: creat de/d36/d74/f8a x:0 0 0 2024-08-19T00:56:22.838 INFO:tasks.workunit.client.0.smithi017.stdout:2/606: dwrite d2/d7/d10/d35/d45/d58/f67 [0,4194304] 0 2024-08-19T00:56:22.839 INFO:tasks.workunit.client.0.smithi017.stdout:8/470: write de/f5d [2573825,97837] 0 2024-08-19T00:56:22.844 INFO:tasks.workunit.client.0.smithi017.stdout:8/471: mkdir de/d36/d74/d8b 0 2024-08-19T00:56:22.845 INFO:tasks.workunit.client.0.smithi017.stdout:2/607: truncate d2/d7/fc 426516 0 2024-08-19T00:56:22.845 INFO:tasks.workunit.client.0.smithi017.stdout:8/472: rename de/d36 to de/d36/d74/d80/d8c 22 2024-08-19T00:56:22.846 INFO:tasks.workunit.client.0.smithi017.stdout:8/473: dread - de/d15/d39/d3d/f72 zero size 2024-08-19T00:56:22.846 INFO:tasks.workunit.client.0.smithi017.stdout:2/608: write d2/d7/d10/d3b/d3c/f40 [2433169,105561] 0 2024-08-19T00:56:22.848 INFO:tasks.workunit.client.0.smithi017.stdout:0/530: unlink d5/f10 0 2024-08-19T00:56:22.849 INFO:tasks.workunit.client.0.smithi017.stdout:2/609: rmdir d2/d7/d10/d35 39 2024-08-19T00:56:22.852 INFO:tasks.workunit.client.0.smithi017.stdout:0/531: symlink d5/d18/d78/lb4 0 2024-08-19T00:56:22.857 INFO:tasks.workunit.client.0.smithi017.stdout:8/474: dwrite de/d15/f70 [0,4194304] 0 2024-08-19T00:56:22.858 INFO:tasks.workunit.client.0.smithi017.stdout:8/475: write de/d15/f35 [1844042,44103] 0 2024-08-19T00:56:22.860 INFO:tasks.workunit.client.0.smithi017.stdout:2/610: dwrite d2/d7/d29/f34 [0,4194304] 0 2024-08-19T00:56:22.860 INFO:tasks.workunit.client.0.smithi017.stdout:8/476: fsync de/d15/f65 0 2024-08-19T00:56:22.865 INFO:tasks.workunit.client.0.smithi017.stdout:8/477: write de/d36/d74/f8a [121415,62764] 0 2024-08-19T00:56:22.865 INFO:tasks.workunit.client.0.smithi017.stdout:7/620: write d3/dc/df/d1c/f97 [491882,91603] 0 2024-08-19T00:56:22.866 INFO:tasks.workunit.client.0.smithi017.stdout:0/532: getdents d5/d17/d26/d30/d3e/d81 0 2024-08-19T00:56:22.869 INFO:tasks.workunit.client.0.smithi017.stdout:8/478: write de/d36/f58 [482639,77109] 0 2024-08-19T00:56:22.872 INFO:tasks.workunit.client.0.smithi017.stdout:0/533: mknod d5/d17/d45/d50/cb5 0 2024-08-19T00:56:22.873 INFO:tasks.workunit.client.0.smithi017.stdout:7/621: write d3/dc/df/d1c/d2c/d83/f86 [563832,74087] 0 2024-08-19T00:56:22.873 INFO:tasks.workunit.client.0.smithi017.stdout:2/611: truncate d2/d7/d10/d35/d45/d58/fb2 339346 0 2024-08-19T00:56:22.874 INFO:tasks.workunit.client.0.smithi017.stdout:5/399: dwrite db/d19/d33/f5b [0,4194304] 0 2024-08-19T00:56:22.874 INFO:tasks.workunit.client.0.smithi017.stdout:9/496: rmdir d0/d58/d49/d70 39 2024-08-19T00:56:22.879 INFO:tasks.workunit.client.0.smithi017.stdout:0/534: mkdir d5/d17/d21/d39/db6 0 2024-08-19T00:56:22.884 INFO:tasks.workunit.client.0.smithi017.stdout:0/535: creat d5/d17/d26/d30/d3e/fb7 x:0 0 0 2024-08-19T00:56:22.886 INFO:tasks.workunit.client.0.smithi017.stdout:3/570: rmdir d5/d18 39 2024-08-19T00:56:22.886 INFO:tasks.workunit.client.0.smithi017.stdout:9/497: dread d0/d33/f39 [0,4194304] 0 2024-08-19T00:56:22.893 INFO:tasks.workunit.client.0.smithi017.stdout:3/571: rmdir d5/da/d3c/d4f/d68 39 2024-08-19T00:56:22.894 INFO:tasks.workunit.client.0.smithi017.stdout:7/622: link d3/dc/df/d1c/d2c/l6c d3/dc/df/d37/d93/lc6 0 2024-08-19T00:56:22.897 INFO:tasks.workunit.client.0.smithi017.stdout:7/623: mkdir d3/dc/df/d1a/dc7 0 2024-08-19T00:56:22.901 INFO:tasks.workunit.client.0.smithi017.stdout:9/498: dread d0/f18 [0,4194304] 0 2024-08-19T00:56:22.901 INFO:tasks.workunit.client.0.smithi017.stdout:3/572: dwrite d5/d15/d92/fa8 [0,4194304] 0 2024-08-19T00:56:22.901 INFO:tasks.workunit.client.0.smithi017.stdout:8/479: unlink de/d36/c5f 0 2024-08-19T00:56:22.903 INFO:tasks.workunit.client.0.smithi017.stdout:9/499: read - d0/d33/d22/d5a/f88 zero size 2024-08-19T00:56:22.905 INFO:tasks.workunit.client.0.smithi017.stdout:3/573: write d5/d18/f8c [457496,112372] 0 2024-08-19T00:56:22.906 INFO:tasks.workunit.client.0.smithi017.stdout:7/624: rename d3/dc/df/d37/d46/f6e to d3/dc/df/d37/d46/d73/d80/fc8 0 2024-08-19T00:56:22.907 INFO:tasks.workunit.client.0.smithi017.stdout:8/480: rmdir de/d15/d62/d75 39 2024-08-19T00:56:22.908 INFO:tasks.workunit.client.0.smithi017.stdout:3/574: truncate d5/da/d27/d28/f96 71474 0 2024-08-19T00:56:22.908 INFO:tasks.workunit.client.0.smithi017.stdout:1/577: unlink d4/d1c/f32 0 2024-08-19T00:56:22.914 INFO:tasks.workunit.client.0.smithi017.stdout:6/537: mkdir d5/d13/dbe 0 2024-08-19T00:56:22.917 INFO:tasks.workunit.client.0.smithi017.stdout:3/575: rename d5/d15/d1b/c1f to d5/d18/cb4 0 2024-08-19T00:56:22.918 INFO:tasks.workunit.client.0.smithi017.stdout:3/576: dread - d5/da/f95 zero size 2024-08-19T00:56:22.918 INFO:tasks.workunit.client.0.smithi017.stdout:9/500: creat d0/d33/d22/d85/f91 x:0 0 0 2024-08-19T00:56:22.921 INFO:tasks.workunit.client.0.smithi017.stdout:7/625: unlink d3/d3c/l74 0 2024-08-19T00:56:22.922 INFO:tasks.workunit.client.0.smithi017.stdout:7/626: read d3/dc/df/d1c/f97 [277864,79904] 0 2024-08-19T00:56:22.923 INFO:tasks.workunit.client.0.smithi017.stdout:8/481: mkdir de/d8d 0 2024-08-19T00:56:22.929 INFO:tasks.workunit.client.0.smithi017.stdout:3/577: creat d5/d15/d92/fb5 x:0 0 0 2024-08-19T00:56:22.932 INFO:tasks.workunit.client.0.smithi017.stdout:7/627: mkdir d3/dc/df/d37/d46/dc9 0 2024-08-19T00:56:22.932 INFO:tasks.workunit.client.0.smithi017.stdout:9/501: dwrite d0/d33/f39 [0,4194304] 0 2024-08-19T00:56:22.942 INFO:tasks.workunit.client.0.smithi017.stdout:2/612: truncate d2/d7/d10/d19/f7b 1074390 0 2024-08-19T00:56:22.946 INFO:tasks.workunit.client.0.smithi017.stdout:5/400: dwrite db/d19/d1f/d15/d3e/d40/d49/d63/d80/f87 [0,4194304] 0 2024-08-19T00:56:22.948 INFO:tasks.workunit.client.0.smithi017.stdout:8/482: creat de/d15/d4f/d68/d84/f8e x:0 0 0 2024-08-19T00:56:22.951 INFO:tasks.workunit.client.0.smithi017.stdout:0/536: dwrite d5/d17/d45/fad [0,4194304] 0 2024-08-19T00:56:22.951 INFO:tasks.workunit.client.0.smithi017.stdout:1/578: link d4/dc/d17/l72 d4/dc/d17/dad/lb2 0 2024-08-19T00:56:22.954 INFO:tasks.workunit.client.0.smithi017.stdout:1/579: fsync d4/dc/d17/d1d/f65 0 2024-08-19T00:56:22.958 INFO:tasks.workunit.client.0.smithi017.stdout:8/483: dwrite de/f81 [0,4194304] 0 2024-08-19T00:56:22.961 INFO:tasks.workunit.client.0.smithi017.stdout:1/580: dread d4/dc/d3b/fb0 [0,4194304] 0 2024-08-19T00:56:22.962 INFO:tasks.workunit.client.0.smithi017.stdout:2/613: mkdir d2/d7/d10/d19/dc7 0 2024-08-19T00:56:22.963 INFO:tasks.workunit.client.0.smithi017.stdout:2/614: stat d2/d7/d10/d3b/l73 0 2024-08-19T00:56:22.966 INFO:tasks.workunit.client.0.smithi017.stdout:9/502: creat d0/d84/f92 x:0 0 0 2024-08-19T00:56:22.968 INFO:tasks.workunit.client.0.smithi017.stdout:5/401: dread - db/d19/d1f/d15/d30/f5e zero size 2024-08-19T00:56:22.977 INFO:tasks.workunit.client.0.smithi017.stdout:6/538: write d5/d13/d11/f68 [45186,93231] 0 2024-08-19T00:56:22.979 INFO:tasks.workunit.client.0.smithi017.stdout:9/503: chown d0/d33/d22/d45/f54 4357356 1 2024-08-19T00:56:22.982 INFO:tasks.workunit.client.0.smithi017.stdout:5/402: creat db/d19/d1f/d15/d30/f91 x:0 0 0 2024-08-19T00:56:22.982 INFO:tasks.workunit.client.0.smithi017.stdout:6/539: read d5/d13/d11/d2c/f38 [927358,16262] 0 2024-08-19T00:56:22.985 INFO:tasks.workunit.client.0.smithi017.stdout:0/537: symlink d5/d17/d45/lb8 0 2024-08-19T00:56:22.986 INFO:tasks.workunit.client.0.smithi017.stdout:3/578: dwrite d5/d15/d1b/f4a [0,4194304] 0 2024-08-19T00:56:22.988 INFO:tasks.workunit.client.0.smithi017.stdout:8/484: link de/d15/d39/f59 de/d36/d74/f8f 0 2024-08-19T00:56:22.989 INFO:tasks.workunit.client.0.smithi017.stdout:7/628: write d3/f12 [2215704,112922] 0 2024-08-19T00:56:22.992 INFO:tasks.workunit.client.0.smithi017.stdout:8/485: write de/d15/d79/f61 [1160390,119016] 0 2024-08-19T00:56:22.992 INFO:tasks.workunit.client.0.smithi017.stdout:0/538: truncate d5/d17/d26/d30/d3e/fb7 494725 0 2024-08-19T00:56:22.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/540: dread d5/f1a [0,4194304] 0 2024-08-19T00:56:22.998 INFO:tasks.workunit.client.0.smithi017.stdout:2/615: link d2/d7/d29/f31 d2/fc8 0 2024-08-19T00:56:23.001 INFO:tasks.workunit.client.0.smithi017.stdout:0/539: chown d5/f16 2686 1 2024-08-19T00:56:23.002 INFO:tasks.workunit.client.0.smithi017.stdout:3/579: truncate d5/da/f48 1147744 0 2024-08-19T00:56:23.002 INFO:tasks.workunit.client.0.smithi017.stdout:3/580: dread - d5/da/d27/d6e/f9c zero size 2024-08-19T00:56:23.008 INFO:tasks.workunit.client.0.smithi017.stdout:0/540: fdatasync d5/f16 0 2024-08-19T00:56:23.010 INFO:tasks.workunit.client.0.smithi017.stdout:1/581: write d4/dc/d19/fac [1049037,77932] 0 2024-08-19T00:56:23.010 INFO:tasks.workunit.client.0.smithi017.stdout:8/486: getdents de/d36/d74/d8b 0 2024-08-19T00:56:23.013 INFO:tasks.workunit.client.0.smithi017.stdout:7/629: mkdir d3/dc/df/d37/d46/dc9/dca 0 2024-08-19T00:56:23.022 INFO:tasks.workunit.client.0.smithi017.stdout:1/582: truncate d4/dc/d17/d1d/f3c 61983 0 2024-08-19T00:56:23.022 INFO:tasks.workunit.client.0.smithi017.stdout:5/403: write f6 [4880353,22286] 0 2024-08-19T00:56:23.024 INFO:tasks.workunit.client.0.smithi017.stdout:3/581: rename d5/d15/d1b/f58 to d5/da/fb6 0 2024-08-19T00:56:23.025 INFO:tasks.workunit.client.0.smithi017.stdout:9/504: write d0/d58/f3e [1122115,11753] 0 2024-08-19T00:56:23.026 INFO:tasks.workunit.client.0.smithi017.stdout:6/541: write d5/d13/f3e [1543162,27616] 0 2024-08-19T00:56:23.026 INFO:tasks.workunit.client.0.smithi017.stdout:1/583: mknod d4/dc/d3b/d3d/d83/cb3 0 2024-08-19T00:56:23.027 INFO:tasks.workunit.client.0.smithi017.stdout:9/505: write d0/d33/d22/d5a/f88 [845950,89048] 0 2024-08-19T00:56:23.030 INFO:tasks.workunit.client.0.smithi017.stdout:0/541: write d5/f16 [2873197,69701] 0 2024-08-19T00:56:23.031 INFO:tasks.workunit.client.0.smithi017.stdout:1/584: truncate d4/d1c/d1f/f99 551344 0 2024-08-19T00:56:23.034 INFO:tasks.workunit.client.0.smithi017.stdout:2/616: dwrite d2/d7/d29/f37 [4194304,4194304] 0 2024-08-19T00:56:23.035 INFO:tasks.workunit.client.0.smithi017.stdout:7/630: rename d3/dc/df/d23/fbe to d3/dc/df/d3d/d90/fcb 0 2024-08-19T00:56:23.036 INFO:tasks.workunit.client.0.smithi017.stdout:3/582: unlink d5/da/d3c/l55 0 2024-08-19T00:56:23.045 INFO:tasks.workunit.client.0.smithi017.stdout:8/487: dwrite de/f34 [0,4194304] 0 2024-08-19T00:56:23.047 INFO:tasks.workunit.client.0.smithi017.stdout:8/488: dread - de/d36/f40 zero size 2024-08-19T00:56:23.048 INFO:tasks.workunit.client.0.smithi017.stdout:3/583: dwrite d5/d15/d1b/f39 [0,4194304] 0 2024-08-19T00:56:23.048 INFO:tasks.workunit.client.0.smithi017.stdout:4/575: sync 2024-08-19T00:56:23.055 INFO:tasks.workunit.client.0.smithi017.stdout:6/542: rename d5/d13/dbe to d5/d13/d11/d2c/d4a/d64/d86/d90/dba/dbf 0 2024-08-19T00:56:23.059 INFO:tasks.workunit.client.0.smithi017.stdout:6/543: dread d5/f36 [0,4194304] 0 2024-08-19T00:56:23.063 INFO:tasks.workunit.client.0.smithi017.stdout:5/404: link fa db/d19/d1f/d15/d1e/d5f/f92 0 2024-08-19T00:56:23.065 INFO:tasks.workunit.client.0.smithi017.stdout:5/405: dread - db/d19/d1f/d15/d3e/f79 zero size 2024-08-19T00:56:23.065 INFO:tasks.workunit.client.0.smithi017.stdout:7/631: dread d3/d3c/d88/f8b [0,4194304] 0 2024-08-19T00:56:23.066 INFO:tasks.workunit.client.0.smithi017.stdout:9/506: creat d0/d58/d49/d5d/f93 x:0 0 0 2024-08-19T00:56:23.067 INFO:tasks.workunit.client.0.smithi017.stdout:1/585: mkdir d4/d1c/d1f/da5/db4 0 2024-08-19T00:56:23.068 INFO:tasks.workunit.client.0.smithi017.stdout:0/542: creat d5/d18/d3a/fb9 x:0 0 0 2024-08-19T00:56:23.069 INFO:tasks.workunit.client.0.smithi017.stdout:4/576: fsync d2/d21/f35 0 2024-08-19T00:56:23.070 INFO:tasks.workunit.client.0.smithi017.stdout:3/584: mknod d5/d18/cb7 0 2024-08-19T00:56:23.071 INFO:tasks.workunit.client.0.smithi017.stdout:4/577: write d2/d1a/d20/fb6 [321168,60092] 0 2024-08-19T00:56:23.071 INFO:tasks.workunit.client.0.smithi017.stdout:3/585: chown d5/da/d27/d28/c83 644571817 1 2024-08-19T00:56:23.072 INFO:tasks.workunit.client.0.smithi017.stdout:8/489: rename de to de/d15/d39/d3d/d90 22 2024-08-19T00:56:23.079 INFO:tasks.workunit.client.0.smithi017.stdout:8/490: dwrite de/d15/d4f/f6e [0,4194304] 0 2024-08-19T00:56:23.080 INFO:tasks.workunit.client.0.smithi017.stdout:9/507: creat d0/d33/d22/d45/f94 x:0 0 0 2024-08-19T00:56:23.080 INFO:tasks.workunit.client.0.smithi017.stdout:2/617: write d2/d7/d10/d19/d48/f9c [920074,92083] 0 2024-08-19T00:56:23.081 INFO:tasks.workunit.client.0.smithi017.stdout:8/491: write de/d15/d4f/f6e [2714924,62872] 0 2024-08-19T00:56:23.084 INFO:tasks.workunit.client.0.smithi017.stdout:1/586: read d4/dc/d19/f53 [893860,14268] 0 2024-08-19T00:56:23.084 INFO:tasks.workunit.client.0.smithi017.stdout:2/618: dread - d2/d7/d10/d3b/d3c/d8a/fbe zero size 2024-08-19T00:56:23.086 INFO:tasks.workunit.client.0.smithi017.stdout:2/619: fdatasync d2/d7/d10/d35/d45/d58/f67 0 2024-08-19T00:56:23.087 INFO:tasks.workunit.client.0.smithi017.stdout:7/632: rename d3/dc/df/d23/d6a/lb7 to d3/dc/df/d37/d93/lcc 0 2024-08-19T00:56:23.095 INFO:tasks.workunit.client.0.smithi017.stdout:9/508: symlink d0/d33/d22/d45/d69/l95 0 2024-08-19T00:56:23.095 INFO:tasks.workunit.client.0.smithi017.stdout:5/406: truncate db/d19/d1f/f1c 1441425 0 2024-08-19T00:56:23.097 INFO:tasks.workunit.client.0.smithi017.stdout:0/543: mkdir d5/dba 0 2024-08-19T00:56:23.098 INFO:tasks.workunit.client.0.smithi017.stdout:8/492: rmdir de/d15/d62 39 2024-08-19T00:56:23.099 INFO:tasks.workunit.client.0.smithi017.stdout:1/587: mknod d4/d1c/d1f/da5/cb5 0 2024-08-19T00:56:23.100 INFO:tasks.workunit.client.0.smithi017.stdout:5/407: read db/d19/d1f/d15/d30/f46 [3689480,83885] 0 2024-08-19T00:56:23.103 INFO:tasks.workunit.client.0.smithi017.stdout:7/633: chown d3/dc/df/c5a 29 1 2024-08-19T00:56:23.103 INFO:tasks.workunit.client.0.smithi017.stdout:7/634: readlink d3/dc/df/d1c/d2c/l4d 0 2024-08-19T00:56:23.113 INFO:tasks.workunit.client.0.smithi017.stdout:8/493: creat de/d15/d79/f91 x:0 0 0 2024-08-19T00:56:23.115 INFO:tasks.workunit.client.0.smithi017.stdout:3/586: creat d5/da/d3c/d4f/d68/d9e/fb8 x:0 0 0 2024-08-19T00:56:23.118 INFO:tasks.workunit.client.0.smithi017.stdout:4/578: truncate d2/d1a/d20/fb6 309016 0 2024-08-19T00:56:23.119 INFO:tasks.workunit.client.0.smithi017.stdout:8/494: dread de/d15/d39/f3e [0,4194304] 0 2024-08-19T00:56:23.120 INFO:tasks.workunit.client.0.smithi017.stdout:2/620: dwrite d2/d7/f6c [0,4194304] 0 2024-08-19T00:56:23.123 INFO:tasks.workunit.client.0.smithi017.stdout:7/635: mknod d3/dc/df/d1c/d2c/d2f/ccd 0 2024-08-19T00:56:23.126 INFO:tasks.workunit.client.0.smithi017.stdout:6/544: getdents d5/d13/d11/d2c/d4a 0 2024-08-19T00:56:23.129 INFO:tasks.workunit.client.0.smithi017.stdout:0/544: mkdir d5/dbb 0 2024-08-19T00:56:23.135 INFO:tasks.workunit.client.0.smithi017.stdout:5/408: symlink db/l93 0 2024-08-19T00:56:23.138 INFO:tasks.workunit.client.0.smithi017.stdout:4/579: symlink d2/d21/d40/d56/d99/lca 0 2024-08-19T00:56:23.142 INFO:tasks.workunit.client.0.smithi017.stdout:8/495: dread de/f52 [0,4194304] 0 2024-08-19T00:56:23.143 INFO:tasks.workunit.client.0.smithi017.stdout:2/621: creat d2/d7/d44/fc9 x:0 0 0 2024-08-19T00:56:23.143 INFO:tasks.workunit.client.0.smithi017.stdout:8/496: stat de/d15/d39/d3d/l87 0 2024-08-19T00:56:23.145 INFO:tasks.workunit.client.0.smithi017.stdout:8/497: fdatasync de/d15/d79/f89 0 2024-08-19T00:56:23.146 INFO:tasks.workunit.client.0.smithi017.stdout:8/498: fdatasync de/d15/f65 0 2024-08-19T00:56:23.148 INFO:tasks.workunit.client.0.smithi017.stdout:0/545: mkdir d5/d18/d78/dbc 0 2024-08-19T00:56:23.149 INFO:tasks.workunit.client.0.smithi017.stdout:9/509: dwrite d0/d33/d22/d45/d8e/f81 [0,4194304] 0 2024-08-19T00:56:23.149 INFO:tasks.workunit.client.0.smithi017.stdout:3/587: write d5/d11/f2f [926191,120427] 0 2024-08-19T00:56:23.150 INFO:tasks.workunit.client.0.smithi017.stdout:9/510: fsync d0/d33/d22/d85/f91 0 2024-08-19T00:56:23.155 INFO:tasks.workunit.client.0.smithi017.stdout:1/588: creat d4/dc/d3b/d3d/fb6 x:0 0 0 2024-08-19T00:56:23.156 INFO:tasks.workunit.client.0.smithi017.stdout:1/589: write d4/dc/d3b/d9d/f89 [261030,24823] 0 2024-08-19T00:56:23.158 INFO:tasks.workunit.client.0.smithi017.stdout:4/580: symlink d2/d1a/lcb 0 2024-08-19T00:56:23.167 INFO:tasks.workunit.client.0.smithi017.stdout:0/546: symlink d5/d17/d26/d30/d5d/lbd 0 2024-08-19T00:56:23.171 INFO:tasks.workunit.client.0.smithi017.stdout:9/511: symlink d0/d33/d22/l96 0 2024-08-19T00:56:23.172 INFO:tasks.workunit.client.0.smithi017.stdout:0/547: dread d5/d17/d26/d30/f38 [4194304,4194304] 0 2024-08-19T00:56:23.174 INFO:tasks.workunit.client.0.smithi017.stdout:3/588: dwrite d5/fc [4194304,4194304] 0 2024-08-19T00:56:23.176 INFO:tasks.workunit.client.0.smithi017.stdout:5/409: creat db/d19/d8d/f94 x:0 0 0 2024-08-19T00:56:23.180 INFO:tasks.workunit.client.0.smithi017.stdout:2/622: write d2/d7/f28 [1865784,122626] 0 2024-08-19T00:56:23.180 INFO:tasks.workunit.client.0.smithi017.stdout:4/581: read d2/d11/f63 [864006,12875] 0 2024-08-19T00:56:23.184 INFO:tasks.workunit.client.0.smithi017.stdout:6/545: rename d5/d13/d11/d2c/fa7 to d5/fc0 0 2024-08-19T00:56:23.187 INFO:tasks.workunit.client.0.smithi017.stdout:5/410: rmdir db/d19/d1f/d15/d1e 39 2024-08-19T00:56:23.190 INFO:tasks.workunit.client.0.smithi017.stdout:4/582: rmdir d2/d16/d70 39 2024-08-19T00:56:23.191 INFO:tasks.workunit.client.0.smithi017.stdout:4/583: stat d2/d21/d40/d56/d95/dae 0 2024-08-19T00:56:23.192 INFO:tasks.workunit.client.0.smithi017.stdout:4/584: read - d2/d1a/d55/d8f/fc3 zero size 2024-08-19T00:56:23.192 INFO:tasks.workunit.client.0.smithi017.stdout:6/546: rmdir d5/d13/d11/d93 39 2024-08-19T00:56:23.194 INFO:tasks.workunit.client.0.smithi017.stdout:1/590: link d4/dc/l6c d4/dc/d3b/d45/lb7 0 2024-08-19T00:56:23.195 INFO:tasks.workunit.client.0.smithi017.stdout:8/499: getdents de/d15/d4f/d68/d84 0 2024-08-19T00:56:23.196 INFO:tasks.workunit.client.0.smithi017.stdout:4/585: dread - d2/d1a/d20/f86 zero size 2024-08-19T00:56:23.196 INFO:tasks.workunit.client.0.smithi017.stdout:8/500: readlink de/d15/d39/d3d/l5e 0 2024-08-19T00:56:23.199 INFO:tasks.workunit.client.0.smithi017.stdout:6/547: creat d5/d13/d11/d2c/d4a/d64/d86/d90/dba/fc1 x:0 0 0 2024-08-19T00:56:23.202 INFO:tasks.workunit.client.0.smithi017.stdout:9/512: link d0/c1c d0/d58/d49/c97 0 2024-08-19T00:56:23.203 INFO:tasks.workunit.client.0.smithi017.stdout:1/591: mkdir d4/dc/d3b/d3d/d54/da4/da6/db8 0 2024-08-19T00:56:23.205 INFO:tasks.workunit.client.0.smithi017.stdout:6/548: unlink d5/l15 0 2024-08-19T00:56:23.206 INFO:tasks.workunit.client.0.smithi017.stdout:5/411: dread db/d19/d1f/d15/d1e/f88 [0,4194304] 0 2024-08-19T00:56:23.207 INFO:tasks.workunit.client.0.smithi017.stdout:4/586: symlink d2/d1a/da1/lcc 0 2024-08-19T00:56:23.209 INFO:tasks.workunit.client.0.smithi017.stdout:9/513: creat d0/d33/d22/d5a/f98 x:0 0 0 2024-08-19T00:56:23.214 INFO:tasks.workunit.client.0.smithi017.stdout:8/501: dread de/d15/f2b [0,4194304] 0 2024-08-19T00:56:23.217 INFO:tasks.workunit.client.0.smithi017.stdout:5/412: dwrite db/d19/d1f/d15/f5a [0,4194304] 0 2024-08-19T00:56:23.218 INFO:tasks.workunit.client.0.smithi017.stdout:4/587: dwrite d2/d16/f38 [0,4194304] 0 2024-08-19T00:56:23.220 INFO:tasks.workunit.client.0.smithi017.stdout:4/588: fsync d2/d21/f8a 0 2024-08-19T00:56:23.228 INFO:tasks.workunit.client.0.smithi017.stdout:1/592: getdents d4/d1c/d75 0 2024-08-19T00:56:23.230 INFO:tasks.workunit.client.0.smithi017.stdout:6/549: write d5/d13/d20/d5e/d8f/f97 [1749814,120181] 0 2024-08-19T00:56:23.232 INFO:tasks.workunit.client.0.smithi017.stdout:5/413: dwrite db/d19/d1f/d15/d3e/d40/f84 [0,4194304] 0 2024-08-19T00:56:23.233 INFO:tasks.workunit.client.0.smithi017.stdout:6/550: stat d5/d13/d20/d5e/c82 0 2024-08-19T00:56:23.235 INFO:tasks.workunit.client.0.smithi017.stdout:6/551: write f2 [5318830,42023] 0 2024-08-19T00:56:23.236 INFO:tasks.workunit.client.0.smithi017.stdout:9/514: dread d0/d33/f17 [0,4194304] 0 2024-08-19T00:56:23.237 INFO:tasks.workunit.client.0.smithi017.stdout:1/593: creat d4/dc/d3b/d3d/d83/d95/fb9 x:0 0 0 2024-08-19T00:56:23.242 INFO:tasks.workunit.client.0.smithi017.stdout:5/414: fdatasync db/d19/d1f/d15/d30/f5e 0 2024-08-19T00:56:23.245 INFO:tasks.workunit.client.0.smithi017.stdout:4/589: dread d2/d11/f63 [0,4194304] 0 2024-08-19T00:56:23.248 INFO:tasks.workunit.client.0.smithi017.stdout:1/594: dwrite d4/f13 [4194304,4194304] 0 2024-08-19T00:56:23.250 INFO:tasks.workunit.client.0.smithi017.stdout:6/552: dwrite d5/d13/d11/f37 [0,4194304] 0 2024-08-19T00:56:23.255 INFO:tasks.workunit.client.0.smithi017.stdout:5/415: creat db/d19/f95 x:0 0 0 2024-08-19T00:56:23.259 INFO:tasks.workunit.client.0.smithi017.stdout:6/553: creat d5/d13/d11/d2c/d4a/d64/d86/d90/dba/dbf/fc2 x:0 0 0 2024-08-19T00:56:23.260 INFO:tasks.workunit.client.0.smithi017.stdout:5/416: read fa [2937613,121698] 0 2024-08-19T00:56:23.262 INFO:tasks.workunit.client.0.smithi017.stdout:8/502: dread de/d15/f29 [0,4194304] 0 2024-08-19T00:56:23.262 INFO:tasks.workunit.client.0.smithi017.stdout:8/503: fsync de/d15/d39/d3d/f4b 0 2024-08-19T00:56:23.263 INFO:tasks.workunit.client.0.smithi017.stdout:1/595: link d4/dc/d3b/d3d/fb6 d4/fba 0 2024-08-19T00:56:23.268 INFO:tasks.workunit.client.0.smithi017.stdout:6/554: rename d5/d13/d11/d2c/d4a/da8/fb4 to d5/d13/d11/d2c/fc3 0 2024-08-19T00:56:23.270 INFO:tasks.workunit.client.0.smithi017.stdout:5/417: dwrite db/d19/d1f/d15/d30/f46 [0,4194304] 0 2024-08-19T00:56:23.273 INFO:tasks.workunit.client.0.smithi017.stdout:1/596: symlink d4/d1c/d1f/lbb 0 2024-08-19T00:56:23.276 INFO:tasks.workunit.client.0.smithi017.stdout:8/504: creat de/d15/f92 x:0 0 0 2024-08-19T00:56:23.276 INFO:tasks.workunit.client.0.smithi017.stdout:5/418: write db/f24 [7991606,103690] 0 2024-08-19T00:56:23.280 INFO:tasks.workunit.client.0.smithi017.stdout:1/597: creat d4/dc/d3b/d45/fbc x:0 0 0 2024-08-19T00:56:23.280 INFO:tasks.workunit.client.0.smithi017.stdout:6/555: dwrite d5/d13/d11/d2c/d51/fa6 [0,4194304] 0 2024-08-19T00:56:23.282 INFO:tasks.workunit.client.0.smithi017.stdout:4/590: dwrite d2/d21/d40/d56/f47 [0,4194304] 0 2024-08-19T00:56:23.284 INFO:tasks.workunit.client.0.smithi017.stdout:1/598: write d4/dc/d3b/d3d/da8/fae [997116,1161] 0 2024-08-19T00:56:23.288 INFO:tasks.workunit.client.0.smithi017.stdout:4/591: write d2/d21/f91 [1886403,54120] 0 2024-08-19T00:56:23.289 INFO:tasks.workunit.client.0.smithi017.stdout:6/556: mknod d5/d13/d11/d52/cc4 0 2024-08-19T00:56:23.297 INFO:tasks.workunit.client.0.smithi017.stdout:4/592: unlink d2/d21/cb9 0 2024-08-19T00:56:23.299 INFO:tasks.workunit.client.0.smithi017.stdout:1/599: truncate d4/dc/f38 800625 0 2024-08-19T00:56:23.300 INFO:tasks.workunit.client.0.smithi017.stdout:8/505: getdents de/d15/d79 0 2024-08-19T00:56:23.303 INFO:tasks.workunit.client.0.smithi017.stdout:1/600: read d4/dc/d3b/d3d/f7d [2303190,67036] 0 2024-08-19T00:56:23.303 INFO:tasks.workunit.client.0.smithi017.stdout:6/557: unlink d5/d13/d11/d2c/c41 0 2024-08-19T00:56:23.307 INFO:tasks.workunit.client.0.smithi017.stdout:4/593: dwrite d2/d21/d53/f5e [0,4194304] 0 2024-08-19T00:56:23.307 INFO:tasks.workunit.client.0.smithi017.stdout:6/558: fsync d5/f36 0 2024-08-19T00:56:23.312 INFO:tasks.workunit.client.0.smithi017.stdout:8/506: mkdir de/d15/d93 0 2024-08-19T00:56:23.313 INFO:tasks.workunit.client.0.smithi017.stdout:5/419: dwrite db/d19/d1f/d15/d1e/f3d [4194304,4194304] 0 2024-08-19T00:56:23.314 INFO:tasks.workunit.client.0.smithi017.stdout:8/507: fdatasync de/d36/f48 0 2024-08-19T00:56:23.316 INFO:tasks.workunit.client.0.smithi017.stdout:8/508: stat de/d15/d79/f67 0 2024-08-19T00:56:23.316 INFO:tasks.workunit.client.0.smithi017.stdout:5/420: chown db/d19/d1f/d15/l3a 7 1 2024-08-19T00:56:23.316 INFO:tasks.workunit.client.0.smithi017.stdout:8/509: dread - de/f51 zero size 2024-08-19T00:56:23.317 INFO:tasks.workunit.client.0.smithi017.stdout:4/594: mkdir d2/d21/d53/dcd 0 2024-08-19T00:56:23.320 INFO:tasks.workunit.client.0.smithi017.stdout:6/559: read d5/f18 [1142100,61019] 0 2024-08-19T00:56:23.326 INFO:tasks.workunit.client.0.smithi017.stdout:8/510: chown de/d15/d39/d3d/c50 162569 1 2024-08-19T00:56:23.327 INFO:tasks.workunit.client.0.smithi017.stdout:8/511: chown de/d15/d39/f6d 18735341 1 2024-08-19T00:56:23.329 INFO:tasks.workunit.client.0.smithi017.stdout:1/601: dread d4/d1c/f2a [0,4194304] 0 2024-08-19T00:56:23.330 INFO:tasks.workunit.client.0.smithi017.stdout:4/595: mkdir d2/d21/d53/d57/dce 0 2024-08-19T00:56:23.334 INFO:tasks.workunit.client.0.smithi017.stdout:8/512: dwrite de/f34 [0,4194304] 0 2024-08-19T00:56:23.340 INFO:tasks.workunit.client.0.smithi017.stdout:8/513: dread de/f34 [0,4194304] 0 2024-08-19T00:56:23.341 INFO:tasks.workunit.client.0.smithi017.stdout:5/421: rename db/d19/d1f/c4b to db/d19/c96 0 2024-08-19T00:56:23.341 INFO:tasks.workunit.client.0.smithi017.stdout:5/422: chown db/d19/d1f/d15/f8a 16 1 2024-08-19T00:56:23.343 INFO:tasks.workunit.client.0.smithi017.stdout:4/596: symlink d2/d87/db2/db5/lcf 0 2024-08-19T00:56:23.343 INFO:tasks.workunit.client.0.smithi017.stdout:5/423: chown db/d19/d1f/d15/d30 102525485 1 2024-08-19T00:56:23.346 INFO:tasks.workunit.client.0.smithi017.stdout:4/597: unlink d2/d16/f3f 0 2024-08-19T00:56:23.347 INFO:tasks.workunit.client.0.smithi017.stdout:1/602: getdents d4/dc/d3b/d3d/d83/d95 0 2024-08-19T00:56:23.351 INFO:tasks.workunit.client.0.smithi017.stdout:6/560: dwrite d5/d13/d20/d5e/d95/f96 [0,4194304] 0 2024-08-19T00:56:23.353 INFO:tasks.workunit.client.0.smithi017.stdout:6/561: readlink d5/d13/d11/d2c/l44 0 2024-08-19T00:56:23.356 INFO:tasks.workunit.client.0.smithi017.stdout:6/562: mknod d5/d13/d11/d2c/d4a/cc5 0 2024-08-19T00:56:23.358 INFO:tasks.workunit.client.0.smithi017.stdout:5/424: dread db/f56 [0,4194304] 0 2024-08-19T00:56:23.358 INFO:tasks.workunit.client.0.smithi017.stdout:1/603: write d4/fba [504182,42077] 0 2024-08-19T00:56:23.359 INFO:tasks.workunit.client.0.smithi017.stdout:6/563: chown d5/d13/d11/d2c/d4a/d64/l79 233363931 1 2024-08-19T00:56:23.360 INFO:tasks.workunit.client.0.smithi017.stdout:1/604: fdatasync d4/dc/d3b/d45/f91 0 2024-08-19T00:56:23.361 INFO:tasks.workunit.client.0.smithi017.stdout:6/564: write d5/d13/d11/d52/fa9 [765049,115534] 0 2024-08-19T00:56:23.364 INFO:tasks.workunit.client.0.smithi017.stdout:4/598: dread d2/d16/f22 [0,4194304] 0 2024-08-19T00:56:23.370 INFO:tasks.workunit.client.0.smithi017.stdout:4/599: dwrite d2/d21/d40/f6c [0,4194304] 0 2024-08-19T00:56:23.377 INFO:tasks.workunit.client.0.smithi017.stdout:5/425: write db/d19/d57/f61 [696031,62010] 0 2024-08-19T00:56:23.380 INFO:tasks.workunit.client.0.smithi017.stdout:5/426: stat db/d19/d1f/d15/d3e/d40/d49/f76 0 2024-08-19T00:56:23.380 INFO:tasks.workunit.client.0.smithi017.stdout:5/427: fdatasync db/f24 0 2024-08-19T00:56:23.383 INFO:tasks.workunit.client.0.smithi017.stdout:4/600: rename d2/d21/d53/d57/d9d to d2/d1a/dd0 0 2024-08-19T00:56:23.385 INFO:tasks.workunit.client.0.smithi017.stdout:4/601: write d2/d21/d40/d56/d99/da3/fba [691116,109165] 0 2024-08-19T00:56:23.386 INFO:tasks.workunit.client.0.smithi017.stdout:5/428: dread db/d19/d1f/d15/d30/f46 [0,4194304] 0 2024-08-19T00:56:23.388 INFO:tasks.workunit.client.0.smithi017.stdout:5/429: chown db/d19/d1f/d15/d3e/d40/d49/f86 4676041 1 2024-08-19T00:56:23.390 INFO:tasks.workunit.client.0.smithi017.stdout:5/430: creat db/d19/d1f/d15/d3e/d40/d49/d63/d80/f97 x:0 0 0 2024-08-19T00:56:23.396 INFO:tasks.workunit.client.0.smithi017.stdout:5/431: link db/d19/d1f/d15/c8b db/d19/d1f/d15/d1e/d5f/c98 0 2024-08-19T00:56:23.396 INFO:tasks.workunit.client.0.smithi017.stdout:1/605: dread d4/dc/d3b/d3d/f7d [0,4194304] 0 2024-08-19T00:56:23.399 INFO:tasks.workunit.client.0.smithi017.stdout:1/606: symlink d4/dc/d3b/d3d/d54/da4/da6/lbd 0 2024-08-19T00:56:23.401 INFO:tasks.workunit.client.0.smithi017.stdout:1/607: read d4/dc/d19/f53 [170140,1895] 0 2024-08-19T00:56:23.402 INFO:tasks.workunit.client.0.smithi017.stdout:5/432: dwrite f6 [0,4194304] 0 2024-08-19T00:56:23.404 INFO:tasks.workunit.client.0.smithi017.stdout:1/608: write d4/d1c/d1f/f94 [569143,125744] 0 2024-08-19T00:56:23.405 INFO:tasks.workunit.client.0.smithi017.stdout:5/433: rmdir db/d19/d33 39 2024-08-19T00:56:23.407 INFO:tasks.workunit.client.0.smithi017.stdout:1/609: creat d4/dc/d17/d1d/fbe x:0 0 0 2024-08-19T00:56:23.407 INFO:tasks.workunit.client.0.smithi017.stdout:6/565: dread d5/d13/d11/d2c/d51/d7e/fae [0,4194304] 0 2024-08-19T00:56:23.409 INFO:tasks.workunit.client.0.smithi017.stdout:5/434: unlink db/d19/d1f/d15/f64 0 2024-08-19T00:56:23.409 INFO:tasks.workunit.client.0.smithi017.stdout:5/435: dread - db/d19/d1f/f74 zero size 2024-08-19T00:56:23.411 INFO:tasks.workunit.client.0.smithi017.stdout:1/610: mknod d4/d78/cbf 0 2024-08-19T00:56:23.412 INFO:tasks.workunit.client.0.smithi017.stdout:4/602: dread d2/d21/f35 [0,4194304] 0 2024-08-19T00:56:23.413 INFO:tasks.workunit.client.0.smithi017.stdout:1/611: readlink d4/dc/d17/d1d/l2e 0 2024-08-19T00:56:23.413 INFO:tasks.workunit.client.0.smithi017.stdout:1/612: chown d4/l6 226242002 1 2024-08-19T00:56:23.413 INFO:tasks.workunit.client.0.smithi017.stdout:5/436: symlink db/d19/d1f/l99 0 2024-08-19T00:56:23.414 INFO:tasks.workunit.client.0.smithi017.stdout:4/603: dread - d2/d1a/dd0/fc5 zero size 2024-08-19T00:56:23.415 INFO:tasks.workunit.client.0.smithi017.stdout:6/566: link d5/d13/d20/f58 d5/fc6 0 2024-08-19T00:56:23.415 INFO:tasks.workunit.client.0.smithi017.stdout:5/437: write db/d19/d57/f61 [270043,82098] 0 2024-08-19T00:56:23.420 INFO:tasks.workunit.client.0.smithi017.stdout:6/567: chown d5/d13/d11/d2c/d4a/d64/d86/d90/la0 496 1 2024-08-19T00:56:23.421 INFO:tasks.workunit.client.0.smithi017.stdout:5/438: mknod db/d19/d1f/d15/d3e/d40/d49/c9a 0 2024-08-19T00:56:23.421 INFO:tasks.workunit.client.0.smithi017.stdout:4/604: symlink d2/d21/ld1 0 2024-08-19T00:56:23.422 INFO:tasks.workunit.client.0.smithi017.stdout:1/613: dwrite d4/d1c/d1f/f94 [0,4194304] 0 2024-08-19T00:56:23.426 INFO:tasks.workunit.client.0.smithi017.stdout:6/568: creat d5/d13/d11/d52/fc7 x:0 0 0 2024-08-19T00:56:23.427 INFO:tasks.workunit.client.0.smithi017.stdout:1/614: write d4/dc/d3b/d3d/f7f [502704,91866] 0 2024-08-19T00:56:23.428 INFO:tasks.workunit.client.0.smithi017.stdout:1/615: chown d4/l37 3113 1 2024-08-19T00:56:23.430 INFO:tasks.workunit.client.0.smithi017.stdout:6/569: creat d5/d13/d11/d2c/d9d/fc8 x:0 0 0 2024-08-19T00:56:23.431 INFO:tasks.workunit.client.0.smithi017.stdout:1/616: mkdir d4/dc/d3b/d45/dc0 0 2024-08-19T00:56:23.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:23 smithi017 ceph-mon[16627]: pgmap v22: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 108 MiB/s rd, 290 MiB/s wr, 585 op/s 2024-08-19T00:56:23.436 INFO:tasks.workunit.client.0.smithi017.stdout:1/617: unlink d4/dc/d3b/d3d/d83/la1 0 2024-08-19T00:56:23.443 INFO:tasks.workunit.client.0.smithi017.stdout:5/439: write db/ff [2044942,6895] 0 2024-08-19T00:56:23.446 INFO:tasks.workunit.client.0.smithi017.stdout:5/440: creat db/d19/d57/f9b x:0 0 0 2024-08-19T00:56:23.449 INFO:tasks.workunit.client.0.smithi017.stdout:1/618: truncate d4/dc/d3b/d45/f8d 1954941 0 2024-08-19T00:56:23.451 INFO:tasks.workunit.client.0.smithi017.stdout:5/441: symlink db/d19/d33/l9c 0 2024-08-19T00:56:23.454 INFO:tasks.workunit.client.0.smithi017.stdout:6/570: dread d5/f18 [0,4194304] 0 2024-08-19T00:56:23.459 INFO:tasks.workunit.client.0.smithi017.stdout:6/571: rename d5/d13/d11/d4d/lb7 to d5/d13/d20/d89/lc9 0 2024-08-19T00:56:23.461 INFO:tasks.workunit.client.0.smithi017.stdout:5/442: truncate db/d19/d1f/d15/d1e/f3d 5486071 0 2024-08-19T00:56:23.462 INFO:tasks.workunit.client.0.smithi017.stdout:5/443: chown db/f2e 3003125 1 2024-08-19T00:56:23.463 INFO:tasks.workunit.client.0.smithi017.stdout:5/444: chown db/d19/d1f/d15/d3e/d40/d49/c78 315098 1 2024-08-19T00:56:23.467 INFO:tasks.workunit.client.0.smithi017.stdout:5/445: unlink db/d19/d1f/d15/d3e/d40/d49/f76 0 2024-08-19T00:56:23.468 INFO:tasks.workunit.client.0.smithi017.stdout:6/572: dread d5/f42 [0,4194304] 0 2024-08-19T00:56:23.473 INFO:tasks.workunit.client.0.smithi017.stdout:6/573: mknod d5/cca 0 2024-08-19T00:56:23.476 INFO:tasks.workunit.client.0.smithi017.stdout:6/574: fsync d5/d13/d11/d2c/f30 0 2024-08-19T00:56:23.487 INFO:tasks.workunit.client.0.smithi017.stdout:6/575: dwrite d5/d13/d11/d2c/d51/f8a [0,4194304] 0 2024-08-19T00:56:23.492 INFO:tasks.workunit.client.0.smithi017.stdout:5/446: dread db/d19/d1f/d15/d3e/d40/d49/d63/d7b/f7e [0,4194304] 0 2024-08-19T00:56:23.503 INFO:tasks.workunit.client.0.smithi017.stdout:6/576: readlink d5/l23 0 2024-08-19T00:56:23.505 INFO:tasks.workunit.client.0.smithi017.stdout:6/577: chown d5/f4f 1713614 1 2024-08-19T00:56:23.507 INFO:tasks.workunit.client.0.smithi017.stdout:6/578: creat d5/d13/d11/d2c/d4a/d64/d86/d90/fcb x:0 0 0 2024-08-19T00:56:23.510 INFO:tasks.workunit.client.0.smithi017.stdout:6/579: rename d5/d13/d20/f32 to d5/d13/d11/d2c/d4a/da8/fcc 0 2024-08-19T00:56:23.512 INFO:tasks.workunit.client.0.smithi017.stdout:6/580: symlink d5/d13/d11/d2c/d4a/d64/lcd 0 2024-08-19T00:56:23.513 INFO:tasks.workunit.client.0.smithi017.stdout:6/581: fdatasync d5/d13/d11/f53 0 2024-08-19T00:56:23.517 INFO:tasks.workunit.client.0.smithi017.stdout:6/582: getdents d5/d13/d20/d5e/d8f 0 2024-08-19T00:56:23.522 INFO:tasks.workunit.client.0.smithi017.stdout:6/583: rename d5/d13/d11/f33 to d5/d13/d11/d2c/d4a/da8/fce 0 2024-08-19T00:56:23.525 INFO:tasks.workunit.client.0.smithi017.stdout:6/584: write d5/d13/d11/d2c/f38 [2748748,16586] 0 2024-08-19T00:56:23.527 INFO:tasks.workunit.client.0.smithi017.stdout:5/447: write db/d19/d1f/d15/f25 [3730754,116505] 0 2024-08-19T00:56:23.529 INFO:tasks.workunit.client.0.smithi017.stdout:6/585: mkdir d5/d13/dcf 0 2024-08-19T00:56:23.531 INFO:tasks.workunit.client.0.smithi017.stdout:5/448: mkdir db/d19/d1f/d15/d3e/d40/d49/d63/d80/d9d 0 2024-08-19T00:56:23.533 INFO:tasks.workunit.client.0.smithi017.stdout:5/449: write db/d19/d1f/d15/d1e/d5f/f73 [662411,64428] 0 2024-08-19T00:56:23.536 INFO:tasks.workunit.client.0.smithi017.stdout:6/586: rename d5/d13/d20/d77/fab to d5/d13/fd0 0 2024-08-19T00:56:23.542 INFO:tasks.workunit.client.0.smithi017.stdout:6/587: dwrite d5/d13/d11/d52/fa9 [0,4194304] 0 2024-08-19T00:56:23.544 INFO:tasks.workunit.client.0.smithi017.stdout:5/450: truncate f6 359970 0 2024-08-19T00:56:23.546 INFO:tasks.workunit.client.0.smithi017.stdout:5/451: write db/d19/d1f/f68 [1041636,99538] 0 2024-08-19T00:56:23.549 INFO:tasks.workunit.client.0.smithi017.stdout:6/588: dwrite d5/d13/d20/d5e/d8f/f97 [0,4194304] 0 2024-08-19T00:56:23.557 INFO:tasks.workunit.client.0.smithi017.stdout:6/589: truncate d5/f1e 327439 0 2024-08-19T00:56:23.567 INFO:tasks.workunit.client.0.smithi017.stdout:6/590: dwrite d5/fc0 [0,4194304] 0 2024-08-19T00:56:23.569 INFO:tasks.workunit.client.0.smithi017.stdout:6/591: dread d5/d13/d11/f68 [0,4194304] 0 2024-08-19T00:56:23.570 INFO:tasks.workunit.client.0.smithi017.stdout:6/592: readlink d5/d13/d11/d52/l81 0 2024-08-19T00:56:23.571 INFO:tasks.workunit.client.0.smithi017.stdout:6/593: dread - d5/d13/d11/d2c/d51/f84 zero size 2024-08-19T00:56:23.574 INFO:tasks.workunit.client.0.smithi017.stdout:6/594: rename d5/d13/d20/d5e to d5/d13/d11/d2c/d4a/da8/dd1 0 2024-08-19T00:56:23.575 INFO:tasks.workunit.client.0.smithi017.stdout:6/595: rename d5/d13 to d5/d13/d11/d2c/d4a/da8/dd1/d8f/dd2 22 2024-08-19T00:56:23.576 INFO:tasks.workunit.client.0.smithi017.stdout:6/596: dread - d5/d13/d11/d52/fc7 zero size 2024-08-19T00:56:23.579 INFO:tasks.workunit.client.0.smithi017.stdout:6/597: creat d5/d13/d11/d2c/d4a/d64/fd3 x:0 0 0 2024-08-19T00:56:23.580 INFO:tasks.workunit.client.0.smithi017.stdout:6/598: chown d5/d13/d11/d2c/d4a/d64/l79 9277288 1 2024-08-19T00:56:23.582 INFO:tasks.workunit.client.0.smithi017.stdout:6/599: symlink d5/ld4 0 2024-08-19T00:56:23.583 INFO:tasks.workunit.client.0.smithi017.stdout:6/600: chown d5/d13/d11/d2c/d4a/f57 180038 1 2024-08-19T00:56:23.585 INFO:tasks.workunit.client.0.smithi017.stdout:6/601: mknod d5/d7b/cd5 0 2024-08-19T00:56:23.592 INFO:tasks.workunit.client.0.smithi017.stdout:5/452: dread fa [0,4194304] 0 2024-08-19T00:56:23.595 INFO:tasks.workunit.client.0.smithi017.stdout:5/453: creat db/d19/d1f/d15/d3e/d40/d49/d63/d7b/f9e x:0 0 0 2024-08-19T00:56:23.597 INFO:tasks.workunit.client.0.smithi017.stdout:6/602: dread d5/d13/f3e [0,4194304] 0 2024-08-19T00:56:23.597 INFO:tasks.workunit.client.0.smithi017.stdout:5/454: chown db/d19/d1f/d15/d1e/d5f/f73 2399781 1 2024-08-19T00:56:23.598 INFO:tasks.workunit.client.0.smithi017.stdout:6/603: write d5/d13/d11/d2c/d4a/da8/dd1/f75 [770321,84352] 0 2024-08-19T00:56:23.599 INFO:tasks.workunit.client.0.smithi017.stdout:6/604: dread - d5/d13/d11/d2c/d4a/d64/d86/d90/fcb zero size 2024-08-19T00:56:23.602 INFO:tasks.workunit.client.0.smithi017.stdout:6/605: symlink d5/d13/d11/d2c/d4a/d64/d86/ld6 0 2024-08-19T00:56:23.629 INFO:tasks.workunit.client.0.smithi017.stdout:6/606: dread d5/d13/d11/d2c/f46 [0,4194304] 0 2024-08-19T00:56:23.659 INFO:tasks.workunit.client.0.smithi017.stdout:6/607: dread d5/d13/d11/d2c/f6e [0,4194304] 0 2024-08-19T00:56:23.669 INFO:tasks.workunit.client.0.smithi017.stdout:6/608: creat d5/d13/d11/d2c/d51/fd7 x:0 0 0 2024-08-19T00:56:23.683 INFO:tasks.workunit.client.0.smithi017.stdout:6/609: write d5/d13/d20/f48 [42458,8203] 0 2024-08-19T00:56:23.686 INFO:tasks.workunit.client.0.smithi017.stdout:6/610: write d5/d13/d11/f68 [250583,3207] 0 2024-08-19T00:56:23.692 INFO:tasks.workunit.client.0.smithi017.stdout:6/611: symlink d5/d13/d11/d2c/d51/ld8 0 2024-08-19T00:56:23.693 INFO:tasks.workunit.client.0.smithi017.stdout:6/612: write d5/d13/f1b [785354,58805] 0 2024-08-19T00:56:23.694 INFO:tasks.workunit.client.0.smithi017.stdout:6/613: dread - d5/d13/d11/d2c/d4a/d64/d86/faf zero size 2024-08-19T00:56:23.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:23 smithi086 ceph-mon[24511]: pgmap v22: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 108 MiB/s rd, 290 MiB/s wr, 585 op/s 2024-08-19T00:56:23.696 INFO:tasks.workunit.client.0.smithi017.stdout:6/614: chown d5/d13/d11/d2c/d4a/da8/dd1/c8d 7883732 1 2024-08-19T00:56:23.698 INFO:tasks.workunit.client.0.smithi017.stdout:6/615: rename d5/d13/d11/d2c/d4a/da8/dd1/d95 to d5/d13/d11/d2c/d4a/da8/dd9 0 2024-08-19T00:56:23.700 INFO:tasks.workunit.client.0.smithi017.stdout:6/616: unlink d5/d13/d11/d4d/c9e 0 2024-08-19T00:56:23.702 INFO:tasks.workunit.client.0.smithi017.stdout:6/617: creat d5/d13/d11/d2c/d4a/d64/d86/d90/fda x:0 0 0 2024-08-19T00:56:23.711 INFO:tasks.workunit.client.0.smithi017.stdout:6/618: write d5/d13/f22 [2396882,56068] 0 2024-08-19T00:56:23.713 INFO:tasks.workunit.client.0.smithi017.stdout:6/619: mknod d5/d13/d11/d52/cdb 0 2024-08-19T00:56:23.714 INFO:tasks.workunit.client.0.smithi017.stdout:6/620: write d5/d13/d11/d2c/f38 [708322,101902] 0 2024-08-19T00:56:23.717 INFO:tasks.workunit.client.0.smithi017.stdout:6/621: mkdir d5/d13/d11/d2c/d4a/da8/dd1/d8f/ddc 0 2024-08-19T00:56:23.720 INFO:tasks.workunit.client.0.smithi017.stdout:6/622: creat d5/d13/d11/d52/fdd x:0 0 0 2024-08-19T00:56:23.731 INFO:tasks.workunit.client.0.smithi017.stdout:6/623: dread d5/d13/d11/d52/fb2 [0,4194304] 0 2024-08-19T00:56:23.734 INFO:tasks.workunit.client.0.smithi017.stdout:6/624: dread d5/d13/d11/d52/fb2 [0,4194304] 0 2024-08-19T00:56:24.104 INFO:tasks.workunit.client.0.smithi017.stdout:7/636: sync 2024-08-19T00:56:24.115 INFO:tasks.workunit.client.0.smithi017.stdout:7/637: dread d3/f2e [4194304,4194304] 0 2024-08-19T00:56:24.122 INFO:tasks.workunit.client.0.smithi017.stdout:7/638: dwrite d3/dc/df/d7d/f9b [0,4194304] 0 2024-08-19T00:56:24.130 INFO:tasks.workunit.client.0.smithi017.stdout:7/639: truncate d3/f2e 7456686 0 2024-08-19T00:56:24.158 INFO:tasks.workunit.client.0.smithi017.stdout:7/640: dread d3/dc/df/d1a/f4a [0,4194304] 0 2024-08-19T00:56:24.162 INFO:tasks.workunit.client.0.smithi017.stdout:7/641: rename d3/lb to d3/dc/df/d7d/lce 0 2024-08-19T00:56:24.165 INFO:tasks.workunit.client.0.smithi017.stdout:7/642: fdatasync d3/dc/df/d1c/f97 0 2024-08-19T00:56:24.166 INFO:tasks.workunit.client.0.smithi017.stdout:7/643: write d3/dc/df/d1c/f55 [1757252,8602] 0 2024-08-19T00:56:24.167 INFO:tasks.workunit.client.0.smithi017.stdout:7/644: chown d3/dc/df/d3d/cc4 1162 1 2024-08-19T00:56:24.201 INFO:tasks.workunit.client.0.smithi017.stdout:0/548: sync 2024-08-19T00:56:24.205 INFO:tasks.workunit.client.0.smithi017.stdout:0/549: rename d5/l7 to d5/d18/d78/dbc/lbe 0 2024-08-19T00:56:24.207 INFO:tasks.workunit.client.0.smithi017.stdout:0/550: write d5/d17/f22 [3927254,54539] 0 2024-08-19T00:56:24.218 INFO:tasks.workunit.client.0.smithi017.stdout:7/645: write d3/dc/f5b [4654107,47695] 0 2024-08-19T00:56:24.220 INFO:tasks.workunit.client.0.smithi017.stdout:7/646: chown d3/dc/df/d23/d69/f98 3233757 1 2024-08-19T00:56:24.221 INFO:tasks.workunit.client.0.smithi017.stdout:7/647: fdatasync d3/dc/df/d23/d69/f6f 0 2024-08-19T00:56:24.226 INFO:tasks.workunit.client.0.smithi017.stdout:7/648: rmdir d3 39 2024-08-19T00:56:24.228 INFO:tasks.workunit.client.0.smithi017.stdout:7/649: fdatasync d3/dc/df/d3d/d90/f59 0 2024-08-19T00:56:24.229 INFO:tasks.workunit.client.0.smithi017.stdout:0/551: write d5/d17/d26/d30/f58 [5064632,43957] 0 2024-08-19T00:56:24.234 INFO:tasks.workunit.client.0.smithi017.stdout:7/650: dwrite d3/d3c/f43 [0,4194304] 0 2024-08-19T00:56:24.313 INFO:tasks.workunit.client.0.smithi017.stdout:0/552: mknod d5/d17/d21/d39/db6/cbf 0 2024-08-19T00:56:24.317 INFO:tasks.workunit.client.0.smithi017.stdout:0/553: mkdir d5/d18/d78/dbc/dc0 0 2024-08-19T00:56:24.318 INFO:tasks.workunit.client.0.smithi017.stdout:0/554: truncate d5/d17/d45/d77/fa2 879416 0 2024-08-19T00:56:24.321 INFO:tasks.workunit.client.0.smithi017.stdout:7/651: link d3/d3c/d88/f8b d3/dc/df/d1c/d2c/d83/fcf 0 2024-08-19T00:56:24.323 INFO:tasks.workunit.client.0.smithi017.stdout:0/555: fdatasync d5/d17/d26/d30/f33 0 2024-08-19T00:56:24.331 INFO:tasks.workunit.client.0.smithi017.stdout:7/652: write d3/dc/df/d1a/f3b [5107384,74261] 0 2024-08-19T00:56:24.332 INFO:tasks.workunit.client.0.smithi017.stdout:7/653: dread - d3/dc/df/d37/f94 zero size 2024-08-19T00:56:24.335 INFO:tasks.workunit.client.0.smithi017.stdout:0/556: dwrite d5/d17/f69 [4194304,4194304] 0 2024-08-19T00:56:24.335 INFO:tasks.workunit.client.0.smithi017.stdout:7/654: mknod d3/dc/df/d1c/d2c/d83/cd0 0 2024-08-19T00:56:24.337 INFO:tasks.workunit.client.0.smithi017.stdout:0/557: fsync d5/d17/d45/d50/f73 0 2024-08-19T00:56:24.343 INFO:tasks.workunit.client.0.smithi017.stdout:7/655: dwrite d3/dc/df/d37/f94 [0,4194304] 0 2024-08-19T00:56:24.345 INFO:tasks.workunit.client.0.smithi017.stdout:0/558: dread d5/d17/d45/d50/f73 [0,4194304] 0 2024-08-19T00:56:24.346 INFO:tasks.workunit.client.0.smithi017.stdout:0/559: chown d5/d17/d45/d50/f73 0 1 2024-08-19T00:56:24.347 INFO:tasks.workunit.client.0.smithi017.stdout:7/656: mkdir d3/dc/df/dd1 0 2024-08-19T00:56:24.355 INFO:tasks.workunit.client.0.smithi017.stdout:7/657: creat d3/dc/df/dd1/fd2 x:0 0 0 2024-08-19T00:56:24.357 INFO:tasks.workunit.client.0.smithi017.stdout:7/658: symlink d3/dc/df/d1c/d2c/d2f/ld3 0 2024-08-19T00:56:24.359 INFO:tasks.workunit.client.0.smithi017.stdout:7/659: unlink d3/dc/df/d3d/d90/fa9 0 2024-08-19T00:56:24.360 INFO:tasks.workunit.client.0.smithi017.stdout:7/660: readlink d3/dc/df/d1c/d2c/l4d 0 2024-08-19T00:56:24.364 INFO:tasks.workunit.client.0.smithi017.stdout:0/560: dwrite d5/d18/f1e [0,4194304] 0 2024-08-19T00:56:24.364 INFO:tasks.workunit.client.0.smithi017.stdout:7/661: mknod d3/dc/df/d3d/d90/cd4 0 2024-08-19T00:56:24.367 INFO:tasks.workunit.client.0.smithi017.stdout:3/589: sync 2024-08-19T00:56:24.369 INFO:tasks.workunit.client.0.smithi017.stdout:3/590: write d5/d11/f34 [9466745,111734] 0 2024-08-19T00:56:24.377 INFO:tasks.workunit.client.0.smithi017.stdout:0/561: truncate d5/d18/f1e 1831020 0 2024-08-19T00:56:24.379 INFO:tasks.workunit.client.0.smithi017.stdout:0/562: write d5/d17/d26/d30/d5d/db0/fa6 [2626036,50527] 0 2024-08-19T00:56:24.379 INFO:tasks.workunit.client.0.smithi017.stdout:7/662: truncate d3/dc/df/d37/f94 1771363 0 2024-08-19T00:56:24.380 INFO:tasks.workunit.client.0.smithi017.stdout:3/591: truncate d5/d11/f16 2494854 0 2024-08-19T00:56:24.383 INFO:tasks.workunit.client.0.smithi017.stdout:3/592: write d5/da/fb6 [4080147,22417] 0 2024-08-19T00:56:24.384 INFO:tasks.workunit.client.0.smithi017.stdout:7/663: rename d3/dc/df/d37/d46/d73/d80/c82 to d3/dc/df/d1a/db9/cd5 0 2024-08-19T00:56:24.385 INFO:tasks.workunit.client.0.smithi017.stdout:7/664: read d3/dc/df/d1a/f4a [3330679,42780] 0 2024-08-19T00:56:24.386 INFO:tasks.workunit.client.0.smithi017.stdout:3/593: truncate d5/da/d27/f6d 1422312 0 2024-08-19T00:56:24.388 INFO:tasks.workunit.client.0.smithi017.stdout:3/594: write d5/da/d3c/d4f/d68/d99/f9b [80358,65738] 0 2024-08-19T00:56:24.391 INFO:tasks.workunit.client.0.smithi017.stdout:3/595: fsync d5/d15/f21 0 2024-08-19T00:56:24.392 INFO:tasks.workunit.client.0.smithi017.stdout:7/665: dwrite d3/dc/df/d3d/d90/f59 [0,4194304] 0 2024-08-19T00:56:24.397 INFO:tasks.workunit.client.0.smithi017.stdout:7/666: creat d3/dc/df/d37/d93/fd6 x:0 0 0 2024-08-19T00:56:24.398 INFO:tasks.workunit.client.0.smithi017.stdout:7/667: dread - d3/dc/d5f/fb8 zero size 2024-08-19T00:56:24.399 INFO:tasks.workunit.client.0.smithi017.stdout:7/668: dread - d3/dc/df/d1a/fc1 zero size 2024-08-19T00:56:24.402 INFO:tasks.workunit.client.0.smithi017.stdout:3/596: getdents d5/da/d27 0 2024-08-19T00:56:24.404 INFO:tasks.workunit.client.0.smithi017.stdout:3/597: write d5/da/d27/d28/f96 [536957,128441] 0 2024-08-19T00:56:24.405 INFO:tasks.workunit.client.0.smithi017.stdout:3/598: fsync d5/da/f72 0 2024-08-19T00:56:24.408 INFO:tasks.workunit.client.0.smithi017.stdout:7/669: dwrite d3/dc/df/d1c/d2c/d2f/f56 [4194304,4194304] 0 2024-08-19T00:56:24.411 INFO:tasks.workunit.client.0.smithi017.stdout:3/599: chown d5/d11/d61/l8d 2278680 1 2024-08-19T00:56:24.412 INFO:tasks.workunit.client.0.smithi017.stdout:7/670: mkdir d3/dc/df/dd1/dd7 0 2024-08-19T00:56:24.413 INFO:tasks.workunit.client.0.smithi017.stdout:3/600: write d5/da/d27/d28/f98 [3169497,45286] 0 2024-08-19T00:56:24.415 INFO:tasks.workunit.client.0.smithi017.stdout:7/671: mkdir d3/dc/df/d23/d69/dd8 0 2024-08-19T00:56:24.419 INFO:tasks.workunit.client.0.smithi017.stdout:3/601: creat d5/d18/dab/fb9 x:0 0 0 2024-08-19T00:56:24.422 INFO:tasks.workunit.client.0.smithi017.stdout:7/672: mknod d3/dc/cd9 0 2024-08-19T00:56:24.425 INFO:tasks.workunit.client.0.smithi017.stdout:7/673: mkdir d3/dc/df/dda 0 2024-08-19T00:56:24.425 INFO:tasks.workunit.client.0.smithi017.stdout:7/674: stat d3/dc 0 2024-08-19T00:56:24.427 INFO:tasks.workunit.client.0.smithi017.stdout:7/675: mkdir d3/dc/df/dd1/dd7/ddb 0 2024-08-19T00:56:24.429 INFO:tasks.workunit.client.0.smithi017.stdout:7/676: symlink d3/dc/df/d37/d46/d73/ldc 0 2024-08-19T00:56:24.431 INFO:tasks.workunit.client.0.smithi017.stdout:7/677: symlink d3/dc/df/d37/d46/d73/d80/ldd 0 2024-08-19T00:56:24.436 INFO:tasks.workunit.client.0.smithi017.stdout:3/602: dread d5/da/d27/d28/f37 [0,4194304] 0 2024-08-19T00:56:24.442 INFO:tasks.workunit.client.0.smithi017.stdout:3/603: creat d5/fba x:0 0 0 2024-08-19T00:56:24.444 INFO:tasks.workunit.client.0.smithi017.stdout:3/604: dread d5/da/d27/f9f [0,4194304] 0 2024-08-19T00:56:24.449 INFO:tasks.workunit.client.0.smithi017.stdout:3/605: creat d5/d11/fbb x:0 0 0 2024-08-19T00:56:24.450 INFO:tasks.workunit.client.0.smithi017.stdout:3/606: write d5/d11/f85 [923630,109633] 0 2024-08-19T00:56:24.453 INFO:tasks.workunit.client.0.smithi017.stdout:7/678: truncate d3/dc/f1f 7319311 0 2024-08-19T00:56:24.455 INFO:tasks.workunit.client.0.smithi017.stdout:3/607: link d5/da/d3c/c59 d5/d18/dab/cbc 0 2024-08-19T00:56:24.456 INFO:tasks.workunit.client.0.smithi017.stdout:7/679: symlink d3/dab/lde 0 2024-08-19T00:56:24.458 INFO:tasks.workunit.client.0.smithi017.stdout:3/608: creat d5/d11/fbd x:0 0 0 2024-08-19T00:56:24.458 INFO:tasks.workunit.client.0.smithi017.stdout:3/609: readlink d5/d11/l5b 0 2024-08-19T00:56:24.459 INFO:tasks.workunit.client.0.smithi017.stdout:7/680: mkdir d3/dc/df/dda/ddf 0 2024-08-19T00:56:24.459 INFO:tasks.workunit.client.0.smithi017.stdout:3/610: rmdir d5/d15 39 2024-08-19T00:56:24.460 INFO:tasks.workunit.client.0.smithi017.stdout:7/681: readlink d3/dc/df/d37/d93/lcc 0 2024-08-19T00:56:24.464 INFO:tasks.workunit.client.0.smithi017.stdout:7/682: rename d3/dc/df/d37/d46/d73/d80/cb0 to d3/dc/df/d37/d93/ce0 0 2024-08-19T00:56:24.472 INFO:tasks.workunit.client.0.smithi017.stdout:7/683: link d3/dc/ca4 d3/dc/df/d37/d46/dc9/dca/ce1 0 2024-08-19T00:56:24.472 INFO:tasks.workunit.client.0.smithi017.stdout:7/684: stat d3/dc/df/d23/d69/fb4 0 2024-08-19T00:56:24.473 INFO:tasks.workunit.client.0.smithi017.stdout:3/611: write f2 [1177830,15220] 0 2024-08-19T00:56:24.477 INFO:tasks.workunit.client.0.smithi017.stdout:7/685: dread d3/dc/df/d37/d46/fbd [0,4194304] 0 2024-08-19T00:56:24.477 INFO:tasks.workunit.client.0.smithi017.stdout:3/612: mknod d5/d32/cbe 0 2024-08-19T00:56:24.481 INFO:tasks.workunit.client.0.smithi017.stdout:3/613: mknod d5/da/d27/d6e/cbf 0 2024-08-19T00:56:24.482 INFO:tasks.workunit.client.0.smithi017.stdout:3/614: write d5/da/fd [10078120,79893] 0 2024-08-19T00:56:24.487 INFO:tasks.workunit.client.0.smithi017.stdout:9/515: sync 2024-08-19T00:56:24.487 INFO:tasks.workunit.client.0.smithi017.stdout:2/623: sync 2024-08-19T00:56:24.495 INFO:tasks.workunit.client.0.smithi017.stdout:3/615: dread d5/da/f2b [4194304,4194304] 0 2024-08-19T00:56:24.506 INFO:tasks.workunit.client.0.smithi017.stdout:2/624: write d2/d7/d10/d35/d45/fa9 [235886,49433] 0 2024-08-19T00:56:24.509 INFO:tasks.workunit.client.0.smithi017.stdout:9/516: link d0/f3a d0/d33/d22/d45/d8e/f99 0 2024-08-19T00:56:24.511 INFO:tasks.workunit.client.0.smithi017.stdout:3/616: rename d5/da/d3c/f8e to d5/d15/d92/fc0 0 2024-08-19T00:56:24.512 INFO:tasks.workunit.client.0.smithi017.stdout:2/625: mkdir d2/dc5/dca 0 2024-08-19T00:56:24.515 INFO:tasks.workunit.client.0.smithi017.stdout:3/617: unlink d5/d15/d92/la0 0 2024-08-19T00:56:24.516 INFO:tasks.workunit.client.0.smithi017.stdout:3/618: write d5/da/d3c/f93 [4554245,2523] 0 2024-08-19T00:56:24.516 INFO:tasks.workunit.client.0.smithi017.stdout:2/626: creat d2/d7/d10/d3b/d80/da2/fcb x:0 0 0 2024-08-19T00:56:24.520 INFO:tasks.workunit.client.0.smithi017.stdout:9/517: rmdir d0/d33/d22/d45/d69/d7b 0 2024-08-19T00:56:24.521 INFO:tasks.workunit.client.0.smithi017.stdout:9/518: chown d0/d58/d49 10010 1 2024-08-19T00:56:24.524 INFO:tasks.workunit.client.0.smithi017.stdout:3/619: dwrite d5/d15/d92/fa8 [4194304,4194304] 0 2024-08-19T00:56:24.526 INFO:tasks.workunit.client.0.smithi017.stdout:9/519: mknod d0/d33/d22/d5e/c9a 0 2024-08-19T00:56:24.533 INFO:tasks.workunit.client.0.smithi017.stdout:9/520: dwrite d0/d33/d22/d45/f94 [0,4194304] 0 2024-08-19T00:56:24.535 INFO:tasks.workunit.client.0.smithi017.stdout:3/620: rename d5/da/f74 to d5/da/d3c/d4f/fc1 0 2024-08-19T00:56:24.536 INFO:tasks.workunit.client.0.smithi017.stdout:3/621: chown d5/d11/d61 3286 1 2024-08-19T00:56:24.541 INFO:tasks.workunit.client.0.smithi017.stdout:3/622: mknod d5/da/d27/cc2 0 2024-08-19T00:56:24.542 INFO:tasks.workunit.client.0.smithi017.stdout:9/521: dwrite d0/d33/d22/d5a/f98 [0,4194304] 0 2024-08-19T00:56:24.542 INFO:tasks.workunit.client.0.smithi017.stdout:3/623: chown d5/d15/f21 26356318 1 2024-08-19T00:56:24.543 INFO:tasks.workunit.client.0.smithi017.stdout:9/522: fdatasync d0/d58/f66 0 2024-08-19T00:56:24.548 INFO:tasks.workunit.client.0.smithi017.stdout:9/523: mkdir d0/d33/d22/d45/d9b 0 2024-08-19T00:56:24.550 INFO:tasks.workunit.client.0.smithi017.stdout:3/624: creat d5/da/d3c/fc3 x:0 0 0 2024-08-19T00:56:24.551 INFO:tasks.workunit.client.0.smithi017.stdout:3/625: readlink d5/d11/l5b 0 2024-08-19T00:56:24.551 INFO:tasks.workunit.client.0.smithi017.stdout:9/524: fdatasync d0/d33/f17 0 2024-08-19T00:56:24.552 INFO:tasks.workunit.client.0.smithi017.stdout:2/627: write d2/d7/d10/d19/d48/f82 [1442852,120949] 0 2024-08-19T00:56:24.553 INFO:tasks.workunit.client.0.smithi017.stdout:9/525: chown d0/d33/d22/d45/d8e/f86 687 1 2024-08-19T00:56:24.564 INFO:tasks.workunit.client.0.smithi017.stdout:2/628: dread d2/d7/f28 [0,4194304] 0 2024-08-19T00:56:24.565 INFO:tasks.workunit.client.0.smithi017.stdout:3/626: write d5/d11/f2a [2960238,89869] 0 2024-08-19T00:56:24.566 INFO:tasks.workunit.client.0.smithi017.stdout:3/627: chown d5/d15/l97 0 1 2024-08-19T00:56:24.569 INFO:tasks.workunit.client.0.smithi017.stdout:3/628: creat d5/d32/fc4 x:0 0 0 2024-08-19T00:56:24.572 INFO:tasks.workunit.client.0.smithi017.stdout:9/526: dwrite d0/d33/d22/d45/f54 [0,4194304] 0 2024-08-19T00:56:24.578 INFO:tasks.workunit.client.0.smithi017.stdout:3/629: truncate d5/da/d3c/d4f/f94 362071 0 2024-08-19T00:56:24.582 INFO:tasks.workunit.client.0.smithi017.stdout:3/630: creat d5/da/d3c/fc5 x:0 0 0 2024-08-19T00:56:24.582 INFO:tasks.workunit.client.0.smithi017.stdout:2/629: dread d2/d7/d29/f31 [0,4194304] 0 2024-08-19T00:56:24.584 INFO:tasks.workunit.client.0.smithi017.stdout:2/630: write d2/d7/d10/d3b/d54/fc1 [496601,43668] 0 2024-08-19T00:56:24.588 INFO:tasks.workunit.client.0.smithi017.stdout:2/631: rename d2/d7/d10/d35/d45/f95 to d2/d7/d10/d3b/d80/d81/fcc 0 2024-08-19T00:56:24.591 INFO:tasks.workunit.client.0.smithi017.stdout:2/632: fdatasync d2/f77 0 2024-08-19T00:56:24.592 INFO:tasks.workunit.client.0.smithi017.stdout:3/631: write d5/da/d27/f3a [1200052,66709] 0 2024-08-19T00:56:24.594 INFO:tasks.workunit.client.0.smithi017.stdout:2/633: mkdir d2/d7/d10/d3b/d80/d81/dcd 0 2024-08-19T00:56:24.595 INFO:tasks.workunit.client.0.smithi017.stdout:3/632: readlink d5/d32/l6b 0 2024-08-19T00:56:24.596 INFO:tasks.workunit.client.0.smithi017.stdout:9/527: dread d0/d33/f1b [0,4194304] 0 2024-08-19T00:56:24.597 INFO:tasks.workunit.client.0.smithi017.stdout:3/633: write d5/d15/d1b/f79 [1448816,124820] 0 2024-08-19T00:56:24.598 INFO:tasks.workunit.client.0.smithi017.stdout:2/634: truncate d2/d7/d10/d3b/d3c/fc3 1608870 0 2024-08-19T00:56:24.605 INFO:tasks.workunit.client.0.smithi017.stdout:9/528: dwrite d0/d33/d22/d5a/f88 [0,4194304] 0 2024-08-19T00:56:24.605 INFO:tasks.workunit.client.0.smithi017.stdout:3/634: creat d5/fc6 x:0 0 0 2024-08-19T00:56:24.605 INFO:tasks.workunit.client.0.smithi017.stdout:9/529: chown d0/d33 71103088 1 2024-08-19T00:56:24.607 INFO:tasks.workunit.client.0.smithi017.stdout:2/635: creat d2/d7/fce x:0 0 0 2024-08-19T00:56:24.608 INFO:tasks.workunit.client.0.smithi017.stdout:3/635: truncate d5/d15/f21 283818 0 2024-08-19T00:56:24.608 INFO:tasks.workunit.client.0.smithi017.stdout:9/530: read d0/d33/d22/f42 [3795685,104992] 0 2024-08-19T00:56:24.609 INFO:tasks.workunit.client.0.smithi017.stdout:0/563: sync 2024-08-19T00:56:24.609 INFO:tasks.workunit.client.0.smithi017.stdout:8/514: sync 2024-08-19T00:56:24.609 INFO:tasks.workunit.client.0.smithi017.stdout:6/625: sync 2024-08-19T00:56:24.609 INFO:tasks.workunit.client.0.smithi017.stdout:1/619: sync 2024-08-19T00:56:24.610 INFO:tasks.workunit.client.0.smithi017.stdout:4/605: sync 2024-08-19T00:56:24.610 INFO:tasks.workunit.client.0.smithi017.stdout:5/455: sync 2024-08-19T00:56:24.612 INFO:tasks.workunit.client.0.smithi017.stdout:3/636: creat d5/da/d3c/d4f/d68/d99/fc7 x:0 0 0 2024-08-19T00:56:24.614 INFO:tasks.workunit.client.0.smithi017.stdout:2/636: getdents d2/d7/d29 0 2024-08-19T00:56:24.614 INFO:tasks.workunit.client.0.smithi017.stdout:4/606: dread - d2/d16/d70/fb0 zero size 2024-08-19T00:56:24.615 INFO:tasks.workunit.client.0.smithi017.stdout:6/626: fdatasync d5/d13/d11/d2c/d4a/d64/fd3 0 2024-08-19T00:56:24.617 INFO:tasks.workunit.client.0.smithi017.stdout:6/627: write d5/d13/d11/f68 [1234968,33990] 0 2024-08-19T00:56:24.619 INFO:tasks.workunit.client.0.smithi017.stdout:9/531: rename d0/d33/d22/f4c to d0/d58/d49/d5d/f9c 0 2024-08-19T00:56:24.621 INFO:tasks.workunit.client.0.smithi017.stdout:0/564: mkdir d5/d18/d3a/dc1 0 2024-08-19T00:56:24.622 INFO:tasks.workunit.client.0.smithi017.stdout:3/637: mknod d5/d11/cc8 0 2024-08-19T00:56:24.622 INFO:tasks.workunit.client.0.smithi017.stdout:0/565: dread d5/d17/d26/f80 [0,4194304] 0 2024-08-19T00:56:24.623 INFO:tasks.workunit.client.0.smithi017.stdout:2/637: read - d2/d7/d10/d3b/d3c/f3d zero size 2024-08-19T00:56:24.625 INFO:tasks.workunit.client.0.smithi017.stdout:5/456: write db/d19/d1f/d15/d3e/f70 [801864,77816] 0 2024-08-19T00:56:24.629 INFO:tasks.workunit.client.0.smithi017.stdout:1/620: symlink d4/dc/d3b/d45/dc0/lc1 0 2024-08-19T00:56:24.630 INFO:tasks.workunit.client.0.smithi017.stdout:6/628: stat d5/lb5 0 2024-08-19T00:56:24.635 INFO:tasks.workunit.client.0.smithi017.stdout:2/638: unlink d2/d7/d10/d35/d45/d58/dbf/d7a/l99 0 2024-08-19T00:56:24.635 INFO:tasks.workunit.client.0.smithi017.stdout:4/607: dread d2/d1a/d55/d8f/fa0 [0,4194304] 0 2024-08-19T00:56:24.637 INFO:tasks.workunit.client.0.smithi017.stdout:3/638: dread d5/da/d27/f6d [0,4194304] 0 2024-08-19T00:56:24.637 INFO:tasks.workunit.client.0.smithi017.stdout:5/457: chown db/d19/d1f/d15/d1e/l4a 0 1 2024-08-19T00:56:24.638 INFO:tasks.workunit.client.0.smithi017.stdout:1/621: symlink d4/d1c/d75/lc2 0 2024-08-19T00:56:24.638 INFO:tasks.workunit.client.0.smithi017.stdout:9/532: dwrite d0/d33/f1b [0,4194304] 0 2024-08-19T00:56:24.641 INFO:tasks.workunit.client.0.smithi017.stdout:2/639: chown d2/l63 1935232 1 2024-08-19T00:56:24.642 INFO:tasks.workunit.client.0.smithi017.stdout:8/515: rename de/d15/l77 to de/d15/d62/d7e/l94 0 2024-08-19T00:56:24.643 INFO:tasks.workunit.client.0.smithi017.stdout:5/458: creat db/d19/d1f/d15/d30/f9f x:0 0 0 2024-08-19T00:56:24.644 INFO:tasks.workunit.client.0.smithi017.stdout:2/640: truncate d2/d7/d10/d19/d48/f82 2499923 0 2024-08-19T00:56:24.644 INFO:tasks.workunit.client.0.smithi017.stdout:1/622: rmdir d4/dc/d3b/d3d/d83 39 2024-08-19T00:56:24.646 INFO:tasks.workunit.client.0.smithi017.stdout:5/459: read db/d19/d1f/d15/d3e/f70 [398576,83603] 0 2024-08-19T00:56:24.651 INFO:tasks.workunit.client.0.smithi017.stdout:8/516: unlink de/d36/f40 0 2024-08-19T00:56:24.654 INFO:tasks.workunit.client.0.smithi017.stdout:2/641: read d2/d7/fc [222478,116285] 0 2024-08-19T00:56:24.658 INFO:tasks.workunit.client.0.smithi017.stdout:4/608: unlink d2/d1a/d20/fb6 0 2024-08-19T00:56:24.660 INFO:tasks.workunit.client.0.smithi017.stdout:1/623: rename d4/dc/d3b/d3d/da8/f76 to d4/dc/d3b/d3d/da8/d62/fc3 0 2024-08-19T00:56:24.662 INFO:tasks.workunit.client.0.smithi017.stdout:1/624: write d4/dc/d3b/d45/f4d [34690,51254] 0 2024-08-19T00:56:24.664 INFO:tasks.workunit.client.0.smithi017.stdout:3/639: creat d5/fc9 x:0 0 0 2024-08-19T00:56:24.665 INFO:tasks.workunit.client.0.smithi017.stdout:5/460: read - db/d19/d1f/d15/d30/f5c zero size 2024-08-19T00:56:24.666 INFO:tasks.workunit.client.0.smithi017.stdout:5/461: dread - db/d19/d1f/d15/d30/f9f zero size 2024-08-19T00:56:24.667 INFO:tasks.workunit.client.0.smithi017.stdout:5/462: dread - db/d19/d1f/d15/f7f zero size 2024-08-19T00:56:24.667 INFO:tasks.workunit.client.0.smithi017.stdout:8/517: unlink de/c13 0 2024-08-19T00:56:24.670 INFO:tasks.workunit.client.0.smithi017.stdout:2/642: creat d2/d7/d29/fcf x:0 0 0 2024-08-19T00:56:24.675 INFO:tasks.workunit.client.0.smithi017.stdout:5/463: dwrite db/d19/d1f/d15/d3e/d40/d49/d63/f90 [0,4194304] 0 2024-08-19T00:56:24.676 INFO:tasks.workunit.client.0.smithi017.stdout:1/625: creat d4/dc/d19/fc4 x:0 0 0 2024-08-19T00:56:24.678 INFO:tasks.workunit.client.0.smithi017.stdout:3/640: mkdir d5/d15/d92/dca 0 2024-08-19T00:56:24.682 INFO:tasks.workunit.client.0.smithi017.stdout:9/533: link d0/c4b d0/d58/d49/d70/c9d 0 2024-08-19T00:56:24.684 INFO:tasks.workunit.client.0.smithi017.stdout:2/643: creat d2/d7/d44/fd0 x:0 0 0 2024-08-19T00:56:24.688 INFO:tasks.workunit.client.0.smithi017.stdout:5/464: fsync db/d19/d1f/d15/d3e/f70 0 2024-08-19T00:56:24.690 INFO:tasks.workunit.client.0.smithi017.stdout:4/609: dwrite d2/d21/d40/f4c [0,4194304] 0 2024-08-19T00:56:24.693 INFO:tasks.workunit.client.0.smithi017.stdout:3/641: write d5/da/d27/d28/f37 [1854404,39436] 0 2024-08-19T00:56:24.695 INFO:tasks.workunit.client.0.smithi017.stdout:2/644: dread - d2/d7/d10/d19/d48/f8e zero size 2024-08-19T00:56:24.695 INFO:tasks.workunit.client.0.smithi017.stdout:4/610: mknod d2/d27/cd2 0 2024-08-19T00:56:24.698 INFO:tasks.workunit.client.0.smithi017.stdout:4/611: chown d2/d21/d40/d56/fa5 75153799 1 2024-08-19T00:56:24.698 INFO:tasks.workunit.client.0.smithi017.stdout:8/518: dwrite de/d36/d74/f8f [4194304,4194304] 0 2024-08-19T00:56:24.698 INFO:tasks.workunit.client.0.smithi017.stdout:2/645: chown d2/d7/d10/d19/c75 15 1 2024-08-19T00:56:24.705 INFO:tasks.workunit.client.0.smithi017.stdout:8/519: creat de/d36/d74/d8b/f95 x:0 0 0 2024-08-19T00:56:24.706 INFO:tasks.workunit.client.0.smithi017.stdout:9/534: read d0/f5b [5534676,101619] 0 2024-08-19T00:56:24.707 INFO:tasks.workunit.client.0.smithi017.stdout:3/642: dwrite f2 [0,4194304] 0 2024-08-19T00:56:24.708 INFO:tasks.workunit.client.0.smithi017.stdout:4/612: truncate d2/d21/d40/d56/d99/da3/faa 692548 0 2024-08-19T00:56:24.709 INFO:tasks.workunit.client.0.smithi017.stdout:2/646: link d2/f33 d2/d7/d10/d35/d84/fd1 0 2024-08-19T00:56:24.709 INFO:tasks.workunit.client.0.smithi017.stdout:1/626: dread d4/dc/d3b/d3d/da8/d62/f8a [0,4194304] 0 2024-08-19T00:56:24.713 INFO:tasks.workunit.client.0.smithi017.stdout:3/643: truncate d5/d32/fb3 284171 0 2024-08-19T00:56:24.714 INFO:tasks.workunit.client.0.smithi017.stdout:3/644: fsync d5/fc6 0 2024-08-19T00:56:24.715 INFO:tasks.workunit.client.0.smithi017.stdout:2/647: readlink d2/l1f 0 2024-08-19T00:56:24.716 INFO:tasks.workunit.client.0.smithi017.stdout:1/627: read d4/dc/d19/fac [1622048,54743] 0 2024-08-19T00:56:24.720 INFO:tasks.workunit.client.0.smithi017.stdout:5/465: truncate db/d19/d1f/d15/d30/f46 317756 0 2024-08-19T00:56:24.722 INFO:tasks.workunit.client.0.smithi017.stdout:9/535: rename d0/d33/d22/d40/f4e to d0/d33/d22/d45/d9b/f9e 0 2024-08-19T00:56:24.724 INFO:tasks.workunit.client.0.smithi017.stdout:9/536: chown d0/d33/d22/d40/f77 1 1 2024-08-19T00:56:24.724 INFO:tasks.workunit.client.0.smithi017.stdout:2/648: rmdir d2/d7/d10 39 2024-08-19T00:56:24.729 INFO:tasks.workunit.client.0.smithi017.stdout:1/628: mknod d4/d1c/d75/cc5 0 2024-08-19T00:56:24.729 INFO:tasks.workunit.client.0.smithi017.stdout:5/466: rmdir db 39 2024-08-19T00:56:24.730 INFO:tasks.workunit.client.0.smithi017.stdout:8/520: rmdir de/d15/d93 0 2024-08-19T00:56:24.734 INFO:tasks.workunit.client.0.smithi017.stdout:3/645: dwrite d5/da/d27/fa7 [0,4194304] 0 2024-08-19T00:56:24.735 INFO:tasks.workunit.client.0.smithi017.stdout:4/613: dread d2/d21/d53/d57/f9f [0,4194304] 0 2024-08-19T00:56:24.737 INFO:tasks.workunit.client.0.smithi017.stdout:4/614: chown d2/d87/db2/fbd 1 1 2024-08-19T00:56:24.743 INFO:tasks.workunit.client.0.smithi017.stdout:9/537: dread d0/d33/d22/f2f [0,4194304] 0 2024-08-19T00:56:24.744 INFO:tasks.workunit.client.0.smithi017.stdout:1/629: creat d4/fc6 x:0 0 0 2024-08-19T00:56:24.746 INFO:tasks.workunit.client.0.smithi017.stdout:9/538: dread - d0/d58/d49/d70/f90 zero size 2024-08-19T00:56:24.748 INFO:tasks.workunit.client.0.smithi017.stdout:9/539: chown d0/d33/c37 13 1 2024-08-19T00:56:24.749 INFO:tasks.workunit.client.0.smithi017.stdout:8/521: write de/f34 [1193816,91523] 0 2024-08-19T00:56:24.753 INFO:tasks.workunit.client.0.smithi017.stdout:1/630: dread d4/dc/d3b/d9d/f89 [0,4194304] 0 2024-08-19T00:56:24.754 INFO:tasks.workunit.client.0.smithi017.stdout:2/649: rename d2/d7/d10/c32 to d2/d7/d29/cd2 0 2024-08-19T00:56:24.759 INFO:tasks.workunit.client.0.smithi017.stdout:1/631: dread d4/dc/d3b/d3d/da8/fae [0,4194304] 0 2024-08-19T00:56:24.761 INFO:tasks.workunit.client.0.smithi017.stdout:8/522: rmdir de/d15/d39 39 2024-08-19T00:56:24.763 INFO:tasks.workunit.client.0.smithi017.stdout:9/540: write d0/d33/d22/d40/f77 [615587,13832] 0 2024-08-19T00:56:24.764 INFO:tasks.workunit.client.0.smithi017.stdout:4/615: dwrite d2/d11/f9c [0,4194304] 0 2024-08-19T00:56:24.768 INFO:tasks.workunit.client.0.smithi017.stdout:2/650: symlink d2/d7/dd/ld3 0 2024-08-19T00:56:24.773 INFO:tasks.workunit.client.0.smithi017.stdout:3/646: rename d5/da/c30 to d5/da/d27/d6e/ccb 0 2024-08-19T00:56:24.778 INFO:tasks.workunit.client.0.smithi017.stdout:5/467: creat db/d19/d1f/d15/fa0 x:0 0 0 2024-08-19T00:56:24.780 INFO:tasks.workunit.client.0.smithi017.stdout:3/647: dread d5/da/d27/f3a [0,4194304] 0 2024-08-19T00:56:24.781 INFO:tasks.workunit.client.0.smithi017.stdout:3/648: write d5/d15/d1b/f39 [2388057,112268] 0 2024-08-19T00:56:24.782 INFO:tasks.workunit.client.0.smithi017.stdout:8/523: symlink de/d36/d74/d80/l96 0 2024-08-19T00:56:24.784 INFO:tasks.workunit.client.0.smithi017.stdout:7/686: sync 2024-08-19T00:56:24.785 INFO:tasks.workunit.client.0.smithi017.stdout:7/687: read d3/dc/df/d3d/d90/f59 [1799949,90499] 0 2024-08-19T00:56:24.787 INFO:tasks.workunit.client.0.smithi017.stdout:9/541: write d0/d58/d49/f6d [800435,51250] 0 2024-08-19T00:56:24.790 INFO:tasks.workunit.client.0.smithi017.stdout:2/651: write d2/d7/f93 [2414209,107316] 0 2024-08-19T00:56:24.792 INFO:tasks.workunit.client.0.smithi017.stdout:8/524: unlink de/d15/d79/f89 0 2024-08-19T00:56:24.795 INFO:tasks.workunit.client.0.smithi017.stdout:1/632: rename d4/dc/f38 to d4/fc7 0 2024-08-19T00:56:24.799 INFO:tasks.workunit.client.0.smithi017.stdout:5/468: symlink db/d19/d1f/d15/d3e/d40/d49/d63/la1 0 2024-08-19T00:56:24.804 INFO:tasks.workunit.client.0.smithi017.stdout:4/616: rename d2/d1a/d55/d73/f81 to d2/d87/fd3 0 2024-08-19T00:56:24.807 INFO:tasks.workunit.client.0.smithi017.stdout:9/542: mkdir d0/d58/d9f 0 2024-08-19T00:56:24.809 INFO:tasks.workunit.client.0.smithi017.stdout:8/525: truncate de/d15/f45 3191569 0 2024-08-19T00:56:24.810 INFO:tasks.workunit.client.0.smithi017.stdout:2/652: dread d2/d7/dd/f4e [0,4194304] 0 2024-08-19T00:56:24.814 INFO:tasks.workunit.client.0.smithi017.stdout:4/617: mkdir d2/d1a/dd0/dd4 0 2024-08-19T00:56:24.815 INFO:tasks.workunit.client.0.smithi017.stdout:8/526: dwrite de/f53 [0,4194304] 0 2024-08-19T00:56:24.815 INFO:tasks.workunit.client.0.smithi017.stdout:7/688: link d3/dc/df/l15 d3/dc/df/d1a/dc7/le2 0 2024-08-19T00:56:24.818 INFO:tasks.workunit.client.0.smithi017.stdout:5/469: mknod db/d19/d1f/d15/d3e/d40/d83/ca2 0 2024-08-19T00:56:24.821 INFO:tasks.workunit.client.0.smithi017.stdout:9/543: mkdir d0/d33/d22/d5a/da0 0 2024-08-19T00:56:24.821 INFO:tasks.workunit.client.0.smithi017.stdout:9/544: readlink d0/l26 0 2024-08-19T00:56:24.821 INFO:tasks.workunit.client.0.smithi017.stdout:5/470: write db/d19/d1f/d15/d3e/d40/d49/d63/d80/f87 [4478958,109779] 0 2024-08-19T00:56:24.822 INFO:tasks.workunit.client.0.smithi017.stdout:5/471: chown db/d19/c2b 210289 1 2024-08-19T00:56:24.823 INFO:tasks.workunit.client.0.smithi017.stdout:9/545: write d0/d58/d49/d70/f90 [106284,63940] 0 2024-08-19T00:56:24.832 INFO:tasks.workunit.client.0.smithi017.stdout:1/633: creat d4/d1c/fc8 x:0 0 0 2024-08-19T00:56:24.839 INFO:tasks.workunit.client.0.smithi017.stdout:9/546: unlink d0/d33/d22/l96 0 2024-08-19T00:56:24.841 INFO:tasks.workunit.client.0.smithi017.stdout:5/472: creat db/d19/d1f/d15/d3e/fa3 x:0 0 0 2024-08-19T00:56:24.842 INFO:tasks.workunit.client.0.smithi017.stdout:5/473: stat db/d19/d1f/d15/d3e/d40/d49/l8e 0 2024-08-19T00:56:24.852 INFO:tasks.workunit.client.0.smithi017.stdout:9/547: fsync d0/f5b 0 2024-08-19T00:56:24.854 INFO:tasks.workunit.client.0.smithi017.stdout:9/548: write d0/d33/d22/d5a/f98 [2453271,119579] 0 2024-08-19T00:56:24.854 INFO:tasks.workunit.client.0.smithi017.stdout:2/653: rmdir d2/d7/dbb 0 2024-08-19T00:56:24.858 INFO:tasks.workunit.client.0.smithi017.stdout:3/649: rename d5/da/d27/f78 to d5/da/d3c/d4f/fcc 0 2024-08-19T00:56:24.858 INFO:tasks.workunit.client.0.smithi017.stdout:1/634: mknod d4/dc/cc9 0 2024-08-19T00:56:24.862 INFO:tasks.workunit.client.0.smithi017.stdout:9/549: dwrite d0/d58/f3e [0,4194304] 0 2024-08-19T00:56:24.865 INFO:tasks.workunit.client.0.smithi017.stdout:2/654: readlink d2/d7/d10/d35/d45/d58/dbf/lb3 0 2024-08-19T00:56:24.866 INFO:tasks.workunit.client.0.smithi017.stdout:4/618: dwrite d2/f12 [4194304,4194304] 0 2024-08-19T00:56:24.868 INFO:tasks.workunit.client.0.smithi017.stdout:7/689: rename d3/dc/df/d37/d93/fd6 to d3/dc/df/d1c/d2c/d83/fe3 0 2024-08-19T00:56:24.868 INFO:tasks.workunit.client.0.smithi017.stdout:3/650: dread d5/da/d27/fa7 [0,4194304] 0 2024-08-19T00:56:24.876 INFO:tasks.workunit.client.0.smithi017.stdout:2/655: creat d2/d7/d10/d3b/d97/fd4 x:0 0 0 2024-08-19T00:56:24.879 INFO:tasks.workunit.client.0.smithi017.stdout:5/474: rename db/d19/d33/f42 to db/d19/d1f/d15/d1e/fa4 0 2024-08-19T00:56:24.880 INFO:tasks.workunit.client.0.smithi017.stdout:5/475: chown db 273 1 2024-08-19T00:56:24.880 INFO:tasks.workunit.client.0.smithi017.stdout:9/550: dwrite d0/d33/d22/d45/d8e/f81 [0,4194304] 0 2024-08-19T00:56:24.881 INFO:tasks.workunit.client.0.smithi017.stdout:3/651: unlink d5/d11/fbd 0 2024-08-19T00:56:24.885 INFO:tasks.workunit.client.0.smithi017.stdout:7/690: symlink d3/dc/df/d37/d93/le4 0 2024-08-19T00:56:24.889 INFO:tasks.workunit.client.0.smithi017.stdout:1/635: mkdir d4/dc/d3b/d3d/d83/d95/dca 0 2024-08-19T00:56:24.890 INFO:tasks.workunit.client.0.smithi017.stdout:8/527: getdents de/d15/d39/d3d 0 2024-08-19T00:56:24.892 INFO:tasks.workunit.client.0.smithi017.stdout:7/691: fdatasync d3/dc/df/d1c/d2c/d2f/f56 0 2024-08-19T00:56:24.892 INFO:tasks.workunit.client.0.smithi017.stdout:5/476: dwrite db/d19/f95 [0,4194304] 0 2024-08-19T00:56:24.893 INFO:tasks.workunit.client.0.smithi017.stdout:2/656: unlink d2/d7/d10/d3b/d3c/f3d 0 2024-08-19T00:56:24.893 INFO:tasks.workunit.client.0.smithi017.stdout:9/551: dwrite d0/d58/d49/d5d/f93 [0,4194304] 0 2024-08-19T00:56:24.894 INFO:tasks.workunit.client.0.smithi017.stdout:0/566: sync 2024-08-19T00:56:24.895 INFO:tasks.workunit.client.0.smithi017.stdout:6/629: sync 2024-08-19T00:56:24.907 INFO:tasks.workunit.client.0.smithi017.stdout:1/636: dwrite d4/dc/d3b/f80 [0,4194304] 0 2024-08-19T00:56:24.913 INFO:tasks.workunit.client.0.smithi017.stdout:4/619: write d2/d1a/f1c [2275982,31609] 0 2024-08-19T00:56:24.920 INFO:tasks.workunit.client.0.smithi017.stdout:5/477: truncate db/d19/d1f/d15/d1e/f27 168760 0 2024-08-19T00:56:24.926 INFO:tasks.workunit.client.0.smithi017.stdout:6/630: dread d5/d13/f22 [0,4194304] 0 2024-08-19T00:56:24.926 INFO:tasks.workunit.client.0.smithi017.stdout:7/692: write d3/dc/df/d3d/d90/f59 [610170,114161] 0 2024-08-19T00:56:24.928 INFO:tasks.workunit.client.0.smithi017.stdout:9/552: mkdir d0/d33/d22/d5a/da0/da1 0 2024-08-19T00:56:24.930 INFO:tasks.workunit.client.0.smithi017.stdout:3/652: dwrite d5/da/d3c/d4f/f94 [0,4194304] 0 2024-08-19T00:56:24.933 INFO:tasks.workunit.client.0.smithi017.stdout:8/528: truncate de/d36/f69 3283540 0 2024-08-19T00:56:24.934 INFO:tasks.workunit.client.0.smithi017.stdout:2/657: dread d2/d7/d29/f5d [0,4194304] 0 2024-08-19T00:56:24.934 INFO:tasks.workunit.client.0.smithi017.stdout:1/637: dwrite d4/dc/d3b/f4a [0,4194304] 0 2024-08-19T00:56:24.935 INFO:tasks.workunit.client.0.smithi017.stdout:4/620: write d2/f78 [1508748,94204] 0 2024-08-19T00:56:24.935 INFO:tasks.workunit.client.0.smithi017.stdout:5/478: creat db/d19/d8d/fa5 x:0 0 0 2024-08-19T00:56:24.936 INFO:tasks.workunit.client.0.smithi017.stdout:8/529: chown de/d15/d4f/f5c 78583 1 2024-08-19T00:56:24.939 INFO:tasks.workunit.client.0.smithi017.stdout:5/479: write db/d19/d1f/d15/d1e/f37 [2362264,102014] 0 2024-08-19T00:56:24.944 INFO:tasks.workunit.client.0.smithi017.stdout:7/693: mkdir d3/dc/df/d3d/d90/d87/de5 0 2024-08-19T00:56:24.944 INFO:tasks.workunit.client.0.smithi017.stdout:3/653: symlink d5/d32/lcd 0 2024-08-19T00:56:24.945 INFO:tasks.workunit.client.0.smithi017.stdout:9/553: fdatasync d0/d33/d22/d5a/f5f 0 2024-08-19T00:56:24.946 INFO:tasks.workunit.client.0.smithi017.stdout:7/694: readlink d3/dc/l7e 0 2024-08-19T00:56:24.949 INFO:tasks.workunit.client.0.smithi017.stdout:4/621: dwrite d2/d1a/dd0/fc5 [0,4194304] 0 2024-08-19T00:56:24.952 INFO:tasks.workunit.client.0.smithi017.stdout:6/631: rename d5/d13/d20/d89/fb1 to d5/d13/d11/d2c/d4a/da8/fde 0 2024-08-19T00:56:24.952 INFO:tasks.workunit.client.0.smithi017.stdout:1/638: stat d4/d1c/c36 0 2024-08-19T00:56:24.954 INFO:tasks.workunit.client.0.smithi017.stdout:8/530: mkdir de/d15/d4f/d97 0 2024-08-19T00:56:24.960 INFO:tasks.workunit.client.0.smithi017.stdout:0/567: link d5/d18/d3a/l93 d5/d17/d26/d30/lc2 0 2024-08-19T00:56:24.961 INFO:tasks.workunit.client.0.smithi017.stdout:3/654: creat d5/da/d3c/d4f/d68/d9e/fce x:0 0 0 2024-08-19T00:56:24.962 INFO:tasks.workunit.client.0.smithi017.stdout:1/639: dread d4/dc/d19/f53 [0,4194304] 0 2024-08-19T00:56:24.962 INFO:tasks.workunit.client.0.smithi017.stdout:9/554: mkdir d0/d33/d22/d45/da2 0 2024-08-19T00:56:24.966 INFO:tasks.workunit.client.0.smithi017.stdout:2/658: rename d2/d7/d10/f25 to d2/d7/d10/d35/d7e/fd5 0 2024-08-19T00:56:24.970 INFO:tasks.workunit.client.0.smithi017.stdout:1/640: dwrite d4/fd [0,4194304] 0 2024-08-19T00:56:24.970 INFO:tasks.workunit.client.0.smithi017.stdout:8/531: unlink de/d15/d39/f78 0 2024-08-19T00:56:24.972 INFO:tasks.workunit.client.0.smithi017.stdout:6/632: unlink d5/d13/d11/d2c/d4a/cc5 0 2024-08-19T00:56:24.974 INFO:tasks.workunit.client.0.smithi017.stdout:4/622: dwrite d2/dc1/fc8 [0,4194304] 0 2024-08-19T00:56:24.977 INFO:tasks.workunit.client.0.smithi017.stdout:4/623: read d2/d1a/d55/d73/fb1 [1781819,3343] 0 2024-08-19T00:56:24.978 INFO:tasks.workunit.client.0.smithi017.stdout:0/568: creat d5/d17/d45/d77/fc3 x:0 0 0 2024-08-19T00:56:24.978 INFO:tasks.workunit.client.0.smithi017.stdout:7/695: creat d3/dc/df/dda/ddf/fe6 x:0 0 0 2024-08-19T00:56:24.979 INFO:tasks.workunit.client.0.smithi017.stdout:4/624: dread - d2/d16/d70/fb0 zero size 2024-08-19T00:56:24.980 INFO:tasks.workunit.client.0.smithi017.stdout:1/641: dread d4/dc/d3b/d3d/f7f [0,4194304] 0 2024-08-19T00:56:24.980 INFO:tasks.workunit.client.0.smithi017.stdout:7/696: chown d3/dc/df/d37/d46 439305 1 2024-08-19T00:56:24.981 INFO:tasks.workunit.client.0.smithi017.stdout:9/555: unlink d0/d58/d49/f6d 0 2024-08-19T00:56:24.981 INFO:tasks.workunit.client.0.smithi017.stdout:1/642: fdatasync d4/dc/d3b/d45/f91 0 2024-08-19T00:56:24.983 INFO:tasks.workunit.client.0.smithi017.stdout:2/659: symlink d2/d7/d10/d35/d45/d58/dbf/ld6 0 2024-08-19T00:56:24.989 INFO:tasks.workunit.client.0.smithi017.stdout:3/655: creat d5/d15/d92/dca/fcf x:0 0 0 2024-08-19T00:56:24.989 INFO:tasks.workunit.client.0.smithi017.stdout:6/633: read d5/f36 [1673208,53772] 0 2024-08-19T00:56:24.992 INFO:tasks.workunit.client.0.smithi017.stdout:3/656: dread - d5/da/d3c/fc3 zero size 2024-08-19T00:56:24.994 INFO:tasks.workunit.client.0.smithi017.stdout:7/697: dwrite d3/dc/df/d7d/f9a [0,4194304] 0 2024-08-19T00:56:24.996 INFO:tasks.workunit.client.0.smithi017.stdout:9/556: symlink d0/d58/d49/d70/la3 0 2024-08-19T00:56:24.998 INFO:tasks.workunit.client.0.smithi017.stdout:2/660: dwrite d2/d7/d10/d3b/d3c/f88 [0,4194304] 0 2024-08-19T00:56:24.998 INFO:tasks.workunit.client.0.smithi017.stdout:1/643: mknod d4/dc/d19/ccb 0 2024-08-19T00:56:25.000 INFO:tasks.workunit.client.0.smithi017.stdout:2/661: fdatasync d2/d7/d10/d3b/d80/da2/fcb 0 2024-08-19T00:56:25.007 INFO:tasks.workunit.client.0.smithi017.stdout:5/480: rename db/d19/c96 to db/d19/ca6 0 2024-08-19T00:56:25.020 INFO:tasks.workunit.client.0.smithi017.stdout:7/698: dread d3/dc/df/d1c/f68 [0,4194304] 0 2024-08-19T00:56:25.020 INFO:tasks.workunit.client.0.smithi017.stdout:7/699: chown d3/dc/df/d3d/d90/cd4 10370842 1 2024-08-19T00:56:25.146 INFO:tasks.workunit.client.0.smithi017.stdout:3/657: mkdir d5/da/d27/d6e/dd0 0 2024-08-19T00:56:25.146 INFO:tasks.workunit.client.0.smithi017.stdout:8/532: write de/d15/d39/f6d [351153,85687] 0 2024-08-19T00:56:25.146 INFO:tasks.workunit.client.0.smithi017.stdout:3/658: chown d5/d15/c19 332818 1 2024-08-19T00:56:25.150 INFO:tasks.workunit.client.0.smithi017.stdout:9/557: rename d0/d33/d22/f44 to d0/d33/d22/d45/d69/fa4 0 2024-08-19T00:56:25.153 INFO:tasks.workunit.client.0.smithi017.stdout:2/662: symlink d2/d7/d10/d35/d45/d58/dbf/d7a/ld7 0 2024-08-19T00:56:25.153 INFO:tasks.workunit.client.0.smithi017.stdout:8/533: dwrite de/d15/d79/f67 [4194304,4194304] 0 2024-08-19T00:56:25.154 INFO:tasks.workunit.client.0.smithi017.stdout:0/569: write d5/d17/d21/d42/f86 [1518765,10891] 0 2024-08-19T00:56:25.155 INFO:tasks.workunit.client.0.smithi017.stdout:4/625: write d2/d11/f33 [680489,103008] 0 2024-08-19T00:56:25.157 INFO:tasks.workunit.client.0.smithi017.stdout:6/634: creat d5/d13/dcf/fdf x:0 0 0 2024-08-19T00:56:25.158 INFO:tasks.workunit.client.0.smithi017.stdout:4/626: truncate d2/d21/d40/d56/d99/da3/fba 997958 0 2024-08-19T00:56:25.159 INFO:tasks.workunit.client.0.smithi017.stdout:4/627: chown d2/d16/d70/f80 1172 1 2024-08-19T00:56:25.295 INFO:tasks.workunit.client.0.smithi017.stdout:9/558: unlink d0/c7d 0 2024-08-19T00:56:25.296 INFO:tasks.workunit.client.0.smithi017.stdout:4/628: dread - d2/d1a/d55/d8f/fc3 zero size 2024-08-19T00:56:25.297 INFO:tasks.workunit.client.0.smithi017.stdout:3/659: symlink d5/da/ld1 0 2024-08-19T00:56:25.299 INFO:tasks.workunit.client.0.smithi017.stdout:3/660: truncate d5/da/d3c/d4f/fcc 574694 0 2024-08-19T00:56:25.300 INFO:tasks.workunit.client.0.smithi017.stdout:6/635: rename d5/d13/d11/d2c/d4a/d64/d86/d90/dba/fc1 to d5/d13/d20/d77/d99/fe0 0 2024-08-19T00:56:25.300 INFO:tasks.workunit.client.0.smithi017.stdout:3/661: readlink d5/l71 0 2024-08-19T00:56:25.300 INFO:tasks.workunit.client.0.smithi017.stdout:6/636: chown f3 476441 1 2024-08-19T00:56:25.301 INFO:tasks.workunit.client.0.smithi017.stdout:4/629: dread d2/f12 [4194304,4194304] 0 2024-08-19T00:56:25.302 INFO:tasks.workunit.client.0.smithi017.stdout:7/700: truncate d3/dc/f1f 5439225 0 2024-08-19T00:56:25.305 INFO:tasks.workunit.client.0.smithi017.stdout:5/481: creat db/fa7 x:0 0 0 2024-08-19T00:56:25.306 INFO:tasks.workunit.client.0.smithi017.stdout:5/482: read fa [1482893,32501] 0 2024-08-19T00:56:25.316 INFO:tasks.workunit.client.0.smithi017.stdout:6/637: unlink d5/d13/d11/d4d/f5b 0 2024-08-19T00:56:25.319 INFO:tasks.workunit.client.0.smithi017.stdout:4/630: rmdir d2/d21/d53/d57 39 2024-08-19T00:56:25.323 INFO:tasks.workunit.client.0.smithi017.stdout:8/534: creat de/d15/d62/f98 x:0 0 0 2024-08-19T00:56:25.324 INFO:tasks.workunit.client.0.smithi017.stdout:5/483: stat db/d19/d1f/d15/d30/f46 0 2024-08-19T00:56:25.326 INFO:tasks.workunit.client.0.smithi017.stdout:8/535: chown de/d15/d79/f91 103 1 2024-08-19T00:56:25.326 INFO:tasks.workunit.client.0.smithi017.stdout:0/570: creat d5/d17/d26/fc4 x:0 0 0 2024-08-19T00:56:25.327 INFO:tasks.workunit.client.0.smithi017.stdout:8/536: chown de/d15/l30 5225997 1 2024-08-19T00:56:25.329 INFO:tasks.workunit.client.0.smithi017.stdout:9/559: dwrite d0/d33/d22/f2f [0,4194304] 0 2024-08-19T00:56:25.331 INFO:tasks.workunit.client.0.smithi017.stdout:8/537: truncate de/d36/d74/d8b/f95 442100 0 2024-08-19T00:56:25.332 INFO:tasks.workunit.client.0.smithi017.stdout:4/631: truncate d2/d21/d53/d5a/f96 88579 0 2024-08-19T00:56:25.333 INFO:tasks.workunit.client.0.smithi017.stdout:9/560: write d0/d33/d22/d40/f77 [161536,69633] 0 2024-08-19T00:56:25.335 INFO:tasks.workunit.client.0.smithi017.stdout:0/571: dread - d5/d18/f82 zero size 2024-08-19T00:56:25.337 INFO:tasks.workunit.client.0.smithi017.stdout:5/484: creat db/d19/d1f/d15/d3e/d40/d49/fa8 x:0 0 0 2024-08-19T00:56:25.338 INFO:tasks.workunit.client.0.smithi017.stdout:6/638: rename d5/d13/d11/d2c/d51/d7e/f7f to d5/d13/d11/d2c/d4a/da8/dd9/fe1 0 2024-08-19T00:56:25.339 INFO:tasks.workunit.client.0.smithi017.stdout:9/561: chown d0/d33/d22/d45/d8e/f7a 21759090 1 2024-08-19T00:56:25.341 INFO:tasks.workunit.client.0.smithi017.stdout:3/662: getdents d5/d18/dab 0 2024-08-19T00:56:25.343 INFO:tasks.workunit.client.0.smithi017.stdout:7/701: truncate d3/dc/df/d37/d46/f9d 1384 0 2024-08-19T00:56:25.344 INFO:tasks.workunit.client.0.smithi017.stdout:9/562: write d0/d33/d22/d45/f94 [2070219,92096] 0 2024-08-19T00:56:25.346 INFO:tasks.workunit.client.0.smithi017.stdout:4/632: creat d2/d21/d40/d56/d95/fd5 x:0 0 0 2024-08-19T00:56:25.347 INFO:tasks.workunit.client.0.smithi017.stdout:8/538: dwrite de/d15/d4f/d68/d84/f8e [0,4194304] 0 2024-08-19T00:56:25.351 INFO:tasks.workunit.client.0.smithi017.stdout:5/485: rmdir db/d19/d1f/d15/d3e/d40/d83 39 2024-08-19T00:56:25.353 INFO:tasks.workunit.client.0.smithi017.stdout:5/486: fdatasync db/d19/d1f/d15/d3e/d40/d49/d63/d80/f87 0 2024-08-19T00:56:25.363 INFO:tasks.workunit.client.0.smithi017.stdout:0/572: dread d5/d18/f23 [0,4194304] 0 2024-08-19T00:56:25.364 INFO:tasks.workunit.client.0.smithi017.stdout:6/639: dread d5/fc0 [0,4194304] 0 2024-08-19T00:56:25.366 INFO:tasks.workunit.client.0.smithi017.stdout:8/539: dread de/d15/d4f/f6e [0,4194304] 0 2024-08-19T00:56:25.377 INFO:tasks.workunit.client.0.smithi017.stdout:4/633: dread d2/d21/d40/f6c [0,4194304] 0 2024-08-19T00:56:25.379 INFO:tasks.workunit.client.0.smithi017.stdout:9/563: truncate d0/d33/f1b 2105413 0 2024-08-19T00:56:25.381 INFO:tasks.workunit.client.0.smithi017.stdout:0/573: symlink d5/d18/d3a/dc1/lc5 0 2024-08-19T00:56:25.383 INFO:tasks.workunit.client.0.smithi017.stdout:8/540: symlink de/l99 0 2024-08-19T00:56:25.384 INFO:tasks.workunit.client.0.smithi017.stdout:4/634: write d2/d11/f9c [398703,54411] 0 2024-08-19T00:56:25.391 INFO:tasks.workunit.client.0.smithi017.stdout:4/635: chown d2/d1a/d55/fad 28831551 1 2024-08-19T00:56:25.392 INFO:tasks.workunit.client.0.smithi017.stdout:5/487: dwrite db/d19/d1f/d15/d3e/d40/f77 [0,4194304] 0 2024-08-19T00:56:25.392 INFO:tasks.workunit.client.0.smithi017.stdout:8/541: rmdir de/d36 39 2024-08-19T00:56:25.392 INFO:tasks.workunit.client.0.smithi017.stdout:3/663: dwrite d5/da/d27/d28/f80 [0,4194304] 0 2024-08-19T00:56:25.393 INFO:tasks.workunit.client.0.smithi017.stdout:6/640: dread d5/d13/d11/f72 [0,4194304] 0 2024-08-19T00:56:25.395 INFO:tasks.workunit.client.0.smithi017.stdout:5/488: readlink db/d19/l3c 0 2024-08-19T00:56:25.396 INFO:tasks.workunit.client.0.smithi017.stdout:7/702: dwrite d3/dc/df/d37/d46/f57 [0,4194304] 0 2024-08-19T00:56:25.397 INFO:tasks.workunit.client.0.smithi017.stdout:6/641: readlink d5/d13/d11/d2c/l43 0 2024-08-19T00:56:25.399 INFO:tasks.workunit.client.0.smithi017.stdout:9/564: dread - d0/d58/d49/d5d/f74 zero size 2024-08-19T00:56:25.401 INFO:tasks.workunit.client.0.smithi017.stdout:7/703: dread d3/dc/df/d23/fae [0,4194304] 0 2024-08-19T00:56:25.408 INFO:tasks.workunit.client.0.smithi017.stdout:3/664: dwrite d5/da/d3c/f93 [4194304,4194304] 0 2024-08-19T00:56:25.410 INFO:tasks.workunit.client.0.smithi017.stdout:8/542: creat de/d15/d4f/d68/d84/f9a x:0 0 0 2024-08-19T00:56:25.418 INFO:tasks.workunit.client.0.smithi017.stdout:5/489: rmdir db/d19/d1f/d15/d3e/d40 39 2024-08-19T00:56:25.419 INFO:tasks.workunit.client.0.smithi017.stdout:0/574: dwrite d5/d17/d45/f72 [0,4194304] 0 2024-08-19T00:56:25.419 INFO:tasks.workunit.client.0.smithi017.stdout:3/665: dwrite d5/da/d27/d28/f80 [0,4194304] 0 2024-08-19T00:56:25.422 INFO:tasks.workunit.client.0.smithi017.stdout:4/636: mkdir d2/d11/dd6 0 2024-08-19T00:56:25.423 INFO:tasks.workunit.client.0.smithi017.stdout:4/637: read - d2/d87/db2/fbd zero size 2024-08-19T00:56:25.425 INFO:tasks.workunit.client.0.smithi017.stdout:4/638: write d2/d1a/d55/fad [779767,24477] 0 2024-08-19T00:56:25.426 INFO:tasks.workunit.client.0.smithi017.stdout:3/666: fsync d5/da/d3c/f93 0 2024-08-19T00:56:25.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:25 smithi017 ceph-mon[16627]: pgmap v23: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 79 MiB/s rd, 206 MiB/s wr, 426 op/s 2024-08-19T00:56:25.433 INFO:tasks.workunit.client.0.smithi017.stdout:6/642: truncate d5/f1e 1057709 0 2024-08-19T00:56:25.434 INFO:tasks.workunit.client.0.smithi017.stdout:6/643: fsync d5/d13/dcf/fdf 0 2024-08-19T00:56:25.441 INFO:tasks.workunit.client.0.smithi017.stdout:3/667: unlink d5/d15/d1b/c49 0 2024-08-19T00:56:25.441 INFO:tasks.workunit.client.0.smithi017.stdout:3/668: readlink d5/da/l13 0 2024-08-19T00:56:25.442 INFO:tasks.workunit.client.0.smithi017.stdout:8/543: rename de/d36/f48 to de/d15/d4f/d68/d84/f9b 0 2024-08-19T00:56:25.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:25 smithi086 ceph-mon[24511]: pgmap v23: 65 pgs: 65 active+clean; 3.2 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 79 MiB/s rd, 206 MiB/s wr, 426 op/s 2024-08-19T00:56:25.446 INFO:tasks.workunit.client.0.smithi017.stdout:6/644: mkdir d5/d13/d11/d2c/d4a/d64/de2 0 2024-08-19T00:56:25.449 INFO:tasks.workunit.client.0.smithi017.stdout:7/704: creat d3/dc/df/d1c/fe7 x:0 0 0 2024-08-19T00:56:25.450 INFO:tasks.workunit.client.0.smithi017.stdout:7/705: write d3/f51 [4512882,8014] 0 2024-08-19T00:56:25.450 INFO:tasks.workunit.client.0.smithi017.stdout:4/639: mkdir d2/dd7 0 2024-08-19T00:56:25.451 INFO:tasks.workunit.client.0.smithi017.stdout:4/640: write d2/d21/d40/f4c [409417,113062] 0 2024-08-19T00:56:25.453 INFO:tasks.workunit.client.0.smithi017.stdout:4/641: write d2/dc1/fc8 [789425,25736] 0 2024-08-19T00:56:25.455 INFO:tasks.workunit.client.0.smithi017.stdout:7/706: read d3/dc/df/d37/d46/d73/fa8 [2617215,93329] 0 2024-08-19T00:56:25.463 INFO:tasks.workunit.client.0.smithi017.stdout:0/575: dread d5/d17/d21/d42/f87 [0,4194304] 0 2024-08-19T00:56:25.464 INFO:tasks.workunit.client.0.smithi017.stdout:0/576: write d5/d17/d26/d30/d3e/d81/f8c [4027973,69948] 0 2024-08-19T00:56:25.465 INFO:tasks.workunit.client.0.smithi017.stdout:0/577: fsync d5/d17/f22 0 2024-08-19T00:56:25.496 INFO:tasks.workunit.client.0.smithi017.stdout:3/669: mknod d5/d15/d92/dca/cd2 0 2024-08-19T00:56:25.496 INFO:tasks.workunit.client.0.smithi017.stdout:3/670: dread - d5/fc9 zero size 2024-08-19T00:56:25.497 INFO:tasks.workunit.client.0.smithi017.stdout:3/671: fsync d5/da/d3c/d4f/d68/d9e/fce 0 2024-08-19T00:56:25.501 INFO:tasks.workunit.client.0.smithi017.stdout:9/565: dread d0/d33/f1b [0,4194304] 0 2024-08-19T00:56:25.504 INFO:tasks.workunit.client.0.smithi017.stdout:4/642: write d2/d1a/d20/f3b [2047327,3154] 0 2024-08-19T00:56:25.504 INFO:tasks.workunit.client.0.smithi017.stdout:7/707: symlink d3/dc/df/dd1/dd7/le8 0 2024-08-19T00:56:25.532 INFO:tasks.workunit.client.0.smithi017.stdout:0/578: creat d5/d17/d21/d42/d9b/fc6 x:0 0 0 2024-08-19T00:56:25.535 INFO:tasks.workunit.client.0.smithi017.stdout:5/490: getdents db/d19/d1f/d15/d3e/d40 0 2024-08-19T00:56:25.535 INFO:tasks.workunit.client.0.smithi017.stdout:5/491: chown db/d19/d57/f85 108223 1 2024-08-19T00:56:25.536 INFO:tasks.workunit.client.0.smithi017.stdout:0/579: dread d5/d17/d21/d42/f87 [0,4194304] 0 2024-08-19T00:56:25.538 INFO:tasks.workunit.client.0.smithi017.stdout:4/643: mknod d2/d11/d24/dc6/cd8 0 2024-08-19T00:56:25.545 INFO:tasks.workunit.client.0.smithi017.stdout:3/672: rename d5/da/d27/d28/f37 to d5/d11/d61/fd3 0 2024-08-19T00:56:25.546 INFO:tasks.workunit.client.0.smithi017.stdout:4/644: dwrite d2/d21/d40/d56/fa5 [0,4194304] 0 2024-08-19T00:56:25.549 INFO:tasks.workunit.client.0.smithi017.stdout:0/580: dread d5/d17/d21/f68 [0,4194304] 0 2024-08-19T00:56:25.549 INFO:tasks.workunit.client.0.smithi017.stdout:6/645: getdents d5/d13/d11/d2c/d4a 0 2024-08-19T00:56:25.550 INFO:tasks.workunit.client.0.smithi017.stdout:7/708: link d3/dc/df/d1c/d2c/d83/c8e d3/dc/df/d37/d93/ce9 0 2024-08-19T00:56:25.553 INFO:tasks.workunit.client.0.smithi017.stdout:7/709: write d3/f12 [1361984,85476] 0 2024-08-19T00:56:25.575 INFO:tasks.workunit.client.0.smithi017.stdout:1/644: sync 2024-08-19T00:56:25.575 INFO:tasks.workunit.client.0.smithi017.stdout:6/646: truncate d5/d13/dcf/fdf 668064 0 2024-08-19T00:56:25.575 INFO:tasks.workunit.client.0.smithi017.stdout:9/566: rename d0/d33/d22/d40/c46 to d0/d33/d22/d45/d9b/ca5 0 2024-08-19T00:56:25.576 INFO:tasks.workunit.client.0.smithi017.stdout:6/647: readlink d5/lb5 0 2024-08-19T00:56:25.578 INFO:tasks.workunit.client.0.smithi017.stdout:0/581: rmdir d5/d17/d26/d30/d5d 39 2024-08-19T00:56:25.578 INFO:tasks.workunit.client.0.smithi017.stdout:4/645: read - d2/d21/d40/f7f zero size 2024-08-19T00:56:25.578 INFO:tasks.workunit.client.0.smithi017.stdout:3/673: dwrite d5/d15/d1b/f7b [0,4194304] 0 2024-08-19T00:56:25.578 INFO:tasks.workunit.client.0.smithi017.stdout:8/544: dwrite de/d15/f45 [0,4194304] 0 2024-08-19T00:56:25.581 INFO:tasks.workunit.client.0.smithi017.stdout:7/710: truncate d3/dc/df/d37/fac 923772 0 2024-08-19T00:56:25.582 INFO:tasks.workunit.client.0.smithi017.stdout:1/645: creat d4/fcc x:0 0 0 2024-08-19T00:56:25.586 INFO:tasks.workunit.client.0.smithi017.stdout:9/567: mkdir d0/d33/d22/d85/da6 0 2024-08-19T00:56:25.587 INFO:tasks.workunit.client.0.smithi017.stdout:3/674: symlink d5/d11/ld4 0 2024-08-19T00:56:25.589 INFO:tasks.workunit.client.0.smithi017.stdout:9/568: fsync d0/d33/d22/d85/f91 0 2024-08-19T00:56:25.590 INFO:tasks.workunit.client.0.smithi017.stdout:8/545: dread de/d15/d4f/d68/d84/f9b [0,4194304] 0 2024-08-19T00:56:25.590 INFO:tasks.workunit.client.0.smithi017.stdout:4/646: truncate d2/d11/f46 1836450 0 2024-08-19T00:56:25.594 INFO:tasks.workunit.client.0.smithi017.stdout:4/647: stat d2/d21/d40/d56/cc2 0 2024-08-19T00:56:25.599 INFO:tasks.workunit.client.0.smithi017.stdout:4/648: chown d2/d21/d40/d56/f47 127826 1 2024-08-19T00:56:25.600 INFO:tasks.workunit.client.0.smithi017.stdout:0/582: write d5/d17/d21/d39/f85 [1211889,58684] 0 2024-08-19T00:56:25.601 INFO:tasks.workunit.client.0.smithi017.stdout:5/492: rename db/d19/d1f/d15/d1e/f3d to db/d19/d1f/fa9 0 2024-08-19T00:56:25.601 INFO:tasks.workunit.client.0.smithi017.stdout:6/648: dwrite d5/d13/d11/d2c/f46 [4194304,4194304] 0 2024-08-19T00:56:25.604 INFO:tasks.workunit.client.0.smithi017.stdout:8/546: creat de/d36/d74/d80/f9c x:0 0 0 2024-08-19T00:56:25.604 INFO:tasks.workunit.client.0.smithi017.stdout:1/646: dwrite d4/dc/d3b/d45/f92 [0,4194304] 0 2024-08-19T00:56:25.606 INFO:tasks.workunit.client.0.smithi017.stdout:0/583: chown d5/d17/f69 3 1 2024-08-19T00:56:25.608 INFO:tasks.workunit.client.0.smithi017.stdout:7/711: getdents d3/dc/df/dd1 0 2024-08-19T00:56:25.611 INFO:tasks.workunit.client.0.smithi017.stdout:7/712: chown d3/dc/df/d37/d46/d73/d80/d81 5 1 2024-08-19T00:56:25.613 INFO:tasks.workunit.client.0.smithi017.stdout:8/547: mkdir de/d15/d9d 0 2024-08-19T00:56:25.614 INFO:tasks.workunit.client.0.smithi017.stdout:9/569: write d0/f47 [284427,19669] 0 2024-08-19T00:56:25.615 INFO:tasks.workunit.client.0.smithi017.stdout:8/548: dread - de/d15/d4f/d68/d84/f9a zero size 2024-08-19T00:56:25.618 INFO:tasks.workunit.client.0.smithi017.stdout:4/649: mknod d2/d21/d53/d57/cd9 0 2024-08-19T00:56:25.625 INFO:tasks.workunit.client.0.smithi017.stdout:1/647: creat d4/dc/d3b/d3d/d83/d95/dca/fcd x:0 0 0 2024-08-19T00:56:25.629 INFO:tasks.workunit.client.0.smithi017.stdout:8/549: dwrite de/d36/d74/f8f [4194304,4194304] 0 2024-08-19T00:56:25.630 INFO:tasks.workunit.client.0.smithi017.stdout:0/584: write d5/d18/f4a [2510601,13322] 0 2024-08-19T00:56:25.632 INFO:tasks.workunit.client.0.smithi017.stdout:9/570: unlink d0/d58/d49/d70/c9d 0 2024-08-19T00:56:25.633 INFO:tasks.workunit.client.0.smithi017.stdout:6/649: dwrite d5/f4f [0,4194304] 0 2024-08-19T00:56:25.639 INFO:tasks.workunit.client.0.smithi017.stdout:4/650: dwrite d2/d1a/d55/fad [0,4194304] 0 2024-08-19T00:56:25.640 INFO:tasks.workunit.client.0.smithi017.stdout:6/650: mkdir d5/d7b/de3 0 2024-08-19T00:56:25.651 INFO:tasks.workunit.client.0.smithi017.stdout:8/550: dwrite de/d15/f35 [0,4194304] 0 2024-08-19T00:56:25.652 INFO:tasks.workunit.client.0.smithi017.stdout:0/585: mkdir d5/d17/d26/d30/d5d/db0/dc7 0 2024-08-19T00:56:25.653 INFO:tasks.workunit.client.0.smithi017.stdout:3/675: dread d5/d11/f14 [4194304,4194304] 0 2024-08-19T00:56:25.655 INFO:tasks.workunit.client.0.smithi017.stdout:1/648: dwrite d4/dc/d3b/d45/fbc [0,4194304] 0 2024-08-19T00:56:25.659 INFO:tasks.workunit.client.0.smithi017.stdout:4/651: rmdir d2/d1a/d55 39 2024-08-19T00:56:25.659 INFO:tasks.workunit.client.0.smithi017.stdout:8/551: rmdir de/d15/d39/d3d 39 2024-08-19T00:56:25.664 INFO:tasks.workunit.client.0.smithi017.stdout:5/493: dread db/f2e [0,4194304] 0 2024-08-19T00:56:25.667 INFO:tasks.workunit.client.0.smithi017.stdout:0/586: read - d5/d17/d2b/f7a zero size 2024-08-19T00:56:25.668 INFO:tasks.workunit.client.0.smithi017.stdout:5/494: readlink db/d19/d1f/d15/d3e/d40/l82 0 2024-08-19T00:56:25.668 INFO:tasks.workunit.client.0.smithi017.stdout:7/713: dwrite d3/dc/df/d37/f94 [0,4194304] 0 2024-08-19T00:56:25.670 INFO:tasks.workunit.client.0.smithi017.stdout:8/552: unlink de/d36/f7b 0 2024-08-19T00:56:25.670 INFO:tasks.workunit.client.0.smithi017.stdout:7/714: write d3/dc/f5b [3953929,70325] 0 2024-08-19T00:56:25.671 INFO:tasks.workunit.client.0.smithi017.stdout:2/663: sync 2024-08-19T00:56:25.671 INFO:tasks.workunit.client.0.smithi017.stdout:7/715: chown d3/dc/df/d23/d6a/db2 4082395 1 2024-08-19T00:56:25.673 INFO:tasks.workunit.client.0.smithi017.stdout:4/652: readlink d2/d21/d40/l5c 0 2024-08-19T00:56:25.674 INFO:tasks.workunit.client.0.smithi017.stdout:6/651: truncate d5/d13/d11/f3b 1123917 0 2024-08-19T00:56:25.677 INFO:tasks.workunit.client.0.smithi017.stdout:3/676: unlink d5/da/d27/c43 0 2024-08-19T00:56:25.679 INFO:tasks.workunit.client.0.smithi017.stdout:1/649: creat d4/dc/d3b/d3d/d54/da4/da6/db8/fce x:0 0 0 2024-08-19T00:56:25.680 INFO:tasks.workunit.client.0.smithi017.stdout:5/495: readlink db/l17 0 2024-08-19T00:56:25.681 INFO:tasks.workunit.client.0.smithi017.stdout:0/587: creat d5/d17/d21/d42/d9b/fc8 x:0 0 0 2024-08-19T00:56:25.683 INFO:tasks.workunit.client.0.smithi017.stdout:7/716: mknod d3/dc/df/d1c/d2c/cea 0 2024-08-19T00:56:25.685 INFO:tasks.workunit.client.0.smithi017.stdout:9/571: dread d0/d33/d22/d45/d8e/f99 [0,4194304] 0 2024-08-19T00:56:25.686 INFO:tasks.workunit.client.0.smithi017.stdout:6/652: dwrite d5/d13/d11/d52/fbc [0,4194304] 0 2024-08-19T00:56:25.686 INFO:tasks.workunit.client.0.smithi017.stdout:3/677: creat d5/d11/fd5 x:0 0 0 2024-08-19T00:56:25.688 INFO:tasks.workunit.client.0.smithi017.stdout:0/588: truncate d5/d17/d45/d77/fc3 482227 0 2024-08-19T00:56:25.690 INFO:tasks.workunit.client.0.smithi017.stdout:6/653: read d5/d13/d11/f37 [3410242,98973] 0 2024-08-19T00:56:25.690 INFO:tasks.workunit.client.0.smithi017.stdout:4/653: rename d2/d1a/d20/f86 to d2/d21/d40/d8b/fda 0 2024-08-19T00:56:25.690 INFO:tasks.workunit.client.0.smithi017.stdout:7/717: write d3/dc/df/d23/d69/fb4 [862361,27964] 0 2024-08-19T00:56:25.692 INFO:tasks.workunit.client.0.smithi017.stdout:7/718: chown d3 1568506 1 2024-08-19T00:56:25.695 INFO:tasks.workunit.client.0.smithi017.stdout:8/553: link de/d15/d4f/d68/d84/f9a de/d36/d74/f9e 0 2024-08-19T00:56:25.697 INFO:tasks.workunit.client.0.smithi017.stdout:1/650: creat d4/d1c/d1f/da5/fcf x:0 0 0 2024-08-19T00:56:25.697 INFO:tasks.workunit.client.0.smithi017.stdout:9/572: dwrite d0/d33/d22/d85/f91 [0,4194304] 0 2024-08-19T00:56:25.699 INFO:tasks.workunit.client.0.smithi017.stdout:1/651: chown d4/dc/d3b 99923589 1 2024-08-19T00:56:25.701 INFO:tasks.workunit.client.0.smithi017.stdout:5/496: unlink db/d19/d1f/d15/d3e/f79 0 2024-08-19T00:56:25.703 INFO:tasks.workunit.client.0.smithi017.stdout:3/678: dwrite d5/da/d27/d6e/fb1 [0,4194304] 0 2024-08-19T00:56:25.713 INFO:tasks.workunit.client.0.smithi017.stdout:6/654: write d5/fc0 [2759938,25702] 0 2024-08-19T00:56:25.717 INFO:tasks.workunit.client.0.smithi017.stdout:2/664: dwrite d2/d7/d10/d3b/d3c/d8a/d6b/f78 [0,4194304] 0 2024-08-19T00:56:25.729 INFO:tasks.workunit.client.0.smithi017.stdout:0/589: mknod d5/dba/cc9 0 2024-08-19T00:56:25.730 INFO:tasks.workunit.client.0.smithi017.stdout:4/654: rename d2/d1a/d55/d8f/fa0 to d2/d1a/dd0/fdb 0 2024-08-19T00:56:25.735 INFO:tasks.workunit.client.0.smithi017.stdout:9/573: getdents d0/d33/d22/d5a/da0/da1 0 2024-08-19T00:56:25.738 INFO:tasks.workunit.client.0.smithi017.stdout:5/497: mkdir db/d19/daa 0 2024-08-19T00:56:25.739 INFO:tasks.workunit.client.0.smithi017.stdout:3/679: mknod d5/d11/d61/cd6 0 2024-08-19T00:56:25.741 INFO:tasks.workunit.client.0.smithi017.stdout:0/590: rmdir d5/d17/d21/d39 39 2024-08-19T00:56:25.743 INFO:tasks.workunit.client.0.smithi017.stdout:0/591: dread - d5/d17/d26/d30/d3e/d81/f8e zero size 2024-08-19T00:56:25.743 INFO:tasks.workunit.client.0.smithi017.stdout:4/655: creat d2/d27/fdc x:0 0 0 2024-08-19T00:56:25.749 INFO:tasks.workunit.client.0.smithi017.stdout:2/665: mknod d2/cd8 0 2024-08-19T00:56:25.752 INFO:tasks.workunit.client.0.smithi017.stdout:4/656: dwrite d2/d1a/d20/f52 [0,4194304] 0 2024-08-19T00:56:25.753 INFO:tasks.workunit.client.0.smithi017.stdout:7/719: dwrite d3/f2e [0,4194304] 0 2024-08-19T00:56:25.755 INFO:tasks.workunit.client.0.smithi017.stdout:4/657: stat d2/d21/d40/d56/fa5 0 2024-08-19T00:56:25.755 INFO:tasks.workunit.client.0.smithi017.stdout:0/592: mkdir d5/d17/d26/d30/d3e/d81/dca 0 2024-08-19T00:56:25.756 INFO:tasks.workunit.client.0.smithi017.stdout:6/655: rmdir d5/d7b/de3 0 2024-08-19T00:56:25.758 INFO:tasks.workunit.client.0.smithi017.stdout:9/574: creat d0/d33/d22/d45/da2/fa7 x:0 0 0 2024-08-19T00:56:25.758 INFO:tasks.workunit.client.0.smithi017.stdout:2/666: truncate d2/d7/d10/d19/d48/f9c 1230019 0 2024-08-19T00:56:25.762 INFO:tasks.workunit.client.0.smithi017.stdout:3/680: dread d5/d11/d61/fd3 [0,4194304] 0 2024-08-19T00:56:25.767 INFO:tasks.workunit.client.0.smithi017.stdout:1/652: dwrite d4/dc/d3b/d45/f8d [0,4194304] 0 2024-08-19T00:56:25.774 INFO:tasks.workunit.client.0.smithi017.stdout:4/658: dwrite d2/d21/d40/d56/fa5 [0,4194304] 0 2024-08-19T00:56:25.782 INFO:tasks.workunit.client.0.smithi017.stdout:6/656: rename d5/d13/d20/d77/c7a to d5/d13/d11/d4d/ce4 0 2024-08-19T00:56:25.782 INFO:tasks.workunit.client.0.smithi017.stdout:7/720: dwrite d3/dc/df/d1c/d2c/d83/fe3 [0,4194304] 0 2024-08-19T00:56:25.783 INFO:tasks.workunit.client.0.smithi017.stdout:6/657: stat d5/d13/f3e 0 2024-08-19T00:56:25.783 INFO:tasks.workunit.client.0.smithi017.stdout:7/721: dread - d3/d3c/d88/fc0 zero size 2024-08-19T00:56:25.786 INFO:tasks.workunit.client.0.smithi017.stdout:7/722: write d3/dc/df/d23/d6a/db6/fbb [10375,123158] 0 2024-08-19T00:56:25.794 INFO:tasks.workunit.client.0.smithi017.stdout:4/659: dwrite d2/d21/d40/d56/f7d [4194304,4194304] 0 2024-08-19T00:56:25.798 INFO:tasks.workunit.client.0.smithi017.stdout:0/593: link d5/d18/d78/lb4 d5/d17/d21/lcb 0 2024-08-19T00:56:25.799 INFO:tasks.workunit.client.0.smithi017.stdout:9/575: write d0/d33/d22/d45/d8e/f7a [2492267,74667] 0 2024-08-19T00:56:25.800 INFO:tasks.workunit.client.0.smithi017.stdout:1/653: write d4/dc/d19/fac [751959,49085] 0 2024-08-19T00:56:25.803 INFO:tasks.workunit.client.0.smithi017.stdout:2/667: dwrite d2/d7/d10/d19/f1d [0,4194304] 0 2024-08-19T00:56:25.804 INFO:tasks.workunit.client.0.smithi017.stdout:1/654: stat d4/dc/d3b/d45/f4d 0 2024-08-19T00:56:25.805 INFO:tasks.workunit.client.0.smithi017.stdout:6/658: mkdir d5/d13/de5 0 2024-08-19T00:56:25.806 INFO:tasks.workunit.client.0.smithi017.stdout:1/655: dread - d4/dc/d3b/d3d/d83/d95/fb9 zero size 2024-08-19T00:56:25.811 INFO:tasks.workunit.client.0.smithi017.stdout:9/576: mknod d0/d33/d22/d40/ca8 0 2024-08-19T00:56:25.813 INFO:tasks.workunit.client.0.smithi017.stdout:9/577: write d0/d33/d22/d45/da2/fa7 [322474,32501] 0 2024-08-19T00:56:25.816 INFO:tasks.workunit.client.0.smithi017.stdout:9/578: read d0/d58/f3e [3811014,106036] 0 2024-08-19T00:56:25.819 INFO:tasks.workunit.client.0.smithi017.stdout:6/659: unlink d5/d13/d11/f59 0 2024-08-19T00:56:25.819 INFO:tasks.workunit.client.0.smithi017.stdout:1/656: dread d4/dc/f18 [0,4194304] 0 2024-08-19T00:56:25.819 INFO:tasks.workunit.client.0.smithi017.stdout:1/657: stat d4/d78 0 2024-08-19T00:56:25.821 INFO:tasks.workunit.client.0.smithi017.stdout:4/660: creat d2/d1a/dd0/dd4/fdd x:0 0 0 2024-08-19T00:56:25.822 INFO:tasks.workunit.client.0.smithi017.stdout:1/658: read d4/dc/f11 [964448,22411] 0 2024-08-19T00:56:25.824 INFO:tasks.workunit.client.0.smithi017.stdout:7/723: creat d3/dc/df/d37/feb x:0 0 0 2024-08-19T00:56:25.825 INFO:tasks.workunit.client.0.smithi017.stdout:9/579: rmdir d0/d33/d22/d45/d9b 39 2024-08-19T00:56:25.829 INFO:tasks.workunit.client.0.smithi017.stdout:6/660: symlink d5/d13/d11/d2c/d4a/d64/d86/d90/dba/le6 0 2024-08-19T00:56:25.830 INFO:tasks.workunit.client.0.smithi017.stdout:2/668: write d2/d7/f96 [841699,114199] 0 2024-08-19T00:56:25.831 INFO:tasks.workunit.client.0.smithi017.stdout:4/661: dwrite d2/d21/d53/f74 [0,4194304] 0 2024-08-19T00:56:25.832 INFO:tasks.workunit.client.0.smithi017.stdout:6/661: chown d5/d13/d11/d2c/l44 77 1 2024-08-19T00:56:25.832 INFO:tasks.workunit.client.0.smithi017.stdout:2/669: readlink d2/d7/d10/d35/d45/d58/dbf/d7a/l87 0 2024-08-19T00:56:25.834 INFO:tasks.workunit.client.0.smithi017.stdout:4/662: read d2/f6 [2013457,123993] 0 2024-08-19T00:56:25.836 INFO:tasks.workunit.client.0.smithi017.stdout:6/662: write d5/d13/d11/d2c/d4a/d64/d86/d90/fda [35133,40154] 0 2024-08-19T00:56:25.839 INFO:tasks.workunit.client.0.smithi017.stdout:1/659: mknod d4/d1c/d1f/cd0 0 2024-08-19T00:56:25.841 INFO:tasks.workunit.client.0.smithi017.stdout:9/580: unlink d0/d33/f39 0 2024-08-19T00:56:25.844 INFO:tasks.workunit.client.0.smithi017.stdout:0/594: getdents d5 0 2024-08-19T00:56:25.845 INFO:tasks.workunit.client.0.smithi017.stdout:4/663: creat d2/d21/d40/fde x:0 0 0 2024-08-19T00:56:25.845 INFO:tasks.workunit.client.0.smithi017.stdout:0/595: chown d5/d17/d26/d30/d5d/lbd 2 1 2024-08-19T00:56:25.847 INFO:tasks.workunit.client.0.smithi017.stdout:1/660: mkdir d4/dd1 0 2024-08-19T00:56:25.849 INFO:tasks.workunit.client.0.smithi017.stdout:6/663: mkdir d5/d13/d11/d2c/d4a/d64/d86/d90/dba/de7 0 2024-08-19T00:56:25.850 INFO:tasks.workunit.client.0.smithi017.stdout:9/581: symlink d0/d33/d22/d40/la9 0 2024-08-19T00:56:25.851 INFO:tasks.workunit.client.0.smithi017.stdout:7/724: creat d3/dc/df/fec x:0 0 0 2024-08-19T00:56:25.859 INFO:tasks.workunit.client.0.smithi017.stdout:7/725: dread d3/dc/df/d37/d46/f9d [0,4194304] 0 2024-08-19T00:56:25.861 INFO:tasks.workunit.client.0.smithi017.stdout:2/670: dread d2/d7/d10/d3b/d54/f4f [0,4194304] 0 2024-08-19T00:56:25.863 INFO:tasks.workunit.client.0.smithi017.stdout:2/671: read d2/d7/d10/f47 [3740180,127304] 0 2024-08-19T00:56:25.866 INFO:tasks.workunit.client.0.smithi017.stdout:0/596: dread d5/d17/d26/d30/f58 [0,4194304] 0 2024-08-19T00:56:25.868 INFO:tasks.workunit.client.0.smithi017.stdout:4/664: write d2/d16/f1f [168544,63966] 0 2024-08-19T00:56:25.870 INFO:tasks.workunit.client.0.smithi017.stdout:4/665: chown d2/d1a/dd0/fc5 1641514 1 2024-08-19T00:56:25.871 INFO:tasks.workunit.client.0.smithi017.stdout:6/664: write d5/f1e [1977739,14366] 0 2024-08-19T00:56:25.873 INFO:tasks.workunit.client.0.smithi017.stdout:9/582: write d0/f60 [8321511,12382] 0 2024-08-19T00:56:25.875 INFO:tasks.workunit.client.0.smithi017.stdout:1/661: creat d4/dc/d3b/fd2 x:0 0 0 2024-08-19T00:56:25.875 INFO:tasks.workunit.client.0.smithi017.stdout:7/726: write d3/dc/df/d37/d46/f9d [716856,13817] 0 2024-08-19T00:56:25.876 INFO:tasks.workunit.client.0.smithi017.stdout:2/672: chown d2/d7/d10/d3b/d3c/d8a/c66 728322 1 2024-08-19T00:56:25.878 INFO:tasks.workunit.client.0.smithi017.stdout:7/727: write d3/dc/df/d37/d46/f57 [820911,18642] 0 2024-08-19T00:56:25.878 INFO:tasks.workunit.client.0.smithi017.stdout:0/597: fsync d5/d17/d21/f2d 0 2024-08-19T00:56:25.881 INFO:tasks.workunit.client.0.smithi017.stdout:1/662: dread d4/fba [0,4194304] 0 2024-08-19T00:56:25.882 INFO:tasks.workunit.client.0.smithi017.stdout:0/598: fsync d5/d17/d26/d30/d5d/db0/fa6 0 2024-08-19T00:56:25.932 INFO:tasks.workunit.client.0.smithi017.stdout:9/583: dwrite d0/d58/d49/d70/f90 [0,4194304] 0 2024-08-19T00:56:25.932 INFO:tasks.workunit.client.0.smithi017.stdout:4/666: mknod d2/d21/d53/d57/dce/cdf 0 2024-08-19T00:56:25.934 INFO:tasks.workunit.client.0.smithi017.stdout:4/667: chown d2/d27/c5d 13419615 1 2024-08-19T00:56:25.939 INFO:tasks.workunit.client.0.smithi017.stdout:6/665: dwrite d5/d13/d11/d93/fb0 [0,4194304] 0 2024-08-19T00:56:25.940 INFO:tasks.workunit.client.0.smithi017.stdout:0/599: read - d5/d17/d45/d50/f96 zero size 2024-08-19T00:56:25.940 INFO:tasks.workunit.client.0.smithi017.stdout:2/673: unlink d2/l22 0 2024-08-19T00:56:25.945 INFO:tasks.workunit.client.0.smithi017.stdout:4/668: fdatasync d2/d21/f42 0 2024-08-19T00:56:25.949 INFO:tasks.workunit.client.0.smithi017.stdout:7/728: dwrite d3/dc/df/d1a/f4a [0,4194304] 0 2024-08-19T00:56:25.949 INFO:tasks.workunit.client.0.smithi017.stdout:0/600: read d5/d17/d45/fb3 [454771,29437] 0 2024-08-19T00:56:25.950 INFO:tasks.workunit.client.0.smithi017.stdout:2/674: truncate d2/d7/d29/f52 28632 0 2024-08-19T00:56:25.952 INFO:tasks.workunit.client.0.smithi017.stdout:4/669: rmdir d2/d1a/dd0/dd4 39 2024-08-19T00:56:25.955 INFO:tasks.workunit.client.0.smithi017.stdout:6/666: truncate d5/d13/d11/d2c/d4a/d64/d86/d90/fda 153487 0 2024-08-19T00:56:25.955 INFO:tasks.workunit.client.0.smithi017.stdout:1/663: dread d4/dc/d3b/d3d/f7d [0,4194304] 0 2024-08-19T00:56:25.956 INFO:tasks.workunit.client.0.smithi017.stdout:4/670: write d2/d21/d40/fde [143436,21834] 0 2024-08-19T00:56:25.956 INFO:tasks.workunit.client.0.smithi017.stdout:0/601: chown d5/d17/d2b/l7d 78380 1 2024-08-19T00:56:25.959 INFO:tasks.workunit.client.0.smithi017.stdout:4/671: chown d2/d21/d40/d56/d99/da3/fba 3494712 1 2024-08-19T00:56:25.959 INFO:tasks.workunit.client.0.smithi017.stdout:7/729: unlink d3/dc/df/d1c/f55 0 2024-08-19T00:56:25.964 INFO:tasks.workunit.client.0.smithi017.stdout:1/664: symlink d4/dc/d3b/d3d/da8/d62/ld3 0 2024-08-19T00:56:25.964 INFO:tasks.workunit.client.0.smithi017.stdout:2/675: rmdir d2/d7/d29 39 2024-08-19T00:56:25.969 INFO:tasks.workunit.client.0.smithi017.stdout:7/730: unlink d3/dc/df/d37/d46/d73/d80/ldd 0 2024-08-19T00:56:25.972 INFO:tasks.workunit.client.0.smithi017.stdout:6/667: creat d5/d13/fe8 x:0 0 0 2024-08-19T00:56:25.972 INFO:tasks.workunit.client.0.smithi017.stdout:6/668: chown d5/d13/fd0 778 1 2024-08-19T00:56:25.973 INFO:tasks.workunit.client.0.smithi017.stdout:6/669: read - d5/d13/d11/d2c/d4a/d64/fd3 zero size 2024-08-19T00:56:25.976 INFO:tasks.workunit.client.0.smithi017.stdout:4/672: creat d2/d87/dbc/fe0 x:0 0 0 2024-08-19T00:56:25.978 INFO:tasks.workunit.client.0.smithi017.stdout:9/584: truncate d0/d33/d22/d45/d8e/f86 1262631 0 2024-08-19T00:56:25.983 INFO:tasks.workunit.client.0.smithi017.stdout:0/602: dwrite d5/d17/d2b/f7a [0,4194304] 0 2024-08-19T00:56:25.984 INFO:tasks.workunit.client.0.smithi017.stdout:1/665: write d4/dc/d3b/d9d/f89 [1031481,63159] 0 2024-08-19T00:56:25.988 INFO:tasks.workunit.client.0.smithi017.stdout:1/666: dread - d4/dc/d3b/d3d/da8/d62/f96 zero size 2024-08-19T00:56:25.991 INFO:tasks.workunit.client.0.smithi017.stdout:0/603: mknod d5/d18/d3a/dc1/ccc 0 2024-08-19T00:56:25.994 INFO:tasks.workunit.client.0.smithi017.stdout:7/731: dread d3/dc/df/d37/d46/d73/fa8 [0,4194304] 0 2024-08-19T00:56:25.995 INFO:tasks.workunit.client.0.smithi017.stdout:6/670: rmdir d5/d13/d11/d2c/d4a/da8/dd1/d8f/ddc 0 2024-08-19T00:56:25.997 INFO:tasks.workunit.client.0.smithi017.stdout:1/667: fdatasync d4/fba 0 2024-08-19T00:56:26.001 INFO:tasks.workunit.client.0.smithi017.stdout:0/604: dwrite d5/d17/d45/f72 [0,4194304] 0 2024-08-19T00:56:26.001 INFO:tasks.workunit.client.0.smithi017.stdout:7/732: fsync d3/dc/df/d1c/d2c/d83/f86 0 2024-08-19T00:56:26.002 INFO:tasks.workunit.client.0.smithi017.stdout:6/671: truncate d5/d13/d11/d52/fb2 4998090 0 2024-08-19T00:56:26.002 INFO:tasks.workunit.client.0.smithi017.stdout:2/676: dread d2/d7/d10/d35/d84/f94 [0,4194304] 0 2024-08-19T00:56:26.005 INFO:tasks.workunit.client.0.smithi017.stdout:2/677: write d2/d7/d10/d35/d45/d58/fb2 [421835,92290] 0 2024-08-19T00:56:26.007 INFO:tasks.workunit.client.0.smithi017.stdout:4/673: dread d2/d1a/d20/f3b [0,4194304] 0 2024-08-19T00:56:26.008 INFO:tasks.workunit.client.0.smithi017.stdout:7/733: mkdir d3/dab/ded 0 2024-08-19T00:56:26.012 INFO:tasks.workunit.client.0.smithi017.stdout:1/668: mknod d4/d1c/d1f/da5/db4/cd4 0 2024-08-19T00:56:26.013 INFO:tasks.workunit.client.0.smithi017.stdout:6/672: read d5/d13/d11/d2c/f30 [587505,48813] 0 2024-08-19T00:56:26.014 INFO:tasks.workunit.client.0.smithi017.stdout:1/669: read d4/dc/d3b/f80 [3332457,4859] 0 2024-08-19T00:56:26.014 INFO:tasks.workunit.client.0.smithi017.stdout:6/673: readlink d5/d13/d20/lbd 0 2024-08-19T00:56:26.016 INFO:tasks.workunit.client.0.smithi017.stdout:6/674: chown d5/d13/d11/d2c/l44 3726 1 2024-08-19T00:56:26.017 INFO:tasks.workunit.client.0.smithi017.stdout:2/678: rename d2/d7/l30 to d2/d7/d10/d35/d45/d58/dbf/ld9 0 2024-08-19T00:56:26.024 INFO:tasks.workunit.client.0.smithi017.stdout:9/585: dread d0/d33/f4d [0,4194304] 0 2024-08-19T00:56:26.024 INFO:tasks.workunit.client.0.smithi017.stdout:6/675: chown d5/d13/d11/d2c/fc3 20 1 2024-08-19T00:56:26.027 INFO:tasks.workunit.client.0.smithi017.stdout:7/734: dwrite d3/dc/df/d3d/d90/fcb [0,4194304] 0 2024-08-19T00:56:26.029 INFO:tasks.workunit.client.0.smithi017.stdout:6/676: dread d5/d13/d11/d2c/f76 [0,4194304] 0 2024-08-19T00:56:26.037 INFO:tasks.workunit.client.0.smithi017.stdout:1/670: link d4/dc/d3b/d3d/da8/d62/f8a d4/dd1/fd5 0 2024-08-19T00:56:26.038 INFO:tasks.workunit.client.0.smithi017.stdout:1/671: write d4/dc/d3b/d9d/f89 [1351395,23100] 0 2024-08-19T00:56:26.046 INFO:tasks.workunit.client.0.smithi017.stdout:4/674: write d2/d11/f46 [2391010,34600] 0 2024-08-19T00:56:26.046 INFO:tasks.workunit.client.0.smithi017.stdout:1/672: dwrite d4/d1c/d1f/da5/fcf [0,4194304] 0 2024-08-19T00:56:26.051 INFO:tasks.workunit.client.0.smithi017.stdout:7/735: mkdir d3/dc/df/d23/d6a/dee 0 2024-08-19T00:56:26.053 INFO:tasks.workunit.client.0.smithi017.stdout:7/736: chown d3/dc/df/dd1/dd7/le8 24891543 1 2024-08-19T00:56:26.053 INFO:tasks.workunit.client.0.smithi017.stdout:6/677: creat d5/d7b/fe9 x:0 0 0 2024-08-19T00:56:26.054 INFO:tasks.workunit.client.0.smithi017.stdout:6/678: fdatasync d5/d13/d11/d52/fbc 0 2024-08-19T00:56:26.057 INFO:tasks.workunit.client.0.smithi017.stdout:6/679: write d5/d13/d11/d2c/d4a/d64/d86/d90/dba/dbf/fc2 [211769,112367] 0 2024-08-19T00:56:26.058 INFO:tasks.workunit.client.0.smithi017.stdout:9/586: mknod d0/d58/caa 0 2024-08-19T00:56:26.065 INFO:tasks.workunit.client.0.smithi017.stdout:6/680: dwrite d5/d13/d11/d2c/d4a/da8/dd1/d8f/f97 [0,4194304] 0 2024-08-19T00:56:26.103 INFO:tasks.workunit.client.0.smithi017.stdout:4/675: dread d2/d1a/f69 [0,4194304] 0 2024-08-19T00:56:26.103 INFO:tasks.workunit.client.0.smithi017.stdout:9/587: stat d0/c1c 0 2024-08-19T00:56:26.104 INFO:tasks.workunit.client.0.smithi017.stdout:2/679: write d2/d7/d29/f52 [129851,120908] 0 2024-08-19T00:56:26.104 INFO:tasks.workunit.client.0.smithi017.stdout:7/737: mknod d3/dc/df/d1c/cef 0 2024-08-19T00:56:26.106 INFO:tasks.workunit.client.0.smithi017.stdout:9/588: write d0/d33/d22/d45/f94 [4517760,34780] 0 2024-08-19T00:56:26.107 INFO:tasks.workunit.client.0.smithi017.stdout:2/680: write d2/d7/d10/d19/d48/f82 [1092175,108269] 0 2024-08-19T00:56:26.170 INFO:tasks.workunit.client.0.smithi017.stdout:9/589: dwrite d0/d33/d22/d45/da2/fa7 [0,4194304] 0 2024-08-19T00:56:26.174 INFO:tasks.workunit.client.0.smithi017.stdout:7/738: dread d3/dc/df/d37/d46/d73/d80/d81/f99 [0,4194304] 0 2024-08-19T00:56:26.202 INFO:tasks.workunit.client.0.smithi017.stdout:4/676: dread d2/d1a/d55/f89 [0,4194304] 0 2024-08-19T00:56:26.203 INFO:tasks.workunit.client.0.smithi017.stdout:1/673: getdents d4/dc/d3b/d3d/d83/d95 0 2024-08-19T00:56:26.205 INFO:tasks.workunit.client.0.smithi017.stdout:6/681: dwrite d5/d13/d11/d2c/d4a/da8/dd1/f6c [0,4194304] 0 2024-08-19T00:56:26.206 INFO:tasks.workunit.client.0.smithi017.stdout:2/681: creat d2/d7/d10/d3b/d80/fda x:0 0 0 2024-08-19T00:56:26.211 INFO:tasks.workunit.client.0.smithi017.stdout:9/590: symlink d0/d33/d22/lab 0 2024-08-19T00:56:26.214 INFO:tasks.workunit.client.0.smithi017.stdout:7/739: mknod d3/dc/df/d3d/d90/cf0 0 2024-08-19T00:56:26.215 INFO:tasks.workunit.client.0.smithi017.stdout:2/682: dwrite d2/d7/d10/d3b/d97/fd4 [0,4194304] 0 2024-08-19T00:56:26.216 INFO:tasks.workunit.client.0.smithi017.stdout:2/683: fsync d2/d7/fce 0 2024-08-19T00:56:26.222 INFO:tasks.workunit.client.0.smithi017.stdout:7/740: dwrite d3/dc/df/d1a/f4a [4194304,4194304] 0 2024-08-19T00:56:26.223 INFO:tasks.workunit.client.0.smithi017.stdout:7/741: write d3/dc/f5b [2606103,59024] 0 2024-08-19T00:56:26.225 INFO:tasks.workunit.client.0.smithi017.stdout:4/677: rename d2/d21/d53/d57/cd9 to d2/d11/d24/dc6/ce1 0 2024-08-19T00:56:26.226 INFO:tasks.workunit.client.0.smithi017.stdout:4/678: stat d2/d21/d40/f4c 0 2024-08-19T00:56:26.227 INFO:tasks.workunit.client.0.smithi017.stdout:1/674: dread d4/dc/d3b/d3d/da8/fae [0,4194304] 0 2024-08-19T00:56:26.234 INFO:tasks.workunit.client.0.smithi017.stdout:2/684: fdatasync d2/d7/d10/d35/d45/d58/dbf/f7f 0 2024-08-19T00:56:26.236 INFO:tasks.workunit.client.0.smithi017.stdout:1/675: dwrite d4/dc/d3b/f50 [4194304,4194304] 0 2024-08-19T00:56:26.237 INFO:tasks.workunit.client.0.smithi017.stdout:2/685: dread - d2/d7/d10/d3b/d80/da2/fcb zero size 2024-08-19T00:56:26.252 INFO:tasks.workunit.client.0.smithi017.stdout:2/686: truncate d2/d7/d10/d3b/d80/f8f 1242421 0 2024-08-19T00:56:26.255 INFO:tasks.workunit.client.0.smithi017.stdout:4/679: mkdir d2/d1a/dd0/dd4/de2 0 2024-08-19T00:56:26.256 INFO:tasks.workunit.client.0.smithi017.stdout:4/680: truncate d2/d1a/dd0/fc4 333838 0 2024-08-19T00:56:26.264 INFO:tasks.workunit.client.0.smithi017.stdout:2/687: symlink d2/d7/d10/d9f/ldb 0 2024-08-19T00:56:26.265 INFO:tasks.workunit.client.0.smithi017.stdout:4/681: symlink d2/dd7/le3 0 2024-08-19T00:56:26.266 INFO:tasks.workunit.client.0.smithi017.stdout:2/688: symlink d2/d7/d10/d9f/ldc 0 2024-08-19T00:56:26.268 INFO:tasks.workunit.client.0.smithi017.stdout:4/682: chown d2/d1a/da1 99057 1 2024-08-19T00:56:26.269 INFO:tasks.workunit.client.0.smithi017.stdout:2/689: mkdir d2/d7/d10/d19/d48/ddd 0 2024-08-19T00:56:26.271 INFO:tasks.workunit.client.0.smithi017.stdout:4/683: mknod d2/d21/d40/d56/d99/ce4 0 2024-08-19T00:56:26.272 INFO:tasks.workunit.client.0.smithi017.stdout:7/742: write d3/dc/df/d23/d69/f98 [228462,95073] 0 2024-08-19T00:56:26.273 INFO:tasks.workunit.client.0.smithi017.stdout:2/690: creat d2/d7/d10/d19/fde x:0 0 0 2024-08-19T00:56:26.286 INFO:tasks.workunit.client.0.smithi017.stdout:2/691: rename d2/d7/d10/d35/c36 to d2/d7/d10/d35/d84/cdf 0 2024-08-19T00:56:26.288 INFO:tasks.workunit.client.0.smithi017.stdout:7/743: link d3/dc/l7e d3/dc/df/d3d/d92/lf1 0 2024-08-19T00:56:26.297 INFO:tasks.workunit.client.0.smithi017.stdout:7/744: link d3/d3c/d88/f8b d3/d3c/ff2 0 2024-08-19T00:56:26.304 INFO:tasks.workunit.client.0.smithi017.stdout:7/745: dwrite d3/dc/df/d23/d69/fb4 [0,4194304] 0 2024-08-19T00:56:26.305 INFO:tasks.workunit.client.0.smithi017.stdout:6/682: truncate d5/d13/d11/d2c/d51/fa3 223947 0 2024-08-19T00:56:26.308 INFO:tasks.workunit.client.0.smithi017.stdout:6/683: symlink d5/d13/dcf/lea 0 2024-08-19T00:56:26.312 INFO:tasks.workunit.client.0.smithi017.stdout:1/676: write d4/fc7 [530092,63307] 0 2024-08-19T00:56:26.312 INFO:tasks.workunit.client.0.smithi017.stdout:6/684: symlink d5/d13/dcf/leb 0 2024-08-19T00:56:26.314 INFO:tasks.workunit.client.0.smithi017.stdout:1/677: read d4/d1c/f2a [2593855,111498] 0 2024-08-19T00:56:26.315 INFO:tasks.workunit.client.0.smithi017.stdout:7/746: mkdir d3/dc/df/d23/d69/dd8/df3 0 2024-08-19T00:56:26.315 INFO:tasks.workunit.client.0.smithi017.stdout:6/685: chown d5/d13/d11/d2c/d4a/d64/d86/d90/dba/le6 265 1 2024-08-19T00:56:26.317 INFO:tasks.workunit.client.0.smithi017.stdout:1/678: unlink d4/d1c/d75/cc5 0 2024-08-19T00:56:26.318 INFO:tasks.workunit.client.0.smithi017.stdout:1/679: read - d4/dc/d3b/d9d/f8c zero size 2024-08-19T00:56:26.319 INFO:tasks.workunit.client.0.smithi017.stdout:1/680: dread - d4/dc/f71 zero size 2024-08-19T00:56:26.320 INFO:tasks.workunit.client.0.smithi017.stdout:7/747: chown d3/dc/df/d1c/d2c/l4d 132272738 1 2024-08-19T00:56:26.321 INFO:tasks.workunit.client.0.smithi017.stdout:6/686: symlink d5/d13/d11/d52/lec 0 2024-08-19T00:56:26.325 INFO:tasks.workunit.client.0.smithi017.stdout:1/681: dread d4/dc/d3b/d9d/f89 [0,4194304] 0 2024-08-19T00:56:26.325 INFO:tasks.workunit.client.0.smithi017.stdout:7/748: fsync d3/dc/df/d7d/f9b 0 2024-08-19T00:56:26.326 INFO:tasks.workunit.client.0.smithi017.stdout:7/749: read d3/dc/df/d37/d46/d73/fa8 [2055278,91318] 0 2024-08-19T00:56:26.356 INFO:tasks.workunit.client.0.smithi017.stdout:4/684: dwrite d2/f61 [0,4194304] 0 2024-08-19T00:56:26.373 INFO:tasks.workunit.client.0.smithi017.stdout:2/692: write d2/d7/d10/d3b/d80/d81/fcc [198970,22744] 0 2024-08-19T00:56:26.378 INFO:tasks.workunit.client.0.smithi017.stdout:2/693: creat d2/d7/d10/d35/d7e/fe0 x:0 0 0 2024-08-19T00:56:26.393 INFO:tasks.workunit.client.0.smithi017.stdout:7/750: rmdir d3/dc/df 39 2024-08-19T00:56:26.402 INFO:tasks.workunit.client.0.smithi017.stdout:1/682: rename d4/d1c to d4/dc/d17/dd6 0 2024-08-19T00:56:26.403 INFO:tasks.workunit.client.0.smithi017.stdout:7/751: getdents d3/dc/df/d23/d6a 0 2024-08-19T00:56:26.404 INFO:tasks.workunit.client.0.smithi017.stdout:1/683: dread d4/dc/f18 [0,4194304] 0 2024-08-19T00:56:26.411 INFO:tasks.workunit.client.0.smithi017.stdout:1/684: unlink d4/dc/d17/dd6/d75/l9f 0 2024-08-19T00:56:26.414 INFO:tasks.workunit.client.0.smithi017.stdout:7/752: dwrite d3/dc/df/d37/d46/d73/fa8 [0,4194304] 0 2024-08-19T00:56:26.416 INFO:tasks.workunit.client.0.smithi017.stdout:6/687: dwrite d5/d13/d11/d2c/f76 [0,4194304] 0 2024-08-19T00:56:26.417 INFO:tasks.workunit.client.0.smithi017.stdout:6/688: dread - d5/d13/fe8 zero size 2024-08-19T00:56:26.421 INFO:tasks.workunit.client.0.smithi017.stdout:6/689: chown d5/d13/d11/f9f 3027 1 2024-08-19T00:56:26.423 INFO:tasks.workunit.client.0.smithi017.stdout:1/685: symlink d4/dd1/ld7 0 2024-08-19T00:56:26.425 INFO:tasks.workunit.client.0.smithi017.stdout:6/690: write d5/d13/d11/f9f [212679,88734] 0 2024-08-19T00:56:26.427 INFO:tasks.workunit.client.0.smithi017.stdout:7/753: dwrite d3/dc/d5f/fb8 [0,4194304] 0 2024-08-19T00:56:26.428 INFO:tasks.workunit.client.0.smithi017.stdout:7/754: chown d3/dc/df/d1a 2163820 1 2024-08-19T00:56:26.432 INFO:tasks.workunit.client.0.smithi017.stdout:1/686: symlink d4/dc/d17/dd6/d1f/da5/ld8 0 2024-08-19T00:56:26.434 INFO:tasks.workunit.client.0.smithi017.stdout:6/691: mknod d5/d13/d11/d2c/d4a/d64/de2/ced 0 2024-08-19T00:56:26.435 INFO:tasks.workunit.client.0.smithi017.stdout:1/687: mknod d4/dc/d3b/d45/dc0/cd9 0 2024-08-19T00:56:26.438 INFO:tasks.workunit.client.0.smithi017.stdout:1/688: symlink d4/dc/d3b/d3d/d54/da4/lda 0 2024-08-19T00:56:26.450 INFO:tasks.workunit.client.0.smithi017.stdout:4/685: dwrite d2/d16/d70/f80 [0,4194304] 0 2024-08-19T00:56:26.453 INFO:tasks.workunit.client.0.smithi017.stdout:4/686: write d2/d11/f33 [468418,27958] 0 2024-08-19T00:56:26.462 INFO:tasks.workunit.client.0.smithi017.stdout:4/687: creat d2/d1a/da1/fe5 x:0 0 0 2024-08-19T00:56:26.465 INFO:tasks.workunit.client.0.smithi017.stdout:4/688: truncate d2/d1a/d55/fad 4371602 0 2024-08-19T00:56:26.469 INFO:tasks.workunit.client.0.smithi017.stdout:4/689: stat d2/d21/d40/d8b/fb8 0 2024-08-19T00:56:26.469 INFO:tasks.workunit.client.0.smithi017.stdout:2/694: dwrite d2/d7/d10/d3b/fb4 [0,4194304] 0 2024-08-19T00:56:26.469 INFO:tasks.workunit.client.0.smithi017.stdout:7/755: dread d3/dc/df/d23/d69/f6f [4194304,4194304] 0 2024-08-19T00:56:26.470 INFO:tasks.workunit.client.0.smithi017.stdout:4/690: fsync d2/d1a/d55/fad 0 2024-08-19T00:56:26.473 INFO:tasks.workunit.client.0.smithi017.stdout:4/691: read d2/d21/d40/d56/f7d [5877882,92603] 0 2024-08-19T00:56:26.477 INFO:tasks.workunit.client.0.smithi017.stdout:2/695: creat d2/d7/d10/d3b/d80/da2/fe1 x:0 0 0 2024-08-19T00:56:26.480 INFO:tasks.workunit.client.0.smithi017.stdout:1/689: rename d4/dc/d3b/d3d/d54/da4 to d4/dc/d17/dd6/d75/d9c/ddb 0 2024-08-19T00:56:26.480 INFO:tasks.workunit.client.0.smithi017.stdout:7/756: dwrite d3/dc/df/d23/d69/fb4 [0,4194304] 0 2024-08-19T00:56:26.493 INFO:tasks.workunit.client.0.smithi017.stdout:4/692: rename d2/d21 to d2/d87/db2/de6 0 2024-08-19T00:56:26.501 INFO:tasks.workunit.client.0.smithi017.stdout:1/690: unlink d4/dc/d17/d1d/c35 0 2024-08-19T00:56:26.504 INFO:tasks.workunit.client.0.smithi017.stdout:2/696: write d2/d7/fc [861284,17434] 0 2024-08-19T00:56:26.505 INFO:tasks.workunit.client.0.smithi017.stdout:2/697: dread - d2/d7/d44/fc9 zero size 2024-08-19T00:56:26.506 INFO:tasks.workunit.client.0.smithi017.stdout:1/691: dread d4/dc/d3b/d3d/f7d [0,4194304] 0 2024-08-19T00:56:26.508 INFO:tasks.workunit.client.0.smithi017.stdout:1/692: dread - d4/f60 zero size 2024-08-19T00:56:26.517 INFO:tasks.workunit.client.0.smithi017.stdout:4/693: mknod d2/dc1/ce7 0 2024-08-19T00:56:26.521 INFO:tasks.workunit.client.0.smithi017.stdout:7/757: unlink d3/dc/l7e 0 2024-08-19T00:56:26.528 INFO:tasks.workunit.client.0.smithi017.stdout:2/698: dwrite d2/d7/f28 [0,4194304] 0 2024-08-19T00:56:26.528 INFO:tasks.workunit.client.0.smithi017.stdout:7/758: creat d3/dc/df/d37/d46/d73/d80/d81/ff4 x:0 0 0 2024-08-19T00:56:26.535 INFO:tasks.workunit.client.0.smithi017.stdout:7/759: rename d3/dc/df/d37/d46/dc9/dca to d3/dc/df/dda/df5 0 2024-08-19T00:56:26.538 INFO:tasks.workunit.client.0.smithi017.stdout:1/693: getdents d4/dc/d19 0 2024-08-19T00:56:26.542 INFO:tasks.workunit.client.0.smithi017.stdout:7/760: rename d3/dc/df/d1c/d2c/l6c to d3/dc/df/dd1/dd7/ddb/lf6 0 2024-08-19T00:56:26.543 INFO:tasks.workunit.client.0.smithi017.stdout:1/694: fsync d4/dc/d3b/d3d/da8/fae 0 2024-08-19T00:56:26.549 INFO:tasks.workunit.client.0.smithi017.stdout:4/694: truncate d2/d87/dbc/fbf 328202 0 2024-08-19T00:56:26.551 INFO:tasks.workunit.client.0.smithi017.stdout:2/699: truncate d2/d7/f6a 1219244 0 2024-08-19T00:56:26.554 INFO:tasks.workunit.client.0.smithi017.stdout:1/695: mknod d4/dc/d17/dd6/cdc 0 2024-08-19T00:56:26.559 INFO:tasks.workunit.client.0.smithi017.stdout:7/761: creat d3/dc/df/ff7 x:0 0 0 2024-08-19T00:56:26.564 INFO:tasks.workunit.client.0.smithi017.stdout:1/696: rename d4/dc/d17/dd6/d1f/cd0 to d4/dc/d3b/d3d/d83/d95/cdd 0 2024-08-19T00:56:26.570 INFO:tasks.workunit.client.0.smithi017.stdout:1/697: rename d4/dc/d3b/d45/dc0/lc1 to d4/dc/d17/dd6/d75/lde 0 2024-08-19T00:56:26.573 INFO:tasks.workunit.client.0.smithi017.stdout:2/700: dwrite d2/d7/d10/d35/d45/d58/dbf/f7f [0,4194304] 0 2024-08-19T00:56:26.575 INFO:tasks.workunit.client.0.smithi017.stdout:7/762: mkdir d3/dc/df/daa/df8 0 2024-08-19T00:56:26.577 INFO:tasks.workunit.client.0.smithi017.stdout:4/695: getdents d2/d1a/dd0 0 2024-08-19T00:56:26.580 INFO:tasks.workunit.client.0.smithi017.stdout:7/763: unlink d3/d3c/f43 0 2024-08-19T00:56:26.581 INFO:tasks.workunit.client.0.smithi017.stdout:7/764: chown d3/dc/df/d7d/f9a 59073050 1 2024-08-19T00:56:26.582 INFO:tasks.workunit.client.0.smithi017.stdout:2/701: mkdir d2/d7/d10/de2 0 2024-08-19T00:56:26.583 INFO:tasks.workunit.client.0.smithi017.stdout:7/765: write d3/dc/df/d37/d93/f9f [1089287,88719] 0 2024-08-19T00:56:26.584 INFO:tasks.workunit.client.0.smithi017.stdout:7/766: stat d3/dc/df/d37 0 2024-08-19T00:56:26.587 INFO:tasks.workunit.client.0.smithi017.stdout:1/698: rename d4/dc/d3b/d3d/da8/d62/c90 to d4/dc/d17/cdf 0 2024-08-19T00:56:26.594 INFO:tasks.workunit.client.0.smithi017.stdout:7/767: mknod d3/dc/df/d3d/d90/d87/cf9 0 2024-08-19T00:56:26.601 INFO:tasks.workunit.client.0.smithi017.stdout:4/696: dwrite d2/d87/db2/de6/d40/d56/d99/da3/fb3 [0,4194304] 0 2024-08-19T00:56:26.602 INFO:tasks.workunit.client.0.smithi017.stdout:2/702: write d2/d7/d10/d35/d55/f6f [344167,97161] 0 2024-08-19T00:56:26.604 INFO:tasks.workunit.client.0.smithi017.stdout:7/768: dread d3/dc/df/d37/f94 [0,4194304] 0 2024-08-19T00:56:26.604 INFO:tasks.workunit.client.0.smithi017.stdout:1/699: dwrite d4/dc/d3b/fb0 [0,4194304] 0 2024-08-19T00:56:26.606 INFO:tasks.workunit.client.0.smithi017.stdout:4/697: truncate d2/d11/f33 923334 0 2024-08-19T00:56:26.611 INFO:tasks.workunit.client.0.smithi017.stdout:2/703: dread d2/d7/d10/d3b/d3c/d8a/d6b/f78 [0,4194304] 0 2024-08-19T00:56:26.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/769: creat d3/dc/df/d23/d6a/dee/ffa x:0 0 0 2024-08-19T00:56:26.617 INFO:tasks.workunit.client.0.smithi017.stdout:2/704: creat d2/d7/d10/d3b/d80/da2/daf/fe3 x:0 0 0 2024-08-19T00:56:26.620 INFO:tasks.workunit.client.0.smithi017.stdout:4/698: rename d2/d87/db2/de6/f91 to d2/d87/db2/de6/d40/d84/fe8 0 2024-08-19T00:56:26.620 INFO:tasks.workunit.client.0.smithi017.stdout:1/700: write d4/dc/d17/d1d/f3c [173156,45718] 0 2024-08-19T00:56:26.621 INFO:tasks.workunit.client.0.smithi017.stdout:7/770: mknod d3/dc/df/d1c/d2c/d83/cfb 0 2024-08-19T00:56:26.624 INFO:tasks.workunit.client.0.smithi017.stdout:1/701: mknod d4/d78/ce0 0 2024-08-19T00:56:26.624 INFO:tasks.workunit.client.0.smithi017.stdout:4/699: dread - d2/d87/db2/de6/d40/d8b/f8d zero size 2024-08-19T00:56:26.628 INFO:tasks.workunit.client.0.smithi017.stdout:1/702: unlink d4/f13 0 2024-08-19T00:56:26.628 INFO:tasks.workunit.client.0.smithi017.stdout:1/703: chown d4/c6b 234 1 2024-08-19T00:56:26.629 INFO:tasks.workunit.client.0.smithi017.stdout:4/700: creat d2/d87/db2/de6/d40/d56/d95/fe9 x:0 0 0 2024-08-19T00:56:26.632 INFO:tasks.workunit.client.0.smithi017.stdout:7/771: unlink d3/dc/le 0 2024-08-19T00:56:26.633 INFO:tasks.workunit.client.0.smithi017.stdout:7/772: chown d3/d3c/d88/lbc 26 1 2024-08-19T00:56:26.633 INFO:tasks.workunit.client.0.smithi017.stdout:2/705: link d2/d7/d10/d19/d48/l5a d2/d7/dd/le4 0 2024-08-19T00:56:26.634 INFO:tasks.workunit.client.0.smithi017.stdout:8/554: sync 2024-08-19T00:56:26.637 INFO:tasks.workunit.client.0.smithi017.stdout:4/701: creat d2/d87/db2/de6/d40/fea x:0 0 0 2024-08-19T00:56:26.638 INFO:tasks.workunit.client.0.smithi017.stdout:1/704: creat d4/dc/d3b/d3d/d83/d95/dca/fe1 x:0 0 0 2024-08-19T00:56:26.639 INFO:tasks.workunit.client.0.smithi017.stdout:7/773: chown d3/dc/df/dda/df5/ce1 524884204 1 2024-08-19T00:56:26.640 INFO:tasks.workunit.client.0.smithi017.stdout:2/706: symlink d2/d7/d10/d35/d55/le5 0 2024-08-19T00:56:26.642 INFO:tasks.workunit.client.0.smithi017.stdout:8/555: creat de/d36/d74/d80/f9f x:0 0 0 2024-08-19T00:56:26.644 INFO:tasks.workunit.client.0.smithi017.stdout:8/556: chown de/d15/d4f/f5c 7654241 1 2024-08-19T00:56:26.645 INFO:tasks.workunit.client.0.smithi017.stdout:1/705: fsync d4/dc/d3b/d3d/f5a 0 2024-08-19T00:56:26.646 INFO:tasks.workunit.client.0.smithi017.stdout:1/706: dread - d4/dc/d17/d1d/fbe zero size 2024-08-19T00:56:26.654 INFO:tasks.workunit.client.0.smithi017.stdout:8/557: creat de/d36/d74/fa0 x:0 0 0 2024-08-19T00:56:26.655 INFO:tasks.workunit.client.0.smithi017.stdout:8/558: stat de/l99 0 2024-08-19T00:56:26.657 INFO:tasks.workunit.client.0.smithi017.stdout:4/702: write d2/d87/db2/de6/d40/f7f [64082,47273] 0 2024-08-19T00:56:26.662 INFO:tasks.workunit.client.0.smithi017.stdout:8/559: fdatasync de/d15/d4f/f6e 0 2024-08-19T00:56:26.663 INFO:tasks.workunit.client.0.smithi017.stdout:7/774: dread d3/dc/df/d1c/d2c/d83/fcf [0,4194304] 0 2024-08-19T00:56:26.664 INFO:tasks.workunit.client.0.smithi017.stdout:1/707: link d4/dc/d19/f79 d4/dd1/fe2 0 2024-08-19T00:56:26.666 INFO:tasks.workunit.client.0.smithi017.stdout:2/707: dread d2/fa [4194304,4194304] 0 2024-08-19T00:56:26.669 INFO:tasks.workunit.client.0.smithi017.stdout:8/560: mkdir de/d15/d62/d75/da1 0 2024-08-19T00:56:26.672 INFO:tasks.workunit.client.0.smithi017.stdout:7/775: symlink d3/dc/df/d1c/d2c/d83/lfc 0 2024-08-19T00:56:26.675 INFO:tasks.workunit.client.0.smithi017.stdout:2/708: dwrite d2/d7/d10/d3b/d97/fd4 [0,4194304] 0 2024-08-19T00:56:26.677 INFO:tasks.workunit.client.0.smithi017.stdout:8/561: chown de/d15/d79/c42 86 1 2024-08-19T00:56:26.682 INFO:tasks.workunit.client.0.smithi017.stdout:1/708: rename d4/dc/f18 to d4/dc/d17/dd6/d1f/da5/fe3 0 2024-08-19T00:56:26.685 INFO:tasks.workunit.client.0.smithi017.stdout:2/709: rmdir d2/d7/d10/d3b/d80 39 2024-08-19T00:56:26.686 INFO:tasks.workunit.client.0.smithi017.stdout:8/562: mknod de/d36/d74/ca2 0 2024-08-19T00:56:26.687 INFO:tasks.workunit.client.0.smithi017.stdout:8/563: chown de/d15/f70 96 1 2024-08-19T00:56:26.689 INFO:tasks.workunit.client.0.smithi017.stdout:7/776: mkdir d3/dc/df/d1c/d2c/dfd 0 2024-08-19T00:56:26.690 INFO:tasks.workunit.client.0.smithi017.stdout:7/777: chown d3/dc/df/d23/f24 121433386 1 2024-08-19T00:56:26.690 INFO:tasks.workunit.client.0.smithi017.stdout:2/710: mknod d2/d7/d10/d3b/d3c/ce6 0 2024-08-19T00:56:26.692 INFO:tasks.workunit.client.0.smithi017.stdout:1/709: creat d4/dc/d3b/d3d/da8/d62/db1/fe4 x:0 0 0 2024-08-19T00:56:26.695 INFO:tasks.workunit.client.0.smithi017.stdout:8/564: dwrite de/f34 [0,4194304] 0 2024-08-19T00:56:26.697 INFO:tasks.workunit.client.0.smithi017.stdout:2/711: write d2/d7/d10/d35/d55/fb0 [1276167,115949] 0 2024-08-19T00:56:26.702 INFO:tasks.workunit.client.0.smithi017.stdout:1/710: stat d4/dc/d17/dd6/d75/d9c/ddb/da6/db8/fce 0 2024-08-19T00:56:26.702 INFO:tasks.workunit.client.0.smithi017.stdout:8/565: creat de/d15/d79/fa3 x:0 0 0 2024-08-19T00:56:26.704 INFO:tasks.workunit.client.0.smithi017.stdout:7/778: link d3/dc/df/d1a/db9/cd5 d3/dc/df/d1c/d2c/cfe 0 2024-08-19T00:56:26.706 INFO:tasks.workunit.client.0.smithi017.stdout:8/566: chown de/d15/d79/l7c 353 1 2024-08-19T00:56:26.709 INFO:tasks.workunit.client.0.smithi017.stdout:1/711: read d4/dc/f11 [1033562,94100] 0 2024-08-19T00:56:26.710 INFO:tasks.workunit.client.0.smithi017.stdout:7/779: dread d3/dc/d5f/fb8 [0,4194304] 0 2024-08-19T00:56:26.721 INFO:tasks.workunit.client.0.smithi017.stdout:2/712: dread d2/d7/f21 [0,4194304] 0 2024-08-19T00:56:26.721 INFO:tasks.workunit.client.0.smithi017.stdout:1/712: dwrite d4/dc/d3b/d45/f92 [0,4194304] 0 2024-08-19T00:56:26.728 INFO:tasks.workunit.client.0.smithi017.stdout:1/713: symlink d4/dc/d3b/d3d/d83/d95/le5 0 2024-08-19T00:56:26.729 INFO:tasks.workunit.client.0.smithi017.stdout:1/714: write d4/fc6 [124883,94909] 0 2024-08-19T00:56:26.731 INFO:tasks.workunit.client.0.smithi017.stdout:8/567: dread de/d15/f35 [0,4194304] 0 2024-08-19T00:56:26.734 INFO:tasks.workunit.client.0.smithi017.stdout:7/780: dread d3/dc/df/d7d/f54 [4194304,4194304] 0 2024-08-19T00:56:26.736 INFO:tasks.workunit.client.0.smithi017.stdout:8/568: fsync de/d15/d39/d3d/f72 0 2024-08-19T00:56:26.736 INFO:tasks.workunit.client.0.smithi017.stdout:1/715: mkdir d4/dc/d3b/de6 0 2024-08-19T00:56:26.738 INFO:tasks.workunit.client.0.smithi017.stdout:7/781: symlink d3/dc/df/d1c/lff 0 2024-08-19T00:56:26.739 INFO:tasks.workunit.client.0.smithi017.stdout:8/569: creat de/d15/d62/d75/fa4 x:0 0 0 2024-08-19T00:56:26.741 INFO:tasks.workunit.client.0.smithi017.stdout:7/782: mkdir d3/dc/df/d23/d6a/db6/d100 0 2024-08-19T00:56:26.743 INFO:tasks.workunit.client.0.smithi017.stdout:8/570: mknod de/d15/d62/d75/ca5 0 2024-08-19T00:56:26.745 INFO:tasks.workunit.client.0.smithi017.stdout:2/713: truncate d2/d7/d10/d35/d45/fa9 136541 0 2024-08-19T00:56:26.745 INFO:tasks.workunit.client.0.smithi017.stdout:8/571: write de/d36/f58 [1517397,71008] 0 2024-08-19T00:56:26.750 INFO:tasks.workunit.client.0.smithi017.stdout:8/572: creat de/d15/d39/d3d/fa6 x:0 0 0 2024-08-19T00:56:26.750 INFO:tasks.workunit.client.0.smithi017.stdout:7/783: dwrite d3/dc/df/d23/d69/f6f [0,4194304] 0 2024-08-19T00:56:26.752 INFO:tasks.workunit.client.0.smithi017.stdout:7/784: write d3/dc/df/d23/f24 [3027898,32688] 0 2024-08-19T00:56:26.753 INFO:tasks.workunit.client.0.smithi017.stdout:2/714: truncate d2/f1a 801972 0 2024-08-19T00:56:26.757 INFO:tasks.workunit.client.0.smithi017.stdout:8/573: creat de/d15/d9d/fa7 x:0 0 0 2024-08-19T00:56:26.758 INFO:tasks.workunit.client.0.smithi017.stdout:7/785: write d3/dc/df/d37/d46/d73/d80/d81/ff4 [732196,125159] 0 2024-08-19T00:56:26.760 INFO:tasks.workunit.client.0.smithi017.stdout:8/574: chown de/d36/d74/d8b/f95 0 1 2024-08-19T00:56:26.768 INFO:tasks.workunit.client.0.smithi017.stdout:7/786: getdents d3/dc/df/d37/d93/da7 0 2024-08-19T00:56:26.770 INFO:tasks.workunit.client.0.smithi017.stdout:8/575: dwrite de/d36/d74/d80/f9c [0,4194304] 0 2024-08-19T00:56:26.772 INFO:tasks.workunit.client.0.smithi017.stdout:7/787: chown d3/dc/df/dd1/dd7 15 1 2024-08-19T00:56:26.778 INFO:tasks.workunit.client.0.smithi017.stdout:2/715: dwrite d2/d7/d10/f47 [0,4194304] 0 2024-08-19T00:56:26.782 INFO:tasks.workunit.client.0.smithi017.stdout:7/788: creat d3/dc/df/d23/f101 x:0 0 0 2024-08-19T00:56:26.785 INFO:tasks.workunit.client.0.smithi017.stdout:8/576: creat de/d15/d39/fa8 x:0 0 0 2024-08-19T00:56:26.785 INFO:tasks.workunit.client.0.smithi017.stdout:8/577: readlink de/d15/l5b 0 2024-08-19T00:56:26.786 INFO:tasks.workunit.client.0.smithi017.stdout:2/716: mknod d2/d7/d10/ce7 0 2024-08-19T00:56:26.786 INFO:tasks.workunit.client.0.smithi017.stdout:8/578: fsync de/d15/f92 0 2024-08-19T00:56:26.788 INFO:tasks.workunit.client.0.smithi017.stdout:7/789: stat d3/dc/df/d37/d93/ce0 0 2024-08-19T00:56:26.793 INFO:tasks.workunit.client.0.smithi017.stdout:2/717: creat d2/d7/d10/d35/d55/fe8 x:0 0 0 2024-08-19T00:56:26.793 INFO:tasks.workunit.client.0.smithi017.stdout:7/790: getdents d3/dc/df/daa/df8 0 2024-08-19T00:56:26.794 INFO:tasks.workunit.client.0.smithi017.stdout:8/579: dwrite de/d15/d39/f6d [0,4194304] 0 2024-08-19T00:56:26.797 INFO:tasks.workunit.client.0.smithi017.stdout:2/718: creat d2/d7/d10/d3b/d97/fe9 x:0 0 0 2024-08-19T00:56:26.801 INFO:tasks.workunit.client.0.smithi017.stdout:8/580: fsync de/d15/d39/d3d/f72 0 2024-08-19T00:56:26.803 INFO:tasks.workunit.client.0.smithi017.stdout:2/719: creat d2/fea x:0 0 0 2024-08-19T00:56:26.804 INFO:tasks.workunit.client.0.smithi017.stdout:8/581: creat de/d15/d79/fa9 x:0 0 0 2024-08-19T00:56:26.807 INFO:tasks.workunit.client.0.smithi017.stdout:8/582: unlink de/d36/d74/d8b/f95 0 2024-08-19T00:56:26.810 INFO:tasks.workunit.client.0.smithi017.stdout:2/720: dwrite d2/fc8 [0,4194304] 0 2024-08-19T00:56:26.812 INFO:tasks.workunit.client.0.smithi017.stdout:8/583: unlink de/d15/d39/d3d/l82 0 2024-08-19T00:56:26.813 INFO:tasks.workunit.client.0.smithi017.stdout:8/584: write de/d15/f83 [577084,85032] 0 2024-08-19T00:56:26.817 INFO:tasks.workunit.client.0.smithi017.stdout:8/585: mknod de/d15/d4f/d97/caa 0 2024-08-19T00:56:26.823 INFO:tasks.workunit.client.0.smithi017.stdout:8/586: dwrite de/d15/d79/fa3 [0,4194304] 0 2024-08-19T00:56:26.900 INFO:tasks.workunit.client.0.smithi017.stdout:7/791: dread d3/f2e [4194304,4194304] 0 2024-08-19T00:56:26.904 INFO:tasks.workunit.client.0.smithi017.stdout:7/792: mknod d3/dc/df/dda/c102 0 2024-08-19T00:56:26.906 INFO:tasks.workunit.client.0.smithi017.stdout:8/587: write de/f52 [4363174,100453] 0 2024-08-19T00:56:26.911 INFO:tasks.workunit.client.0.smithi017.stdout:8/588: dread de/d36/d74/f8a [0,4194304] 0 2024-08-19T00:56:26.912 INFO:tasks.workunit.client.0.smithi017.stdout:2/721: dwrite d2/d7/d10/d3b/d80/d81/fa6 [0,4194304] 0 2024-08-19T00:56:26.917 INFO:tasks.workunit.client.0.smithi017.stdout:2/722: truncate d2/d7/d10/f3e 2628913 0 2024-08-19T00:56:26.922 INFO:tasks.workunit.client.0.smithi017.stdout:8/589: dwrite de/f34 [0,4194304] 0 2024-08-19T00:56:26.922 INFO:tasks.workunit.client.0.smithi017.stdout:5/498: sync 2024-08-19T00:56:26.929 INFO:tasks.workunit.client.0.smithi017.stdout:2/723: dwrite d2/d7/d10/d3b/d80/fda [0,4194304] 0 2024-08-19T00:56:26.930 INFO:tasks.workunit.client.0.smithi017.stdout:8/590: symlink de/d15/d62/d7e/lab 0 2024-08-19T00:56:26.931 INFO:tasks.workunit.client.0.smithi017.stdout:7/793: dread d3/dc/d5f/f89 [0,4194304] 0 2024-08-19T00:56:26.939 INFO:tasks.workunit.client.0.smithi017.stdout:5/499: dwrite db/d19/d1f/d15/d1e/d5f/f73 [0,4194304] 0 2024-08-19T00:56:26.941 INFO:tasks.workunit.client.0.smithi017.stdout:5/500: dread - db/d19/d8d/fa5 zero size 2024-08-19T00:56:26.942 INFO:tasks.workunit.client.0.smithi017.stdout:2/724: rmdir d2/d7/d10/d3b/d80/d81 39 2024-08-19T00:56:26.944 INFO:tasks.workunit.client.0.smithi017.stdout:8/591: mknod de/d36/d74/d8b/cac 0 2024-08-19T00:56:26.945 INFO:tasks.workunit.client.0.smithi017.stdout:8/592: chown de/d15/d62/f98 184649796 1 2024-08-19T00:56:26.946 INFO:tasks.workunit.client.0.smithi017.stdout:8/593: truncate de/d15/f83 1486307 0 2024-08-19T00:56:26.947 INFO:tasks.workunit.client.0.smithi017.stdout:8/594: dread - de/d15/d79/fa9 zero size 2024-08-19T00:56:26.957 INFO:tasks.workunit.client.0.smithi017.stdout:8/595: rmdir de/d15/d4f/d97 39 2024-08-19T00:56:26.958 INFO:tasks.workunit.client.0.smithi017.stdout:8/596: dread - de/d15/d62/d75/fa4 zero size 2024-08-19T00:56:26.960 INFO:tasks.workunit.client.0.smithi017.stdout:8/597: mkdir de/d36/dad 0 2024-08-19T00:56:26.964 INFO:tasks.workunit.client.0.smithi017.stdout:8/598: dread de/f52 [4194304,4194304] 0 2024-08-19T00:56:26.968 INFO:tasks.workunit.client.0.smithi017.stdout:8/599: dread de/f34 [0,4194304] 0 2024-08-19T00:56:26.972 INFO:tasks.workunit.client.0.smithi017.stdout:5/501: write db/d19/d1f/d15/f5d [167906,114331] 0 2024-08-19T00:56:26.973 INFO:tasks.workunit.client.0.smithi017.stdout:8/600: mknod de/d15/d62/d7e/cae 0 2024-08-19T00:56:26.980 INFO:tasks.workunit.client.0.smithi017.stdout:8/601: rename de/d36/f58 to de/d8d/faf 0 2024-08-19T00:56:26.980 INFO:tasks.workunit.client.0.smithi017.stdout:2/725: dwrite d2/d7/d10/d35/d45/d58/dbf/f70 [4194304,4194304] 0 2024-08-19T00:56:26.994 INFO:tasks.workunit.client.0.smithi017.stdout:5/502: dwrite db/d19/d1f/d15/d30/f46 [0,4194304] 0 2024-08-19T00:56:26.997 INFO:tasks.workunit.client.0.smithi017.stdout:8/602: rename de/d15/d39/f6d to de/d36/dad/fb0 0 2024-08-19T00:56:27.004 INFO:tasks.workunit.client.0.smithi017.stdout:5/503: dread - db/d19/d1f/f6d zero size 2024-08-19T00:56:27.006 INFO:tasks.workunit.client.0.smithi017.stdout:2/726: dwrite d2/d7/d10/d3b/d54/f5b [0,4194304] 0 2024-08-19T00:56:27.011 INFO:tasks.workunit.client.0.smithi017.stdout:8/603: dwrite de/d15/d79/fa3 [0,4194304] 0 2024-08-19T00:56:27.015 INFO:tasks.workunit.client.0.smithi017.stdout:2/727: creat d2/d7/d10/d3b/d3c/d8a/feb x:0 0 0 2024-08-19T00:56:27.015 INFO:tasks.workunit.client.0.smithi017.stdout:8/604: read - de/d15/d39/d3d/f72 zero size 2024-08-19T00:56:27.019 INFO:tasks.workunit.client.0.smithi017.stdout:5/504: dwrite db/d19/d33/f53 [0,4194304] 0 2024-08-19T00:56:27.020 INFO:tasks.workunit.client.0.smithi017.stdout:5/505: chown db/d19/d1f/d15/d3e/l4f 955583791 1 2024-08-19T00:56:27.021 INFO:tasks.workunit.client.0.smithi017.stdout:2/728: mknod d2/d7/d10/d35/d45/d58/dbf/d7a/cec 0 2024-08-19T00:56:27.023 INFO:tasks.workunit.client.0.smithi017.stdout:5/506: mknod db/d19/d8d/cab 0 2024-08-19T00:56:27.027 INFO:tasks.workunit.client.0.smithi017.stdout:2/729: link d2/d7/d10/d3b/d80/da2/daf/lc2 d2/dc5/dca/led 0 2024-08-19T00:56:27.031 INFO:tasks.workunit.client.0.smithi017.stdout:5/507: dwrite db/d19/d1f/d15/f89 [0,4194304] 0 2024-08-19T00:56:27.034 INFO:tasks.workunit.client.0.smithi017.stdout:5/508: creat db/d19/d1f/d15/d30/fac x:0 0 0 2024-08-19T00:56:27.036 INFO:tasks.workunit.client.0.smithi017.stdout:2/730: link d2/d7/dd/f15 d2/d7/d10/d3b/d97/fee 0 2024-08-19T00:56:27.042 INFO:tasks.workunit.client.0.smithi017.stdout:2/731: dwrite d2/d7/d10/d19/d48/f82 [0,4194304] 0 2024-08-19T00:56:27.045 INFO:tasks.workunit.client.0.smithi017.stdout:2/732: creat d2/d7/d44/fef x:0 0 0 2024-08-19T00:56:27.049 INFO:tasks.workunit.client.0.smithi017.stdout:2/733: dread d2/d7/f43 [0,4194304] 0 2024-08-19T00:56:27.050 INFO:tasks.workunit.client.0.smithi017.stdout:2/734: fsync d2/d7/d10/d19/f1d 0 2024-08-19T00:56:27.054 INFO:tasks.workunit.client.0.smithi017.stdout:2/735: dread d2/d7/d10/d3b/d3c/d8a/d6b/f9d [0,4194304] 0 2024-08-19T00:56:27.054 INFO:tasks.workunit.client.0.smithi017.stdout:2/736: chown d2/dc5/dca 1538475 1 2024-08-19T00:56:27.055 INFO:tasks.workunit.client.0.smithi017.stdout:8/605: write de/d36/f69 [2559509,56231] 0 2024-08-19T00:56:27.058 INFO:tasks.workunit.client.0.smithi017.stdout:2/737: mknod d2/d7/d10/d35/d45/d58/cf0 0 2024-08-19T00:56:27.060 INFO:tasks.workunit.client.0.smithi017.stdout:2/738: chown d2/d7/d10/d19/fde 31 1 2024-08-19T00:56:27.063 INFO:tasks.workunit.client.0.smithi017.stdout:2/739: mknod d2/d7/d10/d35/d45/d58/cf1 0 2024-08-19T00:56:27.068 INFO:tasks.workunit.client.0.smithi017.stdout:2/740: mkdir d2/d7/d10/d3b/d97/df2 0 2024-08-19T00:56:27.068 INFO:tasks.workunit.client.0.smithi017.stdout:5/509: dwrite db/f2e [4194304,4194304] 0 2024-08-19T00:56:27.068 INFO:tasks.workunit.client.0.smithi017.stdout:8/606: write de/f4d [1694678,26820] 0 2024-08-19T00:56:27.076 INFO:tasks.workunit.client.0.smithi017.stdout:5/510: unlink db/d19/d1f/d15/d3e/d40/d49/fa8 0 2024-08-19T00:56:27.078 INFO:tasks.workunit.client.0.smithi017.stdout:5/511: chown db/d19/d1f/d15/d3e/fa3 4749 1 2024-08-19T00:56:27.080 INFO:tasks.workunit.client.0.smithi017.stdout:8/607: dwrite de/d15/f92 [0,4194304] 0 2024-08-19T00:56:27.081 INFO:tasks.workunit.client.0.smithi017.stdout:2/741: write d2/d7/dd/f1c [3129313,9921] 0 2024-08-19T00:56:27.087 INFO:tasks.workunit.client.0.smithi017.stdout:8/608: dread de/d36/dad/fb0 [0,4194304] 0 2024-08-19T00:56:27.092 INFO:tasks.workunit.client.0.smithi017.stdout:8/609: truncate de/d15/d39/d3d/fa6 842088 0 2024-08-19T00:56:27.095 INFO:tasks.workunit.client.0.smithi017.stdout:5/512: dwrite db/d19/d1f/d15/d3e/d40/d49/f86 [0,4194304] 0 2024-08-19T00:56:27.096 INFO:tasks.workunit.client.0.smithi017.stdout:8/610: read de/d15/f1e [6093357,109414] 0 2024-08-19T00:56:27.100 INFO:tasks.workunit.client.0.smithi017.stdout:5/513: mkdir db/d19/d1f/d15/d3e/d40/dad 0 2024-08-19T00:56:27.102 INFO:tasks.workunit.client.0.smithi017.stdout:5/514: write db/d19/d1f/d15/d1e/f88 [3672393,50305] 0 2024-08-19T00:56:27.105 INFO:tasks.workunit.client.0.smithi017.stdout:8/611: rename c9 to de/d15/d4f/cb1 0 2024-08-19T00:56:27.105 INFO:tasks.workunit.client.0.smithi017.stdout:3/681: sync 2024-08-19T00:56:27.106 INFO:tasks.workunit.client.0.smithi017.stdout:3/682: chown d5/da/d3c 4079536 1 2024-08-19T00:56:27.108 INFO:tasks.workunit.client.0.smithi017.stdout:8/612: creat de/d15/d9d/fb2 x:0 0 0 2024-08-19T00:56:27.109 INFO:tasks.workunit.client.0.smithi017.stdout:2/742: dread d2/f77 [0,4194304] 0 2024-08-19T00:56:27.111 INFO:tasks.workunit.client.0.smithi017.stdout:3/683: rename d5/d15/l97 to d5/d32/ld7 0 2024-08-19T00:56:27.114 INFO:tasks.workunit.client.0.smithi017.stdout:3/684: chown d5/da/d3c/f93 0 1 2024-08-19T00:56:27.115 INFO:tasks.workunit.client.0.smithi017.stdout:3/685: chown d5/da/d27/d28 76430 1 2024-08-19T00:56:27.116 INFO:tasks.workunit.client.0.smithi017.stdout:8/613: dwrite de/d15/d79/fa3 [0,4194304] 0 2024-08-19T00:56:27.117 INFO:tasks.workunit.client.0.smithi017.stdout:2/743: mknod d2/dc5/dca/cf3 0 2024-08-19T00:56:27.120 INFO:tasks.workunit.client.0.smithi017.stdout:5/515: mknod db/d19/d1f/d15/d3e/d40/d49/d63/d80/cae 0 2024-08-19T00:56:27.124 INFO:tasks.workunit.client.0.smithi017.stdout:8/614: rmdir de/d15/d9d 39 2024-08-19T00:56:27.125 INFO:tasks.workunit.client.0.smithi017.stdout:2/744: dread d2/d7/d10/d3b/d80/fda [0,4194304] 0 2024-08-19T00:56:27.126 INFO:tasks.workunit.client.0.smithi017.stdout:3/686: fdatasync d5/da/f48 0 2024-08-19T00:56:27.132 INFO:tasks.workunit.client.0.smithi017.stdout:3/687: creat d5/d11/fd8 x:0 0 0 2024-08-19T00:56:27.135 INFO:tasks.workunit.client.0.smithi017.stdout:2/745: fsync d2/d7/d10/d35/d7e/fd5 0 2024-08-19T00:56:27.140 INFO:tasks.workunit.client.0.smithi017.stdout:0/605: sync 2024-08-19T00:56:27.140 INFO:tasks.workunit.client.0.smithi017.stdout:9/591: sync 2024-08-19T00:56:27.140 INFO:tasks.workunit.client.0.smithi017.stdout:6/692: sync 2024-08-19T00:56:27.140 INFO:tasks.workunit.client.0.smithi017.stdout:4/703: sync 2024-08-19T00:56:27.141 INFO:tasks.workunit.client.0.smithi017.stdout:1/716: sync 2024-08-19T00:56:27.141 INFO:tasks.workunit.client.0.smithi017.stdout:7/794: sync 2024-08-19T00:56:27.142 INFO:tasks.workunit.client.0.smithi017.stdout:1/717: stat d4/dc/d17/d1d 0 2024-08-19T00:56:27.144 INFO:tasks.workunit.client.0.smithi017.stdout:6/693: chown d5/d13/d11/f72 78 1 2024-08-19T00:56:27.145 INFO:tasks.workunit.client.0.smithi017.stdout:2/746: mkdir d2/d7/d10/d3b/d97/df2/df4 0 2024-08-19T00:56:27.146 INFO:tasks.workunit.client.0.smithi017.stdout:5/516: dread fa [0,4194304] 0 2024-08-19T00:56:27.149 INFO:tasks.workunit.client.0.smithi017.stdout:8/615: truncate de/d15/d39/d3d/fa6 780780 0 2024-08-19T00:56:27.150 INFO:tasks.workunit.client.0.smithi017.stdout:3/688: creat d5/d11/d61/fd9 x:0 0 0 2024-08-19T00:56:27.150 INFO:tasks.workunit.client.0.smithi017.stdout:3/689: write d5/ff [4760568,127865] 0 2024-08-19T00:56:27.151 INFO:tasks.workunit.client.0.smithi017.stdout:3/690: readlink d5/l1a 0 2024-08-19T00:56:27.151 INFO:tasks.workunit.client.0.smithi017.stdout:0/606: mkdir d5/d17/d26/d30/d3e/d5a/dcd 0 2024-08-19T00:56:27.152 INFO:tasks.workunit.client.0.smithi017.stdout:3/691: chown d5/da/d27/d6e/cbf 6480779 1 2024-08-19T00:56:27.153 INFO:tasks.workunit.client.0.smithi017.stdout:3/692: fsync d5/fba 0 2024-08-19T00:56:27.153 INFO:tasks.workunit.client.0.smithi017.stdout:6/694: mknod d5/d7b/cee 0 2024-08-19T00:56:27.234 INFO:tasks.workunit.client.0.smithi017.stdout:4/704: rename d2/d87/db2/de6/d40/d56/f4f to d2/d16/d70/feb 0 2024-08-19T00:56:27.235 INFO:tasks.workunit.client.0.smithi017.stdout:7/795: mkdir d3/dc/d103 0 2024-08-19T00:56:27.236 INFO:tasks.workunit.client.0.smithi017.stdout:5/517: fdatasync db/f56 0 2024-08-19T00:56:27.237 INFO:tasks.workunit.client.0.smithi017.stdout:0/607: mkdir d5/d17/d26/d30/d5d/dce 0 2024-08-19T00:56:27.238 INFO:tasks.workunit.client.0.smithi017.stdout:8/616: creat de/d36/d74/d8b/fb3 x:0 0 0 2024-08-19T00:56:27.240 INFO:tasks.workunit.client.0.smithi017.stdout:3/693: mkdir d5/da/d3c/d4f/d68/d9e/dda 0 2024-08-19T00:56:27.241 INFO:tasks.workunit.client.0.smithi017.stdout:7/796: read d3/dc/df/d1c/f68 [3227693,121847] 0 2024-08-19T00:56:27.243 INFO:tasks.workunit.client.0.smithi017.stdout:1/718: rename d4/dc/d17/dd6/d1f/f94 to d4/dc/d3b/d3d/da8/d62/fe7 0 2024-08-19T00:56:27.249 INFO:tasks.workunit.client.0.smithi017.stdout:8/617: dwrite de/d15/d79/fa9 [0,4194304] 0 2024-08-19T00:56:27.253 INFO:tasks.workunit.client.0.smithi017.stdout:8/618: truncate de/d15/d62/d75/fa4 319715 0 2024-08-19T00:56:27.255 INFO:tasks.workunit.client.0.smithi017.stdout:9/592: getdents d0/d33/d22/d85 0 2024-08-19T00:56:27.255 INFO:tasks.workunit.client.0.smithi017.stdout:8/619: write de/d36/d74/fa0 [479138,84640] 0 2024-08-19T00:56:27.259 INFO:tasks.workunit.client.0.smithi017.stdout:6/695: link d5/d13/d11/d2c/d4a/d64/d86/d90/dba/dbf/fc2 d5/d13/d20/d89/fef 0 2024-08-19T00:56:27.260 INFO:tasks.workunit.client.0.smithi017.stdout:6/696: stat d5/d13/d11/d2c/d9d/lad 0 2024-08-19T00:56:27.261 INFO:tasks.workunit.client.0.smithi017.stdout:4/705: symlink d2/d87/db2/de6/d53/lec 0 2024-08-19T00:56:27.262 INFO:tasks.workunit.client.0.smithi017.stdout:1/719: mkdir d4/dc/d3b/d3d/d83/d95/de8 0 2024-08-19T00:56:27.262 INFO:tasks.workunit.client.0.smithi017.stdout:7/797: dread d3/dc/df/d7d/f9a [0,4194304] 0 2024-08-19T00:56:27.265 INFO:tasks.workunit.client.0.smithi017.stdout:8/620: creat de/d15/d62/d75/fb4 x:0 0 0 2024-08-19T00:56:27.266 INFO:tasks.workunit.client.0.smithi017.stdout:9/593: creat d0/d33/d22/d45/d8e/fac x:0 0 0 2024-08-19T00:56:27.269 INFO:tasks.workunit.client.0.smithi017.stdout:4/706: symlink d2/dc1/led 0 2024-08-19T00:56:27.270 INFO:tasks.workunit.client.0.smithi017.stdout:6/697: unlink d5/d13/d11/d2c/d4a/d64/l88 0 2024-08-19T00:56:27.271 INFO:tasks.workunit.client.0.smithi017.stdout:1/720: symlink d4/dc/d19/le9 0 2024-08-19T00:56:27.271 INFO:tasks.workunit.client.0.smithi017.stdout:3/694: dread d5/d11/f16 [0,4194304] 0 2024-08-19T00:56:27.272 INFO:tasks.workunit.client.0.smithi017.stdout:6/698: truncate d5/d13/fd0 337156 0 2024-08-19T00:56:27.278 INFO:tasks.workunit.client.0.smithi017.stdout:6/699: fdatasync d5/d13/d11/d2c/d4a/f57 0 2024-08-19T00:56:27.280 INFO:tasks.workunit.client.0.smithi017.stdout:3/695: dwrite d5/da/f72 [0,4194304] 0 2024-08-19T00:56:27.282 INFO:tasks.workunit.client.0.smithi017.stdout:8/621: dwrite de/d15/f35 [0,4194304] 0 2024-08-19T00:56:27.282 INFO:tasks.workunit.client.0.smithi017.stdout:4/707: link d2/d87/db2/de6/d40/d84/l90 d2/d1a/d55/d64/lee 0 2024-08-19T00:56:27.285 INFO:tasks.workunit.client.0.smithi017.stdout:7/798: rename d3/dc/df/dd1/dd7/ddb/lf6 to d3/dc/df/d23/l104 0 2024-08-19T00:56:27.288 INFO:tasks.workunit.client.0.smithi017.stdout:6/700: mkdir d5/df0 0 2024-08-19T00:56:27.292 INFO:tasks.workunit.client.0.smithi017.stdout:7/799: creat d3/dc/df/dda/df5/f105 x:0 0 0 2024-08-19T00:56:27.295 INFO:tasks.workunit.client.0.smithi017.stdout:4/708: link d2/d87/db2/de6/d40/fea d2/d1a/dd0/dd4/de2/fef 0 2024-08-19T00:56:27.297 INFO:tasks.workunit.client.0.smithi017.stdout:4/709: creat d2/d87/dbc/ff0 x:0 0 0 2024-08-19T00:56:27.320 INFO:tasks.workunit.client.0.smithi017.stdout:4/710: dread d2/d1a/d20/f3b [0,4194304] 0 2024-08-19T00:56:27.321 INFO:tasks.workunit.client.0.smithi017.stdout:4/711: stat d2/d11/d24/c4a 0 2024-08-19T00:56:27.323 INFO:tasks.workunit.client.0.smithi017.stdout:4/712: fsync d2/d87/dbc/fbf 0 2024-08-19T00:56:27.325 INFO:tasks.workunit.client.0.smithi017.stdout:4/713: creat d2/d1a/dd0/dd4/ff1 x:0 0 0 2024-08-19T00:56:27.360 INFO:tasks.workunit.client.0.smithi017.stdout:9/594: dread d0/d33/d22/d45/f54 [0,4194304] 0 2024-08-19T00:56:27.361 INFO:tasks.workunit.client.0.smithi017.stdout:9/595: readlink d0/d33/d22/l43 0 2024-08-19T00:56:27.364 INFO:tasks.workunit.client.0.smithi017.stdout:9/596: symlink d0/d33/d22/d5a/lad 0 2024-08-19T00:56:27.367 INFO:tasks.workunit.client.0.smithi017.stdout:9/597: mkdir d0/d33/d22/d5e/dae 0 2024-08-19T00:56:27.376 INFO:tasks.workunit.client.0.smithi017.stdout:9/598: dread d0/d58/f66 [0,4194304] 0 2024-08-19T00:56:27.377 INFO:tasks.workunit.client.0.smithi017.stdout:1/721: rename d4/dc/d3b/d3d/da8/d62 to d4/dc/d17/dad/dea 0 2024-08-19T00:56:27.379 INFO:tasks.workunit.client.0.smithi017.stdout:1/722: dread - d4/dc/d3b/d3d/f5a zero size 2024-08-19T00:56:27.380 INFO:tasks.workunit.client.0.smithi017.stdout:9/599: mknod d0/d58/d49/d5d/caf 0 2024-08-19T00:56:27.382 INFO:tasks.workunit.client.0.smithi017.stdout:7/800: rename d3/dc/df/d3d/d90/d87 to d3/dab/d106 0 2024-08-19T00:56:27.383 INFO:tasks.workunit.client.0.smithi017.stdout:0/608: dwrite d5/d17/d21/f55 [0,4194304] 0 2024-08-19T00:56:27.385 INFO:tasks.workunit.client.0.smithi017.stdout:1/723: read d4/dc/d17/dd6/f25 [6015725,49280] 0 2024-08-19T00:56:27.387 INFO:tasks.workunit.client.0.smithi017.stdout:9/600: creat d0/d33/d22/fb0 x:0 0 0 2024-08-19T00:56:27.389 INFO:tasks.workunit.client.0.smithi017.stdout:1/724: truncate d4/dc/d17/d1d/f3c 604518 0 2024-08-19T00:56:27.390 INFO:tasks.workunit.client.0.smithi017.stdout:9/601: write d0/d33/d22/d5a/f5f [2292298,67024] 0 2024-08-19T00:56:27.391 INFO:tasks.workunit.client.0.smithi017.stdout:1/725: dread - d4/dc/d3b/d9d/f8c zero size 2024-08-19T00:56:27.393 INFO:tasks.workunit.client.0.smithi017.stdout:0/609: mknod d5/d17/d21/ccf 0 2024-08-19T00:56:27.395 INFO:tasks.workunit.client.0.smithi017.stdout:1/726: readlink d4/dc/d17/l72 0 2024-08-19T00:56:27.395 INFO:tasks.workunit.client.0.smithi017.stdout:0/610: dread - d5/d17/d26/d30/d3e/d81/f8e zero size 2024-08-19T00:56:27.396 INFO:tasks.workunit.client.0.smithi017.stdout:9/602: symlink d0/d84/lb1 0 2024-08-19T00:56:27.398 INFO:tasks.workunit.client.0.smithi017.stdout:0/611: fsync d5/d17/d26/d30/d3e/f91 0 2024-08-19T00:56:27.399 INFO:tasks.workunit.client.0.smithi017.stdout:9/603: write d0/d58/d49/f76 [3486239,85413] 0 2024-08-19T00:56:27.405 INFO:tasks.workunit.client.0.smithi017.stdout:7/801: dread d3/dc/df/d1a/f3b [0,4194304] 0 2024-08-19T00:56:27.405 INFO:tasks.workunit.client.0.smithi017.stdout:0/612: creat d5/d17/d26/d30/d5d/fd0 x:0 0 0 2024-08-19T00:56:27.406 INFO:tasks.workunit.client.0.smithi017.stdout:1/727: dwrite d4/dc/d17/d1d/f65 [0,4194304] 0 2024-08-19T00:56:27.407 INFO:tasks.workunit.client.0.smithi017.stdout:0/613: chown d5/d17/d21/ccf 38 1 2024-08-19T00:56:27.410 INFO:tasks.workunit.client.0.smithi017.stdout:1/728: mkdir d4/dd1/deb 0 2024-08-19T00:56:27.411 INFO:tasks.workunit.client.0.smithi017.stdout:1/729: dread - d4/dc/d3b/d3d/d83/d95/dca/fcd zero size 2024-08-19T00:56:27.411 INFO:tasks.workunit.client.0.smithi017.stdout:7/802: creat d3/dc/df/d23/d69/dd8/f107 x:0 0 0 2024-08-19T00:56:27.412 INFO:tasks.workunit.client.0.smithi017.stdout:0/614: chown d5/d17/d26/d30/c59 32 1 2024-08-19T00:56:27.416 INFO:tasks.workunit.client.0.smithi017.stdout:1/730: symlink d4/dc/d17/dd6/d75/lec 0 2024-08-19T00:56:27.418 INFO:tasks.workunit.client.0.smithi017.stdout:0/615: chown d5/d17/d21/d39/fa1 197115 1 2024-08-19T00:56:27.420 INFO:tasks.workunit.client.0.smithi017.stdout:1/731: mkdir d4/dc/d17/dad/ded 0 2024-08-19T00:56:27.422 INFO:tasks.workunit.client.0.smithi017.stdout:6/701: fsync d5/d13/fd0 0 2024-08-19T00:56:27.424 INFO:tasks.workunit.client.0.smithi017.stdout:7/803: dwrite d3/dc/df/d23/d69/f6f [4194304,4194304] 0 2024-08-19T00:56:27.429 INFO:tasks.workunit.client.0.smithi017.stdout:3/696: dwrite d5/da/f48 [0,4194304] 0 2024-08-19T00:56:27.429 INFO:tasks.workunit.client.0.smithi017.stdout:7/804: dread - d3/dc/df/dd1/fd2 zero size 2024-08-19T00:56:27.429 INFO:tasks.workunit.client.0.smithi017.stdout:8/622: dwrite de/f34 [4194304,4194304] 0 2024-08-19T00:56:27.430 INFO:tasks.workunit.client.0.smithi017.stdout:6/702: unlink d5/d13/d20/l2b 0 2024-08-19T00:56:27.433 INFO:tasks.workunit.client.0.smithi017.stdout:7/805: chown d3/dc/df/d37/d46/d73/d80/d81 48963 1 2024-08-19T00:56:27.434 INFO:tasks.workunit.client.0.smithi017.stdout:3/697: chown d5/d32/fb3 116596 1 2024-08-19T00:56:27.439 INFO:tasks.workunit.client.0.smithi017.stdout:3/698: chown d5/da/f3f 2 1 2024-08-19T00:56:27.442 INFO:tasks.workunit.client.0.smithi017.stdout:8/623: mkdir de/d15/d4f/d68/db5 0 2024-08-19T00:56:27.445 INFO:tasks.workunit.client.0.smithi017.stdout:6/703: write d5/d13/d11/d2c/d4a/da8/fde [116267,83586] 0 2024-08-19T00:56:27.446 INFO:tasks.workunit.client.0.smithi017.stdout:7/806: dwrite d3/dc/df/fec [0,4194304] 0 2024-08-19T00:56:27.449 INFO:tasks.workunit.client.0.smithi017.stdout:7/807: write d3/dc/df/dd1/fd2 [189964,131033] 0 2024-08-19T00:56:27.461 INFO:tasks.workunit.client.0.smithi017.stdout:6/704: dread d5/f1e [0,4194304] 0 2024-08-19T00:56:27.463 INFO:tasks.workunit.client.0.smithi017.stdout:3/699: creat d5/d15/d92/dca/fdb x:0 0 0 2024-08-19T00:56:27.464 INFO:tasks.workunit.client.0.smithi017.stdout:9/604: dwrite d0/d33/d22/d45/f54 [0,4194304] 0 2024-08-19T00:56:27.465 INFO:tasks.workunit.client.0.smithi017.stdout:1/732: write d4/dc/d19/f53 [504997,52660] 0 2024-08-19T00:56:27.467 INFO:tasks.workunit.client.0.smithi017.stdout:6/705: mknod d5/d13/d11/d2c/d4a/da8/dd9/cf1 0 2024-08-19T00:56:27.467 INFO:tasks.workunit.client.0.smithi017.stdout:3/700: stat d5/da/d3c/d4f/d68/d9e/fb8 0 2024-08-19T00:56:27.468 INFO:tasks.workunit.client.0.smithi017.stdout:3/701: fsync d5/d11/f2a 0 2024-08-19T00:56:27.470 INFO:tasks.workunit.client.0.smithi017.stdout:9/605: mkdir d0/d58/d49/d70/db2 0 2024-08-19T00:56:27.471 INFO:tasks.workunit.client.0.smithi017.stdout:9/606: stat d0/d33/d22/l87 0 2024-08-19T00:56:27.474 INFO:tasks.workunit.client.0.smithi017.stdout:6/706: creat d5/d13/dcf/ff2 x:0 0 0 2024-08-19T00:56:27.474 INFO:tasks.workunit.client.0.smithi017.stdout:3/702: rmdir d5/da/d3c/d4f/d68 39 2024-08-19T00:56:27.477 INFO:tasks.workunit.client.0.smithi017.stdout:6/707: truncate d5/d13/d11/d2c/d51/fd7 957492 0 2024-08-19T00:56:27.478 INFO:tasks.workunit.client.0.smithi017.stdout:3/703: write d5/fc [5884792,86770] 0 2024-08-19T00:56:27.479 INFO:tasks.workunit.client.0.smithi017.stdout:8/624: truncate de/f34 25318 0 2024-08-19T00:56:27.485 INFO:tasks.workunit.client.0.smithi017.stdout:8/625: creat de/d8d/fb6 x:0 0 0 2024-08-19T00:56:27.486 INFO:tasks.workunit.client.0.smithi017.stdout:3/704: write d5/d11/d61/f76 [3754405,27191] 0 2024-08-19T00:56:27.488 INFO:tasks.workunit.client.0.smithi017.stdout:9/607: dread d0/d33/d22/d45/d8e/f81 [0,4194304] 0 2024-08-19T00:56:27.488 INFO:tasks.workunit.client.0.smithi017.stdout:7/808: dwrite d3/dc/df/d7d/f54 [0,4194304] 0 2024-08-19T00:56:27.489 INFO:tasks.workunit.client.0.smithi017.stdout:8/626: read - de/d15/d39/d3d/f72 zero size 2024-08-19T00:56:27.490 INFO:tasks.workunit.client.0.smithi017.stdout:9/608: stat d0/d58/f66 0 2024-08-19T00:56:27.492 INFO:tasks.workunit.client.0.smithi017.stdout:3/705: symlink d5/da/d27/d6e/ldc 0 2024-08-19T00:56:27.492 INFO:tasks.workunit.client.0.smithi017.stdout:6/708: dwrite d5/d13/d11/d52/fb2 [0,4194304] 0 2024-08-19T00:56:27.494 INFO:tasks.workunit.client.0.smithi017.stdout:8/627: rmdir de/d15/d62 39 2024-08-19T00:56:27.495 INFO:tasks.workunit.client.0.smithi017.stdout:6/709: write d5/d13/d11/d2c/d4a/da8/fde [1122556,66425] 0 2024-08-19T00:56:27.500 INFO:tasks.workunit.client.0.smithi017.stdout:6/710: stat d5/d13/d11/d2c/d4a/da8/fde 0 2024-08-19T00:56:27.509 INFO:tasks.workunit.client.0.smithi017.stdout:3/706: rename d5/da/d27/d28/c46 to d5/da/d3c/d4f/d68/d9e/dda/cdd 0 2024-08-19T00:56:27.512 INFO:tasks.workunit.client.0.smithi017.stdout:1/733: dread d4/dc/f40 [0,4194304] 0 2024-08-19T00:56:27.515 INFO:tasks.workunit.client.0.smithi017.stdout:1/734: fdatasync d4/dc/d17/d1d/f3c 0 2024-08-19T00:56:27.515 INFO:tasks.workunit.client.0.smithi017.stdout:8/628: dwrite de/d15/d79/f91 [0,4194304] 0 2024-08-19T00:56:27.520 INFO:tasks.workunit.client.0.smithi017.stdout:8/629: dread de/d15/f35 [0,4194304] 0 2024-08-19T00:56:27.543 INFO:tasks.workunit.client.0.smithi017.stdout:1/735: mknod d4/dc/d17/dd6/d75/d9c/ddb/da6/db8/cee 0 2024-08-19T00:56:27.543 INFO:tasks.workunit.client.0.smithi017.stdout:1/736: chown d4/dc/d19/f79 519652 1 2024-08-19T00:56:27.544 INFO:tasks.workunit.client.0.smithi017.stdout:1/737: chown d4/dc/d17/dad/dea/c84 53 1 2024-08-19T00:56:27.545 INFO:tasks.workunit.client.0.smithi017.stdout:8/630: write de/d15/f2b [1025900,96373] 0 2024-08-19T00:56:27.546 INFO:tasks.workunit.client.0.smithi017.stdout:8/631: dread - de/d15/d39/fa8 zero size 2024-08-19T00:56:27.548 INFO:tasks.workunit.client.0.smithi017.stdout:9/609: getdents d0/d33/d22/d5e 0 2024-08-19T00:56:27.548 INFO:tasks.workunit.client.0.smithi017.stdout:8/632: write de/d15/d79/f61 [38485,94099] 0 2024-08-19T00:56:27.556 INFO:tasks.workunit.client.0.smithi017.stdout:6/711: dwrite d5/d13/d20/f56 [0,4194304] 0 2024-08-19T00:56:27.557 INFO:tasks.workunit.client.0.smithi017.stdout:3/707: link d5/d11/f16 d5/d18/fde 0 2024-08-19T00:56:27.560 INFO:tasks.workunit.client.0.smithi017.stdout:1/738: mkdir d4/dc/d3b/de6/def 0 2024-08-19T00:56:27.563 INFO:tasks.workunit.client.0.smithi017.stdout:1/739: dread d4/dc/d3b/d3d/fb6 [0,4194304] 0 2024-08-19T00:56:27.564 INFO:tasks.workunit.client.0.smithi017.stdout:6/712: unlink d5/d13/d11/l61 0 2024-08-19T00:56:27.565 INFO:tasks.workunit.client.0.smithi017.stdout:3/708: mkdir d5/d18/ddf 0 2024-08-19T00:56:27.566 INFO:tasks.workunit.client.0.smithi017.stdout:3/709: truncate d5/da/f95 794097 0 2024-08-19T00:56:27.566 INFO:tasks.workunit.client.0.smithi017.stdout:1/740: read d4/dc/d17/d1d/f1e [1630390,102260] 0 2024-08-19T00:56:27.567 INFO:tasks.workunit.client.0.smithi017.stdout:8/633: creat de/d15/d39/fb7 x:0 0 0 2024-08-19T00:56:27.568 INFO:tasks.workunit.client.0.smithi017.stdout:9/610: creat d0/d33/d22/d45/fb3 x:0 0 0 2024-08-19T00:56:27.571 INFO:tasks.workunit.client.0.smithi017.stdout:3/710: write d5/d15/d1b/f39 [3318547,89254] 0 2024-08-19T00:56:27.574 INFO:tasks.workunit.client.0.smithi017.stdout:1/741: dread d4/dc/f42 [0,4194304] 0 2024-08-19T00:56:27.576 INFO:tasks.workunit.client.0.smithi017.stdout:8/634: creat de/d15/d62/d75/fb8 x:0 0 0 2024-08-19T00:56:27.577 INFO:tasks.workunit.client.0.smithi017.stdout:3/711: mkdir d5/da/d27/d6e/dd0/de0 0 2024-08-19T00:56:27.580 INFO:tasks.workunit.client.0.smithi017.stdout:1/742: dread d4/dc/d3b/d45/f92 [0,4194304] 0 2024-08-19T00:56:27.582 INFO:tasks.workunit.client.0.smithi017.stdout:3/712: mkdir d5/da/d3c/d4f/d68/d9e/de1 0 2024-08-19T00:56:27.584 INFO:tasks.workunit.client.0.smithi017.stdout:8/635: rename de/d15/d62/d7e to de/d15/d4f/d97/db9 0 2024-08-19T00:56:27.585 INFO:tasks.workunit.client.0.smithi017.stdout:8/636: chown de/d15/l1c 95 1 2024-08-19T00:56:27.586 INFO:tasks.workunit.client.0.smithi017.stdout:8/637: dread - de/d36/d74/d8b/fb3 zero size 2024-08-19T00:56:27.586 INFO:tasks.workunit.client.0.smithi017.stdout:1/743: creat d4/dc/d3b/d9d/ff0 x:0 0 0 2024-08-19T00:56:27.589 INFO:tasks.workunit.client.0.smithi017.stdout:1/744: write d4/dc/d17/dd6/d1f/da5/fcf [4678664,115320] 0 2024-08-19T00:56:27.589 INFO:tasks.workunit.client.0.smithi017.stdout:3/713: mknod d5/da/ce2 0 2024-08-19T00:56:27.589 INFO:tasks.workunit.client.0.smithi017.stdout:6/713: dread d5/d13/d11/f5c [0,4194304] 0 2024-08-19T00:56:27.590 INFO:tasks.workunit.client.0.smithi017.stdout:8/638: symlink de/d8d/lba 0 2024-08-19T00:56:27.590 INFO:tasks.workunit.client.0.smithi017.stdout:1/745: readlink d4/dc/d19/le9 0 2024-08-19T00:56:27.592 INFO:tasks.workunit.client.0.smithi017.stdout:8/639: write de/d15/f92 [2261624,9120] 0 2024-08-19T00:56:27.593 INFO:tasks.workunit.client.0.smithi017.stdout:3/714: fsync d5/d15/d1b/f44 0 2024-08-19T00:56:27.593 INFO:tasks.workunit.client.0.smithi017.stdout:8/640: readlink de/d15/l86 0 2024-08-19T00:56:27.595 INFO:tasks.workunit.client.0.smithi017.stdout:6/714: creat d5/d13/d11/d93/ff3 x:0 0 0 2024-08-19T00:56:27.596 INFO:tasks.workunit.client.0.smithi017.stdout:6/715: dread - d5/d13/d11/d93/ff3 zero size 2024-08-19T00:56:27.598 INFO:tasks.workunit.client.0.smithi017.stdout:6/716: write d5/d13/d11/d2c/d4a/d64/d86/d90/fda [1119876,124136] 0 2024-08-19T00:56:27.598 INFO:tasks.workunit.client.0.smithi017.stdout:1/746: creat d4/dc/d17/dd6/d75/d9c/ddb/ff1 x:0 0 0 2024-08-19T00:56:27.602 INFO:tasks.workunit.client.0.smithi017.stdout:1/747: truncate d4/dc/d17/dd6/d1f/f99 670612 0 2024-08-19T00:56:27.623 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:27 smithi017 ceph-mon[16627]: pgmap v24: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 112 MiB/s rd, 276 MiB/s wr, 604 op/s 2024-08-19T00:56:27.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:27 smithi086 ceph-mon[24511]: pgmap v24: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 112 MiB/s rd, 276 MiB/s wr, 604 op/s 2024-08-19T00:56:27.702 INFO:tasks.workunit.client.0.smithi017.stdout:3/715: symlink d5/da/d27/d6e/dd0/de0/le3 0 2024-08-19T00:56:27.708 INFO:tasks.workunit.client.0.smithi017.stdout:3/716: dread d5/d11/f85 [0,4194304] 0 2024-08-19T00:56:27.713 INFO:tasks.workunit.client.0.smithi017.stdout:8/641: creat de/d15/d39/fbb x:0 0 0 2024-08-19T00:56:27.721 INFO:tasks.workunit.client.0.smithi017.stdout:8/642: unlink de/d36/d74/ca2 0 2024-08-19T00:56:27.723 INFO:tasks.workunit.client.0.smithi017.stdout:8/643: write de/d15/d39/fb7 [63173,16031] 0 2024-08-19T00:56:27.726 INFO:tasks.workunit.client.0.smithi017.stdout:3/717: dwrite d5/d11/f85 [0,4194304] 0 2024-08-19T00:56:27.801 INFO:tasks.workunit.client.0.smithi017.stdout:6/717: rename d5/d13/d11/d2c/d4a/da8/dd1/c8d to d5/d13/d20/d77/cf4 0 2024-08-19T00:56:27.806 INFO:tasks.workunit.client.0.smithi017.stdout:6/718: mknod d5/d13/d11/d2c/d4a/d64/d86/d90/dba/dbf/cf5 0 2024-08-19T00:56:27.808 INFO:tasks.workunit.client.0.smithi017.stdout:6/719: mknod d5/d13/d11/d2c/d4a/da8/dd1/d8f/cf6 0 2024-08-19T00:56:27.810 INFO:tasks.workunit.client.0.smithi017.stdout:6/720: write d5/d13/d11/d2c/d4a/da8/dd1/f6c [80964,50683] 0 2024-08-19T00:56:27.811 INFO:tasks.workunit.client.0.smithi017.stdout:6/721: read - d5/d13/d11/d2c/d4a/d64/fd3 zero size 2024-08-19T00:56:27.814 INFO:tasks.workunit.client.0.smithi017.stdout:6/722: read - d5/d13/d11/d52/fb8 zero size 2024-08-19T00:56:27.815 INFO:tasks.workunit.client.0.smithi017.stdout:6/723: fdatasync d5/d13/d11/d2c/f76 0 2024-08-19T00:56:27.816 INFO:tasks.workunit.client.0.smithi017.stdout:6/724: chown d5/d13/d11/d2c/d4a/d64 41 1 2024-08-19T00:56:27.817 INFO:tasks.workunit.client.0.smithi017.stdout:6/725: stat d5/d13/d11/d2c/d4a 0 2024-08-19T00:56:27.821 INFO:tasks.workunit.client.0.smithi017.stdout:6/726: getdents d5/d13/d11/d2c/d51 0 2024-08-19T00:56:27.822 INFO:tasks.workunit.client.0.smithi017.stdout:6/727: fdatasync d5/d13/d11/d2c/d4a/da8/dd1/d8f/f97 0 2024-08-19T00:56:27.826 INFO:tasks.workunit.client.0.smithi017.stdout:6/728: mknod d5/d13/de5/cf7 0 2024-08-19T00:56:27.827 INFO:tasks.workunit.client.0.smithi017.stdout:8/644: truncate de/f37 640806 0 2024-08-19T00:56:27.832 INFO:tasks.workunit.client.0.smithi017.stdout:8/645: dread de/d15/f35 [0,4194304] 0 2024-08-19T00:56:27.837 INFO:tasks.workunit.client.0.smithi017.stdout:8/646: dwrite de/d36/f69 [0,4194304] 0 2024-08-19T00:56:27.841 INFO:tasks.workunit.client.0.smithi017.stdout:8/647: creat de/d15/d4f/d97/db9/fbc x:0 0 0 2024-08-19T00:56:27.845 INFO:tasks.workunit.client.0.smithi017.stdout:8/648: link de/d15/d9d/fb2 de/d36/d74/fbd 0 2024-08-19T00:56:27.851 INFO:tasks.workunit.client.0.smithi017.stdout:8/649: dwrite de/f4d [0,4194304] 0 2024-08-19T00:56:27.867 INFO:tasks.workunit.client.0.smithi017.stdout:3/718: rename d5/d15 to d5/da/d3c/de4 0 2024-08-19T00:56:27.868 INFO:tasks.workunit.client.0.smithi017.stdout:3/719: fsync d5/d18/dab/fb9 0 2024-08-19T00:56:27.875 INFO:tasks.workunit.client.0.smithi017.stdout:8/650: dread de/d15/d39/f59 [0,4194304] 0 2024-08-19T00:56:27.876 INFO:tasks.workunit.client.0.smithi017.stdout:6/729: creat d5/d13/d11/ff8 x:0 0 0 2024-08-19T00:56:27.877 INFO:tasks.workunit.client.0.smithi017.stdout:6/730: chown d5/d13/d11/d2c/d4a/d64/d86/d90/dba/dbf/fc2 318714686 1 2024-08-19T00:56:27.879 INFO:tasks.workunit.client.0.smithi017.stdout:8/651: mknod de/d15/d39/d3d/cbe 0 2024-08-19T00:56:27.883 INFO:tasks.workunit.client.0.smithi017.stdout:8/652: mknod de/d15/d9d/cbf 0 2024-08-19T00:56:27.886 INFO:tasks.workunit.client.0.smithi017.stdout:6/731: dwrite d5/d13/d11/d52/fdd [0,4194304] 0 2024-08-19T00:56:27.891 INFO:tasks.workunit.client.0.smithi017.stdout:6/732: chown d5/d13/d11/d4d/ce4 70869564 1 2024-08-19T00:56:27.916 INFO:tasks.workunit.client.0.smithi017.stdout:6/733: write d5/d13/d11/f3f [4782727,99967] 0 2024-08-19T00:56:27.919 INFO:tasks.workunit.client.0.smithi017.stdout:6/734: symlink d5/d13/d20/d77/d99/lf9 0 2024-08-19T00:56:27.921 INFO:tasks.workunit.client.0.smithi017.stdout:8/653: dwrite de/d15/d4f/d68/d84/f9a [0,4194304] 0 2024-08-19T00:56:27.923 INFO:tasks.workunit.client.0.smithi017.stdout:6/735: mkdir d5/d13/d11/d4d/dfa 0 2024-08-19T00:56:27.927 INFO:tasks.workunit.client.0.smithi017.stdout:6/736: rename d5/d13/c10 to d5/d13/d11/d2c/cfb 0 2024-08-19T00:56:27.928 INFO:tasks.workunit.client.0.smithi017.stdout:6/737: read d5/d13/d11/d2c/f30 [75694,60267] 0 2024-08-19T00:56:27.929 INFO:tasks.workunit.client.0.smithi017.stdout:8/654: creat de/d15/d4f/d68/db5/fc0 x:0 0 0 2024-08-19T00:56:27.930 INFO:tasks.workunit.client.0.smithi017.stdout:6/738: dread d5/d13/dcf/fdf [0,4194304] 0 2024-08-19T00:56:27.932 INFO:tasks.workunit.client.0.smithi017.stdout:6/739: write d5/d13/d11/d93/fb0 [3071343,31663] 0 2024-08-19T00:56:27.933 INFO:tasks.workunit.client.0.smithi017.stdout:8/655: truncate de/f47 1659408 0 2024-08-19T00:56:27.935 INFO:tasks.workunit.client.0.smithi017.stdout:8/656: write de/d15/d4f/d68/db5/fc0 [239483,44554] 0 2024-08-19T00:56:27.938 INFO:tasks.workunit.client.0.smithi017.stdout:6/740: fdatasync d5/fc6 0 2024-08-19T00:56:27.944 INFO:tasks.workunit.client.0.smithi017.stdout:6/741: rename d5/d13/d11/d2c/d4a/d64/lcd to d5/d7b/lfc 0 2024-08-19T00:56:27.946 INFO:tasks.workunit.client.0.smithi017.stdout:6/742: unlink d5/d13/d20/f56 0 2024-08-19T00:56:27.948 INFO:tasks.workunit.client.0.smithi017.stdout:6/743: truncate d5/d13/d11/f53 1512079 0 2024-08-19T00:56:27.953 INFO:tasks.workunit.client.0.smithi017.stdout:6/744: mknod d5/d13/d11/d4d/dfa/cfd 0 2024-08-19T00:56:27.958 INFO:tasks.workunit.client.0.smithi017.stdout:8/657: dwrite de/f47 [0,4194304] 0 2024-08-19T00:56:27.962 INFO:tasks.workunit.client.0.smithi017.stdout:8/658: mknod de/d15/d4f/d97/cc1 0 2024-08-19T00:56:27.964 INFO:tasks.workunit.client.0.smithi017.stdout:6/745: rename d5/d13/d11/d2c/d4a/f57 to d5/d13/ffe 0 2024-08-19T00:56:27.969 INFO:tasks.workunit.client.0.smithi017.stdout:8/659: mkdir de/d15/d39/d3d/dc2 0 2024-08-19T00:56:27.970 INFO:tasks.workunit.client.0.smithi017.stdout:8/660: readlink de/d15/l30 0 2024-08-19T00:56:27.974 INFO:tasks.workunit.client.0.smithi017.stdout:6/746: dwrite d5/d13/d20/d77/d99/fe0 [0,4194304] 0 2024-08-19T00:56:27.978 INFO:tasks.workunit.client.0.smithi017.stdout:8/661: dread de/d36/d74/f9e [0,4194304] 0 2024-08-19T00:56:27.982 INFO:tasks.workunit.client.0.smithi017.stdout:6/747: rename d5/d13/d11/d2c/cfb to d5/d13/d11/d2c/d4a/d64/d86/d90/cff 0 2024-08-19T00:56:27.984 INFO:tasks.workunit.client.0.smithi017.stdout:8/662: mknod de/d15/d4f/cc3 0 2024-08-19T00:56:27.985 INFO:tasks.workunit.client.0.smithi017.stdout:6/748: symlink d5/d13/d11/d2c/d51/l100 0 2024-08-19T00:56:27.986 INFO:tasks.workunit.client.0.smithi017.stdout:8/663: mkdir de/d36/d74/d8b/dc4 0 2024-08-19T00:56:27.987 INFO:tasks.workunit.client.0.smithi017.stdout:6/749: read d5/d13/d11/f3f [918863,76734] 0 2024-08-19T00:56:27.989 INFO:tasks.workunit.client.0.smithi017.stdout:8/664: mkdir de/d15/d9d/dc5 0 2024-08-19T00:56:27.989 INFO:tasks.workunit.client.0.smithi017.stdout:8/665: readlink de/d15/l5b 0 2024-08-19T00:56:27.990 INFO:tasks.workunit.client.0.smithi017.stdout:8/666: chown de/d15/d62/d75/ca5 15 1 2024-08-19T00:56:27.991 INFO:tasks.workunit.client.0.smithi017.stdout:8/667: dread - de/d15/f65 zero size 2024-08-19T00:56:27.995 INFO:tasks.workunit.client.0.smithi017.stdout:8/668: dread de/d15/d79/fa3 [0,4194304] 0 2024-08-19T00:56:28.001 INFO:tasks.workunit.client.0.smithi017.stdout:8/669: mknod de/d15/d9d/dc5/cc6 0 2024-08-19T00:56:28.002 INFO:tasks.workunit.client.0.smithi017.stdout:8/670: fsync de/d36/d74/fa0 0 2024-08-19T00:56:28.008 INFO:tasks.workunit.client.0.smithi017.stdout:6/750: rmdir d5/d13/d11/d2c/d51/d7e 39 2024-08-19T00:56:28.013 INFO:tasks.workunit.client.0.smithi017.stdout:6/751: creat d5/d13/d11/d2c/d4a/d64/de2/f101 x:0 0 0 2024-08-19T00:56:28.014 INFO:tasks.workunit.client.0.smithi017.stdout:8/671: getdents de/d15/d4f/d68/db5 0 2024-08-19T00:56:28.018 INFO:tasks.workunit.client.0.smithi017.stdout:6/752: rmdir d5/d13/d11/d2c/d9d 39 2024-08-19T00:56:28.020 INFO:tasks.workunit.client.0.smithi017.stdout:6/753: chown d5/d13/d11/d93/ff3 15432059 1 2024-08-19T00:56:28.021 INFO:tasks.workunit.client.0.smithi017.stdout:8/672: dwrite de/f47 [0,4194304] 0 2024-08-19T00:56:28.023 INFO:tasks.workunit.client.0.smithi017.stdout:6/754: readlink d5/d13/d11/d2c/d4a/d64/l65 0 2024-08-19T00:56:28.030 INFO:tasks.workunit.client.0.smithi017.stdout:6/755: symlink d5/d13/d20/d77/l102 0 2024-08-19T00:56:28.031 INFO:tasks.workunit.client.0.smithi017.stdout:6/756: chown d5/d13/d11/d2c/d4a/da8/dd9 61583375 1 2024-08-19T00:56:28.035 INFO:tasks.workunit.client.0.smithi017.stdout:8/673: mkdir de/d15/d39/dc7 0 2024-08-19T00:56:28.037 INFO:tasks.workunit.client.0.smithi017.stdout:6/757: mkdir d5/d13/d11/d2c/d4a/d64/d86/d103 0 2024-08-19T00:56:28.038 INFO:tasks.workunit.client.0.smithi017.stdout:8/674: mkdir de/d15/d4f/d68/d84/dc8 0 2024-08-19T00:56:28.044 INFO:tasks.workunit.client.0.smithi017.stdout:8/675: dread de/d15/d79/f61 [0,4194304] 0 2024-08-19T00:56:28.045 INFO:tasks.workunit.client.0.smithi017.stdout:6/758: symlink d5/d13/d11/d2c/d4a/d64/d86/d90/dba/de7/l104 0 2024-08-19T00:56:28.047 INFO:tasks.workunit.client.0.smithi017.stdout:8/676: mknod de/d36/cc9 0 2024-08-19T00:56:28.047 INFO:tasks.workunit.client.0.smithi017.stdout:8/677: dread - de/d36/d74/fbd zero size 2024-08-19T00:56:28.054 INFO:tasks.workunit.client.0.smithi017.stdout:8/678: read de/f37 [152932,101623] 0 2024-08-19T00:56:28.056 INFO:tasks.workunit.client.0.smithi017.stdout:8/679: chown de/d15/d39/d3d/f4b 57937 1 2024-08-19T00:56:28.057 INFO:tasks.workunit.client.0.smithi017.stdout:6/759: rmdir d5/d13/d11/d2c/d4a/d64/d86/d90/dba 39 2024-08-19T00:56:28.058 INFO:tasks.workunit.client.0.smithi017.stdout:6/760: write d5/d13/fd0 [1243193,48860] 0 2024-08-19T00:56:28.058 INFO:tasks.workunit.client.0.smithi017.stdout:8/680: symlink de/d36/d74/d8b/lca 0 2024-08-19T00:56:28.161 INFO:tasks.workunit.client.0.smithi017.stdout:8/681: mknod de/d15/d4f/d68/d84/ccb 0 2024-08-19T00:56:28.163 INFO:tasks.workunit.client.0.smithi017.stdout:6/761: symlink d5/d13/d11/d2c/d4a/d64/d86/d90/dba/l105 0 2024-08-19T00:56:28.164 INFO:tasks.workunit.client.0.smithi017.stdout:6/762: write d5/d13/d11/d2c/d4a/da8/dd9/f96 [3956036,53147] 0 2024-08-19T00:56:28.165 INFO:tasks.workunit.client.0.smithi017.stdout:6/763: dread - d5/d13/d20/d77/d99/fac zero size 2024-08-19T00:56:28.166 INFO:tasks.workunit.client.0.smithi017.stdout:6/764: write d5/d13/d11/d93/ff3 [12077,28331] 0 2024-08-19T00:56:28.175 INFO:tasks.workunit.client.0.smithi017.stdout:8/682: rename de/d15/d4f/d97/db9 to de/d15/d4f/dcc 0 2024-08-19T00:56:28.178 INFO:tasks.workunit.client.0.smithi017.stdout:8/683: mkdir de/d36/d74/d8b/dcd 0 2024-08-19T00:56:28.181 INFO:tasks.workunit.client.0.smithi017.stdout:8/684: mknod de/d15/d39/dc7/cce 0 2024-08-19T00:56:28.182 INFO:tasks.workunit.client.0.smithi017.stdout:8/685: creat de/d15/d9d/fcf x:0 0 0 2024-08-19T00:56:28.187 INFO:tasks.workunit.client.0.smithi017.stdout:8/686: getdents de/d15/d39/d3d/dc2 0 2024-08-19T00:56:28.187 INFO:tasks.workunit.client.0.smithi017.stdout:6/765: dwrite d5/d13/f1f [4194304,4194304] 0 2024-08-19T00:56:28.189 INFO:tasks.workunit.client.0.smithi017.stdout:6/766: write d5/d13/d11/d2c/f46 [3997843,88305] 0 2024-08-19T00:56:28.192 INFO:tasks.workunit.client.0.smithi017.stdout:6/767: write d5/d13/d11/d2c/fc3 [1500711,25390] 0 2024-08-19T00:56:28.193 INFO:tasks.workunit.client.0.smithi017.stdout:8/687: dread de/d36/dad/fb0 [0,4194304] 0 2024-08-19T00:56:28.196 INFO:tasks.workunit.client.0.smithi017.stdout:6/768: rename d5/d13/d11/d2c/d4a/da8/dd9 to d5/d13/d11/d2c/d4a/d106 0 2024-08-19T00:56:28.197 INFO:tasks.workunit.client.0.smithi017.stdout:8/688: symlink de/d36/d74/d8b/ld0 0 2024-08-19T00:56:28.198 INFO:tasks.workunit.client.0.smithi017.stdout:6/769: dread - d5/d13/ffe zero size 2024-08-19T00:56:28.203 INFO:tasks.workunit.client.0.smithi017.stdout:8/689: mknod de/d15/d39/cd1 0 2024-08-19T00:56:28.205 INFO:tasks.workunit.client.0.smithi017.stdout:8/690: mknod de/d36/cd2 0 2024-08-19T00:56:28.209 INFO:tasks.workunit.client.0.smithi017.stdout:6/770: dread f3 [0,4194304] 0 2024-08-19T00:56:28.210 INFO:tasks.workunit.client.0.smithi017.stdout:8/691: creat de/d15/d4f/d68/d84/dc8/fd3 x:0 0 0 2024-08-19T00:56:28.211 INFO:tasks.workunit.client.0.smithi017.stdout:8/692: write de/d36/d74/d80/f9c [1758090,121178] 0 2024-08-19T00:56:28.213 INFO:tasks.workunit.client.0.smithi017.stdout:6/771: truncate d5/d13/d11/f37 3050048 0 2024-08-19T00:56:28.213 INFO:tasks.workunit.client.0.smithi017.stdout:8/693: read de/f5d [245223,116704] 0 2024-08-19T00:56:28.215 INFO:tasks.workunit.client.0.smithi017.stdout:6/772: creat d5/d13/d11/d2c/d4a/d64/d86/d90/dba/f107 x:0 0 0 2024-08-19T00:56:28.217 INFO:tasks.workunit.client.0.smithi017.stdout:6/773: fdatasync d5/d13/d20/fa5 0 2024-08-19T00:56:28.289 INFO:tasks.workunit.client.0.smithi017.stdout:8/694: truncate de/d36/f69 3829464 0 2024-08-19T00:56:28.293 INFO:tasks.workunit.client.0.smithi017.stdout:6/774: truncate d5/d13/f3e 1049579 0 2024-08-19T00:56:28.299 INFO:tasks.workunit.client.0.smithi017.stdout:6/775: getdents d5/d13/d11/d2c 0 2024-08-19T00:56:28.301 INFO:tasks.workunit.client.0.smithi017.stdout:8/695: dread de/f53 [0,4194304] 0 2024-08-19T00:56:28.306 INFO:tasks.workunit.client.0.smithi017.stdout:6/776: link d5/d13/d11/d2c/d4a/d106/cbb d5/d13/d11/d52/c108 0 2024-08-19T00:56:28.319 INFO:tasks.workunit.client.0.smithi017.stdout:8/696: truncate de/d15/d62/d75/fa4 292627 0 2024-08-19T00:56:28.320 INFO:tasks.workunit.client.0.smithi017.stdout:6/777: truncate d5/d13/d11/d2c/d51/fa6 353612 0 2024-08-19T00:56:28.324 INFO:tasks.workunit.client.0.smithi017.stdout:6/778: creat d5/d13/d11/d2c/d4a/da8/dd1/d8f/f109 x:0 0 0 2024-08-19T00:56:28.325 INFO:tasks.workunit.client.0.smithi017.stdout:6/779: write d5/d13/d11/d52/fc7 [882347,112450] 0 2024-08-19T00:56:28.332 INFO:tasks.workunit.client.0.smithi017.stdout:8/697: write de/d15/d9d/fb2 [736139,11905] 0 2024-08-19T00:56:28.341 INFO:tasks.workunit.client.0.smithi017.stdout:8/698: link de/d15/d4f/d97/cc1 de/d36/dad/cd4 0 2024-08-19T00:56:28.346 INFO:tasks.workunit.client.0.smithi017.stdout:8/699: creat de/d15/d39/dc7/fd5 x:0 0 0 2024-08-19T00:56:28.346 INFO:tasks.workunit.client.0.smithi017.stdout:8/700: dread - de/d15/d39/fbb zero size 2024-08-19T00:56:28.347 INFO:tasks.workunit.client.0.smithi017.stdout:8/701: mkdir de/d15/d39/d3d/dc2/dd6 0 2024-08-19T00:56:28.351 INFO:tasks.workunit.client.0.smithi017.stdout:6/780: dread d5/f4f [0,4194304] 0 2024-08-19T00:56:28.359 INFO:tasks.workunit.client.0.smithi017.stdout:8/702: dread de/d15/d39/f41 [0,4194304] 0 2024-08-19T00:56:28.368 INFO:tasks.workunit.client.0.smithi017.stdout:6/781: dread d5/fc0 [0,4194304] 0 2024-08-19T00:56:28.373 INFO:tasks.workunit.client.0.smithi017.stdout:6/782: getdents d5/d13/d20 0 2024-08-19T00:56:28.375 INFO:tasks.workunit.client.0.smithi017.stdout:6/783: truncate d5/d13/d20/d77/d99/fac 29962 0 2024-08-19T00:56:28.378 INFO:tasks.workunit.client.0.smithi017.stdout:6/784: creat d5/d13/d11/d2c/d51/d7e/f10a x:0 0 0 2024-08-19T00:56:28.381 INFO:tasks.workunit.client.0.smithi017.stdout:6/785: creat d5/d13/d11/d2c/d4a/d64/d86/d90/dba/dbf/f10b x:0 0 0 2024-08-19T00:56:28.382 INFO:tasks.workunit.client.0.smithi017.stdout:6/786: stat d5/d13/d11/d2c/d51/ld8 0 2024-08-19T00:56:28.386 INFO:tasks.workunit.client.0.smithi017.stdout:6/787: rmdir d5/d13/d11/d2c/d4a/d64/d86/d103 0 2024-08-19T00:56:28.388 INFO:tasks.workunit.client.0.smithi017.stdout:6/788: fdatasync d5/d13/d20/d89/fa4 0 2024-08-19T00:56:28.394 INFO:tasks.workunit.client.0.smithi017.stdout:6/789: dread d5/d13/d11/f53 [0,4194304] 0 2024-08-19T00:56:28.394 INFO:tasks.workunit.client.0.smithi017.stdout:6/790: chown d5/d13/d11/d2c/d51/d7e/f10a 143059295 1 2024-08-19T00:56:28.400 INFO:tasks.workunit.client.0.smithi017.stdout:6/791: dwrite d5/d13/d11/f9f [0,4194304] 0 2024-08-19T00:56:28.412 INFO:tasks.workunit.client.0.smithi017.stdout:6/792: dwrite d5/d13/d20/d89/fef [0,4194304] 0 2024-08-19T00:56:28.416 INFO:tasks.workunit.client.0.smithi017.stdout:6/793: truncate d5/d13/d11/d2c/d51/d7e/f83 1554093 0 2024-08-19T00:56:28.419 INFO:tasks.workunit.client.0.smithi017.stdout:6/794: symlink d5/d13/d11/d2c/l10c 0 2024-08-19T00:56:28.421 INFO:tasks.workunit.client.0.smithi017.stdout:6/795: creat d5/d13/d11/d93/f10d x:0 0 0 2024-08-19T00:56:28.435 INFO:tasks.workunit.client.0.smithi017.stdout:6/796: link d5/d13/d11/d2c/c45 d5/d13/d11/d2c/d9d/c10e 0 2024-08-19T00:56:28.436 INFO:tasks.workunit.client.0.smithi017.stdout:6/797: fdatasync d5/d13/d11/f3f 0 2024-08-19T00:56:28.437 INFO:tasks.workunit.client.0.smithi017.stdout:6/798: stat d5/d13/d20/d77/d99/fe0 0 2024-08-19T00:56:28.443 INFO:tasks.workunit.client.0.smithi017.stdout:6/799: dwrite d5/d13/d20/d89/fef [0,4194304] 0 2024-08-19T00:56:28.448 INFO:tasks.workunit.client.0.smithi017.stdout:6/800: creat d5/d13/d11/d2c/d51/d7e/f10f x:0 0 0 2024-08-19T00:56:28.462 INFO:tasks.workunit.client.0.smithi017.stdout:6/801: dwrite d5/d13/d11/d2c/d4a/da8/dd1/d8f/fa1 [0,4194304] 0 2024-08-19T00:56:28.475 INFO:tasks.workunit.client.0.smithi017.stdout:6/802: dread d5/d13/d11/f72 [0,4194304] 0 2024-08-19T00:56:28.479 INFO:tasks.workunit.client.0.smithi017.stdout:6/803: rename d5/d13/d20/d89/fa4 to d5/d13/d11/d4d/f110 0 2024-08-19T00:56:28.480 INFO:tasks.workunit.client.0.smithi017.stdout:6/804: chown d5/d13/d11/d2c/d4a/d64/de2/f101 10 1 2024-08-19T00:56:28.484 INFO:tasks.workunit.client.0.smithi017.stdout:6/805: dread d5/fc6 [0,4194304] 0 2024-08-19T00:56:28.485 INFO:tasks.workunit.client.0.smithi017.stdout:6/806: write d5/d13/d11/d52/fdd [4254651,102191] 0 2024-08-19T00:56:28.487 INFO:tasks.workunit.client.0.smithi017.stdout:6/807: rmdir d5/d13/d20 39 2024-08-19T00:56:28.499 INFO:tasks.workunit.client.0.smithi017.stdout:6/808: dwrite d5/f36 [4194304,4194304] 0 2024-08-19T00:56:28.499 INFO:tasks.workunit.client.0.smithi017.stdout:6/809: stat d5/d7b/cee 0 2024-08-19T00:56:28.500 INFO:tasks.workunit.client.0.smithi017.stdout:6/810: fsync d5/d13/d11/ff8 0 2024-08-19T00:56:28.501 INFO:tasks.workunit.client.0.smithi017.stdout:6/811: chown d5/d13/d11/d93/c9a 7961671 1 2024-08-19T00:56:28.504 INFO:tasks.workunit.client.0.smithi017.stdout:6/812: mkdir d5/d7b/d111 0 2024-08-19T00:56:28.544 INFO:tasks.workunit.client.0.smithi017.stdout:5/518: sync 2024-08-19T00:56:28.544 INFO:tasks.workunit.client.0.smithi017.stdout:2/747: sync 2024-08-19T00:56:28.544 INFO:tasks.workunit.client.0.smithi017.stdout:4/714: sync 2024-08-19T00:56:28.558 INFO:tasks.workunit.client.0.smithi017.stdout:2/748: dread d2/fc8 [0,4194304] 0 2024-08-19T00:56:28.582 INFO:tasks.workunit.client.0.smithi017.stdout:5/519: dread db/f2a [0,4194304] 0 2024-08-19T00:56:28.583 INFO:tasks.workunit.client.0.smithi017.stdout:2/749: mkdir d2/d7/d10/d3b/d3c/df5 0 2024-08-19T00:56:28.584 INFO:tasks.workunit.client.0.smithi017.stdout:6/813: getdents d5/d13/de5 0 2024-08-19T00:56:28.584 INFO:tasks.workunit.client.0.smithi017.stdout:2/750: dread - d2/d7/d10/d3b/d80/da2/fe1 zero size 2024-08-19T00:56:28.588 INFO:tasks.workunit.client.0.smithi017.stdout:2/751: rmdir d2/d7/d10/d35/d45 39 2024-08-19T00:56:28.590 INFO:tasks.workunit.client.0.smithi017.stdout:6/814: mkdir d5/d13/d11/d2c/d4a/da8/dd1/d8f/d112 0 2024-08-19T00:56:28.591 INFO:tasks.workunit.client.0.smithi017.stdout:5/520: mknod db/d19/d1f/d15/d3e/d40/d83/caf 0 2024-08-19T00:56:28.593 INFO:tasks.workunit.client.0.smithi017.stdout:5/521: fdatasync db/d19/d1f/d15/f25 0 2024-08-19T00:56:28.594 INFO:tasks.workunit.client.0.smithi017.stdout:5/522: chown f7 275448229 1 2024-08-19T00:56:28.596 INFO:tasks.workunit.client.0.smithi017.stdout:2/752: dwrite d2/d7/d44/fc9 [0,4194304] 0 2024-08-19T00:56:28.598 INFO:tasks.workunit.client.0.smithi017.stdout:5/523: creat db/d19/d33/fb0 x:0 0 0 2024-08-19T00:56:28.602 INFO:tasks.workunit.client.0.smithi017.stdout:7/809: sync 2024-08-19T00:56:28.603 INFO:tasks.workunit.client.0.smithi017.stdout:0/616: sync 2024-08-19T00:56:28.604 INFO:tasks.workunit.client.0.smithi017.stdout:2/753: dwrite d2/d7/d10/d19/d48/f82 [0,4194304] 0 2024-08-19T00:56:28.606 INFO:tasks.workunit.client.0.smithi017.stdout:2/754: chown d2/d7/d10/d19/f27 80050 1 2024-08-19T00:56:28.606 INFO:tasks.workunit.client.0.smithi017.stdout:6/815: getdents d5/d13/d11/d4d 0 2024-08-19T00:56:28.611 INFO:tasks.workunit.client.0.smithi017.stdout:5/524: rename db/ff to db/d19/d1f/d15/fb1 0 2024-08-19T00:56:28.617 INFO:tasks.workunit.client.0.smithi017.stdout:6/816: dread d5/d13/d11/d2c/d4a/d64/d86/d90/dba/dbf/fc2 [0,4194304] 0 2024-08-19T00:56:28.617 INFO:tasks.workunit.client.0.smithi017.stdout:7/810: rename d3/dc/df/d37/d93/lcc to d3/dc/df/d37/d93/da7/l108 0 2024-08-19T00:56:28.618 INFO:tasks.workunit.client.0.smithi017.stdout:4/715: dwrite d2/d87/db2/de6/d53/d57/fa2 [0,4194304] 0 2024-08-19T00:56:28.619 INFO:tasks.workunit.client.0.smithi017.stdout:2/755: fsync d2/d7/d10/d35/d45/fa9 0 2024-08-19T00:56:28.625 INFO:tasks.workunit.client.0.smithi017.stdout:7/811: symlink d3/dab/l109 0 2024-08-19T00:56:28.632 INFO:tasks.workunit.client.0.smithi017.stdout:0/617: dwrite d5/f11 [0,4194304] 0 2024-08-19T00:56:28.640 INFO:tasks.workunit.client.0.smithi017.stdout:7/812: mkdir d3/dab/d106/de5/d10a 0 2024-08-19T00:56:28.641 INFO:tasks.workunit.client.0.smithi017.stdout:4/716: creat d2/d1a/d55/ff2 x:0 0 0 2024-08-19T00:56:28.645 INFO:tasks.workunit.client.0.smithi017.stdout:7/813: write d3/dc/df/d1c/d2c/d83/f86 [1029565,7030] 0 2024-08-19T00:56:28.645 INFO:tasks.workunit.client.0.smithi017.stdout:4/717: fsync d2/d1a/dd0/dd4/fdd 0 2024-08-19T00:56:28.645 INFO:tasks.workunit.client.0.smithi017.stdout:0/618: creat d5/d18/d78/dbc/fd1 x:0 0 0 2024-08-19T00:56:28.645 INFO:tasks.workunit.client.0.smithi017.stdout:2/756: dread d2/d7/d10/d19/f27 [0,4194304] 0 2024-08-19T00:56:28.648 INFO:tasks.workunit.client.0.smithi017.stdout:5/525: dwrite db/d19/d57/f61 [0,4194304] 0 2024-08-19T00:56:28.649 INFO:tasks.workunit.client.0.smithi017.stdout:6/817: truncate d5/d13/d11/d2c/f46 6331414 0 2024-08-19T00:56:28.653 INFO:tasks.workunit.client.0.smithi017.stdout:0/619: symlink d5/d17/d26/d30/d5d/ld2 0 2024-08-19T00:56:28.654 INFO:tasks.workunit.client.0.smithi017.stdout:4/718: rmdir d2/d1a/d55 39 2024-08-19T00:56:28.657 INFO:tasks.workunit.client.0.smithi017.stdout:5/526: chown db/c1b 4051 1 2024-08-19T00:56:28.662 INFO:tasks.workunit.client.0.smithi017.stdout:6/818: mknod d5/d7b/c113 0 2024-08-19T00:56:28.665 INFO:tasks.workunit.client.0.smithi017.stdout:2/757: rename d2/d7/d10/d35/da0 to d2/dc5/df6 0 2024-08-19T00:56:28.666 INFO:tasks.workunit.client.0.smithi017.stdout:5/527: creat db/d19/d57/fb2 x:0 0 0 2024-08-19T00:56:28.666 INFO:tasks.workunit.client.0.smithi017.stdout:2/758: readlink d2/d7/d29/l46 0 2024-08-19T00:56:28.668 INFO:tasks.workunit.client.0.smithi017.stdout:7/814: dwrite d3/dc/df/d37/d46/d73/d80/d81/f99 [0,4194304] 0 2024-08-19T00:56:28.668 INFO:tasks.workunit.client.0.smithi017.stdout:7/815: chown d3/dab/l109 175971 1 2024-08-19T00:56:28.673 INFO:tasks.workunit.client.0.smithi017.stdout:4/719: rename d2/d87/db2/de6/d40/d56/d99/ce4 to d2/d11/d24/cf3 0 2024-08-19T00:56:28.677 INFO:tasks.workunit.client.0.smithi017.stdout:7/816: dwrite d3/dc/df/d1a/fc1 [0,4194304] 0 2024-08-19T00:56:28.678 INFO:tasks.workunit.client.0.smithi017.stdout:6/819: mkdir d5/d13/d11/d2c/d114 0 2024-08-19T00:56:28.681 INFO:tasks.workunit.client.0.smithi017.stdout:0/620: getdents d5/d17/d26/d30/d3e 0 2024-08-19T00:56:28.685 INFO:tasks.workunit.client.0.smithi017.stdout:5/528: rename db/d19/d1f/d15/d3e/d40/d49/d63/d80/f87 to db/d19/d1f/d15/d3e/d40/d49/d63/d80/d9d/fb3 0 2024-08-19T00:56:28.686 INFO:tasks.workunit.client.0.smithi017.stdout:5/529: chown db/d19/d1f/d15/d3e/l4f 659307 1 2024-08-19T00:56:28.690 INFO:tasks.workunit.client.0.smithi017.stdout:7/817: rename d3/dc/df/d37/d46/d73/fa8 to d3/dc/df/d23/d6a/db6/f10b 0 2024-08-19T00:56:28.692 INFO:tasks.workunit.client.0.smithi017.stdout:0/621: mkdir d5/d17/d26/d30/d3e/d5a/dcd/dd3 0 2024-08-19T00:56:28.694 INFO:tasks.workunit.client.0.smithi017.stdout:1/748: sync 2024-08-19T00:56:28.694 INFO:tasks.workunit.client.0.smithi017.stdout:3/720: sync 2024-08-19T00:56:28.695 INFO:tasks.workunit.client.0.smithi017.stdout:9/611: sync 2024-08-19T00:56:28.695 INFO:tasks.workunit.client.0.smithi017.stdout:8/703: sync 2024-08-19T00:56:28.695 INFO:tasks.workunit.client.0.smithi017.stdout:6/820: rename d5/d7b/cd5 to d5/d13/d11/d4d/c115 0 2024-08-19T00:56:28.696 INFO:tasks.workunit.client.0.smithi017.stdout:3/721: stat d5/da/d3c/de4/d1b/ca2 0 2024-08-19T00:56:28.696 INFO:tasks.workunit.client.0.smithi017.stdout:4/720: link d2/l1b d2/dc1/lf4 0 2024-08-19T00:56:28.700 INFO:tasks.workunit.client.0.smithi017.stdout:2/759: getdents d2/d7/d10/d3b/d80/d81 0 2024-08-19T00:56:28.703 INFO:tasks.workunit.client.0.smithi017.stdout:9/612: creat d0/d33/d22/d45/da2/fb4 x:0 0 0 2024-08-19T00:56:28.704 INFO:tasks.workunit.client.0.smithi017.stdout:5/530: dread db/d19/d1f/d15/d3e/d40/f84 [0,4194304] 0 2024-08-19T00:56:28.708 INFO:tasks.workunit.client.0.smithi017.stdout:3/722: fsync d5/f60 0 2024-08-19T00:56:28.710 INFO:tasks.workunit.client.0.smithi017.stdout:2/760: dwrite d2/d7/f96 [0,4194304] 0 2024-08-19T00:56:28.710 INFO:tasks.workunit.client.0.smithi017.stdout:0/622: write d5/d18/fa8 [418407,82774] 0 2024-08-19T00:56:28.713 INFO:tasks.workunit.client.0.smithi017.stdout:7/818: rename d3/dc/l49 to d3/dc/df/d23/d6a/db6/l10c 0 2024-08-19T00:56:28.715 INFO:tasks.workunit.client.0.smithi017.stdout:7/819: write d3/f51 [3792091,119102] 0 2024-08-19T00:56:28.715 INFO:tasks.workunit.client.0.smithi017.stdout:9/613: dwrite d0/d58/d49/d5d/f93 [0,4194304] 0 2024-08-19T00:56:28.719 INFO:tasks.workunit.client.0.smithi017.stdout:6/821: fdatasync d5/d13/d11/d2c/d4a/d64/d86/d90/f98 0 2024-08-19T00:56:28.731 INFO:tasks.workunit.client.0.smithi017.stdout:7/820: creat d3/dc/df/d37/d93/da7/f10d x:0 0 0 2024-08-19T00:56:28.732 INFO:tasks.workunit.client.0.smithi017.stdout:7/821: read d3/dc/f48 [834508,110564] 0 2024-08-19T00:56:28.732 INFO:tasks.workunit.client.0.smithi017.stdout:4/721: write d2/d1a/d55/d64/f94 [263465,90294] 0 2024-08-19T00:56:28.733 INFO:tasks.workunit.client.0.smithi017.stdout:5/531: write db/d19/d1f/d15/d3e/d40/f84 [4040075,51941] 0 2024-08-19T00:56:28.737 INFO:tasks.workunit.client.0.smithi017.stdout:2/761: mkdir d2/d7/df7 0 2024-08-19T00:56:28.739 INFO:tasks.workunit.client.0.smithi017.stdout:9/614: creat d0/d58/d9f/fb5 x:0 0 0 2024-08-19T00:56:28.741 INFO:tasks.workunit.client.0.smithi017.stdout:3/723: dread d5/da/f72 [0,4194304] 0 2024-08-19T00:56:28.743 INFO:tasks.workunit.client.0.smithi017.stdout:4/722: dread d2/d87/db2/de6/d53/d57/fa2 [0,4194304] 0 2024-08-19T00:56:28.743 INFO:tasks.workunit.client.0.smithi017.stdout:0/623: dwrite d5/d17/d26/f9a [0,4194304] 0 2024-08-19T00:56:28.745 INFO:tasks.workunit.client.0.smithi017.stdout:0/624: chown d5 2027 1 2024-08-19T00:56:28.748 INFO:tasks.workunit.client.0.smithi017.stdout:2/762: unlink d2/d7/d10/d3b/d54/f5b 0 2024-08-19T00:56:28.749 INFO:tasks.workunit.client.0.smithi017.stdout:9/615: dread d0/d33/d22/d40/f77 [0,4194304] 0 2024-08-19T00:56:28.750 INFO:tasks.workunit.client.0.smithi017.stdout:3/724: creat d5/da/d3c/d4f/d68/fe5 x:0 0 0 2024-08-19T00:56:28.751 INFO:tasks.workunit.client.0.smithi017.stdout:5/532: dread db/d19/d1f/f1c [0,4194304] 0 2024-08-19T00:56:28.751 INFO:tasks.workunit.client.0.smithi017.stdout:9/616: readlink d0/d33/d22/d5e/l8d 0 2024-08-19T00:56:28.759 INFO:tasks.workunit.client.0.smithi017.stdout:2/763: creat d2/d7/d10/d3b/d80/da2/daf/ff8 x:0 0 0 2024-08-19T00:56:28.762 INFO:tasks.workunit.client.0.smithi017.stdout:9/617: truncate d0/d58/f3e 4451908 0 2024-08-19T00:56:28.763 INFO:tasks.workunit.client.0.smithi017.stdout:9/618: chown d0/d58/d49/c7f 74739 1 2024-08-19T00:56:28.764 INFO:tasks.workunit.client.0.smithi017.stdout:5/533: rmdir db/d19/d1f/d15/d3e/d40/d83 39 2024-08-19T00:56:28.765 INFO:tasks.workunit.client.0.smithi017.stdout:4/723: creat d2/d87/db2/de6/d53/dcd/ff5 x:0 0 0 2024-08-19T00:56:28.768 INFO:tasks.workunit.client.0.smithi017.stdout:7/822: link d3/dc/df/d37/d93/ce0 d3/dc/df/c10e 0 2024-08-19T00:56:28.770 INFO:tasks.workunit.client.0.smithi017.stdout:2/764: fsync d2/d7/d10/d3b/d80/fda 0 2024-08-19T00:56:28.771 INFO:tasks.workunit.client.0.smithi017.stdout:2/765: fdatasync d2/d7/d10/d3b/d80/fda 0 2024-08-19T00:56:28.774 INFO:tasks.workunit.client.0.smithi017.stdout:0/625: truncate d5/d17/d21/d42/f86 155361 0 2024-08-19T00:56:28.776 INFO:tasks.workunit.client.0.smithi017.stdout:4/724: creat d2/d1a/dd0/ff6 x:0 0 0 2024-08-19T00:56:28.778 INFO:tasks.workunit.client.0.smithi017.stdout:9/619: dread d0/f34 [0,4194304] 0 2024-08-19T00:56:28.779 INFO:tasks.workunit.client.0.smithi017.stdout:9/620: write d0/d33/d22/d45/d8e/f7a [364308,104219] 0 2024-08-19T00:56:28.780 INFO:tasks.workunit.client.0.smithi017.stdout:9/621: readlink d0/d58/d49/d70/la3 0 2024-08-19T00:56:28.784 INFO:tasks.workunit.client.0.smithi017.stdout:7/823: rename d3/dc/df/d37/d46/d73/d80/fc8 to d3/dc/df/dd1/dd7/ddb/f10f 0 2024-08-19T00:56:28.785 INFO:tasks.workunit.client.0.smithi017.stdout:7/824: fsync d3/f12 0 2024-08-19T00:56:28.786 INFO:tasks.workunit.client.0.smithi017.stdout:7/825: read - d3/dc/df/d37/d93/da7/f10d zero size 2024-08-19T00:56:28.789 INFO:tasks.workunit.client.0.smithi017.stdout:5/534: fsync db/d19/d1f/fa9 0 2024-08-19T00:56:28.792 INFO:tasks.workunit.client.0.smithi017.stdout:2/766: write d2/fc8 [3471136,29773] 0 2024-08-19T00:56:28.795 INFO:tasks.workunit.client.0.smithi017.stdout:3/725: getdents d5/da/d27/d6e/dd0 0 2024-08-19T00:56:28.797 INFO:tasks.workunit.client.0.smithi017.stdout:2/767: dread d2/d7/d10/d19/d48/f82 [0,4194304] 0 2024-08-19T00:56:28.798 INFO:tasks.workunit.client.0.smithi017.stdout:9/622: rename d0/d33/d22/d5a/f98 to d0/d33/d22/d5a/da0/da1/fb6 0 2024-08-19T00:56:28.799 INFO:tasks.workunit.client.0.smithi017.stdout:2/768: write d2/d7/d10/d3b/d80/d81/fa6 [1014254,37229] 0 2024-08-19T00:56:28.800 INFO:tasks.workunit.client.0.smithi017.stdout:7/826: rmdir d3/dc/df/d23 39 2024-08-19T00:56:28.803 INFO:tasks.workunit.client.0.smithi017.stdout:0/626: dwrite d5/d17/d26/d30/f38 [0,4194304] 0 2024-08-19T00:56:28.805 INFO:tasks.workunit.client.0.smithi017.stdout:4/725: mkdir d2/df7 0 2024-08-19T00:56:28.810 INFO:tasks.workunit.client.0.smithi017.stdout:9/623: rmdir d0 39 2024-08-19T00:56:28.813 INFO:tasks.workunit.client.0.smithi017.stdout:7/827: read d3/dc/df/d1c/f3e [3363274,31877] 0 2024-08-19T00:56:28.813 INFO:tasks.workunit.client.0.smithi017.stdout:5/535: mkdir db/d19/daa/db4 0 2024-08-19T00:56:28.818 INFO:tasks.workunit.client.0.smithi017.stdout:3/726: symlink d5/da/le6 0 2024-08-19T00:56:28.820 INFO:tasks.workunit.client.0.smithi017.stdout:0/627: symlink d5/d17/d26/d30/d3e/d81/dca/ld4 0 2024-08-19T00:56:28.821 INFO:tasks.workunit.client.0.smithi017.stdout:9/624: write d0/d33/d22/d5a/f5f [791504,24844] 0 2024-08-19T00:56:28.823 INFO:tasks.workunit.client.0.smithi017.stdout:0/628: stat d5/d17/d26/d30/d5d/db0/fa6 0 2024-08-19T00:56:28.824 INFO:tasks.workunit.client.0.smithi017.stdout:3/727: mknod d5/d11/ce7 0 2024-08-19T00:56:28.826 INFO:tasks.workunit.client.0.smithi017.stdout:4/726: dwrite d2/d87/db2/de6/d40/f6c [0,4194304] 0 2024-08-19T00:56:28.828 INFO:tasks.workunit.client.0.smithi017.stdout:0/629: write d5/d17/d26/d30/d5d/fd0 [499571,123817] 0 2024-08-19T00:56:28.828 INFO:tasks.workunit.client.0.smithi017.stdout:9/625: unlink d0/d33/d22/d45/d8e/f86 0 2024-08-19T00:56:28.831 INFO:tasks.workunit.client.0.smithi017.stdout:9/626: write d0/d33/d22/d45/fb3 [866349,65134] 0 2024-08-19T00:56:28.833 INFO:tasks.workunit.client.0.smithi017.stdout:7/828: dwrite d3/dc/df/d23/d69/f6f [4194304,4194304] 0 2024-08-19T00:56:28.836 INFO:tasks.workunit.client.0.smithi017.stdout:4/727: symlink d2/d87/dbc/lf8 0 2024-08-19T00:56:28.836 INFO:tasks.workunit.client.0.smithi017.stdout:0/630: dread - d5/d17/d21/d39/fa1 zero size 2024-08-19T00:56:28.838 INFO:tasks.workunit.client.0.smithi017.stdout:9/627: mkdir d0/d58/d49/d5d/db7 0 2024-08-19T00:56:28.843 INFO:tasks.workunit.client.0.smithi017.stdout:4/728: creat d2/d1a/d55/d73/ff9 x:0 0 0 2024-08-19T00:56:28.843 INFO:tasks.workunit.client.0.smithi017.stdout:0/631: mkdir d5/d18/d3a/dc1/dd5 0 2024-08-19T00:56:28.851 INFO:tasks.workunit.client.0.smithi017.stdout:5/536: dwrite db/d19/d1f/d15/d3e/d40/f6e [0,4194304] 0 2024-08-19T00:56:28.852 INFO:tasks.workunit.client.0.smithi017.stdout:7/829: creat d3/dc/df/f110 x:0 0 0 2024-08-19T00:56:28.852 INFO:tasks.workunit.client.0.smithi017.stdout:3/728: dwrite d5/da/d3c/de4/d92/fb5 [0,4194304] 0 2024-08-19T00:56:28.853 INFO:tasks.workunit.client.0.smithi017.stdout:4/729: creat d2/d87/db2/de6/d40/d56/d99/da3/ffa x:0 0 0 2024-08-19T00:56:28.860 INFO:tasks.workunit.client.0.smithi017.stdout:3/729: rmdir d5 39 2024-08-19T00:56:28.862 INFO:tasks.workunit.client.0.smithi017.stdout:5/537: creat db/d19/d8d/fb5 x:0 0 0 2024-08-19T00:56:28.863 INFO:tasks.workunit.client.0.smithi017.stdout:4/730: unlink d2/d87/db2/de6/d40/d84/c88 0 2024-08-19T00:56:28.866 INFO:tasks.workunit.client.0.smithi017.stdout:7/830: dwrite d3/dc/df/d1c/fe7 [0,4194304] 0 2024-08-19T00:56:28.869 INFO:tasks.workunit.client.0.smithi017.stdout:0/632: dread d5/d17/d45/f8f [0,4194304] 0 2024-08-19T00:56:28.872 INFO:tasks.workunit.client.0.smithi017.stdout:3/730: creat d5/da/d3c/de4/d92/fe8 x:0 0 0 2024-08-19T00:56:28.873 INFO:tasks.workunit.client.0.smithi017.stdout:5/538: rmdir db/d19/d1f/d15/d3e/d40/d49 39 2024-08-19T00:56:28.877 INFO:tasks.workunit.client.0.smithi017.stdout:0/633: mkdir d5/d17/d26/d30/d3e/dd6 0 2024-08-19T00:56:28.878 INFO:tasks.workunit.client.0.smithi017.stdout:9/628: dwrite d0/f18 [4194304,4194304] 0 2024-08-19T00:56:28.882 INFO:tasks.workunit.client.0.smithi017.stdout:7/831: mknod d3/dc/df/d23/d6a/db2/c111 0 2024-08-19T00:56:28.885 INFO:tasks.workunit.client.0.smithi017.stdout:3/731: dread d5/da/f2b [0,4194304] 0 2024-08-19T00:56:28.886 INFO:tasks.workunit.client.0.smithi017.stdout:4/731: mknod d2/d1a/dd0/dd4/de2/cfb 0 2024-08-19T00:56:28.889 INFO:tasks.workunit.client.0.smithi017.stdout:3/732: mknod d5/d18/ce9 0 2024-08-19T00:56:28.892 INFO:tasks.workunit.client.0.smithi017.stdout:0/634: rmdir d5/d17/d26/d30/d3e/dd6 0 2024-08-19T00:56:28.893 INFO:tasks.workunit.client.0.smithi017.stdout:5/539: getdents db/d19/d1f/d15/d3e/d40 0 2024-08-19T00:56:28.894 INFO:tasks.workunit.client.0.smithi017.stdout:0/635: fdatasync d5/d17/d26/d30/d3e/d81/f8c 0 2024-08-19T00:56:28.894 INFO:tasks.workunit.client.0.smithi017.stdout:3/733: dread - d5/d18/faa zero size 2024-08-19T00:56:28.895 INFO:tasks.workunit.client.0.smithi017.stdout:7/832: creat d3/dc/df/d1c/f112 x:0 0 0 2024-08-19T00:56:28.898 INFO:tasks.workunit.client.0.smithi017.stdout:0/636: dread d5/d17/d26/d30/d5d/fd0 [0,4194304] 0 2024-08-19T00:56:28.901 INFO:tasks.workunit.client.0.smithi017.stdout:7/833: dread d3/dc/df/d37/d46/d73/d80/d81/ff4 [0,4194304] 0 2024-08-19T00:56:28.903 INFO:tasks.workunit.client.0.smithi017.stdout:4/732: link d2/d16/f6f d2/d87/db2/de6/d40/ffc 0 2024-08-19T00:56:28.905 INFO:tasks.workunit.client.0.smithi017.stdout:9/629: dread d0/d33/f4d [0,4194304] 0 2024-08-19T00:56:28.911 INFO:tasks.workunit.client.0.smithi017.stdout:5/540: creat db/d19/d1f/d15/fb6 x:0 0 0 2024-08-19T00:56:28.911 INFO:tasks.workunit.client.0.smithi017.stdout:0/637: write d5/d17/d26/d30/d3e/f91 [437460,112601] 0 2024-08-19T00:56:28.913 INFO:tasks.workunit.client.0.smithi017.stdout:0/638: write d5/d17/d26/d30/d5d/db0/fa6 [440233,128512] 0 2024-08-19T00:56:28.914 INFO:tasks.workunit.client.0.smithi017.stdout:9/630: creat d0/d33/d22/d5a/fb8 x:0 0 0 2024-08-19T00:56:28.915 INFO:tasks.workunit.client.0.smithi017.stdout:3/734: creat d5/da/d3c/fea x:0 0 0 2024-08-19T00:56:28.915 INFO:tasks.workunit.client.0.smithi017.stdout:9/631: write d0/f47 [1316441,98446] 0 2024-08-19T00:56:28.916 INFO:tasks.workunit.client.0.smithi017.stdout:9/632: stat d0/d58/l80 0 2024-08-19T00:56:28.917 INFO:tasks.workunit.client.0.smithi017.stdout:7/834: unlink d3/dc/df/d7d/lce 0 2024-08-19T00:56:28.917 INFO:tasks.workunit.client.0.smithi017.stdout:3/735: dread - d5/d18/faa zero size 2024-08-19T00:56:28.918 INFO:tasks.workunit.client.0.smithi017.stdout:4/733: symlink d2/d87/db2/de6/d53/da8/lfd 0 2024-08-19T00:56:28.920 INFO:tasks.workunit.client.0.smithi017.stdout:4/734: stat d2/d87/db2/de6/d53/d57/dce/cdf 0 2024-08-19T00:56:28.924 INFO:tasks.workunit.client.0.smithi017.stdout:3/736: creat d5/da/d3c/de4/d92/dca/feb x:0 0 0 2024-08-19T00:56:28.925 INFO:tasks.workunit.client.0.smithi017.stdout:3/737: write d5/da/d3c/d4f/d68/d99/fc7 [777961,86984] 0 2024-08-19T00:56:28.926 INFO:tasks.workunit.client.0.smithi017.stdout:0/639: creat d5/d17/d26/d30/d5d/dce/fd7 x:0 0 0 2024-08-19T00:56:28.929 INFO:tasks.workunit.client.0.smithi017.stdout:0/640: chown d5/d17/d21/d39/f85 1 1 2024-08-19T00:56:28.931 INFO:tasks.workunit.client.0.smithi017.stdout:9/633: unlink d0/d33/f1b 0 2024-08-19T00:56:28.932 INFO:tasks.workunit.client.0.smithi017.stdout:3/738: dread d5/da/f2b [0,4194304] 0 2024-08-19T00:56:28.932 INFO:tasks.workunit.client.0.smithi017.stdout:5/541: dwrite fa [0,4194304] 0 2024-08-19T00:56:28.934 INFO:tasks.workunit.client.0.smithi017.stdout:7/835: mkdir d3/dc/df/d23/d69/dd8/df3/d113 0 2024-08-19T00:56:28.937 INFO:tasks.workunit.client.0.smithi017.stdout:4/735: write d2/d11/d24/f4e [724714,76127] 0 2024-08-19T00:56:28.937 INFO:tasks.workunit.client.0.smithi017.stdout:0/641: mkdir d5/d17/d21/d42/d9b/dd8 0 2024-08-19T00:56:28.938 INFO:tasks.workunit.client.0.smithi017.stdout:9/634: mknod d0/d33/d22/d85/cb9 0 2024-08-19T00:56:28.940 INFO:tasks.workunit.client.0.smithi017.stdout:3/739: rename d5/c1d to d5/da/d3c/d4f/d68/d9e/cec 0 2024-08-19T00:56:28.942 INFO:tasks.workunit.client.0.smithi017.stdout:5/542: mknod db/d19/d1f/d15/d3e/d40/cb7 0 2024-08-19T00:56:28.943 INFO:tasks.workunit.client.0.smithi017.stdout:7/836: write d3/dc/df/d23/d6a/db6/f10b [2979416,18003] 0 2024-08-19T00:56:28.944 INFO:tasks.workunit.client.0.smithi017.stdout:4/736: creat d2/d1a/d55/d73/da6/ffe x:0 0 0 2024-08-19T00:56:28.945 INFO:tasks.workunit.client.0.smithi017.stdout:4/737: fdatasync d2/d1a/d55/d8f/fc3 0 2024-08-19T00:56:28.945 INFO:tasks.workunit.client.0.smithi017.stdout:5/543: dread - db/d19/d1f/f74 zero size 2024-08-19T00:56:28.947 INFO:tasks.workunit.client.0.smithi017.stdout:5/544: fdatasync db/d19/d1f/d15/f5d 0 2024-08-19T00:56:28.948 INFO:tasks.workunit.client.0.smithi017.stdout:5/545: chown db/f2a 17 1 2024-08-19T00:56:28.949 INFO:tasks.workunit.client.0.smithi017.stdout:7/837: mknod d3/dc/df/d37/d46/d73/c114 0 2024-08-19T00:56:28.949 INFO:tasks.workunit.client.0.smithi017.stdout:7/838: chown d3/dc/df/d23/d69/f98 9780 1 2024-08-19T00:56:28.959 INFO:tasks.workunit.client.0.smithi017.stdout:7/839: mkdir d3/dc/df/d1c/d2c/dfd/d115 0 2024-08-19T00:56:28.962 INFO:tasks.workunit.client.0.smithi017.stdout:3/740: getdents d5 0 2024-08-19T00:56:28.962 INFO:tasks.workunit.client.0.smithi017.stdout:4/738: link d2/d87/db2/de6/d40/d56/lc0 d2/d87/db2/de6/d53/lff 0 2024-08-19T00:56:28.965 INFO:tasks.workunit.client.0.smithi017.stdout:0/642: dread d5/d17/f22 [0,4194304] 0 2024-08-19T00:56:28.965 INFO:tasks.workunit.client.0.smithi017.stdout:4/739: write d2/d11/f72 [1051630,31294] 0 2024-08-19T00:56:28.967 INFO:tasks.workunit.client.0.smithi017.stdout:7/840: mknod d3/dc/df/d23/d6a/db6/d100/c116 0 2024-08-19T00:56:28.969 INFO:tasks.workunit.client.0.smithi017.stdout:0/643: chown d5/d17/d21/d42/c25 262825785 1 2024-08-19T00:56:28.970 INFO:tasks.workunit.client.0.smithi017.stdout:0/644: write d5/d17/d26/d30/f54 [3146406,37426] 0 2024-08-19T00:56:28.974 INFO:tasks.workunit.client.0.smithi017.stdout:3/741: rename d5/d11/fd5 to d5/da/d3c/d4f/fed 0 2024-08-19T00:56:28.975 INFO:tasks.workunit.client.0.smithi017.stdout:3/742: stat d5/da/d3c/d4f/l5a 0 2024-08-19T00:56:28.981 INFO:tasks.workunit.client.0.smithi017.stdout:3/743: dwrite d5/da/d3c/f93 [4194304,4194304] 0 2024-08-19T00:56:28.983 INFO:tasks.workunit.client.0.smithi017.stdout:4/740: getdents d2/d11 0 2024-08-19T00:56:28.984 INFO:tasks.workunit.client.0.smithi017.stdout:7/841: getdents d3/dc/df/d1c/d2c 0 2024-08-19T00:56:28.984 INFO:tasks.workunit.client.0.smithi017.stdout:5/546: dwrite db/d19/d1f/d15/d3e/d40/d49/f69 [0,4194304] 0 2024-08-19T00:56:28.987 INFO:tasks.workunit.client.0.smithi017.stdout:7/842: mknod d3/dab/d106/de5/c117 0 2024-08-19T00:56:28.988 INFO:tasks.workunit.client.0.smithi017.stdout:3/744: link d5/da/d3c/de4/d1b/f39 d5/d11/fee 0 2024-08-19T00:56:28.989 INFO:tasks.workunit.client.0.smithi017.stdout:3/745: write d5/da/f95 [1070446,122543] 0 2024-08-19T00:56:28.990 INFO:tasks.workunit.client.0.smithi017.stdout:4/741: mkdir d2/d87/db2/de6/d40/d8b/d100 0 2024-08-19T00:56:29.110 INFO:tasks.workunit.client.0.smithi017.stdout:7/843: creat d3/dc/df/d37/d46/f118 x:0 0 0 2024-08-19T00:56:29.112 INFO:tasks.workunit.client.0.smithi017.stdout:4/742: creat d2/d11/d24/dc6/f101 x:0 0 0 2024-08-19T00:56:29.113 INFO:tasks.workunit.client.0.smithi017.stdout:3/746: creat d5/da/d27/d6e/fef x:0 0 0 2024-08-19T00:56:29.115 INFO:tasks.workunit.client.0.smithi017.stdout:3/747: dread - d5/da/d3c/d4f/d68/fe5 zero size 2024-08-19T00:56:29.116 INFO:tasks.workunit.client.0.smithi017.stdout:3/748: dread - d5/d18/dab/fb9 zero size 2024-08-19T00:56:29.116 INFO:tasks.workunit.client.0.smithi017.stdout:3/749: chown d5/da/d27/d6e/fef 468763 1 2024-08-19T00:56:29.120 INFO:tasks.workunit.client.0.smithi017.stdout:7/844: dread d3/dc/d5f/f89 [4194304,4194304] 0 2024-08-19T00:56:29.166 INFO:tasks.workunit.client.0.smithi017.stdout:5/547: creat db/d19/d1f/d15/d3e/d40/fb8 x:0 0 0 2024-08-19T00:56:29.167 INFO:tasks.workunit.client.0.smithi017.stdout:5/548: write db/f2e [8751432,106188] 0 2024-08-19T00:56:29.177 INFO:tasks.workunit.client.0.smithi017.stdout:4/743: getdents d2/d87/db2/de6 0 2024-08-19T00:56:29.177 INFO:tasks.workunit.client.0.smithi017.stdout:5/549: symlink db/d19/d1f/d15/d3e/d40/d49/d63/d80/d9d/lb9 0 2024-08-19T00:56:29.180 INFO:tasks.workunit.client.0.smithi017.stdout:4/744: mkdir d2/d87/db2/de6/d102 0 2024-08-19T00:56:29.180 INFO:tasks.workunit.client.0.smithi017.stdout:7/845: write d3/dc/f48 [1905989,100433] 0 2024-08-19T00:56:29.182 INFO:tasks.workunit.client.0.smithi017.stdout:7/846: write d3/dc/df/d1a/fc1 [3164182,26583] 0 2024-08-19T00:56:29.183 INFO:tasks.workunit.client.0.smithi017.stdout:5/550: mkdir db/d19/d1f/d15/d3e/d40/d49/d63/d7b/dba 0 2024-08-19T00:56:29.185 INFO:tasks.workunit.client.0.smithi017.stdout:3/750: truncate d5/da/d27/d28/f98 2873268 0 2024-08-19T00:56:29.190 INFO:tasks.workunit.client.0.smithi017.stdout:5/551: fdatasync f6 0 2024-08-19T00:56:29.193 INFO:tasks.workunit.client.0.smithi017.stdout:7/847: rename d3/dc/df/l64 to d3/dc/df/d23/d69/dd8/l119 0 2024-08-19T00:56:29.200 INFO:tasks.workunit.client.0.smithi017.stdout:3/751: rename d5/d11/fd8 to d5/d18/ff0 0 2024-08-19T00:56:29.200 INFO:tasks.workunit.client.0.smithi017.stdout:7/848: creat d3/dc/df/d37/d46/d73/d80/d81/f11a x:0 0 0 2024-08-19T00:56:29.202 INFO:tasks.workunit.client.0.smithi017.stdout:5/552: rmdir db/d19/d1f/d15/d3e/d40/d83 39 2024-08-19T00:56:29.206 INFO:tasks.workunit.client.0.smithi017.stdout:3/752: dwrite d5/da/d3c/de4/d92/fa8 [0,4194304] 0 2024-08-19T00:56:29.210 INFO:tasks.workunit.client.0.smithi017.stdout:7/849: mknod d3/dc/df/d3d/d90/c11b 0 2024-08-19T00:56:29.212 INFO:tasks.workunit.client.0.smithi017.stdout:5/553: mknod db/d19/d1f/d15/d1e/d5f/cbb 0 2024-08-19T00:56:29.213 INFO:tasks.workunit.client.0.smithi017.stdout:5/554: chown db/d19/d1f/d15/d30 71 1 2024-08-19T00:56:29.214 INFO:tasks.workunit.client.0.smithi017.stdout:3/753: write d5/da/d3c/d4f/fed [993126,55540] 0 2024-08-19T00:56:29.218 INFO:tasks.workunit.client.0.smithi017.stdout:4/745: link d2/d87/db2/de6/d40/d8b/fda d2/df7/f103 0 2024-08-19T00:56:29.220 INFO:tasks.workunit.client.0.smithi017.stdout:7/850: dwrite d3/dc/df/d37/d46/f9d [0,4194304] 0 2024-08-19T00:56:29.222 INFO:tasks.workunit.client.0.smithi017.stdout:7/851: chown d3/dc/df/d1c/d2c/d2f 2 1 2024-08-19T00:56:29.226 INFO:tasks.workunit.client.0.smithi017.stdout:3/754: getdents d5/da/d3c/de4/d92/dca 0 2024-08-19T00:56:29.229 INFO:tasks.workunit.client.0.smithi017.stdout:3/755: fdatasync d5/da/f3f 0 2024-08-19T00:56:29.232 INFO:tasks.workunit.client.0.smithi017.stdout:3/756: symlink d5/da/d27/d28/lf1 0 2024-08-19T00:56:29.233 INFO:tasks.workunit.client.0.smithi017.stdout:7/852: getdents d3/dc/df/d23/d69/dd8/df3 0 2024-08-19T00:56:29.234 INFO:tasks.workunit.client.0.smithi017.stdout:7/853: fdatasync d3/d3c/d88/fc0 0 2024-08-19T00:56:29.238 INFO:tasks.workunit.client.0.smithi017.stdout:7/854: creat d3/dc/df/d23/d69/dd8/f11c x:0 0 0 2024-08-19T00:56:29.243 INFO:tasks.workunit.client.0.smithi017.stdout:7/855: rename d3/dc/df/d7d/c84 to d3/dc/df/d23/d69/c11d 0 2024-08-19T00:56:29.244 INFO:tasks.workunit.client.0.smithi017.stdout:4/746: dwrite d2/d11/f14 [0,4194304] 0 2024-08-19T00:56:29.245 INFO:tasks.workunit.client.0.smithi017.stdout:7/856: stat d3/dc/df/d1c/d2c/d83/cfb 0 2024-08-19T00:56:29.246 INFO:tasks.workunit.client.0.smithi017.stdout:5/555: dread db/d19/d1f/d15/f5a [0,4194304] 0 2024-08-19T00:56:29.248 INFO:tasks.workunit.client.0.smithi017.stdout:5/556: write db/d19/d1f/d15/d3e/d40/d49/f86 [3966039,70968] 0 2024-08-19T00:56:29.253 INFO:tasks.workunit.client.0.smithi017.stdout:7/857: rename d3/dc/df/d23/l2d to d3/dc/df/d1c/d2c/dfd/l11e 0 2024-08-19T00:56:29.258 INFO:tasks.workunit.client.0.smithi017.stdout:5/557: creat db/d19/d1f/d15/d3e/fbc x:0 0 0 2024-08-19T00:56:29.260 INFO:tasks.workunit.client.0.smithi017.stdout:5/558: fdatasync db/d19/d1f/d15/fb6 0 2024-08-19T00:56:29.262 INFO:tasks.workunit.client.0.smithi017.stdout:5/559: chown db/d19/d1f/d15/d1e/f27 1 1 2024-08-19T00:56:29.263 INFO:tasks.workunit.client.0.smithi017.stdout:7/858: dread d3/dc/df/d37/d46/f57 [0,4194304] 0 2024-08-19T00:56:29.264 INFO:tasks.workunit.client.0.smithi017.stdout:3/757: write d5/d18/fde [2849410,102809] 0 2024-08-19T00:56:29.265 INFO:tasks.workunit.client.0.smithi017.stdout:7/859: readlink d3/dc/df/d1c/d2c/l4d 0 2024-08-19T00:56:29.268 INFO:tasks.workunit.client.0.smithi017.stdout:5/560: rename db/d19/d33 to db/d19/d1f/dbd 0 2024-08-19T00:56:29.271 INFO:tasks.workunit.client.0.smithi017.stdout:6/822: sync 2024-08-19T00:56:29.271 INFO:tasks.workunit.client.0.smithi017.stdout:9/635: sync 2024-08-19T00:56:29.271 INFO:tasks.workunit.client.0.smithi017.stdout:2/769: sync 2024-08-19T00:56:29.271 INFO:tasks.workunit.client.0.smithi017.stdout:0/645: sync 2024-08-19T00:56:29.271 INFO:tasks.workunit.client.0.smithi017.stdout:8/704: sync 2024-08-19T00:56:29.271 INFO:tasks.workunit.client.0.smithi017.stdout:1/749: sync 2024-08-19T00:56:29.278 INFO:tasks.workunit.client.0.smithi017.stdout:9/636: creat d0/d84/fba x:0 0 0 2024-08-19T00:56:29.279 INFO:tasks.workunit.client.0.smithi017.stdout:1/750: write d4/dc/d3b/d45/f8d [315675,44105] 0 2024-08-19T00:56:29.354 INFO:tasks.workunit.client.0.smithi017.stdout:6/823: dwrite d5/f42 [0,4194304] 0 2024-08-19T00:56:29.355 INFO:tasks.workunit.client.0.smithi017.stdout:9/637: dread - d0/d58/d9f/fb5 zero size 2024-08-19T00:56:29.357 INFO:tasks.workunit.client.0.smithi017.stdout:3/758: truncate d5/d11/d61/fd3 397125 0 2024-08-19T00:56:29.360 INFO:tasks.workunit.client.0.smithi017.stdout:9/638: dread - d0/d33/d22/fb0 zero size 2024-08-19T00:56:29.364 INFO:tasks.workunit.client.0.smithi017.stdout:1/751: dread d4/dc/d3b/d9d/f89 [0,4194304] 0 2024-08-19T00:56:29.369 INFO:tasks.workunit.client.0.smithi017.stdout:0/646: link d5/c28 d5/d17/d26/d30/d3e/d5a/dcd/dd3/cd9 0 2024-08-19T00:56:29.370 INFO:tasks.workunit.client.0.smithi017.stdout:7/860: dread d3/dc/df/d1a/f3b [0,4194304] 0 2024-08-19T00:56:29.370 INFO:tasks.workunit.client.0.smithi017.stdout:6/824: chown d5/d13/d11/d2c/d51/c71 1393760 1 2024-08-19T00:56:29.370 INFO:tasks.workunit.client.0.smithi017.stdout:4/747: dwrite d2/d16/f5b [0,4194304] 0 2024-08-19T00:56:29.372 INFO:tasks.workunit.client.0.smithi017.stdout:1/752: readlink d4/dc/d17/dad/dea/ld3 0 2024-08-19T00:56:29.374 INFO:tasks.workunit.client.0.smithi017.stdout:2/770: dwrite d2/d7/dd/fbd [0,4194304] 0 2024-08-19T00:56:29.374 INFO:tasks.workunit.client.0.smithi017.stdout:8/705: dwrite de/d36/f6a [0,4194304] 0 2024-08-19T00:56:29.374 INFO:tasks.workunit.client.0.smithi017.stdout:9/639: rename d0/d33/d22/d45/d8e/f7a to d0/d33/d22/d40/fbb 0 2024-08-19T00:56:29.377 INFO:tasks.workunit.client.0.smithi017.stdout:0/647: symlink d5/d17/d26/d30/lda 0 2024-08-19T00:56:29.377 INFO:tasks.workunit.client.0.smithi017.stdout:4/748: write d2/d87/db2/de6/d40/d56/fa5 [2866961,39614] 0 2024-08-19T00:56:29.379 INFO:tasks.workunit.client.0.smithi017.stdout:1/753: fsync d4/dc/d3b/d3d/d83/d95/dca/fe1 0 2024-08-19T00:56:29.382 INFO:tasks.workunit.client.0.smithi017.stdout:2/771: truncate d2/d7/d10/d3b/d80/da2/fe1 525488 0 2024-08-19T00:56:29.382 INFO:tasks.workunit.client.0.smithi017.stdout:7/861: creat d3/dc/df/d1a/db9/f11f x:0 0 0 2024-08-19T00:56:29.383 INFO:tasks.workunit.client.0.smithi017.stdout:1/754: fdatasync d4/dc/d17/dd6/d75/d9c/ddb/ff1 0 2024-08-19T00:56:29.387 INFO:tasks.workunit.client.0.smithi017.stdout:0/648: dwrite d5/d17/d26/d30/f38 [4194304,4194304] 0 2024-08-19T00:56:29.389 INFO:tasks.workunit.client.0.smithi017.stdout:8/706: mkdir de/d15/d62/d75/dd7 0 2024-08-19T00:56:29.392 INFO:tasks.workunit.client.0.smithi017.stdout:2/772: stat d2/d7/d10/d3b/d54/laa 0 2024-08-19T00:56:29.392 INFO:tasks.workunit.client.0.smithi017.stdout:1/755: symlink d4/dc/d3b/d45/dc0/lf2 0 2024-08-19T00:56:29.392 INFO:tasks.workunit.client.0.smithi017.stdout:0/649: symlink d5/d17/d26/d30/d5d/dce/ldb 0 2024-08-19T00:56:29.393 INFO:tasks.workunit.client.0.smithi017.stdout:2/773: fdatasync d2/d7/d10/d3b/d80/d81/fa6 0 2024-08-19T00:56:29.394 INFO:tasks.workunit.client.0.smithi017.stdout:6/825: link d5/d7b/c113 d5/d13/d11/d52/c116 0 2024-08-19T00:56:29.396 INFO:tasks.workunit.client.0.smithi017.stdout:2/774: readlink d2/d7/dd/l50 0 2024-08-19T00:56:29.399 INFO:tasks.workunit.client.0.smithi017.stdout:2/775: write d2/fea [1036075,39514] 0 2024-08-19T00:56:29.402 INFO:tasks.workunit.client.0.smithi017.stdout:6/826: dread - d5/d13/d11/d2c/d9d/fc8 zero size 2024-08-19T00:56:29.403 INFO:tasks.workunit.client.0.smithi017.stdout:1/756: dwrite d4/dc/d3b/fd2 [0,4194304] 0 2024-08-19T00:56:29.404 INFO:tasks.workunit.client.0.smithi017.stdout:0/650: dread d5/f11 [0,4194304] 0 2024-08-19T00:56:29.405 INFO:tasks.workunit.client.0.smithi017.stdout:2/776: mkdir d2/d7/d10/d9f/df9 0 2024-08-19T00:56:29.408 INFO:tasks.workunit.client.0.smithi017.stdout:2/777: read d2/d7/f93 [2494685,71040] 0 2024-08-19T00:56:29.410 INFO:tasks.workunit.client.0.smithi017.stdout:6/827: truncate d5/d13/d11/f3b 1079500 0 2024-08-19T00:56:29.412 INFO:tasks.workunit.client.0.smithi017.stdout:1/757: getdents d4/dd1 0 2024-08-19T00:56:29.417 INFO:tasks.workunit.client.0.smithi017.stdout:2/778: dwrite d2/d7/fce [0,4194304] 0 2024-08-19T00:56:29.417 INFO:tasks.workunit.client.0.smithi017.stdout:1/758: mkdir d4/dc/d3b/d3d/d83/d95/dca/df3 0 2024-08-19T00:56:29.423 INFO:tasks.workunit.client.0.smithi017.stdout:1/759: unlink d4/dc/d17/dd6/f25 0 2024-08-19T00:56:29.428 INFO:tasks.workunit.client.0.smithi017.stdout:7/862: dread d3/dc/df/d1c/d2c/d83/fcf [0,4194304] 0 2024-08-19T00:56:29.428 INFO:tasks.workunit.client.0.smithi017.stdout:1/760: truncate d4/dd1/fe2 681000 0 2024-08-19T00:56:29.429 INFO:tasks.workunit.client.0.smithi017.stdout:1/761: chown d4/dc/d3b/d3d/f7d 0 1 2024-08-19T00:56:29.431 INFO:tasks.workunit.client.0.smithi017.stdout:1/762: chown d4/l6 3186 1 2024-08-19T00:56:29.433 INFO:tasks.workunit.client.0.smithi017.stdout:3/759: dread d5/ff [4194304,4194304] 0 2024-08-19T00:56:29.433 INFO:tasks.workunit.client.0.smithi017.stdout:1/763: write d4/dc/d3b/d45/f4d [126184,20712] 0 2024-08-19T00:56:29.434 INFO:tasks.workunit.client.0.smithi017.stdout:2/779: dread d2/d7/f43 [0,4194304] 0 2024-08-19T00:56:29.435 INFO:tasks.workunit.client.0.smithi017.stdout:4/749: dread d2/d27/f4d [0,4194304] 0 2024-08-19T00:56:29.436 INFO:tasks.workunit.client.0.smithi017.stdout:9/640: rmdir d0/d33 39 2024-08-19T00:56:29.437 INFO:tasks.workunit.client.0.smithi017.stdout:3/760: mkdir d5/da/d3c/d4f/d68/df2 0 2024-08-19T00:56:29.438 INFO:tasks.workunit.client.0.smithi017.stdout:3/761: dread - d5/d32/fc4 zero size 2024-08-19T00:56:29.441 INFO:tasks.workunit.client.0.smithi017.stdout:4/750: readlink d2/d1a/lf 0 2024-08-19T00:56:29.444 INFO:tasks.workunit.client.0.smithi017.stdout:4/751: fdatasync d2/d87/db2/de6/d40/d56/d95/fe9 0 2024-08-19T00:56:29.446 INFO:tasks.workunit.client.0.smithi017.stdout:3/762: unlink d5/da/d27/c3b 0 2024-08-19T00:56:29.449 INFO:tasks.workunit.client.0.smithi017.stdout:3/763: truncate d5/da/d3c/de4/d1b/f7b 5057087 0 2024-08-19T00:56:29.449 INFO:tasks.workunit.client.0.smithi017.stdout:4/752: truncate d2/d1a/d55/fad 2334215 0 2024-08-19T00:56:29.452 INFO:tasks.workunit.client.0.smithi017.stdout:4/753: chown d2/d1a/d55/d73/f7b 6956 1 2024-08-19T00:56:29.455 INFO:tasks.workunit.client.0.smithi017.stdout:9/641: dread d0/d58/d49/d70/f90 [0,4194304] 0 2024-08-19T00:56:29.457 INFO:tasks.workunit.client.0.smithi017.stdout:8/707: dwrite de/d15/d4f/f5c [0,4194304] 0 2024-08-19T00:56:29.461 INFO:tasks.workunit.client.0.smithi017.stdout:4/754: mknod d2/dc1/c104 0 2024-08-19T00:56:29.461 INFO:tasks.workunit.client.0.smithi017.stdout:9/642: symlink d0/d84/lbc 0 2024-08-19T00:56:29.464 INFO:tasks.workunit.client.0.smithi017.stdout:8/708: mkdir de/d15/d39/d3d/dc2/dd8 0 2024-08-19T00:56:29.466 INFO:tasks.workunit.client.0.smithi017.stdout:0/651: dwrite d5/d17/d21/f68 [4194304,4194304] 0 2024-08-19T00:56:29.468 INFO:tasks.workunit.client.0.smithi017.stdout:1/764: dread d4/dc/d17/dad/dea/f8a [0,4194304] 0 2024-08-19T00:56:29.472 INFO:tasks.workunit.client.0.smithi017.stdout:3/764: dwrite d5/da/d3c/de4/d92/dca/feb [0,4194304] 0 2024-08-19T00:56:29.479 INFO:tasks.workunit.client.0.smithi017.stdout:2/780: dwrite d2/d7/d10/d35/d45/d58/dbf/fad [0,4194304] 0 2024-08-19T00:56:29.479 INFO:tasks.workunit.client.0.smithi017.stdout:4/755: symlink d2/dd7/l105 0 2024-08-19T00:56:29.479 INFO:tasks.workunit.client.0.smithi017.stdout:0/652: mkdir d5/da4/ddc 0 2024-08-19T00:56:29.479 INFO:tasks.workunit.client.0.smithi017.stdout:2/781: dread - d2/d7/d44/fd0 zero size 2024-08-19T00:56:29.482 INFO:tasks.workunit.client.0.smithi017.stdout:1/765: creat d4/ff4 x:0 0 0 2024-08-19T00:56:29.485 INFO:tasks.workunit.client.0.smithi017.stdout:8/709: dread de/d15/f83 [0,4194304] 0 2024-08-19T00:56:29.488 INFO:tasks.workunit.client.0.smithi017.stdout:3/765: mkdir d5/da/d27/d6e/df3 0 2024-08-19T00:56:29.489 INFO:tasks.workunit.client.0.smithi017.stdout:3/766: chown d5/da/d3c/d4f/l5a 12980 1 2024-08-19T00:56:29.491 INFO:tasks.workunit.client.0.smithi017.stdout:9/643: creat d0/d33/d22/d5e/dae/fbd x:0 0 0 2024-08-19T00:56:29.494 INFO:tasks.workunit.client.0.smithi017.stdout:0/653: creat d5/d17/d21/d42/d9b/fdd x:0 0 0 2024-08-19T00:56:29.496 INFO:tasks.workunit.client.0.smithi017.stdout:4/756: mkdir d2/d87/db2/de6/d40/d56/d99/d106 0 2024-08-19T00:56:29.496 INFO:tasks.workunit.client.0.smithi017.stdout:1/766: rmdir d4/d78 39 2024-08-19T00:56:29.500 INFO:tasks.workunit.client.0.smithi017.stdout:8/710: rename de/c73 to de/d15/d39/d3d/dc2/dd8/cd9 0 2024-08-19T00:56:29.503 INFO:tasks.workunit.client.0.smithi017.stdout:9/644: creat d0/d33/d22/fbe x:0 0 0 2024-08-19T00:56:29.504 INFO:tasks.workunit.client.0.smithi017.stdout:2/782: truncate d2/d7/d10/d19/f39 689962 0 2024-08-19T00:56:29.518 INFO:tasks.workunit.client.0.smithi017.stdout:3/767: write d5/d18/f8c [126002,123860] 0 2024-08-19T00:56:29.519 INFO:tasks.workunit.client.0.smithi017.stdout:0/654: link d5/d17/d2b/f7a d5/d17/d21/d42/d9b/dd8/fde 0 2024-08-19T00:56:29.520 INFO:tasks.workunit.client.0.smithi017.stdout:4/757: dread d2/d1a/dd0/fa9 [0,4194304] 0 2024-08-19T00:56:29.520 INFO:tasks.workunit.client.0.smithi017.stdout:2/783: dwrite d2/d7/d10/d3b/d97/fd4 [4194304,4194304] 0 2024-08-19T00:56:29.522 INFO:tasks.workunit.client.0.smithi017.stdout:3/768: dread - d5/da/d3c/fc5 zero size 2024-08-19T00:56:29.523 INFO:tasks.workunit.client.0.smithi017.stdout:1/767: dread d4/dc/d3b/d3d/f7d [0,4194304] 0 2024-08-19T00:56:29.523 INFO:tasks.workunit.client.0.smithi017.stdout:4/758: write d2/d87/dbc/ff0 [30339,23657] 0 2024-08-19T00:56:29.541 INFO:tasks.workunit.client.0.smithi017.stdout:4/759: chown d2/d87/db2/de6/f35 20402 1 2024-08-19T00:56:29.545 INFO:tasks.workunit.client.0.smithi017.stdout:3/769: unlink d5/da/d3c/d4f/d68/d99/f9b 0 2024-08-19T00:56:29.547 INFO:tasks.workunit.client.0.smithi017.stdout:8/711: write de/d36/f69 [1937123,9260] 0 2024-08-19T00:56:29.551 INFO:tasks.workunit.client.0.smithi017.stdout:9/645: dwrite d0/d33/f29 [0,4194304] 0 2024-08-19T00:56:29.649 INFO:tasks.workunit.client.0.smithi017.stdout:0/655: write d5/d17/d45/f8f [3703991,67637] 0 2024-08-19T00:56:29.651 INFO:tasks.workunit.client.0.smithi017.stdout:3/770: truncate d5/da/d3c/d4f/d68/d9e/fb8 982955 0 2024-08-19T00:56:29.654 INFO:tasks.workunit.client.0.smithi017.stdout:9/646: fsync d0/d33/d22/d45/d8e/f81 0 2024-08-19T00:56:29.655 INFO:tasks.workunit.client.0.smithi017.stdout:1/768: dwrite d4/dc/d3b/d3d/da8/fae [0,4194304] 0 2024-08-19T00:56:29.656 INFO:tasks.workunit.client.0.smithi017.stdout:2/784: rename d2/d7/d10/d35/d84/fd1 to d2/ffa 0 2024-08-19T00:56:29.657 INFO:tasks.workunit.client.0.smithi017.stdout:2/785: chown d2/d7/f93 200958 1 2024-08-19T00:56:29.658 INFO:tasks.workunit.client.0.smithi017.stdout:0/656: mknod d5/d17/d2b/cdf 0 2024-08-19T00:56:29.664 INFO:tasks.workunit.client.0.smithi017.stdout:9/647: chown d0/l26 3 1 2024-08-19T00:56:29.665 INFO:tasks.workunit.client.0.smithi017.stdout:9/648: truncate d0/d33/d22/d5a/fb8 930698 0 2024-08-19T00:56:29.666 INFO:tasks.workunit.client.0.smithi017.stdout:4/760: rename d2/d87/db2/de6/d53/dcd to d2/d87/db2/de6/d40/d56/d99/d106/d107 0 2024-08-19T00:56:29.667 INFO:tasks.workunit.client.0.smithi017.stdout:9/649: chown d0/d33/d22/d5a/f88 34 1 2024-08-19T00:56:29.667 INFO:tasks.workunit.client.0.smithi017.stdout:9/650: stat d0/d33/d22/d40/la9 0 2024-08-19T00:56:29.668 INFO:tasks.workunit.client.0.smithi017.stdout:4/761: write d2/d1a/f1c [509937,29960] 0 2024-08-19T00:56:29.668 INFO:tasks.workunit.client.0.smithi017.stdout:1/769: dread - d4/dc/d17/dd6/d75/d9c/fa0 zero size 2024-08-19T00:56:29.669 INFO:tasks.workunit.client.0.smithi017.stdout:9/651: stat d0/d33/d22/d45/d69/fa4 0 2024-08-19T00:56:29.669 INFO:tasks.workunit.client.0.smithi017.stdout:4/762: chown d2/d87/db2/de6/d40/d8b/d100 0 1 2024-08-19T00:56:29.669 INFO:tasks.workunit.client.0.smithi017.stdout:2/786: symlink d2/d7/d10/d35/d7e/lfb 0 2024-08-19T00:56:29.670 INFO:tasks.workunit.client.0.smithi017.stdout:4/763: chown d2/d11/d24 140 1 2024-08-19T00:56:29.680 INFO:tasks.workunit.client.0.smithi017.stdout:3/771: creat d5/da/d3c/ff4 x:0 0 0 2024-08-19T00:56:29.681 INFO:tasks.workunit.client.0.smithi017.stdout:1/770: symlink d4/dc/d17/dd6/lf5 0 2024-08-19T00:56:29.682 INFO:tasks.workunit.client.0.smithi017.stdout:3/772: read f2 [2162155,72722] 0 2024-08-19T00:56:29.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:29 smithi017 ceph-mon[16627]: pgmap v25: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 73 MiB/s rd, 181 MiB/s wr, 397 op/s 2024-08-19T00:56:29.683 INFO:tasks.workunit.client.0.smithi017.stdout:9/652: getdents d0/d58/d49/d70/db2 0 2024-08-19T00:56:29.684 INFO:tasks.workunit.client.0.smithi017.stdout:4/764: creat d2/d11/dd6/f108 x:0 0 0 2024-08-19T00:56:29.686 INFO:tasks.workunit.client.0.smithi017.stdout:0/657: creat d5/d17/d26/fe0 x:0 0 0 2024-08-19T00:56:29.689 INFO:tasks.workunit.client.0.smithi017.stdout:8/712: link de/d15/d62/d75/fa4 de/d15/d39/fda 0 2024-08-19T00:56:29.691 INFO:tasks.workunit.client.0.smithi017.stdout:1/771: dwrite d4/dc/d19/f53 [0,4194304] 0 2024-08-19T00:56:29.693 INFO:tasks.workunit.client.0.smithi017.stdout:3/773: rmdir d5/da/d3c/d4f 39 2024-08-19T00:56:29.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:29 smithi086 ceph-mon[24511]: pgmap v25: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 73 MiB/s rd, 181 MiB/s wr, 397 op/s 2024-08-19T00:56:29.697 INFO:tasks.workunit.client.0.smithi017.stdout:9/653: dwrite d0/d33/d22/d45/d8e/f81 [0,4194304] 0 2024-08-19T00:56:29.699 INFO:tasks.workunit.client.0.smithi017.stdout:4/765: dwrite d2/d1a/dd0/dd4/ff1 [0,4194304] 0 2024-08-19T00:56:29.703 INFO:tasks.workunit.client.0.smithi017.stdout:2/787: write d2/d7/d10/d3b/d3c/fc3 [4577525,124523] 0 2024-08-19T00:56:29.704 INFO:tasks.workunit.client.0.smithi017.stdout:6/828: sync 2024-08-19T00:56:29.704 INFO:tasks.workunit.client.0.smithi017.stdout:5/561: sync 2024-08-19T00:56:29.707 INFO:tasks.workunit.client.0.smithi017.stdout:6/829: readlink d5/d13/d11/d2c/d4a/d64/d86/d90/dba/le6 0 2024-08-19T00:56:29.709 INFO:tasks.workunit.client.0.smithi017.stdout:0/658: symlink d5/d18/le1 0 2024-08-19T00:56:29.710 INFO:tasks.workunit.client.0.smithi017.stdout:0/659: write d5/d17/d26/fe0 [930467,84438] 0 2024-08-19T00:56:29.713 INFO:tasks.workunit.client.0.smithi017.stdout:9/654: rename d0/d33/d22/d45/d8e/fac to d0/d58/d49/d5d/fbf 0 2024-08-19T00:56:29.713 INFO:tasks.workunit.client.0.smithi017.stdout:9/655: readlink d0/d33/d22/l7c 0 2024-08-19T00:56:29.714 INFO:tasks.workunit.client.0.smithi017.stdout:3/774: write d5/da/f7d [444936,14602] 0 2024-08-19T00:56:29.716 INFO:tasks.workunit.client.0.smithi017.stdout:6/830: mknod d5/d13/de5/c117 0 2024-08-19T00:56:29.718 INFO:tasks.workunit.client.0.smithi017.stdout:1/772: creat d4/dc/d3b/d3d/d83/d95/dca/df3/ff6 x:0 0 0 2024-08-19T00:56:29.719 INFO:tasks.workunit.client.0.smithi017.stdout:0/660: mkdir d5/d17/d26/d30/d5d/db0/de2 0 2024-08-19T00:56:29.720 INFO:tasks.workunit.client.0.smithi017.stdout:0/661: dread - d5/d17/d45/d50/f96 zero size 2024-08-19T00:56:29.720 INFO:tasks.workunit.client.0.smithi017.stdout:2/788: mkdir d2/d7/d10/d19/d48/dab/dfc 0 2024-08-19T00:56:29.721 INFO:tasks.workunit.client.0.smithi017.stdout:3/775: creat d5/ff5 x:0 0 0 2024-08-19T00:56:29.723 INFO:tasks.workunit.client.0.smithi017.stdout:6/831: mkdir d5/d13/d11/d2c/d118 0 2024-08-19T00:56:29.726 INFO:tasks.workunit.client.0.smithi017.stdout:3/776: fdatasync d5/da/d3c/de4/d92/fa8 0 2024-08-19T00:56:29.726 INFO:tasks.workunit.client.0.smithi017.stdout:8/713: dread de/d15/f29 [0,4194304] 0 2024-08-19T00:56:29.729 INFO:tasks.workunit.client.0.smithi017.stdout:2/789: mkdir d2/d7/d10/d9f/df9/dfd 0 2024-08-19T00:56:29.729 INFO:tasks.workunit.client.0.smithi017.stdout:8/714: read de/f47 [4153673,91464] 0 2024-08-19T00:56:29.730 INFO:tasks.workunit.client.0.smithi017.stdout:0/662: link d5/d17/f69 d5/d18/d3a/fe3 0 2024-08-19T00:56:29.731 INFO:tasks.workunit.client.0.smithi017.stdout:2/790: write d2/fea [417052,128548] 0 2024-08-19T00:56:29.732 INFO:tasks.workunit.client.0.smithi017.stdout:1/773: getdents d4/dc/d19 0 2024-08-19T00:56:29.735 INFO:tasks.workunit.client.0.smithi017.stdout:0/663: write d5/d17/d21/d39/f85 [1524410,87265] 0 2024-08-19T00:56:29.736 INFO:tasks.workunit.client.0.smithi017.stdout:6/832: rmdir d5/df0 0 2024-08-19T00:56:29.736 INFO:tasks.workunit.client.0.smithi017.stdout:1/774: stat d4/dc/d17/dd6/d1f 0 2024-08-19T00:56:29.740 INFO:tasks.workunit.client.0.smithi017.stdout:3/777: dwrite d5/da/d3c/fc3 [0,4194304] 0 2024-08-19T00:56:29.741 INFO:tasks.workunit.client.0.smithi017.stdout:2/791: creat d2/d7/d10/d3b/d97/df2/ffe x:0 0 0 2024-08-19T00:56:29.745 INFO:tasks.workunit.client.0.smithi017.stdout:1/775: fsync d4/dc/d3b/d3d/fb6 0 2024-08-19T00:56:29.745 INFO:tasks.workunit.client.0.smithi017.stdout:5/562: dwrite db/d19/d1f/dbd/f5b [4194304,4194304] 0 2024-08-19T00:56:29.746 INFO:tasks.workunit.client.0.smithi017.stdout:9/656: dread d0/d33/d22/d45/d8e/f99 [0,4194304] 0 2024-08-19T00:56:29.748 INFO:tasks.workunit.client.0.smithi017.stdout:1/776: chown d4/dc/d17/d1d/l29 73098758 1 2024-08-19T00:56:29.758 INFO:tasks.workunit.client.0.smithi017.stdout:0/664: symlink d5/d17/d26/d30/d5d/db0/de2/le4 0 2024-08-19T00:56:29.759 INFO:tasks.workunit.client.0.smithi017.stdout:0/665: chown d5/d17/d26/d30/d5d/db0/fa6 8308925 1 2024-08-19T00:56:29.760 INFO:tasks.workunit.client.0.smithi017.stdout:3/778: rmdir d5/da/d3c/d4f 39 2024-08-19T00:56:29.761 INFO:tasks.workunit.client.0.smithi017.stdout:5/563: symlink db/d19/d1f/d15/d3e/d40/d49/lbe 0 2024-08-19T00:56:29.762 INFO:tasks.workunit.client.0.smithi017.stdout:0/666: write d5/d17/d21/d39/f85 [309065,27830] 0 2024-08-19T00:56:29.762 INFO:tasks.workunit.client.0.smithi017.stdout:8/715: getdents de/d15/d4f/dcc 0 2024-08-19T00:56:29.765 INFO:tasks.workunit.client.0.smithi017.stdout:1/777: chown d4/dc/d17/dd6/l5d 1493381334 1 2024-08-19T00:56:29.766 INFO:tasks.workunit.client.0.smithi017.stdout:8/716: write de/d15/d4f/d68/d84/f8e [4144647,126111] 0 2024-08-19T00:56:29.766 INFO:tasks.workunit.client.0.smithi017.stdout:2/792: truncate d2/d7/d10/d3b/d3c/f9b 943952 0 2024-08-19T00:56:29.767 INFO:tasks.workunit.client.0.smithi017.stdout:6/833: dwrite d5/d13/d11/d2c/f30 [0,4194304] 0 2024-08-19T00:56:29.768 INFO:tasks.workunit.client.0.smithi017.stdout:6/834: chown d5/d13/f22 188 1 2024-08-19T00:56:29.769 INFO:tasks.workunit.client.0.smithi017.stdout:1/778: chown d4/dc/d3b/c49 24412 1 2024-08-19T00:56:29.772 INFO:tasks.workunit.client.0.smithi017.stdout:0/667: dread - d5/d18/d78/f88 zero size 2024-08-19T00:56:29.774 INFO:tasks.workunit.client.0.smithi017.stdout:5/564: write f7 [1529105,88036] 0 2024-08-19T00:56:29.777 INFO:tasks.workunit.client.0.smithi017.stdout:9/657: creat d0/d33/d22/d45/fc0 x:0 0 0 2024-08-19T00:56:29.779 INFO:tasks.workunit.client.0.smithi017.stdout:6/835: creat d5/d13/d11/d4d/dfa/f119 x:0 0 0 2024-08-19T00:56:29.781 INFO:tasks.workunit.client.0.smithi017.stdout:8/717: mknod de/d15/d79/cdb 0 2024-08-19T00:56:29.784 INFO:tasks.workunit.client.0.smithi017.stdout:2/793: truncate d2/d7/d10/d3b/d54/f4f 936449 0 2024-08-19T00:56:29.786 INFO:tasks.workunit.client.0.smithi017.stdout:0/668: mknod d5/d17/d21/d42/ce5 0 2024-08-19T00:56:29.787 INFO:tasks.workunit.client.0.smithi017.stdout:2/794: read d2/d7/d44/fc9 [930437,69123] 0 2024-08-19T00:56:29.788 INFO:tasks.workunit.client.0.smithi017.stdout:9/658: creat d0/d33/d22/d85/fc1 x:0 0 0 2024-08-19T00:56:29.788 INFO:tasks.workunit.client.0.smithi017.stdout:0/669: fdatasync d5/d18/d78/dbc/fd1 0 2024-08-19T00:56:29.788 INFO:tasks.workunit.client.0.smithi017.stdout:6/836: mkdir d5/d13/de5/d11a 0 2024-08-19T00:56:29.790 INFO:tasks.workunit.client.0.smithi017.stdout:1/779: dwrite d4/dc/d17/dad/dea/f8a [4194304,4194304] 0 2024-08-19T00:56:29.792 INFO:tasks.workunit.client.0.smithi017.stdout:0/670: chown d5/d17/d21/d42/l5c 1 1 2024-08-19T00:56:29.795 INFO:tasks.workunit.client.0.smithi017.stdout:1/780: chown d4/dc/d17/d1d/c5e 4726 1 2024-08-19T00:56:29.800 INFO:tasks.workunit.client.0.smithi017.stdout:9/659: dwrite d0/d33/d22/d85/f91 [0,4194304] 0 2024-08-19T00:56:29.803 INFO:tasks.workunit.client.0.smithi017.stdout:5/565: dread db/d19/d1f/d15/d30/f46 [0,4194304] 0 2024-08-19T00:56:29.807 INFO:tasks.workunit.client.0.smithi017.stdout:5/566: fdatasync db/d19/d1f/d15/d3e/d40/d49/f86 0 2024-08-19T00:56:29.807 INFO:tasks.workunit.client.0.smithi017.stdout:9/660: dread d0/d33/d22/f2f [0,4194304] 0 2024-08-19T00:56:29.808 INFO:tasks.workunit.client.0.smithi017.stdout:8/718: creat de/d15/d39/d3d/fdc x:0 0 0 2024-08-19T00:56:29.809 INFO:tasks.workunit.client.0.smithi017.stdout:8/719: readlink de/d15/l20 0 2024-08-19T00:56:29.811 INFO:tasks.workunit.client.0.smithi017.stdout:5/567: read - db/d19/d1f/d15/d3e/fbc zero size 2024-08-19T00:56:29.815 INFO:tasks.workunit.client.0.smithi017.stdout:1/781: dread d4/dc/f40 [0,4194304] 0 2024-08-19T00:56:29.817 INFO:tasks.workunit.client.0.smithi017.stdout:6/837: dwrite d5/d13/d11/d4d/f85 [0,4194304] 0 2024-08-19T00:56:29.817 INFO:tasks.workunit.client.0.smithi017.stdout:9/661: symlink d0/d33/d22/d85/lc2 0 2024-08-19T00:56:29.818 INFO:tasks.workunit.client.0.smithi017.stdout:8/720: truncate de/d15/d79/f85 1112459 0 2024-08-19T00:56:29.827 INFO:tasks.workunit.client.0.smithi017.stdout:0/671: truncate d5/d17/d45/f72 1417681 0 2024-08-19T00:56:29.827 INFO:tasks.workunit.client.0.smithi017.stdout:6/838: dwrite d5/d13/d11/ff8 [0,4194304] 0 2024-08-19T00:56:29.828 INFO:tasks.workunit.client.0.smithi017.stdout:1/782: creat d4/dc/d3b/d3d/d83/d95/dca/df3/ff7 x:0 0 0 2024-08-19T00:56:29.831 INFO:tasks.workunit.client.0.smithi017.stdout:1/783: write d4/dc/d3b/d3d/d83/d95/dca/df3/ff7 [867105,4962] 0 2024-08-19T00:56:29.831 INFO:tasks.workunit.client.0.smithi017.stdout:1/784: chown d4/fba 7 1 2024-08-19T00:56:29.832 INFO:tasks.workunit.client.0.smithi017.stdout:2/795: getdents d2/d7/d10/d19/d48 0 2024-08-19T00:56:29.833 INFO:tasks.workunit.client.0.smithi017.stdout:2/796: readlink d2/d7/d10/d35/d45/d58/dbf/ld6 0 2024-08-19T00:56:29.836 INFO:tasks.workunit.client.0.smithi017.stdout:0/672: rmdir d5/d18 39 2024-08-19T00:56:29.837 INFO:tasks.workunit.client.0.smithi017.stdout:6/839: mkdir d5/d13/d11/d2c/d4a/da8/d11b 0 2024-08-19T00:56:29.838 INFO:tasks.workunit.client.0.smithi017.stdout:1/785: symlink d4/dc/d3b/d3d/d83/d95/dca/lf8 0 2024-08-19T00:56:29.844 INFO:tasks.workunit.client.0.smithi017.stdout:9/662: rename d0/d33/d22/d5a/da0/da1 to d0/d58/d49/dc3 0 2024-08-19T00:56:29.847 INFO:tasks.workunit.client.0.smithi017.stdout:2/797: mknod d2/d7/d10/d3b/d80/da2/db7/cff 0 2024-08-19T00:56:29.851 INFO:tasks.workunit.client.0.smithi017.stdout:8/721: getdents de/d15/d4f/d68/d84/dc8 0 2024-08-19T00:56:29.853 INFO:tasks.workunit.client.0.smithi017.stdout:1/786: rename d4/fba to d4/dd1/ff9 0 2024-08-19T00:56:29.854 INFO:tasks.workunit.client.0.smithi017.stdout:1/787: chown d4/dc/d3b/d9d/f8c 35948 1 2024-08-19T00:56:29.855 INFO:tasks.workunit.client.0.smithi017.stdout:9/663: creat d0/d58/d49/dc3/fc4 x:0 0 0 2024-08-19T00:56:29.856 INFO:tasks.workunit.client.0.smithi017.stdout:0/673: dwrite d5/d18/fa8 [0,4194304] 0 2024-08-19T00:56:29.858 INFO:tasks.workunit.client.0.smithi017.stdout:5/568: link db/d19/d1f/d15/d30/l7c db/d19/d1f/d15/d3e/d40/d49/d63/lbf 0 2024-08-19T00:56:29.869 INFO:tasks.workunit.client.0.smithi017.stdout:5/569: creat db/d19/d1f/d15/d3e/d40/d49/d63/d80/d9d/fc0 x:0 0 0 2024-08-19T00:56:29.871 INFO:tasks.workunit.client.0.smithi017.stdout:6/840: link d5/d7b/c113 d5/d13/d11/d2c/d4a/d64/d86/d90/dba/de7/c11c 0 2024-08-19T00:56:29.873 INFO:tasks.workunit.client.0.smithi017.stdout:2/798: write d2/d7/d10/d19/f41 [2216026,98076] 0 2024-08-19T00:56:29.875 INFO:tasks.workunit.client.0.smithi017.stdout:0/674: rename d5/d18/d3a/l83 to d5/d18/d78/dbc/le6 0 2024-08-19T00:56:29.876 INFO:tasks.workunit.client.0.smithi017.stdout:9/664: dread d0/d58/d49/d5d/f9c [0,4194304] 0 2024-08-19T00:56:29.881 INFO:tasks.workunit.client.0.smithi017.stdout:0/675: chown d5/d17/d21/d42/d9b 132915991 1 2024-08-19T00:56:29.881 INFO:tasks.workunit.client.0.smithi017.stdout:8/722: link de/d15/d39/d3d/fa6 de/d15/d39/dc7/fdd 0 2024-08-19T00:56:29.884 INFO:tasks.workunit.client.0.smithi017.stdout:9/665: dread d0/f34 [0,4194304] 0 2024-08-19T00:56:29.885 INFO:tasks.workunit.client.0.smithi017.stdout:5/570: symlink db/d19/d1f/d15/d3e/d40/d49/d63/lc1 0 2024-08-19T00:56:29.887 INFO:tasks.workunit.client.0.smithi017.stdout:1/788: getdents d4/dc/d17/dad/dea/db1 0 2024-08-19T00:56:29.888 INFO:tasks.workunit.client.0.smithi017.stdout:2/799: write d2/d7/fa5 [2623840,61427] 0 2024-08-19T00:56:29.890 INFO:tasks.workunit.client.0.smithi017.stdout:0/676: creat d5/d17/d26/d30/d3e/d81/dca/fe7 x:0 0 0 2024-08-19T00:56:29.894 INFO:tasks.workunit.client.0.smithi017.stdout:5/571: creat db/d19/d1f/d15/d3e/d40/d49/d63/d7b/fc2 x:0 0 0 2024-08-19T00:56:29.895 INFO:tasks.workunit.client.0.smithi017.stdout:1/789: mkdir d4/dc/d17/dad/dea/db1/dfa 0 2024-08-19T00:56:29.895 INFO:tasks.workunit.client.0.smithi017.stdout:2/800: rmdir d2/d7 39 2024-08-19T00:56:29.897 INFO:tasks.workunit.client.0.smithi017.stdout:6/841: rename d5/d13/d11/d2c/d4a/d64/d86/d90/dba/le6 to d5/d13/d11/d2c/d51/l11d 0 2024-08-19T00:56:29.898 INFO:tasks.workunit.client.0.smithi017.stdout:0/677: dwrite d5/d17/d26/d30/d3e/f91 [0,4194304] 0 2024-08-19T00:56:29.900 INFO:tasks.workunit.client.0.smithi017.stdout:8/723: truncate de/d15/d4f/f6e 1704930 0 2024-08-19T00:56:29.900 INFO:tasks.workunit.client.0.smithi017.stdout:8/724: readlink de/d36/l43 0 2024-08-19T00:56:29.906 INFO:tasks.workunit.client.0.smithi017.stdout:9/666: mkdir d0/d33/d22/d85/da6/dc5 0 2024-08-19T00:56:29.907 INFO:tasks.workunit.client.0.smithi017.stdout:5/572: rmdir db/d19/d1f 39 2024-08-19T00:56:29.911 INFO:tasks.workunit.client.0.smithi017.stdout:6/842: rmdir d5/d13/d11/d2c/d4a/d64/d86/d90 39 2024-08-19T00:56:29.913 INFO:tasks.workunit.client.0.smithi017.stdout:6/843: write d5/d13/d11/d52/fb2 [3040147,5468] 0 2024-08-19T00:56:29.916 INFO:tasks.workunit.client.0.smithi017.stdout:9/667: chown d0/d33/d22/d45/d9b 108 1 2024-08-19T00:56:29.919 INFO:tasks.workunit.client.0.smithi017.stdout:7/863: sync 2024-08-19T00:56:29.923 INFO:tasks.workunit.client.0.smithi017.stdout:7/864: write d3/dc/df/d1c/d2c/d83/f86 [1638864,45271] 0 2024-08-19T00:56:29.924 INFO:tasks.workunit.client.0.smithi017.stdout:6/844: dwrite d5/f36 [4194304,4194304] 0 2024-08-19T00:56:29.928 INFO:tasks.workunit.client.0.smithi017.stdout:0/678: dread d5/d17/f1a [4194304,4194304] 0 2024-08-19T00:56:29.931 INFO:tasks.workunit.client.0.smithi017.stdout:9/668: fdatasync d0/d33/d22/d45/d8e/f99 0 2024-08-19T00:56:29.932 INFO:tasks.workunit.client.0.smithi017.stdout:5/573: symlink db/d19/d1f/d15/d3e/d40/d49/d63/d80/lc3 0 2024-08-19T00:56:29.933 INFO:tasks.workunit.client.0.smithi017.stdout:8/725: write de/d15/d39/fda [1030822,94860] 0 2024-08-19T00:56:29.934 INFO:tasks.workunit.client.0.smithi017.stdout:2/801: dwrite d2/d7/d10/d35/d7e/fb1 [0,4194304] 0 2024-08-19T00:56:29.943 INFO:tasks.workunit.client.0.smithi017.stdout:5/574: creat db/d19/d8d/fc4 x:0 0 0 2024-08-19T00:56:29.944 INFO:tasks.workunit.client.0.smithi017.stdout:8/726: symlink de/d15/d4f/d97/lde 0 2024-08-19T00:56:29.945 INFO:tasks.workunit.client.0.smithi017.stdout:1/790: link d4/dc/d17/dd6/c36 d4/dc/d17/dad/dea/db1/cfb 0 2024-08-19T00:56:29.947 INFO:tasks.workunit.client.0.smithi017.stdout:6/845: link d5/d13/d11/d2c/d4a/da8/fde d5/d13/dcf/f11e 0 2024-08-19T00:56:29.948 INFO:tasks.workunit.client.0.smithi017.stdout:0/679: mkdir d5/d18/d78/dbc/dc0/de8 0 2024-08-19T00:56:29.951 INFO:tasks.workunit.client.0.smithi017.stdout:5/575: dread f7 [0,4194304] 0 2024-08-19T00:56:29.951 INFO:tasks.workunit.client.0.smithi017.stdout:2/802: creat d2/d7/d10/d19/d48/dab/dfc/f100 x:0 0 0 2024-08-19T00:56:29.952 INFO:tasks.workunit.client.0.smithi017.stdout:8/727: dwrite de/d15/d4f/d68/d84/f8e [0,4194304] 0 2024-08-19T00:56:29.954 INFO:tasks.workunit.client.0.smithi017.stdout:8/728: truncate de/d15/d39/d3d/f72 627456 0 2024-08-19T00:56:29.958 INFO:tasks.workunit.client.0.smithi017.stdout:1/791: mkdir d4/dc/d3b/d3d/d83/dfc 0 2024-08-19T00:56:29.960 INFO:tasks.workunit.client.0.smithi017.stdout:9/669: creat d0/d58/fc6 x:0 0 0 2024-08-19T00:56:29.963 INFO:tasks.workunit.client.0.smithi017.stdout:8/729: dwrite de/d15/d79/fa9 [4194304,4194304] 0 2024-08-19T00:56:29.963 INFO:tasks.workunit.client.0.smithi017.stdout:0/680: mkdir d5/d17/d26/d30/d5d/db0/de2/de9 0 2024-08-19T00:56:29.966 INFO:tasks.workunit.client.0.smithi017.stdout:0/681: dread - d5/d17/d21/d42/d9b/fc6 zero size 2024-08-19T00:56:29.968 INFO:tasks.workunit.client.0.smithi017.stdout:7/865: getdents d3/dc/df/d23/d6a/db6 0 2024-08-19T00:56:29.970 INFO:tasks.workunit.client.0.smithi017.stdout:1/792: fsync d4/dc/d3b/d9d/f89 0 2024-08-19T00:56:29.970 INFO:tasks.workunit.client.0.smithi017.stdout:3/779: sync 2024-08-19T00:56:29.970 INFO:tasks.workunit.client.0.smithi017.stdout:4/766: sync 2024-08-19T00:56:29.971 INFO:tasks.workunit.client.0.smithi017.stdout:5/576: mkdir db/d19/d1f/d15/dc5 0 2024-08-19T00:56:29.972 INFO:tasks.workunit.client.0.smithi017.stdout:9/670: dwrite d0/d58/f66 [0,4194304] 0 2024-08-19T00:56:29.973 INFO:tasks.workunit.client.0.smithi017.stdout:8/730: dread de/d36/d74/fbd [0,4194304] 0 2024-08-19T00:56:29.973 INFO:tasks.workunit.client.0.smithi017.stdout:7/866: readlink d3/dc/df/d3d/d90/l38 0 2024-08-19T00:56:29.975 INFO:tasks.workunit.client.0.smithi017.stdout:7/867: dread - d3/d3c/d88/fc0 zero size 2024-08-19T00:56:29.978 INFO:tasks.workunit.client.0.smithi017.stdout:5/577: write db/d19/d1f/d15/d3e/d40/d49/f86 [4825740,87577] 0 2024-08-19T00:56:29.978 INFO:tasks.workunit.client.0.smithi017.stdout:8/731: truncate de/d15/d62/d75/fb4 865505 0 2024-08-19T00:56:29.980 INFO:tasks.workunit.client.0.smithi017.stdout:5/578: fsync db/d19/d1f/d15/d1e/f37 0 2024-08-19T00:56:29.982 INFO:tasks.workunit.client.0.smithi017.stdout:8/732: chown de/d15/d39/l56 1408 1 2024-08-19T00:56:29.985 INFO:tasks.workunit.client.0.smithi017.stdout:0/682: truncate d5/d17/d45/d77/fa2 1102777 0 2024-08-19T00:56:29.988 INFO:tasks.workunit.client.0.smithi017.stdout:7/868: mknod d3/dc/df/d23/d6a/db6/c120 0 2024-08-19T00:56:29.989 INFO:tasks.workunit.client.0.smithi017.stdout:6/846: write d5/d13/d11/d2c/d4a/da8/fce [1646949,103428] 0 2024-08-19T00:56:29.992 INFO:tasks.workunit.client.0.smithi017.stdout:2/803: dwrite d2/d7/d10/d35/d84/f94 [0,4194304] 0 2024-08-19T00:56:29.993 INFO:tasks.workunit.client.0.smithi017.stdout:2/804: chown d2/fc8 644755980 1 2024-08-19T00:56:29.994 INFO:tasks.workunit.client.0.smithi017.stdout:8/733: mknod de/d15/d39/d3d/dc2/dd8/cdf 0 2024-08-19T00:56:29.994 INFO:tasks.workunit.client.0.smithi017.stdout:2/805: write d2/d7/d10/d19/f1d [2383563,61431] 0 2024-08-19T00:56:29.996 INFO:tasks.workunit.client.0.smithi017.stdout:9/671: creat d0/d58/d49/d5d/db7/fc7 x:0 0 0 2024-08-19T00:56:29.997 INFO:tasks.workunit.client.0.smithi017.stdout:7/869: rmdir d3/dc/df/d37/d39 39 2024-08-19T00:56:30.005 INFO:tasks.workunit.client.0.smithi017.stdout:4/767: truncate d2/d11/f9c 686375 0 2024-08-19T00:56:30.006 INFO:tasks.workunit.client.0.smithi017.stdout:9/672: dwrite d0/d58/f66 [0,4194304] 0 2024-08-19T00:56:30.006 INFO:tasks.workunit.client.0.smithi017.stdout:1/793: creat d4/dc/d17/ffd x:0 0 0 2024-08-19T00:56:30.008 INFO:tasks.workunit.client.0.smithi017.stdout:2/806: rmdir d2/d7/d10/d9f/df9 39 2024-08-19T00:56:30.008 INFO:tasks.workunit.client.0.smithi017.stdout:7/870: dwrite d3/f12 [0,4194304] 0 2024-08-19T00:56:30.009 INFO:tasks.workunit.client.0.smithi017.stdout:7/871: fsync d3/d3c/d88/fc0 0 2024-08-19T00:56:30.017 INFO:tasks.workunit.client.0.smithi017.stdout:6/847: symlink d5/d13/d11/d2c/d4a/da8/d11b/l11f 0 2024-08-19T00:56:30.017 INFO:tasks.workunit.client.0.smithi017.stdout:5/579: creat db/d19/d1f/d15/fc6 x:0 0 0 2024-08-19T00:56:30.017 INFO:tasks.workunit.client.0.smithi017.stdout:3/780: link d5/da/l5d d5/d32/lf6 0 2024-08-19T00:56:30.021 INFO:tasks.workunit.client.0.smithi017.stdout:9/673: dread d0/f65 [0,4194304] 0 2024-08-19T00:56:30.023 INFO:tasks.workunit.client.0.smithi017.stdout:7/872: chown d3/dc/df/d23/d69/c11d 38503 1 2024-08-19T00:56:30.024 INFO:tasks.workunit.client.0.smithi017.stdout:7/873: chown d3/dc/df/d1c/fe7 18064 1 2024-08-19T00:56:30.025 INFO:tasks.workunit.client.0.smithi017.stdout:0/683: creat d5/da4/ddc/fea x:0 0 0 2024-08-19T00:56:30.027 INFO:tasks.workunit.client.0.smithi017.stdout:3/781: dread - d5/d11/d61/fd9 zero size 2024-08-19T00:56:30.028 INFO:tasks.workunit.client.0.smithi017.stdout:1/794: mknod d4/dc/cfe 0 2024-08-19T00:56:30.029 INFO:tasks.workunit.client.0.smithi017.stdout:8/734: truncate de/d36/d74/f8f 3044790 0 2024-08-19T00:56:30.033 INFO:tasks.workunit.client.0.smithi017.stdout:4/768: dwrite d2/d87/db2/de6/d40/d56/f7d [4194304,4194304] 0 2024-08-19T00:56:30.033 INFO:tasks.workunit.client.0.smithi017.stdout:9/674: creat d0/d84/fc8 x:0 0 0 2024-08-19T00:56:30.035 INFO:tasks.workunit.client.0.smithi017.stdout:9/675: chown d0/d33/d22/d45/d69/l95 611 1 2024-08-19T00:56:30.036 INFO:tasks.workunit.client.0.smithi017.stdout:9/676: dread - d0/d58/d49/d5d/db7/fc7 zero size 2024-08-19T00:56:30.037 INFO:tasks.workunit.client.0.smithi017.stdout:7/874: creat d3/dc/df/d1a/f121 x:0 0 0 2024-08-19T00:56:30.037 INFO:tasks.workunit.client.0.smithi017.stdout:9/677: dread - d0/d84/fc8 zero size 2024-08-19T00:56:30.038 INFO:tasks.workunit.client.0.smithi017.stdout:9/678: chown d0/d58/d49/d5d/db7 7163 1 2024-08-19T00:56:30.040 INFO:tasks.workunit.client.0.smithi017.stdout:3/782: symlink d5/d32/lf7 0 2024-08-19T00:56:30.040 INFO:tasks.workunit.client.0.smithi017.stdout:9/679: write d0/d58/d49/d5d/f93 [3048255,39823] 0 2024-08-19T00:56:30.041 INFO:tasks.workunit.client.0.smithi017.stdout:6/848: dread d5/d13/d11/d2c/d4a/d106/f96 [0,4194304] 0 2024-08-19T00:56:30.041 INFO:tasks.workunit.client.0.smithi017.stdout:8/735: mknod de/d36/ce0 0 2024-08-19T00:56:30.044 INFO:tasks.workunit.client.0.smithi017.stdout:4/769: fsync d2/d87/fd3 0 2024-08-19T00:56:30.045 INFO:tasks.workunit.client.0.smithi017.stdout:8/736: dread de/d36/d74/f8a [0,4194304] 0 2024-08-19T00:56:30.050 INFO:tasks.workunit.client.0.smithi017.stdout:9/680: unlink d0/l26 0 2024-08-19T00:56:30.054 INFO:tasks.workunit.client.0.smithi017.stdout:9/681: dread - d0/d33/d22/fbe zero size 2024-08-19T00:56:30.054 INFO:tasks.workunit.client.0.smithi017.stdout:2/807: getdents d2/d7/d10/d35/d45/d58/dbf 0 2024-08-19T00:56:30.055 INFO:tasks.workunit.client.0.smithi017.stdout:3/783: dread d5/da/f48 [0,4194304] 0 2024-08-19T00:56:30.055 INFO:tasks.workunit.client.0.smithi017.stdout:7/875: dwrite d3/dc/df/d7d/f9a [0,4194304] 0 2024-08-19T00:56:30.056 INFO:tasks.workunit.client.0.smithi017.stdout:8/737: mknod de/d36/d74/ce1 0 2024-08-19T00:56:30.057 INFO:tasks.workunit.client.0.smithi017.stdout:6/849: read d5/d13/d11/d2c/f38 [3738568,67605] 0 2024-08-19T00:56:30.059 INFO:tasks.workunit.client.0.smithi017.stdout:2/808: write d2/d7/d10/d35/d7e/fe0 [137446,102339] 0 2024-08-19T00:56:30.060 INFO:tasks.workunit.client.0.smithi017.stdout:7/876: dread - d3/dc/df/d37/d46/d73/d80/d81/f11a zero size 2024-08-19T00:56:30.060 INFO:tasks.workunit.client.0.smithi017.stdout:0/684: link d5/d17/d26/f80 d5/d17/d26/d30/feb 0 2024-08-19T00:56:30.064 INFO:tasks.workunit.client.0.smithi017.stdout:5/580: rename db/d19/d1f/d15/d3e/d40/l6c to db/d19/d1f/lc7 0 2024-08-19T00:56:30.064 INFO:tasks.workunit.client.0.smithi017.stdout:7/877: write d3/dc/df/d37/d46/f118 [621671,24868] 0 2024-08-19T00:56:30.067 INFO:tasks.workunit.client.0.smithi017.stdout:7/878: truncate d3/dc/df/d23/d69/dd8/f107 284772 0 2024-08-19T00:56:30.072 INFO:tasks.workunit.client.0.smithi017.stdout:6/850: dread d5/f1a [4194304,4194304] 0 2024-08-19T00:56:30.073 INFO:tasks.workunit.client.0.smithi017.stdout:6/851: read d5/d13/d11/d93/fb0 [1496106,1945] 0 2024-08-19T00:56:30.074 INFO:tasks.workunit.client.0.smithi017.stdout:3/784: creat d5/d18/ff8 x:0 0 0 2024-08-19T00:56:30.075 INFO:tasks.workunit.client.0.smithi017.stdout:5/581: fsync db/d19/d1f/d15/d3e/d40/d49/d63/d80/d9d/fb3 0 2024-08-19T00:56:30.077 INFO:tasks.workunit.client.0.smithi017.stdout:1/795: truncate d4/dc/d3b/d45/f8d 1568455 0 2024-08-19T00:56:30.078 INFO:tasks.workunit.client.0.smithi017.stdout:1/796: chown d4/dc/d17/dd6/d75/d9c 16543004 1 2024-08-19T00:56:30.078 INFO:tasks.workunit.client.0.smithi017.stdout:7/879: creat d3/dc/df/d1c/d2c/d2f/f122 x:0 0 0 2024-08-19T00:56:30.083 INFO:tasks.workunit.client.0.smithi017.stdout:4/770: dwrite d2/d1a/d55/d73/f7b [0,4194304] 0 2024-08-19T00:56:30.088 INFO:tasks.workunit.client.0.smithi017.stdout:6/852: chown d5/d13/d11/d2c/d4a/d64/d86/d90/fda 3893 1 2024-08-19T00:56:30.088 INFO:tasks.workunit.client.0.smithi017.stdout:9/682: getdents d0/d33/d22/d5e 0 2024-08-19T00:56:30.092 INFO:tasks.workunit.client.0.smithi017.stdout:5/582: mkdir db/d19/d1f/d15/d3e/d40/d49/d63/d80/dc8 0 2024-08-19T00:56:30.093 INFO:tasks.workunit.client.0.smithi017.stdout:7/880: rmdir d3/dc/df/d23/d6a/db6/d100 39 2024-08-19T00:56:30.098 INFO:tasks.workunit.client.0.smithi017.stdout:2/809: dwrite d2/d7/d29/f34 [4194304,4194304] 0 2024-08-19T00:56:30.100 INFO:tasks.workunit.client.0.smithi017.stdout:0/685: link d5/d17/d26/d30/d5d/l6b d5/d17/d26/d30/d5d/db0/de2/lec 0 2024-08-19T00:56:30.101 INFO:tasks.workunit.client.0.smithi017.stdout:4/771: creat d2/d11/dd6/f109 x:0 0 0 2024-08-19T00:56:30.102 INFO:tasks.workunit.client.0.smithi017.stdout:3/785: dwrite d5/da/d3c/de4/d92/fc0 [4194304,4194304] 0 2024-08-19T00:56:30.104 INFO:tasks.workunit.client.0.smithi017.stdout:3/786: chown d5/d18/ff0 148131640 1 2024-08-19T00:56:30.105 INFO:tasks.workunit.client.0.smithi017.stdout:1/797: mknod d4/dc/d3b/d3d/cff 0 2024-08-19T00:56:30.111 INFO:tasks.workunit.client.0.smithi017.stdout:7/881: dread d3/dc/df/d37/d46/fbd [0,4194304] 0 2024-08-19T00:56:30.112 INFO:tasks.workunit.client.0.smithi017.stdout:7/882: write d3/dc/df/d23/f101 [194880,9325] 0 2024-08-19T00:56:30.114 INFO:tasks.workunit.client.0.smithi017.stdout:9/683: dread d0/d33/d22/d45/d8e/f81 [0,4194304] 0 2024-08-19T00:56:30.116 INFO:tasks.workunit.client.0.smithi017.stdout:6/853: mknod d5/d13/de5/d11a/c120 0 2024-08-19T00:56:30.116 INFO:tasks.workunit.client.0.smithi017.stdout:9/684: write d0/d33/d22/fb0 [775793,48079] 0 2024-08-19T00:56:30.119 INFO:tasks.workunit.client.0.smithi017.stdout:6/854: stat d5/d13/d11/d2c/f30 0 2024-08-19T00:56:30.123 INFO:tasks.workunit.client.0.smithi017.stdout:4/772: creat d2/d87/f10a x:0 0 0 2024-08-19T00:56:30.123 INFO:tasks.workunit.client.0.smithi017.stdout:7/883: dwrite d3/dc/df/d1c/d2c/d83/f86 [4194304,4194304] 0 2024-08-19T00:56:30.126 INFO:tasks.workunit.client.0.smithi017.stdout:0/686: dread d5/d17/d21/f68 [0,4194304] 0 2024-08-19T00:56:30.126 INFO:tasks.workunit.client.0.smithi017.stdout:3/787: creat d5/da/d27/d6e/dd0/de0/ff9 x:0 0 0 2024-08-19T00:56:30.128 INFO:tasks.workunit.client.0.smithi017.stdout:4/773: chown d2/d11/d24/dc6/cd8 3697 1 2024-08-19T00:56:30.133 INFO:tasks.workunit.client.0.smithi017.stdout:0/687: readlink d5/d17/d21/l27 0 2024-08-19T00:56:30.134 INFO:tasks.workunit.client.0.smithi017.stdout:7/884: dwrite d3/dc/df/d3d/d90/fcb [0,4194304] 0 2024-08-19T00:56:30.135 INFO:tasks.workunit.client.0.smithi017.stdout:2/810: mkdir d2/d7/d10/d3b/d3c/d8a/d6b/d101 0 2024-08-19T00:56:30.137 INFO:tasks.workunit.client.0.smithi017.stdout:2/811: chown d2/d7/d10/d3b/d80/l91 43686892 1 2024-08-19T00:56:30.137 INFO:tasks.workunit.client.0.smithi017.stdout:7/885: write d3/dc/df/d1a/fc1 [4438169,62292] 0 2024-08-19T00:56:30.137 INFO:tasks.workunit.client.0.smithi017.stdout:1/798: write d4/dc/d3b/d3d/f5a [725141,67007] 0 2024-08-19T00:56:30.139 INFO:tasks.workunit.client.0.smithi017.stdout:1/799: chown d4/fd 4 1 2024-08-19T00:56:30.141 INFO:tasks.workunit.client.0.smithi017.stdout:6/855: read - d5/d13/d11/d2c/f78 zero size 2024-08-19T00:56:30.142 INFO:tasks.workunit.client.0.smithi017.stdout:9/685: rename d0/d58/c41 to d0/d33/d22/d40/cc9 0 2024-08-19T00:56:30.146 INFO:tasks.workunit.client.0.smithi017.stdout:3/788: mkdir d5/da/d3c/de4/d92/dca/dfa 0 2024-08-19T00:56:30.149 INFO:tasks.workunit.client.0.smithi017.stdout:3/789: truncate d5/da/d3c/fea 260208 0 2024-08-19T00:56:30.150 INFO:tasks.workunit.client.0.smithi017.stdout:7/886: fdatasync d3/dc/df/dd1/dd7/ddb/f10f 0 2024-08-19T00:56:30.151 INFO:tasks.workunit.client.0.smithi017.stdout:8/738: dread de/d15/d39/f59 [0,4194304] 0 2024-08-19T00:56:30.153 INFO:tasks.workunit.client.0.smithi017.stdout:3/790: fdatasync d5/d11/f14 0 2024-08-19T00:56:30.153 INFO:tasks.workunit.client.0.smithi017.stdout:5/583: dwrite db/d19/d1f/d15/d3e/d40/f71 [0,4194304] 0 2024-08-19T00:56:30.154 INFO:tasks.workunit.client.0.smithi017.stdout:6/856: mkdir d5/d13/d11/d2c/d4a/d64/d86/d90/dba/d121 0 2024-08-19T00:56:30.156 INFO:tasks.workunit.client.0.smithi017.stdout:1/800: write d4/dc/d17/dad/dea/fc3 [2119275,103145] 0 2024-08-19T00:56:30.160 INFO:tasks.workunit.client.0.smithi017.stdout:1/801: chown d4/c2d 618 1 2024-08-19T00:56:30.163 INFO:tasks.workunit.client.0.smithi017.stdout:7/887: mknod d3/dc/df/d23/d69/dd8/c123 0 2024-08-19T00:56:30.163 INFO:tasks.workunit.client.0.smithi017.stdout:4/774: write d2/d87/db2/de6/d40/fea [828316,52755] 0 2024-08-19T00:56:30.166 INFO:tasks.workunit.client.0.smithi017.stdout:7/888: chown d3/dc/df/d37/d39 0 1 2024-08-19T00:56:30.167 INFO:tasks.workunit.client.0.smithi017.stdout:6/857: write d5/d13/d11/d2c/f30 [2374060,125313] 0 2024-08-19T00:56:30.170 INFO:tasks.workunit.client.0.smithi017.stdout:8/739: write de/d15/d4f/d68/d84/f9b [1731493,113662] 0 2024-08-19T00:56:30.172 INFO:tasks.workunit.client.0.smithi017.stdout:4/775: symlink d2/d87/db2/de6/d40/d56/dbb/l10b 0 2024-08-19T00:56:30.172 INFO:tasks.workunit.client.0.smithi017.stdout:9/686: dwrite d0/d58/d49/d5d/fbf [0,4194304] 0 2024-08-19T00:56:30.178 INFO:tasks.workunit.client.0.smithi017.stdout:2/812: dwrite d2/d7/d10/d3b/d3c/d8a/d6b/f78 [0,4194304] 0 2024-08-19T00:56:30.179 INFO:tasks.workunit.client.0.smithi017.stdout:9/687: readlink d0/d84/lbc 0 2024-08-19T00:56:30.180 INFO:tasks.workunit.client.0.smithi017.stdout:7/889: chown d3/dc/df/d1c/d2c/d2f/f122 7336781 1 2024-08-19T00:56:30.182 INFO:tasks.workunit.client.0.smithi017.stdout:3/791: dread d5/da/f48 [0,4194304] 0 2024-08-19T00:56:30.185 INFO:tasks.workunit.client.0.smithi017.stdout:9/688: read d0/f18 [384512,62702] 0 2024-08-19T00:56:30.186 INFO:tasks.workunit.client.0.smithi017.stdout:1/802: rmdir d4/dc/d17/dad/dea/db1/dfa 0 2024-08-19T00:56:30.187 INFO:tasks.workunit.client.0.smithi017.stdout:8/740: mkdir de/d15/d39/d3d/dc2/dd8/de2 0 2024-08-19T00:56:30.187 INFO:tasks.workunit.client.0.smithi017.stdout:9/689: fdatasync d0/f18 0 2024-08-19T00:56:30.187 INFO:tasks.workunit.client.0.smithi017.stdout:6/858: read d5/d13/d11/d2c/d4a/da8/fcc [693773,52128] 0 2024-08-19T00:56:30.189 INFO:tasks.workunit.client.0.smithi017.stdout:6/859: chown d5/d13/d11/d52/fb8 1 1 2024-08-19T00:56:30.189 INFO:tasks.workunit.client.0.smithi017.stdout:4/776: fdatasync d2/d1a/d20/f8c 0 2024-08-19T00:56:30.189 INFO:tasks.workunit.client.0.smithi017.stdout:7/890: symlink d3/dc/df/daa/l124 0 2024-08-19T00:56:30.191 INFO:tasks.workunit.client.0.smithi017.stdout:4/777: write d2/dc1/fc8 [1201185,33391] 0 2024-08-19T00:56:30.195 INFO:tasks.workunit.client.0.smithi017.stdout:2/813: truncate d2/d7/f21 3721293 0 2024-08-19T00:56:30.200 INFO:tasks.workunit.client.0.smithi017.stdout:5/584: link db/d19/d1f/d15/d1e/l39 db/d19/d1f/d15/d3e/d40/d49/d63/d80/lc9 0 2024-08-19T00:56:30.204 INFO:tasks.workunit.client.0.smithi017.stdout:8/741: creat de/d15/d4f/d68/db5/fe3 x:0 0 0 2024-08-19T00:56:30.210 INFO:tasks.workunit.client.0.smithi017.stdout:3/792: dwrite d5/da/d3c/de4/d1b/f4a [0,4194304] 0 2024-08-19T00:56:30.211 INFO:tasks.workunit.client.0.smithi017.stdout:3/793: chown d5/da/d27/d28/f80 701566668 1 2024-08-19T00:56:30.223 INFO:tasks.workunit.client.0.smithi017.stdout:6/860: truncate d5/d13/d11/d52/f94 204973 0 2024-08-19T00:56:30.225 INFO:tasks.workunit.client.0.smithi017.stdout:2/814: stat d2/d7/d10/d9f/df9/dfd 0 2024-08-19T00:56:30.227 INFO:tasks.workunit.client.0.smithi017.stdout:8/742: mkdir de/d15/d79/de4 0 2024-08-19T00:56:30.229 INFO:tasks.workunit.client.0.smithi017.stdout:2/815: write d2/d7/d10/d35/d7e/fe0 [12462,70068] 0 2024-08-19T00:56:30.230 INFO:tasks.workunit.client.0.smithi017.stdout:8/743: chown de/d15/d62/d75/ca5 2 1 2024-08-19T00:56:30.231 INFO:tasks.workunit.client.0.smithi017.stdout:9/690: dwrite d0/d33/d22/f42 [0,4194304] 0 2024-08-19T00:56:30.232 INFO:tasks.workunit.client.0.smithi017.stdout:8/744: readlink de/d36/l43 0 2024-08-19T00:56:30.232 INFO:tasks.workunit.client.0.smithi017.stdout:7/891: write d3/d3c/ff2 [2796498,130376] 0 2024-08-19T00:56:30.235 INFO:tasks.workunit.client.0.smithi017.stdout:7/892: fdatasync d3/dc/df/dda/df5/f105 0 2024-08-19T00:56:30.238 INFO:tasks.workunit.client.0.smithi017.stdout:5/585: rename db/d19/daa/db4 to db/d19/d1f/d15/d3e/d40/d83/dca 0 2024-08-19T00:56:30.238 INFO:tasks.workunit.client.0.smithi017.stdout:9/691: dwrite d0/d58/d9f/fb5 [0,4194304] 0 2024-08-19T00:56:30.239 INFO:tasks.workunit.client.0.smithi017.stdout:4/778: write d2/d1a/f69 [407192,52105] 0 2024-08-19T00:56:30.241 INFO:tasks.workunit.client.0.smithi017.stdout:4/779: truncate d2/d87/dbc/fe0 833751 0 2024-08-19T00:56:30.246 INFO:tasks.workunit.client.0.smithi017.stdout:4/780: truncate d2/d11/dd6/f108 17752 0 2024-08-19T00:56:30.249 INFO:tasks.workunit.client.0.smithi017.stdout:9/692: dwrite d0/f47 [0,4194304] 0 2024-08-19T00:56:30.250 INFO:tasks.workunit.client.0.smithi017.stdout:4/781: read d2/d87/db2/de6/d53/f74 [2974893,118942] 0 2024-08-19T00:56:30.257 INFO:tasks.workunit.client.0.smithi017.stdout:6/861: rmdir d5/d13/d11/d2c/d4a/da8/dd1/d8f/d112 0 2024-08-19T00:56:30.265 INFO:tasks.workunit.client.0.smithi017.stdout:6/862: mknod d5/d13/d11/d2c/d9d/c122 0 2024-08-19T00:56:30.268 INFO:tasks.workunit.client.0.smithi017.stdout:3/794: getdents d5/da/d3c/d4f/d68/d99 0 2024-08-19T00:56:30.269 INFO:tasks.workunit.client.0.smithi017.stdout:3/795: chown d5/d18/cb7 16291 1 2024-08-19T00:56:30.271 INFO:tasks.workunit.client.0.smithi017.stdout:9/693: link d0/d33/l3b d0/d33/d22/d85/da6/dc5/lca 0 2024-08-19T00:56:30.272 INFO:tasks.workunit.client.0.smithi017.stdout:3/796: symlink d5/da/d27/d6e/dd0/lfb 0 2024-08-19T00:56:30.275 INFO:tasks.workunit.client.0.smithi017.stdout:3/797: chown d5/c82 0 1 2024-08-19T00:56:30.275 INFO:tasks.workunit.client.0.smithi017.stdout:6/863: link d5/d13/d11/d4d/f110 d5/d13/d11/d2c/d4a/da8/d11b/f123 0 2024-08-19T00:56:30.279 INFO:tasks.workunit.client.0.smithi017.stdout:9/694: creat d0/d58/d49/fcb x:0 0 0 2024-08-19T00:56:30.279 INFO:tasks.workunit.client.0.smithi017.stdout:6/864: dread - d5/d13/d11/d4d/f110 zero size 2024-08-19T00:56:30.282 INFO:tasks.workunit.client.0.smithi017.stdout:3/798: dwrite d5/d18/dab/fb9 [0,4194304] 0 2024-08-19T00:56:30.285 INFO:tasks.workunit.client.0.smithi017.stdout:3/799: write d5/da/d3c/d4f/fed [901495,27495] 0 2024-08-19T00:56:30.289 INFO:tasks.workunit.client.0.smithi017.stdout:5/586: write db/d19/d1f/d15/d1e/f27 [1147810,73852] 0 2024-08-19T00:56:30.290 INFO:tasks.workunit.client.0.smithi017.stdout:2/816: truncate d2/d7/f96 1054230 0 2024-08-19T00:56:30.293 INFO:tasks.workunit.client.0.smithi017.stdout:8/745: write de/d15/d39/dc7/fdd [1077572,66162] 0 2024-08-19T00:56:30.294 INFO:tasks.workunit.client.0.smithi017.stdout:5/587: chown db/d19/d1f/d15/d3e/d40/d83/dca 0 1 2024-08-19T00:56:30.296 INFO:tasks.workunit.client.0.smithi017.stdout:8/746: stat de/d15/d39/dc7/cce 0 2024-08-19T00:56:30.296 INFO:tasks.workunit.client.0.smithi017.stdout:6/865: dwrite d5/d13/d11/d2c/d4a/d64/d86/d90/dba/f107 [0,4194304] 0 2024-08-19T00:56:30.300 INFO:tasks.workunit.client.0.smithi017.stdout:3/800: symlink d5/da/d3c/de4/d92/dca/dfa/lfc 0 2024-08-19T00:56:30.302 INFO:tasks.workunit.client.0.smithi017.stdout:3/801: fdatasync d5/da/d3c/de4/d92/dca/feb 0 2024-08-19T00:56:30.306 INFO:tasks.workunit.client.0.smithi017.stdout:2/817: creat d2/d7/d10/d9f/df9/dfd/f102 x:0 0 0 2024-08-19T00:56:30.307 INFO:tasks.workunit.client.0.smithi017.stdout:2/818: fdatasync d2/d7/d10/d35/d45/d58/dbf/fad 0 2024-08-19T00:56:30.310 INFO:tasks.workunit.client.0.smithi017.stdout:2/819: fsync d2/d7/d10/d3b/d80/d81/fa6 0 2024-08-19T00:56:30.311 INFO:tasks.workunit.client.0.smithi017.stdout:2/820: fsync d2/d7/d29/f31 0 2024-08-19T00:56:30.316 INFO:tasks.workunit.client.0.smithi017.stdout:9/695: getdents d0/d33/d22/d85/da6/dc5 0 2024-08-19T00:56:30.318 INFO:tasks.workunit.client.0.smithi017.stdout:4/782: dwrite d2/d87/db2/de6/d40/d8b/fda [0,4194304] 0 2024-08-19T00:56:30.321 INFO:tasks.workunit.client.0.smithi017.stdout:8/747: creat de/fe5 x:0 0 0 2024-08-19T00:56:30.324 INFO:tasks.workunit.client.0.smithi017.stdout:3/802: mkdir d5/da/d27/d6e/df3/dfd 0 2024-08-19T00:56:30.326 INFO:tasks.workunit.client.0.smithi017.stdout:3/803: chown d5/da/d27/d6e/dd0/de0/le3 668637 1 2024-08-19T00:56:30.329 INFO:tasks.workunit.client.0.smithi017.stdout:9/696: creat d0/d33/d22/d5e/dae/fcc x:0 0 0 2024-08-19T00:56:30.330 INFO:tasks.workunit.client.0.smithi017.stdout:4/783: mknod d2/d1a/d55/d73/da6/c10c 0 2024-08-19T00:56:30.330 INFO:tasks.workunit.client.0.smithi017.stdout:4/784: chown d2/dd7/le3 505676 1 2024-08-19T00:56:30.332 INFO:tasks.workunit.client.0.smithi017.stdout:5/588: getdents db/d19/d1f/d15/d1e/d5f 0 2024-08-19T00:56:30.336 INFO:tasks.workunit.client.0.smithi017.stdout:3/804: creat d5/da/d3c/d4f/d68/df2/ffe x:0 0 0 2024-08-19T00:56:30.338 INFO:tasks.workunit.client.0.smithi017.stdout:4/785: rename d2/d27/f4d to d2/d87/db2/de6/d40/d56/dbb/f10d 0 2024-08-19T00:56:30.340 INFO:tasks.workunit.client.0.smithi017.stdout:9/697: symlink d0/d58/d49/lcd 0 2024-08-19T00:56:30.341 INFO:tasks.workunit.client.0.smithi017.stdout:2/821: getdents d2/d7/d10/d3b/d3c/d8a/d6b 0 2024-08-19T00:56:30.342 INFO:tasks.workunit.client.0.smithi017.stdout:3/805: symlink d5/da/d3c/de4/d92/dca/dfa/lff 0 2024-08-19T00:56:30.353 INFO:tasks.workunit.client.0.smithi017.stdout:9/698: write d0/d58/d49/d70/f90 [3981146,73463] 0 2024-08-19T00:56:30.357 INFO:tasks.workunit.client.0.smithi017.stdout:8/748: dread de/d15/f35 [0,4194304] 0 2024-08-19T00:56:30.361 INFO:tasks.workunit.client.0.smithi017.stdout:6/866: dwrite d5/d13/d20/f27 [0,4194304] 0 2024-08-19T00:56:30.361 INFO:tasks.workunit.client.0.smithi017.stdout:2/822: mknod d2/d7/d10/d9f/c103 0 2024-08-19T00:56:30.366 INFO:tasks.workunit.client.0.smithi017.stdout:5/589: link db/d19/d1f/d15/c8b db/d19/d1f/d15/d1e/ccb 0 2024-08-19T00:56:30.366 INFO:tasks.workunit.client.0.smithi017.stdout:4/786: dread d2/d1a/d20/f3b [0,4194304] 0 2024-08-19T00:56:30.367 INFO:tasks.workunit.client.0.smithi017.stdout:5/590: dread - db/d19/d1f/d15/d30/f5c zero size 2024-08-19T00:56:30.369 INFO:tasks.workunit.client.0.smithi017.stdout:8/749: rmdir de/d15/d39 39 2024-08-19T00:56:30.371 INFO:tasks.workunit.client.0.smithi017.stdout:3/806: creat d5/da/d27/f100 x:0 0 0 2024-08-19T00:56:30.371 INFO:tasks.workunit.client.0.smithi017.stdout:3/807: fdatasync d5/d18/fde 0 2024-08-19T00:56:30.373 INFO:tasks.workunit.client.0.smithi017.stdout:6/867: rename d5/fc0 to d5/d13/d11/d2c/d4a/d106/f124 0 2024-08-19T00:56:30.375 INFO:tasks.workunit.client.0.smithi017.stdout:4/787: symlink d2/d1a/dd0/dd4/l10e 0 2024-08-19T00:56:30.376 INFO:tasks.workunit.client.0.smithi017.stdout:4/788: readlink d2/d16/l19 0 2024-08-19T00:56:30.377 INFO:tasks.workunit.client.0.smithi017.stdout:8/750: unlink de/d36/d74/fbd 0 2024-08-19T00:56:30.379 INFO:tasks.workunit.client.0.smithi017.stdout:8/751: write de/d15/d79/f91 [1776850,31011] 0 2024-08-19T00:56:30.379 INFO:tasks.workunit.client.0.smithi017.stdout:2/823: mkdir d2/d7/d10/d35/d104 0 2024-08-19T00:56:30.382 INFO:tasks.workunit.client.0.smithi017.stdout:3/808: creat d5/da/d3c/d4f/d68/d99/f101 x:0 0 0 2024-08-19T00:56:30.384 INFO:tasks.workunit.client.0.smithi017.stdout:6/868: creat d5/d13/d11/d2c/d4a/d64/d86/d90/dba/f125 x:0 0 0 2024-08-19T00:56:30.385 INFO:tasks.workunit.client.0.smithi017.stdout:6/869: chown d5/d13/d11/d4d/dfa/f119 64 1 2024-08-19T00:56:30.393 INFO:tasks.workunit.client.0.smithi017.stdout:9/699: getdents d0/d84 0 2024-08-19T00:56:30.394 INFO:tasks.workunit.client.0.smithi017.stdout:3/809: mkdir d5/da/d3c/de4/d1b/d102 0 2024-08-19T00:56:30.395 INFO:tasks.workunit.client.0.smithi017.stdout:8/752: dwrite de/d15/d39/fa8 [0,4194304] 0 2024-08-19T00:56:30.397 INFO:tasks.workunit.client.0.smithi017.stdout:4/789: mknod d2/d87/db2/de6/d40/d8b/d100/c10f 0 2024-08-19T00:56:30.404 INFO:tasks.workunit.client.0.smithi017.stdout:5/591: getdents db/d19/daa 0 2024-08-19T00:56:30.404 INFO:tasks.workunit.client.0.smithi017.stdout:2/824: link d2/d7/f6c d2/d7/d10/d9f/df9/f105 0 2024-08-19T00:56:30.406 INFO:tasks.workunit.client.0.smithi017.stdout:6/870: dwrite d5/d13/d11/d93/fb0 [0,4194304] 0 2024-08-19T00:56:30.406 INFO:tasks.workunit.client.0.smithi017.stdout:9/700: rename d0/c13 to d0/d33/d22/d45/da2/cce 0 2024-08-19T00:56:30.411 INFO:tasks.workunit.client.0.smithi017.stdout:5/592: fsync f6 0 2024-08-19T00:56:30.411 INFO:tasks.workunit.client.0.smithi017.stdout:4/790: fdatasync d2/f4b 0 2024-08-19T00:56:30.411 INFO:tasks.workunit.client.0.smithi017.stdout:5/593: chown db/d19/d1f/d15/fb6 6 1 2024-08-19T00:56:30.411 INFO:tasks.workunit.client.0.smithi017.stdout:5/594: read - db/d19/d1f/d15/fb6 zero size 2024-08-19T00:56:30.413 INFO:tasks.workunit.client.0.smithi017.stdout:6/871: mknod d5/d13/d11/d93/c126 0 2024-08-19T00:56:30.415 INFO:tasks.workunit.client.0.smithi017.stdout:3/810: rename d5/d11/d61/l8d to d5/da/d27/d6e/df3/l103 0 2024-08-19T00:56:30.422 INFO:tasks.workunit.client.0.smithi017.stdout:6/872: mkdir d5/d13/d11/d2c/d4a/d64/d127 0 2024-08-19T00:56:30.423 INFO:tasks.workunit.client.0.smithi017.stdout:4/791: dwrite d2/d1a/dd0/dd4/de2/fef [0,4194304] 0 2024-08-19T00:56:30.424 INFO:tasks.workunit.client.0.smithi017.stdout:4/792: chown d2/d87/f10a 620 1 2024-08-19T00:56:30.428 INFO:tasks.workunit.client.0.smithi017.stdout:3/811: symlink d5/da/d3c/d4f/d68/d9e/l104 0 2024-08-19T00:56:30.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:30 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:56:30.434 INFO:tasks.workunit.client.0.smithi017.stdout:4/793: dwrite d2/d87/db2/de6/d40/d56/d99/da3/fb3 [0,4194304] 0 2024-08-19T00:56:30.439 INFO:tasks.workunit.client.0.smithi017.stdout:2/825: dwrite d2/d7/f21 [0,4194304] 0 2024-08-19T00:56:30.442 INFO:tasks.workunit.client.0.smithi017.stdout:6/873: mknod d5/d13/d11/d2c/d114/c128 0 2024-08-19T00:56:30.447 INFO:tasks.workunit.client.0.smithi017.stdout:8/753: rename de/d36/dad/cd4 to de/ce6 0 2024-08-19T00:56:30.449 INFO:tasks.workunit.client.0.smithi017.stdout:2/826: dread d2/d7/d10/d35/d45/fa9 [0,4194304] 0 2024-08-19T00:56:30.449 INFO:tasks.workunit.client.0.smithi017.stdout:4/794: mkdir d2/d11/d24/dbe/d110 0 2024-08-19T00:56:30.450 INFO:tasks.workunit.client.0.smithi017.stdout:6/874: rmdir d5/d13/d11/d2c/d4a/d64/d86/d90/dba/dbf 39 2024-08-19T00:56:30.451 INFO:tasks.workunit.client.0.smithi017.stdout:8/754: read de/d15/d39/fda [212528,12958] 0 2024-08-19T00:56:30.452 INFO:tasks.workunit.client.0.smithi017.stdout:9/701: rename d0/d33/d22/d5e/dae/fbd to d0/d33/d22/d45/d8e/fcf 0 2024-08-19T00:56:30.453 INFO:tasks.workunit.client.0.smithi017.stdout:4/795: write d2/d11/f14 [2923613,92868] 0 2024-08-19T00:56:30.455 INFO:tasks.workunit.client.0.smithi017.stdout:3/812: dread d5/da/d27/d28/f80 [0,4194304] 0 2024-08-19T00:56:30.459 INFO:tasks.workunit.client.0.smithi017.stdout:5/595: dwrite db/d19/d1f/d15/d3e/d40/f44 [0,4194304] 0 2024-08-19T00:56:30.460 INFO:tasks.workunit.client.0.smithi017.stdout:3/813: dread - d5/da/d3c/fc5 zero size 2024-08-19T00:56:30.465 INFO:tasks.workunit.client.0.smithi017.stdout:4/796: dwrite d2/d1a/dd0/dd4/ff1 [0,4194304] 0 2024-08-19T00:56:30.465 INFO:tasks.workunit.client.0.smithi017.stdout:9/702: rename d0/d33/d22/l7c to d0/d33/d22/d45/d9b/ld0 0 2024-08-19T00:56:30.471 INFO:tasks.workunit.client.0.smithi017.stdout:5/596: creat db/d19/d1f/d15/d3e/d40/d49/d63/d80/fcc x:0 0 0 2024-08-19T00:56:30.474 INFO:tasks.workunit.client.0.smithi017.stdout:3/814: dread d5/da/d27/d28/f96 [0,4194304] 0 2024-08-19T00:56:30.477 INFO:tasks.workunit.client.0.smithi017.stdout:6/875: creat d5/d13/d11/d2c/d4a/d64/d86/d90/dba/f129 x:0 0 0 2024-08-19T00:56:30.479 INFO:tasks.workunit.client.0.smithi017.stdout:8/755: dwrite de/d15/f35 [0,4194304] 0 2024-08-19T00:56:30.482 INFO:tasks.workunit.client.0.smithi017.stdout:9/703: rename d0/c2a to d0/d33/d22/d5a/cd1 0 2024-08-19T00:56:30.483 INFO:tasks.workunit.client.0.smithi017.stdout:6/876: stat d5/d13/d11/d2c/d4a/d64/de2/f101 0 2024-08-19T00:56:30.484 INFO:tasks.workunit.client.0.smithi017.stdout:8/756: creat de/d15/d39/dc7/fe7 x:0 0 0 2024-08-19T00:56:30.485 INFO:tasks.workunit.client.0.smithi017.stdout:8/757: dread - de/d15/d39/dc7/fe7 zero size 2024-08-19T00:56:30.486 INFO:tasks.workunit.client.0.smithi017.stdout:5/597: link db/d19/d1f/d15/d3e/d40/f84 db/d19/d1f/d15/d1e/fcd 0 2024-08-19T00:56:30.488 INFO:tasks.workunit.client.0.smithi017.stdout:3/815: rename d5/da/d27/d6e/fa3 to d5/da/d3c/de4/d92/dca/dfa/f105 0 2024-08-19T00:56:30.489 INFO:tasks.workunit.client.0.smithi017.stdout:6/877: mknod d5/d13/d20/d77/c12a 0 2024-08-19T00:56:30.490 INFO:tasks.workunit.client.0.smithi017.stdout:9/704: creat d0/d58/d9f/fd2 x:0 0 0 2024-08-19T00:56:30.491 INFO:tasks.workunit.client.0.smithi017.stdout:8/758: mkdir de/d15/d39/d3d/dc2/de8 0 2024-08-19T00:56:30.491 INFO:tasks.workunit.client.0.smithi017.stdout:9/705: stat d0/d33/d22/d85/da6/dc5 0 2024-08-19T00:56:30.493 INFO:tasks.workunit.client.0.smithi017.stdout:5/598: mkdir db/d19/d1f/d15/d3e/d40/d49/dce 0 2024-08-19T00:56:30.493 INFO:tasks.workunit.client.0.smithi017.stdout:2/827: dread d2/d7/d10/d35/d7e/f8c [0,4194304] 0 2024-08-19T00:56:30.494 INFO:tasks.workunit.client.0.smithi017.stdout:6/878: readlink d5/d13/d11/d2c/l43 0 2024-08-19T00:56:30.498 INFO:tasks.workunit.client.0.smithi017.stdout:9/706: creat d0/d33/d22/d85/da6/dc5/fd3 x:0 0 0 2024-08-19T00:56:30.499 INFO:tasks.workunit.client.0.smithi017.stdout:2/828: mkdir d2/d7/d10/d35/d45/d58/dbf/d7a/d106 0 2024-08-19T00:56:30.499 INFO:tasks.workunit.client.0.smithi017.stdout:4/797: write d2/d87/db2/de6/d40/d56/dbb/f10d [1179909,122576] 0 2024-08-19T00:56:30.500 INFO:tasks.workunit.client.0.smithi017.stdout:4/798: readlink d2/l92 0 2024-08-19T00:56:30.501 INFO:tasks.workunit.client.0.smithi017.stdout:2/829: write d2/d7/d10/d3b/d54/fc1 [1046915,47139] 0 2024-08-19T00:56:30.502 INFO:tasks.workunit.client.0.smithi017.stdout:9/707: mkdir d0/d58/d9f/dd4 0 2024-08-19T00:56:30.504 INFO:tasks.workunit.client.0.smithi017.stdout:4/799: write d2/d87/db2/de6/d40/d56/dbb/f10d [4212039,82801] 0 2024-08-19T00:56:30.507 INFO:tasks.workunit.client.0.smithi017.stdout:5/599: link db/d19/d1f/lc7 db/d19/d1f/d15/d3e/d40/d49/d63/d7b/lcf 0 2024-08-19T00:56:30.508 INFO:tasks.workunit.client.0.smithi017.stdout:4/800: symlink d2/d87/db2/db5/l111 0 2024-08-19T00:56:30.510 INFO:tasks.workunit.client.0.smithi017.stdout:4/801: fsync d2/d1a/d55/d8f/fc3 0 2024-08-19T00:56:30.512 INFO:tasks.workunit.client.0.smithi017.stdout:9/708: dwrite d0/d58/d49/dc3/fc4 [0,4194304] 0 2024-08-19T00:56:30.514 INFO:tasks.workunit.client.0.smithi017.stdout:6/879: dread d5/f1e [0,4194304] 0 2024-08-19T00:56:30.526 INFO:tasks.workunit.client.0.smithi017.stdout:9/709: mkdir d0/d58/d49/d5d/dd5 0 2024-08-19T00:56:30.527 INFO:tasks.workunit.client.0.smithi017.stdout:2/830: link d2/d7/d10/d3b/d80/d81/fc4 d2/d7/d10/d3b/d3c/d8a/f107 0 2024-08-19T00:56:30.529 INFO:tasks.workunit.client.0.smithi017.stdout:9/710: chown d0/d33/d22/lab 3802 1 2024-08-19T00:56:30.530 INFO:tasks.workunit.client.0.smithi017.stdout:2/831: write d2/d7/d29/f52 [513572,75287] 0 2024-08-19T00:56:30.531 INFO:tasks.workunit.client.0.smithi017.stdout:2/832: chown d2/d7/df7 676073 1 2024-08-19T00:56:30.531 INFO:tasks.workunit.client.0.smithi017.stdout:4/802: dwrite d2/d87/db2/de6/d40/d84/fe8 [0,4194304] 0 2024-08-19T00:56:30.533 INFO:tasks.workunit.client.0.smithi017.stdout:2/833: chown d2/d7/d10/d35/d55/fe8 57033341 1 2024-08-19T00:56:30.535 INFO:tasks.workunit.client.0.smithi017.stdout:8/759: dread de/f81 [0,4194304] 0 2024-08-19T00:56:30.537 INFO:tasks.workunit.client.0.smithi017.stdout:3/816: dread d5/da/d3c/de4/d92/fa8 [4194304,4194304] 0 2024-08-19T00:56:30.538 INFO:tasks.workunit.client.0.smithi017.stdout:8/760: dread - de/d15/d39/dc7/fe7 zero size 2024-08-19T00:56:30.538 INFO:tasks.workunit.client.0.smithi017.stdout:2/834: dread d2/d7/d10/d35/d7e/f8c [4194304,4194304] 0 2024-08-19T00:56:30.540 INFO:tasks.workunit.client.0.smithi017.stdout:8/761: read de/d15/f2b [793160,59716] 0 2024-08-19T00:56:30.541 INFO:tasks.workunit.client.0.smithi017.stdout:5/600: truncate db/d19/d1f/dbd/f5b 118830 0 2024-08-19T00:56:30.543 INFO:tasks.workunit.client.0.smithi017.stdout:5/601: dread f7 [0,4194304] 0 2024-08-19T00:56:30.546 INFO:tasks.workunit.client.0.smithi017.stdout:6/880: dwrite d5/f39 [0,4194304] 0 2024-08-19T00:56:30.564 INFO:tasks.workunit.client.0.smithi017.stdout:9/711: read d0/f3a [3454307,79444] 0 2024-08-19T00:56:30.565 INFO:tasks.workunit.client.0.smithi017.stdout:4/803: creat d2/d87/db2/de6/d40/f112 x:0 0 0 2024-08-19T00:56:30.566 INFO:tasks.workunit.client.0.smithi017.stdout:3/817: readlink d5/da/d3c/de4/l22 0 2024-08-19T00:56:30.568 INFO:tasks.workunit.client.0.smithi017.stdout:2/835: mknod d2/d7/d10/d9f/df9/dfd/c108 0 2024-08-19T00:56:30.571 INFO:tasks.workunit.client.0.smithi017.stdout:2/836: write d2/d7/d10/d3b/fb4 [4737331,123324] 0 2024-08-19T00:56:30.572 INFO:tasks.workunit.client.0.smithi017.stdout:9/712: dwrite d0/d33/d22/d85/da6/dc5/fd3 [0,4194304] 0 2024-08-19T00:56:30.575 INFO:tasks.workunit.client.0.smithi017.stdout:3/818: rmdir d5/d18 39 2024-08-19T00:56:30.577 INFO:tasks.workunit.client.0.smithi017.stdout:4/804: symlink d2/d87/db2/de6/d40/d56/l113 0 2024-08-19T00:56:30.579 INFO:tasks.workunit.client.0.smithi017.stdout:3/819: write d5/da/d3c/de4/d1b/f7b [3782399,106644] 0 2024-08-19T00:56:30.580 INFO:tasks.workunit.client.0.smithi017.stdout:2/837: dwrite d2/d7/fce [0,4194304] 0 2024-08-19T00:56:30.582 INFO:tasks.workunit.client.0.smithi017.stdout:8/762: creat de/d15/d39/d3d/dc2/de8/fe9 x:0 0 0 2024-08-19T00:56:30.583 INFO:tasks.workunit.client.0.smithi017.stdout:8/763: readlink de/d15/l1a 0 2024-08-19T00:56:30.584 INFO:tasks.workunit.client.0.smithi017.stdout:8/764: write de/d15/d4f/d68/d84/dc8/fd3 [562941,3782] 0 2024-08-19T00:56:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:9/713: creat d0/d33/d22/d85/da6/fd6 x:0 0 0 2024-08-19T00:56:30.684 INFO:tasks.workunit.client.0.smithi017.stdout:3/820: truncate d5/da/fb6 1747207 0 2024-08-19T00:56:30.685 INFO:tasks.workunit.client.0.smithi017.stdout:8/765: creat de/d36/d74/d80/fea x:0 0 0 2024-08-19T00:56:30.688 INFO:tasks.workunit.client.0.smithi017.stdout:8/766: dread - de/d15/d39/d3d/fdc zero size 2024-08-19T00:56:30.690 INFO:tasks.workunit.client.0.smithi017.stdout:5/602: link db/d19/d1f/lc7 db/d19/daa/ld0 0 2024-08-19T00:56:30.692 INFO:tasks.workunit.client.0.smithi017.stdout:6/881: dwrite d5/d13/d11/d2c/f78 [0,4194304] 0 2024-08-19T00:56:30.692 INFO:tasks.workunit.client.0.smithi017.stdout:3/821: creat d5/da/d3c/de4/d92/f106 x:0 0 0 2024-08-19T00:56:30.695 INFO:tasks.workunit.client.0.smithi017.stdout:3/822: write d5/da/d3c/d4f/d68/df2/ffe [977285,95071] 0 2024-08-19T00:56:30.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:30 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:56:30.707 INFO:tasks.workunit.client.0.smithi017.stdout:5/603: creat db/d19/d1f/d15/d30/fd1 x:0 0 0 2024-08-19T00:56:30.707 INFO:tasks.workunit.client.0.smithi017.stdout:5/604: chown db/d19/d8d/fa5 28 1 2024-08-19T00:56:30.709 INFO:tasks.workunit.client.0.smithi017.stdout:9/714: link d0/d33/f29 d0/d33/d22/d45/d9b/fd7 0 2024-08-19T00:56:30.710 INFO:tasks.workunit.client.0.smithi017.stdout:8/767: mknod de/d15/d39/d3d/dc2/dd8/de2/ceb 0 2024-08-19T00:56:30.712 INFO:tasks.workunit.client.0.smithi017.stdout:8/768: read de/d15/d39/f41 [1586569,69969] 0 2024-08-19T00:56:30.712 INFO:tasks.workunit.client.0.smithi017.stdout:5/605: dread - db/d19/d1f/d15/d30/f9f zero size 2024-08-19T00:56:30.713 INFO:tasks.workunit.client.0.smithi017.stdout:9/715: mkdir d0/d84/dd8 0 2024-08-19T00:56:30.714 INFO:tasks.workunit.client.0.smithi017.stdout:3/823: creat d5/da/d27/f107 x:0 0 0 2024-08-19T00:56:30.717 INFO:tasks.workunit.client.0.smithi017.stdout:2/838: dwrite d2/d7/d10/d3b/d3c/f9b [0,4194304] 0 2024-08-19T00:56:30.719 INFO:tasks.workunit.client.0.smithi017.stdout:2/839: chown d2/d7/d10/d35/d45/d58/c5f 332 1 2024-08-19T00:56:30.719 INFO:tasks.workunit.client.0.smithi017.stdout:9/716: mknod d0/d33/d22/d40/cd9 0 2024-08-19T00:56:30.722 INFO:tasks.workunit.client.0.smithi017.stdout:2/840: truncate d2/d7/d10/d3b/d80/da2/daf/fe3 711077 0 2024-08-19T00:56:30.723 INFO:tasks.workunit.client.0.smithi017.stdout:5/606: mknod db/d19/d1f/d15/d3e/d40/d49/d63/d80/cd2 0 2024-08-19T00:56:30.727 INFO:tasks.workunit.client.0.smithi017.stdout:3/824: mknod d5/da/d3c/d4f/d68/d9e/c108 0 2024-08-19T00:56:30.728 INFO:tasks.workunit.client.0.smithi017.stdout:9/717: dread d0/d33/d22/d85/da6/dc5/fd3 [0,4194304] 0 2024-08-19T00:56:30.728 INFO:tasks.workunit.client.0.smithi017.stdout:6/882: dwrite d5/d13/d11/d2c/f38 [0,4194304] 0 2024-08-19T00:56:30.731 INFO:tasks.workunit.client.0.smithi017.stdout:8/769: write de/f54 [1514332,28234] 0 2024-08-19T00:56:30.734 INFO:tasks.workunit.client.0.smithi017.stdout:8/770: read de/d15/f92 [2165223,19509] 0 2024-08-19T00:56:30.734 INFO:tasks.workunit.client.0.smithi017.stdout:9/718: creat d0/d33/d22/d45/d9b/fda x:0 0 0 2024-08-19T00:56:30.735 INFO:tasks.workunit.client.0.smithi017.stdout:9/719: stat d0/d33/d22/d45/f94 0 2024-08-19T00:56:30.736 INFO:tasks.workunit.client.0.smithi017.stdout:9/720: stat d0/d33/d22/fb0 0 2024-08-19T00:56:30.738 INFO:tasks.workunit.client.0.smithi017.stdout:6/883: truncate d5/d13/f1b 2828032 0 2024-08-19T00:56:30.740 INFO:tasks.workunit.client.0.smithi017.stdout:5/607: mknod db/d19/d1f/d15/dc5/cd3 0 2024-08-19T00:56:30.744 INFO:tasks.workunit.client.0.smithi017.stdout:5/608: truncate db/d19/d1f/d15/fc6 325900 0 2024-08-19T00:56:30.745 INFO:tasks.workunit.client.0.smithi017.stdout:9/721: symlink d0/d33/d22/ldb 0 2024-08-19T00:56:30.746 INFO:tasks.workunit.client.0.smithi017.stdout:8/771: dread de/f34 [0,4194304] 0 2024-08-19T00:56:30.747 INFO:tasks.workunit.client.0.smithi017.stdout:6/884: creat d5/d13/d20/d77/d99/f12b x:0 0 0 2024-08-19T00:56:30.747 INFO:tasks.workunit.client.0.smithi017.stdout:2/841: dwrite d2/d7/d10/d3b/d97/f9a [0,4194304] 0 2024-08-19T00:56:30.748 INFO:tasks.workunit.client.0.smithi017.stdout:9/722: dread - d0/d33/d22/d45/d8e/fcf zero size 2024-08-19T00:56:30.750 INFO:tasks.workunit.client.0.smithi017.stdout:3/825: rename d5/da/d3c/d4f/d68 to d5/da/d3c/d4f/d109 0 2024-08-19T00:56:30.753 INFO:tasks.workunit.client.0.smithi017.stdout:5/609: fsync db/f2a 0 2024-08-19T00:56:30.754 INFO:tasks.workunit.client.0.smithi017.stdout:6/885: creat d5/d13/d20/d89/f12c x:0 0 0 2024-08-19T00:56:30.762 INFO:tasks.workunit.client.0.smithi017.stdout:9/723: symlink d0/d33/d22/ldc 0 2024-08-19T00:56:30.767 INFO:tasks.workunit.client.0.smithi017.stdout:3/826: dread - d5/fc6 zero size 2024-08-19T00:56:30.775 INFO:tasks.workunit.client.0.smithi017.stdout:3/827: dwrite d5/da/d27/d6e/fb1 [4194304,4194304] 0 2024-08-19T00:56:30.776 INFO:tasks.workunit.client.0.smithi017.stdout:8/772: mknod de/d15/d62/d75/dd7/cec 0 2024-08-19T00:56:30.778 INFO:tasks.workunit.client.0.smithi017.stdout:2/842: write d2/d7/d10/d35/d45/f4d [972358,122769] 0 2024-08-19T00:56:30.788 INFO:tasks.workunit.client.0.smithi017.stdout:3/828: mkdir d5/da/d3c/de4/d92/d10a 0 2024-08-19T00:56:30.794 INFO:tasks.workunit.client.0.smithi017.stdout:5/610: truncate db/d19/d1f/d15/d1e/f27 439189 0 2024-08-19T00:56:30.795 INFO:tasks.workunit.client.0.smithi017.stdout:8/773: mkdir de/d15/d39/d3d/dc2/dd6/ded 0 2024-08-19T00:56:30.798 INFO:tasks.workunit.client.0.smithi017.stdout:6/886: dwrite d5/d13/d11/f3b [0,4194304] 0 2024-08-19T00:56:30.799 INFO:tasks.workunit.client.0.smithi017.stdout:2/843: symlink d2/d7/d10/d35/l109 0 2024-08-19T00:56:30.799 INFO:tasks.workunit.client.0.smithi017.stdout:8/774: write de/d15/d4f/f5c [3266806,1405] 0 2024-08-19T00:56:30.801 INFO:tasks.workunit.client.0.smithi017.stdout:9/724: dread d0/d33/d22/d5a/f88 [0,4194304] 0 2024-08-19T00:56:30.806 INFO:tasks.workunit.client.0.smithi017.stdout:3/829: link d5/d11/d61/f76 d5/d11/d61/f10b 0 2024-08-19T00:56:30.807 INFO:tasks.workunit.client.0.smithi017.stdout:3/830: stat d5/da/d3c/d4f 0 2024-08-19T00:56:30.809 INFO:tasks.workunit.client.0.smithi017.stdout:6/887: mkdir d5/d13/d11/d2c/d4a/da8/dd1/d12d 0 2024-08-19T00:56:30.823 INFO:tasks.workunit.client.0.smithi017.stdout:8/775: dread de/d15/f29 [0,4194304] 0 2024-08-19T00:56:30.823 INFO:tasks.workunit.client.0.smithi017.stdout:6/888: truncate d5/d13/d11/d2c/d51/f8a 3621872 0 2024-08-19T00:56:30.825 INFO:tasks.workunit.client.0.smithi017.stdout:3/831: dread d5/da/d27/d28/f98 [0,4194304] 0 2024-08-19T00:56:30.829 INFO:tasks.workunit.client.0.smithi017.stdout:6/889: creat d5/d13/d11/d2c/d4a/d64/f12e x:0 0 0 2024-08-19T00:56:30.831 INFO:tasks.workunit.client.0.smithi017.stdout:8/776: dwrite de/d8d/fb6 [0,4194304] 0 2024-08-19T00:56:30.834 INFO:tasks.workunit.client.0.smithi017.stdout:5/611: truncate db/d19/d1f/d15/d1e/fa4 748532 0 2024-08-19T00:56:30.834 INFO:tasks.workunit.client.0.smithi017.stdout:3/832: mkdir d5/d18/dab/d10c 0 2024-08-19T00:56:30.835 INFO:tasks.workunit.client.0.smithi017.stdout:6/890: dread d5/d13/d11/d93/ff3 [0,4194304] 0 2024-08-19T00:56:30.839 INFO:tasks.workunit.client.0.smithi017.stdout:9/725: dwrite d0/d33/d22/f2f [0,4194304] 0 2024-08-19T00:56:30.839 INFO:tasks.workunit.client.0.smithi017.stdout:9/726: chown d0/d84 63831656 1 2024-08-19T00:56:30.841 INFO:tasks.workunit.client.0.smithi017.stdout:5/612: creat db/d19/d8d/fd4 x:0 0 0 2024-08-19T00:56:30.843 INFO:tasks.workunit.client.0.smithi017.stdout:8/777: symlink de/d15/d39/d3d/lee 0 2024-08-19T00:56:30.849 INFO:tasks.workunit.client.0.smithi017.stdout:6/891: mkdir d5/d13/d20/d89/d12f 0 2024-08-19T00:56:30.851 INFO:tasks.workunit.client.0.smithi017.stdout:9/727: mkdir d0/d33/d22/d45/d69/ddd 0 2024-08-19T00:56:30.853 INFO:tasks.workunit.client.0.smithi017.stdout:5/613: creat db/d19/d1f/d15/d1e/fd5 x:0 0 0 2024-08-19T00:56:30.860 INFO:tasks.workunit.client.0.smithi017.stdout:9/728: creat d0/d33/d22/d45/d69/fde x:0 0 0 2024-08-19T00:56:30.863 INFO:tasks.workunit.client.0.smithi017.stdout:3/833: dread d5/da/d3c/f93 [4194304,4194304] 0 2024-08-19T00:56:30.867 INFO:tasks.workunit.client.0.smithi017.stdout:5/614: rename db/d19/l38 to db/d19/d1f/d15/d3e/ld6 0 2024-08-19T00:56:30.870 INFO:tasks.workunit.client.0.smithi017.stdout:8/778: dwrite de/d15/f2b [0,4194304] 0 2024-08-19T00:56:30.871 INFO:tasks.workunit.client.0.smithi017.stdout:9/729: rename d0/d58/d49/d5d/db7/fc7 to d0/d33/d22/d45/da2/fdf 0 2024-08-19T00:56:30.872 INFO:tasks.workunit.client.0.smithi017.stdout:3/834: getdents d5/da/d27/d6e/df3 0 2024-08-19T00:56:30.874 INFO:tasks.workunit.client.0.smithi017.stdout:5/615: rmdir db/d19/daa 39 2024-08-19T00:56:30.876 INFO:tasks.workunit.client.0.smithi017.stdout:5/616: rename db to db/d19/d1f/d15/d30/dd7 22 2024-08-19T00:56:30.877 INFO:tasks.workunit.client.0.smithi017.stdout:8/779: fdatasync de/d15/d4f/f6e 0 2024-08-19T00:56:30.879 INFO:tasks.workunit.client.0.smithi017.stdout:9/730: fdatasync d0/d33/d22/d45/f54 0 2024-08-19T00:56:30.880 INFO:tasks.workunit.client.0.smithi017.stdout:5/617: fdatasync db/d19/d1f/d15/d3e/d40/d49/d63/f8c 0 2024-08-19T00:56:30.882 INFO:tasks.workunit.client.0.smithi017.stdout:8/780: write de/d15/d39/d3d/dc2/de8/fe9 [732508,91204] 0 2024-08-19T00:56:30.882 INFO:tasks.workunit.client.0.smithi017.stdout:3/835: dwrite d5/da/d3c/de4/d92/fc0 [0,4194304] 0 2024-08-19T00:56:30.894 INFO:tasks.workunit.client.0.smithi017.stdout:3/836: rename d5/d11/ld4 to d5/da/d3c/d4f/d109/d99/l10d 0 2024-08-19T00:56:30.900 INFO:tasks.workunit.client.0.smithi017.stdout:9/731: creat d0/d33/fe0 x:0 0 0 2024-08-19T00:56:30.901 INFO:tasks.workunit.client.0.smithi017.stdout:9/732: chown d0/d33/d22/d5e 18323148 1 2024-08-19T00:56:30.901 INFO:tasks.workunit.client.0.smithi017.stdout:8/781: link de/l99 de/d15/d79/de4/lef 0 2024-08-19T00:56:30.905 INFO:tasks.workunit.client.0.smithi017.stdout:5/618: dwrite db/d19/d1f/d15/d1e/fcd [0,4194304] 0 2024-08-19T00:56:30.913 INFO:tasks.workunit.client.0.smithi017.stdout:9/733: dwrite d0/d33/d22/d45/d69/fa4 [0,4194304] 0 2024-08-19T00:56:30.913 INFO:tasks.workunit.client.0.smithi017.stdout:8/782: write de/d15/d39/fda [2159366,66679] 0 2024-08-19T00:56:30.915 INFO:tasks.workunit.client.0.smithi017.stdout:5/619: rename db/d19/d1f/d15/d3e/d40/f44 to db/d19/d1f/d15/d3e/d40/d83/fd8 0 2024-08-19T00:56:30.917 INFO:tasks.workunit.client.0.smithi017.stdout:3/837: link d5/c12 d5/da/d27/d6e/df3/c10e 0 2024-08-19T00:56:30.918 INFO:tasks.workunit.client.0.smithi017.stdout:9/734: creat d0/d33/d22/d45/d9b/fe1 x:0 0 0 2024-08-19T00:56:30.919 INFO:tasks.workunit.client.0.smithi017.stdout:3/838: write d5/da/d3c/de4/d1b/f7b [4673949,23625] 0 2024-08-19T00:56:30.923 INFO:tasks.workunit.client.0.smithi017.stdout:8/783: mkdir de/d15/d39/d3d/dc2/dd6/ded/df0 0 2024-08-19T00:56:30.926 INFO:tasks.workunit.client.0.smithi017.stdout:9/735: dwrite d0/d33/d22/d45/d9b/fe1 [0,4194304] 0 2024-08-19T00:56:30.928 INFO:tasks.workunit.client.0.smithi017.stdout:5/620: mknod db/d19/daa/cd9 0 2024-08-19T00:56:30.929 INFO:tasks.workunit.client.0.smithi017.stdout:5/621: chown db/c1b 3 1 2024-08-19T00:56:30.930 INFO:tasks.workunit.client.0.smithi017.stdout:5/622: readlink db/d19/d1f/d15/d3e/d40/d49/d63/lc1 0 2024-08-19T00:56:30.932 INFO:tasks.workunit.client.0.smithi017.stdout:8/784: rename de/d15/d79/f67 to de/d15/d39/d3d/dc2/dd6/ff1 0 2024-08-19T00:56:30.933 INFO:tasks.workunit.client.0.smithi017.stdout:9/736: rmdir d0/d84 39 2024-08-19T00:56:30.935 INFO:tasks.workunit.client.0.smithi017.stdout:9/737: fdatasync d0/d33/d22/d45/d69/fde 0 2024-08-19T00:56:30.935 INFO:tasks.workunit.client.0.smithi017.stdout:3/839: creat d5/f10f x:0 0 0 2024-08-19T00:56:30.938 INFO:tasks.workunit.client.0.smithi017.stdout:8/785: dread de/f37 [0,4194304] 0 2024-08-19T00:56:30.938 INFO:tasks.workunit.client.0.smithi017.stdout:9/738: write d0/d84/fc8 [28485,86001] 0 2024-08-19T00:56:30.938 INFO:tasks.workunit.client.0.smithi017.stdout:3/840: unlink d5/da/d3c/d4f/fcc 0 2024-08-19T00:56:30.939 INFO:tasks.workunit.client.0.smithi017.stdout:9/739: fsync d0/d33/d22/d45/d8e/f99 0 2024-08-19T00:56:30.944 INFO:tasks.workunit.client.0.smithi017.stdout:8/786: rename de/d15/d9d/fcf to de/d15/d4f/ff2 0 2024-08-19T00:56:30.946 INFO:tasks.workunit.client.0.smithi017.stdout:9/740: dwrite d0/d33/d22/d45/f94 [0,4194304] 0 2024-08-19T00:56:30.949 INFO:tasks.workunit.client.0.smithi017.stdout:9/741: mkdir d0/d33/d22/d45/d9b/de2 0 2024-08-19T00:56:30.950 INFO:tasks.workunit.client.0.smithi017.stdout:9/742: fsync d0/d58/d49/f76 0 2024-08-19T00:56:30.952 INFO:tasks.workunit.client.0.smithi017.stdout:9/743: truncate d0/d33/d22/d45/f94 5074919 0 2024-08-19T00:56:30.953 INFO:tasks.workunit.client.0.smithi017.stdout:9/744: chown d0/d33/d22/l43 404266186 1 2024-08-19T00:56:30.955 INFO:tasks.workunit.client.0.smithi017.stdout:9/745: truncate d0/d33/d22/fbe 243409 0 2024-08-19T00:56:30.955 INFO:tasks.workunit.client.0.smithi017.stdout:5/623: write db/d19/d1f/fa9 [6456340,14509] 0 2024-08-19T00:56:30.958 INFO:tasks.workunit.client.0.smithi017.stdout:8/787: dread de/f4d [0,4194304] 0 2024-08-19T00:56:30.959 INFO:tasks.workunit.client.0.smithi017.stdout:8/788: chown de/d15/d4f/d68/d84/dc8 205 1 2024-08-19T00:56:30.960 INFO:tasks.workunit.client.0.smithi017.stdout:9/746: dread d0/d33/d22/f42 [0,4194304] 0 2024-08-19T00:56:30.960 INFO:tasks.workunit.client.0.smithi017.stdout:8/789: chown de/d15/d39/d3d/dc2/dd6/ded 11 1 2024-08-19T00:56:30.961 INFO:tasks.workunit.client.0.smithi017.stdout:9/747: write d0/d33/d22/d45/d9b/fe1 [566322,23779] 0 2024-08-19T00:56:30.962 INFO:tasks.workunit.client.0.smithi017.stdout:8/790: rmdir de/d15/d39 39 2024-08-19T00:56:30.967 INFO:tasks.workunit.client.0.smithi017.stdout:9/748: link d0/f47 d0/d58/d49/dc3/fe3 0 2024-08-19T00:56:30.968 INFO:tasks.workunit.client.0.smithi017.stdout:9/749: write d0/d58/fc6 [141874,41271] 0 2024-08-19T00:56:30.971 INFO:tasks.workunit.client.0.smithi017.stdout:8/791: write de/d15/d39/f3e [755689,40785] 0 2024-08-19T00:56:30.974 INFO:tasks.workunit.client.0.smithi017.stdout:9/750: link d0/d33/d22/ldc d0/d33/d22/d45/d8e/le4 0 2024-08-19T00:56:30.984 INFO:tasks.workunit.client.0.smithi017.stdout:8/792: truncate de/d15/d79/fa9 5136775 0 2024-08-19T00:56:30.986 INFO:tasks.workunit.client.0.smithi017.stdout:9/751: write d0/f34 [245780,58857] 0 2024-08-19T00:56:30.986 INFO:tasks.workunit.client.0.smithi017.stdout:8/793: mknod de/d36/d74/d80/cf3 0 2024-08-19T00:56:30.987 INFO:tasks.workunit.client.0.smithi017.stdout:8/794: chown de/d15/d39/fbb 83 1 2024-08-19T00:56:30.988 INFO:tasks.workunit.client.0.smithi017.stdout:9/752: mkdir d0/d33/d22/d40/de5 0 2024-08-19T00:56:30.989 INFO:tasks.workunit.client.0.smithi017.stdout:8/795: stat de/d15/d4f/d68/c7f 0 2024-08-19T00:56:30.991 INFO:tasks.workunit.client.0.smithi017.stdout:9/753: creat d0/d33/d22/d45/d9b/de2/fe6 x:0 0 0 2024-08-19T00:56:30.992 INFO:tasks.workunit.client.0.smithi017.stdout:8/796: mknod de/d15/cf4 0 2024-08-19T00:56:30.992 INFO:tasks.workunit.client.0.smithi017.stdout:9/754: write d0/d58/f66 [772605,81191] 0 2024-08-19T00:56:30.994 INFO:tasks.workunit.client.0.smithi017.stdout:8/797: rmdir de/d15/d9d/dc5 39 2024-08-19T00:56:30.998 INFO:tasks.workunit.client.0.smithi017.stdout:9/755: creat d0/d58/d49/d70/db2/fe7 x:0 0 0 2024-08-19T00:56:31.001 INFO:tasks.workunit.client.0.smithi017.stdout:8/798: link de/d15/d62/d75/fb8 de/d15/d39/d3d/dc2/dd8/ff5 0 2024-08-19T00:56:31.008 INFO:tasks.workunit.client.0.smithi017.stdout:8/799: dread de/f54 [0,4194304] 0 2024-08-19T00:56:31.008 INFO:tasks.workunit.client.0.smithi017.stdout:9/756: dwrite d0/d33/d22/d45/d8e/fcf [0,4194304] 0 2024-08-19T00:56:31.011 INFO:tasks.workunit.client.0.smithi017.stdout:9/757: dread d0/f65 [0,4194304] 0 2024-08-19T00:56:31.011 INFO:tasks.workunit.client.0.smithi017.stdout:9/758: readlink d0/d33/d22/ldb 0 2024-08-19T00:56:31.012 INFO:tasks.workunit.client.0.smithi017.stdout:9/759: dread - d0/d33/d22/d45/d9b/fda zero size 2024-08-19T00:56:31.018 INFO:tasks.workunit.client.0.smithi017.stdout:8/800: link de/d15/d62/d75/dd7/cec de/d15/d39/dc7/cf6 0 2024-08-19T00:56:31.021 INFO:tasks.workunit.client.0.smithi017.stdout:9/760: unlink d0/d33/d22/d45/d8e/le4 0 2024-08-19T00:56:31.023 INFO:tasks.workunit.client.0.smithi017.stdout:8/801: symlink de/d15/d4f/d68/d84/lf7 0 2024-08-19T00:56:31.024 INFO:tasks.workunit.client.0.smithi017.stdout:9/761: unlink d0/d58/d49/lcd 0 2024-08-19T00:56:31.025 INFO:tasks.workunit.client.0.smithi017.stdout:9/762: chown d0/d33/d22/d45/d9b/fd7 1 1 2024-08-19T00:56:31.026 INFO:tasks.workunit.client.0.smithi017.stdout:8/802: mknod de/d15/d39/d3d/dc2/de8/cf8 0 2024-08-19T00:56:31.028 INFO:tasks.workunit.client.0.smithi017.stdout:8/803: unlink de/d15/f92 0 2024-08-19T00:56:31.031 INFO:tasks.workunit.client.0.smithi017.stdout:9/763: dwrite d0/d58/d9f/fd2 [0,4194304] 0 2024-08-19T00:56:31.035 INFO:tasks.workunit.client.0.smithi017.stdout:8/804: chown de/d15/d62/d75/dd7/cec 31048 1 2024-08-19T00:56:31.036 INFO:tasks.workunit.client.0.smithi017.stdout:9/764: fdatasync d0/d33/f4d 0 2024-08-19T00:56:31.043 INFO:tasks.workunit.client.0.smithi017.stdout:8/805: dwrite de/d15/d39/dc7/fdd [0,4194304] 0 2024-08-19T00:56:31.051 INFO:tasks.workunit.client.0.smithi017.stdout:8/806: symlink de/d15/lf9 0 2024-08-19T00:56:31.052 INFO:tasks.workunit.client.0.smithi017.stdout:8/807: fsync de/d15/f35 0 2024-08-19T00:56:31.054 INFO:tasks.workunit.client.0.smithi017.stdout:9/765: dread d0/d33/d22/d45/da2/fa7 [0,4194304] 0 2024-08-19T00:56:31.055 INFO:tasks.workunit.client.0.smithi017.stdout:8/808: dread - de/d15/d62/f98 zero size 2024-08-19T00:56:31.057 INFO:tasks.workunit.client.0.smithi017.stdout:9/766: creat d0/d33/d22/d85/fe8 x:0 0 0 2024-08-19T00:56:31.061 INFO:tasks.workunit.client.0.smithi017.stdout:8/809: rename de/d15/d39/d3d/dc2/de8 to de/d15/d39/dfa 0 2024-08-19T00:56:31.064 INFO:tasks.workunit.client.0.smithi017.stdout:8/810: rename de/d15/d4f/dcc/cae to de/d15/d4f/dcc/cfb 0 2024-08-19T00:56:31.067 INFO:tasks.workunit.client.0.smithi017.stdout:9/767: write d0/d84/f92 [1000422,46226] 0 2024-08-19T00:56:31.071 INFO:tasks.workunit.client.0.smithi017.stdout:8/811: dwrite de/d15/d4f/f5c [0,4194304] 0 2024-08-19T00:56:31.074 INFO:tasks.workunit.client.0.smithi017.stdout:8/812: dread de/f54 [0,4194304] 0 2024-08-19T00:56:31.080 INFO:tasks.workunit.client.0.smithi017.stdout:9/768: truncate d0/d33/d22/d45/fb3 641284 0 2024-08-19T00:56:31.086 INFO:tasks.workunit.client.0.smithi017.stdout:8/813: dwrite de/d15/f3b [4194304,4194304] 0 2024-08-19T00:56:31.089 INFO:tasks.workunit.client.0.smithi017.stdout:9/769: dwrite d0/d33/d22/d45/f94 [4194304,4194304] 0 2024-08-19T00:56:31.091 INFO:tasks.workunit.client.0.smithi017.stdout:9/770: chown d0/d33/d22/d85 10560 1 2024-08-19T00:56:31.095 INFO:tasks.workunit.client.0.smithi017.stdout:9/771: mkdir d0/d33/d22/d85/da6/de9 0 2024-08-19T00:56:31.097 INFO:tasks.workunit.client.0.smithi017.stdout:8/814: getdents de/d15/d39/d3d/dc2/dd8/de2 0 2024-08-19T00:56:31.098 INFO:tasks.workunit.client.0.smithi017.stdout:9/772: write d0/d33/d22/d45/d9b/de2/fe6 [590697,99586] 0 2024-08-19T00:56:31.099 INFO:tasks.workunit.client.0.smithi017.stdout:9/773: read d0/d33/d22/d5a/f88 [3817274,127292] 0 2024-08-19T00:56:31.101 INFO:tasks.workunit.client.0.smithi017.stdout:9/774: read d0/d33/d22/fb0 [181287,60743] 0 2024-08-19T00:56:31.102 INFO:tasks.workunit.client.0.smithi017.stdout:8/815: rename de/d15/d79/f85 to de/d15/d4f/d68/ffc 0 2024-08-19T00:56:31.175 INFO:tasks.workunit.client.0.smithi017.stdout:9/775: write d0/d33/d22/d85/da6/dc5/fd3 [3036241,115120] 0 2024-08-19T00:56:31.175 INFO:tasks.workunit.client.0.smithi017.stdout:9/776: fsync d0/d33/d22/d85/fc1 0 2024-08-19T00:56:31.178 INFO:tasks.workunit.client.0.smithi017.stdout:9/777: creat d0/d33/fea x:0 0 0 2024-08-19T00:56:31.180 INFO:tasks.workunit.client.0.smithi017.stdout:9/778: mknod d0/d33/d22/d45/d9b/de2/ceb 0 2024-08-19T00:56:31.183 INFO:tasks.workunit.client.0.smithi017.stdout:9/779: rename d0/d33/d22/d5e/dae/fcc to d0/d33/d22/d45/d69/fec 0 2024-08-19T00:56:31.184 INFO:tasks.workunit.client.0.smithi017.stdout:9/780: write d0/d58/d49/d5d/fbf [4575125,115726] 0 2024-08-19T00:56:31.191 INFO:tasks.workunit.client.0.smithi017.stdout:9/781: getdents d0/d58/d49/dc3 0 2024-08-19T00:56:31.193 INFO:tasks.workunit.client.0.smithi017.stdout:9/782: creat d0/d58/d49/dc3/fed x:0 0 0 2024-08-19T00:56:31.204 INFO:tasks.workunit.client.0.smithi017.stdout:9/783: dwrite d0/d58/f3e [0,4194304] 0 2024-08-19T00:56:31.215 INFO:tasks.workunit.client.0.smithi017.stdout:9/784: rmdir d0/d58/d49/d5d/db7 0 2024-08-19T00:56:31.235 INFO:tasks.workunit.client.0.smithi017.stdout:9/785: dread d0/d33/f29 [0,4194304] 0 2024-08-19T00:56:31.238 INFO:tasks.workunit.client.0.smithi017.stdout:9/786: unlink d0/d33/d22/ldc 0 2024-08-19T00:56:31.241 INFO:tasks.workunit.client.0.smithi017.stdout:9/787: creat d0/d33/d22/d85/fee x:0 0 0 2024-08-19T00:56:31.249 INFO:tasks.workunit.client.0.smithi017.stdout:9/788: dwrite d0/d58/d49/dc3/fed [0,4194304] 0 2024-08-19T00:56:31.251 INFO:tasks.workunit.client.0.smithi017.stdout:9/789: write d0/d58/d49/d5d/fbf [5037278,72394] 0 2024-08-19T00:56:31.255 INFO:tasks.workunit.client.0.smithi017.stdout:9/790: rmdir d0/d33/d22/d85/da6/dc5 39 2024-08-19T00:56:31.256 INFO:tasks.workunit.client.0.smithi017.stdout:9/791: chown d0/d33/d22/d45/d8e/f81 41 1 2024-08-19T00:56:31.258 INFO:tasks.workunit.client.0.smithi017.stdout:9/792: chown d0/d33/d22/d45/d9b/fe1 2 1 2024-08-19T00:56:31.265 INFO:tasks.workunit.client.0.smithi017.stdout:9/793: fsync d0/d33/f4d 0 2024-08-19T00:56:31.271 INFO:tasks.workunit.client.0.smithi017.stdout:9/794: mkdir d0/d84/dd8/def 0 2024-08-19T00:56:31.272 INFO:tasks.workunit.client.0.smithi017.stdout:9/795: chown d0/d33/d22/d5e/c8f 898964 1 2024-08-19T00:56:31.276 INFO:tasks.workunit.client.0.smithi017.stdout:9/796: creat d0/d84/ff0 x:0 0 0 2024-08-19T00:56:31.283 INFO:tasks.workunit.client.0.smithi017.stdout:9/797: dwrite d0/d33/fe0 [0,4194304] 0 2024-08-19T00:56:31.291 INFO:tasks.workunit.client.0.smithi017.stdout:9/798: creat d0/d33/d22/d45/d69/ddd/ff1 x:0 0 0 2024-08-19T00:56:31.293 INFO:tasks.workunit.client.0.smithi017.stdout:9/799: chown d0/d33/d22/d45/d8e/f81 1328 1 2024-08-19T00:56:31.305 INFO:tasks.workunit.client.0.smithi017.stdout:9/800: getdents d0/d33 0 2024-08-19T00:56:31.310 INFO:tasks.workunit.client.0.smithi017.stdout:9/801: fdatasync d0/d33/f4d 0 2024-08-19T00:56:31.312 INFO:tasks.workunit.client.0.smithi017.stdout:9/802: write d0/d58/d49/d70/db2/fe7 [655462,50758] 0 2024-08-19T00:56:31.313 INFO:tasks.workunit.client.0.smithi017.stdout:9/803: write d0/d33/d22/d45/d8e/f99 [2697320,67103] 0 2024-08-19T00:56:31.319 INFO:tasks.workunit.client.0.smithi017.stdout:9/804: rmdir d0/d33/d22 39 2024-08-19T00:56:31.325 INFO:tasks.workunit.client.0.smithi017.stdout:9/805: mkdir d0/d33/df2 0 2024-08-19T00:56:31.330 INFO:tasks.workunit.client.0.smithi017.stdout:9/806: write d0/d58/d49/f4f [1338079,47316] 0 2024-08-19T00:56:31.391 INFO:tasks.workunit.client.0.smithi017.stdout:9/807: write d0/d33/d22/d45/d9b/fda [600869,18906] 0 2024-08-19T00:56:31.393 INFO:tasks.workunit.client.0.smithi017.stdout:9/808: chown d0/l68 431918116 1 2024-08-19T00:56:31.395 INFO:tasks.workunit.client.0.smithi017.stdout:9/809: getdents d0/d33/d22/d5e/dae 0 2024-08-19T00:56:31.396 INFO:tasks.workunit.client.0.smithi017.stdout:9/810: write d0/d33/d22/d45/d9b/fe1 [3228592,77865] 0 2024-08-19T00:56:31.397 INFO:tasks.workunit.client.0.smithi017.stdout:9/811: write d0/d58/d9f/fb5 [1806867,103573] 0 2024-08-19T00:56:31.400 INFO:tasks.workunit.client.0.smithi017.stdout:9/812: chown d0/d33/f4d 6 1 2024-08-19T00:56:31.401 INFO:tasks.workunit.client.0.smithi017.stdout:9/813: chown d0/d33/d22/d45/d9b/f9e 15385 1 2024-08-19T00:56:31.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:31 smithi017 ceph-mon[16627]: pgmap v26: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 73 MiB/s rd, 181 MiB/s wr, 397 op/s 2024-08-19T00:56:31.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:31 smithi086 ceph-mon[24511]: pgmap v26: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 73 MiB/s rd, 181 MiB/s wr, 397 op/s 2024-08-19T00:56:31.796 INFO:tasks.workunit.client.0.smithi017.stdout:0/688: sync 2024-08-19T00:56:31.799 INFO:tasks.workunit.client.0.smithi017.stdout:0/689: creat d5/d17/d26/d30/fed x:0 0 0 2024-08-19T00:56:31.802 INFO:tasks.workunit.client.0.smithi017.stdout:0/690: fsync d5/d17/f69 0 2024-08-19T00:56:31.806 INFO:tasks.workunit.client.0.smithi017.stdout:0/691: readlink d5/l2a 0 2024-08-19T00:56:31.808 INFO:tasks.workunit.client.0.smithi017.stdout:0/692: creat d5/da4/ddc/fee x:0 0 0 2024-08-19T00:56:31.812 INFO:tasks.workunit.client.0.smithi017.stdout:0/693: rename d5/d17/d26/d30/d5d/lbd to d5/d17/d26/d30/d5d/dce/lef 0 2024-08-19T00:56:31.818 INFO:tasks.workunit.client.0.smithi017.stdout:0/694: write d5/d17/d26/fc4 [702591,90356] 0 2024-08-19T00:56:31.821 INFO:tasks.workunit.client.0.smithi017.stdout:0/695: creat d5/d17/d26/d30/d3e/d81/ff0 x:0 0 0 2024-08-19T00:56:31.825 INFO:tasks.workunit.client.0.smithi017.stdout:0/696: getdents d5/d17 0 2024-08-19T00:56:31.827 INFO:tasks.workunit.client.0.smithi017.stdout:0/697: creat d5/d17/d21/d42/d9b/dd8/ff1 x:0 0 0 2024-08-19T00:56:31.829 INFO:tasks.workunit.client.0.smithi017.stdout:0/698: dread - d5/d17/d26/d30/d3e/d81/fab zero size 2024-08-19T00:56:31.830 INFO:tasks.workunit.client.0.smithi017.stdout:0/699: fdatasync d5/d17/d26/d30/d3e/d81/dca/fe7 0 2024-08-19T00:56:31.840 INFO:tasks.workunit.client.0.smithi017.stdout:0/700: truncate d5/d17/d45/f8f 3253170 0 2024-08-19T00:56:31.840 INFO:tasks.workunit.client.0.smithi017.stdout:0/701: chown d5/d17/d21/ccf 324151241 1 2024-08-19T00:56:31.842 INFO:tasks.workunit.client.0.smithi017.stdout:0/702: fdatasync d5/d17/d26/d30/f63 0 2024-08-19T00:56:31.850 INFO:tasks.workunit.client.0.smithi017.stdout:0/703: write d5/d17/f69 [924835,120006] 0 2024-08-19T00:56:31.851 INFO:tasks.workunit.client.0.smithi017.stdout:0/704: readlink d5/d17/d26/d30/d3e/l8a 0 2024-08-19T00:56:31.856 INFO:tasks.workunit.client.0.smithi017.stdout:0/705: write d5/d18/f7b [649953,20443] 0 2024-08-19T00:56:31.856 INFO:tasks.workunit.client.0.smithi017.stdout:0/706: chown d5/d17/d21/d42/d9b 247355651 1 2024-08-19T00:56:31.866 INFO:tasks.workunit.client.0.smithi017.stdout:0/707: dread d5/d17/f1a [0,4194304] 0 2024-08-19T00:56:31.877 INFO:tasks.workunit.client.0.smithi017.stdout:0/708: dwrite d5/d17/d45/d77/fa2 [0,4194304] 0 2024-08-19T00:56:31.882 INFO:tasks.workunit.client.0.smithi017.stdout:1/803: sync 2024-08-19T00:56:31.882 INFO:tasks.workunit.client.0.smithi017.stdout:4/805: sync 2024-08-19T00:56:31.882 INFO:tasks.workunit.client.0.smithi017.stdout:7/893: sync 2024-08-19T00:56:31.883 INFO:tasks.workunit.client.0.smithi017.stdout:0/709: rename d5/d17/d21/d42/c4f to d5/d18/d3a/dc1/dd5/cf2 0 2024-08-19T00:56:31.884 INFO:tasks.workunit.client.0.smithi017.stdout:1/804: stat d4/dc/d17/d1d/f1e 0 2024-08-19T00:56:31.886 INFO:tasks.workunit.client.0.smithi017.stdout:0/710: symlink d5/d17/d21/d42/d9b/lf3 0 2024-08-19T00:56:31.889 INFO:tasks.workunit.client.0.smithi017.stdout:1/805: mkdir d4/dc/d17/dd6/d75/d9c/ddb/da6/d100 0 2024-08-19T00:56:31.890 INFO:tasks.workunit.client.0.smithi017.stdout:0/711: write d5/d17/d26/d30/f58 [2383088,102394] 0 2024-08-19T00:56:31.893 INFO:tasks.workunit.client.0.smithi017.stdout:7/894: creat d3/dc/f125 x:0 0 0 2024-08-19T00:56:31.893 INFO:tasks.workunit.client.0.smithi017.stdout:0/712: truncate d5/d17/d21/d42/d9b/fdd 320696 0 2024-08-19T00:56:31.897 INFO:tasks.workunit.client.0.smithi017.stdout:4/806: write d2/d87/db2/de6/d40/d56/d99/da3/fba [1027276,82177] 0 2024-08-19T00:56:31.897 INFO:tasks.workunit.client.0.smithi017.stdout:7/895: read d3/dc/df/dd1/dd7/ddb/f10f [2553077,81378] 0 2024-08-19T00:56:31.897 INFO:tasks.workunit.client.0.smithi017.stdout:1/806: dwrite d4/dc/d3b/d45/f4d [0,4194304] 0 2024-08-19T00:56:31.899 INFO:tasks.workunit.client.0.smithi017.stdout:0/713: rename d5/d18/d78/dbc/dc0 to d5/d17/d2b/df4 0 2024-08-19T00:56:31.900 INFO:tasks.workunit.client.0.smithi017.stdout:4/807: chown d2/d87/db2/de6/d40/d56/d95/dae 12167 1 2024-08-19T00:56:31.905 INFO:tasks.workunit.client.0.smithi017.stdout:0/714: dread d5/d18/f7b [0,4194304] 0 2024-08-19T00:56:31.910 INFO:tasks.workunit.client.0.smithi017.stdout:7/896: rename d3/dc/df/d37/d46/f9d to d3/dc/df/f126 0 2024-08-19T00:56:31.910 INFO:tasks.workunit.client.0.smithi017.stdout:4/808: write d2/d16/d70/f80 [2202024,26773] 0 2024-08-19T00:56:31.911 INFO:tasks.workunit.client.0.smithi017.stdout:7/897: write d3/dc/df/d1a/fc1 [1662763,130936] 0 2024-08-19T00:56:31.916 INFO:tasks.workunit.client.0.smithi017.stdout:1/807: link d4/dc/d17/dad/dea/c93 d4/dc/d17/c101 0 2024-08-19T00:56:31.917 INFO:tasks.workunit.client.0.smithi017.stdout:7/898: rename d3/dc/df/lbf to d3/dc/df/d1a/dc7/l127 0 2024-08-19T00:56:31.919 INFO:tasks.workunit.client.0.smithi017.stdout:4/809: mkdir d2/d16/d114 0 2024-08-19T00:56:31.923 INFO:tasks.workunit.client.0.smithi017.stdout:7/899: dwrite d3/f12 [0,4194304] 0 2024-08-19T00:56:31.924 INFO:tasks.workunit.client.0.smithi017.stdout:0/715: getdents d5/da4 0 2024-08-19T00:56:31.930 INFO:tasks.workunit.client.0.smithi017.stdout:0/716: mkdir d5/d17/d2b/df4/df5 0 2024-08-19T00:56:31.931 INFO:tasks.workunit.client.0.smithi017.stdout:1/808: write d4/dc/d3b/f80 [1417526,104574] 0 2024-08-19T00:56:31.933 INFO:tasks.workunit.client.0.smithi017.stdout:0/717: symlink d5/d17/d26/d30/d5d/lf6 0 2024-08-19T00:56:31.933 INFO:tasks.workunit.client.0.smithi017.stdout:0/718: readlink d5/d17/d26/lae 0 2024-08-19T00:56:31.935 INFO:tasks.workunit.client.0.smithi017.stdout:0/719: stat d5/d17/d26/d30/d5d/dce/ldb 0 2024-08-19T00:56:31.936 INFO:tasks.workunit.client.0.smithi017.stdout:4/810: getdents d2/d87/db2/de6/d40/d84 0 2024-08-19T00:56:31.936 INFO:tasks.workunit.client.0.smithi017.stdout:0/720: dread - d5/d17/d26/d30/d3e/d81/ff0 zero size 2024-08-19T00:56:31.936 INFO:tasks.workunit.client.0.smithi017.stdout:1/809: fdatasync d4/dc/d17/d1d/f1e 0 2024-08-19T00:56:31.938 INFO:tasks.workunit.client.0.smithi017.stdout:1/810: chown d4/fd 381475073 1 2024-08-19T00:56:31.938 INFO:tasks.workunit.client.0.smithi017.stdout:4/811: dread - d2/d1a/da1/fe5 zero size 2024-08-19T00:56:31.939 INFO:tasks.workunit.client.0.smithi017.stdout:0/721: truncate d5/d18/d78/dbc/fd1 577982 0 2024-08-19T00:56:31.939 INFO:tasks.workunit.client.0.smithi017.stdout:1/811: chown d4/dc/d17/l72 0 1 2024-08-19T00:56:31.943 INFO:tasks.workunit.client.0.smithi017.stdout:4/812: mkdir d2/d87/db2/de6/d53/d115 0 2024-08-19T00:56:31.945 INFO:tasks.workunit.client.0.smithi017.stdout:4/813: rmdir d2/d87/db2/de6/d53 39 2024-08-19T00:56:31.946 INFO:tasks.workunit.client.0.smithi017.stdout:0/722: getdents d5/d17/d21/d39 0 2024-08-19T00:56:31.947 INFO:tasks.workunit.client.0.smithi017.stdout:4/814: rmdir d2 39 2024-08-19T00:56:31.949 INFO:tasks.workunit.client.0.smithi017.stdout:0/723: rmdir d5/d17/d26/d30/d3e/d5a 39 2024-08-19T00:56:31.949 INFO:tasks.workunit.client.0.smithi017.stdout:1/812: dwrite d4/dc/d3b/f50 [4194304,4194304] 0 2024-08-19T00:56:31.951 INFO:tasks.workunit.client.0.smithi017.stdout:0/724: write d5/d17/d26/fe0 [1051343,123360] 0 2024-08-19T00:56:31.951 INFO:tasks.workunit.client.0.smithi017.stdout:4/815: truncate d2/d1a/dd0/fa9 194380 0 2024-08-19T00:56:31.952 INFO:tasks.workunit.client.0.smithi017.stdout:1/813: readlink d4/dc/d17/dd6/l63 0 2024-08-19T00:56:31.953 INFO:tasks.workunit.client.0.smithi017.stdout:0/725: write d5/d18/d3a/fe3 [5711790,36665] 0 2024-08-19T00:56:31.955 INFO:tasks.workunit.client.0.smithi017.stdout:4/816: mkdir d2/d87/db2/d116 0 2024-08-19T00:56:31.956 INFO:tasks.workunit.client.0.smithi017.stdout:0/726: dread - d5/d17/d21/d42/d9b/fc8 zero size 2024-08-19T00:56:31.958 INFO:tasks.workunit.client.0.smithi017.stdout:4/817: mkdir d2/d87/db2/d116/d117 0 2024-08-19T00:56:31.961 INFO:tasks.workunit.client.0.smithi017.stdout:1/814: write d4/f10 [1671951,12924] 0 2024-08-19T00:56:31.963 INFO:tasks.workunit.client.0.smithi017.stdout:1/815: write d4/dc/d17/d1d/f1e [371988,56044] 0 2024-08-19T00:56:31.964 INFO:tasks.workunit.client.0.smithi017.stdout:4/818: creat d2/f118 x:0 0 0 2024-08-19T00:56:31.967 INFO:tasks.workunit.client.0.smithi017.stdout:1/816: rmdir d4/dc/d17/dad/dea/db1 39 2024-08-19T00:56:31.973 INFO:tasks.workunit.client.0.smithi017.stdout:0/727: dread d5/d17/d21/f2d [0,4194304] 0 2024-08-19T00:56:31.983 INFO:tasks.workunit.client.0.smithi017.stdout:4/819: dwrite d2/d16/d70/fb0 [0,4194304] 0 2024-08-19T00:56:31.983 INFO:tasks.workunit.client.0.smithi017.stdout:0/728: write d5/d17/d45/d50/f96 [327549,2006] 0 2024-08-19T00:56:31.986 INFO:tasks.workunit.client.0.smithi017.stdout:1/817: dwrite d4/dc/f71 [0,4194304] 0 2024-08-19T00:56:31.988 INFO:tasks.workunit.client.0.smithi017.stdout:0/729: fdatasync d5/d18/f56 0 2024-08-19T00:56:31.991 INFO:tasks.workunit.client.0.smithi017.stdout:0/730: dread d5/d17/d21/d42/d9b/fdd [0,4194304] 0 2024-08-19T00:56:31.991 INFO:tasks.workunit.client.0.smithi017.stdout:1/818: chown d4/dc/d3b/d45/f8d 10574782 1 2024-08-19T00:56:31.995 INFO:tasks.workunit.client.0.smithi017.stdout:4/820: link d2/d16/f5b d2/d87/dbc/f119 0 2024-08-19T00:56:31.999 INFO:tasks.workunit.client.0.smithi017.stdout:0/731: rmdir d5/d17/d45/d77 39 2024-08-19T00:56:32.004 INFO:tasks.workunit.client.0.smithi017.stdout:0/732: chown d5/f48 4 1 2024-08-19T00:56:32.005 INFO:tasks.workunit.client.0.smithi017.stdout:1/819: rmdir d4/dc/d3b/de6/def 0 2024-08-19T00:56:32.005 INFO:tasks.workunit.client.0.smithi017.stdout:1/820: fsync d4/ff4 0 2024-08-19T00:56:32.007 INFO:tasks.workunit.client.0.smithi017.stdout:1/821: stat d4/dc/d17/dd6/lab 0 2024-08-19T00:56:32.007 INFO:tasks.workunit.client.0.smithi017.stdout:4/821: fsync d2/d16/f5b 0 2024-08-19T00:56:32.008 INFO:tasks.workunit.client.0.smithi017.stdout:1/822: chown d4/dc/d17/dd6/d1f/lbb 172982541 1 2024-08-19T00:56:32.008 INFO:tasks.workunit.client.0.smithi017.stdout:4/822: read - d2/d1a/da1/fe5 zero size 2024-08-19T00:56:32.012 INFO:tasks.workunit.client.0.smithi017.stdout:4/823: write d2/d11/f72 [630716,63329] 0 2024-08-19T00:56:32.012 INFO:tasks.workunit.client.0.smithi017.stdout:1/823: symlink d4/dc/d3b/l102 0 2024-08-19T00:56:32.014 INFO:tasks.workunit.client.0.smithi017.stdout:1/824: dread - d4/dc/d17/ffd zero size 2024-08-19T00:56:32.017 INFO:tasks.workunit.client.0.smithi017.stdout:0/733: dwrite d5/d18/d3a/fb9 [0,4194304] 0 2024-08-19T00:56:32.018 INFO:tasks.workunit.client.0.smithi017.stdout:1/825: mkdir d4/dc/d3b/d3d/d83/d95/d103 0 2024-08-19T00:56:32.020 INFO:tasks.workunit.client.0.smithi017.stdout:4/824: symlink d2/d87/db2/de6/d40/d56/d95/l11a 0 2024-08-19T00:56:32.020 INFO:tasks.workunit.client.0.smithi017.stdout:4/825: stat d2/d1a/f1c 0 2024-08-19T00:56:32.023 INFO:tasks.workunit.client.0.smithi017.stdout:1/826: creat d4/dc/d17/dd6/d1f/da5/f104 x:0 0 0 2024-08-19T00:56:32.025 INFO:tasks.workunit.client.0.smithi017.stdout:1/827: rmdir d4/dc/d17/dd6/d1f 39 2024-08-19T00:56:32.031 INFO:tasks.workunit.client.0.smithi017.stdout:1/828: truncate d4/dc/d3b/d3d/f86 908896 0 2024-08-19T00:56:32.031 INFO:tasks.workunit.client.0.smithi017.stdout:0/734: dread d5/d17/d26/d30/d3e/d81/f8e [0,4194304] 0 2024-08-19T00:56:32.035 INFO:tasks.workunit.client.0.smithi017.stdout:0/735: unlink d5/d17/d26/d30/d3e/d81/fab 0 2024-08-19T00:56:32.037 INFO:tasks.workunit.client.0.smithi017.stdout:0/736: creat d5/d17/d21/d39/db6/ff7 x:0 0 0 2024-08-19T00:56:32.037 INFO:tasks.workunit.client.0.smithi017.stdout:1/829: dread d4/fc7 [0,4194304] 0 2024-08-19T00:56:32.039 INFO:tasks.workunit.client.0.smithi017.stdout:0/737: dread d5/d17/d26/f80 [0,4194304] 0 2024-08-19T00:56:32.039 INFO:tasks.workunit.client.0.smithi017.stdout:1/830: creat d4/dc/d19/f105 x:0 0 0 2024-08-19T00:56:32.043 INFO:tasks.workunit.client.0.smithi017.stdout:0/738: mknod d5/d17/d26/d30/d3e/cf8 0 2024-08-19T00:56:32.046 INFO:tasks.workunit.client.0.smithi017.stdout:1/831: dwrite d4/dc/d17/d1d/f3c [0,4194304] 0 2024-08-19T00:56:32.049 INFO:tasks.workunit.client.0.smithi017.stdout:0/739: mkdir d5/d17/d21/d42/d9b/dd8/df9 0 2024-08-19T00:56:32.051 INFO:tasks.workunit.client.0.smithi017.stdout:4/826: dread d2/d1a/d55/d73/fb1 [0,4194304] 0 2024-08-19T00:56:32.054 INFO:tasks.workunit.client.0.smithi017.stdout:1/832: write d4/dc/d3b/d3d/f7d [1387304,59234] 0 2024-08-19T00:56:32.055 INFO:tasks.workunit.client.0.smithi017.stdout:1/833: readlink d4/dc/d3b/d3d/d83/d95/le5 0 2024-08-19T00:56:32.057 INFO:tasks.workunit.client.0.smithi017.stdout:0/740: creat d5/d17/d2b/df4/ffa x:0 0 0 2024-08-19T00:56:32.059 INFO:tasks.workunit.client.0.smithi017.stdout:4/827: unlink d2/d16/d70/feb 0 2024-08-19T00:56:32.060 INFO:tasks.workunit.client.0.smithi017.stdout:9/814: sync 2024-08-19T00:56:32.060 INFO:tasks.workunit.client.0.smithi017.stdout:8/816: sync 2024-08-19T00:56:32.060 INFO:tasks.workunit.client.0.smithi017.stdout:3/841: sync 2024-08-19T00:56:32.060 INFO:tasks.workunit.client.0.smithi017.stdout:2/844: sync 2024-08-19T00:56:32.060 INFO:tasks.workunit.client.0.smithi017.stdout:6/892: sync 2024-08-19T00:56:32.060 INFO:tasks.workunit.client.0.smithi017.stdout:5/624: sync 2024-08-19T00:56:32.062 INFO:tasks.workunit.client.0.smithi017.stdout:0/741: mknod d5/d17/d26/d30/d3e/d81/dca/cfb 0 2024-08-19T00:56:32.063 INFO:tasks.workunit.client.0.smithi017.stdout:1/834: read - d4/dc/d17/dd6/d75/d9c/ddb/da6/db8/fce zero size 2024-08-19T00:56:32.064 INFO:tasks.workunit.client.0.smithi017.stdout:4/828: stat d2/d1a/dd0/fc4 0 2024-08-19T00:56:32.068 INFO:tasks.workunit.client.0.smithi017.stdout:3/842: unlink d5/da/d27/d6e/dd0/de0/le3 0 2024-08-19T00:56:32.069 INFO:tasks.workunit.client.0.smithi017.stdout:6/893: truncate d5/d13/f22 1769932 0 2024-08-19T00:56:32.072 INFO:tasks.workunit.client.0.smithi017.stdout:2/845: mknod d2/d7/c10a 0 2024-08-19T00:56:32.076 INFO:tasks.workunit.client.0.smithi017.stdout:8/817: mknod de/d15/d39/d3d/dc2/dd6/ded/df0/cfd 0 2024-08-19T00:56:32.079 INFO:tasks.workunit.client.0.smithi017.stdout:1/835: truncate d4/dd1/ff9 483004 0 2024-08-19T00:56:32.087 INFO:tasks.workunit.client.0.smithi017.stdout:8/818: dwrite de/fe5 [0,4194304] 0 2024-08-19T00:56:32.089 INFO:tasks.workunit.client.0.smithi017.stdout:8/819: fsync de/d8d/fb6 0 2024-08-19T00:56:32.090 INFO:tasks.workunit.client.0.smithi017.stdout:0/742: dwrite d5/d17/d21/d42/d9b/fc8 [0,4194304] 0 2024-08-19T00:56:32.094 INFO:tasks.workunit.client.0.smithi017.stdout:5/625: getdents db/d19/d1f/d15 0 2024-08-19T00:56:32.095 INFO:tasks.workunit.client.0.smithi017.stdout:1/836: truncate d4/dc/d3b/d3d/d83/d95/dca/fcd 331901 0 2024-08-19T00:56:32.095 INFO:tasks.workunit.client.0.smithi017.stdout:2/846: dread d2/d7/d10/d19/f7b [0,4194304] 0 2024-08-19T00:56:32.100 INFO:tasks.workunit.client.0.smithi017.stdout:0/743: chown d5/d18/d3a/l40 122465068 1 2024-08-19T00:56:32.100 INFO:tasks.workunit.client.0.smithi017.stdout:4/829: dread d2/d1a/f68 [0,4194304] 0 2024-08-19T00:56:32.101 INFO:tasks.workunit.client.0.smithi017.stdout:5/626: symlink db/d19/d1f/d15/d1e/d5f/lda 0 2024-08-19T00:56:32.105 INFO:tasks.workunit.client.0.smithi017.stdout:4/830: chown d2/d11/dd6/f109 12445603 1 2024-08-19T00:56:32.105 INFO:tasks.workunit.client.0.smithi017.stdout:6/894: dwrite d5/d13/d11/d52/f94 [0,4194304] 0 2024-08-19T00:56:32.108 INFO:tasks.workunit.client.0.smithi017.stdout:8/820: dwrite de/fe5 [0,4194304] 0 2024-08-19T00:56:32.108 INFO:tasks.workunit.client.0.smithi017.stdout:4/831: dread - d2/d1a/d55/d73/ff9 zero size 2024-08-19T00:56:32.114 INFO:tasks.workunit.client.0.smithi017.stdout:1/837: creat d4/dc/d17/dd6/d1f/da5/f106 x:0 0 0 2024-08-19T00:56:32.115 INFO:tasks.workunit.client.0.smithi017.stdout:4/832: symlink d2/d11/l11b 0 2024-08-19T00:56:32.117 INFO:tasks.workunit.client.0.smithi017.stdout:8/821: symlink de/d15/d62/d75/lfe 0 2024-08-19T00:56:32.117 INFO:tasks.workunit.client.0.smithi017.stdout:0/744: mkdir d5/d17/d26/d30/d3e/d5a/dcd/dfc 0 2024-08-19T00:56:32.118 INFO:tasks.workunit.client.0.smithi017.stdout:0/745: chown d5/d17/d45 5468 1 2024-08-19T00:56:32.120 INFO:tasks.workunit.client.0.smithi017.stdout:6/895: mknod d5/d13/d11/d2c/d51/c130 0 2024-08-19T00:56:32.126 INFO:tasks.workunit.client.0.smithi017.stdout:2/847: getdents d2/d7/d10 0 2024-08-19T00:56:32.127 INFO:tasks.workunit.client.0.smithi017.stdout:5/627: dwrite db/d19/d1f/d15/f52 [0,4194304] 0 2024-08-19T00:56:32.129 INFO:tasks.workunit.client.0.smithi017.stdout:2/848: chown d2/d7/d10/d19/f7b 288023 1 2024-08-19T00:56:32.130 INFO:tasks.workunit.client.0.smithi017.stdout:4/833: mknod d2/d87/db2/de6/d53/d5a/c11c 0 2024-08-19T00:56:32.130 INFO:tasks.workunit.client.0.smithi017.stdout:1/838: read d4/dc/d17/dd6/f70 [414237,54299] 0 2024-08-19T00:56:32.132 INFO:tasks.workunit.client.0.smithi017.stdout:0/746: creat d5/dba/ffd x:0 0 0 2024-08-19T00:56:32.135 INFO:tasks.workunit.client.0.smithi017.stdout:1/839: write d4/dc/d17/dd6/d1f/da5/f106 [311202,74230] 0 2024-08-19T00:56:32.138 INFO:tasks.workunit.client.0.smithi017.stdout:8/822: dread de/d15/d39/f41 [0,4194304] 0 2024-08-19T00:56:32.140 INFO:tasks.workunit.client.0.smithi017.stdout:2/849: dwrite d2/fc8 [0,4194304] 0 2024-08-19T00:56:32.141 INFO:tasks.workunit.client.0.smithi017.stdout:4/834: fsync d2/d1a/dd0/fc5 0 2024-08-19T00:56:32.142 INFO:tasks.workunit.client.0.smithi017.stdout:0/747: dread d5/d17/f1a [0,4194304] 0 2024-08-19T00:56:32.144 INFO:tasks.workunit.client.0.smithi017.stdout:1/840: chown d4/dc/d17/c8e 10463 1 2024-08-19T00:56:32.144 INFO:tasks.workunit.client.0.smithi017.stdout:8/823: creat de/d36/d74/fff x:0 0 0 2024-08-19T00:56:32.145 INFO:tasks.workunit.client.0.smithi017.stdout:8/824: fsync de/d15/d79/f91 0 2024-08-19T00:56:32.146 INFO:tasks.workunit.client.0.smithi017.stdout:4/835: mknod d2/d87/c11d 0 2024-08-19T00:56:32.150 INFO:tasks.workunit.client.0.smithi017.stdout:0/748: unlink d5/d17/d45/fb3 0 2024-08-19T00:56:32.151 INFO:tasks.workunit.client.0.smithi017.stdout:5/628: dwrite db/d19/d1f/d15/d3e/d40/f77 [0,4194304] 0 2024-08-19T00:56:32.153 INFO:tasks.workunit.client.0.smithi017.stdout:5/629: chown db/d19/d1f/d15/d30/f5e 1200 1 2024-08-19T00:56:32.154 INFO:tasks.workunit.client.0.smithi017.stdout:5/630: stat db/d19/d1f/lc7 0 2024-08-19T00:56:32.156 INFO:tasks.workunit.client.0.smithi017.stdout:2/850: symlink d2/d7/d10/d35/l10b 0 2024-08-19T00:56:32.160 INFO:tasks.workunit.client.0.smithi017.stdout:8/825: rmdir de/d36 39 2024-08-19T00:56:32.163 INFO:tasks.workunit.client.0.smithi017.stdout:5/631: creat db/d19/d1f/d15/d3e/d40/d49/d63/d80/fdb x:0 0 0 2024-08-19T00:56:32.164 INFO:tasks.workunit.client.0.smithi017.stdout:4/836: symlink d2/d87/db2/de6/d53/l11e 0 2024-08-19T00:56:32.164 INFO:tasks.workunit.client.0.smithi017.stdout:4/837: readlink d2/l7c 0 2024-08-19T00:56:32.166 INFO:tasks.workunit.client.0.smithi017.stdout:2/851: rmdir d2/d7/d10/d35/d45/d58 39 2024-08-19T00:56:32.167 INFO:tasks.workunit.client.0.smithi017.stdout:2/852: fsync d2/d7/d10/d3b/d97/fe9 0 2024-08-19T00:56:32.167 INFO:tasks.workunit.client.0.smithi017.stdout:0/749: write d5/f11 [3112183,10567] 0 2024-08-19T00:56:32.169 INFO:tasks.workunit.client.0.smithi017.stdout:8/826: creat de/d15/d62/d75/dd7/f100 x:0 0 0 2024-08-19T00:56:32.169 INFO:tasks.workunit.client.0.smithi017.stdout:0/750: stat d5/d17/d26/d30/d5d/db0/fa6 0 2024-08-19T00:56:32.171 INFO:tasks.workunit.client.0.smithi017.stdout:8/827: write de/d15/d39/dc7/fe7 [107010,116460] 0 2024-08-19T00:56:32.171 INFO:tasks.workunit.client.0.smithi017.stdout:0/751: chown d5/d17/f22 27 1 2024-08-19T00:56:32.171 INFO:tasks.workunit.client.0.smithi017.stdout:1/841: link d4/dc/c15 d4/dc/d17/dd6/d75/d9c/c107 0 2024-08-19T00:56:32.172 INFO:tasks.workunit.client.0.smithi017.stdout:8/828: write de/d15/d39/fbb [670142,60624] 0 2024-08-19T00:56:32.174 INFO:tasks.workunit.client.0.smithi017.stdout:8/829: write de/d15/f35 [1398945,35780] 0 2024-08-19T00:56:32.175 INFO:tasks.workunit.client.0.smithi017.stdout:4/838: mkdir d2/d87/db2/de6/d40/d56/d95/d11f 0 2024-08-19T00:56:32.177 INFO:tasks.workunit.client.0.smithi017.stdout:2/853: symlink d2/d7/d10/d9f/df9/dfd/l10c 0 2024-08-19T00:56:32.178 INFO:tasks.workunit.client.0.smithi017.stdout:0/752: mknod d5/d18/d78/cfe 0 2024-08-19T00:56:32.184 INFO:tasks.workunit.client.0.smithi017.stdout:4/839: mknod d2/d1a/d20/c120 0 2024-08-19T00:56:32.186 INFO:tasks.workunit.client.0.smithi017.stdout:5/632: truncate fa 1621071 0 2024-08-19T00:56:32.188 INFO:tasks.workunit.client.0.smithi017.stdout:0/753: truncate d5/d18/f4a 872198 0 2024-08-19T00:56:32.192 INFO:tasks.workunit.client.0.smithi017.stdout:8/830: link de/d8d/faf de/d15/d4f/d68/d84/dc8/f101 0 2024-08-19T00:56:32.194 INFO:tasks.workunit.client.0.smithi017.stdout:4/840: rename d2/d1a/dd0/dd4 to d2/d1a/d55/d73/d121 0 2024-08-19T00:56:32.197 INFO:tasks.workunit.client.0.smithi017.stdout:5/633: mkdir db/d19/d1f/d15/d3e/d40/d49/d63/d80/ddc 0 2024-08-19T00:56:32.199 INFO:tasks.workunit.client.0.smithi017.stdout:2/854: dwrite d2/d7/d10/d3b/d3c/d8a/fbe [0,4194304] 0 2024-08-19T00:56:32.203 INFO:tasks.workunit.client.0.smithi017.stdout:1/842: creat d4/dc/d3b/d3d/f108 x:0 0 0 2024-08-19T00:56:32.207 INFO:tasks.workunit.client.0.smithi017.stdout:8/831: fdatasync de/d15/d4f/d68/d84/dc8/f101 0 2024-08-19T00:56:32.208 INFO:tasks.workunit.client.0.smithi017.stdout:4/841: creat d2/d87/db2/db5/f122 x:0 0 0 2024-08-19T00:56:32.210 INFO:tasks.workunit.client.0.smithi017.stdout:1/843: dwrite d4/dc/d3b/fd2 [0,4194304] 0 2024-08-19T00:56:32.210 INFO:tasks.workunit.client.0.smithi017.stdout:5/634: symlink db/d19/d1f/d15/d1e/d5f/ldd 0 2024-08-19T00:56:32.218 INFO:tasks.workunit.client.0.smithi017.stdout:8/832: symlink de/d15/d39/d3d/dc2/dd8/l102 0 2024-08-19T00:56:32.222 INFO:tasks.workunit.client.0.smithi017.stdout:0/754: dwrite d5/d17/d2b/f74 [0,4194304] 0 2024-08-19T00:56:32.224 INFO:tasks.workunit.client.0.smithi017.stdout:8/833: write de/d15/d4f/d68/db5/fc0 [419147,24560] 0 2024-08-19T00:56:32.227 INFO:tasks.workunit.client.0.smithi017.stdout:5/635: rmdir db/d19/d1f/d15 39 2024-08-19T00:56:32.230 INFO:tasks.workunit.client.0.smithi017.stdout:2/855: rename d2/d7/d10/d19/d48 to d2/d7/d10/d3b/d3c/df5/d10d 0 2024-08-19T00:56:32.232 INFO:tasks.workunit.client.0.smithi017.stdout:2/856: write d2/d7/d44/fef [596196,15174] 0 2024-08-19T00:56:32.232 INFO:tasks.workunit.client.0.smithi017.stdout:1/844: truncate d4/dc/d3b/d45/f8d 1915067 0 2024-08-19T00:56:32.235 INFO:tasks.workunit.client.0.smithi017.stdout:0/755: mkdir d5/d17/d26/d30/d3e/d5a/dcd/dff 0 2024-08-19T00:56:32.239 INFO:tasks.workunit.client.0.smithi017.stdout:4/842: write d2/d1a/d55/f89 [130531,16594] 0 2024-08-19T00:56:32.242 INFO:tasks.workunit.client.0.smithi017.stdout:1/845: rename d4/dc/d17/dd6/d1f/da5/fcf to d4/dc/d17/dd6/d75/f109 0 2024-08-19T00:56:32.243 INFO:tasks.workunit.client.0.smithi017.stdout:1/846: dread - d4/dc/d17/dd6/d75/d9c/ddb/ff1 zero size 2024-08-19T00:56:32.244 INFO:tasks.workunit.client.0.smithi017.stdout:1/847: readlink d4/dc/d3b/d45/dc0/lf2 0 2024-08-19T00:56:32.246 INFO:tasks.workunit.client.0.smithi017.stdout:8/834: unlink de/d15/d4f/d68/ffc 0 2024-08-19T00:56:32.249 INFO:tasks.workunit.client.0.smithi017.stdout:4/843: readlink d2/d87/db2/de6/d40/l5c 0 2024-08-19T00:56:32.250 INFO:tasks.workunit.client.0.smithi017.stdout:2/857: unlink d2/d7/dd/le4 0 2024-08-19T00:56:32.252 INFO:tasks.workunit.client.0.smithi017.stdout:8/835: dwrite de/d15/f2b [0,4194304] 0 2024-08-19T00:56:32.257 INFO:tasks.workunit.client.0.smithi017.stdout:5/636: creat db/d19/d1f/d15/d3e/d40/d49/d63/d80/ddc/fde x:0 0 0 2024-08-19T00:56:32.261 INFO:tasks.workunit.client.0.smithi017.stdout:1/848: mknod d4/dc/c10a 0 2024-08-19T00:56:32.263 INFO:tasks.workunit.client.0.smithi017.stdout:5/637: symlink db/d19/d1f/d15/d3e/d40/d83/ldf 0 2024-08-19T00:56:32.264 INFO:tasks.workunit.client.0.smithi017.stdout:4/844: symlink d2/d16/l123 0 2024-08-19T00:56:32.265 INFO:tasks.workunit.client.0.smithi017.stdout:5/638: dread - db/d19/d1f/d15/d1e/fd5 zero size 2024-08-19T00:56:32.268 INFO:tasks.workunit.client.0.smithi017.stdout:2/858: creat d2/d7/d10/d35/d45/d58/f10e x:0 0 0 2024-08-19T00:56:32.271 INFO:tasks.workunit.client.0.smithi017.stdout:0/756: getdents d5/d17/d26/d30 0 2024-08-19T00:56:32.272 INFO:tasks.workunit.client.0.smithi017.stdout:1/849: dread d4/dc/d17/d1d/f1e [0,4194304] 0 2024-08-19T00:56:32.273 INFO:tasks.workunit.client.0.smithi017.stdout:2/859: readlink d2/l2b 0 2024-08-19T00:56:32.277 INFO:tasks.workunit.client.0.smithi017.stdout:5/639: rename db/d19/d1f/d15/d3e/d40/d49/d63/d80/d9d to db/d19/d1f/d15/d3e/d40/d49/de0 0 2024-08-19T00:56:32.278 INFO:tasks.workunit.client.0.smithi017.stdout:5/640: fdatasync db/d19/d1f/d15/d3e/d40/d49/de0/fc0 0 2024-08-19T00:56:32.280 INFO:tasks.workunit.client.0.smithi017.stdout:8/836: getdents de/d15/d4f/dcc 0 2024-08-19T00:56:32.283 INFO:tasks.workunit.client.0.smithi017.stdout:2/860: creat d2/d7/d10/d9f/df9/f10f x:0 0 0 2024-08-19T00:56:32.287 INFO:tasks.workunit.client.0.smithi017.stdout:0/757: dread d5/d17/d2b/f7a [0,4194304] 0 2024-08-19T00:56:32.287 INFO:tasks.workunit.client.0.smithi017.stdout:1/850: mkdir d4/d10b 0 2024-08-19T00:56:32.293 INFO:tasks.workunit.client.0.smithi017.stdout:0/758: creat d5/d17/d2b/df4/f100 x:0 0 0 2024-08-19T00:56:32.295 INFO:tasks.workunit.client.0.smithi017.stdout:8/837: rename de/d15/c17 to de/d15/d4f/c103 0 2024-08-19T00:56:32.297 INFO:tasks.workunit.client.0.smithi017.stdout:2/861: link d2/d7/dd/ld3 d2/dc5/dca/l110 0 2024-08-19T00:56:32.300 INFO:tasks.workunit.client.0.smithi017.stdout:8/838: mkdir de/d15/d39/d104 0 2024-08-19T00:56:32.301 INFO:tasks.workunit.client.0.smithi017.stdout:8/839: chown de/d15/d39 4068418 1 2024-08-19T00:56:32.303 INFO:tasks.workunit.client.0.smithi017.stdout:8/840: creat de/d15/d79/f105 x:0 0 0 2024-08-19T00:56:32.309 INFO:tasks.workunit.client.0.smithi017.stdout:8/841: dwrite de/d15/d39/d3d/fa6 [0,4194304] 0 2024-08-19T00:56:32.319 INFO:tasks.workunit.client.0.smithi017.stdout:5/641: write db/d19/d1f/d15/d1e/d5f/f6b [3155863,94231] 0 2024-08-19T00:56:32.323 INFO:tasks.workunit.client.0.smithi017.stdout:5/642: creat db/d19/daa/fe1 x:0 0 0 2024-08-19T00:56:32.326 INFO:tasks.workunit.client.0.smithi017.stdout:1/851: write d4/f60 [907562,37276] 0 2024-08-19T00:56:32.335 INFO:tasks.workunit.client.0.smithi017.stdout:1/852: creat d4/dc/d3b/f10c x:0 0 0 2024-08-19T00:56:32.340 INFO:tasks.workunit.client.0.smithi017.stdout:1/853: dread d4/dc/d17/dd6/d1f/da5/f106 [0,4194304] 0 2024-08-19T00:56:32.342 INFO:tasks.workunit.client.0.smithi017.stdout:2/862: write d2/d7/d44/fc9 [1360152,42389] 0 2024-08-19T00:56:32.343 INFO:tasks.workunit.client.0.smithi017.stdout:1/854: read d4/dc/d3b/d3d/d83/d95/dca/df3/ff7 [226374,95336] 0 2024-08-19T00:56:32.345 INFO:tasks.workunit.client.0.smithi017.stdout:2/863: write d2/d7/d44/fc9 [319528,109617] 0 2024-08-19T00:56:32.350 INFO:tasks.workunit.client.0.smithi017.stdout:1/855: symlink d4/dc/d3b/d3d/d83/d95/dca/df3/l10d 0 2024-08-19T00:56:32.354 INFO:tasks.workunit.client.0.smithi017.stdout:2/864: creat d2/d7/d10/d3b/d80/da2/f111 x:0 0 0 2024-08-19T00:56:32.355 INFO:tasks.workunit.client.0.smithi017.stdout:1/856: creat d4/dc/d19/f10e x:0 0 0 2024-08-19T00:56:32.359 INFO:tasks.workunit.client.0.smithi017.stdout:2/865: read d2/d7/d10/d3b/d3c/df5/d10d/f9c [688829,79684] 0 2024-08-19T00:56:32.362 INFO:tasks.workunit.client.0.smithi017.stdout:5/643: write db/d19/d1f/d15/d3e/d40/d49/d63/d7b/f9e [409571,102922] 0 2024-08-19T00:56:32.363 INFO:tasks.workunit.client.0.smithi017.stdout:1/857: dwrite d4/dc/d3b/f80 [0,4194304] 0 2024-08-19T00:56:32.370 INFO:tasks.workunit.client.0.smithi017.stdout:1/858: symlink d4/l10f 0 2024-08-19T00:56:32.370 INFO:tasks.workunit.client.0.smithi017.stdout:2/866: rmdir d2/d7/d10/de2 0 2024-08-19T00:56:32.372 INFO:tasks.workunit.client.0.smithi017.stdout:2/867: write d2/d7/fa5 [3645698,116886] 0 2024-08-19T00:56:32.391 INFO:tasks.workunit.client.0.smithi017.stdout:2/868: write d2/d7/d10/d35/d7e/fb1 [5199247,7704] 0 2024-08-19T00:56:32.391 INFO:tasks.workunit.client.0.smithi017.stdout:1/859: truncate d4/fd 1551266 0 2024-08-19T00:56:32.392 INFO:tasks.workunit.client.0.smithi017.stdout:1/860: chown d4/dc/d3b 458 1 2024-08-19T00:56:32.399 INFO:tasks.workunit.client.0.smithi017.stdout:2/869: unlink d2/d7/d10/d19/f20 0 2024-08-19T00:56:32.404 INFO:tasks.workunit.client.0.smithi017.stdout:1/861: dwrite d4/f14 [4194304,4194304] 0 2024-08-19T00:56:32.406 INFO:tasks.workunit.client.0.smithi017.stdout:2/870: rename d2/d7/d10/d35/d45/d58/dbf/c98 to d2/d7/d10/d19/dc7/c112 0 2024-08-19T00:56:32.418 INFO:tasks.workunit.client.0.smithi017.stdout:2/871: creat d2/d7/d10/d3b/d3c/f113 x:0 0 0 2024-08-19T00:56:32.422 INFO:tasks.workunit.client.0.smithi017.stdout:2/872: mknod d2/d7/d10/d35/d45/c114 0 2024-08-19T00:56:32.425 INFO:tasks.workunit.client.0.smithi017.stdout:1/862: dwrite d4/fd [0,4194304] 0 2024-08-19T00:56:32.426 INFO:tasks.workunit.client.0.smithi017.stdout:2/873: creat d2/d7/d10/d3b/d97/df2/df4/f115 x:0 0 0 2024-08-19T00:56:32.430 INFO:tasks.workunit.client.0.smithi017.stdout:1/863: rmdir d4/dc/d3b 39 2024-08-19T00:56:32.433 INFO:tasks.workunit.client.0.smithi017.stdout:2/874: mkdir d2/d7/d10/d3b/d97/df2/df4/d116 0 2024-08-19T00:56:32.435 INFO:tasks.workunit.client.0.smithi017.stdout:2/875: mkdir d2/d7/d10/d19/d117 0 2024-08-19T00:56:32.438 INFO:tasks.workunit.client.0.smithi017.stdout:2/876: chown d2/d7/d10/d35/d45/d58/la4 17881 1 2024-08-19T00:56:32.444 INFO:tasks.workunit.client.0.smithi017.stdout:2/877: dwrite d2/d7/d10/d35/d45/f4d [0,4194304] 0 2024-08-19T00:56:32.448 INFO:tasks.workunit.client.0.smithi017.stdout:2/878: mknod d2/d7/d10/d3b/d80/da2/c118 0 2024-08-19T00:56:32.450 INFO:tasks.workunit.client.0.smithi017.stdout:2/879: rmdir d2/d7/d10/d3b/d80 39 2024-08-19T00:56:32.452 INFO:tasks.workunit.client.0.smithi017.stdout:1/864: dread d4/dc/d3b/f4a [0,4194304] 0 2024-08-19T00:56:32.452 INFO:tasks.workunit.client.0.smithi017.stdout:2/880: dread - d2/d7/d10/d19/fde zero size 2024-08-19T00:56:32.454 INFO:tasks.workunit.client.0.smithi017.stdout:2/881: write d2/d7/d10/d35/d45/d58/dbf/f7f [4624488,88752] 0 2024-08-19T00:56:32.462 INFO:tasks.workunit.client.0.smithi017.stdout:7/900: sync 2024-08-19T00:56:32.464 INFO:tasks.workunit.client.0.smithi017.stdout:2/882: dread - d2/d7/d29/fcf zero size 2024-08-19T00:56:32.467 INFO:tasks.workunit.client.0.smithi017.stdout:7/901: dwrite d3/f51 [0,4194304] 0 2024-08-19T00:56:32.473 INFO:tasks.workunit.client.0.smithi017.stdout:1/865: dwrite d4/dc/f42 [0,4194304] 0 2024-08-19T00:56:32.474 INFO:tasks.workunit.client.0.smithi017.stdout:1/866: chown d4/dc/d17/d1d/l29 7 1 2024-08-19T00:56:32.479 INFO:tasks.workunit.client.0.smithi017.stdout:1/867: unlink d4/dc/d19/f10e 0 2024-08-19T00:56:32.481 INFO:tasks.workunit.client.0.smithi017.stdout:2/883: truncate d2/d7/d10/d3b/d3c/d8a/f107 277068 0 2024-08-19T00:56:32.482 INFO:tasks.workunit.client.0.smithi017.stdout:1/868: rmdir d4/dc/d3b/d3d/d83/d95/dca 39 2024-08-19T00:56:32.483 INFO:tasks.workunit.client.0.smithi017.stdout:1/869: chown d4/dc/d3b/c74 48811871 1 2024-08-19T00:56:32.484 INFO:tasks.workunit.client.0.smithi017.stdout:2/884: readlink d2/d7/d10/d9f/df9/dfd/l10c 0 2024-08-19T00:56:32.487 INFO:tasks.workunit.client.0.smithi017.stdout:1/870: chown d4/dc/d3b/d3d/d83/d95/dca/fcd 187104 1 2024-08-19T00:56:32.490 INFO:tasks.workunit.client.0.smithi017.stdout:2/885: getdents d2/d7/d10/d9f/df9/dfd 0 2024-08-19T00:56:32.507 INFO:tasks.workunit.client.0.smithi017.stdout:1/871: dread d4/dc/d17/dad/dea/fe7 [0,4194304] 0 2024-08-19T00:56:32.507 INFO:tasks.workunit.client.0.smithi017.stdout:2/886: dread d2/d7/d10/d35/d55/f6f [0,4194304] 0 2024-08-19T00:56:32.509 INFO:tasks.workunit.client.0.smithi017.stdout:1/872: creat d4/dc/d3b/d3d/d83/f110 x:0 0 0 2024-08-19T00:56:32.511 INFO:tasks.workunit.client.0.smithi017.stdout:1/873: unlink d4/dc/d17/d1d/c4b 0 2024-08-19T00:56:32.513 INFO:tasks.workunit.client.0.smithi017.stdout:2/887: rename d2/d7/d10/d3b/d3c/lbc to d2/d7/df7/l119 0 2024-08-19T00:56:32.514 INFO:tasks.workunit.client.0.smithi017.stdout:2/888: chown d2/d7/dd/fbd 20421343 1 2024-08-19T00:56:32.516 INFO:tasks.workunit.client.0.smithi017.stdout:2/889: creat d2/d7/dd/f11a x:0 0 0 2024-08-19T00:56:32.517 INFO:tasks.workunit.client.0.smithi017.stdout:2/890: write d2/d7/d10/d19/f1d [2417701,129407] 0 2024-08-19T00:56:32.523 INFO:tasks.workunit.client.0.smithi017.stdout:1/874: dread d4/dc/d3b/d45/fbc [0,4194304] 0 2024-08-19T00:56:32.525 INFO:tasks.workunit.client.0.smithi017.stdout:1/875: write d4/dc/f42 [1825988,63148] 0 2024-08-19T00:56:32.526 INFO:tasks.workunit.client.0.smithi017.stdout:1/876: readlink d4/dc/d17/dd6/lf5 0 2024-08-19T00:56:32.526 INFO:tasks.workunit.client.0.smithi017.stdout:1/877: chown d4/dc/d17/dd6/d1f/da5 1 1 2024-08-19T00:56:32.533 INFO:tasks.workunit.client.0.smithi017.stdout:1/878: mknod d4/dc/d17/dad/dea/db1/c111 0 2024-08-19T00:56:32.535 INFO:tasks.workunit.client.0.smithi017.stdout:2/891: write d2/d7/f6c [816866,67661] 0 2024-08-19T00:56:32.562 INFO:tasks.workunit.client.0.smithi017.stdout:2/892: fsync d2/d7/d10/d3b/d3c/fc3 0 2024-08-19T00:56:32.563 INFO:tasks.workunit.client.0.smithi017.stdout:1/879: link d4/dc/d3b/d3d/d83/cb3 d4/dc/d17/c112 0 2024-08-19T00:56:32.569 INFO:tasks.workunit.client.0.smithi017.stdout:2/893: creat d2/d7/d10/d3b/d3c/d8a/d6b/d101/f11b x:0 0 0 2024-08-19T00:56:32.572 INFO:tasks.workunit.client.0.smithi017.stdout:2/894: creat d2/d7/d10/d35/d84/f11c x:0 0 0 2024-08-19T00:56:32.574 INFO:tasks.workunit.client.0.smithi017.stdout:2/895: readlink d2/d7/d10/d35/l5e 0 2024-08-19T00:56:32.577 INFO:tasks.workunit.client.0.smithi017.stdout:2/896: symlink d2/d7/d10/d19/l11d 0 2024-08-19T00:56:32.578 INFO:tasks.workunit.client.0.smithi017.stdout:2/897: rmdir d2/dc5 39 2024-08-19T00:56:32.590 INFO:tasks.workunit.client.0.smithi017.stdout:2/898: creat d2/d7/d10/d3b/d80/f11e x:0 0 0 2024-08-19T00:56:32.594 INFO:tasks.workunit.client.0.smithi017.stdout:2/899: mknod d2/d7/d10/d3b/d80/da2/c11f 0 2024-08-19T00:56:32.596 INFO:tasks.workunit.client.0.smithi017.stdout:2/900: read d2/d7/d10/d3b/fb4 [803595,12483] 0 2024-08-19T00:56:32.645 INFO:tasks.workunit.client.0.smithi017.stdout:2/901: getdents d2/d7/d10/d35/d45/d58 0 2024-08-19T00:56:32.647 INFO:tasks.workunit.client.0.smithi017.stdout:2/902: chown d2/d7/d10/d35/lba 100812294 1 2024-08-19T00:56:32.647 INFO:tasks.workunit.client.0.smithi017.stdout:1/880: dwrite d4/dc/d17/dd6/f46 [4194304,4194304] 0 2024-08-19T00:56:32.648 INFO:tasks.workunit.client.0.smithi017.stdout:1/881: readlink d4/dc/d17/dd6/l63 0 2024-08-19T00:56:32.649 INFO:tasks.workunit.client.0.smithi017.stdout:1/882: chown d4/dc/d3b/d3d/l56 11588 1 2024-08-19T00:56:32.681 INFO:tasks.workunit.client.0.smithi017.stdout:1/883: creat d4/dc/d3b/d45/f113 x:0 0 0 2024-08-19T00:56:32.685 INFO:tasks.workunit.client.0.smithi017.stdout:1/884: dread d4/dc/d3b/f4a [0,4194304] 0 2024-08-19T00:56:32.687 INFO:tasks.workunit.client.0.smithi017.stdout:1/885: creat d4/dc/d3b/d9d/f114 x:0 0 0 2024-08-19T00:56:32.690 INFO:tasks.workunit.client.0.smithi017.stdout:1/886: creat d4/dc/d17/dd6/d75/d9c/ddb/da6/db8/f115 x:0 0 0 2024-08-19T00:56:32.706 INFO:tasks.workunit.client.0.smithi017.stdout:2/903: write d2/d7/d10/d3b/d3c/df5/d10d/f82 [1639901,108104] 0 2024-08-19T00:56:32.708 INFO:tasks.workunit.client.0.smithi017.stdout:1/887: dread d4/dc/d17/d1d/f5b [0,4194304] 0 2024-08-19T00:56:32.711 INFO:tasks.workunit.client.0.smithi017.stdout:2/904: creat d2/d7/d10/d35/d45/d58/dbf/d7a/f120 x:0 0 0 2024-08-19T00:56:32.712 INFO:tasks.workunit.client.0.smithi017.stdout:1/888: creat d4/dc/d17/d1d/f116 x:0 0 0 2024-08-19T00:56:32.715 INFO:tasks.workunit.client.0.smithi017.stdout:2/905: dread d2/fc8 [0,4194304] 0 2024-08-19T00:56:32.717 INFO:tasks.workunit.client.0.smithi017.stdout:1/889: truncate d4/dc/d3b/d3d/f87 926190 0 2024-08-19T00:56:32.720 INFO:tasks.workunit.client.0.smithi017.stdout:2/906: read d2/d7/f6a [1106347,61640] 0 2024-08-19T00:56:32.721 INFO:tasks.workunit.client.0.smithi017.stdout:2/907: readlink d2/d7/d10/d9f/df9/dfd/l10c 0 2024-08-19T00:56:32.722 INFO:tasks.workunit.client.0.smithi017.stdout:1/890: symlink d4/dc/d17/dad/ded/l117 0 2024-08-19T00:56:32.724 INFO:tasks.workunit.client.0.smithi017.stdout:1/891: fdatasync d4/dc/d3b/d45/f92 0 2024-08-19T00:56:32.727 INFO:tasks.workunit.client.0.smithi017.stdout:2/908: dwrite d2/d7/d10/d19/f1d [0,4194304] 0 2024-08-19T00:56:32.732 INFO:tasks.workunit.client.0.smithi017.stdout:2/909: mknod d2/c121 0 2024-08-19T00:56:32.734 INFO:tasks.workunit.client.0.smithi017.stdout:2/910: truncate d2/d7/d10/d3b/d54/f61 763051 0 2024-08-19T00:56:32.748 INFO:tasks.workunit.client.0.smithi017.stdout:1/892: write d4/fc7 [380603,81615] 0 2024-08-19T00:56:32.752 INFO:tasks.workunit.client.0.smithi017.stdout:1/893: creat d4/dc/d3b/d3d/d83/d95/de8/f118 x:0 0 0 2024-08-19T00:56:32.754 INFO:tasks.workunit.client.0.smithi017.stdout:1/894: dread d4/dc/d3b/d3d/d83/d95/dca/fcd [0,4194304] 0 2024-08-19T00:56:32.755 INFO:tasks.workunit.client.0.smithi017.stdout:2/911: write d2/f33 [2018756,24027] 0 2024-08-19T00:56:32.765 INFO:tasks.workunit.client.0.smithi017.stdout:2/912: dread d2/d7/d10/d3b/d97/fd4 [4194304,4194304] 0 2024-08-19T00:56:32.766 INFO:tasks.workunit.client.0.smithi017.stdout:2/913: stat d2/d7/d10/d35/d45/d58/dbf/lb3 0 2024-08-19T00:56:32.839 INFO:tasks.workunit.client.0.smithi017.stdout:2/914: mkdir d2/d7/d10/d35/d45/d58/dbf/d7a/d106/d122 0 2024-08-19T00:56:32.840 INFO:tasks.workunit.client.0.smithi017.stdout:1/895: truncate d4/dc/d19/f53 2707555 0 2024-08-19T00:56:32.845 INFO:tasks.workunit.client.0.smithi017.stdout:1/896: dread d4/dc/d17/dd6/d1f/da5/fe3 [0,4194304] 0 2024-08-19T00:56:32.846 INFO:tasks.workunit.client.0.smithi017.stdout:2/915: link d2/d7/d10/d35/l5e d2/d7/d10/d3b/d3c/df5/d10d/ddd/l123 0 2024-08-19T00:56:32.847 INFO:tasks.workunit.client.0.smithi017.stdout:1/897: dread - d4/dc/d17/dd6/d1f/da5/f104 zero size 2024-08-19T00:56:32.848 INFO:tasks.workunit.client.0.smithi017.stdout:2/916: fdatasync d2/d7/d10/d3b/f3f 0 2024-08-19T00:56:32.850 INFO:tasks.workunit.client.0.smithi017.stdout:2/917: write d2/d7/d10/d3b/d3c/df5/d10d/f82 [89679,92297] 0 2024-08-19T00:56:32.861 INFO:tasks.workunit.client.0.smithi017.stdout:2/918: dread d2/d7/d10/d35/d45/d58/dbf/fad [0,4194304] 0 2024-08-19T00:56:32.865 INFO:tasks.workunit.client.0.smithi017.stdout:1/898: write d4/dc/d17/dad/dea/db1/fe4 [437907,27445] 0 2024-08-19T00:56:32.869 INFO:tasks.workunit.client.0.smithi017.stdout:2/919: link d2/d7/d10/d35/d45/d58/c5f d2/d7/d10/d35/d45/d58/dbf/d7a/c124 0 2024-08-19T00:56:32.871 INFO:tasks.workunit.client.0.smithi017.stdout:1/899: dwrite d4/dc/d3b/f80 [0,4194304] 0 2024-08-19T00:56:32.872 INFO:tasks.workunit.client.0.smithi017.stdout:1/900: chown d4/dc/d3b/f4a 381181 1 2024-08-19T00:56:32.876 INFO:tasks.workunit.client.0.smithi017.stdout:2/920: rename d2/d7/d10/d35/d45/c114 to d2/d7/d10/d3b/d54/c125 0 2024-08-19T00:56:32.878 INFO:tasks.workunit.client.0.smithi017.stdout:1/901: mknod d4/dc/d3b/d3d/d83/d95/de8/c119 0 2024-08-19T00:56:32.881 INFO:tasks.workunit.client.0.smithi017.stdout:2/921: dread d2/d7/d10/d35/d45/d58/fb2 [0,4194304] 0 2024-08-19T00:56:32.883 INFO:tasks.workunit.client.0.smithi017.stdout:2/922: mknod d2/d7/d10/d3b/d80/da2/db7/c126 0 2024-08-19T00:56:32.895 INFO:tasks.workunit.client.0.smithi017.stdout:2/923: write d2/d7/d10/d3b/d3c/df5/d10d/f8e [265572,95759] 0 2024-08-19T00:56:32.897 INFO:tasks.workunit.client.0.smithi017.stdout:1/902: dwrite d4/dc/d3b/d3d/fb6 [0,4194304] 0 2024-08-19T00:56:32.904 INFO:tasks.workunit.client.0.smithi017.stdout:1/903: fdatasync d4/dc/d17/dd6/fc8 0 2024-08-19T00:56:32.908 INFO:tasks.workunit.client.0.smithi017.stdout:1/904: symlink d4/dc/d3b/d3d/d83/d95/dca/df3/l11a 0 2024-08-19T00:56:32.908 INFO:tasks.workunit.client.0.smithi017.stdout:2/924: dwrite d2/d7/d10/d3b/d3c/df5/d10d/f9c [0,4194304] 0 2024-08-19T00:56:32.909 INFO:tasks.workunit.client.0.smithi017.stdout:2/925: fdatasync d2/d7/fce 0 2024-08-19T00:56:32.911 INFO:tasks.workunit.client.0.smithi017.stdout:1/905: truncate d4/dc/d17/dd6/d75/d9c/ddb/ff1 714937 0 2024-08-19T00:56:32.913 INFO:tasks.workunit.client.0.smithi017.stdout:1/906: write d4/dc/d17/dd6/d75/d9c/ddb/da6/db8/f115 [999748,15359] 0 2024-08-19T00:56:32.915 INFO:tasks.workunit.client.0.smithi017.stdout:2/926: mkdir d2/d7/d10/d9f/d127 0 2024-08-19T00:56:32.917 INFO:tasks.workunit.client.0.smithi017.stdout:1/907: mkdir d4/dc/d3b/d3d/d83/d95/d11b 0 2024-08-19T00:56:32.922 INFO:tasks.workunit.client.0.smithi017.stdout:1/908: dread d4/dc/f71 [0,4194304] 0 2024-08-19T00:56:32.927 INFO:tasks.workunit.client.0.smithi017.stdout:1/909: link d4/dc/d17/dd6/d1f/da5/cb5 d4/dc/d3b/de6/c11c 0 2024-08-19T00:56:32.928 INFO:tasks.workunit.client.0.smithi017.stdout:1/910: chown d4/dc/d3b/d9d/ff0 1625 1 2024-08-19T00:56:32.930 INFO:tasks.workunit.client.0.smithi017.stdout:1/911: mkdir d4/dc/d19/d11d 0 2024-08-19T00:56:32.931 INFO:tasks.workunit.client.0.smithi017.stdout:2/927: dread d2/d7/d10/d35/d45/d58/dbf/f70 [4194304,4194304] 0 2024-08-19T00:56:33.033 INFO:tasks.workunit.client.0.smithi017.stdout:1/912: rename d4/l39 to d4/dc/d17/dad/l11e 0 2024-08-19T00:56:33.034 INFO:tasks.workunit.client.0.smithi017.stdout:2/928: mkdir d2/d7/d10/d128 0 2024-08-19T00:56:33.035 INFO:tasks.workunit.client.0.smithi017.stdout:1/913: creat d4/dc/d17/dd6/d75/f11f x:0 0 0 2024-08-19T00:56:33.037 INFO:tasks.workunit.client.0.smithi017.stdout:1/914: chown d4/dc/d17/dd6/d75/d9c/ddb/da6/d100 51063429 1 2024-08-19T00:56:33.040 INFO:tasks.workunit.client.0.smithi017.stdout:1/915: mkdir d4/dc/d17/dd6/d1f/da5/d120 0 2024-08-19T00:56:33.041 INFO:tasks.workunit.client.0.smithi017.stdout:1/916: fdatasync d4/f10 0 2024-08-19T00:56:33.046 INFO:tasks.workunit.client.0.smithi017.stdout:2/929: write d2/d7/d10/d3b/d97/fee [4128606,17249] 0 2024-08-19T00:56:33.049 INFO:tasks.workunit.client.0.smithi017.stdout:1/917: write d4/dc/f40 [2479319,102854] 0 2024-08-19T00:56:33.055 INFO:tasks.workunit.client.0.smithi017.stdout:2/930: dwrite d2/d7/d10/d9f/df9/dfd/f102 [0,4194304] 0 2024-08-19T00:56:33.056 INFO:tasks.workunit.client.0.smithi017.stdout:2/931: write d2/fea [250235,22631] 0 2024-08-19T00:56:33.063 INFO:tasks.workunit.client.0.smithi017.stdout:1/918: dwrite d4/dc/d3b/d3d/d83/d95/dca/df3/ff7 [0,4194304] 0 2024-08-19T00:56:33.069 INFO:tasks.workunit.client.0.smithi017.stdout:1/919: rename d4/dc/d17/dd6/f70 to d4/dc/d3b/d9d/f121 0 2024-08-19T00:56:33.075 INFO:tasks.workunit.client.0.smithi017.stdout:2/932: dread d2/d7/d10/d35/d45/d58/f67 [0,4194304] 0 2024-08-19T00:56:33.075 INFO:tasks.workunit.client.0.smithi017.stdout:1/920: dwrite d4/dc/d3b/d45/f92 [0,4194304] 0 2024-08-19T00:56:33.077 INFO:tasks.workunit.client.0.smithi017.stdout:1/921: chown d4/dc/d3b/de6 530513 1 2024-08-19T00:56:33.079 INFO:tasks.workunit.client.0.smithi017.stdout:1/922: creat d4/dc/d3b/d9d/f122 x:0 0 0 2024-08-19T00:56:33.080 INFO:tasks.workunit.client.0.smithi017.stdout:1/923: mknod d4/dc/d3b/d45/c123 0 2024-08-19T00:56:33.081 INFO:tasks.workunit.client.0.smithi017.stdout:1/924: write d4/fd [2799209,406] 0 2024-08-19T00:56:33.082 INFO:tasks.workunit.client.0.smithi017.stdout:9/815: sync 2024-08-19T00:56:33.083 INFO:tasks.workunit.client.0.smithi017.stdout:9/816: readlink d0/d33/d22/d5e/l75 0 2024-08-19T00:56:33.083 INFO:tasks.workunit.client.0.smithi017.stdout:1/925: mknod d4/dc/d17/dd6/d75/c124 0 2024-08-19T00:56:33.085 INFO:tasks.workunit.client.0.smithi017.stdout:1/926: creat d4/dc/d19/f125 x:0 0 0 2024-08-19T00:56:33.087 INFO:tasks.workunit.client.0.smithi017.stdout:9/817: creat d0/d58/d49/d70/db2/ff3 x:0 0 0 2024-08-19T00:56:33.088 INFO:tasks.workunit.client.0.smithi017.stdout:1/927: symlink d4/dc/d3b/d3d/d54/l126 0 2024-08-19T00:56:33.088 INFO:tasks.workunit.client.0.smithi017.stdout:9/818: write d0/d33/d22/d45/fc0 [666281,81094] 0 2024-08-19T00:56:33.090 INFO:tasks.workunit.client.0.smithi017.stdout:2/933: truncate d2/d7/d29/f52 308202 0 2024-08-19T00:56:33.092 INFO:tasks.workunit.client.0.smithi017.stdout:2/934: chown d2/d7/dd/f2a 189989455 1 2024-08-19T00:56:33.094 INFO:tasks.workunit.client.0.smithi017.stdout:9/819: symlink d0/d33/d22/d85/da6/lf4 0 2024-08-19T00:56:33.096 INFO:tasks.workunit.client.0.smithi017.stdout:9/820: creat d0/d33/d22/ff5 x:0 0 0 2024-08-19T00:56:33.102 INFO:tasks.workunit.client.0.smithi017.stdout:2/935: dread d2/fa [0,4194304] 0 2024-08-19T00:56:33.107 INFO:tasks.workunit.client.0.smithi017.stdout:2/936: read d2/d7/d10/d3b/d54/f61 [342093,98694] 0 2024-08-19T00:56:33.108 INFO:tasks.workunit.client.0.smithi017.stdout:2/937: fsync d2/d7/d10/d35/d45/d58/f10e 0 2024-08-19T00:56:33.109 INFO:tasks.workunit.client.0.smithi017.stdout:1/928: truncate d4/dc/d3b/fd2 386378 0 2024-08-19T00:56:33.109 INFO:tasks.workunit.client.0.smithi017.stdout:1/929: stat d4/dc/d17/d1d/c8f 0 2024-08-19T00:56:33.114 INFO:tasks.workunit.client.0.smithi017.stdout:2/938: dwrite d2/d7/d10/d35/d45/d58/dbf/fad [0,4194304] 0 2024-08-19T00:56:33.122 INFO:tasks.workunit.client.0.smithi017.stdout:9/821: dwrite d0/d33/f71 [0,4194304] 0 2024-08-19T00:56:33.128 INFO:tasks.workunit.client.0.smithi017.stdout:9/822: dwrite d0/f3a [0,4194304] 0 2024-08-19T00:56:33.131 INFO:tasks.workunit.client.0.smithi017.stdout:2/939: unlink d2/d7/d10/d3b/d3c/df5/d10d/ddd/l123 0 2024-08-19T00:56:33.131 INFO:tasks.workunit.client.0.smithi017.stdout:1/930: truncate d4/dd1/fd5 2296776 0 2024-08-19T00:56:33.134 INFO:tasks.workunit.client.0.smithi017.stdout:2/940: unlink d2/cd8 0 2024-08-19T00:56:33.135 INFO:tasks.workunit.client.0.smithi017.stdout:0/759: sync 2024-08-19T00:56:33.135 INFO:tasks.workunit.client.0.smithi017.stdout:4/845: sync 2024-08-19T00:56:33.135 INFO:tasks.workunit.client.0.smithi017.stdout:3/843: sync 2024-08-19T00:56:33.136 INFO:tasks.workunit.client.0.smithi017.stdout:5/644: sync 2024-08-19T00:56:33.136 INFO:tasks.workunit.client.0.smithi017.stdout:6/896: sync 2024-08-19T00:56:33.136 INFO:tasks.workunit.client.0.smithi017.stdout:8/842: sync 2024-08-19T00:56:33.137 INFO:tasks.workunit.client.0.smithi017.stdout:9/823: dwrite d0/d58/d49/f76 [0,4194304] 0 2024-08-19T00:56:33.141 INFO:tasks.workunit.client.0.smithi017.stdout:1/931: unlink d4/dc/d3b/d3d/cff 0 2024-08-19T00:56:33.146 INFO:tasks.workunit.client.0.smithi017.stdout:5/645: fsync db/d19/d1f/d15/d3e/d40/d49/d63/d80/fdb 0 2024-08-19T00:56:33.146 INFO:tasks.workunit.client.0.smithi017.stdout:6/897: write d5/d13/d11/d2c/f76 [1552393,8076] 0 2024-08-19T00:56:33.147 INFO:tasks.workunit.client.0.smithi017.stdout:1/932: unlink d4/dc/c64 0 2024-08-19T00:56:33.148 INFO:tasks.workunit.client.0.smithi017.stdout:0/760: mknod d5/d17/d21/d42/d9b/dd8/c101 0 2024-08-19T00:56:33.150 INFO:tasks.workunit.client.0.smithi017.stdout:9/824: write d0/d33/d22/d45/d8e/fcf [787373,108925] 0 2024-08-19T00:56:33.150 INFO:tasks.workunit.client.0.smithi017.stdout:5/646: chown db/d19/d1f/d15/d3e/d40/d49/d63/lc1 43258 1 2024-08-19T00:56:33.151 INFO:tasks.workunit.client.0.smithi017.stdout:1/933: mknod d4/dc/d3b/d3d/d54/c127 0 2024-08-19T00:56:33.156 INFO:tasks.workunit.client.0.smithi017.stdout:6/898: unlink d5/d13/d11/d2c/d4a/d64/d86/d90/dba/de7/l104 0 2024-08-19T00:56:33.158 INFO:tasks.workunit.client.0.smithi017.stdout:3/844: rename d5/da/d3c/de4/d1b/ca5 to d5/da/c110 0 2024-08-19T00:56:33.165 INFO:tasks.workunit.client.0.smithi017.stdout:0/761: dread d5/d17/d26/f9a [0,4194304] 0 2024-08-19T00:56:33.166 INFO:tasks.workunit.client.0.smithi017.stdout:9/825: truncate d0/f5b 5404710 0 2024-08-19T00:56:33.166 INFO:tasks.workunit.client.0.smithi017.stdout:9/826: chown d0/d58/f3e 397053 1 2024-08-19T00:56:33.167 INFO:tasks.workunit.client.0.smithi017.stdout:9/827: dread - d0/d84/ff0 zero size 2024-08-19T00:56:33.169 INFO:tasks.workunit.client.0.smithi017.stdout:9/828: write d0/d33/d22/d45/d69/fde [950989,51415] 0 2024-08-19T00:56:33.169 INFO:tasks.workunit.client.0.smithi017.stdout:1/934: dread d4/f14 [0,4194304] 0 2024-08-19T00:56:33.170 INFO:tasks.workunit.client.0.smithi017.stdout:1/935: chown d4/dc/f40 3485344 1 2024-08-19T00:56:33.172 INFO:tasks.workunit.client.0.smithi017.stdout:1/936: write d4/dc/d3b/d9d/f114 [485588,130377] 0 2024-08-19T00:56:33.174 INFO:tasks.workunit.client.0.smithi017.stdout:8/843: rename de/d15/d39/d3d/f4e to de/d15/d39/d3d/dc2/dd8/f106 0 2024-08-19T00:56:33.174 INFO:tasks.workunit.client.0.smithi017.stdout:2/941: dread d2/d7/d10/d3b/d3c/df5/d10d/f82 [0,4194304] 0 2024-08-19T00:56:33.178 INFO:tasks.workunit.client.0.smithi017.stdout:6/899: rename d5/lb5 to d5/d13/d11/d2c/d4a/d64/d127/l131 0 2024-08-19T00:56:33.178 INFO:tasks.workunit.client.0.smithi017.stdout:9/829: rename d0/d33/d22 to d0/d33/d22/d45/da2/df6 22 2024-08-19T00:56:33.179 INFO:tasks.workunit.client.0.smithi017.stdout:6/900: stat d5/d13/d20 0 2024-08-19T00:56:33.180 INFO:tasks.workunit.client.0.smithi017.stdout:9/830: write d0/d33/d22/d5a/fb8 [955060,124981] 0 2024-08-19T00:56:33.181 INFO:tasks.workunit.client.0.smithi017.stdout:1/937: symlink d4/dc/d3b/d3d/d83/d95/l128 0 2024-08-19T00:56:33.191 INFO:tasks.workunit.client.0.smithi017.stdout:6/901: dread d5/d13/d20/d77/d99/fe0 [0,4194304] 0 2024-08-19T00:56:33.193 INFO:tasks.workunit.client.0.smithi017.stdout:8/844: mkdir de/d15/d62/d107 0 2024-08-19T00:56:33.200 INFO:tasks.workunit.client.0.smithi017.stdout:2/942: dwrite d2/d7/d10/d3b/fb4 [0,4194304] 0 2024-08-19T00:56:33.208 INFO:tasks.workunit.client.0.smithi017.stdout:2/943: truncate d2/d7/d10/d3b/d80/da2/fcb 967056 0 2024-08-19T00:56:33.209 INFO:tasks.workunit.client.0.smithi017.stdout:9/831: truncate d0/d58/d49/dc3/fc4 2490959 0 2024-08-19T00:56:33.212 INFO:tasks.workunit.client.0.smithi017.stdout:2/944: fsync d2/d7/d10/d35/d45/d58/dbf/f7f 0 2024-08-19T00:56:33.213 INFO:tasks.workunit.client.0.smithi017.stdout:6/902: dwrite d5/d13/dcf/fdf [0,4194304] 0 2024-08-19T00:56:33.214 INFO:tasks.workunit.client.0.smithi017.stdout:6/903: chown d5/d13/de5 105 1 2024-08-19T00:56:33.215 INFO:tasks.workunit.client.0.smithi017.stdout:6/904: chown d5/d13/d11/d52/fbc 2104884694 1 2024-08-19T00:56:33.216 INFO:tasks.workunit.client.0.smithi017.stdout:1/938: getdents d4/dc/d3b/d9d 0 2024-08-19T00:56:33.218 INFO:tasks.workunit.client.0.smithi017.stdout:9/832: creat d0/d58/d49/ff7 x:0 0 0 2024-08-19T00:56:33.223 INFO:tasks.workunit.client.0.smithi017.stdout:2/945: rename d2/d7/dd/fbd to d2/dc5/dca/f129 0 2024-08-19T00:56:33.224 INFO:tasks.workunit.client.0.smithi017.stdout:9/833: rmdir d0/d58 39 2024-08-19T00:56:33.226 INFO:tasks.workunit.client.0.smithi017.stdout:6/905: dwrite d5/d13/d11/d2c/d4a/d64/d86/d90/dba/f125 [0,4194304] 0 2024-08-19T00:56:33.227 INFO:tasks.workunit.client.0.smithi017.stdout:6/906: readlink d5/ld4 0 2024-08-19T00:56:33.299 INFO:tasks.workunit.client.0.smithi017.stdout:7/902: sync 2024-08-19T00:56:33.335 INFO:tasks.workunit.client.0.smithi017.stdout:1/939: truncate d4/dc/d19/f79 1504105 0 2024-08-19T00:56:33.340 INFO:tasks.workunit.client.0.smithi017.stdout:2/946: dread d2/d7/d10/d19/f7b [0,4194304] 0 2024-08-19T00:56:33.344 INFO:tasks.workunit.client.0.smithi017.stdout:7/903: fsync d3/dc/df/d23/fae 0 2024-08-19T00:56:33.347 INFO:tasks.workunit.client.0.smithi017.stdout:7/904: chown d3/dc/df/dd1/fd2 95443559 1 2024-08-19T00:56:33.349 INFO:tasks.workunit.client.0.smithi017.stdout:2/947: dwrite d2/d7/d10/d9f/df9/dfd/f102 [0,4194304] 0 2024-08-19T00:56:33.349 INFO:tasks.workunit.client.0.smithi017.stdout:9/834: creat d0/d33/df2/ff8 x:0 0 0 2024-08-19T00:56:33.350 INFO:tasks.workunit.client.0.smithi017.stdout:6/907: dread d5/d13/f1b [0,4194304] 0 2024-08-19T00:56:33.351 INFO:tasks.workunit.client.0.smithi017.stdout:7/905: chown d3/dc/df/d1c/d2c/c50 70 1 2024-08-19T00:56:33.352 INFO:tasks.workunit.client.0.smithi017.stdout:9/835: chown d0/d33/d22/lab 1738213 1 2024-08-19T00:56:33.352 INFO:tasks.workunit.client.0.smithi017.stdout:6/908: chown d5/d13/d11/d52/la2 870329193 1 2024-08-19T00:56:33.352 INFO:tasks.workunit.client.0.smithi017.stdout:9/836: stat d0/d84/ff0 0 2024-08-19T00:56:33.356 INFO:tasks.workunit.client.0.smithi017.stdout:1/940: mkdir d4/dc/d3b/d3d/d83/d95/dca/d129 0 2024-08-19T00:56:33.363 INFO:tasks.workunit.client.0.smithi017.stdout:9/837: write d0/d58/d49/fcb [455717,38465] 0 2024-08-19T00:56:33.366 INFO:tasks.workunit.client.0.smithi017.stdout:1/941: chown d4/dc/d3b/d45/f7b 22 1 2024-08-19T00:56:33.367 INFO:tasks.workunit.client.0.smithi017.stdout:7/906: dread d3/dc/df/d3d/d90/fcb [0,4194304] 0 2024-08-19T00:56:33.369 INFO:tasks.workunit.client.0.smithi017.stdout:6/909: symlink d5/d13/d11/d2c/l132 0 2024-08-19T00:56:33.372 INFO:tasks.workunit.client.0.smithi017.stdout:1/942: mkdir d4/dc/d17/dd6/d75/d9c/d12a 0 2024-08-19T00:56:33.373 INFO:tasks.workunit.client.0.smithi017.stdout:1/943: dread - d4/dc/d17/dd6/d75/f11f zero size 2024-08-19T00:56:33.374 INFO:tasks.workunit.client.0.smithi017.stdout:7/907: write d3/dc/df/d1a/f3b [5523917,117274] 0 2024-08-19T00:56:33.375 INFO:tasks.workunit.client.0.smithi017.stdout:1/944: dread - d4/dc/d17/dd6/d75/f11f zero size 2024-08-19T00:56:33.379 INFO:tasks.workunit.client.0.smithi017.stdout:2/948: dread d2/d7/d10/d35/d7e/fb1 [0,4194304] 0 2024-08-19T00:56:33.385 INFO:tasks.workunit.client.0.smithi017.stdout:2/949: chown d2/d7/d10/d3b/d80/da2/fcb 2131 1 2024-08-19T00:56:33.389 INFO:tasks.workunit.client.0.smithi017.stdout:2/950: creat d2/d7/d10/d3b/d97/f12a x:0 0 0 2024-08-19T00:56:33.391 INFO:tasks.workunit.client.0.smithi017.stdout:2/951: mknod d2/d7/d10/d19/c12b 0 2024-08-19T00:56:33.394 INFO:tasks.workunit.client.0.smithi017.stdout:2/952: mkdir d2/d7/d10/d3b/d3c/df5/d10d/ddd/d12c 0 2024-08-19T00:56:33.397 INFO:tasks.workunit.client.0.smithi017.stdout:2/953: mknod d2/d7/d44/c12d 0 2024-08-19T00:56:33.401 INFO:tasks.workunit.client.0.smithi017.stdout:2/954: mkdir d2/d7/d10/d128/d12e 0 2024-08-19T00:56:33.403 INFO:tasks.workunit.client.0.smithi017.stdout:2/955: fsync d2/d7/d10/d3b/d80/da2/fcb 0 2024-08-19T00:56:33.404 INFO:tasks.workunit.client.0.smithi017.stdout:6/910: write d5/d13/fe8 [1010794,32544] 0 2024-08-19T00:56:33.406 INFO:tasks.workunit.client.0.smithi017.stdout:6/911: write d5/d13/d11/d2c/f38 [5158522,60690] 0 2024-08-19T00:56:33.406 INFO:tasks.workunit.client.0.smithi017.stdout:2/956: unlink d2/d7/d10/d35/d7e/fe0 0 2024-08-19T00:56:33.410 INFO:tasks.workunit.client.0.smithi017.stdout:9/838: truncate d0/d33/f71 4096530 0 2024-08-19T00:56:33.415 INFO:tasks.workunit.client.0.smithi017.stdout:9/839: link d0/d33/d22/d45/fc0 d0/d33/d22/d5e/ff9 0 2024-08-19T00:56:33.415 INFO:tasks.workunit.client.0.smithi017.stdout:7/908: write d3/dc/df/d23/d69/fb4 [5084079,102906] 0 2024-08-19T00:56:33.424 INFO:tasks.workunit.client.0.smithi017.stdout:1/945: dwrite d4/dc/d3b/d9d/f8c [0,4194304] 0 2024-08-19T00:56:33.427 INFO:tasks.workunit.client.0.smithi017.stdout:6/912: dread d5/d13/d11/f9f [0,4194304] 0 2024-08-19T00:56:33.427 INFO:tasks.workunit.client.0.smithi017.stdout:7/909: link d3/dc/df/d1c/d2c/c50 d3/c128 0 2024-08-19T00:56:33.432 INFO:tasks.workunit.client.0.smithi017.stdout:7/910: mkdir d3/dc/df/d1c/d2c/d2f/d129 0 2024-08-19T00:56:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:33 smithi017 ceph-mon[16627]: pgmap v27: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 92 MiB/s rd, 209 MiB/s wr, 516 op/s 2024-08-19T00:56:33.435 INFO:tasks.workunit.client.0.smithi017.stdout:6/913: mkdir d5/d13/d11/d2c/d4a/d64/d86/d90/dba/d133 0 2024-08-19T00:56:33.437 INFO:tasks.workunit.client.0.smithi017.stdout:9/840: dread d0/d33/d22/d5a/f88 [0,4194304] 0 2024-08-19T00:56:33.438 INFO:tasks.workunit.client.0.smithi017.stdout:6/914: chown d5/d7b/lfc 12 1 2024-08-19T00:56:33.443 INFO:tasks.workunit.client.0.smithi017.stdout:9/841: unlink d0/d33/d22/d45/d9b/ca5 0 2024-08-19T00:56:33.444 INFO:tasks.workunit.client.0.smithi017.stdout:2/957: rename d2/d7/d10/d128 to d2/d7/d10/d3b/d80/d81/dcd/d12f 0 2024-08-19T00:56:33.446 INFO:tasks.workunit.client.0.smithi017.stdout:9/842: chown d0/d33/f29 14498890 1 2024-08-19T00:56:33.450 INFO:tasks.workunit.client.0.smithi017.stdout:7/911: rename d3/dc/df/d37/d46/f57 to d3/dc/df/d23/d6a/dee/f12a 0 2024-08-19T00:56:33.461 INFO:tasks.workunit.client.0.smithi017.stdout:9/843: mknod d0/cfa 0 2024-08-19T00:56:33.462 INFO:tasks.workunit.client.0.smithi017.stdout:9/844: write d0/f3a [5004272,2598] 0 2024-08-19T00:56:33.467 INFO:tasks.workunit.client.0.smithi017.stdout:6/915: rename d5/d13/d11/d93/fb0 to d5/f134 0 2024-08-19T00:56:33.469 INFO:tasks.workunit.client.0.smithi017.stdout:9/845: write d0/d33/d22/d40/fbb [1873988,97482] 0 2024-08-19T00:56:33.472 INFO:tasks.workunit.client.0.smithi017.stdout:7/912: rename d3/d3c/d88/f8b to d3/dc/df/dd1/f12b 0 2024-08-19T00:56:33.476 INFO:tasks.workunit.client.0.smithi017.stdout:6/916: rename d5/d13/d11/d2c/d4a/d64/d86/d90/dba/f125 to d5/d13/dcf/f135 0 2024-08-19T00:56:33.489 INFO:tasks.workunit.client.0.smithi017.stdout:4/846: sync 2024-08-19T00:56:33.489 INFO:tasks.workunit.client.0.smithi017.stdout:9/846: rmdir d0/d33/d22/d85/da6/dc5 39 2024-08-19T00:56:33.490 INFO:tasks.workunit.client.0.smithi017.stdout:7/913: unlink d3/dc/df/d37/d46/f118 0 2024-08-19T00:56:33.502 INFO:tasks.workunit.client.0.smithi017.stdout:9/847: mkdir d0/d84/dd8/dfb 0 2024-08-19T00:56:33.505 INFO:tasks.workunit.client.0.smithi017.stdout:6/917: symlink d5/d13/d11/d2c/l136 0 2024-08-19T00:56:33.512 INFO:tasks.workunit.client.0.smithi017.stdout:4/847: rename d2/d87/fd3 to d2/d87/db2/de6/f124 0 2024-08-19T00:56:33.514 INFO:tasks.workunit.client.0.smithi017.stdout:7/914: creat d3/dc/f12c x:0 0 0 2024-08-19T00:56:33.526 INFO:tasks.workunit.client.0.smithi017.stdout:7/915: getdents d3/dc/df/daa/df8 0 2024-08-19T00:56:33.528 INFO:tasks.workunit.client.0.smithi017.stdout:6/918: creat d5/d13/d11/d2c/d4a/d64/d86/d90/dba/f137 x:0 0 0 2024-08-19T00:56:33.532 INFO:tasks.workunit.client.0.smithi017.stdout:7/916: mkdir d3/dc/df/d37/d93/da7/d12d 0 2024-08-19T00:56:33.539 INFO:tasks.workunit.client.0.smithi017.stdout:4/848: getdents d2/d87/db2/de6/d40/d56/d99/da3 0 2024-08-19T00:56:33.546 INFO:tasks.workunit.client.0.smithi017.stdout:2/958: write d2/d7/d10/d3b/d3c/d8a/feb [920369,49008] 0 2024-08-19T00:56:33.547 INFO:tasks.workunit.client.0.smithi017.stdout:7/917: dwrite d3/dc/d5f/f89 [4194304,4194304] 0 2024-08-19T00:56:33.570 INFO:tasks.workunit.client.0.smithi017.stdout:9/848: write d0/d33/d22/fb0 [67605,82845] 0 2024-08-19T00:56:33.595 INFO:tasks.workunit.client.0.smithi017.stdout:6/919: unlink d5/d13/d11/c67 0 2024-08-19T00:56:33.603 INFO:tasks.workunit.client.0.smithi017.stdout:6/920: dwrite d5/d13/d11/d2c/d4a/d64/d86/d90/dba/f129 [0,4194304] 0 2024-08-19T00:56:33.605 INFO:tasks.workunit.client.0.smithi017.stdout:7/918: symlink d3/dc/df/daa/df8/l12e 0 2024-08-19T00:56:33.606 INFO:tasks.workunit.client.0.smithi017.stdout:7/919: chown d3/dc/df/d3d/d90/f59 57369 1 2024-08-19T00:56:33.607 INFO:tasks.workunit.client.0.smithi017.stdout:4/849: link d2/d87/db2/de6/d40/d56/d99/da3/cb4 d2/d1a/d55/d73/d121/c125 0 2024-08-19T00:56:33.609 INFO:tasks.workunit.client.0.smithi017.stdout:2/959: rename d2/d7/d10/d35/d45/d58/f67 to d2/d7/d10/d3b/d3c/f130 0 2024-08-19T00:56:33.615 INFO:tasks.workunit.client.0.smithi017.stdout:7/920: dwrite d3/dc/df/d23/d69/fb4 [4194304,4194304] 0 2024-08-19T00:56:33.617 INFO:tasks.workunit.client.0.smithi017.stdout:7/921: read - d3/dc/df/d1c/f112 zero size 2024-08-19T00:56:33.617 INFO:tasks.workunit.client.0.smithi017.stdout:6/921: rename d5/d13/d11/d52/lec to d5/d13/d11/d2c/d4a/da8/dd1/d12d/l138 0 2024-08-19T00:56:33.625 INFO:tasks.workunit.client.0.smithi017.stdout:9/849: link d0/d33/d22/d5a/lad d0/d33/d22/d85/da6/dc5/lfc 0 2024-08-19T00:56:33.629 INFO:tasks.workunit.client.0.smithi017.stdout:4/850: rename d2/d87/db2/de6/d53/d57/f9f to d2/d87/db2/d116/f126 0 2024-08-19T00:56:33.633 INFO:tasks.workunit.client.0.smithi017.stdout:9/850: dwrite d0/d33/d22/d45/d69/fa4 [0,4194304] 0 2024-08-19T00:56:33.635 INFO:tasks.workunit.client.0.smithi017.stdout:6/922: mkdir d5/d13/d11/d4d/dfa/d139 0 2024-08-19T00:56:33.638 INFO:tasks.workunit.client.0.smithi017.stdout:4/851: truncate d2/d27/fdc 26294 0 2024-08-19T00:56:33.639 INFO:tasks.workunit.client.0.smithi017.stdout:4/852: dread - d2/d1a/d55/ff2 zero size 2024-08-19T00:56:33.641 INFO:tasks.workunit.client.0.smithi017.stdout:2/960: creat d2/d7/f131 x:0 0 0 2024-08-19T00:56:33.643 INFO:tasks.workunit.client.0.smithi017.stdout:2/961: write d2/d7/d10/d19/f41 [3753752,73944] 0 2024-08-19T00:56:33.646 INFO:tasks.workunit.client.0.smithi017.stdout:6/923: mknod d5/d13/d11/d2c/d4a/d64/d86/d90/dba/d121/c13a 0 2024-08-19T00:56:33.646 INFO:tasks.workunit.client.0.smithi017.stdout:6/924: readlink d5/d13/d11/d2c/d4a/d64/l79 0 2024-08-19T00:56:33.650 INFO:tasks.workunit.client.0.smithi017.stdout:4/853: unlink d2/d1a/dd0/ff6 0 2024-08-19T00:56:33.654 INFO:tasks.workunit.client.0.smithi017.stdout:2/962: rename d2/d7/d10/d3b/d3c/df5/d10d/ddd/d12c to d2/d7/d10/d3b/d80/da2/daf/d132 0 2024-08-19T00:56:33.655 INFO:tasks.workunit.client.0.smithi017.stdout:6/925: truncate d5/d13/d20/d77/d99/fac 991302 0 2024-08-19T00:56:33.657 INFO:tasks.workunit.client.0.smithi017.stdout:2/963: write d2/d7/d10/d3b/d3c/d8a/fbe [2177732,9407] 0 2024-08-19T00:56:33.657 INFO:tasks.workunit.client.0.smithi017.stdout:4/854: dwrite d2/d87/db2/de6/d40/fea [0,4194304] 0 2024-08-19T00:56:33.660 INFO:tasks.workunit.client.0.smithi017.stdout:7/922: write d3/dc/df/d37/d46/fbd [991749,5161] 0 2024-08-19T00:56:33.667 INFO:tasks.workunit.client.0.smithi017.stdout:6/926: fsync d5/d13/d11/d4d/f6b 0 2024-08-19T00:56:33.670 INFO:tasks.workunit.client.0.smithi017.stdout:2/964: write d2/d7/f28 [1943809,108430] 0 2024-08-19T00:56:33.671 INFO:tasks.workunit.client.0.smithi017.stdout:4/855: fdatasync d2/d87/db2/de6/d40/d8b/fb8 0 2024-08-19T00:56:33.673 INFO:tasks.workunit.client.0.smithi017.stdout:4/856: chown d2/d1a/d55/d73/d121/l10e 2 1 2024-08-19T00:56:33.673 INFO:tasks.workunit.client.0.smithi017.stdout:6/927: dread d5/d13/d20/f58 [0,4194304] 0 2024-08-19T00:56:33.675 INFO:tasks.workunit.client.0.smithi017.stdout:7/923: write d3/dc/df/d3d/d90/fcb [918622,66642] 0 2024-08-19T00:56:33.678 INFO:tasks.workunit.client.0.smithi017.stdout:7/924: write d3/f51 [5035901,91617] 0 2024-08-19T00:56:33.680 INFO:tasks.workunit.client.0.smithi017.stdout:2/965: dwrite d2/d7/d10/d35/d84/f94 [0,4194304] 0 2024-08-19T00:56:33.682 INFO:tasks.workunit.client.0.smithi017.stdout:2/966: dread - d2/d7/d10/d3b/d3c/df5/d10d/dab/dfc/f100 zero size 2024-08-19T00:56:33.685 INFO:tasks.workunit.client.0.smithi017.stdout:4/857: fsync d2/d87/db2/d116/f126 0 2024-08-19T00:56:33.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:33 smithi086 ceph-mon[24511]: pgmap v27: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 92 MiB/s rd, 209 MiB/s wr, 516 op/s 2024-08-19T00:56:33.696 INFO:tasks.workunit.client.0.smithi017.stdout:7/925: link d3/dc/df/d37/d93/ce0 d3/dc/df/dda/c12f 0 2024-08-19T00:56:33.704 INFO:tasks.workunit.client.0.smithi017.stdout:7/926: dwrite d3/dc/df/d37/d93/da7/f10d [0,4194304] 0 2024-08-19T00:56:33.710 INFO:tasks.workunit.client.0.smithi017.stdout:4/858: write d2/d1a/dd0/fc4 [425709,52353] 0 2024-08-19T00:56:33.712 INFO:tasks.workunit.client.0.smithi017.stdout:2/967: dwrite d2/d7/d10/d19/f27 [0,4194304] 0 2024-08-19T00:56:33.716 INFO:tasks.workunit.client.0.smithi017.stdout:6/928: dread d5/d13/d11/d2c/d51/d7e/fae [0,4194304] 0 2024-08-19T00:56:33.721 INFO:tasks.workunit.client.0.smithi017.stdout:6/929: mkdir d5/d13/d11/d2c/d4a/d106/d13b 0 2024-08-19T00:56:33.728 INFO:tasks.workunit.client.0.smithi017.stdout:6/930: creat d5/d13/d11/d2c/d4a/d64/d86/d90/dba/de7/f13c x:0 0 0 2024-08-19T00:56:33.731 INFO:tasks.workunit.client.0.smithi017.stdout:2/968: dwrite d2/dc5/dca/f129 [0,4194304] 0 2024-08-19T00:56:33.733 INFO:tasks.workunit.client.0.smithi017.stdout:7/927: dwrite d3/dc/df/dda/ddf/fe6 [0,4194304] 0 2024-08-19T00:56:33.735 INFO:tasks.workunit.client.0.smithi017.stdout:4/859: dwrite d2/d87/db2/de6/d40/d56/f47 [0,4194304] 0 2024-08-19T00:56:33.735 INFO:tasks.workunit.client.0.smithi017.stdout:6/931: chown d5/d13/d11/d2c/f46 118 1 2024-08-19T00:56:33.740 INFO:tasks.workunit.client.0.smithi017.stdout:2/969: truncate d2/d7/d10/d3b/d80/da2/f111 814509 0 2024-08-19T00:56:33.740 INFO:tasks.workunit.client.0.smithi017.stdout:4/860: write d2/d87/db2/de6/d40/d56/d99/da3/fba [1336297,122732] 0 2024-08-19T00:56:33.743 INFO:tasks.workunit.client.0.smithi017.stdout:7/928: rmdir d3/dc/df/d1c/d2c/d2f 39 2024-08-19T00:56:33.746 INFO:tasks.workunit.client.0.smithi017.stdout:4/861: write d2/f12 [14408,90740] 0 2024-08-19T00:56:33.747 INFO:tasks.workunit.client.0.smithi017.stdout:4/862: dread - d2/f118 zero size 2024-08-19T00:56:33.751 INFO:tasks.workunit.client.0.smithi017.stdout:4/863: mknod d2/d16/c127 0 2024-08-19T00:56:33.762 INFO:tasks.workunit.client.0.smithi017.stdout:7/929: write d3/dc/df/dd1/fd2 [1151337,106329] 0 2024-08-19T00:56:33.763 INFO:tasks.workunit.client.0.smithi017.stdout:2/970: write d2/f1a [298012,29456] 0 2024-08-19T00:56:33.764 INFO:tasks.workunit.client.0.smithi017.stdout:2/971: chown d2/d7/c10a 65003 1 2024-08-19T00:56:33.767 INFO:tasks.workunit.client.0.smithi017.stdout:7/930: creat d3/dab/d106/f130 x:0 0 0 2024-08-19T00:56:33.767 INFO:tasks.workunit.client.0.smithi017.stdout:6/932: dread d5/d13/d11/d2c/d4a/d106/f96 [0,4194304] 0 2024-08-19T00:56:33.768 INFO:tasks.workunit.client.0.smithi017.stdout:4/864: dread d2/d87/db2/de6/d40/ffc [0,4194304] 0 2024-08-19T00:56:33.773 INFO:tasks.workunit.client.0.smithi017.stdout:6/933: fdatasync d5/d13/d11/d2c/d4a/d106/f124 0 2024-08-19T00:56:33.775 INFO:tasks.workunit.client.0.smithi017.stdout:2/972: write d2/d7/d10/d19/f39 [1679044,1004] 0 2024-08-19T00:56:33.775 INFO:tasks.workunit.client.0.smithi017.stdout:7/931: dwrite d3/dc/df/dd1/dd7/ddb/f10f [4194304,4194304] 0 2024-08-19T00:56:33.775 INFO:tasks.workunit.client.0.smithi017.stdout:4/865: getdents d2/d87/db2/de6/d40/d56/d95/dae 0 2024-08-19T00:56:33.778 INFO:tasks.workunit.client.0.smithi017.stdout:7/932: write d3/dc/df/d23/d6a/db6/f10b [2538410,48664] 0 2024-08-19T00:56:33.779 INFO:tasks.workunit.client.0.smithi017.stdout:2/973: fdatasync d2/d7/d29/f31 0 2024-08-19T00:56:33.781 INFO:tasks.workunit.client.0.smithi017.stdout:6/934: truncate d5/d13/d11/d52/fb8 419440 0 2024-08-19T00:56:33.783 INFO:tasks.workunit.client.0.smithi017.stdout:6/935: write d5/d13/d11/d52/fb2 [1196799,20388] 0 2024-08-19T00:56:33.787 INFO:tasks.workunit.client.0.smithi017.stdout:2/974: mkdir d2/d7/d10/d3b/d80/da2/db7/d133 0 2024-08-19T00:56:33.787 INFO:tasks.workunit.client.0.smithi017.stdout:7/933: dwrite d3/dc/df/d37/d46/d73/d80/d81/f99 [0,4194304] 0 2024-08-19T00:56:33.791 INFO:tasks.workunit.client.0.smithi017.stdout:4/866: creat d2/d87/db2/de6/d53/d57/f128 x:0 0 0 2024-08-19T00:56:33.793 INFO:tasks.workunit.client.0.smithi017.stdout:6/936: creat d5/d13/d11/d2c/d118/f13d x:0 0 0 2024-08-19T00:56:33.795 INFO:tasks.workunit.client.0.smithi017.stdout:4/867: dread d2/d87/dbc/fe0 [0,4194304] 0 2024-08-19T00:56:33.797 INFO:tasks.workunit.client.0.smithi017.stdout:2/975: dwrite d2/d7/d10/d35/d45/d58/f10e [0,4194304] 0 2024-08-19T00:56:33.798 INFO:tasks.workunit.client.0.smithi017.stdout:7/934: getdents d3/dc/df/d1c 0 2024-08-19T00:56:33.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/868: mknod d2/d1a/da1/c129 0 2024-08-19T00:56:33.800 INFO:tasks.workunit.client.0.smithi017.stdout:7/935: readlink d3/dc/df/dd1/dd7/le8 0 2024-08-19T00:56:33.802 INFO:tasks.workunit.client.0.smithi017.stdout:7/936: rename d3 to d3/dc/df/d23/d69/dd8/d131 22 2024-08-19T00:56:33.806 INFO:tasks.workunit.client.0.smithi017.stdout:6/937: creat d5/f13e x:0 0 0 2024-08-19T00:56:33.809 INFO:tasks.workunit.client.0.smithi017.stdout:7/937: creat d3/dc/df/d3d/f132 x:0 0 0 2024-08-19T00:56:33.810 INFO:tasks.workunit.client.0.smithi017.stdout:2/976: write d2/d7/f6a [1668945,87107] 0 2024-08-19T00:56:33.812 INFO:tasks.workunit.client.0.smithi017.stdout:6/938: mkdir d5/d13/d20/d77/d99/d13f 0 2024-08-19T00:56:33.814 INFO:tasks.workunit.client.0.smithi017.stdout:2/977: mkdir d2/d7/d10/d19/d134 0 2024-08-19T00:56:33.816 INFO:tasks.workunit.client.0.smithi017.stdout:6/939: creat d5/d13/d11/d2c/d4a/da8/dd1/f140 x:0 0 0 2024-08-19T00:56:33.817 INFO:tasks.workunit.client.0.smithi017.stdout:4/869: write d2/d11/f33 [848992,69672] 0 2024-08-19T00:56:33.820 INFO:tasks.workunit.client.0.smithi017.stdout:3/845: sync 2024-08-19T00:56:33.820 INFO:tasks.workunit.client.0.smithi017.stdout:5/647: sync 2024-08-19T00:56:33.820 INFO:tasks.workunit.client.0.smithi017.stdout:7/938: rmdir d3/dc/df/d1c/d2c/d2f/d129 0 2024-08-19T00:56:33.821 INFO:tasks.workunit.client.0.smithi017.stdout:4/870: read d2/d11/dd6/f108 [1767,40081] 0 2024-08-19T00:56:33.823 INFO:tasks.workunit.client.0.smithi017.stdout:2/978: link d2/d7/d29/c74 d2/d7/d10/d35/d45/d58/dbf/d7a/d106/c135 0 2024-08-19T00:56:33.827 INFO:tasks.workunit.client.0.smithi017.stdout:3/846: dwrite d5/da/d3c/fc3 [0,4194304] 0 2024-08-19T00:56:33.835 INFO:tasks.workunit.client.0.smithi017.stdout:2/979: mkdir d2/d7/d10/d3b/d80/da2/d136 0 2024-08-19T00:56:33.835 INFO:tasks.workunit.client.0.smithi017.stdout:3/847: dread d5/da/f7d [0,4194304] 0 2024-08-19T00:56:33.837 INFO:tasks.workunit.client.0.smithi017.stdout:3/848: chown d5/da/d27/d28/f96 0 1 2024-08-19T00:56:33.837 INFO:tasks.workunit.client.0.smithi017.stdout:5/648: write db/d19/d1f/d15/d3e/d40/d49/d63/f8c [636102,100934] 0 2024-08-19T00:56:33.839 INFO:tasks.workunit.client.0.smithi017.stdout:5/649: stat db/d19/d1f/d15/d3e/d40/d49/d63/c7d 0 2024-08-19T00:56:33.840 INFO:tasks.workunit.client.0.smithi017.stdout:3/849: dread - d5/fba zero size 2024-08-19T00:56:33.842 INFO:tasks.workunit.client.0.smithi017.stdout:3/850: chown d5/da/d3c/d4f/d109/d99 38291 1 2024-08-19T00:56:33.843 INFO:tasks.workunit.client.0.smithi017.stdout:2/980: rename d2/d7/d10/d3b/d3c/d8a/feb to d2/dc5/dca/f137 0 2024-08-19T00:56:33.845 INFO:tasks.workunit.client.0.smithi017.stdout:7/939: getdents d3/dc/df/d37/d46/d73/d80/d81 0 2024-08-19T00:56:33.845 INFO:tasks.workunit.client.0.smithi017.stdout:7/940: stat d3/dc/df/l47 0 2024-08-19T00:56:33.846 INFO:tasks.workunit.client.0.smithi017.stdout:5/650: write db/d19/d1f/d15/d30/f46 [4108143,113798] 0 2024-08-19T00:56:33.847 INFO:tasks.workunit.client.0.smithi017.stdout:7/941: write d3/dc/df/d37/d93/da7/f10d [2506726,55687] 0 2024-08-19T00:56:33.849 INFO:tasks.workunit.client.0.smithi017.stdout:3/851: truncate d5/d11/f85 2610014 0 2024-08-19T00:56:33.855 INFO:tasks.workunit.client.0.smithi017.stdout:3/852: rmdir d5/da/d3c/d4f/d109/d99 39 2024-08-19T00:56:33.857 INFO:tasks.workunit.client.0.smithi017.stdout:3/853: write d5/da/d3c/de4/d92/fa8 [8912743,12185] 0 2024-08-19T00:56:33.858 INFO:tasks.workunit.client.0.smithi017.stdout:4/871: dread d2/d1a/d55/d73/d121/ff1 [0,4194304] 0 2024-08-19T00:56:33.859 INFO:tasks.workunit.client.0.smithi017.stdout:5/651: truncate db/d19/d1f/dbd/f53 4551441 0 2024-08-19T00:56:33.860 INFO:tasks.workunit.client.0.smithi017.stdout:5/652: chown db/d19/d1f/d15/d3e/d40/d83 1321053888 1 2024-08-19T00:56:33.861 INFO:tasks.workunit.client.0.smithi017.stdout:4/872: write d2/d87/db2/de6/d40/d56/d99/da3/ffa [837655,105638] 0 2024-08-19T00:56:33.867 INFO:tasks.workunit.client.0.smithi017.stdout:3/854: unlink d5/d18/cb4 0 2024-08-19T00:56:33.868 INFO:tasks.workunit.client.0.smithi017.stdout:5/653: dwrite db/d19/d1f/d15/d1e/f3f [0,4194304] 0 2024-08-19T00:56:33.870 INFO:tasks.workunit.client.0.smithi017.stdout:2/981: link d2/d7/d10/d19/dc7/c112 d2/d7/d10/d3b/d3c/d8a/c138 0 2024-08-19T00:56:33.874 INFO:tasks.workunit.client.0.smithi017.stdout:4/873: write d2/d87/db2/de6/d40/ffc [3708587,12624] 0 2024-08-19T00:56:33.876 INFO:tasks.workunit.client.0.smithi017.stdout:2/982: read d2/d7/d10/d3b/d3c/fc3 [2952350,81740] 0 2024-08-19T00:56:33.876 INFO:tasks.workunit.client.0.smithi017.stdout:3/855: dwrite d5/da/d27/d6e/fb1 [4194304,4194304] 0 2024-08-19T00:56:33.877 INFO:tasks.workunit.client.0.smithi017.stdout:5/654: fsync db/d19/d8d/fa5 0 2024-08-19T00:56:33.882 INFO:tasks.workunit.client.0.smithi017.stdout:2/983: mkdir d2/d7/d10/d3b/d80/da2/db7/d139 0 2024-08-19T00:56:33.883 INFO:tasks.workunit.client.0.smithi017.stdout:7/942: dread d3/dc/df/d1c/d2c/d83/fcf [0,4194304] 0 2024-08-19T00:56:33.886 INFO:tasks.workunit.client.0.smithi017.stdout:5/655: creat db/d19/d1f/d15/d1e/d5f/fe2 x:0 0 0 2024-08-19T00:56:33.889 INFO:tasks.workunit.client.0.smithi017.stdout:2/984: readlink d2/d7/d10/d3b/d3c/df5/d10d/l5a 0 2024-08-19T00:56:33.890 INFO:tasks.workunit.client.0.smithi017.stdout:5/656: symlink db/d19/d1f/d15/d3e/d40/d83/le3 0 2024-08-19T00:56:33.890 INFO:tasks.workunit.client.0.smithi017.stdout:7/943: symlink d3/dc/df/d1c/d2c/dfd/l133 0 2024-08-19T00:56:33.891 INFO:tasks.workunit.client.0.smithi017.stdout:7/944: stat d3/dc/f12c 0 2024-08-19T00:56:33.893 INFO:tasks.workunit.client.0.smithi017.stdout:5/657: unlink db/d19/d8d/cab 0 2024-08-19T00:56:33.895 INFO:tasks.workunit.client.0.smithi017.stdout:7/945: mkdir d3/dc/df/d1c/d134 0 2024-08-19T00:56:33.897 INFO:tasks.workunit.client.0.smithi017.stdout:4/874: dread d2/d11/f9c [0,4194304] 0 2024-08-19T00:56:33.897 INFO:tasks.workunit.client.0.smithi017.stdout:5/658: dread - db/d19/d8d/f94 zero size 2024-08-19T00:56:33.900 INFO:tasks.workunit.client.0.smithi017.stdout:5/659: chown db/f2a 16468362 1 2024-08-19T00:56:33.903 INFO:tasks.workunit.client.0.smithi017.stdout:7/946: dread d3/d3c/ff2 [0,4194304] 0 2024-08-19T00:56:33.903 INFO:tasks.workunit.client.0.smithi017.stdout:3/856: dwrite d5/da/d3c/d4f/fc1 [0,4194304] 0 2024-08-19T00:56:33.905 INFO:tasks.workunit.client.0.smithi017.stdout:5/660: mknod db/d19/d57/ce4 0 2024-08-19T00:56:33.909 INFO:tasks.workunit.client.0.smithi017.stdout:4/875: rename d2/d87/db2/de6/d40/d8b to d2/d87/db2/de6/d40/d56/d99/d106/d12a 0 2024-08-19T00:56:33.910 INFO:tasks.workunit.client.0.smithi017.stdout:7/947: chown d3/dc/df/c10e 2758 1 2024-08-19T00:56:33.912 INFO:tasks.workunit.client.0.smithi017.stdout:5/661: fdatasync db/d19/f95 0 2024-08-19T00:56:33.913 INFO:tasks.workunit.client.0.smithi017.stdout:3/857: mkdir d5/da/d3c/d4f/d109/d99/d111 0 2024-08-19T00:56:33.915 INFO:tasks.workunit.client.0.smithi017.stdout:5/662: stat db/cc 0 2024-08-19T00:56:33.917 INFO:tasks.workunit.client.0.smithi017.stdout:5/663: creat db/d19/daa/fe5 x:0 0 0 2024-08-19T00:56:33.918 INFO:tasks.workunit.client.0.smithi017.stdout:5/664: fdatasync f7 0 2024-08-19T00:56:33.919 INFO:tasks.workunit.client.0.smithi017.stdout:5/665: fsync db/d19/d1f/d15/d1e/fcd 0 2024-08-19T00:56:33.921 INFO:tasks.workunit.client.0.smithi017.stdout:3/858: creat d5/da/d27/d6e/df3/f112 x:0 0 0 2024-08-19T00:56:33.925 INFO:tasks.workunit.client.0.smithi017.stdout:5/666: unlink db/d19/f95 0 2024-08-19T00:56:33.927 INFO:tasks.workunit.client.0.smithi017.stdout:4/876: truncate d2/d87/db2/de6/d40/d56/f7d 344913 0 2024-08-19T00:56:33.931 INFO:tasks.workunit.client.0.smithi017.stdout:4/877: mknod d2/d87/db2/de6/d40/d56/d95/dae/c12b 0 2024-08-19T00:56:33.931 INFO:tasks.workunit.client.0.smithi017.stdout:0/762: sync 2024-08-19T00:56:33.931 INFO:tasks.workunit.client.0.smithi017.stdout:8/845: sync 2024-08-19T00:56:33.931 INFO:tasks.workunit.client.0.smithi017.stdout:1/946: sync 2024-08-19T00:56:33.933 INFO:tasks.workunit.client.0.smithi017.stdout:0/763: stat d5/d17/d26/d30/d5d/db0/fa6 0 2024-08-19T00:56:33.934 INFO:tasks.workunit.client.0.smithi017.stdout:4/878: creat d2/d1a/d55/d8f/f12c x:0 0 0 2024-08-19T00:56:33.935 INFO:tasks.workunit.client.0.smithi017.stdout:8/846: mkdir de/d15/d4f/d68/d84/dc8/d108 0 2024-08-19T00:56:33.936 INFO:tasks.workunit.client.0.smithi017.stdout:3/859: dread d5/da/d3c/de4/d92/dca/feb [0,4194304] 0 2024-08-19T00:56:33.936 INFO:tasks.workunit.client.0.smithi017.stdout:1/947: symlink d4/dc/d17/dd6/d1f/da5/l12b 0 2024-08-19T00:56:33.938 INFO:tasks.workunit.client.0.smithi017.stdout:4/879: rmdir d2/d1a/dd0 39 2024-08-19T00:56:33.938 INFO:tasks.workunit.client.0.smithi017.stdout:3/860: fdatasync d5/da/d3c/de4/d1b/f7b 0 2024-08-19T00:56:33.945 INFO:tasks.workunit.client.0.smithi017.stdout:4/880: dwrite d2/d1a/d55/d73/da6/ffe [0,4194304] 0 2024-08-19T00:56:33.947 INFO:tasks.workunit.client.0.smithi017.stdout:0/764: link d5/d17/d26/d30/c6d d5/d17/d21/d42/d9b/dd8/c102 0 2024-08-19T00:56:33.950 INFO:tasks.workunit.client.0.smithi017.stdout:1/948: mkdir d4/dc/d17/dd6/d75/d9c/d12a/d12c 0 2024-08-19T00:56:33.950 INFO:tasks.workunit.client.0.smithi017.stdout:8/847: write de/d15/d4f/d68/d84/f9a [2481884,48897] 0 2024-08-19T00:56:33.952 INFO:tasks.workunit.client.0.smithi017.stdout:1/949: readlink d4/dc/d17/dd6/d75/d9c/ddb/da6/lbd 0 2024-08-19T00:56:33.953 INFO:tasks.workunit.client.0.smithi017.stdout:0/765: fdatasync d5/d17/d2b/f43 0 2024-08-19T00:56:33.955 INFO:tasks.workunit.client.0.smithi017.stdout:4/881: mkdir d2/df7/d12d 0 2024-08-19T00:56:33.960 INFO:tasks.workunit.client.0.smithi017.stdout:1/950: unlink d4/dc/d19/f105 0 2024-08-19T00:56:33.964 INFO:tasks.workunit.client.0.smithi017.stdout:3/861: dwrite d5/da/f3f [4194304,4194304] 0 2024-08-19T00:56:33.964 INFO:tasks.workunit.client.0.smithi017.stdout:4/882: mkdir d2/dc1/d12e 0 2024-08-19T00:56:33.967 INFO:tasks.workunit.client.0.smithi017.stdout:8/848: unlink de/d36/d74/d80/cf3 0 2024-08-19T00:56:33.968 INFO:tasks.workunit.client.0.smithi017.stdout:8/849: readlink de/d15/d4f/dcc/lab 0 2024-08-19T00:56:33.970 INFO:tasks.workunit.client.0.smithi017.stdout:0/766: mknod d5/d18/c103 0 2024-08-19T00:56:33.973 INFO:tasks.workunit.client.0.smithi017.stdout:4/883: mkdir d2/d1a/da1/d12f 0 2024-08-19T00:56:33.977 INFO:tasks.workunit.client.0.smithi017.stdout:0/767: fdatasync d5/d17/d21/d42/f86 0 2024-08-19T00:56:33.980 INFO:tasks.workunit.client.0.smithi017.stdout:4/884: creat d2/d87/db2/de6/d40/d56/d99/d106/d12a/d100/f130 x:0 0 0 2024-08-19T00:56:33.980 INFO:tasks.workunit.client.0.smithi017.stdout:1/951: link d4/dc/d17/dd6/d1f/c2c d4/d78/c12d 0 2024-08-19T00:56:33.981 INFO:tasks.workunit.client.0.smithi017.stdout:4/885: read - d2/d87/db2/de6/d40/d56/d95/fe9 zero size 2024-08-19T00:56:33.982 INFO:tasks.workunit.client.0.smithi017.stdout:4/886: write d2/d87/db2/de6/d40/f112 [527057,8506] 0 2024-08-19T00:56:33.984 INFO:tasks.workunit.client.0.smithi017.stdout:3/862: write d5/d11/f3e [8076619,71548] 0 2024-08-19T00:56:33.986 INFO:tasks.workunit.client.0.smithi017.stdout:1/952: rmdir d4/dc/d3b/d3d 39 2024-08-19T00:56:33.989 INFO:tasks.workunit.client.0.smithi017.stdout:4/887: rename d2/d87/db2/de6/d40/d56/d99/d106/d107 to d2/d87/db2/de6/d102/d131 0 2024-08-19T00:56:33.990 INFO:tasks.workunit.client.0.smithi017.stdout:3/863: chown d5/f60 563 1 2024-08-19T00:56:33.993 INFO:tasks.workunit.client.0.smithi017.stdout:0/768: creat d5/d17/d26/f104 x:0 0 0 2024-08-19T00:56:33.996 INFO:tasks.workunit.client.0.smithi017.stdout:3/864: stat d5/da/d3c/de4/l70 0 2024-08-19T00:56:33.997 INFO:tasks.workunit.client.0.smithi017.stdout:3/865: write d5/da/d3c/de4/d92/fc0 [12972849,103843] 0 2024-08-19T00:56:33.999 INFO:tasks.workunit.client.0.smithi017.stdout:4/888: getdents d2/df7/d12d 0 2024-08-19T00:56:34.000 INFO:tasks.workunit.client.0.smithi017.stdout:1/953: rmdir d4/dc/d3b/d3d/d54 39 2024-08-19T00:56:34.000 INFO:tasks.workunit.client.0.smithi017.stdout:4/889: write d2/d87/db2/de6/d40/fea [1367799,78432] 0 2024-08-19T00:56:34.001 INFO:tasks.workunit.client.0.smithi017.stdout:1/954: chown d4/dc/cfe 189350609 1 2024-08-19T00:56:34.002 INFO:tasks.workunit.client.0.smithi017.stdout:0/769: mknod d5/d17/d45/c105 0 2024-08-19T00:56:34.004 INFO:tasks.workunit.client.0.smithi017.stdout:3/866: symlink d5/da/d3c/de4/d92/d10a/l113 0 2024-08-19T00:56:34.004 INFO:tasks.workunit.client.0.smithi017.stdout:3/867: chown d5/da/d3c/d4f/d109/df2 159216359 1 2024-08-19T00:56:34.005 INFO:tasks.workunit.client.0.smithi017.stdout:3/868: readlink d5/da/d3c/l41 0 2024-08-19T00:56:34.005 INFO:tasks.workunit.client.0.smithi017.stdout:3/869: readlink d5/da/le6 0 2024-08-19T00:56:34.005 INFO:tasks.workunit.client.0.smithi017.stdout:4/890: creat d2/d87/db2/de6/d40/d56/d99/d106/f132 x:0 0 0 2024-08-19T00:56:34.006 INFO:tasks.workunit.client.0.smithi017.stdout:0/770: rmdir d5/d17/d45 39 2024-08-19T00:56:34.007 INFO:tasks.workunit.client.0.smithi017.stdout:1/955: rmdir d4/dc/d17/dd6/d1f/da5 39 2024-08-19T00:56:34.009 INFO:tasks.workunit.client.0.smithi017.stdout:0/771: write d5/d17/d21/f68 [1482702,21535] 0 2024-08-19T00:56:34.009 INFO:tasks.workunit.client.0.smithi017.stdout:4/891: truncate d2/d16/f5b 1301522 0 2024-08-19T00:56:34.013 INFO:tasks.workunit.client.0.smithi017.stdout:4/892: mknod d2/d1a/d55/d73/c133 0 2024-08-19T00:56:34.018 INFO:tasks.workunit.client.0.smithi017.stdout:3/870: link d5/da/d3c/d4f/d109/d9e/cec d5/da/d3c/d4f/d109/d9e/de1/c114 0 2024-08-19T00:56:34.019 INFO:tasks.workunit.client.0.smithi017.stdout:3/871: readlink d5/da/d3c/de4/l70 0 2024-08-19T00:56:34.020 INFO:tasks.workunit.client.0.smithi017.stdout:0/772: creat d5/f106 x:0 0 0 2024-08-19T00:56:34.022 INFO:tasks.workunit.client.0.smithi017.stdout:4/893: link d2/d87/db2/de6/d40/d56/dbb/f10d d2/d1a/d55/d73/f134 0 2024-08-19T00:56:34.025 INFO:tasks.workunit.client.0.smithi017.stdout:1/956: write d4/dc/d3b/d3d/f87 [290873,31702] 0 2024-08-19T00:56:34.026 INFO:tasks.workunit.client.0.smithi017.stdout:4/894: creat d2/d87/db2/db5/f135 x:0 0 0 2024-08-19T00:56:34.028 INFO:tasks.workunit.client.0.smithi017.stdout:3/872: mknod d5/da/d3c/de4/c115 0 2024-08-19T00:56:34.029 INFO:tasks.workunit.client.0.smithi017.stdout:3/873: write d5/d11/f16 [31803,105908] 0 2024-08-19T00:56:34.035 INFO:tasks.workunit.client.0.smithi017.stdout:4/895: dread d2/d87/db2/de6/f42 [0,4194304] 0 2024-08-19T00:56:34.036 INFO:tasks.workunit.client.0.smithi017.stdout:1/957: symlink d4/dc/d17/dd6/l12e 0 2024-08-19T00:56:34.037 INFO:tasks.workunit.client.0.smithi017.stdout:0/773: write d5/f16 [3526907,41373] 0 2024-08-19T00:56:34.043 INFO:tasks.workunit.client.0.smithi017.stdout:0/774: fsync d5/d17/d45/d50/f96 0 2024-08-19T00:56:34.043 INFO:tasks.workunit.client.0.smithi017.stdout:4/896: fdatasync d2/d11/f59 0 2024-08-19T00:56:34.044 INFO:tasks.workunit.client.0.smithi017.stdout:3/874: dwrite d5/da/d3c/d4f/f94 [0,4194304] 0 2024-08-19T00:56:34.045 INFO:tasks.workunit.client.0.smithi017.stdout:0/775: stat d5/d17/d26/d30/d3e/l7f 0 2024-08-19T00:56:34.047 INFO:tasks.workunit.client.0.smithi017.stdout:0/776: write d5/da4/ddc/fea [419382,31836] 0 2024-08-19T00:56:34.048 INFO:tasks.workunit.client.0.smithi017.stdout:1/958: link d4/dc/d17/dd6/d75/f109 d4/dc/d3b/d3d/d54/f12f 0 2024-08-19T00:56:34.049 INFO:tasks.workunit.client.0.smithi017.stdout:3/875: creat d5/da/d3c/d4f/d109/d9e/f116 x:0 0 0 2024-08-19T00:56:34.050 INFO:tasks.workunit.client.0.smithi017.stdout:4/897: truncate d2/d87/db2/de6/d53/d57/f128 452214 0 2024-08-19T00:56:34.054 INFO:tasks.workunit.client.0.smithi017.stdout:1/959: rename d4/dc/d3b/d3d/l56 to d4/dc/d17/d1d/l130 0 2024-08-19T00:56:34.056 INFO:tasks.workunit.client.0.smithi017.stdout:4/898: write d2/d11/d24/dc6/f101 [274546,20513] 0 2024-08-19T00:56:34.060 INFO:tasks.workunit.client.0.smithi017.stdout:3/876: getdents d5/da/d3c/de4/d1b/d102 0 2024-08-19T00:56:34.061 INFO:tasks.workunit.client.0.smithi017.stdout:0/777: getdents d5/d17/d21/d42/d9b 0 2024-08-19T00:56:34.063 INFO:tasks.workunit.client.0.smithi017.stdout:3/877: readlink d5/da/l5d 0 2024-08-19T00:56:34.067 INFO:tasks.workunit.client.0.smithi017.stdout:0/778: mknod d5/d17/d26/d30/d5d/dce/c107 0 2024-08-19T00:56:34.070 INFO:tasks.workunit.client.0.smithi017.stdout:3/878: rename d5/da/d3c/d4f/d109/d9e/de1 to d5/d18/dab/d117 0 2024-08-19T00:56:34.072 INFO:tasks.workunit.client.0.smithi017.stdout:0/779: unlink d5/d17/d21/l7c 0 2024-08-19T00:56:34.073 INFO:tasks.workunit.client.0.smithi017.stdout:1/960: dwrite d4/fc6 [0,4194304] 0 2024-08-19T00:56:34.075 INFO:tasks.workunit.client.0.smithi017.stdout:4/899: dread d2/d11/f72 [0,4194304] 0 2024-08-19T00:56:34.077 INFO:tasks.workunit.client.0.smithi017.stdout:3/879: creat d5/da/d3c/d4f/d109/df2/f118 x:0 0 0 2024-08-19T00:56:34.081 INFO:tasks.workunit.client.0.smithi017.stdout:0/780: rename d5/d17/d26/d30/d5d/c9d to d5/d17/d26/d30/d5d/c108 0 2024-08-19T00:56:34.082 INFO:tasks.workunit.client.0.smithi017.stdout:0/781: chown d5/d17/d21 473052 1 2024-08-19T00:56:34.084 INFO:tasks.workunit.client.0.smithi017.stdout:4/900: symlink d2/d87/db2/de6/d40/l136 0 2024-08-19T00:56:34.085 INFO:tasks.workunit.client.0.smithi017.stdout:3/880: chown d5/da/d27/l66 33 1 2024-08-19T00:56:34.087 INFO:tasks.workunit.client.0.smithi017.stdout:0/782: mknod d5/d18/d3a/c109 0 2024-08-19T00:56:34.087 INFO:tasks.workunit.client.0.smithi017.stdout:3/881: read d5/da/d27/d28/f80 [3771119,96137] 0 2024-08-19T00:56:34.089 INFO:tasks.workunit.client.0.smithi017.stdout:4/901: chown d2/d87/db2/de6/d53/lff 5 1 2024-08-19T00:56:34.093 INFO:tasks.workunit.client.0.smithi017.stdout:3/882: creat d5/da/d3c/de4/d1b/d102/f119 x:0 0 0 2024-08-19T00:56:34.095 INFO:tasks.workunit.client.0.smithi017.stdout:3/883: creat d5/da/d27/d28/f11a x:0 0 0 2024-08-19T00:56:34.178 INFO:tasks.workunit.client.0.smithi017.stdout:3/884: mkdir d5/da/d3c/d4f/d109/d11b 0 2024-08-19T00:56:34.178 INFO:tasks.workunit.client.0.smithi017.stdout:1/961: dwrite d4/dc/d3b/fd2 [0,4194304] 0 2024-08-19T00:56:34.179 INFO:tasks.workunit.client.0.smithi017.stdout:0/783: dread d5/d17/d26/d30/f54 [0,4194304] 0 2024-08-19T00:56:34.182 INFO:tasks.workunit.client.0.smithi017.stdout:3/885: mkdir d5/da/d3c/de4/d11c 0 2024-08-19T00:56:34.185 INFO:tasks.workunit.client.0.smithi017.stdout:3/886: dread - d5/da/d3c/d4f/d109/d9e/f116 zero size 2024-08-19T00:56:34.187 INFO:tasks.workunit.client.0.smithi017.stdout:0/784: dwrite d5/f11 [4194304,4194304] 0 2024-08-19T00:56:34.190 INFO:tasks.workunit.client.0.smithi017.stdout:3/887: truncate d5/d11/fbb 743175 0 2024-08-19T00:56:34.194 INFO:tasks.workunit.client.0.smithi017.stdout:0/785: mkdir d5/d10a 0 2024-08-19T00:56:34.196 INFO:tasks.workunit.client.0.smithi017.stdout:0/786: readlink d5/d17/d26/d30/d3e/d81/dca/ld4 0 2024-08-19T00:56:34.212 INFO:tasks.workunit.client.0.smithi017.stdout:0/787: dread d5/d17/d45/f8f [0,4194304] 0 2024-08-19T00:56:34.212 INFO:tasks.workunit.client.0.smithi017.stdout:1/962: truncate d4/dc/d17/d1d/f1e 3332245 0 2024-08-19T00:56:34.213 INFO:tasks.workunit.client.0.smithi017.stdout:0/788: write d5/d17/d21/f68 [4297896,90575] 0 2024-08-19T00:56:34.217 INFO:tasks.workunit.client.0.smithi017.stdout:0/789: creat d5/da4/ddc/f10b x:0 0 0 2024-08-19T00:56:34.219 INFO:tasks.workunit.client.0.smithi017.stdout:3/888: write d5/da/d3c/f50 [1316023,45556] 0 2024-08-19T00:56:34.221 INFO:tasks.workunit.client.0.smithi017.stdout:0/790: unlink d5/d17/d21/d42/d9b/fdd 0 2024-08-19T00:56:34.221 INFO:tasks.workunit.client.0.smithi017.stdout:0/791: fdatasync d5/d17/d45/d50/f96 0 2024-08-19T00:56:34.222 INFO:tasks.workunit.client.0.smithi017.stdout:1/963: getdents d4/dc/d17/dad/ded 0 2024-08-19T00:56:34.223 INFO:tasks.workunit.client.0.smithi017.stdout:3/889: fsync d5/da/d27/f6d 0 2024-08-19T00:56:34.227 INFO:tasks.workunit.client.0.smithi017.stdout:0/792: creat d5/d17/d21/d42/d9b/dd8/f10c x:0 0 0 2024-08-19T00:56:34.230 INFO:tasks.workunit.client.0.smithi017.stdout:1/964: read d4/dc/d3b/d45/f91 [139655,117159] 0 2024-08-19T00:56:34.231 INFO:tasks.workunit.client.0.smithi017.stdout:1/965: chown d4/dc/d3b/d3d/d54/f12f 21 1 2024-08-19T00:56:34.231 INFO:tasks.workunit.client.0.smithi017.stdout:0/793: unlink d5/d17/d21/d42/d9b/dd8/c101 0 2024-08-19T00:56:34.233 INFO:tasks.workunit.client.0.smithi017.stdout:0/794: write d5/d17/d26/d30/d5d/db0/fa6 [3455058,107368] 0 2024-08-19T00:56:34.234 INFO:tasks.workunit.client.0.smithi017.stdout:1/966: mkdir d4/d78/d131 0 2024-08-19T00:56:34.236 INFO:tasks.workunit.client.0.smithi017.stdout:0/795: chown d5/d18/d78/lb4 382887304 1 2024-08-19T00:56:34.236 INFO:tasks.workunit.client.0.smithi017.stdout:0/796: chown d5/d18/c103 5265502 1 2024-08-19T00:56:34.238 INFO:tasks.workunit.client.0.smithi017.stdout:1/967: mknod d4/dc/d3b/d3d/d83/d95/de8/c132 0 2024-08-19T00:56:34.238 INFO:tasks.workunit.client.0.smithi017.stdout:3/890: getdents d5 0 2024-08-19T00:56:34.240 INFO:tasks.workunit.client.0.smithi017.stdout:0/797: rename d5/d17/d26/fe0 to d5/d18/d78/dbc/f10d 0 2024-08-19T00:56:34.242 INFO:tasks.workunit.client.0.smithi017.stdout:1/968: creat d4/dc/d3b/d3d/d83/d95/de8/f133 x:0 0 0 2024-08-19T00:56:34.246 INFO:tasks.workunit.client.0.smithi017.stdout:3/891: dwrite d5/da/d3c/ff4 [0,4194304] 0 2024-08-19T00:56:34.252 INFO:tasks.workunit.client.0.smithi017.stdout:1/969: creat d4/dc/d17/dd6/d1f/f134 x:0 0 0 2024-08-19T00:56:34.254 INFO:tasks.workunit.client.0.smithi017.stdout:3/892: mkdir d5/d11/d61/d11d 0 2024-08-19T00:56:34.258 INFO:tasks.workunit.client.0.smithi017.stdout:1/970: dread - d4/dc/d3b/d9d/ff0 zero size 2024-08-19T00:56:34.258 INFO:tasks.workunit.client.0.smithi017.stdout:3/893: truncate d5/da/d27/d6e/df3/f112 119586 0 2024-08-19T00:56:34.258 INFO:tasks.workunit.client.0.smithi017.stdout:0/798: dwrite d5/d17/d21/d42/d9b/dd8/fde [4194304,4194304] 0 2024-08-19T00:56:34.261 INFO:tasks.workunit.client.0.smithi017.stdout:0/799: chown d5/d17/d45/d50/l51 51 1 2024-08-19T00:56:34.262 INFO:tasks.workunit.client.0.smithi017.stdout:1/971: fsync d4/dc/d3b/f80 0 2024-08-19T00:56:34.263 INFO:tasks.workunit.client.0.smithi017.stdout:3/894: symlink d5/da/d27/d6e/df3/l11e 0 2024-08-19T00:56:34.265 INFO:tasks.workunit.client.0.smithi017.stdout:0/800: symlink d5/d18/d3a/dc1/l10e 0 2024-08-19T00:56:34.272 INFO:tasks.workunit.client.0.smithi017.stdout:0/801: dwrite d5/d17/d26/d30/f58 [4194304,4194304] 0 2024-08-19T00:56:34.274 INFO:tasks.workunit.client.0.smithi017.stdout:1/972: creat d4/dc/d3b/f135 x:0 0 0 2024-08-19T00:56:34.291 INFO:tasks.workunit.client.0.smithi017.stdout:3/895: dwrite d5/fc6 [0,4194304] 0 2024-08-19T00:56:34.291 INFO:tasks.workunit.client.0.smithi017.stdout:1/973: write d4/dc/d3b/d3d/d83/d95/fb9 [638249,33049] 0 2024-08-19T00:56:34.291 INFO:tasks.workunit.client.0.smithi017.stdout:0/802: dwrite d5/d18/d78/f88 [0,4194304] 0 2024-08-19T00:56:34.297 INFO:tasks.workunit.client.0.smithi017.stdout:1/974: read - d4/dc/d3b/d3d/d83/d95/dca/df3/ff6 zero size 2024-08-19T00:56:34.298 INFO:tasks.workunit.client.0.smithi017.stdout:3/896: dread d5/da/d3c/d4f/d109/d9e/fb8 [0,4194304] 0 2024-08-19T00:56:34.299 INFO:tasks.workunit.client.0.smithi017.stdout:1/975: read d4/dc/d17/dd6/d75/d9c/ddb/da6/db8/f115 [30041,111963] 0 2024-08-19T00:56:34.300 INFO:tasks.workunit.client.0.smithi017.stdout:1/976: dread - d4/ff4 zero size 2024-08-19T00:56:34.304 INFO:tasks.workunit.client.0.smithi017.stdout:1/977: mkdir d4/dc/d3b/d9d/d136 0 2024-08-19T00:56:34.306 INFO:tasks.workunit.client.0.smithi017.stdout:1/978: write d4/dc/d17/dd6/d75/d9c/ddb/ff1 [184129,87311] 0 2024-08-19T00:56:34.309 INFO:tasks.workunit.client.0.smithi017.stdout:0/803: dread d5/d17/d2b/f74 [0,4194304] 0 2024-08-19T00:56:34.310 INFO:tasks.workunit.client.0.smithi017.stdout:0/804: fdatasync d5/d18/f1e 0 2024-08-19T00:56:34.313 INFO:tasks.workunit.client.0.smithi017.stdout:1/979: dread d4/dc/d17/dd6/d75/d9c/ddb/ff1 [0,4194304] 0 2024-08-19T00:56:34.314 INFO:tasks.workunit.client.0.smithi017.stdout:1/980: chown d4/dc/d17/dd6/lab 3 1 2024-08-19T00:56:34.314 INFO:tasks.workunit.client.0.smithi017.stdout:3/897: write d5/d11/fee [4815249,121203] 0 2024-08-19T00:56:34.315 INFO:tasks.workunit.client.0.smithi017.stdout:0/805: symlink d5/d17/d26/d30/d5d/db0/dc7/l10f 0 2024-08-19T00:56:34.317 INFO:tasks.workunit.client.0.smithi017.stdout:3/898: creat d5/da/d27/d28/f11f x:0 0 0 2024-08-19T00:56:34.318 INFO:tasks.workunit.client.0.smithi017.stdout:3/899: dread - d5/d11/d61/fd9 zero size 2024-08-19T00:56:34.319 INFO:tasks.workunit.client.0.smithi017.stdout:0/806: symlink d5/l110 0 2024-08-19T00:56:34.322 INFO:tasks.workunit.client.0.smithi017.stdout:0/807: truncate d5/d17/d21/f2d 2244371 0 2024-08-19T00:56:34.323 INFO:tasks.workunit.client.0.smithi017.stdout:3/900: creat d5/da/d27/d6e/df3/dfd/f120 x:0 0 0 2024-08-19T00:56:34.326 INFO:tasks.workunit.client.0.smithi017.stdout:1/981: dread d4/f14 [4194304,4194304] 0 2024-08-19T00:56:34.326 INFO:tasks.workunit.client.0.smithi017.stdout:0/808: creat d5/d18/f111 x:0 0 0 2024-08-19T00:56:34.328 INFO:tasks.workunit.client.0.smithi017.stdout:3/901: creat d5/da/d27/d6e/dd0/de0/f121 x:0 0 0 2024-08-19T00:56:34.329 INFO:tasks.workunit.client.0.smithi017.stdout:1/982: mkdir d4/dc/d17/dad/d137 0 2024-08-19T00:56:34.330 INFO:tasks.workunit.client.0.smithi017.stdout:0/809: symlink d5/d18/d3a/dc1/dd5/l112 0 2024-08-19T00:56:34.334 INFO:tasks.workunit.client.0.smithi017.stdout:3/902: mknod d5/da/d3c/d4f/d109/d99/d111/c122 0 2024-08-19T00:56:34.340 INFO:tasks.workunit.client.0.smithi017.stdout:3/903: dread d5/da/f95 [0,4194304] 0 2024-08-19T00:56:34.344 INFO:tasks.workunit.client.0.smithi017.stdout:1/983: rmdir d4/dc/d19/d11d 0 2024-08-19T00:56:34.352 INFO:tasks.workunit.client.0.smithi017.stdout:0/810: dread d5/d17/d26/d30/f38 [0,4194304] 0 2024-08-19T00:56:34.353 INFO:tasks.workunit.client.0.smithi017.stdout:3/904: rmdir d5/da/d3c/d4f/d109/d9e/dda 39 2024-08-19T00:56:34.353 INFO:tasks.workunit.client.0.smithi017.stdout:0/811: rmdir d5/d18/d3a/dc1/dd5 39 2024-08-19T00:56:34.353 INFO:tasks.workunit.client.0.smithi017.stdout:0/812: write d5/d17/f69 [4950363,34938] 0 2024-08-19T00:56:34.353 INFO:tasks.workunit.client.0.smithi017.stdout:3/905: creat d5/da/d3c/d4f/d109/d99/f123 x:0 0 0 2024-08-19T00:56:34.354 INFO:tasks.workunit.client.0.smithi017.stdout:0/813: rename d5/d17/d26/d30/lda to d5/d17/d21/d42/d9b/l113 0 2024-08-19T00:56:34.361 INFO:tasks.workunit.client.0.smithi017.stdout:0/814: unlink d5/d18/d78/dbc/le6 0 2024-08-19T00:56:34.375 INFO:tasks.workunit.client.0.smithi017.stdout:1/984: dwrite d4/dd1/fe2 [0,4194304] 0 2024-08-19T00:56:34.375 INFO:tasks.workunit.client.0.smithi017.stdout:0/815: fdatasync d5/d17/d26/d30/f33 0 2024-08-19T00:56:34.377 INFO:tasks.workunit.client.0.smithi017.stdout:0/816: write d5/da4/ddc/f10b [1026601,85796] 0 2024-08-19T00:56:34.378 INFO:tasks.workunit.client.0.smithi017.stdout:1/985: read d4/dc/d17/dd6/d1f/f99 [184020,118895] 0 2024-08-19T00:56:34.380 INFO:tasks.workunit.client.0.smithi017.stdout:3/906: truncate d5/da/d3c/de4/d92/fc0 2850803 0 2024-08-19T00:56:34.383 INFO:tasks.workunit.client.0.smithi017.stdout:3/907: rmdir d5/da/d3c/d4f/d109/df2 39 2024-08-19T00:56:34.388 INFO:tasks.workunit.client.0.smithi017.stdout:0/817: rename d5/d17/d26/d30/d3e/d81/dca/ld4 to d5/d17/d26/d30/d5d/dce/l114 0 2024-08-19T00:56:34.389 INFO:tasks.workunit.client.0.smithi017.stdout:0/818: readlink d5/d17/d21/d42/l36 0 2024-08-19T00:56:34.391 INFO:tasks.workunit.client.0.smithi017.stdout:3/908: dread d5/da/d3c/d4f/d109/df2/ffe [0,4194304] 0 2024-08-19T00:56:34.391 INFO:tasks.workunit.client.0.smithi017.stdout:3/909: stat d5/d18/dab/d117 0 2024-08-19T00:56:34.394 INFO:tasks.workunit.client.0.smithi017.stdout:1/986: dread d4/dc/d3b/d3d/d54/f12f [0,4194304] 0 2024-08-19T00:56:34.455 INFO:tasks.workunit.client.0.smithi017.stdout:0/819: creat d5/d17/d26/d30/f115 x:0 0 0 2024-08-19T00:56:34.457 INFO:tasks.workunit.client.0.smithi017.stdout:1/987: mkdir d4/dc/d17/dd6/d75/d9c/ddb/d138 0 2024-08-19T00:56:34.461 INFO:tasks.workunit.client.0.smithi017.stdout:1/988: rename d4/dc/d19/f41 to d4/dc/d17/dd6/d75/d9c/ddb/f139 0 2024-08-19T00:56:34.462 INFO:tasks.workunit.client.0.smithi017.stdout:1/989: truncate d4/dc/d17/dd6/d75/f11f 55014 0 2024-08-19T00:56:34.463 INFO:tasks.workunit.client.0.smithi017.stdout:0/820: creat d5/d17/d26/d30/d3e/d81/dca/f116 x:0 0 0 2024-08-19T00:56:34.476 INFO:tasks.workunit.client.0.smithi017.stdout:0/821: write d5/d17/d45/f8f [2404182,20344] 0 2024-08-19T00:56:34.483 INFO:tasks.workunit.client.0.smithi017.stdout:0/822: truncate d5/d17/f69 5076364 0 2024-08-19T00:56:34.485 INFO:tasks.workunit.client.0.smithi017.stdout:0/823: mknod d5/d17/d45/d50/c117 0 2024-08-19T00:56:34.491 INFO:tasks.workunit.client.0.smithi017.stdout:0/824: write d5/d17/d26/d30/f33 [2642032,85090] 0 2024-08-19T00:56:34.493 INFO:tasks.workunit.client.0.smithi017.stdout:0/825: mknod d5/da4/ddc/c118 0 2024-08-19T00:56:34.527 INFO:tasks.workunit.client.0.smithi017.stdout:9/851: sync 2024-08-19T00:56:34.529 INFO:tasks.workunit.client.0.smithi017.stdout:9/852: read d0/d33/d22/d45/d9b/f9e [405564,18918] 0 2024-08-19T00:56:34.532 INFO:tasks.workunit.client.0.smithi017.stdout:0/826: read d5/d17/f1a [7015915,114942] 0 2024-08-19T00:56:34.554 INFO:tasks.workunit.client.0.smithi017.stdout:3/910: dread d5/d11/f34 [0,4194304] 0 2024-08-19T00:56:34.579 INFO:tasks.workunit.client.0.smithi017.stdout:9/853: truncate d0/f3a 393526 0 2024-08-19T00:56:34.615 INFO:tasks.workunit.client.0.smithi017.stdout:3/911: mknod d5/da/d3c/de4/d92/d10a/c124 0 2024-08-19T00:56:34.615 INFO:tasks.workunit.client.0.smithi017.stdout:9/854: unlink d0/cfa 0 2024-08-19T00:56:34.618 INFO:tasks.workunit.client.0.smithi017.stdout:3/912: creat d5/d18/dab/d10c/f125 x:0 0 0 2024-08-19T00:56:34.619 INFO:tasks.workunit.client.0.smithi017.stdout:3/913: chown d5/d11/f62 3842 1 2024-08-19T00:56:34.620 INFO:tasks.workunit.client.0.smithi017.stdout:9/855: dread d0/d33/d22/d5e/ff9 [0,4194304] 0 2024-08-19T00:56:34.627 INFO:tasks.workunit.client.0.smithi017.stdout:3/914: rename d5/da/d3c/d4f/d109/d99/l10d to d5/da/d27/d6e/df3/dfd/l126 0 2024-08-19T00:56:34.630 INFO:tasks.workunit.client.0.smithi017.stdout:3/915: mknod d5/da/d27/d6e/df3/c127 0 2024-08-19T00:56:34.634 INFO:tasks.workunit.client.0.smithi017.stdout:9/856: dread d0/d58/d49/f76 [0,4194304] 0 2024-08-19T00:56:34.638 INFO:tasks.workunit.client.0.smithi017.stdout:9/857: creat d0/d58/d49/ffd x:0 0 0 2024-08-19T00:56:34.639 INFO:tasks.workunit.client.0.smithi017.stdout:9/858: chown d0/d58/d49/d5d/f74 59562 1 2024-08-19T00:56:34.640 INFO:tasks.workunit.client.0.smithi017.stdout:3/916: rmdir d5/da/d3c 39 2024-08-19T00:56:34.641 INFO:tasks.workunit.client.0.smithi017.stdout:9/859: read d0/d33/d22/d85/f91 [194959,75553] 0 2024-08-19T00:56:34.644 INFO:tasks.workunit.client.0.smithi017.stdout:9/860: creat d0/d84/ffe x:0 0 0 2024-08-19T00:56:34.645 INFO:tasks.workunit.client.0.smithi017.stdout:3/917: read - d5/da/d3c/de4/d92/fe8 zero size 2024-08-19T00:56:34.645 INFO:tasks.workunit.client.0.smithi017.stdout:9/861: stat d0/d33/f30 0 2024-08-19T00:56:34.645 INFO:tasks.workunit.client.0.smithi017.stdout:3/918: chown d5/da/d3c/de4/d11c 6439689 1 2024-08-19T00:56:34.646 INFO:tasks.workunit.client.0.smithi017.stdout:9/862: write d0/d58/d49/ffd [417839,90707] 0 2024-08-19T00:56:34.648 INFO:tasks.workunit.client.0.smithi017.stdout:9/863: creat d0/d58/d9f/fff x:0 0 0 2024-08-19T00:56:34.650 INFO:tasks.workunit.client.0.smithi017.stdout:3/919: rename d5/c4e to d5/da/d3c/de4/d92/dca/dfa/c128 0 2024-08-19T00:56:34.659 INFO:tasks.workunit.client.0.smithi017.stdout:3/920: fdatasync d5/da/d3c/de4/d92/fc0 0 2024-08-19T00:56:34.661 INFO:tasks.workunit.client.0.smithi017.stdout:3/921: fdatasync d5/da/d3c/de4/d92/fe8 0 2024-08-19T00:56:34.663 INFO:tasks.workunit.client.0.smithi017.stdout:3/922: rmdir d5/da/d27/d6e/dd0/de0 39 2024-08-19T00:56:34.665 INFO:tasks.workunit.client.0.smithi017.stdout:9/864: dread d0/d33/d22/f42 [0,4194304] 0 2024-08-19T00:56:34.667 INFO:tasks.workunit.client.0.smithi017.stdout:3/923: rename d5/da/d27/fa7 to d5/da/d3c/de4/d92/d10a/f129 0 2024-08-19T00:56:34.670 INFO:tasks.workunit.client.0.smithi017.stdout:9/865: getdents d0/d84/dd8/dfb 0 2024-08-19T00:56:34.671 INFO:tasks.workunit.client.0.smithi017.stdout:3/924: truncate d5/da/fb6 998031 0 2024-08-19T00:56:34.675 INFO:tasks.workunit.client.0.smithi017.stdout:9/866: rmdir d0/d33/d22/d5a/da0 0 2024-08-19T00:56:34.676 INFO:tasks.workunit.client.0.smithi017.stdout:3/925: rename d5/da/d3c/f50 to d5/da/d3c/d4f/f12a 0 2024-08-19T00:56:34.679 INFO:tasks.workunit.client.0.smithi017.stdout:3/926: mkdir d5/da/d3c/d4f/d109/d11b/d12b 0 2024-08-19T00:56:34.685 INFO:tasks.workunit.client.0.smithi017.stdout:3/927: dwrite d5/d11/f16 [0,4194304] 0 2024-08-19T00:56:34.692 INFO:tasks.workunit.client.0.smithi017.stdout:3/928: link d5/da/d3c/de4/d1b/f79 d5/d18/dab/d117/f12c 0 2024-08-19T00:56:34.693 INFO:tasks.workunit.client.0.smithi017.stdout:3/929: chown d5/d11/cad 2428048 1 2024-08-19T00:56:34.696 INFO:tasks.workunit.client.0.smithi017.stdout:3/930: symlink d5/da/d3c/d4f/d109/df2/l12d 0 2024-08-19T00:56:34.698 INFO:tasks.workunit.client.0.smithi017.stdout:3/931: creat d5/da/d27/d28/f12e x:0 0 0 2024-08-19T00:56:34.699 INFO:tasks.workunit.client.0.smithi017.stdout:3/932: chown d5/da/d3c/d4f/d109/df2/ffe 7 1 2024-08-19T00:56:34.715 INFO:tasks.workunit.client.0.smithi017.stdout:3/933: write d5/da/d27/d6e/f9c [565304,59391] 0 2024-08-19T00:56:34.718 INFO:tasks.workunit.client.0.smithi017.stdout:3/934: fdatasync d5/da/d3c/d4f/d109/fe5 0 2024-08-19T00:56:34.724 INFO:tasks.workunit.client.0.smithi017.stdout:3/935: dwrite d5/da/d3c/d4f/f94 [0,4194304] 0 2024-08-19T00:56:34.726 INFO:tasks.workunit.client.0.smithi017.stdout:3/936: chown d5/da/d3c/d4f/d109/d99/f123 88244 1 2024-08-19T00:56:34.734 INFO:tasks.workunit.client.0.smithi017.stdout:3/937: write d5/da/d27/d6e/fef [74406,52828] 0 2024-08-19T00:56:34.737 INFO:tasks.workunit.client.0.smithi017.stdout:3/938: mknod d5/da/d3c/c12f 0 2024-08-19T00:56:34.738 INFO:tasks.workunit.client.0.smithi017.stdout:3/939: truncate d5/da/d27/d28/f12e 654451 0 2024-08-19T00:56:34.745 INFO:tasks.workunit.client.0.smithi017.stdout:3/940: write d5/da/d27/d28/f96 [481147,32604] 0 2024-08-19T00:56:34.748 INFO:tasks.workunit.client.0.smithi017.stdout:3/941: chown d5/d11/f85 172826515 1 2024-08-19T00:56:34.750 INFO:tasks.workunit.client.0.smithi017.stdout:3/942: mkdir d5/d11/d61/d11d/d130 0 2024-08-19T00:56:34.751 INFO:tasks.workunit.client.0.smithi017.stdout:3/943: write d5/d11/d61/fd9 [372281,101269] 0 2024-08-19T00:56:34.753 INFO:tasks.workunit.client.0.smithi017.stdout:3/944: truncate d5/da/d3c/d4f/d109/df2/ffe 1148562 0 2024-08-19T00:56:34.756 INFO:tasks.workunit.client.0.smithi017.stdout:3/945: creat d5/d18/dab/f131 x:0 0 0 2024-08-19T00:56:34.758 INFO:tasks.workunit.client.0.smithi017.stdout:3/946: symlink d5/da/d3c/de4/d11c/l132 0 2024-08-19T00:56:34.760 INFO:tasks.workunit.client.0.smithi017.stdout:3/947: chown d5/da/d3c/de4/d92/d10a/f129 17455039 1 2024-08-19T00:56:34.765 INFO:tasks.workunit.client.0.smithi017.stdout:3/948: dread d5/da/fb6 [0,4194304] 0 2024-08-19T00:56:34.775 INFO:tasks.workunit.client.0.smithi017.stdout:3/949: write d5/da/d3c/de4/d92/dca/dfa/f105 [272405,42053] 0 2024-08-19T00:56:34.781 INFO:tasks.workunit.client.0.smithi017.stdout:3/950: creat d5/da/d27/d6e/dd0/de0/f133 x:0 0 0 2024-08-19T00:56:34.784 INFO:tasks.workunit.client.0.smithi017.stdout:3/951: mkdir d5/d11/d61/d11d/d130/d134 0 2024-08-19T00:56:34.787 INFO:tasks.workunit.client.0.smithi017.stdout:3/952: creat d5/d11/d61/f135 x:0 0 0 2024-08-19T00:56:34.787 INFO:tasks.workunit.client.0.smithi017.stdout:3/953: fdatasync d5/d18/ff8 0 2024-08-19T00:56:34.789 INFO:tasks.workunit.client.0.smithi017.stdout:3/954: creat d5/da/d3c/de4/d92/d10a/f136 x:0 0 0 2024-08-19T00:56:34.794 INFO:tasks.workunit.client.0.smithi017.stdout:3/955: link d5/da/d3c/de4/d92/fc0 d5/da/d3c/d4f/d109/f137 0 2024-08-19T00:56:34.797 INFO:tasks.workunit.client.0.smithi017.stdout:3/956: rename d5/d18/ce9 to d5/d18/dab/c138 0 2024-08-19T00:56:34.807 INFO:tasks.workunit.client.0.smithi017.stdout:3/957: dread d5/d11/f85 [0,4194304] 0 2024-08-19T00:56:34.808 INFO:tasks.workunit.client.0.smithi017.stdout:3/958: write d5/da/d3c/d4f/d109/df2/f118 [869306,31036] 0 2024-08-19T00:56:34.810 INFO:tasks.workunit.client.0.smithi017.stdout:3/959: unlink d5/d11/l5b 0 2024-08-19T00:56:34.812 INFO:tasks.workunit.client.0.smithi017.stdout:3/960: symlink d5/d11/d61/l139 0 2024-08-19T00:56:34.815 INFO:tasks.workunit.client.0.smithi017.stdout:3/961: rename d5/d18/fde to d5/da/d3c/de4/d92/f13a 0 2024-08-19T00:56:34.815 INFO:tasks.workunit.client.0.smithi017.stdout:3/962: stat d5/da/d3c/de4/d92/dca/dfa/lff 0 2024-08-19T00:56:34.816 INFO:tasks.workunit.client.0.smithi017.stdout:3/963: fsync d5/da/d27/d6e/dd0/de0/f121 0 2024-08-19T00:56:34.863 INFO:tasks.workunit.client.0.smithi017.stdout:3/964: link d5/da/d3c/d4f/d109/d99/fc7 d5/da/d27/d6e/dd0/f13b 0 2024-08-19T00:56:34.865 INFO:tasks.workunit.client.0.smithi017.stdout:3/965: write d5/fc [4751175,95872] 0 2024-08-19T00:56:34.865 INFO:tasks.workunit.client.0.smithi017.stdout:6/940: sync 2024-08-19T00:56:34.872 INFO:tasks.workunit.client.0.smithi017.stdout:3/966: symlink d5/da/d3c/l13c 0 2024-08-19T00:56:34.874 INFO:tasks.workunit.client.0.smithi017.stdout:3/967: mkdir d5/da/d27/d13d 0 2024-08-19T00:56:34.875 INFO:tasks.workunit.client.0.smithi017.stdout:3/968: chown d5/da/d3c/de4/d92/fa8 33611 1 2024-08-19T00:56:34.879 INFO:tasks.workunit.client.0.smithi017.stdout:6/941: dread d5/f42 [0,4194304] 0 2024-08-19T00:56:34.884 INFO:tasks.workunit.client.0.smithi017.stdout:6/942: rename d5/d13/d20/d77/d99 to d5/d13/d11/d93/d141 0 2024-08-19T00:56:34.884 INFO:tasks.workunit.client.0.smithi017.stdout:3/969: write d5/da/d3c/de4/d1b/f44 [2746271,112110] 0 2024-08-19T00:56:34.885 INFO:tasks.workunit.client.0.smithi017.stdout:3/970: dread - d5/da/d3c/d4f/d109/fe5 zero size 2024-08-19T00:56:34.886 INFO:tasks.workunit.client.0.smithi017.stdout:3/971: stat d5/d11/f2a 0 2024-08-19T00:56:34.887 INFO:tasks.workunit.client.0.smithi017.stdout:3/972: write d5/d18/dab/f131 [441990,20292] 0 2024-08-19T00:56:34.887 INFO:tasks.workunit.client.0.smithi017.stdout:6/943: creat d5/d13/d11/d2c/d4a/da8/f142 x:0 0 0 2024-08-19T00:56:34.890 INFO:tasks.workunit.client.0.smithi017.stdout:3/973: chown d5/da/d27/l9a 65392 1 2024-08-19T00:56:34.891 INFO:tasks.workunit.client.0.smithi017.stdout:6/944: creat d5/d13/d20/d89/f143 x:0 0 0 2024-08-19T00:56:34.898 INFO:tasks.workunit.client.0.smithi017.stdout:6/945: dwrite d5/d13/d11/d4d/dfa/f119 [0,4194304] 0 2024-08-19T00:56:34.904 INFO:tasks.workunit.client.0.smithi017.stdout:3/974: dread d5/d18/dab/fb9 [0,4194304] 0 2024-08-19T00:56:34.907 INFO:tasks.workunit.client.0.smithi017.stdout:3/975: read d5/da/f2b [7125913,72051] 0 2024-08-19T00:56:34.909 INFO:tasks.workunit.client.0.smithi017.stdout:6/946: dwrite d5/d13/d11/d52/fdd [0,4194304] 0 2024-08-19T00:56:34.919 INFO:tasks.workunit.client.0.smithi017.stdout:3/976: dwrite d5/da/d3c/de4/d1b/f20 [0,4194304] 0 2024-08-19T00:56:34.926 INFO:tasks.workunit.client.0.smithi017.stdout:6/947: dread f2 [4194304,4194304] 0 2024-08-19T00:56:34.941 INFO:tasks.workunit.client.0.smithi017.stdout:6/948: dwrite d5/d13/d11/f53 [0,4194304] 0 2024-08-19T00:56:34.946 INFO:tasks.workunit.client.0.smithi017.stdout:6/949: mknod d5/d13/d11/d93/d141/c144 0 2024-08-19T00:56:34.949 INFO:tasks.workunit.client.0.smithi017.stdout:6/950: mkdir d5/d13/d20/d89/d12f/d145 0 2024-08-19T00:56:34.950 INFO:tasks.workunit.client.0.smithi017.stdout:6/951: fdatasync d5/d13/d11/d2c/d4a/d64/de2/f101 0 2024-08-19T00:56:34.955 INFO:tasks.workunit.client.0.smithi017.stdout:6/952: symlink d5/d13/d11/d2c/d4a/d64/d86/d90/dba/d133/l146 0 2024-08-19T00:56:34.956 INFO:tasks.workunit.client.0.smithi017.stdout:6/953: write d5/d13/d11/d4d/f85 [1854541,88067] 0 2024-08-19T00:56:34.959 INFO:tasks.workunit.client.0.smithi017.stdout:6/954: creat d5/d7b/f147 x:0 0 0 2024-08-19T00:56:34.962 INFO:tasks.workunit.client.0.smithi017.stdout:6/955: dread d5/d13/d11/d93/ff3 [0,4194304] 0 2024-08-19T00:56:34.965 INFO:tasks.workunit.client.0.smithi017.stdout:6/956: unlink d5/d13/d11/d93/d141/c144 0 2024-08-19T00:56:34.976 INFO:tasks.workunit.client.0.smithi017.stdout:6/957: dwrite d5/d13/d11/d2c/d4a/da8/dd1/d8f/f109 [0,4194304] 0 2024-08-19T00:56:34.976 INFO:tasks.workunit.client.0.smithi017.stdout:6/958: chown d5/d13/de5 1656324 1 2024-08-19T00:56:34.980 INFO:tasks.workunit.client.0.smithi017.stdout:6/959: link d5/d13/d11/d93/c126 d5/d13/d11/d2c/d4a/d64/d86/d90/dba/d121/c148 0 2024-08-19T00:56:34.982 INFO:tasks.workunit.client.0.smithi017.stdout:6/960: read d5/d13/d11/d52/f94 [1737932,102300] 0 2024-08-19T00:56:34.985 INFO:tasks.workunit.client.0.smithi017.stdout:6/961: mkdir d5/d13/d149 0 2024-08-19T00:56:34.988 INFO:tasks.workunit.client.0.smithi017.stdout:6/962: creat d5/d13/d11/d2c/d118/f14a x:0 0 0 2024-08-19T00:56:34.994 INFO:tasks.workunit.client.0.smithi017.stdout:6/963: dwrite d5/d13/d11/d2c/f38 [0,4194304] 0 2024-08-19T00:56:35.025 INFO:tasks.workunit.client.0.smithi017.stdout:6/964: dread d5/d13/d11/d52/fbc [0,4194304] 0 2024-08-19T00:56:35.111 INFO:tasks.workunit.client.0.smithi017.stdout:6/965: dwrite d5/d13/d11/f68 [0,4194304] 0 2024-08-19T00:56:35.114 INFO:tasks.workunit.client.0.smithi017.stdout:6/966: read d5/d13/d11/d2c/d51/d7e/fae [2566712,81207] 0 2024-08-19T00:56:35.129 INFO:tasks.workunit.client.0.smithi017.stdout:6/967: symlink d5/d13/d11/d2c/l14b 0 2024-08-19T00:56:35.139 INFO:tasks.workunit.client.0.smithi017.stdout:6/968: dwrite d5/d13/d11/d2c/f73 [0,4194304] 0 2024-08-19T00:56:35.142 INFO:tasks.workunit.client.0.smithi017.stdout:6/969: write d5/d13/d11/f9f [2599545,123984] 0 2024-08-19T00:56:35.145 INFO:tasks.workunit.client.0.smithi017.stdout:6/970: mkdir d5/d13/d20/d89/d14c 0 2024-08-19T00:56:35.147 INFO:tasks.workunit.client.0.smithi017.stdout:6/971: dread d5/d13/d11/d2c/d51/fd7 [0,4194304] 0 2024-08-19T00:56:35.152 INFO:tasks.workunit.client.0.smithi017.stdout:6/972: creat d5/d13/d11/d2c/d4a/d64/d86/f14d x:0 0 0 2024-08-19T00:56:35.154 INFO:tasks.workunit.client.0.smithi017.stdout:6/973: chown d5/d13/d11/d2c/c45 95 1 2024-08-19T00:56:35.156 INFO:tasks.workunit.client.0.smithi017.stdout:6/974: mknod d5/d13/d11/d2c/d51/c14e 0 2024-08-19T00:56:35.160 INFO:tasks.workunit.client.0.smithi017.stdout:6/975: creat d5/d13/d11/d2c/d4a/d64/d86/f14f x:0 0 0 2024-08-19T00:56:35.161 INFO:tasks.workunit.client.0.smithi017.stdout:6/976: symlink d5/d13/d11/d2c/d4a/da8/d11b/l150 0 2024-08-19T00:56:35.163 INFO:tasks.workunit.client.0.smithi017.stdout:6/977: rmdir d5/d13/d11/d93 39 2024-08-19T00:56:35.171 INFO:tasks.workunit.client.0.smithi017.stdout:6/978: write d5/d13/d11/d2c/d51/d7e/f83 [2330942,34749] 0 2024-08-19T00:56:35.174 INFO:tasks.workunit.client.0.smithi017.stdout:6/979: symlink d5/d13/d20/d89/l151 0 2024-08-19T00:56:35.184 INFO:tasks.workunit.client.0.smithi017.stdout:6/980: link d5/d13/d11/d52/c108 d5/d13/d11/d93/c152 0 2024-08-19T00:56:35.197 INFO:tasks.workunit.client.0.smithi017.stdout:6/981: dwrite d5/d13/dcf/ff2 [0,4194304] 0 2024-08-19T00:56:35.217 INFO:tasks.workunit.client.0.smithi017.stdout:6/982: dread d5/f39 [0,4194304] 0 2024-08-19T00:56:35.218 INFO:tasks.workunit.client.0.smithi017.stdout:2/985: sync 2024-08-19T00:56:35.221 INFO:tasks.workunit.client.0.smithi017.stdout:6/983: link d5/d13/d11/d2c/d4a/d64/f12e d5/d13/d11/d2c/d4a/f153 0 2024-08-19T00:56:35.223 INFO:tasks.workunit.client.0.smithi017.stdout:2/986: rename d2/d7/d10/d3b/d97/df2/df4 to d2/d7/dd/d13a 0 2024-08-19T00:56:35.224 INFO:tasks.workunit.client.0.smithi017.stdout:6/984: mknod d5/d13/d11/d2c/d4a/da8/c154 0 2024-08-19T00:56:35.225 INFO:tasks.workunit.client.0.smithi017.stdout:6/985: readlink d5/d13/d11/d2c/d51/l100 0 2024-08-19T00:56:35.228 INFO:tasks.workunit.client.0.smithi017.stdout:2/987: dread d2/d7/d29/f52 [0,4194304] 0 2024-08-19T00:56:35.231 INFO:tasks.workunit.client.0.smithi017.stdout:2/988: mknod d2/d7/d10/d19/c13b 0 2024-08-19T00:56:35.232 INFO:tasks.workunit.client.0.smithi017.stdout:2/989: chown d2/d7/d10/d35/d104 1 1 2024-08-19T00:56:35.232 INFO:tasks.workunit.client.0.smithi017.stdout:2/990: dread - d2/d7/d10/d19/fde zero size 2024-08-19T00:56:35.237 INFO:tasks.workunit.client.0.smithi017.stdout:6/986: write d5/d13/d11/f5c [224817,46874] 0 2024-08-19T00:56:35.239 INFO:tasks.workunit.client.0.smithi017.stdout:6/987: chown d5/d13/d11/d2c/d4a/d106/cbb 725 1 2024-08-19T00:56:35.241 INFO:tasks.workunit.client.0.smithi017.stdout:6/988: creat d5/d13/de5/d11a/f155 x:0 0 0 2024-08-19T00:56:35.246 INFO:tasks.workunit.client.0.smithi017.stdout:6/989: rename d5/d13/d11/d2c/d4a/d64/d86/f14d to d5/f156 0 2024-08-19T00:56:35.246 INFO:tasks.workunit.client.0.smithi017.stdout:6/990: chown d5/d13/d11/d2c 50273184 1 2024-08-19T00:56:35.251 INFO:tasks.workunit.client.0.smithi017.stdout:6/991: rename d5/d13/d11/d2c/d4a/d64/d86/d90/dba/de7/c11c to d5/d7b/d111/c157 0 2024-08-19T00:56:35.252 INFO:tasks.workunit.client.0.smithi017.stdout:6/992: stat d5/d13/d11/d2c/d4a/d64/d86/d90/f98 0 2024-08-19T00:56:35.259 INFO:tasks.workunit.client.0.smithi017.stdout:6/993: truncate d5/d13/dcf/fdf 827715 0 2024-08-19T00:56:35.266 INFO:tasks.workunit.client.0.smithi017.stdout:6/994: link d5/d13/d11/d2c/d4a/d64/d86/d90/dba/d121/c148 d5/d13/d11/d2c/d4a/d64/d86/d90/dba/dbf/c158 0 2024-08-19T00:56:35.364 INFO:tasks.workunit.client.0.smithi017.stdout:6/995: creat d5/d13/d11/d2c/d4a/da8/dd1/f159 x:0 0 0 2024-08-19T00:56:35.366 INFO:tasks.workunit.client.0.smithi017.stdout:6/996: creat d5/d13/de5/d11a/f15a x:0 0 0 2024-08-19T00:56:35.367 INFO:tasks.workunit.client.0.smithi017.stdout:6/997: fdatasync d5/d13/d11/ff8 0 2024-08-19T00:56:35.383 INFO:tasks.workunit.client.0.smithi017.stdout:6/998: dwrite d5/fc6 [0,4194304] 0 2024-08-19T00:56:35.388 INFO:tasks.workunit.client.0.smithi017.stdout:6/999: creat d5/d13/d11/d2c/d9d/f15b x:0 0 0 2024-08-19T00:56:35.424 INFO:tasks.workunit.client.0.smithi017.stdout:7/948: sync 2024-08-19T00:56:35.430 INFO:tasks.workunit.client.0.smithi017.stdout:7/949: symlink d3/l135 0 2024-08-19T00:56:35.432 INFO:tasks.workunit.client.0.smithi017.stdout:7/950: rmdir d3/dc/df/d37 39 2024-08-19T00:56:35.436 INFO:tasks.workunit.client.0.smithi017.stdout:7/951: creat d3/dc/df/f136 x:0 0 0 2024-08-19T00:56:35.437 INFO:tasks.workunit.client.0.smithi017.stdout:7/952: rmdir d3/dab/d106 39 2024-08-19T00:56:35.442 INFO:tasks.workunit.client.0.smithi017.stdout:7/953: mknod d3/dc/df/d1c/d2c/c137 0 2024-08-19T00:56:35.444 INFO:tasks.workunit.client.0.smithi017.stdout:7/954: mknod d3/dc/d103/c138 0 2024-08-19T00:56:35.451 INFO:tasks.workunit.client.0.smithi017.stdout:7/955: dwrite d3/d3c/ff2 [0,4194304] 0 2024-08-19T00:56:35.453 INFO:tasks.workunit.client.0.smithi017.stdout:7/956: chown d3/dc/df/d1a/l95 3771993 1 2024-08-19T00:56:35.455 INFO:tasks.workunit.client.0.smithi017.stdout:7/957: write d3/dc/df/d23/f101 [68779,66412] 0 2024-08-19T00:56:35.459 INFO:tasks.workunit.client.0.smithi017.stdout:7/958: creat d3/dc/df/d3d/d90/f139 x:0 0 0 2024-08-19T00:56:35.469 INFO:tasks.workunit.client.0.smithi017.stdout:7/959: write d3/dc/df/d1a/db9/f11f [126955,68942] 0 2024-08-19T00:56:35.473 INFO:tasks.workunit.client.0.smithi017.stdout:7/960: dread d3/d3c/ff2 [0,4194304] 0 2024-08-19T00:56:35.474 INFO:tasks.workunit.client.0.smithi017.stdout:7/961: chown d3/dc/df/d1c/d2c/d83/lfc 969125224 1 2024-08-19T00:56:35.475 INFO:tasks.workunit.client.0.smithi017.stdout:7/962: dread - d3/dc/df/d1c/d2c/d2f/f122 zero size 2024-08-19T00:56:35.481 INFO:tasks.workunit.client.0.smithi017.stdout:7/963: dread d3/dc/df/dd1/fd2 [0,4194304] 0 2024-08-19T00:56:35.492 INFO:tasks.workunit.client.0.smithi017.stdout:7/964: dread d3/dc/d5f/f89 [0,4194304] 0 2024-08-19T00:56:35.494 INFO:tasks.workunit.client.0.smithi017.stdout:7/965: unlink d3/dc/df/d3d/d90/c11b 0 2024-08-19T00:56:35.495 INFO:tasks.workunit.client.0.smithi017.stdout:7/966: truncate d3/dc/f125 928909 0 2024-08-19T00:56:35.500 INFO:tasks.workunit.client.0.smithi017.stdout:7/967: link d3/dc/df/d1c/d2c/cfe d3/dc/df/dda/df5/c13a 0 2024-08-19T00:56:35.502 INFO:tasks.workunit.client.0.smithi017.stdout:7/968: fsync d3/d3c/ff2 0 2024-08-19T00:56:35.504 INFO:tasks.workunit.client.0.smithi017.stdout:7/969: creat d3/dc/df/dd1/dd7/ddb/f13b x:0 0 0 2024-08-19T00:56:35.506 INFO:tasks.workunit.client.0.smithi017.stdout:7/970: write d3/dc/df/d1a/fc1 [1807237,99765] 0 2024-08-19T00:56:35.512 INFO:tasks.workunit.client.0.smithi017.stdout:7/971: dwrite d3/d3c/d88/fc0 [0,4194304] 0 2024-08-19T00:56:35.515 INFO:tasks.workunit.client.0.smithi017.stdout:7/972: truncate d3/dc/f5b 5226559 0 2024-08-19T00:56:35.516 INFO:tasks.workunit.client.0.smithi017.stdout:7/973: chown d3/dc/df/d1a/c79 94347 1 2024-08-19T00:56:35.538 INFO:tasks.workunit.client.0.smithi017.stdout:7/974: dread d3/dc/df/d7d/f9b [0,4194304] 0 2024-08-19T00:56:35.540 INFO:tasks.workunit.client.0.smithi017.stdout:7/975: mkdir d3/d3c/d88/d13c 0 2024-08-19T00:56:35.541 INFO:tasks.workunit.client.0.smithi017.stdout:7/976: chown d3/dc/f125 200179 1 2024-08-19T00:56:35.541 INFO:tasks.workunit.client.0.smithi017.stdout:7/977: chown d3/dc/f52 25979192 1 2024-08-19T00:56:35.542 INFO:tasks.workunit.client.0.smithi017.stdout:7/978: rmdir d3/dc/df/dda 39 2024-08-19T00:56:35.550 INFO:tasks.workunit.client.0.smithi017.stdout:7/979: creat d3/dc/df/d23/d6a/db6/f13d x:0 0 0 2024-08-19T00:56:35.559 INFO:tasks.workunit.client.0.smithi017.stdout:8/850: sync 2024-08-19T00:56:35.559 INFO:tasks.workunit.client.0.smithi017.stdout:4/902: sync 2024-08-19T00:56:35.559 INFO:tasks.workunit.client.0.smithi017.stdout:5/667: sync 2024-08-19T00:56:35.571 INFO:tasks.workunit.client.0.smithi017.stdout:5/668: dread db/d19/d1f/d15/d1e/fcd [0,4194304] 0 2024-08-19T00:56:35.578 INFO:tasks.workunit.client.0.smithi017.stdout:5/669: dwrite db/d19/d1f/d15/d1e/fd5 [0,4194304] 0 2024-08-19T00:56:35.614 INFO:tasks.workunit.client.0.smithi017.stdout:8/851: write de/f4d [4030588,62789] 0 2024-08-19T00:56:35.617 INFO:tasks.workunit.client.0.smithi017.stdout:4/903: stat d2/d1a/dd0/fa9 0 2024-08-19T00:56:35.618 INFO:tasks.workunit.client.0.smithi017.stdout:5/670: symlink db/d19/d1f/le6 0 2024-08-19T00:56:35.619 INFO:tasks.workunit.client.0.smithi017.stdout:5/671: chown db/d19/d1f/d15/d30 1793191023 1 2024-08-19T00:56:35.620 INFO:tasks.workunit.client.0.smithi017.stdout:8/852: mknod de/d15/d39/dfa/c109 0 2024-08-19T00:56:35.621 INFO:tasks.workunit.client.0.smithi017.stdout:7/980: creat d3/dab/f13e x:0 0 0 2024-08-19T00:56:35.623 INFO:tasks.workunit.client.0.smithi017.stdout:4/904: fsync d2/d87/db2/de6/d102/d131/ff5 0 2024-08-19T00:56:35.631 INFO:tasks.workunit.client.0.smithi017.stdout:5/672: dwrite db/d19/d1f/d15/d3e/d40/d49/de0/fc0 [0,4194304] 0 2024-08-19T00:56:35.633 INFO:tasks.workunit.client.0.smithi017.stdout:4/905: truncate d2/d1a/d55/d73/f134 2383364 0 2024-08-19T00:56:35.639 INFO:tasks.workunit.client.0.smithi017.stdout:4/906: rmdir d2/d1a/d55 39 2024-08-19T00:56:35.642 INFO:tasks.workunit.client.0.smithi017.stdout:5/673: mknod db/d19/d1f/d15/d3e/d40/d49/d63/d7b/dba/ce7 0 2024-08-19T00:56:35.647 INFO:tasks.workunit.client.0.smithi017.stdout:7/981: dread d3/dc/df/d23/d69/f6f [4194304,4194304] 0 2024-08-19T00:56:35.649 INFO:tasks.workunit.client.0.smithi017.stdout:4/907: dwrite d2/d87/db2/de6/d40/d56/d99/da3/ffa [0,4194304] 0 2024-08-19T00:56:35.650 INFO:tasks.workunit.client.0.smithi017.stdout:5/674: rename db/d19/d1f/d15/d3e/fa3 to db/d19/d1f/dbd/fe8 0 2024-08-19T00:56:35.652 INFO:tasks.workunit.client.0.smithi017.stdout:7/982: chown d3/dc/df/d1a/db9/f11f 3683 1 2024-08-19T00:56:35.654 INFO:tasks.workunit.client.0.smithi017.stdout:4/908: stat d2/d1a/d55/d64/lee 0 2024-08-19T00:56:35.657 INFO:tasks.workunit.client.0.smithi017.stdout:8/853: dwrite de/d36/d74/f8f [0,4194304] 0 2024-08-19T00:56:35.660 INFO:tasks.workunit.client.0.smithi017.stdout:5/675: dread - db/d19/d1f/d15/d3e/fbc zero size 2024-08-19T00:56:35.661 INFO:tasks.workunit.client.0.smithi017.stdout:5/676: fdatasync f6 0 2024-08-19T00:56:35.665 INFO:tasks.workunit.client.0.smithi017.stdout:7/983: write d3/dc/df/d23/f24 [1383938,67579] 0 2024-08-19T00:56:35.668 INFO:tasks.workunit.client.0.smithi017.stdout:5/677: fsync db/d19/d1f/d15/d1e/d5f/f73 0 2024-08-19T00:56:35.672 INFO:tasks.workunit.client.0.smithi017.stdout:7/984: dwrite d3/dc/df/d1a/f3b [0,4194304] 0 2024-08-19T00:56:35.675 INFO:tasks.workunit.client.0.smithi017.stdout:8/854: link de/d15/d39/dc7/cce de/d8d/c10a 0 2024-08-19T00:56:35.677 INFO:tasks.workunit.client.0.smithi017.stdout:5/678: creat db/d19/d1f/d15/d3e/d40/d49/d63/d80/fe9 x:0 0 0 2024-08-19T00:56:35.678 INFO:tasks.workunit.client.0.smithi017.stdout:4/909: write d2/d1a/dd0/fc5 [1906247,16434] 0 2024-08-19T00:56:35.678 INFO:tasks.workunit.client.0.smithi017.stdout:7/985: rmdir d3/dc/df/d1c/d2c/d83 39 2024-08-19T00:56:35.678 INFO:tasks.workunit.client.0.smithi017.stdout:8/855: fsync de/d15/d39/dfa/fe9 0 2024-08-19T00:56:35.680 INFO:tasks.workunit.client.0.smithi017.stdout:1/990: sync 2024-08-19T00:56:35.680 INFO:tasks.workunit.client.0.smithi017.stdout:0/827: sync 2024-08-19T00:56:35.680 INFO:tasks.workunit.client.0.smithi017.stdout:3/977: sync 2024-08-19T00:56:35.680 INFO:tasks.workunit.client.0.smithi017.stdout:9/867: sync 2024-08-19T00:56:35.680 INFO:tasks.workunit.client.0.smithi017.stdout:5/679: readlink db/d19/d1f/d15/d30/l4e 0 2024-08-19T00:56:35.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:35 smithi017 ceph-mon[16627]: pgmap v28: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 61 MiB/s rd, 126 MiB/s wr, 330 op/s 2024-08-19T00:56:35.684 INFO:tasks.workunit.client.0.smithi017.stdout:4/910: symlink d2/d87/db2/de6/d40/d56/dbb/l137 0 2024-08-19T00:56:35.687 INFO:tasks.workunit.client.0.smithi017.stdout:3/978: chown d5/da/d3c/de4/f91 77362 1 2024-08-19T00:56:35.688 INFO:tasks.workunit.client.0.smithi017.stdout:9/868: dread d0/d33/d22/d45/d69/fde [0,4194304] 0 2024-08-19T00:56:35.691 INFO:tasks.workunit.client.0.smithi017.stdout:5/680: dread - db/d19/d1f/d15/d3e/d40/fb8 zero size 2024-08-19T00:56:35.691 INFO:tasks.workunit.client.0.smithi017.stdout:8/856: write de/d15/d62/f98 [553449,26270] 0 2024-08-19T00:56:35.692 INFO:tasks.workunit.client.0.smithi017.stdout:8/857: chown de/d8d/lba 29 1 2024-08-19T00:56:35.693 INFO:tasks.workunit.client.0.smithi017.stdout:8/858: readlink l3 0 2024-08-19T00:56:35.694 INFO:tasks.workunit.client.0.smithi017.stdout:7/986: truncate d3/dc/df/d23/d6a/db6/fbb 964892 0 2024-08-19T00:56:35.695 INFO:tasks.workunit.client.0.smithi017.stdout:4/911: mkdir d2/d87/db2/de6/d40/d56/dbb/d138 0 2024-08-19T00:56:35.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:35 smithi086 ceph-mon[24511]: pgmap v28: 65 pgs: 65 active+clean; 3.5 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 61 MiB/s rd, 126 MiB/s wr, 330 op/s 2024-08-19T00:56:35.696 INFO:tasks.workunit.client.0.smithi017.stdout:4/912: stat d2/d87/db2/d116/f126 0 2024-08-19T00:56:35.698 INFO:tasks.workunit.client.0.smithi017.stdout:0/828: mkdir d5/d17/d26/d30/d5d/db0/de2/d119 0 2024-08-19T00:56:35.698 INFO:tasks.workunit.client.0.smithi017.stdout:0/829: chown d5/d18/l32 13 1 2024-08-19T00:56:35.699 INFO:tasks.workunit.client.0.smithi017.stdout:9/869: chown d0/d33/c37 5 1 2024-08-19T00:56:35.699 INFO:tasks.workunit.client.0.smithi017.stdout:2/991: sync 2024-08-19T00:56:35.700 INFO:tasks.workunit.client.0.smithi017.stdout:5/681: mkdir db/d19/d1f/d15/d1e/d5f/dea 0 2024-08-19T00:56:35.702 INFO:tasks.workunit.client.0.smithi017.stdout:8/859: rename de/d36/d74 to de/d15/d4f/d68/d84/dc8/d10b 0 2024-08-19T00:56:35.705 INFO:tasks.workunit.client.0.smithi017.stdout:3/979: mknod d5/d32/c13e 0 2024-08-19T00:56:35.706 INFO:tasks.workunit.client.0.smithi017.stdout:8/860: read de/d15/d4f/f5c [475042,46134] 0 2024-08-19T00:56:35.706 INFO:tasks.workunit.client.0.smithi017.stdout:1/991: dwrite d4/dc/d3b/d45/f91 [0,4194304] 0 2024-08-19T00:56:35.707 INFO:tasks.workunit.client.0.smithi017.stdout:4/913: unlink d2/d16/l19 0 2024-08-19T00:56:35.708 INFO:tasks.workunit.client.0.smithi017.stdout:4/914: chown d2/d87/db2/fbd 151587 1 2024-08-19T00:56:35.712 INFO:tasks.workunit.client.0.smithi017.stdout:9/870: creat d0/d58/d9f/f100 x:0 0 0 2024-08-19T00:56:35.713 INFO:tasks.workunit.client.0.smithi017.stdout:2/992: creat d2/d7/d10/d19/f13c x:0 0 0 2024-08-19T00:56:35.715 INFO:tasks.workunit.client.0.smithi017.stdout:2/993: chown d2/d7/d10/d3b/d80/d81/dcd/d12f/d12e 115316749 1 2024-08-19T00:56:35.718 INFO:tasks.workunit.client.0.smithi017.stdout:7/987: unlink d3/dc/df/dda/df5/f105 0 2024-08-19T00:56:35.719 INFO:tasks.workunit.client.0.smithi017.stdout:7/988: fsync d3/dc/df/d23/d69/fb4 0 2024-08-19T00:56:35.721 INFO:tasks.workunit.client.0.smithi017.stdout:7/989: write d3/dc/f125 [1173883,2427] 0 2024-08-19T00:56:35.722 INFO:tasks.workunit.client.0.smithi017.stdout:1/992: chown d4/dc/d17/dd6/l3a 14 1 2024-08-19T00:56:35.725 INFO:tasks.workunit.client.0.smithi017.stdout:8/861: symlink de/d15/d4f/d68/d84/dc8/d10b/d80/l10c 0 2024-08-19T00:56:35.727 INFO:tasks.workunit.client.0.smithi017.stdout:7/990: dread d3/d3c/ff2 [0,4194304] 0 2024-08-19T00:56:35.728 INFO:tasks.workunit.client.0.smithi017.stdout:0/830: creat d5/d17/d2b/df4/de8/f11a x:0 0 0 2024-08-19T00:56:35.728 INFO:tasks.workunit.client.0.smithi017.stdout:9/871: symlink d0/d33/d22/d40/l101 0 2024-08-19T00:56:35.728 INFO:tasks.workunit.client.0.smithi017.stdout:2/994: dread d2/d7/dd/f4e [0,4194304] 0 2024-08-19T00:56:35.733 INFO:tasks.workunit.client.0.smithi017.stdout:5/682: getdents db/d19/d1f/d15/d3e/d40/d83/dca 0 2024-08-19T00:56:35.737 INFO:tasks.workunit.client.0.smithi017.stdout:4/915: creat d2/d16/d114/f139 x:0 0 0 2024-08-19T00:56:35.738 INFO:tasks.workunit.client.0.smithi017.stdout:4/916: chown d2/d1a/d55/f89 4484 1 2024-08-19T00:56:35.740 INFO:tasks.workunit.client.0.smithi017.stdout:0/831: mknod d5/d18/d78/c11b 0 2024-08-19T00:56:35.741 INFO:tasks.workunit.client.0.smithi017.stdout:9/872: creat d0/d33/d22/d5e/dae/f102 x:0 0 0 2024-08-19T00:56:35.742 INFO:tasks.workunit.client.0.smithi017.stdout:8/862: write de/d15/d39/d3d/dc2/dd8/ff5 [992729,69203] 0 2024-08-19T00:56:35.743 INFO:tasks.workunit.client.0.smithi017.stdout:5/683: mkdir db/d19/d8d/deb 0 2024-08-19T00:56:35.745 INFO:tasks.workunit.client.0.smithi017.stdout:1/993: fsync d4/dc/d17/dd6/d1f/da5/f106 0 2024-08-19T00:56:35.746 INFO:tasks.workunit.client.0.smithi017.stdout:3/980: rename d5/da/le6 to d5/da/d3c/d4f/d109/d9e/l13f 0 2024-08-19T00:56:35.750 INFO:tasks.workunit.client.0.smithi017.stdout:4/917: mkdir d2/d87/db2/d13a 0 2024-08-19T00:56:35.751 INFO:tasks.workunit.client.0.smithi017.stdout:0/832: mknod d5/d17/d26/d30/d5d/dce/c11c 0 2024-08-19T00:56:35.753 INFO:tasks.workunit.client.0.smithi017.stdout:2/995: symlink d2/d7/d10/d3b/d80/da2/db7/d133/l13d 0 2024-08-19T00:56:35.755 INFO:tasks.workunit.client.0.smithi017.stdout:1/994: dwrite d4/dc/d17/dd6/d1f/da5/f104 [0,4194304] 0 2024-08-19T00:56:35.755 INFO:tasks.workunit.client.0.smithi017.stdout:2/996: fsync d2/d7/f43 0 2024-08-19T00:56:35.756 INFO:tasks.workunit.client.0.smithi017.stdout:7/991: dread d3/dc/df/d1c/d2c/d2f/f56 [4194304,4194304] 0 2024-08-19T00:56:35.759 INFO:tasks.workunit.client.0.smithi017.stdout:5/684: mknod db/d19/d1f/d15/d3e/d40/d49/d63/d7b/dba/cec 0 2024-08-19T00:56:35.761 INFO:tasks.workunit.client.0.smithi017.stdout:4/918: unlink d2/d1a/d20/c120 0 2024-08-19T00:56:35.763 INFO:tasks.workunit.client.0.smithi017.stdout:5/685: truncate db/d19/daa/fe5 438744 0 2024-08-19T00:56:35.763 INFO:tasks.workunit.client.0.smithi017.stdout:9/873: dread d0/d33/f17 [0,4194304] 0 2024-08-19T00:56:35.765 INFO:tasks.workunit.client.0.smithi017.stdout:5/686: chown db/d19/d1f/f68 0 1 2024-08-19T00:56:35.769 INFO:tasks.workunit.client.0.smithi017.stdout:2/997: dwrite d2/d7/d10/d9f/df9/f105 [0,4194304] 0 2024-08-19T00:56:35.771 INFO:tasks.workunit.client.0.smithi017.stdout:4/919: dwrite d2/f12 [4194304,4194304] 0 2024-08-19T00:56:35.780 INFO:tasks.workunit.client.0.smithi017.stdout:3/981: creat d5/da/d3c/d4f/d109/d11b/d12b/f140 x:0 0 0 2024-08-19T00:56:35.781 INFO:tasks.workunit.client.0.smithi017.stdout:7/992: mkdir d3/dc/df/d1a/dc7/d13f 0 2024-08-19T00:56:35.783 INFO:tasks.workunit.client.0.smithi017.stdout:8/863: write de/d15/d79/fa9 [6001596,68817] 0 2024-08-19T00:56:35.784 INFO:tasks.workunit.client.0.smithi017.stdout:9/874: mknod d0/d84/c103 0 2024-08-19T00:56:35.786 INFO:tasks.workunit.client.0.smithi017.stdout:9/875: write d0/d33/d22/d45/d9b/fda [641957,92264] 0 2024-08-19T00:56:35.787 INFO:tasks.workunit.client.0.smithi017.stdout:8/864: read - de/d15/f65 zero size 2024-08-19T00:56:35.789 INFO:tasks.workunit.client.0.smithi017.stdout:2/998: mknod d2/d7/dd/d13a/d116/c13e 0 2024-08-19T00:56:35.790 INFO:tasks.workunit.client.0.smithi017.stdout:0/833: rename d5/d17/d21/f2d to d5/d18/f11d 0 2024-08-19T00:56:35.791 INFO:tasks.workunit.client.0.smithi017.stdout:9/876: chown d0/d33/cf 4550 1 2024-08-19T00:56:35.792 INFO:tasks.workunit.client.0.smithi017.stdout:4/920: mkdir d2/d16/d13b 0 2024-08-19T00:56:35.793 INFO:tasks.workunit.client.0.smithi017.stdout:9/877: fsync d0/d33/d22/d85/fe8 0 2024-08-19T00:56:35.795 INFO:tasks.workunit.client.0.smithi017.stdout:8/865: dread - de/d15/d4f/d68/d84/dc8/d10b/d8b/fb3 zero size 2024-08-19T00:56:35.796 INFO:tasks.workunit.client.0.smithi017.stdout:1/995: dread d4/fd [0,4194304] 0 2024-08-19T00:56:35.799 INFO:tasks.workunit.client.0.smithi017.stdout:4/921: mknod d2/d1a/d55/d73/da6/c13c 0 2024-08-19T00:56:35.801 INFO:tasks.workunit.client.0.smithi017.stdout:0/834: dread d5/d17/d45/d50/f96 [0,4194304] 0 2024-08-19T00:56:35.803 INFO:tasks.workunit.client.0.smithi017.stdout:3/982: rename d5/da/d3c/de4/d1b/c77 to d5/da/d3c/d4f/d109/df2/c141 0 2024-08-19T00:56:35.804 INFO:tasks.workunit.client.0.smithi017.stdout:8/866: truncate de/d15/d4f/d68/d84/f8e 1849976 0 2024-08-19T00:56:35.805 INFO:tasks.workunit.client.0.smithi017.stdout:5/687: dwrite db/f2a [0,4194304] 0 2024-08-19T00:56:35.808 INFO:tasks.workunit.client.0.smithi017.stdout:9/878: symlink d0/d58/d49/d5d/dd5/l104 0 2024-08-19T00:56:35.809 INFO:tasks.workunit.client.0.smithi017.stdout:3/983: write d5/da/d27/d6e/dd0/de0/f121 [991073,59211] 0 2024-08-19T00:56:35.810 INFO:tasks.workunit.client.0.smithi017.stdout:9/879: stat d0/d33/d22/d45/d8e/fcf 0 2024-08-19T00:56:35.814 INFO:tasks.workunit.client.0.smithi017.stdout:0/835: rmdir d5/d17/d21/d42/d9b 39 2024-08-19T00:56:35.815 INFO:tasks.workunit.client.0.smithi017.stdout:2/999: dread d2/d7/d10/d9f/df9/dfd/f102 [0,4194304] 0 2024-08-19T00:56:35.817 INFO:tasks.workunit.client.0.smithi017.stdout:8/867: creat de/d15/d62/d75/dd7/f10d x:0 0 0 2024-08-19T00:56:35.819 INFO:tasks.workunit.client.0.smithi017.stdout:4/922: dread d2/d11/f72 [0,4194304] 0 2024-08-19T00:56:35.820 INFO:tasks.workunit.client.0.smithi017.stdout:9/880: mkdir d0/d33/d22/d45/d9b/de2/d105 0 2024-08-19T00:56:35.822 INFO:tasks.workunit.client.0.smithi017.stdout:5/688: mknod db/d19/d1f/ced 0 2024-08-19T00:56:35.823 INFO:tasks.workunit.client.0.smithi017.stdout:8/868: creat de/d15/d39/dfa/f10e x:0 0 0 2024-08-19T00:56:35.825 INFO:tasks.workunit.client.0.smithi017.stdout:4/923: truncate d2/d87/f10a 1028156 0 2024-08-19T00:56:35.826 INFO:tasks.workunit.client.0.smithi017.stdout:8/869: read - de/d15/d39/dfa/f10e zero size 2024-08-19T00:56:35.826 INFO:tasks.workunit.client.0.smithi017.stdout:9/881: chown d0/d33/d22/d5a/cd1 50119 1 2024-08-19T00:56:35.828 INFO:tasks.workunit.client.0.smithi017.stdout:3/984: rename d5/da/d27/d6e/df3/l11e to d5/d11/d61/l142 0 2024-08-19T00:56:35.830 INFO:tasks.workunit.client.0.smithi017.stdout:3/985: write d5/da/d27/d6e/dd0/de0/f133 [60020,63710] 0 2024-08-19T00:56:35.830 INFO:tasks.workunit.client.0.smithi017.stdout:5/689: creat db/d19/d1f/d15/d3e/d40/d49/d63/d7b/fee x:0 0 0 2024-08-19T00:56:35.838 INFO:tasks.workunit.client.0.smithi017.stdout:4/924: dread d2/d16/f6f [0,4194304] 0 2024-08-19T00:56:35.840 INFO:tasks.workunit.client.0.smithi017.stdout:5/690: mknod db/d19/d8d/cef 0 2024-08-19T00:56:35.843 INFO:tasks.workunit.client.0.smithi017.stdout:8/870: write de/d15/d39/fb7 [544933,50421] 0 2024-08-19T00:56:35.844 INFO:tasks.workunit.client.0.smithi017.stdout:9/882: creat d0/d58/d9f/dd4/f106 x:0 0 0 2024-08-19T00:56:35.847 INFO:tasks.workunit.client.0.smithi017.stdout:8/871: write de/d15/d39/fda [428357,47897] 0 2024-08-19T00:56:35.851 INFO:tasks.workunit.client.0.smithi017.stdout:5/691: dwrite db/d19/d1f/d15/d1e/fd5 [0,4194304] 0 2024-08-19T00:56:35.852 INFO:tasks.workunit.client.0.smithi017.stdout:0/836: rename d5/d17/f22 to d5/d18/f11e 0 2024-08-19T00:56:35.852 INFO:tasks.workunit.client.0.smithi017.stdout:3/986: dwrite d5/d11/d61/f76 [0,4194304] 0 2024-08-19T00:56:35.854 INFO:tasks.workunit.client.0.smithi017.stdout:4/925: mkdir d2/dc1/d12e/d13d 0 2024-08-19T00:56:35.861 INFO:tasks.workunit.client.0.smithi017.stdout:8/872: rename de/d36/dad/fb0 to de/d15/d4f/dcc/f10f 0 2024-08-19T00:56:35.861 INFO:tasks.workunit.client.0.smithi017.stdout:3/987: dread d5/ff [8388608,4194304] 0 2024-08-19T00:56:35.862 INFO:tasks.workunit.client.0.smithi017.stdout:3/988: read d5/da/fd [2017739,88505] 0 2024-08-19T00:56:35.865 INFO:tasks.workunit.client.0.smithi017.stdout:9/883: link d0/d58/d9f/dd4/f106 d0/d33/d22/d45/d69/ddd/f107 0 2024-08-19T00:56:35.865 INFO:tasks.workunit.client.0.smithi017.stdout:8/873: dread - de/d15/d9d/fa7 zero size 2024-08-19T00:56:35.868 INFO:tasks.workunit.client.0.smithi017.stdout:5/692: mkdir db/d19/d1f/d15/d1e/d5f/dea/df0 0 2024-08-19T00:56:35.872 INFO:tasks.workunit.client.0.smithi017.stdout:0/837: getdents d5/d17/d26/d30/d3e/d81 0 2024-08-19T00:56:35.872 INFO:tasks.workunit.client.0.smithi017.stdout:8/874: mknod de/d15/d39/c110 0 2024-08-19T00:56:35.873 INFO:tasks.workunit.client.0.smithi017.stdout:5/693: symlink db/d19/d1f/d15/d1e/d5f/dea/df0/lf1 0 2024-08-19T00:56:35.875 INFO:tasks.workunit.client.0.smithi017.stdout:5/694: chown db/cc 1428 1 2024-08-19T00:56:35.875 INFO:tasks.workunit.client.0.smithi017.stdout:3/989: dwrite d5/d11/f16 [0,4194304] 0 2024-08-19T00:56:35.877 INFO:tasks.workunit.client.0.smithi017.stdout:0/838: write d5/d17/d26/d30/f58 [7707640,118201] 0 2024-08-19T00:56:35.879 INFO:tasks.workunit.client.0.smithi017.stdout:9/884: dwrite d0/d58/d49/f76 [0,4194304] 0 2024-08-19T00:56:35.881 INFO:tasks.workunit.client.0.smithi017.stdout:5/695: dread - db/d19/d1f/d15/d3e/d40/d49/d63/d80/fe9 zero size 2024-08-19T00:56:35.882 INFO:tasks.workunit.client.0.smithi017.stdout:9/885: fdatasync d0/d33/d22/d85/fe8 0 2024-08-19T00:56:35.882 INFO:tasks.workunit.client.0.smithi017.stdout:3/990: write d5/da/d3c/d4f/d109/d9e/f116 [916461,38203] 0 2024-08-19T00:56:35.891 INFO:tasks.workunit.client.0.smithi017.stdout:9/886: rename d0/d33/d22/d45 to d0/d84/dd8/d108 0 2024-08-19T00:56:35.892 INFO:tasks.workunit.client.0.smithi017.stdout:5/696: symlink db/d19/d1f/d15/lf2 0 2024-08-19T00:56:35.894 INFO:tasks.workunit.client.0.smithi017.stdout:4/926: dwrite d2/d11/dd6/f109 [0,4194304] 0 2024-08-19T00:56:35.896 INFO:tasks.workunit.client.0.smithi017.stdout:0/839: dwrite d5/d17/d26/d30/d3e/f91 [0,4194304] 0 2024-08-19T00:56:35.905 INFO:tasks.workunit.client.0.smithi017.stdout:4/927: unlink d2/l7c 0 2024-08-19T00:56:35.907 INFO:tasks.workunit.client.0.smithi017.stdout:3/991: rename d5/da/cb2 to d5/c143 0 2024-08-19T00:56:35.910 INFO:tasks.workunit.client.0.smithi017.stdout:4/928: creat d2/d1a/d55/d73/d121/f13e x:0 0 0 2024-08-19T00:56:35.911 INFO:tasks.workunit.client.0.smithi017.stdout:0/840: truncate d5/d18/d3a/fe3 4963133 0 2024-08-19T00:56:35.914 INFO:tasks.workunit.client.0.smithi017.stdout:8/875: dwrite de/d15/d4f/d68/d84/dc8/d10b/fa0 [0,4194304] 0 2024-08-19T00:56:35.915 INFO:tasks.workunit.client.0.smithi017.stdout:0/841: dread d5/d18/d78/dbc/fd1 [0,4194304] 0 2024-08-19T00:56:35.920 INFO:tasks.workunit.client.0.smithi017.stdout:5/697: chown db/d19/d1f/d15/d3e/d40/d49/d63/d80/cd2 204 1 2024-08-19T00:56:35.923 INFO:tasks.workunit.client.0.smithi017.stdout:0/842: rmdir d5/d18 39 2024-08-19T00:56:35.925 INFO:tasks.workunit.client.0.smithi017.stdout:4/929: fdatasync d2/d87/f10a 0 2024-08-19T00:56:35.926 INFO:tasks.workunit.client.0.smithi017.stdout:3/992: chown d5/da/d3c/de4/l73 2 1 2024-08-19T00:56:35.930 INFO:tasks.workunit.client.0.smithi017.stdout:4/930: truncate d2/d1a/d55/d73/d121/de2/fef 4734681 0 2024-08-19T00:56:35.930 INFO:tasks.workunit.client.0.smithi017.stdout:5/698: unlink db/d19/d1f/d15/lf2 0 2024-08-19T00:56:35.932 INFO:tasks.workunit.client.0.smithi017.stdout:0/843: getdents d5/d17/d21/d39 0 2024-08-19T00:56:35.937 INFO:tasks.workunit.client.0.smithi017.stdout:5/699: link db/d19/d1f/d15/c8b db/cf3 0 2024-08-19T00:56:35.939 INFO:tasks.workunit.client.0.smithi017.stdout:3/993: dwrite d5/d18/ff0 [0,4194304] 0 2024-08-19T00:56:35.942 INFO:tasks.workunit.client.0.smithi017.stdout:0/844: rename d5/d17/d26/d30/f54 to d5/d18/f11f 0 2024-08-19T00:56:35.944 INFO:tasks.workunit.client.0.smithi017.stdout:3/994: stat d5/da/d3c/d4f/d109/df2/c141 0 2024-08-19T00:56:35.945 INFO:tasks.workunit.client.0.smithi017.stdout:5/700: creat db/d19/d1f/d15/d3e/ff4 x:0 0 0 2024-08-19T00:56:35.946 INFO:tasks.workunit.client.0.smithi017.stdout:3/995: mkdir d5/da/d3c/de4/d11c/d144 0 2024-08-19T00:56:35.949 INFO:tasks.workunit.client.0.smithi017.stdout:3/996: dread - d5/da/d3c/d4f/d109/d99/f123 zero size 2024-08-19T00:56:35.950 INFO:tasks.workunit.client.0.smithi017.stdout:5/701: creat db/d19/d1f/d15/d1e/d5f/ff5 x:0 0 0 2024-08-19T00:56:35.951 INFO:tasks.workunit.client.0.smithi017.stdout:0/845: dwrite d5/d17/d26/f104 [0,4194304] 0 2024-08-19T00:56:35.958 INFO:tasks.workunit.client.0.smithi017.stdout:0/846: mknod d5/d18/d3a/c120 0 2024-08-19T00:56:35.960 INFO:tasks.workunit.client.0.smithi017.stdout:3/997: mkdir d5/da/d3c/d4f/d109/d11b/d12b/d145 0 2024-08-19T00:56:35.960 INFO:tasks.workunit.client.0.smithi017.stdout:3/998: chown d5/da/f7d 1 1 2024-08-19T00:56:35.963 INFO:tasks.workunit.client.0.smithi017.stdout:8/876: dread de/d15/d39/dfa/fe9 [0,4194304] 0 2024-08-19T00:56:35.964 INFO:tasks.workunit.client.0.smithi017.stdout:0/847: symlink d5/d17/d21/d39/l121 0 2024-08-19T00:56:35.967 INFO:tasks.workunit.client.0.smithi017.stdout:3/999: mkdir d5/da/d3c/de4/d92/d146 0 2024-08-19T00:56:35.969 INFO:tasks.workunit.client.0.smithi017.stdout:8/877: mknod de/d15/d62/d107/c111 0 2024-08-19T00:56:35.971 INFO:tasks.workunit.client.0.smithi017.stdout:0/848: truncate d5/d17/d26/d30/f71 654323 0 2024-08-19T00:56:35.975 INFO:tasks.workunit.client.0.smithi017.stdout:8/878: rename de/d15/d62/f98 to de/d15/d4f/d68/d84/dc8/d10b/d80/f112 0 2024-08-19T00:56:35.976 INFO:tasks.workunit.client.0.smithi017.stdout:5/702: dwrite db/f10 [0,4194304] 0 2024-08-19T00:56:35.982 INFO:tasks.workunit.client.0.smithi017.stdout:5/703: rmdir db/d19/d1f/d15 39 2024-08-19T00:56:35.984 INFO:tasks.workunit.client.0.smithi017.stdout:0/849: dread d5/d17/d21/f55 [0,4194304] 0 2024-08-19T00:56:35.990 INFO:tasks.workunit.client.0.smithi017.stdout:8/879: creat de/d15/d39/d3d/f113 x:0 0 0 2024-08-19T00:56:35.991 INFO:tasks.workunit.client.0.smithi017.stdout:0/850: stat d5/d17/d21/d42/d9b/fc8 0 2024-08-19T00:56:35.991 INFO:tasks.workunit.client.0.smithi017.stdout:8/880: chown de/d15/f35 1576 1 2024-08-19T00:56:35.993 INFO:tasks.workunit.client.0.smithi017.stdout:5/704: symlink db/d19/d1f/d15/d3e/d40/d83/dca/lf6 0 2024-08-19T00:56:35.994 INFO:tasks.workunit.client.0.smithi017.stdout:8/881: mkdir de/d15/d39/d3d/dc2/dd8/d114 0 2024-08-19T00:56:35.995 INFO:tasks.workunit.client.0.smithi017.stdout:5/705: write db/d19/d1f/d15/d3e/d40/d49/d63/d80/fdb [177643,39443] 0 2024-08-19T00:56:36.007 INFO:tasks.workunit.client.0.smithi017.stdout:8/882: write de/d15/d39/d3d/dc2/dd8/f106 [867312,2777] 0 2024-08-19T00:56:36.013 INFO:tasks.workunit.client.0.smithi017.stdout:5/706: dread db/d19/d1f/d15/d1e/d5f/f73 [0,4194304] 0 2024-08-19T00:56:36.015 INFO:tasks.workunit.client.0.smithi017.stdout:8/883: dwrite de/d15/d4f/ff2 [0,4194304] 0 2024-08-19T00:56:36.016 INFO:tasks.workunit.client.0.smithi017.stdout:5/707: rmdir db/d19/d1f/d15 39 2024-08-19T00:56:36.020 INFO:tasks.workunit.client.0.smithi017.stdout:8/884: unlink de/d15/d4f/d68/d84/dc8/d10b/d8b/ld0 0 2024-08-19T00:56:36.022 INFO:tasks.workunit.client.0.smithi017.stdout:8/885: write de/d15/d4f/d68/d84/dc8/d10b/fff [711406,25045] 0 2024-08-19T00:56:36.023 INFO:tasks.workunit.client.0.smithi017.stdout:8/886: stat de/c3f 0 2024-08-19T00:56:36.032 INFO:tasks.workunit.client.0.smithi017.stdout:5/708: write db/d19/d1f/d15/d3e/f70 [957943,67078] 0 2024-08-19T00:56:36.037 INFO:tasks.workunit.client.0.smithi017.stdout:5/709: mkdir db/d19/d1f/d15/d3e/d40/dad/df7 0 2024-08-19T00:56:36.038 INFO:tasks.workunit.client.0.smithi017.stdout:8/887: dwrite de/d15/d4f/d68/d84/f9b [0,4194304] 0 2024-08-19T00:56:36.039 INFO:tasks.workunit.client.0.smithi017.stdout:8/888: fdatasync de/d15/d39/f59 0 2024-08-19T00:56:36.045 INFO:tasks.workunit.client.0.smithi017.stdout:5/710: rename db/d19/d1f/d15/d3e/d40/d83/caf to db/d19/d1f/d15/d3e/d40/d49/dce/cf8 0 2024-08-19T00:56:36.046 INFO:tasks.workunit.client.0.smithi017.stdout:8/889: mknod de/d15/d4f/d68/d84/dc8/d10b/d8b/c115 0 2024-08-19T00:56:36.054 INFO:tasks.workunit.client.0.smithi017.stdout:5/711: write db/d19/d1f/d15/d30/f5e [834540,56041] 0 2024-08-19T00:56:36.057 INFO:tasks.workunit.client.0.smithi017.stdout:5/712: creat db/d19/d57/ff9 x:0 0 0 2024-08-19T00:56:36.060 INFO:tasks.workunit.client.0.smithi017.stdout:8/890: dwrite de/d15/d4f/dcc/f10f [0,4194304] 0 2024-08-19T00:56:36.064 INFO:tasks.workunit.client.0.smithi017.stdout:8/891: fdatasync de/d15/d79/f61 0 2024-08-19T00:56:36.067 INFO:tasks.workunit.client.0.smithi017.stdout:5/713: write db/d19/d1f/d15/d1e/f37 [47777,92846] 0 2024-08-19T00:56:36.071 INFO:tasks.workunit.client.0.smithi017.stdout:5/714: chown db/d19/d1f/d15/d3e/d40/d49/dce/cf8 2631 1 2024-08-19T00:56:36.073 INFO:tasks.workunit.client.0.smithi017.stdout:8/892: write de/d15/d62/d75/fb4 [321678,126682] 0 2024-08-19T00:56:36.074 INFO:tasks.workunit.client.0.smithi017.stdout:5/715: mkdir db/d19/d1f/d15/d3e/d40/dad/dfa 0 2024-08-19T00:56:36.074 INFO:tasks.workunit.client.0.smithi017.stdout:8/893: chown de/d15/d4f 3580669 1 2024-08-19T00:56:36.076 INFO:tasks.workunit.client.0.smithi017.stdout:8/894: mkdir de/d15/d4f/d68/d84/d116 0 2024-08-19T00:56:36.077 INFO:tasks.workunit.client.0.smithi017.stdout:5/716: creat db/d19/d1f/d15/d1e/d5f/dea/ffb x:0 0 0 2024-08-19T00:56:36.079 INFO:tasks.workunit.client.0.smithi017.stdout:5/717: write db/d19/d57/ff9 [927881,43477] 0 2024-08-19T00:56:36.083 INFO:tasks.workunit.client.0.smithi017.stdout:5/718: unlink db/d19/d1f/d15/d1e/d5f/c98 0 2024-08-19T00:56:36.084 INFO:tasks.workunit.client.0.smithi017.stdout:8/895: rename de/d15/d9d/fb2 to de/d15/f117 0 2024-08-19T00:56:36.086 INFO:tasks.workunit.client.0.smithi017.stdout:5/719: fsync db/d19/d1f/d15/fc6 0 2024-08-19T00:56:36.089 INFO:tasks.workunit.client.0.smithi017.stdout:5/720: mknod db/d19/d1f/d15/d3e/d40/dad/cfc 0 2024-08-19T00:56:36.091 INFO:tasks.workunit.client.0.smithi017.stdout:8/896: dwrite de/d15/d39/fbb [0,4194304] 0 2024-08-19T00:56:36.096 INFO:tasks.workunit.client.0.smithi017.stdout:8/897: creat de/d15/d4f/dcc/f118 x:0 0 0 2024-08-19T00:56:36.096 INFO:tasks.workunit.client.0.smithi017.stdout:5/721: dread db/d19/d1f/d15/d3e/d40/d49/de0/fc0 [0,4194304] 0 2024-08-19T00:56:36.102 INFO:tasks.workunit.client.0.smithi017.stdout:8/898: mkdir de/d15/d4f/d119 0 2024-08-19T00:56:36.103 INFO:tasks.workunit.client.0.smithi017.stdout:5/722: dwrite db/f2a [0,4194304] 0 2024-08-19T00:56:36.108 INFO:tasks.workunit.client.0.smithi017.stdout:8/899: creat de/d15/d39/d3d/dc2/dd8/f11a x:0 0 0 2024-08-19T00:56:36.121 INFO:tasks.workunit.client.0.smithi017.stdout:8/900: dread de/f4d [0,4194304] 0 2024-08-19T00:56:36.126 INFO:tasks.workunit.client.0.smithi017.stdout:8/901: dwrite de/d15/d79/f91 [0,4194304] 0 2024-08-19T00:56:36.126 INFO:tasks.workunit.client.0.smithi017.stdout:5/723: truncate db/f2a 2137092 0 2024-08-19T00:56:36.126 INFO:tasks.workunit.client.0.smithi017.stdout:8/902: stat de/d8d 0 2024-08-19T00:56:36.129 INFO:tasks.workunit.client.0.smithi017.stdout:5/724: dread - db/d19/d1f/d15/fa0 zero size 2024-08-19T00:56:36.131 INFO:tasks.workunit.client.0.smithi017.stdout:5/725: chown db/d19/d1f/d15/d1e/d5f/ff5 25219 1 2024-08-19T00:56:36.134 INFO:tasks.workunit.client.0.smithi017.stdout:8/903: dread de/d15/d4f/d68/db5/fc0 [0,4194304] 0 2024-08-19T00:56:36.134 INFO:tasks.workunit.client.0.smithi017.stdout:8/904: chown de/d15/c23 126 1 2024-08-19T00:56:36.139 INFO:tasks.workunit.client.0.smithi017.stdout:8/905: getdents de/d15/d39/d3d 0 2024-08-19T00:56:36.143 INFO:tasks.workunit.client.0.smithi017.stdout:5/726: write db/d19/d1f/d15/d1e/fa4 [1262573,120374] 0 2024-08-19T00:56:36.146 INFO:tasks.workunit.client.0.smithi017.stdout:5/727: creat db/d19/d1f/d15/d1e/d5f/ffd x:0 0 0 2024-08-19T00:56:36.147 INFO:tasks.workunit.client.0.smithi017.stdout:8/906: link de/d15/l20 de/d15/d62/l11b 0 2024-08-19T00:56:36.148 INFO:tasks.workunit.client.0.smithi017.stdout:8/907: dread - de/d15/f65 zero size 2024-08-19T00:56:36.148 INFO:tasks.workunit.client.0.smithi017.stdout:5/728: creat db/d19/d1f/d15/d3e/d40/d49/ffe x:0 0 0 2024-08-19T00:56:36.149 INFO:tasks.workunit.client.0.smithi017.stdout:8/908: write de/d8d/fb6 [99296,35163] 0 2024-08-19T00:56:36.149 INFO:tasks.workunit.client.0.smithi017.stdout:5/729: stat db/d19/d1f/d15/d3e/d40/d49 0 2024-08-19T00:56:36.150 INFO:tasks.workunit.client.0.smithi017.stdout:8/909: chown de/d15/d4f/d68/d84/dc8/d10b/d8b/dc4 5558180 1 2024-08-19T00:56:36.159 INFO:tasks.workunit.client.0.smithi017.stdout:8/910: getdents de/d15/d4f 0 2024-08-19T00:56:36.163 INFO:tasks.workunit.client.0.smithi017.stdout:8/911: creat de/d15/d4f/d68/d84/dc8/d10b/d8b/f11c x:0 0 0 2024-08-19T00:56:36.164 INFO:tasks.workunit.client.0.smithi017.stdout:5/730: dwrite db/d19/d1f/d15/d3e/d40/d49/d63/d80/fcc [0,4194304] 0 2024-08-19T00:56:36.166 INFO:tasks.workunit.client.0.smithi017.stdout:8/912: fsync de/f54 0 2024-08-19T00:56:36.170 INFO:tasks.workunit.client.0.smithi017.stdout:5/731: rename db/d19/d57/f7a to db/d19/d1f/d15/d3e/d40/d49/fff 0 2024-08-19T00:56:36.173 INFO:tasks.workunit.client.0.smithi017.stdout:8/913: dwrite de/d15/f3b [0,4194304] 0 2024-08-19T00:56:36.175 INFO:tasks.workunit.client.0.smithi017.stdout:5/732: symlink db/d19/d1f/d15/d3e/d40/d49/dce/l100 0 2024-08-19T00:56:36.179 INFO:tasks.workunit.client.0.smithi017.stdout:8/914: rename de/d15/d4f/c103 to de/d36/c11d 0 2024-08-19T00:56:36.186 INFO:tasks.workunit.client.0.smithi017.stdout:8/915: getdents de/d15/d39/d3d/dc2/dd6/ded 0 2024-08-19T00:56:36.189 INFO:tasks.workunit.client.0.smithi017.stdout:8/916: creat de/d15/d39/d3d/dc2/dd8/d114/f11e x:0 0 0 2024-08-19T00:56:36.191 INFO:tasks.workunit.client.0.smithi017.stdout:8/917: write de/f4d [2509506,98595] 0 2024-08-19T00:56:36.196 INFO:tasks.workunit.client.0.smithi017.stdout:8/918: dread de/d15/d4f/d68/d84/dc8/fd3 [0,4194304] 0 2024-08-19T00:56:36.197 INFO:tasks.workunit.client.0.smithi017.stdout:8/919: write de/d15/f2b [4684299,67400] 0 2024-08-19T00:56:36.201 INFO:tasks.workunit.client.0.smithi017.stdout:8/920: mkdir de/d15/d4f/d68/d84/dc8/d108/d11f 0 2024-08-19T00:56:36.201 INFO:tasks.workunit.client.0.smithi017.stdout:5/733: dread db/d19/d1f/d15/f25 [0,4194304] 0 2024-08-19T00:56:36.202 INFO:tasks.workunit.client.0.smithi017.stdout:8/921: fdatasync de/d15/d4f/d68/d84/dc8/d10b/fff 0 2024-08-19T00:56:36.204 INFO:tasks.workunit.client.0.smithi017.stdout:5/734: mknod db/d19/d1f/d15/d1e/d5f/c101 0 2024-08-19T00:56:36.205 INFO:tasks.workunit.client.0.smithi017.stdout:5/735: chown db/d19/d1f/d15/d30/f5e 778 1 2024-08-19T00:56:36.207 INFO:tasks.workunit.client.0.smithi017.stdout:5/736: mknod db/d19/d1f/d15/d1e/d5f/dea/df0/c102 0 2024-08-19T00:56:36.208 INFO:tasks.workunit.client.0.smithi017.stdout:8/922: dread de/d15/d79/f61 [0,4194304] 0 2024-08-19T00:56:36.210 INFO:tasks.workunit.client.0.smithi017.stdout:8/923: creat de/d15/d79/f120 x:0 0 0 2024-08-19T00:56:36.212 INFO:tasks.workunit.client.0.smithi017.stdout:5/737: rename db/d19/d57/ff9 to db/d19/d1f/d15/d3e/d40/f103 0 2024-08-19T00:56:36.215 INFO:tasks.workunit.client.0.smithi017.stdout:5/738: mkdir db/d104 0 2024-08-19T00:56:36.217 INFO:tasks.workunit.client.0.smithi017.stdout:8/924: getdents de/d15/d9d/dc5 0 2024-08-19T00:56:36.224 INFO:tasks.workunit.client.0.smithi017.stdout:8/925: truncate de/f47 4627020 0 2024-08-19T00:56:36.226 INFO:tasks.workunit.client.0.smithi017.stdout:8/926: rename de/d15 to de/d15/d4f/d68/d84/dc8/d10b/d8b/d121 22 2024-08-19T00:56:36.228 INFO:tasks.workunit.client.0.smithi017.stdout:8/927: symlink de/d15/d62/d107/l122 0 2024-08-19T00:56:36.230 INFO:tasks.workunit.client.0.smithi017.stdout:8/928: symlink de/d15/d39/d3d/dc2/l123 0 2024-08-19T00:56:36.232 INFO:tasks.workunit.client.0.smithi017.stdout:8/929: fdatasync de/f47 0 2024-08-19T00:56:36.235 INFO:tasks.workunit.client.0.smithi017.stdout:8/930: read de/d15/d4f/d68/d84/dc8/d10b/f8f [1366887,85696] 0 2024-08-19T00:56:36.237 INFO:tasks.workunit.client.0.smithi017.stdout:5/739: dwrite db/d19/d1f/d15/d1e/d5f/f92 [0,4194304] 0 2024-08-19T00:56:36.243 INFO:tasks.workunit.client.0.smithi017.stdout:5/740: truncate db/d19/d57/f85 520279 0 2024-08-19T00:56:36.246 INFO:tasks.workunit.client.0.smithi017.stdout:8/931: write de/d15/d4f/d68/d84/dc8/d10b/d80/f9f [834501,51156] 0 2024-08-19T00:56:36.247 INFO:tasks.workunit.client.0.smithi017.stdout:5/741: mkdir db/d19/d1f/d15/d3e/d40/d49/dce/d105 0 2024-08-19T00:56:36.248 INFO:tasks.workunit.client.0.smithi017.stdout:5/742: write fa [1945212,96178] 0 2024-08-19T00:56:36.251 INFO:tasks.workunit.client.0.smithi017.stdout:8/932: mknod de/d15/d62/c124 0 2024-08-19T00:56:36.254 INFO:tasks.workunit.client.0.smithi017.stdout:8/933: creat de/d15/d39/d104/f125 x:0 0 0 2024-08-19T00:56:36.255 INFO:tasks.workunit.client.0.smithi017.stdout:8/934: fdatasync de/f4d 0 2024-08-19T00:56:36.258 INFO:tasks.workunit.client.0.smithi017.stdout:8/935: mknod de/d15/d39/d3d/dc2/dd8/d114/c126 0 2024-08-19T00:56:36.260 INFO:tasks.workunit.client.0.smithi017.stdout:8/936: mkdir de/d15/d4f/d68/d84/d127 0 2024-08-19T00:56:36.264 INFO:tasks.workunit.client.0.smithi017.stdout:5/743: dwrite db/d19/d1f/dbd/fb0 [0,4194304] 0 2024-08-19T00:56:36.273 INFO:tasks.workunit.client.0.smithi017.stdout:5/744: link db/d19/d57/c65 db/d19/d8d/deb/c106 0 2024-08-19T00:56:36.275 INFO:tasks.workunit.client.0.smithi017.stdout:5/745: stat db/d19/d57/f85 0 2024-08-19T00:56:36.276 INFO:tasks.workunit.client.0.smithi017.stdout:8/937: dwrite de/d15/d79/f61 [0,4194304] 0 2024-08-19T00:56:36.279 INFO:tasks.workunit.client.0.smithi017.stdout:5/746: mknod db/d19/d1f/d15/d3e/d40/d49/d63/d80/c107 0 2024-08-19T00:56:36.287 INFO:tasks.workunit.client.0.smithi017.stdout:8/938: truncate de/d8d/fb6 282525 0 2024-08-19T00:56:36.288 INFO:tasks.workunit.client.0.smithi017.stdout:5/747: write db/d19/d1f/d15/d3e/d40/d49/d63/d80/f97 [25522,84607] 0 2024-08-19T00:56:36.292 INFO:tasks.workunit.client.0.smithi017.stdout:8/939: rename de/d15/d39/c6f to de/d15/d39/d3d/dc2/dd6/ded/df0/c128 0 2024-08-19T00:56:36.296 INFO:tasks.workunit.client.0.smithi017.stdout:8/940: truncate de/d15/f70 3524416 0 2024-08-19T00:56:36.296 INFO:tasks.workunit.client.0.smithi017.stdout:8/941: chown de/d15/d62 1015168 1 2024-08-19T00:56:36.297 INFO:tasks.workunit.client.0.smithi017.stdout:5/748: dread db/d19/d1f/d15/f8a [0,4194304] 0 2024-08-19T00:56:36.300 INFO:tasks.workunit.client.0.smithi017.stdout:8/942: creat de/d15/d39/d3d/dc2/dd6/f129 x:0 0 0 2024-08-19T00:56:36.307 INFO:tasks.workunit.client.0.smithi017.stdout:5/749: write db/d19/d8d/f94 [121440,29713] 0 2024-08-19T00:56:36.310 INFO:tasks.workunit.client.0.smithi017.stdout:5/750: creat db/d19/d8d/f108 x:0 0 0 2024-08-19T00:56:36.310 INFO:tasks.workunit.client.0.smithi017.stdout:8/943: write de/d15/d39/d3d/dc2/dd6/ff1 [8327369,4161] 0 2024-08-19T00:56:36.310 INFO:tasks.workunit.client.0.smithi017.stdout:5/751: readlink db/d19/d1f/le6 0 2024-08-19T00:56:36.311 INFO:tasks.workunit.client.0.smithi017.stdout:8/944: stat de/d15/d39/d3d/dc2/dd8/de2/ceb 0 2024-08-19T00:56:36.314 INFO:tasks.workunit.client.0.smithi017.stdout:5/752: mkdir db/d19/d1f/d15/d109 0 2024-08-19T00:56:36.317 INFO:tasks.workunit.client.0.smithi017.stdout:8/945: link de/d15/d4f/d68/d84/dc8/d10b/f8a de/d15/d9d/dc5/f12a 0 2024-08-19T00:56:36.317 INFO:tasks.workunit.client.0.smithi017.stdout:8/946: stat de/d15/d4f/d68/d84/dc8/d10b/d8b/dc4 0 2024-08-19T00:56:36.318 INFO:tasks.workunit.client.0.smithi017.stdout:5/753: rename db/d19/d1f/d15/d30 to db/d19/d1f/d15/d3e/d40/d83/d10a 0 2024-08-19T00:56:36.319 INFO:tasks.workunit.client.0.smithi017.stdout:8/947: mkdir de/d15/d39/d3d/d12b 0 2024-08-19T00:56:36.323 INFO:tasks.workunit.client.0.smithi017.stdout:5/754: truncate db/d19/d1f/d15/f5a 3644932 0 2024-08-19T00:56:36.329 INFO:tasks.workunit.client.0.smithi017.stdout:8/948: write de/d8d/fb6 [904312,74021] 0 2024-08-19T00:56:36.334 INFO:tasks.workunit.client.0.smithi017.stdout:8/949: dread de/d15/d4f/d68/d84/dc8/f101 [0,4194304] 0 2024-08-19T00:56:36.337 INFO:tasks.workunit.client.0.smithi017.stdout:8/950: rename de/d15/l1c to de/d15/d4f/l12c 0 2024-08-19T00:56:36.343 INFO:tasks.workunit.client.0.smithi017.stdout:8/951: creat de/d15/d39/d3d/dc2/dd8/de2/f12d x:0 0 0 2024-08-19T00:56:36.346 INFO:tasks.workunit.client.0.smithi017.stdout:8/952: mkdir de/d15/d39/d3d/dc2/dd6/d12e 0 2024-08-19T00:56:36.347 INFO:tasks.workunit.client.0.smithi017.stdout:8/953: fsync de/d15/d39/d3d/dc2/dd8/f11a 0 2024-08-19T00:56:36.348 INFO:tasks.workunit.client.0.smithi017.stdout:8/954: dread - de/d15/d39/d3d/f113 zero size 2024-08-19T00:56:36.348 INFO:tasks.workunit.client.0.smithi017.stdout:8/955: fdatasync de/f47 0 2024-08-19T00:56:36.350 INFO:tasks.workunit.client.0.smithi017.stdout:8/956: truncate de/d15/d62/d75/dd7/f10d 336898 0 2024-08-19T00:56:36.352 INFO:tasks.workunit.client.0.smithi017.stdout:8/957: mknod de/d15/d4f/dcc/c12f 0 2024-08-19T00:56:36.357 INFO:tasks.workunit.client.0.smithi017.stdout:8/958: link de/d15/d4f/d68/d84/dc8/d10b/d80/l96 de/d15/d62/d75/l130 0 2024-08-19T00:56:36.358 INFO:tasks.workunit.client.0.smithi017.stdout:8/959: write de/d15/d39/fb7 [1135630,93979] 0 2024-08-19T00:56:36.359 INFO:tasks.workunit.client.0.smithi017.stdout:8/960: fdatasync de/f34 0 2024-08-19T00:56:36.373 INFO:tasks.workunit.client.0.smithi017.stdout:8/961: rename de/d15/d4f/dcc to de/d131 0 2024-08-19T00:56:36.377 INFO:tasks.workunit.client.0.smithi017.stdout:8/962: mkdir de/d15/d39/d3d/d12b/d132 0 2024-08-19T00:56:36.377 INFO:tasks.workunit.client.0.smithi017.stdout:8/963: chown de/d15/d79/c42 492 1 2024-08-19T00:56:36.379 INFO:tasks.workunit.client.0.smithi017.stdout:8/964: rmdir de/d15/d39/d3d/dc2/dd6 39 2024-08-19T00:56:36.384 INFO:tasks.workunit.client.0.smithi017.stdout:8/965: rmdir de/d15/d4f/d68/d84/d116 0 2024-08-19T00:56:36.385 INFO:tasks.workunit.client.0.smithi017.stdout:8/966: stat de/d15/d4f/d68/d84/dc8/d10b/fa0 0 2024-08-19T00:56:36.386 INFO:tasks.workunit.client.0.smithi017.stdout:8/967: fdatasync de/d15/d4f/d68/d84/dc8/d10b/fff 0 2024-08-19T00:56:36.390 INFO:tasks.workunit.client.0.smithi017.stdout:8/968: symlink de/d15/d62/l133 0 2024-08-19T00:56:36.391 INFO:tasks.workunit.client.0.smithi017.stdout:8/969: chown de/d15/d39/f3e 1935397954 1 2024-08-19T00:56:36.558 INFO:tasks.workunit.client.0.smithi017.stdout:7/993: sync 2024-08-19T00:56:36.559 INFO:tasks.workunit.client.0.smithi017.stdout:7/994: chown d3/dc/df/d23/d6a/db6/f10b 849196027 1 2024-08-19T00:56:36.560 INFO:tasks.workunit.client.0.smithi017.stdout:7/995: stat d3/dc/df/d23/d6a/db6/c120 0 2024-08-19T00:56:36.609 INFO:tasks.workunit.client.0.smithi017.stdout:7/996: dread d3/dc/df/fec [0,4194304] 0 2024-08-19T00:56:36.612 INFO:tasks.workunit.client.0.smithi017.stdout:7/997: stat d3/dc/df/d37/d46/d73/d80/d81/f99 0 2024-08-19T00:56:36.620 INFO:tasks.workunit.client.0.smithi017.stdout:7/998: write d3/dc/df/d1c/fe7 [2794924,88214] 0 2024-08-19T00:56:36.621 INFO:tasks.workunit.client.0.smithi017.stdout:7/999: chown d3/dc/df/d3d/f132 7974 1 2024-08-19T00:56:36.829 INFO:tasks.workunit.client.0.smithi017.stdout:1/996: sync 2024-08-19T00:56:36.830 INFO:tasks.workunit.client.0.smithi017.stdout:1/997: chown d4/dc/d17/dd6/d75/lec 3 1 2024-08-19T00:56:36.834 INFO:tasks.workunit.client.0.smithi017.stdout:1/998: creat d4/dc/d3b/d3d/d83/d95/dca/df3/f13a x:0 0 0 2024-08-19T00:56:36.834 INFO:tasks.workunit.client.0.smithi017.stdout:1/999: chown d4/dc/d3b/d45 180775478 1 2024-08-19T00:56:37.046 INFO:tasks.workunit.client.0.smithi017.stdout:5/755: sync 2024-08-19T00:56:37.046 INFO:tasks.workunit.client.0.smithi017.stdout:4/931: sync 2024-08-19T00:56:37.046 INFO:tasks.workunit.client.0.smithi017.stdout:9/887: sync 2024-08-19T00:56:37.046 INFO:tasks.workunit.client.0.smithi017.stdout:0/851: sync 2024-08-19T00:56:37.046 INFO:tasks.workunit.client.0.smithi017.stdout:8/970: sync 2024-08-19T00:56:37.048 INFO:tasks.workunit.client.0.smithi017.stdout:8/971: write de/d15/d79/f120 [714429,8664] 0 2024-08-19T00:56:37.051 INFO:tasks.workunit.client.0.smithi017.stdout:5/756: symlink db/d19/d1f/d15/d3e/d40/d49/d63/d80/ddc/l10b 0 2024-08-19T00:56:37.055 INFO:tasks.workunit.client.0.smithi017.stdout:8/972: readlink de/d15/d4f/d68/d84/dc8/d10b/d80/l96 0 2024-08-19T00:56:37.057 INFO:tasks.workunit.client.0.smithi017.stdout:0/852: creat d5/d17/d26/d30/d3e/d5a/dcd/dfc/f122 x:0 0 0 2024-08-19T00:56:37.058 INFO:tasks.workunit.client.0.smithi017.stdout:5/757: symlink db/l10c 0 2024-08-19T00:56:37.059 INFO:tasks.workunit.client.0.smithi017.stdout:4/932: dwrite d2/f6 [0,4194304] 0 2024-08-19T00:56:37.061 INFO:tasks.workunit.client.0.smithi017.stdout:8/973: mknod de/d15/d4f/d68/d84/dc8/d10b/c134 0 2024-08-19T00:56:37.065 INFO:tasks.workunit.client.0.smithi017.stdout:9/888: getdents d0/d84/dd8/d108/d9b 0 2024-08-19T00:56:37.069 INFO:tasks.workunit.client.0.smithi017.stdout:4/933: truncate d2/d1a/d55/d73/f7b 782827 0 2024-08-19T00:56:37.071 INFO:tasks.workunit.client.0.smithi017.stdout:5/758: write db/d19/d1f/d15/f25 [1772026,14920] 0 2024-08-19T00:56:37.074 INFO:tasks.workunit.client.0.smithi017.stdout:0/853: creat d5/dbb/f123 x:0 0 0 2024-08-19T00:56:37.077 INFO:tasks.workunit.client.0.smithi017.stdout:9/889: write d0/d84/dd8/d108/d69/ddd/ff1 [792150,81546] 0 2024-08-19T00:56:37.081 INFO:tasks.workunit.client.0.smithi017.stdout:8/974: creat de/d15/f135 x:0 0 0 2024-08-19T00:56:37.082 INFO:tasks.workunit.client.0.smithi017.stdout:8/975: fsync de/f54 0 2024-08-19T00:56:37.082 INFO:tasks.workunit.client.0.smithi017.stdout:8/976: chown de/d15/f2b 19 1 2024-08-19T00:56:37.089 INFO:tasks.workunit.client.0.smithi017.stdout:4/934: write d2/d87/db2/de6/d40/d56/dbb/f10d [1274757,53130] 0 2024-08-19T00:56:37.092 INFO:tasks.workunit.client.0.smithi017.stdout:8/977: rename de/d15/d39/d3d/f4b to de/d15/d62/d107/f136 0 2024-08-19T00:56:37.130 INFO:tasks.workunit.client.0.smithi017.stdout:4/935: write d2/d11/f72 [752089,83638] 0 2024-08-19T00:56:37.130 INFO:tasks.workunit.client.0.smithi017.stdout:0/854: link d5/da4/fb1 d5/d18/d3a/f124 0 2024-08-19T00:56:37.132 INFO:tasks.workunit.client.0.smithi017.stdout:5/759: dread db/d19/d1f/d15/d3e/d40/f6e [0,4194304] 0 2024-08-19T00:56:37.133 INFO:tasks.workunit.client.0.smithi017.stdout:8/978: symlink de/d15/d39/d3d/d12b/d132/l137 0 2024-08-19T00:56:37.133 INFO:tasks.workunit.client.0.smithi017.stdout:4/936: read d2/d1a/dd0/fc5 [1587981,119500] 0 2024-08-19T00:56:37.134 INFO:tasks.workunit.client.0.smithi017.stdout:8/979: fsync de/f51 0 2024-08-19T00:56:37.134 INFO:tasks.workunit.client.0.smithi017.stdout:4/937: read - d2/d1a/d55/ff2 zero size 2024-08-19T00:56:37.135 INFO:tasks.workunit.client.0.smithi017.stdout:8/980: readlink de/d15/d39/d3d/dc2/l123 0 2024-08-19T00:56:37.136 INFO:tasks.workunit.client.0.smithi017.stdout:4/938: readlink d2/d87/db2/de6/d53/da8/lfd 0 2024-08-19T00:56:37.140 INFO:tasks.workunit.client.0.smithi017.stdout:5/760: symlink db/d19/d1f/d15/d3e/d40/d49/d63/d7b/l10d 0 2024-08-19T00:56:37.145 INFO:tasks.workunit.client.0.smithi017.stdout:8/981: symlink de/d15/d39/d3d/dc2/dd6/ded/l138 0 2024-08-19T00:56:37.147 INFO:tasks.workunit.client.0.smithi017.stdout:0/855: creat d5/d17/d21/f125 x:0 0 0 2024-08-19T00:56:37.148 INFO:tasks.workunit.client.0.smithi017.stdout:5/761: mkdir db/d104/d10e 0 2024-08-19T00:56:37.149 INFO:tasks.workunit.client.0.smithi017.stdout:4/939: write d2/d1a/d55/d73/fb1 [654390,91555] 0 2024-08-19T00:56:37.151 INFO:tasks.workunit.client.0.smithi017.stdout:0/856: mkdir d5/d17/d26/d30/d5d/dce/d126 0 2024-08-19T00:56:37.156 INFO:tasks.workunit.client.0.smithi017.stdout:5/762: rmdir db/d19/d1f/d15/d3e/d40/d49/d63/d80 39 2024-08-19T00:56:37.156 INFO:tasks.workunit.client.0.smithi017.stdout:0/857: dread d5/d17/d21/d42/f86 [0,4194304] 0 2024-08-19T00:56:37.156 INFO:tasks.workunit.client.0.smithi017.stdout:8/982: fdatasync de/d15/f70 0 2024-08-19T00:56:37.158 INFO:tasks.workunit.client.0.smithi017.stdout:8/983: truncate de/d15/d4f/d68/d84/dc8/d10b/f8f 4383300 0 2024-08-19T00:56:37.158 INFO:tasks.workunit.client.0.smithi017.stdout:4/940: write d2/d1a/dd0/fc5 [1674371,90113] 0 2024-08-19T00:56:37.158 INFO:tasks.workunit.client.0.smithi017.stdout:0/858: chown d5/d18/d78/dbc/lbe 12 1 2024-08-19T00:56:37.162 INFO:tasks.workunit.client.0.smithi017.stdout:5/763: creat db/d19/d1f/d15/d3e/d40/d49/d63/d7b/f10f x:0 0 0 2024-08-19T00:56:37.164 INFO:tasks.workunit.client.0.smithi017.stdout:0/859: symlink d5/d17/d26/d30/d3e/d5a/dcd/l127 0 2024-08-19T00:56:37.166 INFO:tasks.workunit.client.0.smithi017.stdout:4/941: truncate d2/d87/db2/de6/d40/d56/d99/da3/faa 757085 0 2024-08-19T00:56:37.167 INFO:tasks.workunit.client.0.smithi017.stdout:5/764: symlink db/d19/d1f/d15/d3e/d40/d83/dca/l110 0 2024-08-19T00:56:37.169 INFO:tasks.workunit.client.0.smithi017.stdout:8/984: rmdir de/d15/d4f/d68/d84/d127 0 2024-08-19T00:56:37.172 INFO:tasks.workunit.client.0.smithi017.stdout:0/860: symlink d5/d18/l128 0 2024-08-19T00:56:37.172 INFO:tasks.workunit.client.0.smithi017.stdout:8/985: stat de/d15/d39/d3d/dc2/dd6/ff1 0 2024-08-19T00:56:37.174 INFO:tasks.workunit.client.0.smithi017.stdout:4/942: dwrite d2/d11/f59 [4194304,4194304] 0 2024-08-19T00:56:37.177 INFO:tasks.workunit.client.0.smithi017.stdout:8/986: truncate de/d36/f6a 4135849 0 2024-08-19T00:56:37.178 INFO:tasks.workunit.client.0.smithi017.stdout:5/765: dwrite db/d19/d1f/d15/d1e/d5f/ff5 [0,4194304] 0 2024-08-19T00:56:37.180 INFO:tasks.workunit.client.0.smithi017.stdout:4/943: mknod d2/d87/db2/de6/d53/d5a/c13f 0 2024-08-19T00:56:37.183 INFO:tasks.workunit.client.0.smithi017.stdout:8/987: symlink de/d36/dad/l139 0 2024-08-19T00:56:37.190 INFO:tasks.workunit.client.0.smithi017.stdout:8/988: mkdir de/d15/d4f/d97/d13a 0 2024-08-19T00:56:37.191 INFO:tasks.workunit.client.0.smithi017.stdout:4/944: dwrite d2/d1a/dd0/fc4 [0,4194304] 0 2024-08-19T00:56:37.193 INFO:tasks.workunit.client.0.smithi017.stdout:8/989: dread - de/d15/d4f/d68/d84/dc8/d10b/d8b/fb3 zero size 2024-08-19T00:56:37.197 INFO:tasks.workunit.client.0.smithi017.stdout:4/945: mkdir d2/d87/dbc/d140 0 2024-08-19T00:56:37.198 INFO:tasks.workunit.client.0.smithi017.stdout:4/946: chown d2/d87/db2/de6/d53/d5a/c13f 3696 1 2024-08-19T00:56:37.201 INFO:tasks.workunit.client.0.smithi017.stdout:8/990: rename de/d15/f29 to de/d15/d79/f13b 0 2024-08-19T00:56:37.211 INFO:tasks.workunit.client.0.smithi017.stdout:5/766: truncate db/d19/d1f/d15/d1e/fa4 149466 0 2024-08-19T00:56:37.213 INFO:tasks.workunit.client.0.smithi017.stdout:5/767: mknod db/d19/daa/c111 0 2024-08-19T00:56:37.215 INFO:tasks.workunit.client.0.smithi017.stdout:5/768: write db/d19/d1f/d15/d3e/d40/d49/d63/f8c [395253,117647] 0 2024-08-19T00:56:37.216 INFO:tasks.workunit.client.0.smithi017.stdout:4/947: write d2/f78 [2467329,128328] 0 2024-08-19T00:56:37.220 INFO:tasks.workunit.client.0.smithi017.stdout:5/769: mknod db/d104/d10e/c112 0 2024-08-19T00:56:37.221 INFO:tasks.workunit.client.0.smithi017.stdout:4/948: truncate d2/d87/dbc/ff0 1006703 0 2024-08-19T00:56:37.222 INFO:tasks.workunit.client.0.smithi017.stdout:5/770: stat db/d19/d1f/d15/d3e/d40/d49/d63/d80/ddc/fde 0 2024-08-19T00:56:37.228 INFO:tasks.workunit.client.0.smithi017.stdout:4/949: creat d2/d87/db2/de6/f141 x:0 0 0 2024-08-19T00:56:37.229 INFO:tasks.workunit.client.0.smithi017.stdout:5/771: dwrite db/d19/d1f/d15/d3e/d40/d49/d63/d80/f97 [0,4194304] 0 2024-08-19T00:56:37.230 INFO:tasks.workunit.client.0.smithi017.stdout:4/950: fdatasync d2/d87/db2/de6/d40/d56/d95/fe9 0 2024-08-19T00:56:37.233 INFO:tasks.workunit.client.0.smithi017.stdout:5/772: fsync db/d19/d1f/f74 0 2024-08-19T00:56:37.236 INFO:tasks.workunit.client.0.smithi017.stdout:4/951: mkdir d2/d87/db2/d116/d117/d142 0 2024-08-19T00:56:37.238 INFO:tasks.workunit.client.0.smithi017.stdout:5/773: mkdir db/d19/d1f/d15/d1e/d5f/dea/df0/d113 0 2024-08-19T00:56:37.240 INFO:tasks.workunit.client.0.smithi017.stdout:5/774: chown db/d19/d1f/d15/d3e/d40/d49/d63/d7b/dba/cec 103346 1 2024-08-19T00:56:37.241 INFO:tasks.workunit.client.0.smithi017.stdout:4/952: symlink d2/d87/db2/d13a/l143 0 2024-08-19T00:56:37.242 INFO:tasks.workunit.client.0.smithi017.stdout:4/953: chown d2/d1a/d55/d8f 8161749 1 2024-08-19T00:56:37.242 INFO:tasks.workunit.client.0.smithi017.stdout:5/775: dread - db/d19/d1f/d15/f7f zero size 2024-08-19T00:56:37.244 INFO:tasks.workunit.client.0.smithi017.stdout:4/954: symlink d2/d87/db2/d116/l144 0 2024-08-19T00:56:37.245 INFO:tasks.workunit.client.0.smithi017.stdout:5/776: symlink db/d19/d1f/d15/d3e/d40/d49/dce/l114 0 2024-08-19T00:56:37.252 INFO:tasks.workunit.client.0.smithi017.stdout:5/777: link db/d19/d1f/d15/d1e/d5f/dea/ffb db/d19/d1f/d15/d1e/d5f/dea/df0/f115 0 2024-08-19T00:56:37.252 INFO:tasks.workunit.client.0.smithi017.stdout:4/955: dwrite d2/d87/db2/de6/d40/ffc [0,4194304] 0 2024-08-19T00:56:37.255 INFO:tasks.workunit.client.0.smithi017.stdout:4/956: mknod d2/d16/d70/c145 0 2024-08-19T00:56:37.257 INFO:tasks.workunit.client.0.smithi017.stdout:5/778: unlink db/d19/d1f/d15/d3e/d40/cb7 0 2024-08-19T00:56:37.259 INFO:tasks.workunit.client.0.smithi017.stdout:4/957: mknod d2/d87/db2/de6/d53/d57/dce/c146 0 2024-08-19T00:56:37.260 INFO:tasks.workunit.client.0.smithi017.stdout:5/779: truncate db/d19/d1f/d15/d3e/d40/d49/de0/fc0 4587623 0 2024-08-19T00:56:37.537 INFO:tasks.workunit.client.0.smithi017.stdout:9/890: sync 2024-08-19T00:56:37.550 INFO:tasks.workunit.client.0.smithi017.stdout:9/891: dread d0/d33/d22/d5a/f88 [0,4194304] 0 2024-08-19T00:56:37.557 INFO:tasks.workunit.client.0.smithi017.stdout:9/892: link d0/d33/d22/d40/ca8 d0/d84/dd8/d108/d9b/de2/c109 0 2024-08-19T00:56:37.609 INFO:tasks.workunit.client.0.smithi017.stdout:9/893: dread d0/d33/fe0 [0,4194304] 0 2024-08-19T00:56:37.611 INFO:tasks.workunit.client.0.smithi017.stdout:5/780: sync 2024-08-19T00:56:37.611 INFO:tasks.workunit.client.0.smithi017.stdout:8/991: sync 2024-08-19T00:56:37.611 INFO:tasks.workunit.client.0.smithi017.stdout:4/958: sync 2024-08-19T00:56:37.611 INFO:tasks.workunit.client.0.smithi017.stdout:0/861: sync 2024-08-19T00:56:37.651 INFO:tasks.workunit.client.0.smithi017.stdout:9/894: creat d0/d33/d22/d5e/dae/f10a x:0 0 0 2024-08-19T00:56:37.657 INFO:tasks.workunit.client.0.smithi017.stdout:5/781: chown db/d19/d1f/d15/d3e/d40/d49/fff 1612 1 2024-08-19T00:56:37.659 INFO:tasks.workunit.client.0.smithi017.stdout:4/959: truncate d2/d87/db2/de6/d40/d56/d99/da3/fb3 3534052 0 2024-08-19T00:56:37.660 INFO:tasks.workunit.client.0.smithi017.stdout:4/960: chown d2/d11/f72 116 1 2024-08-19T00:56:37.666 INFO:tasks.workunit.client.0.smithi017.stdout:5/782: dwrite db/d19/d1f/d15/d3e/d40/d83/d10a/f5e [0,4194304] 0 2024-08-19T00:56:37.668 INFO:tasks.workunit.client.0.smithi017.stdout:5/783: readlink db/d19/d1f/d15/d3e/d40/d49/d63/d80/ddc/l10b 0 2024-08-19T00:56:37.669 INFO:tasks.workunit.client.0.smithi017.stdout:4/961: mkdir d2/d27/d147 0 2024-08-19T00:56:37.670 INFO:tasks.workunit.client.0.smithi017.stdout:5/784: chown db/d19/d1f/d15/d3e/d40/d83/d10a/l4e 373 1 2024-08-19T00:56:37.678 INFO:tasks.workunit.client.0.smithi017.stdout:5/785: truncate db/d19/d1f/d15/d3e/d40/d49/d63/f90 1486381 0 2024-08-19T00:56:37.679 INFO:tasks.workunit.client.0.smithi017.stdout:9/895: link d0/d58/d49/dc3/fc4 d0/d33/d22/d85/da6/dc5/f10b 0 2024-08-19T00:56:37.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:37 smithi017 ceph-mon[16627]: pgmap v29: 65 pgs: 65 active+clean; 3.2 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 86 MiB/s rd, 173 MiB/s wr, 486 op/s 2024-08-19T00:56:37.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:37 smithi086 ceph-mon[24511]: pgmap v29: 65 pgs: 65 active+clean; 3.2 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 86 MiB/s rd, 173 MiB/s wr, 486 op/s 2024-08-19T00:56:37.750 INFO:tasks.workunit.client.0.smithi017.stdout:8/992: write de/f5d [729925,124778] 0 2024-08-19T00:56:37.751 INFO:tasks.workunit.client.0.smithi017.stdout:8/993: chown de/f37 2 1 2024-08-19T00:56:37.754 INFO:tasks.workunit.client.0.smithi017.stdout:8/994: dread - de/d15/d39/d3d/fdc zero size 2024-08-19T00:56:37.754 INFO:tasks.workunit.client.0.smithi017.stdout:0/862: dwrite d5/d18/f23 [0,4194304] 0 2024-08-19T00:56:37.765 INFO:tasks.workunit.client.0.smithi017.stdout:4/962: write d2/d16/d70/f80 [1445027,7576] 0 2024-08-19T00:56:37.768 INFO:tasks.workunit.client.0.smithi017.stdout:4/963: creat d2/d87/db2/de6/d40/f148 x:0 0 0 2024-08-19T00:56:37.774 INFO:tasks.workunit.client.0.smithi017.stdout:4/964: mknod d2/d87/db2/de6/d40/d56/d99/da3/c149 0 2024-08-19T00:56:37.775 INFO:tasks.workunit.client.0.smithi017.stdout:4/965: mkdir d2/d16/d13b/d14a 0 2024-08-19T00:56:37.776 INFO:tasks.workunit.client.0.smithi017.stdout:4/966: write d2/d87/db2/de6/d40/d56/f47 [4119874,116964] 0 2024-08-19T00:56:37.778 INFO:tasks.workunit.client.0.smithi017.stdout:4/967: mknod d2/d16/d70/c14b 0 2024-08-19T00:56:37.779 INFO:tasks.workunit.client.0.smithi017.stdout:4/968: read - d2/d87/db2/de6/d40/d56/d95/fe9 zero size 2024-08-19T00:56:37.780 INFO:tasks.workunit.client.0.smithi017.stdout:4/969: mkdir d2/d1a/da1/d14c 0 2024-08-19T00:56:37.790 INFO:tasks.workunit.client.0.smithi017.stdout:5/786: write db/d19/d1f/d15/d3e/d40/d49/fff [437510,130935] 0 2024-08-19T00:56:37.792 INFO:tasks.workunit.client.0.smithi017.stdout:5/787: fdatasync db/d19/d1f/d15/d3e/d40/d49/fff 0 2024-08-19T00:56:37.799 INFO:tasks.workunit.client.0.smithi017.stdout:5/788: dwrite db/d19/d1f/d15/d1e/d5f/f92 [0,4194304] 0 2024-08-19T00:56:37.822 INFO:tasks.workunit.client.0.smithi017.stdout:0/863: creat d5/d18/f129 x:0 0 0 2024-08-19T00:56:37.830 INFO:tasks.workunit.client.0.smithi017.stdout:0/864: dwrite d5/d17/d21/d42/d9b/dd8/f10c [0,4194304] 0 2024-08-19T00:56:37.849 INFO:tasks.workunit.client.0.smithi017.stdout:8/995: truncate de/d15/d39/fda 1853401 0 2024-08-19T00:56:37.850 INFO:tasks.workunit.client.0.smithi017.stdout:8/996: chown de/d15/d4f/d68/d84/dc8/d10b/d8b 94015 1 2024-08-19T00:56:37.851 INFO:tasks.workunit.client.0.smithi017.stdout:8/997: dread - de/d15/d39/d3d/fdc zero size 2024-08-19T00:56:37.857 INFO:tasks.workunit.client.0.smithi017.stdout:8/998: dread de/d15/f83 [0,4194304] 0 2024-08-19T00:56:37.859 INFO:tasks.workunit.client.0.smithi017.stdout:4/970: write d2/d1a/dd0/fdb [987494,123668] 0 2024-08-19T00:56:37.860 INFO:tasks.workunit.client.0.smithi017.stdout:8/999: chown de/l99 20774489 1 2024-08-19T00:56:37.864 INFO:tasks.workunit.client.0.smithi017.stdout:4/971: mkdir d2/d87/db2/de6/d40/d56/d99/d106/d12a/d100/d14d 0 2024-08-19T00:56:37.874 INFO:tasks.workunit.client.0.smithi017.stdout:0/865: truncate d5/d17/d26/d30/f33 986376 0 2024-08-19T00:56:37.875 INFO:tasks.workunit.client.0.smithi017.stdout:0/866: dread - d5/d17/d26/d30/d3e/d81/dca/f116 zero size 2024-08-19T00:56:37.879 INFO:tasks.workunit.client.0.smithi017.stdout:0/867: rename d5/d17/d21/d39/fa1 to d5/d17/d26/d30/d3e/d5a/f12a 0 2024-08-19T00:56:37.882 INFO:tasks.workunit.client.0.smithi017.stdout:0/868: truncate d5/d18/f82 786568 0 2024-08-19T00:56:37.903 INFO:tasks.workunit.client.0.smithi017.stdout:0/869: fdatasync d5/d17/d26/d30/d5d/dce/fd7 0 2024-08-19T00:56:37.906 INFO:tasks.workunit.client.0.smithi017.stdout:0/870: chown d5/d17/l92 1900285 1 2024-08-19T00:56:37.906 INFO:tasks.workunit.client.0.smithi017.stdout:4/972: dwrite d2/d1a/d20/f52 [4194304,4194304] 0 2024-08-19T00:56:37.911 INFO:tasks.workunit.client.0.smithi017.stdout:4/973: truncate d2/d87/db2/de6/d40/d56/d99/d106/f132 727425 0 2024-08-19T00:56:37.911 INFO:tasks.workunit.client.0.smithi017.stdout:0/871: creat d5/d17/d26/d30/f12b x:0 0 0 2024-08-19T00:56:37.918 INFO:tasks.workunit.client.0.smithi017.stdout:4/974: rename d2/d1a/d55/d73/f134 to d2/d87/db2/de6/d40/d56/dbb/d138/f14e 0 2024-08-19T00:56:37.930 INFO:tasks.workunit.client.0.smithi017.stdout:4/975: write d2/d11/f63 [4306975,4972] 0 2024-08-19T00:56:37.935 INFO:tasks.workunit.client.0.smithi017.stdout:4/976: getdents d2/d87/db2/de6/d40/d56/d99/d106 0 2024-08-19T00:56:37.936 INFO:tasks.workunit.client.0.smithi017.stdout:4/977: chown d2/f12 11310840 1 2024-08-19T00:56:37.936 INFO:tasks.workunit.client.0.smithi017.stdout:0/872: dread d5/d17/d21/d42/d9b/dd8/fde [0,4194304] 0 2024-08-19T00:56:37.939 INFO:tasks.workunit.client.0.smithi017.stdout:0/873: mknod d5/d17/d26/d30/d3e/d5a/dcd/dfc/c12c 0 2024-08-19T00:56:37.940 INFO:tasks.workunit.client.0.smithi017.stdout:4/978: rename d2/dc1/lf4 to d2/d87/db2/de6/d40/d56/dbb/d138/l14f 0 2024-08-19T00:56:37.942 INFO:tasks.workunit.client.0.smithi017.stdout:0/874: truncate d5/d17/d21/d42/f87 911844 0 2024-08-19T00:56:37.950 INFO:tasks.workunit.client.0.smithi017.stdout:0/875: dwrite d5/d18/f129 [0,4194304] 0 2024-08-19T00:56:37.954 INFO:tasks.workunit.client.0.smithi017.stdout:4/979: dwrite d2/d87/db2/de6/d40/f6c [0,4194304] 0 2024-08-19T00:56:37.955 INFO:tasks.workunit.client.0.smithi017.stdout:0/876: symlink d5/d17/d26/d30/d5d/l12d 0 2024-08-19T00:56:37.957 INFO:tasks.workunit.client.0.smithi017.stdout:0/877: read d5/d17/d21/d42/f86 [110634,89588] 0 2024-08-19T00:56:37.958 INFO:tasks.workunit.client.0.smithi017.stdout:4/980: truncate d2/d1a/dd0/fa9 636374 0 2024-08-19T00:56:37.961 INFO:tasks.workunit.client.0.smithi017.stdout:4/981: mkdir d2/d16/d13b/d150 0 2024-08-19T00:56:37.962 INFO:tasks.workunit.client.0.smithi017.stdout:4/982: write d2/d1a/d20/f3b [4820139,4926] 0 2024-08-19T00:56:37.964 INFO:tasks.workunit.client.0.smithi017.stdout:4/983: truncate d2/d1a/d55/d73/d121/ff1 4931218 0 2024-08-19T00:56:37.968 INFO:tasks.workunit.client.0.smithi017.stdout:4/984: fdatasync d2/d1a/d55/d64/f94 0 2024-08-19T00:56:37.968 INFO:tasks.workunit.client.0.smithi017.stdout:0/878: write d5/d17/f1a [8090088,121012] 0 2024-08-19T00:56:37.970 INFO:tasks.workunit.client.0.smithi017.stdout:0/879: write d5/d17/f1a [3074688,66705] 0 2024-08-19T00:56:37.971 INFO:tasks.workunit.client.0.smithi017.stdout:0/880: chown d5/d17/d26/d30/d3e/cf8 28445498 1 2024-08-19T00:56:37.972 INFO:tasks.workunit.client.0.smithi017.stdout:4/985: creat d2/d1a/d55/d73/f151 x:0 0 0 2024-08-19T00:56:37.979 INFO:tasks.workunit.client.0.smithi017.stdout:0/881: creat d5/d17/d26/d30/d5d/dce/d126/f12e x:0 0 0 2024-08-19T00:56:37.981 INFO:tasks.workunit.client.0.smithi017.stdout:0/882: dread - d5/d17/d26/d30/fed zero size 2024-08-19T00:56:37.984 INFO:tasks.workunit.client.0.smithi017.stdout:4/986: write d2/d87/dbc/f119 [2156761,9378] 0 2024-08-19T00:56:37.988 INFO:tasks.workunit.client.0.smithi017.stdout:4/987: creat d2/d87/db2/de6/d53/da8/f152 x:0 0 0 2024-08-19T00:56:37.993 INFO:tasks.workunit.client.0.smithi017.stdout:0/883: dwrite d5/d17/d45/d77/fc3 [0,4194304] 0 2024-08-19T00:56:37.998 INFO:tasks.workunit.client.0.smithi017.stdout:4/988: dwrite d2/d11/f59 [4194304,4194304] 0 2024-08-19T00:56:38.002 INFO:tasks.workunit.client.0.smithi017.stdout:4/989: fsync d2/d87/db2/de6/d40/d56/d99/d106/f132 0 2024-08-19T00:56:38.002 INFO:tasks.workunit.client.0.smithi017.stdout:4/990: chown d2/df7 4255725 1 2024-08-19T00:56:38.004 INFO:tasks.workunit.client.0.smithi017.stdout:4/991: write d2/d1a/d55/ff2 [64785,119480] 0 2024-08-19T00:56:38.005 INFO:tasks.workunit.client.0.smithi017.stdout:0/884: dwrite d5/d18/f11f [0,4194304] 0 2024-08-19T00:56:38.007 INFO:tasks.workunit.client.0.smithi017.stdout:0/885: dread d5/d17/d21/d42/f86 [0,4194304] 0 2024-08-19T00:56:38.012 INFO:tasks.workunit.client.0.smithi017.stdout:0/886: chown d5/d17/d2b/l7d 4349 1 2024-08-19T00:56:38.012 INFO:tasks.workunit.client.0.smithi017.stdout:0/887: stat d5/f106 0 2024-08-19T00:56:38.013 INFO:tasks.workunit.client.0.smithi017.stdout:0/888: chown d5/d17/d26/d30/d5d/db0 3185680 1 2024-08-19T00:56:38.031 INFO:tasks.workunit.client.0.smithi017.stdout:4/992: dwrite d2/d87/db2/de6/d40/d56/fa5 [4194304,4194304] 0 2024-08-19T00:56:38.035 INFO:tasks.workunit.client.0.smithi017.stdout:0/889: dwrite d5/d17/d21/d42/d9b/fc8 [0,4194304] 0 2024-08-19T00:56:38.043 INFO:tasks.workunit.client.0.smithi017.stdout:0/890: dread d5/d17/d21/f55 [0,4194304] 0 2024-08-19T00:56:38.046 INFO:tasks.workunit.client.0.smithi017.stdout:0/891: creat d5/d17/d26/d30/d3e/d81/dca/f12f x:0 0 0 2024-08-19T00:56:38.047 INFO:tasks.workunit.client.0.smithi017.stdout:9/896: sync 2024-08-19T00:56:38.047 INFO:tasks.workunit.client.0.smithi017.stdout:4/993: link d2/d1a/d55/d8f/fc3 d2/d1a/d55/f153 0 2024-08-19T00:56:38.049 INFO:tasks.workunit.client.0.smithi017.stdout:9/897: chown d0/d84/dd8/d108/da2/fdf 47983912 1 2024-08-19T00:56:38.050 INFO:tasks.workunit.client.0.smithi017.stdout:4/994: creat d2/d16/d13b/f154 x:0 0 0 2024-08-19T00:56:38.056 INFO:tasks.workunit.client.0.smithi017.stdout:4/995: dread d2/d87/db2/de6/d40/d56/fa5 [4194304,4194304] 0 2024-08-19T00:56:38.060 INFO:tasks.workunit.client.0.smithi017.stdout:4/996: symlink d2/d11/d24/dbe/l155 0 2024-08-19T00:56:38.063 INFO:tasks.workunit.client.0.smithi017.stdout:0/892: dread d5/d17/d21/f68 [4194304,4194304] 0 2024-08-19T00:56:38.065 INFO:tasks.workunit.client.0.smithi017.stdout:4/997: mknod d2/d87/db2/de6/d40/d56/d99/d106/c156 0 2024-08-19T00:56:38.066 INFO:tasks.workunit.client.0.smithi017.stdout:9/898: write d0/d33/fe0 [4866078,5965] 0 2024-08-19T00:56:38.074 INFO:tasks.workunit.client.0.smithi017.stdout:4/998: dwrite d2/d87/db2/de6/d40/d56/d99/da3/fba [0,4194304] 0 2024-08-19T00:56:38.075 INFO:tasks.workunit.client.0.smithi017.stdout:9/899: creat d0/d84/dd8/def/f10c x:0 0 0 2024-08-19T00:56:38.084 INFO:tasks.workunit.client.0.smithi017.stdout:4/999: creat d2/d16/d13b/d150/f157 x:0 0 0 2024-08-19T00:56:38.085 INFO:tasks.workunit.client.0.smithi017.stdout:0/893: dwrite d5/d17/f69 [4194304,4194304] 0 2024-08-19T00:56:38.093 INFO:tasks.workunit.client.0.smithi017.stdout:0/894: creat d5/d17/d26/d30/d3e/d5a/dcd/dff/f130 x:0 0 0 2024-08-19T00:56:38.098 INFO:tasks.workunit.client.0.smithi017.stdout:9/900: dread d0/d84/dd8/d108/d8e/f81 [0,4194304] 0 2024-08-19T00:56:38.100 INFO:tasks.workunit.client.0.smithi017.stdout:9/901: symlink d0/d58/d49/dc3/l10d 0 2024-08-19T00:56:38.101 INFO:tasks.workunit.client.0.smithi017.stdout:0/895: dwrite d5/d17/f1a [4194304,4194304] 0 2024-08-19T00:56:38.108 INFO:tasks.workunit.client.0.smithi017.stdout:9/902: rename d0/d33/fe0 to d0/d33/d22/d85/da6/f10e 0 2024-08-19T00:56:38.109 INFO:tasks.workunit.client.0.smithi017.stdout:0/896: symlink d5/d17/d26/d30/d5d/db0/de2/d119/l131 0 2024-08-19T00:56:38.109 INFO:tasks.workunit.client.0.smithi017.stdout:9/903: stat d0/d33/df2/ff8 0 2024-08-19T00:56:38.118 INFO:tasks.workunit.client.0.smithi017.stdout:9/904: dwrite d0/d33/d22/fb0 [0,4194304] 0 2024-08-19T00:56:38.121 INFO:tasks.workunit.client.0.smithi017.stdout:5/789: sync 2024-08-19T00:56:38.124 INFO:tasks.workunit.client.0.smithi017.stdout:9/905: dread d0/d84/dd8/d108/d69/fde [0,4194304] 0 2024-08-19T00:56:38.125 INFO:tasks.workunit.client.0.smithi017.stdout:5/790: symlink db/d19/d1f/d15/d1e/l116 0 2024-08-19T00:56:38.128 INFO:tasks.workunit.client.0.smithi017.stdout:9/906: mkdir d0/d33/d22/d40/d10f 0 2024-08-19T00:56:38.134 INFO:tasks.workunit.client.0.smithi017.stdout:9/907: rename d0/f3a to d0/d33/d22/d5a/f110 0 2024-08-19T00:56:38.134 INFO:tasks.workunit.client.0.smithi017.stdout:5/791: dwrite db/d19/d1f/d15/d1e/fcd [0,4194304] 0 2024-08-19T00:56:38.135 INFO:tasks.workunit.client.0.smithi017.stdout:0/897: dwrite d5/d17/d26/d30/d3e/d5a/f12a [0,4194304] 0 2024-08-19T00:56:38.137 INFO:tasks.workunit.client.0.smithi017.stdout:9/908: stat d0/d33/d22/d5e/c9a 0 2024-08-19T00:56:38.137 INFO:tasks.workunit.client.0.smithi017.stdout:5/792: chown db/d19/d1f/d15/f25 3280364 1 2024-08-19T00:56:38.142 INFO:tasks.workunit.client.0.smithi017.stdout:0/898: unlink d5/da4/ddc/fee 0 2024-08-19T00:56:38.143 INFO:tasks.workunit.client.0.smithi017.stdout:0/899: write d5/d18/f129 [1639569,10503] 0 2024-08-19T00:56:38.144 INFO:tasks.workunit.client.0.smithi017.stdout:9/909: mknod d0/d84/dd8/c111 0 2024-08-19T00:56:38.145 INFO:tasks.workunit.client.0.smithi017.stdout:9/910: chown d0 15032212 1 2024-08-19T00:56:38.150 INFO:tasks.workunit.client.0.smithi017.stdout:0/900: rename d5/d17/d26/d30/c64 to d5/d17/d21/d42/c132 0 2024-08-19T00:56:38.153 INFO:tasks.workunit.client.0.smithi017.stdout:0/901: dread d5/d18/f11f [0,4194304] 0 2024-08-19T00:56:38.156 INFO:tasks.workunit.client.0.smithi017.stdout:0/902: creat d5/d17/d26/d30/d3e/f133 x:0 0 0 2024-08-19T00:56:38.159 INFO:tasks.workunit.client.0.smithi017.stdout:0/903: rename d5/d17/d26/l99 to d5/d17/d21/d42/d9b/dd8/df9/l134 0 2024-08-19T00:56:38.161 INFO:tasks.workunit.client.0.smithi017.stdout:0/904: creat d5/d18/d3a/f135 x:0 0 0 2024-08-19T00:56:38.161 INFO:tasks.workunit.client.0.smithi017.stdout:0/905: fdatasync d5/da4/ddc/f10b 0 2024-08-19T00:56:38.166 INFO:tasks.workunit.client.0.smithi017.stdout:5/793: write db/f2e [1999066,21244] 0 2024-08-19T00:56:38.173 INFO:tasks.workunit.client.0.smithi017.stdout:9/911: dwrite d0/d58/f66 [0,4194304] 0 2024-08-19T00:56:38.173 INFO:tasks.workunit.client.0.smithi017.stdout:5/794: dwrite db/d19/d1f/d15/d1e/fd5 [0,4194304] 0 2024-08-19T00:56:38.175 INFO:tasks.workunit.client.0.smithi017.stdout:9/912: fsync d0/d84/ffe 0 2024-08-19T00:56:38.176 INFO:tasks.workunit.client.0.smithi017.stdout:0/906: write d5/d18/f7b [329112,48732] 0 2024-08-19T00:56:38.179 INFO:tasks.workunit.client.0.smithi017.stdout:5/795: mkdir db/d19/d1f/d15/d117 0 2024-08-19T00:56:38.185 INFO:tasks.workunit.client.0.smithi017.stdout:9/913: creat d0/d84/dd8/d108/d9b/de2/d105/f112 x:0 0 0 2024-08-19T00:56:38.185 INFO:tasks.workunit.client.0.smithi017.stdout:0/907: creat d5/d10a/f136 x:0 0 0 2024-08-19T00:56:38.189 INFO:tasks.workunit.client.0.smithi017.stdout:5/796: rename db/d19/d1f/d15/d3e/ld6 to db/d19/d1f/d15/d1e/d5f/dea/l118 0 2024-08-19T00:56:38.191 INFO:tasks.workunit.client.0.smithi017.stdout:9/914: write d0/d84/dd8/d108/d69/fde [829791,73238] 0 2024-08-19T00:56:38.195 INFO:tasks.workunit.client.0.smithi017.stdout:5/797: symlink db/d19/d1f/d15/d3e/l119 0 2024-08-19T00:56:38.197 INFO:tasks.workunit.client.0.smithi017.stdout:9/915: dread d0/d58/d49/d70/db2/fe7 [0,4194304] 0 2024-08-19T00:56:38.198 INFO:tasks.workunit.client.0.smithi017.stdout:5/798: fdatasync db/d19/d1f/d15/d3e/d40/f6e 0 2024-08-19T00:56:38.200 INFO:tasks.workunit.client.0.smithi017.stdout:5/799: fdatasync db/d19/d1f/d15/d3e/d40/d49/d63/d80/f97 0 2024-08-19T00:56:38.204 INFO:tasks.workunit.client.0.smithi017.stdout:0/908: write d5/d17/d26/d30/f71 [652991,74609] 0 2024-08-19T00:56:38.207 INFO:tasks.workunit.client.0.smithi017.stdout:5/800: link db/d19/d1f/d15/f7f db/d19/d1f/d15/d1e/d5f/dea/f11a 0 2024-08-19T00:56:38.208 INFO:tasks.workunit.client.0.smithi017.stdout:9/916: write d0/d84/dd8/d108/d9b/fe1 [2828386,53384] 0 2024-08-19T00:56:38.210 INFO:tasks.workunit.client.0.smithi017.stdout:0/909: truncate d5/d17/d26/d30/d3e/d5a/f84 819221 0 2024-08-19T00:56:38.214 INFO:tasks.workunit.client.0.smithi017.stdout:0/910: creat d5/d17/d26/d30/d3e/d81/f137 x:0 0 0 2024-08-19T00:56:38.219 INFO:tasks.workunit.client.0.smithi017.stdout:5/801: link db/d19/d1f/d15/d3e/d40/d83/d10a/f9f db/d19/d1f/d15/d3e/d40/d49/d63/d7b/dba/f11b 0 2024-08-19T00:56:38.220 INFO:tasks.workunit.client.0.smithi017.stdout:9/917: dwrite d0/f65 [0,4194304] 0 2024-08-19T00:56:38.221 INFO:tasks.workunit.client.0.smithi017.stdout:5/802: dread - db/d19/d1f/d15/fa0 zero size 2024-08-19T00:56:38.221 INFO:tasks.workunit.client.0.smithi017.stdout:9/918: chown d0/d58/d49/d5d/f93 705 1 2024-08-19T00:56:38.225 INFO:tasks.workunit.client.0.smithi017.stdout:5/803: chown db/d19/d1f/d15/d3e/d40/d83/d10a/fac 10595817 1 2024-08-19T00:56:38.232 INFO:tasks.workunit.client.0.smithi017.stdout:0/911: truncate d5/d17/d26/d30/d3e/d81/f8e 1871411 0 2024-08-19T00:56:38.234 INFO:tasks.workunit.client.0.smithi017.stdout:0/912: chown d5/d17/d26/d30/d5d/dce/lef 15565852 1 2024-08-19T00:56:38.240 INFO:tasks.workunit.client.0.smithi017.stdout:0/913: dwrite d5/d17/f1a [0,4194304] 0 2024-08-19T00:56:38.243 INFO:tasks.workunit.client.0.smithi017.stdout:0/914: fdatasync d5/d17/d26/f104 0 2024-08-19T00:56:38.245 INFO:tasks.workunit.client.0.smithi017.stdout:9/919: dwrite d0/d58/d49/d70/f90 [0,4194304] 0 2024-08-19T00:56:38.249 INFO:tasks.workunit.client.0.smithi017.stdout:0/915: fdatasync d5/dba/ffd 0 2024-08-19T00:56:38.252 INFO:tasks.workunit.client.0.smithi017.stdout:5/804: dread db/f10 [0,4194304] 0 2024-08-19T00:56:38.254 INFO:tasks.workunit.client.0.smithi017.stdout:5/805: readlink db/d19/d1f/d15/d3e/l4f 0 2024-08-19T00:56:38.257 INFO:tasks.workunit.client.0.smithi017.stdout:9/920: creat d0/d33/d22/d85/da6/de9/f113 x:0 0 0 2024-08-19T00:56:38.260 INFO:tasks.workunit.client.0.smithi017.stdout:5/806: truncate db/d19/d1f/d15/d3e/d40/d49/d63/d7b/fc2 37739 0 2024-08-19T00:56:38.263 INFO:tasks.workunit.client.0.smithi017.stdout:5/807: dread db/d19/d8d/f94 [0,4194304] 0 2024-08-19T00:56:38.265 INFO:tasks.workunit.client.0.smithi017.stdout:9/921: dwrite d0/d84/ff0 [0,4194304] 0 2024-08-19T00:56:38.265 INFO:tasks.workunit.client.0.smithi017.stdout:0/916: write d5/d17/d21/d42/f87 [179403,69303] 0 2024-08-19T00:56:38.267 INFO:tasks.workunit.client.0.smithi017.stdout:0/917: write d5/d17/d21/f125 [112888,11062] 0 2024-08-19T00:56:38.270 INFO:tasks.workunit.client.0.smithi017.stdout:0/918: dread - d5/d17/d2b/df4/de8/f11a zero size 2024-08-19T00:56:38.270 INFO:tasks.workunit.client.0.smithi017.stdout:5/808: mknod db/d19/d1f/d15/d3e/d40/d83/dca/c11c 0 2024-08-19T00:56:38.271 INFO:tasks.workunit.client.0.smithi017.stdout:0/919: chown d5/d17/d21/f68 16436114 1 2024-08-19T00:56:38.271 INFO:tasks.workunit.client.0.smithi017.stdout:5/809: chown db/d19/daa 23 1 2024-08-19T00:56:38.274 INFO:tasks.workunit.client.0.smithi017.stdout:0/920: mknod d5/d17/d2b/df4/c138 0 2024-08-19T00:56:38.275 INFO:tasks.workunit.client.0.smithi017.stdout:9/922: link d0/d33/l31 d0/d58/d49/d5d/dd5/l114 0 2024-08-19T00:56:38.282 INFO:tasks.workunit.client.0.smithi017.stdout:0/921: dwrite d5/d18/f129 [0,4194304] 0 2024-08-19T00:56:38.283 INFO:tasks.workunit.client.0.smithi017.stdout:9/923: dwrite d0/d58/d49/d70/db2/ff3 [0,4194304] 0 2024-08-19T00:56:38.289 INFO:tasks.workunit.client.0.smithi017.stdout:0/922: stat d5/d17/d26/d30/d3e/d5a/dcd/dd3/cd9 0 2024-08-19T00:56:38.291 INFO:tasks.workunit.client.0.smithi017.stdout:0/923: fsync d5/d17/d26/d30/d3e/d5a/dcd/dff/f130 0 2024-08-19T00:56:38.293 INFO:tasks.workunit.client.0.smithi017.stdout:0/924: chown d5/d17/d26/d30/d5d/db0/dc7 28 1 2024-08-19T00:56:38.296 INFO:tasks.workunit.client.0.smithi017.stdout:0/925: dread d5/d17/d26/d30/feb [0,4194304] 0 2024-08-19T00:56:38.298 INFO:tasks.workunit.client.0.smithi017.stdout:9/924: truncate d0/d84/dd8/d108/d8e/fcf 495748 0 2024-08-19T00:56:38.303 INFO:tasks.workunit.client.0.smithi017.stdout:5/810: dread db/d19/d1f/d15/d3e/f6f [0,4194304] 0 2024-08-19T00:56:38.305 INFO:tasks.workunit.client.0.smithi017.stdout:5/811: mkdir db/d104/d10e/d11d 0 2024-08-19T00:56:38.306 INFO:tasks.workunit.client.0.smithi017.stdout:5/812: chown db/d19/d1f/d15/d3e/d40/d49/d63/f90 6967 1 2024-08-19T00:56:38.307 INFO:tasks.workunit.client.0.smithi017.stdout:5/813: chown db/d19/d1f/dbd/l9c 522 1 2024-08-19T00:56:38.312 INFO:tasks.workunit.client.0.smithi017.stdout:5/814: read db/d19/d1f/d15/f5a [3553068,92469] 0 2024-08-19T00:56:38.312 INFO:tasks.workunit.client.0.smithi017.stdout:0/926: truncate d5/d17/d45/d77/fc3 4141583 0 2024-08-19T00:56:38.313 INFO:tasks.workunit.client.0.smithi017.stdout:9/925: write d0/d84/dd8/d108/d8e/f99 [813615,97029] 0 2024-08-19T00:56:38.316 INFO:tasks.workunit.client.0.smithi017.stdout:9/926: creat d0/d33/d22/d85/f115 x:0 0 0 2024-08-19T00:56:38.318 INFO:tasks.workunit.client.0.smithi017.stdout:9/927: creat d0/d84/dd8/f116 x:0 0 0 2024-08-19T00:56:38.320 INFO:tasks.workunit.client.0.smithi017.stdout:9/928: unlink d0/d33/d22/d40/la9 0 2024-08-19T00:56:38.323 INFO:tasks.workunit.client.0.smithi017.stdout:9/929: rename d0/f5b to d0/d33/d22/d40/f117 0 2024-08-19T00:56:38.328 INFO:tasks.workunit.client.0.smithi017.stdout:9/930: rename d0/d84/dd8/d108/da2/cce to d0/d58/d49/d70/c118 0 2024-08-19T00:56:38.329 INFO:tasks.workunit.client.0.smithi017.stdout:9/931: fsync d0/d33/d22/d85/da6/f10e 0 2024-08-19T00:56:38.331 INFO:tasks.workunit.client.0.smithi017.stdout:9/932: write d0/d84/dd8/d108/d69/fec [859542,122241] 0 2024-08-19T00:56:38.336 INFO:tasks.workunit.client.0.smithi017.stdout:9/933: rename d0/d58/d49/f4f to d0/d33/d22/d5e/dae/f119 0 2024-08-19T00:56:38.338 INFO:tasks.workunit.client.0.smithi017.stdout:9/934: mkdir d0/d84/dd8/def/d11a 0 2024-08-19T00:56:38.347 INFO:tasks.workunit.client.0.smithi017.stdout:9/935: write d0/d84/dd8/d108/d9b/fd7 [348772,14385] 0 2024-08-19T00:56:38.360 INFO:tasks.workunit.client.0.smithi017.stdout:9/936: dread d0/f18 [0,4194304] 0 2024-08-19T00:56:38.362 INFO:tasks.workunit.client.0.smithi017.stdout:9/937: mkdir d0/d33/d22/d5a/d11b 0 2024-08-19T00:56:38.366 INFO:tasks.workunit.client.0.smithi017.stdout:9/938: rename d0/d84/dd8/d108/da2/fb4 to d0/d33/d22/d5a/f11c 0 2024-08-19T00:56:38.368 INFO:tasks.workunit.client.0.smithi017.stdout:9/939: truncate d0/d84/dd8/d108/d9b/fd7 4366766 0 2024-08-19T00:56:38.371 INFO:tasks.workunit.client.0.smithi017.stdout:9/940: rename d0/d58/d49 to d0/d33/df2/d11d 0 2024-08-19T00:56:38.375 INFO:tasks.workunit.client.0.smithi017.stdout:9/941: mknod d0/d84/dd8/dfb/c11e 0 2024-08-19T00:56:38.375 INFO:tasks.workunit.client.0.smithi017.stdout:9/942: readlink d0/d33/d22/d40/l8b 0 2024-08-19T00:56:38.376 INFO:tasks.workunit.client.0.smithi017.stdout:9/943: stat d0/d33/d22/d85/fe8 0 2024-08-19T00:56:38.378 INFO:tasks.workunit.client.0.smithi017.stdout:9/944: dread - d0/d33/d22/d5e/dae/f102 zero size 2024-08-19T00:56:38.385 INFO:tasks.workunit.client.0.smithi017.stdout:9/945: mknod d0/d33/df2/d11d/d70/c11f 0 2024-08-19T00:56:38.386 INFO:tasks.workunit.client.0.smithi017.stdout:9/946: chown d0/d33/d22/l43 2322 1 2024-08-19T00:56:38.389 INFO:tasks.workunit.client.0.smithi017.stdout:9/947: truncate d0/d84/dd8/d108/d9b/de2/d105/f112 514413 0 2024-08-19T00:56:38.392 INFO:tasks.workunit.client.0.smithi017.stdout:9/948: creat d0/d33/df2/d11d/d70/f120 x:0 0 0 2024-08-19T00:56:38.395 INFO:tasks.workunit.client.0.smithi017.stdout:9/949: truncate d0/f47 2090480 0 2024-08-19T00:56:38.397 INFO:tasks.workunit.client.0.smithi017.stdout:9/950: mknod d0/d84/dd8/d108/d69/c121 0 2024-08-19T00:56:38.399 INFO:tasks.workunit.client.0.smithi017.stdout:9/951: rename d0/d84/dd8/d108 to d0/d84/dd8/d108/d9b/de2/d105/d122 22 2024-08-19T00:56:38.426 INFO:tasks.workunit.client.0.smithi017.stdout:9/952: write d0/d58/f3e [3848191,112131] 0 2024-08-19T00:56:38.427 INFO:tasks.workunit.client.0.smithi017.stdout:9/953: mknod d0/d33/df2/c123 0 2024-08-19T00:56:38.430 INFO:tasks.workunit.client.0.smithi017.stdout:9/954: getdents d0/d33/d22/d5a/d11b 0 2024-08-19T00:56:38.433 INFO:tasks.workunit.client.0.smithi017.stdout:9/955: rename d0/d84/dd8/d108/d9b/ld0 to d0/d33/d22/d40/d10f/l124 0 2024-08-19T00:56:38.434 INFO:tasks.workunit.client.0.smithi017.stdout:9/956: rmdir d0/d58 39 2024-08-19T00:56:38.469 INFO:tasks.workunit.client.0.smithi017.stdout:9/957: write d0/d33/f17 [1790917,45387] 0 2024-08-19T00:56:38.473 INFO:tasks.workunit.client.0.smithi017.stdout:9/958: truncate d0/d58/d9f/f100 502852 0 2024-08-19T00:56:38.475 INFO:tasks.workunit.client.0.smithi017.stdout:9/959: write d0/d84/dd8/d108/d69/fec [1715585,47885] 0 2024-08-19T00:56:38.480 INFO:tasks.workunit.client.0.smithi017.stdout:9/960: creat d0/d58/d9f/f125 x:0 0 0 2024-08-19T00:56:38.481 INFO:tasks.workunit.client.0.smithi017.stdout:9/961: chown d0/d33/df2/d11d/c7f 28380 1 2024-08-19T00:56:38.486 INFO:tasks.workunit.client.0.smithi017.stdout:9/962: mkdir d0/d33/df2/d11d/d70/db2/d126 0 2024-08-19T00:56:38.488 INFO:tasks.workunit.client.0.smithi017.stdout:9/963: write d0/d33/df2/d11d/d70/f120 [881984,12401] 0 2024-08-19T00:56:38.495 INFO:tasks.workunit.client.0.smithi017.stdout:9/964: symlink d0/d58/l127 0 2024-08-19T00:56:38.516 INFO:tasks.workunit.client.0.smithi017.stdout:9/965: dwrite d0/d33/df2/d11d/d5d/f9c [0,4194304] 0 2024-08-19T00:56:38.521 INFO:tasks.workunit.client.0.smithi017.stdout:9/966: creat d0/d33/d22/d85/f128 x:0 0 0 2024-08-19T00:56:38.526 INFO:tasks.workunit.client.0.smithi017.stdout:9/967: fsync d0/d33/fea 0 2024-08-19T00:56:38.531 INFO:tasks.workunit.client.0.smithi017.stdout:9/968: mkdir d0/d84/dd8/d108/da2/d129 0 2024-08-19T00:56:38.533 INFO:tasks.workunit.client.0.smithi017.stdout:9/969: rmdir d0/d33/df2/d11d 39 2024-08-19T00:56:38.543 INFO:tasks.workunit.client.0.smithi017.stdout:9/970: dread d0/d33/d22/d40/fbb [0,4194304] 0 2024-08-19T00:56:38.545 INFO:tasks.workunit.client.0.smithi017.stdout:9/971: mknod d0/d84/dd8/dfb/c12a 0 2024-08-19T00:56:38.564 INFO:tasks.workunit.client.0.smithi017.stdout:9/972: dread d0/d33/f4d [0,4194304] 0 2024-08-19T00:56:38.596 INFO:tasks.workunit.client.0.smithi017.stdout:9/973: fdatasync d0/d33/d22/d5a/f88 0 2024-08-19T00:56:38.603 INFO:tasks.workunit.client.0.smithi017.stdout:9/974: dwrite d0/d84/dd8/d108/d9b/fda [0,4194304] 0 2024-08-19T00:56:38.603 INFO:tasks.workunit.client.0.smithi017.stdout:9/975: dread - d0/d84/dd8/d108/da2/fdf zero size 2024-08-19T00:56:38.607 INFO:tasks.workunit.client.0.smithi017.stdout:9/976: fdatasync d0/d84/dd8/d108/d8e/f81 0 2024-08-19T00:56:38.617 INFO:tasks.workunit.client.0.smithi017.stdout:9/977: link d0/d33/d22/d5a/f5f d0/d33/df2/d11d/d70/db2/d126/f12b 0 2024-08-19T00:56:38.631 INFO:tasks.workunit.client.0.smithi017.stdout:9/978: write d0/d33/d22/d5a/f11c [828601,42518] 0 2024-08-19T00:56:38.642 INFO:tasks.workunit.client.0.smithi017.stdout:9/979: dread d0/d33/df2/d11d/dc3/fb6 [0,4194304] 0 2024-08-19T00:56:38.644 INFO:tasks.workunit.client.0.smithi017.stdout:9/980: fdatasync d0/d33/df2/d11d/d5d/f74 0 2024-08-19T00:56:38.644 INFO:tasks.workunit.client.0.smithi017.stdout:9/981: read - d0/d84/dd8/f116 zero size 2024-08-19T00:56:38.648 INFO:tasks.workunit.client.0.smithi017.stdout:9/982: mknod d0/d33/d22/d40/de5/c12c 0 2024-08-19T00:56:38.649 INFO:tasks.workunit.client.0.smithi017.stdout:9/983: write d0/d33/df2/d11d/d5d/f9c [4362012,35476] 0 2024-08-19T00:56:38.654 INFO:tasks.workunit.client.0.smithi017.stdout:9/984: link d0/d33/d22/ldb d0/d84/dd8/d108/da2/d129/l12d 0 2024-08-19T00:56:38.660 INFO:tasks.workunit.client.0.smithi017.stdout:9/985: dwrite d0/d33/d22/d5e/dae/f102 [0,4194304] 0 2024-08-19T00:56:38.662 INFO:tasks.workunit.client.0.smithi017.stdout:9/986: mknod d0/d33/d22/d40/d10f/c12e 0 2024-08-19T00:56:38.666 INFO:tasks.workunit.client.0.smithi017.stdout:9/987: unlink d0/d33/c1f 0 2024-08-19T00:56:38.667 INFO:tasks.workunit.client.0.smithi017.stdout:9/988: read d0/d33/df2/d11d/d70/db2/fe7 [695825,81723] 0 2024-08-19T00:56:38.670 INFO:tasks.workunit.client.0.smithi017.stdout:9/989: rename d0/d33/df2/ff8 to d0/d33/df2/d11d/dc3/f12f 0 2024-08-19T00:56:38.671 INFO:tasks.workunit.client.0.smithi017.stdout:9/990: chown d0/l68 564957 1 2024-08-19T00:56:38.684 INFO:tasks.workunit.client.0.smithi017.stdout:9/991: dwrite d0/f34 [0,4194304] 0 2024-08-19T00:56:38.688 INFO:tasks.workunit.client.0.smithi017.stdout:9/992: unlink d0/d33/d22/d40/l8b 0 2024-08-19T00:56:38.689 INFO:tasks.workunit.client.0.smithi017.stdout:9/993: rename d0/d84/dd8/d108/d9b to d0/d84/dd8/d108/d9b/de2/d130 22 2024-08-19T00:56:38.691 INFO:tasks.workunit.client.0.smithi017.stdout:9/994: chown d0/d33/df2/d11d/d70/c118 13024 1 2024-08-19T00:56:38.692 INFO:tasks.workunit.client.0.smithi017.stdout:9/995: chown d0/d84/dd8/d108/d69/fa4 0 1 2024-08-19T00:56:38.693 INFO:tasks.workunit.client.0.smithi017.stdout:9/996: chown d0/d84/dd8/def/d11a 72979 1 2024-08-19T00:56:38.697 INFO:tasks.workunit.client.0.smithi017.stdout:9/997: rename d0/d33/d22/d5a/d11b to d0/d131 0 2024-08-19T00:56:38.708 INFO:tasks.workunit.client.0.smithi017.stdout:9/998: dwrite d0/d84/dd8/d108/f94 [8388608,4194304] 0 2024-08-19T00:56:38.709 INFO:tasks.workunit.client.0.smithi017.stdout:9/999: chown d0/d33/d22/d85/fc1 680 1 2024-08-19T00:56:38.889 INFO:tasks.workunit.client.0.smithi017.stdout:0/927: sync 2024-08-19T00:56:38.889 INFO:tasks.workunit.client.0.smithi017.stdout:5/815: sync 2024-08-19T00:56:38.890 INFO:tasks.workunit.client.0.smithi017.stdout:0/928: chown d5/d17/d26/d30/d5d/c9e 1314 1 2024-08-19T00:56:38.891 INFO:tasks.workunit.client.0.smithi017.stdout:5/816: dread - db/d19/d1f/d15/fb6 zero size 2024-08-19T00:56:38.892 INFO:tasks.workunit.client.0.smithi017.stdout:5/817: chown db/d19/d1f/d15/d1e/fcd 44 1 2024-08-19T00:56:38.894 INFO:tasks.workunit.client.0.smithi017.stdout:0/929: unlink d5/d17/d26/d30/d3e/f133 0 2024-08-19T00:56:38.897 INFO:tasks.workunit.client.0.smithi017.stdout:0/930: mknod d5/c139 0 2024-08-19T00:56:38.898 INFO:tasks.workunit.client.0.smithi017.stdout:0/931: write d5/d17/d26/f104 [2151602,13120] 0 2024-08-19T00:56:38.901 INFO:tasks.workunit.client.0.smithi017.stdout:0/932: creat d5/da4/ddc/f13a x:0 0 0 2024-08-19T00:56:38.906 INFO:tasks.workunit.client.0.smithi017.stdout:5/818: dread db/d19/d1f/d15/d1e/d5f/f6b [0,4194304] 0 2024-08-19T00:56:38.909 INFO:tasks.workunit.client.0.smithi017.stdout:5/819: mknod db/d19/d1f/d15/d1e/d5f/dea/df0/c11e 0 2024-08-19T00:56:38.913 INFO:tasks.workunit.client.0.smithi017.stdout:5/820: rename db/c48 to db/d19/d1f/d15/d3e/d40/d49/d63/d7b/dba/c11f 0 2024-08-19T00:56:38.915 INFO:tasks.workunit.client.0.smithi017.stdout:5/821: rename db/d19/daa/cd9 to db/d19/d8d/c120 0 2024-08-19T00:56:38.918 INFO:tasks.workunit.client.0.smithi017.stdout:0/933: truncate d5/d17/d2b/f74 1620163 0 2024-08-19T00:56:38.920 INFO:tasks.workunit.client.0.smithi017.stdout:5/822: rename db/d19/d8d/deb to db/d121 0 2024-08-19T00:56:38.921 INFO:tasks.workunit.client.0.smithi017.stdout:0/934: creat d5/d17/d26/d30/d5d/f13b x:0 0 0 2024-08-19T00:56:38.923 INFO:tasks.workunit.client.0.smithi017.stdout:0/935: chown d5/d18/f82 0 1 2024-08-19T00:56:38.924 INFO:tasks.workunit.client.0.smithi017.stdout:5/823: symlink db/d19/d1f/d15/d109/l122 0 2024-08-19T00:56:38.926 INFO:tasks.workunit.client.0.smithi017.stdout:5/824: fdatasync db/d19/d1f/d15/d3e/d40/d49/d63/d7b/fee 0 2024-08-19T00:56:38.927 INFO:tasks.workunit.client.0.smithi017.stdout:5/825: readlink db/d19/d1f/d15/l54 0 2024-08-19T00:56:38.931 INFO:tasks.workunit.client.0.smithi017.stdout:5/826: mkdir db/d19/d1f/dbd/d123 0 2024-08-19T00:56:38.936 INFO:tasks.workunit.client.0.smithi017.stdout:5/827: link db/d19/d1f/d15/d3e/d40/d83/d10a/f5e db/d104/f124 0 2024-08-19T00:56:38.940 INFO:tasks.workunit.client.0.smithi017.stdout:0/936: write d5/d17/d2b/f74 [806269,104489] 0 2024-08-19T00:56:38.943 INFO:tasks.workunit.client.0.smithi017.stdout:0/937: read d5/d17/d26/d30/d3e/f91 [1651037,128089] 0 2024-08-19T00:56:38.946 INFO:tasks.workunit.client.0.smithi017.stdout:0/938: rmdir d5/d17/d26/d30/d5d/dce/d126 39 2024-08-19T00:56:38.947 INFO:tasks.workunit.client.0.smithi017.stdout:5/828: write db/d19/d1f/d15/d1e/d5f/f73 [289050,32912] 0 2024-08-19T00:56:38.951 INFO:tasks.workunit.client.0.smithi017.stdout:5/829: fdatasync db/d19/d1f/d15/d3e/fbc 0 2024-08-19T00:56:38.955 INFO:tasks.workunit.client.0.smithi017.stdout:5/830: symlink db/d19/d1f/d15/d3e/d40/d49/de0/l125 0 2024-08-19T00:56:38.956 INFO:tasks.workunit.client.0.smithi017.stdout:0/939: link d5/d17/d26/d30/feb d5/d17/d26/d30/d5d/dce/d126/f13c 0 2024-08-19T00:56:38.956 INFO:tasks.workunit.client.0.smithi017.stdout:0/940: chown d5/d10a 7 1 2024-08-19T00:56:38.959 INFO:tasks.workunit.client.0.smithi017.stdout:0/941: unlink d5/d17/d21/d39/db6/cbf 0 2024-08-19T00:56:38.961 INFO:tasks.workunit.client.0.smithi017.stdout:5/831: link db/d19/d1f/d15/d1e/d5f/f73 db/d19/d1f/d15/d1e/f126 0 2024-08-19T00:56:38.969 INFO:tasks.workunit.client.0.smithi017.stdout:0/942: truncate d5/f16 404045 0 2024-08-19T00:56:38.970 INFO:tasks.workunit.client.0.smithi017.stdout:5/832: truncate db/d19/d1f/d15/d3e/d40/f103 449971 0 2024-08-19T00:56:38.972 INFO:tasks.workunit.client.0.smithi017.stdout:0/943: truncate d5/dba/ffd 768475 0 2024-08-19T00:56:38.974 INFO:tasks.workunit.client.0.smithi017.stdout:0/944: chown d5/d17/d26/d30/d3e/d5a/dcd/dfc/c12c 186967 1 2024-08-19T00:56:38.978 INFO:tasks.workunit.client.0.smithi017.stdout:0/945: dread - d5/d17/d21/d42/d9b/fc6 zero size 2024-08-19T00:56:38.981 INFO:tasks.workunit.client.0.smithi017.stdout:0/946: read - d5/da4/fb1 zero size 2024-08-19T00:56:38.981 INFO:tasks.workunit.client.0.smithi017.stdout:5/833: write db/d19/d1f/d15/d3e/d40/d83/d10a/f5e [911500,48882] 0 2024-08-19T00:56:38.985 INFO:tasks.workunit.client.0.smithi017.stdout:5/834: creat db/d19/d1f/d15/d3e/d40/dad/f127 x:0 0 0 2024-08-19T00:56:38.986 INFO:tasks.workunit.client.0.smithi017.stdout:5/835: chown db/d19/d1f/d15/d3e/d40/d49/d63/d80/ddc/l10b 668 1 2024-08-19T00:56:38.992 INFO:tasks.workunit.client.0.smithi017.stdout:0/947: write d5/d17/d26/d30/d5d/dce/d126/f13c [759607,47871] 0 2024-08-19T00:56:39.002 INFO:tasks.workunit.client.0.smithi017.stdout:0/948: dwrite d5/d18/f4a [0,4194304] 0 2024-08-19T00:56:39.005 INFO:tasks.workunit.client.0.smithi017.stdout:0/949: mknod d5/d17/d45/d50/c13d 0 2024-08-19T00:56:39.009 INFO:tasks.workunit.client.0.smithi017.stdout:0/950: creat d5/d17/d26/d30/d5d/dce/f13e x:0 0 0 2024-08-19T00:56:39.012 INFO:tasks.workunit.client.0.smithi017.stdout:0/951: mkdir d5/d17/d45/d77/d13f 0 2024-08-19T00:56:39.015 INFO:tasks.workunit.client.0.smithi017.stdout:0/952: truncate d5/d18/f11d 3001841 0 2024-08-19T00:56:39.018 INFO:tasks.workunit.client.0.smithi017.stdout:0/953: mkdir d5/d17/d21/d42/d9b/dd8/d140 0 2024-08-19T00:56:39.019 INFO:tasks.workunit.client.0.smithi017.stdout:0/954: chown d5/d17/d21/d42/l36 4805 1 2024-08-19T00:56:39.031 INFO:tasks.workunit.client.0.smithi017.stdout:0/955: dwrite d5/d17/d26/fc4 [0,4194304] 0 2024-08-19T00:56:39.034 INFO:tasks.workunit.client.0.smithi017.stdout:0/956: readlink d5/d17/d21/d42/d9b/l113 0 2024-08-19T00:56:39.040 INFO:tasks.workunit.client.0.smithi017.stdout:0/957: write d5/d17/d21/d42/d9b/dd8/ff1 [383080,67990] 0 2024-08-19T00:56:39.041 INFO:tasks.workunit.client.0.smithi017.stdout:0/958: chown d5/d18/d3a/dc1/lc5 22503532 1 2024-08-19T00:56:39.042 INFO:tasks.workunit.client.0.smithi017.stdout:0/959: chown d5/d17/d26/d30/d3e/f91 0 1 2024-08-19T00:56:39.045 INFO:tasks.workunit.client.0.smithi017.stdout:0/960: write d5/d17/d21/d39/f44 [2398886,108567] 0 2024-08-19T00:56:39.047 INFO:tasks.workunit.client.0.smithi017.stdout:0/961: fsync d5/d17/d26/d30/d3e/d5a/f12a 0 2024-08-19T00:56:39.048 INFO:tasks.workunit.client.0.smithi017.stdout:0/962: dread - d5/d18/d3a/f135 zero size 2024-08-19T00:56:39.058 INFO:tasks.workunit.client.0.smithi017.stdout:0/963: dread d5/d17/f69 [0,4194304] 0 2024-08-19T00:56:39.061 INFO:tasks.workunit.client.0.smithi017.stdout:0/964: creat d5/d17/d26/f141 x:0 0 0 2024-08-19T00:56:39.062 INFO:tasks.workunit.client.0.smithi017.stdout:0/965: mknod d5/d17/c142 0 2024-08-19T00:56:39.068 INFO:tasks.workunit.client.0.smithi017.stdout:0/966: dwrite d5/dbb/f123 [0,4194304] 0 2024-08-19T00:56:39.069 INFO:tasks.workunit.client.0.smithi017.stdout:0/967: write d5/d18/f1e [1089682,50219] 0 2024-08-19T00:56:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:38 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:38 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:38 smithi017 ceph-mon[16627]: pgmap v30: 65 pgs: 65 active+clean; 3.2 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 53 MiB/s rd, 104 MiB/s wr, 308 op/s 2024-08-19T00:56:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:38 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:56:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:38 smithi017 ceph-mon[16627]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:56:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:38 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017.front.sepia.ceph.com:9095"}]: dispatch 2024-08-19T00:56:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:38 smithi017 ceph-mon[16627]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017.front.sepia.ceph.com:9095"}]: dispatch 2024-08-19T00:56:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:38 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:38 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:56:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:38 smithi017 ceph-mon[16627]: Upgrade: Need to upgrade myself (mgr.smithi086.uthxct) 2024-08-19T00:56:39.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:38 smithi017 ceph-mon[16627]: Upgrade: Need to upgrade myself (mgr.smithi086.uthxct) 2024-08-19T00:56:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:38 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:38 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:38 smithi086 ceph-mon[24511]: pgmap v30: 65 pgs: 65 active+clean; 3.2 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 53 MiB/s rd, 104 MiB/s wr, 308 op/s 2024-08-19T00:56:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:38 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:56:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:38 smithi086 ceph-mon[24511]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:56:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:38 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017.front.sepia.ceph.com:9095"}]: dispatch 2024-08-19T00:56:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:38 smithi086 ceph-mon[24511]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017.front.sepia.ceph.com:9095"}]: dispatch 2024-08-19T00:56:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:38 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:38 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:56:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:38 smithi086 ceph-mon[24511]: Upgrade: Need to upgrade myself (mgr.smithi086.uthxct) 2024-08-19T00:56:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:38 smithi086 ceph-mon[24511]: Upgrade: Need to upgrade myself (mgr.smithi086.uthxct) 2024-08-19T00:56:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.556+0000 7f83cddaf640 1 -- 172.21.15.17:0/1248019807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c8100680 msgr2=0x7f83c8102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.556+0000 7f83cddaf640 1 --2- 172.21.15.17:0/1248019807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c8100680 0x7f83c8102a70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83b80098b0 tx=0x7f83b802a4d0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.556+0000 7f83cddaf640 1 -- 172.21.15.17:0/1248019807 shutdown_connections 2024-08-19T00:56:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.556+0000 7f83cddaf640 1 --2- 172.21.15.17:0/1248019807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83c8102fb0 0x7f83c81053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.556+0000 7f83cddaf640 1 --2- 172.21.15.17:0/1248019807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c8100680 0x7f83c8102a70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.556+0000 7f83cddaf640 1 -- 172.21.15.17:0/1248019807 >> 172.21.15.17:0/1248019807 conn(0x7f83c80fa280 msgr2=0x7f83c80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:39.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.556+0000 7f83cddaf640 1 -- 172.21.15.17:0/1248019807 shutdown_connections 2024-08-19T00:56:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.557+0000 7f83cddaf640 1 -- 172.21.15.17:0/1248019807 wait complete. 2024-08-19T00:56:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.557+0000 7f83cddaf640 1 Processor -- start 2024-08-19T00:56:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.557+0000 7f83cddaf640 1 -- start start 2024-08-19T00:56:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.558+0000 7f83cddaf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c8100680 0x7f83c80fffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.558+0000 7f83cddaf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83c8102fb0 0x7f83c80fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.558+0000 7f83cddaf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80feb70 con 0x7f83c8100680 2024-08-19T00:56:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.558+0000 7f83cddaf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80fece0 con 0x7f83c8102fb0 2024-08-19T00:56:39.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.558+0000 7f83c6ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83c8102fb0 0x7f83c80fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.558+0000 7f83c6ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83c8102fb0 0x7f83c80fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.17:46758/0 (socket says 172.21.15.17:46758) 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.558+0000 7f83c6ffd640 1 -- 172.21.15.17:0/1852865089 learned_addr learned my addr 172.21.15.17:0/1852865089 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.558+0000 7f83c77fe640 1 --2- 172.21.15.17:0/1852865089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c8100680 0x7f83c80fffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.558+0000 7f83c6ffd640 1 -- 172.21.15.17:0/1852865089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c8100680 msgr2=0x7f83c80fffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.558+0000 7f83c6ffd640 1 --2- 172.21.15.17:0/1852865089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c8100680 0x7f83c80fffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.558+0000 7f83c6ffd640 1 -- 172.21.15.17:0/1852865089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc009490 con 0x7f83c8102fb0 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.559+0000 7f83c6ffd640 1 --2- 172.21.15.17:0/1852865089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83c8102fb0 0x7f83c80fe630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00e920 tx=0x7f83bc00ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.559+0000 7f83c4ff9640 1 -- 172.21.15.17:0/1852865089 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83bc009790 con 0x7f83c8102fb0 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.559+0000 7f83c4ff9640 1 -- 172.21.15.17:0/1852865089 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83bc00cd50 con 0x7f83c8102fb0 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.559+0000 7f83cddaf640 1 -- 172.21.15.17:0/1852865089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b8009560 con 0x7f83c8102fb0 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.559+0000 7f83c4ff9640 1 -- 172.21.15.17:0/1852865089 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83bc004a60 con 0x7f83c8102fb0 2024-08-19T00:56:39.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.559+0000 7f83cddaf640 1 -- 172.21.15.17:0/1852865089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c80ff380 con 0x7f83c8102fb0 2024-08-19T00:56:39.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.560+0000 7f83cddaf640 1 -- 172.21.15.17:0/1852865089 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c8108810 con 0x7f83c8102fb0 2024-08-19T00:56:39.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.560+0000 7f83c4ff9640 1 -- 172.21.15.17:0/1852865089 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f83bc004d20 con 0x7f83c8102fb0 2024-08-19T00:56:39.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.561+0000 7f83c4ff9640 1 --2- 172.21.15.17:0/1852865089 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83b006d650 0x7f83b006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:39.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.561+0000 7f83c4ff9640 1 -- 172.21.15.17:0/1852865089 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f83bc014070 con 0x7f83c8102fb0 2024-08-19T00:56:39.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.561+0000 7f83c77fe640 1 --2- 172.21.15.17:0/1852865089 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83b006d650 0x7f83b006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:39.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.562+0000 7f83c77fe640 1 --2- 172.21.15.17:0/1852865089 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83b006d650 0x7f83b006fb10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006010 tx=0x7f83b80314e0 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:39.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.566+0000 7f83c4ff9640 1 -- 172.21.15.17:0/1852865089 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f83bc056af0 con 0x7f83c8102fb0 2024-08-19T00:56:39.677 INFO:tasks.workunit.client.0.smithi017.stdout:0/968: sync 2024-08-19T00:56:39.677 INFO:tasks.workunit.client.0.smithi017.stdout:5/836: sync 2024-08-19T00:56:39.678 INFO:tasks.workunit.client.0.smithi017.stdout:0/969: dread - d5/d10a/f136 zero size 2024-08-19T00:56:39.680 INFO:tasks.workunit.client.0.smithi017.stdout:0/970: dread - d5/d17/d26/d30/d3e/d81/dca/fe7 zero size 2024-08-19T00:56:39.684 INFO:tasks.workunit.client.0.smithi017.stdout:0/971: symlink d5/d17/d26/d30/d5d/db0/de2/d119/l143 0 2024-08-19T00:56:39.686 INFO:tasks.workunit.client.0.smithi017.stdout:0/972: truncate d5/d10a/f136 678869 0 2024-08-19T00:56:39.688 INFO:tasks.workunit.client.0.smithi017.stdout:0/973: dread - d5/d17/d26/d30/fed zero size 2024-08-19T00:56:39.690 INFO:tasks.workunit.client.0.smithi017.stdout:5/837: dwrite db/d19/d1f/dbd/f5b [0,4194304] 0 2024-08-19T00:56:39.692 INFO:tasks.workunit.client.0.smithi017.stdout:5/838: fdatasync db/d19/d1f/d15/d3e/d40/d49/d63/d80/fe9 0 2024-08-19T00:56:39.695 INFO:tasks.workunit.client.0.smithi017.stdout:5/839: read db/d19/d1f/d15/d1e/d5f/ff5 [2166969,65848] 0 2024-08-19T00:56:39.697 INFO:tasks.workunit.client.0.smithi017.stdout:0/974: creat d5/d17/d21/f144 x:0 0 0 2024-08-19T00:56:39.698 INFO:tasks.workunit.client.0.smithi017.stdout:0/975: stat d5/d17/l92 0 2024-08-19T00:56:39.701 INFO:tasks.workunit.client.0.smithi017.stdout:5/840: mkdir db/d19/d1f/d15/d3e/d40/dad/dfa/d128 0 2024-08-19T00:56:39.706 INFO:tasks.workunit.client.0.smithi017.stdout:0/976: creat d5/d17/d26/f145 x:0 0 0 2024-08-19T00:56:39.707 INFO:tasks.workunit.client.0.smithi017.stdout:0/977: readlink d5/d17/d26/d30/d5d/db0/dc7/l10f 0 2024-08-19T00:56:39.708 INFO:tasks.workunit.client.0.smithi017.stdout:0/978: dread - d5/d17/d26/d30/d5d/dce/fd7 zero size 2024-08-19T00:56:39.709 INFO:tasks.workunit.client.0.smithi017.stdout:5/841: write db/d19/d1f/d15/d3e/d40/d83/d10a/fac [137821,118184] 0 2024-08-19T00:56:39.716 INFO:tasks.workunit.client.0.smithi017.stdout:0/979: dwrite d5/d17/d26/d30/d3e/d5a/dcd/dfc/f122 [0,4194304] 0 2024-08-19T00:56:39.718 INFO:tasks.workunit.client.0.smithi017.stdout:5/842: getdents db/d19/d1f/d15/d3e/d40/d83/dca 0 2024-08-19T00:56:39.723 INFO:tasks.workunit.client.0.smithi017.stdout:0/980: dwrite d5/d17/d2b/f43 [0,4194304] 0 2024-08-19T00:56:39.726 INFO:tasks.workunit.client.0.smithi017.stdout:5/843: truncate db/d19/d1f/d15/d1e/d5f/f6b 1509204 0 2024-08-19T00:56:39.726 INFO:tasks.workunit.client.0.smithi017.stdout:0/981: write d5/d17/d26/d30/d5d/f13b [454587,97196] 0 2024-08-19T00:56:39.731 INFO:tasks.workunit.client.0.smithi017.stdout:5/844: mknod db/d19/d1f/dbd/d123/c129 0 2024-08-19T00:56:39.733 INFO:tasks.workunit.client.0.smithi017.stdout:5/845: chown db/d19/d1f/d15/d3e/d40/d49/d63/d80/fdb 2341 1 2024-08-19T00:56:39.754 INFO:tasks.workunit.client.0.smithi017.stdout:5/846: dwrite db/d19/d1f/fa9 [0,4194304] 0 2024-08-19T00:56:39.760 INFO:tasks.workunit.client.0.smithi017.stdout:5/847: dwrite db/d19/d1f/d15/f25 [0,4194304] 0 2024-08-19T00:56:39.767 INFO:tasks.workunit.client.0.smithi017.stdout:5/848: creat db/d19/d1f/f12a x:0 0 0 2024-08-19T00:56:39.772 INFO:tasks.workunit.client.0.smithi017.stdout:5/849: creat db/d19/d1f/d15/d3e/d40/d49/d63/d7b/dba/f12b x:0 0 0 2024-08-19T00:56:39.774 INFO:tasks.workunit.client.0.smithi017.stdout:5/850: write db/f2a [1800842,113884] 0 2024-08-19T00:56:39.792 INFO:tasks.workunit.client.0.smithi017.stdout:5/851: dwrite db/d19/d1f/d15/d3e/d40/f71 [0,4194304] 0 2024-08-19T00:56:39.795 INFO:tasks.workunit.client.0.smithi017.stdout:5/852: mknod db/d19/d1f/d15/d1e/d5f/c12c 0 2024-08-19T00:56:39.806 INFO:tasks.workunit.client.0.smithi017.stdout:5/853: dwrite db/d19/daa/fe1 [0,4194304] 0 2024-08-19T00:56:39.809 INFO:tasks.workunit.client.0.smithi017.stdout:5/854: truncate db/d19/d1f/d15/d3e/d40/d49/ffe 511255 0 2024-08-19T00:56:39.812 INFO:tasks.workunit.client.0.smithi017.stdout:5/855: creat db/d19/d8d/f12d x:0 0 0 2024-08-19T00:56:39.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.843+0000 7f83cddaf640 1 -- 172.21.15.17:0/1852865089 --> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83c81039d0 con 0x7f83b006d650 2024-08-19T00:56:39.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.844+0000 7f83c4ff9640 1 -- 172.21.15.17:0/1852865089 <== mgr.24369 v2:172.21.15.86:6828/261187346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f83c81039d0 con 0x7f83b006d650 2024-08-19T00:56:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.847+0000 7f83cddaf640 1 -- 172.21.15.17:0/1852865089 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83b006d650 msgr2=0x7f83b006fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.847+0000 7f83cddaf640 1 --2- 172.21.15.17:0/1852865089 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83b006d650 0x7f83b006fb10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006010 tx=0x7f83b80314e0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.847+0000 7f83cddaf640 1 -- 172.21.15.17:0/1852865089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83c8102fb0 msgr2=0x7f83c80fe630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.847+0000 7f83cddaf640 1 --2- 172.21.15.17:0/1852865089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83c8102fb0 0x7f83c80fe630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00e920 tx=0x7f83bc00ede0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.847+0000 7f83cddaf640 1 -- 172.21.15.17:0/1852865089 shutdown_connections 2024-08-19T00:56:39.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.847+0000 7f83cddaf640 1 --2- 172.21.15.17:0/1852865089 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83c8102fb0 0x7f83c80fe630 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.847+0000 7f83cddaf640 1 --2- 172.21.15.17:0/1852865089 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f83b006d650 0x7f83b006fb10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.847+0000 7f83cddaf640 1 --2- 172.21.15.17:0/1852865089 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83c8100680 0x7f83c80fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.847+0000 7f83cddaf640 1 -- 172.21.15.17:0/1852865089 >> 172.21.15.17:0/1852865089 conn(0x7f83c80fa280 msgr2=0x7f83c80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:39.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.847+0000 7f83cddaf640 1 -- 172.21.15.17:0/1852865089 shutdown_connections 2024-08-19T00:56:39.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.847+0000 7f83cddaf640 1 -- 172.21.15.17:0/1852865089 wait complete. 2024-08-19T00:56:39.860 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:56:39.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.936+0000 7fc7977b7640 1 -- 172.21.15.17:0/239695286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc790100740 msgr2=0x7fc790102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:39.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.936+0000 7fc7977b7640 1 --2- 172.21.15.17:0/239695286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc790100740 0x7fc790102b30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc78c009880 tx=0x7fc78c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.937+0000 7fc7977b7640 1 -- 172.21.15.17:0/239695286 shutdown_connections 2024-08-19T00:56:39.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.937+0000 7fc7977b7640 1 --2- 172.21.15.17:0/239695286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc790103070 0x7fc790105460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.937+0000 7fc7977b7640 1 --2- 172.21.15.17:0/239695286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc790100740 0x7fc790102b30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.937+0000 7fc7977b7640 1 -- 172.21.15.17:0/239695286 >> 172.21.15.17:0/239695286 conn(0x7fc7900fa280 msgr2=0x7fc7900fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:39.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.937+0000 7fc7977b7640 1 -- 172.21.15.17:0/239695286 shutdown_connections 2024-08-19T00:56:39.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.937+0000 7fc7977b7640 1 -- 172.21.15.17:0/239695286 wait complete. 2024-08-19T00:56:39.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.937+0000 7fc7977b7640 1 Processor -- start 2024-08-19T00:56:39.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.937+0000 7fc7977b7640 1 -- start start 2024-08-19T00:56:39.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc7977b7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc790100740 0x7fc7901956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:39.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc7977b7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc790103070 0x7fc790195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc7977b7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7901961f0 con 0x7fc790100740 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc7977b7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc790196360 con 0x7fc790103070 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc795553640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc790100740 0x7fc7901956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc795553640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc790100740 0x7fc7901956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34716/0 (socket says 172.21.15.17:34716) 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc795553640 1 -- 172.21.15.17:0/61491112 learned_addr learned my addr 172.21.15.17:0/61491112 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc794d52640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc790103070 0x7fc790195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc795553640 1 -- 172.21.15.17:0/61491112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc790103070 msgr2=0x7fc790195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc795553640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc790103070 0x7fc790195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc795553640 1 -- 172.21.15.17:0/61491112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c009560 con 0x7fc790100740 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc794d52640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc790103070 0x7fc790195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.938+0000 7fc795553640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc790100740 0x7fc7901956e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0099a0 tx=0x7fc78c032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.939+0000 7fc7867fc640 1 -- 172.21.15.17:0/61491112 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc78c005220 con 0x7fc790100740 2024-08-19T00:56:39.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.939+0000 7fc7867fc640 1 -- 172.21.15.17:0/61491112 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc78c005380 con 0x7fc790100740 2024-08-19T00:56:39.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.939+0000 7fc7867fc640 1 -- 172.21.15.17:0/61491112 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc78c003b10 con 0x7fc790100740 2024-08-19T00:56:39.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.939+0000 7fc7977b7640 1 -- 172.21.15.17:0/61491112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79019ada0 con 0x7fc790100740 2024-08-19T00:56:39.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.939+0000 7fc7977b7640 1 -- 172.21.15.17:0/61491112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79019b230 con 0x7fc790100740 2024-08-19T00:56:39.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.940+0000 7fc7977b7640 1 -- 172.21.15.17:0/61491112 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc790108830 con 0x7fc790100740 2024-08-19T00:56:39.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.940+0000 7fc7867fc640 1 -- 172.21.15.17:0/61491112 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 91559+0+0 (secure 0 0 0) 0x7fc78c003c90 con 0x7fc790100740 2024-08-19T00:56:39.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.941+0000 7fc7867fc640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc77c06d650 0x7fc77c06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:39.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.941+0000 7fc7867fc640 1 -- 172.21.15.17:0/61491112 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc78c0addf0 con 0x7fc790100740 2024-08-19T00:56:39.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.941+0000 7fc794d52640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc77c06d650 0x7fc77c06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:39.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.941+0000 7fc794d52640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc77c06d650 0x7fc77c06fb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc790196c00 tx=0x7fc78000b390 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:39.945+0000 7fc7867fc640 1 -- 172.21.15.17:0/61491112 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fc78c077660 con 0x7fc790100740 2024-08-19T00:56:40.017 INFO:tasks.workunit.client.0.smithi017.stdout:0/982: sync 2024-08-19T00:56:40.022 INFO:tasks.workunit.client.0.smithi017.stdout:0/983: rename d5/d17/d26/f104 to d5/d17/d26/d30/d3e/d5a/f146 0 2024-08-19T00:56:40.035 INFO:tasks.workunit.client.0.smithi017.stdout:0/984: dwrite d5/d18/f111 [0,4194304] 0 2024-08-19T00:56:40.039 INFO:tasks.workunit.client.0.smithi017.stdout:0/985: rmdir d5/d17/d26/d30/d3e/d5a/dcd/dd3 39 2024-08-19T00:56:40.044 INFO:tasks.workunit.client.0.smithi017.stdout:0/986: dread d5/d18/f56 [0,4194304] 0 2024-08-19T00:56:40.053 INFO:tasks.workunit.client.0.smithi017.stdout:0/987: truncate d5/d17/d26/d30/f58 2464714 0 2024-08-19T00:56:40.068 INFO:tasks.workunit.client.0.smithi017.stdout:0/988: dwrite d5/d18/d78/f88 [4194304,4194304] 0 2024-08-19T00:56:40.072 INFO:tasks.workunit.client.0.smithi017.stdout:0/989: chown d5/d17/d26/d30/d5d/dce/l114 2191775 1 2024-08-19T00:56:40.073 INFO:tasks.workunit.client.0.smithi017.stdout:0/990: mknod d5/d18/d78/dbc/c147 0 2024-08-19T00:56:40.078 INFO:tasks.workunit.client.0.smithi017.stdout:0/991: dread d5/d18/d3a/fe3 [4194304,4194304] 0 2024-08-19T00:56:40.084 INFO:tasks.workunit.client.0.smithi017.stdout:0/992: dread d5/d17/d45/d50/f73 [0,4194304] 0 2024-08-19T00:56:40.088 INFO:tasks.workunit.client.0.smithi017.stdout:0/993: truncate d5/dba/ffd 1346272 0 2024-08-19T00:56:40.093 INFO:tasks.workunit.client.0.smithi017.stdout:0/994: mkdir d5/d17/d26/d30/d5d/dce/d148 0 2024-08-19T00:56:40.094 INFO:tasks.workunit.client.0.smithi017.stdout:0/995: rename d5/d17/d26/d30/d3e to d5/d17/d26/d30/d3e/d81/d149 22 2024-08-19T00:56:40.096 INFO:tasks.workunit.client.0.smithi017.stdout:0/996: chown d5/d17/d21/d42/c1f 2157629 1 2024-08-19T00:56:40.097 INFO:tasks.workunit.client.0.smithi017.stdout:0/997: chown d5/l6c 173970 1 2024-08-19T00:56:40.103 INFO:tasks.workunit.client.0.smithi017.stdout:0/998: dwrite d5/d17/d2b/df4/de8/f11a [0,4194304] 0 2024-08-19T00:56:40.106 INFO:tasks.workunit.client.0.smithi017.stdout:0/999: chown d5/d17/d26/d30/c47 3291 1 2024-08-19T00:56:40.188 INFO:tasks.workunit.client.0.smithi017.stdout:5/856: sync 2024-08-19T00:56:40.193 INFO:tasks.workunit.client.0.smithi017.stdout:5/857: getdents db/d19/d1f 0 2024-08-19T00:56:40.194 INFO:tasks.workunit.client.0.smithi017.stdout:5/858: readlink db/d19/d1f/d15/d3e/d40/d49/de0/l125 0 2024-08-19T00:56:40.200 INFO:tasks.workunit.client.0.smithi017.stdout:5/859: dwrite db/d19/d8d/fd4 [0,4194304] 0 2024-08-19T00:56:40.207 INFO:tasks.workunit.client.0.smithi017.stdout:5/860: rename db/d19/d1f/d15/d3e/d40/d49/d63/d80/f97 to db/d19/d1f/d15/d1e/d5f/dea/df0/f12e 0 2024-08-19T00:56:40.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.206+0000 7fc7977b7640 1 -- 172.21.15.17:0/61491112 --> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc79019b4a0 con 0x7fc77c06d650 2024-08-19T00:56:40.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.207+0000 7fc7867fc640 1 -- 172.21.15.17:0/61491112 <== mgr.24369 v2:172.21.15.86:6828/261187346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fc79019b4a0 con 0x7fc77c06d650 2024-08-19T00:56:40.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.211+0000 7fc7977b7640 1 -- 172.21.15.17:0/61491112 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc77c06d650 msgr2=0x7fc77c06fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:40.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.211+0000 7fc7977b7640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc77c06d650 0x7fc77c06fb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc790196c00 tx=0x7fc78000b390 comp rx=0 tx=0).stop 2024-08-19T00:56:40.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.211+0000 7fc7977b7640 1 -- 172.21.15.17:0/61491112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc790100740 msgr2=0x7fc7901956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:40.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.211+0000 7fc7977b7640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc790100740 0x7fc7901956e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0099a0 tx=0x7fc78c032bb0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.211+0000 7fc7977b7640 1 -- 172.21.15.17:0/61491112 shutdown_connections 2024-08-19T00:56:40.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.211+0000 7fc7977b7640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc790103070 0x7fc790195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.211+0000 7fc7977b7640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc77c06d650 0x7fc77c06fb10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.211+0000 7fc7977b7640 1 --2- 172.21.15.17:0/61491112 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc790100740 0x7fc7901956e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.211+0000 7fc7977b7640 1 -- 172.21.15.17:0/61491112 >> 172.21.15.17:0/61491112 conn(0x7fc7900fa280 msgr2=0x7fc7900fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:40.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.211+0000 7fc7977b7640 1 -- 172.21.15.17:0/61491112 shutdown_connections 2024-08-19T00:56:40.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.211+0000 7fc7977b7640 1 -- 172.21.15.17:0/61491112 wait complete. 2024-08-19T00:56:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.305+0000 7fc6f1834640 1 -- 172.21.15.17:0/641912371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0feaa0 msgr2=0x7fc6ec0feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.305+0000 7fc6f1834640 1 --2- 172.21.15.17:0/641912371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0feaa0 0x7fc6ec0feea0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc009880 tx=0x7fc6dc02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.305+0000 7fc6f1834640 1 -- 172.21.15.17:0/641912371 shutdown_connections 2024-08-19T00:56:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.305+0000 7fc6f1834640 1 --2- 172.21.15.17:0/641912371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec0ffca0 0x7fc6ec100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.305+0000 7fc6f1834640 1 --2- 172.21.15.17:0/641912371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0feaa0 0x7fc6ec0feea0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.305+0000 7fc6f1834640 1 -- 172.21.15.17:0/641912371 >> 172.21.15.17:0/641912371 conn(0x7fc6ec0fa250 msgr2=0x7fc6ec0fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.305+0000 7fc6f1834640 1 -- 172.21.15.17:0/641912371 shutdown_connections 2024-08-19T00:56:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.305+0000 7fc6f1834640 1 -- 172.21.15.17:0/641912371 wait complete. 2024-08-19T00:56:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.306+0000 7fc6f1834640 1 Processor -- start 2024-08-19T00:56:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.306+0000 7fc6f1834640 1 -- start start 2024-08-19T00:56:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6f1834640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec0feaa0 0x7fc6ec068ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6f1834640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0ffca0 0x7fc6ec19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6f1834640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec19a910 con 0x7fc6ec0ffca0 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6f1834640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec19aa80 con 0x7fc6ec0feaa0 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6ea7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0ffca0 0x7fc6ec19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6ea7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0ffca0 0x7fc6ec19a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34728/0 (socket says 172.21.15.17:34728) 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6ea7fc640 1 -- 172.21.15.17:0/188041222 learned_addr learned my addr 172.21.15.17:0/188041222 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6eaffd640 1 --2- 172.21.15.17:0/188041222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec0feaa0 0x7fc6ec068ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6ea7fc640 1 -- 172.21.15.17:0/188041222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec0feaa0 msgr2=0x7fc6ec068ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6ea7fc640 1 --2- 172.21.15.17:0/188041222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec0feaa0 0x7fc6ec068ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6ea7fc640 1 -- 172.21.15.17:0/188041222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc009560 con 0x7fc6ec0ffca0 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6ea7fc640 1 --2- 172.21.15.17:0/188041222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0ffca0 0x7fc6ec19a340 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000d8d0 tx=0x7fc6e000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.307+0000 7fc6f0832640 1 -- 172.21.15.17:0/188041222 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e000bea0 con 0x7fc6ec0ffca0 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.308+0000 7fc6f0832640 1 -- 172.21.15.17:0/188041222 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6e0009c00 con 0x7fc6ec0ffca0 2024-08-19T00:56:40.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.308+0000 7fc6f1834640 1 -- 172.21.15.17:0/188041222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec19ad60 con 0x7fc6ec0ffca0 2024-08-19T00:56:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.308+0000 7fc6f0832640 1 -- 172.21.15.17:0/188041222 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e000f710 con 0x7fc6ec0ffca0 2024-08-19T00:56:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.308+0000 7fc6f1834640 1 -- 172.21.15.17:0/188041222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec19b330 con 0x7fc6ec0ffca0 2024-08-19T00:56:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.309+0000 7fc6f0832640 1 -- 172.21.15.17:0/188041222 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 25) v1 ==== 91559+0+0 (secure 0 0 0) 0x7fc6e0010460 con 0x7fc6ec0ffca0 2024-08-19T00:56:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.309+0000 7fc6f1834640 1 -- 172.21.15.17:0/188041222 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec18e620 con 0x7fc6ec0ffca0 2024-08-19T00:56:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.310+0000 7fc6f0832640 1 --2- 172.21.15.17:0/188041222 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc6d406d660 0x7fc6d406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.310+0000 7fc6f0832640 1 -- 172.21.15.17:0/188041222 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc6e008cd80 con 0x7fc6ec0ffca0 2024-08-19T00:56:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.310+0000 7fc6eaffd640 1 --2- 172.21.15.17:0/188041222 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc6d406d660 0x7fc6d406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.311+0000 7fc6eaffd640 1 --2- 172.21.15.17:0/188041222 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc6d406d660 0x7fc6d406fb20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec069530 tx=0x7fc6dc0314e0 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:40.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.315+0000 7fc6f0832640 1 -- 172.21.15.17:0/188041222 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fc6e00565f0 con 0x7fc6ec0ffca0 2024-08-19T00:56:40.430 INFO:tasks.workunit.client.0.smithi017.stdout:5/861: sync 2024-08-19T00:56:40.431 INFO:tasks.workunit.client.0.smithi017.stdout:5/862: symlink db/d19/d1f/d15/d3e/d40/dad/l12f 0 2024-08-19T00:56:40.434 INFO:tasks.workunit.client.0.smithi017.stdout:5/863: mkdir db/d19/d1f/dbd/d123/d130 0 2024-08-19T00:56:40.440 INFO:tasks.workunit.client.0.smithi017.stdout:5/864: getdents db/d19/d1f/d15/d3e/d40/d49/dce/d105 0 2024-08-19T00:56:40.444 INFO:tasks.workunit.client.0.smithi017.stdout:5/865: symlink db/d19/d1f/d15/d3e/l131 0 2024-08-19T00:56:40.448 INFO:tasks.workunit.client.0.smithi017.stdout:5/866: mkdir db/d19/d1f/d15/d3e/d40/d49/d63/d80/ddc/d132 0 2024-08-19T00:56:40.493 INFO:tasks.workunit.client.0.smithi017.stdout:5/867: dwrite db/d19/d1f/d15/d3e/d40/f103 [0,4194304] 0 2024-08-19T00:56:40.494 INFO:tasks.workunit.client.0.smithi017.stdout:5/868: chown db/d19/d1f/d15/d3e/d40/f6e 150348360 1 2024-08-19T00:56:40.503 INFO:tasks.workunit.client.0.smithi017.stdout:5/869: rename db/d19/d1f/d15/d3e/d40/d49/dce/l114 to db/d19/d1f/d15/d3e/d40/d83/dca/l133 0 2024-08-19T00:56:40.508 INFO:tasks.workunit.client.0.smithi017.stdout:5/870: rename db/d19/d8d/f12d to db/d19/d1f/d15/d117/f134 0 2024-08-19T00:56:40.515 INFO:tasks.workunit.client.0.smithi017.stdout:5/871: dwrite db/d19/daa/fe1 [4194304,4194304] 0 2024-08-19T00:56:40.521 INFO:tasks.workunit.client.0.smithi017.stdout:5/872: mkdir db/d19/d1f/d15/d3e/d40/d49/d63/d80/dc8/d135 0 2024-08-19T00:56:40.540 INFO:tasks.workunit.client.0.smithi017.stdout:5/873: dwrite db/d19/d1f/d15/d1e/d5f/f73 [0,4194304] 0 2024-08-19T00:56:40.541 INFO:tasks.workunit.client.0.smithi017.stdout:5/874: dread - db/d19/d1f/d15/d1e/d5f/ffd zero size 2024-08-19T00:56:40.545 INFO:tasks.workunit.client.0.smithi017.stdout:5/875: rename db/d19/d1f/d15/d3e/l4f to db/d19/d8d/l136 0 2024-08-19T00:56:40.546 INFO:tasks.workunit.client.0.smithi017.stdout:5/876: write db/d19/d1f/d15/d3e/d40/f71 [3209420,30695] 0 2024-08-19T00:56:40.551 INFO:tasks.workunit.client.0.smithi017.stdout:5/877: creat db/d19/d1f/d15/d3e/d40/dad/df7/f137 x:0 0 0 2024-08-19T00:56:40.551 INFO:tasks.workunit.client.0.smithi017.stdout:5/878: chown db/d19/d8d/fc4 484613224 1 2024-08-19T00:56:40.566 INFO:tasks.workunit.client.0.smithi017.stdout:5/879: write db/d19/d1f/d15/d3e/d40/d83/d10a/fd1 [899358,51656] 0 2024-08-19T00:56:40.607 INFO:tasks.workunit.client.0.smithi017.stdout:5/880: creat db/f138 x:0 0 0 2024-08-19T00:56:40.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.618+0000 7fc6f1834640 1 -- 172.21.15.17:0/188041222 --> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6ec02c4f0 con 0x7fc6d406d660 2024-08-19T00:56:40.627 INFO:tasks.workunit.client.0.smithi017.stdout:5/881: write db/d19/d1f/d15/d3e/d40/d49/d63/f90 [428472,128873] 0 2024-08-19T00:56:40.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.628+0000 7fc6f0832640 1 -- 172.21.15.17:0/188041222 <== mgr.24369 v2:172.21.15.86:6828/261187346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc6ec02c4f0 con 0x7fc6d406d660 2024-08-19T00:56:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:56:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (7m) 42s ago 8m 24.2M - 0.25.0 c8568f914cd2 eb29e4d36dfe 2024-08-19T00:56:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (8m) 42s ago 8m 8006k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T00:56:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (7m) 50s ago 7m 7759k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T00:56:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (8m) 42s ago 8m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T00:56:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (7m) 50s ago 7m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T00:56:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (7m) 42s ago 8m 83.5M - 9.4.7 954c08fa6188 293dd58dd677 2024-08-19T00:56:40.630 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (3m) 42s ago 3m 195M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T00:56:40.631 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (3m) 42s ago 3m 191M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T00:56:40.631 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (3m) 50s ago 3m 21.7M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T00:56:40.631 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (3m) 50s ago 3m 20.6M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T00:56:40.631 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:9283,8765,8443 running (10m) 42s ago 10m 240M - 18.2.4-721-gbaa926de e6c292a6bc95 41b04ec2a4ce 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (69s) 50s ago 7m 482M - 19.1.0-1382-gde09dd01 ea7a5189f30b 750e1ecdf317 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (10m) 42s ago 10m 51.1M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 771bc6b905a5 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (7m) 50s ago 7m 44.0M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 c6fce0ad535d 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (8m) 42s ago 8m 16.0M - 1.5.0 0da6a335fe13 33c11a243263 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (7m) 50s ago 7m 16.6M - 1.5.0 0da6a335fe13 15ad23a27a0c 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (6m) 42s ago 6m 96.0M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (6m) 42s ago 6m 99.5M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (5m) 42s ago 5m 81.8M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (5m) 50s ago 5m 103M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (5m) 50s ago 5m 101M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (4m) 50s ago 4m 83.2M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T00:56:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 starting - - - - 2024-08-19T00:56:40.635 INFO:tasks.workunit.client.0.smithi017.stdout:5/882: fdatasync db/d19/d1f/d15/d1e/d5f/dea/df0/f115 0 2024-08-19T00:56:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.630+0000 7fc6f1834640 1 -- 172.21.15.17:0/188041222 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc6d406d660 msgr2=0x7fc6d406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:40.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.630+0000 7fc6f1834640 1 --2- 172.21.15.17:0/188041222 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc6d406d660 0x7fc6d406fb20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec069530 tx=0x7fc6dc0314e0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.630+0000 7fc6f1834640 1 -- 172.21.15.17:0/188041222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0ffca0 msgr2=0x7fc6ec19a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:40.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.630+0000 7fc6f1834640 1 --2- 172.21.15.17:0/188041222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0ffca0 0x7fc6ec19a340 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000d8d0 tx=0x7fc6e000dd90 comp rx=0 tx=0).stop 2024-08-19T00:56:40.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.631+0000 7fc6f1834640 1 -- 172.21.15.17:0/188041222 shutdown_connections 2024-08-19T00:56:40.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.631+0000 7fc6f1834640 1 --2- 172.21.15.17:0/188041222 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7fc6d406d660 0x7fc6d406fb20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.631+0000 7fc6f1834640 1 --2- 172.21.15.17:0/188041222 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6ec0ffca0 0x7fc6ec19a340 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.631+0000 7fc6f1834640 1 --2- 172.21.15.17:0/188041222 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6ec0feaa0 0x7fc6ec068ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.631+0000 7fc6f1834640 1 -- 172.21.15.17:0/188041222 >> 172.21.15.17:0/188041222 conn(0x7fc6ec0fa250 msgr2=0x7fc6ec103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:40.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.631+0000 7fc6f1834640 1 -- 172.21.15.17:0/188041222 shutdown_connections 2024-08-19T00:56:40.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.631+0000 7fc6f1834640 1 -- 172.21.15.17:0/188041222 wait complete. 2024-08-19T00:56:40.636 INFO:tasks.workunit.client.0.smithi017.stdout:5/883: unlink db/d19/d1f/d15/d1e/d5f/dea/df0/f115 0 2024-08-19T00:56:40.637 INFO:tasks.workunit.client.0.smithi017.stdout:5/884: chown db/d19/d1f/d15/d3e/d40/d83/d10a/fac 3386026 1 2024-08-19T00:56:40.646 INFO:tasks.workunit.client.0.smithi017.stdout:5/885: write db/d19/d1f/dbd/f53 [2221253,38218] 0 2024-08-19T00:56:40.648 INFO:tasks.workunit.client.0.smithi017.stdout:5/886: chown db/d19/d1f/d15/d3e/d40/d49/d63/d80/fe9 384940365 1 2024-08-19T00:56:40.649 INFO:tasks.workunit.client.0.smithi017.stdout:5/887: chown db/d19/d1f/d15/fc6 143 1 2024-08-19T00:56:40.651 INFO:tasks.workunit.client.0.smithi017.stdout:5/888: creat db/d19/d1f/d15/d3e/d40/d49/d63/d7b/f139 x:0 0 0 2024-08-19T00:56:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.735+0000 7f4d8aace640 1 -- 172.21.15.17:0/2450127154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d84100680 msgr2=0x7f4d84102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.735+0000 7f4d8aace640 1 --2- 172.21.15.17:0/2450127154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d84100680 0x7f4d84102a70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d780098b0 tx=0x7f4d7802a4d0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.736+0000 7f4d8aace640 1 -- 172.21.15.17:0/2450127154 shutdown_connections 2024-08-19T00:56:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.736+0000 7f4d8aace640 1 --2- 172.21.15.17:0/2450127154 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d84102fb0 0x7f4d841053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.736+0000 7f4d8aace640 1 --2- 172.21.15.17:0/2450127154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d84100680 0x7f4d84102a70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.736+0000 7f4d8aace640 1 -- 172.21.15.17:0/2450127154 >> 172.21.15.17:0/2450127154 conn(0x7f4d840fa280 msgr2=0x7f4d840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.736+0000 7f4d8aace640 1 -- 172.21.15.17:0/2450127154 shutdown_connections 2024-08-19T00:56:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.736+0000 7f4d8aace640 1 -- 172.21.15.17:0/2450127154 wait complete. 2024-08-19T00:56:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.736+0000 7f4d8aace640 1 Processor -- start 2024-08-19T00:56:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.736+0000 7f4d8aace640 1 -- start start 2024-08-19T00:56:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d8aace640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d84100680 0x7f4d840fff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d8aace640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d84102fb0 0x7f4d840fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d8aace640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d84100540 con 0x7f4d84102fb0 2024-08-19T00:56:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d8aace640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d840feba0 con 0x7f4d84100680 2024-08-19T00:56:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d83fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d84102fb0 0x7f4d840fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d8886a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d84100680 0x7f4d840fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d83fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d84102fb0 0x7f4d840fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34754/0 (socket says 172.21.15.17:34754) 2024-08-19T00:56:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d8886a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d84100680 0x7f4d840fff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.17:46796/0 (socket says 172.21.15.17:46796) 2024-08-19T00:56:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d83fff640 1 -- 172.21.15.17:0/130817343 learned_addr learned my addr 172.21.15.17:0/130817343 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:56:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d8886a640 1 -- 172.21.15.17:0/130817343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d84102fb0 msgr2=0x7f4d840fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d8886a640 1 --2- 172.21.15.17:0/130817343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d84102fb0 0x7f4d840fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d8886a640 1 -- 172.21.15.17:0/130817343 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78009560 con 0x7f4d84100680 2024-08-19T00:56:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d83fff640 1 --2- 172.21.15.17:0/130817343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d84102fb0 0x7f4d840fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:56:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.737+0000 7f4d8886a640 1 --2- 172.21.15.17:0/130817343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d84100680 0x7f4d840fff70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d7802a9f0 tx=0x7f4d780055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.738+0000 7f4d81ffb640 1 -- 172.21.15.17:0/130817343 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d78004aa0 con 0x7f4d84100680 2024-08-19T00:56:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.738+0000 7f4d8aace640 1 -- 172.21.15.17:0/130817343 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d840fee20 con 0x7f4d84100680 2024-08-19T00:56:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.738+0000 7f4d81ffb640 1 -- 172.21.15.17:0/130817343 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d78005d50 con 0x7f4d84100680 2024-08-19T00:56:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.738+0000 7f4d81ffb640 1 -- 172.21.15.17:0/130817343 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d780039b0 con 0x7f4d84100680 2024-08-19T00:56:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.738+0000 7f4d8aace640 1 -- 172.21.15.17:0/130817343 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d840ff310 con 0x7f4d84100680 2024-08-19T00:56:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.739+0000 7f4d8aace640 1 -- 172.21.15.17:0/130817343 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d84108810 con 0x7f4d84100680 2024-08-19T00:56:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.739+0000 7f4d81ffb640 1 -- 172.21.15.17:0/130817343 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f4d78003c70 con 0x7f4d84100680 2024-08-19T00:56:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.740+0000 7f4d81ffb640 1 --2- 172.21.15.17:0/130817343 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f4d7406d650 0x7f4d7406fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.740+0000 7f4d81ffb640 1 -- 172.21.15.17:0/130817343 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f4d780ae180 con 0x7f4d84100680 2024-08-19T00:56:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.740+0000 7f4d83fff640 1 --2- 172.21.15.17:0/130817343 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f4d7406d650 0x7f4d7406fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.741+0000 7f4d83fff640 1 --2- 172.21.15.17:0/130817343 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f4d7406d650 0x7f4d7406fb10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4d840ffcf0 tx=0x7f4d70005f90 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:40.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:40.745+0000 7f4d81ffb640 1 -- 172.21.15.17:0/130817343 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f4d78077910 con 0x7f4d84100680 2024-08-19T00:56:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:40 smithi017 ceph-mon[16627]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:40 smithi017 ceph-mon[16627]: pgmap v31: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 57 MiB/s rd, 110 MiB/s wr, 325 op/s 2024-08-19T00:56:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:40 smithi017 ceph-mon[16627]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:40.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:40 smithi086 ceph-mon[24511]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:40 smithi086 ceph-mon[24511]: pgmap v31: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 57 MiB/s rd, 110 MiB/s wr, 325 op/s 2024-08-19T00:56:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:40 smithi086 ceph-mon[24511]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:40.981 INFO:tasks.workunit.client.0.smithi017.stdout:5/889: sync 2024-08-19T00:56:40.989 INFO:tasks.workunit.client.0.smithi017.stdout:5/890: link db/d19/d1f/d15/d3e/d40/d83/d10a/l4e db/d19/d1f/d15/d3e/d40/d49/d63/d80/dc8/d135/l13a 0 2024-08-19T00:56:40.990 INFO:tasks.workunit.client.0.smithi017.stdout:5/891: chown db/d19/d1f/d15/d3e/d40/d49/d63/f8c 46893904 1 2024-08-19T00:56:40.995 INFO:tasks.workunit.client.0.smithi017.stdout:5/892: mkdir db/d19/d1f/d15/d13b 0 2024-08-19T00:56:40.998 INFO:tasks.workunit.client.0.smithi017.stdout:5/893: symlink db/d19/d1f/d15/d3e/d40/dad/dfa/l13c 0 2024-08-19T00:56:41.003 INFO:tasks.workunit.client.0.smithi017.stdout:5/894: creat db/d19/d1f/d15/d3e/d40/f13d x:0 0 0 2024-08-19T00:56:41.005 INFO:tasks.workunit.client.0.smithi017.stdout:5/895: mknod db/d19/d1f/dbd/d123/c13e 0 2024-08-19T00:56:41.008 INFO:tasks.workunit.client.0.smithi017.stdout:5/896: mknod db/d19/d1f/d15/d3e/d40/dad/c13f 0 2024-08-19T00:56:41.013 INFO:tasks.workunit.client.0.smithi017.stdout:5/897: dwrite db/d19/d1f/dbd/fb0 [0,4194304] 0 2024-08-19T00:56:41.021 INFO:tasks.workunit.client.0.smithi017.stdout:5/898: rename db/d19/d1f/d15/d13b to db/d19/d1f/d15/d140 0 2024-08-19T00:56:41.041 INFO:tasks.workunit.client.0.smithi017.stdout:5/899: dwrite db/d19/d1f/d15/d3e/d40/d49/d63/d7b/f9e [0,4194304] 0 2024-08-19T00:56:41.046 INFO:tasks.workunit.client.0.smithi017.stdout:5/900: fdatasync db/d19/d1f/d15/d3e/d40/f71 0 2024-08-19T00:56:41.056 INFO:tasks.workunit.client.0.smithi017.stdout:5/901: dwrite db/d19/d57/f61 [0,4194304] 0 2024-08-19T00:56:41.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.060+0000 7f4d8aace640 1 -- 172.21.15.17:0/130817343 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4d8419d8d0 con 0x7f4d84100680 2024-08-19T00:56:41.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.061+0000 7f4d81ffb640 1 -- 172.21.15.17:0/130817343 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+834 (secure 0 0 0) 0x7f4d7809b360 con 0x7f4d84100680 2024-08-19T00:56:41.063 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:56:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T00:56:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2 2024-08-19T00:56:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:56:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T00:56:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T00:56:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-19T00:56:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:56:41.063 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T00:56:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6 2024-08-19T00:56:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:56:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T00:56:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T00:56:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:56:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T00:56:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 13, 2024-08-19T00:56:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-19T00:56:41.064 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T00:56:41.064 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:56:41.065 INFO:tasks.workunit.client.0.smithi017.stdout:5/902: dwrite db/d19/d1f/d15/d1e/d5f/ffd [0,4194304] 0 2024-08-19T00:56:41.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.065+0000 7f4d8aace640 1 -- 172.21.15.17:0/130817343 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f4d7406d650 msgr2=0x7f4d7406fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:41.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.065+0000 7f4d8aace640 1 --2- 172.21.15.17:0/130817343 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f4d7406d650 0x7f4d7406fb10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4d840ffcf0 tx=0x7f4d70005f90 comp rx=0 tx=0).stop 2024-08-19T00:56:41.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.065+0000 7f4d8aace640 1 -- 172.21.15.17:0/130817343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d84100680 msgr2=0x7f4d840fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:41.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.065+0000 7f4d8aace640 1 --2- 172.21.15.17:0/130817343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d84100680 0x7f4d840fff70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4d7802a9f0 tx=0x7f4d780055a0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.065+0000 7f4d8aace640 1 -- 172.21.15.17:0/130817343 shutdown_connections 2024-08-19T00:56:41.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.065+0000 7f4d8aace640 1 --2- 172.21.15.17:0/130817343 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f4d7406d650 0x7f4d7406fb10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.065+0000 7f4d8aace640 1 --2- 172.21.15.17:0/130817343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4d84102fb0 0x7f4d840fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.065+0000 7f4d8aace640 1 --2- 172.21.15.17:0/130817343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4d84100680 0x7f4d840fff70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.065+0000 7f4d8aace640 1 -- 172.21.15.17:0/130817343 >> 172.21.15.17:0/130817343 conn(0x7f4d840fa280 msgr2=0x7f4d840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:41.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.065+0000 7f4d8aace640 1 -- 172.21.15.17:0/130817343 shutdown_connections 2024-08-19T00:56:41.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.065+0000 7f4d8aace640 1 -- 172.21.15.17:0/130817343 wait complete. 2024-08-19T00:56:41.070 INFO:tasks.workunit.client.0.smithi017.stdout:5/903: creat db/d19/d1f/d15/d3e/d40/d49/d63/d80/f141 x:0 0 0 2024-08-19T00:56:41.075 INFO:tasks.workunit.client.0.smithi017.stdout:5/904: mkdir db/d19/d1f/d15/d3e/d40/d49/d142 0 2024-08-19T00:56:41.076 INFO:tasks.workunit.client.0.smithi017.stdout:5/905: dread - db/d19/d1f/f6d zero size 2024-08-19T00:56:41.077 INFO:tasks.workunit.client.0.smithi017.stdout:5/906: chown db/d19/d1f/d15/d3e/d40/d83/d10a/f5c 66301990 1 2024-08-19T00:56:41.079 INFO:tasks.workunit.client.0.smithi017.stdout:5/907: symlink db/d19/d1f/d15/d109/l143 0 2024-08-19T00:56:41.084 INFO:tasks.workunit.client.0.smithi017.stdout:5/908: creat db/d19/d1f/d15/d3e/d40/f144 x:0 0 0 2024-08-19T00:56:41.090 INFO:tasks.workunit.client.0.smithi017.stdout:5/909: creat db/d19/d1f/d15/d1e/d5f/dea/df0/d113/f145 x:0 0 0 2024-08-19T00:56:41.093 INFO:tasks.workunit.client.0.smithi017.stdout:5/910: mkdir db/d19/d1f/d15/d3e/d40/d49/dce/d146 0 2024-08-19T00:56:41.095 INFO:tasks.workunit.client.0.smithi017.stdout:5/911: creat db/d19/d1f/d15/d3e/d40/d49/f147 x:0 0 0 2024-08-19T00:56:41.099 INFO:tasks.workunit.client.0.smithi017.stdout:5/912: creat db/d19/d1f/d15/d3e/d40/d49/dce/d105/f148 x:0 0 0 2024-08-19T00:56:41.104 INFO:tasks.workunit.client.0.smithi017.stdout:5/913: rename db/d19/d1f/d15/d3e/d40/d49/d63/d80/fdb to db/d19/d1f/d15/d1e/d5f/f149 0 2024-08-19T00:56:41.105 INFO:tasks.workunit.client.0.smithi017.stdout:5/914: chown db/d19/d1f/d15/d3e/l119 940999 1 2024-08-19T00:56:41.108 INFO:tasks.workunit.client.0.smithi017.stdout:5/915: read db/d19/d1f/d15/fb1 [2049857,22128] 0 2024-08-19T00:56:41.110 INFO:tasks.workunit.client.0.smithi017.stdout:5/916: chown db/d19/d1f/d15/d3e/d40/d49/f86 3979 1 2024-08-19T00:56:41.110 INFO:tasks.workunit.client.0.smithi017.stdout:5/917: stat db/d19/d8d 0 2024-08-19T00:56:41.129 INFO:tasks.workunit.client.0.smithi017.stdout:5/918: truncate db/d19/d1f/d15/d3e/f70 533976 0 2024-08-19T00:56:41.136 INFO:tasks.workunit.client.0.smithi017.stdout:5/919: dwrite db/d19/d1f/d15/d3e/d40/f103 [0,4194304] 0 2024-08-19T00:56:41.137 INFO:tasks.workunit.client.0.smithi017.stdout:5/920: read - db/d19/d1f/d15/d3e/d40/d49/f147 zero size 2024-08-19T00:56:41.152 INFO:tasks.workunit.client.0.smithi017.stdout:5/921: link db/d19/d1f/d15/d3e/d40/d49/c78 db/d19/d1f/d15/d1e/d5f/dea/df0/d113/c14a 0 2024-08-19T00:56:41.155 INFO:tasks.workunit.client.0.smithi017.stdout:5/922: chown db/d19/d1f/d15/d3e/d40/d49/d63/d7b/fc2 822 1 2024-08-19T00:56:41.170 INFO:tasks.workunit.client.0.smithi017.stdout:5/923: dread db/d19/d1f/d15/d3e/d40/d49/f86 [0,4194304] 0 2024-08-19T00:56:41.171 INFO:tasks.workunit.client.0.smithi017.stdout:5/924: chown db/d19/d1f/d15/d3e/d40/dad/dfa/d128 1029567 1 2024-08-19T00:56:41.178 INFO:tasks.workunit.client.0.smithi017.stdout:5/925: dwrite db/d19/d1f/d15/d1e/d5f/dea/df0/d113/f145 [0,4194304] 0 2024-08-19T00:56:41.181 INFO:tasks.workunit.client.0.smithi017.stdout:5/926: chown db/d19/d1f/d15/l3a 15 1 2024-08-19T00:56:41.185 INFO:tasks.workunit.client.0.smithi017.stdout:5/927: symlink db/d19/d1f/dbd/d123/d130/l14b 0 2024-08-19T00:56:41.187 INFO:tasks.workunit.client.0.smithi017.stdout:5/928: truncate db/d19/d1f/d15/d117/f134 970012 0 2024-08-19T00:56:41.188 INFO:tasks.workunit.client.0.smithi017.stdout:5/929: fsync db/d19/d1f/f12a 0 2024-08-19T00:56:41.190 INFO:tasks.workunit.client.0.smithi017.stdout:5/930: chown db/d19/l3c 76647741 1 2024-08-19T00:56:41.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.189+0000 7f0144f55640 1 -- 172.21.15.17:0/4087951997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0140100d90 msgr2=0x7f0140101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.189+0000 7f0144f55640 1 --2- 172.21.15.17:0/4087951997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0140100d90 0x7f0140101210 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0134009880 tx=0x7f013402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.190+0000 7f0144f55640 1 -- 172.21.15.17:0/4087951997 shutdown_connections 2024-08-19T00:56:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.190+0000 7f0144f55640 1 --2- 172.21.15.17:0/4087951997 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0140100d90 0x7f0140101210 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.190+0000 7f0144f55640 1 --2- 172.21.15.17:0/4087951997 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01400ffb90 0x7f01400fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.190+0000 7f0144f55640 1 -- 172.21.15.17:0/4087951997 >> 172.21.15.17:0/4087951997 conn(0x7f01400fb320 msgr2=0x7f01400fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.190+0000 7f0144f55640 1 -- 172.21.15.17:0/4087951997 shutdown_connections 2024-08-19T00:56:41.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.190+0000 7f0144f55640 1 -- 172.21.15.17:0/4087951997 wait complete. 2024-08-19T00:56:41.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.191+0000 7f0144f55640 1 Processor -- start 2024-08-19T00:56:41.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.191+0000 7f0144f55640 1 -- start start 2024-08-19T00:56:41.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.191+0000 7f0144f55640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01400ffb90 0x7f0140197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:41.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.191+0000 7f0144f55640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0140100d90 0x7f0140197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:41.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.191+0000 7f0144f55640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140198320 con 0x7f0140100d90 2024-08-19T00:56:41.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.191+0000 7f0144f55640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140198490 con 0x7f01400ffb90 2024-08-19T00:56:41.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.191+0000 7f013dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0140100d90 0x7f0140197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:41.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.191+0000 7f013dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0140100d90 0x7f0140197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34784/0 (socket says 172.21.15.17:34784) 2024-08-19T00:56:41.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.191+0000 7f013dd9b640 1 -- 172.21.15.17:0/3840974690 learned_addr learned my addr 172.21.15.17:0/3840974690 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:56:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.191+0000 7f013e59c640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01400ffb90 0x7f0140197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.192+0000 7f013e59c640 1 -- 172.21.15.17:0/3840974690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0140100d90 msgr2=0x7f0140197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:41.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.192+0000 7f013e59c640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0140100d90 0x7f0140197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.192+0000 7f013e59c640 1 -- 172.21.15.17:0/3840974690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0134009560 con 0x7f01400ffb90 2024-08-19T00:56:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.192+0000 7f013dd9b640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0140100d90 0x7f0140197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:56:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.192+0000 7f013e59c640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01400ffb90 0x7f0140197810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f013000e940 tx=0x7f013000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.192+0000 7f012f7fe640 1 -- 172.21.15.17:0/3840974690 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f013000cc90 con 0x7f01400ffb90 2024-08-19T00:56:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.192+0000 7f012f7fe640 1 -- 172.21.15.17:0/3840974690 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01300044f0 con 0x7f01400ffb90 2024-08-19T00:56:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.192+0000 7f0144f55640 1 -- 172.21.15.17:0/3840974690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014019cf30 con 0x7f01400ffb90 2024-08-19T00:56:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.192+0000 7f012f7fe640 1 -- 172.21.15.17:0/3840974690 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0130010430 con 0x7f01400ffb90 2024-08-19T00:56:41.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.192+0000 7f0144f55640 1 -- 172.21.15.17:0/3840974690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014019d470 con 0x7f01400ffb90 2024-08-19T00:56:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.193+0000 7f0144f55640 1 -- 172.21.15.17:0/3840974690 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01400fff90 con 0x7f01400ffb90 2024-08-19T00:56:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.194+0000 7f012f7fe640 1 -- 172.21.15.17:0/3840974690 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 25) v1 ==== 91559+0+0 (secure 0 0 0) 0x7f0130004030 con 0x7f01400ffb90 2024-08-19T00:56:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.194+0000 7f012f7fe640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f012806d660 0x7f012806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:56:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.194+0000 7f012f7fe640 1 -- 172.21.15.17:0/3840974690 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f0130014070 con 0x7f01400ffb90 2024-08-19T00:56:41.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.194+0000 7f013dd9b640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f012806d660 0x7f012806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:56:41.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.195+0000 7f013dd9b640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f012806d660 0x7f012806fb20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0140198d30 tx=0x7f01340314e0 comp rx=0 tx=0).ready entity=mgr.24369 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:56:41.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.199+0000 7f012f7fe640 1 -- 172.21.15.17:0/3840974690 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f0130056c50 con 0x7f01400ffb90 2024-08-19T00:56:41.203 INFO:tasks.workunit.client.0.smithi017.stdout:5/931: dwrite db/d19/d1f/d15/d1e/d5f/ff5 [0,4194304] 0 2024-08-19T00:56:41.214 INFO:tasks.workunit.client.0.smithi017.stdout:5/932: dwrite db/d19/d1f/f74 [0,4194304] 0 2024-08-19T00:56:41.395 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-19T00:56:41.396 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-08-19T00:56:41.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.459+0000 7f0144f55640 1 -- 172.21.15.17:0/3840974690 --> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f014002c550 con 0x7f012806d660 2024-08-19T00:56:41.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.460+0000 7f012f7fe640 1 -- 172.21.15.17:0/3840974690 <== mgr.24369 v2:172.21.15.86:6828/261187346 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f014002c550 con 0x7f012806d660 2024-08-19T00:56:41.462 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:56:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T00:56:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T00:56:41.462 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-19T00:56:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [], 2024-08-19T00:56:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "1/2 daemons upgraded", 2024-08-19T00:56:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mgr daemons", 2024-08-19T00:56:41.463 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T00:56:41.463 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:56:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.463+0000 7f0144f55640 1 -- 172.21.15.17:0/3840974690 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f012806d660 msgr2=0x7f012806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.463+0000 7f0144f55640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f012806d660 0x7f012806fb20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0140198d30 tx=0x7f01340314e0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.463+0000 7f0144f55640 1 -- 172.21.15.17:0/3840974690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01400ffb90 msgr2=0x7f0140197810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:56:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.463+0000 7f0144f55640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01400ffb90 0x7f0140197810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f013000e940 tx=0x7f013000ee00 comp rx=0 tx=0).stop 2024-08-19T00:56:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.464+0000 7f0144f55640 1 -- 172.21.15.17:0/3840974690 shutdown_connections 2024-08-19T00:56:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.464+0000 7f0144f55640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.86:6828/261187346,v1:172.21.15.86:6829/261187346] conn(0x7f012806d660 0x7f012806fb20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.464+0000 7f0144f55640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0140100d90 0x7f0140197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.464+0000 7f0144f55640 1 --2- 172.21.15.17:0/3840974690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f01400ffb90 0x7f0140197810 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:56:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.464+0000 7f0144f55640 1 -- 172.21.15.17:0/3840974690 >> 172.21.15.17:0/3840974690 conn(0x7f01400fb320 msgr2=0x7f0140104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:56:41.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.464+0000 7f0144f55640 1 -- 172.21.15.17:0/3840974690 shutdown_connections 2024-08-19T00:56:41.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:56:41.464+0000 7f0144f55640 1 -- 172.21.15.17:0/3840974690 wait complete. 2024-08-19T00:56:41.623 INFO:tasks.workunit.client.0.smithi017.stdout:5/933: sync 2024-08-19T00:56:41.636 INFO:tasks.workunit.client.0.smithi017.stdout:5/934: chown db/d19/d1f/d15/d3e/d40/l82 2 1 2024-08-19T00:56:41.637 INFO:tasks.workunit.client.0.smithi017.stdout:5/935: write db/d19/d1f/d15/d3e/d40/d83/d10a/fac [1049435,19627] 0 2024-08-19T00:56:41.657 INFO:tasks.workunit.client.0.smithi017.stdout:5/936: dwrite db/d19/d1f/d15/d1e/f27 [0,4194304] 0 2024-08-19T00:56:41.660 INFO:tasks.workunit.client.0.smithi017.stdout:5/937: chown db/d19/d1f/d15/d1e/d5f/dea/df0/d113/c14a 350943061 1 2024-08-19T00:56:41.667 INFO:tasks.workunit.client.0.smithi017.stdout:5/938: dwrite db/d19/d1f/fa9 [0,4194304] 0 2024-08-19T00:56:41.671 INFO:tasks.workunit.client.0.smithi017.stdout:5/939: unlink db/d19/d1f/d15/d1e/d5f/dea/df0/c11e 0 2024-08-19T00:56:41.673 INFO:tasks.workunit.client.0.smithi017.stdout:5/940: symlink db/l14c 0 2024-08-19T00:56:41.674 INFO:tasks.workunit.client.0.smithi017.stdout:5/941: chown db/d19/d1f/dbd/fe8 119285400 1 2024-08-19T00:56:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:41 smithi017 ceph-mon[16627]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:41 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/130817343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:56:41.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:41 smithi086 ceph-mon[24511]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:41.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:41 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/130817343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:56:42.050 INFO:tasks.workunit.client.0.smithi017.stdout:5/942: sync 2024-08-19T00:56:42.051 INFO:tasks.workunit.client.0.smithi017.stdout:5/943: stat db/d19/d1f/d15/d117/f134 0 2024-08-19T00:56:42.052 INFO:tasks.workunit.client.0.smithi017.stdout:5/944: write db/d19/d57/f61 [4531451,6087] 0 2024-08-19T00:56:42.055 INFO:tasks.workunit.client.0.smithi017.stdout:5/945: creat db/d121/f14d x:0 0 0 2024-08-19T00:56:42.055 INFO:tasks.workunit.client.0.smithi017.stdout:5/946: dread - db/d19/d8d/fa5 zero size 2024-08-19T00:56:42.069 INFO:tasks.workunit.client.0.smithi017.stdout:5/947: dread db/d19/d1f/dbd/f53 [0,4194304] 0 2024-08-19T00:56:42.081 INFO:tasks.workunit.client.0.smithi017.stdout:5/948: dread db/d19/d1f/d15/d1e/f88 [0,4194304] 0 2024-08-19T00:56:42.082 INFO:tasks.workunit.client.0.smithi017.stdout:5/949: stat db/d19/d1f/d15/d3e/d40/d83/d10a/l58 0 2024-08-19T00:56:42.092 INFO:tasks.workunit.client.0.smithi017.stdout:5/950: dwrite db/d19/d1f/d15/d3e/d40/d49/f86 [0,4194304] 0 2024-08-19T00:56:42.104 INFO:tasks.workunit.client.0.smithi017.stdout:5/951: dwrite db/d19/d1f/d15/d1e/f88 [0,4194304] 0 2024-08-19T00:56:42.107 INFO:tasks.workunit.client.0.smithi017.stdout:5/952: creat db/d19/d1f/d15/d3e/d40/d49/d63/d7b/f14e x:0 0 0 2024-08-19T00:56:42.110 INFO:tasks.workunit.client.0.smithi017.stdout:5/953: symlink db/d19/d1f/dbd/d123/l14f 0 2024-08-19T00:56:42.112 INFO:tasks.workunit.client.0.smithi017.stdout:5/954: truncate db/f66 1704926 0 2024-08-19T00:56:42.116 INFO:tasks.workunit.client.0.smithi017.stdout:5/955: rename db/d19/d1f/d15/d3e/d40/d83/d10a/f9f to db/d19/d8d/f150 0 2024-08-19T00:56:42.118 INFO:tasks.workunit.client.0.smithi017.stdout:5/956: write db/d19/d1f/d15/d1e/f37 [2001349,123779] 0 2024-08-19T00:56:42.120 INFO:tasks.workunit.client.0.smithi017.stdout:5/957: write db/d19/d1f/d15/d3e/d40/f103 [2756240,8477] 0 2024-08-19T00:56:42.130 INFO:tasks.workunit.client.0.smithi017.stdout:5/958: write db/d19/d1f/d15/fc6 [1074992,9280] 0 2024-08-19T00:56:42.131 INFO:tasks.workunit.client.0.smithi017.stdout:5/959: write db/d19/daa/fe1 [190618,61824] 0 2024-08-19T00:56:42.133 INFO:tasks.workunit.client.0.smithi017.stdout:5/960: chown db/d19/d1f/d15/d3e/d40/d49/d63/d7b 1321 1 2024-08-19T00:56:42.135 INFO:tasks.workunit.client.0.smithi017.stdout:5/961: mkdir db/d19/d1f/d15/d1e/d5f/dea/df0/d113/d151 0 2024-08-19T00:56:42.145 INFO:tasks.workunit.client.0.smithi017.stdout:5/962: dwrite db/d19/d8d/fb5 [0,4194304] 0 2024-08-19T00:56:42.147 INFO:tasks.workunit.client.0.smithi017.stdout:5/963: write db/d19/d1f/d15/d3e/d40/d83/d10a/fd1 [1698479,39408] 0 2024-08-19T00:56:42.154 INFO:tasks.workunit.client.0.smithi017.stdout:5/964: creat db/d104/d10e/d11d/f152 x:0 0 0 2024-08-19T00:56:42.158 INFO:tasks.workunit.client.0.smithi017.stdout:5/965: mkdir db/d19/d1f/d15/d3e/d40/d49/dce/d105/d153 0 2024-08-19T00:56:42.161 INFO:tasks.workunit.client.0.smithi017.stdout:5/966: symlink db/d19/d1f/d15/d3e/d40/d49/d63/d80/ddc/l154 0 2024-08-19T00:56:42.163 INFO:tasks.workunit.client.0.smithi017.stdout:5/967: unlink db/d19/d1f/lc7 0 2024-08-19T00:56:42.176 INFO:tasks.workunit.client.0.smithi017.stdout:5/968: dread db/d19/d1f/d15/d1e/d5f/ffd [0,4194304] 0 2024-08-19T00:56:42.178 INFO:tasks.workunit.client.0.smithi017.stdout:5/969: read db/d19/d1f/d15/d3e/d40/d49/f86 [3252695,92854] 0 2024-08-19T00:56:42.180 INFO:tasks.workunit.client.0.smithi017.stdout:5/970: readlink db/d19/d1f/le6 0 2024-08-19T00:56:42.181 INFO:tasks.workunit.client.0.smithi017.stdout:5/971: fdatasync db/d19/d1f/d15/d3e/d40/d49/ffe 0 2024-08-19T00:56:42.185 INFO:tasks.workunit.client.0.smithi017.stdout:5/972: mkdir db/d121/d155 0 2024-08-19T00:56:42.188 INFO:tasks.workunit.client.0.smithi017.stdout:5/973: chown db/d19/d1f/dbd/fe8 5246113 1 2024-08-19T00:56:42.193 INFO:tasks.workunit.client.0.smithi017.stdout:5/974: dread db/d19/d1f/f74 [0,4194304] 0 2024-08-19T00:56:42.195 INFO:tasks.workunit.client.0.smithi017.stdout:5/975: mknod db/d19/d1f/d15/d1e/d5f/dea/c156 0 2024-08-19T00:56:42.202 INFO:tasks.workunit.client.0.smithi017.stdout:5/976: getdents db/d19/d1f/d15/d3e/d40/d49/d63 0 2024-08-19T00:56:42.207 INFO:tasks.workunit.client.0.smithi017.stdout:5/977: dread db/d19/d1f/d15/f5d [0,4194304] 0 2024-08-19T00:56:42.210 INFO:tasks.workunit.client.0.smithi017.stdout:5/978: creat db/d19/d8d/f157 x:0 0 0 2024-08-19T00:56:42.213 INFO:tasks.workunit.client.0.smithi017.stdout:5/979: mkdir db/d19/d1f/d15/d3e/d40/d49/d63/d80/ddc/d158 0 2024-08-19T00:56:42.223 INFO:tasks.workunit.client.0.smithi017.stdout:5/980: write db/d19/d1f/d15/d3e/d40/f77 [1962932,68420] 0 2024-08-19T00:56:42.226 INFO:tasks.workunit.client.0.smithi017.stdout:5/981: write db/d19/d1f/f12a [889927,4213] 0 2024-08-19T00:56:42.227 INFO:tasks.workunit.client.0.smithi017.stdout:5/982: chown db/d19/d1f/d15/d3e/d40/d49/l8e 178182539 1 2024-08-19T00:56:42.229 INFO:tasks.workunit.client.0.smithi017.stdout:5/983: chown db/d19/d8d/f150 120117 1 2024-08-19T00:56:42.230 INFO:tasks.workunit.client.0.smithi017.stdout:5/984: fsync db/d19/d1f/d15/d3e/d40/f71 0 2024-08-19T00:56:42.233 INFO:tasks.workunit.client.0.smithi017.stdout:5/985: creat db/d19/d1f/d15/d3e/d40/d49/d63/d80/dc8/d135/f159 x:0 0 0 2024-08-19T00:56:42.234 INFO:tasks.workunit.client.0.smithi017.stdout:5/986: creat db/d19/daa/f15a x:0 0 0 2024-08-19T00:56:42.240 INFO:tasks.workunit.client.0.smithi017.stdout:5/987: dwrite db/d19/d1f/d15/f25 [0,4194304] 0 2024-08-19T00:56:42.245 INFO:tasks.workunit.client.0.smithi017.stdout:5/988: symlink db/d19/d1f/dbd/l15b 0 2024-08-19T00:56:42.247 INFO:tasks.workunit.client.0.smithi017.stdout:5/989: creat db/d121/d155/f15c x:0 0 0 2024-08-19T00:56:42.249 INFO:tasks.workunit.client.0.smithi017.stdout:5/990: fsync db/d19/d1f/d15/d1e/d5f/fe2 0 2024-08-19T00:56:42.295 INFO:tasks.workunit.client.0.smithi017.stdout:5/991: truncate db/d19/d1f/dbd/fb0 2834618 0 2024-08-19T00:56:42.296 INFO:tasks.workunit.client.0.smithi017.stdout:5/992: truncate db/d19/d1f/d15/d1e/d5f/ffd 5025980 0 2024-08-19T00:56:42.297 INFO:tasks.workunit.client.0.smithi017.stdout:5/993: write db/d19/d1f/d15/d3e/d40/f103 [3718434,114767] 0 2024-08-19T00:56:42.302 INFO:tasks.workunit.client.0.smithi017.stdout:5/994: symlink db/d19/d1f/d15/l15d 0 2024-08-19T00:56:42.310 INFO:tasks.workunit.client.0.smithi017.stdout:5/995: dwrite db/d19/d1f/d15/d3e/d40/d49/f69 [0,4194304] 0 2024-08-19T00:56:42.322 INFO:tasks.workunit.client.0.smithi017.stdout:5/996: dwrite db/d19/d1f/d15/d1e/fa4 [0,4194304] 0 2024-08-19T00:56:42.325 INFO:tasks.workunit.client.0.smithi017.stdout:5/997: write db/d19/d1f/d15/d3e/d40/d49/d63/d80/dc8/d135/f159 [990164,28990] 0 2024-08-19T00:56:42.330 INFO:tasks.workunit.client.0.smithi017.stdout:5/998: rename db/d19/d1f/d15/d3e/d40/d49/d63/d80/fe9 to db/d19/d1f/d15/d3e/d40/d49/de0/f15e 0 2024-08-19T00:56:42.337 INFO:tasks.workunit.client.0.smithi017.stdout:5/999: dwrite db/d19/d1f/f74 [4194304,4194304] 0 2024-08-19T00:56:42.344 INFO:tasks.workunit.client.0.smithi017.stderr:+ rm -rf -- ./tmp.fHyOCfnTF1 2024-08-19T00:56:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:42 smithi086 ceph-mon[24511]: from='client.24453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:42 smithi086 ceph-mon[24511]: pgmap v32: 65 pgs: 65 active+clean; 2.7 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 66 MiB/s rd, 135 MiB/s wr, 422 op/s 2024-08-19T00:56:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:42 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:42 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.hfpawi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:56:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:42 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.hfpawi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:56:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:42 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:56:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:42 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:56:42.951 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:42 smithi017 ceph-mon[16627]: from='client.24453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:56:42.951 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:42 smithi017 ceph-mon[16627]: pgmap v32: 65 pgs: 65 active+clean; 2.7 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 66 MiB/s rd, 135 MiB/s wr, 422 op/s 2024-08-19T00:56:42.952 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:42 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:42.952 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:42 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.hfpawi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:56:42.952 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:42 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.hfpawi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:56:42.952 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:42 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:56:42.952 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:42 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:56:43.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:43 smithi086 ceph-mon[24511]: Upgrade: Updating mgr.smithi017.hfpawi 2024-08-19T00:56:43.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:43 smithi086 ceph-mon[24511]: Deploying daemon mgr.smithi017.hfpawi on smithi017 2024-08-19T00:56:43.955 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:43 smithi017 ceph-mon[16627]: Upgrade: Updating mgr.smithi017.hfpawi 2024-08-19T00:56:43.955 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:43 smithi017 ceph-mon[16627]: Deploying daemon mgr.smithi017.hfpawi on smithi017 2024-08-19T00:56:45.107 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:44 smithi017 ceph-mon[16627]: pgmap v33: 65 pgs: 65 active+clean; 2.7 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 39 MiB/s rd, 78 MiB/s wr, 270 op/s 2024-08-19T00:56:45.107 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:44 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:56:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:44 smithi086 ceph-mon[24511]: pgmap v33: 65 pgs: 65 active+clean; 2.7 GiB data, 8.5 GiB used, 528 GiB / 536 GiB avail; 39 MiB/s rd, 78 MiB/s wr, 270 op/s 2024-08-19T00:56:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:44 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:56:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:46 smithi017 ceph-mon[16627]: pgmap v34: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 41 MiB/s rd, 87 MiB/s wr, 353 op/s 2024-08-19T00:56:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:46 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:46 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:46 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:56:47.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:46 smithi086 ceph-mon[24511]: pgmap v34: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 41 MiB/s rd, 87 MiB/s wr, 353 op/s 2024-08-19T00:56:47.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:46 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:47.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:46 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:47.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:46 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:56:49.071 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:48 smithi017 ceph-mon[16627]: pgmap v35: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 15 MiB/s rd, 40 MiB/s wr, 197 op/s 2024-08-19T00:56:49.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:48 smithi086 ceph-mon[24511]: pgmap v35: 65 pgs: 65 active+clean; 2.2 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 15 MiB/s rd, 40 MiB/s wr, 197 op/s 2024-08-19T00:56:51.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:50 smithi017 ceph-mon[16627]: pgmap v36: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 15 MiB/s rd, 40 MiB/s wr, 212 op/s 2024-08-19T00:56:51.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:50 smithi086 ceph-mon[24511]: pgmap v36: 65 pgs: 65 active+clean; 2.0 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail; 15 MiB/s rd, 40 MiB/s wr, 212 op/s 2024-08-19T00:56:53.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:52 smithi017 ceph-mon[16627]: pgmap v37: 65 pgs: 65 active+clean; 1.6 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 11 MiB/s rd, 35 MiB/s wr, 250 op/s 2024-08-19T00:56:53.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:52 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:53.407 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:52 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:53.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:52 smithi086 ceph-mon[24511]: pgmap v37: 65 pgs: 65 active+clean; 1.6 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 11 MiB/s rd, 35 MiB/s wr, 250 op/s 2024-08-19T00:56:53.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:52 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:53.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:52 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:54 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:54 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:54 smithi017 ceph-mon[16627]: Standby manager daemon smithi017.hfpawi restarted 2024-08-19T00:56:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:54 smithi017 ceph-mon[16627]: Standby manager daemon smithi017.hfpawi started 2024-08-19T00:56:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:54 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.hfpawi/crt"}]: dispatch 2024-08-19T00:56:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:54 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:56:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:54 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.hfpawi/key"}]: dispatch 2024-08-19T00:56:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:54 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:56:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:54 smithi017 ceph-mon[16627]: pgmap v38: 65 pgs: 65 active+clean; 1.6 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 2.5 MiB/s rd, 9.4 MiB/s wr, 152 op/s 2024-08-19T00:56:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:54 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:54 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:54 smithi086 ceph-mon[24511]: Standby manager daemon smithi017.hfpawi restarted 2024-08-19T00:56:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:54 smithi086 ceph-mon[24511]: Standby manager daemon smithi017.hfpawi started 2024-08-19T00:56:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:54 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.hfpawi/crt"}]: dispatch 2024-08-19T00:56:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:54 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:56:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:54 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi017.hfpawi/key"}]: dispatch 2024-08-19T00:56:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:54 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:56:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:54 smithi086 ceph-mon[24511]: pgmap v38: 65 pgs: 65 active+clean; 1.6 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 2.5 MiB/s rd, 9.4 MiB/s wr, 152 op/s 2024-08-19T00:56:55.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:55 smithi017 ceph-mon[16627]: mgrmap e26: smithi086.uthxct(active, since 70s), standbys: smithi017.hfpawi 2024-08-19T00:56:55.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:55 smithi086 ceph-mon[24511]: mgrmap e26: smithi086.uthxct(active, since 70s), standbys: smithi017.hfpawi 2024-08-19T00:56:56.628 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:56 smithi017 ceph-mon[16627]: pgmap v39: 65 pgs: 65 active+clean; 1.0 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 213 op/s 2024-08-19T00:56:56.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:56 smithi086 ceph-mon[24511]: pgmap v39: 65 pgs: 65 active+clean; 1.0 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 3.3 MiB/s rd, 10 MiB/s wr, 213 op/s 2024-08-19T00:56:58.164 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:58.164 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:58.164 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:56:58.164 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:56:58.164 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:58.164 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:56:58.164 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mgr fail", "who": "smithi086.uthxct"}]: dispatch 2024-08-19T00:56:58.164 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mgr fail", "who": "smithi086.uthxct"}]: dispatch 2024-08-19T00:56:58.164 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: Activating manager daemon smithi017.hfpawi 2024-08-19T00:56:58.164 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: osdmap e48: 6 total, 6 up, 6 in 2024-08-19T00:56:58.164 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd='[{"prefix": "mgr fail", "who": "smithi086.uthxct"}]': finished 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: mgrmap e27: smithi017.hfpawi(active, starting, since 0.00710337s) 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi017.hfpawi", "id": "smithi017.hfpawi"}]: dispatch 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:56:58.165 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:56:58.166 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:56:58.166 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:56:58.166 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:56:58.166 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:56:58.166 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: Manager daemon smithi017.hfpawi is now available 2024-08-19T00:56:58.166 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:56:58.166 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:56:58.166 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:56:58.166 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/trash_purge_schedule"}]: dispatch 2024-08-19T00:56:58.255 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:58.255 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:58.255 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:56:58.255 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:56:58.255 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' 2024-08-19T00:56:58.255 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:56:58.255 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.24369 172.21.15.86:0/149654709' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mgr fail", "who": "smithi086.uthxct"}]: dispatch 2024-08-19T00:56:58.255 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "mgr fail", "who": "smithi086.uthxct"}]: dispatch 2024-08-19T00:56:58.255 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: Activating manager daemon smithi017.hfpawi 2024-08-19T00:56:58.255 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: osdmap e48: 6 total, 6 up, 6 in 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.24369 ' entity='mgr.smithi086.uthxct' cmd='[{"prefix": "mgr fail", "who": "smithi086.uthxct"}]': finished 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: mgrmap e27: smithi017.hfpawi(active, starting, since 0.00710337s) 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi017.hfpawi", "id": "smithi017.hfpawi"}]: dispatch 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T00:56:58.256 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T00:56:58.257 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T00:56:58.257 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T00:56:58.257 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T00:56:58.257 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T00:56:58.257 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T00:56:58.257 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T00:56:58.257 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: Manager daemon smithi017.hfpawi is now available 2024-08-19T00:56:58.257 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:56:58.257 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/mirror_snapshot_schedule"}]: dispatch 2024-08-19T00:56:58.257 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:56:58.257 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/trash_purge_schedule"}]: dispatch 2024-08-19T00:56:59.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:59 smithi017 ceph-mon[16627]: mgrmap e28: smithi017.hfpawi(active, since 1.00989s) 2024-08-19T00:56:59.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:56:59 smithi017 ceph-mon[16627]: pgmap v3: 65 pgs: 65 active+clean; 781 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-08-19T00:56:59.440 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:59 smithi086 ceph-mon[24511]: mgrmap e28: smithi017.hfpawi(active, since 1.00989s) 2024-08-19T00:56:59.440 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:56:59 smithi086 ceph-mon[24511]: pgmap v3: 65 pgs: 65 active+clean; 781 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-08-19T00:57:00.398 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-19T00:57:00.399 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-19T00:57:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:00 smithi017 ceph-mon[16627]: pgmap v4: 65 pgs: 65 active+clean; 781 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-08-19T00:57:00.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:00 smithi086 ceph-mon[24511]: pgmap v4: 65 pgs: 65 active+clean; 781 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail 2024-08-19T00:57:01.384 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:01 smithi086 ceph-mon[24511]: mgrmap e29: smithi017.hfpawi(active, since 3s) 2024-08-19T00:57:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:01 smithi017 ceph-mon[16627]: mgrmap e29: smithi017.hfpawi(active, since 3s) 2024-08-19T00:57:02.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:02 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:02.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:02 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:02.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:02 smithi017 ceph-mon[16627]: [19/Aug/2024:00:57:01] ENGINE Bus STARTING 2024-08-19T00:57:02.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:02 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:02.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:02 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:02.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:02 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:02.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:02 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:02.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:02 smithi086 ceph-mon[24511]: [19/Aug/2024:00:57:01] ENGINE Bus STARTING 2024-08-19T00:57:02.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:02 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:02.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:02 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:03.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:03 smithi017 ceph-mon[16627]: [19/Aug/2024:00:57:01] ENGINE Serving on http://172.21.15.17:8765 2024-08-19T00:57:03.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:03 smithi017 ceph-mon[16627]: [19/Aug/2024:00:57:01] ENGINE Serving on https://172.21.15.17:7150 2024-08-19T00:57:03.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:03 smithi017 ceph-mon[16627]: [19/Aug/2024:00:57:01] ENGINE Bus STARTED 2024-08-19T00:57:03.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:03 smithi017 ceph-mon[16627]: [19/Aug/2024:00:57:01] ENGINE Error in HTTPServer.serve 2024-08-19T00:57:03.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Traceback (most recent call last): 2024-08-19T00:57:03.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:57:03.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:57:03.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:57:03.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._run(expiration_interval) 2024-08-19T00:57:03.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:57:03.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:57:03.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:57:03.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:57:03.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:57:03.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s = self.context.wrap_socket( 2024-08-19T00:57:03.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:57:03.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: return self.sslsocket_class._create( 2024-08-19T00:57:03.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:57:03.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self.do_handshake() 2024-08-19T00:57:03.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:57:03.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._sslobj.do_handshake() 2024-08-19T00:57:03.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:57:03.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:03 smithi017 ceph-mon[16627]: Standby manager daemon smithi086.uthxct started 2024-08-19T00:57:03.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:03 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/3778883325' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/crt"}]: dispatch 2024-08-19T00:57:03.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:03 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/3778883325' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:57:03.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:03 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/3778883325' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/key"}]: dispatch 2024-08-19T00:57:03.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:03 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/3778883325' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:57:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:03 smithi086 ceph-mon[24511]: [19/Aug/2024:00:57:01] ENGINE Serving on http://172.21.15.17:8765 2024-08-19T00:57:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:03 smithi086 ceph-mon[24511]: [19/Aug/2024:00:57:01] ENGINE Serving on https://172.21.15.17:7150 2024-08-19T00:57:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:03 smithi086 ceph-mon[24511]: [19/Aug/2024:00:57:01] ENGINE Bus STARTED 2024-08-19T00:57:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:03 smithi086 ceph-mon[24511]: [19/Aug/2024:00:57:01] ENGINE Error in HTTPServer.serve 2024-08-19T00:57:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Traceback (most recent call last): 2024-08-19T00:57:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T00:57:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self._connections.run(self.expiration_interval) 2024-08-19T00:57:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T00:57:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self._run(expiration_interval) 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: s = self.context.wrap_socket( 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: return self.sslsocket_class._create( 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self.do_handshake() 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self._sslobj.do_handshake() 2024-08-19T00:57:03.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T00:57:03.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:03 smithi086 ceph-mon[24511]: Standby manager daemon smithi086.uthxct started 2024-08-19T00:57:03.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:03 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/3778883325' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/crt"}]: dispatch 2024-08-19T00:57:03.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:03 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/3778883325' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:57:03.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:03 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/3778883325' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/key"}]: dispatch 2024-08-19T00:57:03.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:03 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/3778883325' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:57:04.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:04 smithi017 ceph-mon[16627]: pgmap v6: 65 pgs: 65 active+clean; 544 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.0 KiB/s wr, 38 op/s 2024-08-19T00:57:04.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:04 smithi017 ceph-mon[16627]: mgrmap e30: smithi017.hfpawi(active, since 6s), standbys: smithi086.uthxct 2024-08-19T00:57:04.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:04 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi086.uthxct", "id": "smithi086.uthxct"}]: dispatch 2024-08-19T00:57:04.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:04 smithi086 ceph-mon[24511]: pgmap v6: 65 pgs: 65 active+clean; 544 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 2.0 KiB/s wr, 38 op/s 2024-08-19T00:57:04.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:04 smithi086 ceph-mon[24511]: mgrmap e30: smithi017.hfpawi(active, since 6s), standbys: smithi086.uthxct 2024-08-19T00:57:04.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:04 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi086.uthxct", "id": "smithi086.uthxct"}]: dispatch 2024-08-19T00:57:06.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:06 smithi017 ceph-mon[16627]: pgmap v7: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 119 op/s 2024-08-19T00:57:06.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:06 smithi086 ceph-mon[24511]: pgmap v7: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 119 op/s 2024-08-19T00:57:08.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:08 smithi017 ceph-mon[16627]: pgmap v8: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 926 KiB/s rd, 1.0 MiB/s wr, 92 op/s 2024-08-19T00:57:08.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:08 smithi086 ceph-mon[24511]: pgmap v8: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 926 KiB/s rd, 1.0 MiB/s wr, 92 op/s 2024-08-19T00:57:10.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:10 smithi017 ceph-mon[16627]: pgmap v9: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-08-19T00:57:10.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:10 smithi086 ceph-mon[24511]: pgmap v9: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-08-19T00:57:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.581+0000 7efc9d6bb640 1 -- 172.21.15.17:0/2013685598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98100700 msgr2=0x7efc98102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.581+0000 7efc9d6bb640 1 --2- 172.21.15.17:0/2013685598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98100700 0x7efc98102af0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efc88009880 tx=0x7efc8802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.581+0000 7efc9d6bb640 1 -- 172.21.15.17:0/2013685598 shutdown_connections 2024-08-19T00:57:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.581+0000 7efc9d6bb640 1 --2- 172.21.15.17:0/2013685598 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc98103030 0x7efc98105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.581+0000 7efc9d6bb640 1 --2- 172.21.15.17:0/2013685598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98100700 0x7efc98102af0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.581+0000 7efc9d6bb640 1 -- 172.21.15.17:0/2013685598 >> 172.21.15.17:0/2013685598 conn(0x7efc980fa280 msgr2=0x7efc980fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.581+0000 7efc9d6bb640 1 -- 172.21.15.17:0/2013685598 shutdown_connections 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.581+0000 7efc9d6bb640 1 -- 172.21.15.17:0/2013685598 wait complete. 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.581+0000 7efc9d6bb640 1 Processor -- start 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.582+0000 7efc9d6bb640 1 -- start start 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.582+0000 7efc9d6bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98100700 0x7efc981956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.582+0000 7efc9d6bb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc98103030 0x7efc98195c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.582+0000 7efc9d6bb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc981961f0 con 0x7efc98100700 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.582+0000 7efc9d6bb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc98196360 con 0x7efc98103030 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.582+0000 7efc96ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98100700 0x7efc981956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.582+0000 7efc96ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98100700 0x7efc981956e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51020/0 (socket says 172.21.15.17:51020) 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.582+0000 7efc96ffd640 1 -- 172.21.15.17:0/4008339495 learned_addr learned my addr 172.21.15.17:0/4008339495 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:57:11.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.582+0000 7efc967fc640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc98103030 0x7efc98195c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.583+0000 7efc96ffd640 1 -- 172.21.15.17:0/4008339495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc98103030 msgr2=0x7efc98195c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:11.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.583+0000 7efc96ffd640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc98103030 0x7efc98195c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.583+0000 7efc96ffd640 1 -- 172.21.15.17:0/4008339495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c009490 con 0x7efc98100700 2024-08-19T00:57:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.583+0000 7efc967fc640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc98103030 0x7efc98195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:57:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.583+0000 7efc96ffd640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98100700 0x7efc981956e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efc880055a0 tx=0x7efc880055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.583+0000 7efc7ffff640 1 -- 172.21.15.17:0/4008339495 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc88004aa0 con 0x7efc98100700 2024-08-19T00:57:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.583+0000 7efc9d6bb640 1 -- 172.21.15.17:0/4008339495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc88009560 con 0x7efc98100700 2024-08-19T00:57:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.583+0000 7efc9d6bb640 1 -- 172.21.15.17:0/4008339495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9819b0b0 con 0x7efc98100700 2024-08-19T00:57:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.583+0000 7efc7ffff640 1 -- 172.21.15.17:0/4008339495 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efc88004c00 con 0x7efc98100700 2024-08-19T00:57:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.583+0000 7efc7ffff640 1 -- 172.21.15.17:0/4008339495 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc88003b10 con 0x7efc98100700 2024-08-19T00:57:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.584+0000 7efc9d6bb640 1 -- 172.21.15.17:0/4008339495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc98100ae0 con 0x7efc98100700 2024-08-19T00:57:11.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.585+0000 7efc7ffff640 1 -- 172.21.15.17:0/4008339495 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7efc88003d10 con 0x7efc98100700 2024-08-19T00:57:11.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.585+0000 7efc7ffff640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efc8006df30 0x7efc800703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:11.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.585+0000 7efc7ffff640 1 -- 172.21.15.17:0/4008339495 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efc880aee20 con 0x7efc98100700 2024-08-19T00:57:11.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.585+0000 7efc967fc640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efc8006df30 0x7efc800703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:11.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.586+0000 7efc967fc640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efc8006df30 0x7efc800703f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efc98196bb0 tx=0x7efc8c005f90 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:11.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.592+0000 7efc7ffff640 1 -- 172.21.15.17:0/4008339495 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7efc88078600 con 0x7efc98100700 2024-08-19T00:57:11.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.871+0000 7efc9d6bb640 1 -- 172.21.15.17:0/4008339495 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efc98103a50 con 0x7efc8006df30 2024-08-19T00:57:11.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.872+0000 7efc7ffff640 1 -- 172.21.15.17:0/4008339495 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7efc98103a50 con 0x7efc8006df30 2024-08-19T00:57:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.874+0000 7efc9d6bb640 1 -- 172.21.15.17:0/4008339495 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efc8006df30 msgr2=0x7efc800703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:11.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.874+0000 7efc9d6bb640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efc8006df30 0x7efc800703f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efc98196bb0 tx=0x7efc8c005f90 comp rx=0 tx=0).stop 2024-08-19T00:57:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.874+0000 7efc9d6bb640 1 -- 172.21.15.17:0/4008339495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98100700 msgr2=0x7efc981956e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.874+0000 7efc9d6bb640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98100700 0x7efc981956e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efc880055a0 tx=0x7efc880055d0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.874+0000 7efc9d6bb640 1 -- 172.21.15.17:0/4008339495 shutdown_connections 2024-08-19T00:57:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.874+0000 7efc9d6bb640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efc8006df30 0x7efc800703f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.874+0000 7efc9d6bb640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efc98103030 0x7efc98195c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.874+0000 7efc9d6bb640 1 --2- 172.21.15.17:0/4008339495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efc98100700 0x7efc981956e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.874+0000 7efc9d6bb640 1 -- 172.21.15.17:0/4008339495 >> 172.21.15.17:0/4008339495 conn(0x7efc980fa280 msgr2=0x7efc980fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.875+0000 7efc9d6bb640 1 -- 172.21.15.17:0/4008339495 shutdown_connections 2024-08-19T00:57:11.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.875+0000 7efc9d6bb640 1 -- 172.21.15.17:0/4008339495 wait complete. 2024-08-19T00:57:11.885 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:57:11.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.972+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/2161383712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840feaf0 msgr2=0x7f4f840feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:11.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.972+0000 7f4f8ab4d640 1 --2- 172.21.15.17:0/2161383712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840feaf0 0x7f4f840feef0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009880 tx=0x7f4f7802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.972+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/2161383712 shutdown_connections 2024-08-19T00:57:11.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.972+0000 7f4f8ab4d640 1 --2- 172.21.15.17:0/2161383712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f840ffcf0 0x7f4f84100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.973+0000 7f4f8ab4d640 1 --2- 172.21.15.17:0/2161383712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840feaf0 0x7f4f840feef0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.973+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/2161383712 >> 172.21.15.17:0/2161383712 conn(0x7f4f840fa280 msgr2=0x7f4f840fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:11.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.973+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/2161383712 shutdown_connections 2024-08-19T00:57:11.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.973+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/2161383712 wait complete. 2024-08-19T00:57:11.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.973+0000 7f4f8ab4d640 1 Processor -- start 2024-08-19T00:57:11.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.973+0000 7f4f8ab4d640 1 -- start start 2024-08-19T00:57:11.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.973+0000 7f4f8ab4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840feaf0 0x7f4f84102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:11.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.973+0000 7f4f8ab4d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f840ffcf0 0x7f4f841010d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:11.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.974+0000 7f4f8ab4d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f84101610 con 0x7f4f840feaf0 2024-08-19T00:57:11.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.974+0000 7f4f8ab4d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f84101780 con 0x7f4f840ffcf0 2024-08-19T00:57:11.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.974+0000 7f4f888e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840feaf0 0x7f4f84102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:11.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.974+0000 7f4f888e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840feaf0 0x7f4f84102a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51048/0 (socket says 172.21.15.17:51048) 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.974+0000 7f4f888e9640 1 -- 172.21.15.17:0/1152777140 learned_addr learned my addr 172.21.15.17:0/1152777140 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.974+0000 7f4f83fff640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f840ffcf0 0x7f4f841010d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.974+0000 7f4f888e9640 1 -- 172.21.15.17:0/1152777140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f840ffcf0 msgr2=0x7f4f841010d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.974+0000 7f4f888e9640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f840ffcf0 0x7f4f841010d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.974+0000 7f4f888e9640 1 -- 172.21.15.17:0/1152777140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78009560 con 0x7f4f840feaf0 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.974+0000 7f4f83fff640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f840ffcf0 0x7f4f841010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.974+0000 7f4f888e9640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840feaf0 0x7f4f84102a80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4f7802a9c0 tx=0x7f4f780055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.975+0000 7f4f81ffb640 1 -- 172.21.15.17:0/1152777140 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f78004aa0 con 0x7f4f840feaf0 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.975+0000 7f4f81ffb640 1 -- 172.21.15.17:0/1152777140 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f78005d50 con 0x7f4f840feaf0 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.975+0000 7f4f81ffb640 1 -- 172.21.15.17:0/1152777140 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f780039e0 con 0x7f4f840feaf0 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.975+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/1152777140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f84101a00 con 0x7f4f840feaf0 2024-08-19T00:57:11.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.975+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/1152777140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f84101ef0 con 0x7f4f840feaf0 2024-08-19T00:57:11.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.976+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/1152777140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f841076e0 con 0x7f4f840feaf0 2024-08-19T00:57:11.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.977+0000 7f4f81ffb640 1 -- 172.21.15.17:0/1152777140 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f4f78031c00 con 0x7f4f840feaf0 2024-08-19T00:57:11.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.978+0000 7f4f81ffb640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4f7406df30 0x7f4f740703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:11.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.978+0000 7f4f81ffb640 1 -- 172.21.15.17:0/1152777140 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4f780aedc0 con 0x7f4f840feaf0 2024-08-19T00:57:11.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.978+0000 7f4f83fff640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4f7406df30 0x7f4f740703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:11.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.980+0000 7f4f83fff640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4f7406df30 0x7f4f740703f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f84102800 tx=0x7f4f70005f90 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:11.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:11.985+0000 7f4f81ffb640 1 -- 172.21.15.17:0/1152777140 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f4f780784e0 con 0x7f4f840feaf0 2024-08-19T00:57:12.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.289+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/1152777140 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f840683f0 con 0x7f4f7406df30 2024-08-19T00:57:12.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.291+0000 7f4f81ffb640 1 -- 172.21.15.17:0/1152777140 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f4f840683f0 con 0x7f4f7406df30 2024-08-19T00:57:12.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.294+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/1152777140 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4f7406df30 msgr2=0x7f4f740703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:12.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.294+0000 7f4f8ab4d640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4f7406df30 0x7f4f740703f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4f84102800 tx=0x7f4f70005f90 comp rx=0 tx=0).stop 2024-08-19T00:57:12.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.294+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/1152777140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840feaf0 msgr2=0x7f4f84102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.294+0000 7f4f8ab4d640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840feaf0 0x7f4f84102a80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4f7802a9c0 tx=0x7f4f780055a0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.295+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/1152777140 shutdown_connections 2024-08-19T00:57:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.295+0000 7f4f8ab4d640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4f7406df30 0x7f4f740703f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.295+0000 7f4f8ab4d640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f840ffcf0 0x7f4f841010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.295+0000 7f4f8ab4d640 1 --2- 172.21.15.17:0/1152777140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f840feaf0 0x7f4f84102a80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.295+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/1152777140 >> 172.21.15.17:0/1152777140 conn(0x7f4f840fa280 msgr2=0x7f4f84067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:12.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.295+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/1152777140 shutdown_connections 2024-08-19T00:57:12.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.295+0000 7f4f8ab4d640 1 -- 172.21.15.17:0/1152777140 wait complete. 2024-08-19T00:57:12.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.418+0000 7fb7514b9640 1 -- 172.21.15.17:0/1511463127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c0feaf0 msgr2=0x7fb74c0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:12.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.418+0000 7fb7514b9640 1 --2- 172.21.15.17:0/1511463127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c0feaf0 0x7fb74c0feef0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009880 tx=0x7fb73c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.418+0000 7fb7514b9640 1 -- 172.21.15.17:0/1511463127 shutdown_connections 2024-08-19T00:57:12.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.418+0000 7fb7514b9640 1 --2- 172.21.15.17:0/1511463127 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74c0ffcf0 0x7fb74c100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.418+0000 7fb7514b9640 1 --2- 172.21.15.17:0/1511463127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c0feaf0 0x7fb74c0feef0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.418+0000 7fb7514b9640 1 -- 172.21.15.17:0/1511463127 >> 172.21.15.17:0/1511463127 conn(0x7fb74c0fa280 msgr2=0x7fb74c0fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:12.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.418+0000 7fb7514b9640 1 -- 172.21.15.17:0/1511463127 shutdown_connections 2024-08-19T00:57:12.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.418+0000 7fb7514b9640 1 -- 172.21.15.17:0/1511463127 wait complete. 2024-08-19T00:57:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.419+0000 7fb7514b9640 1 Processor -- start 2024-08-19T00:57:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.419+0000 7fb7514b9640 1 -- start start 2024-08-19T00:57:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.419+0000 7fb7514b9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74c0feaf0 0x7fb74c1956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.419+0000 7fb7514b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c0ffcf0 0x7fb74c195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.419+0000 7fb7514b9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c1961c0 con 0x7fb74c0ffcf0 2024-08-19T00:57:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.419+0000 7fb7514b9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c196330 con 0x7fb74c0feaf0 2024-08-19T00:57:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.419+0000 7fb74a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c0ffcf0 0x7fb74c195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.419+0000 7fb74a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c0ffcf0 0x7fb74c195bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51066/0 (socket says 172.21.15.17:51066) 2024-08-19T00:57:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.419+0000 7fb74a7fc640 1 -- 172.21.15.17:0/1661100444 learned_addr learned my addr 172.21.15.17:0/1661100444 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:57:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.419+0000 7fb74affd640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74c0feaf0 0x7fb74c1956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.420+0000 7fb74a7fc640 1 -- 172.21.15.17:0/1661100444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74c0feaf0 msgr2=0x7fb74c1956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.420+0000 7fb74a7fc640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74c0feaf0 0x7fb74c1956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.420+0000 7fb74a7fc640 1 -- 172.21.15.17:0/1661100444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c009560 con 0x7fb74c0ffcf0 2024-08-19T00:57:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.420+0000 7fb74affd640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74c0feaf0 0x7fb74c1956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:57:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.420+0000 7fb74a7fc640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c0ffcf0 0x7fb74c195bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb74000d720 tx=0x7fb74000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.420+0000 7fb733fff640 1 -- 172.21.15.17:0/1661100444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7400051f0 con 0x7fb74c0ffcf0 2024-08-19T00:57:12.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.420+0000 7fb733fff640 1 -- 172.21.15.17:0/1661100444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb740009ce0 con 0x7fb74c0ffcf0 2024-08-19T00:57:12.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.420+0000 7fb733fff640 1 -- 172.21.15.17:0/1661100444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb740010460 con 0x7fb74c0ffcf0 2024-08-19T00:57:12.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.420+0000 7fb7514b9640 1 -- 172.21.15.17:0/1661100444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74c19add0 con 0x7fb74c0ffcf0 2024-08-19T00:57:12.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.421+0000 7fb7514b9640 1 -- 172.21.15.17:0/1661100444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74c19b2f0 con 0x7fb74c0ffcf0 2024-08-19T00:57:12.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.422+0000 7fb7514b9640 1 -- 172.21.15.17:0/1661100444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74c0feef0 con 0x7fb74c0ffcf0 2024-08-19T00:57:12.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.423+0000 7fb733fff640 1 -- 172.21.15.17:0/1661100444 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fb740005350 con 0x7fb74c0ffcf0 2024-08-19T00:57:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.423+0000 7fb733fff640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb73406df20 0x7fb7340703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.423+0000 7fb733fff640 1 -- 172.21.15.17:0/1661100444 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb74008d8b0 con 0x7fb74c0ffcf0 2024-08-19T00:57:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.424+0000 7fb74affd640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb73406df20 0x7fb7340703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.424+0000 7fb74affd640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb73406df20 0x7fb7340703e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb73c006010 tx=0x7fb73c0314e0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:12.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.428+0000 7fb733fff640 1 -- 172.21.15.17:0/1661100444 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fb740056fd0 con 0x7fb74c0ffcf0 2024-08-19T00:57:12.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.680+0000 7fb7514b9640 1 -- 172.21.15.17:0/1661100444 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb74c1035e0 con 0x7fb73406df20 2024-08-19T00:57:12.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:12 smithi017 ceph-mon[16627]: pgmap v10: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 127 op/s 2024-08-19T00:57:12.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:12 smithi086 ceph-mon[24511]: pgmap v10: 65 pgs: 65 active+clean; 292 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 127 op/s 2024-08-19T00:57:12.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.695+0000 7fb733fff640 1 -- 172.21.15.17:0/1661100444 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fb74c1035e0 con 0x7fb73406df20 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (7m) 20s ago 9m 24.2M - 0.25.0 c8568f914cd2 eb29e4d36dfe 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (9m) 20s ago 9m 8078k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (8m) 11s ago 8m 7864k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (9m) 20s ago 9m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (8m) 11s ago 8m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (7m) 20s ago 8m 85.4M - 9.4.7 954c08fa6188 293dd58dd677 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (3m) 20s ago 3m 252M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (3m) 20s ago 3m 274M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (3m) 11s ago 3m 25.2M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (3m) 11s ago 3m 23.1M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T00:57:12.698 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (26s) 20s ago 10m 51.1M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (101s) 11s ago 8m 125M - 19.1.0-1382-gde09dd01 ea7a5189f30b 750e1ecdf317 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (10m) 20s ago 10m 51.7M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 771bc6b905a5 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (8m) 11s ago 8m 45.1M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 c6fce0ad535d 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (9m) 20s ago 9m 15.8M - 1.5.0 0da6a335fe13 33c11a243263 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (8m) 11s ago 8m 16.1M - 1.5.0 0da6a335fe13 15ad23a27a0c 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 20s ago 7m 189M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (6m) 20s ago 6m 195M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (6m) 20s ago 6m 154M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (6m) 11s ago 6m 214M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (5m) 11s ago 5m 184M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (5m) 11s ago 5m 181M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T00:57:12.699 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (38s) 20s ago 8m 41.8M - 2.43.0 a07b618ecd1d 46c5e8801ba6 2024-08-19T00:57:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.697+0000 7fb7514b9640 1 -- 172.21.15.17:0/1661100444 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb73406df20 msgr2=0x7fb7340703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.698+0000 7fb7514b9640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb73406df20 0x7fb7340703e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb73c006010 tx=0x7fb73c0314e0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.698+0000 7fb7514b9640 1 -- 172.21.15.17:0/1661100444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c0ffcf0 msgr2=0x7fb74c195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.698+0000 7fb7514b9640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c0ffcf0 0x7fb74c195bf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb74000d720 tx=0x7fb74000dbe0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.698+0000 7fb7514b9640 1 -- 172.21.15.17:0/1661100444 shutdown_connections 2024-08-19T00:57:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.698+0000 7fb7514b9640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb73406df20 0x7fb7340703e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.698+0000 7fb7514b9640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb74c0ffcf0 0x7fb74c195bf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.698+0000 7fb7514b9640 1 --2- 172.21.15.17:0/1661100444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb74c0feaf0 0x7fb74c1956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.698+0000 7fb7514b9640 1 -- 172.21.15.17:0/1661100444 >> 172.21.15.17:0/1661100444 conn(0x7fb74c0fa280 msgr2=0x7fb74c0fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.698+0000 7fb7514b9640 1 -- 172.21.15.17:0/1661100444 shutdown_connections 2024-08-19T00:57:12.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.698+0000 7fb7514b9640 1 -- 172.21.15.17:0/1661100444 wait complete. 2024-08-19T00:57:12.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.796+0000 7f5faf42b640 1 -- 172.21.15.17:0/2253731057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fa8100680 msgr2=0x7f5fa8102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:12.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.796+0000 7f5faf42b640 1 --2- 172.21.15.17:0/2253731057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fa8100680 0x7f5fa8102a70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5fa40098b0 tx=0x7f5fa402a4d0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.796+0000 7f5faf42b640 1 -- 172.21.15.17:0/2253731057 shutdown_connections 2024-08-19T00:57:12.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.796+0000 7f5faf42b640 1 --2- 172.21.15.17:0/2253731057 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa8102fb0 0x7f5fa81053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.796+0000 7f5faf42b640 1 --2- 172.21.15.17:0/2253731057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fa8100680 0x7f5fa8102a70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.796+0000 7f5faf42b640 1 -- 172.21.15.17:0/2253731057 >> 172.21.15.17:0/2253731057 conn(0x7f5fa80fa280 msgr2=0x7f5fa80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:12.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.796+0000 7f5faf42b640 1 -- 172.21.15.17:0/2253731057 shutdown_connections 2024-08-19T00:57:12.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.796+0000 7f5faf42b640 1 -- 172.21.15.17:0/2253731057 wait complete. 2024-08-19T00:57:12.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.796+0000 7f5faf42b640 1 Processor -- start 2024-08-19T00:57:12.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.796+0000 7f5faf42b640 1 -- start start 2024-08-19T00:57:12.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5faf42b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa8100680 0x7f5fa8195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:12.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5faf42b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fa8102fb0 0x7f5fa8195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:12.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5faf42b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8196220 con 0x7f5fa8102fb0 2024-08-19T00:57:12.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5faf42b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8196390 con 0x7f5fa8100680 2024-08-19T00:57:12.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5fac9c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fa8102fb0 0x7f5fa8195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:12.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5fad1c7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa8100680 0x7f5fa8195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:12.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5fad1c7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa8100680 0x7f5fa8195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.17:55398/0 (socket says 172.21.15.17:55398) 2024-08-19T00:57:12.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5fac9c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fa8102fb0 0x7f5fa8195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51082/0 (socket says 172.21.15.17:51082) 2024-08-19T00:57:12.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5fad1c7640 1 -- 172.21.15.17:0/2678896672 learned_addr learned my addr 172.21.15.17:0/2678896672 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:57:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5fac9c6640 1 -- 172.21.15.17:0/2678896672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa8100680 msgr2=0x7f5fa8195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5fac9c6640 1 --2- 172.21.15.17:0/2678896672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa8100680 0x7f5fa8195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5fac9c6640 1 -- 172.21.15.17:0/2678896672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4009560 con 0x7f5fa8102fb0 2024-08-19T00:57:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5fad1c7640 1 --2- 172.21.15.17:0/2678896672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa8100680 0x7f5fa8195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:57:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.797+0000 7f5fac9c6640 1 --2- 172.21.15.17:0/2678896672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fa8102fb0 0x7f5fa8195c50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800d6a0 tx=0x7f5f9800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.798+0000 7f5f9e7fc640 1 -- 172.21.15.17:0/2678896672 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f980051f0 con 0x7f5fa8102fb0 2024-08-19T00:57:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.798+0000 7f5f9e7fc640 1 -- 172.21.15.17:0/2678896672 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f98009c80 con 0x7f5fa8102fb0 2024-08-19T00:57:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.798+0000 7f5faf42b640 1 -- 172.21.15.17:0/2678896672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa819ae30 con 0x7f5fa8102fb0 2024-08-19T00:57:12.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.798+0000 7f5f9e7fc640 1 -- 172.21.15.17:0/2678896672 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f98004dd0 con 0x7f5fa8102fb0 2024-08-19T00:57:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.798+0000 7f5faf42b640 1 -- 172.21.15.17:0/2678896672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa819b350 con 0x7f5fa8102fb0 2024-08-19T00:57:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.799+0000 7f5faf42b640 1 -- 172.21.15.17:0/2678896672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa8100a60 con 0x7f5fa8102fb0 2024-08-19T00:57:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.799+0000 7f5f9e7fc640 1 -- 172.21.15.17:0/2678896672 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f5f980097c0 con 0x7f5fa8102fb0 2024-08-19T00:57:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.800+0000 7f5f9e7fc640 1 --2- 172.21.15.17:0/2678896672 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f5f9406df30 0x7f5f940703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.800+0000 7f5f9e7fc640 1 -- 172.21.15.17:0/2678896672 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5f9808d840 con 0x7f5fa8102fb0 2024-08-19T00:57:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.800+0000 7f5fad1c7640 1 --2- 172.21.15.17:0/2678896672 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f5f9406df30 0x7f5f940703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:12.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.800+0000 7f5fad1c7640 1 --2- 172.21.15.17:0/2678896672 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f5f9406df30 0x7f5f940703f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4000c00 tx=0x7f5fa40314e0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:12.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:12.804+0000 7f5f9e7fc640 1 -- 172.21.15.17:0/2678896672 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f5f98056ee0 con 0x7f5fa8102fb0 2024-08-19T00:57:13.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.151+0000 7f5faf42b640 1 -- 172.21.15.17:0/2678896672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5fa8108830 con 0x7f5fa8102fb0 2024-08-19T00:57:13.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.152+0000 7f5f9e7fc640 1 -- 172.21.15.17:0/2678896672 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7f5f9805a5a0 con 0x7f5fa8102fb0 2024-08-19T00:57:13.154 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:57:13.154 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T00:57:13.154 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2 2024-08-19T00:57:13.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:57:13.154 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T00:57:13.154 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T00:57:13.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:57:13.154 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T00:57:13.155 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6 2024-08-19T00:57:13.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:57:13.155 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T00:57:13.155 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T00:57:13.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:57:13.155 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T00:57:13.155 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 12, 2024-08-19T00:57:13.155 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T00:57:13.155 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T00:57:13.155 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:57:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.154+0000 7f5faf42b640 1 -- 172.21.15.17:0/2678896672 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f5f9406df30 msgr2=0x7f5f940703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.154+0000 7f5faf42b640 1 --2- 172.21.15.17:0/2678896672 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f5f9406df30 0x7f5f940703f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4000c00 tx=0x7f5fa40314e0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.154+0000 7f5faf42b640 1 -- 172.21.15.17:0/2678896672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fa8102fb0 msgr2=0x7f5fa8195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.154+0000 7f5faf42b640 1 --2- 172.21.15.17:0/2678896672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fa8102fb0 0x7f5fa8195c50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800d6a0 tx=0x7f5f9800db60 comp rx=0 tx=0).stop 2024-08-19T00:57:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.154+0000 7f5faf42b640 1 -- 172.21.15.17:0/2678896672 shutdown_connections 2024-08-19T00:57:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.154+0000 7f5faf42b640 1 --2- 172.21.15.17:0/2678896672 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f5f9406df30 0x7f5f940703f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.154+0000 7f5faf42b640 1 --2- 172.21.15.17:0/2678896672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fa8102fb0 0x7f5fa8195c50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.154+0000 7f5faf42b640 1 --2- 172.21.15.17:0/2678896672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fa8100680 0x7f5fa8195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.154+0000 7f5faf42b640 1 -- 172.21.15.17:0/2678896672 >> 172.21.15.17:0/2678896672 conn(0x7f5fa80fa280 msgr2=0x7f5fa80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.154+0000 7f5faf42b640 1 -- 172.21.15.17:0/2678896672 shutdown_connections 2024-08-19T00:57:13.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.154+0000 7f5faf42b640 1 -- 172.21.15.17:0/2678896672 wait complete. 2024-08-19T00:57:13.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.260+0000 7ff329561640 1 -- 172.21.15.17:0/278121342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3240ffaa0 msgr2=0x7ff3240fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:13.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.260+0000 7ff329561640 1 --2- 172.21.15.17:0/278121342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3240ffaa0 0x7ff3240fff20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff318009880 tx=0x7ff31802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.260+0000 7ff329561640 1 -- 172.21.15.17:0/278121342 shutdown_connections 2024-08-19T00:57:13.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.260+0000 7ff329561640 1 --2- 172.21.15.17:0/278121342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3240ffaa0 0x7ff3240fff20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.260+0000 7ff329561640 1 --2- 172.21.15.17:0/278121342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3240fe8a0 0x7ff3240feca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.260+0000 7ff329561640 1 -- 172.21.15.17:0/278121342 >> 172.21.15.17:0/278121342 conn(0x7ff3240fa010 msgr2=0x7ff3240fc470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:13.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.261+0000 7ff329561640 1 -- 172.21.15.17:0/278121342 shutdown_connections 2024-08-19T00:57:13.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.261+0000 7ff329561640 1 -- 172.21.15.17:0/278121342 wait complete. 2024-08-19T00:57:13.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.261+0000 7ff329561640 1 Processor -- start 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.261+0000 7ff329561640 1 -- start start 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.262+0000 7ff329561640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3240fe8a0 0x7ff324068740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.262+0000 7ff329561640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3240ffaa0 0x7ff32419a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.262+0000 7ff329561640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32419a720 con 0x7ff3240fe8a0 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.262+0000 7ff329561640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32419a890 con 0x7ff3240ffaa0 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.262+0000 7ff323fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3240fe8a0 0x7ff324068740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.262+0000 7ff323fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3240fe8a0 0x7ff324068740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51104/0 (socket says 172.21.15.17:51104) 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.262+0000 7ff323fff640 1 -- 172.21.15.17:0/1449920411 learned_addr learned my addr 172.21.15.17:0/1449920411 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.262+0000 7ff3237fe640 1 --2- 172.21.15.17:0/1449920411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3240ffaa0 0x7ff32419a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.262+0000 7ff323fff640 1 -- 172.21.15.17:0/1449920411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3240ffaa0 msgr2=0x7ff32419a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.262+0000 7ff323fff640 1 --2- 172.21.15.17:0/1449920411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3240ffaa0 0x7ff32419a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.262+0000 7ff323fff640 1 -- 172.21.15.17:0/1449920411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff318009560 con 0x7ff3240fe8a0 2024-08-19T00:57:13.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.263+0000 7ff323fff640 1 --2- 172.21.15.17:0/1449920411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3240fe8a0 0x7ff324068740 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff31400e940 tx=0x7ff31400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.263+0000 7ff3217fa640 1 -- 172.21.15.17:0/1449920411 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff314009700 con 0x7ff3240fe8a0 2024-08-19T00:57:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.263+0000 7ff329561640 1 -- 172.21.15.17:0/1449920411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff324194010 con 0x7ff3240fe8a0 2024-08-19T00:57:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.263+0000 7ff3217fa640 1 -- 172.21.15.17:0/1449920411 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff31400cc90 con 0x7ff3240fe8a0 2024-08-19T00:57:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.263+0000 7ff329561640 1 -- 172.21.15.17:0/1449920411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3241945b0 con 0x7ff3240fe8a0 2024-08-19T00:57:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.264+0000 7ff3217fa640 1 -- 172.21.15.17:0/1449920411 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff314010430 con 0x7ff3240fe8a0 2024-08-19T00:57:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.265+0000 7ff329561640 1 -- 172.21.15.17:0/1449920411 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff324195fa0 con 0x7ff3240fe8a0 2024-08-19T00:57:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.266+0000 7ff3217fa640 1 -- 172.21.15.17:0/1449920411 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7ff314003fa0 con 0x7ff3240fe8a0 2024-08-19T00:57:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.266+0000 7ff3217fa640 1 --2- 172.21.15.17:0/1449920411 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30c06df30 0x7ff30c0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:13.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.267+0000 7ff3217fa640 1 -- 172.21.15.17:0/1449920411 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff314014070 con 0x7ff3240fe8a0 2024-08-19T00:57:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.267+0000 7ff3237fe640 1 --2- 172.21.15.17:0/1449920411 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30c06df30 0x7ff30c0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:13.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.267+0000 7ff3237fe640 1 --2- 172.21.15.17:0/1449920411 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30c06df30 0x7ff30c0703f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff318000c00 tx=0x7ff3180314e0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:13.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.275+0000 7ff3217fa640 1 -- 172.21.15.17:0/1449920411 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7ff3140578c0 con 0x7ff3240fe8a0 2024-08-19T00:57:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:13 smithi017 ceph-mon[16627]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:13 smithi017 ceph-mon[16627]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:13 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:57:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:13 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2678896672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:57:13.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.566+0000 7ff329561640 1 -- 172.21.15.17:0/1449920411 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff32402c4f0 con 0x7ff30c06df30 2024-08-19T00:57:13.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.567+0000 7ff3217fa640 1 -- 172.21.15.17:0/1449920411 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7ff32402c4f0 con 0x7ff30c06df30 2024-08-19T00:57:13.569 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:57:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T00:57:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T00:57:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-19T00:57:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T00:57:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T00:57:13.569 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T00:57:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "2/2 daemons upgraded", 2024-08-19T00:57:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-08-19T00:57:13.570 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T00:57:13.570 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:57:13.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.569+0000 7ff329561640 1 -- 172.21.15.17:0/1449920411 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30c06df30 msgr2=0x7ff30c0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:13.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.569+0000 7ff329561640 1 --2- 172.21.15.17:0/1449920411 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30c06df30 0x7ff30c0703f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff318000c00 tx=0x7ff3180314e0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.569+0000 7ff329561640 1 -- 172.21.15.17:0/1449920411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3240fe8a0 msgr2=0x7ff324068740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:13.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.569+0000 7ff329561640 1 --2- 172.21.15.17:0/1449920411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3240fe8a0 0x7ff324068740 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff31400e940 tx=0x7ff31400ee00 comp rx=0 tx=0).stop 2024-08-19T00:57:13.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.570+0000 7ff329561640 1 -- 172.21.15.17:0/1449920411 shutdown_connections 2024-08-19T00:57:13.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.570+0000 7ff329561640 1 --2- 172.21.15.17:0/1449920411 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30c06df30 0x7ff30c0703f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.570+0000 7ff329561640 1 --2- 172.21.15.17:0/1449920411 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff3240ffaa0 0x7ff32419a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.570+0000 7ff329561640 1 --2- 172.21.15.17:0/1449920411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3240fe8a0 0x7ff324068740 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:13.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.570+0000 7ff329561640 1 -- 172.21.15.17:0/1449920411 >> 172.21.15.17:0/1449920411 conn(0x7ff3240fa010 msgr2=0x7ff3241031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:13.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.570+0000 7ff329561640 1 -- 172.21.15.17:0/1449920411 shutdown_connections 2024-08-19T00:57:13.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:13.570+0000 7ff329561640 1 -- 172.21.15.17:0/1449920411 wait complete. 2024-08-19T00:57:13.638 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:13 smithi086 ceph-mon[24511]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:13.638 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:13 smithi086 ceph-mon[24511]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:13.639 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:13 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:57:13.639 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:13 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/2678896672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:57:14.669 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:14 smithi086 ceph-mon[24511]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:14.670 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:14 smithi086 ceph-mon[24511]: pgmap v11: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 134 op/s 2024-08-19T00:57:14.670 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:14 smithi086 ceph-mon[24511]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:14.670 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:14 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:14.670 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:14 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:14.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:14 smithi017 ceph-mon[16627]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:14.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:14 smithi017 ceph-mon[16627]: pgmap v11: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 134 op/s 2024-08-19T00:57:14.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:14 smithi017 ceph-mon[16627]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:14.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:14 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:14.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:14 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:16.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:15 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:16.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:15 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:16.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:15 smithi017 ceph-mon[16627]: pgmap v12: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 164 op/s 2024-08-19T00:57:16.206 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:15 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:16.206 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:15 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:16.206 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:15 smithi086 ceph-mon[24511]: pgmap v12: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 164 op/s 2024-08-19T00:57:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:18 smithi017 ceph-mon[16627]: pgmap v13: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 110 op/s 2024-08-19T00:57:18.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:18 smithi086 ceph-mon[24511]: pgmap v13: 65 pgs: 65 active+clean; 297 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 110 op/s 2024-08-19T00:57:20.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:20 smithi017 ceph-mon[16627]: pgmap v14: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 158 op/s 2024-08-19T00:57:20.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:20 smithi086 ceph-mon[24511]: pgmap v14: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 158 op/s 2024-08-19T00:57:22.624 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:22 smithi017 ceph-mon[16627]: pgmap v15: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 100 op/s 2024-08-19T00:57:22.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:22 smithi086 ceph-mon[24511]: pgmap v15: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 100 op/s 2024-08-19T00:57:24.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:24 smithi017 ceph-mon[16627]: pgmap v16: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 126 op/s 2024-08-19T00:57:24.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:24 smithi086 ceph-mon[24511]: pgmap v16: 65 pgs: 65 active+clean; 309 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 126 op/s 2024-08-19T00:57:26.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:26 smithi017 ceph-mon[16627]: pgmap v17: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 148 op/s 2024-08-19T00:57:26.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:26 smithi086 ceph-mon[24511]: pgmap v17: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 148 op/s 2024-08-19T00:57:28.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:28 smithi017 ceph-mon[16627]: pgmap v18: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-08-19T00:57:28.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:28 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:57:28.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:28 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:28.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:28 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:28.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:28 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:57:28.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:28 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:57:28.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:28 smithi086 ceph-mon[24511]: pgmap v18: 65 pgs: 65 active+clean; 312 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-08-19T00:57:28.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:28 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:57:28.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:28 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:28.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:28 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:28.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:28 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:57:28.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:28 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:57:29.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: Updating smithi017:/etc/ceph/ceph.conf 2024-08-19T00:57:29.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: Updating smithi086:/etc/ceph/ceph.conf 2024-08-19T00:57:29.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:57:29.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:57:29.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:57:29.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:57:29.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:57:29.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:29.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:29.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:29.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:29.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:29 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: Updating smithi017:/etc/ceph/ceph.conf 2024-08-19T00:57:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: Updating smithi086:/etc/ceph/ceph.conf 2024-08-19T00:57:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:57:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T00:57:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:57:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-08-19T00:57:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:57:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:29.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:29 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:30.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:30 smithi017 ceph-mon[16627]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:57:30.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:30 smithi017 ceph-mon[16627]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-08-19T00:57:30.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:30 smithi017 ceph-mon[16627]: pgmap v19: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 254 op/s 2024-08-19T00:57:30.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:30 smithi017 ceph-mon[16627]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-08-19T00:57:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:30 smithi086 ceph-mon[24511]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T00:57:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:30 smithi086 ceph-mon[24511]: Reconfiguring prometheus.smithi017 (dependencies changed)... 2024-08-19T00:57:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:30 smithi086 ceph-mon[24511]: pgmap v19: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 254 op/s 2024-08-19T00:57:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:30 smithi086 ceph-mon[24511]: Reconfiguring daemon prometheus.smithi017 on smithi017 2024-08-19T00:57:32.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:32 smithi017 ceph-mon[16627]: pgmap v20: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-08-19T00:57:32.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:32 smithi086 ceph-mon[24511]: pgmap v20: 65 pgs: 65 active+clean; 308 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 206 op/s 2024-08-19T00:57:34.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:34 smithi017 ceph-mon[16627]: pgmap v21: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 347 op/s 2024-08-19T00:57:34.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:34 smithi086 ceph-mon[24511]: pgmap v21: 65 pgs: 65 active+clean; 304 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 347 op/s 2024-08-19T00:57:36.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:36 smithi017 ceph-mon[16627]: pgmap v22: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 395 op/s 2024-08-19T00:57:36.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:36 smithi086 ceph-mon[24511]: pgmap v22: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 395 op/s 2024-08-19T00:57:38.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:38 smithi017 ceph-mon[16627]: pgmap v23: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 365 op/s 2024-08-19T00:57:38.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:38 smithi086 ceph-mon[24511]: pgmap v23: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 365 op/s 2024-08-19T00:57:40.526 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:40 smithi017 ceph-mon[16627]: pgmap v24: 65 pgs: 65 active+clean; 294 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 504 op/s 2024-08-19T00:57:40.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:40 smithi086 ceph-mon[24511]: pgmap v24: 65 pgs: 65 active+clean; 294 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 504 op/s 2024-08-19T00:57:42.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:42 smithi086 ceph-mon[24511]: pgmap v25: 65 pgs: 65 active+clean; 294 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 353 op/s 2024-08-19T00:57:42.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:42 smithi017 ceph-mon[16627]: pgmap v25: 65 pgs: 65 active+clean; 294 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 353 op/s 2024-08-19T00:57:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.678+0000 7faff0344640 1 -- 172.21.15.17:0/2843757391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafe8100610 msgr2=0x7fafe8102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.678+0000 7faff0344640 1 --2- 172.21.15.17:0/2843757391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafe8100610 0x7fafe8102a00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fafe40098b0 tx=0x7fafe402a4d0 comp rx=0 tx=0).stop 2024-08-19T00:57:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.679+0000 7faff0344640 1 -- 172.21.15.17:0/2843757391 shutdown_connections 2024-08-19T00:57:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.679+0000 7faff0344640 1 --2- 172.21.15.17:0/2843757391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe8102f40 0x7fafe8105330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.679+0000 7faff0344640 1 --2- 172.21.15.17:0/2843757391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafe8100610 0x7fafe8102a00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.679+0000 7faff0344640 1 -- 172.21.15.17:0/2843757391 >> 172.21.15.17:0/2843757391 conn(0x7fafe80fa230 msgr2=0x7fafe80fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:43.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.679+0000 7faff0344640 1 -- 172.21.15.17:0/2843757391 shutdown_connections 2024-08-19T00:57:43.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:43 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:57:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.679+0000 7faff0344640 1 -- 172.21.15.17:0/2843757391 wait complete. 2024-08-19T00:57:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.680+0000 7faff0344640 1 Processor -- start 2024-08-19T00:57:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.680+0000 7faff0344640 1 -- start start 2024-08-19T00:57:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.680+0000 7faff0344640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafe8100610 0x7fafe8195650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.680+0000 7faff0344640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe8102f40 0x7fafe8195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.680+0000 7faff0344640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe8196160 con 0x7fafe8100610 2024-08-19T00:57:43.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.680+0000 7faff0344640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe81962d0 con 0x7fafe8102f40 2024-08-19T00:57:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.681+0000 7fafee0e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafe8100610 0x7fafe8195650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.681+0000 7fafee0e0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafe8100610 0x7fafe8195650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41574/0 (socket says 172.21.15.17:41574) 2024-08-19T00:57:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.681+0000 7fafee0e0640 1 -- 172.21.15.17:0/819962576 learned_addr learned my addr 172.21.15.17:0/819962576 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:57:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.681+0000 7fafed8df640 1 --2- 172.21.15.17:0/819962576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe8102f40 0x7fafe8195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.681+0000 7fafee0e0640 1 -- 172.21.15.17:0/819962576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe8102f40 msgr2=0x7fafe8195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.681+0000 7fafee0e0640 1 --2- 172.21.15.17:0/819962576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe8102f40 0x7fafe8195b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.681+0000 7fafee0e0640 1 -- 172.21.15.17:0/819962576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe4009560 con 0x7fafe8100610 2024-08-19T00:57:43.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.681+0000 7fafee0e0640 1 --2- 172.21.15.17:0/819962576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafe8100610 0x7fafe8195650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fafe40054f0 tx=0x7fafe4005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.682+0000 7fafdf7fe640 1 -- 172.21.15.17:0/819962576 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe4004aa0 con 0x7fafe8100610 2024-08-19T00:57:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.682+0000 7faff0344640 1 -- 172.21.15.17:0/819962576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe819ad10 con 0x7fafe8100610 2024-08-19T00:57:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.682+0000 7fafdf7fe640 1 -- 172.21.15.17:0/819962576 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafe4004c00 con 0x7fafe8100610 2024-08-19T00:57:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.682+0000 7faff0344640 1 -- 172.21.15.17:0/819962576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe819b230 con 0x7fafe8100610 2024-08-19T00:57:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.682+0000 7fafdf7fe640 1 -- 172.21.15.17:0/819962576 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafe4003b10 con 0x7fafe8100610 2024-08-19T00:57:43.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.683+0000 7faff0344640 1 -- 172.21.15.17:0/819962576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe81087c0 con 0x7fafe8100610 2024-08-19T00:57:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.684+0000 7fafdf7fe640 1 -- 172.21.15.17:0/819962576 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fafe4031640 con 0x7fafe8100610 2024-08-19T00:57:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.684+0000 7fafdf7fe640 1 --2- 172.21.15.17:0/819962576 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fafd406df30 0x7fafd40703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.684+0000 7fafdf7fe640 1 -- 172.21.15.17:0/819962576 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fafe40aebe0 con 0x7fafe8100610 2024-08-19T00:57:43.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.685+0000 7fafed8df640 1 --2- 172.21.15.17:0/819962576 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fafd406df30 0x7fafd40703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:43.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.685+0000 7fafed8df640 1 --2- 172.21.15.17:0/819962576 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fafd406df30 0x7fafd40703f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fafe8196b70 tx=0x7fafd800b390 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:43.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.689+0000 7fafdf7fe640 1 -- 172.21.15.17:0/819962576 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fafe4078280 con 0x7fafe8100610 2024-08-19T00:57:43.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:43 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:57:43.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.994+0000 7faff0344640 1 -- 172.21.15.17:0/819962576 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafe8103920 con 0x7fafd406df30 2024-08-19T00:57:43.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.996+0000 7fafdf7fe640 1 -- 172.21.15.17:0/819962576 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fafe8103920 con 0x7fafd406df30 2024-08-19T00:57:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.999+0000 7faff0344640 1 -- 172.21.15.17:0/819962576 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fafd406df30 msgr2=0x7fafd40703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.999+0000 7faff0344640 1 --2- 172.21.15.17:0/819962576 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fafd406df30 0x7fafd40703f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fafe8196b70 tx=0x7fafd800b390 comp rx=0 tx=0).stop 2024-08-19T00:57:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.999+0000 7faff0344640 1 -- 172.21.15.17:0/819962576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafe8100610 msgr2=0x7fafe8195650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.999+0000 7faff0344640 1 --2- 172.21.15.17:0/819962576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafe8100610 0x7fafe8195650 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fafe40054f0 tx=0x7fafe4005520 comp rx=0 tx=0).stop 2024-08-19T00:57:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.999+0000 7faff0344640 1 -- 172.21.15.17:0/819962576 shutdown_connections 2024-08-19T00:57:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.999+0000 7faff0344640 1 --2- 172.21.15.17:0/819962576 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fafd406df30 0x7fafd40703f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.999+0000 7faff0344640 1 --2- 172.21.15.17:0/819962576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafe8102f40 0x7fafe8195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.999+0000 7faff0344640 1 --2- 172.21.15.17:0/819962576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafe8100610 0x7fafe8195650 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.999+0000 7faff0344640 1 -- 172.21.15.17:0/819962576 >> 172.21.15.17:0/819962576 conn(0x7fafe80fa230 msgr2=0x7fafe80fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.999+0000 7faff0344640 1 -- 172.21.15.17:0/819962576 shutdown_connections 2024-08-19T00:57:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:43.999+0000 7faff0344640 1 -- 172.21.15.17:0/819962576 wait complete. 2024-08-19T00:57:44.013 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:57:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.113+0000 7efe9e65c640 1 -- 172.21.15.17:0/481959842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe980744e0 msgr2=0x7efe98072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.113+0000 7efe9e65c640 1 --2- 172.21.15.17:0/481959842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe980744e0 0x7efe98072940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe88009880 tx=0x7efe8802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.114+0000 7efe9e65c640 1 -- 172.21.15.17:0/481959842 shutdown_connections 2024-08-19T00:57:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.114+0000 7efe9e65c640 1 --2- 172.21.15.17:0/481959842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe98072f10 0x7efe98073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.114+0000 7efe9e65c640 1 --2- 172.21.15.17:0/481959842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe980744e0 0x7efe98072940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.114+0000 7efe9e65c640 1 -- 172.21.15.17:0/481959842 >> 172.21.15.17:0/481959842 conn(0x7efe980fb360 msgr2=0x7efe980fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.114+0000 7efe9e65c640 1 -- 172.21.15.17:0/481959842 shutdown_connections 2024-08-19T00:57:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.114+0000 7efe9e65c640 1 -- 172.21.15.17:0/481959842 wait complete. 2024-08-19T00:57:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.114+0000 7efe9e65c640 1 Processor -- start 2024-08-19T00:57:44.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe9e65c640 1 -- start start 2024-08-19T00:57:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe9e65c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe98072f10 0x7efe9819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe9e65c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980744e0 0x7efe9819c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe9e65c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9819c750 con 0x7efe980744e0 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe9e65c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9819c8c0 con 0x7efe98072f10 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe97fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe98072f10 0x7efe9819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980744e0 0x7efe9819c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe8ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980744e0 0x7efe9819c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41590/0 (socket says 172.21.15.17:41590) 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe8ffff640 1 -- 172.21.15.17:0/1930650954 learned_addr learned my addr 172.21.15.17:0/1930650954 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe97fff640 1 -- 172.21.15.17:0/1930650954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980744e0 msgr2=0x7efe9819c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe97fff640 1 --2- 172.21.15.17:0/1930650954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980744e0 0x7efe9819c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.115+0000 7efe97fff640 1 -- 172.21.15.17:0/1930650954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe88009560 con 0x7efe98072f10 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.116+0000 7efe97fff640 1 --2- 172.21.15.17:0/1930650954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe98072f10 0x7efe9819bc40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe8802a9c0 tx=0x7efe880055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.116+0000 7efe95ffb640 1 -- 172.21.15.17:0/1930650954 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe88004aa0 con 0x7efe98072f10 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.116+0000 7efe95ffb640 1 -- 172.21.15.17:0/1930650954 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe88005d50 con 0x7efe98072f10 2024-08-19T00:57:44.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.116+0000 7efe9e65c640 1 -- 172.21.15.17:0/1930650954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe981a12f0 con 0x7efe98072f10 2024-08-19T00:57:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.116+0000 7efe9e65c640 1 -- 172.21.15.17:0/1930650954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe981a1860 con 0x7efe98072f10 2024-08-19T00:57:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.117+0000 7efe95ffb640 1 -- 172.21.15.17:0/1930650954 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe88003940 con 0x7efe98072f10 2024-08-19T00:57:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.117+0000 7efe9e65c640 1 -- 172.21.15.17:0/1930650954 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9810edd0 con 0x7efe98072f10 2024-08-19T00:57:44.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.118+0000 7efe95ffb640 1 -- 172.21.15.17:0/1930650954 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7efe88031b90 con 0x7efe98072f10 2024-08-19T00:57:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.119+0000 7efe95ffb640 1 --2- 172.21.15.17:0/1930650954 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efe7806df30 0x7efe780703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.119+0000 7efe8ffff640 1 --2- 172.21.15.17:0/1930650954 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efe7806df30 0x7efe780703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.120+0000 7efe8ffff640 1 --2- 172.21.15.17:0/1930650954 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efe7806df30 0x7efe780703f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efe80009cd0 tx=0x7efe80005f90 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:44.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.120+0000 7efe95ffb640 1 -- 172.21.15.17:0/1930650954 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7efe880aedd0 con 0x7efe98072f10 2024-08-19T00:57:44.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.123+0000 7efe95ffb640 1 -- 172.21.15.17:0/1930650954 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7efe8807bf80 con 0x7efe98072f10 2024-08-19T00:57:44.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.397+0000 7efe9e65c640 1 -- 172.21.15.17:0/1930650954 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe98102b60 con 0x7efe7806df30 2024-08-19T00:57:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.399+0000 7efe95ffb640 1 -- 172.21.15.17:0/1930650954 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7efe98102b60 con 0x7efe7806df30 2024-08-19T00:57:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.402+0000 7efe9e65c640 1 -- 172.21.15.17:0/1930650954 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efe7806df30 msgr2=0x7efe780703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.402+0000 7efe9e65c640 1 --2- 172.21.15.17:0/1930650954 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efe7806df30 0x7efe780703f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efe80009cd0 tx=0x7efe80005f90 comp rx=0 tx=0).stop 2024-08-19T00:57:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.402+0000 7efe9e65c640 1 -- 172.21.15.17:0/1930650954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe98072f10 msgr2=0x7efe9819bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.402+0000 7efe9e65c640 1 --2- 172.21.15.17:0/1930650954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe98072f10 0x7efe9819bc40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe8802a9c0 tx=0x7efe880055a0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.402+0000 7efe9e65c640 1 -- 172.21.15.17:0/1930650954 shutdown_connections 2024-08-19T00:57:44.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.402+0000 7efe9e65c640 1 --2- 172.21.15.17:0/1930650954 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7efe7806df30 0x7efe780703f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.402+0000 7efe9e65c640 1 --2- 172.21.15.17:0/1930650954 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe980744e0 0x7efe9819c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.402+0000 7efe9e65c640 1 --2- 172.21.15.17:0/1930650954 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe98072f10 0x7efe9819bc40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.402+0000 7efe9e65c640 1 -- 172.21.15.17:0/1930650954 >> 172.21.15.17:0/1930650954 conn(0x7efe980fb360 msgr2=0x7efe98101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.402+0000 7efe9e65c640 1 -- 172.21.15.17:0/1930650954 shutdown_connections 2024-08-19T00:57:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.402+0000 7efe9e65c640 1 -- 172.21.15.17:0/1930650954 wait complete. 2024-08-19T00:57:44.511 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:44 smithi017 ceph-mon[16627]: pgmap v26: 65 pgs: 65 active+clean; 287 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 457 op/s 2024-08-19T00:57:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.510+0000 7fda206e1640 1 -- 172.21.15.17:0/3023571037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda180ffcf0 msgr2=0x7fda18100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.510+0000 7fda206e1640 1 --2- 172.21.15.17:0/3023571037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda180ffcf0 0x7fda18100170 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fda08009880 tx=0x7fda0802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.510+0000 7fda206e1640 1 -- 172.21.15.17:0/3023571037 shutdown_connections 2024-08-19T00:57:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.510+0000 7fda206e1640 1 --2- 172.21.15.17:0/3023571037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda180ffcf0 0x7fda18100170 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.510+0000 7fda206e1640 1 --2- 172.21.15.17:0/3023571037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda180feaf0 0x7fda180feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.510+0000 7fda206e1640 1 -- 172.21.15.17:0/3023571037 >> 172.21.15.17:0/3023571037 conn(0x7fda180fa280 msgr2=0x7fda180fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.511+0000 7fda206e1640 1 -- 172.21.15.17:0/3023571037 shutdown_connections 2024-08-19T00:57:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.511+0000 7fda206e1640 1 -- 172.21.15.17:0/3023571037 wait complete. 2024-08-19T00:57:44.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.511+0000 7fda206e1640 1 Processor -- start 2024-08-19T00:57:44.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.511+0000 7fda206e1640 1 -- start start 2024-08-19T00:57:44.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.512+0000 7fda206e1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda180feaf0 0x7fda180681c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:44.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.512+0000 7fda206e1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda180ffcf0 0x7fda18068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.512+0000 7fda206e1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda18071130 con 0x7fda180ffcf0 2024-08-19T00:57:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.512+0000 7fda206e1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda180712a0 con 0x7fda180feaf0 2024-08-19T00:57:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.512+0000 7fda1dc7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda180ffcf0 0x7fda18068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.512+0000 7fda1dc7c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda180ffcf0 0x7fda18068700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41596/0 (socket says 172.21.15.17:41596) 2024-08-19T00:57:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.512+0000 7fda1dc7c640 1 -- 172.21.15.17:0/1005807128 learned_addr learned my addr 172.21.15.17:0/1005807128 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:57:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.512+0000 7fda1e47d640 1 --2- 172.21.15.17:0/1005807128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda180feaf0 0x7fda180681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.512+0000 7fda1dc7c640 1 -- 172.21.15.17:0/1005807128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda180feaf0 msgr2=0x7fda180681c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.512+0000 7fda1dc7c640 1 --2- 172.21.15.17:0/1005807128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda180feaf0 0x7fda180681c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.512+0000 7fda1dc7c640 1 -- 172.21.15.17:0/1005807128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda08009560 con 0x7fda180ffcf0 2024-08-19T00:57:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.513+0000 7fda1dc7c640 1 --2- 172.21.15.17:0/1005807128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda180ffcf0 0x7fda18068700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fda08006010 tx=0x7fda080055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:44.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.513+0000 7fda0f7fe640 1 -- 172.21.15.17:0/1005807128 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda08004aa0 con 0x7fda180ffcf0 2024-08-19T00:57:44.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.513+0000 7fda0f7fe640 1 -- 172.21.15.17:0/1005807128 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda08005d50 con 0x7fda180ffcf0 2024-08-19T00:57:44.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.513+0000 7fda0f7fe640 1 -- 172.21.15.17:0/1005807128 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda080039e0 con 0x7fda180ffcf0 2024-08-19T00:57:44.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.513+0000 7fda206e1640 1 -- 172.21.15.17:0/1005807128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda18071520 con 0x7fda180ffcf0 2024-08-19T00:57:44.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.513+0000 7fda206e1640 1 -- 172.21.15.17:0/1005807128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda18071950 con 0x7fda180ffcf0 2024-08-19T00:57:44.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.515+0000 7fda206e1640 1 -- 172.21.15.17:0/1005807128 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda180feef0 con 0x7fda180ffcf0 2024-08-19T00:57:44.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.516+0000 7fda0f7fe640 1 -- 172.21.15.17:0/1005807128 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fda08031c00 con 0x7fda180ffcf0 2024-08-19T00:57:44.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.516+0000 7fda0f7fe640 1 --2- 172.21.15.17:0/1005807128 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fda0406df80 0x7fda04070440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:44.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.516+0000 7fda0f7fe640 1 -- 172.21.15.17:0/1005807128 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fda080aee60 con 0x7fda180ffcf0 2024-08-19T00:57:44.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.517+0000 7fda1e47d640 1 --2- 172.21.15.17:0/1005807128 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fda0406df80 0x7fda04070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:44.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.518+0000 7fda1e47d640 1 --2- 172.21.15.17:0/1005807128 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fda0406df80 0x7fda04070440 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fda180ffb50 tx=0x7fda14005f90 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:44.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.522+0000 7fda0f7fe640 1 -- 172.21.15.17:0/1005807128 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fda080784e0 con 0x7fda180ffcf0 2024-08-19T00:57:44.609 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:44 smithi086 ceph-mon[24511]: pgmap v26: 65 pgs: 65 active+clean; 287 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 457 op/s 2024-08-19T00:57:44.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.817+0000 7fda206e1640 1 -- 172.21.15.17:0/1005807128 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda18071d30 con 0x7fda0406df80 2024-08-19T00:57:44.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.834+0000 7fda0f7fe640 1 -- 172.21.15.17:0/1005807128 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fda18071d30 con 0x7fda0406df80 2024-08-19T00:57:44.836 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:57:44.836 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (8m) 30s ago 9m 24.2M - 0.25.0 c8568f914cd2 eb29e4d36dfe 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (9m) 30s ago 9m 8094k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (8m) 43s ago 8m 7864k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (9m) 30s ago 9m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (8m) 43s ago 8m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (8m) 30s ago 9m 85.4M - 9.4.7 954c08fa6188 293dd58dd677 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (4m) 30s ago 4m 254M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (4m) 30s ago 4m 277M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (4m) 43s ago 4m 25.2M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (4m) 43s ago 4m 23.1M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (58s) 30s ago 11m 475M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (2m) 43s ago 8m 125M - 19.1.0-1382-gde09dd01 ea7a5189f30b 750e1ecdf317 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (11m) 30s ago 11m 53.8M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 771bc6b905a5 2024-08-19T00:57:44.837 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (8m) 43s ago 8m 45.1M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 c6fce0ad535d 2024-08-19T00:57:44.838 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (9m) 30s ago 9m 15.7M - 1.5.0 0da6a335fe13 33c11a243263 2024-08-19T00:57:44.838 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (8m) 43s ago 8m 16.1M - 1.5.0 0da6a335fe13 15ad23a27a0c 2024-08-19T00:57:44.838 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 30s ago 7m 185M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T00:57:44.838 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (7m) 30s ago 7m 194M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T00:57:44.838 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (7m) 30s ago 6m 154M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T00:57:44.838 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (6m) 43s ago 6m 214M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T00:57:44.838 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (6m) 43s ago 6m 184M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T00:57:44.838 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (5m) 43s ago 5m 181M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T00:57:44.838 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 starting - - - - 2024-08-19T00:57:44.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.837+0000 7fda206e1640 1 -- 172.21.15.17:0/1005807128 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fda0406df80 msgr2=0x7fda04070440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.837+0000 7fda206e1640 1 --2- 172.21.15.17:0/1005807128 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fda0406df80 0x7fda04070440 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fda180ffb50 tx=0x7fda14005f90 comp rx=0 tx=0).stop 2024-08-19T00:57:44.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.837+0000 7fda206e1640 1 -- 172.21.15.17:0/1005807128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda180ffcf0 msgr2=0x7fda18068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.837+0000 7fda206e1640 1 --2- 172.21.15.17:0/1005807128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda180ffcf0 0x7fda18068700 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fda08006010 tx=0x7fda080055a0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.837+0000 7fda206e1640 1 -- 172.21.15.17:0/1005807128 shutdown_connections 2024-08-19T00:57:44.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.837+0000 7fda206e1640 1 --2- 172.21.15.17:0/1005807128 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fda0406df80 0x7fda04070440 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.837+0000 7fda206e1640 1 --2- 172.21.15.17:0/1005807128 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda180ffcf0 0x7fda18068700 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.837+0000 7fda206e1640 1 --2- 172.21.15.17:0/1005807128 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda180feaf0 0x7fda180681c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.837+0000 7fda206e1640 1 -- 172.21.15.17:0/1005807128 >> 172.21.15.17:0/1005807128 conn(0x7fda180fa280 msgr2=0x7fda181033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:44.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.837+0000 7fda206e1640 1 -- 172.21.15.17:0/1005807128 shutdown_connections 2024-08-19T00:57:44.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.837+0000 7fda206e1640 1 -- 172.21.15.17:0/1005807128 wait complete. 2024-08-19T00:57:44.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.967+0000 7f728057d640 1 -- 172.21.15.17:0/3650166267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72780ffcf0 msgr2=0x7f7278100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.967+0000 7f728057d640 1 --2- 172.21.15.17:0/3650166267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72780ffcf0 0x7f7278100170 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7274009880 tx=0x7f727402a4d0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.967+0000 7f728057d640 1 -- 172.21.15.17:0/3650166267 shutdown_connections 2024-08-19T00:57:44.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.967+0000 7f728057d640 1 --2- 172.21.15.17:0/3650166267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72780ffcf0 0x7f7278100170 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.967+0000 7f728057d640 1 --2- 172.21.15.17:0/3650166267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72780feaf0 0x7f72780feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.967+0000 7f728057d640 1 -- 172.21.15.17:0/3650166267 >> 172.21.15.17:0/3650166267 conn(0x7f72780fa280 msgr2=0x7f72780fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:44.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.968+0000 7f728057d640 1 -- 172.21.15.17:0/3650166267 shutdown_connections 2024-08-19T00:57:44.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.968+0000 7f728057d640 1 -- 172.21.15.17:0/3650166267 wait complete. 2024-08-19T00:57:44.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.969+0000 7f728057d640 1 Processor -- start 2024-08-19T00:57:44.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.969+0000 7f728057d640 1 -- start start 2024-08-19T00:57:44.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.969+0000 7f728057d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72780feaf0 0x7f727806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:44.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.969+0000 7f728057d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72780ffcf0 0x7f727806a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:44.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.969+0000 7f728057d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727806adb0 con 0x7f72780feaf0 2024-08-19T00:57:44.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.969+0000 7f728057d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727806af20 con 0x7f72780ffcf0 2024-08-19T00:57:44.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.970+0000 7f727e319640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72780feaf0 0x7f727806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:44.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.970+0000 7f727e319640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72780feaf0 0x7f727806a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41610/0 (socket says 172.21.15.17:41610) 2024-08-19T00:57:44.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.970+0000 7f727e319640 1 -- 172.21.15.17:0/4085679061 learned_addr learned my addr 172.21.15.17:0/4085679061 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:57:44.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.971+0000 7f727db18640 1 --2- 172.21.15.17:0/4085679061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72780ffcf0 0x7f727806a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:44.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.971+0000 7f727e319640 1 -- 172.21.15.17:0/4085679061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72780ffcf0 msgr2=0x7f727806a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:44.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.971+0000 7f727e319640 1 --2- 172.21.15.17:0/4085679061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72780ffcf0 0x7f727806a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:44.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.971+0000 7f727e319640 1 -- 172.21.15.17:0/4085679061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7274009560 con 0x7f72780feaf0 2024-08-19T00:57:44.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.971+0000 7f727e319640 1 --2- 172.21.15.17:0/4085679061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72780feaf0 0x7f727806a2a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f726c00b3f0 tx=0x7f726c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:44.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.972+0000 7f726b7fe640 1 -- 172.21.15.17:0/4085679061 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f726c011800 con 0x7f72780feaf0 2024-08-19T00:57:44.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.972+0000 7f726b7fe640 1 -- 172.21.15.17:0/4085679061 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f726c011e20 con 0x7f72780feaf0 2024-08-19T00:57:44.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.972+0000 7f726b7fe640 1 -- 172.21.15.17:0/4085679061 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f726c00f2e0 con 0x7f72780feaf0 2024-08-19T00:57:44.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.972+0000 7f728057d640 1 -- 172.21.15.17:0/4085679061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727806f9f0 con 0x7f72780feaf0 2024-08-19T00:57:44.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.972+0000 7f728057d640 1 -- 172.21.15.17:0/4085679061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727806ffc0 con 0x7f72780feaf0 2024-08-19T00:57:44.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.974+0000 7f728057d640 1 -- 172.21.15.17:0/4085679061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7278106810 con 0x7f72780feaf0 2024-08-19T00:57:44.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.975+0000 7f726b7fe640 1 -- 172.21.15.17:0/4085679061 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f726c010380 con 0x7f72780feaf0 2024-08-19T00:57:44.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.975+0000 7f726b7fe640 1 --2- 172.21.15.17:0/4085679061 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f726406e030 0x7f72640704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:44.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.976+0000 7f726b7fe640 1 -- 172.21.15.17:0/4085679061 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f726c08d870 con 0x7f72780feaf0 2024-08-19T00:57:44.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.976+0000 7f727db18640 1 --2- 172.21.15.17:0/4085679061 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f726406e030 0x7f72640704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:44.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.978+0000 7f727db18640 1 --2- 172.21.15.17:0/4085679061 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f726406e030 0x7f72640704f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f727806b7c0 tx=0x7f7274005350 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:44.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:44.983+0000 7f726b7fe640 1 -- 172.21.15.17:0/4085679061 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f726c056fd0 con 0x7f72780feaf0 2024-08-19T00:57:45.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.338+0000 7f728057d640 1 -- 172.21.15.17:0/4085679061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f72781086f0 con 0x7f72780feaf0 2024-08-19T00:57:45.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.338+0000 7f726b7fe640 1 -- 172.21.15.17:0/4085679061 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7f726c05a690 con 0x7f72780feaf0 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T00:57:45.341 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T00:57:45.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:57:45.342 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T00:57:45.342 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 12, 2024-08-19T00:57:45.342 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T00:57:45.342 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T00:57:45.342 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:57:45.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.341+0000 7f728057d640 1 -- 172.21.15.17:0/4085679061 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f726406e030 msgr2=0x7f72640704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:45.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.341+0000 7f728057d640 1 --2- 172.21.15.17:0/4085679061 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f726406e030 0x7f72640704f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f727806b7c0 tx=0x7f7274005350 comp rx=0 tx=0).stop 2024-08-19T00:57:45.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.341+0000 7f728057d640 1 -- 172.21.15.17:0/4085679061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72780feaf0 msgr2=0x7f727806a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:45.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.341+0000 7f728057d640 1 --2- 172.21.15.17:0/4085679061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72780feaf0 0x7f727806a2a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f726c00b3f0 tx=0x7f726c00b8b0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.341+0000 7f728057d640 1 -- 172.21.15.17:0/4085679061 shutdown_connections 2024-08-19T00:57:45.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.341+0000 7f728057d640 1 --2- 172.21.15.17:0/4085679061 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f726406e030 0x7f72640704f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.341+0000 7f728057d640 1 --2- 172.21.15.17:0/4085679061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f72780ffcf0 0x7f727806a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.341+0000 7f728057d640 1 --2- 172.21.15.17:0/4085679061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72780feaf0 0x7f727806a2a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.341+0000 7f728057d640 1 -- 172.21.15.17:0/4085679061 >> 172.21.15.17:0/4085679061 conn(0x7f72780fa280 msgr2=0x7f7278103370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:45.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.341+0000 7f728057d640 1 -- 172.21.15.17:0/4085679061 shutdown_connections 2024-08-19T00:57:45.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.341+0000 7f728057d640 1 -- 172.21.15.17:0/4085679061 wait complete. 2024-08-19T00:57:45.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.450+0000 7fde3a4b3640 1 -- 172.21.15.17:0/3592166812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde340feaa0 msgr2=0x7fde340feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:45.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.450+0000 7fde3a4b3640 1 --2- 172.21.15.17:0/3592166812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde340feaa0 0x7fde340feea0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fde24009880 tx=0x7fde2402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.450+0000 7fde3a4b3640 1 -- 172.21.15.17:0/3592166812 shutdown_connections 2024-08-19T00:57:45.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.450+0000 7fde3a4b3640 1 --2- 172.21.15.17:0/3592166812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde340ffca0 0x7fde34100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.450+0000 7fde3a4b3640 1 --2- 172.21.15.17:0/3592166812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde340feaa0 0x7fde340feea0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.450+0000 7fde3a4b3640 1 -- 172.21.15.17:0/3592166812 >> 172.21.15.17:0/3592166812 conn(0x7fde340fa230 msgr2=0x7fde340fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:45.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.450+0000 7fde3a4b3640 1 -- 172.21.15.17:0/3592166812 shutdown_connections 2024-08-19T00:57:45.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.450+0000 7fde3a4b3640 1 -- 172.21.15.17:0/3592166812 wait complete. 2024-08-19T00:57:45.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.451+0000 7fde3a4b3640 1 Processor -- start 2024-08-19T00:57:45.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.451+0000 7fde3a4b3640 1 -- start start 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde3a4b3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde340feaa0 0x7fde34068fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde3a4b3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde340ffca0 0x7fde3419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde3a4b3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3419a970 con 0x7fde340ffca0 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde3a4b3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3419aab0 con 0x7fde340feaa0 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde33fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde340feaa0 0x7fde34068fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde33fff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde340feaa0 0x7fde34068fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.17:53320/0 (socket says 172.21.15.17:53320) 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde340ffca0 0x7fde3419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde33fff640 1 -- 172.21.15.17:0/1821827868 learned_addr learned my addr 172.21.15.17:0/1821827868 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde33fff640 1 -- 172.21.15.17:0/1821827868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde340ffca0 msgr2=0x7fde3419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde33fff640 1 --2- 172.21.15.17:0/1821827868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde340ffca0 0x7fde3419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde33fff640 1 -- 172.21.15.17:0/1821827868 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde24009560 con 0x7fde340feaa0 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.452+0000 7fde33fff640 1 --2- 172.21.15.17:0/1821827868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde340feaa0 0x7fde34068fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde2402a9c0 tx=0x7fde240055a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:45.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.453+0000 7fde317fa640 1 -- 172.21.15.17:0/1821827868 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde24004aa0 con 0x7fde340feaa0 2024-08-19T00:57:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.453+0000 7fde3a4b3640 1 -- 172.21.15.17:0/1821827868 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3419ad00 con 0x7fde340feaa0 2024-08-19T00:57:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.453+0000 7fde317fa640 1 -- 172.21.15.17:0/1821827868 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde24005d50 con 0x7fde340feaa0 2024-08-19T00:57:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.453+0000 7fde317fa640 1 -- 172.21.15.17:0/1821827868 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde240039b0 con 0x7fde340feaa0 2024-08-19T00:57:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.453+0000 7fde3a4b3640 1 -- 172.21.15.17:0/1821827868 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3419b270 con 0x7fde340feaa0 2024-08-19T00:57:45.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.454+0000 7fde3a4b3640 1 -- 172.21.15.17:0/1821827868 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3418e640 con 0x7fde340feaa0 2024-08-19T00:57:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.455+0000 7fde317fa640 1 -- 172.21.15.17:0/1821827868 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 30) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fde24003c70 con 0x7fde340feaa0 2024-08-19T00:57:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.455+0000 7fde317fa640 1 --2- 172.21.15.17:0/1821827868 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fde1c06df20 0x7fde1c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:57:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.455+0000 7fde317fa640 1 -- 172.21.15.17:0/1821827868 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fde240aeec0 con 0x7fde340feaa0 2024-08-19T00:57:45.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.455+0000 7fde337fe640 1 --2- 172.21.15.17:0/1821827868 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fde1c06df20 0x7fde1c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:57:45.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.456+0000 7fde337fe640 1 --2- 172.21.15.17:0/1821827868 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fde1c06df20 0x7fde1c0703e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fde34069530 tx=0x7fde28005f90 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:57:45.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.460+0000 7fde317fa640 1 -- 172.21.15.17:0/1821827868 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fde24078560 con 0x7fde340feaa0 2024-08-19T00:57:45.643 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:45 smithi086 ceph-mon[24511]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:45.644 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:45 smithi086 ceph-mon[24511]: from='client.24509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:45.644 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:45 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:45.644 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:45 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:45.644 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:45 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:57:45.644 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:45 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017:9095"}]: dispatch 2024-08-19T00:57:45.644 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:45 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:45.644 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:45 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:57:45.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:45 smithi017 ceph-mon[16627]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:45.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:45 smithi017 ceph-mon[16627]: from='client.24509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:45.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:45 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:45.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:45 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:45.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:45 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:57:45.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:45 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017:9095"}]: dispatch 2024-08-19T00:57:45.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:45 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:45.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:45 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:57:45.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.699+0000 7fde3a4b3640 1 -- 172.21.15.17:0/1821827868 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde3402c4f0 con 0x7fde1c06df20 2024-08-19T00:57:45.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.700+0000 7fde317fa640 1 -- 172.21.15.17:0/1821827868 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fde3402c4f0 con 0x7fde1c06df20 2024-08-19T00:57:45.702 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:57:45.702 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T00:57:45.702 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T00:57:45.702 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-19T00:57:45.702 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T00:57:45.702 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T00:57:45.702 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T00:57:45.702 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "2/2 daemons upgraded", 2024-08-19T00:57:45.702 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mgr daemons", 2024-08-19T00:57:45.703 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T00:57:45.703 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:57:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.702+0000 7fde3a4b3640 1 -- 172.21.15.17:0/1821827868 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fde1c06df20 msgr2=0x7fde1c0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.702+0000 7fde3a4b3640 1 --2- 172.21.15.17:0/1821827868 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fde1c06df20 0x7fde1c0703e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fde34069530 tx=0x7fde28005f90 comp rx=0 tx=0).stop 2024-08-19T00:57:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.702+0000 7fde3a4b3640 1 -- 172.21.15.17:0/1821827868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde340feaa0 msgr2=0x7fde34068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:57:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.702+0000 7fde3a4b3640 1 --2- 172.21.15.17:0/1821827868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde340feaa0 0x7fde34068fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde2402a9c0 tx=0x7fde240055a0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.702+0000 7fde3a4b3640 1 -- 172.21.15.17:0/1821827868 shutdown_connections 2024-08-19T00:57:45.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.702+0000 7fde3a4b3640 1 --2- 172.21.15.17:0/1821827868 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fde1c06df20 0x7fde1c0703e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.702+0000 7fde3a4b3640 1 --2- 172.21.15.17:0/1821827868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde340ffca0 0x7fde3419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.702+0000 7fde3a4b3640 1 --2- 172.21.15.17:0/1821827868 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fde340feaa0 0x7fde34068fb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:57:45.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.702+0000 7fde3a4b3640 1 -- 172.21.15.17:0/1821827868 >> 172.21.15.17:0/1821827868 conn(0x7fde340fa230 msgr2=0x7fde34103350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:57:45.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.702+0000 7fde3a4b3640 1 -- 172.21.15.17:0/1821827868 shutdown_connections 2024-08-19T00:57:45.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:57:45.703+0000 7fde3a4b3640 1 -- 172.21.15.17:0/1821827868 wait complete. 2024-08-19T00:57:46.645 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:46 smithi086 ceph-mon[24511]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:57:46.645 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:46 smithi086 ceph-mon[24511]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017:9095"}]: dispatch 2024-08-19T00:57:46.645 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:46 smithi086 ceph-mon[24511]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:46.645 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:46 smithi086 ceph-mon[24511]: pgmap v27: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 347 op/s 2024-08-19T00:57:46.645 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:46 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/4085679061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:57:46.646 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-08-19T00:57:46.646 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-08-19T00:57:46.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:46 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:57:46.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:46 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi017:9095"}]: dispatch 2024-08-19T00:57:46.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:46 smithi017 ceph-mon[16627]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:46.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:46 smithi017 ceph-mon[16627]: pgmap v27: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 347 op/s 2024-08-19T00:57:46.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:46 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/4085679061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:57:47.011 DEBUG:teuthology.parallel:result is None 2024-08-19T00:57:47.318 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:47 smithi086 ceph-mon[24511]: from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:47.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:47 smithi017 ceph-mon[16627]: from='client.24519 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:57:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:48 smithi086 ceph-mon[24511]: pgmap v28: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 274 op/s 2024-08-19T00:57:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:48 smithi086 ceph-mon[24511]: Upgrade: Updating mgr.smithi086.uthxct 2024-08-19T00:57:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi086.uthxct", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:57:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:57:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:57:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:48 smithi086 ceph-mon[24511]: Deploying daemon mgr.smithi086.uthxct on smithi086 2024-08-19T00:57:48.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:48 smithi017 ceph-mon[16627]: pgmap v28: 65 pgs: 65 active+clean; 290 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 274 op/s 2024-08-19T00:57:48.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:48 smithi017 ceph-mon[16627]: Upgrade: Updating mgr.smithi086.uthxct 2024-08-19T00:57:48.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi086.uthxct", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T00:57:48.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T00:57:48.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:57:48.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:48 smithi017 ceph-mon[16627]: Deploying daemon mgr.smithi086.uthxct on smithi086 2024-08-19T00:57:50.630 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:50 smithi086 ceph-mon[24511]: pgmap v29: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 362 op/s 2024-08-19T00:57:50.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:50 smithi017 ceph-mon[16627]: pgmap v29: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 362 op/s 2024-08-19T00:57:52.621 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:52 smithi086 ceph-mon[24511]: pgmap v30: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 222 op/s 2024-08-19T00:57:52.621 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:52.621 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:52.621 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:57:52.621 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:52.621 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:52.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:52 smithi017 ceph-mon[16627]: pgmap v30: 65 pgs: 65 active+clean; 278 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 222 op/s 2024-08-19T00:57:52.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:52.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:52.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:57:52.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:52.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:54.825 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:54 smithi017 ceph-mon[16627]: pgmap v31: 65 pgs: 65 active+clean; 265 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 286 op/s 2024-08-19T00:57:54.825 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:54 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:54.825 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:54 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:54 smithi086 ceph-mon[24511]: pgmap v31: 65 pgs: 65 active+clean; 265 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 286 op/s 2024-08-19T00:57:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:54 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:54 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:56.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:56 smithi017 ceph-mon[16627]: pgmap v32: 65 pgs: 65 active+clean; 267 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 213 op/s 2024-08-19T00:57:56.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:56 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:56.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:56 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:56.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:56 smithi086 ceph-mon[24511]: pgmap v32: 65 pgs: 65 active+clean; 267 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 213 op/s 2024-08-19T00:57:56.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:56 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:56.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:56 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:56.821 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-08-19T00:57:56.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-19T00:57:57.190 DEBUG:teuthology.parallel:result is None 2024-08-19T00:57:57.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-19T00:57:57.229 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-19T00:57:57.229 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-08-19T00:57:57.266 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-08-19T00:57:57.267 DEBUG:teuthology.parallel:result is None 2024-08-19T00:57:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:57 smithi017 ceph-mon[16627]: Standby manager daemon smithi086.uthxct restarted 2024-08-19T00:57:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:57 smithi017 ceph-mon[16627]: Standby manager daemon smithi086.uthxct started 2024-08-19T00:57:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:57 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/381627489' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/crt"}]: dispatch 2024-08-19T00:57:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:57 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/381627489' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:57:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:57 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/381627489' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/key"}]: dispatch 2024-08-19T00:57:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:57 smithi017 ceph-mon[16627]: from='mgr.? 172.21.15.86:0/381627489' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:57:57.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:57 smithi086 ceph-mon[24511]: Standby manager daemon smithi086.uthxct restarted 2024-08-19T00:57:57.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:57 smithi086 ceph-mon[24511]: Standby manager daemon smithi086.uthxct started 2024-08-19T00:57:57.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:57 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/381627489' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/crt"}]: dispatch 2024-08-19T00:57:57.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:57 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/381627489' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T00:57:57.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:57 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/381627489' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/key"}]: dispatch 2024-08-19T00:57:57.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:57 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/381627489' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T00:57:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:58 smithi017 ceph-mon[16627]: pgmap v33: 65 pgs: 65 active+clean; 267 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 181 op/s 2024-08-19T00:57:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:58 smithi017 ceph-mon[16627]: mgrmap e31: smithi017.hfpawi(active, since 60s), standbys: smithi086.uthxct 2024-08-19T00:57:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:57:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:58.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:58 smithi086 ceph-mon[24511]: pgmap v33: 65 pgs: 65 active+clean; 267 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 181 op/s 2024-08-19T00:57:58.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:58 smithi086 ceph-mon[24511]: mgrmap e31: smithi017.hfpawi(active, since 60s), standbys: smithi086.uthxct 2024-08-19T00:57:58.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:57:58.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:58.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:59.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:57:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:57:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:57:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:57:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: Upgrade: Setting container_image for all mgr 2024-08-19T00:57:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi017.hfpawi"}]: dispatch 2024-08-19T00:57:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi017.hfpawi"}]': finished 2024-08-19T00:57:59.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi086.uthxct"}]: dispatch 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi086.uthxct"}]': finished 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: Upgrade: Setting container_image for all rgw 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: Upgrade: Setting container_image for all rbd-mirror 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: Upgrade: Setting container_image for all cephfs-mirror 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: Upgrade: Setting container_image for all iscsi 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:57:59.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: Upgrade: Setting container_image for all nfs 2024-08-19T00:57:59.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:59.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:57:59.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: Upgrade: Setting container_image for all nvmeof 2024-08-19T00:57:59.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:57:59.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:57:59 smithi017 ceph-mon[16627]: pgmap v34: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 263 op/s 2024-08-19T00:58:00.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:00.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: Upgrade: Setting container_image for all mgr 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi017.hfpawi"}]: dispatch 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi017.hfpawi"}]': finished 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi086.uthxct"}]: dispatch 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi086.uthxct"}]': finished 2024-08-19T00:58:00.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: Upgrade: Setting container_image for all rgw 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: Upgrade: Setting container_image for all rbd-mirror 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: Upgrade: Setting container_image for all cephfs-mirror 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: Upgrade: Setting container_image for all iscsi 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:00.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:00.199 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: Upgrade: Setting container_image for all nfs 2024-08-19T00:58:00.199 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:00.199 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:00.199 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: Upgrade: Setting container_image for all nvmeof 2024-08-19T00:58:00.199 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:00.199 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:57:59 smithi086 ceph-mon[24511]: pgmap v34: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 263 op/s 2024-08-19T00:58:01.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:00 smithi017 ceph-mon[16627]: Upgrade: Updating node-exporter.smithi017 (1/2) 2024-08-19T00:58:01.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:00 smithi017 ceph-mon[16627]: Deploying daemon node-exporter.smithi017 on smithi017 2024-08-19T00:58:01.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:00 smithi086 ceph-mon[24511]: Upgrade: Updating node-exporter.smithi017 (1/2) 2024-08-19T00:58:01.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:00 smithi086 ceph-mon[24511]: Deploying daemon node-exporter.smithi017 on smithi017 2024-08-19T00:58:01.997 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:01 smithi017 ceph-mon[16627]: pgmap v35: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 930 KiB/s rd, 955 KiB/s wr, 175 op/s 2024-08-19T00:58:02.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:01 smithi086 ceph-mon[24511]: pgmap v35: 65 pgs: 65 active+clean; 260 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 930 KiB/s rd, 955 KiB/s wr, 175 op/s 2024-08-19T00:58:04.135 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:03 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:04.136 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:03 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:04.136 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:03 smithi086 ceph-mon[24511]: pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 964 KiB/s rd, 988 KiB/s wr, 185 op/s 2024-08-19T00:58:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:03 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:03 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:03 smithi017 ceph-mon[16627]: pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 964 KiB/s rd, 988 KiB/s wr, 185 op/s 2024-08-19T00:58:05.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:04 smithi017 ceph-mon[16627]: Upgrade: Updating node-exporter.smithi086 (2/2) 2024-08-19T00:58:05.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:04 smithi017 ceph-mon[16627]: Deploying daemon node-exporter.smithi086 on smithi086 2024-08-19T00:58:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:04 smithi086 ceph-mon[24511]: Upgrade: Updating node-exporter.smithi086 (2/2) 2024-08-19T00:58:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:04 smithi086 ceph-mon[24511]: Deploying daemon node-exporter.smithi086 on smithi086 2024-08-19T00:58:06.154 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:05 smithi086 ceph-mon[24511]: pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 830 KiB/s rd, 764 KiB/s wr, 124 op/s 2024-08-19T00:58:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:05 smithi017 ceph-mon[16627]: pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 830 KiB/s rd, 764 KiB/s wr, 124 op/s 2024-08-19T00:58:07.865 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:07 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:07.865 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:07 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:07.865 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:07 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:07 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:07 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:07 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:08.769 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:08 smithi017 ceph-mon[16627]: pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 520 KiB/s rd, 458 KiB/s wr, 94 op/s 2024-08-19T00:58:08.769 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:08 smithi086 ceph-mon[24511]: pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 520 KiB/s rd, 458 KiB/s wr, 94 op/s 2024-08-19T00:58:10.523 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:10 smithi086 ceph-mon[24511]: pgmap v39: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 521 KiB/s rd, 458 KiB/s wr, 96 op/s 2024-08-19T00:58:10.523 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:10 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:10.523 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:10 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:10.523 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:10 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:10.523 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:10 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:10.530 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:10 smithi017 ceph-mon[16627]: pgmap v39: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 521 KiB/s rd, 458 KiB/s wr, 96 op/s 2024-08-19T00:58:10.530 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:10 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:10.530 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:10 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:10.530 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:10 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:10.530 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:10 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:12.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:12 smithi086 ceph-mon[24511]: pgmap v40: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-08-19T00:58:12.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:12 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:12.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:12 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:12.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:12 smithi017 ceph-mon[16627]: pgmap v40: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 33 KiB/s wr, 13 op/s 2024-08-19T00:58:12.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:12 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:12.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:12 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:13.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:13 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:13.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:13 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:13.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:13 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:58:13.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:13 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:13.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:13 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:13 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:13 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:13 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:58:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:13 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:13 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:14.676 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:14 smithi086 ceph-mon[24511]: pgmap v41: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-08-19T00:58:14.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:14 smithi017 ceph-mon[16627]: pgmap v41: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-08-19T00:58:15.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.803+0000 7f107f32b640 1 -- 172.21.15.17:0/1272442052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10780744e0 msgr2=0x7f1078072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:15.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.803+0000 7f107f32b640 1 --2- 172.21.15.17:0/1272442052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10780744e0 0x7f1078072940 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1074009880 tx=0x7f107402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:58:15.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.803+0000 7f107f32b640 1 -- 172.21.15.17:0/1272442052 shutdown_connections 2024-08-19T00:58:15.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.803+0000 7f107f32b640 1 --2- 172.21.15.17:0/1272442052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1078072f10 0x7f1078073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:15.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.803+0000 7f107f32b640 1 --2- 172.21.15.17:0/1272442052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10780744e0 0x7f1078072940 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:15.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.803+0000 7f107f32b640 1 -- 172.21.15.17:0/1272442052 >> 172.21.15.17:0/1272442052 conn(0x7f10780fb320 msgr2=0x7f10780fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.804+0000 7f107f32b640 1 -- 172.21.15.17:0/1272442052 shutdown_connections 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.804+0000 7f107f32b640 1 -- 172.21.15.17:0/1272442052 wait complete. 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.804+0000 7f107f32b640 1 Processor -- start 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.804+0000 7f107f32b640 1 -- start start 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.804+0000 7f107f32b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1078072f10 0x7f107819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.804+0000 7f107f32b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10780744e0 0x7f107819c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.804+0000 7f107f32b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107819c750 con 0x7f10780744e0 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.804+0000 7f107f32b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107819c8c0 con 0x7f1078072f10 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f107c8c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10780744e0 0x7f107819c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f107c8c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10780744e0 0x7f107819c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38290/0 (socket says 172.21.15.17:38290) 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f107c8c6640 1 -- 172.21.15.17:0/4123950087 learned_addr learned my addr 172.21.15.17:0/4123950087 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f107d0c7640 1 --2- 172.21.15.17:0/4123950087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1078072f10 0x7f107819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f107c8c6640 1 -- 172.21.15.17:0/4123950087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1078072f10 msgr2=0x7f107819bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f107c8c6640 1 --2- 172.21.15.17:0/4123950087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1078072f10 0x7f107819bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f107c8c6640 1 -- 172.21.15.17:0/4123950087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1074009560 con 0x7f10780744e0 2024-08-19T00:58:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f107c8c6640 1 --2- 172.21.15.17:0/4123950087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10780744e0 0x7f107819c180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f106800d8d0 tx=0x7f106800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:15.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f106e7fc640 1 -- 172.21.15.17:0/4123950087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1068009c00 con 0x7f10780744e0 2024-08-19T00:58:15.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f106e7fc640 1 -- 172.21.15.17:0/4123950087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1068009d60 con 0x7f10780744e0 2024-08-19T00:58:15.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f106e7fc640 1 -- 172.21.15.17:0/4123950087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10680049d0 con 0x7f10780744e0 2024-08-19T00:58:15.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.805+0000 7f107f32b640 1 -- 172.21.15.17:0/4123950087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10781a1350 con 0x7f10780744e0 2024-08-19T00:58:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.806+0000 7f107f32b640 1 -- 172.21.15.17:0/4123950087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10781a1850 con 0x7f10780744e0 2024-08-19T00:58:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.807+0000 7f107f32b640 1 -- 172.21.15.17:0/4123950087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107810ed70 con 0x7f10780744e0 2024-08-19T00:58:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.807+0000 7f106e7fc640 1 -- 172.21.15.17:0/4123950087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f1068004c40 con 0x7f10780744e0 2024-08-19T00:58:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.808+0000 7f106e7fc640 1 --2- 172.21.15.17:0/4123950087 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406df30 0x7f10640703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.808+0000 7f106e7fc640 1 -- 172.21.15.17:0/4123950087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f106808db40 con 0x7f10780744e0 2024-08-19T00:58:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.808+0000 7f107d0c7640 1 --2- 172.21.15.17:0/4123950087 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406df30 0x7f10640703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.808+0000 7f107d0c7640 1 --2- 172.21.15.17:0/4123950087 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406df30 0x7f10640703f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f107819d120 tx=0x7f10740314e0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:15.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:15.812+0000 7f106e7fc640 1 -- 172.21.15.17:0/4123950087 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f1068057130 con 0x7f10780744e0 2024-08-19T00:58:16.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.010+0000 7f107f32b640 1 -- 172.21.15.17:0/4123950087 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1078102b20 con 0x7f106406df30 2024-08-19T00:58:16.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.012+0000 7f106e7fc640 1 -- 172.21.15.17:0/4123950087 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f1078102b20 con 0x7f106406df30 2024-08-19T00:58:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.014+0000 7f107f32b640 1 -- 172.21.15.17:0/4123950087 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406df30 msgr2=0x7f10640703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.014+0000 7f107f32b640 1 --2- 172.21.15.17:0/4123950087 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406df30 0x7f10640703f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f107819d120 tx=0x7f10740314e0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.014+0000 7f107f32b640 1 -- 172.21.15.17:0/4123950087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10780744e0 msgr2=0x7f107819c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.014+0000 7f107f32b640 1 --2- 172.21.15.17:0/4123950087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10780744e0 0x7f107819c180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f106800d8d0 tx=0x7f106800dd90 comp rx=0 tx=0).stop 2024-08-19T00:58:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.014+0000 7f107f32b640 1 -- 172.21.15.17:0/4123950087 shutdown_connections 2024-08-19T00:58:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.014+0000 7f107f32b640 1 --2- 172.21.15.17:0/4123950087 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406df30 0x7f10640703f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.014+0000 7f107f32b640 1 --2- 172.21.15.17:0/4123950087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10780744e0 0x7f107819c180 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.014+0000 7f107f32b640 1 --2- 172.21.15.17:0/4123950087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1078072f10 0x7f107819bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.014+0000 7f107f32b640 1 -- 172.21.15.17:0/4123950087 >> 172.21.15.17:0/4123950087 conn(0x7f10780fb320 msgr2=0x7f1078101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:16.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.014+0000 7f107f32b640 1 -- 172.21.15.17:0/4123950087 shutdown_connections 2024-08-19T00:58:16.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.014+0000 7f107f32b640 1 -- 172.21.15.17:0/4123950087 wait complete. 2024-08-19T00:58:16.024 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:58:16.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.097+0000 7ff88f955640 1 -- 172.21.15.17:0/1613741369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8880ffb80 msgr2=0x7ff8880fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.097+0000 7ff88f955640 1 --2- 172.21.15.17:0/1613741369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8880ffb80 0x7ff8880fff80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff884009c20 tx=0x7ff88402a970 comp rx=0 tx=0).stop 2024-08-19T00:58:16.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.097+0000 7ff88f955640 1 -- 172.21.15.17:0/1613741369 shutdown_connections 2024-08-19T00:58:16.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.097+0000 7ff88f955640 1 --2- 172.21.15.17:0/1613741369 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff888100d80 0x7ff888101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.097+0000 7ff88f955640 1 --2- 172.21.15.17:0/1613741369 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8880ffb80 0x7ff8880fff80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.097+0000 7ff88f955640 1 -- 172.21.15.17:0/1613741369 >> 172.21.15.17:0/1613741369 conn(0x7ff8880fb310 msgr2=0x7ff8880fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:16.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.098+0000 7ff88f955640 1 -- 172.21.15.17:0/1613741369 shutdown_connections 2024-08-19T00:58:16.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.098+0000 7ff88f955640 1 -- 172.21.15.17:0/1613741369 wait complete. 2024-08-19T00:58:16.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.098+0000 7ff88f955640 1 Processor -- start 2024-08-19T00:58:16.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.098+0000 7ff88f955640 1 -- start start 2024-08-19T00:58:16.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.098+0000 7ff88f955640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8880ffb80 0x7ff8881955f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:16.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.098+0000 7ff88f955640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff888100d80 0x7ff888195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:16.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88f955640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888196100 con 0x7ff8880ffb80 2024-08-19T00:58:16.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88f955640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888196270 con 0x7ff888100d80 2024-08-19T00:58:16.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88d6f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8880ffb80 0x7ff8881955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:16.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88d6f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8880ffb80 0x7ff8881955f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38318/0 (socket says 172.21.15.17:38318) 2024-08-19T00:58:16.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88d6f1640 1 -- 172.21.15.17:0/1709145812 learned_addr learned my addr 172.21.15.17:0/1709145812 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:58:16.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88cef0640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff888100d80 0x7ff888195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:16.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88d6f1640 1 -- 172.21.15.17:0/1709145812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff888100d80 msgr2=0x7ff888195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88d6f1640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff888100d80 0x7ff888195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88d6f1640 1 -- 172.21.15.17:0/1709145812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884009900 con 0x7ff8880ffb80 2024-08-19T00:58:16.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88cef0640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff888100d80 0x7ff888195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:58:16.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88d6f1640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8880ffb80 0x7ff8881955f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff88402f620 tx=0x7ff88402f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:16.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff87e7fc640 1 -- 172.21.15.17:0/1709145812 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff884030840 con 0x7ff8880ffb80 2024-08-19T00:58:16.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff87e7fc640 1 -- 172.21.15.17:0/1709145812 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff884004040 con 0x7ff8880ffb80 2024-08-19T00:58:16.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.099+0000 7ff88f955640 1 -- 172.21.15.17:0/1709145812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88819acb0 con 0x7ff8880ffb80 2024-08-19T00:58:16.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.100+0000 7ff87e7fc640 1 -- 172.21.15.17:0/1709145812 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff88403a640 con 0x7ff8880ffb80 2024-08-19T00:58:16.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.100+0000 7ff88f955640 1 -- 172.21.15.17:0/1709145812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88819b1a0 con 0x7ff8880ffb80 2024-08-19T00:58:16.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.101+0000 7ff88f955640 1 -- 172.21.15.17:0/1709145812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff888108790 con 0x7ff8880ffb80 2024-08-19T00:58:16.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.101+0000 7ff87e7fc640 1 -- 172.21.15.17:0/1709145812 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7ff88400a040 con 0x7ff8880ffb80 2024-08-19T00:58:16.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.101+0000 7ff87e7fc640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff87406df30 0x7ff8740703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:16.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.102+0000 7ff87e7fc640 1 -- 172.21.15.17:0/1709145812 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff88402c040 con 0x7ff8880ffb80 2024-08-19T00:58:16.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.102+0000 7ff88cef0640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff87406df30 0x7ff8740703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:16.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.102+0000 7ff88cef0640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff87406df30 0x7ff8740703f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff888196b10 tx=0x7ff87800b390 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:16.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.106+0000 7ff87e7fc640 1 -- 172.21.15.17:0/1709145812 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7ff884078bc0 con 0x7ff8880ffb80 2024-08-19T00:58:16.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.298+0000 7ff88f955640 1 -- 172.21.15.17:0/1709145812 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff88819b3c0 con 0x7ff87406df30 2024-08-19T00:58:16.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.299+0000 7ff87e7fc640 1 -- 172.21.15.17:0/1709145812 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7ff88819b3c0 con 0x7ff87406df30 2024-08-19T00:58:16.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.301+0000 7ff88f955640 1 -- 172.21.15.17:0/1709145812 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff87406df30 msgr2=0x7ff8740703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.301+0000 7ff88f955640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff87406df30 0x7ff8740703f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff888196b10 tx=0x7ff87800b390 comp rx=0 tx=0).stop 2024-08-19T00:58:16.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.301+0000 7ff88f955640 1 -- 172.21.15.17:0/1709145812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8880ffb80 msgr2=0x7ff8881955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.301+0000 7ff88f955640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8880ffb80 0x7ff8881955f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff88402f620 tx=0x7ff88402f650 comp rx=0 tx=0).stop 2024-08-19T00:58:16.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.301+0000 7ff88f955640 1 -- 172.21.15.17:0/1709145812 shutdown_connections 2024-08-19T00:58:16.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.301+0000 7ff88f955640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff87406df30 0x7ff8740703f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.301+0000 7ff88f955640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff888100d80 0x7ff888195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.301+0000 7ff88f955640 1 --2- 172.21.15.17:0/1709145812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8880ffb80 0x7ff8881955f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.301+0000 7ff88f955640 1 -- 172.21.15.17:0/1709145812 >> 172.21.15.17:0/1709145812 conn(0x7ff8880fb310 msgr2=0x7ff888103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:16.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.302+0000 7ff88f955640 1 -- 172.21.15.17:0/1709145812 shutdown_connections 2024-08-19T00:58:16.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.302+0000 7ff88f955640 1 -- 172.21.15.17:0/1709145812 wait complete. 2024-08-19T00:58:16.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.384+0000 7f32cc71a640 1 -- 172.21.15.17:0/215818756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c4100680 msgr2=0x7f32c4102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.384+0000 7f32cc71a640 1 --2- 172.21.15.17:0/215818756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c4100680 0x7f32c4102a70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009c50 tx=0x7f32c002a9a0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.384+0000 7f32cc71a640 1 -- 172.21.15.17:0/215818756 shutdown_connections 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.384+0000 7f32cc71a640 1 --2- 172.21.15.17:0/215818756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c4102fb0 0x7f32c41053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.384+0000 7f32cc71a640 1 --2- 172.21.15.17:0/215818756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c4100680 0x7f32c4102a70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32cc71a640 1 -- 172.21.15.17:0/215818756 >> 172.21.15.17:0/215818756 conn(0x7f32c40fa280 msgr2=0x7f32c40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32cc71a640 1 -- 172.21.15.17:0/215818756 shutdown_connections 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32cc71a640 1 -- 172.21.15.17:0/215818756 wait complete. 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32cc71a640 1 Processor -- start 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32cc71a640 1 -- start start 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32cc71a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c4100680 0x7f32c4195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32cc71a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c4102fb0 0x7f32c4195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32cc71a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4196220 con 0x7f32c4102fb0 2024-08-19T00:58:16.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32cc71a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c4196390 con 0x7f32c4100680 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32c9cb5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c4102fb0 0x7f32c4195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32c9cb5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c4102fb0 0x7f32c4195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38332/0 (socket says 172.21.15.17:38332) 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.385+0000 7f32c9cb5640 1 -- 172.21.15.17:0/181756042 learned_addr learned my addr 172.21.15.17:0/181756042 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.386+0000 7f32ca4b6640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c4100680 0x7f32c4195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.386+0000 7f32c9cb5640 1 -- 172.21.15.17:0/181756042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c4100680 msgr2=0x7f32c4195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.386+0000 7f32c9cb5640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c4100680 0x7f32c4195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.386+0000 7f32c9cb5640 1 -- 172.21.15.17:0/181756042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0009900 con 0x7f32c4102fb0 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.386+0000 7f32ca4b6640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c4100680 0x7f32c4195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.386+0000 7f32c9cb5640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c4102fb0 0x7f32c4195c50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f32b400d6f0 tx=0x7f32b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.386+0000 7f32bb7fe640 1 -- 172.21.15.17:0/181756042 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b40051f0 con 0x7f32c4102fb0 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.386+0000 7f32bb7fe640 1 -- 172.21.15.17:0/181756042 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32b4009ce0 con 0x7f32c4102fb0 2024-08-19T00:58:16.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.386+0000 7f32cc71a640 1 -- 172.21.15.17:0/181756042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c419ae30 con 0x7f32c4102fb0 2024-08-19T00:58:16.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.386+0000 7f32bb7fe640 1 -- 172.21.15.17:0/181756042 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b4004e80 con 0x7f32c4102fb0 2024-08-19T00:58:16.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.386+0000 7f32cc71a640 1 -- 172.21.15.17:0/181756042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c419b350 con 0x7f32c4102fb0 2024-08-19T00:58:16.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.387+0000 7f32cc71a640 1 -- 172.21.15.17:0/181756042 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c4100a60 con 0x7f32c4102fb0 2024-08-19T00:58:16.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.388+0000 7f32bb7fe640 1 -- 172.21.15.17:0/181756042 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7f32b40046c0 con 0x7f32c4102fb0 2024-08-19T00:58:16.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.388+0000 7f32bb7fe640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f32b006df30 0x7f32b00703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:16.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.388+0000 7f32bb7fe640 1 -- 172.21.15.17:0/181756042 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f32b408d7f0 con 0x7f32c4102fb0 2024-08-19T00:58:16.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.388+0000 7f32ca4b6640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f32b006df30 0x7f32b00703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:16.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.389+0000 7f32ca4b6640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f32b006df30 0x7f32b00703f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f32c0006010 tx=0x7f32c0009890 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:16.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.392+0000 7f32bb7fe640 1 -- 172.21.15.17:0/181756042 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f32b4056e60 con 0x7f32c4102fb0 2024-08-19T00:58:16.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.579+0000 7f32cc71a640 1 -- 172.21.15.17:0/181756042 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f32c41039d0 con 0x7f32b006df30 2024-08-19T00:58:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.588+0000 7f32bb7fe640 1 -- 172.21.15.17:0/181756042 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f32c41039d0 con 0x7f32b006df30 2024-08-19T00:58:16.590 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (8m) 4s ago 10m 24.2M - 0.25.0 c8568f914cd2 eb29e4d36dfe 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (10m) 4s ago 10m 8190k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (9m) 7s ago 9m 7948k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (10m) 4s ago 10m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (9m) 7s ago 9m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (8m) 4s ago 9m 85.5M - 9.4.7 954c08fa6188 293dd58dd677 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (4m) 4s ago 4m 158M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (4m) 4s ago 4m 98.7M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (4m) 7s ago 4m 26.0M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (4m) 7s ago 4m 25.7M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (90s) 4s ago 11m 496M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T00:58:16.591 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (25s) 7s ago 9m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T00:58:16.592 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (11m) 4s ago 11m 57.1M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 771bc6b905a5 2024-08-19T00:58:16.592 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (9m) 7s ago 9m 48.0M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 c6fce0ad535d 2024-08-19T00:58:16.592 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (14s) 4s ago 10m 7402k - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T00:58:16.592 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (10s) 7s ago 9m 3556k - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T00:58:16.592 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (8m) 4s ago 8m 217M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T00:58:16.592 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (7m) 4s ago 7m 228M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T00:58:16.592 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (7m) 4s ago 7m 189M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T00:58:16.592 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (7m) 7s ago 7m 244M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T00:58:16.592 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (6m) 7s ago 6m 217M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T00:58:16.592 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (6m) 7s ago 6m 217M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T00:58:16.592 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (32s) 4s ago 9m 43.4M - 2.43.0 a07b618ecd1d b71589ba8d52 2024-08-19T00:58:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.590+0000 7f32cc71a640 1 -- 172.21.15.17:0/181756042 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f32b006df30 msgr2=0x7f32b00703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.590+0000 7f32cc71a640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f32b006df30 0x7f32b00703f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f32c0006010 tx=0x7f32c0009890 comp rx=0 tx=0).stop 2024-08-19T00:58:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.590+0000 7f32cc71a640 1 -- 172.21.15.17:0/181756042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c4102fb0 msgr2=0x7f32c4195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.590+0000 7f32cc71a640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c4102fb0 0x7f32c4195c50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f32b400d6f0 tx=0x7f32b400dbb0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.590+0000 7f32cc71a640 1 -- 172.21.15.17:0/181756042 shutdown_connections 2024-08-19T00:58:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.590+0000 7f32cc71a640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f32b006df30 0x7f32b00703f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.590+0000 7f32cc71a640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c4102fb0 0x7f32c4195c50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.590+0000 7f32cc71a640 1 --2- 172.21.15.17:0/181756042 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c4100680 0x7f32c4195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.590+0000 7f32cc71a640 1 -- 172.21.15.17:0/181756042 >> 172.21.15.17:0/181756042 conn(0x7f32c40fa280 msgr2=0x7f32c40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.590+0000 7f32cc71a640 1 -- 172.21.15.17:0/181756042 shutdown_connections 2024-08-19T00:58:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.590+0000 7f32cc71a640 1 -- 172.21.15.17:0/181756042 wait complete. 2024-08-19T00:58:16.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.678+0000 7ff0dd65d640 1 -- 172.21.15.17:0/971333079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d80ffbd0 msgr2=0x7ff0d80fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.678+0000 7ff0dd65d640 1 --2- 172.21.15.17:0/971333079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d80ffbd0 0x7ff0d80fffd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009880 tx=0x7ff0c802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.678+0000 7ff0dd65d640 1 -- 172.21.15.17:0/971333079 shutdown_connections 2024-08-19T00:58:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.678+0000 7ff0dd65d640 1 --2- 172.21.15.17:0/971333079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d8100dd0 0x7ff0d8101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.678+0000 7ff0dd65d640 1 --2- 172.21.15.17:0/971333079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d80ffbd0 0x7ff0d80fffd0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.678+0000 7ff0dd65d640 1 -- 172.21.15.17:0/971333079 >> 172.21.15.17:0/971333079 conn(0x7ff0d80fb360 msgr2=0x7ff0d80fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.678+0000 7ff0dd65d640 1 -- 172.21.15.17:0/971333079 shutdown_connections 2024-08-19T00:58:16.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.678+0000 7ff0dd65d640 1 -- 172.21.15.17:0/971333079 wait complete. 2024-08-19T00:58:16.681 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:16 smithi017 ceph-mon[16627]: pgmap v42: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-19T00:58:16.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.679+0000 7ff0dd65d640 1 Processor -- start 2024-08-19T00:58:16.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.679+0000 7ff0dd65d640 1 -- start start 2024-08-19T00:58:16.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.679+0000 7ff0dd65d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d80ffbd0 0x7ff0d8195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:16.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0dd65d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8100dd0 0x7ff0d8195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:16.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0dd65d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8196230 con 0x7ff0d8100dd0 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0dd65d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81963a0 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0d67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8100dd0 0x7ff0d8195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0d6ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d80ffbd0 0x7ff0d8195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0d6ffd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d80ffbd0 0x7ff0d8195720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.17:36662/0 (socket says 172.21.15.17:36662) 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0d67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8100dd0 0x7ff0d8195c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38356/0 (socket says 172.21.15.17:38356) 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0d6ffd640 1 -- 172.21.15.17:0/1155376596 learned_addr learned my addr 172.21.15.17:0/1155376596 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0d6ffd640 1 -- 172.21.15.17:0/1155376596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8100dd0 msgr2=0x7ff0d8195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0d6ffd640 1 --2- 172.21.15.17:0/1155376596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8100dd0 0x7ff0d8195c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0d6ffd640 1 -- 172.21.15.17:0/1155376596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c8009560 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.680+0000 7ff0d67fc640 1 --2- 172.21.15.17:0/1155376596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8100dd0 0x7ff0d8195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.681+0000 7ff0d6ffd640 1 --2- 172.21.15.17:0/1155376596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d80ffbd0 0x7ff0d8195720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0c802a9c0 tx=0x7ff0c8005610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.681+0000 7ff0bffff640 1 -- 172.21.15.17:0/1155376596 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0c8004b20 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.681+0000 7ff0bffff640 1 -- 172.21.15.17:0/1155376596 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0c8004c80 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.681+0000 7ff0dd65d640 1 -- 172.21.15.17:0/1155376596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d819ade0 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.681+0000 7ff0dd65d640 1 -- 172.21.15.17:0/1155376596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d819b2f0 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.681+0000 7ff0bffff640 1 -- 172.21.15.17:0/1155376596 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0c8003ae0 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.682+0000 7ff0dd65d640 1 -- 172.21.15.17:0/1155376596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d8108840 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.683+0000 7ff0bffff640 1 -- 172.21.15.17:0/1155376596 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7ff0c8003c40 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.683+0000 7ff0bffff640 1 --2- 172.21.15.17:0/1155376596 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff0c006df20 0x7ff0c00703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.683+0000 7ff0bffff640 1 -- 172.21.15.17:0/1155376596 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff0c80aefe0 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.684+0000 7ff0d67fc640 1 --2- 172.21.15.17:0/1155376596 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff0c006df20 0x7ff0c00703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:16.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.684+0000 7ff0d67fc640 1 --2- 172.21.15.17:0/1155376596 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff0c006df20 0x7ff0c00703e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8196c40 tx=0x7ff0cc009110 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:16.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.688+0000 7ff0bffff640 1 -- 172.21.15.17:0/1155376596 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7ff0c8078570 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:16 smithi086 ceph-mon[24511]: pgmap v42: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-08-19T00:58:16.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.934+0000 7ff0dd65d640 1 -- 172.21.15.17:0/1155376596 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff0d819b560 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.935+0000 7ff0bffff640 1 -- 172.21.15.17:0/1155376596 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7ff0c807bc30 con 0x7ff0d80ffbd0 2024-08-19T00:58:16.937 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:58:16.937 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T00:58:16.937 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2 2024-08-19T00:58:16.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 12, 2024-08-19T00:58:16.938 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T00:58:16.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T00:58:16.939 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:58:16.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.937+0000 7ff0dd65d640 1 -- 172.21.15.17:0/1155376596 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff0c006df20 msgr2=0x7ff0c00703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.937+0000 7ff0dd65d640 1 --2- 172.21.15.17:0/1155376596 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff0c006df20 0x7ff0c00703e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8196c40 tx=0x7ff0cc009110 comp rx=0 tx=0).stop 2024-08-19T00:58:16.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.937+0000 7ff0dd65d640 1 -- 172.21.15.17:0/1155376596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d80ffbd0 msgr2=0x7ff0d8195720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:16.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.937+0000 7ff0dd65d640 1 --2- 172.21.15.17:0/1155376596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d80ffbd0 0x7ff0d8195720 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff0c802a9c0 tx=0x7ff0c8005610 comp rx=0 tx=0).stop 2024-08-19T00:58:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.937+0000 7ff0dd65d640 1 -- 172.21.15.17:0/1155376596 shutdown_connections 2024-08-19T00:58:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.937+0000 7ff0dd65d640 1 --2- 172.21.15.17:0/1155376596 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff0c006df20 0x7ff0c00703e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.937+0000 7ff0dd65d640 1 --2- 172.21.15.17:0/1155376596 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0d8100dd0 0x7ff0d8195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.937+0000 7ff0dd65d640 1 --2- 172.21.15.17:0/1155376596 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0d80ffbd0 0x7ff0d8195720 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.937+0000 7ff0dd65d640 1 -- 172.21.15.17:0/1155376596 >> 172.21.15.17:0/1155376596 conn(0x7ff0d80fb360 msgr2=0x7ff0d8104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.937+0000 7ff0dd65d640 1 -- 172.21.15.17:0/1155376596 shutdown_connections 2024-08-19T00:58:16.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:16.937+0000 7ff0dd65d640 1 -- 172.21.15.17:0/1155376596 wait complete. 2024-08-19T00:58:17.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.023+0000 7fdef7c18640 1 -- 172.21.15.17:0/3400431425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef0100680 msgr2=0x7fdef0102a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:17.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.023+0000 7fdef7c18640 1 --2- 172.21.15.17:0/3400431425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef0100680 0x7fdef0102a70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0098b0 tx=0x7fdeec02a4d0 comp rx=0 tx=0).stop 2024-08-19T00:58:17.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.023+0000 7fdef7c18640 1 -- 172.21.15.17:0/3400431425 shutdown_connections 2024-08-19T00:58:17.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.023+0000 7fdef7c18640 1 --2- 172.21.15.17:0/3400431425 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef0102fb0 0x7fdef01053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:17.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.023+0000 7fdef7c18640 1 --2- 172.21.15.17:0/3400431425 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef0100680 0x7fdef0102a70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:17.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.023+0000 7fdef7c18640 1 -- 172.21.15.17:0/3400431425 >> 172.21.15.17:0/3400431425 conn(0x7fdef00fa280 msgr2=0x7fdef00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:17.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.023+0000 7fdef7c18640 1 -- 172.21.15.17:0/3400431425 shutdown_connections 2024-08-19T00:58:17.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.023+0000 7fdef7c18640 1 -- 172.21.15.17:0/3400431425 wait complete. 2024-08-19T00:58:17.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.023+0000 7fdef7c18640 1 Processor -- start 2024-08-19T00:58:17.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.023+0000 7fdef7c18640 1 -- start start 2024-08-19T00:58:17.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef7c18640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef0100680 0x7fdef0195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:17.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef7c18640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef0102fb0 0x7fdef0195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:17.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef7c18640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef0196220 con 0x7fdef0102fb0 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef7c18640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdef0196390 con 0x7fdef0100680 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef51b3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef0102fb0 0x7fdef0195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef51b3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef0102fb0 0x7fdef0195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59110/0 (socket says 172.21.15.17:59110) 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef51b3640 1 -- 172.21.15.17:0/958499885 learned_addr learned my addr 172.21.15.17:0/958499885 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef59b4640 1 --2- 172.21.15.17:0/958499885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef0100680 0x7fdef0195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef51b3640 1 -- 172.21.15.17:0/958499885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef0100680 msgr2=0x7fdef0195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef51b3640 1 --2- 172.21.15.17:0/958499885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef0100680 0x7fdef0195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef51b3640 1 -- 172.21.15.17:0/958499885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec009560 con 0x7fdef0102fb0 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef51b3640 1 --2- 172.21.15.17:0/958499885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef0102fb0 0x7fdef0195c50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdee000d6f0 tx=0x7fdee000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdee6ffd640 1 -- 172.21.15.17:0/958499885 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdee00051f0 con 0x7fdef0102fb0 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdee6ffd640 1 -- 172.21.15.17:0/958499885 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdee0009ce0 con 0x7fdef0102fb0 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef7c18640 1 -- 172.21.15.17:0/958499885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdef019ae30 con 0x7fdef0102fb0 2024-08-19T00:58:17.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdee6ffd640 1 -- 172.21.15.17:0/958499885 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdee0004e80 con 0x7fdef0102fb0 2024-08-19T00:58:17.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.024+0000 7fdef7c18640 1 -- 172.21.15.17:0/958499885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdef019b350 con 0x7fdef0102fb0 2024-08-19T00:58:17.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.025+0000 7fdef7c18640 1 -- 172.21.15.17:0/958499885 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdef0108830 con 0x7fdef0102fb0 2024-08-19T00:58:17.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.026+0000 7fdee6ffd640 1 -- 172.21.15.17:0/958499885 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 31) v1 ==== 92166+0+0 (secure 0 0 0) 0x7fdee00046c0 con 0x7fdef0102fb0 2024-08-19T00:58:17.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.027+0000 7fdee6ffd640 1 --2- 172.21.15.17:0/958499885 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fdedc06df30 0x7fdedc0703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:17.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.027+0000 7fdee6ffd640 1 -- 172.21.15.17:0/958499885 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fdee008d870 con 0x7fdef0102fb0 2024-08-19T00:58:17.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.027+0000 7fdef59b4640 1 --2- 172.21.15.17:0/958499885 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fdedc06df30 0x7fdedc0703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:17.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.027+0000 7fdef59b4640 1 --2- 172.21.15.17:0/958499885 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fdedc06df30 0x7fdedc0703f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdeec031540 tx=0x7fdeec000bc0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:17.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.031+0000 7fdee6ffd640 1 -- 172.21.15.17:0/958499885 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fdee0056ee0 con 0x7fdef0102fb0 2024-08-19T00:58:17.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.228+0000 7fdef7c18640 1 -- 172.21.15.17:0/958499885 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdef01039d0 con 0x7fdedc06df30 2024-08-19T00:58:17.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.229+0000 7fdee6ffd640 1 -- 172.21.15.17:0/958499885 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fdef01039d0 con 0x7fdedc06df30 2024-08-19T00:58:17.231 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:58:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T00:58:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T00:58:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-19T00:58:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T00:58:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T00:58:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T00:58:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "2/2 daemons upgraded", 2024-08-19T00:58:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading node-exporter daemons", 2024-08-19T00:58:17.232 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T00:58:17.232 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:58:17.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.233+0000 7fdef7c18640 1 -- 172.21.15.17:0/958499885 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fdedc06df30 msgr2=0x7fdedc0703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:17.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.233+0000 7fdef7c18640 1 --2- 172.21.15.17:0/958499885 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fdedc06df30 0x7fdedc0703f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdeec031540 tx=0x7fdeec000bc0 comp rx=0 tx=0).stop 2024-08-19T00:58:17.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.233+0000 7fdef7c18640 1 -- 172.21.15.17:0/958499885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef0102fb0 msgr2=0x7fdef0195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:17.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.233+0000 7fdef7c18640 1 --2- 172.21.15.17:0/958499885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef0102fb0 0x7fdef0195c50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdee000d6f0 tx=0x7fdee000dbb0 comp rx=0 tx=0).stop 2024-08-19T00:58:17.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.233+0000 7fdef7c18640 1 -- 172.21.15.17:0/958499885 shutdown_connections 2024-08-19T00:58:17.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.233+0000 7fdef7c18640 1 --2- 172.21.15.17:0/958499885 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fdedc06df30 0x7fdedc0703f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:17.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.233+0000 7fdef7c18640 1 --2- 172.21.15.17:0/958499885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdef0102fb0 0x7fdef0195c50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:17.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.233+0000 7fdef7c18640 1 --2- 172.21.15.17:0/958499885 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdef0100680 0x7fdef0195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:17.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.233+0000 7fdef7c18640 1 -- 172.21.15.17:0/958499885 >> 172.21.15.17:0/958499885 conn(0x7fdef00fa280 msgr2=0x7fdef00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:17.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.233+0000 7fdef7c18640 1 -- 172.21.15.17:0/958499885 shutdown_connections 2024-08-19T00:58:17.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:17.233+0000 7fdef7c18640 1 -- 172.21.15.17:0/958499885 wait complete. 2024-08-19T00:58:17.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:17 smithi017 ceph-mon[16627]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:17.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:17 smithi017 ceph-mon[16627]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:17.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:17 smithi017 ceph-mon[16627]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:17.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:17 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1155376596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:17 smithi086 ceph-mon[24511]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:17 smithi086 ceph-mon[24511]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:17 smithi086 ceph-mon[24511]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:17 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/1155376596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:18.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:18 smithi086 ceph-mon[24511]: pgmap v43: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:18.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:18 smithi086 ceph-mon[24511]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:18 smithi017 ceph-mon[16627]: pgmap v43: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:18 smithi017 ceph-mon[16627]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:19.675 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:19.675 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:19.675 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:58:19.675 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:58:19.675 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:19.675 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:19.676 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.676 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.676 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.676 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.676 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.676 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.676 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.676 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:19 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:58:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:58:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:19.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:19 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:20.911 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:20 smithi017 ceph-mon[16627]: pgmap v44: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:58:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:20 smithi086 ceph-mon[24511]: pgmap v44: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:58:21.907 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:21 smithi017 ceph-mon[16627]: Upgrade: Updating prometheus.smithi017 2024-08-19T00:58:21.907 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:21 smithi017 ceph-mon[16627]: Deploying daemon prometheus.smithi017 on smithi017 2024-08-19T00:58:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:21 smithi086 ceph-mon[24511]: Upgrade: Updating prometheus.smithi017 2024-08-19T00:58:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:21 smithi086 ceph-mon[24511]: Deploying daemon prometheus.smithi017 on smithi017 2024-08-19T00:58:22.611 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:22 smithi017 ceph-mon[16627]: pgmap v45: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:22.855 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:22 smithi086 ceph-mon[24511]: pgmap v45: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:24.844 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:24 smithi017 ceph-mon[16627]: pgmap v46: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:58:24.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:24 smithi086 ceph-mon[24511]: pgmap v46: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:58:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:26 smithi017 ceph-mon[16627]: pgmap v47: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:26 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:26 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:26 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:26 smithi086 ceph-mon[24511]: pgmap v47: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:26 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:26 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:26 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:28.814 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:28 smithi017 ceph-mon[16627]: pgmap v48: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:28.814 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:28 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:58:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:28 smithi086 ceph-mon[24511]: pgmap v48: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:28 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:58:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:29 smithi017 ceph-mon[16627]: mgrmap e32: smithi017.hfpawi(active, since 91s), standbys: smithi086.uthxct 2024-08-19T00:58:29.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:29 smithi086 ceph-mon[24511]: mgrmap e32: smithi017.hfpawi(active, since 91s), standbys: smithi086.uthxct 2024-08-19T00:58:30.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:30 smithi017 ceph-mon[16627]: pgmap v49: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-19T00:58:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:30 smithi086 ceph-mon[24511]: pgmap v49: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-19T00:58:31.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:31 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:31.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:31 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:31.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:31 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:31.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:31 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:31 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:31 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:31 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:31.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:31 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:32 smithi017 ceph-mon[16627]: pgmap v50: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-08-19T00:58:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:32 smithi086 ceph-mon[24511]: pgmap v50: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 426 B/s wr, 3 op/s 2024-08-19T00:58:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:34 smithi017 ceph-mon[16627]: pgmap v51: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-19T00:58:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:34 smithi086 ceph-mon[24511]: pgmap v51: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-19T00:58:35.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:35.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:35.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:58:35.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:58:35.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:35.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:58:35.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:35.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:35 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:58:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:58:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:58:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:35.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:35 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:36.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:36 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:58:36.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:36 smithi017 ceph-mon[16627]: pgmap v52: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 426 B/s wr, 4 op/s 2024-08-19T00:58:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:36 smithi086 ceph-mon[24511]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-08-19T00:58:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:36 smithi086 ceph-mon[24511]: pgmap v52: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 426 B/s wr, 4 op/s 2024-08-19T00:58:37.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:37 smithi017 ceph-mon[16627]: Upgrade: Updating alertmanager.smithi017 2024-08-19T00:58:37.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:37 smithi017 ceph-mon[16627]: Deploying daemon alertmanager.smithi017 on smithi017 2024-08-19T00:58:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:37 smithi086 ceph-mon[24511]: Upgrade: Updating alertmanager.smithi017 2024-08-19T00:58:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:37 smithi086 ceph-mon[24511]: Deploying daemon alertmanager.smithi017 on smithi017 2024-08-19T00:58:38.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:38 smithi017 ceph-mon[16627]: pgmap v53: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-08-19T00:58:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:38 smithi086 ceph-mon[24511]: pgmap v53: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 426 B/s wr, 3 op/s 2024-08-19T00:58:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:40 smithi017 ceph-mon[16627]: pgmap v54: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-19T00:58:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:40 smithi086 ceph-mon[24511]: pgmap v54: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2024-08-19T00:58:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:42 smithi017 ceph-mon[16627]: pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-19T00:58:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:42 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:42 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:42 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:42 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:42 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:42 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:58:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:42 smithi086 ceph-mon[24511]: pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-19T00:58:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:42 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:42 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:42 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:42 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:42 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:42 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:58:44.912 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:44 smithi017 ceph-mon[16627]: pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-19T00:58:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:44 smithi086 ceph-mon[24511]: pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-19T00:58:46.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:46 smithi017 ceph-mon[16627]: pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:46 smithi086 ceph-mon[24511]: pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:47.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.324+0000 7f2a86f35640 1 -- 172.21.15.17:0/3635046972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a800feaf0 msgr2=0x7f2a800feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:47.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.324+0000 7f2a86f35640 1 --2- 172.21.15.17:0/3635046972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a800feaf0 0x7f2a800feef0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2a74009880 tx=0x7f2a7402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.324+0000 7f2a86f35640 1 -- 172.21.15.17:0/3635046972 shutdown_connections 2024-08-19T00:58:47.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.324+0000 7f2a86f35640 1 --2- 172.21.15.17:0/3635046972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a800ffcf0 0x7f2a80100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.324+0000 7f2a86f35640 1 --2- 172.21.15.17:0/3635046972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a800feaf0 0x7f2a800feef0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.324+0000 7f2a86f35640 1 -- 172.21.15.17:0/3635046972 >> 172.21.15.17:0/3635046972 conn(0x7f2a800fa280 msgr2=0x7f2a800fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.324+0000 7f2a86f35640 1 -- 172.21.15.17:0/3635046972 shutdown_connections 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.324+0000 7f2a86f35640 1 -- 172.21.15.17:0/3635046972 wait complete. 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a86f35640 1 Processor -- start 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a86f35640 1 -- start start 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a86f35640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a800feaf0 0x7f2a801978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a86f35640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a800ffcf0 0x7f2a80197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a86f35640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a801983e0 con 0x7f2a800ffcf0 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a86f35640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80198550 con 0x7f2a800feaf0 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a7ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a800ffcf0 0x7f2a80197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a7ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a800ffcf0 0x7f2a80197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34352/0 (socket says 172.21.15.17:34352) 2024-08-19T00:58:47.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a7ffff640 1 -- 172.21.15.17:0/4211063573 learned_addr learned my addr 172.21.15.17:0/4211063573 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:58:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a84cd1640 1 --2- 172.21.15.17:0/4211063573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a800feaf0 0x7f2a801978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:47.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a7ffff640 1 -- 172.21.15.17:0/4211063573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a800feaf0 msgr2=0x7f2a801978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.325+0000 7f2a7ffff640 1 --2- 172.21.15.17:0/4211063573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a800feaf0 0x7f2a801978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.326+0000 7f2a7ffff640 1 -- 172.21.15.17:0/4211063573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a74009560 con 0x7f2a800ffcf0 2024-08-19T00:58:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.326+0000 7f2a7ffff640 1 --2- 172.21.15.17:0/4211063573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a800ffcf0 0x7f2a80197e10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00c920 tx=0x7f2a6c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.326+0000 7f2a7dffb640 1 -- 172.21.15.17:0/4211063573 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a6c007b80 con 0x7f2a800ffcf0 2024-08-19T00:58:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.326+0000 7f2a7dffb640 1 -- 172.21.15.17:0/4211063573 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a6c0054e0 con 0x7f2a800ffcf0 2024-08-19T00:58:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.326+0000 7f2a86f35640 1 -- 172.21.15.17:0/4211063573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8019cff0 con 0x7f2a800ffcf0 2024-08-19T00:58:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.326+0000 7f2a7dffb640 1 -- 172.21.15.17:0/4211063573 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a6c00f450 con 0x7f2a800ffcf0 2024-08-19T00:58:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.326+0000 7f2a86f35640 1 -- 172.21.15.17:0/4211063573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8019d510 con 0x7f2a800ffcf0 2024-08-19T00:58:47.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.327+0000 7f2a86f35640 1 -- 172.21.15.17:0/4211063573 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a800feef0 con 0x7f2a800ffcf0 2024-08-19T00:58:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.328+0000 7f2a7dffb640 1 -- 172.21.15.17:0/4211063573 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f2a6c004f60 con 0x7f2a800ffcf0 2024-08-19T00:58:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.328+0000 7f2a7dffb640 1 --2- 172.21.15.17:0/4211063573 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2a7006ddf0 0x7f2a700702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.328+0000 7f2a7dffb640 1 -- 172.21.15.17:0/4211063573 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2a6c08d940 con 0x7f2a800ffcf0 2024-08-19T00:58:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.328+0000 7f2a84cd1640 1 --2- 172.21.15.17:0/4211063573 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2a7006ddf0 0x7f2a700702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.329+0000 7f2a84cd1640 1 --2- 172.21.15.17:0/4211063573 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2a7006ddf0 0x7f2a700702b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a74009230 tx=0x7f2a740314e0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:47.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.336+0000 7f2a7dffb640 1 -- 172.21.15.17:0/4211063573 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f2a6c057200 con 0x7f2a800ffcf0 2024-08-19T00:58:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.532+0000 7f2a86f35640 1 -- 172.21.15.17:0/4211063573 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a800683b0 con 0x7f2a7006ddf0 2024-08-19T00:58:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.533+0000 7f2a7dffb640 1 -- 172.21.15.17:0/4211063573 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f2a800683b0 con 0x7f2a7006ddf0 2024-08-19T00:58:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.535+0000 7f2a86f35640 1 -- 172.21.15.17:0/4211063573 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2a7006ddf0 msgr2=0x7f2a700702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.535+0000 7f2a86f35640 1 --2- 172.21.15.17:0/4211063573 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2a7006ddf0 0x7f2a700702b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2a74009230 tx=0x7f2a740314e0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.535+0000 7f2a86f35640 1 -- 172.21.15.17:0/4211063573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a800ffcf0 msgr2=0x7f2a80197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.535+0000 7f2a86f35640 1 --2- 172.21.15.17:0/4211063573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a800ffcf0 0x7f2a80197e10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00c920 tx=0x7f2a6c00cde0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.535+0000 7f2a86f35640 1 -- 172.21.15.17:0/4211063573 shutdown_connections 2024-08-19T00:58:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.535+0000 7f2a86f35640 1 --2- 172.21.15.17:0/4211063573 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2a7006ddf0 0x7f2a700702b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.535+0000 7f2a86f35640 1 --2- 172.21.15.17:0/4211063573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a800ffcf0 0x7f2a80197e10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.535+0000 7f2a86f35640 1 --2- 172.21.15.17:0/4211063573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a800feaf0 0x7f2a801978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.535+0000 7f2a86f35640 1 -- 172.21.15.17:0/4211063573 >> 172.21.15.17:0/4211063573 conn(0x7f2a800fa280 msgr2=0x7f2a80067ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.536+0000 7f2a86f35640 1 -- 172.21.15.17:0/4211063573 shutdown_connections 2024-08-19T00:58:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.536+0000 7f2a86f35640 1 -- 172.21.15.17:0/4211063573 wait complete. 2024-08-19T00:58:47.547 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:58:47.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.620+0000 7f67ac4c6640 1 -- 172.21.15.17:0/39083133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67a40feaf0 msgr2=0x7f67a40feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.620+0000 7f67ac4c6640 1 --2- 172.21.15.17:0/39083133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67a40feaf0 0x7f67a40feef0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009880 tx=0x7f67a002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.620+0000 7f67ac4c6640 1 -- 172.21.15.17:0/39083133 shutdown_connections 2024-08-19T00:58:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.620+0000 7f67ac4c6640 1 --2- 172.21.15.17:0/39083133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67a40ffcf0 0x7f67a4100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.620+0000 7f67ac4c6640 1 --2- 172.21.15.17:0/39083133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67a40feaf0 0x7f67a40feef0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.620+0000 7f67ac4c6640 1 -- 172.21.15.17:0/39083133 >> 172.21.15.17:0/39083133 conn(0x7f67a40fa280 msgr2=0x7f67a40fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.620+0000 7f67ac4c6640 1 -- 172.21.15.17:0/39083133 shutdown_connections 2024-08-19T00:58:47.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.620+0000 7f67ac4c6640 1 -- 172.21.15.17:0/39083133 wait complete. 2024-08-19T00:58:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.621+0000 7f67ac4c6640 1 Processor -- start 2024-08-19T00:58:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.621+0000 7f67ac4c6640 1 -- start start 2024-08-19T00:58:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.621+0000 7f67ac4c6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67a40feaf0 0x7f67a4068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.621+0000 7f67ac4c6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67a40ffcf0 0x7f67a419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f67ac4c6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a4196290 con 0x7f67a40ffcf0 2024-08-19T00:58:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f67ac4c6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a419cd60 con 0x7f67a40feaf0 2024-08-19T00:58:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f67a9a61640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67a40ffcf0 0x7f67a419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f67a9a61640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67a40ffcf0 0x7f67a419c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34374/0 (socket says 172.21.15.17:34374) 2024-08-19T00:58:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f67a9a61640 1 -- 172.21.15.17:0/1030764550 learned_addr learned my addr 172.21.15.17:0/1030764550 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:58:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f67aa262640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67a40feaf0 0x7f67a4068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:47.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f67a9a61640 1 -- 172.21.15.17:0/1030764550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67a40feaf0 msgr2=0x7f67a4068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f67a9a61640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67a40feaf0 0x7f67a4068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f67a9a61640 1 -- 172.21.15.17:0/1030764550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a0009560 con 0x7f67a40ffcf0 2024-08-19T00:58:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f67aa262640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67a40feaf0 0x7f67a4068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T00:58:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f67a9a61640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67a40ffcf0 0x7f67a419c820 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f679400d6f0 tx=0x7f679400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.622+0000 7f679b7fe640 1 -- 172.21.15.17:0/1030764550 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6794009a20 con 0x7f67a40ffcf0 2024-08-19T00:58:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.623+0000 7f67ac4c6640 1 -- 172.21.15.17:0/1030764550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a419cff0 con 0x7f67a40ffcf0 2024-08-19T00:58:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.623+0000 7f67ac4c6640 1 -- 172.21.15.17:0/1030764550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a419d510 con 0x7f67a40ffcf0 2024-08-19T00:58:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.623+0000 7f679b7fe640 1 -- 172.21.15.17:0/1030764550 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f67940054e0 con 0x7f67a40ffcf0 2024-08-19T00:58:47.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.623+0000 7f679b7fe640 1 -- 172.21.15.17:0/1030764550 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6794010460 con 0x7f67a40ffcf0 2024-08-19T00:58:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.624+0000 7f67ac4c6640 1 -- 172.21.15.17:0/1030764550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6788005280 con 0x7f67a40ffcf0 2024-08-19T00:58:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.625+0000 7f679b7fe640 1 -- 172.21.15.17:0/1030764550 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f67940046c0 con 0x7f67a40ffcf0 2024-08-19T00:58:47.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.625+0000 7f679b7fe640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f679006ddf0 0x7f67900702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:47.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.626+0000 7f679b7fe640 1 -- 172.21.15.17:0/1030764550 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f679408d5b0 con 0x7f67a40ffcf0 2024-08-19T00:58:47.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.626+0000 7f67aa262640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f679006ddf0 0x7f67900702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:47.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.626+0000 7f67aa262640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f679006ddf0 0x7f67900702b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009230 tx=0x7f67a00314e0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:47.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.630+0000 7f679b7fe640 1 -- 172.21.15.17:0/1030764550 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f6794056ef0 con 0x7f67a40ffcf0 2024-08-19T00:58:47.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.824+0000 7f67ac4c6640 1 -- 172.21.15.17:0/1030764550 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6788000bf0 con 0x7f679006ddf0 2024-08-19T00:58:47.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.826+0000 7f679b7fe640 1 -- 172.21.15.17:0/1030764550 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f6788000bf0 con 0x7f679006ddf0 2024-08-19T00:58:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.828+0000 7f67ac4c6640 1 -- 172.21.15.17:0/1030764550 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f679006ddf0 msgr2=0x7f67900702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.828+0000 7f67ac4c6640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f679006ddf0 0x7f67900702b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009230 tx=0x7f67a00314e0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.828+0000 7f67ac4c6640 1 -- 172.21.15.17:0/1030764550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67a40ffcf0 msgr2=0x7f67a419c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.828+0000 7f67ac4c6640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67a40ffcf0 0x7f67a419c820 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f679400d6f0 tx=0x7f679400dbb0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.828+0000 7f67ac4c6640 1 -- 172.21.15.17:0/1030764550 shutdown_connections 2024-08-19T00:58:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.828+0000 7f67ac4c6640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f679006ddf0 0x7f67900702b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.828+0000 7f67ac4c6640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67a40ffcf0 0x7f67a419c820 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.828+0000 7f67ac4c6640 1 --2- 172.21.15.17:0/1030764550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67a40feaf0 0x7f67a4068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.828+0000 7f67ac4c6640 1 -- 172.21.15.17:0/1030764550 >> 172.21.15.17:0/1030764550 conn(0x7f67a40fa280 msgr2=0x7f67a41033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:47.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.828+0000 7f67ac4c6640 1 -- 172.21.15.17:0/1030764550 shutdown_connections 2024-08-19T00:58:47.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.828+0000 7f67ac4c6640 1 -- 172.21.15.17:0/1030764550 wait complete. 2024-08-19T00:58:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.911+0000 7f9700553640 1 -- 172.21.15.17:0/482341557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96f80feaf0 msgr2=0x7f96f80feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.911+0000 7f9700553640 1 --2- 172.21.15.17:0/482341557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96f80feaf0 0x7f96f80feef0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009880 tx=0x7f96f402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.911+0000 7f9700553640 1 -- 172.21.15.17:0/482341557 shutdown_connections 2024-08-19T00:58:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.911+0000 7f9700553640 1 --2- 172.21.15.17:0/482341557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96f80ffcf0 0x7f96f8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.911+0000 7f9700553640 1 --2- 172.21.15.17:0/482341557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96f80feaf0 0x7f96f80feef0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.911+0000 7f9700553640 1 -- 172.21.15.17:0/482341557 >> 172.21.15.17:0/482341557 conn(0x7f96f80fa280 msgr2=0x7f96f80fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.912+0000 7f9700553640 1 -- 172.21.15.17:0/482341557 shutdown_connections 2024-08-19T00:58:47.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.912+0000 7f9700553640 1 -- 172.21.15.17:0/482341557 wait complete. 2024-08-19T00:58:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.912+0000 7f9700553640 1 Processor -- start 2024-08-19T00:58:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.912+0000 7f9700553640 1 -- start start 2024-08-19T00:58:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.912+0000 7f9700553640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96f80feaf0 0x7f96f80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.912+0000 7f9700553640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96f80ffcf0 0x7f96f819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.912+0000 7f9700553640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f819a9b0 con 0x7f96f80ffcf0 2024-08-19T00:58:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.912+0000 7f9700553640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f819ab20 con 0x7f96f80feaf0 2024-08-19T00:58:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f96fdaee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96f80ffcf0 0x7f96f819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f96fdaee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96f80ffcf0 0x7f96f819a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34382/0 (socket says 172.21.15.17:34382) 2024-08-19T00:58:47.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f96fdaee640 1 -- 172.21.15.17:0/2161580758 learned_addr learned my addr 172.21.15.17:0/2161580758 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:58:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f96fe2ef640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96f80feaf0 0x7f96f80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f96fdaee640 1 -- 172.21.15.17:0/2161580758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96f80feaf0 msgr2=0x7f96f80687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f96fdaee640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96f80feaf0 0x7f96f80687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f96fdaee640 1 -- 172.21.15.17:0/2161580758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f4009560 con 0x7f96f80ffcf0 2024-08-19T00:58:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f96fe2ef640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96f80feaf0 0x7f96f80687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:58:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f96fdaee640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96f80ffcf0 0x7f96f819a3e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f96e800d6f0 tx=0x7f96e800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f96ef7fe640 1 -- 172.21.15.17:0/2161580758 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96e8009a30 con 0x7f96f80ffcf0 2024-08-19T00:58:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f96ef7fe640 1 -- 172.21.15.17:0/2161580758 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96e80054e0 con 0x7f96f80ffcf0 2024-08-19T00:58:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.913+0000 7f9700553640 1 -- 172.21.15.17:0/2161580758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f819ae00 con 0x7f96f80ffcf0 2024-08-19T00:58:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.914+0000 7f96ef7fe640 1 -- 172.21.15.17:0/2161580758 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96e8010460 con 0x7f96f80ffcf0 2024-08-19T00:58:47.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.914+0000 7f9700553640 1 -- 172.21.15.17:0/2161580758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f819b320 con 0x7f96f80ffcf0 2024-08-19T00:58:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.915+0000 7f96ef7fe640 1 -- 172.21.15.17:0/2161580758 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f96e8009b90 con 0x7f96f80ffcf0 2024-08-19T00:58:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.915+0000 7f9700553640 1 -- 172.21.15.17:0/2161580758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f80feef0 con 0x7f96f80ffcf0 2024-08-19T00:58:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.916+0000 7f96ef7fe640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f96e406ddf0 0x7f96e40702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:47.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.916+0000 7f96fe2ef640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f96e406ddf0 0x7f96e40702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.916+0000 7f96ef7fe640 1 -- 172.21.15.17:0/2161580758 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f96e808d6a0 con 0x7f96f80ffcf0 2024-08-19T00:58:47.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.917+0000 7f96fe2ef640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f96e406ddf0 0x7f96e40702b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96f8068d10 tx=0x7f96f40314e0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:47.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:47.921+0000 7f96ef7fe640 1 -- 172.21.15.17:0/2161580758 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f96e8056f30 con 0x7f96f80ffcf0 2024-08-19T00:58:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.116+0000 7f9700553640 1 -- 172.21.15.17:0/2161580758 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f96f802c540 con 0x7f96e406ddf0 2024-08-19T00:58:48.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.125+0000 7f96ef7fe640 1 -- 172.21.15.17:0/2161580758 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f96f802c540 con 0x7f96e406ddf0 2024-08-19T00:58:48.127 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:58:48.127 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (6s) 1s ago 10m 16.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T00:58:48.127 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (10m) 1s ago 10m 8238k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T00:58:48.127 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (9m) 38s ago 9m 7948k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T00:58:48.127 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (10m) 1s ago 10m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (9m) 38s ago 9m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (9m) 1s ago 10m 85.5M - 9.4.7 954c08fa6188 293dd58dd677 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (5m) 1s ago 5m 158M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (5m) 1s ago 5m 91.7M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (5m) 38s ago 5m 26.0M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (5m) 38s ago 5m 25.7M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (2m) 1s ago 12m 499M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (57s) 38s ago 9m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (12m) 1s ago 12m 57.0M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 771bc6b905a5 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (9m) 38s ago 9m 48.0M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 c6fce0ad535d 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (45s) 1s ago 10m 13.0M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (42s) 38s ago 9m 3556k - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T00:58:48.128 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (8m) 1s ago 8m 218M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T00:58:48.129 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (8m) 1s ago 8m 227M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T00:58:48.129 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (8m) 1s ago 8m 189M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T00:58:48.129 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (7m) 38s ago 7m 244M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T00:58:48.129 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (7m) 38s ago 7m 217M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T00:58:48.129 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (6m) 38s ago 6m 217M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T00:58:48.129 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (22s) 1s ago 10m 46.6M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T00:58:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.128+0000 7f9700553640 1 -- 172.21.15.17:0/2161580758 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f96e406ddf0 msgr2=0x7f96e40702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.128+0000 7f9700553640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f96e406ddf0 0x7f96e40702b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96f8068d10 tx=0x7f96f40314e0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.128+0000 7f9700553640 1 -- 172.21.15.17:0/2161580758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96f80ffcf0 msgr2=0x7f96f819a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.128+0000 7f9700553640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96f80ffcf0 0x7f96f819a3e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f96e800d6f0 tx=0x7f96e800dbb0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.128+0000 7f9700553640 1 -- 172.21.15.17:0/2161580758 shutdown_connections 2024-08-19T00:58:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.128+0000 7f9700553640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f96e406ddf0 0x7f96e40702b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.128+0000 7f9700553640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96f80ffcf0 0x7f96f819a3e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.128+0000 7f9700553640 1 --2- 172.21.15.17:0/2161580758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96f80feaf0 0x7f96f80687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.128+0000 7f9700553640 1 -- 172.21.15.17:0/2161580758 >> 172.21.15.17:0/2161580758 conn(0x7f96f80fa280 msgr2=0x7f96f81033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.128+0000 7f9700553640 1 -- 172.21.15.17:0/2161580758 shutdown_connections 2024-08-19T00:58:48.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.128+0000 7f9700553640 1 -- 172.21.15.17:0/2161580758 wait complete. 2024-08-19T00:58:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:48 smithi017 ceph-mon[16627]: pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:48 smithi017 ceph-mon[16627]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:48.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.209+0000 7f0bbede1640 1 -- 172.21.15.17:0/3506363912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb8100d90 msgr2=0x7f0bb8101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:48.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.209+0000 7f0bbede1640 1 --2- 172.21.15.17:0/3506363912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb8100d90 0x7f0bb8101210 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009880 tx=0x7f0ba802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.209+0000 7f0bbede1640 1 -- 172.21.15.17:0/3506363912 shutdown_connections 2024-08-19T00:58:48.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.209+0000 7f0bbede1640 1 --2- 172.21.15.17:0/3506363912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb8100d90 0x7f0bb8101210 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.209+0000 7f0bbede1640 1 --2- 172.21.15.17:0/3506363912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bb80ffb90 0x7f0bb80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.209+0000 7f0bbede1640 1 -- 172.21.15.17:0/3506363912 >> 172.21.15.17:0/3506363912 conn(0x7f0bb80fb320 msgr2=0x7f0bb80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:48.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.209+0000 7f0bbede1640 1 -- 172.21.15.17:0/3506363912 shutdown_connections 2024-08-19T00:58:48.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.209+0000 7f0bbede1640 1 -- 172.21.15.17:0/3506363912 wait complete. 2024-08-19T00:58:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.210+0000 7f0bbede1640 1 Processor -- start 2024-08-19T00:58:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.210+0000 7f0bbede1640 1 -- start start 2024-08-19T00:58:48.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.210+0000 7f0bbede1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bb80ffb90 0x7f0bb8195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.210+0000 7f0bbede1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb8100d90 0x7f0bb8195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.210+0000 7f0bbede1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8196240 con 0x7f0bb8100d90 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.210+0000 7f0bbede1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb81963b0 con 0x7f0bb80ffb90 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.210+0000 7f0baffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb8100d90 0x7f0bb8195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.210+0000 7f0baffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb8100d90 0x7f0bb8195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34400/0 (socket says 172.21.15.17:34400) 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.210+0000 7f0baffff640 1 -- 172.21.15.17:0/318125199 learned_addr learned my addr 172.21.15.17:0/318125199 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.210+0000 7f0bbcb7d640 1 --2- 172.21.15.17:0/318125199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bb80ffb90 0x7f0bb8195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.211+0000 7f0baffff640 1 -- 172.21.15.17:0/318125199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bb80ffb90 msgr2=0x7f0bb8195730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.211+0000 7f0baffff640 1 --2- 172.21.15.17:0/318125199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bb80ffb90 0x7f0bb8195730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.211+0000 7f0baffff640 1 -- 172.21.15.17:0/318125199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba8009560 con 0x7f0bb8100d90 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.211+0000 7f0baffff640 1 --2- 172.21.15.17:0/318125199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb8100d90 0x7f0bb8195c70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8005640 tx=0x7f0ba8005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.211+0000 7f0badffb640 1 -- 172.21.15.17:0/318125199 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ba8004ba0 con 0x7f0bb8100d90 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.211+0000 7f0bbede1640 1 -- 172.21.15.17:0/318125199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb819adf0 con 0x7f0bb8100d90 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.211+0000 7f0badffb640 1 -- 172.21.15.17:0/318125199 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ba8004d00 con 0x7f0bb8100d90 2024-08-19T00:58:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.211+0000 7f0badffb640 1 -- 172.21.15.17:0/318125199 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ba8003b70 con 0x7f0bb8100d90 2024-08-19T00:58:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.211+0000 7f0bbede1640 1 -- 172.21.15.17:0/318125199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb819b330 con 0x7f0bb8100d90 2024-08-19T00:58:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.212+0000 7f0bbede1640 1 -- 172.21.15.17:0/318125199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb8100010 con 0x7f0bb8100d90 2024-08-19T00:58:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.213+0000 7f0badffb640 1 -- 172.21.15.17:0/318125199 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f0ba8031640 con 0x7f0bb8100d90 2024-08-19T00:58:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.213+0000 7f0badffb640 1 --2- 172.21.15.17:0/318125199 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f0ba006ddf0 0x7f0ba00702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.214+0000 7f0badffb640 1 -- 172.21.15.17:0/318125199 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0ba80aed90 con 0x7f0bb8100d90 2024-08-19T00:58:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.214+0000 7f0bbcb7d640 1 --2- 172.21.15.17:0/318125199 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f0ba006ddf0 0x7f0ba00702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:48.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.214+0000 7f0bbcb7d640 1 --2- 172.21.15.17:0/318125199 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f0ba006ddf0 0x7f0ba00702b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8100bf0 tx=0x7f0bb4009110 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:48.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.218+0000 7f0badffb640 1 -- 172.21.15.17:0/318125199 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f0ba80785a0 con 0x7f0bb8100d90 2024-08-19T00:58:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:48 smithi086 ceph-mon[24511]: pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:48 smithi086 ceph-mon[24511]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:48.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.466+0000 7f0bbede1640 1 -- 172.21.15.17:0/318125199 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0bb8108820 con 0x7f0bb8100d90 2024-08-19T00:58:48.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.467+0000 7f0badffb640 1 -- 172.21.15.17:0/318125199 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7f0ba807bc60 con 0x7f0bb8100d90 2024-08-19T00:58:48.469 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:58:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T00:58:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2 2024-08-19T00:58:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:58:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T00:58:48.469 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T00:58:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:58:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T00:58:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6 2024-08-19T00:58:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:58:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T00:58:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T00:58:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:58:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T00:58:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 12, 2024-08-19T00:58:48.470 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T00:58:48.471 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T00:58:48.471 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:58:48.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.469+0000 7f0bbede1640 1 -- 172.21.15.17:0/318125199 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f0ba006ddf0 msgr2=0x7f0ba00702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:48.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.469+0000 7f0bbede1640 1 --2- 172.21.15.17:0/318125199 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f0ba006ddf0 0x7f0ba00702b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8100bf0 tx=0x7f0bb4009110 comp rx=0 tx=0).stop 2024-08-19T00:58:48.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.469+0000 7f0bbede1640 1 -- 172.21.15.17:0/318125199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb8100d90 msgr2=0x7f0bb8195c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:48.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.469+0000 7f0bbede1640 1 --2- 172.21.15.17:0/318125199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb8100d90 0x7f0bb8195c70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8005640 tx=0x7f0ba8005670 comp rx=0 tx=0).stop 2024-08-19T00:58:48.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.469+0000 7f0bbede1640 1 -- 172.21.15.17:0/318125199 shutdown_connections 2024-08-19T00:58:48.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.469+0000 7f0bbede1640 1 --2- 172.21.15.17:0/318125199 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f0ba006ddf0 0x7f0ba00702b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.470+0000 7f0bbede1640 1 --2- 172.21.15.17:0/318125199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bb8100d90 0x7f0bb8195c70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.470+0000 7f0bbede1640 1 --2- 172.21.15.17:0/318125199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bb80ffb90 0x7f0bb8195730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.470+0000 7f0bbede1640 1 -- 172.21.15.17:0/318125199 >> 172.21.15.17:0/318125199 conn(0x7f0bb80fb320 msgr2=0x7f0bb8103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:48.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.470+0000 7f0bbede1640 1 -- 172.21.15.17:0/318125199 shutdown_connections 2024-08-19T00:58:48.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.470+0000 7f0bbede1640 1 -- 172.21.15.17:0/318125199 wait complete. 2024-08-19T00:58:48.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.556+0000 7f4c10d96640 1 -- 172.21.15.17:0/2523891641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c0c100d90 msgr2=0x7f4c0c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:48.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.556+0000 7f4c10d96640 1 --2- 172.21.15.17:0/2523891641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c0c100d90 0x7f4c0c101210 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009880 tx=0x7f4c0002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.556+0000 7f4c10d96640 1 -- 172.21.15.17:0/2523891641 shutdown_connections 2024-08-19T00:58:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.556+0000 7f4c10d96640 1 --2- 172.21.15.17:0/2523891641 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c0c100d90 0x7f4c0c101210 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.556+0000 7f4c10d96640 1 --2- 172.21.15.17:0/2523891641 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c0c0ffb90 0x7f4c0c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.556+0000 7f4c10d96640 1 -- 172.21.15.17:0/2523891641 >> 172.21.15.17:0/2523891641 conn(0x7f4c0c0fb320 msgr2=0x7f4c0c0fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.556+0000 7f4c10d96640 1 -- 172.21.15.17:0/2523891641 shutdown_connections 2024-08-19T00:58:48.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.556+0000 7f4c10d96640 1 -- 172.21.15.17:0/2523891641 wait complete. 2024-08-19T00:58:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.557+0000 7f4c10d96640 1 Processor -- start 2024-08-19T00:58:48.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.557+0000 7f4c10d96640 1 -- start start 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.557+0000 7f4c10d96640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c0c0ffb90 0x7f4c0c195630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.557+0000 7f4c10d96640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c0c100d90 0x7f4c0c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.557+0000 7f4c10d96640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c196140 con 0x7f4c0c100d90 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.557+0000 7f4c10d96640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0c1962b0 con 0x7f4c0c0ffb90 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.557+0000 7f4c09d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c0c100d90 0x7f4c0c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.557+0000 7f4c09d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c0c100d90 0x7f4c0c195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34424/0 (socket says 172.21.15.17:34424) 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.557+0000 7f4c09d9b640 1 -- 172.21.15.17:0/2301985423 learned_addr learned my addr 172.21.15.17:0/2301985423 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.558+0000 7f4c0a59c640 1 --2- 172.21.15.17:0/2301985423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c0c0ffb90 0x7f4c0c195630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.558+0000 7f4c09d9b640 1 -- 172.21.15.17:0/2301985423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c0c0ffb90 msgr2=0x7f4c0c195630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.558+0000 7f4c09d9b640 1 --2- 172.21.15.17:0/2301985423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c0c0ffb90 0x7f4c0c195630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.558+0000 7f4c09d9b640 1 -- 172.21.15.17:0/2301985423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00009560 con 0x7f4c0c100d90 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.558+0000 7f4c09d9b640 1 --2- 172.21.15.17:0/2301985423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c0c100d90 0x7f4c0c195b70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4c00005640 tx=0x7f4c00005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:48.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.558+0000 7f4bfb7fe640 1 -- 172.21.15.17:0/2301985423 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c00004ba0 con 0x7f4c0c100d90 2024-08-19T00:58:48.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.558+0000 7f4bfb7fe640 1 -- 172.21.15.17:0/2301985423 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c00004d00 con 0x7f4c0c100d90 2024-08-19T00:58:48.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.558+0000 7f4c10d96640 1 -- 172.21.15.17:0/2301985423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0c19acf0 con 0x7f4c0c100d90 2024-08-19T00:58:48.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.558+0000 7f4bfb7fe640 1 -- 172.21.15.17:0/2301985423 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c00003c30 con 0x7f4c0c100d90 2024-08-19T00:58:48.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.558+0000 7f4c10d96640 1 -- 172.21.15.17:0/2301985423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0c19b260 con 0x7f4c0c100d90 2024-08-19T00:58:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.559+0000 7f4c10d96640 1 -- 172.21.15.17:0/2301985423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0c18f730 con 0x7f4c0c100d90 2024-08-19T00:58:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.560+0000 7f4bfb7fe640 1 -- 172.21.15.17:0/2301985423 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f4c00031640 con 0x7f4c0c100d90 2024-08-19T00:58:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.560+0000 7f4bfb7fe640 1 --2- 172.21.15.17:0/2301985423 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4bf406ddf0 0x7f4bf40702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:58:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.560+0000 7f4bfb7fe640 1 -- 172.21.15.17:0/2301985423 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4c000aee90 con 0x7f4c0c100d90 2024-08-19T00:58:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.560+0000 7f4c0a59c640 1 --2- 172.21.15.17:0/2301985423 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4bf406ddf0 0x7f4bf40702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:58:48.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.561+0000 7f4c0a59c640 1 --2- 172.21.15.17:0/2301985423 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4bf406ddf0 0x7f4bf40702b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0058c0 tx=0x7f4bfc00a4c0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:58:48.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.565+0000 7f4bfb7fe640 1 -- 172.21.15.17:0/2301985423 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f4c000786a0 con 0x7f4c0c100d90 2024-08-19T00:58:48.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.757+0000 7f4c10d96640 1 -- 172.21.15.17:0/2301985423 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c0c02c4f0 con 0x7f4bf406ddf0 2024-08-19T00:58:48.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.758+0000 7f4bfb7fe640 1 -- 172.21.15.17:0/2301985423 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f4c0c02c4f0 con 0x7f4bf406ddf0 2024-08-19T00:58:48.760 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:58:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T00:58:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T00:58:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-08-19T00:58:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T00:58:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T00:58:48.760 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T00:58:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "2/2 daemons upgraded", 2024-08-19T00:58:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading alertmanager daemons", 2024-08-19T00:58:48.761 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T00:58:48.761 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:58:48.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.760+0000 7f4c10d96640 1 -- 172.21.15.17:0/2301985423 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4bf406ddf0 msgr2=0x7f4bf40702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:48.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.760+0000 7f4c10d96640 1 --2- 172.21.15.17:0/2301985423 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4bf406ddf0 0x7f4bf40702b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0058c0 tx=0x7f4bfc00a4c0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.760+0000 7f4c10d96640 1 -- 172.21.15.17:0/2301985423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c0c100d90 msgr2=0x7f4c0c195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:58:48.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.760+0000 7f4c10d96640 1 --2- 172.21.15.17:0/2301985423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c0c100d90 0x7f4c0c195b70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4c00005640 tx=0x7f4c00005670 comp rx=0 tx=0).stop 2024-08-19T00:58:48.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.760+0000 7f4c10d96640 1 -- 172.21.15.17:0/2301985423 shutdown_connections 2024-08-19T00:58:48.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.760+0000 7f4c10d96640 1 --2- 172.21.15.17:0/2301985423 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f4bf406ddf0 0x7f4bf40702b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.760+0000 7f4c10d96640 1 --2- 172.21.15.17:0/2301985423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c0c100d90 0x7f4c0c195b70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.760+0000 7f4c10d96640 1 --2- 172.21.15.17:0/2301985423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c0c0ffb90 0x7f4c0c195630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:58:48.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.760+0000 7f4c10d96640 1 -- 172.21.15.17:0/2301985423 >> 172.21.15.17:0/2301985423 conn(0x7f4c0c0fb320 msgr2=0x7f4c0c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:58:48.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.761+0000 7f4c10d96640 1 -- 172.21.15.17:0/2301985423 shutdown_connections 2024-08-19T00:58:48.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:58:48.761+0000 7f4c10d96640 1 -- 172.21.15.17:0/2301985423 wait complete. 2024-08-19T00:58:49.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:49 smithi017 ceph-mon[16627]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:49.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:49 smithi017 ceph-mon[16627]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:49.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:49 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/318125199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:49.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:49 smithi086 ceph-mon[24511]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:49.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:49 smithi086 ceph-mon[24511]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:49.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:49 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/318125199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:50.383 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:50 smithi017 ceph-mon[16627]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:50.383 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:50 smithi017 ceph-mon[16627]: pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:58:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:50 smithi086 ceph-mon[24511]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:58:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:50 smithi086 ceph-mon[24511]: pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:58:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:58:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:58:52.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:52.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:52.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-19T00:58:52.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-19T00:58:52.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:52.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:52.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:52.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:58:52.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:52.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:58:53.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:53 smithi017 ceph-mon[16627]: Upgrade: Updating grafana.smithi017 2024-08-19T00:58:53.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:53 smithi086 ceph-mon[24511]: Upgrade: Updating grafana.smithi017 2024-08-19T00:58:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:54 smithi017 ceph-mon[16627]: Deploying daemon grafana.smithi017 on smithi017 2024-08-19T00:58:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:54 smithi017 ceph-mon[16627]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:58:54.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:54 smithi086 ceph-mon[24511]: Deploying daemon grafana.smithi017 on smithi017 2024-08-19T00:58:54.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:54 smithi086 ceph-mon[24511]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:58:56.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:56 smithi017 ceph-mon[16627]: pgmap v62: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:56.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:56 smithi086 ceph-mon[24511]: pgmap v62: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:58.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:58 smithi017 ceph-mon[16627]: pgmap v63: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:58.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:58:58 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:58:58.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:58 smithi086 ceph-mon[24511]: pgmap v63: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:58:58.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:58:58 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:59:00.445 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:00 smithi017 ceph-mon[16627]: pgmap v64: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:00.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:00 smithi086 ceph-mon[24511]: pgmap v64: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:02.244 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:02 smithi017 ceph-mon[16627]: pgmap v65: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:02.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:02 smithi086 ceph-mon[24511]: pgmap v65: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:04.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:04 smithi017 ceph-mon[16627]: pgmap v66: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:04.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:04 smithi086 ceph-mon[24511]: pgmap v66: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:05 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:05 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:05 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:05 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:05 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:05 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:06 smithi017 ceph-mon[16627]: pgmap v67: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:06 smithi086 ceph-mon[24511]: pgmap v67: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:08.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:08 smithi017 ceph-mon[16627]: pgmap v68: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:08.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:08 smithi086 ceph-mon[24511]: pgmap v68: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:10 smithi017 ceph-mon[16627]: pgmap v69: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:10 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:10 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:10 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:10 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:10 smithi086 ceph-mon[24511]: pgmap v69: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:10 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:10 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:10 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:10 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:12 smithi017 ceph-mon[16627]: pgmap v70: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:12 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:59:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:12 smithi086 ceph-mon[24511]: pgmap v70: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:12 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:59:14.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:14 smithi086 ceph-mon[24511]: pgmap v71: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:15.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:14 smithi017 ceph-mon[16627]: pgmap v71: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:16.784 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:16 smithi017 ceph-mon[16627]: pgmap v72: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:16.785 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:16 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:16.785 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:16 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:16.785 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:16 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:16.785 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:16 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:59:16.785 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:16 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:16 smithi086 ceph-mon[24511]: pgmap v72: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:16 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:16 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:16 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:16 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:59:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:16 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:17.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-19T00:59:17.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:17.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-08-19T00:59:17.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-08-19T00:59:17.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:59:17.950 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:17.951 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:17.951 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:17.951 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:59:17.951 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:17.951 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:17 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-08-19T00:59:18.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:18.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:18.187 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:17 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.856+0000 7fabedf9e640 1 -- 172.21.15.17:0/1115493328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabe8100630 msgr2=0x7fabe8102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.856+0000 7fabedf9e640 1 --2- 172.21.15.17:0/1115493328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabe8100630 0x7fabe8102a20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fabd80098b0 tx=0x7fabd802a4d0 comp rx=0 tx=0).stop 2024-08-19T00:59:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.857+0000 7fabedf9e640 1 -- 172.21.15.17:0/1115493328 shutdown_connections 2024-08-19T00:59:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.857+0000 7fabedf9e640 1 --2- 172.21.15.17:0/1115493328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabe8102f60 0x7fabe8105350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.857+0000 7fabedf9e640 1 --2- 172.21.15.17:0/1115493328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabe8100630 0x7fabe8102a20 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.857+0000 7fabedf9e640 1 -- 172.21.15.17:0/1115493328 >> 172.21.15.17:0/1115493328 conn(0x7fabe80fa250 msgr2=0x7fabe80fc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.857+0000 7fabedf9e640 1 -- 172.21.15.17:0/1115493328 shutdown_connections 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.857+0000 7fabedf9e640 1 -- 172.21.15.17:0/1115493328 wait complete. 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.857+0000 7fabedf9e640 1 Processor -- start 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.857+0000 7fabedf9e640 1 -- start start 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabedf9e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabe8100630 0x7fabe80fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabedf9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabe8102f60 0x7fabe80fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabedf9e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80feb20 con 0x7fabe8102f60 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabedf9e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80fec90 con 0x7fabe8100630 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabdeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabe8102f60 0x7fabe80fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabdeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabe8102f60 0x7fabe80fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38522/0 (socket says 172.21.15.17:38522) 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabdeffd640 1 -- 172.21.15.17:0/3719062165 learned_addr learned my addr 172.21.15.17:0/3719062165 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabe77fe640 1 --2- 172.21.15.17:0/3719062165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabe8100630 0x7fabe80fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:18.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabdeffd640 1 -- 172.21.15.17:0/3719062165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabe8100630 msgr2=0x7fabe80fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:18.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabdeffd640 1 --2- 172.21.15.17:0/3719062165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabe8100630 0x7fabe80fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:18.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabdeffd640 1 -- 172.21.15.17:0/3719062165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009560 con 0x7fabe8102f60 2024-08-19T00:59:18.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.858+0000 7fabdeffd640 1 --2- 172.21.15.17:0/3719062165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabe8102f60 0x7fabe80fe5e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fabd0005fd0 tx=0x7fabd000dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:18.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.859+0000 7fabe57fa640 1 -- 172.21.15.17:0/3719062165 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabd0009c00 con 0x7fabe8102f60 2024-08-19T00:59:18.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.859+0000 7fabedf9e640 1 -- 172.21.15.17:0/3719062165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe80fef70 con 0x7fabe8102f60 2024-08-19T00:59:18.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.859+0000 7fabe57fa640 1 -- 172.21.15.17:0/3719062165 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabd000de90 con 0x7fabe8102f60 2024-08-19T00:59:18.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.859+0000 7fabe57fa640 1 -- 172.21.15.17:0/3719062165 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabd0003ea0 con 0x7fabe8102f60 2024-08-19T00:59:18.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.859+0000 7fabedf9e640 1 -- 172.21.15.17:0/3719062165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe819d6a0 con 0x7fabe8102f60 2024-08-19T00:59:18.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.860+0000 7fabedf9e640 1 -- 172.21.15.17:0/3719062165 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe8100a10 con 0x7fabe8102f60 2024-08-19T00:59:18.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.860+0000 7fabe57fa640 1 -- 172.21.15.17:0/3719062165 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7fabd0004000 con 0x7fabe8102f60 2024-08-19T00:59:18.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.861+0000 7fabe57fa640 1 --2- 172.21.15.17:0/3719062165 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fabd406ddf0 0x7fabd40702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:18.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.861+0000 7fabe57fa640 1 -- 172.21.15.17:0/3719062165 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fabd008daa0 con 0x7fabe8102f60 2024-08-19T00:59:18.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.861+0000 7fabe77fe640 1 --2- 172.21.15.17:0/3719062165 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fabd406ddf0 0x7fabd40702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:18.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.861+0000 7fabe77fe640 1 --2- 172.21.15.17:0/3719062165 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fabd406ddf0 0x7fabd40702b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fabd8006010 tx=0x7fabd80314e0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:18.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:18.865+0000 7fabe57fa640 1 -- 172.21.15.17:0/3719062165 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fabd00572b0 con 0x7fabe8102f60 2024-08-19T00:59:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:18 smithi086 ceph-mon[24511]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-19T00:59:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:18 smithi086 ceph-mon[24511]: Upgrade: Finalizing container_image settings 2024-08-19T00:59:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:18 smithi086 ceph-mon[24511]: Upgrade: Complete! 2024-08-19T00:59:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:18 smithi086 ceph-mon[24511]: pgmap v73: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:19.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.060+0000 7fabedf9e640 1 -- 172.21.15.17:0/3719062165 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fabe8103980 con 0x7fabd406ddf0 2024-08-19T00:59:19.062 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:18 smithi017 ceph-mon[16627]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-08-19T00:59:19.062 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:18 smithi017 ceph-mon[16627]: Upgrade: Finalizing container_image settings 2024-08-19T00:59:19.062 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:18 smithi017 ceph-mon[16627]: Upgrade: Complete! 2024-08-19T00:59:19.062 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:18 smithi017 ceph-mon[16627]: pgmap v73: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:19.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.061+0000 7fabe57fa640 1 -- 172.21.15.17:0/3719062165 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fabe8103980 con 0x7fabd406ddf0 2024-08-19T00:59:19.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.063+0000 7fabedf9e640 1 -- 172.21.15.17:0/3719062165 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fabd406ddf0 msgr2=0x7fabd40702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:19.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.063+0000 7fabedf9e640 1 --2- 172.21.15.17:0/3719062165 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fabd406ddf0 0x7fabd40702b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fabd8006010 tx=0x7fabd80314e0 comp rx=0 tx=0).stop 2024-08-19T00:59:19.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.063+0000 7fabedf9e640 1 -- 172.21.15.17:0/3719062165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabe8102f60 msgr2=0x7fabe80fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:19.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.063+0000 7fabedf9e640 1 --2- 172.21.15.17:0/3719062165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabe8102f60 0x7fabe80fe5e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fabd0005fd0 tx=0x7fabd000dd60 comp rx=0 tx=0).stop 2024-08-19T00:59:19.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.063+0000 7fabedf9e640 1 -- 172.21.15.17:0/3719062165 shutdown_connections 2024-08-19T00:59:19.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.063+0000 7fabedf9e640 1 --2- 172.21.15.17:0/3719062165 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fabd406ddf0 0x7fabd40702b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:19.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.063+0000 7fabedf9e640 1 --2- 172.21.15.17:0/3719062165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fabe8102f60 0x7fabe80fe5e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:19.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.063+0000 7fabedf9e640 1 --2- 172.21.15.17:0/3719062165 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fabe8100630 0x7fabe80fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:19.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.063+0000 7fabedf9e640 1 -- 172.21.15.17:0/3719062165 >> 172.21.15.17:0/3719062165 conn(0x7fabe80fa250 msgr2=0x7fabe80fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:19.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.063+0000 7fabedf9e640 1 -- 172.21.15.17:0/3719062165 shutdown_connections 2024-08-19T00:59:19.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:19.063+0000 7fabedf9e640 1 -- 172.21.15.17:0/3719062165 wait complete. 2024-08-19T00:59:19.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-08-19T00:59:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:59:19.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:19 smithi017 ceph-mon[16627]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:19.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:19 smithi017 ceph-mon[16627]: pgmap v74: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:19 smithi086 ceph-mon[24511]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:19 smithi086 ceph-mon[24511]: pgmap v74: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.482+0000 7f108104f640 1 -- 172.21.15.17:0/1480192175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f107c0ff2b0 msgr2=0x7f107c0ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.482+0000 7f108104f640 1 --2- 172.21.15.17:0/1480192175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f107c0ff2b0 0x7f107c0ff690 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f106c009880 tx=0x7f106c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.482+0000 7f108104f640 1 -- 172.21.15.17:0/1480192175 shutdown_connections 2024-08-19T00:59:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.482+0000 7f108104f640 1 --2- 172.21.15.17:0/1480192175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c0ffc60 0x7f107c1036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.482+0000 7f108104f640 1 --2- 172.21.15.17:0/1480192175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f107c0ff2b0 0x7f107c0ff690 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.482+0000 7f108104f640 1 -- 172.21.15.17:0/1480192175 >> 172.21.15.17:0/1480192175 conn(0x7f107c0f9e50 msgr2=0x7f107c0fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.482+0000 7f108104f640 1 -- 172.21.15.17:0/1480192175 shutdown_connections 2024-08-19T00:59:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.482+0000 7f108104f640 1 -- 172.21.15.17:0/1480192175 wait complete. 2024-08-19T00:59:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.483+0000 7f108104f640 1 Processor -- start 2024-08-19T00:59:21.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.483+0000 7f108104f640 1 -- start start 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.483+0000 7f108104f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f107c0ff2b0 0x7f107c19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.483+0000 7f108104f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c0ffc60 0x7f107c19bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.483+0000 7f108104f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c195a20 con 0x7f107c0ff2b0 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.483+0000 7f108104f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c195b60 con 0x7f107c0ffc60 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.483+0000 7f107ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f107c0ff2b0 0x7f107c19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.483+0000 7f107ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f107c0ff2b0 0x7f107c19b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38532/0 (socket says 172.21.15.17:38532) 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.483+0000 7f107ad9d640 1 -- 172.21.15.17:0/74358857 learned_addr learned my addr 172.21.15.17:0/74358857 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.483+0000 7f107a59c640 1 --2- 172.21.15.17:0/74358857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c0ffc60 0x7f107c19bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.484+0000 7f107ad9d640 1 -- 172.21.15.17:0/74358857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c0ffc60 msgr2=0x7f107c19bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.484+0000 7f107ad9d640 1 --2- 172.21.15.17:0/74358857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c0ffc60 0x7f107c19bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.484+0000 7f107ad9d640 1 -- 172.21.15.17:0/74358857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c009560 con 0x7f107c0ff2b0 2024-08-19T00:59:21.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.484+0000 7f107ad9d640 1 --2- 172.21.15.17:0/74358857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f107c0ff2b0 0x7f107c19b9c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f106c02a9c0 tx=0x7f106c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.484+0000 7f1063fff640 1 -- 172.21.15.17:0/74358857 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f106c004aa0 con 0x7f107c0ff2b0 2024-08-19T00:59:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.484+0000 7f108104f640 1 -- 172.21.15.17:0/74358857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107c195de0 con 0x7f107c0ff2b0 2024-08-19T00:59:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.484+0000 7f1063fff640 1 -- 172.21.15.17:0/74358857 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f106c004c00 con 0x7f107c0ff2b0 2024-08-19T00:59:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.484+0000 7f1063fff640 1 -- 172.21.15.17:0/74358857 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f106c003a20 con 0x7f107c0ff2b0 2024-08-19T00:59:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.484+0000 7f108104f640 1 -- 172.21.15.17:0/74358857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107c1962d0 con 0x7f107c0ff2b0 2024-08-19T00:59:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.485+0000 7f108104f640 1 -- 172.21.15.17:0/74358857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107c100270 con 0x7f107c0ff2b0 2024-08-19T00:59:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.486+0000 7f1063fff640 1 -- 172.21.15.17:0/74358857 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f106c031c90 con 0x7f107c0ff2b0 2024-08-19T00:59:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.486+0000 7f1063fff640 1 --2- 172.21.15.17:0/74358857 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406ddf0 0x7f10640702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.486+0000 7f1063fff640 1 -- 172.21.15.17:0/74358857 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f106c0aec30 con 0x7f107c0ff2b0 2024-08-19T00:59:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.486+0000 7f107a59c640 1 --2- 172.21.15.17:0/74358857 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406ddf0 0x7f10640702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:21.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.487+0000 7f107a59c640 1 --2- 172.21.15.17:0/74358857 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406ddf0 0x7f10640702b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f107c197270 tx=0x7f1070009110 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:21.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.491+0000 7f1063fff640 1 -- 172.21.15.17:0/74358857 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f106c078440 con 0x7f107c0ff2b0 2024-08-19T00:59:21.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.754+0000 7f108104f640 1 -- 172.21.15.17:0/74358857 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f107c0ff690 con 0x7f107c0ff2b0 2024-08-19T00:59:21.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.754+0000 7f1063fff640 1 -- 172.21.15.17:0/74358857 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7f106c07bb00 con 0x7f107c0ff2b0 2024-08-19T00:59:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.756+0000 7f108104f640 1 -- 172.21.15.17:0/74358857 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406ddf0 msgr2=0x7f10640702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.756+0000 7f108104f640 1 --2- 172.21.15.17:0/74358857 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406ddf0 0x7f10640702b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f107c197270 tx=0x7f1070009110 comp rx=0 tx=0).stop 2024-08-19T00:59:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.756+0000 7f108104f640 1 -- 172.21.15.17:0/74358857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f107c0ff2b0 msgr2=0x7f107c19b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.756+0000 7f108104f640 1 --2- 172.21.15.17:0/74358857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f107c0ff2b0 0x7f107c19b9c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f106c02a9c0 tx=0x7f106c0055a0 comp rx=0 tx=0).stop 2024-08-19T00:59:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.756+0000 7f108104f640 1 -- 172.21.15.17:0/74358857 shutdown_connections 2024-08-19T00:59:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.756+0000 7f108104f640 1 --2- 172.21.15.17:0/74358857 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f106406ddf0 0x7f10640702b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.756+0000 7f108104f640 1 --2- 172.21.15.17:0/74358857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f107c0ffc60 0x7f107c19bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.756+0000 7f108104f640 1 --2- 172.21.15.17:0/74358857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f107c0ff2b0 0x7f107c19b9c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.756+0000 7f108104f640 1 -- 172.21.15.17:0/74358857 >> 172.21.15.17:0/74358857 conn(0x7f107c0f9e50 msgr2=0x7f107c0fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.757+0000 7f108104f640 1 -- 172.21.15.17:0/74358857 shutdown_connections 2024-08-19T00:59:21.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:21.757+0000 7f108104f640 1 -- 172.21.15.17:0/74358857 wait complete. 2024-08-19T00:59:21.767 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:59:22.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:22 smithi017 ceph-mon[16627]: pgmap v75: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:22.389 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:22 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/74358857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:22.412 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-08-19T00:59:22.622 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:59:22.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:22 smithi086 ceph-mon[24511]: pgmap v75: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:22.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:22 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/74358857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:24.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.228+0000 7f7419f69640 1 -- 172.21.15.17:0/2833851312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74141049f0 msgr2=0x7f7414104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:24.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.228+0000 7f7419f69640 1 --2- 172.21.15.17:0/2833851312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74141049f0 0x7f7414104dd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7404009880 tx=0x7f740402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:24.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.228+0000 7f7419f69640 1 -- 172.21.15.17:0/2833851312 shutdown_connections 2024-08-19T00:59:24.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.228+0000 7f7419f69640 1 --2- 172.21.15.17:0/2833851312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74140fe9f0 0x7f74140fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:24.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.228+0000 7f7419f69640 1 --2- 172.21.15.17:0/2833851312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74141049f0 0x7f7414104dd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:24.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.228+0000 7f7419f69640 1 -- 172.21.15.17:0/2833851312 >> 172.21.15.17:0/2833851312 conn(0x7f74140758a0 msgr2=0x7f74140fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:24.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.228+0000 7f7419f69640 1 -- 172.21.15.17:0/2833851312 shutdown_connections 2024-08-19T00:59:24.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.228+0000 7f7419f69640 1 -- 172.21.15.17:0/2833851312 wait complete. 2024-08-19T00:59:24.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.229+0000 7f7419f69640 1 Processor -- start 2024-08-19T00:59:24.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.229+0000 7f7419f69640 1 -- start start 2024-08-19T00:59:24.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.229+0000 7f7419f69640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74140fe9f0 0x7f7414196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:24.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.229+0000 7f7419f69640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74141049f0 0x7f7414196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:24.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.229+0000 7f7419f69640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7414197510 con 0x7f74141049f0 2024-08-19T00:59:24.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.229+0000 7f7419f69640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7414197680 con 0x7f74140fe9f0 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.229+0000 7f7412ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74141049f0 0x7f7414196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.229+0000 7f7412ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74141049f0 0x7f7414196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38552/0 (socket says 172.21.15.17:38552) 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.229+0000 7f7412ffd640 1 -- 172.21.15.17:0/2840042408 learned_addr learned my addr 172.21.15.17:0/2840042408 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.229+0000 7f74137fe640 1 --2- 172.21.15.17:0/2840042408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74140fe9f0 0x7f7414196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.230+0000 7f7412ffd640 1 -- 172.21.15.17:0/2840042408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74140fe9f0 msgr2=0x7f7414196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.230+0000 7f7412ffd640 1 --2- 172.21.15.17:0/2840042408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74140fe9f0 0x7f7414196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.230+0000 7f7412ffd640 1 -- 172.21.15.17:0/2840042408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404009560 con 0x7f74141049f0 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.230+0000 7f7412ffd640 1 --2- 172.21.15.17:0/2840042408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74141049f0 0x7f7414196f40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f740800b420 tx=0x7f740800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.230+0000 7f7410ff9640 1 -- 172.21.15.17:0/2840042408 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7408011800 con 0x7f74141049f0 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.230+0000 7f7410ff9640 1 -- 172.21.15.17:0/2840042408 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7408011e20 con 0x7f74141049f0 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.230+0000 7f7419f69640 1 -- 172.21.15.17:0/2840042408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741419fa70 con 0x7f74141049f0 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.230+0000 7f7410ff9640 1 -- 172.21.15.17:0/2840042408 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f740800f2e0 con 0x7f74141049f0 2024-08-19T00:59:24.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.230+0000 7f7419f69640 1 -- 172.21.15.17:0/2840042408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741419fee0 con 0x7f74141049f0 2024-08-19T00:59:24.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.231+0000 7f7419f69640 1 -- 172.21.15.17:0/2840042408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7414100130 con 0x7f74141049f0 2024-08-19T00:59:24.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.232+0000 7f7410ff9640 1 -- 172.21.15.17:0/2840042408 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f7408010380 con 0x7f74141049f0 2024-08-19T00:59:24.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.232+0000 7f7410ff9640 1 --2- 172.21.15.17:0/2840042408 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f73fc06ddf0 0x7f73fc0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:24.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.232+0000 7f7410ff9640 1 -- 172.21.15.17:0/2840042408 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f740808d3a0 con 0x7f74141049f0 2024-08-19T00:59:24.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.232+0000 7f74137fe640 1 --2- 172.21.15.17:0/2840042408 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f73fc06ddf0 0x7f73fc0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:24.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.233+0000 7f74137fe640 1 --2- 172.21.15.17:0/2840042408 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f73fc06ddf0 0x7f73fc0702b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7404009230 tx=0x7f74040058d0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:24.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.236+0000 7f7410ff9640 1 -- 172.21.15.17:0/2840042408 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f7408056c30 con 0x7f74141049f0 2024-08-19T00:59:24.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:24 smithi017 ceph-mon[16627]: pgmap v76: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.481+0000 7f7419f69640 1 -- 172.21.15.17:0/2840042408 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f74140feed0 con 0x7f74141049f0 2024-08-19T00:59:24.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.481+0000 7f7410ff9640 1 -- 172.21.15.17:0/2840042408 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7f740805a2f0 con 0x7f74141049f0 2024-08-19T00:59:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.483+0000 7f7419f69640 1 -- 172.21.15.17:0/2840042408 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f73fc06ddf0 msgr2=0x7f73fc0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.483+0000 7f7419f69640 1 --2- 172.21.15.17:0/2840042408 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f73fc06ddf0 0x7f73fc0702b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7404009230 tx=0x7f74040058d0 comp rx=0 tx=0).stop 2024-08-19T00:59:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.483+0000 7f7419f69640 1 -- 172.21.15.17:0/2840042408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74141049f0 msgr2=0x7f7414196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.483+0000 7f7419f69640 1 --2- 172.21.15.17:0/2840042408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74141049f0 0x7f7414196f40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f740800b420 tx=0x7f740800b8e0 comp rx=0 tx=0).stop 2024-08-19T00:59:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.483+0000 7f7419f69640 1 -- 172.21.15.17:0/2840042408 shutdown_connections 2024-08-19T00:59:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.483+0000 7f7419f69640 1 --2- 172.21.15.17:0/2840042408 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f73fc06ddf0 0x7f73fc0702b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.483+0000 7f7419f69640 1 --2- 172.21.15.17:0/2840042408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74141049f0 0x7f7414196f40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.483+0000 7f7419f69640 1 --2- 172.21.15.17:0/2840042408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74140fe9f0 0x7f7414196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.483+0000 7f7419f69640 1 -- 172.21.15.17:0/2840042408 >> 172.21.15.17:0/2840042408 conn(0x7f74140758a0 msgr2=0x7f74140fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.484+0000 7f7419f69640 1 -- 172.21.15.17:0/2840042408 shutdown_connections 2024-08-19T00:59:24.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:24.484+0000 7f7419f69640 1 -- 172.21.15.17:0/2840042408 wait complete. 2024-08-19T00:59:24.494 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)" 2024-08-19T00:59:24.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:24 smithi086 ceph-mon[24511]: pgmap v76: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:25.167 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-08-19T00:59:25.377 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:59:25.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:25 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2840042408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:25.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:25 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/2840042408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:26.426 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:26 smithi017 ceph-mon[16627]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:26.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:26 smithi086 ceph-mon[24511]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:26.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.940+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3824013316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8180ffda0 msgr2=0x7fb818100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.940+0000 7fb81ed0e640 1 --2- 172.21.15.17:0/3824013316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8180ffda0 0x7fb818100180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009880 tx=0x7fb80c02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.940+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3824013316 shutdown_connections 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.940+0000 7fb81ed0e640 1 --2- 172.21.15.17:0/3824013316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb818100750 0x7fb8181047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.940+0000 7fb81ed0e640 1 --2- 172.21.15.17:0/3824013316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8180ffda0 0x7fb818100180 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.940+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3824013316 >> 172.21.15.17:0/3824013316 conn(0x7fb8180fb840 msgr2=0x7fb8180fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.940+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3824013316 shutdown_connections 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.940+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3824013316 wait complete. 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb81ed0e640 1 Processor -- start 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb81ed0e640 1 -- start start 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb81ed0e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8180ffda0 0x7fb8180727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb81ed0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb818100750 0x7fb818072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:26.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb81ed0e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb818074780 con 0x7fb818100750 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb81ed0e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb818073230 con 0x7fb8180ffda0 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb817fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb818100750 0x7fb818072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb817fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb818100750 0x7fb818072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37346/0 (socket says 172.21.15.17:37346) 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb817fff640 1 -- 172.21.15.17:0/3142408142 learned_addr learned my addr 172.21.15.17:0/3142408142 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb81caaa640 1 --2- 172.21.15.17:0/3142408142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8180ffda0 0x7fb8180727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb817fff640 1 -- 172.21.15.17:0/3142408142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8180ffda0 msgr2=0x7fb8180727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb817fff640 1 --2- 172.21.15.17:0/3142408142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8180ffda0 0x7fb8180727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.941+0000 7fb817fff640 1 -- 172.21.15.17:0/3142408142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c009560 con 0x7fb818100750 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.942+0000 7fb817fff640 1 --2- 172.21.15.17:0/3142408142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb818100750 0x7fb818072cf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb80400c8a0 tx=0x7fb80400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.942+0000 7fb815ffb640 1 -- 172.21.15.17:0/3142408142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb804007b80 con 0x7fb818100750 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.942+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3142408142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb818073510 con 0x7fb818100750 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.942+0000 7fb815ffb640 1 -- 172.21.15.17:0/3142408142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb804007ce0 con 0x7fb818100750 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.942+0000 7fb815ffb640 1 -- 172.21.15.17:0/3142408142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb804018810 con 0x7fb818100750 2024-08-19T00:59:26.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.942+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3142408142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8181a1f50 con 0x7fb818100750 2024-08-19T00:59:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.943+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3142408142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb818101280 con 0x7fb818100750 2024-08-19T00:59:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.944+0000 7fb815ffb640 1 -- 172.21.15.17:0/3142408142 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7fb804018a80 con 0x7fb818100750 2024-08-19T00:59:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.944+0000 7fb815ffb640 1 --2- 172.21.15.17:0/3142408142 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb80806ddf0 0x7fb8080702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.944+0000 7fb815ffb640 1 -- 172.21.15.17:0/3142408142 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb80408dd90 con 0x7fb818100750 2024-08-19T00:59:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.944+0000 7fb81caaa640 1 --2- 172.21.15.17:0/3142408142 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb80806ddf0 0x7fb8080702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.945+0000 7fb81caaa640 1 --2- 172.21.15.17:0/3142408142 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb80806ddf0 0x7fb8080702b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb80c000c00 tx=0x7fb80c005a20 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:26.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:26.948+0000 7fb815ffb640 1 -- 172.21.15.17:0/3142408142 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fb8040575a0 con 0x7fb818100750 2024-08-19T00:59:27.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.198+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3142408142 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb818108150 con 0x7fb818100750 2024-08-19T00:59:27.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.199+0000 7fb815ffb640 1 -- 172.21.15.17:0/3142408142 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7fb80405ac60 con 0x7fb818100750 2024-08-19T00:59:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.201+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3142408142 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb80806ddf0 msgr2=0x7fb8080702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.201+0000 7fb81ed0e640 1 --2- 172.21.15.17:0/3142408142 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb80806ddf0 0x7fb8080702b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb80c000c00 tx=0x7fb80c005a20 comp rx=0 tx=0).stop 2024-08-19T00:59:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.201+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3142408142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb818100750 msgr2=0x7fb818072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.201+0000 7fb81ed0e640 1 --2- 172.21.15.17:0/3142408142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb818100750 0x7fb818072cf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb80400c8a0 tx=0x7fb80400cd60 comp rx=0 tx=0).stop 2024-08-19T00:59:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.201+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3142408142 shutdown_connections 2024-08-19T00:59:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.201+0000 7fb81ed0e640 1 --2- 172.21.15.17:0/3142408142 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb80806ddf0 0x7fb8080702b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.201+0000 7fb81ed0e640 1 --2- 172.21.15.17:0/3142408142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb818100750 0x7fb818072cf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.201+0000 7fb81ed0e640 1 --2- 172.21.15.17:0/3142408142 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb8180ffda0 0x7fb8180727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.201+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3142408142 >> 172.21.15.17:0/3142408142 conn(0x7fb8180fb840 msgr2=0x7fb8180fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:27.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.201+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3142408142 shutdown_connections 2024-08-19T00:59:27.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:27.201+0000 7fb81ed0e640 1 -- 172.21.15.17:0/3142408142 wait complete. 2024-08-19T00:59:27.211 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:59:27.485 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:27 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/3142408142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:27.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:27 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/3142408142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:27.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-08-19T00:59:28.008 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:59:28.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:28 smithi017 ceph-mon[16627]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:28.386 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:28 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:59:28.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:28 smithi086 ceph-mon[24511]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:28.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:28 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:59:29.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.557+0000 7fd36ceb3640 1 -- 172.21.15.17:0/4050680286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd368104a10 msgr2=0x7fd368104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:29.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.557+0000 7fd36ceb3640 1 --2- 172.21.15.17:0/4050680286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd368104a10 0x7fd368104df0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd358009880 tx=0x7fd35802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:29.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.557+0000 7fd36ceb3640 1 -- 172.21.15.17:0/4050680286 shutdown_connections 2024-08-19T00:59:29.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.557+0000 7fd36ceb3640 1 --2- 172.21.15.17:0/4050680286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3680fea10 0x7fd3680fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:29.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.557+0000 7fd36ceb3640 1 --2- 172.21.15.17:0/4050680286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd368104a10 0x7fd368104df0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:29.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.557+0000 7fd36ceb3640 1 -- 172.21.15.17:0/4050680286 >> 172.21.15.17:0/4050680286 conn(0x7fd3680fa730 msgr2=0x7fd3680fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:29.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.557+0000 7fd36ceb3640 1 -- 172.21.15.17:0/4050680286 shutdown_connections 2024-08-19T00:59:29.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.557+0000 7fd36ceb3640 1 -- 172.21.15.17:0/4050680286 wait complete. 2024-08-19T00:59:29.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.558+0000 7fd36ceb3640 1 Processor -- start 2024-08-19T00:59:29.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.558+0000 7fd36ceb3640 1 -- start start 2024-08-19T00:59:29.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.558+0000 7fd36ceb3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3680fea10 0x7fd368196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:29.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.558+0000 7fd36ceb3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd368104a10 0x7fd368196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:29.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.558+0000 7fd36ceb3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd368197470 con 0x7fd368104a10 2024-08-19T00:59:29.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.558+0000 7fd36ceb3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3681975e0 con 0x7fd3680fea10 2024-08-19T00:59:29.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.558+0000 7fd365d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd368104a10 0x7fd368196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:29.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.558+0000 7fd365d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd368104a10 0x7fd368196ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37368/0 (socket says 172.21.15.17:37368) 2024-08-19T00:59:29.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.558+0000 7fd365d9b640 1 -- 172.21.15.17:0/2938542900 learned_addr learned my addr 172.21.15.17:0/2938542900 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:29.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.558+0000 7fd36659c640 1 --2- 172.21.15.17:0/2938542900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3680fea10 0x7fd368196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:29.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.559+0000 7fd365d9b640 1 -- 172.21.15.17:0/2938542900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3680fea10 msgr2=0x7fd368196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:29.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.559+0000 7fd365d9b640 1 --2- 172.21.15.17:0/2938542900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3680fea10 0x7fd368196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:29.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.559+0000 7fd365d9b640 1 -- 172.21.15.17:0/2938542900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358009560 con 0x7fd368104a10 2024-08-19T00:59:29.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.559+0000 7fd365d9b640 1 --2- 172.21.15.17:0/2938542900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd368104a10 0x7fd368196ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00d6f0 tx=0x7fd35c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:29.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.559+0000 7fd3577fe640 1 -- 172.21.15.17:0/2938542900 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd35c009a30 con 0x7fd368104a10 2024-08-19T00:59:29.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.559+0000 7fd36ceb3640 1 -- 172.21.15.17:0/2938542900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36819f9d0 con 0x7fd368104a10 2024-08-19T00:59:29.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.559+0000 7fd3577fe640 1 -- 172.21.15.17:0/2938542900 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd35c0054e0 con 0x7fd368104a10 2024-08-19T00:59:29.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.559+0000 7fd36ceb3640 1 -- 172.21.15.17:0/2938542900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36819fe40 con 0x7fd368104a10 2024-08-19T00:59:29.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.559+0000 7fd3577fe640 1 -- 172.21.15.17:0/2938542900 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd35c010460 con 0x7fd368104a10 2024-08-19T00:59:29.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.560+0000 7fd36ceb3640 1 -- 172.21.15.17:0/2938542900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd368100150 con 0x7fd368104a10 2024-08-19T00:59:29.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.561+0000 7fd3577fe640 1 -- 172.21.15.17:0/2938542900 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7fd35c0106d0 con 0x7fd368104a10 2024-08-19T00:59:29.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.561+0000 7fd3577fe640 1 --2- 172.21.15.17:0/2938542900 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd35006ddf0 0x7fd3500702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:29.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.561+0000 7fd3577fe640 1 -- 172.21.15.17:0/2938542900 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd35c08d6a0 con 0x7fd368104a10 2024-08-19T00:59:29.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.561+0000 7fd36659c640 1 --2- 172.21.15.17:0/2938542900 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd35006ddf0 0x7fd3500702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:29.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.562+0000 7fd36659c640 1 --2- 172.21.15.17:0/2938542900 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd35006ddf0 0x7fd3500702b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd358009230 tx=0x7fd3580058d0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:29.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.568+0000 7fd3577fe640 1 -- 172.21.15.17:0/2938542900 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fd35c056f60 con 0x7fd368104a10 2024-08-19T00:59:29.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:29.766+0000 7fd36ceb3640 1 -- 172.21.15.17:0/2938542900 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "target": ["mon-mgr", ""]}) v1 -- 0x7fd36810bca0 con 0x7fd35006ddf0 2024-08-19T00:59:30.648 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:30 smithi017 ceph-mon[16627]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:30 smithi086 ceph-mon[24511]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:31.643 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:31 smithi017 ceph-mon[16627]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:31.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.673+0000 7fd3577fe640 1 -- 172.21.15.17:0/2938542900 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5739 (secure 0 0 0) 0x7fd36810bca0 con 0x7fd35006ddf0 2024-08-19T00:59:31.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.675+0000 7fd36ceb3640 1 -- 172.21.15.17:0/2938542900 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd35006ddf0 msgr2=0x7fd3500702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:31.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.675+0000 7fd36ceb3640 1 --2- 172.21.15.17:0/2938542900 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd35006ddf0 0x7fd3500702b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd358009230 tx=0x7fd3580058d0 comp rx=0 tx=0).stop 2024-08-19T00:59:31.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.675+0000 7fd36ceb3640 1 -- 172.21.15.17:0/2938542900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd368104a10 msgr2=0x7fd368196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:31.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.675+0000 7fd36ceb3640 1 --2- 172.21.15.17:0/2938542900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd368104a10 0x7fd368196ea0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00d6f0 tx=0x7fd35c00dbb0 comp rx=0 tx=0).stop 2024-08-19T00:59:31.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.675+0000 7fd36ceb3640 1 -- 172.21.15.17:0/2938542900 shutdown_connections 2024-08-19T00:59:31.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.675+0000 7fd36ceb3640 1 --2- 172.21.15.17:0/2938542900 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd35006ddf0 0x7fd3500702b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:31.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.675+0000 7fd36ceb3640 1 --2- 172.21.15.17:0/2938542900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd368104a10 0x7fd368196ea0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:31.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.675+0000 7fd36ceb3640 1 --2- 172.21.15.17:0/2938542900 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3680fea10 0x7fd368196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:31.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.675+0000 7fd36ceb3640 1 -- 172.21.15.17:0/2938542900 >> 172.21.15.17:0/2938542900 conn(0x7fd3680fa730 msgr2=0x7fd3680fb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:31.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.675+0000 7fd36ceb3640 1 -- 172.21.15.17:0/2938542900 shutdown_connections 2024-08-19T00:59:31.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:31.675+0000 7fd36ceb3640 1 -- 172.21.15.17:0/2938542900 wait complete. 2024-08-19T00:59:31.688 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:59:31.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:31 smithi086 ceph-mon[24511]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:32.242 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph orch ps' 2024-08-19T00:59:32.451 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:59:32.573 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:32 smithi017 ceph-mon[16627]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:32.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:32 smithi086 ceph-mon[24511]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:34.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.097+0000 7f71dd987640 1 -- 172.21.15.17:0/4162055591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d81016c0 msgr2=0x7f71d8109bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:34.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.097+0000 7f71dd987640 1 --2- 172.21.15.17:0/4162055591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d81016c0 0x7f71d8109bb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f71c0009880 tx=0x7f71c002a530 comp rx=0 tx=0).stop 2024-08-19T00:59:34.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.097+0000 7f71dd987640 1 -- 172.21.15.17:0/4162055591 shutdown_connections 2024-08-19T00:59:34.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.097+0000 7f71dd987640 1 --2- 172.21.15.17:0/4162055591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d81016c0 0x7f71d8109bb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:34.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.097+0000 7f71dd987640 1 --2- 172.21.15.17:0/4162055591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d8100da0 0x7f71d8101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:34.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.097+0000 7f71dd987640 1 -- 172.21.15.17:0/4162055591 >> 172.21.15.17:0/4162055591 conn(0x7f71d80fa700 msgr2=0x7f71d80fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:34.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.097+0000 7f71dd987640 1 -- 172.21.15.17:0/4162055591 shutdown_connections 2024-08-19T00:59:34.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.097+0000 7f71dd987640 1 -- 172.21.15.17:0/4162055591 wait complete. 2024-08-19T00:59:34.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.097+0000 7f71dd987640 1 Processor -- start 2024-08-19T00:59:34.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71dd987640 1 -- start start 2024-08-19T00:59:34.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71dd987640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8100da0 0x7f71d80fea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:34.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71dd987640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d81016c0 0x7f71d80fef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71dd987640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80ff480 con 0x7f71d8100da0 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71dd987640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80ff5f0 con 0x7f71d81016c0 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71d6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8100da0 0x7f71d80fea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71d6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8100da0 0x7f71d80fea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37390/0 (socket says 172.21.15.17:37390) 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71d6ffd640 1 -- 172.21.15.17:0/3215029134 learned_addr learned my addr 172.21.15.17:0/3215029134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71d67fc640 1 --2- 172.21.15.17:0/3215029134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d81016c0 0x7f71d80fef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71d6ffd640 1 -- 172.21.15.17:0/3215029134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d81016c0 msgr2=0x7f71d80fef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71d6ffd640 1 --2- 172.21.15.17:0/3215029134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d81016c0 0x7f71d80fef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.098+0000 7f71d6ffd640 1 -- 172.21.15.17:0/3215029134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0009560 con 0x7f71d8100da0 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.099+0000 7f71d6ffd640 1 --2- 172.21.15.17:0/3215029134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8100da0 0x7f71d80fea00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f71c800eb10 tx=0x7f71c800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.099+0000 7f71dc985640 1 -- 172.21.15.17:0/3215029134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c8004b20 con 0x7f71d8100da0 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.099+0000 7f71dc985640 1 -- 172.21.15.17:0/3215029134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71c8004c80 con 0x7f71d8100da0 2024-08-19T00:59:34.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.099+0000 7f71dd987640 1 -- 172.21.15.17:0/3215029134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d81a1cf0 con 0x7f71d8100da0 2024-08-19T00:59:34.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.099+0000 7f71dc985640 1 -- 172.21.15.17:0/3215029134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71c8010640 con 0x7f71d8100da0 2024-08-19T00:59:34.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.099+0000 7f71dd987640 1 -- 172.21.15.17:0/3215029134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d81a2050 con 0x7f71d8100da0 2024-08-19T00:59:34.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.100+0000 7f71dd987640 1 -- 172.21.15.17:0/3215029134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d8068c90 con 0x7f71d8100da0 2024-08-19T00:59:34.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.100+0000 7f71dc985640 1 -- 172.21.15.17:0/3215029134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f71c80055e0 con 0x7f71d8100da0 2024-08-19T00:59:34.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.101+0000 7f71dc985640 1 --2- 172.21.15.17:0/3215029134 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f71c406ddf0 0x7f71c40702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:34.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.101+0000 7f71dc985640 1 -- 172.21.15.17:0/3215029134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f71c8014070 con 0x7f71d8100da0 2024-08-19T00:59:34.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.101+0000 7f71d67fc640 1 --2- 172.21.15.17:0/3215029134 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f71c406ddf0 0x7f71c40702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:34.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.101+0000 7f71d67fc640 1 --2- 172.21.15.17:0/3215029134 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f71c406ddf0 0x7f71c40702b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f71c0000c00 tx=0x7f71c00058d0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:34.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.105+0000 7f71dc985640 1 -- 172.21.15.17:0/3215029134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f71c8057b00 con 0x7f71d8100da0 2024-08-19T00:59:34.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.292+0000 7f71dd987640 1 -- 172.21.15.17:0/3215029134 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f71d80ff7b0 con 0x7f71c406ddf0 2024-08-19T00:59:34.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.301+0000 7f71dc985640 1 -- 172.21.15.17:0/3215029134 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f71d80ff7b0 con 0x7f71c406ddf0 2024-08-19T00:59:34.304 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:59:34.304 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (52s) 24s ago 11m 16.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T00:59:34.304 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (11m) 24s ago 11m 8262k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T00:59:34.304 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (10m) 85s ago 10m 7948k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (11m) 24s ago 11m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (10m) 85s ago 10m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (30s) 24s ago 11m 48.1M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (6m) 24s ago 6m 158M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (6m) 24s ago 6m 91.7M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (5m) 85s ago 5m 26.0M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (6m) 85s ago 6m 25.7M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (2m) 24s ago 12m 506M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (103s) 85s ago 10m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (13m) 24s ago 13m 57.3M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 771bc6b905a5 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (10m) 85s ago 10m 48.0M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 c6fce0ad535d 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (91s) 24s ago 11m 15.6M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T00:59:34.305 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (88s) 85s ago 10m 3556k - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T00:59:34.306 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (9m) 24s ago 9m 218M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T00:59:34.306 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (9m) 24s ago 9m 228M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T00:59:34.306 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (8m) 24s ago 8m 189M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T00:59:34.306 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (8m) 85s ago 8m 244M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T00:59:34.306 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (8m) 85s ago 8m 217M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T00:59:34.306 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (7m) 85s ago 7m 217M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T00:59:34.306 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (69s) 24s ago 11m 49.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T00:59:34.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.304+0000 7f71dd987640 1 -- 172.21.15.17:0/3215029134 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f71c406ddf0 msgr2=0x7f71c40702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:34.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.304+0000 7f71dd987640 1 --2- 172.21.15.17:0/3215029134 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f71c406ddf0 0x7f71c40702b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f71c0000c00 tx=0x7f71c00058d0 comp rx=0 tx=0).stop 2024-08-19T00:59:34.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.304+0000 7f71dd987640 1 -- 172.21.15.17:0/3215029134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8100da0 msgr2=0x7f71d80fea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:34.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.304+0000 7f71dd987640 1 --2- 172.21.15.17:0/3215029134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8100da0 0x7f71d80fea00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f71c800eb10 tx=0x7f71c800c2d0 comp rx=0 tx=0).stop 2024-08-19T00:59:34.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.304+0000 7f71dd987640 1 -- 172.21.15.17:0/3215029134 shutdown_connections 2024-08-19T00:59:34.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.304+0000 7f71dd987640 1 --2- 172.21.15.17:0/3215029134 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f71c406ddf0 0x7f71c40702b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:34.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.304+0000 7f71dd987640 1 --2- 172.21.15.17:0/3215029134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71d81016c0 0x7f71d80fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:34.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.304+0000 7f71dd987640 1 --2- 172.21.15.17:0/3215029134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8100da0 0x7f71d80fea00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:34.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.304+0000 7f71dd987640 1 -- 172.21.15.17:0/3215029134 >> 172.21.15.17:0/3215029134 conn(0x7f71d80fa700 msgr2=0x7f71d8101fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:34.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.304+0000 7f71dd987640 1 -- 172.21.15.17:0/3215029134 shutdown_connections 2024-08-19T00:59:34.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:34.304+0000 7f71dd987640 1 -- 172.21.15.17:0/3215029134 wait complete. 2024-08-19T00:59:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:34 smithi086 ceph-mon[24511]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:34.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:34 smithi017 ceph-mon[16627]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:34.967 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-19T00:59:34.968 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:59:34.968 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-08-19T00:59:35.180 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:59:35.319 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:35 smithi017 ceph-mon[16627]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:35.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:35 smithi086 ceph-mon[24511]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:36.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:36 smithi017 ceph-mon[16627]: pgmap v82: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:36.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.668+0000 7f053fcd3640 1 -- 172.21.15.17:0/228794288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0538100750 msgr2=0x7f05381047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.668+0000 7f053fcd3640 1 --2- 172.21.15.17:0/228794288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0538100750 0x7f05381047a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0528009880 tx=0x7f052802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.668+0000 7f053fcd3640 1 -- 172.21.15.17:0/228794288 shutdown_connections 2024-08-19T00:59:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.668+0000 7f053fcd3640 1 --2- 172.21.15.17:0/228794288 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0538100750 0x7f05381047a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.668+0000 7f053fcd3640 1 --2- 172.21.15.17:0/228794288 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05380ffda0 0x7f0538100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.668+0000 7f053fcd3640 1 -- 172.21.15.17:0/228794288 >> 172.21.15.17:0/228794288 conn(0x7f05380fb840 msgr2=0x7f05380fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.668+0000 7f053fcd3640 1 -- 172.21.15.17:0/228794288 shutdown_connections 2024-08-19T00:59:36.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.668+0000 7f053fcd3640 1 -- 172.21.15.17:0/228794288 wait complete. 2024-08-19T00:59:36.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.669+0000 7f053fcd3640 1 Processor -- start 2024-08-19T00:59:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.669+0000 7f053fcd3640 1 -- start start 2024-08-19T00:59:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.669+0000 7f053fcd3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05380ffda0 0x7f053819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.669+0000 7f053fcd3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0538100750 0x7f053819df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.669+0000 7f053fcd3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0538197b40 con 0x7f05380ffda0 2024-08-19T00:59:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.669+0000 7f053fcd3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0538197cb0 con 0x7f0538100750 2024-08-19T00:59:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.669+0000 7f053da6f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05380ffda0 0x7f053819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.669+0000 7f053da6f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05380ffda0 0x7f053819da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37396/0 (socket says 172.21.15.17:37396) 2024-08-19T00:59:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.669+0000 7f053da6f640 1 -- 172.21.15.17:0/4032446097 learned_addr learned my addr 172.21.15.17:0/4032446097 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.669+0000 7f053d26e640 1 --2- 172.21.15.17:0/4032446097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0538100750 0x7f053819df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.670+0000 7f053da6f640 1 -- 172.21.15.17:0/4032446097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0538100750 msgr2=0x7f053819df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:36.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.670+0000 7f053da6f640 1 --2- 172.21.15.17:0/4032446097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0538100750 0x7f053819df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:36.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.670+0000 7f053da6f640 1 -- 172.21.15.17:0/4032446097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009560 con 0x7f05380ffda0 2024-08-19T00:59:36.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.670+0000 7f053da6f640 1 --2- 172.21.15.17:0/4032446097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05380ffda0 0x7f053819da50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f053400e970 tx=0x7f053400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:36.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.670+0000 7f052effd640 1 -- 172.21.15.17:0/4032446097 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f053400cc90 con 0x7f05380ffda0 2024-08-19T00:59:36.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.670+0000 7f052effd640 1 -- 172.21.15.17:0/4032446097 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f053400cdf0 con 0x7f05380ffda0 2024-08-19T00:59:36.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.670+0000 7f052effd640 1 -- 172.21.15.17:0/4032446097 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0534010430 con 0x7f05380ffda0 2024-08-19T00:59:36.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.670+0000 7f053fcd3640 1 -- 172.21.15.17:0/4032446097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0538197f90 con 0x7f05380ffda0 2024-08-19T00:59:36.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.670+0000 7f053fcd3640 1 -- 172.21.15.17:0/4032446097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05381984b0 con 0x7f05380ffda0 2024-08-19T00:59:36.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.671+0000 7f053fcd3640 1 -- 172.21.15.17:0/4032446097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0538101280 con 0x7f05380ffda0 2024-08-19T00:59:36.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.672+0000 7f052effd640 1 -- 172.21.15.17:0/4032446097 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f05340046c0 con 0x7f05380ffda0 2024-08-19T00:59:36.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.672+0000 7f052effd640 1 --2- 172.21.15.17:0/4032446097 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f052406ddf0 0x7f05240702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:36.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.672+0000 7f052effd640 1 -- 172.21.15.17:0/4032446097 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0534014070 con 0x7f05380ffda0 2024-08-19T00:59:36.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.672+0000 7f053d26e640 1 --2- 172.21.15.17:0/4032446097 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f052406ddf0 0x7f05240702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:36.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.673+0000 7f053d26e640 1 --2- 172.21.15.17:0/4032446097 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f052406ddf0 0x7f05240702b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0528009230 tx=0x7f05280058d0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:36.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.676+0000 7f052effd640 1 -- 172.21.15.17:0/4032446097 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f0534057880 con 0x7f05380ffda0 2024-08-19T00:59:36.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:36 smithi086 ceph-mon[24511]: pgmap v82: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:36.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.852+0000 7f053fcd3640 1 -- 172.21.15.17:0/4032446097 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f0538198fb0 con 0x7f05380ffda0 2024-08-19T00:59:36.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.857+0000 7f052effd640 1 -- 172.21.15.17:0/4032446097 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v51)=0 v51) v1 ==== 125+0+0 (secure 0 0 0) 0x7f053405af40 con 0x7f05380ffda0 2024-08-19T00:59:36.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.859+0000 7f053fcd3640 1 -- 172.21.15.17:0/4032446097 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f052406ddf0 msgr2=0x7f05240702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:36.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.859+0000 7f053fcd3640 1 --2- 172.21.15.17:0/4032446097 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f052406ddf0 0x7f05240702b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0528009230 tx=0x7f05280058d0 comp rx=0 tx=0).stop 2024-08-19T00:59:36.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.859+0000 7f053fcd3640 1 -- 172.21.15.17:0/4032446097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05380ffda0 msgr2=0x7f053819da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:36.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.859+0000 7f053fcd3640 1 --2- 172.21.15.17:0/4032446097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05380ffda0 0x7f053819da50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f053400e970 tx=0x7f053400ed70 comp rx=0 tx=0).stop 2024-08-19T00:59:36.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.859+0000 7f053fcd3640 1 -- 172.21.15.17:0/4032446097 shutdown_connections 2024-08-19T00:59:36.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.859+0000 7f053fcd3640 1 --2- 172.21.15.17:0/4032446097 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f052406ddf0 0x7f05240702b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:36.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.859+0000 7f053fcd3640 1 --2- 172.21.15.17:0/4032446097 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0538100750 0x7f053819df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:36.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.859+0000 7f053fcd3640 1 --2- 172.21.15.17:0/4032446097 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05380ffda0 0x7f053819da50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:36.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.859+0000 7f053fcd3640 1 -- 172.21.15.17:0/4032446097 >> 172.21.15.17:0/4032446097 conn(0x7f05380fb840 msgr2=0x7f05380fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:36.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.859+0000 7f053fcd3640 1 -- 172.21.15.17:0/4032446097 shutdown_connections 2024-08-19T00:59:36.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:36.859+0000 7f053fcd3640 1 -- 172.21.15.17:0/4032446097 wait complete. 2024-08-19T00:59:37.522 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-19T00:59:37.523 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:59:37.523 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-08-19T00:59:37.735 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:59:38.119 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:37 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/4032446097' entity='client.admin' 2024-08-19T00:59:38.119 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:37 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:38.119 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:37 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:38.119 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:37 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:59:38.119 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:37 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:38.119 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:37 smithi017 ceph-mon[16627]: pgmap v83: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:38.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:37 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/4032446097' entity='client.admin' 2024-08-19T00:59:38.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:37 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:38.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:37 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:38.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:37 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:59:38.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:37 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:38.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:37 smithi086 ceph-mon[24511]: pgmap v83: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:39.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.406+0000 7f50579df640 1 -- 172.21.15.17:0/3931760951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50500fe880 msgr2=0x7f50500fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.406+0000 7f50579df640 1 --2- 172.21.15.17:0/3931760951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50500fe880 0x7f50500fec60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5048009880 tx=0x7f504802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 -- 172.21.15.17:0/3931760951 shutdown_connections 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 --2- 172.21.15.17:0/3931760951 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50500ff230 0x7f505010bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 --2- 172.21.15.17:0/3931760951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50500fe880 0x7f50500fec60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 -- 172.21.15.17:0/3931760951 >> 172.21.15.17:0/3931760951 conn(0x7f50500fa730 msgr2=0x7f50500fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 -- 172.21.15.17:0/3931760951 shutdown_connections 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 -- 172.21.15.17:0/3931760951 wait complete. 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 Processor -- start 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 -- start start 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50500fe880 0x7f505019d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50500ff230 0x7f505019df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505019e540 con 0x7f50500ff230 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.407+0000 7f50579df640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5050197ad0 con 0x7f50500fe880 2024-08-19T00:59:39.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f5054f7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50500ff230 0x7f505019df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f5054f7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50500ff230 0x7f505019df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41284/0 (socket says 172.21.15.17:41284) 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f5054f7a640 1 -- 172.21.15.17:0/1900454296 learned_addr learned my addr 172.21.15.17:0/1900454296 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f505577b640 1 --2- 172.21.15.17:0/1900454296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50500fe880 0x7f505019d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f5054f7a640 1 -- 172.21.15.17:0/1900454296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50500fe880 msgr2=0x7f505019d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f5054f7a640 1 --2- 172.21.15.17:0/1900454296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50500fe880 0x7f505019d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f5054f7a640 1 -- 172.21.15.17:0/1900454296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5048009560 con 0x7f50500ff230 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f5054f7a640 1 --2- 172.21.15.17:0/1900454296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50500ff230 0x7f505019df20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f504400d8d0 tx=0x7f504400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f504e7fc640 1 -- 172.21.15.17:0/1900454296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504400bea0 con 0x7f50500ff230 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f50579df640 1 -- 172.21.15.17:0/1900454296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5050197db0 con 0x7f50500ff230 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f504e7fc640 1 -- 172.21.15.17:0/1900454296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5044009c00 con 0x7f50500ff230 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f504e7fc640 1 -- 172.21.15.17:0/1900454296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f504400f710 con 0x7f50500ff230 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.408+0000 7f50579df640 1 -- 172.21.15.17:0/1900454296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5050198300 con 0x7f50500ff230 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.410+0000 7f50579df640 1 -- 172.21.15.17:0/1900454296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5050068d30 con 0x7f50500ff230 2024-08-19T00:59:39.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.410+0000 7f504e7fc640 1 -- 172.21.15.17:0/1900454296 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f5044010460 con 0x7f50500ff230 2024-08-19T00:59:39.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.410+0000 7f504e7fc640 1 --2- 172.21.15.17:0/1900454296 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f503806ddf0 0x7f50380702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:39.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.411+0000 7f504e7fc640 1 -- 172.21.15.17:0/1900454296 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f504408d850 con 0x7f50500ff230 2024-08-19T00:59:39.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.411+0000 7f505577b640 1 --2- 172.21.15.17:0/1900454296 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f503806ddf0 0x7f50380702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:39.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.411+0000 7f505577b640 1 --2- 172.21.15.17:0/1900454296 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f503806ddf0 0x7f50380702b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5048000c00 tx=0x7f5048005a20 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:39.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.415+0000 7f504e7fc640 1 -- 172.21.15.17:0/1900454296 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f50440570e0 con 0x7f50500ff230 2024-08-19T00:59:39.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.592+0000 7f50579df640 1 -- 172.21.15.17:0/1900454296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f50500fec60 con 0x7f50500ff230 2024-08-19T00:59:39.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.592+0000 7f504e7fc640 1 -- 172.21.15.17:0/1900454296 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v51)=0 v51) v1 ==== 155+0+0 (secure 0 0 0) 0x7f504405a7a0 con 0x7f50500ff230 2024-08-19T00:59:39.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.594+0000 7f50579df640 1 -- 172.21.15.17:0/1900454296 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f503806ddf0 msgr2=0x7f50380702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:39.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.594+0000 7f50579df640 1 --2- 172.21.15.17:0/1900454296 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f503806ddf0 0x7f50380702b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5048000c00 tx=0x7f5048005a20 comp rx=0 tx=0).stop 2024-08-19T00:59:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.594+0000 7f50579df640 1 -- 172.21.15.17:0/1900454296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50500ff230 msgr2=0x7f505019df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.594+0000 7f50579df640 1 --2- 172.21.15.17:0/1900454296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50500ff230 0x7f505019df20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f504400d8d0 tx=0x7f504400dd90 comp rx=0 tx=0).stop 2024-08-19T00:59:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.594+0000 7f50579df640 1 -- 172.21.15.17:0/1900454296 shutdown_connections 2024-08-19T00:59:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.594+0000 7f50579df640 1 --2- 172.21.15.17:0/1900454296 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f503806ddf0 0x7f50380702b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.594+0000 7f50579df640 1 --2- 172.21.15.17:0/1900454296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50500ff230 0x7f505019df20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.594+0000 7f50579df640 1 --2- 172.21.15.17:0/1900454296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50500fe880 0x7f505019d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.594+0000 7f50579df640 1 -- 172.21.15.17:0/1900454296 >> 172.21.15.17:0/1900454296 conn(0x7f50500fa730 msgr2=0x7f50500fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.594+0000 7f50579df640 1 -- 172.21.15.17:0/1900454296 shutdown_connections 2024-08-19T00:59:39.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:39.594+0000 7f50579df640 1 -- 172.21.15.17:0/1900454296 wait complete. 2024-08-19T00:59:40.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-08-19T00:59:40.429 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:59:40.551 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:40 smithi017 ceph-mon[16627]: pgmap v84: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:40.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:40 smithi086 ceph-mon[24511]: pgmap v84: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.027+0000 7f6d83079640 1 -- 172.21.15.17:0/1246172610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d7c0fe9f0 msgr2=0x7f6d7c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.027+0000 7f6d83079640 1 --2- 172.21.15.17:0/1246172610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d7c0fe9f0 0x7f6d7c0fee50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009880 tx=0x7f6d6802a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.027+0000 7f6d83079640 1 -- 172.21.15.17:0/1246172610 shutdown_connections 2024-08-19T00:59:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.027+0000 7f6d83079640 1 --2- 172.21.15.17:0/1246172610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d7c0fe9f0 0x7f6d7c0fee50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:42.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.027+0000 7f6d83079640 1 --2- 172.21.15.17:0/1246172610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7c1049f0 0x7f6d7c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.027+0000 7f6d83079640 1 -- 172.21.15.17:0/1246172610 >> 172.21.15.17:0/1246172610 conn(0x7f6d7c0758a0 msgr2=0x7f6d7c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.027+0000 7f6d83079640 1 -- 172.21.15.17:0/1246172610 shutdown_connections 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.027+0000 7f6d83079640 1 -- 172.21.15.17:0/1246172610 wait complete. 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.027+0000 7f6d83079640 1 Processor -- start 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.027+0000 7f6d83079640 1 -- start start 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d83079640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7c0fe9f0 0x7f6d7c0fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d83079640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d7c1049f0 0x7f6d7c0fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d83079640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c0fb800 con 0x7f6d7c1049f0 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d83079640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c0fb940 con 0x7f6d7c0fe9f0 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d7bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d7c1049f0 0x7f6d7c0fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d7bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d7c1049f0 0x7f6d7c0fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41300/0 (socket says 172.21.15.17:41300) 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d7bfff640 1 -- 172.21.15.17:0/1107736213 learned_addr learned my addr 172.21.15.17:0/1107736213 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d80e15640 1 --2- 172.21.15.17:0/1107736213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7c0fe9f0 0x7f6d7c0fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:42.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d7bfff640 1 -- 172.21.15.17:0/1107736213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7c0fe9f0 msgr2=0x7f6d7c0fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:42.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d7bfff640 1 --2- 172.21.15.17:0/1107736213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7c0fe9f0 0x7f6d7c0fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:42.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d7bfff640 1 -- 172.21.15.17:0/1107736213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d68009560 con 0x7f6d7c1049f0 2024-08-19T00:59:42.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d7bfff640 1 --2- 172.21.15.17:0/1107736213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d7c1049f0 0x7f6d7c0fb2c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6d6802a9c0 tx=0x7f6d680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d79ffb640 1 -- 172.21.15.17:0/1107736213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d68004aa0 con 0x7f6d7c1049f0 2024-08-19T00:59:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.028+0000 7f6d83079640 1 -- 172.21.15.17:0/1107736213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d7c0fbbc0 con 0x7f6d7c1049f0 2024-08-19T00:59:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.029+0000 7f6d79ffb640 1 -- 172.21.15.17:0/1107736213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d68004c00 con 0x7f6d7c1049f0 2024-08-19T00:59:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.029+0000 7f6d79ffb640 1 -- 172.21.15.17:0/1107736213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d68003980 con 0x7f6d7c1049f0 2024-08-19T00:59:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.029+0000 7f6d83079640 1 -- 172.21.15.17:0/1107736213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7c1a1fb0 con 0x7f6d7c1049f0 2024-08-19T00:59:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.030+0000 7f6d83079640 1 -- 172.21.15.17:0/1107736213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d7c100130 con 0x7f6d7c1049f0 2024-08-19T00:59:42.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.030+0000 7f6d79ffb640 1 -- 172.21.15.17:0/1107736213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f6d68003bf0 con 0x7f6d7c1049f0 2024-08-19T00:59:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.031+0000 7f6d79ffb640 1 --2- 172.21.15.17:0/1107736213 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f6d6c06ddf0 0x7f6d6c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.031+0000 7f6d79ffb640 1 -- 172.21.15.17:0/1107736213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6d680aec10 con 0x7f6d7c1049f0 2024-08-19T00:59:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.031+0000 7f6d80e15640 1 --2- 172.21.15.17:0/1107736213 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f6d6c06ddf0 0x7f6d6c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:42.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.032+0000 7f6d80e15640 1 --2- 172.21.15.17:0/1107736213 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f6d6c06ddf0 0x7f6d6c0702b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6d70005fd0 tx=0x7f6d70005850 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:42.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.036+0000 7f6d79ffb640 1 -- 172.21.15.17:0/1107736213 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f6d68078420 con 0x7f6d7c1049f0 2024-08-19T00:59:42.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.217+0000 7f6d83079640 1 -- 172.21.15.17:0/1107736213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f6d7c0fee50 con 0x7f6d7c1049f0 2024-08-19T00:59:42.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.217+0000 7f6d79ffb640 1 -- 172.21.15.17:0/1107736213 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v51)=0 v51) v1 ==== 163+0+0 (secure 0 0 0) 0x7f6d6807bae0 con 0x7f6d7c1049f0 2024-08-19T00:59:42.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.219+0000 7f6d83079640 1 -- 172.21.15.17:0/1107736213 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f6d6c06ddf0 msgr2=0x7f6d6c0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:42.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.219+0000 7f6d83079640 1 --2- 172.21.15.17:0/1107736213 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f6d6c06ddf0 0x7f6d6c0702b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6d70005fd0 tx=0x7f6d70005850 comp rx=0 tx=0).stop 2024-08-19T00:59:42.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.219+0000 7f6d83079640 1 -- 172.21.15.17:0/1107736213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d7c1049f0 msgr2=0x7f6d7c0fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:42.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.219+0000 7f6d83079640 1 --2- 172.21.15.17:0/1107736213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d7c1049f0 0x7f6d7c0fb2c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6d6802a9c0 tx=0x7f6d680055a0 comp rx=0 tx=0).stop 2024-08-19T00:59:42.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.219+0000 7f6d83079640 1 -- 172.21.15.17:0/1107736213 shutdown_connections 2024-08-19T00:59:42.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.219+0000 7f6d83079640 1 --2- 172.21.15.17:0/1107736213 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f6d6c06ddf0 0x7f6d6c0702b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:42.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.219+0000 7f6d83079640 1 --2- 172.21.15.17:0/1107736213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d7c1049f0 0x7f6d7c0fb2c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:42.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.220+0000 7f6d83079640 1 --2- 172.21.15.17:0/1107736213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d7c0fe9f0 0x7f6d7c0fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:42.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.220+0000 7f6d83079640 1 -- 172.21.15.17:0/1107736213 >> 172.21.15.17:0/1107736213 conn(0x7f6d7c0758a0 msgr2=0x7f6d7c0fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:42.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.220+0000 7f6d83079640 1 -- 172.21.15.17:0/1107736213 shutdown_connections 2024-08-19T00:59:42.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:42.220+0000 7f6d83079640 1 -- 172.21.15.17:0/1107736213 wait complete. 2024-08-19T00:59:42.574 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:42 smithi017 ceph-mon[16627]: pgmap v85: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:42.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:42 smithi086 ceph-mon[24511]: pgmap v85: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:42.852 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph config set global log_to_journald false --force' 2024-08-19T00:59:43.065 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:59:43.445 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:43 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:59:43.597 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:43 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:59:44.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:44 smithi017 ceph-mon[16627]: pgmap v86: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:44.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.519+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/3246372208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d340ffda0 msgr2=0x7f2d34100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:44.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.519+0000 7f2d3b5eb640 1 --2- 172.21.15.17:0/3246372208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d340ffda0 0x7f2d34100180 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009c20 tx=0x7f2d2402a970 comp rx=0 tx=0).stop 2024-08-19T00:59:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.519+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/3246372208 shutdown_connections 2024-08-19T00:59:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.519+0000 7f2d3b5eb640 1 --2- 172.21.15.17:0/3246372208 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d34100750 0x7f2d341047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.519+0000 7f2d3b5eb640 1 --2- 172.21.15.17:0/3246372208 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d340ffda0 0x7f2d34100180 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.519+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/3246372208 >> 172.21.15.17:0/3246372208 conn(0x7f2d340fb840 msgr2=0x7f2d340fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.519+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/3246372208 shutdown_connections 2024-08-19T00:59:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.519+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/3246372208 wait complete. 2024-08-19T00:59:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d3b5eb640 1 Processor -- start 2024-08-19T00:59:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d3b5eb640 1 -- start start 2024-08-19T00:59:44.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d3b5eb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d340ffda0 0x7f2d340727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:44.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d3b5eb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34100750 0x7f2d34072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:44.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d3b5eb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34073230 con 0x7f2d34100750 2024-08-19T00:59:44.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d3b5eb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340733a0 con 0x7f2d340ffda0 2024-08-19T00:59:44.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d38b86640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34100750 0x7f2d34072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:44.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d38b86640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34100750 0x7f2d34072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41318/0 (socket says 172.21.15.17:41318) 2024-08-19T00:59:44.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d38b86640 1 -- 172.21.15.17:0/1936180215 learned_addr learned my addr 172.21.15.17:0/1936180215 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:44.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d39387640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d340ffda0 0x7f2d340727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:44.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d38b86640 1 -- 172.21.15.17:0/1936180215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d340ffda0 msgr2=0x7f2d340727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d38b86640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d340ffda0 0x7f2d340727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d38b86640 1 -- 172.21.15.17:0/1936180215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d24009900 con 0x7f2d34100750 2024-08-19T00:59:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d39387640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d340ffda0 0x7f2d340727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:59:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.520+0000 7f2d38b86640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34100750 0x7f2d34072cf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800d6f0 tx=0x7f2d2800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.521+0000 7f2d327fc640 1 -- 172.21.15.17:0/1936180215 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d28009a30 con 0x7f2d34100750 2024-08-19T00:59:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.521+0000 7f2d327fc640 1 -- 172.21.15.17:0/1936180215 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d280054e0 con 0x7f2d34100750 2024-08-19T00:59:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.521+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/1936180215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d341a1cb0 con 0x7f2d34100750 2024-08-19T00:59:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.521+0000 7f2d327fc640 1 -- 172.21.15.17:0/1936180215 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d28010460 con 0x7f2d34100750 2024-08-19T00:59:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.521+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/1936180215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d341a2010 con 0x7f2d34100750 2024-08-19T00:59:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.522+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/1936180215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d34101280 con 0x7f2d34100750 2024-08-19T00:59:44.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.522+0000 7f2d327fc640 1 -- 172.21.15.17:0/1936180215 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f2d28009b90 con 0x7f2d34100750 2024-08-19T00:59:44.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.523+0000 7f2d327fc640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2d1c06ddf0 0x7f2d1c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:44.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.523+0000 7f2d327fc640 1 -- 172.21.15.17:0/1936180215 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2d2808d750 con 0x7f2d34100750 2024-08-19T00:59:44.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.523+0000 7f2d39387640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2d1c06ddf0 0x7f2d1c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:44.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.523+0000 7f2d39387640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2d1c06ddf0 0x7f2d1c0702b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2d240098d0 tx=0x7f2d24009360 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:44.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.527+0000 7f2d327fc640 1 -- 172.21.15.17:0/1936180215 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f2d28056f60 con 0x7f2d34100750 2024-08-19T00:59:44.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:44 smithi086 ceph-mon[24511]: pgmap v86: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.705+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/1936180215 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f2d34100180 con 0x7f2d34100750 2024-08-19T00:59:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.705+0000 7f2d327fc640 1 -- 172.21.15.17:0/1936180215 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v51)=0 v51) v1 ==== 135+0+0 (secure 0 0 0) 0x7f2d2805a620 con 0x7f2d34100750 2024-08-19T00:59:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.707+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/1936180215 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2d1c06ddf0 msgr2=0x7f2d1c0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.707+0000 7f2d3b5eb640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2d1c06ddf0 0x7f2d1c0702b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2d240098d0 tx=0x7f2d24009360 comp rx=0 tx=0).stop 2024-08-19T00:59:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.707+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/1936180215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34100750 msgr2=0x7f2d34072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.707+0000 7f2d3b5eb640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34100750 0x7f2d34072cf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800d6f0 tx=0x7f2d2800dbb0 comp rx=0 tx=0).stop 2024-08-19T00:59:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.707+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/1936180215 shutdown_connections 2024-08-19T00:59:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.707+0000 7f2d3b5eb640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f2d1c06ddf0 0x7f2d1c0702b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:44.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.707+0000 7f2d3b5eb640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d34100750 0x7f2d34072cf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.707+0000 7f2d3b5eb640 1 --2- 172.21.15.17:0/1936180215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2d340ffda0 0x7f2d340727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.707+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/1936180215 >> 172.21.15.17:0/1936180215 conn(0x7f2d340fb840 msgr2=0x7f2d340fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.708+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/1936180215 shutdown_connections 2024-08-19T00:59:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:44.708+0000 7f2d3b5eb640 1 -- 172.21.15.17:0/1936180215 wait complete. 2024-08-19T00:59:45.329 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-08-19T00:59:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:59:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:46 smithi017 ceph-mon[16627]: pgmap v87: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:46.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:46 smithi086 ceph-mon[24511]: pgmap v87: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.157+0000 7feb3815d640 1 -- 172.21.15.17:0/4112590009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb30100cb0 msgr2=0x7feb30101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.157+0000 7feb3815d640 1 --2- 172.21.15.17:0/4112590009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb30100cb0 0x7feb30101090 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009880 tx=0x7feb2c02a530 comp rx=0 tx=0).stop 2024-08-19T00:59:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.157+0000 7feb3815d640 1 -- 172.21.15.17:0/4112590009 shutdown_connections 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.157+0000 7feb3815d640 1 --2- 172.21.15.17:0/4112590009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb301015d0 0x7feb30109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.157+0000 7feb3815d640 1 --2- 172.21.15.17:0/4112590009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb30100cb0 0x7feb30101090 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.157+0000 7feb3815d640 1 -- 172.21.15.17:0/4112590009 >> 172.21.15.17:0/4112590009 conn(0x7feb300758a0 msgr2=0x7feb300fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.157+0000 7feb3815d640 1 -- 172.21.15.17:0/4112590009 shutdown_connections 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.157+0000 7feb3815d640 1 -- 172.21.15.17:0/4112590009 wait complete. 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.158+0000 7feb3815d640 1 Processor -- start 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.158+0000 7feb3815d640 1 -- start start 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.158+0000 7feb3815d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb30100cb0 0x7feb3019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.158+0000 7feb3815d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb301015d0 0x7feb3019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.158+0000 7feb3815d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3019c410 con 0x7feb301015d0 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.158+0000 7feb3815d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb301959a0 con 0x7feb30100cb0 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.158+0000 7feb356f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb301015d0 0x7feb3019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.158+0000 7feb356f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb301015d0 0x7feb3019bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60714/0 (socket says 172.21.15.17:60714) 2024-08-19T00:59:47.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.158+0000 7feb356f8640 1 -- 172.21.15.17:0/1683838302 learned_addr learned my addr 172.21.15.17:0/1683838302 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.158+0000 7feb35ef9640 1 --2- 172.21.15.17:0/1683838302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb30100cb0 0x7feb3019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.159+0000 7feb356f8640 1 -- 172.21.15.17:0/1683838302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb30100cb0 msgr2=0x7feb3019b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.159+0000 7feb356f8640 1 --2- 172.21.15.17:0/1683838302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb30100cb0 0x7feb3019b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.159+0000 7feb356f8640 1 -- 172.21.15.17:0/1683838302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c009560 con 0x7feb301015d0 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.159+0000 7feb356f8640 1 --2- 172.21.15.17:0/1683838302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb301015d0 0x7feb3019bdf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb2000d6c0 tx=0x7feb2000db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.159+0000 7feb26ffd640 1 -- 172.21.15.17:0/1683838302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb200099f0 con 0x7feb301015d0 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.159+0000 7feb26ffd640 1 -- 172.21.15.17:0/1683838302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb20009b50 con 0x7feb301015d0 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.159+0000 7feb3815d640 1 -- 172.21.15.17:0/1683838302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb30195c80 con 0x7feb301015d0 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.159+0000 7feb26ffd640 1 -- 172.21.15.17:0/1683838302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb2000f6f0 con 0x7feb301015d0 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.159+0000 7feb3815d640 1 -- 172.21.15.17:0/1683838302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb301961d0 con 0x7feb301015d0 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.160+0000 7feb3815d640 1 -- 172.21.15.17:0/1683838302 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb30068510 con 0x7feb301015d0 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.161+0000 7feb26ffd640 1 -- 172.21.15.17:0/1683838302 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7feb2000f970 con 0x7feb301015d0 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.161+0000 7feb26ffd640 1 --2- 172.21.15.17:0/1683838302 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7feb1c06ddf0 0x7feb1c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.161+0000 7feb26ffd640 1 -- 172.21.15.17:0/1683838302 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7feb2008d830 con 0x7feb301015d0 2024-08-19T00:59:47.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.161+0000 7feb35ef9640 1 --2- 172.21.15.17:0/1683838302 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7feb1c06ddf0 0x7feb1c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:47.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.162+0000 7feb35ef9640 1 --2- 172.21.15.17:0/1683838302 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7feb1c06ddf0 0x7feb1c0702b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009230 tx=0x7feb2c0058d0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:47.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.166+0000 7feb26ffd640 1 -- 172.21.15.17:0/1683838302 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7feb20058130 con 0x7feb301015d0 2024-08-19T00:59:47.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.364+0000 7feb3815d640 1 -- 172.21.15.17:0/1683838302 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "target": ["mon-mgr", ""]}) v1 -- 0x7feb3010ce20 con 0x7feb1c06ddf0 2024-08-19T00:59:47.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.369+0000 7feb26ffd640 1 -- 172.21.15.17:0/1683838302 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7feb3010ce20 con 0x7feb1c06ddf0 2024-08-19T00:59:47.371 INFO:teuthology.orchestra.run.smithi017.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:59:47.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.371+0000 7feb3815d640 1 -- 172.21.15.17:0/1683838302 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7feb1c06ddf0 msgr2=0x7feb1c0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:47.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.371+0000 7feb3815d640 1 --2- 172.21.15.17:0/1683838302 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7feb1c06ddf0 0x7feb1c0702b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009230 tx=0x7feb2c0058d0 comp rx=0 tx=0).stop 2024-08-19T00:59:47.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.371+0000 7feb3815d640 1 -- 172.21.15.17:0/1683838302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb301015d0 msgr2=0x7feb3019bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:47.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.371+0000 7feb3815d640 1 --2- 172.21.15.17:0/1683838302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb301015d0 0x7feb3019bdf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb2000d6c0 tx=0x7feb2000db80 comp rx=0 tx=0).stop 2024-08-19T00:59:47.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.371+0000 7feb3815d640 1 -- 172.21.15.17:0/1683838302 shutdown_connections 2024-08-19T00:59:47.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.371+0000 7feb3815d640 1 --2- 172.21.15.17:0/1683838302 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7feb1c06ddf0 0x7feb1c0702b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:47.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.371+0000 7feb3815d640 1 --2- 172.21.15.17:0/1683838302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb301015d0 0x7feb3019bdf0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:47.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.371+0000 7feb3815d640 1 --2- 172.21.15.17:0/1683838302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb30100cb0 0x7feb3019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:47.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.372+0000 7feb3815d640 1 -- 172.21.15.17:0/1683838302 >> 172.21.15.17:0/1683838302 conn(0x7feb300758a0 msgr2=0x7feb30101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:47.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.372+0000 7feb3815d640 1 -- 172.21.15.17:0/1683838302 shutdown_connections 2024-08-19T00:59:47.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:47.372+0000 7feb3815d640 1 -- 172.21.15.17:0/1683838302 wait complete. 2024-08-19T00:59:48.349 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-08-19T00:59:48.350 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T00:59:48.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-08-19T00:59:48.583 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:48 smithi017 ceph-mon[16627]: pgmap v88: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:48.583 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:48 smithi017 ceph-mon[16627]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:48.583 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:48 smithi017 ceph-mon[16627]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:59:48.583 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:48.583 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:48.583 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:48.583 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:59:48.583 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:48 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:48.584 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:48 smithi017 ceph-mon[16627]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:59:48.626 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T00:59:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:48 smithi086 ceph-mon[24511]: pgmap v88: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:48 smithi086 ceph-mon[24511]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:48 smithi086 ceph-mon[24511]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:59:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T00:59:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:48 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:48 smithi086 ceph-mon[24511]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:de09dd018de4baddfa6ca4d43bc8fb784cf75833 2024-08-19T00:59:50.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:50 smithi017 ceph-mon[16627]: pgmap v89: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:50 smithi086 ceph-mon[24511]: pgmap v89: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.558+0000 7f1536e08640 1 -- 172.21.15.17:0/1370949230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1530100750 msgr2=0x7f15301047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.558+0000 7f1536e08640 1 --2- 172.21.15.17:0/1370949230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1530100750 0x7f15301047a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1520009880 tx=0x7f152002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.558+0000 7f1536e08640 1 -- 172.21.15.17:0/1370949230 shutdown_connections 2024-08-19T00:59:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.558+0000 7f1536e08640 1 --2- 172.21.15.17:0/1370949230 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1530100750 0x7f15301047a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.558+0000 7f1536e08640 1 --2- 172.21.15.17:0/1370949230 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15300ffda0 0x7f1530100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.558+0000 7f1536e08640 1 -- 172.21.15.17:0/1370949230 >> 172.21.15.17:0/1370949230 conn(0x7f15300fb840 msgr2=0x7f15300fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.558+0000 7f1536e08640 1 -- 172.21.15.17:0/1370949230 shutdown_connections 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.558+0000 7f1536e08640 1 -- 172.21.15.17:0/1370949230 wait complete. 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1536e08640 1 Processor -- start 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1536e08640 1 -- start start 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1536e08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15300ffda0 0x7f15300727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1536e08640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1530100750 0x7f1530072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1536e08640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1530073230 con 0x7f15300ffda0 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1536e08640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300733a0 con 0x7f1530100750 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1534ba4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15300ffda0 0x7f15300727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1534ba4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15300ffda0 0x7f15300727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60734/0 (socket says 172.21.15.17:60734) 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1534ba4640 1 -- 172.21.15.17:0/672383316 learned_addr learned my addr 172.21.15.17:0/672383316 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f152ffff640 1 --2- 172.21.15.17:0/672383316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1530100750 0x7f1530072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:51.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1534ba4640 1 -- 172.21.15.17:0/672383316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1530100750 msgr2=0x7f1530072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1534ba4640 1 --2- 172.21.15.17:0/672383316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1530100750 0x7f1530072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1534ba4640 1 -- 172.21.15.17:0/672383316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1520009560 con 0x7f15300ffda0 2024-08-19T00:59:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.559+0000 7f1534ba4640 1 --2- 172.21.15.17:0/672383316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15300ffda0 0x7f15300727b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f151800d8d0 tx=0x7f151800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.560+0000 7f152dffb640 1 -- 172.21.15.17:0/672383316 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f151800bea0 con 0x7f15300ffda0 2024-08-19T00:59:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.560+0000 7f152dffb640 1 -- 172.21.15.17:0/672383316 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1518009c00 con 0x7f15300ffda0 2024-08-19T00:59:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.560+0000 7f152dffb640 1 -- 172.21.15.17:0/672383316 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f151800f710 con 0x7f15300ffda0 2024-08-19T00:59:51.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.560+0000 7f1536e08640 1 -- 172.21.15.17:0/672383316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15301a1c90 con 0x7f15300ffda0 2024-08-19T00:59:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.560+0000 7f1536e08640 1 -- 172.21.15.17:0/672383316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15301a1ff0 con 0x7f15300ffda0 2024-08-19T00:59:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.561+0000 7f1536e08640 1 -- 172.21.15.17:0/672383316 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1530101280 con 0x7f15300ffda0 2024-08-19T00:59:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.561+0000 7f152dffb640 1 -- 172.21.15.17:0/672383316 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f1518010460 con 0x7f15300ffda0 2024-08-19T00:59:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.562+0000 7f152dffb640 1 --2- 172.21.15.17:0/672383316 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f151c06ddf0 0x7f151c0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.562+0000 7f152dffb640 1 -- 172.21.15.17:0/672383316 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f151808d7c0 con 0x7f15300ffda0 2024-08-19T00:59:51.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.562+0000 7f152ffff640 1 --2- 172.21.15.17:0/672383316 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f151c06ddf0 0x7f151c0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:51.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.562+0000 7f152ffff640 1 --2- 172.21.15.17:0/672383316 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f151c06ddf0 0x7f151c0702b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1520009230 tx=0x7f15200058d0 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:51.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.566+0000 7f152dffb640 1 -- 172.21.15.17:0/672383316 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f1518057100 con 0x7f15300ffda0 2024-08-19T00:59:51.661 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:51 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:51.661 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:51 smithi017 ceph-mon[16627]: Upgrade: Target is version 19.1.0-1382-gde09dd01 (squid) 2024-08-19T00:59:51.661 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:51 smithi017 ceph-mon[16627]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9'] 2024-08-19T00:59:51.661 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:51 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:51.661 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:51 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:51.661 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:51 smithi017 ceph-mon[16627]: Upgrade: Setting container_image for all mgr 2024-08-19T00:59:51.661 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:51 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:51.662 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:51 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-19T00:59:51.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.760+0000 7f1536e08640 1 -- 172.21.15.17:0/672383316 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1530073560 con 0x7f151c06ddf0 2024-08-19T00:59:51.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.762+0000 7f152dffb640 1 -- 172.21.15.17:0/672383316 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1530073560 con 0x7f151c06ddf0 2024-08-19T00:59:51.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.764+0000 7f1536e08640 1 -- 172.21.15.17:0/672383316 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f151c06ddf0 msgr2=0x7f151c0702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:51.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.764+0000 7f1536e08640 1 --2- 172.21.15.17:0/672383316 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f151c06ddf0 0x7f151c0702b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1520009230 tx=0x7f15200058d0 comp rx=0 tx=0).stop 2024-08-19T00:59:51.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.764+0000 7f1536e08640 1 -- 172.21.15.17:0/672383316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15300ffda0 msgr2=0x7f15300727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:51.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.764+0000 7f1536e08640 1 --2- 172.21.15.17:0/672383316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15300ffda0 0x7f15300727b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f151800d8d0 tx=0x7f151800dd90 comp rx=0 tx=0).stop 2024-08-19T00:59:51.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.764+0000 7f1536e08640 1 -- 172.21.15.17:0/672383316 shutdown_connections 2024-08-19T00:59:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.764+0000 7f1536e08640 1 --2- 172.21.15.17:0/672383316 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f151c06ddf0 0x7f151c0702b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.764+0000 7f1536e08640 1 --2- 172.21.15.17:0/672383316 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1530100750 0x7f1530072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.764+0000 7f1536e08640 1 --2- 172.21.15.17:0/672383316 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15300ffda0 0x7f15300727b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.764+0000 7f1536e08640 1 -- 172.21.15.17:0/672383316 >> 172.21.15.17:0/672383316 conn(0x7f15300fb840 msgr2=0x7f15300fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.764+0000 7f1536e08640 1 -- 172.21.15.17:0/672383316 shutdown_connections 2024-08-19T00:59:51.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.764+0000 7f1536e08640 1 -- 172.21.15.17:0/672383316 wait complete. 2024-08-19T00:59:51.775 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T00:59:51.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.847+0000 7f3cb9570640 1 -- 172.21.15.17:0/3500141267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb4100d50 msgr2=0x7f3cb4101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:51.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.847+0000 7f3cb9570640 1 --2- 172.21.15.17:0/3500141267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb4100d50 0x7f3cb4101130 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009c20 tx=0x7f3ca402a970 comp rx=0 tx=0).stop 2024-08-19T00:59:51.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.848+0000 7f3cb9570640 1 -- 172.21.15.17:0/3500141267 shutdown_connections 2024-08-19T00:59:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.848+0000 7f3cb9570640 1 --2- 172.21.15.17:0/3500141267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4101670 0x7f3cb4109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.848+0000 7f3cb9570640 1 --2- 172.21.15.17:0/3500141267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb4100d50 0x7f3cb4101130 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.848+0000 7f3cb9570640 1 -- 172.21.15.17:0/3500141267 >> 172.21.15.17:0/3500141267 conn(0x7f3cb40fa730 msgr2=0x7f3cb40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.848+0000 7f3cb9570640 1 -- 172.21.15.17:0/3500141267 shutdown_connections 2024-08-19T00:59:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.848+0000 7f3cb9570640 1 -- 172.21.15.17:0/3500141267 wait complete. 2024-08-19T00:59:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.848+0000 7f3cb9570640 1 Processor -- start 2024-08-19T00:59:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.848+0000 7f3cb9570640 1 -- start start 2024-08-19T00:59:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb9570640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4100d50 0x7f3cb419d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb9570640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb4101670 0x7f3cb419dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb9570640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb419e550 con 0x7f3cb4101670 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb9570640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4197ad0 con 0x7f3cb4100d50 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb4101670 0x7f3cb419dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb4101670 0x7f3cb419dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60758/0 (socket says 172.21.15.17:60758) 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb27fc640 1 -- 172.21.15.17:0/528355903 learned_addr learned my addr 172.21.15.17:0/528355903 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb2ffd640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4100d50 0x7f3cb419d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb27fc640 1 -- 172.21.15.17:0/528355903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4100d50 msgr2=0x7f3cb419d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb27fc640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4100d50 0x7f3cb419d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb27fc640 1 -- 172.21.15.17:0/528355903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4009900 con 0x7f3cb4101670 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb2ffd640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4100d50 0x7f3cb419d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb27fc640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb4101670 0x7f3cb419dec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00e970 tx=0x7f3c9c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cabfff640 1 -- 172.21.15.17:0/528355903 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c9c00cc90 con 0x7f3cb4101670 2024-08-19T00:59:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cabfff640 1 -- 172.21.15.17:0/528355903 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c9c00cdf0 con 0x7f3cb4101670 2024-08-19T00:59:51.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb9570640 1 -- 172.21.15.17:0/528355903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb4197db0 con 0x7f3cb4101670 2024-08-19T00:59:51.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cabfff640 1 -- 172.21.15.17:0/528355903 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c9c010430 con 0x7f3cb4101670 2024-08-19T00:59:51.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.849+0000 7f3cb9570640 1 -- 172.21.15.17:0/528355903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb4198300 con 0x7f3cb4101670 2024-08-19T00:59:51.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.850+0000 7f3cb9570640 1 -- 172.21.15.17:0/528355903 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb4068cd0 con 0x7f3cb4101670 2024-08-19T00:59:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.851+0000 7f3cabfff640 1 -- 172.21.15.17:0/528355903 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f3c9c0046c0 con 0x7f3cb4101670 2024-08-19T00:59:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.851+0000 7f3cabfff640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f3ca006ddf0 0x7f3ca00702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.851+0000 7f3cabfff640 1 -- 172.21.15.17:0/528355903 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3c9c014070 con 0x7f3cb4101670 2024-08-19T00:59:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.851+0000 7f3cb2ffd640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f3ca006ddf0 0x7f3ca00702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.852+0000 7f3cb2ffd640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f3ca006ddf0 0x7f3ca00702b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4000f80 tx=0x7f3ca402ff40 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:51.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:51.856+0000 7f3cabfff640 1 -- 172.21.15.17:0/528355903 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f3c9c0579d0 con 0x7f3cb4101670 2024-08-19T00:59:51.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:51 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:51.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:51 smithi086 ceph-mon[24511]: Upgrade: Target is version 19.1.0-1382-gde09dd01 (squid) 2024-08-19T00:59:51.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:51 smithi086 ceph-mon[24511]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9'] 2024-08-19T00:59:51.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:51 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T00:59:51.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:51 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:51.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:51 smithi086 ceph-mon[24511]: Upgrade: Setting container_image for all mgr 2024-08-19T00:59:51.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:51 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:51.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:51 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-19T00:59:52.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.052+0000 7f3cb9570640 1 -- 172.21.15.17:0/528355903 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cb410cd70 con 0x7f3ca006ddf0 2024-08-19T00:59:52.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.053+0000 7f3cabfff640 1 -- 172.21.15.17:0/528355903 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f3cb410cd70 con 0x7f3ca006ddf0 2024-08-19T00:59:52.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.055+0000 7f3cb9570640 1 -- 172.21.15.17:0/528355903 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f3ca006ddf0 msgr2=0x7f3ca00702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.055+0000 7f3cb9570640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f3ca006ddf0 0x7f3ca00702b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4000f80 tx=0x7f3ca402ff40 comp rx=0 tx=0).stop 2024-08-19T00:59:52.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.055+0000 7f3cb9570640 1 -- 172.21.15.17:0/528355903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb4101670 msgr2=0x7f3cb419dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.055+0000 7f3cb9570640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb4101670 0x7f3cb419dec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00e970 tx=0x7f3c9c00ed70 comp rx=0 tx=0).stop 2024-08-19T00:59:52.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.055+0000 7f3cb9570640 1 -- 172.21.15.17:0/528355903 shutdown_connections 2024-08-19T00:59:52.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.055+0000 7f3cb9570640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f3ca006ddf0 0x7f3ca00702b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.055+0000 7f3cb9570640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3cb4101670 0x7f3cb419dec0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.055+0000 7f3cb9570640 1 --2- 172.21.15.17:0/528355903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3cb4100d50 0x7f3cb419d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.055+0000 7f3cb9570640 1 -- 172.21.15.17:0/528355903 >> 172.21.15.17:0/528355903 conn(0x7f3cb40fa730 msgr2=0x7f3cb40fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:52.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.056+0000 7f3cb9570640 1 -- 172.21.15.17:0/528355903 shutdown_connections 2024-08-19T00:59:52.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.056+0000 7f3cb9570640 1 -- 172.21.15.17:0/528355903 wait complete. 2024-08-19T00:59:52.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.137+0000 7f8e7684e640 1 -- 172.21.15.17:0/2012031193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e70104a10 msgr2=0x7f8e70104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.137+0000 7f8e7684e640 1 --2- 172.21.15.17:0/2012031193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e70104a10 0x7f8e70104df0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009880 tx=0x7f8e6002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.137+0000 7f8e7684e640 1 -- 172.21.15.17:0/2012031193 shutdown_connections 2024-08-19T00:59:52.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.137+0000 7f8e7684e640 1 --2- 172.21.15.17:0/2012031193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e700fea10 0x7f8e700fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.137+0000 7f8e7684e640 1 --2- 172.21.15.17:0/2012031193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e70104a10 0x7f8e70104df0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.137+0000 7f8e7684e640 1 -- 172.21.15.17:0/2012031193 >> 172.21.15.17:0/2012031193 conn(0x7f8e700fa730 msgr2=0x7f8e700fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:52.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.137+0000 7f8e7684e640 1 -- 172.21.15.17:0/2012031193 shutdown_connections 2024-08-19T00:59:52.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.137+0000 7f8e7684e640 1 -- 172.21.15.17:0/2012031193 wait complete. 2024-08-19T00:59:52.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.138+0000 7f8e7684e640 1 Processor -- start 2024-08-19T00:59:52.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.138+0000 7f8e7684e640 1 -- start start 2024-08-19T00:59:52.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.138+0000 7f8e7684e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e700fea10 0x7f8e7019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:52.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.138+0000 7f8e7684e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e70104a10 0x7f8e7019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:52.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.138+0000 7f8e7684e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7019c3d0 con 0x7f8e70104a10 2024-08-19T00:59:52.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.138+0000 7f8e7684e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70195960 con 0x7f8e700fea10 2024-08-19T00:59:52.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e70104a10 0x7f8e7019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:52.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e70104a10 0x7f8e7019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60772/0 (socket says 172.21.15.17:60772) 2024-08-19T00:59:52.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3358631843 learned_addr learned my addr 172.21.15.17:0/3358631843 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:52.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6ffff640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e700fea10 0x7f8e7019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:52.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3358631843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e700fea10 msgr2=0x7f8e7019b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6f7fe640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e700fea10 0x7f8e7019b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6f7fe640 1 -- 172.21.15.17:0/3358631843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60009560 con 0x7f8e70104a10 2024-08-19T00:59:52.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6ffff640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e700fea10 0x7f8e7019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:59:52.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6f7fe640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e70104a10 0x7f8e7019bdb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400d6f0 tx=0x7f8e6400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:52.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/3358631843 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e64009a30 con 0x7f8e70104a10 2024-08-19T00:59:52.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/3358631843 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e640054e0 con 0x7f8e70104a10 2024-08-19T00:59:52.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/3358631843 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e64010460 con 0x7f8e70104a10 2024-08-19T00:59:52.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e7684e640 1 -- 172.21.15.17:0/3358631843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e70195c40 con 0x7f8e70104a10 2024-08-19T00:59:52.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.139+0000 7f8e7684e640 1 -- 172.21.15.17:0/3358631843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e70196190 con 0x7f8e70104a10 2024-08-19T00:59:52.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.140+0000 7f8e7684e640 1 -- 172.21.15.17:0/3358631843 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e70100150 con 0x7f8e70104a10 2024-08-19T00:59:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.141+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/3358631843 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f8e64009b90 con 0x7f8e70104a10 2024-08-19T00:59:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.141+0000 7f8e6d7fa640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f8e5806ddf0 0x7f8e580702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.141+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/3358631843 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8e6408d750 con 0x7f8e70104a10 2024-08-19T00:59:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.141+0000 7f8e6ffff640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f8e5806ddf0 0x7f8e580702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:52.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.142+0000 7f8e6ffff640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f8e5806ddf0 0x7f8e580702b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e60006010 tx=0x7f8e60005e60 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:52.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.146+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/3358631843 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f8e64056f60 con 0x7f8e70104a10 2024-08-19T00:59:52.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.332+0000 7f8e7684e640 1 -- 172.21.15.17:0/3358631843 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e7010bca0 con 0x7f8e5806ddf0 2024-08-19T00:59:52.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.341+0000 7f8e6d7fa640 1 -- 172.21.15.17:0/3358631843 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f8e7010bca0 con 0x7f8e5806ddf0 2024-08-19T00:59:52.344 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T00:59:52.344 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (70s) 42s ago 11m 16.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T00:59:52.344 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (12m) 42s ago 12m 8262k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T00:59:52.344 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (11m) 103s ago 11m 7948k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T00:59:52.344 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (12m) 42s ago 12m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T00:59:52.344 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (10m) 103s ago 10m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T00:59:52.344 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (48s) 42s ago 11m 48.1M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T00:59:52.344 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (6m) 42s ago 6m 158M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T00:59:52.344 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (6m) 42s ago 6m 91.7M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T00:59:52.344 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (6m) 103s ago 6m 26.0M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (6m) 103s ago 6m 25.7M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (3m) 42s ago 13m 506M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (2m) 103s ago 10m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (13m) 42s ago 13m 57.3M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 771bc6b905a5 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (10m) 103s ago 10m 48.0M 2048M 18.2.4-721-gbaa926de e6c292a6bc95 c6fce0ad535d 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (110s) 42s ago 11m 15.6M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (106s) 103s ago 10m 3556k - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (10m) 42s ago 9m 218M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (9m) 42s ago 9m 228M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (9m) 42s ago 9m 189M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (8m) 103s ago 8m 244M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T00:59:52.345 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (8m) 103s ago 8m 217M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T00:59:52.346 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (7m) 103s ago 7m 217M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T00:59:52.346 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (87s) 42s ago 11m 49.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T00:59:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.343+0000 7f8e7684e640 1 -- 172.21.15.17:0/3358631843 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f8e5806ddf0 msgr2=0x7f8e580702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.344+0000 7f8e7684e640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f8e5806ddf0 0x7f8e580702b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e60006010 tx=0x7f8e60005e60 comp rx=0 tx=0).stop 2024-08-19T00:59:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.344+0000 7f8e7684e640 1 -- 172.21.15.17:0/3358631843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e70104a10 msgr2=0x7f8e7019bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.344+0000 7f8e7684e640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e70104a10 0x7f8e7019bdb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8e6400d6f0 tx=0x7f8e6400dbb0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.344+0000 7f8e7684e640 1 -- 172.21.15.17:0/3358631843 shutdown_connections 2024-08-19T00:59:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.344+0000 7f8e7684e640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f8e5806ddf0 0x7f8e580702b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.344+0000 7f8e7684e640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e70104a10 0x7f8e7019bdb0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.344+0000 7f8e7684e640 1 --2- 172.21.15.17:0/3358631843 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8e700fea10 0x7f8e7019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.344+0000 7f8e7684e640 1 -- 172.21.15.17:0/3358631843 >> 172.21.15.17:0/3358631843 conn(0x7f8e700fa730 msgr2=0x7f8e70068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.344+0000 7f8e7684e640 1 -- 172.21.15.17:0/3358631843 shutdown_connections 2024-08-19T00:59:52.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.344+0000 7f8e7684e640 1 -- 172.21.15.17:0/3358631843 wait complete. 2024-08-19T00:59:52.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.425+0000 7ff324147640 1 -- 172.21.15.17:0/198716003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31c100750 msgr2=0x7ff31c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.425+0000 7ff324147640 1 --2- 172.21.15.17:0/198716003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31c100750 0x7ff31c1047a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff310009880 tx=0x7ff31002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.425+0000 7ff324147640 1 -- 172.21.15.17:0/198716003 shutdown_connections 2024-08-19T00:59:52.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.425+0000 7ff324147640 1 --2- 172.21.15.17:0/198716003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31c100750 0x7ff31c1047a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.425+0000 7ff324147640 1 --2- 172.21.15.17:0/198716003 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff31c0ffda0 0x7ff31c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.425+0000 7ff324147640 1 -- 172.21.15.17:0/198716003 >> 172.21.15.17:0/198716003 conn(0x7ff31c0fb840 msgr2=0x7ff31c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:52.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.425+0000 7ff324147640 1 -- 172.21.15.17:0/198716003 shutdown_connections 2024-08-19T00:59:52.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.425+0000 7ff324147640 1 -- 172.21.15.17:0/198716003 wait complete. 2024-08-19T00:59:52.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff324147640 1 Processor -- start 2024-08-19T00:59:52.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff324147640 1 -- start start 2024-08-19T00:59:52.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff324147640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff31c0ffda0 0x7ff31c19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:52.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff324147640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31c100750 0x7ff31c19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:52.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff324147640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c195930 con 0x7ff31c100750 2024-08-19T00:59:52.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff324147640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c195a70 con 0x7ff31c0ffda0 2024-08-19T00:59:52.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff3216e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31c100750 0x7ff31c19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:52.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff3216e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31c100750 0x7ff31c19be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60790/0 (socket says 172.21.15.17:60790) 2024-08-19T00:59:52.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff3216e2640 1 -- 172.21.15.17:0/2588379705 learned_addr learned my addr 172.21.15.17:0/2588379705 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:52.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff321ee3640 1 --2- 172.21.15.17:0/2588379705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff31c0ffda0 0x7ff31c19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:52.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff3216e2640 1 -- 172.21.15.17:0/2588379705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff31c0ffda0 msgr2=0x7ff31c19b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff3216e2640 1 --2- 172.21.15.17:0/2588379705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff31c0ffda0 0x7ff31c19b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.426+0000 7ff3216e2640 1 -- 172.21.15.17:0/2588379705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff310009560 con 0x7ff31c100750 2024-08-19T00:59:52.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.427+0000 7ff3216e2640 1 --2- 172.21.15.17:0/2588379705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31c100750 0x7ff31c19be10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff31002a9c0 tx=0x7ff3100055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:52.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.427+0000 7ff31affd640 1 -- 172.21.15.17:0/2588379705 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff310004aa0 con 0x7ff31c100750 2024-08-19T00:59:52.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.427+0000 7ff324147640 1 -- 172.21.15.17:0/2588379705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31c195cf0 con 0x7ff31c100750 2024-08-19T00:59:52.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.427+0000 7ff31affd640 1 -- 172.21.15.17:0/2588379705 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff310004c00 con 0x7ff31c100750 2024-08-19T00:59:52.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.427+0000 7ff31affd640 1 -- 172.21.15.17:0/2588379705 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff310003980 con 0x7ff31c100750 2024-08-19T00:59:52.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.427+0000 7ff324147640 1 -- 172.21.15.17:0/2588379705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31c1961e0 con 0x7ff31c100750 2024-08-19T00:59:52.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.428+0000 7ff324147640 1 -- 172.21.15.17:0/2588379705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31c101280 con 0x7ff31c100750 2024-08-19T00:59:52.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.428+0000 7ff31affd640 1 -- 172.21.15.17:0/2588379705 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7ff310003b20 con 0x7ff31c100750 2024-08-19T00:59:52.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.429+0000 7ff31affd640 1 --2- 172.21.15.17:0/2588379705 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30406ddf0 0x7ff3040702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:52.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.429+0000 7ff31affd640 1 -- 172.21.15.17:0/2588379705 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff3100aeb70 con 0x7ff31c100750 2024-08-19T00:59:52.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.429+0000 7ff321ee3640 1 --2- 172.21.15.17:0/2588379705 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30406ddf0 0x7ff3040702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:52.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.429+0000 7ff321ee3640 1 --2- 172.21.15.17:0/2588379705 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30406ddf0 0x7ff3040702b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff30c005fd0 tx=0x7ff30c009870 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:52.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.433+0000 7ff31affd640 1 -- 172.21.15.17:0/2588379705 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7ff310078400 con 0x7ff31c100750 2024-08-19T00:59:52.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.680+0000 7ff324147640 1 -- 172.21.15.17:0/2588379705 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff31c196ec0 con 0x7ff31c100750 2024-08-19T00:59:52.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:52 smithi017 ceph-mon[16627]: pgmap v90: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:52.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:52.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:59:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:59:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:52 smithi017 ceph-mon[16627]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:52.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.680+0000 7ff31affd640 1 -- 172.21.15.17:0/2588379705 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+729 (secure 0 0 0) 0x7ff31007bac0 con 0x7ff31c100750 2024-08-19T00:59:52.683 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:59:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T00:59:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2 2024-08-19T00:59:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:59:52.683 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 12, 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T00:59:52.684 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:59:52.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.683+0000 7ff324147640 1 -- 172.21.15.17:0/2588379705 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30406ddf0 msgr2=0x7ff3040702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.683+0000 7ff324147640 1 --2- 172.21.15.17:0/2588379705 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30406ddf0 0x7ff3040702b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff30c005fd0 tx=0x7ff30c009870 comp rx=0 tx=0).stop 2024-08-19T00:59:52.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.683+0000 7ff324147640 1 -- 172.21.15.17:0/2588379705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31c100750 msgr2=0x7ff31c19be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.683+0000 7ff324147640 1 --2- 172.21.15.17:0/2588379705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31c100750 0x7ff31c19be10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff31002a9c0 tx=0x7ff3100055a0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.683+0000 7ff324147640 1 -- 172.21.15.17:0/2588379705 shutdown_connections 2024-08-19T00:59:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.683+0000 7ff324147640 1 --2- 172.21.15.17:0/2588379705 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7ff30406ddf0 0x7ff3040702b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.683+0000 7ff324147640 1 --2- 172.21.15.17:0/2588379705 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff31c100750 0x7ff31c19be10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.683+0000 7ff324147640 1 --2- 172.21.15.17:0/2588379705 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff31c0ffda0 0x7ff31c19b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.683+0000 7ff324147640 1 -- 172.21.15.17:0/2588379705 >> 172.21.15.17:0/2588379705 conn(0x7ff31c0fb840 msgr2=0x7ff31c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.683+0000 7ff324147640 1 -- 172.21.15.17:0/2588379705 shutdown_connections 2024-08-19T00:59:52.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.683+0000 7ff324147640 1 -- 172.21.15.17:0/2588379705 wait complete. 2024-08-19T00:59:52.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.768+0000 7fb21b502640 1 -- 172.21.15.17:0/2556884080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb214105bf0 msgr2=0x7fb214105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.768+0000 7fb21b502640 1 --2- 172.21.15.17:0/2556884080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb214105bf0 0x7fb214105fd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb210009880 tx=0x7fb21002a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.768+0000 7fb21b502640 1 -- 172.21.15.17:0/2556884080 shutdown_connections 2024-08-19T00:59:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.768+0000 7fb21b502640 1 --2- 172.21.15.17:0/2556884080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2140ffb40 0x7fb2140fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.768+0000 7fb21b502640 1 --2- 172.21.15.17:0/2556884080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb214105bf0 0x7fb214105fd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.768+0000 7fb21b502640 1 -- 172.21.15.17:0/2556884080 >> 172.21.15.17:0/2556884080 conn(0x7fb2140fb860 msgr2=0x7fb2140fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.768+0000 7fb21b502640 1 -- 172.21.15.17:0/2556884080 shutdown_connections 2024-08-19T00:59:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.768+0000 7fb21b502640 1 -- 172.21.15.17:0/2556884080 wait complete. 2024-08-19T00:59:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.769+0000 7fb21b502640 1 Processor -- start 2024-08-19T00:59:52.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.769+0000 7fb21b502640 1 -- start start 2024-08-19T00:59:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.769+0000 7fb21b502640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2140ffb40 0x7fb2140727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.769+0000 7fb21b502640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb214105bf0 0x7fb214072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.769+0000 7fb21b502640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214073230 con 0x7fb2140ffb40 2024-08-19T00:59:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.769+0000 7fb21b502640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2140733a0 con 0x7fb214105bf0 2024-08-19T00:59:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.769+0000 7fb21929e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2140ffb40 0x7fb2140727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.769+0000 7fb21929e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2140ffb40 0x7fb2140727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60818/0 (socket says 172.21.15.17:60818) 2024-08-19T00:59:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.769+0000 7fb21929e640 1 -- 172.21.15.17:0/1770205706 learned_addr learned my addr 172.21.15.17:0/1770205706 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.769+0000 7fb218a9d640 1 --2- 172.21.15.17:0/1770205706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb214105bf0 0x7fb214072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.770+0000 7fb21929e640 1 -- 172.21.15.17:0/1770205706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb214105bf0 msgr2=0x7fb214072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.770+0000 7fb21929e640 1 --2- 172.21.15.17:0/1770205706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb214105bf0 0x7fb214072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.770+0000 7fb21929e640 1 -- 172.21.15.17:0/1770205706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb210009560 con 0x7fb2140ffb40 2024-08-19T00:59:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.770+0000 7fb21929e640 1 --2- 172.21.15.17:0/1770205706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2140ffb40 0x7fb2140727b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb210006010 tx=0x7fb2100055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.770+0000 7fb20a7fc640 1 -- 172.21.15.17:0/1770205706 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb210004aa0 con 0x7fb2140ffb40 2024-08-19T00:59:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.770+0000 7fb21b502640 1 -- 172.21.15.17:0/1770205706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb214073620 con 0x7fb2140ffb40 2024-08-19T00:59:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.770+0000 7fb20a7fc640 1 -- 172.21.15.17:0/1770205706 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb210031470 con 0x7fb2140ffb40 2024-08-19T00:59:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.770+0000 7fb20a7fc640 1 -- 172.21.15.17:0/1770205706 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb210003940 con 0x7fb2140ffb40 2024-08-19T00:59:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.770+0000 7fb21b502640 1 -- 172.21.15.17:0/1770205706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2141a1f50 con 0x7fb2140ffb40 2024-08-19T00:59:52.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.771+0000 7fb21b502640 1 -- 172.21.15.17:0/1770205706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2141011f0 con 0x7fb2140ffb40 2024-08-19T00:59:52.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.772+0000 7fb20a7fc640 1 -- 172.21.15.17:0/1770205706 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7fb210031b90 con 0x7fb2140ffb40 2024-08-19T00:59:52.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.772+0000 7fb20a7fc640 1 --2- 172.21.15.17:0/1770205706 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb20006de00 0x7fb2000702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:52.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.772+0000 7fb20a7fc640 1 -- 172.21.15.17:0/1770205706 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb2100aea80 con 0x7fb2140ffb40 2024-08-19T00:59:52.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.773+0000 7fb218a9d640 1 --2- 172.21.15.17:0/1770205706 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb20006de00 0x7fb2000702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:52.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.773+0000 7fb218a9d640 1 --2- 172.21.15.17:0/1770205706 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb20006de00 0x7fb2000702c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb214073f30 tx=0x7fb20400b390 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.777+0000 7fb20a7fc640 1 -- 172.21.15.17:0/1770205706 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fb210078340 con 0x7fb2140ffb40 2024-08-19T00:59:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:52 smithi086 ceph-mon[24511]: pgmap v90: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' 2024-08-19T00:59:52.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T00:59:52.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T00:59:52.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:52 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T00:59:52.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.991+0000 7fb21b502640 1 -- 172.21.15.17:0/1770205706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb214073d80 con 0x7fb2140ffb40 2024-08-19T00:59:52.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.991+0000 7fb20a7fc640 1 -- 172.21.15.17:0/1770205706 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1863 (secure 0 0 0) 0x7fb210004c00 con 0x7fb2140ffb40 2024-08-19T00:59:52.995 INFO:teuthology.orchestra.run.smithi017.stdout:e21 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 21 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T00:53:41.004049+0000 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T00:59:52.996 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 46 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14486,1=24299} 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T00:59:52.997 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T00:59:52.998 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T00:59:52.998 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T00:59:52.998 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T00:59:52.998 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T00:59:52.998 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T00:59:52.998 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:59:52.998 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:59:52.998 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:59:52.998 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:59:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:59:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T00:59:52.999 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T00:59:52.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.993+0000 7fb21b502640 1 -- 172.21.15.17:0/1770205706 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb20006de00 msgr2=0x7fb2000702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:52.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.993+0000 7fb21b502640 1 --2- 172.21.15.17:0/1770205706 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb20006de00 0x7fb2000702c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb214073f30 tx=0x7fb20400b390 comp rx=0 tx=0).stop 2024-08-19T00:59:52.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.993+0000 7fb21b502640 1 -- 172.21.15.17:0/1770205706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2140ffb40 msgr2=0x7fb2140727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:53.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.993+0000 7fb21b502640 1 --2- 172.21.15.17:0/1770205706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2140ffb40 0x7fb2140727b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb210006010 tx=0x7fb2100055a0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.993+0000 7fb21b502640 1 -- 172.21.15.17:0/1770205706 shutdown_connections 2024-08-19T00:59:53.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.993+0000 7fb21b502640 1 --2- 172.21.15.17:0/1770205706 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fb20006de00 0x7fb2000702c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.993+0000 7fb21b502640 1 --2- 172.21.15.17:0/1770205706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb214105bf0 0x7fb214072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.993+0000 7fb21b502640 1 --2- 172.21.15.17:0/1770205706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2140ffb40 0x7fb2140727b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.993+0000 7fb21b502640 1 -- 172.21.15.17:0/1770205706 >> 172.21.15.17:0/1770205706 conn(0x7fb2140fb860 msgr2=0x7fb2140fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:53.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.993+0000 7fb21b502640 1 -- 172.21.15.17:0/1770205706 shutdown_connections 2024-08-19T00:59:53.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:52.993+0000 7fb21b502640 1 -- 172.21.15.17:0/1770205706 wait complete. 2024-08-19T00:59:53.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.080+0000 7f1ad96b9640 1 -- 172.21.15.17:0/2208793855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad4104a10 msgr2=0x7f1ad4104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:53.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.080+0000 7f1ad96b9640 1 --2- 172.21.15.17:0/2208793855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad4104a10 0x7f1ad4104df0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009880 tx=0x7f1ac402a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.080+0000 7f1ad96b9640 1 -- 172.21.15.17:0/2208793855 shutdown_connections 2024-08-19T00:59:53.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.080+0000 7f1ad96b9640 1 --2- 172.21.15.17:0/2208793855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad40fea10 0x7f1ad40fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.080+0000 7f1ad96b9640 1 --2- 172.21.15.17:0/2208793855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad4104a10 0x7f1ad4104df0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.080+0000 7f1ad96b9640 1 -- 172.21.15.17:0/2208793855 >> 172.21.15.17:0/2208793855 conn(0x7f1ad40fa730 msgr2=0x7f1ad40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:53.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.081+0000 7f1ad96b9640 1 -- 172.21.15.17:0/2208793855 shutdown_connections 2024-08-19T00:59:53.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.081+0000 7f1ad96b9640 1 -- 172.21.15.17:0/2208793855 wait complete. 2024-08-19T00:59:53.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.081+0000 7f1ad96b9640 1 Processor -- start 2024-08-19T00:59:53.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.081+0000 7f1ad96b9640 1 -- start start 2024-08-19T00:59:53.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.081+0000 7f1ad96b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad40fea10 0x7f1ad4196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:53.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad96b9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad4104a10 0x7f1ad4196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:53.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad96b9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4197490 con 0x7f1ad40fea10 2024-08-19T00:59:53.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad96b9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4197600 con 0x7f1ad4104a10 2024-08-19T00:59:53.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad40fea10 0x7f1ad4196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad40fea10 0x7f1ad4196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60840/0 (socket says 172.21.15.17:60840) 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad2ffd640 1 -- 172.21.15.17:0/4205790589 learned_addr learned my addr 172.21.15.17:0/4205790589 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad2ffd640 1 -- 172.21.15.17:0/4205790589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad4104a10 msgr2=0x7f1ad4196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad2ffd640 1 --2- 172.21.15.17:0/4205790589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad4104a10 0x7f1ad4196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad2ffd640 1 -- 172.21.15.17:0/4205790589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4009560 con 0x7f1ad40fea10 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad2ffd640 1 --2- 172.21.15.17:0/4205790589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad40fea10 0x7f1ad4196980 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1ac402a9c0 tx=0x7f1ac40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1acbfff640 1 -- 172.21.15.17:0/4205790589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ac4004aa0 con 0x7f1ad40fea10 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1acbfff640 1 -- 172.21.15.17:0/4205790589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ac4004c00 con 0x7f1ad40fea10 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad96b9640 1 -- 172.21.15.17:0/4205790589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad419f9f0 con 0x7f1ad40fea10 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1acbfff640 1 -- 172.21.15.17:0/4205790589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ac4003980 con 0x7f1ad40fea10 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.082+0000 7f1ad96b9640 1 -- 172.21.15.17:0/4205790589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad419fd50 con 0x7f1ad40fea10 2024-08-19T00:59:53.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.083+0000 7f1ad96b9640 1 -- 172.21.15.17:0/4205790589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad4100150 con 0x7f1ad40fea10 2024-08-19T00:59:53.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.084+0000 7f1acbfff640 1 -- 172.21.15.17:0/4205790589 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7f1ac4003bf0 con 0x7f1ad40fea10 2024-08-19T00:59:53.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.084+0000 7f1acbfff640 1 --2- 172.21.15.17:0/4205790589 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f1ac006ddf0 0x7f1ac00702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:53.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.085+0000 7f1acbfff640 1 -- 172.21.15.17:0/4205790589 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1ac40aec30 con 0x7f1ad40fea10 2024-08-19T00:59:53.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.085+0000 7f1ad27fc640 1 --2- 172.21.15.17:0/4205790589 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f1ac006ddf0 0x7f1ac00702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:53.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.085+0000 7f1ad27fc640 1 --2- 172.21.15.17:0/4205790589 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f1ac006ddf0 0x7f1ac00702b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1abc005fd0 tx=0x7f1abc005850 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:53.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.089+0000 7f1acbfff640 1 -- 172.21.15.17:0/4205790589 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7f1ac4078440 con 0x7f1ad40fea10 2024-08-19T00:59:53.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.285+0000 7f1ad96b9640 1 -- 172.21.15.17:0/4205790589 --> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ad4106ff0 con 0x7f1ac006ddf0 2024-08-19T00:59:53.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.286+0000 7f1acbfff640 1 -- 172.21.15.17:0/4205790589 <== mgr.14654 v2:172.21.15.17:6800/3438217243 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1ad4106ff0 con 0x7f1ac006ddf0 2024-08-19T00:59:53.288 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T00:59:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T00:59:53.288 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T00:59:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T00:59:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T00:59:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T00:59:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T00:59:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "2/23 daemons upgraded", 2024-08-19T00:59:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mon daemons", 2024-08-19T00:59:53.289 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T00:59:53.289 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T00:59:53.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.289+0000 7f1ad96b9640 1 -- 172.21.15.17:0/4205790589 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f1ac006ddf0 msgr2=0x7f1ac00702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:53.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.289+0000 7f1ad96b9640 1 --2- 172.21.15.17:0/4205790589 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f1ac006ddf0 0x7f1ac00702b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1abc005fd0 tx=0x7f1abc005850 comp rx=0 tx=0).stop 2024-08-19T00:59:53.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.289+0000 7f1ad96b9640 1 -- 172.21.15.17:0/4205790589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad40fea10 msgr2=0x7f1ad4196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:53.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.289+0000 7f1ad96b9640 1 --2- 172.21.15.17:0/4205790589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad40fea10 0x7f1ad4196980 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1ac402a9c0 tx=0x7f1ac40055a0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.289+0000 7f1ad96b9640 1 -- 172.21.15.17:0/4205790589 shutdown_connections 2024-08-19T00:59:53.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.289+0000 7f1ad96b9640 1 --2- 172.21.15.17:0/4205790589 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7f1ac006ddf0 0x7f1ac00702b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.289+0000 7f1ad96b9640 1 --2- 172.21.15.17:0/4205790589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ad4104a10 0x7f1ad4196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.289+0000 7f1ad96b9640 1 --2- 172.21.15.17:0/4205790589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ad40fea10 0x7f1ad4196980 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.289+0000 7f1ad96b9640 1 -- 172.21.15.17:0/4205790589 >> 172.21.15.17:0/4205790589 conn(0x7f1ad40fa730 msgr2=0x7f1ad40fb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:53.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.289+0000 7f1ad96b9640 1 -- 172.21.15.17:0/4205790589 shutdown_connections 2024-08-19T00:59:53.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.289+0000 7f1ad96b9640 1 -- 172.21.15.17:0/4205790589 wait complete. 2024-08-19T00:59:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.372+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/611885869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5ec104a30 msgr2=0x7fd5ec104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:53.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.372+0000 7fd5f0bfd640 1 --2- 172.21.15.17:0/611885869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5ec104a30 0x7fd5ec104e10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009880 tx=0x7fd5dc02a4a0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.372+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/611885869 shutdown_connections 2024-08-19T00:59:53.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.372+0000 7fd5f0bfd640 1 --2- 172.21.15.17:0/611885869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5ec0fea30 0x7fd5ec0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.372+0000 7fd5f0bfd640 1 --2- 172.21.15.17:0/611885869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5ec104a30 0x7fd5ec104e10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.372+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/611885869 >> 172.21.15.17:0/611885869 conn(0x7fd5ec0fa730 msgr2=0x7fd5ec0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:53.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.372+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/611885869 shutdown_connections 2024-08-19T00:59:53.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.372+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/611885869 wait complete. 2024-08-19T00:59:53.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5f0bfd640 1 Processor -- start 2024-08-19T00:59:53.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5f0bfd640 1 -- start start 2024-08-19T00:59:53.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5f0bfd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5ec0fea30 0x7fd5ec0fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:53.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5f0bfd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5ec104a30 0x7fd5ec0fb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:53.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5f0bfd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec0fbad0 con 0x7fd5ec0fea30 2024-08-19T00:59:53.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5f0bfd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec0fbc40 con 0x7fd5ec104a30 2024-08-19T00:59:53.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5ec0fea30 0x7fd5ec0fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:53.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5ea59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5ec0fea30 0x7fd5ec0fb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60858/0 (socket says 172.21.15.17:60858) 2024-08-19T00:59:53.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5ea59c640 1 -- 172.21.15.17:0/937865331 learned_addr learned my addr 172.21.15.17:0/937865331 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T00:59:53.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5e3fff640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5ec104a30 0x7fd5ec0fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:53.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5ea59c640 1 -- 172.21.15.17:0/937865331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5ec104a30 msgr2=0x7fd5ec0fb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:53.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5ea59c640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5ec104a30 0x7fd5ec0fb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5ea59c640 1 -- 172.21.15.17:0/937865331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc009560 con 0x7fd5ec0fea30 2024-08-19T00:59:53.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5e3fff640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5ec104a30 0x7fd5ec0fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T00:59:53.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.373+0000 7fd5ea59c640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5ec0fea30 0x7fd5ec0fb050 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc02a9c0 tx=0x7fd5dc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:53.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.374+0000 7fd5e37fe640 1 -- 172.21.15.17:0/937865331 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5dc0048d0 con 0x7fd5ec0fea30 2024-08-19T00:59:53.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.374+0000 7fd5e37fe640 1 -- 172.21.15.17:0/937865331 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5dc031640 con 0x7fd5ec0fea30 2024-08-19T00:59:53.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.374+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/937865331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ec0fbec0 con 0x7fd5ec0fea30 2024-08-19T00:59:53.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.374+0000 7fd5e37fe640 1 -- 172.21.15.17:0/937865331 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5dc0038d0 con 0x7fd5ec0fea30 2024-08-19T00:59:53.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.374+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/937865331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ec1a1f40 con 0x7fd5ec0fea30 2024-08-19T00:59:53.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.375+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/937865331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ec100170 con 0x7fd5ec0fea30 2024-08-19T00:59:53.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.375+0000 7fd5e37fe640 1 -- 172.21.15.17:0/937865331 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 32) v1 ==== 92064+0+0 (secure 0 0 0) 0x7fd5dc004a30 con 0x7fd5ec0fea30 2024-08-19T00:59:53.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.376+0000 7fd5e37fe640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd5d806ddf0 0x7fd5d80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T00:59:53.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.376+0000 7fd5e37fe640 1 -- 172.21.15.17:0/937865331 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd5dc0ae9a0 con 0x7fd5ec0fea30 2024-08-19T00:59:53.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.376+0000 7fd5e3fff640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd5d806ddf0 0x7fd5d80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T00:59:53.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.376+0000 7fd5e3fff640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd5d806ddf0 0x7fd5d80702b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0fc7d0 tx=0x7fd5d4005f90 comp rx=0 tx=0).ready entity=mgr.14654 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T00:59:53.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.380+0000 7fd5e37fe640 1 -- 172.21.15.17:0/937865331 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187634 (secure 0 0 0) 0x7fd5dc078230 con 0x7fd5ec0fea30 2024-08-19T00:59:53.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.632+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/937865331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd5ec0fee90 con 0x7fd5ec0fea30 2024-08-19T00:59:53.635 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:53 smithi017 ceph-mon[16627]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:53.635 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:53 smithi017 ceph-mon[16627]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:53.635 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:53 smithi017 ceph-mon[16627]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:53.635 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:53 smithi017 ceph-mon[16627]: Upgrade: Updating mon.smithi017 2024-08-19T00:59:53.635 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:53 smithi017 ceph-mon[16627]: Deploying daemon mon.smithi017 on smithi017 2024-08-19T00:59:53.635 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:53 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/2588379705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:53.635 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:53 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/1770205706' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T00:59:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.633+0000 7fd5e37fe640 1 -- 172.21.15.17:0/937865331 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fd5dc0400e0 con 0x7fd5ec0fea30 2024-08-19T00:59:53.636 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T00:59:53.636 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T00:59:53.636 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T00:59:53.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.635+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/937865331 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd5d806ddf0 msgr2=0x7fd5d80702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:53.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.635+0000 7fd5f0bfd640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd5d806ddf0 0x7fd5d80702b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec0fc7d0 tx=0x7fd5d4005f90 comp rx=0 tx=0).stop 2024-08-19T00:59:53.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.635+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/937865331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5ec0fea30 msgr2=0x7fd5ec0fb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T00:59:53.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.635+0000 7fd5f0bfd640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5ec0fea30 0x7fd5ec0fb050 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc02a9c0 tx=0x7fd5dc0055a0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.635+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/937865331 shutdown_connections 2024-08-19T00:59:53.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.635+0000 7fd5f0bfd640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.17:6800/3438217243,v1:172.21.15.17:6801/3438217243] conn(0x7fd5d806ddf0 0x7fd5d80702b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.635+0000 7fd5f0bfd640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5ec104a30 0x7fd5ec0fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.635+0000 7fd5f0bfd640 1 --2- 172.21.15.17:0/937865331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5ec0fea30 0x7fd5ec0fb050 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T00:59:53.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.635+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/937865331 >> 172.21.15.17:0/937865331 conn(0x7fd5ec0fa730 msgr2=0x7fd5ec068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T00:59:53.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.635+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/937865331 shutdown_connections 2024-08-19T00:59:53.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T00:59:53.635+0000 7fd5f0bfd640 1 -- 172.21.15.17:0/937865331 wait complete. 2024-08-19T00:59:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:53 smithi086 ceph-mon[24511]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:53 smithi086 ceph-mon[24511]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:53 smithi086 ceph-mon[24511]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:53 smithi086 ceph-mon[24511]: Upgrade: Updating mon.smithi017 2024-08-19T00:59:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:53 smithi086 ceph-mon[24511]: Deploying daemon mon.smithi017 on smithi017 2024-08-19T00:59:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:53 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/2588379705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T00:59:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:53 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/1770205706' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T00:59:54.521 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:54 smithi017 systemd[1]: Stopping Ceph mon.smithi017 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T00:59:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:54 smithi086 ceph-mon[24511]: pgmap v91: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:54 smithi086 ceph-mon[24511]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:54 smithi086 ceph-mon[24511]: from='client.? 172.21.15.17:0/937865331' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T00:59:54.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:54 smithi017 ceph-mon[16627]: pgmap v91: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T00:59:54.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:54 smithi017 ceph-mon[16627]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T00:59:54.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:54 smithi017 ceph-mon[16627]: from='client.? 172.21.15.17:0/937865331' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T00:59:54.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[16623]: 2024-08-19T00:59:54.712+0000 7f06e26a1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi017 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T00:59:54.888 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[16623]: 2024-08-19T00:59:54.712+0000 7f06e26a1640 -1 mon.smithi017@0(leader) e2 *** Got Signal Terminated *** 2024-08-19T00:59:55.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:54 smithi017 podman[99199]: 2024-08-19 00:59:54.886562494 +0000 UTC m=+0.291191528 container died 771bc6b905a5d69765e968377e6695a275b67261a0a28e56a5c57d357f6a4f90 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=reef-baa926d, io.buildah.version=1.36.0) 2024-08-19T00:59:55.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:55 smithi017 podman[99199]: 2024-08-19 00:59:55.271361736 +0000 UTC m=+0.675990749 container cleanup 771bc6b905a5d69765e968377e6695a275b67261a0a28e56a5c57d357f6a4f90 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, org.label-schema.build-date=20240731, RELEASE=reef-baa926d, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-19T00:59:55.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:55 smithi017 bash[99199]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017 2024-08-19T00:59:55.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:55 smithi017 podman[99210]: 2024-08-19 00:59:55.522637111 +0000 UTC m=+0.640034664 container remove 771bc6b905a5d69765e968377e6695a275b67261a0a28e56a5c57d357f6a4f90 (image=quay.ceph.io/ceph-ci/ceph:reef, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=reef-baa926d) 2024-08-19T00:59:55.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:55 smithi017 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi017.service: Deactivated successfully. 2024-08-19T00:59:55.866 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:55 smithi017 systemd[1]: Stopped Ceph mon.smithi017 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T00:59:55.867 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:55 smithi017 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi017.service: Consumed 12.855s CPU time. 2024-08-19T00:59:56.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:55 smithi017 systemd[1]: Starting Ceph mon.smithi017 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T00:59:56.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 podman[99351]: 2024-08-19 00:59:55.984390552 +0000 UTC m=+0.017409809 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T00:59:56.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 podman[99351]: 2024-08-19 00:59:56.090481315 +0000 UTC m=+0.123500599 container create d3c8cdedb4549814676901f6a752ee9f96646f6f680d758cbdef533fca091793 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-19T00:59:56.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 podman[99351]: 2024-08-19 00:59:56.326611486 +0000 UTC m=+0.359630738 container init d3c8cdedb4549814676901f6a752ee9f96646f6f680d758cbdef533fca091793 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 podman[99351]: 2024-08-19 00:59:56.330333673 +0000 UTC m=+0.363352916 container start d3c8cdedb4549814676901f6a752ee9f96646f6f680d758cbdef533fca091793 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: set uid:gid to 167:167 (ceph:ceph) 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc), process ceph-mon, pid 2 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: pidfile_write: ignore empty --pid-file 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: load: jerasure load: lrc 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: RocksDB version: 7.9.2 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Git sha 0 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Compile date 2024-08-18 15:19:56 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: DB SUMMARY 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: DB Session ID: QMOFP9V9MHSRZO9RR5TU 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: CURRENT file: CURRENT 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: IDENTITY file: IDENTITY 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1519 Bytes 2024-08-19T00:59:56.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi017/store.db dir, Total Num: 1, files: 000032.sst 2024-08-19T00:59:56.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi017/store.db: 000030.log size: 1750513 ; 2024-08-19T00:59:56.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.error_if_exists: 0 2024-08-19T00:59:56.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.create_if_missing: 0 2024-08-19T00:59:56.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.paranoid_checks: 1 2024-08-19T00:59:56.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-19T00:59:56.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-19T00:59:56.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-19T00:59:56.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.env: 0x55be239717a0 2024-08-19T00:59:56.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.fs: PosixFileSystem 2024-08-19T00:59:56.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.info_log: 0x55be242cf6e0 2024-08-19T00:59:56.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_file_opening_threads: 16 2024-08-19T00:59:56.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.statistics: (nil) 2024-08-19T00:59:56.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.use_fsync: 0 2024-08-19T00:59:56.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_log_file_size: 0 2024-08-19T00:59:56.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-19T00:59:56.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-19T00:59:56.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.keep_log_file_num: 1000 2024-08-19T00:59:56.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.recycle_log_file_num: 0 2024-08-19T00:59:56.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.allow_fallocate: 1 2024-08-19T00:59:56.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.allow_mmap_reads: 0 2024-08-19T00:59:56.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.allow_mmap_writes: 0 2024-08-19T00:59:56.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.use_direct_reads: 0 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.create_missing_column_families: 0 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.db_log_dir: 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.wal_dir: 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.advise_random_on_open: 1 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.db_write_buffer_size: 0 2024-08-19T00:59:56.688 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.write_buffer_manager: 0x55be242dedc0 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.rate_limiter: (nil) 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.wal_recovery_mode: 2 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.enable_thread_tracking: 0 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.enable_pipelined_write: 0 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.unordered_write: 0 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-19T00:59:56.689 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.row_cache: None 2024-08-19T00:59:56.690 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.wal_filter: None 2024-08-19T00:59:56.690 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-19T00:59:56.690 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.allow_ingest_behind: 0 2024-08-19T00:59:56.690 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.two_write_queues: 0 2024-08-19T00:59:56.690 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.manual_wal_flush: 0 2024-08-19T00:59:56.690 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.wal_compression: 0 2024-08-19T00:59:56.690 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.atomic_flush: 0 2024-08-19T00:59:56.690 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-19T00:59:56.690 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.log_readahead_size: 0 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.best_efforts_recovery: 0 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.allow_data_in_errors: 0 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.db_host_id: __hostname__ 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_background_jobs: 2 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_background_compactions: -1 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_subcompactions: 1 2024-08-19T00:59:56.691 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_total_wal_size: 0 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_open_files: -1 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bytes_per_sync: 0 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_readahead_size: 0 2024-08-19T00:59:56.692 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_background_flushes: -1 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Compression algorithms supported: 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: kZSTD supported: 0 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: kXpressCompression supported: 0 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: kBZip2Compression supported: 0 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: kLZ4Compression supported: 1 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: kZlibCompression supported: 1 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: kLZ4HCCompression supported: 1 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: kSnappyCompression supported: 1 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-19T00:59:56.693 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi017/store.db/MANIFEST-000015 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.merge_operator: 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_filter: None 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_filter_factory: None 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.sst_partitioner_factory: None 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55be242cf320) 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: cache_index_and_filter_blocks: 1 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-19T00:59:56.694 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: pin_top_level_index_and_filter: 1 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_type: 0 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: data_block_index_type: 0 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_shortening: 1 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: checksum: 4 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: no_block_cache: 0 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache: 0x55be242c3090 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_name: BinnedLRUCache 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_options: 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: capacity : 536870912 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: num_shard_bits : 4 2024-08-19T00:59:56.695 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: strict_capacity_limit : 0 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: high_pri_pool_ratio: 0.000 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_cache_compressed: (nil) 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: persistent_cache: (nil) 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_size: 4096 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_size_deviation: 10 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_restart_interval: 16 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: index_block_restart_interval: 1 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: metadata_block_size: 4096 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: partition_filters: 0 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: use_delta_encoding: 1 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: filter_policy: bloomfilter 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: whole_key_filtering: 1 2024-08-19T00:59:56.696 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: verify_compression: 0 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: read_amp_bytes_per_bit: 0 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: format_version: 5 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: enable_index_compression: 1 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: block_align: 0 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: max_auto_readahead_size: 262144 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: prepopulate_block_cache: 0 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: initial_auto_readahead_size: 8192 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: num_file_reads_for_auto_readahead: 2 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.write_buffer_size: 33554432 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_write_buffer_number: 2 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compression: NoCompression 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bottommost_compression: Disabled 2024-08-19T00:59:56.697 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.prefix_extractor: nullptr 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.num_levels: 7 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-19T00:59:56.698 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compression_opts.level: 32767 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compression_opts.strategy: 0 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compression_opts.enabled: false 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-19T00:59:56.699 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.target_file_size_base: 67108864 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-19T00:59:56.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.arena_block_size: 1048576 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.disable_auto_compactions: 0 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-19T00:59:56.701 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.inplace_update_support: 0 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.bloom_locality: 0 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.max_successive_merges: 0 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-19T00:59:56.702 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.paranoid_file_checks: 0 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.force_consistency_checks: 1 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.report_bg_io_stats: 0 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.ttl: 2592000 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.enable_blob_files: false 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.min_blob_size: 0 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.blob_file_size: 268435456 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-19T00:59:56.703 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.blob_file_starting_level: 0 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi017/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12048, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f8d645fe-211f-41fd-90f2-c2226d7c2f21 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724029196357139, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724029196363076, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 1560727, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12049, "largest_seqno": 13417, "table_properties": {"data_size": 1554148, "index_size": 3938, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1605, "raw_key_size": 14783, "raw_average_key_size": 23, "raw_value_size": 1540934, "raw_average_value_size": 2473, "num_data_blocks": 180, "num_entries": 623, "num_filter_entries": 623, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724029196, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f8d645fe-211f-41fd-90f2-c2226d7c2f21", "db_session_id": "QMOFP9V9MHSRZO9RR5TU", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724029196363195, "job": 1, "event": "recovery_finished"} 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-08-19T00:59:56.704 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi017/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55be242f0e00 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: DB pointer 0x55be243ea000 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** DB Stats ** 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-19T00:59:56.705 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** Compaction Stats [default] ** 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: L0 1/0 1.49 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 469.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: L6 1/0 7.01 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Sum 2/0 8.50 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 469.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 469.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** Compaction Stats [default] ** 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-19T00:59:56.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-19T00:59:56.707 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 469.8 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-08-19T00:59:56.707 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:59:56.707 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-19T00:59:56.707 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:59:56.707 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-19T00:59:56.707 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-08-19T00:59:56.707 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-19T00:59:56.707 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-19T00:59:56.707 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-19T00:59:56.707 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-19T00:59:56.707 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Cumulative compaction: 0.00 GB write, 178.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Interval compaction: 0.00 GB write, 178.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Block cache BinnedLRUCache@0x55be242c3090#2 capacity: 512.00 MB usage: 5.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: starting mon.smithi017 rank 0 at public addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] at bind addrs [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi017 fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: mon.smithi017@-1(???) e2 preinit fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: mon.smithi017@-1(???).mds e21 new map 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: mon.smithi017@-1(???).mds e21 print_map 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: e21 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-08-19T00:59:56.708 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: legacy client fscid: 1 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Filesystem 'cephfs' (1) 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: fs_name cephfs 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: epoch 21 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: created 2024-08-19T00:53:21.603255+0000 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: modified 2024-08-19T00:53:41.004049+0000 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: tableserver 0 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: root 0 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: session_timeout 60 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: session_autoclose 300 2024-08-19T00:59:56.709 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: max_file_size 1099511627776 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: max_xattr_size 65536 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: required_client_features {} 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: last_failure 0 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: last_failure_osd_epoch 46 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: max_mds 2 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: in 0,1 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: up {0=14486,1=24299} 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: failed 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: damaged 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: stopped 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: data_pools [3] 2024-08-19T00:59:56.710 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: metadata_pool 2 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: inline_data enabled 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: balancer 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: bal_rank_mask -1 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: standby_count_wanted 1 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: qdb_cluster leader: 0 members: 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: [mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: [mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: [mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: [mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: mon.smithi017@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: mon.smithi017@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: mon.smithi017@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-08-19T00:59:56.711 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: mon.smithi017@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-08-19T00:59:56.712 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 ceph-mon[99370]: mon.smithi017@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-08-19T00:59:56.712 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 bash[99351]: d3c8cdedb4549814676901f6a752ee9f96646f6f680d758cbdef533fca091793 2024-08-19T00:59:56.712 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:56 smithi017 systemd[1]: Started Ceph mon.smithi017 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T00:59:58.048 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:59:58.048 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:59:58.048 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: pgmap v92: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: pgmap v93: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: mon.smithi017 calling monitor election 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: mon.smithi017 is new leader, mons smithi017,smithi086 in quorum (ranks 0,1) 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: monmap epoch 2 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: last_changed 2024-08-19T00:49:07.613835+0000 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: created 2024-08-19T00:46:27.325176+0000 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: min_mon_release 18 (reef) 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: election_strategy: 1 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: 1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.smithi086 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T00:59:58.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: osdmap e48: 6 total, 6 up, 6 in 2024-08-19T00:59:58.050 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: mgrmap e32: smithi017.hfpawi(active, since 3m), standbys: smithi086.uthxct 2024-08-19T00:59:58.050 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T00:59:58.050 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T00:59:58.050 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T00:59:58.050 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: from='mgr.14654 ' entity='' 2024-08-19T00:59:58.050 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 00:59:57 smithi017 ceph-mon[99370]: mgrmap e33: smithi017.hfpawi(active, since 3m), standbys: smithi086.uthxct 2024-08-19T00:59:58.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T00:59:58.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T00:59:58.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: pgmap v92: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:58.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: pgmap v93: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T00:59:58.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: from='mgr.14654 172.21.15.17:0/1907452660' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T00:59:58.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: mon.smithi017 calling monitor election 2024-08-19T00:59:58.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: mon.smithi017 is new leader, mons smithi017,smithi086 in quorum (ranks 0,1) 2024-08-19T00:59:58.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: monmap epoch 2 2024-08-19T00:59:58.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T00:59:58.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: last_changed 2024-08-19T00:49:07.613835+0000 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: created 2024-08-19T00:46:27.325176+0000 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: min_mon_release 18 (reef) 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: election_strategy: 1 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: 1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.smithi086 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: osdmap e48: 6 total, 6 up, 6 in 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: mgrmap e32: smithi017.hfpawi(active, since 3m), standbys: smithi086.uthxct 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: from='mgr.14654 ' entity='' 2024-08-19T00:59:58.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 00:59:57 smithi086 ceph-mon[24511]: mgrmap e33: smithi017.hfpawi(active, since 3m), standbys: smithi086.uthxct 2024-08-19T01:00:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:00 smithi017 ceph-mon[99370]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:00 smithi086 ceph-mon[24511]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:02 smithi017 ceph-mon[99370]: Standby manager daemon smithi086.uthxct restarted 2024-08-19T01:00:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:02 smithi017 ceph-mon[99370]: Standby manager daemon smithi086.uthxct started 2024-08-19T01:00:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:02 smithi017 ceph-mon[99370]: from='mgr.? 172.21.15.86:0/3099407819' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/crt"}]: dispatch 2024-08-19T01:00:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:02 smithi017 ceph-mon[99370]: from='mgr.? 172.21.15.86:0/3099407819' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T01:00:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:02 smithi017 ceph-mon[99370]: from='mgr.? 172.21.15.86:0/3099407819' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/key"}]: dispatch 2024-08-19T01:00:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:02 smithi017 ceph-mon[99370]: from='mgr.? 172.21.15.86:0/3099407819' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T01:00:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:02 smithi086 ceph-mon[24511]: Standby manager daemon smithi086.uthxct restarted 2024-08-19T01:00:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:02 smithi086 ceph-mon[24511]: Standby manager daemon smithi086.uthxct started 2024-08-19T01:00:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:02 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/3099407819' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/crt"}]: dispatch 2024-08-19T01:00:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:02 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/3099407819' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-19T01:00:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:02 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/3099407819' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi086.uthxct/key"}]: dispatch 2024-08-19T01:00:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:02 smithi086 ceph-mon[24511]: from='mgr.? 172.21.15.86:0/3099407819' entity='mgr.smithi086.uthxct' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-19T01:00:03.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: mgrmap e34: smithi017.hfpawi(active, since 3m), standbys: smithi086.uthxct 2024-08-19T01:00:03.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: Active manager daemon smithi017.hfpawi restarted 2024-08-19T01:00:03.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: Activating manager daemon smithi017.hfpawi 2024-08-19T01:00:03.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: osdmap e49: 6 total, 6 up, 6 in 2024-08-19T01:00:03.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: mgrmap e35: smithi017.hfpawi(active, starting, since 0.0057064s), standbys: smithi086.uthxct 2024-08-19T01:00:03.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T01:00:03.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T01:00:03.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T01:00:03.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T01:00:03.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T01:00:03.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T01:00:03.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi017.hfpawi", "id": "smithi017.hfpawi"}]: dispatch 2024-08-19T01:00:03.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi086.uthxct", "id": "smithi086.uthxct"}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: Manager daemon smithi017.hfpawi is now available 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:00:03.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/mirror_snapshot_schedule"}]: dispatch 2024-08-19T01:00:03.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/mirror_snapshot_schedule"}]: dispatch 2024-08-19T01:00:03.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/trash_purge_schedule"}]: dispatch 2024-08-19T01:00:03.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:03 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/trash_purge_schedule"}]: dispatch 2024-08-19T01:00:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: mgrmap e34: smithi017.hfpawi(active, since 3m), standbys: smithi086.uthxct 2024-08-19T01:00:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: Active manager daemon smithi017.hfpawi restarted 2024-08-19T01:00:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: Activating manager daemon smithi017.hfpawi 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: osdmap e49: 6 total, 6 up, 6 in 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: mgrmap e35: smithi017.hfpawi(active, starting, since 0.0057064s), standbys: smithi086.uthxct 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi017.hfpawi", "id": "smithi017.hfpawi"}]: dispatch 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr metadata", "who": "smithi086.uthxct", "id": "smithi086.uthxct"}]: dispatch 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T01:00:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: Manager daemon smithi017.hfpawi is now available 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/mirror_snapshot_schedule"}]: dispatch 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/mirror_snapshot_schedule"}]: dispatch 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/trash_purge_schedule"}]: dispatch 2024-08-19T01:00:03.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:03 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi017.hfpawi/trash_purge_schedule"}]: dispatch 2024-08-19T01:00:05.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:04 smithi017 ceph-mon[99370]: mgrmap e36: smithi017.hfpawi(active, since 1.00854s), standbys: smithi086.uthxct 2024-08-19T01:00:05.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:04 smithi017 ceph-mon[99370]: pgmap v3: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-19T01:00:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:04 smithi086 ceph-mon[24511]: mgrmap e36: smithi017.hfpawi(active, since 1.00854s), standbys: smithi086.uthxct 2024-08-19T01:00:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:04 smithi086 ceph-mon[24511]: pgmap v3: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-19T01:00:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:05 smithi017 ceph-mon[99370]: [19/Aug/2024:01:00:04] ENGINE Bus STARTING 2024-08-19T01:00:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:05 smithi017 ceph-mon[99370]: [19/Aug/2024:01:00:04] ENGINE Serving on https://172.21.15.17:7150 2024-08-19T01:00:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:05 smithi017 ceph-mon[99370]: [19/Aug/2024:01:00:04] ENGINE Error in HTTPServer.serve 2024-08-19T01:00:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: Traceback (most recent call last): 2024-08-19T01:00:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T01:00:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._connections.run(self.expiration_interval) 2024-08-19T01:00:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T01:00:06.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._run(expiration_interval) 2024-08-19T01:00:06.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T01:00:06.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T01:00:06.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T01:00:06.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T01:00:06.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T01:00:06.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: s = self.context.wrap_socket( 2024-08-19T01:00:06.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T01:00:06.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: return self.sslsocket_class._create( 2024-08-19T01:00:06.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T01:00:06.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self.do_handshake() 2024-08-19T01:00:06.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T01:00:06.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: self._sslobj.do_handshake() 2024-08-19T01:00:06.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T01:00:06.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:05 smithi017 ceph-mon[99370]: [19/Aug/2024:01:00:04] ENGINE Serving on http://172.21.15.17:8765 2024-08-19T01:00:06.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:05 smithi017 ceph-mon[99370]: [19/Aug/2024:01:00:04] ENGINE Bus STARTED 2024-08-19T01:00:06.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:05 smithi017 ceph-mon[99370]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-19T01:00:06.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:05 smithi017 ceph-mon[99370]: mgrmap e37: smithi017.hfpawi(active, since 2s), standbys: smithi086.uthxct 2024-08-19T01:00:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:05 smithi086 ceph-mon[24511]: [19/Aug/2024:01:00:04] ENGINE Bus STARTING 2024-08-19T01:00:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:05 smithi086 ceph-mon[24511]: [19/Aug/2024:01:00:04] ENGINE Serving on https://172.21.15.17:7150 2024-08-19T01:00:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:05 smithi086 ceph-mon[24511]: [19/Aug/2024:01:00:04] ENGINE Error in HTTPServer.serve 2024-08-19T01:00:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Traceback (most recent call last): 2024-08-19T01:00:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-19T01:00:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self._connections.run(self.expiration_interval) 2024-08-19T01:00:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-19T01:00:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self._run(expiration_interval) 2024-08-19T01:00:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-19T01:00:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: s = self.context.wrap_socket( 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: return self.sslsocket_class._create( 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self.do_handshake() 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: self._sslobj.do_handshake() 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:05 smithi086 ceph-mon[24511]: [19/Aug/2024:01:00:04] ENGINE Serving on http://172.21.15.17:8765 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:05 smithi086 ceph-mon[24511]: [19/Aug/2024:01:00:04] ENGINE Bus STARTED 2024-08-19T01:00:06.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:05 smithi086 ceph-mon[24511]: pgmap v4: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-19T01:00:06.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:05 smithi086 ceph-mon[24511]: mgrmap e37: smithi017.hfpawi(active, since 2s), standbys: smithi086.uthxct 2024-08-19T01:00:07.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:07 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:07.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:07 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:07.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:07 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:07.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:07 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:07.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:07 smithi017 ceph-mon[99370]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-19T01:00:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:07 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:07 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:07 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:07 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:07 smithi086 ceph-mon[24511]: pgmap v5: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-08-19T01:00:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:08 smithi017 ceph-mon[99370]: mgrmap e38: smithi017.hfpawi(active, since 4s), standbys: smithi086.uthxct 2024-08-19T01:00:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:08 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:08 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:08 smithi086 ceph-mon[24511]: mgrmap e38: smithi017.hfpawi(active, since 4s), standbys: smithi086.uthxct 2024-08-19T01:00:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:08 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:08 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:09.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:09 smithi017 ceph-mon[99370]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 0 B/s wr, 26 op/s 2024-08-19T01:00:09.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:09 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:09.771 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:09 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:09.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:09 smithi086 ceph-mon[24511]: pgmap v6: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 0 B/s wr, 26 op/s 2024-08-19T01:00:09.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:09 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:09.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:09 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:10 smithi017 ceph-mon[99370]: pgmap v7: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-19T01:00:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:10 smithi086 ceph-mon[24511]: pgmap v7: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-08-19T01:00:13.408 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.408 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: Updating smithi017:/etc/ceph/ceph.conf 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: Updating smithi086:/etc/ceph/ceph.conf 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: pgmap v8: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-19T01:00:13.409 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.410 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.410 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.410 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.410 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:13 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:00:13.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: Updating smithi017:/etc/ceph/ceph.conf 2024-08-19T01:00:13.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: Updating smithi086:/etc/ceph/ceph.conf 2024-08-19T01:00:13.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T01:00:13.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-19T01:00:13.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: Updating smithi017:/etc/ceph/ceph.client.admin.keyring 2024-08-19T01:00:13.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: Updating smithi086:/etc/ceph/ceph.client.admin.keyring 2024-08-19T01:00:13.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: Updating smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T01:00:13.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: Updating smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-19T01:00:13.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: pgmap v8: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-08-19T01:00:13.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:13.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:13 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:14.433 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:14 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:00:14.433 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:14 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:00:14.433 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:14 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-19T01:00:14.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:14 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:00:14.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:14 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:00:14.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:14 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-08-19T01:00:15.885 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:15 smithi086 ceph-mon[24511]: Upgrade: Updating mon.smithi086 2024-08-19T01:00:15.885 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:15 smithi086 ceph-mon[24511]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:15.885 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:15 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T01:00:15.885 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:15 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T01:00:15.885 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:15 smithi086 ceph-mon[24511]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:15.885 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:15 smithi086 ceph-mon[24511]: Deploying daemon mon.smithi086 on smithi086 2024-08-19T01:00:15.885 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:15 smithi086 ceph-mon[24511]: pgmap v9: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-08-19T01:00:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:15 smithi017 ceph-mon[99370]: Upgrade: Updating mon.smithi086 2024-08-19T01:00:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:15 smithi017 ceph-mon[99370]: from='mgr.34104 ' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:15 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T01:00:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:15 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T01:00:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:15 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:15 smithi017 ceph-mon[99370]: Deploying daemon mon.smithi086 on smithi086 2024-08-19T01:00:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:15 smithi017 ceph-mon[99370]: pgmap v9: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-08-19T01:00:16.523 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:16 smithi086 systemd[1]: Stopping Ceph mon.smithi086 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:00:16.881 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:16 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086[24503]: 2024-08-19T01:00:16.519+0000 7fe0abd91640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi086 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:00:16.881 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:16 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086[24503]: 2024-08-19T01:00:16.520+0000 7fe0abd91640 -1 mon.smithi086@1(peon) e2 *** Got Signal Terminated *** 2024-08-19T01:00:16.881 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:16 smithi086 podman[71140]: 2024-08-19 01:00:16.612943625 +0000 UTC m=+0.200171675 container died c6fce0ad535d0218d538c4cfdf0ecd7218dfd35a7d9019075776377d891a7cb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=reef-baa926d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:00:17.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:16 smithi086 podman[71140]: 2024-08-19 01:00:16.979344759 +0000 UTC m=+0.566572805 container cleanup c6fce0ad535d0218d538c4cfdf0ecd7218dfd35a7d9019075776377d891a7cb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-baa926d, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, org.label-schema.license=GPLv2) 2024-08-19T01:00:17.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:16 smithi086 bash[71140]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086 2024-08-19T01:00:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:17 smithi086 podman[71152]: 2024-08-19 01:00:17.347697816 +0000 UTC m=+0.736820630 container remove c6fce0ad535d0218d538c4cfdf0ecd7218dfd35a7d9019075776377d891a7cb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086, ceph=True, RELEASE=reef-baa926d, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-19T01:00:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:17 smithi086 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi086.service: Deactivated successfully. 2024-08-19T01:00:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:17 smithi086 systemd[1]: Stopped Ceph mon.smithi086 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:00:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:17 smithi086 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi086.service: Consumed 7.048s CPU time. 2024-08-19T01:00:18.116 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:17 smithi086 systemd[1]: Starting Ceph mon.smithi086 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:00:18.116 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:17 smithi086 podman[71285]: 2024-08-19 01:00:17.889973208 +0000 UTC m=+0.017730661 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:00:18.116 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 podman[71285]: 2024-08-19 01:00:18.01574491 +0000 UTC m=+0.143502406 container create 1ffcf46dbba95c595481864d2953a1ca11c95961d6658e3a447c60f48d1448ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-19T01:00:18.267 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 podman[71285]: 2024-08-19 01:00:18.234711841 +0000 UTC m=+0.362469306 container init 1ffcf46dbba95c595481864d2953a1ca11c95961d6658e3a447c60f48d1448ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True) 2024-08-19T01:00:18.267 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 podman[71285]: 2024-08-19 01:00:18.237879105 +0000 UTC m=+0.365636562 container start 1ffcf46dbba95c595481864d2953a1ca11c95961d6658e3a447c60f48d1448ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, ceph=True) 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: set uid:gid to 167:167 (ceph:ceph) 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc), process ceph-mon, pid 2 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: pidfile_write: ignore empty --pid-file 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: load: jerasure load: lrc 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: RocksDB version: 7.9.2 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Git sha 0 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Compile date 2024-08-18 15:19:56 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: DB SUMMARY 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: DB Session ID: 9PMBKJO339RQQIFX9PK5 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: CURRENT file: CURRENT 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: IDENTITY file: IDENTITY 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1412 Bytes 2024-08-19T01:00:18.268 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi086/store.db dir, Total Num: 1, files: 000027.sst 2024-08-19T01:00:18.269 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi086/store.db: 000025.log size: 5515095 ; 2024-08-19T01:00:18.269 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.error_if_exists: 0 2024-08-19T01:00:18.269 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.create_if_missing: 0 2024-08-19T01:00:18.269 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.paranoid_checks: 1 2024-08-19T01:00:18.269 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-19T01:00:18.269 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-19T01:00:18.269 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-19T01:00:18.269 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.env: 0x55f6c48047a0 2024-08-19T01:00:18.269 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.fs: PosixFileSystem 2024-08-19T01:00:18.269 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.info_log: 0x55f6c641b6e0 2024-08-19T01:00:18.269 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_file_opening_threads: 16 2024-08-19T01:00:18.270 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.statistics: (nil) 2024-08-19T01:00:18.270 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.use_fsync: 0 2024-08-19T01:00:18.270 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_log_file_size: 0 2024-08-19T01:00:18.270 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-19T01:00:18.270 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-19T01:00:18.270 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.keep_log_file_num: 1000 2024-08-19T01:00:18.270 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.recycle_log_file_num: 0 2024-08-19T01:00:18.270 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.allow_fallocate: 1 2024-08-19T01:00:18.270 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.allow_mmap_reads: 0 2024-08-19T01:00:18.270 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.allow_mmap_writes: 0 2024-08-19T01:00:18.270 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.use_direct_reads: 0 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.create_missing_column_families: 0 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.db_log_dir: 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.wal_dir: 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.advise_random_on_open: 1 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.db_write_buffer_size: 0 2024-08-19T01:00:18.271 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.write_buffer_manager: 0x55f6c642adc0 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.rate_limiter: (nil) 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.wal_recovery_mode: 2 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.enable_thread_tracking: 0 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.enable_pipelined_write: 0 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.unordered_write: 0 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-19T01:00:18.272 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-19T01:00:18.379 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-19T01:00:18.379 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.row_cache: None 2024-08-19T01:00:18.379 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.wal_filter: None 2024-08-19T01:00:18.379 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-19T01:00:18.379 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.allow_ingest_behind: 0 2024-08-19T01:00:18.379 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.two_write_queues: 0 2024-08-19T01:00:18.379 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.manual_wal_flush: 0 2024-08-19T01:00:18.379 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.wal_compression: 0 2024-08-19T01:00:18.379 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.atomic_flush: 0 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.log_readahead_size: 0 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.best_efforts_recovery: 0 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.allow_data_in_errors: 0 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.db_host_id: __hostname__ 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_background_jobs: 2 2024-08-19T01:00:18.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_background_compactions: -1 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_subcompactions: 1 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_total_wal_size: 0 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_open_files: -1 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bytes_per_sync: 0 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-19T01:00:18.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_readahead_size: 0 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_background_flushes: -1 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Compression algorithms supported: 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: kZSTD supported: 0 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: kXpressCompression supported: 0 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: kBZip2Compression supported: 0 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: kLZ4Compression supported: 1 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: kZlibCompression supported: 1 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: kLZ4HCCompression supported: 1 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: kSnappyCompression supported: 1 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-19T01:00:18.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi086/store.db/MANIFEST-000010 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.merge_operator: 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_filter: None 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_filter_factory: None 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.sst_partitioner_factory: None 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f6c641b320) 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: cache_index_and_filter_blocks: 1 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-19T01:00:18.383 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: pin_top_level_index_and_filter: 1 2024-08-19T01:00:18.384 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: index_type: 0 2024-08-19T01:00:18.384 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: data_block_index_type: 0 2024-08-19T01:00:18.384 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: index_shortening: 1 2024-08-19T01:00:18.384 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-19T01:00:18.384 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: checksum: 4 2024-08-19T01:00:18.384 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: no_block_cache: 0 2024-08-19T01:00:18.384 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: block_cache: 0x55f6c640f090 2024-08-19T01:00:18.384 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: block_cache_name: BinnedLRUCache 2024-08-19T01:00:18.384 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: block_cache_options: 2024-08-19T01:00:18.384 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: capacity : 536870912 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: num_shard_bits : 4 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: strict_capacity_limit : 0 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: high_pri_pool_ratio: 0.000 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: block_cache_compressed: (nil) 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: persistent_cache: (nil) 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: block_size: 4096 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: block_size_deviation: 10 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: block_restart_interval: 16 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: index_block_restart_interval: 1 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: metadata_block_size: 4096 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: partition_filters: 0 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: use_delta_encoding: 1 2024-08-19T01:00:18.385 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: filter_policy: bloomfilter 2024-08-19T01:00:18.386 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: whole_key_filtering: 1 2024-08-19T01:00:18.386 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: verify_compression: 0 2024-08-19T01:00:18.386 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: read_amp_bytes_per_bit: 0 2024-08-19T01:00:18.386 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: format_version: 5 2024-08-19T01:00:18.386 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: enable_index_compression: 1 2024-08-19T01:00:18.387 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: block_align: 0 2024-08-19T01:00:18.387 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: max_auto_readahead_size: 262144 2024-08-19T01:00:18.387 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: prepopulate_block_cache: 0 2024-08-19T01:00:18.387 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: initial_auto_readahead_size: 8192 2024-08-19T01:00:18.387 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: num_file_reads_for_auto_readahead: 2 2024-08-19T01:00:18.387 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.write_buffer_size: 33554432 2024-08-19T01:00:18.387 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_write_buffer_number: 2 2024-08-19T01:00:18.387 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compression: NoCompression 2024-08-19T01:00:18.387 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bottommost_compression: Disabled 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.prefix_extractor: nullptr 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.num_levels: 7 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-19T01:00:18.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compression_opts.level: 32767 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compression_opts.strategy: 0 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compression_opts.enabled: false 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-19T01:00:18.389 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.target_file_size_base: 67108864 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-19T01:00:18.390 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.arena_block_size: 1048576 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.disable_auto_compactions: 0 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-19T01:00:18.391 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.inplace_update_support: 0 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.bloom_locality: 0 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.max_successive_merges: 0 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.paranoid_file_checks: 0 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.force_consistency_checks: 1 2024-08-19T01:00:18.392 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.report_bg_io_stats: 0 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.ttl: 2592000 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.enable_blob_files: false 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.min_blob_size: 0 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.blob_file_size: 268435456 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.blob_file_starting_level: 0 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-19T01:00:18.393 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-19T01:00:18.394 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi086/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12194, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-08-19T01:00:18.394 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-08-19T01:00:18.394 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d658eba4-5833-4608-b0a6-953b6abd4952 2024-08-19T01:00:18.394 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724029218265002, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-08-19T01:00:18.394 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-08-19T01:00:18.394 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724029218279923, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 3381117, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12199, "largest_seqno": 14198, "table_properties": {"data_size": 3372509, "index_size": 5450, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2117, "raw_key_size": 19784, "raw_average_key_size": 23, "raw_value_size": 3354757, "raw_average_value_size": 4022, "num_data_blocks": 247, "num_entries": 834, "num_filter_entries": 834, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724029218, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d658eba4-5833-4608-b0a6-953b6abd4952", "db_session_id": "9PMBKJO339RQQIFX9PK5", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-08-19T01:00:18.395 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724029218280073, "job": 1, "event": "recovery_finished"} 2024-08-19T01:00:18.395 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-08-19T01:00:18.395 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-08-19T01:00:18.395 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi086/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-19T01:00:18.395 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f6c643ce00 2024-08-19T01:00:18.395 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: DB pointer 0x55f6c6536000 2024-08-19T01:00:18.395 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-19T01:00:18.395 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: ** DB Stats ** 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: ** Compaction Stats [default] ** 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-19T01:00:18.396 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: L0 1/0 3.22 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 686.2 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: L6 1/0 7.01 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Sum 2/0 10.24 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 686.2 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 686.2 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: ** Compaction Stats [default] ** 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 686.2 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-08-19T01:00:18.397 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Cumulative compaction: 0.00 GB write, 167.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Interval compaction: 0.00 GB write, 167.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Block cache BinnedLRUCache@0x55f6c640f090#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: starting mon.smithi086 rank 1 at public addrs [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] at bind addrs [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi086 fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: mon.smithi086@-1(???) e2 preinit fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T01:00:18.398 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: mon.smithi086@-1(???).mds e21 new map 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: mon.smithi086@-1(???).mds e21 print_map 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: e21 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: legacy client fscid: 1 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: Filesystem 'cephfs' (1) 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: fs_name cephfs 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: epoch 21 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: modified 2024-08-19T00:53:41.004049+0000 2024-08-19T01:00:18.399 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: tableserver 0 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: root 0 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: session_timeout 60 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: session_autoclose 300 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: max_file_size 1099511627776 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: max_xattr_size 65536 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: required_client_features {} 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: last_failure 0 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: last_failure_osd_epoch 46 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: max_mds 2 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: in 0,1 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: up {0=14486,1=24299} 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: failed 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: damaged 2024-08-19T01:00:18.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: stopped 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: data_pools [3] 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: metadata_pool 2 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: inline_data enabled 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: balancer 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: bal_rank_mask -1 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: standby_count_wanted 1 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: qdb_cluster leader: 0 members: 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: [mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: [mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: [mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: [mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout: 2024-08-19T01:00:18.401 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: mon.smithi086@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-08-19T01:00:18.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: mon.smithi086@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-08-19T01:00:18.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: mon.smithi086@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-08-19T01:00:18.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: mon.smithi086@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-08-19T01:00:18.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 ceph-mon[71303]: mon.smithi086@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-08-19T01:00:18.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 bash[71285]: 1ffcf46dbba95c595481864d2953a1ca11c95961d6658e3a447c60f48d1448ee 2024-08-19T01:00:18.402 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:18 smithi086 systemd[1]: Started Ceph mon.smithi086 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:00:19.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T01:00:19.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T01:00:19.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T01:00:19.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T01:00:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: 1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.smithi086 2024-08-19T01:00:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T01:00:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: osdmap e49: 6 total, 6 up, 6 in 2024-08-19T01:00:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: mgrmap e38: smithi017.hfpawi(active, since 16s), standbys: smithi086.uthxct 2024-08-19T01:00:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:00:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: mon.smithi017 calling monitor election 2024-08-19T01:00:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: mon.smithi086 calling monitor election 2024-08-19T01:00:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T01:00:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T01:00:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: mon.smithi017 is new leader, mons smithi017,smithi086 in quorum (ranks 0,1) 2024-08-19T01:00:20.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: monmap epoch 3 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: last_changed 2024-08-19T01:00:19.597710+0000 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: created 2024-08-19T00:46:27.325176+0000 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: min_mon_release 19 (squid) 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: election_strategy: 1 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: 1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.smithi086 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: osdmap e49: 6 total, 6 up, 6 in 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: mgrmap e38: smithi017.hfpawi(active, since 16s), standbys: smithi086.uthxct 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:20.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:20.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:00:20.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:20.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:20.936 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:20 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:00:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: 1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.smithi086 2024-08-19T01:00:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T01:00:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: osdmap e49: 6 total, 6 up, 6 in 2024-08-19T01:00:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: mgrmap e38: smithi017.hfpawi(active, since 16s), standbys: smithi086.uthxct 2024-08-19T01:00:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:00:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: mon.smithi017 calling monitor election 2024-08-19T01:00:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: mon.smithi086 calling monitor election 2024-08-19T01:00:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi017"}]: dispatch 2024-08-19T01:00:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mon metadata", "id": "smithi086"}]: dispatch 2024-08-19T01:00:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: mon.smithi017 is new leader, mons smithi017,smithi086 in quorum (ranks 0,1) 2024-08-19T01:00:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: monmap epoch 3 2024-08-19T01:00:20.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T01:00:20.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: last_changed 2024-08-19T01:00:19.597710+0000 2024-08-19T01:00:20.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: created 2024-08-19T00:46:27.325176+0000 2024-08-19T01:00:20.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: min_mon_release 19 (squid) 2024-08-19T01:00:20.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: election_strategy: 1 2024-08-19T01:00:20.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: 0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.smithi017 2024-08-19T01:00:20.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: 1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.smithi086 2024-08-19T01:00:20.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2 up:standby-replay 2024-08-19T01:00:20.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: osdmap e49: 6 total, 6 up, 6 in 2024-08-19T01:00:20.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: mgrmap e38: smithi017.hfpawi(active, since 16s), standbys: smithi086.uthxct 2024-08-19T01:00:20.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:20.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:20.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:00:20.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:20.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:20.949 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:20 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:00:21.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:21 smithi017 ceph-mon[99370]: pgmap v12: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:21 smithi086 ceph-mon[71303]: pgmap v12: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:23.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:23 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:23.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:23 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:23.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:23 smithi017 ceph-mon[99370]: pgmap v13: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:23.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:23 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:23.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:23 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:23.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.724+0000 7f687fe1e640 1 -- 172.21.15.17:0/1323119180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68780fdb10 msgr2=0x7f68780fdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:23.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.724+0000 7f687fe1e640 1 --2- 172.21.15.17:0/1323119180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68780fdb10 0x7f68780fdf50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6868009880 tx=0x7f686802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:00:23.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 -- 172.21.15.17:0/1323119180 shutdown_connections 2024-08-19T01:00:23.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 --2- 172.21.15.17:0/1323119180 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f68780fdb10 0x7f68780fdf50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:23.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 --2- 172.21.15.17:0/1323119180 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6878100940 0x7f6878100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:23.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 -- 172.21.15.17:0/1323119180 >> 172.21.15.17:0/1323119180 conn(0x7f68780f9a60 msgr2=0x7f68780fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:23.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 -- 172.21.15.17:0/1323119180 shutdown_connections 2024-08-19T01:00:23.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 -- 172.21.15.17:0/1323119180 wait complete. 2024-08-19T01:00:23.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 Processor -- start 2024-08-19T01:00:23.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 -- start start 2024-08-19T01:00:23.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68780fdb10 0x7f6878197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:23.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6878100940 0x7f6878198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:23.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68781988f0 con 0x7f6878100940 2024-08-19T01:00:23.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.725+0000 7f687fe1e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687819b560 con 0x7f68780fdb10 2024-08-19T01:00:23.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f687d3b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6878100940 0x7f6878198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:23.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f687d3b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6878100940 0x7f6878198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38846/0 (socket says 172.21.15.17:38846) 2024-08-19T01:00:23.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f687d3b9640 1 -- 172.21.15.17:0/3233853256 learned_addr learned my addr 172.21.15.17:0/3233853256 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:23.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f687dbba640 1 --2- 172.21.15.17:0/3233853256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68780fdb10 0x7f6878197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:23.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f687d3b9640 1 -- 172.21.15.17:0/3233853256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68780fdb10 msgr2=0x7f6878197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:23.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f687d3b9640 1 --2- 172.21.15.17:0/3233853256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68780fdb10 0x7f6878197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:23.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f687d3b9640 1 -- 172.21.15.17:0/3233853256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868009560 con 0x7f6878100940 2024-08-19T01:00:23.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f687d3b9640 1 --2- 172.21.15.17:0/3233853256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6878100940 0x7f6878198210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6868006010 tx=0x7f68680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:23.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f686effd640 1 -- 172.21.15.17:0/3233853256 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6868004aa0 con 0x7f6878100940 2024-08-19T01:00:23.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f686effd640 1 -- 172.21.15.17:0/3233853256 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6868031470 con 0x7f6878100940 2024-08-19T01:00:23.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f687fe1e640 1 -- 172.21.15.17:0/3233853256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687819b7e0 con 0x7f6878100940 2024-08-19T01:00:23.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f686effd640 1 -- 172.21.15.17:0/3233853256 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6868003940 con 0x7f6878100940 2024-08-19T01:00:23.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.726+0000 7f687fe1e640 1 -- 172.21.15.17:0/3233853256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687819bcd0 con 0x7f6878100940 2024-08-19T01:00:23.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.727+0000 7f687fe1e640 1 -- 172.21.15.17:0/3233853256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68780ff030 con 0x7f6878100940 2024-08-19T01:00:23.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.728+0000 7f686effd640 1 -- 172.21.15.17:0/3233853256 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f6868031b90 con 0x7f6878100940 2024-08-19T01:00:23.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.729+0000 7f686effd640 1 --2- 172.21.15.17:0/3233853256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f686406e2a0 0x7f6864070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:23.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.729+0000 7f686effd640 1 -- 172.21.15.17:0/3233853256 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f68680af490 con 0x7f6878100940 2024-08-19T01:00:23.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.729+0000 7f687dbba640 1 --2- 172.21.15.17:0/3233853256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f686406e2a0 0x7f6864070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:23.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.729+0000 7f687dbba640 1 --2- 172.21.15.17:0/3233853256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f686406e2a0 0x7f6864070760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6874005d00 tx=0x7f687400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:23.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.733+0000 7f686effd640 1 -- 172.21.15.17:0/3233853256 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6868078610 con 0x7f6878100940 2024-08-19T01:00:23.821 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:23 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:23.821 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:23 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:23.821 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:23 smithi086 ceph-mon[71303]: pgmap v13: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:23.821 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:23 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:23.821 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:23 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.926+0000 7f687fe1e640 1 -- 172.21.15.17:0/3233853256 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f687810ef80 con 0x7f686406e2a0 2024-08-19T01:00:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.928+0000 7f686effd640 1 -- 172.21.15.17:0/3233853256 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f687810ef80 con 0x7f686406e2a0 2024-08-19T01:00:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.930+0000 7f687fe1e640 1 -- 172.21.15.17:0/3233853256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f686406e2a0 msgr2=0x7f6864070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.930+0000 7f687fe1e640 1 --2- 172.21.15.17:0/3233853256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f686406e2a0 0x7f6864070760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6874005d00 tx=0x7f687400b410 comp rx=0 tx=0).stop 2024-08-19T01:00:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.930+0000 7f687fe1e640 1 -- 172.21.15.17:0/3233853256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6878100940 msgr2=0x7f6878198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.930+0000 7f687fe1e640 1 --2- 172.21.15.17:0/3233853256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6878100940 0x7f6878198210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6868006010 tx=0x7f68680055a0 comp rx=0 tx=0).stop 2024-08-19T01:00:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.930+0000 7f687fe1e640 1 -- 172.21.15.17:0/3233853256 shutdown_connections 2024-08-19T01:00:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.930+0000 7f687fe1e640 1 --2- 172.21.15.17:0/3233853256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f686406e2a0 0x7f6864070760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.930+0000 7f687fe1e640 1 --2- 172.21.15.17:0/3233853256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6878100940 0x7f6878198210 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.930+0000 7f687fe1e640 1 --2- 172.21.15.17:0/3233853256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68780fdb10 0x7f6878197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.930+0000 7f687fe1e640 1 -- 172.21.15.17:0/3233853256 >> 172.21.15.17:0/3233853256 conn(0x7f68780f9a60 msgr2=0x7f68780fab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.930+0000 7f687fe1e640 1 -- 172.21.15.17:0/3233853256 shutdown_connections 2024-08-19T01:00:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:23.930+0000 7f687fe1e640 1 -- 172.21.15.17:0/3233853256 wait complete. 2024-08-19T01:00:23.941 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:00:24.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.013+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/3397966924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e480ff210 msgr2=0x7f1e4810bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.013+0000 7f1e4f3d7640 1 --2- 172.21.15.17:0/3397966924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e480ff210 0x7f1e4810bed0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1e38009880 tx=0x7f1e3802a490 comp rx=0 tx=0).stop 2024-08-19T01:00:24.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.013+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/3397966924 shutdown_connections 2024-08-19T01:00:24.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.013+0000 7f1e4f3d7640 1 --2- 172.21.15.17:0/3397966924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e480ff210 0x7f1e4810bed0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.013+0000 7f1e4f3d7640 1 --2- 172.21.15.17:0/3397966924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e480fe860 0x7f1e480fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.013+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/3397966924 >> 172.21.15.17:0/3397966924 conn(0x7f1e480fa730 msgr2=0x7f1e480fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:24.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.014+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/3397966924 shutdown_connections 2024-08-19T01:00:24.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.014+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/3397966924 wait complete. 2024-08-19T01:00:24.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.014+0000 7f1e4f3d7640 1 Processor -- start 2024-08-19T01:00:24.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.014+0000 7f1e4f3d7640 1 -- start start 2024-08-19T01:00:24.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.014+0000 7f1e4f3d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e480fe860 0x7f1e48197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4f3d7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e480ff210 0x7f1e48198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4f3d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e481988f0 con 0x7f1e480fe860 2024-08-19T01:00:24.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4f3d7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4819b560 con 0x7f1e480ff210 2024-08-19T01:00:24.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4d173640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e480fe860 0x7f1e48197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:24.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4d173640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e480fe860 0x7f1e48197cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38870/0 (socket says 172.21.15.17:38870) 2024-08-19T01:00:24.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4d173640 1 -- 172.21.15.17:0/751237278 learned_addr learned my addr 172.21.15.17:0/751237278 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:24.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4d173640 1 -- 172.21.15.17:0/751237278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e480ff210 msgr2=0x7f1e48198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4d173640 1 --2- 172.21.15.17:0/751237278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e480ff210 0x7f1e48198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4d173640 1 -- 172.21.15.17:0/751237278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e38009560 con 0x7f1e480fe860 2024-08-19T01:00:24.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4d173640 1 --2- 172.21.15.17:0/751237278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e480fe860 0x7f1e48197cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400cc60 tx=0x7f1e4400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:24.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e3e7fc640 1 -- 172.21.15.17:0/751237278 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e44004b20 con 0x7f1e480fe860 2024-08-19T01:00:24.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/751237278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4819b840 con 0x7f1e480fe860 2024-08-19T01:00:24.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/751237278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4819bd90 con 0x7f1e480fe860 2024-08-19T01:00:24.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e3e7fc640 1 -- 172.21.15.17:0/751237278 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e44004c80 con 0x7f1e480fe860 2024-08-19T01:00:24.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.015+0000 7f1e3e7fc640 1 -- 172.21.15.17:0/751237278 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e4400f640 con 0x7f1e480fe860 2024-08-19T01:00:24.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.016+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/751237278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c005250 con 0x7f1e480fe860 2024-08-19T01:00:24.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.017+0000 7f1e3e7fc640 1 -- 172.21.15.17:0/751237278 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f1e440055e0 con 0x7f1e480fe860 2024-08-19T01:00:24.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.017+0000 7f1e3e7fc640 1 --2- 172.21.15.17:0/751237278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e3406e2b0 0x7f1e34070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.018+0000 7f1e3e7fc640 1 -- 172.21.15.17:0/751237278 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1e4408e460 con 0x7f1e480fe860 2024-08-19T01:00:24.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.018+0000 7f1e4c972640 1 --2- 172.21.15.17:0/751237278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e3406e2b0 0x7f1e34070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:24.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.018+0000 7f1e4c972640 1 --2- 172.21.15.17:0/751237278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e3406e2b0 0x7f1e34070770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1e48199240 tx=0x7f1e38000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:24.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.022+0000 7f1e3e7fc640 1 -- 172.21.15.17:0/751237278 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1e44057650 con 0x7f1e480fe860 2024-08-19T01:00:24.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.214+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/751237278 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e2c000bc0 con 0x7f1e3406e2b0 2024-08-19T01:00:24.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.215+0000 7f1e3e7fc640 1 -- 172.21.15.17:0/751237278 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f1e2c000bc0 con 0x7f1e3406e2b0 2024-08-19T01:00:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.217+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/751237278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e3406e2b0 msgr2=0x7f1e34070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.217+0000 7f1e4f3d7640 1 --2- 172.21.15.17:0/751237278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e3406e2b0 0x7f1e34070770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1e48199240 tx=0x7f1e38000bc0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.217+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/751237278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e480fe860 msgr2=0x7f1e48197cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.217+0000 7f1e4f3d7640 1 --2- 172.21.15.17:0/751237278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e480fe860 0x7f1e48197cd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400cc60 tx=0x7f1e4400a620 comp rx=0 tx=0).stop 2024-08-19T01:00:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.217+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/751237278 shutdown_connections 2024-08-19T01:00:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.217+0000 7f1e4f3d7640 1 --2- 172.21.15.17:0/751237278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e3406e2b0 0x7f1e34070770 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.217+0000 7f1e4f3d7640 1 --2- 172.21.15.17:0/751237278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e480ff210 0x7f1e48198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.217+0000 7f1e4f3d7640 1 --2- 172.21.15.17:0/751237278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e480fe860 0x7f1e48197cd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.217+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/751237278 >> 172.21.15.17:0/751237278 conn(0x7f1e480fa730 msgr2=0x7f1e480fbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:24.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.218+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/751237278 shutdown_connections 2024-08-19T01:00:24.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.218+0000 7f1e4f3d7640 1 -- 172.21.15.17:0/751237278 wait complete. 2024-08-19T01:00:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.300+0000 7fe855a19640 1 -- 172.21.15.17:0/16392219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8500ffda0 msgr2=0x7fe850100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.300+0000 7fe855a19640 1 --2- 172.21.15.17:0/16392219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8500ffda0 0x7fe850100180 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe840009880 tx=0x7fe84002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.300+0000 7fe855a19640 1 -- 172.21.15.17:0/16392219 shutdown_connections 2024-08-19T01:00:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.300+0000 7fe855a19640 1 --2- 172.21.15.17:0/16392219 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe850100750 0x7fe8501047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.300+0000 7fe855a19640 1 --2- 172.21.15.17:0/16392219 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8500ffda0 0x7fe850100180 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.300+0000 7fe855a19640 1 -- 172.21.15.17:0/16392219 >> 172.21.15.17:0/16392219 conn(0x7fe8500fb840 msgr2=0x7fe8500fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.300+0000 7fe855a19640 1 -- 172.21.15.17:0/16392219 shutdown_connections 2024-08-19T01:00:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.300+0000 7fe855a19640 1 -- 172.21.15.17:0/16392219 wait complete. 2024-08-19T01:00:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.301+0000 7fe855a19640 1 Processor -- start 2024-08-19T01:00:24.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.301+0000 7fe855a19640 1 -- start start 2024-08-19T01:00:24.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.301+0000 7fe855a19640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8500ffda0 0x7fe8500727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.301+0000 7fe855a19640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100750 0x7fe850072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.301+0000 7fe855a19640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe850073230 con 0x7fe850100750 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.301+0000 7fe855a19640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500733a0 con 0x7fe8500ffda0 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.301+0000 7fe84effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100750 0x7fe850072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.301+0000 7fe84effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100750 0x7fe850072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38890/0 (socket says 172.21.15.17:38890) 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.301+0000 7fe84effd640 1 -- 172.21.15.17:0/2878727689 learned_addr learned my addr 172.21.15.17:0/2878727689 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.301+0000 7fe846ffd640 1 --2- 172.21.15.17:0/2878727689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8500ffda0 0x7fe8500727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.302+0000 7fe84effd640 1 -- 172.21.15.17:0/2878727689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8500ffda0 msgr2=0x7fe8500727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.302+0000 7fe84effd640 1 --2- 172.21.15.17:0/2878727689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8500ffda0 0x7fe8500727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.302+0000 7fe84effd640 1 -- 172.21.15.17:0/2878727689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840009560 con 0x7fe850100750 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.302+0000 7fe84effd640 1 --2- 172.21.15.17:0/2878727689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100750 0x7fe850072cf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe83800b420 tx=0x7fe83800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.302+0000 7fe854a17640 1 -- 172.21.15.17:0/2878727689 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe838011800 con 0x7fe850100750 2024-08-19T01:00:24.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.302+0000 7fe854a17640 1 -- 172.21.15.17:0/2878727689 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe838011e20 con 0x7fe850100750 2024-08-19T01:00:24.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.302+0000 7fe855a19640 1 -- 172.21.15.17:0/2878727689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8501a1d90 con 0x7fe850100750 2024-08-19T01:00:24.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.302+0000 7fe854a17640 1 -- 172.21.15.17:0/2878727689 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83800f2e0 con 0x7fe850100750 2024-08-19T01:00:24.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.302+0000 7fe855a19640 1 -- 172.21.15.17:0/2878727689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8501a20f0 con 0x7fe850100750 2024-08-19T01:00:24.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.303+0000 7fe855a19640 1 -- 172.21.15.17:0/2878727689 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe850101280 con 0x7fe850100750 2024-08-19T01:00:24.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.304+0000 7fe854a17640 1 -- 172.21.15.17:0/2878727689 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fe838010380 con 0x7fe850100750 2024-08-19T01:00:24.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.304+0000 7fe854a17640 1 --2- 172.21.15.17:0/2878727689 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe83c06e2b0 0x7fe83c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.304+0000 7fe854a17640 1 -- 172.21.15.17:0/2878727689 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe83808db30 con 0x7fe850100750 2024-08-19T01:00:24.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.304+0000 7fe846ffd640 1 --2- 172.21.15.17:0/2878727689 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe83c06e2b0 0x7fe83c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:24.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.305+0000 7fe846ffd640 1 --2- 172.21.15.17:0/2878727689 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe83c06e2b0 0x7fe83c070770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe840009230 tx=0x7fe8400058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:24.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.309+0000 7fe854a17640 1 -- 172.21.15.17:0/2878727689 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe838056db0 con 0x7fe850100750 2024-08-19T01:00:24.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.493+0000 7fe855a19640 1 -- 172.21.15.17:0/2878727689 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe850108120 con 0x7fe83c06e2b0 2024-08-19T01:00:24.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.503+0000 7fe854a17640 1 -- 172.21.15.17:0/2878727689 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fe850108120 con 0x7fe83c06e2b0 2024-08-19T01:00:24.505 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:00:24.505 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (103s) 16s ago 12m 20.0M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:00:24.505 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (12m) 16s ago 12m 8342k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:00:24.505 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (11m) 1s ago 11m 8128k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:00:24.505 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (12m) 16s ago 12m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T01:00:24.505 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (11m) 1s ago 11m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (80s) 16s ago 12m 76.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (6m) 16s ago 6m 157M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (6m) 16s ago 6m 91.7M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (6m) 1s ago 6m 26.7M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (6m) 1s ago 6m 25.9M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (3m) 16s ago 13m 472M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (2m) 1s ago 11m 438M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (28s) 16s ago 13m 27.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (6s) 1s ago 11m 25.2M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (2m) 16s ago 12m 15.4M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (2m) 1s ago 11m 14.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (10m) 16s ago 10m 220M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T01:00:24.506 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (10m) 16s ago 10m 229M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T01:00:24.507 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (9m) 16s ago 9m 190M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T01:00:24.507 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (9m) 1s ago 9m 246M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T01:00:24.507 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (8m) 1s ago 8m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T01:00:24.507 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (8m) 1s ago 8m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T01:00:24.507 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (119s) 16s ago 11m 62.9M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:00:24.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.505+0000 7fe855a19640 1 -- 172.21.15.17:0/2878727689 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe83c06e2b0 msgr2=0x7fe83c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.505+0000 7fe855a19640 1 --2- 172.21.15.17:0/2878727689 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe83c06e2b0 0x7fe83c070770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe840009230 tx=0x7fe8400058d0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.505+0000 7fe855a19640 1 -- 172.21.15.17:0/2878727689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100750 msgr2=0x7fe850072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.505+0000 7fe855a19640 1 --2- 172.21.15.17:0/2878727689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100750 0x7fe850072cf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe83800b420 tx=0x7fe83800b8e0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.505+0000 7fe855a19640 1 -- 172.21.15.17:0/2878727689 shutdown_connections 2024-08-19T01:00:24.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.505+0000 7fe855a19640 1 --2- 172.21.15.17:0/2878727689 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe83c06e2b0 0x7fe83c070770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.505+0000 7fe855a19640 1 --2- 172.21.15.17:0/2878727689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe850100750 0x7fe850072cf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.505+0000 7fe855a19640 1 --2- 172.21.15.17:0/2878727689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8500ffda0 0x7fe8500727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.505+0000 7fe855a19640 1 -- 172.21.15.17:0/2878727689 >> 172.21.15.17:0/2878727689 conn(0x7fe8500fb840 msgr2=0x7fe8500fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:24.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.505+0000 7fe855a19640 1 -- 172.21.15.17:0/2878727689 shutdown_connections 2024-08-19T01:00:24.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.505+0000 7fe855a19640 1 -- 172.21.15.17:0/2878727689 wait complete. 2024-08-19T01:00:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.585+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1618763100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fb01049f0 msgr2=0x7f6fb0104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.585+0000 7f6fb80f1640 1 --2- 172.21.15.17:0/1618763100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fb01049f0 0x7f6fb0104dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009c20 tx=0x7f6fac02a970 comp rx=0 tx=0).stop 2024-08-19T01:00:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.586+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1618763100 shutdown_connections 2024-08-19T01:00:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.586+0000 7f6fb80f1640 1 --2- 172.21.15.17:0/1618763100 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fb00fe9f0 0x7f6fb00fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.586+0000 7f6fb80f1640 1 --2- 172.21.15.17:0/1618763100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fb01049f0 0x7f6fb0104dd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.586+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1618763100 >> 172.21.15.17:0/1618763100 conn(0x7f6fb00758a0 msgr2=0x7f6fb00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.586+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1618763100 shutdown_connections 2024-08-19T01:00:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.586+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1618763100 wait complete. 2024-08-19T01:00:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.586+0000 7f6fb80f1640 1 Processor -- start 2024-08-19T01:00:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.586+0000 7f6fb80f1640 1 -- start start 2024-08-19T01:00:24.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb80f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fb00fe9f0 0x7f6fb00fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb80f1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fb01049f0 0x7f6fb00fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb80f1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00fb800 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb80f1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb00fb940 con 0x7f6fb01049f0 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb5e8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fb00fe9f0 0x7f6fb00fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb5e8d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fb00fe9f0 0x7f6fb00fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38910/0 (socket says 172.21.15.17:38910) 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb5e8d640 1 -- 172.21.15.17:0/1321036604 learned_addr learned my addr 172.21.15.17:0/1321036604 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb568c640 1 --2- 172.21.15.17:0/1321036604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fb01049f0 0x7f6fb00fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb5e8d640 1 -- 172.21.15.17:0/1321036604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fb01049f0 msgr2=0x7f6fb00fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb5e8d640 1 --2- 172.21.15.17:0/1321036604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fb01049f0 0x7f6fb00fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb5e8d640 1 -- 172.21.15.17:0/1321036604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac009900 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fb5e8d640 1 --2- 172.21.15.17:0/1321036604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fb00fe9f0 0x7f6fb00fad80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fac032000 tx=0x7f6fac0308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.587+0000 7f6fa6ffd640 1 -- 172.21.15.17:0/1321036604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fac02f590 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.588+0000 7f6fa6ffd640 1 -- 172.21.15.17:0/1321036604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6fac030ca0 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.588+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1321036604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb00fbbc0 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.588+0000 7f6fa6ffd640 1 -- 172.21.15.17:0/1321036604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fac039450 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.588+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1321036604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb01a21c0 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.589+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1321036604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb0100130 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.589+0000 7f6fa6ffd640 1 -- 172.21.15.17:0/1321036604 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f6fac00a040 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.590+0000 7f6fa6ffd640 1 --2- 172.21.15.17:0/1321036604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f9c06e2a0 0x7f6f9c070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.590+0000 7f6fa6ffd640 1 -- 172.21.15.17:0/1321036604 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6fac02c040 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.590+0000 7f6fb568c640 1 --2- 172.21.15.17:0/1321036604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f9c06e2a0 0x7f6f9c070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:24.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.590+0000 7f6fb568c640 1 --2- 172.21.15.17:0/1321036604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f9c06e2a0 0x7f6f9c070760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00fc880 tx=0x7f6fa0009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:24.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.595+0000 7f6fa6ffd640 1 -- 172.21.15.17:0/1321036604 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6fac078810 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.837+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1321036604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6fb010bce0 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.838+0000 7f6fa6ffd640 1 -- 172.21.15.17:0/1321036604 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f6fac07bed0 con 0x7f6fb00fe9f0 2024-08-19T01:00:24.840 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:00:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:00:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:00:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:00:24.840 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 10, 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:00:24.841 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:00:24.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.840+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1321036604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f9c06e2a0 msgr2=0x7f6f9c070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.840+0000 7f6fb80f1640 1 --2- 172.21.15.17:0/1321036604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f9c06e2a0 0x7f6f9c070760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00fc880 tx=0x7f6fa0009110 comp rx=0 tx=0).stop 2024-08-19T01:00:24.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.840+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1321036604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fb00fe9f0 msgr2=0x7f6fb00fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.840+0000 7f6fb80f1640 1 --2- 172.21.15.17:0/1321036604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fb00fe9f0 0x7f6fb00fad80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6fac032000 tx=0x7f6fac0308a0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.840+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1321036604 shutdown_connections 2024-08-19T01:00:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.840+0000 7f6fb80f1640 1 --2- 172.21.15.17:0/1321036604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f9c06e2a0 0x7f6f9c070760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.840+0000 7f6fb80f1640 1 --2- 172.21.15.17:0/1321036604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6fb01049f0 0x7f6fb00fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.840+0000 7f6fb80f1640 1 --2- 172.21.15.17:0/1321036604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6fb00fe9f0 0x7f6fb00fad80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.840+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1321036604 >> 172.21.15.17:0/1321036604 conn(0x7f6fb00758a0 msgr2=0x7f6fb00fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.840+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1321036604 shutdown_connections 2024-08-19T01:00:24.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.840+0000 7f6fb80f1640 1 -- 172.21.15.17:0/1321036604 wait complete. 2024-08-19T01:00:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.923+0000 7f73b6844640 1 -- 172.21.15.17:0/3735050371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b00ffda0 msgr2=0x7f73b0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.923+0000 7f73b6844640 1 --2- 172.21.15.17:0/3735050371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b00ffda0 0x7f73b0100180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009880 tx=0x7f73a002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.923+0000 7f73b6844640 1 -- 172.21.15.17:0/3735050371 shutdown_connections 2024-08-19T01:00:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.923+0000 7f73b6844640 1 --2- 172.21.15.17:0/3735050371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73b0100750 0x7f73b01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.923+0000 7f73b6844640 1 --2- 172.21.15.17:0/3735050371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b00ffda0 0x7f73b0100180 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.923+0000 7f73b6844640 1 -- 172.21.15.17:0/3735050371 >> 172.21.15.17:0/3735050371 conn(0x7f73b00fb840 msgr2=0x7f73b00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.923+0000 7f73b6844640 1 -- 172.21.15.17:0/3735050371 shutdown_connections 2024-08-19T01:00:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.923+0000 7f73b6844640 1 -- 172.21.15.17:0/3735050371 wait complete. 2024-08-19T01:00:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73b6844640 1 Processor -- start 2024-08-19T01:00:24.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73b6844640 1 -- start start 2024-08-19T01:00:24.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73b6844640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73b00ffda0 0x7f73b019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73b6844640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b0100750 0x7f73b019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73b6844640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0195a10 con 0x7f73b0100750 2024-08-19T01:00:24.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73b6844640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0195b50 con 0x7f73b00ffda0 2024-08-19T01:00:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b0100750 0x7f73b019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b0100750 0x7f73b019bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38930/0 (socket says 172.21.15.17:38930) 2024-08-19T01:00:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73a7fff640 1 -- 172.21.15.17:0/892620655 learned_addr learned my addr 172.21.15.17:0/892620655 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73affff640 1 --2- 172.21.15.17:0/892620655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73b00ffda0 0x7f73b019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73a7fff640 1 -- 172.21.15.17:0/892620655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73b00ffda0 msgr2=0x7f73b019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73a7fff640 1 --2- 172.21.15.17:0/892620655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73b00ffda0 0x7f73b019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.924+0000 7f73a7fff640 1 -- 172.21.15.17:0/892620655 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a0009560 con 0x7f73b0100750 2024-08-19T01:00:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.925+0000 7f73a7fff640 1 --2- 172.21.15.17:0/892620655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b0100750 0x7f73b019bef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f739800e970 tx=0x7f739800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.925+0000 7f73adffb640 1 -- 172.21.15.17:0/892620655 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f739800cc90 con 0x7f73b0100750 2024-08-19T01:00:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.925+0000 7f73adffb640 1 -- 172.21.15.17:0/892620655 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f739800cdf0 con 0x7f73b0100750 2024-08-19T01:00:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.925+0000 7f73b6844640 1 -- 172.21.15.17:0/892620655 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b0195e30 con 0x7f73b0100750 2024-08-19T01:00:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.925+0000 7f73adffb640 1 -- 172.21.15.17:0/892620655 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7398010430 con 0x7f73b0100750 2024-08-19T01:00:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.925+0000 7f73b6844640 1 -- 172.21.15.17:0/892620655 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b0196380 con 0x7f73b0100750 2024-08-19T01:00:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.926+0000 7f73b6844640 1 -- 172.21.15.17:0/892620655 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b0101280 con 0x7f73b0100750 2024-08-19T01:00:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.926+0000 7f73adffb640 1 -- 172.21.15.17:0/892620655 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f73980046c0 con 0x7f73b0100750 2024-08-19T01:00:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.927+0000 7f73adffb640 1 --2- 172.21.15.17:0/892620655 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f739c06e2b0 0x7f739c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.927+0000 7f73adffb640 1 -- 172.21.15.17:0/892620655 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7398014070 con 0x7f73b0100750 2024-08-19T01:00:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.927+0000 7f73affff640 1 --2- 172.21.15.17:0/892620655 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f739c06e2b0 0x7f739c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:24.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.927+0000 7f73affff640 1 --2- 172.21.15.17:0/892620655 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f739c06e2b0 0x7f739c070770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009230 tx=0x7f73a00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:24.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:24.931+0000 7f73adffb640 1 -- 172.21.15.17:0/892620655 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f73980579c0 con 0x7f73b0100750 2024-08-19T01:00:25.111 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:24 smithi086 ceph-mon[71303]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:25.112 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:24 smithi086 ceph-mon[71303]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:25.112 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:24 smithi086 ceph-mon[71303]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:25.112 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:24 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1321036604' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:00:25.112 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:24 smithi086 ceph-mon[71303]: pgmap v14: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:25.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.143+0000 7f73b6844640 1 -- 172.21.15.17:0/892620655 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f73b0196f70 con 0x7f73b0100750 2024-08-19T01:00:25.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:24 smithi017 ceph-mon[99370]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:25.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:24 smithi017 ceph-mon[99370]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:25.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:24 smithi017 ceph-mon[99370]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:25.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:24 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1321036604' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:00:25.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:24 smithi017 ceph-mon[99370]: pgmap v14: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:25.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.144+0000 7f73adffb640 1 -- 172.21.15.17:0/892620655 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1933 (secure 0 0 0) 0x7f739808ce60 con 0x7f73b0100750 2024-08-19T01:00:25.146 INFO:teuthology.orchestra.run.smithi017.stdout:e21 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 21 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T00:53:41.004049+0000 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:00:25.147 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 46 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14486,1=24299} 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T01:00:25.148 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:00:25.149 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:00:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T01:00:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.146+0000 7f73b6844640 1 -- 172.21.15.17:0/892620655 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f739c06e2b0 msgr2=0x7f739c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.146+0000 7f73b6844640 1 --2- 172.21.15.17:0/892620655 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f739c06e2b0 0x7f739c070770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009230 tx=0x7f73a00058d0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.146+0000 7f73b6844640 1 -- 172.21.15.17:0/892620655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b0100750 msgr2=0x7f73b019bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.146+0000 7f73b6844640 1 --2- 172.21.15.17:0/892620655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b0100750 0x7f73b019bef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f739800e970 tx=0x7f739800ed70 comp rx=0 tx=0).stop 2024-08-19T01:00:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.146+0000 7f73b6844640 1 -- 172.21.15.17:0/892620655 shutdown_connections 2024-08-19T01:00:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.146+0000 7f73b6844640 1 --2- 172.21.15.17:0/892620655 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f739c06e2b0 0x7f739c070770 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.146+0000 7f73b6844640 1 --2- 172.21.15.17:0/892620655 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f73b0100750 0x7f73b019bef0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.146+0000 7f73b6844640 1 --2- 172.21.15.17:0/892620655 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f73b00ffda0 0x7f73b019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.146+0000 7f73b6844640 1 -- 172.21.15.17:0/892620655 >> 172.21.15.17:0/892620655 conn(0x7f73b00fb840 msgr2=0x7f73b00fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.146+0000 7f73b6844640 1 -- 172.21.15.17:0/892620655 shutdown_connections 2024-08-19T01:00:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.146+0000 7f73b6844640 1 -- 172.21.15.17:0/892620655 wait complete. 2024-08-19T01:00:25.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.230+0000 7f573efe7640 1 -- 172.21.15.17:0/2590543502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57380fea30 msgr2=0x7f57380fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:25.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.230+0000 7f573efe7640 1 --2- 172.21.15.17:0/2590543502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57380fea30 0x7f57380fee90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5724009880 tx=0x7f572402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.230+0000 7f573efe7640 1 -- 172.21.15.17:0/2590543502 shutdown_connections 2024-08-19T01:00:25.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.230+0000 7f573efe7640 1 --2- 172.21.15.17:0/2590543502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57380fea30 0x7f57380fee90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.230+0000 7f573efe7640 1 --2- 172.21.15.17:0/2590543502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5738104a30 0x7f5738104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.230+0000 7f573efe7640 1 -- 172.21.15.17:0/2590543502 >> 172.21.15.17:0/2590543502 conn(0x7f57380fa730 msgr2=0x7f57380fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:25.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.230+0000 7f573efe7640 1 -- 172.21.15.17:0/2590543502 shutdown_connections 2024-08-19T01:00:25.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.230+0000 7f573efe7640 1 -- 172.21.15.17:0/2590543502 wait complete. 2024-08-19T01:00:25.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f573efe7640 1 Processor -- start 2024-08-19T01:00:25.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f573efe7640 1 -- start start 2024-08-19T01:00:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f573efe7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57380fea30 0x7f5738196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f573efe7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5738104a30 0x7f5738196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f573efe7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5738197430 con 0x7f5738104a30 2024-08-19T01:00:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f573efe7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57381975a0 con 0x7f57380fea30 2024-08-19T01:00:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f5737fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5738104a30 0x7f5738196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f5737fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5738104a30 0x7f5738196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38938/0 (socket says 172.21.15.17:38938) 2024-08-19T01:00:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f5737fff640 1 -- 172.21.15.17:0/3075863331 learned_addr learned my addr 172.21.15.17:0/3075863331 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f573cd83640 1 --2- 172.21.15.17:0/3075863331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57380fea30 0x7f5738196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f5737fff640 1 -- 172.21.15.17:0/3075863331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57380fea30 msgr2=0x7f5738196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:25.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f5737fff640 1 --2- 172.21.15.17:0/3075863331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57380fea30 0x7f5738196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.231+0000 7f5737fff640 1 -- 172.21.15.17:0/3075863331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5724009560 con 0x7f5738104a30 2024-08-19T01:00:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.232+0000 7f5737fff640 1 --2- 172.21.15.17:0/3075863331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5738104a30 0x7f5738196e60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f572402a9c0 tx=0x7f57240055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.232+0000 7f5735ffb640 1 -- 172.21.15.17:0/3075863331 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5724004aa0 con 0x7f5738104a30 2024-08-19T01:00:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.232+0000 7f573efe7640 1 -- 172.21.15.17:0/3075863331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573819f990 con 0x7f5738104a30 2024-08-19T01:00:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.232+0000 7f5735ffb640 1 -- 172.21.15.17:0/3075863331 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5724004c00 con 0x7f5738104a30 2024-08-19T01:00:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.232+0000 7f5735ffb640 1 -- 172.21.15.17:0/3075863331 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5724003980 con 0x7f5738104a30 2024-08-19T01:00:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.232+0000 7f573efe7640 1 -- 172.21.15.17:0/3075863331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573819fcf0 con 0x7f5738104a30 2024-08-19T01:00:25.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.233+0000 7f573efe7640 1 -- 172.21.15.17:0/3075863331 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5738100170 con 0x7f5738104a30 2024-08-19T01:00:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.233+0000 7f5735ffb640 1 -- 172.21.15.17:0/3075863331 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f5724003bf0 con 0x7f5738104a30 2024-08-19T01:00:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.234+0000 7f5735ffb640 1 --2- 172.21.15.17:0/3075863331 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f572806e2b0 0x7f5728070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.234+0000 7f5735ffb640 1 -- 172.21.15.17:0/3075863331 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f57240af340 con 0x7f5738104a30 2024-08-19T01:00:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.234+0000 7f573cd83640 1 --2- 172.21.15.17:0/3075863331 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f572806e2b0 0x7f5728070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:25.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.234+0000 7f573cd83640 1 --2- 172.21.15.17:0/3075863331 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f572806e2b0 0x7f5728070770 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f572c00bbe0 tx=0x7f572c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:25.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.238+0000 7f5735ffb640 1 -- 172.21.15.17:0/3075863331 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5724078560 con 0x7f5738104a30 2024-08-19T01:00:25.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.430+0000 7f573efe7640 1 -- 172.21.15.17:0/3075863331 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f573810bca0 con 0x7f572806e2b0 2024-08-19T01:00:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.431+0000 7f5735ffb640 1 -- 172.21.15.17:0/3075863331 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f573810bca0 con 0x7f572806e2b0 2024-08-19T01:00:25.433 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:00:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:00:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:00:25.433 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:00:25.434 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:00:25.434 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:00:25.434 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:00:25.434 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:00:25.434 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "4/23 daemons upgraded", 2024-08-19T01:00:25.434 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mon daemons", 2024-08-19T01:00:25.434 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:00:25.434 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:00:25.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.434+0000 7f573efe7640 1 -- 172.21.15.17:0/3075863331 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f572806e2b0 msgr2=0x7f5728070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:25.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.434+0000 7f573efe7640 1 --2- 172.21.15.17:0/3075863331 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f572806e2b0 0x7f5728070770 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f572c00bbe0 tx=0x7f572c00b390 comp rx=0 tx=0).stop 2024-08-19T01:00:25.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.434+0000 7f573efe7640 1 -- 172.21.15.17:0/3075863331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5738104a30 msgr2=0x7f5738196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:25.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.434+0000 7f573efe7640 1 --2- 172.21.15.17:0/3075863331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5738104a30 0x7f5738196e60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f572402a9c0 tx=0x7f57240055a0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.434+0000 7f573efe7640 1 -- 172.21.15.17:0/3075863331 shutdown_connections 2024-08-19T01:00:25.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.434+0000 7f573efe7640 1 --2- 172.21.15.17:0/3075863331 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f572806e2b0 0x7f5728070770 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.434+0000 7f573efe7640 1 --2- 172.21.15.17:0/3075863331 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5738104a30 0x7f5738196e60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.434+0000 7f573efe7640 1 --2- 172.21.15.17:0/3075863331 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57380fea30 0x7f5738196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.434+0000 7f573efe7640 1 -- 172.21.15.17:0/3075863331 >> 172.21.15.17:0/3075863331 conn(0x7f57380fa730 msgr2=0x7f57380fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:25.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.434+0000 7f573efe7640 1 -- 172.21.15.17:0/3075863331 shutdown_connections 2024-08-19T01:00:25.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.434+0000 7f573efe7640 1 -- 172.21.15.17:0/3075863331 wait complete. 2024-08-19T01:00:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.516+0000 7fcda5734640 1 -- 172.21.15.17:0/3962983728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcda00ffb40 msgr2=0x7fcda00fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.516+0000 7fcda5734640 1 --2- 172.21.15.17:0/3962983728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcda00ffb40 0x7fcda00fffa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009880 tx=0x7fcd9402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.516+0000 7fcda5734640 1 -- 172.21.15.17:0/3962983728 shutdown_connections 2024-08-19T01:00:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.516+0000 7fcda5734640 1 --2- 172.21.15.17:0/3962983728 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcda00ffb40 0x7fcda00fffa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.516+0000 7fcda5734640 1 --2- 172.21.15.17:0/3962983728 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0105bf0 0x7fcda0105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.516+0000 7fcda5734640 1 -- 172.21.15.17:0/3962983728 >> 172.21.15.17:0/3962983728 conn(0x7fcda00fb7e0 msgr2=0x7fcda00fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.516+0000 7fcda5734640 1 -- 172.21.15.17:0/3962983728 shutdown_connections 2024-08-19T01:00:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.516+0000 7fcda5734640 1 -- 172.21.15.17:0/3962983728 wait complete. 2024-08-19T01:00:25.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.517+0000 7fcda5734640 1 Processor -- start 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.517+0000 7fcda5734640 1 -- start start 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.517+0000 7fcda5734640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcda00ffb40 0x7fcda019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.517+0000 7fcda5734640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0105bf0 0x7fcda019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcda5734640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda019c300 con 0x7fcda00ffb40 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcda5734640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda0195890 con 0x7fcda0105bf0 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcd9effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcda00ffb40 0x7fcda019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcd9effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcda00ffb40 0x7fcda019b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38956/0 (socket says 172.21.15.17:38956) 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcd9effd640 1 -- 172.21.15.17:0/4180224645 learned_addr learned my addr 172.21.15.17:0/4180224645 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcd9e7fc640 1 --2- 172.21.15.17:0/4180224645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0105bf0 0x7fcda019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcd9effd640 1 -- 172.21.15.17:0/4180224645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0105bf0 msgr2=0x7fcda019bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcd9effd640 1 --2- 172.21.15.17:0/4180224645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0105bf0 0x7fcda019bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcd9effd640 1 -- 172.21.15.17:0/4180224645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94009560 con 0x7fcda00ffb40 2024-08-19T01:00:25.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcd9effd640 1 --2- 172.21.15.17:0/4180224645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcda00ffb40 0x7fcda019b7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000d8d0 tx=0x7fcd9000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcd87fff640 1 -- 172.21.15.17:0/4180224645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd90009c00 con 0x7fcda00ffb40 2024-08-19T01:00:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcda5734640 1 -- 172.21.15.17:0/4180224645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda0195b70 con 0x7fcda00ffb40 2024-08-19T01:00:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcd87fff640 1 -- 172.21.15.17:0/4180224645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd90009d60 con 0x7fcda00ffb40 2024-08-19T01:00:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcd87fff640 1 -- 172.21.15.17:0/4180224645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd900049d0 con 0x7fcda00ffb40 2024-08-19T01:00:25.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.518+0000 7fcda5734640 1 -- 172.21.15.17:0/4180224645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda0196090 con 0x7fcda00ffb40 2024-08-19T01:00:25.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.519+0000 7fcda5734640 1 -- 172.21.15.17:0/4180224645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda01011f0 con 0x7fcda00ffb40 2024-08-19T01:00:25.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.520+0000 7fcd87fff640 1 -- 172.21.15.17:0/4180224645 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fcd90004c90 con 0x7fcda00ffb40 2024-08-19T01:00:25.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.520+0000 7fcd87fff640 1 --2- 172.21.15.17:0/4180224645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd8806e2b0 0x7fcd88070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:25.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.520+0000 7fcd87fff640 1 -- 172.21.15.17:0/4180224645 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcd9008e090 con 0x7fcda00ffb40 2024-08-19T01:00:25.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.520+0000 7fcd9e7fc640 1 --2- 172.21.15.17:0/4180224645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd8806e2b0 0x7fcd88070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:25.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.521+0000 7fcd9e7fc640 1 --2- 172.21.15.17:0/4180224645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd8806e2b0 0x7fcd88070770 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009230 tx=0x7fcd940058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:25.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.525+0000 7fcd87fff640 1 -- 172.21.15.17:0/4180224645 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcd90057200 con 0x7fcda00ffb40 2024-08-19T01:00:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.772+0000 7fcda5734640 1 -- 172.21.15.17:0/4180224645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcda0108010 con 0x7fcda00ffb40 2024-08-19T01:00:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.772+0000 7fcd87fff640 1 -- 172.21.15.17:0/4180224645 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fcd9005a8c0 con 0x7fcda00ffb40 2024-08-19T01:00:25.775 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:25.775 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:25.775 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:00:25.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.774+0000 7fcda5734640 1 -- 172.21.15.17:0/4180224645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd8806e2b0 msgr2=0x7fcd88070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.774+0000 7fcda5734640 1 --2- 172.21.15.17:0/4180224645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd8806e2b0 0x7fcd88070770 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd94009230 tx=0x7fcd940058d0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.774+0000 7fcda5734640 1 -- 172.21.15.17:0/4180224645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcda00ffb40 msgr2=0x7fcda019b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.774+0000 7fcda5734640 1 --2- 172.21.15.17:0/4180224645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcda00ffb40 0x7fcda019b7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000d8d0 tx=0x7fcd9000dd90 comp rx=0 tx=0).stop 2024-08-19T01:00:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.774+0000 7fcda5734640 1 -- 172.21.15.17:0/4180224645 shutdown_connections 2024-08-19T01:00:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.774+0000 7fcda5734640 1 --2- 172.21.15.17:0/4180224645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd8806e2b0 0x7fcd88070770 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.774+0000 7fcda5734640 1 --2- 172.21.15.17:0/4180224645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcda0105bf0 0x7fcda019bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.774+0000 7fcda5734640 1 --2- 172.21.15.17:0/4180224645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcda00ffb40 0x7fcda019b7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.774+0000 7fcda5734640 1 -- 172.21.15.17:0/4180224645 >> 172.21.15.17:0/4180224645 conn(0x7fcda00fb7e0 msgr2=0x7fcda00fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.774+0000 7fcda5734640 1 -- 172.21.15.17:0/4180224645 shutdown_connections 2024-08-19T01:00:25.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:25.774+0000 7fcda5734640 1 -- 172.21.15.17:0/4180224645 wait complete. 2024-08-19T01:00:26.057 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:25 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/892620655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:00:26.057 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:25 smithi086 ceph-mon[71303]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:26.057 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:25 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4180224645' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:00:26.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:25 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/892620655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:00:26.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:25 smithi017 ceph-mon[99370]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:26.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:25 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4180224645' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:00:27.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:27 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:27.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:27 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:27.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:27 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:27.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:27 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:00:27.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:27 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:27.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:27 smithi017 ceph-mon[99370]: Reconfiguring mon.smithi017 (monmap changed)... 2024-08-19T01:00:27.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:27 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T01:00:27.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:27 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T01:00:27.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:27 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:27.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:27 smithi017 ceph-mon[99370]: Reconfiguring daemon mon.smithi017 on smithi017 2024-08-19T01:00:27.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:27 smithi017 ceph-mon[99370]: pgmap v15: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:27.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:27 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:27.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:27 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:27.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:27 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:27 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:00:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:27 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:27 smithi086 ceph-mon[71303]: Reconfiguring mon.smithi017 (monmap changed)... 2024-08-19T01:00:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:27 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T01:00:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:27 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T01:00:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:27 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:27 smithi086 ceph-mon[71303]: Reconfiguring daemon mon.smithi017 on smithi017 2024-08-19T01:00:27.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:27 smithi086 ceph-mon[71303]: pgmap v15: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:29.291 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:29.291 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:29.291 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:28 smithi017 ceph-mon[99370]: Reconfiguring mgr.smithi017.hfpawi (monmap changed)... 2024-08-19T01:00:29.291 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.hfpawi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T01:00:29.291 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T01:00:29.291 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:29.291 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:28 smithi017 ceph-mon[99370]: Reconfiguring daemon mgr.smithi017.hfpawi on smithi017 2024-08-19T01:00:29.291 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:28 smithi017 ceph-mon[99370]: pgmap v16: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:29.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:29.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:29.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:28 smithi086 ceph-mon[71303]: Reconfiguring mgr.smithi017.hfpawi (monmap changed)... 2024-08-19T01:00:29.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi017.hfpawi", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T01:00:29.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T01:00:29.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:29.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:28 smithi086 ceph-mon[71303]: Reconfiguring daemon mgr.smithi017.hfpawi on smithi017 2024-08-19T01:00:29.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:28 smithi086 ceph-mon[71303]: pgmap v16: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:30.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:30.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:30.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:30 smithi017 ceph-mon[99370]: Reconfiguring ceph-exporter.smithi017 (monmap changed)... 2024-08-19T01:00:30.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:00:30.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:00:30.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-19T01:00:30.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:30 smithi017 ceph-mon[99370]: Unable to update caps for client.ceph-exporter.smithi017 2024-08-19T01:00:30.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi017"}]: dispatch 2024-08-19T01:00:30.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:30.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:30 smithi017 ceph-mon[99370]: Reconfiguring daemon ceph-exporter.smithi017 on smithi017 2024-08-19T01:00:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:30 smithi086 ceph-mon[71303]: Reconfiguring ceph-exporter.smithi017 (monmap changed)... 2024-08-19T01:00:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:00:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:00:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-19T01:00:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:30 smithi086 ceph-mon[71303]: Unable to update caps for client.ceph-exporter.smithi017 2024-08-19T01:00:30.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi017"}]: dispatch 2024-08-19T01:00:30.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:30.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:30 smithi086 ceph-mon[71303]: Reconfiguring daemon ceph-exporter.smithi017 on smithi017 2024-08-19T01:00:32.100 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:32.100 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:32.100 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:31 smithi017 ceph-mon[99370]: Reconfiguring crash.smithi017 (monmap changed)... 2024-08-19T01:00:32.100 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T01:00:32.100 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:32.100 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:31 smithi017 ceph-mon[99370]: Reconfiguring daemon crash.smithi017 on smithi017 2024-08-19T01:00:32.101 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:31 smithi017 ceph-mon[99370]: pgmap v17: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:31 smithi086 ceph-mon[71303]: Reconfiguring crash.smithi017 (monmap changed)... 2024-08-19T01:00:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T01:00:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:31 smithi086 ceph-mon[71303]: Reconfiguring daemon crash.smithi017 on smithi017 2024-08-19T01:00:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:31 smithi086 ceph-mon[71303]: pgmap v17: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:33 smithi017 ceph-mon[99370]: Reconfiguring osd.0 (monmap changed)... 2024-08-19T01:00:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-19T01:00:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:33 smithi017 ceph-mon[99370]: Reconfiguring daemon osd.0 on smithi017 2024-08-19T01:00:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:33 smithi017 ceph-mon[99370]: pgmap v18: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:00:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:33 smithi086 ceph-mon[71303]: Reconfiguring osd.0 (monmap changed)... 2024-08-19T01:00:33.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-19T01:00:33.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:33.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:33 smithi086 ceph-mon[71303]: Reconfiguring daemon osd.0 on smithi017 2024-08-19T01:00:33.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:33 smithi086 ceph-mon[71303]: pgmap v18: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:33.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:00:34.878 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:34.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:34.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:34 smithi017 ceph-mon[99370]: Reconfiguring osd.1 (monmap changed)... 2024-08-19T01:00:34.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-19T01:00:34.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:34.879 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:34 smithi017 ceph-mon[99370]: Reconfiguring daemon osd.1 on smithi017 2024-08-19T01:00:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:34 smithi086 ceph-mon[71303]: Reconfiguring osd.1 (monmap changed)... 2024-08-19T01:00:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-19T01:00:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:34 smithi086 ceph-mon[71303]: Reconfiguring daemon osd.1 on smithi017 2024-08-19T01:00:35.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:35 smithi017 ceph-mon[99370]: pgmap v19: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:35.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:35.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:35.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-19T01:00:35.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:35 smithi086 ceph-mon[71303]: pgmap v19: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-19T01:00:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:36.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:36 smithi017 ceph-mon[99370]: Reconfiguring osd.2 (monmap changed)... 2024-08-19T01:00:36.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:36 smithi017 ceph-mon[99370]: Reconfiguring daemon osd.2 on smithi017 2024-08-19T01:00:36.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:36 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:36.893 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:36 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:36.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:36 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.junbdp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:00:36.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:36 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:36 smithi086 ceph-mon[71303]: Reconfiguring osd.2 (monmap changed)... 2024-08-19T01:00:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:36 smithi086 ceph-mon[71303]: Reconfiguring daemon osd.2 on smithi017 2024-08-19T01:00:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:36 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:36 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:36 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.junbdp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:00:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:36 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:37.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:37 smithi017 ceph-mon[99370]: Reconfiguring mds.cephfs.smithi017.junbdp (monmap changed)... 2024-08-19T01:00:37.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:37 smithi017 ceph-mon[99370]: Reconfiguring daemon mds.cephfs.smithi017.junbdp on smithi017 2024-08-19T01:00:37.776 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:37 smithi017 ceph-mon[99370]: pgmap v20: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:37 smithi086 ceph-mon[71303]: Reconfiguring mds.cephfs.smithi017.junbdp (monmap changed)... 2024-08-19T01:00:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:37 smithi086 ceph-mon[71303]: Reconfiguring daemon mds.cephfs.smithi017.junbdp on smithi017 2024-08-19T01:00:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:37 smithi086 ceph-mon[71303]: pgmap v20: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:38 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:38 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:38 smithi017 ceph-mon[99370]: Reconfiguring mds.cephfs.smithi017.gvlpoy (monmap changed)... 2024-08-19T01:00:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:38 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.gvlpoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:00:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:38 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:38 smithi017 ceph-mon[99370]: Reconfiguring daemon mds.cephfs.smithi017.gvlpoy on smithi017 2024-08-19T01:00:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:38 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:38 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:38 smithi086 ceph-mon[71303]: Reconfiguring mds.cephfs.smithi017.gvlpoy (monmap changed)... 2024-08-19T01:00:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:38 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.gvlpoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:00:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:38 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:38 smithi086 ceph-mon[71303]: Reconfiguring daemon mds.cephfs.smithi017.gvlpoy on smithi017 2024-08-19T01:00:39.910 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:39 smithi086 ceph-mon[71303]: pgmap v21: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:39.910 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:39 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:39.910 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:39 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:39.910 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:39 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:00:39.910 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:39 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:00:39.911 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:39 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-19T01:00:39.911 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:39 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi086"}]: dispatch 2024-08-19T01:00:39.911 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:39 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:40.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:39 smithi017 ceph-mon[99370]: pgmap v21: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:40.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:39 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:40.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:39 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:40.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:39 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:00:40.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:39 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:00:40.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:39 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-08-19T01:00:40.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:39 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi086"}]: dispatch 2024-08-19T01:00:40.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:39 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:41.146 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:40 smithi086 ceph-mon[71303]: Reconfiguring ceph-exporter.smithi086 (monmap changed)... 2024-08-19T01:00:41.147 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:40 smithi086 ceph-mon[71303]: Unable to update caps for client.ceph-exporter.smithi086 2024-08-19T01:00:41.147 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:40 smithi086 ceph-mon[71303]: Reconfiguring daemon ceph-exporter.smithi086 on smithi086 2024-08-19T01:00:41.147 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:41.147 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:41.147 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi086", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T01:00:41.147 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:40 smithi017 ceph-mon[99370]: Reconfiguring ceph-exporter.smithi086 (monmap changed)... 2024-08-19T01:00:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:40 smithi017 ceph-mon[99370]: Unable to update caps for client.ceph-exporter.smithi086 2024-08-19T01:00:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:40 smithi017 ceph-mon[99370]: Reconfiguring daemon ceph-exporter.smithi086 on smithi086 2024-08-19T01:00:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:41.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:41.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi086", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T01:00:41.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:42.120 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:41 smithi086 ceph-mon[71303]: Reconfiguring crash.smithi086 (monmap changed)... 2024-08-19T01:00:42.120 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:41 smithi086 ceph-mon[71303]: Reconfiguring daemon crash.smithi086 on smithi086 2024-08-19T01:00:42.120 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:41 smithi086 ceph-mon[71303]: pgmap v22: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:42.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:41 smithi017 ceph-mon[99370]: Reconfiguring crash.smithi086 (monmap changed)... 2024-08-19T01:00:42.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:41 smithi017 ceph-mon[99370]: Reconfiguring daemon crash.smithi086 on smithi086 2024-08-19T01:00:42.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:41 smithi017 ceph-mon[99370]: pgmap v22: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:43.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:43 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:43.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:43 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:43.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:43 smithi017 ceph-mon[99370]: Reconfiguring mgr.smithi086.uthxct (monmap changed)... 2024-08-19T01:00:43.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:43 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi086.uthxct", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T01:00:43.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:43 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T01:00:43.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:43 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:43.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:43 smithi017 ceph-mon[99370]: Reconfiguring daemon mgr.smithi086.uthxct on smithi086 2024-08-19T01:00:43.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:43 smithi017 ceph-mon[99370]: pgmap v23: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:43.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:43 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:43.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:43 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:43.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:43 smithi086 ceph-mon[71303]: Reconfiguring mgr.smithi086.uthxct (monmap changed)... 2024-08-19T01:00:43.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:43 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi086.uthxct", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-19T01:00:43.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:43 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-19T01:00:43.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:43 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:43.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:43 smithi086 ceph-mon[71303]: Reconfiguring daemon mgr.smithi086.uthxct on smithi086 2024-08-19T01:00:43.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:43 smithi086 ceph-mon[71303]: pgmap v23: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:44 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:44 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:45.062 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:44 smithi017 ceph-mon[99370]: Reconfiguring mon.smithi086 (monmap changed)... 2024-08-19T01:00:45.062 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:44 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T01:00:45.062 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:44 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T01:00:45.062 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:44 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:45.062 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:44 smithi017 ceph-mon[99370]: Reconfiguring daemon mon.smithi086 on smithi086 2024-08-19T01:00:45.150 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:44 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:45.150 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:44 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:45.150 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:44 smithi086 ceph-mon[71303]: Reconfiguring mon.smithi086 (monmap changed)... 2024-08-19T01:00:45.150 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:44 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-19T01:00:45.150 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:44 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-19T01:00:45.150 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:44 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:45.151 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:44 smithi086 ceph-mon[71303]: Reconfiguring daemon mon.smithi086 on smithi086 2024-08-19T01:00:45.970 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:45 smithi086 ceph-mon[71303]: pgmap v24: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:45.970 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:45.970 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:45.970 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-19T01:00:45.970 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:45 smithi017 ceph-mon[99370]: pgmap v24: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-19T01:00:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:46 smithi086 ceph-mon[71303]: Reconfiguring osd.3 (monmap changed)... 2024-08-19T01:00:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:46 smithi086 ceph-mon[71303]: Reconfiguring daemon osd.3 on smithi086 2024-08-19T01:00:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:46 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:46 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:46 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-19T01:00:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:46 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:46 smithi017 ceph-mon[99370]: Reconfiguring osd.3 (monmap changed)... 2024-08-19T01:00:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:46 smithi017 ceph-mon[99370]: Reconfiguring daemon osd.3 on smithi086 2024-08-19T01:00:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:46 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:46 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:46 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-19T01:00:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:46 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:48.045 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:47 smithi086 ceph-mon[71303]: Reconfiguring osd.4 (monmap changed)... 2024-08-19T01:00:48.046 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:47 smithi086 ceph-mon[71303]: Reconfiguring daemon osd.4 on smithi086 2024-08-19T01:00:48.046 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:47 smithi086 ceph-mon[71303]: pgmap v25: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:47 smithi017 ceph-mon[99370]: Reconfiguring osd.4 (monmap changed)... 2024-08-19T01:00:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:47 smithi017 ceph-mon[99370]: Reconfiguring daemon osd.4 on smithi086 2024-08-19T01:00:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:47 smithi017 ceph-mon[99370]: pgmap v25: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:48.840 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:00:48.840 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:48.840 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:48.841 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-19T01:00:48.841 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:00:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-19T01:00:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:49.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:49 smithi086 ceph-mon[71303]: Reconfiguring osd.5 (monmap changed)... 2024-08-19T01:00:49.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:49 smithi086 ceph-mon[71303]: Reconfiguring daemon osd.5 on smithi086 2024-08-19T01:00:49.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:49 smithi086 ceph-mon[71303]: pgmap v26: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:49.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:49 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:49.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:49 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:49.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:49 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.uxhjfl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:00:49.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:49 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:50.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:49 smithi017 ceph-mon[99370]: Reconfiguring osd.5 (monmap changed)... 2024-08-19T01:00:50.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:49 smithi017 ceph-mon[99370]: Reconfiguring daemon osd.5 on smithi086 2024-08-19T01:00:50.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:49 smithi017 ceph-mon[99370]: pgmap v26: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:50.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:49 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:50.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:49 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:50.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:49 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.uxhjfl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:00:50.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:49 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:51.067 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:50 smithi086 ceph-mon[71303]: Reconfiguring mds.cephfs.smithi086.uxhjfl (monmap changed)... 2024-08-19T01:00:51.068 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:50 smithi086 ceph-mon[71303]: Reconfiguring daemon mds.cephfs.smithi086.uxhjfl on smithi086 2024-08-19T01:00:51.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:50 smithi017 ceph-mon[99370]: Reconfiguring mds.cephfs.smithi086.uxhjfl (monmap changed)... 2024-08-19T01:00:51.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:50 smithi017 ceph-mon[99370]: Reconfiguring daemon mds.cephfs.smithi086.uxhjfl on smithi086 2024-08-19T01:00:52.139 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:51 smithi086 ceph-mon[71303]: pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:52.139 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:51 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:52.140 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:51 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:52.140 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:51 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.oncasl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:00:52.140 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:51 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:51 smithi017 ceph-mon[99370]: pgmap v27: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:51 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:51 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:51 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.oncasl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:00:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:51 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: Reconfiguring mds.cephfs.smithi086.oncasl (monmap changed)... 2024-08-19T01:00:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: Reconfiguring daemon mds.cephfs.smithi086.oncasl on smithi086 2024-08-19T01:00:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:00:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:00:52.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:00:52.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:52.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi017"}]: dispatch 2024-08-19T01:00:52.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi017"}]': finished 2024-08-19T01:00:52.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi086"}]: dispatch 2024-08-19T01:00:52.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:52 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi086"}]': finished 2024-08-19T01:00:53.030 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: Reconfiguring mds.cephfs.smithi086.oncasl (monmap changed)... 2024-08-19T01:00:53.030 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: Reconfiguring daemon mds.cephfs.smithi086.oncasl on smithi086 2024-08-19T01:00:53.030 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:53.030 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:53.030 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:00:53.030 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:00:53.030 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:00:53.030 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:53.030 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi017"}]: dispatch 2024-08-19T01:00:53.031 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi017"}]': finished 2024-08-19T01:00:53.031 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi086"}]: dispatch 2024-08-19T01:00:53.031 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:52 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi086"}]': finished 2024-08-19T01:00:53.999 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:53 smithi017 ceph-mon[99370]: Upgrade: Setting container_image for all mon 2024-08-19T01:00:53.999 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:53 smithi017 ceph-mon[99370]: pgmap v28: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:53 smithi086 ceph-mon[71303]: Upgrade: Setting container_image for all mon 2024-08-19T01:00:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:53 smithi086 ceph-mon[71303]: pgmap v28: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:55 smithi086 ceph-mon[71303]: Upgrade: Updating crash.smithi017 (1/2) 2024-08-19T01:00:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:55 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:55 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T01:00:55.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:55 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:55.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:55 smithi086 ceph-mon[71303]: Deploying daemon crash.smithi017 on smithi017 2024-08-19T01:00:55.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:55 smithi086 ceph-mon[71303]: pgmap v29: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:55.289 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:55 smithi017 ceph-mon[99370]: Upgrade: Updating crash.smithi017 (1/2) 2024-08-19T01:00:55.290 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:55 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:55.290 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:55 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi017", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T01:00:55.290 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:55 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:00:55.290 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:55 smithi017 ceph-mon[99370]: Deploying daemon crash.smithi017 on smithi017 2024-08-19T01:00:55.290 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:55 smithi017 ceph-mon[99370]: pgmap v29: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:55.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.863+0000 7ff6441da640 1 -- 172.21.15.17:0/1073696157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0ff3c0 msgr2=0x7ff63c103890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:55.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.863+0000 7ff6441da640 1 --2- 172.21.15.17:0/1073696157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0ff3c0 0x7ff63c103890 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009880 tx=0x7ff62c02a530 comp rx=0 tx=0).stop 2024-08-19T01:00:55.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.863+0000 7ff6441da640 1 -- 172.21.15.17:0/1073696157 shutdown_connections 2024-08-19T01:00:55.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.863+0000 7ff6441da640 1 --2- 172.21.15.17:0/1073696157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0ff3c0 0x7ff63c103890 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:55.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.863+0000 7ff6441da640 1 --2- 172.21.15.17:0/1073696157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff63c0feaa0 0x7ff63c0fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:55.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.863+0000 7ff6441da640 1 -- 172.21.15.17:0/1073696157 >> 172.21.15.17:0/1073696157 conn(0x7ff63c0758a0 msgr2=0x7ff63c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:55.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.863+0000 7ff6441da640 1 -- 172.21.15.17:0/1073696157 shutdown_connections 2024-08-19T01:00:55.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.863+0000 7ff6441da640 1 -- 172.21.15.17:0/1073696157 wait complete. 2024-08-19T01:00:55.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.864+0000 7ff6441da640 1 Processor -- start 2024-08-19T01:00:55.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.864+0000 7ff6441da640 1 -- start start 2024-08-19T01:00:55.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.864+0000 7ff6441da640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff63c0feaa0 0x7ff63c19c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:55.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.864+0000 7ff6441da640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0ff3c0 0x7ff63c19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:55.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.864+0000 7ff6441da640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c19cce0 con 0x7ff63c0ff3c0 2024-08-19T01:00:55.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.864+0000 7ff6441da640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c1a0a50 con 0x7ff63c0feaa0 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff641775640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0ff3c0 0x7ff63c19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff641775640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0ff3c0 0x7ff63c19c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41164/0 (socket says 172.21.15.17:41164) 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff641775640 1 -- 172.21.15.17:0/2444573714 learned_addr learned my addr 172.21.15.17:0/2444573714 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff641f76640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff63c0feaa0 0x7ff63c19c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff641775640 1 -- 172.21.15.17:0/2444573714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff63c0feaa0 msgr2=0x7ff63c19c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff641775640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff63c0feaa0 0x7ff63c19c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff641775640 1 -- 172.21.15.17:0/2444573714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c009560 con 0x7ff63c0ff3c0 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff641f76640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff63c0feaa0 0x7ff63c19c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff641775640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0ff3c0 0x7ff63c19c650 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff62c02aa50 tx=0x7ff62c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff632ffd640 1 -- 172.21.15.17:0/2444573714 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62c0048d0 con 0x7ff63c0ff3c0 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff6441da640 1 -- 172.21.15.17:0/2444573714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c1a0cd0 con 0x7ff63c0ff3c0 2024-08-19T01:00:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff632ffd640 1 -- 172.21.15.17:0/2444573714 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff62c031640 con 0x7ff63c0ff3c0 2024-08-19T01:00:55.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.865+0000 7ff632ffd640 1 -- 172.21.15.17:0/2444573714 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff62c0038d0 con 0x7ff63c0ff3c0 2024-08-19T01:00:55.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.866+0000 7ff6441da640 1 -- 172.21.15.17:0/2444573714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c1a11c0 con 0x7ff63c0ff3c0 2024-08-19T01:00:55.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.867+0000 7ff6441da640 1 -- 172.21.15.17:0/2444573714 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63c068510 con 0x7ff63c0ff3c0 2024-08-19T01:00:55.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.868+0000 7ff632ffd640 1 -- 172.21.15.17:0/2444573714 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ff62c02ad50 con 0x7ff63c0ff3c0 2024-08-19T01:00:55.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.868+0000 7ff632ffd640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff62806e2b0 0x7ff628070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:55.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.868+0000 7ff632ffd640 1 -- 172.21.15.17:0/2444573714 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff62c0af020 con 0x7ff63c0ff3c0 2024-08-19T01:00:55.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.869+0000 7ff641f76640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff62806e2b0 0x7ff628070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:55.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.869+0000 7ff641f76640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff62806e2b0 0x7ff628070770 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff6380058c0 tx=0x7ff638005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:55.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:55.874+0000 7ff632ffd640 1 -- 172.21.15.17:0/2444573714 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff62c078210 con 0x7ff63c0ff3c0 2024-08-19T01:00:56.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.070+0000 7ff6441da640 1 -- 172.21.15.17:0/2444573714 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff63c1133a0 con 0x7ff62806e2b0 2024-08-19T01:00:56.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.071+0000 7ff632ffd640 1 -- 172.21.15.17:0/2444573714 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7ff63c1133a0 con 0x7ff62806e2b0 2024-08-19T01:00:56.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.073+0000 7ff6441da640 1 -- 172.21.15.17:0/2444573714 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff62806e2b0 msgr2=0x7ff628070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.073+0000 7ff6441da640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff62806e2b0 0x7ff628070770 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff6380058c0 tx=0x7ff638005850 comp rx=0 tx=0).stop 2024-08-19T01:00:56.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.073+0000 7ff6441da640 1 -- 172.21.15.17:0/2444573714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0ff3c0 msgr2=0x7ff63c19c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.073+0000 7ff6441da640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0ff3c0 0x7ff63c19c650 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff62c02aa50 tx=0x7ff62c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.073+0000 7ff6441da640 1 -- 172.21.15.17:0/2444573714 shutdown_connections 2024-08-19T01:00:56.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.073+0000 7ff6441da640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff62806e2b0 0x7ff628070770 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.073+0000 7ff6441da640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff63c0ff3c0 0x7ff63c19c650 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.073+0000 7ff6441da640 1 --2- 172.21.15.17:0/2444573714 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff63c0feaa0 0x7ff63c19c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.073+0000 7ff6441da640 1 -- 172.21.15.17:0/2444573714 >> 172.21.15.17:0/2444573714 conn(0x7ff63c0758a0 msgr2=0x7ff63c10d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:56.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.074+0000 7ff6441da640 1 -- 172.21.15.17:0/2444573714 shutdown_connections 2024-08-19T01:00:56.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.074+0000 7ff6441da640 1 -- 172.21.15.17:0/2444573714 wait complete. 2024-08-19T01:00:56.084 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:00:56.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.156+0000 7fd5b7be4640 1 -- 172.21.15.17:0/2455047677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00fea10 msgr2=0x7fd5b00fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.156+0000 7fd5b7be4640 1 --2- 172.21.15.17:0/2455047677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00fea10 0x7fd5b00fee70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009880 tx=0x7fd5a402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.156+0000 7fd5b7be4640 1 -- 172.21.15.17:0/2455047677 shutdown_connections 2024-08-19T01:00:56.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.156+0000 7fd5b7be4640 1 --2- 172.21.15.17:0/2455047677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b00fea10 0x7fd5b00fee70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.156+0000 7fd5b7be4640 1 --2- 172.21.15.17:0/2455047677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b0104a10 0x7fd5b0104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.156+0000 7fd5b7be4640 1 -- 172.21.15.17:0/2455047677 >> 172.21.15.17:0/2455047677 conn(0x7fd5b00fa730 msgr2=0x7fd5b00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:56.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.157+0000 7fd5b7be4640 1 -- 172.21.15.17:0/2455047677 shutdown_connections 2024-08-19T01:00:56.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.157+0000 7fd5b7be4640 1 -- 172.21.15.17:0/2455047677 wait complete. 2024-08-19T01:00:56.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.157+0000 7fd5b7be4640 1 Processor -- start 2024-08-19T01:00:56.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.157+0000 7fd5b7be4640 1 -- start start 2024-08-19T01:00:56.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.158+0000 7fd5b7be4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b00fea10 0x7fd5b00fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:56.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.158+0000 7fd5b7be4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0104a10 0x7fd5b00fb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:56.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.158+0000 7fd5b7be4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00fbac0 con 0x7fd5b0104a10 2024-08-19T01:00:56.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.158+0000 7fd5b7be4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b00fbc30 con 0x7fd5b00fea10 2024-08-19T01:00:56.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.158+0000 7fd5b517f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0104a10 0x7fd5b00fb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:56.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.158+0000 7fd5b517f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0104a10 0x7fd5b00fb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41182/0 (socket says 172.21.15.17:41182) 2024-08-19T01:00:56.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.158+0000 7fd5b517f640 1 -- 172.21.15.17:0/3017812301 learned_addr learned my addr 172.21.15.17:0/3017812301 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:56.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.158+0000 7fd5b5980640 1 --2- 172.21.15.17:0/3017812301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b00fea10 0x7fd5b00fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:56.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.158+0000 7fd5b517f640 1 -- 172.21.15.17:0/3017812301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b00fea10 msgr2=0x7fd5b00fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.158+0000 7fd5b517f640 1 --2- 172.21.15.17:0/3017812301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b00fea10 0x7fd5b00fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.158+0000 7fd5b517f640 1 -- 172.21.15.17:0/3017812301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4009560 con 0x7fd5b0104a10 2024-08-19T01:00:56.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.159+0000 7fd5b517f640 1 --2- 172.21.15.17:0/3017812301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0104a10 0x7fd5b00fb580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4006010 tx=0x7fd5a40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:56.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.159+0000 7fd5aeffd640 1 -- 172.21.15.17:0/3017812301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5a40048d0 con 0x7fd5b0104a10 2024-08-19T01:00:56.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.159+0000 7fd5aeffd640 1 -- 172.21.15.17:0/3017812301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd5a4031640 con 0x7fd5b0104a10 2024-08-19T01:00:56.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.159+0000 7fd5b7be4640 1 -- 172.21.15.17:0/3017812301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b00fbeb0 con 0x7fd5b0104a10 2024-08-19T01:00:56.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.159+0000 7fd5b7be4640 1 -- 172.21.15.17:0/3017812301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b01a1f30 con 0x7fd5b0104a10 2024-08-19T01:00:56.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.159+0000 7fd5aeffd640 1 -- 172.21.15.17:0/3017812301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5a4003840 con 0x7fd5b0104a10 2024-08-19T01:00:56.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.161+0000 7fd5b7be4640 1 -- 172.21.15.17:0/3017812301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c005250 con 0x7fd5b0104a10 2024-08-19T01:00:56.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.161+0000 7fd5aeffd640 1 -- 172.21.15.17:0/3017812301 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fd5a4003af0 con 0x7fd5b0104a10 2024-08-19T01:00:56.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.161+0000 7fd5aeffd640 1 --2- 172.21.15.17:0/3017812301 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd59806e2a0 0x7fd598070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:56.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.161+0000 7fd5aeffd640 1 -- 172.21.15.17:0/3017812301 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd5a40af070 con 0x7fd5b0104a10 2024-08-19T01:00:56.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.161+0000 7fd5b5980640 1 --2- 172.21.15.17:0/3017812301 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd59806e2a0 0x7fd598070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:56.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.162+0000 7fd5b5980640 1 --2- 172.21.15.17:0/3017812301 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd59806e2a0 0x7fd598070760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009b60 tx=0x7fd5a8005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:56.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.166+0000 7fd5aeffd640 1 -- 172.21.15.17:0/3017812301 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd5a4078260 con 0x7fd5b0104a10 2024-08-19T01:00:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.360+0000 7fd5b7be4640 1 -- 172.21.15.17:0/3017812301 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd59c000bc0 con 0x7fd59806e2a0 2024-08-19T01:00:56.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.362+0000 7fd5aeffd640 1 -- 172.21.15.17:0/3017812301 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fd59c000bc0 con 0x7fd59806e2a0 2024-08-19T01:00:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.364+0000 7fd5b7be4640 1 -- 172.21.15.17:0/3017812301 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd59806e2a0 msgr2=0x7fd598070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.364+0000 7fd5b7be4640 1 --2- 172.21.15.17:0/3017812301 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd59806e2a0 0x7fd598070760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009b60 tx=0x7fd5a8005f90 comp rx=0 tx=0).stop 2024-08-19T01:00:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.364+0000 7fd5b7be4640 1 -- 172.21.15.17:0/3017812301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0104a10 msgr2=0x7fd5b00fb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.364+0000 7fd5b7be4640 1 --2- 172.21.15.17:0/3017812301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0104a10 0x7fd5b00fb580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4006010 tx=0x7fd5a40055a0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.364+0000 7fd5b7be4640 1 -- 172.21.15.17:0/3017812301 shutdown_connections 2024-08-19T01:00:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.364+0000 7fd5b7be4640 1 --2- 172.21.15.17:0/3017812301 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd59806e2a0 0x7fd598070760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.364+0000 7fd5b7be4640 1 --2- 172.21.15.17:0/3017812301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5b0104a10 0x7fd5b00fb580 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.364+0000 7fd5b7be4640 1 --2- 172.21.15.17:0/3017812301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5b00fea10 0x7fd5b00fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.364+0000 7fd5b7be4640 1 -- 172.21.15.17:0/3017812301 >> 172.21.15.17:0/3017812301 conn(0x7fd5b00fa730 msgr2=0x7fd5b0068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:56.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.364+0000 7fd5b7be4640 1 -- 172.21.15.17:0/3017812301 shutdown_connections 2024-08-19T01:00:56.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.364+0000 7fd5b7be4640 1 -- 172.21.15.17:0/3017812301 wait complete. 2024-08-19T01:00:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.447+0000 7ff988a8a640 1 -- 172.21.15.17:0/157844883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9840ffda0 msgr2=0x7ff984100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.447+0000 7ff988a8a640 1 --2- 172.21.15.17:0/157844883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9840ffda0 0x7ff984100180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff974009c20 tx=0x7ff97402a970 comp rx=0 tx=0).stop 2024-08-19T01:00:56.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.447+0000 7ff988a8a640 1 -- 172.21.15.17:0/157844883 shutdown_connections 2024-08-19T01:00:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.447+0000 7ff988a8a640 1 --2- 172.21.15.17:0/157844883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff984100750 0x7ff9841047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.447+0000 7ff988a8a640 1 --2- 172.21.15.17:0/157844883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9840ffda0 0x7ff984100180 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.447+0000 7ff988a8a640 1 -- 172.21.15.17:0/157844883 >> 172.21.15.17:0/157844883 conn(0x7ff9840fb840 msgr2=0x7ff9840fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.447+0000 7ff988a8a640 1 -- 172.21.15.17:0/157844883 shutdown_connections 2024-08-19T01:00:56.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.447+0000 7ff988a8a640 1 -- 172.21.15.17:0/157844883 wait complete. 2024-08-19T01:00:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.448+0000 7ff988a8a640 1 Processor -- start 2024-08-19T01:00:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.448+0000 7ff988a8a640 1 -- start start 2024-08-19T01:00:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.448+0000 7ff988a8a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9840ffda0 0x7ff98419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.448+0000 7ff988a8a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff984100750 0x7ff98419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.448+0000 7ff988a8a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98419c360 con 0x7ff9840ffda0 2024-08-19T01:00:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.448+0000 7ff988a8a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9841958f0 con 0x7ff984100750 2024-08-19T01:00:56.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.448+0000 7ff98259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9840ffda0 0x7ff98419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.448+0000 7ff98259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9840ffda0 0x7ff98419b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41188/0 (socket says 172.21.15.17:41188) 2024-08-19T01:00:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.448+0000 7ff98259c640 1 -- 172.21.15.17:0/2357030405 learned_addr learned my addr 172.21.15.17:0/2357030405 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.448+0000 7ff981d9b640 1 --2- 172.21.15.17:0/2357030405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff984100750 0x7ff98419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.449+0000 7ff98259c640 1 -- 172.21.15.17:0/2357030405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff984100750 msgr2=0x7ff98419bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.449+0000 7ff98259c640 1 --2- 172.21.15.17:0/2357030405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff984100750 0x7ff98419bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.449+0000 7ff98259c640 1 -- 172.21.15.17:0/2357030405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974009900 con 0x7ff9840ffda0 2024-08-19T01:00:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.449+0000 7ff98259c640 1 --2- 172.21.15.17:0/2357030405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9840ffda0 0x7ff98419b800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff97402ae90 tx=0x7ff974030880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.449+0000 7ff97b7fe640 1 -- 172.21.15.17:0/2357030405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff97402f3c0 con 0x7ff9840ffda0 2024-08-19T01:00:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.449+0000 7ff988a8a640 1 -- 172.21.15.17:0/2357030405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff984195b70 con 0x7ff9840ffda0 2024-08-19T01:00:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.449+0000 7ff97b7fe640 1 -- 172.21.15.17:0/2357030405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff97402f9e0 con 0x7ff9840ffda0 2024-08-19T01:00:56.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.449+0000 7ff97b7fe640 1 -- 172.21.15.17:0/2357030405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff974039450 con 0x7ff9840ffda0 2024-08-19T01:00:56.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.449+0000 7ff988a8a640 1 -- 172.21.15.17:0/2357030405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff984196060 con 0x7ff9840ffda0 2024-08-19T01:00:56.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.450+0000 7ff988a8a640 1 -- 172.21.15.17:0/2357030405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff984101280 con 0x7ff9840ffda0 2024-08-19T01:00:56.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.451+0000 7ff97b7fe640 1 -- 172.21.15.17:0/2357030405 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7ff97400a040 con 0x7ff9840ffda0 2024-08-19T01:00:56.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.451+0000 7ff97b7fe640 1 --2- 172.21.15.17:0/2357030405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff97006e2b0 0x7ff970070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:56.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.451+0000 7ff97b7fe640 1 -- 172.21.15.17:0/2357030405 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff97402c040 con 0x7ff9840ffda0 2024-08-19T01:00:56.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.451+0000 7ff981d9b640 1 --2- 172.21.15.17:0/2357030405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff97006e2b0 0x7ff970070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:56.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.451+0000 7ff981d9b640 1 --2- 172.21.15.17:0/2357030405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff97006e2b0 0x7ff970070770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff96c005fd0 tx=0x7ff96c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:56.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.456+0000 7ff97b7fe640 1 -- 172.21.15.17:0/2357030405 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff974078860 con 0x7ff9840ffda0 2024-08-19T01:00:56.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.648+0000 7ff988a8a640 1 -- 172.21.15.17:0/2357030405 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff98410cdb0 con 0x7ff97006e2b0 2024-08-19T01:00:56.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.658+0000 7ff97b7fe640 1 -- 172.21.15.17:0/2357030405 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7ff98410cdb0 con 0x7ff97006e2b0 2024-08-19T01:00:56.660 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (2m) 48s ago 12m 20.0M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (13m) 48s ago 13m 8342k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (12m) 34s ago 12m 8128k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (13m) 48s ago 13m 6891k - 18.2.4-721-gbaa926de e6c292a6bc95 8ef9c76167d7 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (12m) 34s ago 12m 6899k - 18.2.4-721-gbaa926de e6c292a6bc95 a01ab9e3d902 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (112s) 48s ago 12m 76.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (7m) 48s ago 7m 157M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (7m) 48s ago 7m 91.7M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (7m) 34s ago 7m 26.7M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (7m) 34s ago 7m 25.9M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (4m) 48s ago 14m 472M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (3m) 34s ago 11m 438M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:00:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (60s) 48s ago 14m 27.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:00:56.662 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (38s) 34s ago 11m 25.2M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:00:56.662 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (2m) 48s ago 12m 15.4M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:00:56.662 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (2m) 34s ago 11m 14.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:00:56.662 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (11m) 48s ago 11m 220M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 0997dcc5892b 2024-08-19T01:00:56.662 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (10m) 48s ago 10m 229M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T01:00:56.662 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (10m) 48s ago 10m 190M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T01:00:56.662 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (9m) 34s ago 9m 246M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T01:00:56.662 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (9m) 34s ago 9m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T01:00:56.662 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (9m) 34s ago 8m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T01:00:56.662 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (2m) 48s ago 12m 62.9M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:00:56.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.660+0000 7ff988a8a640 1 -- 172.21.15.17:0/2357030405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff97006e2b0 msgr2=0x7ff970070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.660+0000 7ff988a8a640 1 --2- 172.21.15.17:0/2357030405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff97006e2b0 0x7ff970070770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff96c005fd0 tx=0x7ff96c005850 comp rx=0 tx=0).stop 2024-08-19T01:00:56.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.660+0000 7ff988a8a640 1 -- 172.21.15.17:0/2357030405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9840ffda0 msgr2=0x7ff98419b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.660+0000 7ff988a8a640 1 --2- 172.21.15.17:0/2357030405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9840ffda0 0x7ff98419b800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff97402ae90 tx=0x7ff974030880 comp rx=0 tx=0).stop 2024-08-19T01:00:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.660+0000 7ff988a8a640 1 -- 172.21.15.17:0/2357030405 shutdown_connections 2024-08-19T01:00:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.660+0000 7ff988a8a640 1 --2- 172.21.15.17:0/2357030405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff97006e2b0 0x7ff970070770 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.660+0000 7ff988a8a640 1 --2- 172.21.15.17:0/2357030405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff984100750 0x7ff98419bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.660+0000 7ff988a8a640 1 --2- 172.21.15.17:0/2357030405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9840ffda0 0x7ff98419b800 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.660+0000 7ff988a8a640 1 -- 172.21.15.17:0/2357030405 >> 172.21.15.17:0/2357030405 conn(0x7ff9840fb840 msgr2=0x7ff9840fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:56.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.660+0000 7ff988a8a640 1 -- 172.21.15.17:0/2357030405 shutdown_connections 2024-08-19T01:00:56.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.660+0000 7ff988a8a640 1 -- 172.21.15.17:0/2357030405 wait complete. 2024-08-19T01:00:56.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.756+0000 7f23d9e0e640 1 -- 172.21.15.17:0/3417570592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23d41015f0 msgr2=0x7f23d4109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.756+0000 7f23d9e0e640 1 --2- 172.21.15.17:0/3417570592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23d41015f0 0x7f23d4109ae0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f23c8009880 tx=0x7f23c802a530 comp rx=0 tx=0).stop 2024-08-19T01:00:56.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.756+0000 7f23d9e0e640 1 -- 172.21.15.17:0/3417570592 shutdown_connections 2024-08-19T01:00:56.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.756+0000 7f23d9e0e640 1 --2- 172.21.15.17:0/3417570592 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23d41015f0 0x7f23d4109ae0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.756+0000 7f23d9e0e640 1 --2- 172.21.15.17:0/3417570592 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23d4100cd0 0x7f23d41010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.756+0000 7f23d9e0e640 1 -- 172.21.15.17:0/3417570592 >> 172.21.15.17:0/3417570592 conn(0x7f23d40fa730 msgr2=0x7f23d40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:56.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.756+0000 7f23d9e0e640 1 -- 172.21.15.17:0/3417570592 shutdown_connections 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.756+0000 7f23d9e0e640 1 -- 172.21.15.17:0/3417570592 wait complete. 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.756+0000 7f23d9e0e640 1 Processor -- start 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d9e0e640 1 -- start start 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d9e0e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23d4100cd0 0x7f23d419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d9e0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23d41015f0 0x7f23d419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d9e0e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d419c340 con 0x7f23d41015f0 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d9e0e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d4195960 con 0x7f23d4100cd0 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23d41015f0 0x7f23d419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d37fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23d4100cd0 0x7f23d419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23d41015f0 0x7f23d419bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46564/0 (socket says 172.21.15.17:46564) 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d2ffd640 1 -- 172.21.15.17:0/2154340986 learned_addr learned my addr 172.21.15.17:0/2154340986 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:56.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d2ffd640 1 -- 172.21.15.17:0/2154340986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23d4100cd0 msgr2=0x7f23d419b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:56.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d2ffd640 1 --2- 172.21.15.17:0/2154340986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23d4100cd0 0x7f23d419b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:56.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.757+0000 7f23d2ffd640 1 -- 172.21.15.17:0/2154340986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8009560 con 0x7f23d41015f0 2024-08-19T01:00:56.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.758+0000 7f23d2ffd640 1 --2- 172.21.15.17:0/2154340986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23d41015f0 0x7f23d419bdb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f23c802aa50 tx=0x7f23c80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:56.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.758+0000 7f23d0ff9640 1 -- 172.21.15.17:0/2154340986 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c80048d0 con 0x7f23d41015f0 2024-08-19T01:00:56.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.758+0000 7f23d0ff9640 1 -- 172.21.15.17:0/2154340986 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23c8031640 con 0x7f23d41015f0 2024-08-19T01:00:56.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.758+0000 7f23d9e0e640 1 -- 172.21.15.17:0/2154340986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d4195be0 con 0x7f23d41015f0 2024-08-19T01:00:56.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.758+0000 7f23d0ff9640 1 -- 172.21.15.17:0/2154340986 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23c8003890 con 0x7f23d41015f0 2024-08-19T01:00:56.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.758+0000 7f23d9e0e640 1 -- 172.21.15.17:0/2154340986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d41960d0 con 0x7f23d41015f0 2024-08-19T01:00:56.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.759+0000 7f23d9e0e640 1 -- 172.21.15.17:0/2154340986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d4068d30 con 0x7f23d41015f0 2024-08-19T01:00:56.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.759+0000 7f23d0ff9640 1 -- 172.21.15.17:0/2154340986 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f23c802ad50 con 0x7f23d41015f0 2024-08-19T01:00:56.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.760+0000 7f23d0ff9640 1 --2- 172.21.15.17:0/2154340986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f23bc06e2b0 0x7f23bc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:56.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.760+0000 7f23d0ff9640 1 -- 172.21.15.17:0/2154340986 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f23c80af080 con 0x7f23d41015f0 2024-08-19T01:00:56.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.760+0000 7f23d37fe640 1 --2- 172.21.15.17:0/2154340986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f23bc06e2b0 0x7f23bc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:56.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.761+0000 7f23d37fe640 1 --2- 172.21.15.17:0/2154340986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f23bc06e2b0 0x7f23bc070770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f23c400abe0 tx=0x7f23c400a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:56.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:56.766+0000 7f23d0ff9640 1 -- 172.21.15.17:0/2154340986 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f23c80781f0 con 0x7f23d41015f0 2024-08-19T01:00:57.036 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:56 smithi017 ceph-mon[99370]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:57.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:56 smithi017 ceph-mon[99370]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:57.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:56 smithi017 ceph-mon[99370]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:57.037 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:56 smithi017 ceph-mon[99370]: pgmap v30: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:57.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.034+0000 7f23d9e0e640 1 -- 172.21.15.17:0/2154340986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f23d4196ea0 con 0x7f23d41015f0 2024-08-19T01:00:57.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.034+0000 7f23d0ff9640 1 -- 172.21.15.17:0/2154340986 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+727 (secure 0 0 0) 0x7f23c807b8b0 con 0x7f23d41015f0 2024-08-19T01:00:57.038 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:00:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:00:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:00:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:00:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:00:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:00:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:00:57.038 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:00:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6 2024-08-19T01:00:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:00:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:00:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T01:00:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:00:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:00:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 10, 2024-08-19T01:00:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:00:57.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:00:57.039 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:00:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.037+0000 7f23d9e0e640 1 -- 172.21.15.17:0/2154340986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f23bc06e2b0 msgr2=0x7f23bc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.037+0000 7f23d9e0e640 1 --2- 172.21.15.17:0/2154340986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f23bc06e2b0 0x7f23bc070770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f23c400abe0 tx=0x7f23c400a2d0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.037+0000 7f23d9e0e640 1 -- 172.21.15.17:0/2154340986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23d41015f0 msgr2=0x7f23d419bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.037+0000 7f23d9e0e640 1 --2- 172.21.15.17:0/2154340986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23d41015f0 0x7f23d419bdb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f23c802aa50 tx=0x7f23c80055a0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.037+0000 7f23d9e0e640 1 -- 172.21.15.17:0/2154340986 shutdown_connections 2024-08-19T01:00:57.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.037+0000 7f23d9e0e640 1 --2- 172.21.15.17:0/2154340986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f23bc06e2b0 0x7f23bc070770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.037+0000 7f23d9e0e640 1 --2- 172.21.15.17:0/2154340986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23d41015f0 0x7f23d419bdb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.037+0000 7f23d9e0e640 1 --2- 172.21.15.17:0/2154340986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23d4100cd0 0x7f23d419b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.037+0000 7f23d9e0e640 1 -- 172.21.15.17:0/2154340986 >> 172.21.15.17:0/2154340986 conn(0x7f23d40fa730 msgr2=0x7f23d4101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.037+0000 7f23d9e0e640 1 -- 172.21.15.17:0/2154340986 shutdown_connections 2024-08-19T01:00:57.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.037+0000 7f23d9e0e640 1 -- 172.21.15.17:0/2154340986 wait complete. 2024-08-19T01:00:57.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.125+0000 7f208ba5e640 1 -- 172.21.15.17:0/1832840817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2084072850 msgr2=0x7f2084072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.125+0000 7f208ba5e640 1 --2- 172.21.15.17:0/1832840817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2084072850 0x7f2084072c30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2080009880 tx=0x7f208002a530 comp rx=0 tx=0).stop 2024-08-19T01:00:57.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.125+0000 7f208ba5e640 1 -- 172.21.15.17:0/1832840817 shutdown_connections 2024-08-19T01:00:57.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.125+0000 7f208ba5e640 1 --2- 172.21.15.17:0/1832840817 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2084073170 0x7f2084110610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.125+0000 7f208ba5e640 1 --2- 172.21.15.17:0/1832840817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2084072850 0x7f2084072c30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.125+0000 7f208ba5e640 1 -- 172.21.15.17:0/1832840817 >> 172.21.15.17:0/1832840817 conn(0x7f20840fb860 msgr2=0x7f20840fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:57.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.125+0000 7f208ba5e640 1 -- 172.21.15.17:0/1832840817 shutdown_connections 2024-08-19T01:00:57.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.125+0000 7f208ba5e640 1 -- 172.21.15.17:0/1832840817 wait complete. 2024-08-19T01:00:57.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.125+0000 7f208ba5e640 1 Processor -- start 2024-08-19T01:00:57.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.125+0000 7f208ba5e640 1 -- start start 2024-08-19T01:00:57.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f208ba5e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2084072850 0x7f208419c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f208ba5e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2084073170 0x7f208419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f208ba5e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208419cca0 con 0x7f2084072850 2024-08-19T01:00:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f208ba5e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20841a0a10 con 0x7f2084073170 2024-08-19T01:00:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f20897fa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2084072850 0x7f208419c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f20897fa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2084072850 0x7f208419c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46586/0 (socket says 172.21.15.17:46586) 2024-08-19T01:00:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f20897fa640 1 -- 172.21.15.17:0/3232907169 learned_addr learned my addr 172.21.15.17:0/3232907169 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f2088ff9640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2084073170 0x7f208419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f20897fa640 1 -- 172.21.15.17:0/3232907169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2084073170 msgr2=0x7f208419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f20897fa640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2084073170 0x7f208419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f20897fa640 1 -- 172.21.15.17:0/3232907169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2080009560 con 0x7f2084072850 2024-08-19T01:00:57.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f2088ff9640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2084073170 0x7f208419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:00:57.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f20897fa640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2084072850 0x7f208419c0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2080005940 tx=0x7f2080032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:57.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f207a7fc640 1 -- 172.21.15.17:0/3232907169 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2080005220 con 0x7f2084072850 2024-08-19T01:00:57.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f208ba5e640 1 -- 172.21.15.17:0/3232907169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20841a0c90 con 0x7f2084072850 2024-08-19T01:00:57.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f207a7fc640 1 -- 172.21.15.17:0/3232907169 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2080005380 con 0x7f2084072850 2024-08-19T01:00:57.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.126+0000 7f207a7fc640 1 -- 172.21.15.17:0/3232907169 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2080003a50 con 0x7f2084072850 2024-08-19T01:00:57.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.127+0000 7f208ba5e640 1 -- 172.21.15.17:0/3232907169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20841a11e0 con 0x7f2084072850 2024-08-19T01:00:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.127+0000 7f208ba5e640 1 -- 172.21.15.17:0/3232907169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2084073f90 con 0x7f2084072850 2024-08-19T01:00:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.128+0000 7f207a7fc640 1 -- 172.21.15.17:0/3232907169 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f208002ad50 con 0x7f2084072850 2024-08-19T01:00:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.128+0000 7f207a7fc640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f207006e2b0 0x7f2070070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.129+0000 7f207a7fc640 1 -- 172.21.15.17:0/3232907169 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f20800aede0 con 0x7f2084072850 2024-08-19T01:00:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.129+0000 7f2088ff9640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f207006e2b0 0x7f2070070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:57.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.129+0000 7f2088ff9640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f207006e2b0 0x7f2070070770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2074005fd0 tx=0x7f2074005ea0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:57.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.133+0000 7f207a7fc640 1 -- 172.21.15.17:0/3232907169 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2080077f30 con 0x7f2084072850 2024-08-19T01:00:57.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:56 smithi086 ceph-mon[71303]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:57.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:56 smithi086 ceph-mon[71303]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:57.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:56 smithi086 ceph-mon[71303]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:57.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:56 smithi086 ceph-mon[71303]: pgmap v30: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:00:57.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.344+0000 7f208ba5e640 1 -- 172.21.15.17:0/3232907169 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2084072c30 con 0x7f2084072850 2024-08-19T01:00:57.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.345+0000 7f207a7fc640 1 -- 172.21.15.17:0/3232907169 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1933 (secure 0 0 0) 0x7f20800357a0 con 0x7f2084072850 2024-08-19T01:00:57.347 INFO:teuthology.orchestra.run.smithi017.stdout:e21 2024-08-19T01:00:57.347 INFO:teuthology.orchestra.run.smithi017.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-19T01:00:57.347 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:00:57.347 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 21 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T00:53:41.004049+0000 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:00:57.348 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 46 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14486,1=24299} 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:00:57.349 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:00:57.350 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:00:57.350 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:00:57.350 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:00:57.350 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:00:57.350 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:00:57.350 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:57.350 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:57.350 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:57.350 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:00:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:00:57.350 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:00:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T01:00:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.347+0000 7f208ba5e640 1 -- 172.21.15.17:0/3232907169 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f207006e2b0 msgr2=0x7f2070070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.347+0000 7f208ba5e640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f207006e2b0 0x7f2070070770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2074005fd0 tx=0x7f2074005ea0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.347+0000 7f208ba5e640 1 -- 172.21.15.17:0/3232907169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2084072850 msgr2=0x7f208419c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.347+0000 7f208ba5e640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2084072850 0x7f208419c0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2080005940 tx=0x7f2080032bd0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.347+0000 7f208ba5e640 1 -- 172.21.15.17:0/3232907169 shutdown_connections 2024-08-19T01:00:57.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.347+0000 7f208ba5e640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f207006e2b0 0x7f2070070770 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.347+0000 7f208ba5e640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2084073170 0x7f208419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.347+0000 7f208ba5e640 1 --2- 172.21.15.17:0/3232907169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2084072850 0x7f208419c0d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.347+0000 7f208ba5e640 1 -- 172.21.15.17:0/3232907169 >> 172.21.15.17:0/3232907169 conn(0x7f20840fb860 msgr2=0x7f2084103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.347+0000 7f208ba5e640 1 -- 172.21.15.17:0/3232907169 shutdown_connections 2024-08-19T01:00:57.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.347+0000 7f208ba5e640 1 -- 172.21.15.17:0/3232907169 wait complete. 2024-08-19T01:00:57.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.433+0000 7efd3157e640 1 -- 172.21.15.17:0/3063034212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd2c105c00 msgr2=0x7efd2c105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.433+0000 7efd3157e640 1 --2- 172.21.15.17:0/3063034212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd2c105c00 0x7efd2c105fe0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009880 tx=0x7efd1c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.433+0000 7efd3157e640 1 -- 172.21.15.17:0/3063034212 shutdown_connections 2024-08-19T01:00:57.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.433+0000 7efd3157e640 1 --2- 172.21.15.17:0/3063034212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd2c0ffb50 0x7efd2c0fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.433+0000 7efd3157e640 1 --2- 172.21.15.17:0/3063034212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd2c105c00 0x7efd2c105fe0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.433+0000 7efd3157e640 1 -- 172.21.15.17:0/3063034212 >> 172.21.15.17:0/3063034212 conn(0x7efd2c0fb830 msgr2=0x7efd2c0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:57.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.433+0000 7efd3157e640 1 -- 172.21.15.17:0/3063034212 shutdown_connections 2024-08-19T01:00:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.433+0000 7efd3157e640 1 -- 172.21.15.17:0/3063034212 wait complete. 2024-08-19T01:00:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.433+0000 7efd3157e640 1 Processor -- start 2024-08-19T01:00:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd3157e640 1 -- start start 2024-08-19T01:00:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd3157e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd2c0ffb50 0x7efd2c197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd3157e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd2c105c00 0x7efd2c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd3157e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c198990 con 0x7efd2c105c00 2024-08-19T01:00:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd3157e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c19c700 con 0x7efd2c0ffb50 2024-08-19T01:00:57.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd2a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd2c105c00 0x7efd2c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:57.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd2a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd2c105c00 0x7efd2c198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46618/0 (socket says 172.21.15.17:46618) 2024-08-19T01:00:57.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd2a7fc640 1 -- 172.21.15.17:0/2306816630 learned_addr learned my addr 172.21.15.17:0/2306816630 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd2affd640 1 --2- 172.21.15.17:0/2306816630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd2c0ffb50 0x7efd2c197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd2a7fc640 1 -- 172.21.15.17:0/2306816630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd2c0ffb50 msgr2=0x7efd2c197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd2a7fc640 1 --2- 172.21.15.17:0/2306816630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd2c0ffb50 0x7efd2c197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.434+0000 7efd2a7fc640 1 -- 172.21.15.17:0/2306816630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c009560 con 0x7efd2c105c00 2024-08-19T01:00:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.435+0000 7efd2a7fc640 1 --2- 172.21.15.17:0/2306816630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd2c105c00 0x7efd2c198300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd1400b420 tx=0x7efd1400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.435+0000 7efd23fff640 1 -- 172.21.15.17:0/2306816630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd14011800 con 0x7efd2c105c00 2024-08-19T01:00:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.435+0000 7efd23fff640 1 -- 172.21.15.17:0/2306816630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd14011e20 con 0x7efd2c105c00 2024-08-19T01:00:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.435+0000 7efd3157e640 1 -- 172.21.15.17:0/2306816630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2c19c9e0 con 0x7efd2c105c00 2024-08-19T01:00:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.435+0000 7efd23fff640 1 -- 172.21.15.17:0/2306816630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd1400f2e0 con 0x7efd2c105c00 2024-08-19T01:00:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.435+0000 7efd3157e640 1 -- 172.21.15.17:0/2306816630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2c19cf30 con 0x7efd2c105c00 2024-08-19T01:00:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.436+0000 7efd3157e640 1 -- 172.21.15.17:0/2306816630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2c101200 con 0x7efd2c105c00 2024-08-19T01:00:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.437+0000 7efd23fff640 1 -- 172.21.15.17:0/2306816630 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7efd14010380 con 0x7efd2c105c00 2024-08-19T01:00:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.437+0000 7efd23fff640 1 --2- 172.21.15.17:0/2306816630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd1806e2b0 0x7efd18070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.437+0000 7efd2affd640 1 --2- 172.21.15.17:0/2306816630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd1806e2b0 0x7efd18070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.437+0000 7efd23fff640 1 -- 172.21.15.17:0/2306816630 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7efd1408db30 con 0x7efd2c105c00 2024-08-19T01:00:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.438+0000 7efd2affd640 1 --2- 172.21.15.17:0/2306816630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd1806e2b0 0x7efd18070770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009230 tx=0x7efd1c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:57.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.442+0000 7efd23fff640 1 -- 172.21.15.17:0/2306816630 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efd14056db0 con 0x7efd2c105c00 2024-08-19T01:00:57.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.639+0000 7efd3157e640 1 -- 172.21.15.17:0/2306816630 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd2c10ce20 con 0x7efd1806e2b0 2024-08-19T01:00:57.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.641+0000 7efd23fff640 1 -- 172.21.15.17:0/2306816630 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7efd2c10ce20 con 0x7efd1806e2b0 2024-08-19T01:00:57.643 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:00:57.643 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:00:57.643 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:00:57.643 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:00:57.643 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:00:57.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:00:57.643 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:00:57.643 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:00:57.643 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "4/23 daemons upgraded", 2024-08-19T01:00:57.643 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading crash daemons", 2024-08-19T01:00:57.643 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:00:57.644 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:00:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.643+0000 7efd3157e640 1 -- 172.21.15.17:0/2306816630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd1806e2b0 msgr2=0x7efd18070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.643+0000 7efd3157e640 1 --2- 172.21.15.17:0/2306816630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd1806e2b0 0x7efd18070770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efd1c009230 tx=0x7efd1c0058d0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.643+0000 7efd3157e640 1 -- 172.21.15.17:0/2306816630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd2c105c00 msgr2=0x7efd2c198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.643+0000 7efd3157e640 1 --2- 172.21.15.17:0/2306816630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd2c105c00 0x7efd2c198300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd1400b420 tx=0x7efd1400b8e0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.643+0000 7efd3157e640 1 -- 172.21.15.17:0/2306816630 shutdown_connections 2024-08-19T01:00:57.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.643+0000 7efd3157e640 1 --2- 172.21.15.17:0/2306816630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd1806e2b0 0x7efd18070770 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.643+0000 7efd3157e640 1 --2- 172.21.15.17:0/2306816630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd2c105c00 0x7efd2c198300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.643+0000 7efd3157e640 1 --2- 172.21.15.17:0/2306816630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd2c0ffb50 0x7efd2c197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.643+0000 7efd3157e640 1 -- 172.21.15.17:0/2306816630 >> 172.21.15.17:0/2306816630 conn(0x7efd2c0fb830 msgr2=0x7efd2c072fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.643+0000 7efd3157e640 1 -- 172.21.15.17:0/2306816630 shutdown_connections 2024-08-19T01:00:57.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.643+0000 7efd3157e640 1 -- 172.21.15.17:0/2306816630 wait complete. 2024-08-19T01:00:57.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.727+0000 7f125116c640 1 -- 172.21.15.17:0/2867334062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124c0ffda0 msgr2=0x7f124c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.727+0000 7f125116c640 1 --2- 172.21.15.17:0/2867334062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124c0ffda0 0x7f124c100180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f123c009c20 tx=0x7f123c02a970 comp rx=0 tx=0).stop 2024-08-19T01:00:57.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.727+0000 7f125116c640 1 -- 172.21.15.17:0/2867334062 shutdown_connections 2024-08-19T01:00:57.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.727+0000 7f125116c640 1 --2- 172.21.15.17:0/2867334062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124c100750 0x7f124c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.727+0000 7f125116c640 1 --2- 172.21.15.17:0/2867334062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124c0ffda0 0x7f124c100180 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.727+0000 7f125116c640 1 -- 172.21.15.17:0/2867334062 >> 172.21.15.17:0/2867334062 conn(0x7f124c0fb840 msgr2=0x7f124c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:57.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.727+0000 7f125116c640 1 -- 172.21.15.17:0/2867334062 shutdown_connections 2024-08-19T01:00:57.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.727+0000 7f125116c640 1 -- 172.21.15.17:0/2867334062 wait complete. 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.727+0000 7f125116c640 1 Processor -- start 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f125116c640 1 -- start start 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f125116c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124c0ffda0 0x7f124c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f125116c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124c100750 0x7f124c19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f125116c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c195a10 con 0x7f124c100750 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f125116c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c195b50 con 0x7f124c0ffda0 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f124a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124c100750 0x7f124c19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f124a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124c100750 0x7f124c19bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46650/0 (socket says 172.21.15.17:46650) 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f124a59c640 1 -- 172.21.15.17:0/1055461183 learned_addr learned my addr 172.21.15.17:0/1055461183 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f124ad9d640 1 --2- 172.21.15.17:0/1055461183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124c0ffda0 0x7f124c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f124a59c640 1 -- 172.21.15.17:0/1055461183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124c0ffda0 msgr2=0x7f124c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f124a59c640 1 --2- 172.21.15.17:0/1055461183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124c0ffda0 0x7f124c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f124a59c640 1 -- 172.21.15.17:0/1055461183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c009900 con 0x7f124c100750 2024-08-19T01:00:57.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.728+0000 7f124a59c640 1 --2- 172.21.15.17:0/1055461183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124c100750 0x7f124c19bef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f124000d6f0 tx=0x7f124000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:57.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.729+0000 7f1233fff640 1 -- 172.21.15.17:0/1055461183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1240009a30 con 0x7f124c100750 2024-08-19T01:00:57.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.729+0000 7f1233fff640 1 -- 172.21.15.17:0/1055461183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f12400054e0 con 0x7f124c100750 2024-08-19T01:00:57.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.729+0000 7f125116c640 1 -- 172.21.15.17:0/1055461183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c195e30 con 0x7f124c100750 2024-08-19T01:00:57.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.729+0000 7f1233fff640 1 -- 172.21.15.17:0/1055461183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1240010460 con 0x7f124c100750 2024-08-19T01:00:57.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.729+0000 7f125116c640 1 -- 172.21.15.17:0/1055461183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c196380 con 0x7f124c100750 2024-08-19T01:00:57.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.730+0000 7f125116c640 1 -- 172.21.15.17:0/1055461183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c101280 con 0x7f124c100750 2024-08-19T01:00:57.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.730+0000 7f1233fff640 1 -- 172.21.15.17:0/1055461183 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f1240009b90 con 0x7f124c100750 2024-08-19T01:00:57.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.731+0000 7f1233fff640 1 --2- 172.21.15.17:0/1055461183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f123406e2b0 0x7f1234070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:00:57.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.731+0000 7f1233fff640 1 -- 172.21.15.17:0/1055461183 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f124008de60 con 0x7f124c100750 2024-08-19T01:00:57.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.731+0000 7f124ad9d640 1 --2- 172.21.15.17:0/1055461183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f123406e2b0 0x7f1234070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:00:57.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.731+0000 7f124ad9d640 1 --2- 172.21.15.17:0/1055461183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f123406e2b0 0x7f1234070770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f123c000f80 tx=0x7f123c03d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:00:57.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.735+0000 7f1233fff640 1 -- 172.21.15.17:0/1055461183 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1240057080 con 0x7f124c100750 2024-08-19T01:00:57.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.980+0000 7f125116c640 1 -- 172.21.15.17:0/1055461183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f124c196f40 con 0x7f124c100750 2024-08-19T01:00:57.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.980+0000 7f1233fff640 1 -- 172.21.15.17:0/1055461183 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f1240017090 con 0x7f124c100750 2024-08-19T01:00:57.983 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:57.983 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:00:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:00:57.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.982+0000 7f125116c640 1 -- 172.21.15.17:0/1055461183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f123406e2b0 msgr2=0x7f1234070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.982+0000 7f125116c640 1 --2- 172.21.15.17:0/1055461183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f123406e2b0 0x7f1234070770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f123c000f80 tx=0x7f123c03d040 comp rx=0 tx=0).stop 2024-08-19T01:00:57.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.982+0000 7f125116c640 1 -- 172.21.15.17:0/1055461183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124c100750 msgr2=0x7f124c19bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:00:57.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.982+0000 7f125116c640 1 --2- 172.21.15.17:0/1055461183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124c100750 0x7f124c19bef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f124000d6f0 tx=0x7f124000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.983+0000 7f125116c640 1 -- 172.21.15.17:0/1055461183 shutdown_connections 2024-08-19T01:00:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.983+0000 7f125116c640 1 --2- 172.21.15.17:0/1055461183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f123406e2b0 0x7f1234070770 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.983+0000 7f125116c640 1 --2- 172.21.15.17:0/1055461183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f124c100750 0x7f124c19bef0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.983+0000 7f125116c640 1 --2- 172.21.15.17:0/1055461183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f124c0ffda0 0x7f124c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:00:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.983+0000 7f125116c640 1 -- 172.21.15.17:0/1055461183 >> 172.21.15.17:0/1055461183 conn(0x7f124c0fb840 msgr2=0x7f124c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:00:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.983+0000 7f125116c640 1 -- 172.21.15.17:0/1055461183 shutdown_connections 2024-08-19T01:00:57.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:00:57.983+0000 7f125116c640 1 -- 172.21.15.17:0/1055461183 wait complete. 2024-08-19T01:00:58.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:57 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2154340986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:00:58.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:57 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3232907169' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:00:58.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:57 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:58.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:57 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:58.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:57 smithi017 ceph-mon[99370]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:58.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:57 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2154340986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:00:58.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:57 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3232907169' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:00:58.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:57 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:58.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:57 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:00:58.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:57 smithi086 ceph-mon[71303]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:00:59.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:58 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1055461183' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:00:59.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:00:58 smithi017 ceph-mon[99370]: pgmap v31: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:00:59.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:58 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1055461183' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:00:59.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:00:58 smithi086 ceph-mon[71303]: pgmap v31: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:01:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:00 smithi017 ceph-mon[99370]: Upgrade: Updating crash.smithi086 (2/2) 2024-08-19T01:01:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi086", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T01:01:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:01:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:00 smithi017 ceph-mon[99370]: Deploying daemon crash.smithi086 on smithi086 2024-08-19T01:01:00.369 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:00 smithi086 ceph-mon[71303]: Upgrade: Updating crash.smithi086 (2/2) 2024-08-19T01:01:00.370 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:00.370 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi086", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-08-19T01:01:00.370 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:01:00.370 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:00 smithi086 ceph-mon[71303]: Deploying daemon crash.smithi086 on smithi086 2024-08-19T01:01:01.109 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:01 smithi086 ceph-mon[71303]: pgmap v32: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:01.289 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:01 smithi017 ceph-mon[99370]: pgmap v32: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:03.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:03.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:03.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:01:03.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:03 smithi017 ceph-mon[99370]: pgmap v33: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:03.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:01:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:01:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:03 smithi086 ceph-mon[71303]: pgmap v33: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:01:05.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:04 smithi017 ceph-mon[99370]: pgmap v34: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:01:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:04 smithi086 ceph-mon[71303]: pgmap v34: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:01:06.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:06 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:06.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:06 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:06.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:06 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:06.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:06 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:06.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:06 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:06.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:06 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:06.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:06 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:06.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:06 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:07.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:07 smithi086 ceph-mon[71303]: pgmap v35: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:07.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:07 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:07.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:07 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:07 smithi017 ceph-mon[99370]: pgmap v35: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:07 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:07 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:09.387 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:09.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:09.388 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:08 smithi086 ceph-mon[71303]: pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:01:09.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:09.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:09.400 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:08 smithi017 ceph-mon[99370]: pgmap v36: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:01:10.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:10.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:10.694 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:10.694 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:11.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:11 smithi017 ceph-mon[99370]: pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:11.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:11.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:11.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:01:11.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:01:11.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:11.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:11 smithi086 ceph-mon[71303]: pgmap v37: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:11.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:11.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:11.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:01:11.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:01:11.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:12.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: Upgrade: Setting container_image for all crash 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi017"}]: dispatch 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi017"}]': finished 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi086"}]: dispatch 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi086"}]': finished 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-19T01:01:12.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:12 smithi017 ceph-mon[99370]: Upgrade: osd.0 is safe to restart 2024-08-19T01:01:12.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:01:12.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:12.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:12.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:12.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: Upgrade: Setting container_image for all crash 2024-08-19T01:01:12.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:12.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi017"}]: dispatch 2024-08-19T01:01:12.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi017"}]': finished 2024-08-19T01:01:12.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi086"}]: dispatch 2024-08-19T01:01:12.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi086"}]': finished 2024-08-19T01:01:12.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-19T01:01:12.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-08-19T01:01:12.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:12 smithi086 ceph-mon[71303]: Upgrade: osd.0 is safe to restart 2024-08-19T01:01:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:13 smithi017 ceph-mon[99370]: Upgrade: Updating osd.0 2024-08-19T01:01:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:13 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:13 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-19T01:01:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:13 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:01:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:13 smithi017 ceph-mon[99370]: Deploying daemon osd.0 on smithi017 2024-08-19T01:01:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:13 smithi017 ceph-mon[99370]: pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:14.140 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:13 smithi086 ceph-mon[71303]: Upgrade: Updating osd.0 2024-08-19T01:01:14.140 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:13 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:14.140 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:13 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-19T01:01:14.140 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:13 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:01:14.140 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:13 smithi086 ceph-mon[71303]: Deploying daemon osd.0 on smithi017 2024-08-19T01:01:14.140 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:13 smithi086 ceph-mon[71303]: pgmap v38: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:15.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:14 smithi017 ceph-mon[99370]: pgmap v39: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:01:15.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:14 smithi086 ceph-mon[71303]: pgmap v39: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:01:16.032 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:15 smithi017 systemd[1]: Stopping Ceph osd.0 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:01:16.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:16 smithi017 ceph-mon[99370]: osd.0 marked itself down and dead 2024-08-19T01:01:16.434 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:16 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0[34735]: 2024-08-19T01:01:16.028+0000 7fbce8e63640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:01:16.434 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:16 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0[34735]: 2024-08-19T01:01:16.028+0000 7fbce8e63640 -1 osd.0 49 *** Got signal Terminated *** 2024-08-19T01:01:16.434 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:16 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0[34735]: 2024-08-19T01:01:16.028+0000 7fbce8e63640 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:01:16.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:16 smithi086 ceph-mon[71303]: osd.0 marked itself down and dead 2024-08-19T01:01:16.816 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:16 smithi017 podman[109942]: 2024-08-19 01:01:16.520154198 +0000 UTC m=+0.610092960 container died 0997dcc5892bfdfebad780d9cd3274ad8efdfe55382ea140ffce6dc22fba81eb (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=reef-baa926d, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-19T01:01:17.098 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:16 smithi017 podman[109942]: 2024-08-19 01:01:16.904950157 +0000 UTC m=+0.994888919 container cleanup 0997dcc5892bfdfebad780d9cd3274ad8efdfe55382ea140ffce6dc22fba81eb (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=reef-baa926d, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:01:17.098 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:16 smithi017 bash[109942]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0 2024-08-19T01:01:17.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:17 smithi017 ceph-mon[99370]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:01:17.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:17 smithi017 ceph-mon[99370]: osdmap e50: 6 total, 5 up, 6 in 2024-08-19T01:01:17.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:17 smithi017 ceph-mon[99370]: pgmap v41: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:01:17.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:17 smithi017 ceph-mon[99370]: osdmap e51: 6 total, 5 up, 6 in 2024-08-19T01:01:17.434 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:17 smithi017 podman[109960]: 2024-08-19 01:01:17.14023945 +0000 UTC m=+0.622262204 container remove 0997dcc5892bfdfebad780d9cd3274ad8efdfe55382ea140ffce6dc22fba81eb (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0, RELEASE=reef-baa926d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-19T01:01:17.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:17 smithi086 ceph-mon[71303]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:01:17.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:17 smithi086 ceph-mon[71303]: osdmap e50: 6 total, 5 up, 6 in 2024-08-19T01:01:17.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:17 smithi086 ceph-mon[71303]: pgmap v41: 65 pgs: 9 stale+active+clean, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:01:17.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:17 smithi086 ceph-mon[71303]: osdmap e51: 6 total, 5 up, 6 in 2024-08-19T01:01:17.737 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:17 smithi017 podman[110049]: 2024-08-19 01:01:17.380264377 +0000 UTC m=+0.017255559 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:01:17.737 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:17 smithi017 podman[110049]: 2024-08-19 01:01:17.499495633 +0000 UTC m=+0.136486841 container create ce95ffd115437e6509483750dde8c8eb22d39e3a47b0aa106c1f872938cdbc27 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-19T01:01:18.183 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:17 smithi017 podman[110049]: 2024-08-19 01:01:17.735439048 +0000 UTC m=+0.372430226 container init ce95ffd115437e6509483750dde8c8eb22d39e3a47b0aa106c1f872938cdbc27 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:01:18.183 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:17 smithi017 podman[110049]: 2024-08-19 01:01:17.739584514 +0000 UTC m=+0.376575681 container start ce95ffd115437e6509483750dde8c8eb22d39e3a47b0aa106c1f872938cdbc27 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-19T01:01:18.183 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:17 smithi017 podman[110049]: 2024-08-19 01:01:17.826944855 +0000 UTC m=+0.463936023 container attach ce95ffd115437e6509483750dde8c8eb22d39e3a47b0aa106c1f872938cdbc27 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-19T01:01:18.183 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:17 smithi017 podman[110072]: 2024-08-19 01:01:17.958820121 +0000 UTC m=+0.018255543 container died ce95ffd115437e6509483750dde8c8eb22d39e3a47b0aa106c1f872938cdbc27 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-19T01:01:18.908 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:18 smithi017 podman[110072]: 2024-08-19 01:01:18.53049964 +0000 UTC m=+0.589935093 container remove ce95ffd115437e6509483750dde8c8eb22d39e3a47b0aa106c1f872938cdbc27 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-de09dd0) 2024-08-19T01:01:18.908 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:18 smithi017 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.0.service: Deactivated successfully. 2024-08-19T01:01:18.908 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:18 smithi017 systemd[1]: Stopped Ceph osd.0 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:01:18.909 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:18 smithi017 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.0.service: Consumed 55.651s CPU time. 2024-08-19T01:01:18.909 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:18 smithi017 systemd[1]: Starting Ceph osd.0 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:01:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:01:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:18 smithi017 ceph-mon[99370]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 60/321 objects degraded (18.692%) 2024-08-19T01:01:19.183 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:18 smithi017 podman[110171]: 2024-08-19 01:01:18.883406071 +0000 UTC m=+0.017271047 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:01:19.183 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 podman[110171]: 2024-08-19 01:01:19.007376415 +0000 UTC m=+0.141241374 container create 5c71bf2fc94982cbb3b96e84bde82b77ffe6ebec96ac6ebe4f2defee6fc40a78 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-de09dd0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:01:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:01:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:18 smithi086 ceph-mon[71303]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 60/321 objects degraded (18.692%) 2024-08-19T01:01:19.495 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 podman[110171]: 2024-08-19 01:01:19.227966397 +0000 UTC m=+0.361831375 container init 5c71bf2fc94982cbb3b96e84bde82b77ffe6ebec96ac6ebe4f2defee6fc40a78 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-19T01:01:19.495 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 podman[110171]: 2024-08-19 01:01:19.231412009 +0000 UTC m=+0.365276976 container start 5c71bf2fc94982cbb3b96e84bde82b77ffe6ebec96ac6ebe4f2defee6fc40a78 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-19T01:01:19.495 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 podman[110171]: 2024-08-19 01:01:19.334827483 +0000 UTC m=+0.468692450 container attach 5c71bf2fc94982cbb3b96e84bde82b77ffe6ebec96ac6ebe4f2defee6fc40a78 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:01:19.495 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:19.495 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-08-19T01:01:19.496 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-08-19T01:01:19.497 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-08-19T01:01:19.909 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-08-19T01:01:19.909 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-08-19T01:01:19.909 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-19T01:01:19.909 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-19T01:01:19.909 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-19T01:01:19.909 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-19T01:01:19.910 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate[110187]: --> ceph-volume lvm activate successful for osd ID: 0 2024-08-19T01:01:19.910 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 bash[110171]: --> ceph-volume lvm activate successful for osd ID: 0 2024-08-19T01:01:19.910 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:19 smithi017 podman[110171]: 2024-08-19 01:01:19.520261909 +0000 UTC m=+0.654126877 container died 5c71bf2fc94982cbb3b96e84bde82b77ffe6ebec96ac6ebe4f2defee6fc40a78 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-19T01:01:20.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:19 smithi017 ceph-mon[99370]: Health check failed: Degraded data redundancy: 60/321 objects degraded (18.692%), 20 pgs degraded (PG_DEGRADED) 2024-08-19T01:01:20.183 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:20 smithi017 podman[110312]: 2024-08-19 01:01:20.130524176 +0000 UTC m=+0.604522782 container remove 5c71bf2fc94982cbb3b96e84bde82b77ffe6ebec96ac6ebe4f2defee6fc40a78 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-activate, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-19T01:01:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:19 smithi086 ceph-mon[71303]: Health check failed: Degraded data redundancy: 60/321 objects degraded (18.692%), 20 pgs degraded (PG_DEGRADED) 2024-08-19T01:01:20.627 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:20 smithi017 podman[110374]: 2024-08-19 01:01:20.331601378 +0000 UTC m=+0.100558790 container create 759a865efe387ac1fe984a656c3969d8146a7f79770a2c5021d5fe326b350485 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-08-19T01:01:20.627 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:20 smithi017 podman[110374]: 2024-08-19 01:01:20.248526066 +0000 UTC m=+0.017483494 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:01:20.627 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:20 smithi017 podman[110374]: 2024-08-19 01:01:20.525397208 +0000 UTC m=+0.294354630 container init 759a865efe387ac1fe984a656c3969d8146a7f79770a2c5021d5fe326b350485 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-08-19T01:01:20.627 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:20 smithi017 podman[110374]: 2024-08-19 01:01:20.528530951 +0000 UTC m=+0.297488361 container start 759a865efe387ac1fe984a656c3969d8146a7f79770a2c5021d5fe326b350485 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-19T01:01:20.628 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:20 smithi017 ceph-osd[110392]: -- 172.21.15.17:0/724076135 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56482ef841e0 con 0x56482e189c00 2024-08-19T01:01:20.628 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:20 smithi017 bash[110374]: 759a865efe387ac1fe984a656c3969d8146a7f79770a2c5021d5fe326b350485 2024-08-19T01:01:20.933 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:20 smithi017 systemd[1]: Started Ceph osd.0 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:01:21.401 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:21 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0[110388]: 2024-08-19T01:01:21.071+0000 7f34e9932640 -1 Falling back to public interface 2024-08-19T01:01:21.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:21 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:21.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:21 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:21.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:21 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:01:21.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:21 smithi017 ceph-mon[99370]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 60/321 objects degraded (18.692%) 2024-08-19T01:01:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:21 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:21 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:21 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:01:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:21 smithi086 ceph-mon[71303]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 60/321 objects degraded (18.692%) 2024-08-19T01:01:23.103 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:22 smithi017 ceph-mon[99370]: pgmap v45: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 60/321 objects degraded (18.692%) 2024-08-19T01:01:23.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:22 smithi086 ceph-mon[71303]: pgmap v45: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 60/321 objects degraded (18.692%) 2024-08-19T01:01:25.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:24 smithi017 ceph-mon[99370]: pgmap v46: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 60/321 objects degraded (18.692%) 2024-08-19T01:01:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:24 smithi086 ceph-mon[71303]: pgmap v46: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 60/321 objects degraded (18.692%) 2024-08-19T01:01:26.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:25 smithi017 ceph-mon[99370]: from='osd.0 [v2:172.21.15.17:6802/3127154318,v1:172.21.15.17:6803/3127154318]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-19T01:01:26.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:25 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:26.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:25 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:26.184 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:25 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0[110388]: 2024-08-19T01:01:25.886+0000 7f34e9932640 -1 osd.0 49 log_to_monitors true 2024-08-19T01:01:26.184 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:01:25 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0[110388]: 2024-08-19T01:01:25.940+0000 7f34dd6c4640 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T01:01:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:25 smithi086 ceph-mon[71303]: from='osd.0 [v2:172.21.15.17:6802/3127154318,v1:172.21.15.17:6803/3127154318]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-19T01:01:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:25 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:25 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:26.937 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:26 smithi017 ceph-mon[99370]: from='osd.0 [v2:172.21.15.17:6802/3127154318,v1:172.21.15.17:6803/3127154318]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-19T01:01:26.938 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:26 smithi017 ceph-mon[99370]: osdmap e52: 6 total, 5 up, 6 in 2024-08-19T01:01:26.938 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:26 smithi017 ceph-mon[99370]: from='osd.0 [v2:172.21.15.17:6802/3127154318,v1:172.21.15.17:6803/3127154318]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T01:01:26.938 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:26 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:26.938 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:26 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:26.938 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:26 smithi017 ceph-mon[99370]: pgmap v48: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-08-19T01:01:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:26 smithi086 ceph-mon[71303]: from='osd.0 [v2:172.21.15.17:6802/3127154318,v1:172.21.15.17:6803/3127154318]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-19T01:01:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:26 smithi086 ceph-mon[71303]: osdmap e52: 6 total, 5 up, 6 in 2024-08-19T01:01:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:26 smithi086 ceph-mon[71303]: from='osd.0 [v2:172.21.15.17:6802/3127154318,v1:172.21.15.17:6803/3127154318]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T01:01:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:26 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:26 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:26 smithi086 ceph-mon[71303]: pgmap v48: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 60/321 objects degraded (18.692%) 2024-08-19T01:01:28.067 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:27 smithi017 ceph-mon[99370]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:01:28.067 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:27 smithi017 ceph-mon[99370]: osd.0 [v2:172.21.15.17:6802/3127154318,v1:172.21.15.17:6803/3127154318] boot 2024-08-19T01:01:28.067 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:27 smithi017 ceph-mon[99370]: osdmap e53: 6 total, 6 up, 6 in 2024-08-19T01:01:28.067 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:27 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T01:01:28.068 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:27 smithi017 ceph-mon[99370]: osdmap e54: 6 total, 6 up, 6 in 2024-08-19T01:01:28.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.070+0000 7f8495aba640 1 -- 172.21.15.17:0/4167743307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8490101620 msgr2=0x7f8490109b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.070+0000 7f8495aba640 1 --2- 172.21.15.17:0/4167743307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8490101620 0x7f8490109b10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8484009880 tx=0x7f848402a530 comp rx=0 tx=0).stop 2024-08-19T01:01:28.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.070+0000 7f8495aba640 1 -- 172.21.15.17:0/4167743307 shutdown_connections 2024-08-19T01:01:28.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.070+0000 7f8495aba640 1 --2- 172.21.15.17:0/4167743307 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8490101620 0x7f8490109b10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.070+0000 7f8495aba640 1 --2- 172.21.15.17:0/4167743307 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8490100d00 0x7f84901010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.070+0000 7f8495aba640 1 -- 172.21.15.17:0/4167743307 >> 172.21.15.17:0/4167743307 conn(0x7f84900fa700 msgr2=0x7f84900fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:28.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.070+0000 7f8495aba640 1 -- 172.21.15.17:0/4167743307 shutdown_connections 2024-08-19T01:01:28.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.070+0000 7f8495aba640 1 -- 172.21.15.17:0/4167743307 wait complete. 2024-08-19T01:01:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.071+0000 7f8495aba640 1 Processor -- start 2024-08-19T01:01:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.071+0000 7f8495aba640 1 -- start start 2024-08-19T01:01:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.071+0000 7f8495aba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8490100d00 0x7f849019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.071+0000 7f8495aba640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8490101620 0x7f849019bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.071+0000 7f8495aba640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849019c400 con 0x7f8490100d00 2024-08-19T01:01:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.071+0000 7f8495aba640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8490195990 con 0x7f8490101620 2024-08-19T01:01:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f848f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8490100d00 0x7f849019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f848f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8490100d00 0x7f849019b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38976/0 (socket says 172.21.15.17:38976) 2024-08-19T01:01:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f848f7fe640 1 -- 172.21.15.17:0/2624747133 learned_addr learned my addr 172.21.15.17:0/2624747133 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:01:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f848effd640 1 --2- 172.21.15.17:0/2624747133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8490101620 0x7f849019bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f848f7fe640 1 -- 172.21.15.17:0/2624747133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8490101620 msgr2=0x7f849019bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f848f7fe640 1 --2- 172.21.15.17:0/2624747133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8490101620 0x7f849019bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f848f7fe640 1 -- 172.21.15.17:0/2624747133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8484009560 con 0x7f8490100d00 2024-08-19T01:01:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f848f7fe640 1 --2- 172.21.15.17:0/2624747133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8490100d00 0x7f849019b8a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f848000c810 tx=0x7f848000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f848cff9640 1 -- 172.21.15.17:0/2624747133 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84800041f0 con 0x7f8490100d00 2024-08-19T01:01:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f8495aba640 1 -- 172.21.15.17:0/2624747133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8490195c70 con 0x7f8490100d00 2024-08-19T01:01:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f848cff9640 1 -- 172.21.15.17:0/2624747133 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8480007e70 con 0x7f8490100d00 2024-08-19T01:01:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f848cff9640 1 -- 172.21.15.17:0/2624747133 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84800049d0 con 0x7f8490100d00 2024-08-19T01:01:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.072+0000 7f8495aba640 1 -- 172.21.15.17:0/2624747133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8490196190 con 0x7f8490100d00 2024-08-19T01:01:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.073+0000 7f8495aba640 1 -- 172.21.15.17:0/2624747133 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8490068d30 con 0x7f8490100d00 2024-08-19T01:01:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.074+0000 7f848cff9640 1 -- 172.21.15.17:0/2624747133 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f84800079b0 con 0x7f8490100d00 2024-08-19T01:01:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.074+0000 7f848cff9640 1 --2- 172.21.15.17:0/2624747133 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f847806e2a0 0x7f8478070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:28.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.075+0000 7f848cff9640 1 -- 172.21.15.17:0/2624747133 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f848008e0f0 con 0x7f8490100d00 2024-08-19T01:01:28.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.075+0000 7f848effd640 1 --2- 172.21.15.17:0/2624747133 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f847806e2a0 0x7f8478070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:28.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.075+0000 7f848effd640 1 --2- 172.21.15.17:0/2624747133 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f847806e2a0 0x7f8478070760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8484009230 tx=0x7f8484005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.079+0000 7f848cff9640 1 -- 172.21.15.17:0/2624747133 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8480057310 con 0x7f8490100d00 2024-08-19T01:01:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:27 smithi086 ceph-mon[71303]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:01:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:27 smithi086 ceph-mon[71303]: osd.0 [v2:172.21.15.17:6802/3127154318,v1:172.21.15.17:6803/3127154318] boot 2024-08-19T01:01:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:27 smithi086 ceph-mon[71303]: osdmap e53: 6 total, 6 up, 6 in 2024-08-19T01:01:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:27 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-19T01:01:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:27 smithi086 ceph-mon[71303]: osdmap e54: 6 total, 6 up, 6 in 2024-08-19T01:01:28.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.297+0000 7f8495aba640 1 -- 172.21.15.17:0/2624747133 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84901043d0 con 0x7f847806e2a0 2024-08-19T01:01:28.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.298+0000 7f848cff9640 1 -- 172.21.15.17:0/2624747133 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f84901043d0 con 0x7f847806e2a0 2024-08-19T01:01:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.300+0000 7f8495aba640 1 -- 172.21.15.17:0/2624747133 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f847806e2a0 msgr2=0x7f8478070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.300+0000 7f8495aba640 1 --2- 172.21.15.17:0/2624747133 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f847806e2a0 0x7f8478070760 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8484009230 tx=0x7f8484005a20 comp rx=0 tx=0).stop 2024-08-19T01:01:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.300+0000 7f8495aba640 1 -- 172.21.15.17:0/2624747133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8490100d00 msgr2=0x7f849019b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.300+0000 7f8495aba640 1 --2- 172.21.15.17:0/2624747133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8490100d00 0x7f849019b8a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f848000c810 tx=0x7f848000ccd0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.300+0000 7f8495aba640 1 -- 172.21.15.17:0/2624747133 shutdown_connections 2024-08-19T01:01:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.300+0000 7f8495aba640 1 --2- 172.21.15.17:0/2624747133 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f847806e2a0 0x7f8478070760 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.300+0000 7f8495aba640 1 --2- 172.21.15.17:0/2624747133 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8490101620 0x7f849019bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.300+0000 7f8495aba640 1 --2- 172.21.15.17:0/2624747133 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8490100d00 0x7f849019b8a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.300+0000 7f8495aba640 1 -- 172.21.15.17:0/2624747133 >> 172.21.15.17:0/2624747133 conn(0x7f84900fa700 msgr2=0x7f8490101fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.301+0000 7f8495aba640 1 -- 172.21.15.17:0/2624747133 shutdown_connections 2024-08-19T01:01:28.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.301+0000 7f8495aba640 1 -- 172.21.15.17:0/2624747133 wait complete. 2024-08-19T01:01:28.312 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:01:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.384+0000 7f0be14d9640 1 -- 172.21.15.17:0/1579671544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc100750 msgr2=0x7f0bdc1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.384+0000 7f0be14d9640 1 --2- 172.21.15.17:0/1579671544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc100750 0x7f0bdc1047a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009880 tx=0x7f0bc402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.384+0000 7f0be14d9640 1 -- 172.21.15.17:0/1579671544 shutdown_connections 2024-08-19T01:01:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.384+0000 7f0be14d9640 1 --2- 172.21.15.17:0/1579671544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc100750 0x7f0bdc1047a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.384+0000 7f0be14d9640 1 --2- 172.21.15.17:0/1579671544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bdc0ffda0 0x7f0bdc100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.384+0000 7f0be14d9640 1 -- 172.21.15.17:0/1579671544 >> 172.21.15.17:0/1579671544 conn(0x7f0bdc0fb840 msgr2=0x7f0bdc0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.385+0000 7f0be14d9640 1 -- 172.21.15.17:0/1579671544 shutdown_connections 2024-08-19T01:01:28.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.385+0000 7f0be14d9640 1 -- 172.21.15.17:0/1579671544 wait complete. 2024-08-19T01:01:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.385+0000 7f0be14d9640 1 Processor -- start 2024-08-19T01:01:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0be14d9640 1 -- start start 2024-08-19T01:01:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0be14d9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bdc0ffda0 0x7f0bdc19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0be14d9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc100750 0x7f0bdc19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0be14d9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc19c380 con 0x7f0bdc100750 2024-08-19T01:01:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0be14d9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc195910 con 0x7f0bdc0ffda0 2024-08-19T01:01:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0bda7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc100750 0x7f0bdc19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:28.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0bda7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc100750 0x7f0bdc19bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38994/0 (socket says 172.21.15.17:38994) 2024-08-19T01:01:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0bda7fc640 1 -- 172.21.15.17:0/3505478818 learned_addr learned my addr 172.21.15.17:0/3505478818 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:01:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0bdaffd640 1 --2- 172.21.15.17:0/3505478818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bdc0ffda0 0x7f0bdc19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0bda7fc640 1 -- 172.21.15.17:0/3505478818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bdc0ffda0 msgr2=0x7f0bdc19b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0bda7fc640 1 --2- 172.21.15.17:0/3505478818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bdc0ffda0 0x7f0bdc19b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.386+0000 7f0bda7fc640 1 -- 172.21.15.17:0/3505478818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4009560 con 0x7f0bdc100750 2024-08-19T01:01:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.387+0000 7f0bda7fc640 1 --2- 172.21.15.17:0/3505478818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc100750 0x7f0bdc19bd60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0bc402a9c0 tx=0x7f0bc40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.387+0000 7f0bd3fff640 1 -- 172.21.15.17:0/3505478818 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bc4004aa0 con 0x7f0bdc100750 2024-08-19T01:01:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.387+0000 7f0bd3fff640 1 -- 172.21.15.17:0/3505478818 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0bc4004c00 con 0x7f0bdc100750 2024-08-19T01:01:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.387+0000 7f0be14d9640 1 -- 172.21.15.17:0/3505478818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc195b90 con 0x7f0bdc100750 2024-08-19T01:01:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.387+0000 7f0bd3fff640 1 -- 172.21.15.17:0/3505478818 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bc4003980 con 0x7f0bdc100750 2024-08-19T01:01:28.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.387+0000 7f0be14d9640 1 -- 172.21.15.17:0/3505478818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc196080 con 0x7f0bdc100750 2024-08-19T01:01:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.388+0000 7f0be14d9640 1 -- 172.21.15.17:0/3505478818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc101280 con 0x7f0bdc100750 2024-08-19T01:01:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.388+0000 7f0bd3fff640 1 -- 172.21.15.17:0/3505478818 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f0bc4003bf0 con 0x7f0bdc100750 2024-08-19T01:01:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.389+0000 7f0bd3fff640 1 --2- 172.21.15.17:0/3505478818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bc806e2b0 0x7f0bc8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:28.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.389+0000 7f0bd3fff640 1 -- 172.21.15.17:0/3505478818 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0bc40af3f0 con 0x7f0bdc100750 2024-08-19T01:01:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.389+0000 7f0bdaffd640 1 --2- 172.21.15.17:0/3505478818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bc806e2b0 0x7f0bc8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:28.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.389+0000 7f0bdaffd640 1 --2- 172.21.15.17:0/3505478818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bc806e2b0 0x7f0bc8070770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc005fd0 tx=0x7f0bcc009870 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:28.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.393+0000 7f0bd3fff640 1 -- 172.21.15.17:0/3505478818 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0bc4078560 con 0x7f0bdc100750 2024-08-19T01:01:28.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.596+0000 7f0be14d9640 1 -- 172.21.15.17:0/3505478818 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bdc10cdb0 con 0x7f0bc806e2b0 2024-08-19T01:01:28.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.597+0000 7f0bd3fff640 1 -- 172.21.15.17:0/3505478818 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f0bdc10cdb0 con 0x7f0bc806e2b0 2024-08-19T01:01:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.600+0000 7f0be14d9640 1 -- 172.21.15.17:0/3505478818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bc806e2b0 msgr2=0x7f0bc8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.600+0000 7f0be14d9640 1 --2- 172.21.15.17:0/3505478818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bc806e2b0 0x7f0bc8070770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc005fd0 tx=0x7f0bcc009870 comp rx=0 tx=0).stop 2024-08-19T01:01:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.600+0000 7f0be14d9640 1 -- 172.21.15.17:0/3505478818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc100750 msgr2=0x7f0bdc19bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.600+0000 7f0be14d9640 1 --2- 172.21.15.17:0/3505478818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc100750 0x7f0bdc19bd60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0bc402a9c0 tx=0x7f0bc40055a0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.600+0000 7f0be14d9640 1 -- 172.21.15.17:0/3505478818 shutdown_connections 2024-08-19T01:01:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.600+0000 7f0be14d9640 1 --2- 172.21.15.17:0/3505478818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bc806e2b0 0x7f0bc8070770 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.600+0000 7f0be14d9640 1 --2- 172.21.15.17:0/3505478818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0bdc100750 0x7f0bdc19bd60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.600+0000 7f0be14d9640 1 --2- 172.21.15.17:0/3505478818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0bdc0ffda0 0x7f0bdc19b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.600+0000 7f0be14d9640 1 -- 172.21.15.17:0/3505478818 >> 172.21.15.17:0/3505478818 conn(0x7f0bdc0fb840 msgr2=0x7f0bdc0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:28.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.600+0000 7f0be14d9640 1 -- 172.21.15.17:0/3505478818 shutdown_connections 2024-08-19T01:01:28.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.600+0000 7f0be14d9640 1 -- 172.21.15.17:0/3505478818 wait complete. 2024-08-19T01:01:28.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.685+0000 7fa779687640 1 -- 172.21.15.17:0/2265600122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7740fe9f0 msgr2=0x7fa7740fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.685+0000 7fa779687640 1 --2- 172.21.15.17:0/2265600122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7740fe9f0 0x7fa7740fee50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa768009880 tx=0x7fa76802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.685+0000 7fa779687640 1 -- 172.21.15.17:0/2265600122 shutdown_connections 2024-08-19T01:01:28.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.685+0000 7fa779687640 1 --2- 172.21.15.17:0/2265600122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7740fe9f0 0x7fa7740fee50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.685+0000 7fa779687640 1 --2- 172.21.15.17:0/2265600122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7741049f0 0x7fa774104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.685+0000 7fa779687640 1 -- 172.21.15.17:0/2265600122 >> 172.21.15.17:0/2265600122 conn(0x7fa7740758a0 msgr2=0x7fa7740fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.685+0000 7fa779687640 1 -- 172.21.15.17:0/2265600122 shutdown_connections 2024-08-19T01:01:28.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.685+0000 7fa779687640 1 -- 172.21.15.17:0/2265600122 wait complete. 2024-08-19T01:01:28.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.686+0000 7fa779687640 1 Processor -- start 2024-08-19T01:01:28.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.686+0000 7fa779687640 1 -- start start 2024-08-19T01:01:28.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.686+0000 7fa779687640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7740fe9f0 0x7fa774196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:28.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.686+0000 7fa779687640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7741049f0 0x7fa774196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.686+0000 7fa779687640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa774197430 con 0x7fa7740fe9f0 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.686+0000 7fa779687640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7741975a0 con 0x7fa7741049f0 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.686+0000 7fa772ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7740fe9f0 0x7fa774196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.686+0000 7fa772ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7740fe9f0 0x7fa774196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39024/0 (socket says 172.21.15.17:39024) 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.686+0000 7fa772ffd640 1 -- 172.21.15.17:0/3897332264 learned_addr learned my addr 172.21.15.17:0/3897332264 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.686+0000 7fa7727fc640 1 --2- 172.21.15.17:0/3897332264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7741049f0 0x7fa774196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.687+0000 7fa772ffd640 1 -- 172.21.15.17:0/3897332264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7741049f0 msgr2=0x7fa774196e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.687+0000 7fa772ffd640 1 --2- 172.21.15.17:0/3897332264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7741049f0 0x7fa774196e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.687+0000 7fa772ffd640 1 -- 172.21.15.17:0/3897332264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768009560 con 0x7fa7740fe9f0 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.687+0000 7fa772ffd640 1 --2- 172.21.15.17:0/3897332264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7740fe9f0 0x7fa774196920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa76400d8d0 tx=0x7fa76400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.687+0000 7fa75bfff640 1 -- 172.21.15.17:0/3897332264 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76400bea0 con 0x7fa7740fe9f0 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.687+0000 7fa75bfff640 1 -- 172.21.15.17:0/3897332264 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa764009c00 con 0x7fa7740fe9f0 2024-08-19T01:01:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.687+0000 7fa779687640 1 -- 172.21.15.17:0/3897332264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77419f990 con 0x7fa7740fe9f0 2024-08-19T01:01:28.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.687+0000 7fa75bfff640 1 -- 172.21.15.17:0/3897332264 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76400f710 con 0x7fa7740fe9f0 2024-08-19T01:01:28.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.687+0000 7fa779687640 1 -- 172.21.15.17:0/3897332264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77419fda0 con 0x7fa7740fe9f0 2024-08-19T01:01:28.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.688+0000 7fa779687640 1 -- 172.21.15.17:0/3897332264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa774100130 con 0x7fa7740fe9f0 2024-08-19T01:01:28.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.689+0000 7fa75bfff640 1 -- 172.21.15.17:0/3897332264 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fa764010460 con 0x7fa7740fe9f0 2024-08-19T01:01:28.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.689+0000 7fa75bfff640 1 --2- 172.21.15.17:0/3897332264 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa75c06e2a0 0x7fa75c070760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:28.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.690+0000 7fa75bfff640 1 -- 172.21.15.17:0/3897332264 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa76408df90 con 0x7fa7740fe9f0 2024-08-19T01:01:28.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.690+0000 7fa7727fc640 1 --2- 172.21.15.17:0/3897332264 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa75c06e2a0 0x7fa75c070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:28.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.690+0000 7fa7727fc640 1 --2- 172.21.15.17:0/3897332264 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa75c06e2a0 0x7fa75c070760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa768009230 tx=0x7fa768005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:28.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.694+0000 7fa75bfff640 1 -- 172.21.15.17:0/3897332264 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa764057230 con 0x7fa7740fe9f0 2024-08-19T01:01:28.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.906+0000 7fa779687640 1 -- 172.21.15.17:0/3897332264 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa774068330 con 0x7fa75c06e2a0 2024-08-19T01:01:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.916+0000 7fa75bfff640 1 -- 172.21.15.17:0/3897332264 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa774068330 con 0x7fa75c06e2a0 2024-08-19T01:01:28.918 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:01:28.918 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (2m) 3s ago 13m 26.7M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:01:28.918 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (13m) 3s ago 13m 8442k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:01:28.918 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (12m) 23s ago 12m 8182k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (31s) 3s ago 13m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (26s) 23s ago 12m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (2m) 3s ago 13m 79.0M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (7m) 3s ago 7m 157M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (8m) 3s ago 8m 91.6M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (7m) 23s ago 7m 26.6M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (8m) 23s ago 7m 25.9M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (4m) 3s ago 14m 495M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (3m) 23s ago 12m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (92s) 3s ago 14m 42.7M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (71s) 23s ago 12m 36.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (3m) 3s ago 13m 15.2M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (3m) 23s ago 12m 15.5M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:01:28.919 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (8s) 3s ago 11m 12.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:01:28.920 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (11m) 3s ago 11m 229M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 d47fc8629124 2024-08-19T01:01:28.920 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (10m) 3s ago 10m 191M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T01:01:28.920 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (10m) 23s ago 10m 246M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T01:01:28.920 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (9m) 23s ago 9m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T01:01:28.920 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (9m) 23s ago 9m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T01:01:28.920 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (3m) 3s ago 12m 67.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:01:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.918+0000 7fa779687640 1 -- 172.21.15.17:0/3897332264 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa75c06e2a0 msgr2=0x7fa75c070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.918+0000 7fa779687640 1 --2- 172.21.15.17:0/3897332264 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa75c06e2a0 0x7fa75c070760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa768009230 tx=0x7fa768005a20 comp rx=0 tx=0).stop 2024-08-19T01:01:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.918+0000 7fa779687640 1 -- 172.21.15.17:0/3897332264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7740fe9f0 msgr2=0x7fa774196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.918+0000 7fa779687640 1 --2- 172.21.15.17:0/3897332264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7740fe9f0 0x7fa774196920 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa76400d8d0 tx=0x7fa76400dd90 comp rx=0 tx=0).stop 2024-08-19T01:01:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.918+0000 7fa779687640 1 -- 172.21.15.17:0/3897332264 shutdown_connections 2024-08-19T01:01:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.918+0000 7fa779687640 1 --2- 172.21.15.17:0/3897332264 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa75c06e2a0 0x7fa75c070760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.918+0000 7fa779687640 1 --2- 172.21.15.17:0/3897332264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7741049f0 0x7fa774196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.918+0000 7fa779687640 1 --2- 172.21.15.17:0/3897332264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7740fe9f0 0x7fa774196920 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.918+0000 7fa779687640 1 -- 172.21.15.17:0/3897332264 >> 172.21.15.17:0/3897332264 conn(0x7fa7740758a0 msgr2=0x7fa7740fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.918+0000 7fa779687640 1 -- 172.21.15.17:0/3897332264 shutdown_connections 2024-08-19T01:01:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:28.918+0000 7fa779687640 1 -- 172.21.15.17:0/3897332264 wait complete. 2024-08-19T01:01:29.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.005+0000 7fa37398f640 1 -- 172.21.15.17:0/3654820629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36c1015d0 msgr2=0x7fa36c109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.005+0000 7fa37398f640 1 --2- 172.21.15.17:0/3654820629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36c1015d0 0x7fa36c109ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009880 tx=0x7fa35c02a530 comp rx=0 tx=0).stop 2024-08-19T01:01:29.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.005+0000 7fa37398f640 1 -- 172.21.15.17:0/3654820629 shutdown_connections 2024-08-19T01:01:29.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.005+0000 7fa37398f640 1 --2- 172.21.15.17:0/3654820629 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36c1015d0 0x7fa36c109ac0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.005+0000 7fa37398f640 1 --2- 172.21.15.17:0/3654820629 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa36c100cb0 0x7fa36c101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.005+0000 7fa37398f640 1 -- 172.21.15.17:0/3654820629 >> 172.21.15.17:0/3654820629 conn(0x7fa36c0758a0 msgr2=0x7fa36c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:29.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.005+0000 7fa37398f640 1 -- 172.21.15.17:0/3654820629 shutdown_connections 2024-08-19T01:01:29.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.005+0000 7fa37398f640 1 -- 172.21.15.17:0/3654820629 wait complete. 2024-08-19T01:01:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa37398f640 1 Processor -- start 2024-08-19T01:01:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa37398f640 1 -- start start 2024-08-19T01:01:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa37398f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa36c100cb0 0x7fa36c0fe910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa37398f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36c1015d0 0x7fa36c0fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa37398f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c0ff390 con 0x7fa36c1015d0 2024-08-19T01:01:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa37398f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c0ff500 con 0x7fa36c100cb0 2024-08-19T01:01:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa370f2a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36c1015d0 0x7fa36c0fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa370f2a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36c1015d0 0x7fa36c0fee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39038/0 (socket says 172.21.15.17:39038) 2024-08-19T01:01:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa370f2a640 1 -- 172.21.15.17:0/4119255275 learned_addr learned my addr 172.21.15.17:0/4119255275 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:01:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa37172b640 1 --2- 172.21.15.17:0/4119255275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa36c100cb0 0x7fa36c0fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa370f2a640 1 -- 172.21.15.17:0/4119255275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa36c100cb0 msgr2=0x7fa36c0fe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa370f2a640 1 --2- 172.21.15.17:0/4119255275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa36c100cb0 0x7fa36c0fe910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.006+0000 7fa370f2a640 1 -- 172.21.15.17:0/4119255275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c009560 con 0x7fa36c1015d0 2024-08-19T01:01:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.007+0000 7fa370f2a640 1 --2- 172.21.15.17:0/4119255275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36c1015d0 0x7fa36c0fee50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa35c02aa50 tx=0x7fa35c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.007+0000 7fa3627fc640 1 -- 172.21.15.17:0/4119255275 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c004aa0 con 0x7fa36c1015d0 2024-08-19T01:01:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.007+0000 7fa37398f640 1 -- 172.21.15.17:0/4119255275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36c0ff780 con 0x7fa36c1015d0 2024-08-19T01:01:29.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.007+0000 7fa3627fc640 1 -- 172.21.15.17:0/4119255275 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa35c004c00 con 0x7fa36c1015d0 2024-08-19T01:01:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.007+0000 7fa3627fc640 1 -- 172.21.15.17:0/4119255275 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa35c0039b0 con 0x7fa36c1015d0 2024-08-19T01:01:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.007+0000 7fa37398f640 1 -- 172.21.15.17:0/4119255275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36c1a1f20 con 0x7fa36c1015d0 2024-08-19T01:01:29.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.008+0000 7fa37398f640 1 -- 172.21.15.17:0/4119255275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa36c068510 con 0x7fa36c1015d0 2024-08-19T01:01:29.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.009+0000 7fa3627fc640 1 -- 172.21.15.17:0/4119255275 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fa35c02ad50 con 0x7fa36c1015d0 2024-08-19T01:01:29.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.010+0000 7fa3627fc640 1 --2- 172.21.15.17:0/4119255275 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa35806e2b0 0x7fa358070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.010+0000 7fa3627fc640 1 -- 172.21.15.17:0/4119255275 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa35c0af030 con 0x7fa36c1015d0 2024-08-19T01:01:29.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.010+0000 7fa37172b640 1 --2- 172.21.15.17:0/4119255275 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa35806e2b0 0x7fa358070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.011+0000 7fa37172b640 1 --2- 172.21.15.17:0/4119255275 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa35806e2b0 0x7fa358070770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa3680058c0 tx=0x7fa36800a4c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:29.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.014+0000 7fa3627fc640 1 -- 172.21.15.17:0/4119255275 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa35c0781a0 con 0x7fa36c1015d0 2024-08-19T01:01:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:28 smithi086 ceph-mon[71303]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:01:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:28 smithi086 ceph-mon[71303]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:01:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:28 smithi086 ceph-mon[71303]: pgmap v51: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 8/321 objects degraded (2.492%) 2024-08-19T01:01:29.243 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:28 smithi017 ceph-mon[99370]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:01:29.243 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:28 smithi017 ceph-mon[99370]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:01:29.243 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:28 smithi017 ceph-mon[99370]: pgmap v51: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 8/321 objects degraded (2.492%) 2024-08-19T01:01:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.263+0000 7fa37398f640 1 -- 172.21.15.17:0/4119255275 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa36c101090 con 0x7fa36c1015d0 2024-08-19T01:01:29.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.263+0000 7fa3627fc640 1 -- 172.21.15.17:0/4119255275 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+829 (secure 0 0 0) 0x7fa35c07b860 con 0x7fa36c1015d0 2024-08-19T01:01:29.265 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:01:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:01:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:01:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:01:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:01:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:01:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:01:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:01:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 5, 2024-08-19T01:01:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-19T01:01:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:01:29.266 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:01:29.267 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T01:01:29.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:01:29.267 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:01:29.267 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 9, 2024-08-19T01:01:29.267 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 5 2024-08-19T01:01:29.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:01:29.267 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:01:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.266+0000 7fa37398f640 1 -- 172.21.15.17:0/4119255275 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa35806e2b0 msgr2=0x7fa358070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.266+0000 7fa37398f640 1 --2- 172.21.15.17:0/4119255275 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa35806e2b0 0x7fa358070770 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa3680058c0 tx=0x7fa36800a4c0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.266+0000 7fa37398f640 1 -- 172.21.15.17:0/4119255275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36c1015d0 msgr2=0x7fa36c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.266+0000 7fa37398f640 1 --2- 172.21.15.17:0/4119255275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36c1015d0 0x7fa36c0fee50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa35c02aa50 tx=0x7fa35c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.266+0000 7fa37398f640 1 -- 172.21.15.17:0/4119255275 shutdown_connections 2024-08-19T01:01:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.266+0000 7fa37398f640 1 --2- 172.21.15.17:0/4119255275 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa35806e2b0 0x7fa358070770 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.266+0000 7fa37398f640 1 --2- 172.21.15.17:0/4119255275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa36c1015d0 0x7fa36c0fee50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.266+0000 7fa37398f640 1 --2- 172.21.15.17:0/4119255275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa36c100cb0 0x7fa36c0fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.266+0000 7fa37398f640 1 -- 172.21.15.17:0/4119255275 >> 172.21.15.17:0/4119255275 conn(0x7fa36c0758a0 msgr2=0x7fa36c101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:29.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.266+0000 7fa37398f640 1 -- 172.21.15.17:0/4119255275 shutdown_connections 2024-08-19T01:01:29.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.266+0000 7fa37398f640 1 -- 172.21.15.17:0/4119255275 wait complete. 2024-08-19T01:01:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.351+0000 7f24f8497640 1 -- 172.21.15.17:0/1091591773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f00fea30 msgr2=0x7f24f00fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.351+0000 7f24f8497640 1 --2- 172.21.15.17:0/1091591773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f00fea30 0x7f24f00fee90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f24e0009880 tx=0x7f24e002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.351+0000 7f24f8497640 1 -- 172.21.15.17:0/1091591773 shutdown_connections 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.351+0000 7f24f8497640 1 --2- 172.21.15.17:0/1091591773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f00fea30 0x7f24f00fee90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.351+0000 7f24f8497640 1 --2- 172.21.15.17:0/1091591773 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24f0104a30 0x7f24f0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.351+0000 7f24f8497640 1 -- 172.21.15.17:0/1091591773 >> 172.21.15.17:0/1091591773 conn(0x7f24f00fa730 msgr2=0x7f24f00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.351+0000 7f24f8497640 1 -- 172.21.15.17:0/1091591773 shutdown_connections 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.351+0000 7f24f8497640 1 -- 172.21.15.17:0/1091591773 wait complete. 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.352+0000 7f24f8497640 1 Processor -- start 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.352+0000 7f24f8497640 1 -- start start 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.352+0000 7f24f8497640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24f00fea30 0x7f24f019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.352+0000 7f24f8497640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f0104a30 0x7f24f019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.352+0000 7f24f8497640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f019c360 con 0x7f24f0104a30 2024-08-19T01:01:29.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.352+0000 7f24f8497640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f01958f0 con 0x7f24f00fea30 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.352+0000 7f24f5a32640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f0104a30 0x7f24f019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.352+0000 7f24f5a32640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f0104a30 0x7f24f019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39056/0 (socket says 172.21.15.17:39056) 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.352+0000 7f24f5a32640 1 -- 172.21.15.17:0/1188050876 learned_addr learned my addr 172.21.15.17:0/1188050876 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.353+0000 7f24f6233640 1 --2- 172.21.15.17:0/1188050876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24f00fea30 0x7f24f019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.353+0000 7f24f5a32640 1 -- 172.21.15.17:0/1188050876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24f00fea30 msgr2=0x7f24f019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.353+0000 7f24f5a32640 1 --2- 172.21.15.17:0/1188050876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24f00fea30 0x7f24f019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.353+0000 7f24f5a32640 1 -- 172.21.15.17:0/1188050876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e0009560 con 0x7f24f0104a30 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.353+0000 7f24f5a32640 1 --2- 172.21.15.17:0/1188050876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f0104a30 0x7f24f019bd40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f24e002a9c0 tx=0x7f24e00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.353+0000 7f24e77fe640 1 -- 172.21.15.17:0/1188050876 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e0004aa0 con 0x7f24f0104a30 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.353+0000 7f24e77fe640 1 -- 172.21.15.17:0/1188050876 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f24e0004c00 con 0x7f24f0104a30 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.353+0000 7f24e77fe640 1 -- 172.21.15.17:0/1188050876 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24e0003980 con 0x7f24f0104a30 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.353+0000 7f24f8497640 1 -- 172.21.15.17:0/1188050876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f0195b70 con 0x7f24f0104a30 2024-08-19T01:01:29.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.353+0000 7f24f8497640 1 -- 172.21.15.17:0/1188050876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f0196060 con 0x7f24f0104a30 2024-08-19T01:01:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.354+0000 7f24f8497640 1 -- 172.21.15.17:0/1188050876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f0100170 con 0x7f24f0104a30 2024-08-19T01:01:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.355+0000 7f24e77fe640 1 -- 172.21.15.17:0/1188050876 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f24e0003b00 con 0x7f24f0104a30 2024-08-19T01:01:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.355+0000 7f24e77fe640 1 --2- 172.21.15.17:0/1188050876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f24dc06e2b0 0x7f24dc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.356+0000 7f24e77fe640 1 -- 172.21.15.17:0/1188050876 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f24e00af290 con 0x7f24f0104a30 2024-08-19T01:01:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.356+0000 7f24f6233640 1 --2- 172.21.15.17:0/1188050876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f24dc06e2b0 0x7f24dc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.356+0000 7f24f6233640 1 --2- 172.21.15.17:0/1188050876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f24dc06e2b0 0x7f24dc070770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00bbe0 tx=0x7f24ec00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:29.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.360+0000 7f24e77fe640 1 -- 172.21.15.17:0/1188050876 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f24e0078530 con 0x7f24f0104a30 2024-08-19T01:01:29.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.581+0000 7f24f8497640 1 -- 172.21.15.17:0/1188050876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f24f00fee90 con 0x7f24f0104a30 2024-08-19T01:01:29.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.582+0000 7f24e77fe640 1 -- 172.21.15.17:0/1188050876 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1933 (secure 0 0 0) 0x7f24e007bbf0 con 0x7f24f0104a30 2024-08-19T01:01:29.584 INFO:teuthology.orchestra.run.smithi017.stdout:e21 2024-08-19T01:01:29.584 INFO:teuthology.orchestra.run.smithi017.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-19T01:01:29.584 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:01:29.584 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:01:29.584 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 21 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T00:53:41.004049+0000 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:01:29.585 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 46 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14486,1=24299} 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:01:29.586 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:01:29.587 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:01:29.587 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:01:29.587 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:01:29.587 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:01:29.587 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:01:29.587 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:01:29.587 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:01:29.587 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:01:29.587 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:01:29.587 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:01:29.587 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:01:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T01:01:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.584+0000 7f24f8497640 1 -- 172.21.15.17:0/1188050876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f24dc06e2b0 msgr2=0x7f24dc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.584+0000 7f24f8497640 1 --2- 172.21.15.17:0/1188050876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f24dc06e2b0 0x7f24dc070770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00bbe0 tx=0x7f24ec00b390 comp rx=0 tx=0).stop 2024-08-19T01:01:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.584+0000 7f24f8497640 1 -- 172.21.15.17:0/1188050876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f0104a30 msgr2=0x7f24f019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.584+0000 7f24f8497640 1 --2- 172.21.15.17:0/1188050876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f0104a30 0x7f24f019bd40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f24e002a9c0 tx=0x7f24e00055a0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.584+0000 7f24f8497640 1 -- 172.21.15.17:0/1188050876 shutdown_connections 2024-08-19T01:01:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.584+0000 7f24f8497640 1 --2- 172.21.15.17:0/1188050876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f24dc06e2b0 0x7f24dc070770 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.584+0000 7f24f8497640 1 --2- 172.21.15.17:0/1188050876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24f0104a30 0x7f24f019bd40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.584+0000 7f24f8497640 1 --2- 172.21.15.17:0/1188050876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f24f00fea30 0x7f24f019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.584+0000 7f24f8497640 1 -- 172.21.15.17:0/1188050876 >> 172.21.15.17:0/1188050876 conn(0x7f24f00fa730 msgr2=0x7f24f0068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.584+0000 7f24f8497640 1 -- 172.21.15.17:0/1188050876 shutdown_connections 2024-08-19T01:01:29.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.584+0000 7f24f8497640 1 -- 172.21.15.17:0/1188050876 wait complete. 2024-08-19T01:01:29.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.668+0000 7fe4f482d640 1 -- 172.21.15.17:0/374834043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f00fe9f0 msgr2=0x7fe4f00fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.668+0000 7fe4f482d640 1 --2- 172.21.15.17:0/374834043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f00fe9f0 0x7fe4f00fee50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009880 tx=0x7fe4e402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.668+0000 7fe4f482d640 1 -- 172.21.15.17:0/374834043 shutdown_connections 2024-08-19T01:01:29.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.668+0000 7fe4f482d640 1 --2- 172.21.15.17:0/374834043 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f00fe9f0 0x7fe4f00fee50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.668+0000 7fe4f482d640 1 --2- 172.21.15.17:0/374834043 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f01049f0 0x7fe4f0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.668+0000 7fe4f482d640 1 -- 172.21.15.17:0/374834043 >> 172.21.15.17:0/374834043 conn(0x7fe4f00758a0 msgr2=0x7fe4f00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:29.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.668+0000 7fe4f482d640 1 -- 172.21.15.17:0/374834043 shutdown_connections 2024-08-19T01:01:29.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.669+0000 7fe4f482d640 1 -- 172.21.15.17:0/374834043 wait complete. 2024-08-19T01:01:29.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.669+0000 7fe4f482d640 1 Processor -- start 2024-08-19T01:01:29.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.669+0000 7fe4f482d640 1 -- start start 2024-08-19T01:01:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.669+0000 7fe4f482d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f00fe9f0 0x7fe4f0194770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4f482d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f01049f0 0x7fe4f0194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4f482d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f01951f0 con 0x7fe4f01049f0 2024-08-19T01:01:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4f482d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0195360 con 0x7fe4f00fe9f0 2024-08-19T01:01:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4edd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f01049f0 0x7fe4f0194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4edd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f01049f0 0x7fe4f0194cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39072/0 (socket says 172.21.15.17:39072) 2024-08-19T01:01:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4edd9b640 1 -- 172.21.15.17:0/2833543031 learned_addr learned my addr 172.21.15.17:0/2833543031 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:01:29.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4ee59c640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f00fe9f0 0x7fe4f0194770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4edd9b640 1 -- 172.21.15.17:0/2833543031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f00fe9f0 msgr2=0x7fe4f0194770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4edd9b640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f00fe9f0 0x7fe4f0194770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4edd9b640 1 -- 172.21.15.17:0/2833543031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4009560 con 0x7fe4f01049f0 2024-08-19T01:01:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4ee59c640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f00fe9f0 0x7fe4f0194770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:01:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4edd9b640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f01049f0 0x7fe4f0194cb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4e402a9c0 tx=0x7fe4e40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4df7fe640 1 -- 172.21.15.17:0/2833543031 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e40048d0 con 0x7fe4f01049f0 2024-08-19T01:01:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4f482d640 1 -- 172.21.15.17:0/2833543031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f01955e0 con 0x7fe4f01049f0 2024-08-19T01:01:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4df7fe640 1 -- 172.21.15.17:0/2833543031 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4e4031640 con 0x7fe4f01049f0 2024-08-19T01:01:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4df7fe640 1 -- 172.21.15.17:0/2833543031 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4e40038d0 con 0x7fe4f01049f0 2024-08-19T01:01:29.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.670+0000 7fe4f482d640 1 -- 172.21.15.17:0/2833543031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f01a2000 con 0x7fe4f01049f0 2024-08-19T01:01:29.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.671+0000 7fe4f482d640 1 -- 172.21.15.17:0/2833543031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f0100130 con 0x7fe4f01049f0 2024-08-19T01:01:29.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.672+0000 7fe4df7fe640 1 -- 172.21.15.17:0/2833543031 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fe4e4003b90 con 0x7fe4f01049f0 2024-08-19T01:01:29.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.672+0000 7fe4df7fe640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe4d806e2b0 0x7fe4d8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.672+0000 7fe4df7fe640 1 -- 172.21.15.17:0/2833543031 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe4e40af1c0 con 0x7fe4f01049f0 2024-08-19T01:01:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.672+0000 7fe4ee59c640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe4d806e2b0 0x7fe4d8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.673+0000 7fe4ee59c640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe4d806e2b0 0x7fe4d8070770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009c20 tx=0x7fe4e0005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:29.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.677+0000 7fe4df7fe640 1 -- 172.21.15.17:0/2833543031 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe4e4078330 con 0x7fe4f01049f0 2024-08-19T01:01:29.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.870+0000 7fe4f482d640 1 -- 172.21.15.17:0/2833543031 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4f0103fc0 con 0x7fe4d806e2b0 2024-08-19T01:01:29.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.871+0000 7fe4df7fe640 1 -- 172.21.15.17:0/2833543031 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe4f0103fc0 con 0x7fe4d806e2b0 2024-08-19T01:01:29.873 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:01:29.873 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:01:29.873 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:01:29.873 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:01:29.874 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:01:29.874 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:01:29.874 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:01:29.874 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:01:29.874 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:01:29.874 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "7/23 daemons upgraded", 2024-08-19T01:01:29.874 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-08-19T01:01:29.874 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:01:29.874 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:01:29.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.873+0000 7fe4f482d640 1 -- 172.21.15.17:0/2833543031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe4d806e2b0 msgr2=0x7fe4d8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.873+0000 7fe4f482d640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe4d806e2b0 0x7fe4d8070770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009c20 tx=0x7fe4e0005f90 comp rx=0 tx=0).stop 2024-08-19T01:01:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.873+0000 7fe4f482d640 1 -- 172.21.15.17:0/2833543031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f01049f0 msgr2=0x7fe4f0194cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.873+0000 7fe4f482d640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f01049f0 0x7fe4f0194cb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe4e402a9c0 tx=0x7fe4e40055a0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.873+0000 7fe4f482d640 1 -- 172.21.15.17:0/2833543031 shutdown_connections 2024-08-19T01:01:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.873+0000 7fe4f482d640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe4d806e2b0 0x7fe4d8070770 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.873+0000 7fe4f482d640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4f01049f0 0x7fe4f0194cb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.873+0000 7fe4f482d640 1 --2- 172.21.15.17:0/2833543031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe4f00fe9f0 0x7fe4f0194770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.873+0000 7fe4f482d640 1 -- 172.21.15.17:0/2833543031 >> 172.21.15.17:0/2833543031 conn(0x7fe4f00758a0 msgr2=0x7fe4f00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.873+0000 7fe4f482d640 1 -- 172.21.15.17:0/2833543031 shutdown_connections 2024-08-19T01:01:29.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.873+0000 7fe4f482d640 1 -- 172.21.15.17:0/2833543031 wait complete. 2024-08-19T01:01:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.956+0000 7f9d656f4640 1 -- 172.21.15.17:0/518322486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d601016b0 msgr2=0x7f9d60109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.956+0000 7f9d656f4640 1 --2- 172.21.15.17:0/518322486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d601016b0 0x7f9d60109ba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009880 tx=0x7f9d5402a530 comp rx=0 tx=0).stop 2024-08-19T01:01:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.956+0000 7f9d656f4640 1 -- 172.21.15.17:0/518322486 shutdown_connections 2024-08-19T01:01:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.956+0000 7f9d656f4640 1 --2- 172.21.15.17:0/518322486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d601016b0 0x7f9d60109ba0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.956+0000 7f9d656f4640 1 --2- 172.21.15.17:0/518322486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d60100d90 0x7f9d60101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.956+0000 7f9d656f4640 1 -- 172.21.15.17:0/518322486 >> 172.21.15.17:0/518322486 conn(0x7f9d600fa710 msgr2=0x7f9d600fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.956+0000 7f9d656f4640 1 -- 172.21.15.17:0/518322486 shutdown_connections 2024-08-19T01:01:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.956+0000 7f9d656f4640 1 -- 172.21.15.17:0/518322486 wait complete. 2024-08-19T01:01:29.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.957+0000 7f9d656f4640 1 Processor -- start 2024-08-19T01:01:29.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.957+0000 7f9d656f4640 1 -- start start 2024-08-19T01:01:29.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.957+0000 7f9d656f4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d60100d90 0x7f9d6019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.957+0000 7f9d656f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d601016b0 0x7f9d6019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.957+0000 7f9d656f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6019c430 con 0x7f9d601016b0 2024-08-19T01:01:29.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.957+0000 7f9d656f4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d601959c0 con 0x7f9d60100d90 2024-08-19T01:01:29.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.957+0000 7f9d5e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d601016b0 0x7f9d6019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.957+0000 7f9d5e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d601016b0 0x7f9d6019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39090/0 (socket says 172.21.15.17:39090) 2024-08-19T01:01:29.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.957+0000 7f9d5e7fc640 1 -- 172.21.15.17:0/2602946494 learned_addr learned my addr 172.21.15.17:0/2602946494 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:01:29.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.958+0000 7f9d5effd640 1 --2- 172.21.15.17:0/2602946494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d60100d90 0x7f9d6019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.958+0000 7f9d5e7fc640 1 -- 172.21.15.17:0/2602946494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d60100d90 msgr2=0x7f9d6019b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:29.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.958+0000 7f9d5e7fc640 1 --2- 172.21.15.17:0/2602946494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d60100d90 0x7f9d6019b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:29.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.958+0000 7f9d5e7fc640 1 -- 172.21.15.17:0/2602946494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54009560 con 0x7f9d601016b0 2024-08-19T01:01:29.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.958+0000 7f9d5e7fc640 1 --2- 172.21.15.17:0/2602946494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d601016b0 0x7f9d6019be10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d5402aa50 tx=0x7f9d54032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:29.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.958+0000 7f9d47fff640 1 -- 172.21.15.17:0/2602946494 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d54005220 con 0x7f9d601016b0 2024-08-19T01:01:29.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.958+0000 7f9d656f4640 1 -- 172.21.15.17:0/2602946494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d60195c40 con 0x7f9d601016b0 2024-08-19T01:01:29.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.958+0000 7f9d47fff640 1 -- 172.21.15.17:0/2602946494 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d54005d50 con 0x7f9d601016b0 2024-08-19T01:01:29.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.958+0000 7f9d47fff640 1 -- 172.21.15.17:0/2602946494 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d54003940 con 0x7f9d601016b0 2024-08-19T01:01:29.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.958+0000 7f9d656f4640 1 -- 172.21.15.17:0/2602946494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d60196130 con 0x7f9d601016b0 2024-08-19T01:01:29.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.959+0000 7f9d656f4640 1 -- 172.21.15.17:0/2602946494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d60068c90 con 0x7f9d601016b0 2024-08-19T01:01:29.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.960+0000 7f9d47fff640 1 -- 172.21.15.17:0/2602946494 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 38) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f9d5402ad50 con 0x7f9d601016b0 2024-08-19T01:01:29.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.960+0000 7f9d47fff640 1 --2- 172.21.15.17:0/2602946494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4806e2b0 0x7f9d48070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:01:29.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.960+0000 7f9d47fff640 1 -- 172.21.15.17:0/2602946494 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9d540aebf0 con 0x7f9d601016b0 2024-08-19T01:01:29.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.960+0000 7f9d5effd640 1 --2- 172.21.15.17:0/2602946494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4806e2b0 0x7f9d48070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:01:29.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.961+0000 7f9d5effd640 1 --2- 172.21.15.17:0/2602946494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4806e2b0 0x7f9d48070770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009bd0 tx=0x7f9d50005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:01:29.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:29.965+0000 7f9d47fff640 1 -- 172.21.15.17:0/2602946494 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9d54077e10 con 0x7f9d601016b0 2024-08-19T01:01:30.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:29 smithi017 ceph-mon[99370]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:01:30.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:29 smithi017 ceph-mon[99370]: Health check update: Degraded data redundancy: 8/321 objects degraded (2.492%), 3 pgs degraded (PG_DEGRADED) 2024-08-19T01:01:30.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:29 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4119255275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:30.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:29 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1188050876' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:01:30.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:29 smithi086 ceph-mon[71303]: from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:01:30.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:29 smithi086 ceph-mon[71303]: Health check update: Degraded data redundancy: 8/321 objects degraded (2.492%), 3 pgs degraded (PG_DEGRADED) 2024-08-19T01:01:30.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:29 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4119255275' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:30.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:29 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1188050876' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:01:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.214+0000 7f9d656f4640 1 -- 172.21.15.17:0/2602946494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9d60101170 con 0x7f9d601016b0 2024-08-19T01:01:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.215+0000 7f9d47fff640 1 -- 172.21.15.17:0/2602946494 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+537 (secure 0 0 0) 0x7f9d5407b4d0 con 0x7f9d601016b0 2024-08-19T01:01:30.217 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 8/321 objects degraded (2.492%), 3 pgs degraded 2024-08-19T01:01:30.217 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:01:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:01:30.217 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 8/321 objects degraded (2.492%), 3 pgs degraded 2024-08-19T01:01:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-08-19T01:01:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-08-19T01:01:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-08-19T01:01:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.217+0000 7f9d656f4640 1 -- 172.21.15.17:0/2602946494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4806e2b0 msgr2=0x7f9d48070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.217+0000 7f9d656f4640 1 --2- 172.21.15.17:0/2602946494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4806e2b0 0x7f9d48070770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009bd0 tx=0x7f9d50005f90 comp rx=0 tx=0).stop 2024-08-19T01:01:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.217+0000 7f9d656f4640 1 -- 172.21.15.17:0/2602946494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d601016b0 msgr2=0x7f9d6019be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:01:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.217+0000 7f9d656f4640 1 --2- 172.21.15.17:0/2602946494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d601016b0 0x7f9d6019be10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9d5402aa50 tx=0x7f9d54032bb0 comp rx=0 tx=0).stop 2024-08-19T01:01:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.217+0000 7f9d656f4640 1 -- 172.21.15.17:0/2602946494 shutdown_connections 2024-08-19T01:01:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.217+0000 7f9d656f4640 1 --2- 172.21.15.17:0/2602946494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4806e2b0 0x7f9d48070770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.217+0000 7f9d656f4640 1 --2- 172.21.15.17:0/2602946494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d601016b0 0x7f9d6019be10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.217+0000 7f9d656f4640 1 --2- 172.21.15.17:0/2602946494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d60100d90 0x7f9d6019b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:01:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.217+0000 7f9d656f4640 1 -- 172.21.15.17:0/2602946494 >> 172.21.15.17:0/2602946494 conn(0x7f9d600fa710 msgr2=0x7f9d60101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:01:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.217+0000 7f9d656f4640 1 -- 172.21.15.17:0/2602946494 shutdown_connections 2024-08-19T01:01:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:01:30.217+0000 7f9d656f4640 1 -- 172.21.15.17:0/2602946494 wait complete. 2024-08-19T01:01:31.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:01:31.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:31.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:31.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:01:31.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:01:31.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:31.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:01:31.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:31.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:31.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:31.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-19T01:01:31.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-19T01:01:31.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-08-19T01:01:31.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2602946494' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:01:31.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:31 smithi017 ceph-mon[99370]: pgmap v52: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 8/321 objects degraded (2.492%) 2024-08-19T01:01:31.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:01:31.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:31.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:31.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:01:31.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:01:31.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:31.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:01:31.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:31.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:31.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:01:31.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-19T01:01:31.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-19T01:01:31.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-08-19T01:01:31.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2602946494' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:01:31.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:31 smithi086 ceph-mon[71303]: pgmap v52: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 8/321 objects degraded (2.492%) 2024-08-19T01:01:33.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:32 smithi017 ceph-mon[99370]: pgmap v53: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-19T01:01:33.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:32 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:33.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:32 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:01:33.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:32 smithi086 ceph-mon[71303]: pgmap v53: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-08-19T01:01:33.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:32 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:33.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:32 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:01:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:33 smithi017 ceph-mon[99370]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/321 objects degraded (2.492%), 3 pgs degraded) 2024-08-19T01:01:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:33 smithi086 ceph-mon[71303]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/321 objects degraded (2.492%), 3 pgs degraded) 2024-08-19T01:01:36.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:35 smithi017 ceph-mon[99370]: pgmap v54: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 383 B/s wr, 4 op/s 2024-08-19T01:01:36.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:35 smithi017 ceph-mon[99370]: mgrmap e39: smithi017.hfpawi(active, since 92s), standbys: smithi086.uthxct 2024-08-19T01:01:36.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:35 smithi086 ceph-mon[71303]: pgmap v54: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 383 B/s wr, 4 op/s 2024-08-19T01:01:36.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:35 smithi086 ceph-mon[71303]: mgrmap e39: smithi017.hfpawi(active, since 92s), standbys: smithi086.uthxct 2024-08-19T01:01:38.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:37 smithi086 ceph-mon[71303]: pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 309 B/s wr, 3 op/s 2024-08-19T01:01:38.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:38.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:37 smithi017 ceph-mon[99370]: pgmap v55: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 309 B/s wr, 3 op/s 2024-08-19T01:01:38.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:40.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:39 smithi086 ceph-mon[71303]: pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 280 B/s wr, 5 op/s 2024-08-19T01:01:40.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:39 smithi017 ceph-mon[99370]: pgmap v56: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 280 B/s wr, 5 op/s 2024-08-19T01:01:42.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:41 smithi086 ceph-mon[71303]: pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-19T01:01:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:41 smithi017 ceph-mon[99370]: pgmap v57: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-19T01:01:44.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:43 smithi086 ceph-mon[71303]: pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-19T01:01:44.215 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:43 smithi017 ceph-mon[99370]: pgmap v58: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 3 op/s 2024-08-19T01:01:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:45 smithi017 ceph-mon[99370]: pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-19T01:01:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-19T01:01:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:45 smithi017 ceph-mon[99370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-19T01:01:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:45 smithi017 ceph-mon[99370]: Upgrade: osd.1 is safe to restart 2024-08-19T01:01:46.288 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:45 smithi086 ceph-mon[71303]: pgmap v59: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-19T01:01:46.288 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-19T01:01:46.288 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:45 smithi086 ceph-mon[71303]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-08-19T01:01:46.288 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:45 smithi086 ceph-mon[71303]: Upgrade: osd.1 is safe to restart 2024-08-19T01:01:47.916 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:47 smithi017 ceph-mon[99370]: Upgrade: Updating osd.1 2024-08-19T01:01:47.916 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:47 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:47.916 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:47 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-19T01:01:47.916 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:47 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:01:47.917 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:47 smithi017 ceph-mon[99370]: Deploying daemon osd.1 on smithi017 2024-08-19T01:01:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:47 smithi086 ceph-mon[71303]: Upgrade: Updating osd.1 2024-08-19T01:01:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:47 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:47 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-19T01:01:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:47 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:01:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:47 smithi086 ceph-mon[71303]: Deploying daemon osd.1 on smithi017 2024-08-19T01:01:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:48 smithi017 ceph-mon[99370]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:01:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:48 smithi086 ceph-mon[71303]: pgmap v60: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:01:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:01:49.988 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:49 smithi017 systemd[1]: Stopping Ceph osd.1 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:01:50.433 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:49 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1[41984]: 2024-08-19T01:01:49.985+0000 7f4edc9c6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:01:50.433 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:49 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1[41984]: 2024-08-19T01:01:49.985+0000 7f4edc9c6640 -1 osd.1 54 *** Got signal Terminated *** 2024-08-19T01:01:50.433 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:49 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1[41984]: 2024-08-19T01:01:49.985+0000 7f4edc9c6640 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:01:51.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:50 smithi017 ceph-mon[99370]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:01:51.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:50 smithi017 ceph-mon[99370]: osd.1 marked itself down and dead 2024-08-19T01:01:51.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:50 smithi086 ceph-mon[71303]: pgmap v61: 65 pgs: 65 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:01:51.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:50 smithi086 ceph-mon[71303]: osd.1 marked itself down and dead 2024-08-19T01:01:51.572 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:51 smithi017 podman[115316]: 2024-08-19 01:01:51.261838226 +0000 UTC m=+1.401130208 container died d47fc862912450fe5157d4e9b4f7f0d33a737f0a803142cc08f114f2e5ae766d (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1, maintainer=Guillaume Abrioux , RELEASE=reef-baa926d, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:01:51.905 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:51 smithi017 ceph-mon[99370]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:01:51.905 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:51 smithi017 ceph-mon[99370]: osdmap e55: 6 total, 5 up, 6 in 2024-08-19T01:01:51.905 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:51 smithi017 ceph-mon[99370]: osdmap e56: 6 total, 5 up, 6 in 2024-08-19T01:01:51.905 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:51 smithi017 podman[115316]: 2024-08-19 01:01:51.668783029 +0000 UTC m=+1.808075010 container cleanup d47fc862912450fe5157d4e9b4f7f0d33a737f0a803142cc08f114f2e5ae766d (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=reef-baa926d, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-19T01:01:51.905 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:51 smithi017 bash[115316]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1 2024-08-19T01:01:52.183 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:51 smithi017 podman[115330]: 2024-08-19 01:01:51.903752235 +0000 UTC m=+0.632134345 container remove d47fc862912450fe5157d4e9b4f7f0d33a737f0a803142cc08f114f2e5ae766d (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1, RELEASE=reef-baa926d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-19T01:01:52.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:51 smithi086 ceph-mon[71303]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:01:52.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:51 smithi086 ceph-mon[71303]: osdmap e55: 6 total, 5 up, 6 in 2024-08-19T01:01:52.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:51 smithi086 ceph-mon[71303]: osdmap e56: 6 total, 5 up, 6 in 2024-08-19T01:01:52.504 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:52 smithi017 podman[115420]: 2024-08-19 01:01:52.15539196 +0000 UTC m=+0.017567118 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:01:52.504 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:52 smithi017 podman[115420]: 2024-08-19 01:01:52.254726064 +0000 UTC m=+0.116901222 container create 0bab27aa82d3e970043d4bdf452ae52e36d8da785858da240b392955968d78d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:01:52.504 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:52 smithi017 podman[115420]: 2024-08-19 01:01:52.499590565 +0000 UTC m=+0.361765736 container init 0bab27aa82d3e970043d4bdf452ae52e36d8da785858da240b392955968d78d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-19T01:01:52.504 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:52 smithi017 podman[115420]: 2024-08-19 01:01:52.503136259 +0000 UTC m=+0.365311418 container start 0bab27aa82d3e970043d4bdf452ae52e36d8da785858da240b392955968d78d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T01:01:52.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:52 smithi017 ceph-mon[99370]: pgmap v63: 65 pgs: 12 stale+active+clean, 53 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:01:52.934 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:52 smithi017 podman[115420]: 2024-08-19 01:01:52.582541511 +0000 UTC m=+0.444716678 container attach 0bab27aa82d3e970043d4bdf452ae52e36d8da785858da240b392955968d78d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:01:52.934 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:52 smithi017 podman[115420]: 2024-08-19 01:01:52.693185498 +0000 UTC m=+0.555360657 container died 0bab27aa82d3e970043d4bdf452ae52e36d8da785858da240b392955968d78d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:01:53.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:52 smithi086 ceph-mon[71303]: pgmap v63: 65 pgs: 12 stale+active+clean, 53 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:01:53.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:53 smithi017 podman[115443]: 2024-08-19 01:01:53.261491475 +0000 UTC m=+0.561952110 container remove 0bab27aa82d3e970043d4bdf452ae52e36d8da785858da240b392955968d78d1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-19T01:01:53.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:53 smithi017 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.1.service: Deactivated successfully. 2024-08-19T01:01:53.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:53 smithi017 systemd[1]: Stopped Ceph osd.1 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:01:53.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:53 smithi017 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.1.service: Consumed 1min 1.217s CPU time. 2024-08-19T01:01:53.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:53 smithi017 systemd[1]: Starting Ceph osd.1 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:01:54.009 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:53 smithi017 ceph-mon[99370]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-08-19T01:01:54.009 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:53 smithi017 podman[115544]: 2024-08-19 01:01:53.617263091 +0000 UTC m=+0.017596104 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:01:54.009 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:53 smithi017 podman[115544]: 2024-08-19 01:01:53.738011097 +0000 UTC m=+0.138344102 container create 6eaba37ca8189c323f1172e710c910335673f0b8a705f3a75284a7d7ca647140 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:01:54.010 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 podman[115544]: 2024-08-19 01:01:54.008164779 +0000 UTC m=+0.408497798 container init 6eaba37ca8189c323f1172e710c910335673f0b8a705f3a75284a7d7ca647140 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-19T01:01:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:53 smithi086 ceph-mon[71303]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-08-19T01:01:54.278 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 podman[115544]: 2024-08-19 01:01:54.012024732 +0000 UTC m=+0.412357740 container start 6eaba37ca8189c323f1172e710c910335673f0b8a705f3a75284a7d7ca647140 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-19T01:01:54.278 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 podman[115544]: 2024-08-19 01:01:54.090936733 +0000 UTC m=+0.491269750 container attach 6eaba37ca8189c323f1172e710c910335673f0b8a705f3a75284a7d7ca647140 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-08-19T01:01:54.278 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:54.278 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:54.278 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:54.278 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:54.278 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:01:54.278 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:01:54.278 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:54.279 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:54.279 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:54.279 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:01:54.279 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-19T01:01:54.279 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-19T01:01:54.279 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-08-19T01:01:54.279 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-08-19T01:01:54.279 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-08-19T01:01:54.279 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-08-19T01:01:54.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-08-19T01:01:54.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-08-19T01:01:54.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-19T01:01:54.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-19T01:01:54.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-19T01:01:54.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-19T01:01:54.684 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate[115558]: --> ceph-volume lvm activate successful for osd ID: 1 2024-08-19T01:01:54.684 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 bash[115544]: --> ceph-volume lvm activate successful for osd ID: 1 2024-08-19T01:01:54.684 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 podman[115544]: 2024-08-19 01:01:54.302486145 +0000 UTC m=+0.702819150 container died 6eaba37ca8189c323f1172e710c910335673f0b8a705f3a75284a7d7ca647140 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_CLEAN=True) 2024-08-19T01:01:55.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:54 smithi017 ceph-mon[99370]: pgmap v65: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-19T01:01:55.061 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:54 smithi017 podman[115675]: 2024-08-19 01:01:54.961934173 +0000 UTC m=+0.653107761 container remove 6eaba37ca8189c323f1172e710c910335673f0b8a705f3a75284a7d7ca647140 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-activate, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:01:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:54 smithi086 ceph-mon[71303]: pgmap v65: 65 pgs: 5 peering, 9 stale+active+clean, 51 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-08-19T01:01:55.391 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:55 smithi017 podman[115737]: 2024-08-19 01:01:55.171152624 +0000 UTC m=+0.111008654 container create 146db8dc74d104353e55c1f7c240574243ef12c78f4a15652b60d8809ec8810b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T01:01:55.391 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:55 smithi017 podman[115737]: 2024-08-19 01:01:55.077739724 +0000 UTC m=+0.017595756 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:01:55.391 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:55 smithi017 podman[115737]: 2024-08-19 01:01:55.390187589 +0000 UTC m=+0.330043630 container init 146db8dc74d104353e55c1f7c240574243ef12c78f4a15652b60d8809ec8810b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-08-19T01:01:55.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:55 smithi017 podman[115737]: 2024-08-19 01:01:55.393304988 +0000 UTC m=+0.333161020 container start 146db8dc74d104353e55c1f7c240574243ef12c78f4a15652b60d8809ec8810b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0) 2024-08-19T01:01:55.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:55 smithi017 ceph-osd[115757]: -- 172.21.15.17:0/1640826366 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559c724901e0 con 0x559c72428000 2024-08-19T01:01:55.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:55 smithi017 bash[115737]: 146db8dc74d104353e55c1f7c240574243ef12c78f4a15652b60d8809ec8810b 2024-08-19T01:01:55.683 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:55 smithi017 systemd[1]: Started Ceph osd.1 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:01:56.316 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:01:55 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1[115753]: 2024-08-19T01:01:55.932+0000 7f1dc96cf640 -1 Falling back to public interface 2024-08-19T01:01:56.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:56 smithi017 ceph-mon[99370]: pgmap v66: 65 pgs: 16 active+undersized, 5 peering, 13 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 42/321 objects degraded (13.084%) 2024-08-19T01:01:56.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:56 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:56.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:56 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:56.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:56 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:01:56.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:56 smithi017 ceph-mon[99370]: Health check failed: Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded (PG_DEGRADED) 2024-08-19T01:01:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:56 smithi086 ceph-mon[71303]: pgmap v66: 65 pgs: 16 active+undersized, 5 peering, 13 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 42/321 objects degraded (13.084%) 2024-08-19T01:01:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:56 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:56 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:01:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:56 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:01:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:56 smithi086 ceph-mon[71303]: Health check failed: Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded (PG_DEGRADED) 2024-08-19T01:01:57.881 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:57 smithi017 ceph-mon[99370]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-08-19T01:01:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:57 smithi086 ceph-mon[71303]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-08-19T01:01:58.656 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:01:58 smithi017 ceph-mon[99370]: pgmap v67: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46/321 objects degraded (14.330%) 2024-08-19T01:01:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:01:58 smithi086 ceph-mon[71303]: pgmap v67: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 46/321 objects degraded (14.330%) 2024-08-19T01:02:00.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.312+0000 7fa4d9b05640 1 -- 172.21.15.17:0/3485979507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d40ff250 msgr2=0x7fa4d410bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.312+0000 7fa4d9b05640 1 --2- 172.21.15.17:0/3485979507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d40ff250 0x7fa4d410bf10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009880 tx=0x7fa4c802a490 comp rx=0 tx=0).stop 2024-08-19T01:02:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.312+0000 7fa4d9b05640 1 -- 172.21.15.17:0/3485979507 shutdown_connections 2024-08-19T01:02:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.312+0000 7fa4d9b05640 1 --2- 172.21.15.17:0/3485979507 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d40ff250 0x7fa4d410bf10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.312+0000 7fa4d9b05640 1 --2- 172.21.15.17:0/3485979507 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4d40fe8a0 0x7fa4d40fec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.312+0000 7fa4d9b05640 1 -- 172.21.15.17:0/3485979507 >> 172.21.15.17:0/3485979507 conn(0x7fa4d40758a0 msgr2=0x7fa4d40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.312+0000 7fa4d9b05640 1 -- 172.21.15.17:0/3485979507 shutdown_connections 2024-08-19T01:02:00.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.312+0000 7fa4d9b05640 1 -- 172.21.15.17:0/3485979507 wait complete. 2024-08-19T01:02:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.313+0000 7fa4d9b05640 1 Processor -- start 2024-08-19T01:02:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.313+0000 7fa4d9b05640 1 -- start start 2024-08-19T01:02:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d9b05640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d40fe8a0 0x7fa4d4197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d9b05640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4d40ff250 0x7fa4d4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d9b05640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d41989c0 con 0x7fa4d40fe8a0 2024-08-19T01:02:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d9b05640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d419c730 con 0x7fa4d40ff250 2024-08-19T01:02:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d40fe8a0 0x7fa4d4197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d40fe8a0 0x7fa4d4197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44622/0 (socket says 172.21.15.17:44622) 2024-08-19T01:02:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d37fe640 1 -- 172.21.15.17:0/2090668921 learned_addr learned my addr 172.21.15.17:0/2090668921 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:00.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d2ffd640 1 --2- 172.21.15.17:0/2090668921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4d40ff250 0x7fa4d4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:00.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d37fe640 1 -- 172.21.15.17:0/2090668921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4d40ff250 msgr2=0x7fa4d4198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:00.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d37fe640 1 --2- 172.21.15.17:0/2090668921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4d40ff250 0x7fa4d4198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d37fe640 1 -- 172.21.15.17:0/2090668921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c8009560 con 0x7fa4d40fe8a0 2024-08-19T01:02:00.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.314+0000 7fa4d37fe640 1 --2- 172.21.15.17:0/2090668921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d40fe8a0 0x7fa4d4197df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400b420 tx=0x7fa4c400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:00.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.315+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/2090668921 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c4011800 con 0x7fa4d40fe8a0 2024-08-19T01:02:00.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.315+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/2090668921 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4c4011e20 con 0x7fa4d40fe8a0 2024-08-19T01:02:00.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.315+0000 7fa4d9b05640 1 -- 172.21.15.17:0/2090668921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d419ca10 con 0x7fa4d40fe8a0 2024-08-19T01:02:00.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.315+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/2090668921 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c400f2e0 con 0x7fa4d40fe8a0 2024-08-19T01:02:00.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.315+0000 7fa4d9b05640 1 -- 172.21.15.17:0/2090668921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d419cf30 con 0x7fa4d40fe8a0 2024-08-19T01:02:00.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.316+0000 7fa4d9b05640 1 -- 172.21.15.17:0/2090668921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d40684b0 con 0x7fa4d40fe8a0 2024-08-19T01:02:00.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.316+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/2090668921 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa4c4011960 con 0x7fa4d40fe8a0 2024-08-19T01:02:00.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.317+0000 7fa4d0ff9640 1 --2- 172.21.15.17:0/2090668921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4bc06e170 0x7fa4bc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:00.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.317+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/2090668921 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa4c408d9a0 con 0x7fa4d40fe8a0 2024-08-19T01:02:00.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.317+0000 7fa4d2ffd640 1 --2- 172.21.15.17:0/2090668921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4bc06e170 0x7fa4bc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:00.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.318+0000 7fa4d2ffd640 1 --2- 172.21.15.17:0/2090668921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4bc06e170 0x7fa4bc070630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009230 tx=0x7fa4c80058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:00.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.322+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/2090668921 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa4c4056d30 con 0x7fa4d40fe8a0 2024-08-19T01:02:00.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.545+0000 7fa4d9b05640 1 -- 172.21.15.17:0/2090668921 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4d410ef40 con 0x7fa4bc06e170 2024-08-19T01:02:00.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.546+0000 7fa4d0ff9640 1 -- 172.21.15.17:0/2090668921 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa4d410ef40 con 0x7fa4bc06e170 2024-08-19T01:02:00.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.549+0000 7fa4d9b05640 1 -- 172.21.15.17:0/2090668921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4bc06e170 msgr2=0x7fa4bc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:00.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.549+0000 7fa4d9b05640 1 --2- 172.21.15.17:0/2090668921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4bc06e170 0x7fa4bc070630 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009230 tx=0x7fa4c80058d0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.549+0000 7fa4d9b05640 1 -- 172.21.15.17:0/2090668921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d40fe8a0 msgr2=0x7fa4d4197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:00.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.549+0000 7fa4d9b05640 1 --2- 172.21.15.17:0/2090668921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d40fe8a0 0x7fa4d4197df0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400b420 tx=0x7fa4c400b8e0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.549+0000 7fa4d9b05640 1 -- 172.21.15.17:0/2090668921 shutdown_connections 2024-08-19T01:02:00.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.549+0000 7fa4d9b05640 1 --2- 172.21.15.17:0/2090668921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4bc06e170 0x7fa4bc070630 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.549+0000 7fa4d9b05640 1 --2- 172.21.15.17:0/2090668921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4d40ff250 0x7fa4d4198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.549+0000 7fa4d9b05640 1 --2- 172.21.15.17:0/2090668921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4d40fe8a0 0x7fa4d4197df0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.549+0000 7fa4d9b05640 1 -- 172.21.15.17:0/2090668921 >> 172.21.15.17:0/2090668921 conn(0x7fa4d40758a0 msgr2=0x7fa4d40fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:00.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.549+0000 7fa4d9b05640 1 -- 172.21.15.17:0/2090668921 shutdown_connections 2024-08-19T01:02:00.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.549+0000 7fa4d9b05640 1 -- 172.21.15.17:0/2090668921 wait complete. 2024-08-19T01:02:00.562 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:02:00.605 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:00 smithi017 ceph-mon[99370]: pgmap v68: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 46/321 objects degraded (14.330%) 2024-08-19T01:02:00.606 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:00.606 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:00.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.653+0000 7fb45ab11640 1 -- 172.21.15.17:0/1497287636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4540fe9f0 msgr2=0x7fb4540fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:00.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.653+0000 7fb45ab11640 1 --2- 172.21.15.17:0/1497287636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4540fe9f0 0x7fb4540fee50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb440009880 tx=0x7fb44002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.653+0000 7fb45ab11640 1 -- 172.21.15.17:0/1497287636 shutdown_connections 2024-08-19T01:02:00.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.653+0000 7fb45ab11640 1 --2- 172.21.15.17:0/1497287636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4540fe9f0 0x7fb4540fee50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.653+0000 7fb45ab11640 1 --2- 172.21.15.17:0/1497287636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4541049f0 0x7fb454104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.653+0000 7fb45ab11640 1 -- 172.21.15.17:0/1497287636 >> 172.21.15.17:0/1497287636 conn(0x7fb4540758a0 msgr2=0x7fb4540fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:00.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.653+0000 7fb45ab11640 1 -- 172.21.15.17:0/1497287636 shutdown_connections 2024-08-19T01:02:00.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.653+0000 7fb45ab11640 1 -- 172.21.15.17:0/1497287636 wait complete. 2024-08-19T01:02:00.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.654+0000 7fb45ab11640 1 Processor -- start 2024-08-19T01:02:00.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.654+0000 7fb45ab11640 1 -- start start 2024-08-19T01:02:00.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.654+0000 7fb45ab11640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4540fe9f0 0x7fb454067cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:00.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.654+0000 7fb45ab11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4541049f0 0x7fb454068210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:00.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.654+0000 7fb45ab11640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb454068750 con 0x7fb4541049f0 2024-08-19T01:02:00.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.654+0000 7fb45ab11640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4540688c0 con 0x7fb4540fe9f0 2024-08-19T01:02:00.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.654+0000 7fb453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4541049f0 0x7fb454068210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.654+0000 7fb453fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4541049f0 0x7fb454068210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44626/0 (socket says 172.21.15.17:44626) 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.654+0000 7fb453fff640 1 -- 172.21.15.17:0/706913783 learned_addr learned my addr 172.21.15.17:0/706913783 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.654+0000 7fb4588ad640 1 --2- 172.21.15.17:0/706913783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4540fe9f0 0x7fb454067cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.655+0000 7fb453fff640 1 -- 172.21.15.17:0/706913783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4540fe9f0 msgr2=0x7fb454067cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.655+0000 7fb453fff640 1 --2- 172.21.15.17:0/706913783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4540fe9f0 0x7fb454067cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.655+0000 7fb453fff640 1 -- 172.21.15.17:0/706913783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440009560 con 0x7fb4541049f0 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.655+0000 7fb453fff640 1 --2- 172.21.15.17:0/706913783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4541049f0 0x7fb454068210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb440006010 tx=0x7fb4400055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.655+0000 7fb451ffb640 1 -- 172.21.15.17:0/706913783 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb440004aa0 con 0x7fb4541049f0 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.655+0000 7fb451ffb640 1 -- 172.21.15.17:0/706913783 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb440031470 con 0x7fb4541049f0 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.655+0000 7fb451ffb640 1 -- 172.21.15.17:0/706913783 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb440003940 con 0x7fb4541049f0 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.655+0000 7fb45ab11640 1 -- 172.21.15.17:0/706913783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb454068ae0 con 0x7fb4541049f0 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.656+0000 7fb45ab11640 1 -- 172.21.15.17:0/706913783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4541a8540 con 0x7fb4541049f0 2024-08-19T01:02:00.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.657+0000 7fb45ab11640 1 -- 172.21.15.17:0/706913783 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb454100130 con 0x7fb4541049f0 2024-08-19T01:02:00.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.658+0000 7fb451ffb640 1 -- 172.21.15.17:0/706913783 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb440031b90 con 0x7fb4541049f0 2024-08-19T01:02:00.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.659+0000 7fb451ffb640 1 --2- 172.21.15.17:0/706913783 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44406e1c0 0x7fb444070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:00.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.659+0000 7fb451ffb640 1 -- 172.21.15.17:0/706913783 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb4400af130 con 0x7fb4541049f0 2024-08-19T01:02:00.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.659+0000 7fb4588ad640 1 --2- 172.21.15.17:0/706913783 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44406e1c0 0x7fb444070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:00.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.659+0000 7fb4588ad640 1 --2- 172.21.15.17:0/706913783 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44406e1c0 0x7fb444070680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb448005d00 tx=0x7fb44800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:00.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.666+0000 7fb451ffb640 1 -- 172.21.15.17:0/706913783 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb440078550 con 0x7fb4541049f0 2024-08-19T01:02:00.867 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:02:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1[115753]: 2024-08-19T01:02:00.807+0000 7f1dc96cf640 -1 osd.1 54 log_to_monitors true 2024-08-19T01:02:00.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.864+0000 7fb45ab11640 1 -- 172.21.15.17:0/706913783 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb454107020 con 0x7fb44406e1c0 2024-08-19T01:02:00.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.866+0000 7fb451ffb640 1 -- 172.21.15.17:0/706913783 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb454107020 con 0x7fb44406e1c0 2024-08-19T01:02:00.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.868+0000 7fb45ab11640 1 -- 172.21.15.17:0/706913783 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44406e1c0 msgr2=0x7fb444070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.868+0000 7fb45ab11640 1 --2- 172.21.15.17:0/706913783 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44406e1c0 0x7fb444070680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb448005d00 tx=0x7fb44800b410 comp rx=0 tx=0).stop 2024-08-19T01:02:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.868+0000 7fb45ab11640 1 -- 172.21.15.17:0/706913783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4541049f0 msgr2=0x7fb454068210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.868+0000 7fb45ab11640 1 --2- 172.21.15.17:0/706913783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4541049f0 0x7fb454068210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb440006010 tx=0x7fb4400055a0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.868+0000 7fb45ab11640 1 -- 172.21.15.17:0/706913783 shutdown_connections 2024-08-19T01:02:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.868+0000 7fb45ab11640 1 --2- 172.21.15.17:0/706913783 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44406e1c0 0x7fb444070680 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.868+0000 7fb45ab11640 1 --2- 172.21.15.17:0/706913783 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4541049f0 0x7fb454068210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.868+0000 7fb45ab11640 1 --2- 172.21.15.17:0/706913783 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4540fe9f0 0x7fb454067cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.868+0000 7fb45ab11640 1 -- 172.21.15.17:0/706913783 >> 172.21.15.17:0/706913783 conn(0x7fb4540758a0 msgr2=0x7fb4540fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.868+0000 7fb45ab11640 1 -- 172.21.15.17:0/706913783 shutdown_connections 2024-08-19T01:02:00.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.868+0000 7fb45ab11640 1 -- 172.21.15.17:0/706913783 wait complete. 2024-08-19T01:02:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:00 smithi086 ceph-mon[71303]: pgmap v68: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 46/321 objects degraded (14.330%) 2024-08-19T01:02:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:00.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.954+0000 7f74a0e31640 1 -- 172.21.15.17:0/2682378390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c0fe9f0 msgr2=0x7f749c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:00.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.954+0000 7f74a0e31640 1 --2- 172.21.15.17:0/2682378390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c0fe9f0 0x7f749c0fee50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7490009880 tx=0x7f749002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.955+0000 7f74a0e31640 1 -- 172.21.15.17:0/2682378390 shutdown_connections 2024-08-19T01:02:00.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.955+0000 7f74a0e31640 1 --2- 172.21.15.17:0/2682378390 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c0fe9f0 0x7f749c0fee50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.955+0000 7f74a0e31640 1 --2- 172.21.15.17:0/2682378390 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f749c1049f0 0x7f749c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.955+0000 7f74a0e31640 1 -- 172.21.15.17:0/2682378390 >> 172.21.15.17:0/2682378390 conn(0x7f749c0758a0 msgr2=0x7f749c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:00.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.955+0000 7f74a0e31640 1 -- 172.21.15.17:0/2682378390 shutdown_connections 2024-08-19T01:02:00.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.955+0000 7f74a0e31640 1 -- 172.21.15.17:0/2682378390 wait complete. 2024-08-19T01:02:00.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.955+0000 7f74a0e31640 1 Processor -- start 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.955+0000 7f74a0e31640 1 -- start start 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f74a0e31640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c0fe9f0 0x7f749c19b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f74a0e31640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f749c1049f0 0x7f749c19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f74a0e31640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c19c3e0 con 0x7f749c0fe9f0 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f74a0e31640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c195970 con 0x7f749c1049f0 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f749a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c0fe9f0 0x7f749c19b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f749a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c0fe9f0 0x7f749c19b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44644/0 (socket says 172.21.15.17:44644) 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f749a59c640 1 -- 172.21.15.17:0/672776457 learned_addr learned my addr 172.21.15.17:0/672776457 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f7499d9b640 1 --2- 172.21.15.17:0/672776457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f749c1049f0 0x7f749c19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f749a59c640 1 -- 172.21.15.17:0/672776457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f749c1049f0 msgr2=0x7f749c19bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f749a59c640 1 --2- 172.21.15.17:0/672776457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f749c1049f0 0x7f749c19bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:00.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f749a59c640 1 -- 172.21.15.17:0/672776457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7490009560 con 0x7f749c0fe9f0 2024-08-19T01:02:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f749a59c640 1 --2- 172.21.15.17:0/672776457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c0fe9f0 0x7f749c19b880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f748c00d6f0 tx=0x7f748c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f748b7fe640 1 -- 172.21.15.17:0/672776457 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f748c009a30 con 0x7f749c0fe9f0 2024-08-19T01:02:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f748b7fe640 1 -- 172.21.15.17:0/672776457 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f748c0054e0 con 0x7f749c0fe9f0 2024-08-19T01:02:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.956+0000 7f74a0e31640 1 -- 172.21.15.17:0/672776457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c195c50 con 0x7f749c0fe9f0 2024-08-19T01:02:00.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.957+0000 7f748b7fe640 1 -- 172.21.15.17:0/672776457 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f748c010460 con 0x7f749c0fe9f0 2024-08-19T01:02:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.957+0000 7f74a0e31640 1 -- 172.21.15.17:0/672776457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c196170 con 0x7f749c0fe9f0 2024-08-19T01:02:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.958+0000 7f748b7fe640 1 -- 172.21.15.17:0/672776457 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f748c009b90 con 0x7f749c0fe9f0 2024-08-19T01:02:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.958+0000 7f74a0e31640 1 -- 172.21.15.17:0/672776457 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c100130 con 0x7f749c0fe9f0 2024-08-19T01:02:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.959+0000 7f748b7fe640 1 --2- 172.21.15.17:0/672776457 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f748406e170 0x7f7484070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.959+0000 7f748b7fe640 1 -- 172.21.15.17:0/672776457 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f748c08dd20 con 0x7f749c0fe9f0 2024-08-19T01:02:00.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.959+0000 7f7499d9b640 1 --2- 172.21.15.17:0/672776457 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f748406e170 0x7f7484070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:00.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.960+0000 7f7499d9b640 1 --2- 172.21.15.17:0/672776457 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f748406e170 0x7f7484070630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7490000c00 tx=0x7f7490005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:00.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:00.964+0000 7f748b7fe640 1 -- 172.21.15.17:0/672776457 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f748c057010 con 0x7f749c0fe9f0 2024-08-19T01:02:01.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.159+0000 7f74a0e31640 1 -- 172.21.15.17:0/672776457 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f749c106fd0 con 0x7f748406e170 2024-08-19T01:02:01.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.169+0000 7f748b7fe640 1 -- 172.21.15.17:0/672776457 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f749c106fd0 con 0x7f748406e170 2024-08-19T01:02:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:02:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (3m) 0s ago 13m 26.7M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:02:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (14m) 0s ago 14m 8753k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:02:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (13m) 55s ago 13m 8182k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:02:01.171 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (64s) 0s ago 14m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (59s) 55s ago 13m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (2m) 0s ago 13m 82.8M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (8m) 0s ago 8m 156M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (8m) 0s ago 8m 92.0M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (8m) 55s ago 8m 26.6M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (8m) 55s ago 8m 25.9M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (5m) 0s ago 15m 497M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (4m) 55s ago 12m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (2m) 0s ago 15m 45.7M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (103s) 55s ago 12m 36.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (3m) 0s ago 14m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (3m) 55s ago 13m 15.5M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (40s) 0s ago 12m 83.2M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:02:01.172 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (6s) 0s ago 11m 11.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:02:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (11m) 0s ago 11m 192M 1217M 18.2.4-721-gbaa926de e6c292a6bc95 e284700e38ab 2024-08-19T01:02:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (10m) 55s ago 10m 246M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T01:02:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (10m) 55s ago 10m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T01:02:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (10m) 55s ago 10m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T01:02:01.173 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (3m) 0s ago 13m 67.3M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:02:01.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.171+0000 7f74a0e31640 1 -- 172.21.15.17:0/672776457 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f748406e170 msgr2=0x7f7484070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.171+0000 7f74a0e31640 1 --2- 172.21.15.17:0/672776457 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f748406e170 0x7f7484070630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7490000c00 tx=0x7f7490005a20 comp rx=0 tx=0).stop 2024-08-19T01:02:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.171+0000 7f74a0e31640 1 -- 172.21.15.17:0/672776457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c0fe9f0 msgr2=0x7f749c19b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.171+0000 7f74a0e31640 1 --2- 172.21.15.17:0/672776457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c0fe9f0 0x7f749c19b880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f748c00d6f0 tx=0x7f748c00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.171+0000 7f74a0e31640 1 -- 172.21.15.17:0/672776457 shutdown_connections 2024-08-19T01:02:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.171+0000 7f74a0e31640 1 --2- 172.21.15.17:0/672776457 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f748406e170 0x7f7484070630 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.171+0000 7f74a0e31640 1 --2- 172.21.15.17:0/672776457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f749c1049f0 0x7f749c19bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.171+0000 7f74a0e31640 1 --2- 172.21.15.17:0/672776457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f749c0fe9f0 0x7f749c19b880 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.171+0000 7f74a0e31640 1 -- 172.21.15.17:0/672776457 >> 172.21.15.17:0/672776457 conn(0x7f749c0758a0 msgr2=0x7f749c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.171+0000 7f74a0e31640 1 -- 172.21.15.17:0/672776457 shutdown_connections 2024-08-19T01:02:01.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.172+0000 7f74a0e31640 1 -- 172.21.15.17:0/672776457 wait complete. 2024-08-19T01:02:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.260+0000 7f9e80f59640 1 -- 172.21.15.17:0/485177260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c1049f0 msgr2=0x7f9e7c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.260+0000 7f9e80f59640 1 --2- 172.21.15.17:0/485177260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c1049f0 0x7f9e7c104dd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c009880 tx=0x7f9e6c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.260+0000 7f9e80f59640 1 -- 172.21.15.17:0/485177260 shutdown_connections 2024-08-19T01:02:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.260+0000 7f9e80f59640 1 --2- 172.21.15.17:0/485177260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e7c0fe9f0 0x7f9e7c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.260+0000 7f9e80f59640 1 --2- 172.21.15.17:0/485177260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c1049f0 0x7f9e7c104dd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.260+0000 7f9e80f59640 1 -- 172.21.15.17:0/485177260 >> 172.21.15.17:0/485177260 conn(0x7f9e7c0758a0 msgr2=0x7f9e7c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.260+0000 7f9e80f59640 1 -- 172.21.15.17:0/485177260 shutdown_connections 2024-08-19T01:02:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.260+0000 7f9e80f59640 1 -- 172.21.15.17:0/485177260 wait complete. 2024-08-19T01:02:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.261+0000 7f9e80f59640 1 Processor -- start 2024-08-19T01:02:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.261+0000 7f9e80f59640 1 -- start start 2024-08-19T01:02:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.261+0000 7f9e80f59640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0fe9f0 0x7f9e7c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.261+0000 7f9e80f59640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e7c1049f0 0x7f9e7c19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.261+0000 7f9e80f59640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c195900 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.261+0000 7f9e80f59640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c195a40 con 0x7f9e7c1049f0 2024-08-19T01:02:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.261+0000 7f9e7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0fe9f0 0x7f9e7c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.261+0000 7f9e7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0fe9f0 0x7f9e7c19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44656/0 (socket says 172.21.15.17:44656) 2024-08-19T01:02:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.261+0000 7f9e7a59c640 1 -- 172.21.15.17:0/3381784570 learned_addr learned my addr 172.21.15.17:0/3381784570 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.261+0000 7f9e79d9b640 1 --2- 172.21.15.17:0/3381784570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e7c1049f0 0x7f9e7c19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.262+0000 7f9e7a59c640 1 -- 172.21.15.17:0/3381784570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e7c1049f0 msgr2=0x7f9e7c19bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.262+0000 7f9e7a59c640 1 --2- 172.21.15.17:0/3381784570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e7c1049f0 0x7f9e7c19bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.262+0000 7f9e7a59c640 1 -- 172.21.15.17:0/3381784570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c009560 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.262+0000 7f9e7a59c640 1 --2- 172.21.15.17:0/3381784570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0fe9f0 0x7f9e7c19b8a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c006010 tx=0x7f9e6c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.262+0000 7f9e6b7fe640 1 -- 172.21.15.17:0/3381784570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e6c004aa0 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.262+0000 7f9e6b7fe640 1 -- 172.21.15.17:0/3381784570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e6c031470 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.262+0000 7f9e6b7fe640 1 -- 172.21.15.17:0/3381784570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e6c003940 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.262+0000 7f9e80f59640 1 -- 172.21.15.17:0/3381784570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c195cc0 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.262+0000 7f9e80f59640 1 -- 172.21.15.17:0/3381784570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c1961b0 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.263+0000 7f9e80f59640 1 -- 172.21.15.17:0/3381784570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c100130 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.264+0000 7f9e6b7fe640 1 -- 172.21.15.17:0/3381784570 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9e6c031b90 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.264+0000 7f9e6b7fe640 1 --2- 172.21.15.17:0/3381784570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9e6406e180 0x7f9e64070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:01.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.265+0000 7f9e6b7fe640 1 -- 172.21.15.17:0/3381784570 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9e6c0af130 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.265+0000 7f9e79d9b640 1 --2- 172.21.15.17:0/3381784570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9e6406e180 0x7f9e64070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:01.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.265+0000 7f9e79d9b640 1 --2- 172.21.15.17:0/3381784570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9e6406e180 0x7f9e64070640 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c197150 tx=0x7f9e7000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:01.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.269+0000 7f9e6b7fe640 1 -- 172.21.15.17:0/3381784570 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9e6c078550 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.517+0000 7f9e80f59640 1 -- 172.21.15.17:0/3381784570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9e7c0fee50 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.517+0000 7f9e6b7fe640 1 -- 172.21.15.17:0/3381784570 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+829 (secure 0 0 0) 0x7f9e6c004c00 con 0x7f9e7c0fe9f0 2024-08-19T01:02:01.520 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:02:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:02:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:02:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:02:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:02:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:02:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:02:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:02:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4, 2024-08-19T01:02:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-19T01:02:01.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:02:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:02:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T01:02:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:02:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:02:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 8, 2024-08-19T01:02:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 5 2024-08-19T01:02:01.521 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:02:01.521 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:02:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.520+0000 7f9e80f59640 1 -- 172.21.15.17:0/3381784570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9e6406e180 msgr2=0x7f9e64070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.520+0000 7f9e80f59640 1 --2- 172.21.15.17:0/3381784570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9e6406e180 0x7f9e64070640 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c197150 tx=0x7f9e7000b390 comp rx=0 tx=0).stop 2024-08-19T01:02:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.520+0000 7f9e80f59640 1 -- 172.21.15.17:0/3381784570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0fe9f0 msgr2=0x7f9e7c19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.520+0000 7f9e80f59640 1 --2- 172.21.15.17:0/3381784570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0fe9f0 0x7f9e7c19b8a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c006010 tx=0x7f9e6c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.520+0000 7f9e80f59640 1 -- 172.21.15.17:0/3381784570 shutdown_connections 2024-08-19T01:02:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.520+0000 7f9e80f59640 1 --2- 172.21.15.17:0/3381784570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9e6406e180 0x7f9e64070640 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.520+0000 7f9e80f59640 1 --2- 172.21.15.17:0/3381784570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e7c1049f0 0x7f9e7c19bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.520+0000 7f9e80f59640 1 --2- 172.21.15.17:0/3381784570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e7c0fe9f0 0x7f9e7c19b8a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.520+0000 7f9e80f59640 1 -- 172.21.15.17:0/3381784570 >> 172.21.15.17:0/3381784570 conn(0x7f9e7c0758a0 msgr2=0x7f9e7c0fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.520+0000 7f9e80f59640 1 -- 172.21.15.17:0/3381784570 shutdown_connections 2024-08-19T01:02:01.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.520+0000 7f9e80f59640 1 -- 172.21.15.17:0/3381784570 wait complete. 2024-08-19T01:02:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.607+0000 7f62d8697640 1 -- 172.21.15.17:0/1200294820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d00fe9f0 msgr2=0x7f62d00fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.607+0000 7f62d8697640 1 --2- 172.21.15.17:0/1200294820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d00fe9f0 0x7f62d00fee50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009880 tx=0x7f62c002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.608+0000 7f62d8697640 1 -- 172.21.15.17:0/1200294820 shutdown_connections 2024-08-19T01:02:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.608+0000 7f62d8697640 1 --2- 172.21.15.17:0/1200294820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d00fe9f0 0x7f62d00fee50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.608+0000 7f62d8697640 1 --2- 172.21.15.17:0/1200294820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d01049f0 0x7f62d0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.608+0000 7f62d8697640 1 -- 172.21.15.17:0/1200294820 >> 172.21.15.17:0/1200294820 conn(0x7f62d00758a0 msgr2=0x7f62d00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.608+0000 7f62d8697640 1 -- 172.21.15.17:0/1200294820 shutdown_connections 2024-08-19T01:02:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.608+0000 7f62d8697640 1 -- 172.21.15.17:0/1200294820 wait complete. 2024-08-19T01:02:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.609+0000 7f62d8697640 1 Processor -- start 2024-08-19T01:02:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.609+0000 7f62d8697640 1 -- start start 2024-08-19T01:02:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.609+0000 7f62d8697640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d00fe9f0 0x7f62d019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.609+0000 7f62d8697640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d01049f0 0x7f62d019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.609+0000 7f62d8697640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0195970 con 0x7f62d01049f0 2024-08-19T01:02:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.609+0000 7f62d8697640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0195ab0 con 0x7f62d00fe9f0 2024-08-19T01:02:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.609+0000 7f62d6433640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d00fe9f0 0x7f62d019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.609+0000 7f62d6433640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d00fe9f0 0x7f62d019b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.17:52856/0 (socket says 172.21.15.17:52856) 2024-08-19T01:02:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.609+0000 7f62d5c32640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d01049f0 0x7f62d019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.609+0000 7f62d6433640 1 -- 172.21.15.17:0/1420555030 learned_addr learned my addr 172.21.15.17:0/1420555030 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.610+0000 7f62d6433640 1 -- 172.21.15.17:0/1420555030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d01049f0 msgr2=0x7f62d019be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.610+0000 7f62d6433640 1 --2- 172.21.15.17:0/1420555030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d01049f0 0x7f62d019be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.610+0000 7f62d6433640 1 -- 172.21.15.17:0/1420555030 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c0009560 con 0x7f62d00fe9f0 2024-08-19T01:02:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.610+0000 7f62d6433640 1 --2- 172.21.15.17:0/1420555030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d00fe9f0 0x7f62d019b910 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00d8d0 tx=0x7f62cc00dd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.611+0000 7f62c77fe640 1 -- 172.21.15.17:0/1420555030 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62cc009c00 con 0x7f62d00fe9f0 2024-08-19T01:02:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.611+0000 7f62c77fe640 1 -- 172.21.15.17:0/1420555030 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62cc009d60 con 0x7f62d00fe9f0 2024-08-19T01:02:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.611+0000 7f62c77fe640 1 -- 172.21.15.17:0/1420555030 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62cc0049d0 con 0x7f62d00fe9f0 2024-08-19T01:02:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.611+0000 7f62d8697640 1 -- 172.21.15.17:0/1420555030 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d0195d90 con 0x7f62d00fe9f0 2024-08-19T01:02:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.611+0000 7f62d8697640 1 -- 172.21.15.17:0/1420555030 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d0196260 con 0x7f62d00fe9f0 2024-08-19T01:02:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.612+0000 7f62d8697640 1 -- 172.21.15.17:0/1420555030 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d0100130 con 0x7f62d00fe9f0 2024-08-19T01:02:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.613+0000 7f62c77fe640 1 -- 172.21.15.17:0/1420555030 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f62cc004c40 con 0x7f62d00fe9f0 2024-08-19T01:02:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.613+0000 7f62c77fe640 1 --2- 172.21.15.17:0/1420555030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62bc06e1c0 0x7f62bc070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.614+0000 7f62c77fe640 1 -- 172.21.15.17:0/1420555030 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f62cc08dd80 con 0x7f62d00fe9f0 2024-08-19T01:02:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.614+0000 7f62d5c32640 1 --2- 172.21.15.17:0/1420555030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62bc06e1c0 0x7f62bc070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.614+0000 7f62d5c32640 1 --2- 172.21.15.17:0/1420555030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62bc06e1c0 0x7f62bc070680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009230 tx=0x7f62c0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.618+0000 7f62c77fe640 1 -- 172.21.15.17:0/1420555030 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f62cc0570f0 con 0x7f62d00fe9f0 2024-08-19T01:02:01.797 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:02:01 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1[115753]: 2024-08-19T01:02:01.627+0000 7f1dbd461640 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T01:02:01.797 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:01 smithi017 ceph-mon[99370]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:01.797 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:01 smithi017 ceph-mon[99370]: from='osd.1 [v2:172.21.15.17:6810/412166957,v1:172.21.15.17:6811/412166957]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-19T01:02:01.797 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:01 smithi017 ceph-mon[99370]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:01.797 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:01 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:01.798 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:01 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:01.798 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:01 smithi017 ceph-mon[99370]: Health check update: Degraded data redundancy: 46/321 objects degraded (14.330%), 15 pgs degraded (PG_DEGRADED) 2024-08-19T01:02:01.798 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:01 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3381784570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:01.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.836+0000 7f62d8697640 1 -- 172.21.15.17:0/1420555030 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f62d010bc60 con 0x7f62d00fe9f0 2024-08-19T01:02:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.837+0000 7f62c77fe640 1 -- 172.21.15.17:0/1420555030 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1933 (secure 0 0 0) 0x7f62cc017070 con 0x7f62d00fe9f0 2024-08-19T01:02:01.839 INFO:teuthology.orchestra.run.smithi017.stdout:e21 2024-08-19T01:02:01.839 INFO:teuthology.orchestra.run.smithi017.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-19T01:02:01.839 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:02:01.839 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:02:01.839 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 21 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T00:53:41.004049+0000 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:02:01.840 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 46 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14486,1=24299} 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:02:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:02:01.842 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:02:01.842 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:02:01.842 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:02:01.842 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:02:01.842 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:02:01.842 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:02:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:02:01.842 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:02:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T01:02:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.839+0000 7f62d8697640 1 -- 172.21.15.17:0/1420555030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62bc06e1c0 msgr2=0x7f62bc070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.839+0000 7f62d8697640 1 --2- 172.21.15.17:0/1420555030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62bc06e1c0 0x7f62bc070680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009230 tx=0x7f62c0005a20 comp rx=0 tx=0).stop 2024-08-19T01:02:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.839+0000 7f62d8697640 1 -- 172.21.15.17:0/1420555030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d00fe9f0 msgr2=0x7f62d019b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.839+0000 7f62d8697640 1 --2- 172.21.15.17:0/1420555030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d00fe9f0 0x7f62d019b910 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00d8d0 tx=0x7f62cc00dd90 comp rx=0 tx=0).stop 2024-08-19T01:02:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.839+0000 7f62d8697640 1 -- 172.21.15.17:0/1420555030 shutdown_connections 2024-08-19T01:02:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.839+0000 7f62d8697640 1 --2- 172.21.15.17:0/1420555030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62bc06e1c0 0x7f62bc070680 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.839+0000 7f62d8697640 1 --2- 172.21.15.17:0/1420555030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62d01049f0 0x7f62d019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.839+0000 7f62d8697640 1 --2- 172.21.15.17:0/1420555030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62d00fe9f0 0x7f62d019b910 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.839+0000 7f62d8697640 1 -- 172.21.15.17:0/1420555030 >> 172.21.15.17:0/1420555030 conn(0x7f62d00758a0 msgr2=0x7f62d00fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:01.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.839+0000 7f62d8697640 1 -- 172.21.15.17:0/1420555030 shutdown_connections 2024-08-19T01:02:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.839+0000 7f62d8697640 1 -- 172.21.15.17:0/1420555030 wait complete. 2024-08-19T01:02:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.924+0000 7fe003cce640 1 -- 172.21.15.17:0/1572075975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdffc0fea30 msgr2=0x7fdffc0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.924+0000 7fe003cce640 1 --2- 172.21.15.17:0/1572075975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdffc0fea30 0x7fdffc0fee90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009880 tx=0x7fdfec02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.924+0000 7fe003cce640 1 -- 172.21.15.17:0/1572075975 shutdown_connections 2024-08-19T01:02:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.924+0000 7fe003cce640 1 --2- 172.21.15.17:0/1572075975 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdffc0fea30 0x7fdffc0fee90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.924+0000 7fe003cce640 1 --2- 172.21.15.17:0/1572075975 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc104a30 0x7fdffc104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.924+0000 7fe003cce640 1 -- 172.21.15.17:0/1572075975 >> 172.21.15.17:0/1572075975 conn(0x7fdffc0fa730 msgr2=0x7fdffc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:01.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.924+0000 7fe003cce640 1 -- 172.21.15.17:0/1572075975 shutdown_connections 2024-08-19T01:02:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.924+0000 7fe003cce640 1 -- 172.21.15.17:0/1572075975 wait complete. 2024-08-19T01:02:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.925+0000 7fe003cce640 1 Processor -- start 2024-08-19T01:02:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.925+0000 7fe003cce640 1 -- start start 2024-08-19T01:02:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.925+0000 7fe003cce640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdffc0fea30 0x7fdffc19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.925+0000 7fe003cce640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc104a30 0x7fdffc19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.925+0000 7fe003cce640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc194800 con 0x7fdffc0fea30 2024-08-19T01:02:01.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.925+0000 7fe003cce640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdffc194970 con 0x7fdffc104a30 2024-08-19T01:02:01.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.925+0000 7fe001a6a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdffc0fea30 0x7fdffc19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:01.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.925+0000 7fe001a6a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdffc0fea30 0x7fdffc19a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44676/0 (socket says 172.21.15.17:44676) 2024-08-19T01:02:01.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.925+0000 7fe001a6a640 1 -- 172.21.15.17:0/2348778795 learned_addr learned my addr 172.21.15.17:0/2348778795 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.925+0000 7fe001269640 1 --2- 172.21.15.17:0/2348778795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc104a30 0x7fdffc19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.926+0000 7fe001a6a640 1 -- 172.21.15.17:0/2348778795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc104a30 msgr2=0x7fdffc19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.926+0000 7fe001a6a640 1 --2- 172.21.15.17:0/2348778795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc104a30 0x7fdffc19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.926+0000 7fe001a6a640 1 -- 172.21.15.17:0/2348778795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec009560 con 0x7fdffc0fea30 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.926+0000 7fe001a6a640 1 --2- 172.21.15.17:0/2348778795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdffc0fea30 0x7fdffc19a710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdff800d8d0 tx=0x7fdff800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.926+0000 7fdff2ffd640 1 -- 172.21.15.17:0/2348778795 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff800bea0 con 0x7fdffc0fea30 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.926+0000 7fdff2ffd640 1 -- 172.21.15.17:0/2348778795 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdff8009c00 con 0x7fdffc0fea30 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.926+0000 7fe003cce640 1 -- 172.21.15.17:0/2348778795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdffc194c50 con 0x7fdffc0fea30 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.926+0000 7fdff2ffd640 1 -- 172.21.15.17:0/2348778795 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdff800f710 con 0x7fdffc0fea30 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.926+0000 7fe003cce640 1 -- 172.21.15.17:0/2348778795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdffc195170 con 0x7fdffc0fea30 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.927+0000 7fe003cce640 1 -- 172.21.15.17:0/2348778795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdffc100170 con 0x7fdffc0fea30 2024-08-19T01:02:01.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.928+0000 7fdff2ffd640 1 -- 172.21.15.17:0/2348778795 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdff8010460 con 0x7fdffc0fea30 2024-08-19T01:02:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.928+0000 7fdff2ffd640 1 --2- 172.21.15.17:0/2348778795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdfe806e170 0x7fdfe8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.928+0000 7fdff2ffd640 1 -- 172.21.15.17:0/2348778795 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdff808dcd0 con 0x7fdffc0fea30 2024-08-19T01:02:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.928+0000 7fe001269640 1 --2- 172.21.15.17:0/2348778795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdfe806e170 0x7fdfe8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:01.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.928+0000 7fe001269640 1 --2- 172.21.15.17:0/2348778795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdfe806e170 0x7fdfe8070630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009230 tx=0x7fdfec0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:01.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:01.932+0000 7fdff2ffd640 1 -- 172.21.15.17:0/2348778795 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdff8057190 con 0x7fdffc0fea30 2024-08-19T01:02:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:01 smithi086 ceph-mon[71303]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:01 smithi086 ceph-mon[71303]: from='osd.1 [v2:172.21.15.17:6810/412166957,v1:172.21.15.17:6811/412166957]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-19T01:02:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:01 smithi086 ceph-mon[71303]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:01 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:01 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:01.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:01 smithi086 ceph-mon[71303]: Health check update: Degraded data redundancy: 46/321 objects degraded (14.330%), 15 pgs degraded (PG_DEGRADED) 2024-08-19T01:02:01.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:01 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3381784570' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.130+0000 7fe003cce640 1 -- 172.21.15.17:0/2348778795 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdffc195d10 con 0x7fdfe806e170 2024-08-19T01:02:02.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.131+0000 7fdff2ffd640 1 -- 172.21.15.17:0/2348778795 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdffc195d10 con 0x7fdfe806e170 2024-08-19T01:02:02.133 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:02:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:02:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:02:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:02:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:02:02.133 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:02:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:02:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:02:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:02:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "8/23 daemons upgraded", 2024-08-19T01:02:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-08-19T01:02:02.134 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:02:02.134 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:02:02.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.133+0000 7fe003cce640 1 -- 172.21.15.17:0/2348778795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdfe806e170 msgr2=0x7fdfe8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.133+0000 7fe003cce640 1 --2- 172.21.15.17:0/2348778795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdfe806e170 0x7fdfe8070630 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdfec009230 tx=0x7fdfec0058d0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.133+0000 7fe003cce640 1 -- 172.21.15.17:0/2348778795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdffc0fea30 msgr2=0x7fdffc19a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.133+0000 7fe003cce640 1 --2- 172.21.15.17:0/2348778795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdffc0fea30 0x7fdffc19a710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdff800d8d0 tx=0x7fdff800dd90 comp rx=0 tx=0).stop 2024-08-19T01:02:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.133+0000 7fe003cce640 1 -- 172.21.15.17:0/2348778795 shutdown_connections 2024-08-19T01:02:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.133+0000 7fe003cce640 1 --2- 172.21.15.17:0/2348778795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdfe806e170 0x7fdfe8070630 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.133+0000 7fe003cce640 1 --2- 172.21.15.17:0/2348778795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdffc104a30 0x7fdffc19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.133+0000 7fe003cce640 1 --2- 172.21.15.17:0/2348778795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdffc0fea30 0x7fdffc19a710 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.133+0000 7fe003cce640 1 -- 172.21.15.17:0/2348778795 >> 172.21.15.17:0/2348778795 conn(0x7fdffc0fa730 msgr2=0x7fdffc0fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.133+0000 7fe003cce640 1 -- 172.21.15.17:0/2348778795 shutdown_connections 2024-08-19T01:02:02.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.134+0000 7fe003cce640 1 -- 172.21.15.17:0/2348778795 wait complete. 2024-08-19T01:02:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.215+0000 7f4adfe26640 1 -- 172.21.15.17:0/1095972782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad8104a30 msgr2=0x7f4ad8104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.215+0000 7f4adfe26640 1 --2- 172.21.15.17:0/1095972782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad8104a30 0x7f4ad8104e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009880 tx=0x7f4ad002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.215+0000 7f4adfe26640 1 -- 172.21.15.17:0/1095972782 shutdown_connections 2024-08-19T01:02:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.215+0000 7f4adfe26640 1 --2- 172.21.15.17:0/1095972782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ad80fea30 0x7f4ad80fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.215+0000 7f4adfe26640 1 --2- 172.21.15.17:0/1095972782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad8104a30 0x7f4ad8104e10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.215+0000 7f4adfe26640 1 -- 172.21.15.17:0/1095972782 >> 172.21.15.17:0/1095972782 conn(0x7f4ad80fa730 msgr2=0x7f4ad80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.216+0000 7f4adfe26640 1 -- 172.21.15.17:0/1095972782 shutdown_connections 2024-08-19T01:02:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.216+0000 7f4adfe26640 1 -- 172.21.15.17:0/1095972782 wait complete. 2024-08-19T01:02:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.216+0000 7f4adfe26640 1 Processor -- start 2024-08-19T01:02:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.216+0000 7f4adfe26640 1 -- start start 2024-08-19T01:02:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4adfe26640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ad80fea30 0x7f4ad8194a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4adfe26640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad8104a30 0x7f4ad8194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4adfe26640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad8195630 con 0x7f4ad8104a30 2024-08-19T01:02:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4adfe26640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad8199380 con 0x7f4ad80fea30 2024-08-19T01:02:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4add3c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad8104a30 0x7f4ad8194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4add3c1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad8104a30 0x7f4ad8194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44700/0 (socket says 172.21.15.17:44700) 2024-08-19T01:02:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4add3c1640 1 -- 172.21.15.17:0/3706593460 learned_addr learned my addr 172.21.15.17:0/3706593460 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4addbc2640 1 --2- 172.21.15.17:0/3706593460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ad80fea30 0x7f4ad8194a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4add3c1640 1 -- 172.21.15.17:0/3706593460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ad80fea30 msgr2=0x7f4ad8194a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4add3c1640 1 --2- 172.21.15.17:0/3706593460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ad80fea30 0x7f4ad8194a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4add3c1640 1 -- 172.21.15.17:0/3706593460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0009560 con 0x7f4ad8104a30 2024-08-19T01:02:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4add3c1640 1 --2- 172.21.15.17:0/3706593460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad8104a30 0x7f4ad8194f50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00d6f0 tx=0x7f4acc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4ad6ffd640 1 -- 172.21.15.17:0/3706593460 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4acc009a30 con 0x7f4ad8104a30 2024-08-19T01:02:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.217+0000 7f4ad6ffd640 1 -- 172.21.15.17:0/3706593460 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4acc0054e0 con 0x7f4ad8104a30 2024-08-19T01:02:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.218+0000 7f4ad6ffd640 1 -- 172.21.15.17:0/3706593460 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4acc010460 con 0x7f4ad8104a30 2024-08-19T01:02:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.218+0000 7f4adfe26640 1 -- 172.21.15.17:0/3706593460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad8199580 con 0x7f4ad8104a30 2024-08-19T01:02:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.218+0000 7f4adfe26640 1 -- 172.21.15.17:0/3706593460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad8199ad0 con 0x7f4ad8104a30 2024-08-19T01:02:02.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.219+0000 7f4adfe26640 1 -- 172.21.15.17:0/3706593460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad8100170 con 0x7f4ad8104a30 2024-08-19T01:02:02.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.219+0000 7f4ad6ffd640 1 -- 172.21.15.17:0/3706593460 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4acc009b90 con 0x7f4ad8104a30 2024-08-19T01:02:02.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.220+0000 7f4ad6ffd640 1 --2- 172.21.15.17:0/3706593460 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ac006e170 0x7f4ac0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:02.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.220+0000 7f4ad6ffd640 1 -- 172.21.15.17:0/3706593460 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4acc08dbc0 con 0x7f4ad8104a30 2024-08-19T01:02:02.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.220+0000 7f4addbc2640 1 --2- 172.21.15.17:0/3706593460 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ac006e170 0x7f4ac0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:02.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.220+0000 7f4addbc2640 1 --2- 172.21.15.17:0/3706593460 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ac006e170 0x7f4ac0070630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009230 tx=0x7f4ad00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:02.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.224+0000 7f4ad6ffd640 1 -- 172.21.15.17:0/3706593460 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4acc056fe0 con 0x7f4ad8104a30 2024-08-19T01:02:02.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.469+0000 7f4adfe26640 1 -- 172.21.15.17:0/3706593460 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4ad810bd80 con 0x7f4ad8104a30 2024-08-19T01:02:02.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.469+0000 7f4ad6ffd640 1 -- 172.21.15.17:0/3706593460 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1294 (secure 0 0 0) 0x7f4acc020090 con 0x7f4ad8104a30 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 46/321 objects degraded (14.330%), 15 pgs degraded 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout: osd.1 (root=default,host=smithi017) is down 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 46/321 objects degraded (14.330%), 15 pgs degraded 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-08-19T01:02:02.472 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-08-19T01:02:02.473 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-08-19T01:02:02.473 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-08-19T01:02:02.473 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-08-19T01:02:02.473 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-08-19T01:02:02.473 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-08-19T01:02:02.473 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-08-19T01:02:02.473 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-08-19T01:02:02.473 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-08-19T01:02:02.473 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-08-19T01:02:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.471+0000 7f4adfe26640 1 -- 172.21.15.17:0/3706593460 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ac006e170 msgr2=0x7f4ac0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.471+0000 7f4adfe26640 1 --2- 172.21.15.17:0/3706593460 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ac006e170 0x7f4ac0070630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0009230 tx=0x7f4ad00058d0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.471+0000 7f4adfe26640 1 -- 172.21.15.17:0/3706593460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad8104a30 msgr2=0x7f4ad8194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.471+0000 7f4adfe26640 1 --2- 172.21.15.17:0/3706593460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad8104a30 0x7f4ad8194f50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00d6f0 tx=0x7f4acc00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.471+0000 7f4adfe26640 1 -- 172.21.15.17:0/3706593460 shutdown_connections 2024-08-19T01:02:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.471+0000 7f4adfe26640 1 --2- 172.21.15.17:0/3706593460 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ac006e170 0x7f4ac0070630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.471+0000 7f4adfe26640 1 --2- 172.21.15.17:0/3706593460 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ad8104a30 0x7f4ad8194f50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.471+0000 7f4adfe26640 1 --2- 172.21.15.17:0/3706593460 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ad80fea30 0x7f4ad8194a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.471+0000 7f4adfe26640 1 -- 172.21.15.17:0/3706593460 >> 172.21.15.17:0/3706593460 conn(0x7f4ad80fa730 msgr2=0x7f4ad80fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:02.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.471+0000 7f4adfe26640 1 -- 172.21.15.17:0/3706593460 shutdown_connections 2024-08-19T01:02:02.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:02.471+0000 7f4adfe26640 1 -- 172.21.15.17:0/3706593460 wait complete. 2024-08-19T01:02:02.815 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:02 smithi017 ceph-mon[99370]: pgmap v69: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 46/321 objects degraded (14.330%) 2024-08-19T01:02:02.815 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:02 smithi017 ceph-mon[99370]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:02.815 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:02 smithi017 ceph-mon[99370]: from='osd.1 [v2:172.21.15.17:6810/412166957,v1:172.21.15.17:6811/412166957]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-19T01:02:02.815 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:02 smithi017 ceph-mon[99370]: osdmap e57: 6 total, 5 up, 6 in 2024-08-19T01:02:02.815 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:02 smithi017 ceph-mon[99370]: from='osd.1 [v2:172.21.15.17:6810/412166957,v1:172.21.15.17:6811/412166957]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T01:02:02.815 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:02 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1420555030' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:02:02.815 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:02 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3706593460' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:02:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:02 smithi086 ceph-mon[71303]: pgmap v69: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 46/321 objects degraded (14.330%) 2024-08-19T01:02:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:02 smithi086 ceph-mon[71303]: from='client.34230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:02 smithi086 ceph-mon[71303]: from='osd.1 [v2:172.21.15.17:6810/412166957,v1:172.21.15.17:6811/412166957]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-19T01:02:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:02 smithi086 ceph-mon[71303]: osdmap e57: 6 total, 5 up, 6 in 2024-08-19T01:02:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:02 smithi086 ceph-mon[71303]: from='osd.1 [v2:172.21.15.17:6810/412166957,v1:172.21.15.17:6811/412166957]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T01:02:02.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:02 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1420555030' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:02:02.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:02 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3706593460' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:02:03.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:03 smithi017 ceph-mon[99370]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:03.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:03 smithi017 ceph-mon[99370]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:02:03.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:03 smithi017 ceph-mon[99370]: osd.1 [v2:172.21.15.17:6810/412166957,v1:172.21.15.17:6811/412166957] boot 2024-08-19T01:02:03.902 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:03 smithi017 ceph-mon[99370]: osdmap e58: 6 total, 6 up, 6 in 2024-08-19T01:02:03.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T01:02:03.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:03.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:02:03.903 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:03 smithi017 ceph-mon[99370]: osdmap e59: 6 total, 6 up, 6 in 2024-08-19T01:02:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:03 smithi086 ceph-mon[71303]: from='client.34242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:03 smithi086 ceph-mon[71303]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:02:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:03 smithi086 ceph-mon[71303]: osd.1 [v2:172.21.15.17:6810/412166957,v1:172.21.15.17:6811/412166957] boot 2024-08-19T01:02:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:03 smithi086 ceph-mon[71303]: osdmap e58: 6 total, 6 up, 6 in 2024-08-19T01:02:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-19T01:02:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:02:03.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:03 smithi086 ceph-mon[71303]: osdmap e59: 6 total, 6 up, 6 in 2024-08-19T01:02:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:04 smithi017 ceph-mon[99370]: pgmap v72: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 46/321 objects degraded (14.330%) 2024-08-19T01:02:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:04 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:04 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:04 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:02:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:04 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:02:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:04 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:04 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:02:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:04 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:04 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:04 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:04.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:04 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-19T01:02:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:04 smithi086 ceph-mon[71303]: pgmap v72: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 46/321 objects degraded (14.330%) 2024-08-19T01:02:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:04 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:04 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:04 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:02:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:04 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:02:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:04 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:04 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:02:04.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:04 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:04.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:04 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:04.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:04 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:04.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:04 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-19T01:02:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:05 smithi017 ceph-mon[99370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-19T01:02:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:05 smithi017 ceph-mon[99370]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-08-19T01:02:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:05 smithi086 ceph-mon[71303]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-19T01:02:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:05 smithi086 ceph-mon[71303]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-08-19T01:02:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:06 smithi017 ceph-mon[99370]: pgmap v74: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 24/321 objects degraded (7.477%) 2024-08-19T01:02:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:06 smithi017 ceph-mon[99370]: Health check update: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded (PG_DEGRADED) 2024-08-19T01:02:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:06 smithi086 ceph-mon[71303]: pgmap v74: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 24/321 objects degraded (7.477%) 2024-08-19T01:02:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:06 smithi086 ceph-mon[71303]: Health check update: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded (PG_DEGRADED) 2024-08-19T01:02:07.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:07 smithi086 ceph-mon[71303]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded) 2024-08-19T01:02:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:07 smithi017 ceph-mon[99370]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/321 objects degraded (7.477%), 7 pgs degraded) 2024-08-19T01:02:08.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:08 smithi086 ceph-mon[71303]: pgmap v75: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s 2024-08-19T01:02:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:08 smithi017 ceph-mon[99370]: pgmap v75: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s 2024-08-19T01:02:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:10 smithi086 ceph-mon[71303]: pgmap v76: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:02:11.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:10 smithi017 ceph-mon[99370]: pgmap v76: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:02:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:12 smithi086 ceph-mon[71303]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-08-19T01:02:13.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:12 smithi017 ceph-mon[99370]: pgmap v77: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-08-19T01:02:14.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:13 smithi017 ceph-mon[99370]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-08-19T01:02:14.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:13 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:14.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:13 smithi086 ceph-mon[71303]: pgmap v78: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-08-19T01:02:14.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:13 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:16.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:15 smithi017 ceph-mon[99370]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:02:16.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:15 smithi086 ceph-mon[71303]: pgmap v79: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:02:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:17 smithi017 ceph-mon[99370]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:02:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:17 smithi086 ceph-mon[71303]: pgmap v80: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:02:20.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:19 smithi017 ceph-mon[99370]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:02:20.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-19T01:02:20.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:19 smithi017 ceph-mon[99370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-19T01:02:20.156 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:19 smithi017 ceph-mon[99370]: Upgrade: osd.2 is safe to restart 2024-08-19T01:02:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:19 smithi086 ceph-mon[71303]: pgmap v81: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:02:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-19T01:02:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:19 smithi086 ceph-mon[71303]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-08-19T01:02:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:19 smithi086 ceph-mon[71303]: Upgrade: osd.2 is safe to restart 2024-08-19T01:02:22.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:22 smithi086 ceph-mon[71303]: pgmap v82: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:22.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:22 smithi086 ceph-mon[71303]: Upgrade: Updating osd.2 2024-08-19T01:02:22.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:22 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:22.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:22 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-19T01:02:22.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:22 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:02:22.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:22 smithi086 ceph-mon[71303]: Deploying daemon osd.2 on smithi017 2024-08-19T01:02:22.338 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:22 smithi017 ceph-mon[99370]: pgmap v82: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:22.338 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:22 smithi017 ceph-mon[99370]: Upgrade: Updating osd.2 2024-08-19T01:02:22.338 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:22 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:22.338 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:22 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-19T01:02:22.338 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:22 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:02:22.338 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:22 smithi017 ceph-mon[99370]: Deploying daemon osd.2 on smithi017 2024-08-19T01:02:23.933 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:23 smithi017 systemd[1]: Stopping Ceph osd.2 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:02:24.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:24 smithi017 ceph-mon[99370]: pgmap v83: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:24.433 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:24 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[49538]: 2024-08-19T01:02:24.105+0000 7f90dd140640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:02:24.433 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:24 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[49538]: 2024-08-19T01:02:24.105+0000 7f90dd140640 -1 osd.2 59 *** Got signal Terminated *** 2024-08-19T01:02:24.433 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:24 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[49538]: 2024-08-19T01:02:24.105+0000 7f90dd140640 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:02:24.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:24 smithi086 ceph-mon[71303]: pgmap v83: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:25.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:25 smithi017 ceph-mon[99370]: osd.2 marked itself down and dead 2024-08-19T01:02:25.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:25 smithi086 ceph-mon[71303]: osd.2 marked itself down and dead 2024-08-19T01:02:25.809 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:25 smithi017 podman[120682]: 2024-08-19 01:02:25.537075029 +0000 UTC m=+1.540796562 container died e284700e38abd6c17ea4e6bb1735ef36b4a6ace42ef73c2e9e4d4261da2144ef (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, RELEASE=reef-baa926d, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-19T01:02:26.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:26 smithi017 ceph-mon[99370]: pgmap v84: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:02:26.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:26 smithi017 ceph-mon[99370]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:02:26.151 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:26 smithi017 ceph-mon[99370]: osdmap e60: 6 total, 5 up, 6 in 2024-08-19T01:02:26.151 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:25 smithi017 podman[120682]: 2024-08-19 01:02:25.898016301 +0000 UTC m=+1.901737834 container cleanup e284700e38abd6c17ea4e6bb1735ef36b4a6ace42ef73c2e9e4d4261da2144ef (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=reef-baa926d, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:02:26.151 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:25 smithi017 bash[120682]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2 2024-08-19T01:02:26.433 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:26 smithi017 podman[120699]: 2024-08-19 01:02:26.149366853 +0000 UTC m=+0.604757570 container remove e284700e38abd6c17ea4e6bb1735ef36b4a6ace42ef73c2e9e4d4261da2144ef (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2, maintainer=Guillaume Abrioux , RELEASE=reef-baa926d, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:02:26.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:26 smithi086 ceph-mon[71303]: pgmap v84: 65 pgs: 65 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:02:26.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:26 smithi086 ceph-mon[71303]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:02:26.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:26 smithi086 ceph-mon[71303]: osdmap e60: 6 total, 5 up, 6 in 2024-08-19T01:02:26.763 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:26 smithi017 podman[120784]: 2024-08-19 01:02:26.390312841 +0000 UTC m=+0.017408962 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:02:26.763 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:26 smithi017 podman[120784]: 2024-08-19 01:02:26.509046892 +0000 UTC m=+0.136143002 container create 7bb681b4707392c084172b884b1d77fb64c7d676cc089c7c82024eb42fe4c219 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:02:26.763 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:26 smithi017 podman[120784]: 2024-08-19 01:02:26.761516519 +0000 UTC m=+0.388612648 container init 7bb681b4707392c084172b884b1d77fb64c7d676cc089c7c82024eb42fe4c219 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, RELEASE=squid-de09dd0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, ceph=True) 2024-08-19T01:02:27.050 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:26 smithi017 podman[120784]: 2024-08-19 01:02:26.765152381 +0000 UTC m=+0.392248504 container start 7bb681b4707392c084172b884b1d77fb64c7d676cc089c7c82024eb42fe4c219 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:02:27.050 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:26 smithi017 podman[120784]: 2024-08-19 01:02:26.844757951 +0000 UTC m=+0.471854072 container attach 7bb681b4707392c084172b884b1d77fb64c7d676cc089c7c82024eb42fe4c219 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:02:27.050 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:26 smithi017 podman[120784]: 2024-08-19 01:02:26.966989252 +0000 UTC m=+0.594085363 container died 7bb681b4707392c084172b884b1d77fb64c7d676cc089c7c82024eb42fe4c219 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-19T01:02:27.324 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:27 smithi017 ceph-mon[99370]: osdmap e61: 6 total, 5 up, 6 in 2024-08-19T01:02:27.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:27 smithi086 ceph-mon[71303]: osdmap e61: 6 total, 5 up, 6 in 2024-08-19T01:02:27.922 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:27 smithi017 podman[120808]: 2024-08-19 01:02:27.666040552 +0000 UTC m=+0.693201342 container remove 7bb681b4707392c084172b884b1d77fb64c7d676cc089c7c82024eb42fe4c219 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-19T01:02:27.922 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:27 smithi017 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.2.service: Deactivated successfully. 2024-08-19T01:02:27.922 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:27 smithi017 systemd[1]: Stopped Ceph osd.2 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:02:27.922 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:27 smithi017 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.2.service: Consumed 49.612s CPU time. 2024-08-19T01:02:28.183 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:27 smithi017 systemd[1]: Starting Ceph osd.2 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:02:28.183 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 podman[120907]: 2024-08-19 01:02:28.050463292 +0000 UTC m=+0.018258106 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:02:28.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-mon[99370]: pgmap v87: 65 pgs: 4 active+undersized, 8 peering, 2 stale+active+clean, 3 active+undersized+degraded, 48 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 15/321 objects degraded (4.673%) 2024-08-19T01:02:28.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-mon[99370]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-19T01:02:28.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-mon[99370]: Health check failed: Degraded data redundancy: 15/321 objects degraded (4.673%), 3 pgs degraded (PG_DEGRADED) 2024-08-19T01:02:28.438 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 podman[120907]: 2024-08-19 01:02:28.183682636 +0000 UTC m=+0.151477436 container create 324844bd6b3a80602e3954de6496090b91d76b85dcd3621a82924f58ea361686 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-19T01:02:28.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:28 smithi086 ceph-mon[71303]: pgmap v87: 65 pgs: 4 active+undersized, 8 peering, 2 stale+active+clean, 3 active+undersized+degraded, 48 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 15/321 objects degraded (4.673%) 2024-08-19T01:02:28.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:28 smithi086 ceph-mon[71303]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-19T01:02:28.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:28 smithi086 ceph-mon[71303]: Health check failed: Degraded data redundancy: 15/321 objects degraded (4.673%), 3 pgs degraded (PG_DEGRADED) 2024-08-19T01:02:28.697 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 podman[120907]: 2024-08-19 01:02:28.436560639 +0000 UTC m=+0.404355447 container init 324844bd6b3a80602e3954de6496090b91d76b85dcd3621a82924f58ea361686 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, GIT_CLEAN=True) 2024-08-19T01:02:28.697 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 podman[120907]: 2024-08-19 01:02:28.440898404 +0000 UTC m=+0.408693209 container start 324844bd6b3a80602e3954de6496090b91d76b85dcd3621a82924f58ea361686 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-08-19T01:02:28.698 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 podman[120907]: 2024-08-19 01:02:28.527965157 +0000 UTC m=+0.495759957 container attach 324844bd6b3a80602e3954de6496090b91d76b85dcd3621a82924f58ea361686 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-19T01:02:28.698 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:02:28.698 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:02:28.698 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:02:28.698 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:02:28.698 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:02:28.698 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:02:28.698 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:02:28.698 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:02:28.698 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:02:28.698 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:02:28.699 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-19T01:02:28.699 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-19T01:02:28.699 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-08-19T01:02:28.699 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-08-19T01:02:28.699 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-08-19T01:02:28.699 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-08-19T01:02:29.184 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-08-19T01:02:29.184 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-08-19T01:02:29.184 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-19T01:02:29.184 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-19T01:02:29.184 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-19T01:02:29.185 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-19T01:02:29.185 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate[120930]: --> ceph-volume lvm activate successful for osd ID: 2 2024-08-19T01:02:29.185 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 bash[120907]: --> ceph-volume lvm activate successful for osd ID: 2 2024-08-19T01:02:29.185 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:28 smithi017 podman[121058]: 2024-08-19 01:02:28.751221974 +0000 UTC m=+0.018675133 container died 324844bd6b3a80602e3954de6496090b91d76b85dcd3621a82924f58ea361686 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-19T01:02:29.522 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:29 smithi017 podman[121058]: 2024-08-19 01:02:29.307028143 +0000 UTC m=+0.574481303 container remove 324844bd6b3a80602e3954de6496090b91d76b85dcd3621a82924f58ea361686 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-activate, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-19T01:02:29.836 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:29 smithi017 podman[121119]: 2024-08-19 01:02:29.424507759 +0000 UTC m=+0.017876553 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:02:29.837 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:29 smithi017 podman[121119]: 2024-08-19 01:02:29.524609364 +0000 UTC m=+0.117978199 container create d03c5f91e697a5a52a639ad99111f169d9752f38275a28dadfff9b42bca6bfd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-19T01:02:29.837 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:29 smithi017 podman[121119]: 2024-08-19 01:02:29.726847832 +0000 UTC m=+0.320216639 container init d03c5f91e697a5a52a639ad99111f169d9752f38275a28dadfff9b42bca6bfd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0) 2024-08-19T01:02:29.837 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:29 smithi017 podman[121119]: 2024-08-19 01:02:29.729984694 +0000 UTC m=+0.323353496 container start d03c5f91e697a5a52a639ad99111f169d9752f38275a28dadfff9b42bca6bfd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-19T01:02:29.837 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:29 smithi017 ceph-osd[121138]: -- 172.21.15.17:0/128812302 <== mon.0 v2:172.21.15.17:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fcbef0c1e0 con 0x55fcbeea4000 2024-08-19T01:02:30.102 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:29 smithi017 bash[121119]: d03c5f91e697a5a52a639ad99111f169d9752f38275a28dadfff9b42bca6bfd1 2024-08-19T01:02:30.102 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:29 smithi017 systemd[1]: Started Ceph osd.2 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:02:30.102 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:30 smithi017 ceph-mon[99370]: pgmap v88: 65 pgs: 10 active+undersized, 8 peering, 9 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 31/321 objects degraded (9.657%) 2024-08-19T01:02:30.103 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:30.103 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:30.103 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:02:30.433 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:30 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[121134]: 2024-08-19T01:02:30.273+0000 7ff6adf04640 -1 Falling back to public interface 2024-08-19T01:02:30.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:30 smithi086 ceph-mon[71303]: pgmap v88: 65 pgs: 10 active+undersized, 8 peering, 9 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 31/321 objects degraded (9.657%) 2024-08-19T01:02:30.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:30.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:30.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:02:32.355 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:32 smithi017 ceph-mon[99370]: pgmap v89: 65 pgs: 10 active+undersized, 8 peering, 9 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 31/321 objects degraded (9.657%) 2024-08-19T01:02:32.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:32 smithi086 ceph-mon[71303]: pgmap v89: 65 pgs: 10 active+undersized, 8 peering, 9 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 31/321 objects degraded (9.657%) 2024-08-19T01:02:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.557+0000 7ff2588ed640 1 -- 172.21.15.17:0/3401431356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2540ffb50 msgr2=0x7ff2540fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.557+0000 7ff2588ed640 1 --2- 172.21.15.17:0/3401431356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2540ffb50 0x7ff2540fffb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff248009880 tx=0x7ff24802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.557+0000 7ff2588ed640 1 -- 172.21.15.17:0/3401431356 shutdown_connections 2024-08-19T01:02:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.557+0000 7ff2588ed640 1 --2- 172.21.15.17:0/3401431356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2540ffb50 0x7ff2540fffb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.557+0000 7ff2588ed640 1 --2- 172.21.15.17:0/3401431356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff254105c00 0x7ff254105fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.557+0000 7ff2588ed640 1 -- 172.21.15.17:0/3401431356 >> 172.21.15.17:0/3401431356 conn(0x7ff2540fb830 msgr2=0x7ff2540fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:32.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.557+0000 7ff2588ed640 1 -- 172.21.15.17:0/3401431356 shutdown_connections 2024-08-19T01:02:32.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.557+0000 7ff2588ed640 1 -- 172.21.15.17:0/3401431356 wait complete. 2024-08-19T01:02:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff2588ed640 1 Processor -- start 2024-08-19T01:02:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff2588ed640 1 -- start start 2024-08-19T01:02:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff2588ed640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2540ffb50 0x7ff25419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff2588ed640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff254105c00 0x7ff25419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff2588ed640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25419c4b0 con 0x7ff254105c00 2024-08-19T01:02:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff2588ed640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff254195a40 con 0x7ff2540ffb50 2024-08-19T01:02:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff251d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff254105c00 0x7ff25419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff251d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff254105c00 0x7ff25419be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35926/0 (socket says 172.21.15.17:35926) 2024-08-19T01:02:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff251d9b640 1 -- 172.21.15.17:0/351023645 learned_addr learned my addr 172.21.15.17:0/351023645 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff25259c640 1 --2- 172.21.15.17:0/351023645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2540ffb50 0x7ff25419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff251d9b640 1 -- 172.21.15.17:0/351023645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2540ffb50 msgr2=0x7ff25419b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff251d9b640 1 --2- 172.21.15.17:0/351023645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2540ffb50 0x7ff25419b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.558+0000 7ff251d9b640 1 -- 172.21.15.17:0/351023645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff248009560 con 0x7ff254105c00 2024-08-19T01:02:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.559+0000 7ff251d9b640 1 --2- 172.21.15.17:0/351023645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff254105c00 0x7ff25419be90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff24802a9c0 tx=0x7ff2480055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.559+0000 7ff2437fe640 1 -- 172.21.15.17:0/351023645 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff248004aa0 con 0x7ff254105c00 2024-08-19T01:02:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.559+0000 7ff2588ed640 1 -- 172.21.15.17:0/351023645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff254195cc0 con 0x7ff254105c00 2024-08-19T01:02:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.559+0000 7ff2437fe640 1 -- 172.21.15.17:0/351023645 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff248004c00 con 0x7ff254105c00 2024-08-19T01:02:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.559+0000 7ff2437fe640 1 -- 172.21.15.17:0/351023645 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff248003a20 con 0x7ff254105c00 2024-08-19T01:02:32.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.559+0000 7ff2588ed640 1 -- 172.21.15.17:0/351023645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2541961b0 con 0x7ff254105c00 2024-08-19T01:02:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.560+0000 7ff2588ed640 1 -- 172.21.15.17:0/351023645 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff254101200 con 0x7ff254105c00 2024-08-19T01:02:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.561+0000 7ff2437fe640 1 -- 172.21.15.17:0/351023645 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff248031c90 con 0x7ff254105c00 2024-08-19T01:02:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.561+0000 7ff2437fe640 1 --2- 172.21.15.17:0/351023645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff23c06e170 0x7ff23c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.561+0000 7ff2437fe640 1 -- 172.21.15.17:0/351023645 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff2480af0c0 con 0x7ff254105c00 2024-08-19T01:02:32.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.561+0000 7ff25259c640 1 --2- 172.21.15.17:0/351023645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff23c06e170 0x7ff23c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:32.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.562+0000 7ff25259c640 1 --2- 172.21.15.17:0/351023645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff23c06e170 0x7ff23c070630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff244009990 tx=0x7ff244009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:32.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.570+0000 7ff2437fe640 1 -- 172.21.15.17:0/351023645 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff2480784d0 con 0x7ff254105c00 2024-08-19T01:02:32.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.787+0000 7ff2588ed640 1 -- 172.21.15.17:0/351023645 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff25410ce20 con 0x7ff23c06e170 2024-08-19T01:02:32.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.788+0000 7ff2437fe640 1 -- 172.21.15.17:0/351023645 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff25410ce20 con 0x7ff23c06e170 2024-08-19T01:02:32.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.790+0000 7ff2588ed640 1 -- 172.21.15.17:0/351023645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff23c06e170 msgr2=0x7ff23c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.790+0000 7ff2588ed640 1 --2- 172.21.15.17:0/351023645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff23c06e170 0x7ff23c070630 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff244009990 tx=0x7ff244009110 comp rx=0 tx=0).stop 2024-08-19T01:02:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.790+0000 7ff2588ed640 1 -- 172.21.15.17:0/351023645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff254105c00 msgr2=0x7ff25419be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.790+0000 7ff2588ed640 1 --2- 172.21.15.17:0/351023645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff254105c00 0x7ff25419be90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff24802a9c0 tx=0x7ff2480055a0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.790+0000 7ff2588ed640 1 -- 172.21.15.17:0/351023645 shutdown_connections 2024-08-19T01:02:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.790+0000 7ff2588ed640 1 --2- 172.21.15.17:0/351023645 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff23c06e170 0x7ff23c070630 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.790+0000 7ff2588ed640 1 --2- 172.21.15.17:0/351023645 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff254105c00 0x7ff25419be90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.790+0000 7ff2588ed640 1 --2- 172.21.15.17:0/351023645 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2540ffb50 0x7ff25419b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.790+0000 7ff2588ed640 1 -- 172.21.15.17:0/351023645 >> 172.21.15.17:0/351023645 conn(0x7ff2540fb830 msgr2=0x7ff2540fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.791+0000 7ff2588ed640 1 -- 172.21.15.17:0/351023645 shutdown_connections 2024-08-19T01:02:32.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.791+0000 7ff2588ed640 1 -- 172.21.15.17:0/351023645 wait complete. 2024-08-19T01:02:32.802 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:02:32.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.876+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/4044555006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eac104a30 msgr2=0x7f7eac104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.876+0000 7f7eb1e3d640 1 --2- 172.21.15.17:0/4044555006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eac104a30 0x7f7eac104e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009880 tx=0x7f7e9c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.876+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/4044555006 shutdown_connections 2024-08-19T01:02:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.876+0000 7f7eb1e3d640 1 --2- 172.21.15.17:0/4044555006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eac0fea30 0x7f7eac0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.876+0000 7f7eb1e3d640 1 --2- 172.21.15.17:0/4044555006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eac104a30 0x7f7eac104e10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.876+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/4044555006 >> 172.21.15.17:0/4044555006 conn(0x7f7eac0fa730 msgr2=0x7f7eac0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.876+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/4044555006 shutdown_connections 2024-08-19T01:02:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.876+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/4044555006 wait complete. 2024-08-19T01:02:32.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.877+0000 7f7eb1e3d640 1 Processor -- start 2024-08-19T01:02:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.877+0000 7f7eb1e3d640 1 -- start start 2024-08-19T01:02:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.877+0000 7f7eb1e3d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eac0fea30 0x7f7eac0fb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:32.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.877+0000 7f7eb1e3d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eac104a30 0x7f7eac0fb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.877+0000 7f7eb1e3d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0fba90 con 0x7f7eac104a30 2024-08-19T01:02:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.877+0000 7f7eb1e3d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0fbc00 con 0x7f7eac0fea30 2024-08-19T01:02:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.877+0000 7f7eaaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eac104a30 0x7f7eac0fb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.877+0000 7f7eaaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eac104a30 0x7f7eac0fb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35942/0 (socket says 172.21.15.17:35942) 2024-08-19T01:02:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.877+0000 7f7eaaffd640 1 -- 172.21.15.17:0/2908722351 learned_addr learned my addr 172.21.15.17:0/2908722351 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.878+0000 7f7eab7fe640 1 --2- 172.21.15.17:0/2908722351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eac0fea30 0x7f7eac0fb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.878+0000 7f7eaaffd640 1 -- 172.21.15.17:0/2908722351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eac0fea30 msgr2=0x7f7eac0fb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.878+0000 7f7eaaffd640 1 --2- 172.21.15.17:0/2908722351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eac0fea30 0x7f7eac0fb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.878+0000 7f7eaaffd640 1 -- 172.21.15.17:0/2908722351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c009560 con 0x7f7eac104a30 2024-08-19T01:02:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.878+0000 7f7eaaffd640 1 --2- 172.21.15.17:0/2908722351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eac104a30 0x7f7eac0fb550 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000e970 tx=0x7f7ea000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:32.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.878+0000 7f7ea8ff9640 1 -- 172.21.15.17:0/2908722351 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ea000cc90 con 0x7f7eac104a30 2024-08-19T01:02:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.878+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/2908722351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eac1a1cb0 con 0x7f7eac104a30 2024-08-19T01:02:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.878+0000 7f7ea8ff9640 1 -- 172.21.15.17:0/2908722351 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ea000cdf0 con 0x7f7eac104a30 2024-08-19T01:02:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.878+0000 7f7ea8ff9640 1 -- 172.21.15.17:0/2908722351 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ea0010430 con 0x7f7eac104a30 2024-08-19T01:02:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.878+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/2908722351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac1a2010 con 0x7f7eac104a30 2024-08-19T01:02:32.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.880+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/2908722351 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac100170 con 0x7f7eac104a30 2024-08-19T01:02:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.880+0000 7f7ea8ff9640 1 -- 172.21.15.17:0/2908722351 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7ea00046c0 con 0x7f7eac104a30 2024-08-19T01:02:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.881+0000 7f7ea8ff9640 1 --2- 172.21.15.17:0/2908722351 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e9406e170 0x7f7e94070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.881+0000 7f7ea8ff9640 1 -- 172.21.15.17:0/2908722351 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7ea0014070 con 0x7f7eac104a30 2024-08-19T01:02:32.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.881+0000 7f7eab7fe640 1 --2- 172.21.15.17:0/2908722351 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e9406e170 0x7f7e94070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:32.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.882+0000 7f7eab7fe640 1 --2- 172.21.15.17:0/2908722351 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e9406e170 0x7f7e94070630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c000c00 tx=0x7f7e9c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:32.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:32.887+0000 7f7ea8ff9640 1 -- 172.21.15.17:0/2908722351 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7ea0057a60 con 0x7f7eac104a30 2024-08-19T01:02:33.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.123+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/2908722351 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7eac10bcc0 con 0x7f7e9406e170 2024-08-19T01:02:33.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.125+0000 7f7ea8ff9640 1 -- 172.21.15.17:0/2908722351 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7eac10bcc0 con 0x7f7e9406e170 2024-08-19T01:02:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.127+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/2908722351 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e9406e170 msgr2=0x7f7e94070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.127+0000 7f7eb1e3d640 1 --2- 172.21.15.17:0/2908722351 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e9406e170 0x7f7e94070630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c000c00 tx=0x7f7e9c005a20 comp rx=0 tx=0).stop 2024-08-19T01:02:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.127+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/2908722351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eac104a30 msgr2=0x7f7eac0fb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.127+0000 7f7eb1e3d640 1 --2- 172.21.15.17:0/2908722351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eac104a30 0x7f7eac0fb550 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000e970 tx=0x7f7ea000ed70 comp rx=0 tx=0).stop 2024-08-19T01:02:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.127+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/2908722351 shutdown_connections 2024-08-19T01:02:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.127+0000 7f7eb1e3d640 1 --2- 172.21.15.17:0/2908722351 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e9406e170 0x7f7e94070630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.127+0000 7f7eb1e3d640 1 --2- 172.21.15.17:0/2908722351 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7eac104a30 0x7f7eac0fb550 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.127+0000 7f7eb1e3d640 1 --2- 172.21.15.17:0/2908722351 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7eac0fea30 0x7f7eac0fb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.127+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/2908722351 >> 172.21.15.17:0/2908722351 conn(0x7f7eac0fa730 msgr2=0x7f7eac068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:33.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.127+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/2908722351 shutdown_connections 2024-08-19T01:02:33.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.127+0000 7f7eb1e3d640 1 -- 172.21.15.17:0/2908722351 wait complete. 2024-08-19T01:02:33.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.216+0000 7f36ed75a640 1 -- 172.21.15.17:0/3806327358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e80fe9f0 msgr2=0x7f36e80fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.216+0000 7f36ed75a640 1 --2- 172.21.15.17:0/3806327358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e80fe9f0 0x7f36e80fee50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f36dc009880 tx=0x7f36dc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.216+0000 7f36ed75a640 1 -- 172.21.15.17:0/3806327358 shutdown_connections 2024-08-19T01:02:33.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.216+0000 7f36ed75a640 1 --2- 172.21.15.17:0/3806327358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e80fe9f0 0x7f36e80fee50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.216+0000 7f36ed75a640 1 --2- 172.21.15.17:0/3806327358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e81049f0 0x7f36e8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.216+0000 7f36ed75a640 1 -- 172.21.15.17:0/3806327358 >> 172.21.15.17:0/3806327358 conn(0x7f36e80758a0 msgr2=0x7f36e80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:33.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.216+0000 7f36ed75a640 1 -- 172.21.15.17:0/3806327358 shutdown_connections 2024-08-19T01:02:33.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.216+0000 7f36ed75a640 1 -- 172.21.15.17:0/3806327358 wait complete. 2024-08-19T01:02:33.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.217+0000 7f36ed75a640 1 Processor -- start 2024-08-19T01:02:33.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.217+0000 7f36ed75a640 1 -- start start 2024-08-19T01:02:33.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.217+0000 7f36ed75a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e80fe9f0 0x7f36e819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.217+0000 7f36ed75a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e81049f0 0x7f36e819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.217+0000 7f36ed75a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e819c3b0 con 0x7f36e80fe9f0 2024-08-19T01:02:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.217+0000 7f36ed75a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e8195940 con 0x7f36e81049f0 2024-08-19T01:02:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.217+0000 7f36e6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e80fe9f0 0x7f36e819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.217+0000 7f36e6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e80fe9f0 0x7f36e819b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35950/0 (socket says 172.21.15.17:35950) 2024-08-19T01:02:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.217+0000 7f36e6ffd640 1 -- 172.21.15.17:0/927975648 learned_addr learned my addr 172.21.15.17:0/927975648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.218+0000 7f36e67fc640 1 --2- 172.21.15.17:0/927975648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e81049f0 0x7f36e819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.218+0000 7f36e6ffd640 1 -- 172.21.15.17:0/927975648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e81049f0 msgr2=0x7f36e819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.218+0000 7f36e6ffd640 1 --2- 172.21.15.17:0/927975648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e81049f0 0x7f36e819bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.218+0000 7f36e6ffd640 1 -- 172.21.15.17:0/927975648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc009560 con 0x7f36e80fe9f0 2024-08-19T01:02:33.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.218+0000 7f36e6ffd640 1 --2- 172.21.15.17:0/927975648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e80fe9f0 0x7f36e819b850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f36d800d6f0 tx=0x7f36d800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.218+0000 7f36cffff640 1 -- 172.21.15.17:0/927975648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36d8009a30 con 0x7f36e80fe9f0 2024-08-19T01:02:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.218+0000 7f36ed75a640 1 -- 172.21.15.17:0/927975648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e8195c20 con 0x7f36e80fe9f0 2024-08-19T01:02:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.218+0000 7f36cffff640 1 -- 172.21.15.17:0/927975648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f36d80054e0 con 0x7f36e80fe9f0 2024-08-19T01:02:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.218+0000 7f36cffff640 1 -- 172.21.15.17:0/927975648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36d8010460 con 0x7f36e80fe9f0 2024-08-19T01:02:33.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.218+0000 7f36ed75a640 1 -- 172.21.15.17:0/927975648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e8196140 con 0x7f36e80fe9f0 2024-08-19T01:02:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.219+0000 7f36ed75a640 1 -- 172.21.15.17:0/927975648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e8100130 con 0x7f36e80fe9f0 2024-08-19T01:02:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.220+0000 7f36cffff640 1 -- 172.21.15.17:0/927975648 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f36d8009b90 con 0x7f36e80fe9f0 2024-08-19T01:02:33.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.220+0000 7f36cffff640 1 --2- 172.21.15.17:0/927975648 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f36d006e170 0x7f36d0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.221+0000 7f36cffff640 1 -- 172.21.15.17:0/927975648 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f36d808dbd0 con 0x7f36e80fe9f0 2024-08-19T01:02:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.221+0000 7f36e67fc640 1 --2- 172.21.15.17:0/927975648 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f36d006e170 0x7f36d0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.221+0000 7f36e67fc640 1 --2- 172.21.15.17:0/927975648 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f36d006e170 0x7f36d0070630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36dc000c00 tx=0x7f36dc005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:33.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.225+0000 7f36cffff640 1 -- 172.21.15.17:0/927975648 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f36d8056fe0 con 0x7f36e80fe9f0 2024-08-19T01:02:33.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.418+0000 7f36ed75a640 1 -- 172.21.15.17:0/927975648 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f36e8101c70 con 0x7f36d006e170 2024-08-19T01:02:33.420 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:33 smithi017 ceph-mon[99370]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:33.420 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:33.420 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:02:33.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.428+0000 7f36cffff640 1 -- 172.21.15.17:0/927975648 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f36e8101c70 con 0x7f36d006e170 2024-08-19T01:02:33.434 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:02:33.434 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (3m) 32s ago 14m 26.7M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:02:33.434 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (14m) 32s ago 14m 8753k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:02:33.434 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (13m) 87s ago 13m 8182k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:02:33.434 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (96s) 32s ago 14m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:02:33.434 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (91s) 87s ago 13m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:02:33.434 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (3m) 32s ago 14m 82.8M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:02:33.434 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (9m) 32s ago 9m 156M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (9m) 32s ago 9m 92.0M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (8m) 87s ago 8m 26.6M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (9m) 87s ago 9m 25.9M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (5m) 32s ago 15m 497M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (4m) 87s ago 13m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (2m) 32s ago 16m 45.7M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (2m) 87s ago 13m 36.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (4m) 32s ago 14m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (4m) 87s ago 13m 15.5M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (73s) 32s ago 12m 83.2M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (38s) 32s ago 12m 11.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 starting - - - 1217M 2024-08-19T01:02:33.435 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (11m) 87s ago 11m 246M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 41d889d726f0 2024-08-19T01:02:33.436 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (11m) 87s ago 11m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T01:02:33.436 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (10m) 87s ago 10m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T01:02:33.436 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (4m) 32s ago 14m 67.3M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:02:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.430+0000 7f36ed75a640 1 -- 172.21.15.17:0/927975648 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f36d006e170 msgr2=0x7f36d0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.430+0000 7f36ed75a640 1 --2- 172.21.15.17:0/927975648 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f36d006e170 0x7f36d0070630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36dc000c00 tx=0x7f36dc005a20 comp rx=0 tx=0).stop 2024-08-19T01:02:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.430+0000 7f36ed75a640 1 -- 172.21.15.17:0/927975648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e80fe9f0 msgr2=0x7f36e819b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.430+0000 7f36ed75a640 1 --2- 172.21.15.17:0/927975648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e80fe9f0 0x7f36e819b850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f36d800d6f0 tx=0x7f36d800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.431+0000 7f36ed75a640 1 -- 172.21.15.17:0/927975648 shutdown_connections 2024-08-19T01:02:33.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.431+0000 7f36ed75a640 1 --2- 172.21.15.17:0/927975648 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f36d006e170 0x7f36d0070630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.431+0000 7f36ed75a640 1 --2- 172.21.15.17:0/927975648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36e81049f0 0x7f36e819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.431+0000 7f36ed75a640 1 --2- 172.21.15.17:0/927975648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36e80fe9f0 0x7f36e819b850 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.431+0000 7f36ed75a640 1 -- 172.21.15.17:0/927975648 >> 172.21.15.17:0/927975648 conn(0x7f36e80758a0 msgr2=0x7f36e80fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:33.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.431+0000 7f36ed75a640 1 -- 172.21.15.17:0/927975648 shutdown_connections 2024-08-19T01:02:33.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.431+0000 7f36ed75a640 1 -- 172.21.15.17:0/927975648 wait complete. 2024-08-19T01:02:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:33 smithi086 ceph-mon[71303]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:02:33.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.516+0000 7fa43cb74640 1 -- 172.21.15.17:0/3122391953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa438104b20 msgr2=0x7fa438104f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.516+0000 7fa43cb74640 1 --2- 172.21.15.17:0/3122391953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa438104b20 0x7fa438104f00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa428009880 tx=0x7fa42802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.516+0000 7fa43cb74640 1 -- 172.21.15.17:0/3122391953 shutdown_connections 2024-08-19T01:02:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.516+0000 7fa43cb74640 1 --2- 172.21.15.17:0/3122391953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4380fdf40 0x7fa4380fe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.516+0000 7fa43cb74640 1 --2- 172.21.15.17:0/3122391953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa438104b20 0x7fa438104f00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.516+0000 7fa43cb74640 1 -- 172.21.15.17:0/3122391953 >> 172.21.15.17:0/3122391953 conn(0x7fa4380f9e50 msgr2=0x7fa4380fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.516+0000 7fa43cb74640 1 -- 172.21.15.17:0/3122391953 shutdown_connections 2024-08-19T01:02:33.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.516+0000 7fa43cb74640 1 -- 172.21.15.17:0/3122391953 wait complete. 2024-08-19T01:02:33.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.517+0000 7fa43cb74640 1 Processor -- start 2024-08-19T01:02:33.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.517+0000 7fa43cb74640 1 -- start start 2024-08-19T01:02:33.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.517+0000 7fa43cb74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4380fdf40 0x7fa43819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.517+0000 7fa43cb74640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa438104b20 0x7fa43819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.517+0000 7fa43cb74640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43819c450 con 0x7fa4380fdf40 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.517+0000 7fa43cb74640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4381959e0 con 0x7fa438104b20 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.517+0000 7fa43659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4380fdf40 0x7fa43819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.517+0000 7fa43659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4380fdf40 0x7fa43819b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35974/0 (socket says 172.21.15.17:35974) 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.517+0000 7fa43659c640 1 -- 172.21.15.17:0/2383042910 learned_addr learned my addr 172.21.15.17:0/2383042910 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.517+0000 7fa42dd9b640 1 --2- 172.21.15.17:0/2383042910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa438104b20 0x7fa43819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.518+0000 7fa43659c640 1 -- 172.21.15.17:0/2383042910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa438104b20 msgr2=0x7fa43819be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.518+0000 7fa43659c640 1 --2- 172.21.15.17:0/2383042910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa438104b20 0x7fa43819be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.518+0000 7fa43659c640 1 -- 172.21.15.17:0/2383042910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa428009560 con 0x7fa4380fdf40 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.518+0000 7fa43659c640 1 --2- 172.21.15.17:0/2383042910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4380fdf40 0x7fa43819b8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa42802a9c0 tx=0x7fa4280055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.518+0000 7fa42ffff640 1 -- 172.21.15.17:0/2383042910 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa428004aa0 con 0x7fa4380fdf40 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.518+0000 7fa43cb74640 1 -- 172.21.15.17:0/2383042910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa438195c60 con 0x7fa4380fdf40 2024-08-19T01:02:33.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.518+0000 7fa42ffff640 1 -- 172.21.15.17:0/2383042910 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa428004c00 con 0x7fa4380fdf40 2024-08-19T01:02:33.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.518+0000 7fa42ffff640 1 -- 172.21.15.17:0/2383042910 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa428003ab0 con 0x7fa4380fdf40 2024-08-19T01:02:33.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.518+0000 7fa43cb74640 1 -- 172.21.15.17:0/2383042910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa438196150 con 0x7fa4380fdf40 2024-08-19T01:02:33.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.519+0000 7fa43cb74640 1 -- 172.21.15.17:0/2383042910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa438101260 con 0x7fa4380fdf40 2024-08-19T01:02:33.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.520+0000 7fa42ffff640 1 -- 172.21.15.17:0/2383042910 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa428031d20 con 0x7fa4380fdf40 2024-08-19T01:02:33.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.520+0000 7fa42ffff640 1 --2- 172.21.15.17:0/2383042910 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa42406e170 0x7fa424070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:33.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.520+0000 7fa42ffff640 1 -- 172.21.15.17:0/2383042910 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa4280af140 con 0x7fa4380fdf40 2024-08-19T01:02:33.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.520+0000 7fa42dd9b640 1 --2- 172.21.15.17:0/2383042910 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa42406e170 0x7fa424070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:33.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.521+0000 7fa42dd9b640 1 --2- 172.21.15.17:0/2383042910 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa42406e170 0x7fa424070630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa438196e50 tx=0x7fa42000a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:33.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.524+0000 7fa42ffff640 1 -- 172.21.15.17:0/2383042910 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa428078580 con 0x7fa4380fdf40 2024-08-19T01:02:33.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.781+0000 7fa43cb74640 1 -- 172.21.15.17:0/2383042910 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa438108060 con 0x7fa4380fdf40 2024-08-19T01:02:33.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.781+0000 7fa42ffff640 1 -- 172.21.15.17:0/2383042910 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+829 (secure 0 0 0) 0x7fa42807bc40 con 0x7fa4380fdf40 2024-08-19T01:02:33.784 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:02:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:02:33.784 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:02:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:02:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:02:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:02:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:02:33.785 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:02:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 3, 2024-08-19T01:02:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:02:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:02:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:02:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T01:02:33.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:02:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:02:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 7, 2024-08-19T01:02:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:02:33.787 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:02:33.787 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:02:33.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.785+0000 7fa43cb74640 1 -- 172.21.15.17:0/2383042910 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa42406e170 msgr2=0x7fa424070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.785+0000 7fa43cb74640 1 --2- 172.21.15.17:0/2383042910 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa42406e170 0x7fa424070630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa438196e50 tx=0x7fa42000a250 comp rx=0 tx=0).stop 2024-08-19T01:02:33.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.785+0000 7fa43cb74640 1 -- 172.21.15.17:0/2383042910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4380fdf40 msgr2=0x7fa43819b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.785+0000 7fa43cb74640 1 --2- 172.21.15.17:0/2383042910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4380fdf40 0x7fa43819b8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa42802a9c0 tx=0x7fa4280055a0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.785+0000 7fa43cb74640 1 -- 172.21.15.17:0/2383042910 shutdown_connections 2024-08-19T01:02:33.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.785+0000 7fa43cb74640 1 --2- 172.21.15.17:0/2383042910 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa42406e170 0x7fa424070630 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.785+0000 7fa43cb74640 1 --2- 172.21.15.17:0/2383042910 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa438104b20 0x7fa43819be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.785+0000 7fa43cb74640 1 --2- 172.21.15.17:0/2383042910 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4380fdf40 0x7fa43819b8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.785+0000 7fa43cb74640 1 -- 172.21.15.17:0/2383042910 >> 172.21.15.17:0/2383042910 conn(0x7fa4380f9e50 msgr2=0x7fa4380fb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.785+0000 7fa43cb74640 1 -- 172.21.15.17:0/2383042910 shutdown_connections 2024-08-19T01:02:33.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.785+0000 7fa43cb74640 1 -- 172.21.15.17:0/2383042910 wait complete. 2024-08-19T01:02:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.875+0000 7f7e56e21640 1 -- 172.21.15.17:0/2717281963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e500fe9f0 msgr2=0x7f7e500fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.875+0000 7f7e56e21640 1 --2- 172.21.15.17:0/2717281963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e500fe9f0 0x7f7e500fee50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009880 tx=0x7f7e3802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.875+0000 7f7e56e21640 1 -- 172.21.15.17:0/2717281963 shutdown_connections 2024-08-19T01:02:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.875+0000 7f7e56e21640 1 --2- 172.21.15.17:0/2717281963 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e500fe9f0 0x7f7e500fee50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.875+0000 7f7e56e21640 1 --2- 172.21.15.17:0/2717281963 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e501049f0 0x7f7e50104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.875+0000 7f7e56e21640 1 -- 172.21.15.17:0/2717281963 >> 172.21.15.17:0/2717281963 conn(0x7f7e500758a0 msgr2=0x7f7e500fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:33.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.876+0000 7f7e56e21640 1 -- 172.21.15.17:0/2717281963 shutdown_connections 2024-08-19T01:02:33.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.876+0000 7f7e56e21640 1 -- 172.21.15.17:0/2717281963 wait complete. 2024-08-19T01:02:33.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.876+0000 7f7e56e21640 1 Processor -- start 2024-08-19T01:02:33.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.876+0000 7f7e56e21640 1 -- start start 2024-08-19T01:02:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.876+0000 7f7e56e21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e500fe9f0 0x7f7e5019b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.876+0000 7f7e56e21640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e501049f0 0x7f7e5019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.876+0000 7f7e56e21640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e501958e0 con 0x7f7e500fe9f0 2024-08-19T01:02:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.876+0000 7f7e56e21640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50195a50 con 0x7f7e501049f0 2024-08-19T01:02:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e54bbd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e500fe9f0 0x7f7e5019b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e54bbd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e500fe9f0 0x7f7e5019b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36002/0 (socket says 172.21.15.17:36002) 2024-08-19T01:02:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e54bbd640 1 -- 172.21.15.17:0/3942154670 learned_addr learned my addr 172.21.15.17:0/3942154670 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:33.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e4ffff640 1 --2- 172.21.15.17:0/3942154670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e501049f0 0x7f7e5019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e54bbd640 1 -- 172.21.15.17:0/3942154670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e501049f0 msgr2=0x7f7e5019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e54bbd640 1 --2- 172.21.15.17:0/3942154670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e501049f0 0x7f7e5019bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e54bbd640 1 -- 172.21.15.17:0/3942154670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e38009560 con 0x7f7e500fe9f0 2024-08-19T01:02:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e54bbd640 1 --2- 172.21.15.17:0/3942154670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e500fe9f0 0x7f7e5019b7f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000ea30 tx=0x7f7e4000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e4dffb640 1 -- 172.21.15.17:0/3942154670 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4000cdb0 con 0x7f7e500fe9f0 2024-08-19T01:02:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e4dffb640 1 -- 172.21.15.17:0/3942154670 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e40011930 con 0x7f7e500fe9f0 2024-08-19T01:02:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e56e21640 1 -- 172.21.15.17:0/3942154670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e50195d30 con 0x7f7e500fe9f0 2024-08-19T01:02:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.877+0000 7f7e4dffb640 1 -- 172.21.15.17:0/3942154670 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e4001aa30 con 0x7f7e500fe9f0 2024-08-19T01:02:33.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.878+0000 7f7e56e21640 1 -- 172.21.15.17:0/3942154670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e50196250 con 0x7f7e500fe9f0 2024-08-19T01:02:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.879+0000 7f7e56e21640 1 -- 172.21.15.17:0/3942154670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e50100130 con 0x7f7e500fe9f0 2024-08-19T01:02:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.879+0000 7f7e4dffb640 1 -- 172.21.15.17:0/3942154670 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7e4001ab90 con 0x7f7e500fe9f0 2024-08-19T01:02:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.879+0000 7f7e4dffb640 1 --2- 172.21.15.17:0/3942154670 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e3c06e170 0x7f7e3c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.880+0000 7f7e4dffb640 1 -- 172.21.15.17:0/3942154670 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7e4008e660 con 0x7f7e500fe9f0 2024-08-19T01:02:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.880+0000 7f7e4ffff640 1 --2- 172.21.15.17:0/3942154670 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e3c06e170 0x7f7e3c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:33.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.880+0000 7f7e4ffff640 1 --2- 172.21.15.17:0/3942154670 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e3c06e170 0x7f7e3c070630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009230 tx=0x7f7e380058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:33.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:33.887+0000 7f7e4dffb640 1 -- 172.21.15.17:0/3942154670 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7e40057a70 con 0x7f7e500fe9f0 2024-08-19T01:02:34.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.109+0000 7f7e56e21640 1 -- 172.21.15.17:0/3942154670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7e501964f0 con 0x7f7e500fe9f0 2024-08-19T01:02:34.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.109+0000 7f7e4dffb640 1 -- 172.21.15.17:0/3942154670 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1933 (secure 0 0 0) 0x7f7e4005b130 con 0x7f7e500fe9f0 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:e21 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 21 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T00:53:41.004049+0000 2024-08-19T01:02:34.112 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 46 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14486,1=24299} 2024-08-19T01:02:34.113 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:02:34.114 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:02:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:02:34.115 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:02:34.115 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T01:02:34.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.112+0000 7f7e56e21640 1 -- 172.21.15.17:0/3942154670 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e3c06e170 msgr2=0x7f7e3c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:34.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.112+0000 7f7e56e21640 1 --2- 172.21.15.17:0/3942154670 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e3c06e170 0x7f7e3c070630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e38009230 tx=0x7f7e380058d0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.113+0000 7f7e56e21640 1 -- 172.21.15.17:0/3942154670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e500fe9f0 msgr2=0x7f7e5019b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.113+0000 7f7e56e21640 1 --2- 172.21.15.17:0/3942154670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e500fe9f0 0x7f7e5019b7f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7e4000ea30 tx=0x7f7e4000eef0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.113+0000 7f7e56e21640 1 -- 172.21.15.17:0/3942154670 shutdown_connections 2024-08-19T01:02:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.113+0000 7f7e56e21640 1 --2- 172.21.15.17:0/3942154670 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e3c06e170 0x7f7e3c070630 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.113+0000 7f7e56e21640 1 --2- 172.21.15.17:0/3942154670 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e501049f0 0x7f7e5019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.113+0000 7f7e56e21640 1 --2- 172.21.15.17:0/3942154670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e500fe9f0 0x7f7e5019b7f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.113+0000 7f7e56e21640 1 -- 172.21.15.17:0/3942154670 >> 172.21.15.17:0/3942154670 conn(0x7f7e500758a0 msgr2=0x7f7e50102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.113+0000 7f7e56e21640 1 -- 172.21.15.17:0/3942154670 shutdown_connections 2024-08-19T01:02:34.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.113+0000 7f7e56e21640 1 -- 172.21.15.17:0/3942154670 wait complete. 2024-08-19T01:02:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.208+0000 7fc3213a1640 1 -- 172.21.15.17:0/3082771021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc31c1015d0 msgr2=0x7fc31c109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.208+0000 7fc3213a1640 1 --2- 172.21.15.17:0/3082771021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc31c1015d0 0x7fc31c109ac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc310009880 tx=0x7fc31002a530 comp rx=0 tx=0).stop 2024-08-19T01:02:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.208+0000 7fc3213a1640 1 -- 172.21.15.17:0/3082771021 shutdown_connections 2024-08-19T01:02:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.208+0000 7fc3213a1640 1 --2- 172.21.15.17:0/3082771021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc31c1015d0 0x7fc31c109ac0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.208+0000 7fc3213a1640 1 --2- 172.21.15.17:0/3082771021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc31c100cb0 0x7fc31c101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.208+0000 7fc3213a1640 1 -- 172.21.15.17:0/3082771021 >> 172.21.15.17:0/3082771021 conn(0x7fc31c0758a0 msgr2=0x7fc31c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.208+0000 7fc3213a1640 1 -- 172.21.15.17:0/3082771021 shutdown_connections 2024-08-19T01:02:34.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.208+0000 7fc3213a1640 1 -- 172.21.15.17:0/3082771021 wait complete. 2024-08-19T01:02:34.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.209+0000 7fc3213a1640 1 Processor -- start 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.209+0000 7fc3213a1640 1 -- start start 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.209+0000 7fc3213a1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc31c100cb0 0x7fc31c19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.209+0000 7fc3213a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc31c1015d0 0x7fc31c193740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.209+0000 7fc3213a1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c193e20 con 0x7fc31c1015d0 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.209+0000 7fc3213a1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c193f90 con 0x7fc31c100cb0 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.209+0000 7fc31a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc31c1015d0 0x7fc31c193740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.209+0000 7fc31affd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc31c100cb0 0x7fc31c19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.209+0000 7fc31a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc31c1015d0 0x7fc31c193740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36032/0 (socket says 172.21.15.17:36032) 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.209+0000 7fc31a7fc640 1 -- 172.21.15.17:0/2763766985 learned_addr learned my addr 172.21.15.17:0/2763766985 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.210+0000 7fc31affd640 1 -- 172.21.15.17:0/2763766985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc31c1015d0 msgr2=0x7fc31c193740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.210+0000 7fc31affd640 1 --2- 172.21.15.17:0/2763766985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc31c1015d0 0x7fc31c193740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.210+0000 7fc31affd640 1 -- 172.21.15.17:0/2763766985 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc310009560 con 0x7fc31c100cb0 2024-08-19T01:02:34.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.210+0000 7fc31affd640 1 --2- 172.21.15.17:0/2763766985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc31c100cb0 0x7fc31c19a6b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00e970 tx=0x7fc30c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:34.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.210+0000 7fc303fff640 1 -- 172.21.15.17:0/2763766985 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc30c009620 con 0x7fc31c100cb0 2024-08-19T01:02:34.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.210+0000 7fc3213a1640 1 -- 172.21.15.17:0/2763766985 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c194270 con 0x7fc31c100cb0 2024-08-19T01:02:34.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.210+0000 7fc303fff640 1 -- 172.21.15.17:0/2763766985 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc30c0044f0 con 0x7fc31c100cb0 2024-08-19T01:02:34.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.210+0000 7fc303fff640 1 -- 172.21.15.17:0/2763766985 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc30c0049d0 con 0x7fc31c100cb0 2024-08-19T01:02:34.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.210+0000 7fc3213a1640 1 -- 172.21.15.17:0/2763766985 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c1945c0 con 0x7fc31c100cb0 2024-08-19T01:02:34.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.212+0000 7fc3213a1640 1 -- 172.21.15.17:0/2763766985 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c068510 con 0x7fc31c100cb0 2024-08-19T01:02:34.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.212+0000 7fc303fff640 1 -- 172.21.15.17:0/2763766985 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc30c004030 con 0x7fc31c100cb0 2024-08-19T01:02:34.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.212+0000 7fc303fff640 1 --2- 172.21.15.17:0/2763766985 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30406e170 0x7fc304070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:34.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.213+0000 7fc303fff640 1 -- 172.21.15.17:0/2763766985 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc30c014070 con 0x7fc31c100cb0 2024-08-19T01:02:34.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.213+0000 7fc31a7fc640 1 --2- 172.21.15.17:0/2763766985 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30406e170 0x7fc304070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:34.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.213+0000 7fc31a7fc640 1 --2- 172.21.15.17:0/2763766985 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30406e170 0x7fc304070630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc31c19abf0 tx=0x7fc310005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:34.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.217+0000 7fc303fff640 1 -- 172.21.15.17:0/2763766985 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc30c057780 con 0x7fc31c100cb0 2024-08-19T01:02:34.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:34 smithi017 ceph-mon[99370]: pgmap v90: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 1 op/s; 42/321 objects degraded (13.084%) 2024-08-19T01:02:34.403 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:34 smithi017 ceph-mon[99370]: Health check update: Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded (PG_DEGRADED) 2024-08-19T01:02:34.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:34 smithi017 ceph-mon[99370]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-19T01:02:34.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:34 smithi017 ceph-mon[99370]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:34.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:34 smithi017 ceph-mon[99370]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:34.404 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:34 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2383042910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:34.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.421+0000 7fc3213a1640 1 -- 172.21.15.17:0/2763766985 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc31c10ce40 con 0x7fc30406e170 2024-08-19T01:02:34.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.422+0000 7fc303fff640 1 -- 172.21.15.17:0/2763766985 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc31c10ce40 con 0x7fc30406e170 2024-08-19T01:02:34.424 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "8/23 daemons upgraded", 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:02:34.425 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:02:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.425+0000 7fc3213a1640 1 -- 172.21.15.17:0/2763766985 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30406e170 msgr2=0x7fc304070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.425+0000 7fc3213a1640 1 --2- 172.21.15.17:0/2763766985 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30406e170 0x7fc304070630 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc31c19abf0 tx=0x7fc310005a20 comp rx=0 tx=0).stop 2024-08-19T01:02:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.425+0000 7fc3213a1640 1 -- 172.21.15.17:0/2763766985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc31c100cb0 msgr2=0x7fc31c19a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.425+0000 7fc3213a1640 1 --2- 172.21.15.17:0/2763766985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc31c100cb0 0x7fc31c19a6b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00e970 tx=0x7fc30c00ee30 comp rx=0 tx=0).stop 2024-08-19T01:02:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.426+0000 7fc3213a1640 1 -- 172.21.15.17:0/2763766985 shutdown_connections 2024-08-19T01:02:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.426+0000 7fc3213a1640 1 --2- 172.21.15.17:0/2763766985 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30406e170 0x7fc304070630 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.426+0000 7fc3213a1640 1 --2- 172.21.15.17:0/2763766985 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc31c1015d0 0x7fc31c193740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.426+0000 7fc3213a1640 1 --2- 172.21.15.17:0/2763766985 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc31c100cb0 0x7fc31c19a6b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.426+0000 7fc3213a1640 1 -- 172.21.15.17:0/2763766985 >> 172.21.15.17:0/2763766985 conn(0x7fc31c0758a0 msgr2=0x7fc31c100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.426+0000 7fc3213a1640 1 -- 172.21.15.17:0/2763766985 shutdown_connections 2024-08-19T01:02:34.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.426+0000 7fc3213a1640 1 -- 172.21.15.17:0/2763766985 wait complete. 2024-08-19T01:02:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:34 smithi086 ceph-mon[71303]: pgmap v90: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 127 B/s rd, 1 op/s; 42/321 objects degraded (13.084%) 2024-08-19T01:02:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:34 smithi086 ceph-mon[71303]: Health check update: Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded (PG_DEGRADED) 2024-08-19T01:02:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:34 smithi086 ceph-mon[71303]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-19T01:02:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:34 smithi086 ceph-mon[71303]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:34 smithi086 ceph-mon[71303]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:34 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2383042910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:34.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 -- 172.21.15.17:0/1935821564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d34100cb0 msgr2=0x7f6d34101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:34.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 --2- 172.21.15.17:0/1935821564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d34100cb0 0x7f6d34101090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009880 tx=0x7f6d2802a530 comp rx=0 tx=0).stop 2024-08-19T01:02:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 -- 172.21.15.17:0/1935821564 shutdown_connections 2024-08-19T01:02:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 --2- 172.21.15.17:0/1935821564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d341015d0 0x7f6d34109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 --2- 172.21.15.17:0/1935821564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d34100cb0 0x7f6d34101090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 -- 172.21.15.17:0/1935821564 >> 172.21.15.17:0/1935821564 conn(0x7f6d340758a0 msgr2=0x7f6d340fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 -- 172.21.15.17:0/1935821564 shutdown_connections 2024-08-19T01:02:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 -- 172.21.15.17:0/1935821564 wait complete. 2024-08-19T01:02:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 Processor -- start 2024-08-19T01:02:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 -- start start 2024-08-19T01:02:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d34100cb0 0x7f6d3419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.517+0000 7f6d3ac73640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d341015d0 0x7f6d3419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:34.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d3ac73640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3419c3d0 con 0x7f6d34100cb0 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d3ac73640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d34195960 con 0x7f6d341015d0 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d38a0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d34100cb0 0x7f6d3419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d38a0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d34100cb0 0x7f6d3419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36054/0 (socket says 172.21.15.17:36054) 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d38a0f640 1 -- 172.21.15.17:0/2768269385 learned_addr learned my addr 172.21.15.17:0/2768269385 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d33fff640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d341015d0 0x7f6d3419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d38a0f640 1 -- 172.21.15.17:0/2768269385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d341015d0 msgr2=0x7f6d3419bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d38a0f640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d341015d0 0x7f6d3419bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d38a0f640 1 -- 172.21.15.17:0/2768269385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d28009560 con 0x7f6d34100cb0 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d33fff640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d341015d0 0x7f6d3419bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d38a0f640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d34100cb0 0x7f6d3419b870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6d2802aa50 tx=0x7f6d280055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d31ffb640 1 -- 172.21.15.17:0/2768269385 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d280048d0 con 0x7f6d34100cb0 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d31ffb640 1 -- 172.21.15.17:0/2768269385 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d28031640 con 0x7f6d34100cb0 2024-08-19T01:02:34.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d3ac73640 1 -- 172.21.15.17:0/2768269385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d34195be0 con 0x7f6d34100cb0 2024-08-19T01:02:34.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.518+0000 7f6d31ffb640 1 -- 172.21.15.17:0/2768269385 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d280038d0 con 0x7f6d34100cb0 2024-08-19T01:02:34.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.519+0000 7f6d3ac73640 1 -- 172.21.15.17:0/2768269385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d341960d0 con 0x7f6d34100cb0 2024-08-19T01:02:34.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.520+0000 7f6d3ac73640 1 -- 172.21.15.17:0/2768269385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d34068510 con 0x7f6d34100cb0 2024-08-19T01:02:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.520+0000 7f6d31ffb640 1 -- 172.21.15.17:0/2768269385 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6d2802ad50 con 0x7f6d34100cb0 2024-08-19T01:02:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.521+0000 7f6d31ffb640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d2406e170 0x7f6d24070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:02:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.521+0000 7f6d31ffb640 1 -- 172.21.15.17:0/2768269385 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6d280aee30 con 0x7f6d34100cb0 2024-08-19T01:02:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.521+0000 7f6d33fff640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d2406e170 0x7f6d24070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:02:34.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.521+0000 7f6d33fff640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d2406e170 0x7f6d24070630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6d34196dd0 tx=0x7f6d20005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:02:34.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.525+0000 7f6d31ffb640 1 -- 172.21.15.17:0/2768269385 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6d280781a0 con 0x7f6d34100cb0 2024-08-19T01:02:34.683 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:34 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[121134]: 2024-08-19T01:02:34.500+0000 7ff6adf04640 -1 osd.2 59 log_to_monitors true 2024-08-19T01:02:34.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.773+0000 7f6d3ac73640 1 -- 172.21.15.17:0/2768269385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6d34104340 con 0x7f6d34100cb0 2024-08-19T01:02:34.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.773+0000 7f6d31ffb640 1 -- 172.21.15.17:0/2768269385 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1186 (secure 0 0 0) 0x7f6d2807b860 con 0x7f6d34100cb0 2024-08-19T01:02:34.775 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded 2024-08-19T01:02:34.775 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:02:34.775 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: osd.2 (root=default,host=smithi017) is down 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 42/321 objects degraded (13.084%), 13 pgs degraded 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-08-19T01:02:34.776 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-08-19T01:02:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-08-19T01:02:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-08-19T01:02:34.777 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-08-19T01:02:34.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.775+0000 7f6d3ac73640 1 -- 172.21.15.17:0/2768269385 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d2406e170 msgr2=0x7f6d24070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.775+0000 7f6d3ac73640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d2406e170 0x7f6d24070630 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6d34196dd0 tx=0x7f6d20005f90 comp rx=0 tx=0).stop 2024-08-19T01:02:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.775+0000 7f6d3ac73640 1 -- 172.21.15.17:0/2768269385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d34100cb0 msgr2=0x7f6d3419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:02:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.775+0000 7f6d3ac73640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d34100cb0 0x7f6d3419b870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6d2802aa50 tx=0x7f6d280055a0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.775+0000 7f6d3ac73640 1 -- 172.21.15.17:0/2768269385 shutdown_connections 2024-08-19T01:02:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.775+0000 7f6d3ac73640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d2406e170 0x7f6d24070630 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.775+0000 7f6d3ac73640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d341015d0 0x7f6d3419bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.775+0000 7f6d3ac73640 1 --2- 172.21.15.17:0/2768269385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d34100cb0 0x7f6d3419b870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:02:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.775+0000 7f6d3ac73640 1 -- 172.21.15.17:0/2768269385 >> 172.21.15.17:0/2768269385 conn(0x7f6d340758a0 msgr2=0x7f6d34101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:02:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.775+0000 7f6d3ac73640 1 -- 172.21.15.17:0/2768269385 shutdown_connections 2024-08-19T01:02:34.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:02:34.775+0000 7f6d3ac73640 1 -- 172.21.15.17:0/2768269385 wait complete. 2024-08-19T01:02:35.433 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:02:35 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[121134]: 2024-08-19T01:02:35.085+0000 7ff6a5c9e640 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T01:02:35.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:35 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3942154670' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:02:35.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:35 smithi017 ceph-mon[99370]: from='client.44213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:35.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:35 smithi017 ceph-mon[99370]: from='osd.2 [v2:172.21.15.17:6818/2576526402,v1:172.21.15.17:6819/2576526402]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-19T01:02:35.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:35 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2768269385' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:02:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:35 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3942154670' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:02:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:35 smithi086 ceph-mon[71303]: from='client.44213 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:02:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:35 smithi086 ceph-mon[71303]: from='osd.2 [v2:172.21.15.17:6818/2576526402,v1:172.21.15.17:6819/2576526402]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-19T01:02:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:35 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2768269385' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:02:36.326 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:36 smithi017 ceph-mon[99370]: pgmap v91: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 3 op/s; 42/321 objects degraded (13.084%) 2024-08-19T01:02:36.326 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:36 smithi017 ceph-mon[99370]: from='osd.2 [v2:172.21.15.17:6818/2576526402,v1:172.21.15.17:6819/2576526402]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-19T01:02:36.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:36 smithi017 ceph-mon[99370]: osdmap e62: 6 total, 5 up, 6 in 2024-08-19T01:02:36.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:36 smithi017 ceph-mon[99370]: from='osd.2 [v2:172.21.15.17:6818/2576526402,v1:172.21.15.17:6819/2576526402]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T01:02:36.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:36 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:36.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:36 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:36.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:36 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:36.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:36 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:36.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:36 smithi086 ceph-mon[71303]: pgmap v91: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 3 op/s; 42/321 objects degraded (13.084%) 2024-08-19T01:02:36.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:36 smithi086 ceph-mon[71303]: from='osd.2 [v2:172.21.15.17:6818/2576526402,v1:172.21.15.17:6819/2576526402]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-19T01:02:36.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:36 smithi086 ceph-mon[71303]: osdmap e62: 6 total, 5 up, 6 in 2024-08-19T01:02:36.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:36 smithi086 ceph-mon[71303]: from='osd.2 [v2:172.21.15.17:6818/2576526402,v1:172.21.15.17:6819/2576526402]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi017", "root=default"]}]: dispatch 2024-08-19T01:02:36.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:36 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:36.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:36 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:36.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:36 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:36.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:36 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:37 smithi017 ceph-mon[99370]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:02:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:37 smithi017 ceph-mon[99370]: osd.2 [v2:172.21.15.17:6818/2576526402,v1:172.21.15.17:6819/2576526402] boot 2024-08-19T01:02:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:37 smithi017 ceph-mon[99370]: osdmap e63: 6 total, 6 up, 6 in 2024-08-19T01:02:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T01:02:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:37 smithi086 ceph-mon[71303]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:02:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:37 smithi086 ceph-mon[71303]: osd.2 [v2:172.21.15.17:6818/2576526402,v1:172.21.15.17:6819/2576526402] boot 2024-08-19T01:02:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:37 smithi086 ceph-mon[71303]: osdmap e63: 6 total, 6 up, 6 in 2024-08-19T01:02:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-19T01:02:38.348 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:38 smithi017 ceph-mon[99370]: pgmap v94: 65 pgs: 3 peering, 12 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 38/321 objects degraded (11.838%) 2024-08-19T01:02:38.348 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:38 smithi017 ceph-mon[99370]: osdmap e64: 6 total, 6 up, 6 in 2024-08-19T01:02:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:38 smithi086 ceph-mon[71303]: pgmap v94: 65 pgs: 3 peering, 12 active+undersized, 12 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 38/321 objects degraded (11.838%) 2024-08-19T01:02:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:38 smithi086 ceph-mon[71303]: osdmap e64: 6 total, 6 up, 6 in 2024-08-19T01:02:40.322 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: pgmap v96: 65 pgs: 3 peering, 7 active+undersized, 7 active+undersized+degraded, 48 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 23/321 objects degraded (7.165%) 2024-08-19T01:02:40.322 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:40.322 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:40.322 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:02:40.322 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:02:40.323 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:40.323 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: Health check update: Degraded data redundancy: 23/321 objects degraded (7.165%), 7 pgs degraded (PG_DEGRADED) 2024-08-19T01:02:40.323 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:02:40.323 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:40.323 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:40.323 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:40.323 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-19T01:02:40.323 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-19T01:02:40.323 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:40 smithi017 ceph-mon[99370]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-08-19T01:02:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: pgmap v96: 65 pgs: 3 peering, 7 active+undersized, 7 active+undersized+degraded, 48 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 23/321 objects degraded (7.165%) 2024-08-19T01:02:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:02:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:02:40.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:40.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: Health check update: Degraded data redundancy: 23/321 objects degraded (7.165%), 7 pgs degraded (PG_DEGRADED) 2024-08-19T01:02:40.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:02:40.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:40.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:40.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:02:40.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-19T01:02:40.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-19T01:02:40.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:40 smithi086 ceph-mon[71303]: Upgrade: unsafe to stop osd(s) at this time (6 PGs are or would become offline) 2024-08-19T01:02:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:42 smithi017 ceph-mon[99370]: pgmap v97: 65 pgs: 3 peering, 3 active+undersized, 2 active+undersized+degraded, 57 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 5/321 objects degraded (1.558%) 2024-08-19T01:02:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:42 smithi086 ceph-mon[71303]: pgmap v97: 65 pgs: 3 peering, 3 active+undersized, 2 active+undersized+degraded, 57 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 5/321 objects degraded (1.558%) 2024-08-19T01:02:43.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:43 smithi017 ceph-mon[99370]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/321 objects degraded (1.558%), 2 pgs degraded) 2024-08-19T01:02:43.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:43 smithi086 ceph-mon[71303]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/321 objects degraded (1.558%), 2 pgs degraded) 2024-08-19T01:02:44.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:44 smithi017 ceph-mon[99370]: pgmap v98: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-08-19T01:02:44.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:44 smithi086 ceph-mon[71303]: pgmap v98: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 2 op/s 2024-08-19T01:02:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:46 smithi017 ceph-mon[99370]: pgmap v99: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-19T01:02:46.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:46 smithi086 ceph-mon[71303]: pgmap v99: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-19T01:02:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:48 smithi017 ceph-mon[99370]: pgmap v100: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-08-19T01:02:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:02:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:48 smithi086 ceph-mon[71303]: pgmap v100: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-08-19T01:02:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:02:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:50 smithi017 ceph-mon[99370]: pgmap v101: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-19T01:02:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:50 smithi086 ceph-mon[71303]: pgmap v101: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-19T01:02:52.403 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:52 smithi086 ceph-mon[71303]: pgmap v102: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:52.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:52 smithi017 ceph-mon[99370]: pgmap v102: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:54 smithi017 ceph-mon[99370]: pgmap v103: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:54.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:54 smithi086 ceph-mon[71303]: pgmap v103: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:55 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-19T01:02:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:55 smithi086 ceph-mon[71303]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-19T01:02:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:55 smithi086 ceph-mon[71303]: Upgrade: osd.3 is safe to restart 2024-08-19T01:02:55.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:55 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-19T01:02:55.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:55 smithi017 ceph-mon[99370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-08-19T01:02:55.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:55 smithi017 ceph-mon[99370]: Upgrade: osd.3 is safe to restart 2024-08-19T01:02:56.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:56 smithi086 ceph-mon[71303]: pgmap v104: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:02:56.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:56 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:56.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:56 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-19T01:02:56.400 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:56 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:02:56.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:56 smithi017 ceph-mon[99370]: pgmap v104: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:02:56.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:56 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:02:56.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:56 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-19T01:02:56.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:56 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:02:57.340 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:57 smithi086 ceph-mon[71303]: Upgrade: Updating osd.3 2024-08-19T01:02:57.340 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:57 smithi086 ceph-mon[71303]: Deploying daemon osd.3 on smithi086 2024-08-19T01:02:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:57 smithi017 ceph-mon[99370]: Upgrade: Updating osd.3 2024-08-19T01:02:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:57 smithi017 ceph-mon[99370]: Deploying daemon osd.3 on smithi086 2024-08-19T01:02:58.330 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:02:58 smithi086 ceph-mon[71303]: pgmap v105: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:02:58 smithi017 ceph-mon[99370]: pgmap v105: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:02:59.236 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:02:58 smithi086 systemd[1]: Stopping Ceph osd.3 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:02:59.696 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:02:59 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[30489]: 2024-08-19T01:02:59.267+0000 7fc3eb157640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:02:59.696 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:02:59 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[30489]: 2024-08-19T01:02:59.267+0000 7fc3eb157640 -1 osd.3 64 *** Got signal Terminated *** 2024-08-19T01:02:59.696 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:02:59 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[30489]: 2024-08-19T01:02:59.267+0000 7fc3eb157640 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:03:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:00 smithi017 ceph-mon[99370]: pgmap v106: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:03:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:00 smithi017 ceph-mon[99370]: osd.3 marked itself down and dead 2024-08-19T01:03:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:00 smithi086 ceph-mon[71303]: pgmap v106: 65 pgs: 65 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:03:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:00 smithi086 ceph-mon[71303]: osd.3 marked itself down and dead 2024-08-19T01:03:00.777 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:00 smithi086 podman[80551]: 2024-08-19 01:03:00.470634555 +0000 UTC m=+1.330309615 container died 41d889d726f085456b83559ce2233dbcfc30969502a796115420819d95c67fb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=reef-baa926d, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-19T01:03:01.121 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:00 smithi086 podman[80551]: 2024-08-19 01:03:00.883660336 +0000 UTC m=+1.743335395 container cleanup 41d889d726f085456b83559ce2233dbcfc30969502a796115420819d95c67fb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=reef-baa926d, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:03:01.122 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:00 smithi086 bash[80551]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3 2024-08-19T01:03:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:01 smithi017 ceph-mon[99370]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:03:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:01 smithi017 ceph-mon[99370]: osdmap e65: 6 total, 5 up, 6 in 2024-08-19T01:03:01.446 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:01 smithi086 podman[80579]: 2024-08-19 01:03:01.126627813 +0000 UTC m=+0.651859013 container remove 41d889d726f085456b83559ce2233dbcfc30969502a796115420819d95c67fb2 (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3, RELEASE=reef-baa926d, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T01:03:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:01 smithi086 ceph-mon[71303]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:03:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:01 smithi086 ceph-mon[71303]: osdmap e65: 6 total, 5 up, 6 in 2024-08-19T01:03:01.823 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:01 smithi086 podman[80666]: 2024-08-19 01:03:01.452873667 +0000 UTC m=+0.017226454 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:03:01.823 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:01 smithi086 podman[80666]: 2024-08-19 01:03:01.56919015 +0000 UTC m=+0.133542938 container create 2e1c33dd8c691facbf9ec3db7f234b4f0878c5d8eb11216c4f6974c7c18d9068 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-deactivate, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-19T01:03:01.823 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:01 smithi086 podman[80666]: 2024-08-19 01:03:01.821904384 +0000 UTC m=+0.386257177 container init 2e1c33dd8c691facbf9ec3db7f234b4f0878c5d8eb11216c4f6974c7c18d9068 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True) 2024-08-19T01:03:02.135 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:01 smithi086 podman[80666]: 2024-08-19 01:03:01.825498152 +0000 UTC m=+0.389850944 container start 2e1c33dd8c691facbf9ec3db7f234b4f0878c5d8eb11216c4f6974c7c18d9068 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-19T01:03:02.135 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:01 smithi086 podman[80666]: 2024-08-19 01:03:01.913368422 +0000 UTC m=+0.477721210 container attach 2e1c33dd8c691facbf9ec3db7f234b4f0878c5d8eb11216c4f6974c7c18d9068 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-19T01:03:02.135 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:02 smithi086 podman[80666]: 2024-08-19 01:03:02.011447735 +0000 UTC m=+0.575800525 container died 2e1c33dd8c691facbf9ec3db7f234b4f0878c5d8eb11216c4f6974c7c18d9068 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-19T01:03:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:02 smithi017 ceph-mon[99370]: pgmap v108: 65 pgs: 16 stale+active+clean, 49 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:03:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:02 smithi017 ceph-mon[99370]: osdmap e66: 6 total, 5 up, 6 in 2024-08-19T01:03:02.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:02 smithi086 ceph-mon[71303]: pgmap v108: 65 pgs: 16 stale+active+clean, 49 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:03:02.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:02 smithi086 ceph-mon[71303]: osdmap e66: 6 total, 5 up, 6 in 2024-08-19T01:03:02.898 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:02 smithi086 podman[80689]: 2024-08-19 01:03:02.658466121 +0000 UTC m=+0.641141381 container remove 2e1c33dd8c691facbf9ec3db7f234b4f0878c5d8eb11216c4f6974c7c18d9068 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-19T01:03:02.898 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:02 smithi086 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.3.service: Deactivated successfully. 2024-08-19T01:03:02.898 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:02 smithi086 systemd[1]: Stopped Ceph osd.3 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:03:02.898 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:02 smithi086 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.3.service: Consumed 1min 4.671s CPU time. 2024-08-19T01:03:03.196 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:02 smithi086 systemd[1]: Starting Ceph osd.3 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:03:03.196 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 podman[80789]: 2024-08-19 01:03:03.01742283 +0000 UTC m=+0.017327959 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:03:03.196 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 podman[80789]: 2024-08-19 01:03:03.13424552 +0000 UTC m=+0.134150642 container create 17069cd434650780bf33fef4573fa3aaf549eee4c235883e719ded0b13e78097 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-19T01:03:03.535 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 podman[80789]: 2024-08-19 01:03:03.403675882 +0000 UTC m=+0.403581005 container init 17069cd434650780bf33fef4573fa3aaf549eee4c235883e719ded0b13e78097 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-19T01:03:03.535 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 podman[80789]: 2024-08-19 01:03:03.407835518 +0000 UTC m=+0.407740640 container start 17069cd434650780bf33fef4573fa3aaf549eee4c235883e719ded0b13e78097 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-19T01:03:03.535 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 podman[80789]: 2024-08-19 01:03:03.478286533 +0000 UTC m=+0.478191668 container attach 17069cd434650780bf33fef4573fa3aaf549eee4c235883e719ded0b13e78097 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-08-19T01:03:03.916 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:03.916 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:03.916 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-08-19T01:03:03.917 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-08-19T01:03:03.918 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-08-19T01:03:03.918 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-08-19T01:03:03.918 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-19T01:03:03.918 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-08-19T01:03:03.918 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-19T01:03:03.918 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-19T01:03:03.918 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate[80804]: --> ceph-volume lvm activate successful for osd ID: 3 2024-08-19T01:03:03.918 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 bash[80789]: --> ceph-volume lvm activate successful for osd ID: 3 2024-08-19T01:03:03.918 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:03 smithi086 podman[80789]: 2024-08-19 01:03:03.695259934 +0000 UTC m=+0.695165062 container died 17069cd434650780bf33fef4573fa3aaf549eee4c235883e719ded0b13e78097 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0) 2024-08-19T01:03:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:03 smithi017 ceph-mon[99370]: pgmap v110: 65 pgs: 3 active+undersized, 7 peering, 11 stale+active+clean, 6 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 18/321 objects degraded (5.607%) 2024-08-19T01:03:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:03:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:03 smithi017 ceph-mon[99370]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-19T01:03:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:03 smithi017 ceph-mon[99370]: Health check failed: Degraded data redundancy: 18/321 objects degraded (5.607%), 6 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-mon[71303]: pgmap v110: 65 pgs: 3 active+undersized, 7 peering, 11 stale+active+clean, 6 active+undersized+degraded, 38 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 18/321 objects degraded (5.607%) 2024-08-19T01:03:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:03:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-mon[71303]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-08-19T01:03:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:03 smithi086 ceph-mon[71303]: Health check failed: Degraded data redundancy: 18/321 objects degraded (5.607%), 6 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:04.618 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:04 smithi086 podman[80916]: 2024-08-19 01:03:04.365901625 +0000 UTC m=+0.665072710 container remove 17069cd434650780bf33fef4573fa3aaf549eee4c235883e719ded0b13e78097 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-19T01:03:04.618 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:04 smithi086 podman[80975]: 2024-08-19 01:03:04.482869688 +0000 UTC m=+0.017288145 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:03:04.618 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:04 smithi086 podman[80975]: 2024-08-19 01:03:04.616719133 +0000 UTC m=+0.151137635 container create da32fbdb045396085c6aacd0b32500c2fcdd8f2e97ebbfacbe2bf0958ae50196 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:03:04.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.871+0000 7f6b4a97d640 1 -- 172.21.15.17:0/4150706006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44100cb0 msgr2=0x7f6b44101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.871+0000 7f6b4a97d640 1 --2- 172.21.15.17:0/4150706006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44100cb0 0x7f6b44101090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009880 tx=0x7f6b3402a530 comp rx=0 tx=0).stop 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.871+0000 7f6b4a97d640 1 -- 172.21.15.17:0/4150706006 shutdown_connections 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.871+0000 7f6b4a97d640 1 --2- 172.21.15.17:0/4150706006 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b441015d0 0x7f6b44109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.871+0000 7f6b4a97d640 1 --2- 172.21.15.17:0/4150706006 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44100cb0 0x7f6b44101090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.871+0000 7f6b4a97d640 1 -- 172.21.15.17:0/4150706006 >> 172.21.15.17:0/4150706006 conn(0x7f6b440758a0 msgr2=0x7f6b440fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.871+0000 7f6b4a97d640 1 -- 172.21.15.17:0/4150706006 shutdown_connections 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.871+0000 7f6b4a97d640 1 -- 172.21.15.17:0/4150706006 wait complete. 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.872+0000 7f6b4a97d640 1 Processor -- start 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.872+0000 7f6b4a97d640 1 -- start start 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.872+0000 7f6b4a97d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44100cb0 0x7f6b4419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.872+0000 7f6b4a97d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b441015d0 0x7f6b4419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.872+0000 7f6b4a97d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4419c3d0 con 0x7f6b44100cb0 2024-08-19T01:03:04.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.872+0000 7f6b4a97d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b44195960 con 0x7f6b441015d0 2024-08-19T01:03:04.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b43fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44100cb0 0x7f6b4419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:04.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b43fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44100cb0 0x7f6b4419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33940/0 (socket says 172.21.15.17:33940) 2024-08-19T01:03:04.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b43fff640 1 -- 172.21.15.17:0/3723035606 learned_addr learned my addr 172.21.15.17:0/3723035606 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:04.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b437fe640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b441015d0 0x7f6b4419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b43fff640 1 -- 172.21.15.17:0/3723035606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b441015d0 msgr2=0x7f6b4419bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b43fff640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b441015d0 0x7f6b4419bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b43fff640 1 -- 172.21.15.17:0/3723035606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b34009560 con 0x7f6b44100cb0 2024-08-19T01:03:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b437fe640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b441015d0 0x7f6b4419bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T01:03:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b43fff640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44100cb0 0x7f6b4419b870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6b3402aa50 tx=0x7f6b340055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b417fa640 1 -- 172.21.15.17:0/3723035606 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b340048d0 con 0x7f6b44100cb0 2024-08-19T01:03:04.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b417fa640 1 -- 172.21.15.17:0/3723035606 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b34031640 con 0x7f6b44100cb0 2024-08-19T01:03:04.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b4a97d640 1 -- 172.21.15.17:0/3723035606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b44195be0 con 0x7f6b44100cb0 2024-08-19T01:03:04.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.873+0000 7f6b4a97d640 1 -- 172.21.15.17:0/3723035606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b441960d0 con 0x7f6b44100cb0 2024-08-19T01:03:04.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.874+0000 7f6b417fa640 1 -- 172.21.15.17:0/3723035606 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b340038d0 con 0x7f6b44100cb0 2024-08-19T01:03:04.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.874+0000 7f6b4a97d640 1 -- 172.21.15.17:0/3723035606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b30005250 con 0x7f6b44100cb0 2024-08-19T01:03:04.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.875+0000 7f6b417fa640 1 -- 172.21.15.17:0/3723035606 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6b3402ad50 con 0x7f6b44100cb0 2024-08-19T01:03:04.879 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:04 smithi086 podman[80975]: 2024-08-19 01:03:04.852142189 +0000 UTC m=+0.386560653 container init da32fbdb045396085c6aacd0b32500c2fcdd8f2e97ebbfacbe2bf0958ae50196 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-19T01:03:04.879 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:04 smithi086 podman[80975]: 2024-08-19 01:03:04.85532321 +0000 UTC m=+0.389741668 container start da32fbdb045396085c6aacd0b32500c2fcdd8f2e97ebbfacbe2bf0958ae50196 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, ceph=True) 2024-08-19T01:03:04.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.876+0000 7f6b417fa640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b2c06e170 0x7f6b2c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:04.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.876+0000 7f6b437fe640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b2c06e170 0x7f6b2c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:04.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.876+0000 7f6b417fa640 1 -- 172.21.15.17:0/3723035606 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6b340aec90 con 0x7f6b44100cb0 2024-08-19T01:03:04.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.876+0000 7f6b437fe640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b2c06e170 0x7f6b2c070630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b44196dd0 tx=0x7f6b38005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:04.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:04.880+0000 7f6b417fa640 1 -- 172.21.15.17:0/3723035606 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6b340780d0 con 0x7f6b44100cb0 2024-08-19T01:03:05.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.076+0000 7f6b4a97d640 1 -- 172.21.15.17:0/3723035606 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b30000bc0 con 0x7f6b2c06e170 2024-08-19T01:03:05.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.077+0000 7f6b417fa640 1 -- 172.21.15.17:0/3723035606 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6b30000bc0 con 0x7f6b2c06e170 2024-08-19T01:03:05.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.079+0000 7f6b4a97d640 1 -- 172.21.15.17:0/3723035606 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b2c06e170 msgr2=0x7f6b2c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.079+0000 7f6b4a97d640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b2c06e170 0x7f6b2c070630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b44196dd0 tx=0x7f6b38005f90 comp rx=0 tx=0).stop 2024-08-19T01:03:05.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.079+0000 7f6b4a97d640 1 -- 172.21.15.17:0/3723035606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44100cb0 msgr2=0x7f6b4419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.079+0000 7f6b4a97d640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44100cb0 0x7f6b4419b870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6b3402aa50 tx=0x7f6b340055a0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.079+0000 7f6b4a97d640 1 -- 172.21.15.17:0/3723035606 shutdown_connections 2024-08-19T01:03:05.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.079+0000 7f6b4a97d640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b2c06e170 0x7f6b2c070630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.079+0000 7f6b4a97d640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b441015d0 0x7f6b4419bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.079+0000 7f6b4a97d640 1 --2- 172.21.15.17:0/3723035606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b44100cb0 0x7f6b4419b870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.079+0000 7f6b4a97d640 1 -- 172.21.15.17:0/3723035606 >> 172.21.15.17:0/3723035606 conn(0x7f6b440758a0 msgr2=0x7f6b44101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:05.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.079+0000 7f6b4a97d640 1 -- 172.21.15.17:0/3723035606 shutdown_connections 2024-08-19T01:03:05.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.079+0000 7f6b4a97d640 1 -- 172.21.15.17:0/3723035606 wait complete. 2024-08-19T01:03:05.091 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:03:05.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.163+0000 7f7e78f32640 1 -- 172.21.15.17:0/3216881624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e740ff1d0 msgr2=0x7f7e740ff610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.163+0000 7f7e78f32640 1 --2- 172.21.15.17:0/3216881624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e740ff1d0 0x7f7e740ff610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009880 tx=0x7f7e6802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.164+0000 7f7e78f32640 1 -- 172.21.15.17:0/3216881624 shutdown_connections 2024-08-19T01:03:05.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.164+0000 7f7e78f32640 1 --2- 172.21.15.17:0/3216881624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e740ff1d0 0x7f7e740ff610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.164+0000 7f7e78f32640 1 --2- 172.21.15.17:0/3216881624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e74103a20 0x7f7e74103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.164+0000 7f7e78f32640 1 -- 172.21.15.17:0/3216881624 >> 172.21.15.17:0/3216881624 conn(0x7f7e740f9e70 msgr2=0x7f7e740fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.164+0000 7f7e78f32640 1 -- 172.21.15.17:0/3216881624 shutdown_connections 2024-08-19T01:03:05.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.164+0000 7f7e78f32640 1 -- 172.21.15.17:0/3216881624 wait complete. 2024-08-19T01:03:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e78f32640 1 Processor -- start 2024-08-19T01:03:05.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e78f32640 1 -- start start 2024-08-19T01:03:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e78f32640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e740ff1d0 0x7f7e741969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e78f32640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e74103a20 0x7f7e74196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e78f32640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741974d0 con 0x7f7e74103a20 2024-08-19T01:03:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e78f32640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e74197640 con 0x7f7e740ff1d0 2024-08-19T01:03:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e71d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e74103a20 0x7f7e74196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e71d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e74103a20 0x7f7e74196f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33946/0 (socket says 172.21.15.17:33946) 2024-08-19T01:03:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e71d9b640 1 -- 172.21.15.17:0/4077079032 learned_addr learned my addr 172.21.15.17:0/4077079032 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e7259c640 1 --2- 172.21.15.17:0/4077079032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e740ff1d0 0x7f7e741969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e71d9b640 1 -- 172.21.15.17:0/4077079032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e740ff1d0 msgr2=0x7f7e741969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e71d9b640 1 --2- 172.21.15.17:0/4077079032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e740ff1d0 0x7f7e741969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e71d9b640 1 -- 172.21.15.17:0/4077079032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68009560 con 0x7f7e74103a20 2024-08-19T01:03:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.165+0000 7f7e71d9b640 1 --2- 172.21.15.17:0/4077079032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e74103a20 0x7f7e74196f00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7e68006010 tx=0x7f7e680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.166+0000 7f7e637fe640 1 -- 172.21.15.17:0/4077079032 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e68004aa0 con 0x7f7e74103a20 2024-08-19T01:03:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.166+0000 7f7e637fe640 1 -- 172.21.15.17:0/4077079032 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e68031470 con 0x7f7e74103a20 2024-08-19T01:03:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.166+0000 7f7e78f32640 1 -- 172.21.15.17:0/4077079032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7419fa30 con 0x7f7e74103a20 2024-08-19T01:03:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.166+0000 7f7e637fe640 1 -- 172.21.15.17:0/4077079032 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e68003940 con 0x7f7e74103a20 2024-08-19T01:03:05.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.166+0000 7f7e78f32640 1 -- 172.21.15.17:0/4077079032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7419fd90 con 0x7f7e74103a20 2024-08-19T01:03:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.167+0000 7f7e78f32640 1 -- 172.21.15.17:0/4077079032 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e741001e0 con 0x7f7e74103a20 2024-08-19T01:03:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.167+0000 7f7e637fe640 1 -- 172.21.15.17:0/4077079032 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7e68031b90 con 0x7f7e74103a20 2024-08-19T01:03:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.168+0000 7f7e637fe640 1 --2- 172.21.15.17:0/4077079032 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e5c06e180 0x7f7e5c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.168+0000 7f7e637fe640 1 -- 172.21.15.17:0/4077079032 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7e680af160 con 0x7f7e74103a20 2024-08-19T01:03:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.168+0000 7f7e7259c640 1 --2- 172.21.15.17:0/4077079032 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e5c06e180 0x7f7e5c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:05.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.168+0000 7f7e7259c640 1 --2- 172.21.15.17:0/4077079032 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e5c06e180 0x7f7e5c070640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e64005fd0 tx=0x7f7e64009760 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:05.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.172+0000 7f7e637fe640 1 -- 172.21.15.17:0/4077079032 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7e680785a0 con 0x7f7e74103a20 2024-08-19T01:03:05.196 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:04 smithi086 ceph-osd[80995]: -- 172.21.15.86:0/108494432 <== mon.1 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561a6a2841e0 con 0x561a6949dc00 2024-08-19T01:03:05.196 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:04 smithi086 bash[80975]: da32fbdb045396085c6aacd0b32500c2fcdd8f2e97ebbfacbe2bf0958ae50196 2024-08-19T01:03:05.196 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:04 smithi086 systemd[1]: Started Ceph osd.3 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:03:05.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.361+0000 7f7e78f32640 1 -- 172.21.15.17:0/4077079032 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e7410bda0 con 0x7f7e5c06e180 2024-08-19T01:03:05.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.362+0000 7f7e637fe640 1 -- 172.21.15.17:0/4077079032 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7e7410bda0 con 0x7f7e5c06e180 2024-08-19T01:03:05.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.364+0000 7f7e78f32640 1 -- 172.21.15.17:0/4077079032 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e5c06e180 msgr2=0x7f7e5c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.364+0000 7f7e78f32640 1 --2- 172.21.15.17:0/4077079032 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e5c06e180 0x7f7e5c070640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e64005fd0 tx=0x7f7e64009760 comp rx=0 tx=0).stop 2024-08-19T01:03:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.364+0000 7f7e78f32640 1 -- 172.21.15.17:0/4077079032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e74103a20 msgr2=0x7f7e74196f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.364+0000 7f7e78f32640 1 --2- 172.21.15.17:0/4077079032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e74103a20 0x7f7e74196f00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7e68006010 tx=0x7f7e680055a0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.364+0000 7f7e78f32640 1 -- 172.21.15.17:0/4077079032 shutdown_connections 2024-08-19T01:03:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.364+0000 7f7e78f32640 1 --2- 172.21.15.17:0/4077079032 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e5c06e180 0x7f7e5c070640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.364+0000 7f7e78f32640 1 --2- 172.21.15.17:0/4077079032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e74103a20 0x7f7e74196f00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.364+0000 7f7e78f32640 1 --2- 172.21.15.17:0/4077079032 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e740ff1d0 0x7f7e741969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.364+0000 7f7e78f32640 1 -- 172.21.15.17:0/4077079032 >> 172.21.15.17:0/4077079032 conn(0x7f7e740f9e70 msgr2=0x7f7e740fab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.364+0000 7f7e78f32640 1 -- 172.21.15.17:0/4077079032 shutdown_connections 2024-08-19T01:03:05.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.365+0000 7f7e78f32640 1 -- 172.21.15.17:0/4077079032 wait complete. 2024-08-19T01:03:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.447+0000 7f8cb15a1640 1 -- 172.21.15.17:0/2204686395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac105930 msgr2=0x7f8cac105d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.447+0000 7f8cb15a1640 1 --2- 172.21.15.17:0/2204686395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac105930 0x7f8cac105d10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009880 tx=0x7f8c9c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.448+0000 7f8cb15a1640 1 -- 172.21.15.17:0/2204686395 shutdown_connections 2024-08-19T01:03:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.448+0000 7f8cb15a1640 1 --2- 172.21.15.17:0/2204686395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cac067c30 0x7f8cac068070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.448+0000 7f8cb15a1640 1 --2- 172.21.15.17:0/2204686395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac105930 0x7f8cac105d10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.448+0000 7f8cb15a1640 1 -- 172.21.15.17:0/2204686395 >> 172.21.15.17:0/2204686395 conn(0x7f8cac074540 msgr2=0x7f8cac074950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.448+0000 7f8cb15a1640 1 -- 172.21.15.17:0/2204686395 shutdown_connections 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.448+0000 7f8cb15a1640 1 -- 172.21.15.17:0/2204686395 wait complete. 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.448+0000 7f8cb15a1640 1 Processor -- start 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.448+0000 7f8cb15a1640 1 -- start start 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cb15a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac067c30 0x7f8cac0fec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cb15a1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cac105930 0x7f8cac0ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cb15a1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0ff6f0 con 0x7f8cac067c30 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cb15a1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0ff860 con 0x7f8cac105930 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac067c30 0x7f8cac0fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cabfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac067c30 0x7f8cac0fec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33964/0 (socket says 172.21.15.17:33964) 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cabfff640 1 -- 172.21.15.17:0/3218866375 learned_addr learned my addr 172.21.15.17:0/3218866375 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:05.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cab7fe640 1 --2- 172.21.15.17:0/3218866375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cac105930 0x7f8cac0ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cabfff640 1 -- 172.21.15.17:0/3218866375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cac105930 msgr2=0x7f8cac0ff1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cabfff640 1 --2- 172.21.15.17:0/3218866375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cac105930 0x7f8cac0ff1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cabfff640 1 -- 172.21.15.17:0/3218866375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c009560 con 0x7f8cac067c30 2024-08-19T01:03:05.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8cabfff640 1 --2- 172.21.15.17:0/3218866375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac067c30 0x7f8cac0fec70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c02a9c0 tx=0x7f8c9c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.449+0000 7f8ca97fa640 1 -- 172.21.15.17:0/3218866375 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9c004aa0 con 0x7f8cac067c30 2024-08-19T01:03:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.450+0000 7f8ca97fa640 1 -- 172.21.15.17:0/3218866375 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c9c004c00 con 0x7f8cac067c30 2024-08-19T01:03:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.450+0000 7f8ca97fa640 1 -- 172.21.15.17:0/3218866375 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9c003980 con 0x7f8cac067c30 2024-08-19T01:03:05.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.450+0000 7f8cb15a1640 1 -- 172.21.15.17:0/3218866375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac0ffae0 con 0x7f8cac067c30 2024-08-19T01:03:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.450+0000 7f8cb15a1640 1 -- 172.21.15.17:0/3218866375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac1a1d00 con 0x7f8cac067c30 2024-08-19T01:03:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.451+0000 7f8cb15a1640 1 -- 172.21.15.17:0/3218866375 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac101060 con 0x7f8cac067c30 2024-08-19T01:03:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.451+0000 7f8ca97fa640 1 -- 172.21.15.17:0/3218866375 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8c9c003bf0 con 0x7f8cac067c30 2024-08-19T01:03:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.451+0000 7f8ca97fa640 1 --2- 172.21.15.17:0/3218866375 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c9406e170 0x7f8c94070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.452+0000 7f8ca97fa640 1 -- 172.21.15.17:0/3218866375 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8c9c0aef00 con 0x7f8cac067c30 2024-08-19T01:03:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.452+0000 7f8cab7fe640 1 --2- 172.21.15.17:0/3218866375 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c9406e170 0x7f8c94070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:05.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.452+0000 7f8cab7fe640 1 --2- 172.21.15.17:0/3218866375 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c9406e170 0x7f8c94070630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8cac1003f0 tx=0x7f8ca000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:05.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.456+0000 7f8ca97fa640 1 -- 172.21.15.17:0/3218866375 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8c9c078340 con 0x7f8cac067c30 2024-08-19T01:03:05.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.639+0000 7f8cb15a1640 1 -- 172.21.15.17:0/3218866375 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cac0ffae0 con 0x7f8c9406e170 2024-08-19T01:03:05.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.648+0000 7f8ca97fa640 1 -- 172.21.15.17:0/3218866375 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f8cac0ffae0 con 0x7f8c9406e170 2024-08-19T01:03:05.651 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:03:05.651 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (4m) 30s ago 14m 26.7M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:03:05.651 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (15m) 30s ago 15m 8862k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:03:05.651 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (14m) 2m ago 14m 8182k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:03:05.651 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (2m) 30s ago 15m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:03:05.651 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (2m) 2m ago 14m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:03:05.651 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (4m) 30s ago 14m 79.7M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:03:05.651 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (9m) 30s ago 9m 156M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (9m) 30s ago 9m 92.0M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (9m) 2m ago 9m 26.6M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (9m) 2m ago 9m 25.9M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (6m) 30s ago 16m 498M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (5m) 2m ago 14m 439M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (3m) 30s ago 16m 47.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (2m) 2m ago 13m 36.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (5m) 30s ago 15m 16.0M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (4m) 2m ago 14m 15.5M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (105s) 30s ago 13m 85.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (70s) 30s ago 12m 87.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (36s) 30s ago 12m 11.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:03:05.652 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 starting - - - 2240M 2024-08-19T01:03:05.653 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (11m) 2m ago 11m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 b15aa7e403b5 2024-08-19T01:03:05.653 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (11m) 2m ago 11m 220M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T01:03:05.653 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (4m) 30s ago 14m 67.3M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:03:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.650+0000 7f8cb15a1640 1 -- 172.21.15.17:0/3218866375 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c9406e170 msgr2=0x7f8c94070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.650+0000 7f8cb15a1640 1 --2- 172.21.15.17:0/3218866375 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c9406e170 0x7f8c94070630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8cac1003f0 tx=0x7f8ca000b390 comp rx=0 tx=0).stop 2024-08-19T01:03:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.650+0000 7f8cb15a1640 1 -- 172.21.15.17:0/3218866375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac067c30 msgr2=0x7f8cac0fec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.650+0000 7f8cb15a1640 1 --2- 172.21.15.17:0/3218866375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac067c30 0x7f8cac0fec70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c02a9c0 tx=0x7f8c9c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.651+0000 7f8cb15a1640 1 -- 172.21.15.17:0/3218866375 shutdown_connections 2024-08-19T01:03:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.651+0000 7f8cb15a1640 1 --2- 172.21.15.17:0/3218866375 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c9406e170 0x7f8c94070630 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.651+0000 7f8cb15a1640 1 --2- 172.21.15.17:0/3218866375 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8cac105930 0x7f8cac0ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.651+0000 7f8cb15a1640 1 --2- 172.21.15.17:0/3218866375 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8cac067c30 0x7f8cac0fec70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.651+0000 7f8cb15a1640 1 -- 172.21.15.17:0/3218866375 >> 172.21.15.17:0/3218866375 conn(0x7f8cac074540 msgr2=0x7f8cac0fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.651+0000 7f8cb15a1640 1 -- 172.21.15.17:0/3218866375 shutdown_connections 2024-08-19T01:03:05.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.651+0000 7f8cb15a1640 1 -- 172.21.15.17:0/3218866375 wait complete. 2024-08-19T01:03:05.696 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:05 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[80991]: 2024-08-19T01:03:05.408+0000 7f5e253cb640 -1 Falling back to public interface 2024-08-19T01:03:05.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.731+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/2605454116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340ff230 msgr2=0x7fdd3410bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.731+0000 7fdd3bfa1640 1 --2- 172.21.15.17:0/2605454116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340ff230 0x7fdd3410bef0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009880 tx=0x7fdd2402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.731+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/2605454116 shutdown_connections 2024-08-19T01:03:05.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.731+0000 7fdd3bfa1640 1 --2- 172.21.15.17:0/2605454116 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340ff230 0x7fdd3410bef0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.731+0000 7fdd3bfa1640 1 --2- 172.21.15.17:0/2605454116 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd340fe880 0x7fdd340fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.731+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/2605454116 >> 172.21.15.17:0/2605454116 conn(0x7fdd340fa730 msgr2=0x7fdd340fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:05.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.731+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/2605454116 shutdown_connections 2024-08-19T01:03:05.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.731+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/2605454116 wait complete. 2024-08-19T01:03:05.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.732+0000 7fdd3bfa1640 1 Processor -- start 2024-08-19T01:03:05.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.732+0000 7fdd3bfa1640 1 -- start start 2024-08-19T01:03:05.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.732+0000 7fdd3bfa1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340fe880 0x7fdd3419d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:05.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.732+0000 7fdd3bfa1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd340ff230 0x7fdd3419df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:05.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.732+0000 7fdd3bfa1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3419e530 con 0x7fdd340fe880 2024-08-19T01:03:05.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.732+0000 7fdd3bfa1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34197ac0 con 0x7fdd340ff230 2024-08-19T01:03:05.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd39d3d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340fe880 0x7fdd3419d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:05.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd39d3d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340fe880 0x7fdd3419d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33974/0 (socket says 172.21.15.17:33974) 2024-08-19T01:03:05.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd39d3d640 1 -- 172.21.15.17:0/1063687790 learned_addr learned my addr 172.21.15.17:0/1063687790 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:05.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd3953c640 1 --2- 172.21.15.17:0/1063687790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd340ff230 0x7fdd3419df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:05.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd39d3d640 1 -- 172.21.15.17:0/1063687790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd340ff230 msgr2=0x7fdd3419df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd39d3d640 1 --2- 172.21.15.17:0/1063687790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd340ff230 0x7fdd3419df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd39d3d640 1 -- 172.21.15.17:0/1063687790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd24009560 con 0x7fdd340fe880 2024-08-19T01:03:05.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd39d3d640 1 --2- 172.21.15.17:0/1063687790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340fe880 0x7fdd3419d9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000ea00 tx=0x7fdd3000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:05.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd2affd640 1 -- 172.21.15.17:0/1063687790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd3000cd50 con 0x7fdd340fe880 2024-08-19T01:03:05.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd2affd640 1 -- 172.21.15.17:0/1063687790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd30005020 con 0x7fdd340fe880 2024-08-19T01:03:05.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/1063687790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd34197da0 con 0x7fdd340fe880 2024-08-19T01:03:05.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd2affd640 1 -- 172.21.15.17:0/1063687790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd300116a0 con 0x7fdd340fe880 2024-08-19T01:03:05.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.733+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/1063687790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd341982c0 con 0x7fdd340fe880 2024-08-19T01:03:05.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.734+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/1063687790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd34068d30 con 0x7fdd340fe880 2024-08-19T01:03:05.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.735+0000 7fdd2affd640 1 -- 172.21.15.17:0/1063687790 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdd30005190 con 0x7fdd340fe880 2024-08-19T01:03:05.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.736+0000 7fdd2affd640 1 --2- 172.21.15.17:0/1063687790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd2006e180 0x7fdd20070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:05.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.736+0000 7fdd3953c640 1 --2- 172.21.15.17:0/1063687790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd2006e180 0x7fdd20070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:05.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.736+0000 7fdd2affd640 1 -- 172.21.15.17:0/1063687790 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdd3008e3e0 con 0x7fdd340fe880 2024-08-19T01:03:05.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.736+0000 7fdd3953c640 1 --2- 172.21.15.17:0/1063687790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd2006e180 0x7fdd20070640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdd24000c00 tx=0x7fdd24005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:05.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.740+0000 7fdd2affd640 1 -- 172.21.15.17:0/1063687790 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdd300577f0 con 0x7fdd340fe880 2024-08-19T01:03:05.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.990+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/1063687790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdd34106770 con 0x7fdd340fe880 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.990+0000 7fdd2affd640 1 -- 172.21.15.17:0/1063687790 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+829 (secure 0 0 0) 0x7fdd3001f350 con 0x7fdd340fe880 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2, 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:03:05.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:03:05.994 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:03:05.994 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T01:03:05.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:03:05.994 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:03:05.994 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 6, 2024-08-19T01:03:05.994 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 7 2024-08-19T01:03:05.994 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:03:05.994 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:03:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.992+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/1063687790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd2006e180 msgr2=0x7fdd20070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.992+0000 7fdd3bfa1640 1 --2- 172.21.15.17:0/1063687790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd2006e180 0x7fdd20070640 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdd24000c00 tx=0x7fdd24005e30 comp rx=0 tx=0).stop 2024-08-19T01:03:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.992+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/1063687790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340fe880 msgr2=0x7fdd3419d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.992+0000 7fdd3bfa1640 1 --2- 172.21.15.17:0/1063687790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340fe880 0x7fdd3419d9d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000ea00 tx=0x7fdd3000eec0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.992+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/1063687790 shutdown_connections 2024-08-19T01:03:05.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.992+0000 7fdd3bfa1640 1 --2- 172.21.15.17:0/1063687790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd2006e180 0x7fdd20070640 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.992+0000 7fdd3bfa1640 1 --2- 172.21.15.17:0/1063687790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd340ff230 0x7fdd3419df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.992+0000 7fdd3bfa1640 1 --2- 172.21.15.17:0/1063687790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd340fe880 0x7fdd3419d9d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.992+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/1063687790 >> 172.21.15.17:0/1063687790 conn(0x7fdd340fa730 msgr2=0x7fdd340fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.993+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/1063687790 shutdown_connections 2024-08-19T01:03:05.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:05.993+0000 7fdd3bfa1640 1 -- 172.21.15.17:0/1063687790 wait complete. 2024-08-19T01:03:06.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.075+0000 7f8dd8317640 1 -- 172.21.15.17:0/2224448501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dd0103a20 msgr2=0x7f8dd0103e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.075+0000 7f8dd8317640 1 --2- 172.21.15.17:0/2224448501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dd0103a20 0x7f8dd0103e00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0009c20 tx=0x7f8dc002a970 comp rx=0 tx=0).stop 2024-08-19T01:03:06.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.075+0000 7f8dd8317640 1 -- 172.21.15.17:0/2224448501 shutdown_connections 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.075+0000 7f8dd8317640 1 --2- 172.21.15.17:0/2224448501 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd00ff1d0 0x7f8dd00ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.075+0000 7f8dd8317640 1 --2- 172.21.15.17:0/2224448501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dd0103a20 0x7f8dd0103e00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.075+0000 7f8dd8317640 1 -- 172.21.15.17:0/2224448501 >> 172.21.15.17:0/2224448501 conn(0x7f8dd00f9e70 msgr2=0x7f8dd00fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.075+0000 7f8dd8317640 1 -- 172.21.15.17:0/2224448501 shutdown_connections 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.075+0000 7f8dd8317640 1 -- 172.21.15.17:0/2224448501 wait complete. 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.075+0000 7f8dd8317640 1 Processor -- start 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.075+0000 7f8dd8317640 1 -- start start 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd8317640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd00ff1d0 0x7f8dd019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd8317640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dd0103a20 0x7f8dd019bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd8317640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd019c4f0 con 0x7f8dd0103a20 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd8317640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd0195a80 con 0x7f8dd00ff1d0 2024-08-19T01:03:06.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd58b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dd0103a20 0x7f8dd019bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:06.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd58b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dd0103a20 0x7f8dd019bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34000/0 (socket says 172.21.15.17:34000) 2024-08-19T01:03:06.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd58b2640 1 -- 172.21.15.17:0/3547433365 learned_addr learned my addr 172.21.15.17:0/3547433365 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:06.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd60b3640 1 --2- 172.21.15.17:0/3547433365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd00ff1d0 0x7f8dd019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:06.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd58b2640 1 -- 172.21.15.17:0/3547433365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd00ff1d0 msgr2=0x7f8dd019b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd58b2640 1 --2- 172.21.15.17:0/3547433365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd00ff1d0 0x7f8dd019b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd58b2640 1 -- 172.21.15.17:0/3547433365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc0009900 con 0x7f8dd0103a20 2024-08-19T01:03:06.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd58b2640 1 --2- 172.21.15.17:0/3547433365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dd0103a20 0x7f8dd019bed0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400b420 tx=0x7f8dc400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:06.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dcf7fe640 1 -- 172.21.15.17:0/3547433365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dc4011800 con 0x7f8dd0103a20 2024-08-19T01:03:06.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dcf7fe640 1 -- 172.21.15.17:0/3547433365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8dc4011e20 con 0x7f8dd0103a20 2024-08-19T01:03:06.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.076+0000 7f8dd8317640 1 -- 172.21.15.17:0/3547433365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd0195d60 con 0x7f8dd0103a20 2024-08-19T01:03:06.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.077+0000 7f8dcf7fe640 1 -- 172.21.15.17:0/3547433365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dc400f2e0 con 0x7f8dd0103a20 2024-08-19T01:03:06.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.077+0000 7f8dd8317640 1 -- 172.21.15.17:0/3547433365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd01962b0 con 0x7f8dd0103a20 2024-08-19T01:03:06.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.078+0000 7f8dd8317640 1 -- 172.21.15.17:0/3547433365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd01001e0 con 0x7f8dd0103a20 2024-08-19T01:03:06.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.078+0000 7f8dcf7fe640 1 -- 172.21.15.17:0/3547433365 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8dc4010380 con 0x7f8dd0103a20 2024-08-19T01:03:06.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.078+0000 7f8dcf7fe640 1 --2- 172.21.15.17:0/3547433365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8db806e170 0x7f8db8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:06.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.079+0000 7f8dcf7fe640 1 -- 172.21.15.17:0/3547433365 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8dc408d9b0 con 0x7f8dd0103a20 2024-08-19T01:03:06.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.079+0000 7f8dd60b3640 1 --2- 172.21.15.17:0/3547433365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8db806e170 0x7f8db8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:06.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.079+0000 7f8dd60b3640 1 --2- 172.21.15.17:0/3547433365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8db806e170 0x7f8db8070630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0000f80 tx=0x7f8dc003d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:06.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.083+0000 7f8dcf7fe640 1 -- 172.21.15.17:0/3547433365 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8dc4056d40 con 0x7f8dd0103a20 2024-08-19T01:03:06.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.293+0000 7f8dd8317640 1 -- 172.21.15.17:0/3547433365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8dd00ff610 con 0x7f8dd0103a20 2024-08-19T01:03:06.295 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:06 smithi017 ceph-mon[99370]: pgmap v111: 65 pgs: 13 active+undersized, 7 peering, 1 stale+active+clean, 14 active+undersized+degraded, 30 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-08-19T01:03:06.295 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:06 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:06.295 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:06 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:06.295 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:06 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:03:06.295 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:06 smithi017 ceph-mon[99370]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:06.296 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:06 smithi017 ceph-mon[99370]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:06.296 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:06 smithi017 ceph-mon[99370]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:06.296 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:06 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1063687790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:06.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.293+0000 7f8dcf7fe640 1 -- 172.21.15.17:0/3547433365 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1933 (secure 0 0 0) 0x7f8dc405a400 con 0x7f8dd0103a20 2024-08-19T01:03:06.296 INFO:teuthology.orchestra.run.smithi017.stdout:e21 2024-08-19T01:03:06.296 INFO:teuthology.orchestra.run.smithi017.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-19T01:03:06.296 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:03:06.296 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 21 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T00:53:41.004049+0000 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:03:06.297 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 46 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14486,1=24299} 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:03:06.298 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:03:06.299 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:03:06.299 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:03:06.299 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:03:06.299 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:03:06.299 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:03:06.299 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:03:06.299 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:03:06.299 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:03:06.299 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:03:06.299 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:03:06.300 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T01:03:06.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.295+0000 7f8dd8317640 1 -- 172.21.15.17:0/3547433365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8db806e170 msgr2=0x7f8db8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.295+0000 7f8dd8317640 1 --2- 172.21.15.17:0/3547433365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8db806e170 0x7f8db8070630 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0000f80 tx=0x7f8dc003d040 comp rx=0 tx=0).stop 2024-08-19T01:03:06.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.295+0000 7f8dd8317640 1 -- 172.21.15.17:0/3547433365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dd0103a20 msgr2=0x7f8dd019bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.295+0000 7f8dd8317640 1 --2- 172.21.15.17:0/3547433365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dd0103a20 0x7f8dd019bed0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400b420 tx=0x7f8dc400b8e0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.295+0000 7f8dd8317640 1 -- 172.21.15.17:0/3547433365 shutdown_connections 2024-08-19T01:03:06.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.295+0000 7f8dd8317640 1 --2- 172.21.15.17:0/3547433365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8db806e170 0x7f8db8070630 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.295+0000 7f8dd8317640 1 --2- 172.21.15.17:0/3547433365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8dd0103a20 0x7f8dd019bed0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.295+0000 7f8dd8317640 1 --2- 172.21.15.17:0/3547433365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8dd00ff1d0 0x7f8dd019b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.295+0000 7f8dd8317640 1 -- 172.21.15.17:0/3547433365 >> 172.21.15.17:0/3547433365 conn(0x7f8dd00f9e70 msgr2=0x7f8dd00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:06.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.295+0000 7f8dd8317640 1 -- 172.21.15.17:0/3547433365 shutdown_connections 2024-08-19T01:03:06.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.295+0000 7f8dd8317640 1 -- 172.21.15.17:0/3547433365 wait complete. 2024-08-19T01:03:06.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.379+0000 7f3fb7e41640 1 -- 172.21.15.17:0/3661256565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb01049f0 msgr2=0x7f3fb0104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.379+0000 7f3fb7e41640 1 --2- 172.21.15.17:0/3661256565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb01049f0 0x7f3fb0104dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8009880 tx=0x7f3fa802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.379+0000 7f3fb7e41640 1 -- 172.21.15.17:0/3661256565 shutdown_connections 2024-08-19T01:03:06.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.379+0000 7f3fb7e41640 1 --2- 172.21.15.17:0/3661256565 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb00fe9f0 0x7f3fb00fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.379+0000 7f3fb7e41640 1 --2- 172.21.15.17:0/3661256565 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb01049f0 0x7f3fb0104dd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.379+0000 7f3fb7e41640 1 -- 172.21.15.17:0/3661256565 >> 172.21.15.17:0/3661256565 conn(0x7f3fb00758a0 msgr2=0x7f3fb00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:06.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.379+0000 7f3fb7e41640 1 -- 172.21.15.17:0/3661256565 shutdown_connections 2024-08-19T01:03:06.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.379+0000 7f3fb7e41640 1 -- 172.21.15.17:0/3661256565 wait complete. 2024-08-19T01:03:06.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.379+0000 7f3fb7e41640 1 Processor -- start 2024-08-19T01:03:06.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.379+0000 7f3fb7e41640 1 -- start start 2024-08-19T01:03:06.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb7e41640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb00fe9f0 0x7f3fb0196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:06.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb7e41640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb01049f0 0x7f3fb0196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb7e41640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb0197490 con 0x7f3fb00fe9f0 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb7e41640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb0197600 con 0x7f3fb01049f0 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb5bdd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb00fe9f0 0x7f3fb0196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb5bdd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb00fe9f0 0x7f3fb0196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34028/0 (socket says 172.21.15.17:34028) 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb5bdd640 1 -- 172.21.15.17:0/314108917 learned_addr learned my addr 172.21.15.17:0/314108917 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb53dc640 1 --2- 172.21.15.17:0/314108917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb01049f0 0x7f3fb0196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb5bdd640 1 -- 172.21.15.17:0/314108917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb01049f0 msgr2=0x7f3fb0196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb5bdd640 1 --2- 172.21.15.17:0/314108917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb01049f0 0x7f3fb0196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb5bdd640 1 -- 172.21.15.17:0/314108917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa8009560 con 0x7f3fb00fe9f0 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.380+0000 7f3fb5bdd640 1 --2- 172.21.15.17:0/314108917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb00fe9f0 0x7f3fb0196980 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3fa802a9c0 tx=0x7f3fa80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.381+0000 7f3faeffd640 1 -- 172.21.15.17:0/314108917 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa8004aa0 con 0x7f3fb00fe9f0 2024-08-19T01:03:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.381+0000 7f3fb7e41640 1 -- 172.21.15.17:0/314108917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb019f9f0 con 0x7f3fb00fe9f0 2024-08-19T01:03:06.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.381+0000 7f3faeffd640 1 -- 172.21.15.17:0/314108917 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3fa8004c00 con 0x7f3fb00fe9f0 2024-08-19T01:03:06.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.381+0000 7f3faeffd640 1 -- 172.21.15.17:0/314108917 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fa8003980 con 0x7f3fb00fe9f0 2024-08-19T01:03:06.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.381+0000 7f3fb7e41640 1 -- 172.21.15.17:0/314108917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb019fd50 con 0x7f3fb00fe9f0 2024-08-19T01:03:06.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.382+0000 7f3fb7e41640 1 -- 172.21.15.17:0/314108917 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb0100130 con 0x7f3fb00fe9f0 2024-08-19T01:03:06.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.382+0000 7f3faeffd640 1 -- 172.21.15.17:0/314108917 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3fa8003bf0 con 0x7f3fb00fe9f0 2024-08-19T01:03:06.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.383+0000 7f3faeffd640 1 --2- 172.21.15.17:0/314108917 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f9806e170 0x7f3f98070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:06.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.383+0000 7f3faeffd640 1 -- 172.21.15.17:0/314108917 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3fa80af0b0 con 0x7f3fb00fe9f0 2024-08-19T01:03:06.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.383+0000 7f3fb53dc640 1 --2- 172.21.15.17:0/314108917 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f9806e170 0x7f3f98070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:06.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.383+0000 7f3fb53dc640 1 --2- 172.21.15.17:0/314108917 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f9806e170 0x7f3f98070630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0068470 tx=0x7f3fa400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:06.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.387+0000 7f3faeffd640 1 -- 172.21.15.17:0/314108917 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3fa80784f0 con 0x7f3fb00fe9f0 2024-08-19T01:03:06.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:06 smithi086 ceph-mon[71303]: pgmap v111: 65 pgs: 13 active+undersized, 7 peering, 1 stale+active+clean, 14 active+undersized+degraded, 30 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 54/321 objects degraded (16.822%) 2024-08-19T01:03:06.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:06 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:06.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:06 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:06.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:06 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:03:06.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:06 smithi086 ceph-mon[71303]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:06.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:06 smithi086 ceph-mon[71303]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:06.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:06 smithi086 ceph-mon[71303]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:06.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:06 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1063687790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:06.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.582+0000 7f3fb7e41640 1 -- 172.21.15.17:0/314108917 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fb0068220 con 0x7f3f9806e170 2024-08-19T01:03:06.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.583+0000 7f3faeffd640 1 -- 172.21.15.17:0/314108917 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3fb0068220 con 0x7f3f9806e170 2024-08-19T01:03:06.585 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:03:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:03:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:03:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:03:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:03:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:03:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:03:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:03:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:03:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "9/23 daemons upgraded", 2024-08-19T01:03:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-08-19T01:03:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:03:06.586 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:03:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.585+0000 7f3fb7e41640 1 -- 172.21.15.17:0/314108917 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f9806e170 msgr2=0x7f3f98070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.585+0000 7f3fb7e41640 1 --2- 172.21.15.17:0/314108917 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f9806e170 0x7f3f98070630 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0068470 tx=0x7f3fa400b390 comp rx=0 tx=0).stop 2024-08-19T01:03:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.585+0000 7f3fb7e41640 1 -- 172.21.15.17:0/314108917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb00fe9f0 msgr2=0x7f3fb0196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.585+0000 7f3fb7e41640 1 --2- 172.21.15.17:0/314108917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb00fe9f0 0x7f3fb0196980 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3fa802a9c0 tx=0x7f3fa80055a0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.585+0000 7f3fb7e41640 1 -- 172.21.15.17:0/314108917 shutdown_connections 2024-08-19T01:03:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.585+0000 7f3fb7e41640 1 --2- 172.21.15.17:0/314108917 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f9806e170 0x7f3f98070630 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.585+0000 7f3fb7e41640 1 --2- 172.21.15.17:0/314108917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3fb01049f0 0x7f3fb0196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.585+0000 7f3fb7e41640 1 --2- 172.21.15.17:0/314108917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3fb00fe9f0 0x7f3fb0196980 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.585+0000 7f3fb7e41640 1 -- 172.21.15.17:0/314108917 >> 172.21.15.17:0/314108917 conn(0x7f3fb00758a0 msgr2=0x7f3fb00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.586+0000 7f3fb7e41640 1 -- 172.21.15.17:0/314108917 shutdown_connections 2024-08-19T01:03:06.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.586+0000 7f3fb7e41640 1 -- 172.21.15.17:0/314108917 wait complete. 2024-08-19T01:03:06.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.667+0000 7fd14e4f6640 1 -- 172.21.15.17:0/4105456440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1481016b0 msgr2=0x7fd148109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.667+0000 7fd14e4f6640 1 --2- 172.21.15.17:0/4105456440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1481016b0 0x7fd148109ba0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0098b0 tx=0x7fd13c02a4d0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.667+0000 7fd14e4f6640 1 -- 172.21.15.17:0/4105456440 shutdown_connections 2024-08-19T01:03:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.667+0000 7fd14e4f6640 1 --2- 172.21.15.17:0/4105456440 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd1481016b0 0x7fd148109ba0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.667+0000 7fd14e4f6640 1 --2- 172.21.15.17:0/4105456440 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd148100d90 0x7fd148101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.667+0000 7fd14e4f6640 1 -- 172.21.15.17:0/4105456440 >> 172.21.15.17:0/4105456440 conn(0x7fd1480fa730 msgr2=0x7fd1480fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.667+0000 7fd14e4f6640 1 -- 172.21.15.17:0/4105456440 shutdown_connections 2024-08-19T01:03:06.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.667+0000 7fd14e4f6640 1 -- 172.21.15.17:0/4105456440 wait complete. 2024-08-19T01:03:06.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.668+0000 7fd14e4f6640 1 Processor -- start 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.668+0000 7fd14e4f6640 1 -- start start 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.668+0000 7fd14e4f6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd148100d90 0x7fd1480fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.668+0000 7fd14e4f6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1481016b0 0x7fd1480fef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.668+0000 7fd14e4f6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480ff470 con 0x7fd148100d90 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.668+0000 7fd14e4f6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1480ff5e0 con 0x7fd1481016b0 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.668+0000 7fd147fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd148100d90 0x7fd1480fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.668+0000 7fd147fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd148100d90 0x7fd1480fe9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34042/0 (socket says 172.21.15.17:34042) 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.668+0000 7fd147fff640 1 -- 172.21.15.17:0/1701269949 learned_addr learned my addr 172.21.15.17:0/1701269949 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.669+0000 7fd1477fe640 1 --2- 172.21.15.17:0/1701269949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1481016b0 0x7fd1480fef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.669+0000 7fd147fff640 1 -- 172.21.15.17:0/1701269949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1481016b0 msgr2=0x7fd1480fef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.669+0000 7fd147fff640 1 --2- 172.21.15.17:0/1701269949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1481016b0 0x7fd1480fef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.669+0000 7fd147fff640 1 -- 172.21.15.17:0/1701269949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c009560 con 0x7fd148100d90 2024-08-19T01:03:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.669+0000 7fd147fff640 1 --2- 172.21.15.17:0/1701269949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd148100d90 0x7fd1480fe9f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd13800e970 tx=0x7fd13800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.669+0000 7fd1457fa640 1 -- 172.21.15.17:0/1701269949 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd13800cc90 con 0x7fd148100d90 2024-08-19T01:03:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.669+0000 7fd1457fa640 1 -- 172.21.15.17:0/1701269949 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd13800cdf0 con 0x7fd148100d90 2024-08-19T01:03:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.669+0000 7fd14e4f6640 1 -- 172.21.15.17:0/1701269949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1481a1cd0 con 0x7fd148100d90 2024-08-19T01:03:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.669+0000 7fd1457fa640 1 -- 172.21.15.17:0/1701269949 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd138010430 con 0x7fd148100d90 2024-08-19T01:03:06.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.669+0000 7fd14e4f6640 1 -- 172.21.15.17:0/1701269949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1481a2030 con 0x7fd148100d90 2024-08-19T01:03:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.670+0000 7fd14e4f6640 1 -- 172.21.15.17:0/1701269949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd148068c90 con 0x7fd148100d90 2024-08-19T01:03:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.670+0000 7fd1457fa640 1 -- 172.21.15.17:0/1701269949 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd138005020 con 0x7fd148100d90 2024-08-19T01:03:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.671+0000 7fd1457fa640 1 --2- 172.21.15.17:0/1701269949 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd13006e170 0x7fd130070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.671+0000 7fd1457fa640 1 -- 172.21.15.17:0/1701269949 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd138014070 con 0x7fd148100d90 2024-08-19T01:03:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.671+0000 7fd1477fe640 1 --2- 172.21.15.17:0/1701269949 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd13006e170 0x7fd130070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:06.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.671+0000 7fd1477fe640 1 --2- 172.21.15.17:0/1701269949 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd13006e170 0x7fd130070630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009230 tx=0x7fd13c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:06.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.675+0000 7fd1457fa640 1 -- 172.21.15.17:0/1701269949 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd138057a40 con 0x7fd148100d90 2024-08-19T01:03:06.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.924+0000 7fd14e4f6640 1 -- 172.21.15.17:0/1701269949 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd1480ff7a0 con 0x7fd148100d90 2024-08-19T01:03:06.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.925+0000 7fd1457fa640 1 -- 172.21.15.17:0/1701269949 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1579 (secure 0 0 0) 0x7fd1480ff7a0 con 0x7fd148100d90 2024-08-19T01:03:06.927 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Reduced data availability: 3 pgs peering; Degraded data redundancy: 54/321 objects degraded (16.822%), 14 pgs degraded 2024-08-19T01:03:06.927 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:03:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:03:06.927 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-19T01:03:06.927 INFO:teuthology.orchestra.run.smithi017.stdout: osd.3 (root=default,host=smithi086) is down 2024-08-19T01:03:06.927 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 3 pgs peering 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 1.0 is stuck peering for 2m, current state peering, last acting [0,1] 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.5 is stuck peering for 5m, current state peering, last acting [0,4] 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 3.15 is stuck peering for 5m, current state peering, last acting [0,4] 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 54/321 objects degraded (16.822%), 14 pgs degraded 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-08-19T01:03:06.928 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-08-19T01:03:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-08-19T01:03:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-08-19T01:03:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-08-19T01:03:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-08-19T01:03:06.929 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-08-19T01:03:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.927+0000 7fd14e4f6640 1 -- 172.21.15.17:0/1701269949 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd13006e170 msgr2=0x7fd130070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.927+0000 7fd14e4f6640 1 --2- 172.21.15.17:0/1701269949 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd13006e170 0x7fd130070630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009230 tx=0x7fd13c005a20 comp rx=0 tx=0).stop 2024-08-19T01:03:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.927+0000 7fd14e4f6640 1 -- 172.21.15.17:0/1701269949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd148100d90 msgr2=0x7fd1480fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.927+0000 7fd14e4f6640 1 --2- 172.21.15.17:0/1701269949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd148100d90 0x7fd1480fe9f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd13800e970 tx=0x7fd13800ed70 comp rx=0 tx=0).stop 2024-08-19T01:03:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.927+0000 7fd14e4f6640 1 -- 172.21.15.17:0/1701269949 shutdown_connections 2024-08-19T01:03:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.927+0000 7fd14e4f6640 1 --2- 172.21.15.17:0/1701269949 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd13006e170 0x7fd130070630 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.927+0000 7fd14e4f6640 1 --2- 172.21.15.17:0/1701269949 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd1481016b0 0x7fd1480fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.927+0000 7fd14e4f6640 1 --2- 172.21.15.17:0/1701269949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd148100d90 0x7fd1480fe9f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.927+0000 7fd14e4f6640 1 -- 172.21.15.17:0/1701269949 >> 172.21.15.17:0/1701269949 conn(0x7fd1480fa730 msgr2=0x7fd148101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.927+0000 7fd14e4f6640 1 -- 172.21.15.17:0/1701269949 shutdown_connections 2024-08-19T01:03:06.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:06.927+0000 7fd14e4f6640 1 -- 172.21.15.17:0/1701269949 wait complete. 2024-08-19T01:03:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:07 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3547433365' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:03:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:07 smithi017 ceph-mon[99370]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:07 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1701269949' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:03:07.338 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:07 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3547433365' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:03:07.339 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:07 smithi086 ceph-mon[71303]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:07.339 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:07 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1701269949' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:03:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:08 smithi017 ceph-mon[99370]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 68/321 objects degraded (21.184%) 2024-08-19T01:03:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:08 smithi017 ceph-mon[99370]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-19T01:03:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:08.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:08 smithi086 ceph-mon[71303]: pgmap v112: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 68/321 objects degraded (21.184%) 2024-08-19T01:03:08.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:08 smithi086 ceph-mon[71303]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-19T01:03:08.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:08.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:09.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:09 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:09.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:09 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:09.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:09 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:09.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:09 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:10.446 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:10 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[80991]: 2024-08-19T01:03:10.250+0000 7f5e253cb640 -1 osd.3 64 log_to_monitors true 2024-08-19T01:03:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:10 smithi017 ceph-mon[99370]: pgmap v113: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 68/321 objects degraded (21.184%) 2024-08-19T01:03:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:10 smithi017 ceph-mon[99370]: from='osd.3 [v2:172.21.15.86:6800/3632842050,v1:172.21.15.86:6801/3632842050]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-19T01:03:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:10 smithi017 ceph-mon[99370]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-19T01:03:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:10 smithi086 ceph-mon[71303]: pgmap v113: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 259 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 68/321 objects degraded (21.184%) 2024-08-19T01:03:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:10 smithi086 ceph-mon[71303]: from='osd.3 [v2:172.21.15.86:6800/3632842050,v1:172.21.15.86:6801/3632842050]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-19T01:03:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:10 smithi086 ceph-mon[71303]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-19T01:03:10.946 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:03:10 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[80991]: 2024-08-19T01:03:10.682+0000 7f5e1d165640 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T01:03:11.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:11 smithi017 ceph-mon[99370]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-19T01:03:11.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:11 smithi017 ceph-mon[99370]: osdmap e67: 6 total, 5 up, 6 in 2024-08-19T01:03:11.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:11 smithi017 ceph-mon[99370]: from='osd.3 [v2:172.21.15.86:6800/3632842050,v1:172.21.15.86:6801/3632842050]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:03:11.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:11 smithi017 ceph-mon[99370]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:03:11.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:11 smithi017 ceph-mon[99370]: Health check update: Degraded data redundancy: 68/321 objects degraded (21.184%), 19 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:11.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:11 smithi086 ceph-mon[71303]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-19T01:03:11.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:11 smithi086 ceph-mon[71303]: osdmap e67: 6 total, 5 up, 6 in 2024-08-19T01:03:11.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:11 smithi086 ceph-mon[71303]: from='osd.3 [v2:172.21.15.86:6800/3632842050,v1:172.21.15.86:6801/3632842050]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:03:11.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:11 smithi086 ceph-mon[71303]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:03:11.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:11 smithi086 ceph-mon[71303]: Health check update: Degraded data redundancy: 68/321 objects degraded (21.184%), 19 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: pgmap v115: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 68/321 objects degraded (21.184%) 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: osd.3 [v2:172.21.15.86:6800/3632842050,v1:172.21.15.86:6801/3632842050] boot 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: osdmap e68: 6 total, 6 up, 6 in 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:12.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:12.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:12.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-19T01:03:12.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:12 smithi017 ceph-mon[99370]: osdmap e69: 6 total, 6 up, 6 in 2024-08-19T01:03:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: pgmap v115: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 68/321 objects degraded (21.184%) 2024-08-19T01:03:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:03:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: osd.3 [v2:172.21.15.86:6800/3632842050,v1:172.21.15.86:6801/3632842050] boot 2024-08-19T01:03:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: osdmap e68: 6 total, 6 up, 6 in 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-19T01:03:12.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:12 smithi086 ceph-mon[71303]: osdmap e69: 6 total, 6 up, 6 in 2024-08-19T01:03:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:13 smithi017 ceph-mon[99370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-19T01:03:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:13 smithi017 ceph-mon[99370]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-08-19T01:03:13.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:13 smithi086 ceph-mon[71303]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-19T01:03:13.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:13 smithi086 ceph-mon[71303]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-08-19T01:03:14.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:14 smithi017 ceph-mon[99370]: pgmap v118: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 68/321 objects degraded (21.184%) 2024-08-19T01:03:14.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:14 smithi086 ceph-mon[71303]: pgmap v118: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 68/321 objects degraded (21.184%) 2024-08-19T01:03:16.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:16 smithi017 ceph-mon[99370]: pgmap v119: 65 pgs: 13 active+undersized, 17 active+undersized+degraded, 35 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 58/321 objects degraded (18.069%) 2024-08-19T01:03:16.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:16 smithi017 ceph-mon[99370]: Health check update: Degraded data redundancy: 58/321 objects degraded (18.069%), 17 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:16 smithi086 ceph-mon[71303]: pgmap v119: 65 pgs: 13 active+undersized, 17 active+undersized+degraded, 35 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 58/321 objects degraded (18.069%) 2024-08-19T01:03:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:16 smithi086 ceph-mon[71303]: Health check update: Degraded data redundancy: 58/321 objects degraded (18.069%), 17 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:18.016 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:17 smithi086 ceph-mon[71303]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/321 objects degraded (18.069%), 17 pgs degraded) 2024-08-19T01:03:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:17 smithi017 ceph-mon[99370]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/321 objects degraded (18.069%), 17 pgs degraded) 2024-08-19T01:03:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:18 smithi017 ceph-mon[99370]: pgmap v120: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-08-19T01:03:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:03:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:18 smithi086 ceph-mon[71303]: pgmap v120: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 4 op/s 2024-08-19T01:03:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:03:21.157 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:20 smithi017 ceph-mon[99370]: pgmap v121: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-08-19T01:03:21.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:20 smithi086 ceph-mon[71303]: pgmap v121: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-08-19T01:03:23.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:22 smithi017 ceph-mon[99370]: pgmap v122: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-08-19T01:03:23.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:22 smithi086 ceph-mon[71303]: pgmap v122: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-08-19T01:03:24.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:23 smithi017 ceph-mon[99370]: pgmap v123: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:03:24.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:23 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:24.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:23 smithi086 ceph-mon[71303]: pgmap v123: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:03:24.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:23 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:26.262 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:25 smithi017 ceph-mon[99370]: pgmap v124: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:03:26.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:25 smithi086 ceph-mon[71303]: pgmap v124: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:03:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:27 smithi086 ceph-mon[71303]: pgmap v125: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:03:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:27 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-19T01:03:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:27 smithi086 ceph-mon[71303]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-19T01:03:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:27 smithi086 ceph-mon[71303]: Upgrade: osd.4 is safe to restart 2024-08-19T01:03:28.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:27 smithi017 ceph-mon[99370]: pgmap v125: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:03:28.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:27 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-19T01:03:28.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:27 smithi017 ceph-mon[99370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-08-19T01:03:28.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:27 smithi017 ceph-mon[99370]: Upgrade: osd.4 is safe to restart 2024-08-19T01:03:29.917 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:29 smithi086 ceph-mon[71303]: Upgrade: Updating osd.4 2024-08-19T01:03:29.917 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:29 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:29.917 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:29 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-19T01:03:29.917 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:29 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:03:29.917 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:29 smithi086 ceph-mon[71303]: Deploying daemon osd.4 on smithi086 2024-08-19T01:03:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:29 smithi017 ceph-mon[99370]: Upgrade: Updating osd.4 2024-08-19T01:03:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:29 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:29 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-19T01:03:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:29 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:03:29.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:29 smithi017 ceph-mon[99370]: Deploying daemon osd.4 on smithi086 2024-08-19T01:03:30.898 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:30 smithi086 ceph-mon[71303]: pgmap v126: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:03:30.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:30 smithi017 ceph-mon[99370]: pgmap v126: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:03:31.800 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:31 smithi086 systemd[1]: Stopping Ceph osd.4 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:03:32.196 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:31 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[37391]: 2024-08-19T01:03:31.809+0000 7fc9e0a34640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:03:32.196 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:31 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[37391]: 2024-08-19T01:03:31.809+0000 7fc9e0a34640 -1 osd.4 69 *** Got signal Terminated *** 2024-08-19T01:03:32.196 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:31 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[37391]: 2024-08-19T01:03:31.809+0000 7fc9e0a34640 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:03:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:32 smithi017 ceph-mon[99370]: pgmap v127: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:03:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:32 smithi017 ceph-mon[99370]: osd.4 marked itself down and dead 2024-08-19T01:03:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:32 smithi086 ceph-mon[71303]: pgmap v127: 65 pgs: 65 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:03:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:32 smithi086 ceph-mon[71303]: osd.4 marked itself down and dead 2024-08-19T01:03:33.430 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:33 smithi086 podman[85704]: 2024-08-19 01:03:33.125345866 +0000 UTC m=+1.422433408 container died b15aa7e403b5d48d2cce58798226558712945f9e23d964efe631f1fee3097dde (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=reef-baa926d, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-19T01:03:33.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:33 smithi086 ceph-mon[71303]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:03:33.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:33 smithi086 ceph-mon[71303]: osdmap e70: 6 total, 5 up, 6 in 2024-08-19T01:03:33.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:33.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:03:33.697 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:33 smithi086 podman[85704]: 2024-08-19 01:03:33.526449593 +0000 UTC m=+1.823537140 container cleanup b15aa7e403b5d48d2cce58798226558712945f9e23d964efe631f1fee3097dde (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=reef-baa926d, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-19T01:03:33.697 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:33 smithi086 bash[85704]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4 2024-08-19T01:03:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:33 smithi017 ceph-mon[99370]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:03:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:33 smithi017 ceph-mon[99370]: osdmap e70: 6 total, 5 up, 6 in 2024-08-19T01:03:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:03:34.196 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:33 smithi086 podman[85730]: 2024-08-19 01:03:33.794624413 +0000 UTC m=+0.666799566 container remove b15aa7e403b5d48d2cce58798226558712945f9e23d964efe631f1fee3097dde (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, RELEASE=reef-baa926d, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-19T01:03:34.549 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:34 smithi086 podman[85819]: 2024-08-19 01:03:34.220534521 +0000 UTC m=+0.109630888 container create 67978c8e0cbcfa72c634f2cbc8a8292915542d8a22e99f63a8be1bf27c8d080c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-19T01:03:34.549 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:34 smithi086 podman[85819]: 2024-08-19 01:03:34.128285701 +0000 UTC m=+0.017382033 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:03:34.549 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:34 smithi086 podman[85819]: 2024-08-19 01:03:34.465106581 +0000 UTC m=+0.354202919 container init 67978c8e0cbcfa72c634f2cbc8a8292915542d8a22e99f63a8be1bf27c8d080c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-08-19T01:03:34.549 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:34 smithi086 podman[85819]: 2024-08-19 01:03:34.46852678 +0000 UTC m=+0.357623108 container start 67978c8e0cbcfa72c634f2cbc8a8292915542d8a22e99f63a8be1bf27c8d080c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-19T01:03:34.549 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:34 smithi086 podman[85819]: 2024-08-19 01:03:34.547935354 +0000 UTC m=+0.437031693 container attach 67978c8e0cbcfa72c634f2cbc8a8292915542d8a22e99f63a8be1bf27c8d080c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-19T01:03:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:34 smithi017 ceph-mon[99370]: pgmap v129: 65 pgs: 6 stale+active+clean, 59 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:03:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:34 smithi017 ceph-mon[99370]: osdmap e71: 6 total, 5 up, 6 in 2024-08-19T01:03:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:34 smithi086 ceph-mon[71303]: pgmap v129: 65 pgs: 6 stale+active+clean, 59 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:03:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:34 smithi086 ceph-mon[71303]: osdmap e71: 6 total, 5 up, 6 in 2024-08-19T01:03:34.946 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:34 smithi086 podman[85819]: 2024-08-19 01:03:34.665473951 +0000 UTC m=+0.554570278 container died 67978c8e0cbcfa72c634f2cbc8a8292915542d8a22e99f63a8be1bf27c8d080c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0) 2024-08-19T01:03:35.629 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:35 smithi086 podman[85842]: 2024-08-19 01:03:35.301201044 +0000 UTC m=+0.630317196 container remove 67978c8e0cbcfa72c634f2cbc8a8292915542d8a22e99f63a8be1bf27c8d080c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-19T01:03:35.629 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:35 smithi086 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.4.service: Deactivated successfully. 2024-08-19T01:03:35.629 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:35 smithi086 systemd[1]: Stopped Ceph osd.4 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:03:35.629 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:35 smithi086 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.4.service: Consumed 52.656s CPU time. 2024-08-19T01:03:35.629 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:35 smithi086 systemd[1]: Starting Ceph osd.4 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:03:35.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:35 smithi017 ceph-mon[99370]: Health check failed: Degraded data redundancy: 7/321 objects degraded (2.181%), 2 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:35.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:35 smithi086 ceph-mon[71303]: Health check failed: Degraded data redundancy: 7/321 objects degraded (2.181%), 2 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:35.946 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:35 smithi086 podman[85940]: 2024-08-19 01:03:35.649009413 +0000 UTC m=+0.017228421 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:03:35.946 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:35 smithi086 podman[85940]: 2024-08-19 01:03:35.852166948 +0000 UTC m=+0.220385991 container create a9649fa55586ab955276564d06d8f8075db0e06fd39cd5b23c0f46f50712ce34 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0) 2024-08-19T01:03:36.225 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 podman[85940]: 2024-08-19 01:03:36.062947081 +0000 UTC m=+0.431166090 container init a9649fa55586ab955276564d06d8f8075db0e06fd39cd5b23c0f46f50712ce34 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-08-19T01:03:36.225 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 podman[85940]: 2024-08-19 01:03:36.06634603 +0000 UTC m=+0.434565028 container start a9649fa55586ab955276564d06d8f8075db0e06fd39cd5b23c0f46f50712ce34 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0) 2024-08-19T01:03:36.225 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 podman[85940]: 2024-08-19 01:03:36.137618496 +0000 UTC m=+0.505837501 container attach a9649fa55586ab955276564d06d8f8075db0e06fd39cd5b23c0f46f50712ce34 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-08-19T01:03:36.225 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:36.226 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:36.226 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:36.226 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:36.226 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:03:36.226 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:03:36.630 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:36.630 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:36.630 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-19T01:03:36.631 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-19T01:03:36.632 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate[85956]: --> ceph-volume lvm activate successful for osd ID: 4 2024-08-19T01:03:36.632 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 bash[85940]: --> ceph-volume lvm activate successful for osd ID: 4 2024-08-19T01:03:36.632 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 podman[85940]: 2024-08-19 01:03:36.344735969 +0000 UTC m=+0.712954971 container died a9649fa55586ab955276564d06d8f8075db0e06fd39cd5b23c0f46f50712ce34 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-08-19T01:03:36.911 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:36 smithi086 ceph-mon[71303]: pgmap v131: 65 pgs: 3 active+undersized, 5 stale+active+clean, 2 active+undersized+degraded, 55 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 7/321 objects degraded (2.181%) 2024-08-19T01:03:36.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:36 smithi017 ceph-mon[99370]: pgmap v131: 65 pgs: 3 active+undersized, 5 stale+active+clean, 2 active+undersized+degraded, 55 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 7/321 objects degraded (2.181%) 2024-08-19T01:03:37.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.017+0000 7f138c48a640 1 -- 172.21.15.17:0/4184946215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13840fedc0 msgr2=0x7f1384102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.017+0000 7f138c48a640 1 --2- 172.21.15.17:0/4184946215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13840fedc0 0x7f1384102e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f137400a990 tx=0x7f137402b7d0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.017+0000 7f138c48a640 1 -- 172.21.15.17:0/4184946215 shutdown_connections 2024-08-19T01:03:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.017+0000 7f138c48a640 1 --2- 172.21.15.17:0/4184946215 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13840fedc0 0x7f1384102e10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.017+0000 7f138c48a640 1 --2- 172.21.15.17:0/4184946215 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13840fe410 0x7f13840fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.017+0000 7f138c48a640 1 -- 172.21.15.17:0/4184946215 >> 172.21.15.17:0/4184946215 conn(0x7f13840f9e70 msgr2=0x7f13840fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.017+0000 7f138c48a640 1 -- 172.21.15.17:0/4184946215 shutdown_connections 2024-08-19T01:03:37.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.017+0000 7f138c48a640 1 -- 172.21.15.17:0/4184946215 wait complete. 2024-08-19T01:03:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.018+0000 7f138c48a640 1 Processor -- start 2024-08-19T01:03:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.018+0000 7f138c48a640 1 -- start start 2024-08-19T01:03:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.018+0000 7f138c48a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13840fe410 0x7f138419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.018+0000 7f138c48a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13840fedc0 0x7f138419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.018+0000 7f138c48a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138419c340 con 0x7f13840fe410 2024-08-19T01:03:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.018+0000 7f138c48a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13841958d0 con 0x7f13840fedc0 2024-08-19T01:03:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f138a226640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13840fe410 0x7f138419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f138a226640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13840fe410 0x7f138419b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47144/0 (socket says 172.21.15.17:47144) 2024-08-19T01:03:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f138a226640 1 -- 172.21.15.17:0/3956311821 learned_addr learned my addr 172.21.15.17:0/3956311821 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f1389a25640 1 --2- 172.21.15.17:0/3956311821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13840fedc0 0x7f138419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f138a226640 1 -- 172.21.15.17:0/3956311821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13840fedc0 msgr2=0x7f138419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f138a226640 1 --2- 172.21.15.17:0/3956311821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13840fedc0 0x7f138419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f138a226640 1 -- 172.21.15.17:0/3956311821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137400a670 con 0x7f13840fe410 2024-08-19T01:03:37.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f138a226640 1 --2- 172.21.15.17:0/3956311821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13840fe410 0x7f138419b7e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f138000e970 tx=0x7f138000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:37.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f137b7fe640 1 -- 172.21.15.17:0/3956311821 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f138000cc90 con 0x7f13840fe410 2024-08-19T01:03:37.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f137b7fe640 1 -- 172.21.15.17:0/3956311821 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f138000cdf0 con 0x7f13840fe410 2024-08-19T01:03:37.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f138c48a640 1 -- 172.21.15.17:0/3956311821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1384195bb0 con 0x7f13840fe410 2024-08-19T01:03:37.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f137b7fe640 1 -- 172.21.15.17:0/3956311821 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1380010430 con 0x7f13840fe410 2024-08-19T01:03:37.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.019+0000 7f138c48a640 1 -- 172.21.15.17:0/3956311821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13841960d0 con 0x7f13840fe410 2024-08-19T01:03:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.020+0000 7f138c48a640 1 -- 172.21.15.17:0/3956311821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13840ff8f0 con 0x7f13840fe410 2024-08-19T01:03:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.021+0000 7f137b7fe640 1 -- 172.21.15.17:0/3956311821 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f13800046c0 con 0x7f13840fe410 2024-08-19T01:03:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.021+0000 7f137b7fe640 1 --2- 172.21.15.17:0/3956311821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f137006e170 0x7f1370070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.022+0000 7f137b7fe640 1 -- 172.21.15.17:0/3956311821 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1380014070 con 0x7f13840fe410 2024-08-19T01:03:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.022+0000 7f1389a25640 1 --2- 172.21.15.17:0/3956311821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f137006e170 0x7f1370070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.022+0000 7f1389a25640 1 --2- 172.21.15.17:0/3956311821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f137006e170 0x7f1370070630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1374006010 tx=0x7f1374008760 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:37.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.026+0000 7f137b7fe640 1 -- 172.21.15.17:0/3956311821 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f13800579a0 con 0x7f13840fe410 2024-08-19T01:03:37.196 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:36 smithi086 podman[86062]: 2024-08-19 01:03:36.909789996 +0000 UTC m=+0.559575625 container remove a9649fa55586ab955276564d06d8f8075db0e06fd39cd5b23c0f46f50712ce34 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-19T01:03:37.196 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:37 smithi086 podman[86119]: 2024-08-19 01:03:37.025188149 +0000 UTC m=+0.017125233 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:03:37.196 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:37 smithi086 podman[86119]: 2024-08-19 01:03:37.127144515 +0000 UTC m=+0.119081591 container create 9bce1ba418a66ee1a3d9f43c733f6f16baf1c5b61fb486c6529721cf1199ed88 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-19T01:03:37.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.221+0000 7f138c48a640 1 -- 172.21.15.17:0/3956311821 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1384106790 con 0x7f137006e170 2024-08-19T01:03:37.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.222+0000 7f137b7fe640 1 -- 172.21.15.17:0/3956311821 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f1384106790 con 0x7f137006e170 2024-08-19T01:03:37.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.224+0000 7f138c48a640 1 -- 172.21.15.17:0/3956311821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f137006e170 msgr2=0x7f1370070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.224+0000 7f138c48a640 1 --2- 172.21.15.17:0/3956311821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f137006e170 0x7f1370070630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1374006010 tx=0x7f1374008760 comp rx=0 tx=0).stop 2024-08-19T01:03:37.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.224+0000 7f138c48a640 1 -- 172.21.15.17:0/3956311821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13840fe410 msgr2=0x7f138419b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.224+0000 7f138c48a640 1 --2- 172.21.15.17:0/3956311821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13840fe410 0x7f138419b7e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f138000e970 tx=0x7f138000ed70 comp rx=0 tx=0).stop 2024-08-19T01:03:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.224+0000 7f138c48a640 1 -- 172.21.15.17:0/3956311821 shutdown_connections 2024-08-19T01:03:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.224+0000 7f138c48a640 1 --2- 172.21.15.17:0/3956311821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f137006e170 0x7f1370070630 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.224+0000 7f138c48a640 1 --2- 172.21.15.17:0/3956311821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13840fedc0 0x7f138419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.224+0000 7f138c48a640 1 --2- 172.21.15.17:0/3956311821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13840fe410 0x7f138419b7e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.224+0000 7f138c48a640 1 -- 172.21.15.17:0/3956311821 >> 172.21.15.17:0/3956311821 conn(0x7f13840f9e70 msgr2=0x7f13840fb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.224+0000 7f138c48a640 1 -- 172.21.15.17:0/3956311821 shutdown_connections 2024-08-19T01:03:37.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.224+0000 7f138c48a640 1 -- 172.21.15.17:0/3956311821 wait complete. 2024-08-19T01:03:37.235 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:03:37.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.307+0000 7ffa729ab640 1 -- 172.21.15.17:0/2742511044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0fe9f0 msgr2=0x7ffa6c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.307+0000 7ffa729ab640 1 --2- 172.21.15.17:0/2742511044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0fe9f0 0x7ffa6c0fee50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009880 tx=0x7ffa6002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.307+0000 7ffa729ab640 1 -- 172.21.15.17:0/2742511044 shutdown_connections 2024-08-19T01:03:37.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.307+0000 7ffa729ab640 1 --2- 172.21.15.17:0/2742511044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0fe9f0 0x7ffa6c0fee50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.307+0000 7ffa729ab640 1 --2- 172.21.15.17:0/2742511044 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c1049f0 0x7ffa6c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.307+0000 7ffa729ab640 1 -- 172.21.15.17:0/2742511044 >> 172.21.15.17:0/2742511044 conn(0x7ffa6c0758a0 msgr2=0x7ffa6c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:37.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.308+0000 7ffa729ab640 1 -- 172.21.15.17:0/2742511044 shutdown_connections 2024-08-19T01:03:37.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.308+0000 7ffa729ab640 1 -- 172.21.15.17:0/2742511044 wait complete. 2024-08-19T01:03:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.308+0000 7ffa729ab640 1 Processor -- start 2024-08-19T01:03:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.308+0000 7ffa729ab640 1 -- start start 2024-08-19T01:03:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa729ab640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0fe9f0 0x7ffa6c19a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa729ab640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c1049f0 0x7ffa6c19ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa729ab640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c19b360 con 0x7ffa6c0fe9f0 2024-08-19T01:03:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa729ab640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c194940 con 0x7ffa6c1049f0 2024-08-19T01:03:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa6bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0fe9f0 0x7ffa6c19a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa6bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0fe9f0 0x7ffa6c19a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47162/0 (socket says 172.21.15.17:47162) 2024-08-19T01:03:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa6bfff640 1 -- 172.21.15.17:0/1058141456 learned_addr learned my addr 172.21.15.17:0/1058141456 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa6b7fe640 1 --2- 172.21.15.17:0/1058141456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c1049f0 0x7ffa6c19ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa6bfff640 1 -- 172.21.15.17:0/1058141456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c1049f0 msgr2=0x7ffa6c19ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa6bfff640 1 --2- 172.21.15.17:0/1058141456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c1049f0 0x7ffa6c19ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa6bfff640 1 -- 172.21.15.17:0/1058141456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa60009560 con 0x7ffa6c0fe9f0 2024-08-19T01:03:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.309+0000 7ffa6bfff640 1 --2- 172.21.15.17:0/1058141456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0fe9f0 0x7ffa6c19a800 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00b420 tx=0x7ffa5c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:37.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.310+0000 7ffa697fa640 1 -- 172.21.15.17:0/1058141456 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa5c011800 con 0x7ffa6c0fe9f0 2024-08-19T01:03:37.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.310+0000 7ffa697fa640 1 -- 172.21.15.17:0/1058141456 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa5c011e20 con 0x7ffa6c0fe9f0 2024-08-19T01:03:37.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.310+0000 7ffa729ab640 1 -- 172.21.15.17:0/1058141456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c194c20 con 0x7ffa6c0fe9f0 2024-08-19T01:03:37.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.310+0000 7ffa697fa640 1 -- 172.21.15.17:0/1058141456 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa5c00f2e0 con 0x7ffa6c0fe9f0 2024-08-19T01:03:37.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.310+0000 7ffa729ab640 1 -- 172.21.15.17:0/1058141456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c195090 con 0x7ffa6c0fe9f0 2024-08-19T01:03:37.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.311+0000 7ffa729ab640 1 -- 172.21.15.17:0/1058141456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c100130 con 0x7ffa6c0fe9f0 2024-08-19T01:03:37.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.311+0000 7ffa697fa640 1 -- 172.21.15.17:0/1058141456 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ffa5c010380 con 0x7ffa6c0fe9f0 2024-08-19T01:03:37.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.312+0000 7ffa697fa640 1 --2- 172.21.15.17:0/1058141456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5406e180 0x7ffa54070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.312+0000 7ffa697fa640 1 -- 172.21.15.17:0/1058141456 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ffa5c08da10 con 0x7ffa6c0fe9f0 2024-08-19T01:03:37.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.312+0000 7ffa6b7fe640 1 --2- 172.21.15.17:0/1058141456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5406e180 0x7ffa54070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.312+0000 7ffa6b7fe640 1 --2- 172.21.15.17:0/1058141456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5406e180 0x7ffa54070640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009230 tx=0x7ffa60005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:37.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.316+0000 7ffa697fa640 1 -- 172.21.15.17:0/1058141456 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ffa5c056d40 con 0x7ffa6c0fe9f0 2024-08-19T01:03:37.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.512+0000 7ffa729ab640 1 -- 172.21.15.17:0/1058141456 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa6c10bda0 con 0x7ffa5406e180 2024-08-19T01:03:37.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.513+0000 7ffa697fa640 1 -- 172.21.15.17:0/1058141456 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ffa6c10bda0 con 0x7ffa5406e180 2024-08-19T01:03:37.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.515+0000 7ffa729ab640 1 -- 172.21.15.17:0/1058141456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5406e180 msgr2=0x7ffa54070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.515+0000 7ffa729ab640 1 --2- 172.21.15.17:0/1058141456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5406e180 0x7ffa54070640 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa60009230 tx=0x7ffa60005a20 comp rx=0 tx=0).stop 2024-08-19T01:03:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.515+0000 7ffa729ab640 1 -- 172.21.15.17:0/1058141456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0fe9f0 msgr2=0x7ffa6c19a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.515+0000 7ffa729ab640 1 --2- 172.21.15.17:0/1058141456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0fe9f0 0x7ffa6c19a800 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00b420 tx=0x7ffa5c00b8e0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.515+0000 7ffa729ab640 1 -- 172.21.15.17:0/1058141456 shutdown_connections 2024-08-19T01:03:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.515+0000 7ffa729ab640 1 --2- 172.21.15.17:0/1058141456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5406e180 0x7ffa54070640 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.515+0000 7ffa729ab640 1 --2- 172.21.15.17:0/1058141456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c1049f0 0x7ffa6c19ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.515+0000 7ffa729ab640 1 --2- 172.21.15.17:0/1058141456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0fe9f0 0x7ffa6c19a800 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.515+0000 7ffa729ab640 1 -- 172.21.15.17:0/1058141456 >> 172.21.15.17:0/1058141456 conn(0x7ffa6c0758a0 msgr2=0x7ffa6c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.515+0000 7ffa729ab640 1 -- 172.21.15.17:0/1058141456 shutdown_connections 2024-08-19T01:03:37.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.515+0000 7ffa729ab640 1 -- 172.21.15.17:0/1058141456 wait complete. 2024-08-19T01:03:37.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.599+0000 7f6a30e9d640 1 -- 172.21.15.17:0/592772889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a2c1049f0 msgr2=0x7f6a2c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.599+0000 7f6a30e9d640 1 --2- 172.21.15.17:0/592772889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a2c1049f0 0x7f6a2c104dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c009880 tx=0x7f6a1c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.599+0000 7f6a30e9d640 1 -- 172.21.15.17:0/592772889 shutdown_connections 2024-08-19T01:03:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.599+0000 7f6a30e9d640 1 --2- 172.21.15.17:0/592772889 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a2c0fe9f0 0x7f6a2c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.599+0000 7f6a30e9d640 1 --2- 172.21.15.17:0/592772889 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a2c1049f0 0x7f6a2c104dd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.599+0000 7f6a30e9d640 1 -- 172.21.15.17:0/592772889 >> 172.21.15.17:0/592772889 conn(0x7f6a2c0758a0 msgr2=0x7f6a2c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.599+0000 7f6a30e9d640 1 -- 172.21.15.17:0/592772889 shutdown_connections 2024-08-19T01:03:37.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.599+0000 7f6a30e9d640 1 -- 172.21.15.17:0/592772889 wait complete. 2024-08-19T01:03:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.600+0000 7f6a30e9d640 1 Processor -- start 2024-08-19T01:03:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.600+0000 7f6a30e9d640 1 -- start start 2024-08-19T01:03:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a30e9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a2c0fe9f0 0x7f6a2c105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a30e9d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a2c1049f0 0x7f6a2c105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a30e9d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c1063a0 con 0x7f6a2c0fe9f0 2024-08-19T01:03:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a30e9d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c1064e0 con 0x7f6a2c1049f0 2024-08-19T01:03:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a2a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a2c0fe9f0 0x7f6a2c105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a29d9b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a2c1049f0 0x7f6a2c105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a2a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a2c0fe9f0 0x7f6a2c105920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47184/0 (socket says 172.21.15.17:47184) 2024-08-19T01:03:37.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a2a59c640 1 -- 172.21.15.17:0/483768895 learned_addr learned my addr 172.21.15.17:0/483768895 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a29d9b640 1 -- 172.21.15.17:0/483768895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a2c0fe9f0 msgr2=0x7f6a2c105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a29d9b640 1 --2- 172.21.15.17:0/483768895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a2c0fe9f0 0x7f6a2c105920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a29d9b640 1 -- 172.21.15.17:0/483768895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c009560 con 0x7f6a2c1049f0 2024-08-19T01:03:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a2a59c640 1 --2- 172.21.15.17:0/483768895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a2c0fe9f0 0x7f6a2c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T01:03:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.601+0000 7f6a29d9b640 1 --2- 172.21.15.17:0/483768895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a2c1049f0 0x7f6a2c105e60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000d6d0 tx=0x7f6a2000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.602+0000 7f6a1b7fe640 1 -- 172.21.15.17:0/483768895 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a200051f0 con 0x7f6a2c1049f0 2024-08-19T01:03:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.602+0000 7f6a1b7fe640 1 -- 172.21.15.17:0/483768895 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a20004c60 con 0x7f6a2c1049f0 2024-08-19T01:03:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.602+0000 7f6a30e9d640 1 -- 172.21.15.17:0/483768895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c1a1c30 con 0x7f6a2c1049f0 2024-08-19T01:03:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.602+0000 7f6a1b7fe640 1 -- 172.21.15.17:0/483768895 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a20009d30 con 0x7f6a2c1049f0 2024-08-19T01:03:37.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.602+0000 7f6a30e9d640 1 -- 172.21.15.17:0/483768895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c1a2040 con 0x7f6a2c1049f0 2024-08-19T01:03:37.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.603+0000 7f6a30e9d640 1 -- 172.21.15.17:0/483768895 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c100130 con 0x7f6a2c1049f0 2024-08-19T01:03:37.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.603+0000 7f6a1b7fe640 1 -- 172.21.15.17:0/483768895 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6a200047a0 con 0x7f6a2c1049f0 2024-08-19T01:03:37.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.604+0000 7f6a1b7fe640 1 --2- 172.21.15.17:0/483768895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a1406e180 0x7f6a14070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.604+0000 7f6a2a59c640 1 --2- 172.21.15.17:0/483768895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a1406e180 0x7f6a14070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.604+0000 7f6a1b7fe640 1 -- 172.21.15.17:0/483768895 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6a2008dc70 con 0x7f6a2c1049f0 2024-08-19T01:03:37.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.604+0000 7f6a2a59c640 1 --2- 172.21.15.17:0/483768895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a1406e180 0x7f6a14070640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c000c00 tx=0x7f6a1c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:37.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.609+0000 7f6a1b7fe640 1 -- 172.21.15.17:0/483768895 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6a20094080 con 0x7f6a2c1049f0 2024-08-19T01:03:37.696 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:37 smithi086 podman[86119]: 2024-08-19 01:03:37.31253636 +0000 UTC m=+0.304473447 container init 9bce1ba418a66ee1a3d9f43c733f6f16baf1c5b61fb486c6529721cf1199ed88 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-19T01:03:37.697 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:37 smithi086 podman[86119]: 2024-08-19 01:03:37.315731084 +0000 UTC m=+0.307668160 container start 9bce1ba418a66ee1a3d9f43c733f6f16baf1c5b61fb486c6529721cf1199ed88 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-08-19T01:03:37.697 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:37 smithi086 ceph-osd[86138]: -- 172.21.15.86:0/1554760730 <== mon.1 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bd583d21e0 con 0x55bd58366000 2024-08-19T01:03:37.697 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:37 smithi086 bash[86119]: 9bce1ba418a66ee1a3d9f43c733f6f16baf1c5b61fb486c6529721cf1199ed88 2024-08-19T01:03:37.697 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:37 smithi086 systemd[1]: Started Ceph osd.4 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:03:37.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.793+0000 7f6a30e9d640 1 -- 172.21.15.17:0/483768895 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a2c10bd20 con 0x7f6a1406e180 2024-08-19T01:03:37.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.807+0000 7f6a1b7fe640 1 -- 172.21.15.17:0/483768895 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f6a2c10bd20 con 0x7f6a1406e180 2024-08-19T01:03:37.809 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (4m) 62s ago 15m 26.7M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (15m) 62s ago 15m 8862k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (14m) 29s ago 14m 8342k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (2m) 62s ago 15m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (2m) 29s ago 14m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (4m) 62s ago 15m 79.7M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (10m) 62s ago 10m 156M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (10m) 62s ago 10m 92.0M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (10m) 29s ago 10m 26.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (10m) 29s ago 10m 25.9M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (6m) 62s ago 17m 498M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (5m) 29s ago 14m 441M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:03:37.810 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (3m) 62s ago 17m 47.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:03:37.811 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (3m) 29s ago 14m 39.7M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:03:37.811 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (5m) 62s ago 15m 16.0M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:03:37.811 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (5m) 29s ago 14m 15.4M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:03:37.811 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (2m) 62s ago 13m 85.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:03:37.811 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (102s) 62s ago 13m 87.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:03:37.811 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (68s) 62s ago 12m 11.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:03:37.811 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (33s) 29s ago 12m 11.5M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:03:37.811 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 starting - - - 2240M 2024-08-19T01:03:37.811 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (11m) 29s ago 11m 221M 2240M 18.2.4-721-gbaa926de e6c292a6bc95 59b6d8d3f06b 2024-08-19T01:03:37.811 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (5m) 62s ago 15m 67.3M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:03:37.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.809+0000 7f6a30e9d640 1 -- 172.21.15.17:0/483768895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a1406e180 msgr2=0x7f6a14070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.809+0000 7f6a30e9d640 1 --2- 172.21.15.17:0/483768895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a1406e180 0x7f6a14070640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c000c00 tx=0x7f6a1c005a20 comp rx=0 tx=0).stop 2024-08-19T01:03:37.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.809+0000 7f6a30e9d640 1 -- 172.21.15.17:0/483768895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a2c1049f0 msgr2=0x7f6a2c105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.809+0000 7f6a30e9d640 1 --2- 172.21.15.17:0/483768895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a2c1049f0 0x7f6a2c105e60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000d6d0 tx=0x7f6a2000db90 comp rx=0 tx=0).stop 2024-08-19T01:03:37.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.810+0000 7f6a30e9d640 1 -- 172.21.15.17:0/483768895 shutdown_connections 2024-08-19T01:03:37.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.810+0000 7f6a30e9d640 1 --2- 172.21.15.17:0/483768895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a1406e180 0x7f6a14070640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.810+0000 7f6a30e9d640 1 --2- 172.21.15.17:0/483768895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a2c1049f0 0x7f6a2c105e60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.810+0000 7f6a30e9d640 1 --2- 172.21.15.17:0/483768895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a2c0fe9f0 0x7f6a2c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.810+0000 7f6a30e9d640 1 -- 172.21.15.17:0/483768895 >> 172.21.15.17:0/483768895 conn(0x7f6a2c0758a0 msgr2=0x7f6a2c067f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:37.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.810+0000 7f6a30e9d640 1 -- 172.21.15.17:0/483768895 shutdown_connections 2024-08-19T01:03:37.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.810+0000 7f6a30e9d640 1 -- 172.21.15.17:0/483768895 wait complete. 2024-08-19T01:03:37.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.893+0000 7f32cf756640 1 -- 172.21.15.17:0/562447328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c8100c60 msgr2=0x7f32c8101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.893+0000 7f32cf756640 1 --2- 172.21.15.17:0/562447328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c8100c60 0x7f32c8101040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f32c40098b0 tx=0x7f32c402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.893+0000 7f32cf756640 1 -- 172.21.15.17:0/562447328 shutdown_connections 2024-08-19T01:03:37.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.893+0000 7f32cf756640 1 --2- 172.21.15.17:0/562447328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c8101610 0x7f32c8109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.893+0000 7f32cf756640 1 --2- 172.21.15.17:0/562447328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c8100c60 0x7f32c8101040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.893+0000 7f32cf756640 1 -- 172.21.15.17:0/562447328 >> 172.21.15.17:0/562447328 conn(0x7f32c80fa730 msgr2=0x7f32c80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.893+0000 7f32cf756640 1 -- 172.21.15.17:0/562447328 shutdown_connections 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.893+0000 7f32cf756640 1 -- 172.21.15.17:0/562447328 wait complete. 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.894+0000 7f32cf756640 1 Processor -- start 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.894+0000 7f32cf756640 1 -- start start 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.894+0000 7f32cf756640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c8100c60 0x7f32c80fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.894+0000 7f32cf756640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c8101610 0x7f32c80fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.894+0000 7f32cf756640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80ff3d0 con 0x7f32c8100c60 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.894+0000 7f32cf756640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80ff540 con 0x7f32c8101610 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.894+0000 7f32cd4f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c8100c60 0x7f32c80fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.894+0000 7f32cd4f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c8100c60 0x7f32c80fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47210/0 (socket says 172.21.15.17:47210) 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.894+0000 7f32cd4f2640 1 -- 172.21.15.17:0/3867067950 learned_addr learned my addr 172.21.15.17:0/3867067950 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:37.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.894+0000 7f32cccf1640 1 --2- 172.21.15.17:0/3867067950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c8101610 0x7f32c80fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.895+0000 7f32cd4f2640 1 -- 172.21.15.17:0/3867067950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c8101610 msgr2=0x7f32c80fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.895+0000 7f32cd4f2640 1 --2- 172.21.15.17:0/3867067950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c8101610 0x7f32c80fee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.895+0000 7f32cd4f2640 1 -- 172.21.15.17:0/3867067950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c4009560 con 0x7f32c8100c60 2024-08-19T01:03:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.895+0000 7f32cd4f2640 1 --2- 172.21.15.17:0/3867067950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c8100c60 0x7f32c80fe950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f32c4006010 tx=0x7f32c40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.895+0000 7f32be7fc640 1 -- 172.21.15.17:0/3867067950 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32c4004aa0 con 0x7f32c8100c60 2024-08-19T01:03:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.895+0000 7f32be7fc640 1 -- 172.21.15.17:0/3867067950 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32c4004c00 con 0x7f32c8100c60 2024-08-19T01:03:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.895+0000 7f32be7fc640 1 -- 172.21.15.17:0/3867067950 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32c4003a20 con 0x7f32c8100c60 2024-08-19T01:03:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.895+0000 7f32cf756640 1 -- 172.21.15.17:0/3867067950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c80ff7c0 con 0x7f32c8100c60 2024-08-19T01:03:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.895+0000 7f32cf756640 1 -- 172.21.15.17:0/3867067950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c81a1f30 con 0x7f32c8100c60 2024-08-19T01:03:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.896+0000 7f32cf756640 1 -- 172.21.15.17:0/3867067950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c8068d30 con 0x7f32c8100c60 2024-08-19T01:03:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.897+0000 7f32be7fc640 1 -- 172.21.15.17:0/3867067950 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f32c4003ba0 con 0x7f32c8100c60 2024-08-19T01:03:37.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.897+0000 7f32be7fc640 1 --2- 172.21.15.17:0/3867067950 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32b406e170 0x7f32b4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:37.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.897+0000 7f32be7fc640 1 -- 172.21.15.17:0/3867067950 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f32c40aefe0 con 0x7f32c8100c60 2024-08-19T01:03:37.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.897+0000 7f32cccf1640 1 --2- 172.21.15.17:0/3867067950 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32b406e170 0x7f32b4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:37.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.898+0000 7f32cccf1640 1 --2- 172.21.15.17:0/3867067950 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32b406e170 0x7f32b4070630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32c81000d0 tx=0x7f32b800a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:37.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:37.902+0000 7f32be7fc640 1 -- 172.21.15.17:0/3867067950 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f32c40784a0 con 0x7f32c8100c60 2024-08-19T01:03:38.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.146+0000 7f32cf756640 1 -- 172.21.15.17:0/3867067950 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f32c80ff7c0 con 0x7f32c8100c60 2024-08-19T01:03:38.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.147+0000 7f32be7fc640 1 -- 172.21.15.17:0/3867067950 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+829 (secure 0 0 0) 0x7f32c80ff7c0 con 0x7f32c8100c60 2024-08-19T01:03:38.149 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:03:38.149 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:03:38.149 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:03:38.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:03:38.149 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:03:38.149 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:03:38.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 5, 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 8 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:03:38.150 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:03:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.149+0000 7f32cf756640 1 -- 172.21.15.17:0/3867067950 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32b406e170 msgr2=0x7f32b4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.149+0000 7f32cf756640 1 --2- 172.21.15.17:0/3867067950 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32b406e170 0x7f32b4070630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32c81000d0 tx=0x7f32b800a250 comp rx=0 tx=0).stop 2024-08-19T01:03:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.149+0000 7f32cf756640 1 -- 172.21.15.17:0/3867067950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c8100c60 msgr2=0x7f32c80fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.149+0000 7f32cf756640 1 --2- 172.21.15.17:0/3867067950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c8100c60 0x7f32c80fe950 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f32c4006010 tx=0x7f32c40055a0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.149+0000 7f32cf756640 1 -- 172.21.15.17:0/3867067950 shutdown_connections 2024-08-19T01:03:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.149+0000 7f32cf756640 1 --2- 172.21.15.17:0/3867067950 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32b406e170 0x7f32b4070630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.149+0000 7f32cf756640 1 --2- 172.21.15.17:0/3867067950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32c8101610 0x7f32c80fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.149+0000 7f32cf756640 1 --2- 172.21.15.17:0/3867067950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32c8100c60 0x7f32c80fe950 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.149+0000 7f32cf756640 1 -- 172.21.15.17:0/3867067950 >> 172.21.15.17:0/3867067950 conn(0x7f32c80fa730 msgr2=0x7f32c8101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.149+0000 7f32cf756640 1 -- 172.21.15.17:0/3867067950 shutdown_connections 2024-08-19T01:03:38.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.149+0000 7f32cf756640 1 -- 172.21.15.17:0/3867067950 wait complete. 2024-08-19T01:03:38.171 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:37 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:03:37.859+0000 7fc91addf640 -1 Falling back to public interface 2024-08-19T01:03:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.231+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2214953052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a8100c60 msgr2=0x7f10a8101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.231+0000 7f10ad9d5640 1 --2- 172.21.15.17:0/2214953052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a8100c60 0x7f10a8101040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f10980098b0 tx=0x7f109802a4d0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.231+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2214953052 shutdown_connections 2024-08-19T01:03:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.231+0000 7f10ad9d5640 1 --2- 172.21.15.17:0/2214953052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8101610 0x7f10a8109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.231+0000 7f10ad9d5640 1 --2- 172.21.15.17:0/2214953052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a8100c60 0x7f10a8101040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.231+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2214953052 >> 172.21.15.17:0/2214953052 conn(0x7f10a80fa730 msgr2=0x7f10a80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.231+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2214953052 shutdown_connections 2024-08-19T01:03:38.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.231+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2214953052 wait complete. 2024-08-19T01:03:38.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.232+0000 7f10ad9d5640 1 Processor -- start 2024-08-19T01:03:38.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.232+0000 7f10ad9d5640 1 -- start start 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.232+0000 7f10ad9d5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8100c60 0x7f10a80fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.232+0000 7f10ad9d5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a8101610 0x7f10a80fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.232+0000 7f10ad9d5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80ff3d0 con 0x7f10a8101610 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.232+0000 7f10ad9d5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80ff540 con 0x7f10a8100c60 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.232+0000 7f10a67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a8101610 0x7f10a80fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.232+0000 7f10a67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a8101610 0x7f10a80fee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47232/0 (socket says 172.21.15.17:47232) 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.232+0000 7f10a67fc640 1 -- 172.21.15.17:0/2130564796 learned_addr learned my addr 172.21.15.17:0/2130564796 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.232+0000 7f10a6ffd640 1 --2- 172.21.15.17:0/2130564796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8100c60 0x7f10a80fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.233+0000 7f10a67fc640 1 -- 172.21.15.17:0/2130564796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8100c60 msgr2=0x7f10a80fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.233+0000 7f10a67fc640 1 --2- 172.21.15.17:0/2130564796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8100c60 0x7f10a80fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.233+0000 7f10a67fc640 1 -- 172.21.15.17:0/2130564796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1098009560 con 0x7f10a8101610 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.233+0000 7f10a67fc640 1 --2- 172.21.15.17:0/2130564796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a8101610 0x7f10a80fee90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f109c00d8d0 tx=0x7f109c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:38.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.233+0000 7f10ac9d3640 1 -- 172.21.15.17:0/2130564796 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f109c009c00 con 0x7f10a8101610 2024-08-19T01:03:38.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.233+0000 7f10ac9d3640 1 -- 172.21.15.17:0/2130564796 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f109c009d60 con 0x7f10a8101610 2024-08-19T01:03:38.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.233+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2130564796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a81a1c90 con 0x7f10a8101610 2024-08-19T01:03:38.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.233+0000 7f10ac9d3640 1 -- 172.21.15.17:0/2130564796 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f109c0049d0 con 0x7f10a8101610 2024-08-19T01:03:38.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.233+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2130564796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a81a1ff0 con 0x7f10a8101610 2024-08-19T01:03:38.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.234+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2130564796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a8068d30 con 0x7f10a8101610 2024-08-19T01:03:38.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.235+0000 7f10ac9d3640 1 -- 172.21.15.17:0/2130564796 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f109c004c40 con 0x7f10a8101610 2024-08-19T01:03:38.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.235+0000 7f10ac9d3640 1 --2- 172.21.15.17:0/2130564796 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f109006e180 0x7f1090070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:38.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.235+0000 7f10ac9d3640 1 -- 172.21.15.17:0/2130564796 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f109c08dce0 con 0x7f10a8101610 2024-08-19T01:03:38.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.235+0000 7f10a6ffd640 1 --2- 172.21.15.17:0/2130564796 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f109006e180 0x7f1090070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:38.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.236+0000 7f10a6ffd640 1 --2- 172.21.15.17:0/2130564796 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f109006e180 0x7f1090070640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1098009880 tx=0x7f1098005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.239+0000 7f10ac9d3640 1 -- 172.21.15.17:0/2130564796 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f109c0570f0 con 0x7f10a8101610 2024-08-19T01:03:38.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.454+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2130564796 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f10a81043e0 con 0x7f10a8101610 2024-08-19T01:03:38.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.454+0000 7f10ac9d3640 1 -- 172.21.15.17:0/2130564796 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1933 (secure 0 0 0) 0x7f109c017070 con 0x7f10a8101610 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout:e21 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 21 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:03:38.457 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T00:53:41.004049+0000 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 46 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:03:38.458 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14486,1=24299} 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:03:38.459 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:03:38.460 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:03:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:03:38.460 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:03:38.460 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T01:03:38.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.456+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2130564796 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f109006e180 msgr2=0x7f1090070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.456+0000 7f10ad9d5640 1 --2- 172.21.15.17:0/2130564796 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f109006e180 0x7f1090070640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1098009880 tx=0x7f1098005a20 comp rx=0 tx=0).stop 2024-08-19T01:03:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.456+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2130564796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a8101610 msgr2=0x7f10a80fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.456+0000 7f10ad9d5640 1 --2- 172.21.15.17:0/2130564796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a8101610 0x7f10a80fee90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f109c00d8d0 tx=0x7f109c00dd90 comp rx=0 tx=0).stop 2024-08-19T01:03:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.456+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2130564796 shutdown_connections 2024-08-19T01:03:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.456+0000 7f10ad9d5640 1 --2- 172.21.15.17:0/2130564796 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f109006e180 0x7f1090070640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.456+0000 7f10ad9d5640 1 --2- 172.21.15.17:0/2130564796 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10a8101610 0x7f10a80fee90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.456+0000 7f10ad9d5640 1 --2- 172.21.15.17:0/2130564796 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10a8100c60 0x7f10a80fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.456+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2130564796 >> 172.21.15.17:0/2130564796 conn(0x7f10a80fa730 msgr2=0x7f10a8101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.456+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2130564796 shutdown_connections 2024-08-19T01:03:38.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.457+0000 7f10ad9d5640 1 -- 172.21.15.17:0/2130564796 wait complete. 2024-08-19T01:03:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.540+0000 7fbbb9e41640 1 -- 172.21.15.17:0/1730219918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb4100c60 msgr2=0x7fbbb4101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.540+0000 7fbbb9e41640 1 --2- 172.21.15.17:0/1730219918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb4100c60 0x7fbbb4101040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbba40098b0 tx=0x7fbba402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.541+0000 7fbbb9e41640 1 -- 172.21.15.17:0/1730219918 shutdown_connections 2024-08-19T01:03:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.541+0000 7fbbb9e41640 1 --2- 172.21.15.17:0/1730219918 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb4101610 0x7fbbb4109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.541+0000 7fbbb9e41640 1 --2- 172.21.15.17:0/1730219918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb4100c60 0x7fbbb4101040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.541+0000 7fbbb9e41640 1 -- 172.21.15.17:0/1730219918 >> 172.21.15.17:0/1730219918 conn(0x7fbbb40fa730 msgr2=0x7fbbb40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:38.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.541+0000 7fbbb9e41640 1 -- 172.21.15.17:0/1730219918 shutdown_connections 2024-08-19T01:03:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.541+0000 7fbbb9e41640 1 -- 172.21.15.17:0/1730219918 wait complete. 2024-08-19T01:03:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.541+0000 7fbbb9e41640 1 Processor -- start 2024-08-19T01:03:38.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.541+0000 7fbbb9e41640 1 -- start start 2024-08-19T01:03:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbb9e41640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb4100c60 0x7fbbb419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbb9e41640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb4101610 0x7fbbb419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbb9e41640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb419c380 con 0x7fbbb4101610 2024-08-19T01:03:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbb9e41640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb4195910 con 0x7fbbb4100c60 2024-08-19T01:03:38.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbaaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb4101610 0x7fbbb419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbaaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb4101610 0x7fbbb419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47258/0 (socket says 172.21.15.17:47258) 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbaaffd640 1 -- 172.21.15.17:0/637792826 learned_addr learned my addr 172.21.15.17:0/637792826 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbaaffd640 1 -- 172.21.15.17:0/637792826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb4100c60 msgr2=0x7fbbb419b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbb37fe640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb4100c60 0x7fbbb419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbaaffd640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb4100c60 0x7fbbb419b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbaaffd640 1 -- 172.21.15.17:0/637792826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba4009560 con 0x7fbbb4101610 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbb37fe640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb4100c60 0x7fbbb419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbaaffd640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb4101610 0x7fbbb419bd60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00d8d0 tx=0x7fbb9c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbb17fa640 1 -- 172.21.15.17:0/637792826 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb9c009c00 con 0x7fbbb4101610 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbb9e41640 1 -- 172.21.15.17:0/637792826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb4195bf0 con 0x7fbbb4101610 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbb17fa640 1 -- 172.21.15.17:0/637792826 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb9c009d60 con 0x7fbbb4101610 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbb17fa640 1 -- 172.21.15.17:0/637792826 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb9c0049d0 con 0x7fbbb4101610 2024-08-19T01:03:38.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.542+0000 7fbbb9e41640 1 -- 172.21.15.17:0/637792826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb4196140 con 0x7fbbb4101610 2024-08-19T01:03:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.543+0000 7fbbb9e41640 1 -- 172.21.15.17:0/637792826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb4068d30 con 0x7fbbb4101610 2024-08-19T01:03:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.544+0000 7fbbb17fa640 1 -- 172.21.15.17:0/637792826 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbb9c004c90 con 0x7fbbb4101610 2024-08-19T01:03:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.544+0000 7fbbb17fa640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbba006e170 0x7fbba0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:38.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.544+0000 7fbbb17fa640 1 -- 172.21.15.17:0/637792826 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fbb9c08de20 con 0x7fbbb4101610 2024-08-19T01:03:38.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.544+0000 7fbbb37fe640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbba006e170 0x7fbba0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:38.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.545+0000 7fbbb37fe640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbba006e170 0x7fbba0070630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbba4006010 tx=0x7fbba4005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:38.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.549+0000 7fbbb17fa640 1 -- 172.21.15.17:0/637792826 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbb9c0571b0 con 0x7fbbb4101610 2024-08-19T01:03:38.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.749+0000 7fbbb9e41640 1 -- 172.21.15.17:0/637792826 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbb410cdb0 con 0x7fbba006e170 2024-08-19T01:03:38.751 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:38 smithi017 ceph-mon[99370]: pgmap v132: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-08-19T01:03:38.751 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:38 smithi017 ceph-mon[99370]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:38.752 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:38 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:38.752 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:38 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:38.752 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:38 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:03:38.752 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:38 smithi017 ceph-mon[99370]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:38.752 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:38 smithi017 ceph-mon[99370]: from='client.44259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:38.752 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:38 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3867067950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:38.752 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:38 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2130564796' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:03:38.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.750+0000 7fbbb17fa640 1 -- 172.21.15.17:0/637792826 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fbbb410cdb0 con 0x7fbba006e170 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "10/23 daemons upgraded", 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:03:38.753 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:03:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.753+0000 7fbbb9e41640 1 -- 172.21.15.17:0/637792826 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbba006e170 msgr2=0x7fbba0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.753+0000 7fbbb9e41640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbba006e170 0x7fbba0070630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbba4006010 tx=0x7fbba4005e60 comp rx=0 tx=0).stop 2024-08-19T01:03:38.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.753+0000 7fbbb9e41640 1 -- 172.21.15.17:0/637792826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb4101610 msgr2=0x7fbbb419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.753+0000 7fbbb9e41640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb4101610 0x7fbbb419bd60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00d8d0 tx=0x7fbb9c00dd90 comp rx=0 tx=0).stop 2024-08-19T01:03:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.753+0000 7fbbb9e41640 1 -- 172.21.15.17:0/637792826 shutdown_connections 2024-08-19T01:03:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.753+0000 7fbbb9e41640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbba006e170 0x7fbba0070630 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.753+0000 7fbbb9e41640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbb4101610 0x7fbbb419bd60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.753+0000 7fbbb9e41640 1 --2- 172.21.15.17:0/637792826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbb4100c60 0x7fbbb419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.753+0000 7fbbb9e41640 1 -- 172.21.15.17:0/637792826 >> 172.21.15.17:0/637792826 conn(0x7fbbb40fa730 msgr2=0x7fbbb4101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.753+0000 7fbbb9e41640 1 -- 172.21.15.17:0/637792826 shutdown_connections 2024-08-19T01:03:38.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.754+0000 7fbbb9e41640 1 -- 172.21.15.17:0/637792826 wait complete. 2024-08-19T01:03:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.836+0000 7fd0fb190640 1 -- 172.21.15.17:0/136386250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0f4100d90 msgr2=0x7fd0f4101170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.836+0000 7fd0fb190640 1 --2- 172.21.15.17:0/136386250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0f4100d90 0x7fd0f4101170 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0098b0 tx=0x7fd0ec02a4d0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.836+0000 7fd0fb190640 1 -- 172.21.15.17:0/136386250 shutdown_connections 2024-08-19T01:03:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.836+0000 7fd0fb190640 1 --2- 172.21.15.17:0/136386250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0f41016b0 0x7fd0f4109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.836+0000 7fd0fb190640 1 --2- 172.21.15.17:0/136386250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0f4100d90 0x7fd0f4101170 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.836+0000 7fd0fb190640 1 -- 172.21.15.17:0/136386250 >> 172.21.15.17:0/136386250 conn(0x7fd0f40fa730 msgr2=0x7fd0f40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:38.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.836+0000 7fd0fb190640 1 -- 172.21.15.17:0/136386250 shutdown_connections 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.836+0000 7fd0fb190640 1 -- 172.21.15.17:0/136386250 wait complete. 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.836+0000 7fd0fb190640 1 Processor -- start 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0fb190640 1 -- start start 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0fb190640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0f4100d90 0x7fd0f40fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0fb190640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0f41016b0 0x7fd0f40fef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0fb190640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40ff470 con 0x7fd0f4100d90 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0fb190640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40ff5e0 con 0x7fd0f41016b0 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0f8f2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0f4100d90 0x7fd0f40fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0f8f2c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0f4100d90 0x7fd0f40fe9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47274/0 (socket says 172.21.15.17:47274) 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0f8f2c640 1 -- 172.21.15.17:0/3427804250 learned_addr learned my addr 172.21.15.17:0/3427804250 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0f3fff640 1 --2- 172.21.15.17:0/3427804250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0f41016b0 0x7fd0f40fef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0f8f2c640 1 -- 172.21.15.17:0/3427804250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0f41016b0 msgr2=0x7fd0f40fef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:38.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0f8f2c640 1 --2- 172.21.15.17:0/3427804250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0f41016b0 0x7fd0f40fef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0f8f2c640 1 -- 172.21.15.17:0/3427804250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec009560 con 0x7fd0f4100d90 2024-08-19T01:03:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.837+0000 7fd0f8f2c640 1 --2- 172.21.15.17:0/3427804250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0f4100d90 0x7fd0f40fe9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec006010 tx=0x7fd0ec0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.838+0000 7fd0f1ffb640 1 -- 172.21.15.17:0/3427804250 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0ec0048d0 con 0x7fd0f4100d90 2024-08-19T01:03:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.838+0000 7fd0f1ffb640 1 -- 172.21.15.17:0/3427804250 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0ec031640 con 0x7fd0f4100d90 2024-08-19T01:03:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.838+0000 7fd0fb190640 1 -- 172.21.15.17:0/3427804250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f40ff860 con 0x7fd0f4100d90 2024-08-19T01:03:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.838+0000 7fd0f1ffb640 1 -- 172.21.15.17:0/3427804250 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0ec003800 con 0x7fd0f4100d90 2024-08-19T01:03:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.838+0000 7fd0fb190640 1 -- 172.21.15.17:0/3427804250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f41a1f50 con 0x7fd0f4100d90 2024-08-19T01:03:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.839+0000 7fd0fb190640 1 -- 172.21.15.17:0/3427804250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f4068c90 con 0x7fd0f4100d90 2024-08-19T01:03:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.839+0000 7fd0f1ffb640 1 -- 172.21.15.17:0/3427804250 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd0ec004a30 con 0x7fd0f4100d90 2024-08-19T01:03:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.840+0000 7fd0f1ffb640 1 --2- 172.21.15.17:0/3427804250 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd0e006e170 0x7fd0e0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:03:38.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.840+0000 7fd0f1ffb640 1 -- 172.21.15.17:0/3427804250 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd0ec0aee90 con 0x7fd0f4100d90 2024-08-19T01:03:38.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.840+0000 7fd0f3fff640 1 --2- 172.21.15.17:0/3427804250 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd0e006e170 0x7fd0e0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:03:38.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.840+0000 7fd0f3fff640 1 --2- 172.21.15.17:0/3427804250 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd0e006e170 0x7fd0e0070630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4100170 tx=0x7fd0dc005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:03:38.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:38.844+0000 7fd0f1ffb640 1 -- 172.21.15.17:0/3427804250 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd0ec0782d0 con 0x7fd0f4100d90 2024-08-19T01:03:38.902 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:38 smithi086 ceph-mon[71303]: pgmap v132: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-08-19T01:03:38.903 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:38 smithi086 ceph-mon[71303]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:38.903 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:38 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:38.903 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:38 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:38.903 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:38 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:03:38.903 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:38 smithi086 ceph-mon[71303]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:38.903 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:38 smithi086 ceph-mon[71303]: from='client.44259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:38.903 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:38 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3867067950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:38.903 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:38 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2130564796' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:03:39.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.087+0000 7fd0fb190640 1 -- 172.21.15.17:0/3427804250 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd0f40ff860 con 0x7fd0f4100d90 2024-08-19T01:03:39.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.088+0000 7fd0f1ffb640 1 -- 172.21.15.17:0/3427804250 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1296 (secure 0 0 0) 0x7fd0f40ff860 con 0x7fd0f4100d90 2024-08-19T01:03:39.090 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded 2024-08-19T01:03:39.090 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:03:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:03:39.090 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-19T01:03:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: osd.4 (root=default,host=smithi086) is down 2024-08-19T01:03:39.090 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded 2024-08-19T01:03:39.090 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-08-19T01:03:39.091 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-08-19T01:03:39.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.090+0000 7fd0fb190640 1 -- 172.21.15.17:0/3427804250 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd0e006e170 msgr2=0x7fd0e0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:39.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.090+0000 7fd0fb190640 1 --2- 172.21.15.17:0/3427804250 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd0e006e170 0x7fd0e0070630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4100170 tx=0x7fd0dc005f90 comp rx=0 tx=0).stop 2024-08-19T01:03:39.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.090+0000 7fd0fb190640 1 -- 172.21.15.17:0/3427804250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0f4100d90 msgr2=0x7fd0f40fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:03:39.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.090+0000 7fd0fb190640 1 --2- 172.21.15.17:0/3427804250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0f4100d90 0x7fd0f40fe9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec006010 tx=0x7fd0ec0055a0 comp rx=0 tx=0).stop 2024-08-19T01:03:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.090+0000 7fd0fb190640 1 -- 172.21.15.17:0/3427804250 shutdown_connections 2024-08-19T01:03:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.090+0000 7fd0fb190640 1 --2- 172.21.15.17:0/3427804250 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd0e006e170 0x7fd0e0070630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.090+0000 7fd0fb190640 1 --2- 172.21.15.17:0/3427804250 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0f41016b0 0x7fd0f40fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.090+0000 7fd0fb190640 1 --2- 172.21.15.17:0/3427804250 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0f4100d90 0x7fd0f40fe9f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:03:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.090+0000 7fd0fb190640 1 -- 172.21.15.17:0/3427804250 >> 172.21.15.17:0/3427804250 conn(0x7fd0f40fa730 msgr2=0x7fd0f4102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:03:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.090+0000 7fd0fb190640 1 -- 172.21.15.17:0/3427804250 shutdown_connections 2024-08-19T01:03:39.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:03:39.090+0000 7fd0fb190640 1 -- 172.21.15.17:0/3427804250 wait complete. 2024-08-19T01:03:39.824 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:39 smithi086 ceph-mon[71303]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:39.824 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:39 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3427804250' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:03:39.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:39 smithi017 ceph-mon[99370]: from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:03:39.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:39 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3427804250' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:03:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:40 smithi017 ceph-mon[99370]: pgmap v133: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 54/321 objects degraded (16.822%) 2024-08-19T01:03:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:40 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:40 smithi086 ceph-mon[71303]: pgmap v133: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 54/321 objects degraded (16.822%) 2024-08-19T01:03:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:40 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:42 smithi017 ceph-mon[99370]: pgmap v134: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-08-19T01:03:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:42 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:42 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:42 smithi017 ceph-mon[99370]: Health check update: Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:42 smithi086 ceph-mon[71303]: pgmap v134: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-08-19T01:03:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:42 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:42 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:42 smithi086 ceph-mon[71303]: Health check update: Degraded data redundancy: 54/321 objects degraded (16.822%), 15 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:42.908 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:42 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:03:42.702+0000 7fc91addf640 -1 osd.4 69 log_to_monitors true 2024-08-19T01:03:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:43 smithi086 ceph-mon[71303]: from='osd.4 [v2:172.21.15.86:6808/1609239537,v1:172.21.15.86:6809/1609239537]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T01:03:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:43 smithi086 ceph-mon[71303]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T01:03:43.196 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:03:43 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:03:43.144+0000 7fc912b79640 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T01:03:43.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:43 smithi017 ceph-mon[99370]: from='osd.4 [v2:172.21.15.86:6808/1609239537,v1:172.21.15.86:6809/1609239537]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T01:03:43.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:43 smithi017 ceph-mon[99370]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-19T01:03:44.372 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:44 smithi086 ceph-mon[71303]: pgmap v135: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-08-19T01:03:44.372 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:44 smithi086 ceph-mon[71303]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-19T01:03:44.372 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:44 smithi086 ceph-mon[71303]: osdmap e72: 6 total, 5 up, 6 in 2024-08-19T01:03:44.372 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:44 smithi086 ceph-mon[71303]: from='osd.4 [v2:172.21.15.86:6808/1609239537,v1:172.21.15.86:6809/1609239537]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:03:44.372 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:44 smithi086 ceph-mon[71303]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:03:44.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:44 smithi017 ceph-mon[99370]: pgmap v135: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-08-19T01:03:44.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:44 smithi017 ceph-mon[99370]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-19T01:03:44.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:44 smithi017 ceph-mon[99370]: osdmap e72: 6 total, 5 up, 6 in 2024-08-19T01:03:44.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:44 smithi017 ceph-mon[99370]: from='osd.4 [v2:172.21.15.86:6808/1609239537,v1:172.21.15.86:6809/1609239537]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:03:44.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:44 smithi017 ceph-mon[99370]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:03:45.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:03:45.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: osd.4 [v2:172.21.15.86:6808/1609239537,v1:172.21.15.86:6809/1609239537] boot 2024-08-19T01:03:45.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: osdmap e73: 6 total, 6 up, 6 in 2024-08-19T01:03:45.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T01:03:45.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:45.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:45.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:03:45.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:03:45.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:45.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:03:45.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:45.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:45.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:45.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-19T01:03:45.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-19T01:03:45.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:45 smithi017 ceph-mon[99370]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-19T01:03:45.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:03:45.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: osd.4 [v2:172.21.15.86:6808/1609239537,v1:172.21.15.86:6809/1609239537] boot 2024-08-19T01:03:45.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: osdmap e73: 6 total, 6 up, 6 in 2024-08-19T01:03:45.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-19T01:03:45.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:45.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:45.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:03:45.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:03:45.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:45.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:03:45.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:45.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:45.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:03:45.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-19T01:03:45.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-19T01:03:45.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:45 smithi086 ceph-mon[71303]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-08-19T01:03:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:46 smithi017 ceph-mon[99370]: pgmap v138: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-08-19T01:03:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:46 smithi017 ceph-mon[99370]: osdmap e74: 6 total, 6 up, 6 in 2024-08-19T01:03:46.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:46 smithi086 ceph-mon[71303]: pgmap v138: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 54/321 objects degraded (16.822%) 2024-08-19T01:03:46.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:46 smithi086 ceph-mon[71303]: osdmap e74: 6 total, 6 up, 6 in 2024-08-19T01:03:47.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:47 smithi017 ceph-mon[99370]: Health check update: Degraded data redundancy: 10/321 objects degraded (3.115%), 3 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:47.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:47 smithi086 ceph-mon[71303]: Health check update: Degraded data redundancy: 10/321 objects degraded (3.115%), 3 pgs degraded (PG_DEGRADED) 2024-08-19T01:03:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:48 smithi017 ceph-mon[99370]: pgmap v140: 65 pgs: 1 peering, 7 active+undersized, 3 active+undersized+degraded, 54 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s; 10/321 objects degraded (3.115%) 2024-08-19T01:03:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:03:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:48 smithi086 ceph-mon[71303]: pgmap v140: 65 pgs: 1 peering, 7 active+undersized, 3 active+undersized+degraded, 54 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s; 10/321 objects degraded (3.115%) 2024-08-19T01:03:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:03:49.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:49 smithi017 ceph-mon[99370]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/321 objects degraded (3.115%), 3 pgs degraded) 2024-08-19T01:03:49.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:49 smithi086 ceph-mon[71303]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/321 objects degraded (3.115%), 3 pgs degraded) 2024-08-19T01:03:50.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:50 smithi017 ceph-mon[99370]: pgmap v141: 65 pgs: 1 peering, 64 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-08-19T01:03:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:50 smithi086 ceph-mon[71303]: pgmap v141: 65 pgs: 1 peering, 64 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 3 op/s 2024-08-19T01:03:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:52 smithi017 ceph-mon[99370]: pgmap v142: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-08-19T01:03:52.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:52 smithi086 ceph-mon[71303]: pgmap v142: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-08-19T01:03:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:54 smithi017 ceph-mon[99370]: pgmap v143: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-08-19T01:03:54.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:54 smithi086 ceph-mon[71303]: pgmap v143: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-08-19T01:03:56.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:56 smithi017 ceph-mon[99370]: pgmap v144: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-08-19T01:03:56.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:56 smithi086 ceph-mon[71303]: pgmap v144: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-08-19T01:03:58.543 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:58 smithi086 ceph-mon[71303]: pgmap v145: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-19T01:03:58.543 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:03:58 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:03:58.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:58 smithi017 ceph-mon[99370]: pgmap v145: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-19T01:03:58.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:03:58 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:00.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:00 smithi017 ceph-mon[99370]: pgmap v146: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:04:00.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-19T01:04:00.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:00 smithi017 ceph-mon[99370]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-19T01:04:00.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:00 smithi017 ceph-mon[99370]: Upgrade: osd.5 is safe to restart 2024-08-19T01:04:00.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:00 smithi086 ceph-mon[71303]: pgmap v146: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:04:00.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-19T01:04:00.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:00 smithi086 ceph-mon[71303]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-08-19T01:04:00.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:00 smithi086 ceph-mon[71303]: Upgrade: osd.5 is safe to restart 2024-08-19T01:04:02.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:01 smithi086 ceph-mon[71303]: pgmap v147: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:04:02.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:01 smithi086 ceph-mon[71303]: Upgrade: Updating osd.5 2024-08-19T01:04:02.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:01 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:02.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:01 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-19T01:04:02.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:01 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:02.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:01 smithi086 ceph-mon[71303]: Deploying daemon osd.5 on smithi086 2024-08-19T01:04:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:01 smithi017 ceph-mon[99370]: pgmap v147: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:04:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:01 smithi017 ceph-mon[99370]: Upgrade: Updating osd.5 2024-08-19T01:04:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:01 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:01 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-19T01:04:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:01 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:01 smithi017 ceph-mon[99370]: Deploying daemon osd.5 on smithi086 2024-08-19T01:04:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:03 smithi017 ceph-mon[99370]: pgmap v148: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:04:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:04:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:03 smithi086 ceph-mon[71303]: pgmap v148: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:04:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:04:04.196 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:04 smithi086 systemd[1]: Stopping Ceph osd.5 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:04:04.696 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:04 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[43880]: 2024-08-19T01:04:04.360+0000 7f6b690c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:04:04.696 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:04 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[43880]: 2024-08-19T01:04:04.360+0000 7f6b690c9640 -1 osd.5 74 *** Got signal Terminated *** 2024-08-19T01:04:04.696 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:04 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[43880]: 2024-08-19T01:04:04.360+0000 7f6b690c9640 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:04:05.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:04 smithi017 ceph-mon[99370]: osd.5 marked itself down and dead 2024-08-19T01:04:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:04 smithi086 ceph-mon[71303]: osd.5 marked itself down and dead 2024-08-19T01:04:05.539 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:05 smithi086 podman[90720]: 2024-08-19 01:04:05.280968532 +0000 UTC m=+1.015303109 container died 59b6d8d3f06b6f1a33659e911c1b55d8366fd67a3ada600f05126657c25fd163 (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=reef-baa926d, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-19T01:04:05.922 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:05 smithi086 podman[90720]: 2024-08-19 01:04:05.628161206 +0000 UTC m=+1.362495782 container cleanup 59b6d8d3f06b6f1a33659e911c1b55d8366fd67a3ada600f05126657c25fd163 (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5, RELEASE=reef-baa926d, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-19T01:04:05.922 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:05 smithi086 bash[90720]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5 2024-08-19T01:04:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:05 smithi017 ceph-mon[99370]: pgmap v149: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:04:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:05 smithi017 ceph-mon[99370]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:04:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:05 smithi017 ceph-mon[99370]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-08-19T01:04:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:05 smithi017 ceph-mon[99370]: osdmap e75: 6 total, 5 up, 6 in 2024-08-19T01:04:06.196 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:05 smithi086 podman[90737]: 2024-08-19 01:04:05.920837331 +0000 UTC m=+0.640201267 container remove 59b6d8d3f06b6f1a33659e911c1b55d8366fd67a3ada600f05126657c25fd163 (image=quay.ceph.io/ceph-ci/ceph@sha256:72ef1cd08fef1fa146cff7cc4d8a103dd72cfe7f2e8f16bd1cb98a937d106282, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=reef-baa926d, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-08-19T01:04:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:05 smithi086 ceph-mon[71303]: pgmap v149: 65 pgs: 65 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:04:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:05 smithi086 ceph-mon[71303]: Health check failed: 1 osds down (OSD_DOWN) 2024-08-19T01:04:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:05 smithi086 ceph-mon[71303]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-08-19T01:04:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:05 smithi086 ceph-mon[71303]: osdmap e75: 6 total, 5 up, 6 in 2024-08-19T01:04:06.608 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:06 smithi086 podman[90830]: 2024-08-19 01:04:06.168034446 +0000 UTC m=+0.017095993 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:04:06.609 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:06 smithi086 podman[90830]: 2024-08-19 01:04:06.296965297 +0000 UTC m=+0.146026837 container create 6b62fc2cb287d838199f54b2c40e3d4bc909271acefa61f265cf339bc1291a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0) 2024-08-19T01:04:06.609 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:06 smithi086 podman[90830]: 2024-08-19 01:04:06.607701093 +0000 UTC m=+0.456762637 container init 6b62fc2cb287d838199f54b2c40e3d4bc909271acefa61f265cf339bc1291a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:04:06.931 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:06 smithi086 podman[90830]: 2024-08-19 01:04:06.611056909 +0000 UTC m=+0.460118459 container start 6b62fc2cb287d838199f54b2c40e3d4bc909271acefa61f265cf339bc1291a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0) 2024-08-19T01:04:06.932 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:06 smithi086 podman[90830]: 2024-08-19 01:04:06.70761749 +0000 UTC m=+0.556679031 container attach 6b62fc2cb287d838199f54b2c40e3d4bc909271acefa61f265cf339bc1291a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-deactivate, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:04:06.932 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:06 smithi086 podman[90830]: 2024-08-19 01:04:06.7967377 +0000 UTC m=+0.645799242 container died 6b62fc2cb287d838199f54b2c40e3d4bc909271acefa61f265cf339bc1291a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.36.0) 2024-08-19T01:04:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:06 smithi017 ceph-mon[99370]: osdmap e76: 6 total, 5 up, 6 in 2024-08-19T01:04:07.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:06 smithi086 ceph-mon[71303]: osdmap e76: 6 total, 5 up, 6 in 2024-08-19T01:04:07.696 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:07 smithi086 podman[90853]: 2024-08-19 01:04:07.335734588 +0000 UTC m=+0.531026313 container remove 6b62fc2cb287d838199f54b2c40e3d4bc909271acefa61f265cf339bc1291a4c (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:04:07.696 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:07 smithi086 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.5.service: Deactivated successfully. 2024-08-19T01:04:07.696 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:07 smithi086 systemd[1]: Stopped Ceph osd.5 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:04:07.696 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:07 smithi086 systemd[1]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.5.service: Consumed 53.424s CPU time. 2024-08-19T01:04:07.697 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:07 smithi086 systemd[1]: Starting Ceph osd.5 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:04:08.049 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:07 smithi086 ceph-mon[71303]: pgmap v152: 65 pgs: 4 active+undersized, 15 peering, 4 stale+active+clean, 2 active+undersized+degraded, 40 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/321 objects degraded (1.558%) 2024-08-19T01:04:08.049 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:07 smithi086 ceph-mon[71303]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2024-08-19T01:04:08.049 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:07 smithi086 ceph-mon[71303]: Health check failed: Degraded data redundancy: 5/321 objects degraded (1.558%), 2 pgs degraded (PG_DEGRADED) 2024-08-19T01:04:08.049 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:07 smithi086 podman[90954]: 2024-08-19 01:04:07.679435995 +0000 UTC m=+0.017639717 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:04:08.049 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:07 smithi086 podman[90954]: 2024-08-19 01:04:07.786614878 +0000 UTC m=+0.124818590 container create 344c83e99e58c4da95dc2f3cbe5cd78fb6209d8533c943fcb848739941e8267e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-de09dd0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-19T01:04:08.049 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 podman[90954]: 2024-08-19 01:04:08.047852842 +0000 UTC m=+0.386056560 container init 344c83e99e58c4da95dc2f3cbe5cd78fb6209d8533c943fcb848739941e8267e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-19T01:04:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:07 smithi017 ceph-mon[99370]: pgmap v152: 65 pgs: 4 active+undersized, 15 peering, 4 stale+active+clean, 2 active+undersized+degraded, 40 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5/321 objects degraded (1.558%) 2024-08-19T01:04:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:07 smithi017 ceph-mon[99370]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2024-08-19T01:04:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:07 smithi017 ceph-mon[99370]: Health check failed: Degraded data redundancy: 5/321 objects degraded (1.558%), 2 pgs degraded (PG_DEGRADED) 2024-08-19T01:04:08.314 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 podman[90954]: 2024-08-19 01:04:08.0517056 +0000 UTC m=+0.389909313 container start 344c83e99e58c4da95dc2f3cbe5cd78fb6209d8533c943fcb848739941e8267e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-19T01:04:08.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 podman[90954]: 2024-08-19 01:04:08.139331882 +0000 UTC m=+0.477535599 container attach 344c83e99e58c4da95dc2f3cbe5cd78fb6209d8533c943fcb848739941e8267e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-19T01:04:08.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:04:08.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:04:08.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:04:08.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:04:08.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:04:08.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: --> Failed to activate via raw: activate() takes 1 positional argument but 5 were given 2024-08-19T01:04:08.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:04:08.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:04:08.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:04:08.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-08-19T01:04:08.316 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-19T01:04:08.316 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-19T01:04:08.316 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-08-19T01:04:08.316 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-08-19T01:04:08.316 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-08-19T01:04:08.316 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-08-19T01:04:08.696 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-08-19T01:04:08.697 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-08-19T01:04:08.697 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-19T01:04:08.697 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-08-19T01:04:08.697 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-19T01:04:08.697 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-19T01:04:08.697 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate[90968]: --> ceph-volume lvm activate successful for osd ID: 5 2024-08-19T01:04:08.697 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 bash[90954]: --> ceph-volume lvm activate successful for osd ID: 5 2024-08-19T01:04:08.697 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 podman[90954]: 2024-08-19 01:04:08.339952807 +0000 UTC m=+0.678156525 container died 344c83e99e58c4da95dc2f3cbe5cd78fb6209d8533c943fcb848739941e8267e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-19T01:04:09.180 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:08 smithi086 podman[91074]: 2024-08-19 01:04:08.968184639 +0000 UTC m=+0.618337308 container remove 344c83e99e58c4da95dc2f3cbe5cd78fb6209d8533c943fcb848739941e8267e (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-activate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-19T01:04:09.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.187+0000 7f97c86dd640 1 -- 172.21.15.17:0/1247917056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97c0105c00 msgr2=0x7f97c0105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.187+0000 7f97c86dd640 1 --2- 172.21.15.17:0/1247917056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97c0105c00 0x7f97c0105fe0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009880 tx=0x7f97bc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.187+0000 7f97c86dd640 1 -- 172.21.15.17:0/1247917056 shutdown_connections 2024-08-19T01:04:09.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.187+0000 7f97c86dd640 1 --2- 172.21.15.17:0/1247917056 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97c00ffb50 0x7f97c00fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.187+0000 7f97c86dd640 1 --2- 172.21.15.17:0/1247917056 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97c0105c00 0x7f97c0105fe0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.187+0000 7f97c86dd640 1 -- 172.21.15.17:0/1247917056 >> 172.21.15.17:0/1247917056 conn(0x7f97c00fb830 msgr2=0x7f97c00fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:09.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.187+0000 7f97c86dd640 1 -- 172.21.15.17:0/1247917056 shutdown_connections 2024-08-19T01:04:09.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.187+0000 7f97c86dd640 1 -- 172.21.15.17:0/1247917056 wait complete. 2024-08-19T01:04:09.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c86dd640 1 Processor -- start 2024-08-19T01:04:09.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c86dd640 1 -- start start 2024-08-19T01:04:09.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c86dd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97c00ffb50 0x7f97c00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:09.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c86dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97c0105c00 0x7f97c0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c86dd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c0073230 con 0x7f97c0105c00 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c86dd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00733a0 con 0x7f97c00ffb50 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c5c78640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97c0105c00 0x7f97c0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c5c78640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97c0105c00 0x7f97c0072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39568/0 (socket says 172.21.15.17:39568) 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c5c78640 1 -- 172.21.15.17:0/1369934344 learned_addr learned my addr 172.21.15.17:0/1369934344 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c6479640 1 --2- 172.21.15.17:0/1369934344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97c00ffb50 0x7f97c00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c5c78640 1 -- 172.21.15.17:0/1369934344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97c00ffb50 msgr2=0x7f97c00727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c5c78640 1 --2- 172.21.15.17:0/1369934344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97c00ffb50 0x7f97c00727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.188+0000 7f97c5c78640 1 -- 172.21.15.17:0/1369934344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc009560 con 0x7f97c0105c00 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.189+0000 7f97c5c78640 1 --2- 172.21.15.17:0/1369934344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97c0105c00 0x7f97c0072cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f97b000d8d0 tx=0x7f97b000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.189+0000 7f97b77fe640 1 -- 172.21.15.17:0/1369934344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b0009c00 con 0x7f97c0105c00 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.189+0000 7f97b77fe640 1 -- 172.21.15.17:0/1369934344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97b0009d60 con 0x7f97c0105c00 2024-08-19T01:04:09.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.189+0000 7f97c86dd640 1 -- 172.21.15.17:0/1369934344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c01a1c60 con 0x7f97c0105c00 2024-08-19T01:04:09.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.189+0000 7f97b77fe640 1 -- 172.21.15.17:0/1369934344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b00049d0 con 0x7f97c0105c00 2024-08-19T01:04:09.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.189+0000 7f97c86dd640 1 -- 172.21.15.17:0/1369934344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c01a1fc0 con 0x7f97c0105c00 2024-08-19T01:04:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.190+0000 7f97c86dd640 1 -- 172.21.15.17:0/1369934344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c0101200 con 0x7f97c0105c00 2024-08-19T01:04:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.191+0000 7f97b77fe640 1 -- 172.21.15.17:0/1369934344 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f97b0004c90 con 0x7f97c0105c00 2024-08-19T01:04:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.191+0000 7f97b77fe640 1 --2- 172.21.15.17:0/1369934344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f97ac06e180 0x7f97ac070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.191+0000 7f97b77fe640 1 -- 172.21.15.17:0/1369934344 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f97b008de00 con 0x7f97c0105c00 2024-08-19T01:04:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.191+0000 7f97c6479640 1 --2- 172.21.15.17:0/1369934344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f97ac06e180 0x7f97ac070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:09.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.192+0000 7f97c6479640 1 --2- 172.21.15.17:0/1369934344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f97ac06e180 0x7f97ac070640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009230 tx=0x7f97bc005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:09.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.196+0000 7f97b77fe640 1 -- 172.21.15.17:0/1369934344 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f97b0057190 con 0x7f97c0105c00 2024-08-19T01:04:09.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.388+0000 7f97c86dd640 1 -- 172.21.15.17:0/1369934344 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f97c010cda0 con 0x7f97ac06e180 2024-08-19T01:04:09.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.390+0000 7f97b77fe640 1 -- 172.21.15.17:0/1369934344 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f97c010cda0 con 0x7f97ac06e180 2024-08-19T01:04:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.392+0000 7f97c86dd640 1 -- 172.21.15.17:0/1369934344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f97ac06e180 msgr2=0x7f97ac070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.392+0000 7f97c86dd640 1 --2- 172.21.15.17:0/1369934344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f97ac06e180 0x7f97ac070640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009230 tx=0x7f97bc005a20 comp rx=0 tx=0).stop 2024-08-19T01:04:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.392+0000 7f97c86dd640 1 -- 172.21.15.17:0/1369934344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97c0105c00 msgr2=0x7f97c0072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.392+0000 7f97c86dd640 1 --2- 172.21.15.17:0/1369934344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97c0105c00 0x7f97c0072cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f97b000d8d0 tx=0x7f97b000dd90 comp rx=0 tx=0).stop 2024-08-19T01:04:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.392+0000 7f97c86dd640 1 -- 172.21.15.17:0/1369934344 shutdown_connections 2024-08-19T01:04:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.392+0000 7f97c86dd640 1 --2- 172.21.15.17:0/1369934344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f97ac06e180 0x7f97ac070640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.392+0000 7f97c86dd640 1 --2- 172.21.15.17:0/1369934344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97c0105c00 0x7f97c0072cf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.392+0000 7f97c86dd640 1 --2- 172.21.15.17:0/1369934344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97c00ffb50 0x7f97c00727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.392+0000 7f97c86dd640 1 -- 172.21.15.17:0/1369934344 >> 172.21.15.17:0/1369934344 conn(0x7f97c00fb830 msgr2=0x7f97c00fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.392+0000 7f97c86dd640 1 -- 172.21.15.17:0/1369934344 shutdown_connections 2024-08-19T01:04:09.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.392+0000 7f97c86dd640 1 -- 172.21.15.17:0/1369934344 wait complete. 2024-08-19T01:04:09.403 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:04:09.446 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:09 smithi086 podman[91133]: 2024-08-19 01:04:09.08194208 +0000 UTC m=+0.016751283 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:04:09.446 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:09 smithi086 podman[91133]: 2024-08-19 01:04:09.202335547 +0000 UTC m=+0.137144792 container create 6816a54a030f44e3ed049b2d917f89a9699ea9929cd7434159915367964139bb (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-19T01:04:09.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.475+0000 7f8ac2726640 1 -- 172.21.15.17:0/486182055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8abc100d50 msgr2=0x7f8abc101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.475+0000 7f8ac2726640 1 --2- 172.21.15.17:0/486182055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8abc100d50 0x7f8abc101130 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009880 tx=0x7f8aac02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.476+0000 7f8ac2726640 1 -- 172.21.15.17:0/486182055 shutdown_connections 2024-08-19T01:04:09.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.476+0000 7f8ac2726640 1 --2- 172.21.15.17:0/486182055 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc101670 0x7f8abc109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.476+0000 7f8ac2726640 1 --2- 172.21.15.17:0/486182055 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8abc100d50 0x7f8abc101130 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.476+0000 7f8ac2726640 1 -- 172.21.15.17:0/486182055 >> 172.21.15.17:0/486182055 conn(0x7f8abc0fa730 msgr2=0x7f8abc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:09.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.476+0000 7f8ac2726640 1 -- 172.21.15.17:0/486182055 shutdown_connections 2024-08-19T01:04:09.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.476+0000 7f8ac2726640 1 -- 172.21.15.17:0/486182055 wait complete. 2024-08-19T01:04:09.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.476+0000 7f8ac2726640 1 Processor -- start 2024-08-19T01:04:09.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.476+0000 7f8ac2726640 1 -- start start 2024-08-19T01:04:09.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8ac2726640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8abc100d50 0x7f8abc0fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:09.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8ac2726640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc101670 0x7f8abc0feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:09.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8ac2726640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0ff430 con 0x7f8abc100d50 2024-08-19T01:04:09.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8ac2726640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0ff5a0 con 0x7f8abc101670 2024-08-19T01:04:09.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8abbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8abc100d50 0x7f8abc0fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:09.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8abbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8abc100d50 0x7f8abc0fe9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39574/0 (socket says 172.21.15.17:39574) 2024-08-19T01:04:09.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8abbfff640 1 -- 172.21.15.17:0/550157048 learned_addr learned my addr 172.21.15.17:0/550157048 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8abb7fe640 1 --2- 172.21.15.17:0/550157048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc101670 0x7f8abc0feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8abbfff640 1 -- 172.21.15.17:0/550157048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc101670 msgr2=0x7f8abc0feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8abbfff640 1 --2- 172.21.15.17:0/550157048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc101670 0x7f8abc0feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8abbfff640 1 -- 172.21.15.17:0/550157048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac009560 con 0x7f8abc100d50 2024-08-19T01:04:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.477+0000 7f8abbfff640 1 --2- 172.21.15.17:0/550157048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8abc100d50 0x7f8abc0fe9b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8aac02a9c0 tx=0x7f8aac0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.478+0000 7f8ab97fa640 1 -- 172.21.15.17:0/550157048 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8aac0048d0 con 0x7f8abc100d50 2024-08-19T01:04:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.478+0000 7f8ab97fa640 1 -- 172.21.15.17:0/550157048 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8aac031640 con 0x7f8abc100d50 2024-08-19T01:04:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.478+0000 7f8ac2726640 1 -- 172.21.15.17:0/550157048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc1a1c50 con 0x7f8abc100d50 2024-08-19T01:04:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.478+0000 7f8ab97fa640 1 -- 172.21.15.17:0/550157048 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8aac0038d0 con 0x7f8abc100d50 2024-08-19T01:04:09.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.478+0000 7f8ac2726640 1 -- 172.21.15.17:0/550157048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc1a1fb0 con 0x7f8abc100d50 2024-08-19T01:04:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.479+0000 7f8ac2726640 1 -- 172.21.15.17:0/550157048 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc068cd0 con 0x7f8abc100d50 2024-08-19T01:04:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.479+0000 7f8ab97fa640 1 -- 172.21.15.17:0/550157048 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8aac003b90 con 0x7f8abc100d50 2024-08-19T01:04:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.480+0000 7f8ab97fa640 1 --2- 172.21.15.17:0/550157048 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8aa406e170 0x7f8aa4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.480+0000 7f8ab97fa640 1 -- 172.21.15.17:0/550157048 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8aac0aefa0 con 0x7f8abc100d50 2024-08-19T01:04:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.480+0000 7f8abb7fe640 1 --2- 172.21.15.17:0/550157048 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8aa406e170 0x7f8aa4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:09.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.480+0000 7f8abb7fe640 1 --2- 172.21.15.17:0/550157048 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8aa406e170 0x7f8aa4070630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8abc100130 tx=0x7f8ab0005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:09.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.484+0000 7f8ab97fa640 1 -- 172.21.15.17:0/550157048 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8aac0783e0 con 0x7f8abc100d50 2024-08-19T01:04:09.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.679+0000 7f8ac2726640 1 -- 172.21.15.17:0/550157048 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8abc104410 con 0x7f8aa406e170 2024-08-19T01:04:09.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.680+0000 7f8ab97fa640 1 -- 172.21.15.17:0/550157048 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f8abc104410 con 0x7f8aa406e170 2024-08-19T01:04:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.682+0000 7f8ac2726640 1 -- 172.21.15.17:0/550157048 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8aa406e170 msgr2=0x7f8aa4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.682+0000 7f8ac2726640 1 --2- 172.21.15.17:0/550157048 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8aa406e170 0x7f8aa4070630 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8abc100130 tx=0x7f8ab0005f90 comp rx=0 tx=0).stop 2024-08-19T01:04:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.682+0000 7f8ac2726640 1 -- 172.21.15.17:0/550157048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8abc100d50 msgr2=0x7f8abc0fe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.682+0000 7f8ac2726640 1 --2- 172.21.15.17:0/550157048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8abc100d50 0x7f8abc0fe9b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8aac02a9c0 tx=0x7f8aac0055a0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.682+0000 7f8ac2726640 1 -- 172.21.15.17:0/550157048 shutdown_connections 2024-08-19T01:04:09.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.682+0000 7f8ac2726640 1 --2- 172.21.15.17:0/550157048 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8aa406e170 0x7f8aa4070630 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.682+0000 7f8ac2726640 1 --2- 172.21.15.17:0/550157048 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8abc101670 0x7f8abc0feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.682+0000 7f8ac2726640 1 --2- 172.21.15.17:0/550157048 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8abc100d50 0x7f8abc0fe9b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.682+0000 7f8ac2726640 1 -- 172.21.15.17:0/550157048 >> 172.21.15.17:0/550157048 conn(0x7f8abc0fa730 msgr2=0x7f8abc101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:09.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.682+0000 7f8ac2726640 1 -- 172.21.15.17:0/550157048 shutdown_connections 2024-08-19T01:04:09.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.682+0000 7f8ac2726640 1 -- 172.21.15.17:0/550157048 wait complete. 2024-08-19T01:04:09.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.764+0000 7fe1a95cf640 1 -- 172.21.15.17:0/2053556935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a4105bf0 msgr2=0x7fe1a4105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.764+0000 7fe1a95cf640 1 --2- 172.21.15.17:0/2053556935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a4105bf0 0x7fe1a4105fd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe194009880 tx=0x7fe19402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.764+0000 7fe1a95cf640 1 -- 172.21.15.17:0/2053556935 shutdown_connections 2024-08-19T01:04:09.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.764+0000 7fe1a95cf640 1 --2- 172.21.15.17:0/2053556935 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a40ffb40 0x7fe1a40fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.764+0000 7fe1a95cf640 1 --2- 172.21.15.17:0/2053556935 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a4105bf0 0x7fe1a4105fd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.764+0000 7fe1a95cf640 1 -- 172.21.15.17:0/2053556935 >> 172.21.15.17:0/2053556935 conn(0x7fe1a40fb7e0 msgr2=0x7fe1a40fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:09.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.765+0000 7fe1a95cf640 1 -- 172.21.15.17:0/2053556935 shutdown_connections 2024-08-19T01:04:09.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.765+0000 7fe1a95cf640 1 -- 172.21.15.17:0/2053556935 wait complete. 2024-08-19T01:04:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.765+0000 7fe1a95cf640 1 Processor -- start 2024-08-19T01:04:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.765+0000 7fe1a95cf640 1 -- start start 2024-08-19T01:04:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a95cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a40ffb40 0x7fe1a419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a95cf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a4105bf0 0x7fe1a419bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a95cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a419c2c0 con 0x7fe1a40ffb40 2024-08-19T01:04:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a95cf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a41958b0 con 0x7fe1a4105bf0 2024-08-19T01:04:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a40ffb40 0x7fe1a419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a40ffb40 0x7fe1a419b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39606/0 (socket says 172.21.15.17:39606) 2024-08-19T01:04:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a2ffd640 1 -- 172.21.15.17:0/4161920805 learned_addr learned my addr 172.21.15.17:0/4161920805 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a27fc640 1 --2- 172.21.15.17:0/4161920805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a4105bf0 0x7fe1a419bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:09.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a2ffd640 1 -- 172.21.15.17:0/4161920805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a4105bf0 msgr2=0x7fe1a419bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a2ffd640 1 --2- 172.21.15.17:0/4161920805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a4105bf0 0x7fe1a419bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a2ffd640 1 -- 172.21.15.17:0/4161920805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe194009560 con 0x7fe1a40ffb40 2024-08-19T01:04:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.766+0000 7fe1a2ffd640 1 --2- 172.21.15.17:0/4161920805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a40ffb40 0x7fe1a419b6f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe19402a9c0 tx=0x7fe1940055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.767+0000 7fe18bfff640 1 -- 172.21.15.17:0/4161920805 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe194004aa0 con 0x7fe1a40ffb40 2024-08-19T01:04:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.767+0000 7fe1a95cf640 1 -- 172.21.15.17:0/4161920805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a4195b30 con 0x7fe1a40ffb40 2024-08-19T01:04:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.767+0000 7fe1a95cf640 1 -- 172.21.15.17:0/4161920805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a4196020 con 0x7fe1a40ffb40 2024-08-19T01:04:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.767+0000 7fe18bfff640 1 -- 172.21.15.17:0/4161920805 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe194004c00 con 0x7fe1a40ffb40 2024-08-19T01:04:09.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.767+0000 7fe18bfff640 1 -- 172.21.15.17:0/4161920805 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe194003980 con 0x7fe1a40ffb40 2024-08-19T01:04:09.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.768+0000 7fe1a95cf640 1 -- 172.21.15.17:0/4161920805 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe190005250 con 0x7fe1a40ffb40 2024-08-19T01:04:09.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.768+0000 7fe18bfff640 1 -- 172.21.15.17:0/4161920805 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe194003be0 con 0x7fe1a40ffb40 2024-08-19T01:04:09.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.769+0000 7fe18bfff640 1 --2- 172.21.15.17:0/4161920805 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe18c06e170 0x7fe18c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:09.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.769+0000 7fe18bfff640 1 -- 172.21.15.17:0/4161920805 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe1940aef80 con 0x7fe1a40ffb40 2024-08-19T01:04:09.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.769+0000 7fe1a27fc640 1 --2- 172.21.15.17:0/4161920805 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe18c06e170 0x7fe18c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:09.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.769+0000 7fe1a27fc640 1 --2- 172.21.15.17:0/4161920805 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe18c06e170 0x7fe18c070630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40ff170 tx=0x7fe19800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:09.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.773+0000 7fe18bfff640 1 -- 172.21.15.17:0/4161920805 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe1940e3df0 con 0x7fe1a40ffb40 2024-08-19T01:04:09.946 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:09 smithi086 podman[91133]: 2024-08-19 01:04:09.472787934 +0000 UTC m=+0.407597129 container init 6816a54a030f44e3ed049b2d917f89a9699ea9929cd7434159915367964139bb (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-08-19T01:04:09.946 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:09 smithi086 podman[91133]: 2024-08-19 01:04:09.476071524 +0000 UTC m=+0.410880729 container start 6816a54a030f44e3ed049b2d917f89a9699ea9929cd7434159915367964139bb (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T01:04:09.946 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:09 smithi086 ceph-osd[91152]: -- 172.21.15.86:0/1507893632 <== mon.1 v2:172.21.15.86:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f6f38321e0 con 0x55f6f37c6000 2024-08-19T01:04:09.946 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:09 smithi086 bash[91133]: 6816a54a030f44e3ed049b2d917f89a9699ea9929cd7434159915367964139bb 2024-08-19T01:04:09.947 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:09 smithi086 systemd[1]: Started Ceph osd.5 for 61e0bb80-5dc4-11ef-bccf-c7b262605968. 2024-08-19T01:04:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.957+0000 7fe1a95cf640 1 -- 172.21.15.17:0/4161920805 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe190000bc0 con 0x7fe18c06e170 2024-08-19T01:04:09.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.967+0000 7fe18bfff640 1 -- 172.21.15.17:0/4161920805 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fe190000bc0 con 0x7fe18c06e170 2024-08-19T01:04:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:04:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (5m) 94s ago 16m 26.7M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:04:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (16m) 94s ago 16m 8862k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:04:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (15m) 29s ago 15m 8744k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:04:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (3m) 94s ago 16m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:04:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (3m) 29s ago 15m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:04:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (5m) 94s ago 15m 79.7M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:04:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (10m) 94s ago 10m 156M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T01:04:09.969 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (10m) 94s ago 10m 92.0M - 18.2.4-721-gbaa926de e6c292a6bc95 666c45c8ac78 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (10m) 29s ago 10m 26.6M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (10m) 29s ago 10m 25.9M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (7m) 94s ago 17m 498M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (6m) 29s ago 15m 441M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (4m) 94s ago 17m 47.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (3m) 29s ago 15m 41.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (6m) 94s ago 16m 16.0M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (6m) 29s ago 15m 15.1M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (2m) 94s ago 14m 85.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (2m) 94s ago 13m 87.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (100s) 94s ago 13m 11.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:04:09.970 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (65s) 29s ago 13m 89.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:04:09.971 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (32s) 29s ago 12m 12.1M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:04:09.971 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 starting - - - 2240M 2024-08-19T01:04:09.971 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (5m) 94s ago 15m 67.3M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:04:09.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.969+0000 7fe1a95cf640 1 -- 172.21.15.17:0/4161920805 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe18c06e170 msgr2=0x7fe18c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.969+0000 7fe1a95cf640 1 --2- 172.21.15.17:0/4161920805 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe18c06e170 0x7fe18c070630 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40ff170 tx=0x7fe19800b410 comp rx=0 tx=0).stop 2024-08-19T01:04:09.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.969+0000 7fe1a95cf640 1 -- 172.21.15.17:0/4161920805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a40ffb40 msgr2=0x7fe1a419b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:09.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.969+0000 7fe1a95cf640 1 --2- 172.21.15.17:0/4161920805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a40ffb40 0x7fe1a419b6f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe19402a9c0 tx=0x7fe1940055a0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.969+0000 7fe1a95cf640 1 -- 172.21.15.17:0/4161920805 shutdown_connections 2024-08-19T01:04:09.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.969+0000 7fe1a95cf640 1 --2- 172.21.15.17:0/4161920805 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe18c06e170 0x7fe18c070630 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.969+0000 7fe1a95cf640 1 --2- 172.21.15.17:0/4161920805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1a4105bf0 0x7fe1a419bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.969+0000 7fe1a95cf640 1 --2- 172.21.15.17:0/4161920805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1a40ffb40 0x7fe1a419b6f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:09.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.969+0000 7fe1a95cf640 1 -- 172.21.15.17:0/4161920805 >> 172.21.15.17:0/4161920805 conn(0x7fe1a40fb7e0 msgr2=0x7fe1a40fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:09.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.970+0000 7fe1a95cf640 1 -- 172.21.15.17:0/4161920805 shutdown_connections 2024-08-19T01:04:09.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:09.970+0000 7fe1a95cf640 1 -- 172.21.15.17:0/4161920805 wait complete. 2024-08-19T01:04:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.051+0000 7fdc811e8640 1 -- 172.21.15.17:0/3543209756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc7c0ffda0 msgr2=0x7fdc7c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.051+0000 7fdc811e8640 1 --2- 172.21.15.17:0/3543209756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc7c0ffda0 0x7fdc7c100180 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c009c20 tx=0x7fdc6c02a970 comp rx=0 tx=0).stop 2024-08-19T01:04:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.051+0000 7fdc811e8640 1 -- 172.21.15.17:0/3543209756 shutdown_connections 2024-08-19T01:04:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.051+0000 7fdc811e8640 1 --2- 172.21.15.17:0/3543209756 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc7c100750 0x7fdc7c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.051+0000 7fdc811e8640 1 --2- 172.21.15.17:0/3543209756 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc7c0ffda0 0x7fdc7c100180 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.051+0000 7fdc811e8640 1 -- 172.21.15.17:0/3543209756 >> 172.21.15.17:0/3543209756 conn(0x7fdc7c0fb840 msgr2=0x7fdc7c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:10.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.051+0000 7fdc811e8640 1 -- 172.21.15.17:0/3543209756 shutdown_connections 2024-08-19T01:04:10.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.051+0000 7fdc811e8640 1 -- 172.21.15.17:0/3543209756 wait complete. 2024-08-19T01:04:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.051+0000 7fdc811e8640 1 Processor -- start 2024-08-19T01:04:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.052+0000 7fdc811e8640 1 -- start start 2024-08-19T01:04:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.052+0000 7fdc811e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc7c0ffda0 0x7fdc7c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.052+0000 7fdc811e8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc7c100750 0x7fdc7c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.052+0000 7fdc811e8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c073230 con 0x7fdc7c0ffda0 2024-08-19T01:04:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.052+0000 7fdc811e8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c073370 con 0x7fdc7c100750 2024-08-19T01:04:10.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.052+0000 7fdc7ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc7c0ffda0 0x7fdc7c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.052+0000 7fdc7ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc7c0ffda0 0x7fdc7c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39622/0 (socket says 172.21.15.17:39622) 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.052+0000 7fdc7ad9d640 1 -- 172.21.15.17:0/2667437737 learned_addr learned my addr 172.21.15.17:0/2667437737 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.052+0000 7fdc7a59c640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc7c100750 0x7fdc7c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.053+0000 7fdc7a59c640 1 -- 172.21.15.17:0/2667437737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc7c0ffda0 msgr2=0x7fdc7c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.053+0000 7fdc7a59c640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc7c0ffda0 0x7fdc7c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.053+0000 7fdc7a59c640 1 -- 172.21.15.17:0/2667437737 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c009900 con 0x7fdc7c100750 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.053+0000 7fdc7ad9d640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc7c0ffda0 0x7fdc7c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.053+0000 7fdc7a59c640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc7c100750 0x7fdc7c072cf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400d6a0 tx=0x7fdc6400db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.053+0000 7fdc73fff640 1 -- 172.21.15.17:0/2667437737 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc640051f0 con 0x7fdc7c100750 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.053+0000 7fdc73fff640 1 -- 172.21.15.17:0/2667437737 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc64009c80 con 0x7fdc7c100750 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.053+0000 7fdc811e8640 1 -- 172.21.15.17:0/2667437737 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c1a1db0 con 0x7fdc7c100750 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.053+0000 7fdc73fff640 1 -- 172.21.15.17:0/2667437737 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc64004e10 con 0x7fdc7c100750 2024-08-19T01:04:10.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.053+0000 7fdc811e8640 1 -- 172.21.15.17:0/2667437737 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c1a21c0 con 0x7fdc7c100750 2024-08-19T01:04:10.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.054+0000 7fdc811e8640 1 -- 172.21.15.17:0/2667437737 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c101280 con 0x7fdc7c100750 2024-08-19T01:04:10.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.054+0000 7fdc73fff640 1 -- 172.21.15.17:0/2667437737 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdc640097c0 con 0x7fdc7c100750 2024-08-19T01:04:10.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.055+0000 7fdc73fff640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc6806e110 0x7fdc680705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.055+0000 7fdc73fff640 1 -- 172.21.15.17:0/2667437737 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdc6408db10 con 0x7fdc7c100750 2024-08-19T01:04:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.055+0000 7fdc7ad9d640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc6806e110 0x7fdc680705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.056+0000 7fdc7ad9d640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc6806e110 0x7fdc680705d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c000f80 tx=0x7fdc6c03d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:10.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.059+0000 7fdc73fff640 1 -- 172.21.15.17:0/2667437737 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdc64056eb0 con 0x7fdc7c100750 2024-08-19T01:04:10.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.301+0000 7fdc811e8640 1 -- 172.21.15.17:0/2667437737 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdc7c1080b0 con 0x7fdc7c100750 2024-08-19T01:04:10.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.302+0000 7fdc73fff640 1 -- 172.21.15.17:0/2667437737 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+724 (secure 0 0 0) 0x7fdc6405a570 con 0x7fdc7c100750 2024-08-19T01:04:10.304 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:04:10.304 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:04:10.304 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:04:10.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 5 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 4, 2024-08-19T01:04:10.305 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 9 2024-08-19T01:04:10.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:04:10.306 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:04:10.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.304+0000 7fdc811e8640 1 -- 172.21.15.17:0/2667437737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc6806e110 msgr2=0x7fdc680705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.304+0000 7fdc811e8640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc6806e110 0x7fdc680705d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c000f80 tx=0x7fdc6c03d040 comp rx=0 tx=0).stop 2024-08-19T01:04:10.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.304+0000 7fdc811e8640 1 -- 172.21.15.17:0/2667437737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc7c100750 msgr2=0x7fdc7c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.304+0000 7fdc811e8640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc7c100750 0x7fdc7c072cf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400d6a0 tx=0x7fdc6400db60 comp rx=0 tx=0).stop 2024-08-19T01:04:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.304+0000 7fdc811e8640 1 -- 172.21.15.17:0/2667437737 shutdown_connections 2024-08-19T01:04:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.304+0000 7fdc811e8640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc6806e110 0x7fdc680705d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.304+0000 7fdc811e8640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc7c100750 0x7fdc7c072cf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.304+0000 7fdc811e8640 1 --2- 172.21.15.17:0/2667437737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc7c0ffda0 0x7fdc7c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.304+0000 7fdc811e8640 1 -- 172.21.15.17:0/2667437737 >> 172.21.15.17:0/2667437737 conn(0x7fdc7c0fb840 msgr2=0x7fdc7c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.304+0000 7fdc811e8640 1 -- 172.21.15.17:0/2667437737 shutdown_connections 2024-08-19T01:04:10.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.304+0000 7fdc811e8640 1 -- 172.21.15.17:0/2667437737 wait complete. 2024-08-19T01:04:10.362 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:10 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:04:10.027+0000 7fc37a884640 -1 Falling back to public interface 2024-08-19T01:04:10.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.386+0000 7f48ed587640 1 -- 172.21.15.17:0/41031118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e8105bf0 msgr2=0x7f48e8105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.386+0000 7f48ed587640 1 --2- 172.21.15.17:0/41031118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e8105bf0 0x7f48e8105fd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009880 tx=0x7f48d802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.386+0000 7f48ed587640 1 -- 172.21.15.17:0/41031118 shutdown_connections 2024-08-19T01:04:10.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.386+0000 7f48ed587640 1 --2- 172.21.15.17:0/41031118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80ffb40 0x7f48e80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.386+0000 7f48ed587640 1 --2- 172.21.15.17:0/41031118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e8105bf0 0x7f48e8105fd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.386+0000 7f48ed587640 1 -- 172.21.15.17:0/41031118 >> 172.21.15.17:0/41031118 conn(0x7f48e80fb7e0 msgr2=0x7f48e80fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:10.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.386+0000 7f48ed587640 1 -- 172.21.15.17:0/41031118 shutdown_connections 2024-08-19T01:04:10.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.386+0000 7f48ed587640 1 -- 172.21.15.17:0/41031118 wait complete. 2024-08-19T01:04:10.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48ed587640 1 Processor -- start 2024-08-19T01:04:10.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48ed587640 1 -- start start 2024-08-19T01:04:10.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48ed587640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80ffb40 0x7f48e80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48ed587640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e8105bf0 0x7f48e8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48ed587640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8073230 con 0x7f48e8105bf0 2024-08-19T01:04:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48ed587640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e80733a0 con 0x7f48e80ffb40 2024-08-19T01:04:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48e67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e8105bf0 0x7f48e8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48e67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e8105bf0 0x7f48e8072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39642/0 (socket says 172.21.15.17:39642) 2024-08-19T01:04:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48e67fc640 1 -- 172.21.15.17:0/2551617110 learned_addr learned my addr 172.21.15.17:0/2551617110 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48e6ffd640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80ffb40 0x7f48e80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48e67fc640 1 -- 172.21.15.17:0/2551617110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80ffb40 msgr2=0x7f48e80727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48e67fc640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80ffb40 0x7f48e80727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48e67fc640 1 -- 172.21.15.17:0/2551617110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d8009560 con 0x7f48e8105bf0 2024-08-19T01:04:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.387+0000 7f48e6ffd640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80ffb40 0x7f48e80727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:04:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.388+0000 7f48e67fc640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e8105bf0 0x7f48e8072cf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00d6f0 tx=0x7f48dc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.388+0000 7f48cffff640 1 -- 172.21.15.17:0/2551617110 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48dc009a30 con 0x7f48e8105bf0 2024-08-19T01:04:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.388+0000 7f48cffff640 1 -- 172.21.15.17:0/2551617110 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f48dc0054e0 con 0x7f48e8105bf0 2024-08-19T01:04:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.388+0000 7f48ed587640 1 -- 172.21.15.17:0/2551617110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e81a1cd0 con 0x7f48e8105bf0 2024-08-19T01:04:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.388+0000 7f48cffff640 1 -- 172.21.15.17:0/2551617110 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f48dc010460 con 0x7f48e8105bf0 2024-08-19T01:04:10.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.388+0000 7f48ed587640 1 -- 172.21.15.17:0/2551617110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e81a2030 con 0x7f48e8105bf0 2024-08-19T01:04:10.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.389+0000 7f48ed587640 1 -- 172.21.15.17:0/2551617110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e81011f0 con 0x7f48e8105bf0 2024-08-19T01:04:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.389+0000 7f48cffff640 1 -- 172.21.15.17:0/2551617110 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f48dc009b90 con 0x7f48e8105bf0 2024-08-19T01:04:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.390+0000 7f48cffff640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f48d006e170 0x7f48d0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.390+0000 7f48cffff640 1 -- 172.21.15.17:0/2551617110 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f48dc08dc80 con 0x7f48e8105bf0 2024-08-19T01:04:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.390+0000 7f48e6ffd640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f48d006e170 0x7f48d0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.390+0000 7f48e6ffd640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f48d006e170 0x7f48d0070630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f48d8000c00 tx=0x7f48d8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:10.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.394+0000 7f48cffff640 1 -- 172.21.15.17:0/2551617110 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f48dc057010 con 0x7f48e8105bf0 2024-08-19T01:04:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.607+0000 7f48ed587640 1 -- 172.21.15.17:0/2551617110 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f48e80fffa0 con 0x7f48e8105bf0 2024-08-19T01:04:10.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.607+0000 7f48cffff640 1 -- 172.21.15.17:0/2551617110 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1933 (secure 0 0 0) 0x7f48dc0207a0 con 0x7f48e8105bf0 2024-08-19T01:04:10.610 INFO:teuthology.orchestra.run.smithi017.stdout:e21 2024-08-19T01:04:10.610 INFO:teuthology.orchestra.run.smithi017.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-08-19T01:04:10.610 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:04:10.610 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:04:10.610 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:04:10.610 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:04:10.610 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:04:10.610 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:04:10.610 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 21 2024-08-19T01:04:10.610 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T00:53:41.004049+0000 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 46 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:04:10.611 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=14486,1=24299} 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{0:14486} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.17:6828/1603673340,v1:172.21.15.17:6829/1603673340] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:04:10.612 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:14500} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/4086584591,v1:172.21.15.17:6827/4086584591] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:04:10.613 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{1:24299} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.86:6824/3387019469,v1:172.21.15.86:6825/3387019469] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:04:10.613 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{1:24311} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.86:6826/91507416,v1:172.21.15.86:6827/91507416] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:04:10.613 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:04:10.613 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:04:10.613 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 21 2024-08-19T01:04:10.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.610+0000 7f48ed587640 1 -- 172.21.15.17:0/2551617110 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f48d006e170 msgr2=0x7f48d0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.610+0000 7f48ed587640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f48d006e170 0x7f48d0070630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f48d8000c00 tx=0x7f48d8005a20 comp rx=0 tx=0).stop 2024-08-19T01:04:10.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.610+0000 7f48ed587640 1 -- 172.21.15.17:0/2551617110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e8105bf0 msgr2=0x7f48e8072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.610+0000 7f48ed587640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e8105bf0 0x7f48e8072cf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00d6f0 tx=0x7f48dc00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.610+0000 7f48ed587640 1 -- 172.21.15.17:0/2551617110 shutdown_connections 2024-08-19T01:04:10.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.610+0000 7f48ed587640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f48d006e170 0x7f48d0070630 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.610+0000 7f48ed587640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48e8105bf0 0x7f48e8072cf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.610+0000 7f48ed587640 1 --2- 172.21.15.17:0/2551617110 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f48e80ffb40 0x7f48e80727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.610+0000 7f48ed587640 1 -- 172.21.15.17:0/2551617110 >> 172.21.15.17:0/2551617110 conn(0x7f48e80fb7e0 msgr2=0x7f48e80fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:10.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.610+0000 7f48ed587640 1 -- 172.21.15.17:0/2551617110 shutdown_connections 2024-08-19T01:04:10.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.611+0000 7f48ed587640 1 -- 172.21.15.17:0/2551617110 wait complete. 2024-08-19T01:04:10.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.694+0000 7fa760359640 1 -- 172.21.15.17:0/1777336482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7580ffda0 msgr2=0x7fa758100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.694+0000 7fa760359640 1 --2- 172.21.15.17:0/1777336482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7580ffda0 0x7fa758100180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa748009c20 tx=0x7fa74802a970 comp rx=0 tx=0).stop 2024-08-19T01:04:10.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.694+0000 7fa760359640 1 -- 172.21.15.17:0/1777336482 shutdown_connections 2024-08-19T01:04:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.694+0000 7fa760359640 1 --2- 172.21.15.17:0/1777336482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa758100750 0x7fa7581047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.694+0000 7fa760359640 1 --2- 172.21.15.17:0/1777336482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7580ffda0 0x7fa758100180 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.694+0000 7fa760359640 1 -- 172.21.15.17:0/1777336482 >> 172.21.15.17:0/1777336482 conn(0x7fa7580fb840 msgr2=0x7fa7580fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.694+0000 7fa760359640 1 -- 172.21.15.17:0/1777336482 shutdown_connections 2024-08-19T01:04:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.694+0000 7fa760359640 1 -- 172.21.15.17:0/1777336482 wait complete. 2024-08-19T01:04:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.695+0000 7fa760359640 1 Processor -- start 2024-08-19T01:04:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.695+0000 7fa760359640 1 -- start start 2024-08-19T01:04:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.695+0000 7fa760359640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7580ffda0 0x7fa7580727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.695+0000 7fa760359640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa758100750 0x7fa758072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.695+0000 7fa760359640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758073230 con 0x7fa7580ffda0 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.695+0000 7fa760359640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7580733a0 con 0x7fa758100750 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.695+0000 7fa75e0f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7580ffda0 0x7fa7580727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.695+0000 7fa75e0f5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7580ffda0 0x7fa7580727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39664/0 (socket says 172.21.15.17:39664) 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.695+0000 7fa75e0f5640 1 -- 172.21.15.17:0/1185673749 learned_addr learned my addr 172.21.15.17:0/1185673749 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.696+0000 7fa75d8f4640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa758100750 0x7fa758072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.696+0000 7fa75e0f5640 1 -- 172.21.15.17:0/1185673749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa758100750 msgr2=0x7fa758072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.696+0000 7fa75e0f5640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa758100750 0x7fa758072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.696+0000 7fa75e0f5640 1 -- 172.21.15.17:0/1185673749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748009900 con 0x7fa7580ffda0 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.696+0000 7fa75d8f4640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa758100750 0x7fa758072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.696+0000 7fa75e0f5640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7580ffda0 0x7fa7580727b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa74802ae90 tx=0x7fa748030880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.696+0000 7fa7577fe640 1 -- 172.21.15.17:0/1185673749 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa74802f3c0 con 0x7fa7580ffda0 2024-08-19T01:04:10.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.696+0000 7fa760359640 1 -- 172.21.15.17:0/1185673749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa758073620 con 0x7fa7580ffda0 2024-08-19T01:04:10.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.696+0000 7fa7577fe640 1 -- 172.21.15.17:0/1185673749 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa74802f9e0 con 0x7fa7580ffda0 2024-08-19T01:04:10.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.696+0000 7fa7577fe640 1 -- 172.21.15.17:0/1185673749 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa748039450 con 0x7fa7580ffda0 2024-08-19T01:04:10.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.696+0000 7fa760359640 1 -- 172.21.15.17:0/1185673749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7581a1ef0 con 0x7fa7580ffda0 2024-08-19T01:04:10.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.697+0000 7fa760359640 1 -- 172.21.15.17:0/1185673749 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa758101280 con 0x7fa7580ffda0 2024-08-19T01:04:10.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.698+0000 7fa7577fe640 1 -- 172.21.15.17:0/1185673749 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa74800a040 con 0x7fa7580ffda0 2024-08-19T01:04:10.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.698+0000 7fa7577fe640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa74006e170 0x7fa740070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.698+0000 7fa7577fe640 1 -- 172.21.15.17:0/1185673749 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa74802c040 con 0x7fa7580ffda0 2024-08-19T01:04:10.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.698+0000 7fa75d8f4640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa74006e170 0x7fa740070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.699+0000 7fa75d8f4640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa74006e170 0x7fa740070630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0058c0 tx=0x7fa74c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:10.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.703+0000 7fa7577fe640 1 -- 172.21.15.17:0/1185673749 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa748078700 con 0x7fa7580ffda0 2024-08-19T01:04:10.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.896+0000 7fa760359640 1 -- 172.21.15.17:0/1185673749 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa758073620 con 0x7fa74006e170 2024-08-19T01:04:10.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:10 smithi017 ceph-mon[99370]: pgmap v153: 65 pgs: 8 active+undersized, 15 peering, 5 active+undersized+degraded, 37 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15/321 objects degraded (4.673%) 2024-08-19T01:04:10.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:10 smithi017 ceph-mon[99370]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:10.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:10.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:10.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:10.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:10 smithi017 ceph-mon[99370]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:10.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:10 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2667437737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:10.899 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:10 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2551617110' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:04:10.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.898+0000 7fa7577fe640 1 -- 172.21.15.17:0/1185673749 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa758073620 con 0x7fa74006e170 2024-08-19T01:04:10.900 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:04:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:04:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:04:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:04:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:04:10.900 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:04:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:04:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:04:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:04:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "11/23 daemons upgraded", 2024-08-19T01:04:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading osd daemons", 2024-08-19T01:04:10.901 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:04:10.901 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:04:10.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.900+0000 7fa760359640 1 -- 172.21.15.17:0/1185673749 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa74006e170 msgr2=0x7fa740070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.900+0000 7fa760359640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa74006e170 0x7fa740070630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa74c0058c0 tx=0x7fa74c005850 comp rx=0 tx=0).stop 2024-08-19T01:04:10.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.900+0000 7fa760359640 1 -- 172.21.15.17:0/1185673749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7580ffda0 msgr2=0x7fa7580727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.900+0000 7fa760359640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7580ffda0 0x7fa7580727b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa74802ae90 tx=0x7fa748030880 comp rx=0 tx=0).stop 2024-08-19T01:04:10.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.900+0000 7fa760359640 1 -- 172.21.15.17:0/1185673749 shutdown_connections 2024-08-19T01:04:10.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.900+0000 7fa760359640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa74006e170 0x7fa740070630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.900+0000 7fa760359640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa758100750 0x7fa758072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.900+0000 7fa760359640 1 --2- 172.21.15.17:0/1185673749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7580ffda0 0x7fa7580727b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.900+0000 7fa760359640 1 -- 172.21.15.17:0/1185673749 >> 172.21.15.17:0/1185673749 conn(0x7fa7580fb840 msgr2=0x7fa7580fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:10.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.900+0000 7fa760359640 1 -- 172.21.15.17:0/1185673749 shutdown_connections 2024-08-19T01:04:10.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.900+0000 7fa760359640 1 -- 172.21.15.17:0/1185673749 wait complete. 2024-08-19T01:04:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:10 smithi086 ceph-mon[71303]: pgmap v153: 65 pgs: 8 active+undersized, 15 peering, 5 active+undersized+degraded, 37 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 15/321 objects degraded (4.673%) 2024-08-19T01:04:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:10 smithi086 ceph-mon[71303]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:10 smithi086 ceph-mon[71303]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:10 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2667437737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:10.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:10 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2551617110' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:04:10.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.983+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/139906808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94100750 msgr2=0x7f8d941047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.983+0000 7f8d9bf8f640 1 --2- 172.21.15.17:0/139906808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94100750 0x7f8d941047a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009880 tx=0x7f8d8402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.983+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/139906808 shutdown_connections 2024-08-19T01:04:10.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.983+0000 7f8d9bf8f640 1 --2- 172.21.15.17:0/139906808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d94100750 0x7f8d941047a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.983+0000 7f8d9bf8f640 1 --2- 172.21.15.17:0/139906808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d940ffda0 0x7f8d94100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.983+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/139906808 >> 172.21.15.17:0/139906808 conn(0x7f8d940fb840 msgr2=0x7f8d940fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:10.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.983+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/139906808 shutdown_connections 2024-08-19T01:04:10.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.983+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/139906808 wait complete. 2024-08-19T01:04:10.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d9bf8f640 1 Processor -- start 2024-08-19T01:04:10.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d9bf8f640 1 -- start start 2024-08-19T01:04:10.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d9bf8f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d940ffda0 0x7f8d9419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d9bf8f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d94100750 0x7f8d9419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d9bf8f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9419c380 con 0x7f8d940ffda0 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d9bf8f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d94195910 con 0x7f8d94100750 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d99d2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d940ffda0 0x7f8d9419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d99d2b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d940ffda0 0x7f8d9419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39686/0 (socket says 172.21.15.17:39686) 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d99d2b640 1 -- 172.21.15.17:0/1427544590 learned_addr learned my addr 172.21.15.17:0/1427544590 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d9952a640 1 --2- 172.21.15.17:0/1427544590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d94100750 0x7f8d9419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d99d2b640 1 -- 172.21.15.17:0/1427544590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d94100750 msgr2=0x7f8d9419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d99d2b640 1 --2- 172.21.15.17:0/1427544590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d94100750 0x7f8d9419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d99d2b640 1 -- 172.21.15.17:0/1427544590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d84009560 con 0x7f8d940ffda0 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.984+0000 7f8d99d2b640 1 --2- 172.21.15.17:0/1427544590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d940ffda0 0x7f8d9419b820 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000d8d0 tx=0x7f8d9000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.985+0000 7f8d8affd640 1 -- 172.21.15.17:0/1427544590 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d90009c00 con 0x7f8d940ffda0 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.985+0000 7f8d8affd640 1 -- 172.21.15.17:0/1427544590 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d90009d60 con 0x7f8d940ffda0 2024-08-19T01:04:10.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.985+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/1427544590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d94195bf0 con 0x7f8d940ffda0 2024-08-19T01:04:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.985+0000 7f8d8affd640 1 -- 172.21.15.17:0/1427544590 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d900049d0 con 0x7f8d940ffda0 2024-08-19T01:04:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.985+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/1427544590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d94196110 con 0x7f8d940ffda0 2024-08-19T01:04:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.986+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/1427544590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d94101280 con 0x7f8d940ffda0 2024-08-19T01:04:10.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.986+0000 7f8d8affd640 1 -- 172.21.15.17:0/1427544590 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8d90004c90 con 0x7f8d940ffda0 2024-08-19T01:04:10.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.987+0000 7f8d8affd640 1 --2- 172.21.15.17:0/1427544590 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8d8006e170 0x7f8d80070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:10.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.987+0000 7f8d8affd640 1 -- 172.21.15.17:0/1427544590 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f8d9008dd70 con 0x7f8d940ffda0 2024-08-19T01:04:10.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.987+0000 7f8d9952a640 1 --2- 172.21.15.17:0/1427544590 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8d8006e170 0x7f8d80070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:10.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.987+0000 7f8d9952a640 1 --2- 172.21.15.17:0/1427544590 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8d8006e170 0x7f8d80070630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009230 tx=0x7f8d840058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:10.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:10.991+0000 7f8d8affd640 1 -- 172.21.15.17:0/1427544590 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8d90057100 con 0x7f8d940ffda0 2024-08-19T01:04:11.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.235+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/1427544590 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8d94100180 con 0x7f8d940ffda0 2024-08-19T01:04:11.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.236+0000 7f8d8affd640 1 -- 172.21.15.17:0/1427544590 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1546 (secure 0 0 0) 0x7f8d90017620 con 0x7f8d940ffda0 2024-08-19T01:04:11.238 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Reduced data availability: 6 pgs peering; Degraded data redundancy: 15/321 objects degraded (4.673%), 5 pgs degraded 2024-08-19T01:04:11.238 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:04:11.238 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:04:11.238 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] OSD_DOWN: 1 osds down 2024-08-19T01:04:11.238 INFO:teuthology.orchestra.run.smithi017.stdout: osd.5 (root=default,host=smithi086) is down 2024-08-19T01:04:11.238 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 6 pgs peering 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.3 is stuck peering for 6m, current state peering, last acting [2,1] 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.16 is stuck peering for 6m, current state peering, last acting [3,2] 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.17 is stuck peering for 2m, current state peering, last acting [2,1] 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout: pg 3.5 is stuck peering for 6m, current state peering, last acting [2,3] 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout: pg 3.f is stuck peering for 6m, current state peering, last acting [3,0] 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout: pg 3.16 is stuck peering for 6m, current state peering, last acting [3,1] 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 15/321 objects degraded (4.673%), 5 pgs degraded 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-08-19T01:04:11.239 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-08-19T01:04:11.240 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-08-19T01:04:11.240 INFO:teuthology.orchestra.run.smithi017.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-08-19T01:04:11.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.238+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/1427544590 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8d8006e170 msgr2=0x7f8d80070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:11.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.238+0000 7f8d9bf8f640 1 --2- 172.21.15.17:0/1427544590 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8d8006e170 0x7f8d80070630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009230 tx=0x7f8d840058d0 comp rx=0 tx=0).stop 2024-08-19T01:04:11.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.238+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/1427544590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d940ffda0 msgr2=0x7f8d9419b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.238+0000 7f8d9bf8f640 1 --2- 172.21.15.17:0/1427544590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d940ffda0 0x7f8d9419b820 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000d8d0 tx=0x7f8d9000dd90 comp rx=0 tx=0).stop 2024-08-19T01:04:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.238+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/1427544590 shutdown_connections 2024-08-19T01:04:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.238+0000 7f8d9bf8f640 1 --2- 172.21.15.17:0/1427544590 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8d8006e170 0x7f8d80070630 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.238+0000 7f8d9bf8f640 1 --2- 172.21.15.17:0/1427544590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8d94100750 0x7f8d9419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.238+0000 7f8d9bf8f640 1 --2- 172.21.15.17:0/1427544590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d940ffda0 0x7f8d9419b820 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.238+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/1427544590 >> 172.21.15.17:0/1427544590 conn(0x7f8d940fb840 msgr2=0x7f8d940fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.238+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/1427544590 shutdown_connections 2024-08-19T01:04:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:11.238+0000 7f8d9bf8f640 1 -- 172.21.15.17:0/1427544590 wait complete. 2024-08-19T01:04:11.912 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:11 smithi086 ceph-mon[71303]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:11.912 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:11 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1427544590' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:04:11.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:11 smithi017 ceph-mon[99370]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:11.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:11 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1427544590' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:04:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:12 smithi017 ceph-mon[99370]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:12 smithi017 ceph-mon[99370]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-08-19T01:04:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:12 smithi017 ceph-mon[99370]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs peering) 2024-08-19T01:04:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:12 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:12 smithi086 ceph-mon[71303]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:12 smithi086 ceph-mon[71303]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-08-19T01:04:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:12 smithi086 ceph-mon[71303]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs peering) 2024-08-19T01:04:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:12 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:14.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:14 smithi086 ceph-mon[71303]: pgmap v155: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-08-19T01:04:14.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:14 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:14.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:14 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:14.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:14 smithi017 ceph-mon[99370]: pgmap v155: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-08-19T01:04:14.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:14 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:14.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:14 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:14.946 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:14 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:04:14.729+0000 7fc37a884640 -1 osd.5 74 log_to_monitors true 2024-08-19T01:04:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:15 smithi017 ceph-mon[99370]: from='osd.5 [v2:172.21.15.86:6816/2382776857,v1:172.21.15.86:6817/2382776857]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T01:04:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:15 smithi017 ceph-mon[99370]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T01:04:15.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:15 smithi086 ceph-mon[71303]: from='osd.5 [v2:172.21.15.86:6816/2382776857,v1:172.21.15.86:6817/2382776857]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T01:04:15.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:15 smithi086 ceph-mon[71303]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-19T01:04:15.446 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:04:15 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:04:15.207+0000 7fc37261e640 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-19T01:04:16.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:16 smithi086 ceph-mon[71303]: pgmap v156: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-08-19T01:04:16.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:16 smithi086 ceph-mon[71303]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-19T01:04:16.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:16 smithi086 ceph-mon[71303]: osdmap e77: 6 total, 5 up, 6 in 2024-08-19T01:04:16.380 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:16 smithi086 ceph-mon[71303]: from='osd.5 [v2:172.21.15.86:6816/2382776857,v1:172.21.15.86:6817/2382776857]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:04:16.381 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:16 smithi086 ceph-mon[71303]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:04:16.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:16 smithi017 ceph-mon[99370]: pgmap v156: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 259 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 51/321 objects degraded (15.888%) 2024-08-19T01:04:16.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:16 smithi017 ceph-mon[99370]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-19T01:04:16.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:16 smithi017 ceph-mon[99370]: osdmap e77: 6 total, 5 up, 6 in 2024-08-19T01:04:16.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:16 smithi017 ceph-mon[99370]: from='osd.5 [v2:172.21.15.86:6816/2382776857,v1:172.21.15.86:6817/2382776857]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:04:16.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:16 smithi017 ceph-mon[99370]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi086", "root=default"]}]: dispatch 2024-08-19T01:04:17.515 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:04:17.515 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: osd.5 [v2:172.21.15.86:6816/2382776857,v1:172.21.15.86:6817/2382776857] boot 2024-08-19T01:04:17.515 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: osdmap e78: 6 total, 6 up, 6 in 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: Health check update: Degraded data redundancy: 51/321 objects degraded (15.888%), 14 pgs degraded (PG_DEGRADED) 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:17.516 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: Upgrade: Setting container_image for all osd 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: Upgrade: Setting require_osd_release to 19 squid 2024-08-19T01:04:17.517 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-08-19T01:04:17.518 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-08-19T01:04:17.518 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-08-19T01:04:17.518 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:17 smithi086 ceph-mon[71303]: osdmap e79: 6 total, 6 up, 6 in 2024-08-19T01:04:17.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: osd.5 [v2:172.21.15.86:6816/2382776857,v1:172.21.15.86:6817/2382776857] boot 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: osdmap e78: 6 total, 6 up, 6 in 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: Health check update: Degraded data redundancy: 51/321 objects degraded (15.888%), 14 pgs degraded (PG_DEGRADED) 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:17.684 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: Upgrade: Setting container_image for all osd 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-08-19T01:04:17.685 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-08-19T01:04:17.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-08-19T01:04:17.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-08-19T01:04:17.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-08-19T01:04:17.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: Upgrade: Setting require_osd_release to 19 squid 2024-08-19T01:04:17.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-08-19T01:04:17.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-08-19T01:04:17.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-08-19T01:04:17.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:17 smithi017 ceph-mon[99370]: osdmap e79: 6 total, 6 up, 6 in 2024-08-19T01:04:18.681 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:18 smithi086 ceph-mon[71303]: pgmap v159: 65 pgs: 2 peering, 13 active+undersized, 13 active+undersized+degraded, 37 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 48/321 objects degraded (14.953%) 2024-08-19T01:04:18.681 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:18 smithi086 ceph-mon[71303]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-08-19T01:04:18.681 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:18.681 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-08-19T01:04:18.682 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:18 smithi086 ceph-mon[71303]: osdmap e80: 6 total, 6 up, 6 in 2024-08-19T01:04:18.682 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:18.682 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:04:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:18 smithi017 ceph-mon[99370]: pgmap v159: 65 pgs: 2 peering, 13 active+undersized, 13 active+undersized+degraded, 37 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 48/321 objects degraded (14.953%) 2024-08-19T01:04:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:18 smithi017 ceph-mon[99370]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-08-19T01:04:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-08-19T01:04:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:18 smithi017 ceph-mon[99370]: osdmap e80: 6 total, 6 up, 6 in 2024-08-19T01:04:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:04:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:18 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:04:18.358+0000 7f7b3a4d2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T01:04:19.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-08-19T01:04:19.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-08-19T01:04:19.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2024-08-19T01:04:19.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:19.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T01:04:19.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-08-19T01:04:19.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-19T01:04:19.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: osdmap e81: 6 total, 6 up, 6 in 2024-08-19T01:04:19.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] up:boot 2024-08-19T01:04:19.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6826/3225608690,v1:172.21.15.17:6827/3225608690] up:boot 2024-08-19T01:04:19.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-08-19T01:04:19.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T01:04:19.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:19 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T01:04:19.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-08-19T01:04:19.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-08-19T01:04:19.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: fsmap cephfs:2 {0=cephfs.smithi017.gvlpoy=up:active,1=cephfs.smithi086.uxhjfl=up:active} 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-19T01:04:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-19T01:04:19.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-08-19T01:04:19.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-19T01:04:19.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: osdmap e81: 6 total, 6 up, 6 in 2024-08-19T01:04:19.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] up:boot 2024-08-19T01:04:19.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6826/3225608690,v1:172.21.15.17:6827/3225608690] up:boot 2024-08-19T01:04:19.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-08-19T01:04:19.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T01:04:19.698 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:19 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T01:04:20.560 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:20 smithi017 ceph-mon[99370]: pgmap v163: 65 pgs: 2 peering, 12 active+undersized, 11 active+undersized+degraded, 40 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s; 43/321 objects degraded (13.396%) 2024-08-19T01:04:20.560 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:20 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.86:6824/612667702,v1:172.21.15.86:6825/612667702] up:boot 2024-08-19T01:04:20.561 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:20 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6828/1504429560,v1:172.21.15.17:6829/1504429560] up:boot 2024-08-19T01:04:20.561 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:20 smithi017 ceph-mon[99370]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:04:20.561 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:20 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T01:04:20.561 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:20 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T01:04:20.561 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:20 smithi017 ceph-mon[99370]: Upgrade: Updating mds.cephfs.smithi017.junbdp 2024-08-19T01:04:20.561 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:20 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:20.561 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:20 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.junbdp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:04:20.561 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:20 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:20.561 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:20 smithi017 ceph-mon[99370]: Deploying daemon mds.cephfs.smithi017.junbdp on smithi017 2024-08-19T01:04:20.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:20 smithi086 ceph-mon[71303]: pgmap v163: 65 pgs: 2 peering, 12 active+undersized, 11 active+undersized+degraded, 40 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 3 op/s; 43/321 objects degraded (13.396%) 2024-08-19T01:04:20.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:20 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.86:6824/612667702,v1:172.21.15.86:6825/612667702] up:boot 2024-08-19T01:04:20.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:20 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6828/1504429560,v1:172.21.15.17:6829/1504429560] up:boot 2024-08-19T01:04:20.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:20 smithi086 ceph-mon[71303]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:04:20.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:20 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T01:04:20.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:20 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T01:04:20.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:20 smithi086 ceph-mon[71303]: Upgrade: Updating mds.cephfs.smithi017.junbdp 2024-08-19T01:04:20.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:20 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:20.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:20 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.junbdp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:04:20.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:20 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:20.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:20 smithi086 ceph-mon[71303]: Deploying daemon mds.cephfs.smithi017.junbdp on smithi017 2024-08-19T01:04:21.588 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:21 smithi017 ceph-mon[99370]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/321 objects degraded (13.396%), 11 pgs degraded) 2024-08-19T01:04:21.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:21 smithi086 ceph-mon[71303]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/321 objects degraded (13.396%), 11 pgs degraded) 2024-08-19T01:04:22.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:22 smithi017 ceph-mon[99370]: pgmap v164: 65 pgs: 2 peering, 1 active+undersized, 62 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:22.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:22 smithi086 ceph-mon[71303]: pgmap v164: 65 pgs: 2 peering, 1 active+undersized, 62 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:23.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:23 smithi017 ceph-mon[99370]: osdmap e82: 6 total, 6 up, 6 in 2024-08-19T01:04:23.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:23 smithi017 ceph-mon[99370]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-08-19T01:04:23.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:23 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T01:04:23.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:23 smithi086 ceph-mon[71303]: osdmap e82: 6 total, 6 up, 6 in 2024-08-19T01:04:23.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:23 smithi086 ceph-mon[71303]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-08-19T01:04:23.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:23 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T01:04:24.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:24 smithi017 ceph-mon[99370]: pgmap v166: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:24.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:24 smithi086 ceph-mon[71303]: pgmap v166: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:26.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:26 smithi086 ceph-mon[71303]: pgmap v167: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:26.745 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:26 smithi017 ceph-mon[99370]: pgmap v167: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:28 smithi017 ceph-mon[99370]: pgmap v168: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:28 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] up:boot 2024-08-19T01:04:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:28 smithi017 ceph-mon[99370]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:04:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T01:04:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:28 smithi086 ceph-mon[71303]: pgmap v168: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:28 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] up:boot 2024-08-19T01:04:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:28 smithi086 ceph-mon[71303]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:04:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T01:04:30.738 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:30 smithi017 ceph-mon[99370]: pgmap v169: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:30 smithi086 ceph-mon[71303]: pgmap v169: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:32 smithi017 ceph-mon[99370]: pgmap v170: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-08-19T01:04:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:32 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:32 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:32 smithi086 ceph-mon[71303]: pgmap v170: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s 2024-08-19T01:04:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:32 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:32 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:33 smithi017 ceph-mon[99370]: pgmap v171: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:04:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:33 smithi086 ceph-mon[71303]: pgmap v171: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:04:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:36.004 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:35 smithi017 ceph-mon[99370]: pgmap v172: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:36.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:35 smithi086 ceph-mon[71303]: pgmap v172: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:37.661 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:37.661 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:37.661 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:37.661 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:04:37.662 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:37.662 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:37.662 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:37.662 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:37.662 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:37.662 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:37.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:37.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:37.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:37.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:04:37.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:37.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:37.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:37.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:37.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:37.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:38 smithi017 ceph-mon[99370]: pgmap v173: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:38 smithi017 ceph-mon[99370]: Upgrade: Updating mds.cephfs.smithi017.gvlpoy 2024-08-19T01:04:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:38 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:38 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.gvlpoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:04:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:38 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:38 smithi017 ceph-mon[99370]: Deploying daemon mds.cephfs.smithi017.gvlpoy on smithi017 2024-08-19T01:04:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:38 smithi086 ceph-mon[71303]: pgmap v173: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:38 smithi086 ceph-mon[71303]: Upgrade: Updating mds.cephfs.smithi017.gvlpoy 2024-08-19T01:04:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:38 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:38 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi017.gvlpoy", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:04:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:38 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:38 smithi086 ceph-mon[71303]: Deploying daemon mds.cephfs.smithi017.gvlpoy on smithi017 2024-08-19T01:04:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:40 smithi017 ceph-mon[99370]: pgmap v174: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:40 smithi017 ceph-mon[99370]: osdmap e83: 6 total, 6 up, 6 in 2024-08-19T01:04:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:40 smithi017 ceph-mon[99370]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-08-19T01:04:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:40 smithi086 ceph-mon[71303]: pgmap v174: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:40 smithi086 ceph-mon[71303]: osdmap e83: 6 total, 6 up, 6 in 2024-08-19T01:04:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:40 smithi086 ceph-mon[71303]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-08-19T01:04:41.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.333+0000 7f7ea1d84640 1 -- 172.21.15.17:0/1151594807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e9c104b50 msgr2=0x7f7e9c104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.333+0000 7f7ea1d84640 1 --2- 172.21.15.17:0/1151594807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e9c104b50 0x7f7e9c104f30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c009880 tx=0x7f7e8c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.333+0000 7f7ea1d84640 1 -- 172.21.15.17:0/1151594807 shutdown_connections 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.333+0000 7f7ea1d84640 1 --2- 172.21.15.17:0/1151594807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e9c0fdf70 0x7f7e9c0fe3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.333+0000 7f7ea1d84640 1 --2- 172.21.15.17:0/1151594807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e9c104b50 0x7f7e9c104f30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.333+0000 7f7ea1d84640 1 -- 172.21.15.17:0/1151594807 >> 172.21.15.17:0/1151594807 conn(0x7f7e9c0f9ec0 msgr2=0x7f7e9c0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.333+0000 7f7ea1d84640 1 -- 172.21.15.17:0/1151594807 shutdown_connections 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.333+0000 7f7ea1d84640 1 -- 172.21.15.17:0/1151594807 wait complete. 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.333+0000 7f7ea1d84640 1 Processor -- start 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.334+0000 7f7ea1d84640 1 -- start start 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.334+0000 7f7ea1d84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e9c0fdf70 0x7f7e9c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.334+0000 7f7ea1d84640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e9c104b50 0x7f7e9c19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:41.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.334+0000 7f7ea1d84640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c19c460 con 0x7f7e9c0fdf70 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.334+0000 7f7ea1d84640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c1959f0 con 0x7f7e9c104b50 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.334+0000 7f7e9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e9c0fdf70 0x7f7e9c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.334+0000 7f7e9b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e9c0fdf70 0x7f7e9c19b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41278/0 (socket says 172.21.15.17:41278) 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.334+0000 7f7e9b7fe640 1 -- 172.21.15.17:0/2326048168 learned_addr learned my addr 172.21.15.17:0/2326048168 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.334+0000 7f7e92ffd640 1 --2- 172.21.15.17:0/2326048168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e9c104b50 0x7f7e9c19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.335+0000 7f7e9b7fe640 1 -- 172.21.15.17:0/2326048168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e9c104b50 msgr2=0x7f7e9c19be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.335+0000 7f7e9b7fe640 1 --2- 172.21.15.17:0/2326048168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e9c104b50 0x7f7e9c19be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.335+0000 7f7e9b7fe640 1 -- 172.21.15.17:0/2326048168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c009560 con 0x7f7e9c0fdf70 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.335+0000 7f7e9b7fe640 1 --2- 172.21.15.17:0/2326048168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e9c0fdf70 0x7f7e9c19b900 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c02a9c0 tx=0x7f7e8c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.335+0000 7f7e997fa640 1 -- 172.21.15.17:0/2326048168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e8c004aa0 con 0x7f7e9c0fdf70 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.335+0000 7f7e997fa640 1 -- 172.21.15.17:0/2326048168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e8c004c00 con 0x7f7e9c0fdf70 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.335+0000 7f7ea1d84640 1 -- 172.21.15.17:0/2326048168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9c195c70 con 0x7f7e9c0fdf70 2024-08-19T01:04:41.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.335+0000 7f7e997fa640 1 -- 172.21.15.17:0/2326048168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e8c003ab0 con 0x7f7e9c0fdf70 2024-08-19T01:04:41.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.335+0000 7f7ea1d84640 1 -- 172.21.15.17:0/2326048168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9c196160 con 0x7f7e9c0fdf70 2024-08-19T01:04:41.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.336+0000 7f7ea1d84640 1 -- 172.21.15.17:0/2326048168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9c101290 con 0x7f7e9c0fdf70 2024-08-19T01:04:41.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.337+0000 7f7e997fa640 1 -- 172.21.15.17:0/2326048168 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7e8c003ce0 con 0x7f7e9c0fdf70 2024-08-19T01:04:41.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.337+0000 7f7e997fa640 1 --2- 172.21.15.17:0/2326048168 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e8806e170 0x7f7e88070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:41.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.337+0000 7f7e997fa640 1 -- 172.21.15.17:0/2326048168 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7e8c0af250 con 0x7f7e9c0fdf70 2024-08-19T01:04:41.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.337+0000 7f7e92ffd640 1 --2- 172.21.15.17:0/2326048168 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e8806e170 0x7f7e88070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:41.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.338+0000 7f7e92ffd640 1 --2- 172.21.15.17:0/2326048168 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e8806e170 0x7f7e88070630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c196e60 tx=0x7f7e8400a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:41.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.343+0000 7f7e997fa640 1 -- 172.21.15.17:0/2326048168 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7e8c078540 con 0x7f7e9c0fdf70 2024-08-19T01:04:41.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.537+0000 7f7ea1d84640 1 -- 172.21.15.17:0/2326048168 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e9c10ceb0 con 0x7f7e8806e170 2024-08-19T01:04:41.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.538+0000 7f7e997fa640 1 -- 172.21.15.17:0/2326048168 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7e9c10ceb0 con 0x7f7e8806e170 2024-08-19T01:04:41.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.540+0000 7f7ea1d84640 1 -- 172.21.15.17:0/2326048168 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e8806e170 msgr2=0x7f7e88070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:41.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.540+0000 7f7ea1d84640 1 --2- 172.21.15.17:0/2326048168 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e8806e170 0x7f7e88070630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c196e60 tx=0x7f7e8400a250 comp rx=0 tx=0).stop 2024-08-19T01:04:41.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.540+0000 7f7ea1d84640 1 -- 172.21.15.17:0/2326048168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e9c0fdf70 msgr2=0x7f7e9c19b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:41.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.540+0000 7f7ea1d84640 1 --2- 172.21.15.17:0/2326048168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e9c0fdf70 0x7f7e9c19b900 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c02a9c0 tx=0x7f7e8c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.540+0000 7f7ea1d84640 1 -- 172.21.15.17:0/2326048168 shutdown_connections 2024-08-19T01:04:41.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.540+0000 7f7ea1d84640 1 --2- 172.21.15.17:0/2326048168 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e8806e170 0x7f7e88070630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.540+0000 7f7ea1d84640 1 --2- 172.21.15.17:0/2326048168 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e9c104b50 0x7f7e9c19be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.540+0000 7f7ea1d84640 1 --2- 172.21.15.17:0/2326048168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e9c0fdf70 0x7f7e9c19b900 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.540+0000 7f7ea1d84640 1 -- 172.21.15.17:0/2326048168 >> 172.21.15.17:0/2326048168 conn(0x7f7e9c0f9ec0 msgr2=0x7f7e9c0fb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:41.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.540+0000 7f7ea1d84640 1 -- 172.21.15.17:0/2326048168 shutdown_connections 2024-08-19T01:04:41.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.540+0000 7f7ea1d84640 1 -- 172.21.15.17:0/2326048168 wait complete. 2024-08-19T01:04:41.552 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:04:41.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.625+0000 7fb276aac640 1 -- 172.21.15.17:0/21686120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb270100ce0 msgr2=0x7fb2701010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:41.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.625+0000 7fb276aac640 1 --2- 172.21.15.17:0/21686120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb270100ce0 0x7fb2701010c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb268009880 tx=0x7fb26802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.625+0000 7fb276aac640 1 -- 172.21.15.17:0/21686120 shutdown_connections 2024-08-19T01:04:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.625+0000 7fb276aac640 1 --2- 172.21.15.17:0/21686120 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270101600 0x7fb270109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.625+0000 7fb276aac640 1 --2- 172.21.15.17:0/21686120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb270100ce0 0x7fb2701010c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.625+0000 7fb276aac640 1 -- 172.21.15.17:0/21686120 >> 172.21.15.17:0/21686120 conn(0x7fb2700fa6a0 msgr2=0x7fb2700fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.625+0000 7fb276aac640 1 -- 172.21.15.17:0/21686120 shutdown_connections 2024-08-19T01:04:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.625+0000 7fb276aac640 1 -- 172.21.15.17:0/21686120 wait complete. 2024-08-19T01:04:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.626+0000 7fb276aac640 1 Processor -- start 2024-08-19T01:04:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.626+0000 7fb276aac640 1 -- start start 2024-08-19T01:04:41.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.626+0000 7fb276aac640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270100ce0 0x7fb2701959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.626+0000 7fb276aac640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb270101600 0x7fb270195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.626+0000 7fb276aac640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb270196600 con 0x7fb270101600 2024-08-19T01:04:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.626+0000 7fb276aac640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27019a350 con 0x7fb270100ce0 2024-08-19T01:04:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.626+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb270101600 0x7fb270195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.626+0000 7fb26ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb270101600 0x7fb270195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41284/0 (socket says 172.21.15.17:41284) 2024-08-19T01:04:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.626+0000 7fb26ffff640 1 -- 172.21.15.17:0/2827408563 learned_addr learned my addr 172.21.15.17:0/2827408563 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.626+0000 7fb274848640 1 --2- 172.21.15.17:0/2827408563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270100ce0 0x7fb2701959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.627+0000 7fb26ffff640 1 -- 172.21.15.17:0/2827408563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270100ce0 msgr2=0x7fb2701959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.627+0000 7fb26ffff640 1 --2- 172.21.15.17:0/2827408563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270100ce0 0x7fb2701959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.627+0000 7fb26ffff640 1 -- 172.21.15.17:0/2827408563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268009560 con 0x7fb270101600 2024-08-19T01:04:41.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.627+0000 7fb26ffff640 1 --2- 172.21.15.17:0/2827408563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb270101600 0x7fb270195f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb25800d6f0 tx=0x7fb25800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:41.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.627+0000 7fb26dffb640 1 -- 172.21.15.17:0/2827408563 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb258009a30 con 0x7fb270101600 2024-08-19T01:04:41.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.627+0000 7fb276aac640 1 -- 172.21.15.17:0/2827408563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27019a630 con 0x7fb270101600 2024-08-19T01:04:41.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.627+0000 7fb26dffb640 1 -- 172.21.15.17:0/2827408563 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2580054e0 con 0x7fb270101600 2024-08-19T01:04:41.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.627+0000 7fb276aac640 1 -- 172.21.15.17:0/2827408563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27019ab80 con 0x7fb270101600 2024-08-19T01:04:41.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.627+0000 7fb26dffb640 1 -- 172.21.15.17:0/2827408563 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb258004e20 con 0x7fb270101600 2024-08-19T01:04:41.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.628+0000 7fb276aac640 1 -- 172.21.15.17:0/2827408563 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb270068c60 con 0x7fb270101600 2024-08-19T01:04:41.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.629+0000 7fb26dffb640 1 -- 172.21.15.17:0/2827408563 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb258010460 con 0x7fb270101600 2024-08-19T01:04:41.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.629+0000 7fb26dffb640 1 --2- 172.21.15.17:0/2827408563 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb25c06e170 0x7fb25c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:41.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.629+0000 7fb26dffb640 1 -- 172.21.15.17:0/2827408563 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb25808dcb0 con 0x7fb270101600 2024-08-19T01:04:41.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.629+0000 7fb274848640 1 --2- 172.21.15.17:0/2827408563 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb25c06e170 0x7fb25c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:41.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.630+0000 7fb274848640 1 --2- 172.21.15.17:0/2827408563 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb25c06e170 0x7fb25c070630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb268009230 tx=0x7fb2680058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:41.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.635+0000 7fb26dffb640 1 -- 172.21.15.17:0/2827408563 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb258057040 con 0x7fb270101600 2024-08-19T01:04:41.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.826+0000 7fb276aac640 1 -- 172.21.15.17:0/2827408563 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb270104330 con 0x7fb25c06e170 2024-08-19T01:04:41.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.827+0000 7fb26dffb640 1 -- 172.21.15.17:0/2827408563 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb270104330 con 0x7fb25c06e170 2024-08-19T01:04:41.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.829+0000 7fb276aac640 1 -- 172.21.15.17:0/2827408563 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb25c06e170 msgr2=0x7fb25c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:41.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.829+0000 7fb276aac640 1 --2- 172.21.15.17:0/2827408563 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb25c06e170 0x7fb25c070630 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb268009230 tx=0x7fb2680058d0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.829+0000 7fb276aac640 1 -- 172.21.15.17:0/2827408563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb270101600 msgr2=0x7fb270195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.829+0000 7fb276aac640 1 --2- 172.21.15.17:0/2827408563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb270101600 0x7fb270195f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb25800d6f0 tx=0x7fb25800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.829+0000 7fb276aac640 1 -- 172.21.15.17:0/2827408563 shutdown_connections 2024-08-19T01:04:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.829+0000 7fb276aac640 1 --2- 172.21.15.17:0/2827408563 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb25c06e170 0x7fb25c070630 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.829+0000 7fb276aac640 1 --2- 172.21.15.17:0/2827408563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb270101600 0x7fb270195f20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.829+0000 7fb276aac640 1 --2- 172.21.15.17:0/2827408563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb270100ce0 0x7fb2701959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.829+0000 7fb276aac640 1 -- 172.21.15.17:0/2827408563 >> 172.21.15.17:0/2827408563 conn(0x7fb2700fa6a0 msgr2=0x7fb270101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.829+0000 7fb276aac640 1 -- 172.21.15.17:0/2827408563 shutdown_connections 2024-08-19T01:04:41.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.829+0000 7fb276aac640 1 -- 172.21.15.17:0/2827408563 wait complete. 2024-08-19T01:04:41.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.912+0000 7fd539914640 1 -- 172.21.15.17:0/905794441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5340fe980 msgr2=0x7fd5340fede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:41.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.912+0000 7fd539914640 1 --2- 172.21.15.17:0/905794441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5340fe980 0x7fd5340fede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd528009880 tx=0x7fd52802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.912+0000 7fd539914640 1 -- 172.21.15.17:0/905794441 shutdown_connections 2024-08-19T01:04:41.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.912+0000 7fd539914640 1 --2- 172.21.15.17:0/905794441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5340fe980 0x7fd5340fede0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.912+0000 7fd539914640 1 --2- 172.21.15.17:0/905794441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd534104980 0x7fd534104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.912+0000 7fd539914640 1 -- 172.21.15.17:0/905794441 >> 172.21.15.17:0/905794441 conn(0x7fd534075830 msgr2=0x7fd5340fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:41.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.912+0000 7fd539914640 1 -- 172.21.15.17:0/905794441 shutdown_connections 2024-08-19T01:04:41.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.913+0000 7fd539914640 1 -- 172.21.15.17:0/905794441 wait complete. 2024-08-19T01:04:41.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.913+0000 7fd539914640 1 Processor -- start 2024-08-19T01:04:41.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.914+0000 7fd539914640 1 -- start start 2024-08-19T01:04:41.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.914+0000 7fd539914640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5340fe980 0x7fd53419b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:41.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.914+0000 7fd539914640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd534104980 0x7fd53419be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.914+0000 7fd539914640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53419c420 con 0x7fd534104980 2024-08-19T01:04:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.914+0000 7fd539914640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5341959b0 con 0x7fd5340fe980 2024-08-19T01:04:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.914+0000 7fd5327fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd534104980 0x7fd53419be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.914+0000 7fd5327fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd534104980 0x7fd53419be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41300/0 (socket says 172.21.15.17:41300) 2024-08-19T01:04:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.914+0000 7fd5327fc640 1 -- 172.21.15.17:0/1934116296 learned_addr learned my addr 172.21.15.17:0/1934116296 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.914+0000 7fd532ffd640 1 --2- 172.21.15.17:0/1934116296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5340fe980 0x7fd53419b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.915+0000 7fd5327fc640 1 -- 172.21.15.17:0/1934116296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5340fe980 msgr2=0x7fd53419b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.915+0000 7fd5327fc640 1 --2- 172.21.15.17:0/1934116296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5340fe980 0x7fd53419b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.915+0000 7fd5327fc640 1 -- 172.21.15.17:0/1934116296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528009560 con 0x7fd534104980 2024-08-19T01:04:41.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.915+0000 7fd5327fc640 1 --2- 172.21.15.17:0/1934116296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd534104980 0x7fd53419be00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd52802a9c0 tx=0x7fd5280055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:41.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.915+0000 7fd538912640 1 -- 172.21.15.17:0/1934116296 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd528004aa0 con 0x7fd534104980 2024-08-19T01:04:41.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.915+0000 7fd539914640 1 -- 172.21.15.17:0/1934116296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd534195c30 con 0x7fd534104980 2024-08-19T01:04:41.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.915+0000 7fd538912640 1 -- 172.21.15.17:0/1934116296 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd528004c00 con 0x7fd534104980 2024-08-19T01:04:41.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.915+0000 7fd539914640 1 -- 172.21.15.17:0/1934116296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd534196120 con 0x7fd534104980 2024-08-19T01:04:41.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.915+0000 7fd538912640 1 -- 172.21.15.17:0/1934116296 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5280039c0 con 0x7fd534104980 2024-08-19T01:04:41.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.916+0000 7fd539914640 1 -- 172.21.15.17:0/1934116296 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5341000c0 con 0x7fd534104980 2024-08-19T01:04:41.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.917+0000 7fd538912640 1 -- 172.21.15.17:0/1934116296 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd528031640 con 0x7fd534104980 2024-08-19T01:04:41.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.917+0000 7fd538912640 1 --2- 172.21.15.17:0/1934116296 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd51c06e1e0 0x7fd51c0706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:41.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.917+0000 7fd538912640 1 -- 172.21.15.17:0/1934116296 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd5280af550 con 0x7fd534104980 2024-08-19T01:04:41.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.917+0000 7fd532ffd640 1 --2- 172.21.15.17:0/1934116296 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd51c06e1e0 0x7fd51c0706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:41.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.918+0000 7fd532ffd640 1 --2- 172.21.15.17:0/1934116296 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd51c06e1e0 0x7fd51c0706a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd524009990 tx=0x7fd524009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:41.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:41.921+0000 7fd538912640 1 -- 172.21.15.17:0/1934116296 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd528078830 con 0x7fd534104980 2024-08-19T01:04:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.104+0000 7fd539914640 1 -- 172.21.15.17:0/1934116296 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd53410bc70 con 0x7fd51c06e1e0 2024-08-19T01:04:42.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.114+0000 7fd538912640 1 -- 172.21.15.17:0/1934116296 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd53410bc70 con 0x7fd51c06e1e0 2024-08-19T01:04:42.117 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:04:42.117 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (6m) 9s ago 16m 25.1M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:04:42.117 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (16m) 9s ago 16m 9479k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:04:42.117 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (15m) 29s ago 15m 8925k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:04:42.117 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (3m) 9s ago 16m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (3m) 29s ago 15m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (5m) 9s ago 16m 78.3M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (11m) 9s ago 11m 12.0M - 18.2.4-721-gbaa926de e6c292a6bc95 157ba6fb5570 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (15s) 9s ago 11m 11.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (11m) 29s ago 11m 26.6M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (11m) 29s ago 11m 25.6M - 18.2.4-721-gbaa926de e6c292a6bc95 c0f5151d4806 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (7m) 9s ago 18m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (6m) 29s ago 15m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (4m) 9s ago 18m 50.9M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (4m) 29s ago 15m 41.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (6m) 9s ago 16m 15.7M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:04:42.118 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (6m) 29s ago 15m 15.6M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:04:42.119 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (3m) 9s ago 14m 89.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:04:42.119 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (2m) 9s ago 14m 90.2M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:04:42.119 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (2m) 9s ago 13m 80.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:04:42.119 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (97s) 29s ago 13m 90.1M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:04:42.119 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (65s) 29s ago 13m 86.0M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:04:42.119 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (33s) 29s ago 12m 14.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:04:42.119 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (6m) 9s ago 16m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:04:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.117+0000 7fd539914640 1 -- 172.21.15.17:0/1934116296 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd51c06e1e0 msgr2=0x7fd51c0706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.117+0000 7fd539914640 1 --2- 172.21.15.17:0/1934116296 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd51c06e1e0 0x7fd51c0706a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd524009990 tx=0x7fd524009110 comp rx=0 tx=0).stop 2024-08-19T01:04:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.117+0000 7fd539914640 1 -- 172.21.15.17:0/1934116296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd534104980 msgr2=0x7fd53419be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.117+0000 7fd539914640 1 --2- 172.21.15.17:0/1934116296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd534104980 0x7fd53419be00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd52802a9c0 tx=0x7fd5280055a0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.117+0000 7fd539914640 1 -- 172.21.15.17:0/1934116296 shutdown_connections 2024-08-19T01:04:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.117+0000 7fd539914640 1 --2- 172.21.15.17:0/1934116296 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd51c06e1e0 0x7fd51c0706a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.117+0000 7fd539914640 1 --2- 172.21.15.17:0/1934116296 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd534104980 0x7fd53419be00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.117+0000 7fd539914640 1 --2- 172.21.15.17:0/1934116296 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd5340fe980 0x7fd53419b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.117+0000 7fd539914640 1 -- 172.21.15.17:0/1934116296 >> 172.21.15.17:0/1934116296 conn(0x7fd534075830 msgr2=0x7fd5340fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.117+0000 7fd539914640 1 -- 172.21.15.17:0/1934116296 shutdown_connections 2024-08-19T01:04:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.117+0000 7fd539914640 1 -- 172.21.15.17:0/1934116296 wait complete. 2024-08-19T01:04:42.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.200+0000 7f98b5cf6640 1 -- 172.21.15.17:0/4178856623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98b0073170 msgr2=0x7f98b0110610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.200+0000 7f98b5cf6640 1 --2- 172.21.15.17:0/4178856623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98b0073170 0x7f98b0110610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9898009880 tx=0x7f989802a530 comp rx=0 tx=0).stop 2024-08-19T01:04:42.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.200+0000 7f98b5cf6640 1 -- 172.21.15.17:0/4178856623 shutdown_connections 2024-08-19T01:04:42.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.200+0000 7f98b5cf6640 1 --2- 172.21.15.17:0/4178856623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98b0073170 0x7f98b0110610 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.200+0000 7f98b5cf6640 1 --2- 172.21.15.17:0/4178856623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98b0072850 0x7f98b0072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.200+0000 7f98b5cf6640 1 -- 172.21.15.17:0/4178856623 >> 172.21.15.17:0/4178856623 conn(0x7f98b00fb840 msgr2=0x7f98b00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:42.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.200+0000 7f98b5cf6640 1 -- 172.21.15.17:0/4178856623 shutdown_connections 2024-08-19T01:04:42.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.200+0000 7f98b5cf6640 1 -- 172.21.15.17:0/4178856623 wait complete. 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98b5cf6640 1 Processor -- start 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98b5cf6640 1 -- start start 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98b5cf6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98b0072850 0x7f98b019c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98b5cf6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98b0073170 0x7f98b019c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98b5cf6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b019ce70 con 0x7f98b0072850 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98b5cf6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b01a0be0 con 0x7f98b0073170 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98af7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98b0072850 0x7f98b019c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98af7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98b0072850 0x7f98b019c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41328/0 (socket says 172.21.15.17:41328) 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98af7fe640 1 -- 172.21.15.17:0/1491821820 learned_addr learned my addr 172.21.15.17:0/1491821820 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98aeffd640 1 --2- 172.21.15.17:0/1491821820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98b0073170 0x7f98b019c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98af7fe640 1 -- 172.21.15.17:0/1491821820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98b0073170 msgr2=0x7f98b019c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.201+0000 7f98af7fe640 1 --2- 172.21.15.17:0/1491821820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98b0073170 0x7f98b019c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.202+0000 7f98af7fe640 1 -- 172.21.15.17:0/1491821820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898009560 con 0x7f98b0072850 2024-08-19T01:04:42.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.202+0000 7f98af7fe640 1 --2- 172.21.15.17:0/1491821820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98b0072850 0x7f98b019c2a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f98a000b420 tx=0x7f98a000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:42.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.202+0000 7f98acff9640 1 -- 172.21.15.17:0/1491821820 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a0011800 con 0x7f98b0072850 2024-08-19T01:04:42.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.202+0000 7f98acff9640 1 -- 172.21.15.17:0/1491821820 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98a0011e20 con 0x7f98b0072850 2024-08-19T01:04:42.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.202+0000 7f98b5cf6640 1 -- 172.21.15.17:0/1491821820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b01a0ec0 con 0x7f98b0072850 2024-08-19T01:04:42.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.202+0000 7f98acff9640 1 -- 172.21.15.17:0/1491821820 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98a000f2e0 con 0x7f98b0072850 2024-08-19T01:04:42.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.202+0000 7f98b5cf6640 1 -- 172.21.15.17:0/1491821820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b01a13e0 con 0x7f98b0072850 2024-08-19T01:04:42.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.203+0000 7f98b5cf6640 1 -- 172.21.15.17:0/1491821820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b0073f90 con 0x7f98b0072850 2024-08-19T01:04:42.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.203+0000 7f98acff9640 1 -- 172.21.15.17:0/1491821820 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f98a0010380 con 0x7f98b0072850 2024-08-19T01:04:42.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.204+0000 7f98acff9640 1 --2- 172.21.15.17:0/1491821820 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f989c06e1c0 0x7f989c070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:42.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.204+0000 7f98acff9640 1 -- 172.21.15.17:0/1491821820 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f98a008db00 con 0x7f98b0072850 2024-08-19T01:04:42.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.204+0000 7f98aeffd640 1 --2- 172.21.15.17:0/1491821820 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f989c06e1c0 0x7f989c070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:42.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.204+0000 7f98aeffd640 1 --2- 172.21.15.17:0/1491821820 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f989c06e1c0 0x7f989c070680 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9898000c00 tx=0x7f9898005750 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:42.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.208+0000 7f98acff9640 1 -- 172.21.15.17:0/1491821820 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f98a0056d40 con 0x7f98b0072850 2024-08-19T01:04:42.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.453+0000 7f98b5cf6640 1 -- 172.21.15.17:0/1491821820 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f98b019d690 con 0x7f98b0072850 2024-08-19T01:04:42.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.453+0000 7f98acff9640 1 -- 172.21.15.17:0/1491821820 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f98a005a400 con 0x7f98b0072850 2024-08-19T01:04:42.455 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:04:42.455 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:04:42.455 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:04:42.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2, 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 1 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:04:42.456 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 2, 2024-08-19T01:04:42.457 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 11 2024-08-19T01:04:42.457 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:04:42.457 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:04:42.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.455+0000 7f98b5cf6640 1 -- 172.21.15.17:0/1491821820 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f989c06e1c0 msgr2=0x7f989c070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.455+0000 7f98b5cf6640 1 --2- 172.21.15.17:0/1491821820 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f989c06e1c0 0x7f989c070680 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9898000c00 tx=0x7f9898005750 comp rx=0 tx=0).stop 2024-08-19T01:04:42.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.455+0000 7f98b5cf6640 1 -- 172.21.15.17:0/1491821820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98b0072850 msgr2=0x7f98b019c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.455+0000 7f98b5cf6640 1 --2- 172.21.15.17:0/1491821820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98b0072850 0x7f98b019c2a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f98a000b420 tx=0x7f98a000b8e0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.455+0000 7f98b5cf6640 1 -- 172.21.15.17:0/1491821820 shutdown_connections 2024-08-19T01:04:42.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.455+0000 7f98b5cf6640 1 --2- 172.21.15.17:0/1491821820 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f989c06e1c0 0x7f989c070680 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.455+0000 7f98b5cf6640 1 --2- 172.21.15.17:0/1491821820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98b0073170 0x7f98b019c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.455+0000 7f98b5cf6640 1 --2- 172.21.15.17:0/1491821820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98b0072850 0x7f98b019c2a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.455+0000 7f98b5cf6640 1 -- 172.21.15.17:0/1491821820 >> 172.21.15.17:0/1491821820 conn(0x7f98b00fb840 msgr2=0x7f98b00ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:42.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.455+0000 7f98b5cf6640 1 -- 172.21.15.17:0/1491821820 shutdown_connections 2024-08-19T01:04:42.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.455+0000 7f98b5cf6640 1 -- 172.21.15.17:0/1491821820 wait complete. 2024-08-19T01:04:42.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.538+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3181229240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f28101f70 msgr2=0x7f6f28102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.538+0000 7f6f2cb35640 1 --2- 172.21.15.17:0/3181229240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f28101f70 0x7f6f28102350 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009880 tx=0x7f6f1802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.538+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3181229240 shutdown_connections 2024-08-19T01:04:42.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.538+0000 7f6f2cb35640 1 --2- 172.21.15.17:0/3181229240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f28102920 0x7f6f28106970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.538+0000 7f6f2cb35640 1 --2- 172.21.15.17:0/3181229240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f28101f70 0x7f6f28102350 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.538+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3181229240 >> 172.21.15.17:0/3181229240 conn(0x7f6f280fd9f0 msgr2=0x7f6f280ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:42.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.538+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3181229240 shutdown_connections 2024-08-19T01:04:42.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.538+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3181229240 wait complete. 2024-08-19T01:04:42.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.538+0000 7f6f2cb35640 1 Processor -- start 2024-08-19T01:04:42.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f2cb35640 1 -- start start 2024-08-19T01:04:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f2cb35640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f28101f70 0x7f6f28197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f2cb35640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f28102920 0x7f6f281982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f2cb35640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f28198960 con 0x7f6f28102920 2024-08-19T01:04:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f2cb35640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2819c6d0 con 0x7f6f28101f70 2024-08-19T01:04:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f25d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f28102920 0x7f6f281982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f25d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f28102920 0x7f6f281982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41352/0 (socket says 172.21.15.17:41352) 2024-08-19T01:04:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f25d9b640 1 -- 172.21.15.17:0/3338912175 learned_addr learned my addr 172.21.15.17:0/3338912175 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f2659c640 1 --2- 172.21.15.17:0/3338912175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f28101f70 0x7f6f28197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f25d9b640 1 -- 172.21.15.17:0/3338912175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f28101f70 msgr2=0x7f6f28197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f25d9b640 1 --2- 172.21.15.17:0/3338912175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f28101f70 0x7f6f28197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f25d9b640 1 -- 172.21.15.17:0/3338912175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18009560 con 0x7f6f28102920 2024-08-19T01:04:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.539+0000 7f6f25d9b640 1 --2- 172.21.15.17:0/3338912175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f28102920 0x7f6f281982d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00b420 tx=0x7f6f1c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.540+0000 7f6f177fe640 1 -- 172.21.15.17:0/3338912175 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f1c011800 con 0x7f6f28102920 2024-08-19T01:04:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.540+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3338912175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2819c9b0 con 0x7f6f28102920 2024-08-19T01:04:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.540+0000 7f6f177fe640 1 -- 172.21.15.17:0/3338912175 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f1c011e20 con 0x7f6f28102920 2024-08-19T01:04:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.540+0000 7f6f177fe640 1 -- 172.21.15.17:0/3338912175 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f1c00f2e0 con 0x7f6f28102920 2024-08-19T01:04:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.540+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3338912175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2819cf00 con 0x7f6f28102920 2024-08-19T01:04:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.541+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3338912175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f28103450 con 0x7f6f28102920 2024-08-19T01:04:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.541+0000 7f6f177fe640 1 -- 172.21.15.17:0/3338912175 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6f1c010380 con 0x7f6f28102920 2024-08-19T01:04:42.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.542+0000 7f6f177fe640 1 --2- 172.21.15.17:0/3338912175 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f1006e170 0x7f6f10070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:42.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.542+0000 7f6f177fe640 1 -- 172.21.15.17:0/3338912175 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6f1c08da60 con 0x7f6f28102920 2024-08-19T01:04:42.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.542+0000 7f6f2659c640 1 --2- 172.21.15.17:0/3338912175 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f1006e170 0x7f6f10070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:42.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.542+0000 7f6f2659c640 1 --2- 172.21.15.17:0/3338912175 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f1006e170 0x7f6f10070630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009230 tx=0x7f6f180058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:42.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.546+0000 7f6f177fe640 1 -- 172.21.15.17:0/3338912175 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6f1c056d40 con 0x7f6f28102920 2024-08-19T01:04:42.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.759+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3338912175 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6f281023d0 con 0x7f6f28102920 2024-08-19T01:04:42.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.760+0000 7f6f177fe640 1 -- 172.21.15.17:0/3338912175 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1729 (secure 0 0 0) 0x7f6f1c05a400 con 0x7f6f28102920 2024-08-19T01:04:42.762 INFO:teuthology.orchestra.run.smithi017.stdout:e27 2024-08-19T01:04:42.762 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:04:39:872973+0000 2024-08-19T01:04:42.762 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:04:42.762 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:04:42.763 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:04:42.764 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:04:42.765 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:04:42.765 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:04:42.765 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:04:42.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:04:42.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:04:42.765 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:04:42.765 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:04:42.765 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:04:42.765 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:04:42.765 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44317} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/612667702,v1:172.21.15.86:6825/612667702] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:04:42.766 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-08-19T01:04:42.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.762+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3338912175 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f1006e170 msgr2=0x7f6f10070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.762+0000 7f6f2cb35640 1 --2- 172.21.15.17:0/3338912175 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f1006e170 0x7f6f10070630 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009230 tx=0x7f6f180058d0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.762+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3338912175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f28102920 msgr2=0x7f6f281982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.762+0000 7f6f2cb35640 1 --2- 172.21.15.17:0/3338912175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f28102920 0x7f6f281982d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c00b420 tx=0x7f6f1c00b8e0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.762+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3338912175 shutdown_connections 2024-08-19T01:04:42.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.762+0000 7f6f2cb35640 1 --2- 172.21.15.17:0/3338912175 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f1006e170 0x7f6f10070630 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.762+0000 7f6f2cb35640 1 --2- 172.21.15.17:0/3338912175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f28102920 0x7f6f281982d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.762+0000 7f6f2cb35640 1 --2- 172.21.15.17:0/3338912175 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f28101f70 0x7f6f28197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.762+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3338912175 >> 172.21.15.17:0/3338912175 conn(0x7f6f280fd9f0 msgr2=0x7f6f280fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:42.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.762+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3338912175 shutdown_connections 2024-08-19T01:04:42.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.762+0000 7f6f2cb35640 1 -- 172.21.15.17:0/3338912175 wait complete. 2024-08-19T01:04:42.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.845+0000 7f74c10d7640 1 -- 172.21.15.17:0/3794174447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100d30 msgr2=0x7f74bc101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.845+0000 7f74c10d7640 1 --2- 172.21.15.17:0/3794174447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100d30 0x7f74bc101110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009880 tx=0x7f74ac02a530 comp rx=0 tx=0).stop 2024-08-19T01:04:42.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.845+0000 7f74c10d7640 1 -- 172.21.15.17:0/3794174447 shutdown_connections 2024-08-19T01:04:42.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.845+0000 7f74c10d7640 1 --2- 172.21.15.17:0/3794174447 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc101650 0x7f74bc109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.845+0000 7f74c10d7640 1 --2- 172.21.15.17:0/3794174447 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100d30 0x7f74bc101110 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.845+0000 7f74c10d7640 1 -- 172.21.15.17:0/3794174447 >> 172.21.15.17:0/3794174447 conn(0x7f74bc0758a0 msgr2=0x7f74bc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:42.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.845+0000 7f74c10d7640 1 -- 172.21.15.17:0/3794174447 shutdown_connections 2024-08-19T01:04:42.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.845+0000 7f74c10d7640 1 -- 172.21.15.17:0/3794174447 wait complete. 2024-08-19T01:04:42.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.846+0000 7f74c10d7640 1 Processor -- start 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.846+0000 7f74c10d7640 1 -- start start 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74c10d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100d30 0x7f74bc19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74c10d7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc101650 0x7f74bc19bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74c10d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc19c3f0 con 0x7f74bc100d30 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74c10d7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc195980 con 0x7f74bc101650 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74bad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100d30 0x7f74bc19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74bad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100d30 0x7f74bc19b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41370/0 (socket says 172.21.15.17:41370) 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74bad9d640 1 -- 172.21.15.17:0/333970623 learned_addr learned my addr 172.21.15.17:0/333970623 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74ba59c640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc101650 0x7f74bc19bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74bad9d640 1 -- 172.21.15.17:0/333970623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc101650 msgr2=0x7f74bc19bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74bad9d640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc101650 0x7f74bc19bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:42.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74bad9d640 1 -- 172.21.15.17:0/333970623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac009560 con 0x7f74bc100d30 2024-08-19T01:04:42.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74ba59c640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc101650 0x7f74bc19bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:04:42.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74bad9d640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100d30 0x7f74bc19b890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f74ac006010 tx=0x7f74ac032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:42.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74a3fff640 1 -- 172.21.15.17:0/333970623 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74ac0051f0 con 0x7f74bc100d30 2024-08-19T01:04:42.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.847+0000 7f74c10d7640 1 -- 172.21.15.17:0/333970623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74bc195c00 con 0x7f74bc100d30 2024-08-19T01:04:42.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.848+0000 7f74c10d7640 1 -- 172.21.15.17:0/333970623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc1960f0 con 0x7f74bc100d30 2024-08-19T01:04:42.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.848+0000 7f74a3fff640 1 -- 172.21.15.17:0/333970623 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74ac005d50 con 0x7f74bc100d30 2024-08-19T01:04:42.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.848+0000 7f74a3fff640 1 -- 172.21.15.17:0/333970623 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74ac0039e0 con 0x7f74bc100d30 2024-08-19T01:04:42.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.849+0000 7f74c10d7640 1 -- 172.21.15.17:0/333970623 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a8005250 con 0x7f74bc100d30 2024-08-19T01:04:42.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.849+0000 7f74a3fff640 1 -- 172.21.15.17:0/333970623 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f74ac02ad50 con 0x7f74bc100d30 2024-08-19T01:04:42.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.849+0000 7f74a3fff640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74a406e180 0x7f74a4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:42.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.850+0000 7f74a3fff640 1 -- 172.21.15.17:0/333970623 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f74ac0ae770 con 0x7f74bc100d30 2024-08-19T01:04:42.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.850+0000 7f74ba59c640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74a406e180 0x7f74a4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:42.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.850+0000 7f74ba59c640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74a406e180 0x7f74a4070640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f74bc196df0 tx=0x7f74b0005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:42.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:42.854+0000 7f74a3fff640 1 -- 172.21.15.17:0/333970623 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f74ac077ad0 con 0x7f74bc100d30 2024-08-19T01:04:42.975 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:42 smithi017 ceph-mon[99370]: pgmap v176: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:42.975 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:42 smithi017 ceph-mon[99370]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:42.975 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:42 smithi017 ceph-mon[99370]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:42.975 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:42 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1491821820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:42.975 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:42 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3338912175' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:04:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.052+0000 7f74c10d7640 1 -- 172.21.15.17:0/333970623 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74a8000bc0 con 0x7f74a406e180 2024-08-19T01:04:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.054+0000 7f74a3fff640 1 -- 172.21.15.17:0/333970623 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f74a8000bc0 con 0x7f74a406e180 2024-08-19T01:04:43.056 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:04:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:04:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:04:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:04:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:04:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:04:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:04:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:04:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:04:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:04:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "13/23 daemons upgraded", 2024-08-19T01:04:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:04:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:04:43.057 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:04:43.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.056+0000 7f74c10d7640 1 -- 172.21.15.17:0/333970623 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74a406e180 msgr2=0x7f74a4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:43.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.056+0000 7f74c10d7640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74a406e180 0x7f74a4070640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f74bc196df0 tx=0x7f74b0005e50 comp rx=0 tx=0).stop 2024-08-19T01:04:43.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.056+0000 7f74c10d7640 1 -- 172.21.15.17:0/333970623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100d30 msgr2=0x7f74bc19b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:43.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.056+0000 7f74c10d7640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100d30 0x7f74bc19b890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f74ac006010 tx=0x7f74ac032bb0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.056+0000 7f74c10d7640 1 -- 172.21.15.17:0/333970623 shutdown_connections 2024-08-19T01:04:43.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.056+0000 7f74c10d7640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74a406e180 0x7f74a4070640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.056+0000 7f74c10d7640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc101650 0x7f74bc19bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.056+0000 7f74c10d7640 1 --2- 172.21.15.17:0/333970623 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100d30 0x7f74bc19b890 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.056+0000 7f74c10d7640 1 -- 172.21.15.17:0/333970623 >> 172.21.15.17:0/333970623 conn(0x7f74bc0758a0 msgr2=0x7f74bc101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:43.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.056+0000 7f74c10d7640 1 -- 172.21.15.17:0/333970623 shutdown_connections 2024-08-19T01:04:43.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.056+0000 7f74c10d7640 1 -- 172.21.15.17:0/333970623 wait complete. 2024-08-19T01:04:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.139+0000 7fd408e33640 1 -- 172.21.15.17:0/3961325640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd404105be0 msgr2=0x7fd404105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.139+0000 7fd408e33640 1 --2- 172.21.15.17:0/3961325640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd404105be0 0x7fd404105fc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009880 tx=0x7fd3f402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.139+0000 7fd408e33640 1 -- 172.21.15.17:0/3961325640 shutdown_connections 2024-08-19T01:04:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.139+0000 7fd408e33640 1 --2- 172.21.15.17:0/3961325640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4040ffb30 0x7fd4040fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.139+0000 7fd408e33640 1 --2- 172.21.15.17:0/3961325640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd404105be0 0x7fd404105fc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.139+0000 7fd408e33640 1 -- 172.21.15.17:0/3961325640 >> 172.21.15.17:0/3961325640 conn(0x7fd4040fb810 msgr2=0x7fd4040fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.139+0000 7fd408e33640 1 -- 172.21.15.17:0/3961325640 shutdown_connections 2024-08-19T01:04:43.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.140+0000 7fd408e33640 1 -- 172.21.15.17:0/3961325640 wait complete. 2024-08-19T01:04:43.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.140+0000 7fd408e33640 1 Processor -- start 2024-08-19T01:04:43.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.140+0000 7fd408e33640 1 -- start start 2024-08-19T01:04:43.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd408e33640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4040ffb30 0x7fd4040727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:43.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd408e33640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd404105be0 0x7fd404072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:43.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd408e33640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd404073230 con 0x7fd404105be0 2024-08-19T01:04:43.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd408e33640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd404073370 con 0x7fd4040ffb30 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd401d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd404105be0 0x7fd404072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd401d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd404105be0 0x7fd404072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41388/0 (socket says 172.21.15.17:41388) 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd401d9b640 1 -- 172.21.15.17:0/2571754203 learned_addr learned my addr 172.21.15.17:0/2571754203 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd40259c640 1 --2- 172.21.15.17:0/2571754203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4040ffb30 0x7fd4040727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd401d9b640 1 -- 172.21.15.17:0/2571754203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4040ffb30 msgr2=0x7fd4040727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd401d9b640 1 --2- 172.21.15.17:0/2571754203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4040ffb30 0x7fd4040727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd401d9b640 1 -- 172.21.15.17:0/2571754203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f4009560 con 0x7fd404105be0 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd401d9b640 1 --2- 172.21.15.17:0/2571754203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd404105be0 0x7fd404072cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00b420 tx=0x7fd3ec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd3fb7fe640 1 -- 172.21.15.17:0/2571754203 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ec011800 con 0x7fd404105be0 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd408e33640 1 -- 172.21.15.17:0/2571754203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4041a1de0 con 0x7fd404105be0 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd3fb7fe640 1 -- 172.21.15.17:0/2571754203 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3ec011e20 con 0x7fd404105be0 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.141+0000 7fd3fb7fe640 1 -- 172.21.15.17:0/2571754203 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ec00f2e0 con 0x7fd404105be0 2024-08-19T01:04:43.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.142+0000 7fd408e33640 1 -- 172.21.15.17:0/2571754203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4041a21f0 con 0x7fd404105be0 2024-08-19T01:04:43.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.143+0000 7fd408e33640 1 -- 172.21.15.17:0/2571754203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4041011e0 con 0x7fd404105be0 2024-08-19T01:04:43.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.143+0000 7fd3fb7fe640 1 -- 172.21.15.17:0/2571754203 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd3ec010380 con 0x7fd404105be0 2024-08-19T01:04:43.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.144+0000 7fd3fb7fe640 1 --2- 172.21.15.17:0/2571754203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3f006e170 0x7fd3f0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:04:43.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.144+0000 7fd3fb7fe640 1 -- 172.21.15.17:0/2571754203 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd3ec08db90 con 0x7fd404105be0 2024-08-19T01:04:43.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.144+0000 7fd40259c640 1 --2- 172.21.15.17:0/2571754203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3f006e170 0x7fd3f0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:04:43.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.144+0000 7fd40259c640 1 --2- 172.21.15.17:0/2571754203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3f006e170 0x7fd3f0070630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4000c00 tx=0x7fd3f4004120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:04:43.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.148+0000 7fd3fb7fe640 1 -- 172.21.15.17:0/2571754203 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd3ec056dd0 con 0x7fd404105be0 2024-08-19T01:04:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:42 smithi086 ceph-mon[71303]: pgmap v176: 65 pgs: 65 active+clean; 259 MiB data, 1002 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:42 smithi086 ceph-mon[71303]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:42 smithi086 ceph-mon[71303]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:42 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1491821820' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:42 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3338912175' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:04:43.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.470+0000 7fd408e33640 1 -- 172.21.15.17:0/2571754203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd404100010 con 0x7fd404105be0 2024-08-19T01:04:43.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.470+0000 7fd3fb7fe640 1 -- 172.21.15.17:0/2571754203 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7fd3ec05a490 con 0x7fd404105be0 2024-08-19T01:04:43.473 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:04:43.473 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:04:43.473 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:04:43.473 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:04:43.473 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:04:43.473 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:04:43.473 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:04:43.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.473+0000 7fd408e33640 1 -- 172.21.15.17:0/2571754203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3f006e170 msgr2=0x7fd3f0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:43.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.473+0000 7fd408e33640 1 --2- 172.21.15.17:0/2571754203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3f006e170 0x7fd3f0070630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4000c00 tx=0x7fd3f4004120 comp rx=0 tx=0).stop 2024-08-19T01:04:43.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.473+0000 7fd408e33640 1 -- 172.21.15.17:0/2571754203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd404105be0 msgr2=0x7fd404072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:04:43.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.473+0000 7fd408e33640 1 --2- 172.21.15.17:0/2571754203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd404105be0 0x7fd404072cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00b420 tx=0x7fd3ec00b8e0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.473+0000 7fd408e33640 1 -- 172.21.15.17:0/2571754203 shutdown_connections 2024-08-19T01:04:43.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.473+0000 7fd408e33640 1 --2- 172.21.15.17:0/2571754203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3f006e170 0x7fd3f0070630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.473+0000 7fd408e33640 1 --2- 172.21.15.17:0/2571754203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd404105be0 0x7fd404072cf0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.473+0000 7fd408e33640 1 --2- 172.21.15.17:0/2571754203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4040ffb30 0x7fd4040727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:04:43.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.473+0000 7fd408e33640 1 -- 172.21.15.17:0/2571754203 >> 172.21.15.17:0/2571754203 conn(0x7fd4040fb810 msgr2=0x7fd4040fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:04:43.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.473+0000 7fd408e33640 1 -- 172.21.15.17:0/2571754203 shutdown_connections 2024-08-19T01:04:43.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:04:43.473+0000 7fd408e33640 1 -- 172.21.15.17:0/2571754203 wait complete. 2024-08-19T01:04:44.094 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:43 smithi017 ceph-mon[99370]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:44.094 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:43 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2571754203' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:04:44.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:43 smithi086 ceph-mon[71303]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:44.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:43 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2571754203' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:04:45.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:44 smithi017 ceph-mon[99370]: pgmap v177: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:45.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:44 smithi017 ceph-mon[99370]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:45.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:44 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:45.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:44 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:45.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:44 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:44 smithi086 ceph-mon[71303]: pgmap v177: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:44 smithi086 ceph-mon[71303]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:04:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:44 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:44 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:45.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:44 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:45 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] up:boot 2024-08-19T01:04:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:45 smithi017 ceph-mon[99370]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:04:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:45 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T01:04:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:45 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] up:boot 2024-08-19T01:04:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:45 smithi086 ceph-mon[71303]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:04:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:45 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T01:04:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:46 smithi017 ceph-mon[99370]: pgmap v178: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:46 smithi086 ceph-mon[71303]: pgmap v178: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:48 smithi017 ceph-mon[99370]: pgmap v179: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:04:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:48 smithi086 ceph-mon[71303]: pgmap v179: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:04:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:50 smithi017 ceph-mon[99370]: pgmap v180: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:50 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:50 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:50 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:50 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:50 smithi086 ceph-mon[71303]: pgmap v180: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:50 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:50 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:50 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:50 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:52.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:52 smithi017 ceph-mon[99370]: pgmap v181: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:52.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:52 smithi086 ceph-mon[71303]: pgmap v181: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:54 smithi086 ceph-mon[71303]: pgmap v182: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:54 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:54 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:54 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:54.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:54 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:04:54.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:54 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:54.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:54 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:54.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:54 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:54.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:54 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:54.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:54 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:54.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:54 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:54 smithi017 ceph-mon[99370]: pgmap v182: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:54 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:54 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:54 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:54 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:04:54.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:54 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:54.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:54 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:04:54.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:54 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:54.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:54 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:54.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:54 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:54.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:54 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:04:55.884 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:55 smithi086 ceph-mon[71303]: Upgrade: Updating mds.cephfs.smithi086.uxhjfl 2024-08-19T01:04:55.884 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:55 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:55.884 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:55 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.uxhjfl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:04:55.884 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:55 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:55.884 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:55 smithi086 ceph-mon[71303]: Deploying daemon mds.cephfs.smithi086.uxhjfl on smithi086 2024-08-19T01:04:55.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:55 smithi017 ceph-mon[99370]: Upgrade: Updating mds.cephfs.smithi086.uxhjfl 2024-08-19T01:04:55.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:55 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:04:55.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:55 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.uxhjfl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:04:55.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:55 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:04:55.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:55 smithi017 ceph-mon[99370]: Deploying daemon mds.cephfs.smithi086.uxhjfl on smithi086 2024-08-19T01:04:56.834 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:56 smithi017 ceph-mon[99370]: pgmap v183: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:56 smithi086 ceph-mon[71303]: pgmap v183: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:57.778 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:57 smithi086 ceph-mon[71303]: osdmap e84: 6 total, 6 up, 6 in 2024-08-19T01:04:57.779 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:57 smithi086 ceph-mon[71303]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-08-19T01:04:57.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:57 smithi017 ceph-mon[99370]: osdmap e84: 6 total, 6 up, 6 in 2024-08-19T01:04:57.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:57 smithi017 ceph-mon[99370]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-08-19T01:04:58.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:04:58 smithi086 ceph-mon[71303]: pgmap v185: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:04:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:04:58 smithi017 ceph-mon[99370]: pgmap v185: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:00.820 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:00 smithi086 ceph-mon[71303]: pgmap v186: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:00.820 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:00.820 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:00.821 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:05:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:00 smithi017 ceph-mon[99370]: pgmap v186: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:05:01.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:01 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] up:boot 2024-08-19T01:05:01.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:01 smithi017 ceph-mon[99370]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:05:01.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:01 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T01:05:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:01 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] up:boot 2024-08-19T01:05:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:01 smithi086 ceph-mon[71303]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:05:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:01 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T01:05:02.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:02 smithi086 ceph-mon[71303]: pgmap v187: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:02 smithi017 ceph-mon[99370]: pgmap v187: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:03.993 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:03.993 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:03.993 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:05:03.993 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:03.993 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:05:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:05:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:04 smithi086 ceph-mon[71303]: pgmap v188: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:05.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:04 smithi017 ceph-mon[99370]: pgmap v188: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:06 smithi017 ceph-mon[99370]: pgmap v189: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:07.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:06 smithi086 ceph-mon[71303]: pgmap v189: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:08.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:08 smithi017 ceph-mon[99370]: pgmap v190: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:08 smithi086 ceph-mon[71303]: pgmap v190: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:11.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:10 smithi017 ceph-mon[99370]: pgmap v191: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:10 smithi086 ceph-mon[71303]: pgmap v191: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:13.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:12 smithi017 ceph-mon[99370]: pgmap v192: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:13.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:12 smithi086 ceph-mon[71303]: pgmap v192: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:13.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.568+0000 7f2893e0c640 1 -- 172.21.15.17:0/927776066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c0ff1f0 msgr2=0x7f288c10beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:13.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.568+0000 7f2893e0c640 1 --2- 172.21.15.17:0/927776066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c0ff1f0 0x7f288c10beb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f287c009880 tx=0x7f287c02a490 comp rx=0 tx=0).stop 2024-08-19T01:05:13.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.568+0000 7f2893e0c640 1 -- 172.21.15.17:0/927776066 shutdown_connections 2024-08-19T01:05:13.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.568+0000 7f2893e0c640 1 --2- 172.21.15.17:0/927776066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c0ff1f0 0x7f288c10beb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:13.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.568+0000 7f2893e0c640 1 --2- 172.21.15.17:0/927776066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c0fe840 0x7f288c0fec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:13.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.568+0000 7f2893e0c640 1 -- 172.21.15.17:0/927776066 >> 172.21.15.17:0/927776066 conn(0x7f288c0758a0 msgr2=0x7f288c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:13.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.568+0000 7f2893e0c640 1 -- 172.21.15.17:0/927776066 shutdown_connections 2024-08-19T01:05:13.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.568+0000 7f2893e0c640 1 -- 172.21.15.17:0/927776066 wait complete. 2024-08-19T01:05:13.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.568+0000 7f2893e0c640 1 Processor -- start 2024-08-19T01:05:13.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f2893e0c640 1 -- start start 2024-08-19T01:05:13.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f2893e0c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c0fe840 0x7f288c10bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f2893e0c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c0ff1f0 0x7f288c102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f2893e0c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c1032b0 con 0x7f288c0fe840 2024-08-19T01:05:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f2893e0c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c103420 con 0x7f288c0ff1f0 2024-08-19T01:05:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f2891ba8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c0fe840 0x7f288c10bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f2891ba8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c0fe840 0x7f288c10bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42802/0 (socket says 172.21.15.17:42802) 2024-08-19T01:05:13.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f2891ba8640 1 -- 172.21.15.17:0/3690917071 learned_addr learned my addr 172.21.15.17:0/3690917071 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:13.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f28913a7640 1 --2- 172.21.15.17:0/3690917071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c0ff1f0 0x7f288c102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:13.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f2891ba8640 1 -- 172.21.15.17:0/3690917071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c0ff1f0 msgr2=0x7f288c102ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:13.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f2891ba8640 1 --2- 172.21.15.17:0/3690917071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c0ff1f0 0x7f288c102ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:13.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.569+0000 7f2891ba8640 1 -- 172.21.15.17:0/3690917071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c009560 con 0x7f288c0fe840 2024-08-19T01:05:13.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.570+0000 7f2891ba8640 1 --2- 172.21.15.17:0/3690917071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c0fe840 0x7f288c10bd20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f288800ea00 tx=0x7f288800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:13.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.570+0000 7f2882ffd640 1 -- 172.21.15.17:0/3690917071 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f288800cd50 con 0x7f288c0fe840 2024-08-19T01:05:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.570+0000 7f2882ffd640 1 -- 172.21.15.17:0/3690917071 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2888005020 con 0x7f288c0fe840 2024-08-19T01:05:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.570+0000 7f2882ffd640 1 -- 172.21.15.17:0/3690917071 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28880116a0 con 0x7f288c0fe840 2024-08-19T01:05:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.570+0000 7f2893e0c640 1 -- 172.21.15.17:0/3690917071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c103700 con 0x7f288c0fe840 2024-08-19T01:05:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.570+0000 7f2893e0c640 1 -- 172.21.15.17:0/3690917071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c1077e0 con 0x7f288c0fe840 2024-08-19T01:05:13.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.571+0000 7f2893e0c640 1 -- 172.21.15.17:0/3690917071 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c068510 con 0x7f288c0fe840 2024-08-19T01:05:13.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.572+0000 7f2882ffd640 1 -- 172.21.15.17:0/3690917071 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2888005190 con 0x7f288c0fe840 2024-08-19T01:05:13.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.572+0000 7f2882ffd640 1 --2- 172.21.15.17:0/3690917071 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f287806e170 0x7f2878070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:13.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.572+0000 7f2882ffd640 1 -- 172.21.15.17:0/3690917071 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f288808e550 con 0x7f288c0fe840 2024-08-19T01:05:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.572+0000 7f28913a7640 1 --2- 172.21.15.17:0/3690917071 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f287806e170 0x7f2878070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.573+0000 7f28913a7640 1 --2- 172.21.15.17:0/3690917071 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f287806e170 0x7f2878070630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f287c000c00 tx=0x7f287c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:13.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.576+0000 7f2882ffd640 1 -- 172.21.15.17:0/3690917071 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2888057830 con 0x7f288c0fe840 2024-08-19T01:05:13.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.772+0000 7f2893e0c640 1 -- 172.21.15.17:0/3690917071 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f288c10ef40 con 0x7f287806e170 2024-08-19T01:05:13.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.773+0000 7f2882ffd640 1 -- 172.21.15.17:0/3690917071 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f288c10ef40 con 0x7f287806e170 2024-08-19T01:05:13.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.775+0000 7f2893e0c640 1 -- 172.21.15.17:0/3690917071 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f287806e170 msgr2=0x7f2878070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:13.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.775+0000 7f2893e0c640 1 --2- 172.21.15.17:0/3690917071 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f287806e170 0x7f2878070630 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f287c000c00 tx=0x7f287c005a20 comp rx=0 tx=0).stop 2024-08-19T01:05:13.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.775+0000 7f2893e0c640 1 -- 172.21.15.17:0/3690917071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c0fe840 msgr2=0x7f288c10bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:13.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.775+0000 7f2893e0c640 1 --2- 172.21.15.17:0/3690917071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c0fe840 0x7f288c10bd20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f288800ea00 tx=0x7f288800eec0 comp rx=0 tx=0).stop 2024-08-19T01:05:13.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.775+0000 7f2893e0c640 1 -- 172.21.15.17:0/3690917071 shutdown_connections 2024-08-19T01:05:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.775+0000 7f2893e0c640 1 --2- 172.21.15.17:0/3690917071 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f287806e170 0x7f2878070630 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.775+0000 7f2893e0c640 1 --2- 172.21.15.17:0/3690917071 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f288c0ff1f0 0x7f288c102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.775+0000 7f2893e0c640 1 --2- 172.21.15.17:0/3690917071 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f288c0fe840 0x7f288c10bd20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.775+0000 7f2893e0c640 1 -- 172.21.15.17:0/3690917071 >> 172.21.15.17:0/3690917071 conn(0x7f288c0758a0 msgr2=0x7f288c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.775+0000 7f2893e0c640 1 -- 172.21.15.17:0/3690917071 shutdown_connections 2024-08-19T01:05:13.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.775+0000 7f2893e0c640 1 -- 172.21.15.17:0/3690917071 wait complete. 2024-08-19T01:05:13.786 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:05:13.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.858+0000 7fafc71cf640 1 -- 172.21.15.17:0/194829531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc00ffda0 msgr2=0x7fafc0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:13.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.858+0000 7fafc71cf640 1 --2- 172.21.15.17:0/194829531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc00ffda0 0x7fafc0100180 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009880 tx=0x7fafb002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:05:13.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.859+0000 7fafc71cf640 1 -- 172.21.15.17:0/194829531 shutdown_connections 2024-08-19T01:05:13.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.859+0000 7fafc71cf640 1 --2- 172.21.15.17:0/194829531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafc0100750 0x7fafc01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:13.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.859+0000 7fafc71cf640 1 --2- 172.21.15.17:0/194829531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc00ffda0 0x7fafc0100180 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:13.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.859+0000 7fafc71cf640 1 -- 172.21.15.17:0/194829531 >> 172.21.15.17:0/194829531 conn(0x7fafc00fb840 msgr2=0x7fafc00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:13.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.859+0000 7fafc71cf640 1 -- 172.21.15.17:0/194829531 shutdown_connections 2024-08-19T01:05:13.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.859+0000 7fafc71cf640 1 -- 172.21.15.17:0/194829531 wait complete. 2024-08-19T01:05:13.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.859+0000 7fafc71cf640 1 Processor -- start 2024-08-19T01:05:13.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.859+0000 7fafc71cf640 1 -- start start 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafc71cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc00ffda0 0x7fafc00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafc71cf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafc0100750 0x7fafc0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafc71cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc0073230 con 0x7fafc00ffda0 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafc71cf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc00733a0 con 0x7fafc0100750 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafc4f6b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc00ffda0 0x7fafc00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafc4f6b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc00ffda0 0x7fafc00727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42828/0 (socket says 172.21.15.17:42828) 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafc4f6b640 1 -- 172.21.15.17:0/2074228062 learned_addr learned my addr 172.21.15.17:0/2074228062 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafbffff640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafc0100750 0x7fafc0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafc4f6b640 1 -- 172.21.15.17:0/2074228062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafc0100750 msgr2=0x7fafc0072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafc4f6b640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafc0100750 0x7fafc0072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafc4f6b640 1 -- 172.21.15.17:0/2074228062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0009560 con 0x7fafc00ffda0 2024-08-19T01:05:13.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafbffff640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafc0100750 0x7fafc0072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:05:13.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafc4f6b640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc00ffda0 0x7fafc00727b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fafb002a9c0 tx=0x7fafb00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:13.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.860+0000 7fafbdffb640 1 -- 172.21.15.17:0/2074228062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafb0004aa0 con 0x7fafc00ffda0 2024-08-19T01:05:13.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.861+0000 7fafbdffb640 1 -- 172.21.15.17:0/2074228062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fafb0004c00 con 0x7fafc00ffda0 2024-08-19T01:05:13.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.861+0000 7fafc71cf640 1 -- 172.21.15.17:0/2074228062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc0073620 con 0x7fafc00ffda0 2024-08-19T01:05:13.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.861+0000 7fafbdffb640 1 -- 172.21.15.17:0/2074228062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafb0003980 con 0x7fafc00ffda0 2024-08-19T01:05:13.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.861+0000 7fafc71cf640 1 -- 172.21.15.17:0/2074228062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc01a1ef0 con 0x7fafc00ffda0 2024-08-19T01:05:13.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.862+0000 7fafc71cf640 1 -- 172.21.15.17:0/2074228062 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc0101280 con 0x7fafc00ffda0 2024-08-19T01:05:13.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.862+0000 7fafbdffb640 1 -- 172.21.15.17:0/2074228062 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fafb0003bf0 con 0x7fafc00ffda0 2024-08-19T01:05:13.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.863+0000 7fafbdffb640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fafa806e170 0x7fafa8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:13.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.863+0000 7fafbdffb640 1 -- 172.21.15.17:0/2074228062 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fafb00af060 con 0x7fafc00ffda0 2024-08-19T01:05:13.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.863+0000 7fafbffff640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fafa806e170 0x7fafa8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:13.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.863+0000 7fafbffff640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fafa806e170 0x7fafa8070630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fafb40058c0 tx=0x7fafb4005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:13.867+0000 7fafbdffb640 1 -- 172.21.15.17:0/2074228062 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fafb0078340 con 0x7fafc00ffda0 2024-08-19T01:05:14.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.059+0000 7fafc71cf640 1 -- 172.21.15.17:0/2074228062 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafc0073620 con 0x7fafa806e170 2024-08-19T01:05:14.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.060+0000 7fafbdffb640 1 -- 172.21.15.17:0/2074228062 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fafc0073620 con 0x7fafa806e170 2024-08-19T01:05:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.062+0000 7fafc71cf640 1 -- 172.21.15.17:0/2074228062 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fafa806e170 msgr2=0x7fafa8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.062+0000 7fafc71cf640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fafa806e170 0x7fafa8070630 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fafb40058c0 tx=0x7fafb4005850 comp rx=0 tx=0).stop 2024-08-19T01:05:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.062+0000 7fafc71cf640 1 -- 172.21.15.17:0/2074228062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc00ffda0 msgr2=0x7fafc00727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.062+0000 7fafc71cf640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc00ffda0 0x7fafc00727b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fafb002a9c0 tx=0x7fafb00055a0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.062+0000 7fafc71cf640 1 -- 172.21.15.17:0/2074228062 shutdown_connections 2024-08-19T01:05:14.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.062+0000 7fafc71cf640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fafa806e170 0x7fafa8070630 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.062+0000 7fafc71cf640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fafc0100750 0x7fafc0072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.062+0000 7fafc71cf640 1 --2- 172.21.15.17:0/2074228062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc00ffda0 0x7fafc00727b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.062+0000 7fafc71cf640 1 -- 172.21.15.17:0/2074228062 >> 172.21.15.17:0/2074228062 conn(0x7fafc00fb840 msgr2=0x7fafc00fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:14.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.062+0000 7fafc71cf640 1 -- 172.21.15.17:0/2074228062 shutdown_connections 2024-08-19T01:05:14.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.062+0000 7fafc71cf640 1 -- 172.21.15.17:0/2074228062 wait complete. 2024-08-19T01:05:14.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.144+0000 7f11ac6c7640 1 -- 172.21.15.17:0/2722528559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a41015f0 msgr2=0x7f11a4109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.144+0000 7f11ac6c7640 1 --2- 172.21.15.17:0/2722528559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a41015f0 0x7f11a4109ae0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1194009880 tx=0x7f119402a530 comp rx=0 tx=0).stop 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.144+0000 7f11ac6c7640 1 -- 172.21.15.17:0/2722528559 shutdown_connections 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.144+0000 7f11ac6c7640 1 --2- 172.21.15.17:0/2722528559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a41015f0 0x7f11a4109ae0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.144+0000 7f11ac6c7640 1 --2- 172.21.15.17:0/2722528559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a4100cd0 0x7f11a41010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.144+0000 7f11ac6c7640 1 -- 172.21.15.17:0/2722528559 >> 172.21.15.17:0/2722528559 conn(0x7f11a40fa730 msgr2=0x7f11a40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.145+0000 7f11ac6c7640 1 -- 172.21.15.17:0/2722528559 shutdown_connections 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.145+0000 7f11ac6c7640 1 -- 172.21.15.17:0/2722528559 wait complete. 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.145+0000 7f11ac6c7640 1 Processor -- start 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.145+0000 7f11ac6c7640 1 -- start start 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.145+0000 7f11ac6c7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a4100cd0 0x7f11a419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.145+0000 7f11ac6c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a41015f0 0x7f11a419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:14.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.145+0000 7f11ac6c7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a419c3d0 con 0x7f11a41015f0 2024-08-19T01:05:14.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.145+0000 7f11ac6c7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a4195960 con 0x7f11a4100cd0 2024-08-19T01:05:14.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f11a9c62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a41015f0 0x7f11a419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:14.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f11a9c62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a41015f0 0x7f11a419bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42840/0 (socket says 172.21.15.17:42840) 2024-08-19T01:05:14.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f11a9c62640 1 -- 172.21.15.17:0/1592484901 learned_addr learned my addr 172.21.15.17:0/1592484901 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:14.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f11aa463640 1 --2- 172.21.15.17:0/1592484901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a4100cd0 0x7f11a419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f11a9c62640 1 -- 172.21.15.17:0/1592484901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a4100cd0 msgr2=0x7f11a419b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f11a9c62640 1 --2- 172.21.15.17:0/1592484901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a4100cd0 0x7f11a419b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f11a9c62640 1 -- 172.21.15.17:0/1592484901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1194009560 con 0x7f11a41015f0 2024-08-19T01:05:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f11a9c62640 1 --2- 172.21.15.17:0/1592484901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a41015f0 0x7f11a419bdb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1194006010 tx=0x7f11940055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f119b7fe640 1 -- 172.21.15.17:0/1592484901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11940048d0 con 0x7f11a41015f0 2024-08-19T01:05:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f119b7fe640 1 -- 172.21.15.17:0/1592484901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1194031640 con 0x7f11a41015f0 2024-08-19T01:05:14.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f11ac6c7640 1 -- 172.21.15.17:0/1592484901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a4195be0 con 0x7f11a41015f0 2024-08-19T01:05:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.146+0000 7f119b7fe640 1 -- 172.21.15.17:0/1592484901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1194003820 con 0x7f11a41015f0 2024-08-19T01:05:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.147+0000 7f11ac6c7640 1 -- 172.21.15.17:0/1592484901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a41960d0 con 0x7f11a41015f0 2024-08-19T01:05:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.148+0000 7f11ac6c7640 1 -- 172.21.15.17:0/1592484901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a4068d30 con 0x7f11a41015f0 2024-08-19T01:05:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.148+0000 7f119b7fe640 1 -- 172.21.15.17:0/1592484901 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f119402ad50 con 0x7f11a41015f0 2024-08-19T01:05:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.149+0000 7f119b7fe640 1 --2- 172.21.15.17:0/1592484901 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f119006e180 0x7f1190070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:14.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.149+0000 7f119b7fe640 1 -- 172.21.15.17:0/1592484901 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f11940aee70 con 0x7f11a41015f0 2024-08-19T01:05:14.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.149+0000 7f11aa463640 1 --2- 172.21.15.17:0/1592484901 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f119006e180 0x7f1190070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:14.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.149+0000 7f11aa463640 1 --2- 172.21.15.17:0/1592484901 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f119006e180 0x7f1190070640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f11a0005fd0 tx=0x7f11a0009760 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:14.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.153+0000 7f119b7fe640 1 -- 172.21.15.17:0/1592484901 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1194078200 con 0x7f11a41015f0 2024-08-19T01:05:14.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.338+0000 7f11ac6c7640 1 -- 172.21.15.17:0/1592484901 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f11a410cda0 con 0x7f119006e180 2024-08-19T01:05:14.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.347+0000 7f119b7fe640 1 -- 172.21.15.17:0/1592484901 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f11a410cda0 con 0x7f119006e180 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (6m) 25s ago 17m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (17m) 25s ago 17m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (16m) 11s ago 16m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (4m) 25s ago 17m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (4m) 11s ago 16m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (6m) 25s ago 16m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (30s) 25s ago 11m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (47s) 25s ago 11m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (11m) 11s ago 11m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (14s) 11s ago 11m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:05:14.350 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (8m) 25s ago 18m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (7m) 11s ago 16m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (5m) 25s ago 18m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (4m) 11s ago 16m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (7m) 25s ago 17m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (7m) 11s ago 16m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (3m) 25s ago 15m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (3m) 25s ago 14m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (2m) 25s ago 14m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (2m) 11s ago 14m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (97s) 11s ago 13m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (65s) 11s ago 13m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:05:14.351 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (6m) 25s ago 16m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:05:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.350+0000 7f11ac6c7640 1 -- 172.21.15.17:0/1592484901 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f119006e180 msgr2=0x7f1190070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.350+0000 7f11ac6c7640 1 --2- 172.21.15.17:0/1592484901 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f119006e180 0x7f1190070640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f11a0005fd0 tx=0x7f11a0009760 comp rx=0 tx=0).stop 2024-08-19T01:05:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.350+0000 7f11ac6c7640 1 -- 172.21.15.17:0/1592484901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a41015f0 msgr2=0x7f11a419bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.350+0000 7f11ac6c7640 1 --2- 172.21.15.17:0/1592484901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a41015f0 0x7f11a419bdb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1194006010 tx=0x7f11940055a0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.350+0000 7f11ac6c7640 1 -- 172.21.15.17:0/1592484901 shutdown_connections 2024-08-19T01:05:14.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.350+0000 7f11ac6c7640 1 --2- 172.21.15.17:0/1592484901 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f119006e180 0x7f1190070640 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.350+0000 7f11ac6c7640 1 --2- 172.21.15.17:0/1592484901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f11a41015f0 0x7f11a419bdb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.350+0000 7f11ac6c7640 1 --2- 172.21.15.17:0/1592484901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f11a4100cd0 0x7f11a419b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.350+0000 7f11ac6c7640 1 -- 172.21.15.17:0/1592484901 >> 172.21.15.17:0/1592484901 conn(0x7f11a40fa730 msgr2=0x7f11a4101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:14.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.350+0000 7f11ac6c7640 1 -- 172.21.15.17:0/1592484901 shutdown_connections 2024-08-19T01:05:14.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.350+0000 7f11ac6c7640 1 -- 172.21.15.17:0/1592484901 wait complete. 2024-08-19T01:05:14.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.431+0000 7ff9ee81a640 1 -- 172.21.15.17:0/3619800022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9e8101650 msgr2=0x7ff9e8109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.431+0000 7ff9ee81a640 1 --2- 172.21.15.17:0/3619800022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9e8101650 0x7ff9e8109b40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009880 tx=0x7ff9dc02a530 comp rx=0 tx=0).stop 2024-08-19T01:05:14.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.431+0000 7ff9ee81a640 1 -- 172.21.15.17:0/3619800022 shutdown_connections 2024-08-19T01:05:14.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.431+0000 7ff9ee81a640 1 --2- 172.21.15.17:0/3619800022 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9e8101650 0x7ff9e8109b40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.431+0000 7ff9ee81a640 1 --2- 172.21.15.17:0/3619800022 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8100d30 0x7ff9e8101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.431+0000 7ff9ee81a640 1 -- 172.21.15.17:0/3619800022 >> 172.21.15.17:0/3619800022 conn(0x7ff9e80758a0 msgr2=0x7ff9e80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.431+0000 7ff9ee81a640 1 -- 172.21.15.17:0/3619800022 shutdown_connections 2024-08-19T01:05:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.431+0000 7ff9ee81a640 1 -- 172.21.15.17:0/3619800022 wait complete. 2024-08-19T01:05:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.432+0000 7ff9ee81a640 1 Processor -- start 2024-08-19T01:05:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.432+0000 7ff9ee81a640 1 -- start start 2024-08-19T01:05:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.432+0000 7ff9ee81a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8100d30 0x7ff9e8197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.432+0000 7ff9ee81a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9e8101650 0x7ff9e8198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.432+0000 7ff9ee81a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8198910 con 0x7ff9e8101650 2024-08-19T01:05:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.432+0000 7ff9ee81a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e819c680 con 0x7ff9e8100d30 2024-08-19T01:05:14.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.432+0000 7ff9e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9e8101650 0x7ff9e8198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:14.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.432+0000 7ff9e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9e8101650 0x7ff9e8198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42864/0 (socket says 172.21.15.17:42864) 2024-08-19T01:05:14.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.432+0000 7ff9e77fe640 1 -- 172.21.15.17:0/1846955744 learned_addr learned my addr 172.21.15.17:0/1846955744 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:14.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.432+0000 7ff9e7fff640 1 --2- 172.21.15.17:0/1846955744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8100d30 0x7ff9e8197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:14.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.433+0000 7ff9e77fe640 1 -- 172.21.15.17:0/1846955744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8100d30 msgr2=0x7ff9e8197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.433+0000 7ff9e77fe640 1 --2- 172.21.15.17:0/1846955744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8100d30 0x7ff9e8197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.433+0000 7ff9e77fe640 1 -- 172.21.15.17:0/1846955744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc009560 con 0x7ff9e8101650 2024-08-19T01:05:14.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.433+0000 7ff9e77fe640 1 --2- 172.21.15.17:0/1846955744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9e8101650 0x7ff9e8198280 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc005940 tx=0x7ff9dc032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:14.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.433+0000 7ff9e57fa640 1 -- 172.21.15.17:0/1846955744 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9dc005220 con 0x7ff9e8101650 2024-08-19T01:05:14.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.433+0000 7ff9e57fa640 1 -- 172.21.15.17:0/1846955744 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9dc005380 con 0x7ff9e8101650 2024-08-19T01:05:14.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.433+0000 7ff9ee81a640 1 -- 172.21.15.17:0/1846955744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e819c900 con 0x7ff9e8101650 2024-08-19T01:05:14.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.433+0000 7ff9e57fa640 1 -- 172.21.15.17:0/1846955744 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9dc003a50 con 0x7ff9e8101650 2024-08-19T01:05:14.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.433+0000 7ff9ee81a640 1 -- 172.21.15.17:0/1846955744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e819cdf0 con 0x7ff9e8101650 2024-08-19T01:05:14.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.434+0000 7ff9ee81a640 1 -- 172.21.15.17:0/1846955744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e8068490 con 0x7ff9e8101650 2024-08-19T01:05:14.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.435+0000 7ff9e57fa640 1 -- 172.21.15.17:0/1846955744 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff9dc02ad50 con 0x7ff9e8101650 2024-08-19T01:05:14.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.435+0000 7ff9e57fa640 1 --2- 172.21.15.17:0/1846955744 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff9d006e170 0x7ff9d0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:14.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.435+0000 7ff9e57fa640 1 -- 172.21.15.17:0/1846955744 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff9dc0aec70 con 0x7ff9e8101650 2024-08-19T01:05:14.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.435+0000 7ff9e7fff640 1 --2- 172.21.15.17:0/1846955744 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff9d006e170 0x7ff9d0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:14.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.436+0000 7ff9e7fff640 1 --2- 172.21.15.17:0/1846955744 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff9d006e170 0x7ff9d0070630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80058c0 tx=0x7ff9d800a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:14.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.439+0000 7ff9e57fa640 1 -- 172.21.15.17:0/1846955744 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff9dc0b5080 con 0x7ff9e8101650 2024-08-19T01:05:14.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.695+0000 7ff9ee81a640 1 -- 172.21.15.17:0/1846955744 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff9e81990d0 con 0x7ff9e8101650 2024-08-19T01:05:14.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.695+0000 7ff9e57fa640 1 -- 172.21.15.17:0/1846955744 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7ff9dc077f60 con 0x7ff9e8101650 2024-08-19T01:05:14.697 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:05:14.698 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:05:14.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:05:14.699 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:05:14.699 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:05:14.699 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:05:14.699 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:05:14.699 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:05:14.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.698+0000 7ff9ee81a640 1 -- 172.21.15.17:0/1846955744 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff9d006e170 msgr2=0x7ff9d0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.698+0000 7ff9ee81a640 1 --2- 172.21.15.17:0/1846955744 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff9d006e170 0x7ff9d0070630 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80058c0 tx=0x7ff9d800a2d0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.698+0000 7ff9ee81a640 1 -- 172.21.15.17:0/1846955744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9e8101650 msgr2=0x7ff9e8198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.698+0000 7ff9ee81a640 1 --2- 172.21.15.17:0/1846955744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9e8101650 0x7ff9e8198280 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc005940 tx=0x7ff9dc032bd0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.698+0000 7ff9ee81a640 1 -- 172.21.15.17:0/1846955744 shutdown_connections 2024-08-19T01:05:14.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.698+0000 7ff9ee81a640 1 --2- 172.21.15.17:0/1846955744 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff9d006e170 0x7ff9d0070630 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.698+0000 7ff9ee81a640 1 --2- 172.21.15.17:0/1846955744 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9e8101650 0x7ff9e8198280 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.698+0000 7ff9ee81a640 1 --2- 172.21.15.17:0/1846955744 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9e8100d30 0x7ff9e8197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.698+0000 7ff9ee81a640 1 -- 172.21.15.17:0/1846955744 >> 172.21.15.17:0/1846955744 conn(0x7ff9e80758a0 msgr2=0x7ff9e80fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:14.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.698+0000 7ff9ee81a640 1 -- 172.21.15.17:0/1846955744 shutdown_connections 2024-08-19T01:05:14.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.698+0000 7ff9ee81a640 1 -- 172.21.15.17:0/1846955744 wait complete. 2024-08-19T01:05:14.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.782+0000 7fc13e3d4640 1 -- 172.21.15.17:0/787510790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc138101630 msgr2=0x7fc138109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.782+0000 7fc13e3d4640 1 --2- 172.21.15.17:0/787510790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc138101630 0x7fc138109b20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0098b0 tx=0x7fc12c02a560 comp rx=0 tx=0).stop 2024-08-19T01:05:14.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.782+0000 7fc13e3d4640 1 -- 172.21.15.17:0/787510790 shutdown_connections 2024-08-19T01:05:14.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.782+0000 7fc13e3d4640 1 --2- 172.21.15.17:0/787510790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc138101630 0x7fc138109b20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.782+0000 7fc13e3d4640 1 --2- 172.21.15.17:0/787510790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc138100d10 0x7fc1381010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.782+0000 7fc13e3d4640 1 -- 172.21.15.17:0/787510790 >> 172.21.15.17:0/787510790 conn(0x7fc1380758a0 msgr2=0x7fc1380fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:14.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.782+0000 7fc13e3d4640 1 -- 172.21.15.17:0/787510790 shutdown_connections 2024-08-19T01:05:14.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.782+0000 7fc13e3d4640 1 -- 172.21.15.17:0/787510790 wait complete. 2024-08-19T01:05:14.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.782+0000 7fc13e3d4640 1 Processor -- start 2024-08-19T01:05:14.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.782+0000 7fc13e3d4640 1 -- start start 2024-08-19T01:05:14.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc13e3d4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc138100d10 0x7fc13819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:14.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc13e3d4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc138101630 0x7fc13819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:14.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc13e3d4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13819c3c0 con 0x7fc138101630 2024-08-19T01:05:14.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc13e3d4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1381959e0 con 0x7fc138100d10 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc1377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc138101630 0x7fc13819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc1377fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc138101630 0x7fc13819be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42886/0 (socket says 172.21.15.17:42886) 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc1377fe640 1 -- 172.21.15.17:0/3600005550 learned_addr learned my addr 172.21.15.17:0/3600005550 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc137fff640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc138100d10 0x7fc13819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc1377fe640 1 -- 172.21.15.17:0/3600005550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc138100d10 msgr2=0x7fc13819b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc1377fe640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc138100d10 0x7fc13819b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc1377fe640 1 -- 172.21.15.17:0/3600005550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c009560 con 0x7fc138101630 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc137fff640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc138100d10 0x7fc13819b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc1377fe640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc138101630 0x7fc13819be30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc12c006010 tx=0x7fc12c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc1357fa640 1 -- 172.21.15.17:0/3600005550 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc12c004aa0 con 0x7fc138101630 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc1357fa640 1 -- 172.21.15.17:0/3600005550 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc12c004c00 con 0x7fc138101630 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.783+0000 7fc13e3d4640 1 -- 172.21.15.17:0/3600005550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc138195c60 con 0x7fc138101630 2024-08-19T01:05:14.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.784+0000 7fc1357fa640 1 -- 172.21.15.17:0/3600005550 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc12c003a20 con 0x7fc138101630 2024-08-19T01:05:14.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.784+0000 7fc13e3d4640 1 -- 172.21.15.17:0/3600005550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc138196150 con 0x7fc138101630 2024-08-19T01:05:14.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.784+0000 7fc13e3d4640 1 -- 172.21.15.17:0/3600005550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1380684b0 con 0x7fc138101630 2024-08-19T01:05:14.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.785+0000 7fc1357fa640 1 -- 172.21.15.17:0/3600005550 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc12c003bc0 con 0x7fc138101630 2024-08-19T01:05:14.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.786+0000 7fc1357fa640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc12006e170 0x7fc120070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:14.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.786+0000 7fc1357fa640 1 -- 172.21.15.17:0/3600005550 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc12c0af2b0 con 0x7fc138101630 2024-08-19T01:05:14.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.786+0000 7fc137fff640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc12006e170 0x7fc120070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:14.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.786+0000 7fc137fff640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc12006e170 0x7fc120070630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc12800abe0 tx=0x7fc12800a5c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:14.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:14.790+0000 7fc1357fa640 1 -- 172.21.15.17:0/3600005550 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc12c078610 con 0x7fc138101630 2024-08-19T01:05:15.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.001+0000 7fc13e3d4640 1 -- 172.21.15.17:0/3600005550 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc1381043c0 con 0x7fc138101630 2024-08-19T01:05:15.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:14 smithi017 ceph-mon[99370]: pgmap v193: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:15.003 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:14 smithi017 ceph-mon[99370]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:15.004 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:14 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1846955744' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:05:15.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.001+0000 7fc1357fa640 1 -- 172.21.15.17:0/3600005550 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7fc12c07bcd0 con 0x7fc138101630 2024-08-19T01:05:15.004 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:05:15.004 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:05:15.004 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:05:15.004 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:05:15.004 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:05:15.005 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:05:15.006 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:05:15.007 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:05:15.008 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:05:15.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.004+0000 7fc13e3d4640 1 -- 172.21.15.17:0/3600005550 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc12006e170 msgr2=0x7fc120070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:15.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.004+0000 7fc13e3d4640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc12006e170 0x7fc120070630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc12800abe0 tx=0x7fc12800a5c0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.004+0000 7fc13e3d4640 1 -- 172.21.15.17:0/3600005550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc138101630 msgr2=0x7fc13819be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:15.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.004+0000 7fc13e3d4640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc138101630 0x7fc13819be30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc12c006010 tx=0x7fc12c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.005+0000 7fc13e3d4640 1 -- 172.21.15.17:0/3600005550 shutdown_connections 2024-08-19T01:05:15.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.005+0000 7fc13e3d4640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc12006e170 0x7fc120070630 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.005+0000 7fc13e3d4640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc138101630 0x7fc13819be30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.005+0000 7fc13e3d4640 1 --2- 172.21.15.17:0/3600005550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc138100d10 0x7fc13819b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.005+0000 7fc13e3d4640 1 -- 172.21.15.17:0/3600005550 >> 172.21.15.17:0/3600005550 conn(0x7fc1380758a0 msgr2=0x7fc138101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:15.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.005+0000 7fc13e3d4640 1 -- 172.21.15.17:0/3600005550 shutdown_connections 2024-08-19T01:05:15.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.005+0000 7fc13e3d4640 1 -- 172.21.15.17:0/3600005550 wait complete. 2024-08-19T01:05:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.088+0000 7f5f00cb9640 1 -- 172.21.15.17:0/3094746962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5efc104a30 msgr2=0x7f5efc104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.088+0000 7f5f00cb9640 1 --2- 172.21.15.17:0/3094746962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5efc104a30 0x7f5efc104e10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5eec009880 tx=0x7f5eec02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.088+0000 7f5f00cb9640 1 -- 172.21.15.17:0/3094746962 shutdown_connections 2024-08-19T01:05:15.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.088+0000 7f5f00cb9640 1 --2- 172.21.15.17:0/3094746962 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5efc0fea30 0x7f5efc0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.088+0000 7f5f00cb9640 1 --2- 172.21.15.17:0/3094746962 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5efc104a30 0x7f5efc104e10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.088+0000 7f5f00cb9640 1 -- 172.21.15.17:0/3094746962 >> 172.21.15.17:0/3094746962 conn(0x7f5efc0fa730 msgr2=0x7f5efc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.088+0000 7f5f00cb9640 1 -- 172.21.15.17:0/3094746962 shutdown_connections 2024-08-19T01:05:15.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.088+0000 7f5f00cb9640 1 -- 172.21.15.17:0/3094746962 wait complete. 2024-08-19T01:05:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.089+0000 7f5f00cb9640 1 Processor -- start 2024-08-19T01:05:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.089+0000 7f5f00cb9640 1 -- start start 2024-08-19T01:05:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.089+0000 7f5f00cb9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5efc0fea30 0x7f5efc19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.089+0000 7f5f00cb9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5efc104a30 0x7f5efc19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:15.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.089+0000 7f5f00cb9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1947e0 con 0x7f5efc104a30 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.089+0000 7f5f00cb9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc194950 con 0x7f5efc0fea30 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.089+0000 7f5ef9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5efc104a30 0x7f5efc19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.089+0000 7f5ef9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5efc104a30 0x7f5efc19ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42912/0 (socket says 172.21.15.17:42912) 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.089+0000 7f5ef9d9b640 1 -- 172.21.15.17:0/144513381 learned_addr learned my addr 172.21.15.17:0/144513381 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.089+0000 7f5efa59c640 1 --2- 172.21.15.17:0/144513381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5efc0fea30 0x7f5efc19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.090+0000 7f5ef9d9b640 1 -- 172.21.15.17:0/144513381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5efc0fea30 msgr2=0x7f5efc19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.090+0000 7f5ef9d9b640 1 --2- 172.21.15.17:0/144513381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5efc0fea30 0x7f5efc19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.090+0000 7f5ef9d9b640 1 -- 172.21.15.17:0/144513381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec009560 con 0x7f5efc104a30 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.090+0000 7f5ef9d9b640 1 --2- 172.21.15.17:0/144513381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5efc104a30 0x7f5efc19ac30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c810 tx=0x7f5ef000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.090+0000 7f5eeb7fe640 1 -- 172.21.15.17:0/144513381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ef00041f0 con 0x7f5efc104a30 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.090+0000 7f5f00cb9640 1 -- 172.21.15.17:0/144513381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc194c30 con 0x7f5efc104a30 2024-08-19T01:05:15.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.090+0000 7f5eeb7fe640 1 -- 172.21.15.17:0/144513381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ef0007e70 con 0x7f5efc104a30 2024-08-19T01:05:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.090+0000 7f5eeb7fe640 1 -- 172.21.15.17:0/144513381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ef00049d0 con 0x7f5efc104a30 2024-08-19T01:05:15.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.090+0000 7f5f00cb9640 1 -- 172.21.15.17:0/144513381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc195180 con 0x7f5efc104a30 2024-08-19T01:05:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.091+0000 7f5f00cb9640 1 -- 172.21.15.17:0/144513381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc100170 con 0x7f5efc104a30 2024-08-19T01:05:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.092+0000 7f5eeb7fe640 1 -- 172.21.15.17:0/144513381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5ef00079b0 con 0x7f5efc104a30 2024-08-19T01:05:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.092+0000 7f5eeb7fe640 1 --2- 172.21.15.17:0/144513381 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ee406e170 0x7f5ee4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.092+0000 7f5eeb7fe640 1 -- 172.21.15.17:0/144513381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5ef008dfe0 con 0x7f5efc104a30 2024-08-19T01:05:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.092+0000 7f5efa59c640 1 --2- 172.21.15.17:0/144513381 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ee406e170 0x7f5ee4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:15.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.093+0000 7f5efa59c640 1 --2- 172.21.15.17:0/144513381 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ee406e170 0x7f5ee4070630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5eec000c00 tx=0x7f5eec005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:15.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.097+0000 7f5eeb7fe640 1 -- 172.21.15.17:0/144513381 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5ef00572c0 con 0x7f5efc104a30 2024-08-19T01:05:15.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:14 smithi086 ceph-mon[71303]: pgmap v193: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:15.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:14 smithi086 ceph-mon[71303]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:15.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:14 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1846955744' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:05:15.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.290+0000 7f5f00cb9640 1 -- 172.21.15.17:0/144513381 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5efc195cf0 con 0x7f5ee406e170 2024-08-19T01:05:15.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.291+0000 7f5eeb7fe640 1 -- 172.21.15.17:0/144513381 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5efc195cf0 con 0x7f5ee406e170 2024-08-19T01:05:15.293 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:05:15.293 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:05:15.293 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:05:15.293 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:05:15.293 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:05:15.293 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:05:15.293 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:05:15.294 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:05:15.294 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:05:15.294 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:05:15.294 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:05:15.294 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:05:15.294 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:05:15.294 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:05:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.294+0000 7f5f00cb9640 1 -- 172.21.15.17:0/144513381 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ee406e170 msgr2=0x7f5ee4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.294+0000 7f5f00cb9640 1 --2- 172.21.15.17:0/144513381 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ee406e170 0x7f5ee4070630 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5eec000c00 tx=0x7f5eec005a20 comp rx=0 tx=0).stop 2024-08-19T01:05:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.294+0000 7f5f00cb9640 1 -- 172.21.15.17:0/144513381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5efc104a30 msgr2=0x7f5efc19ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.294+0000 7f5f00cb9640 1 --2- 172.21.15.17:0/144513381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5efc104a30 0x7f5efc19ac30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c810 tx=0x7f5ef000ccd0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.294+0000 7f5f00cb9640 1 -- 172.21.15.17:0/144513381 shutdown_connections 2024-08-19T01:05:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.294+0000 7f5f00cb9640 1 --2- 172.21.15.17:0/144513381 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ee406e170 0x7f5ee4070630 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.294+0000 7f5f00cb9640 1 --2- 172.21.15.17:0/144513381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5efc104a30 0x7f5efc19ac30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.294+0000 7f5f00cb9640 1 --2- 172.21.15.17:0/144513381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5efc0fea30 0x7f5efc19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.294+0000 7f5f00cb9640 1 -- 172.21.15.17:0/144513381 >> 172.21.15.17:0/144513381 conn(0x7f5efc0fa730 msgr2=0x7f5efc0fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.294+0000 7f5f00cb9640 1 -- 172.21.15.17:0/144513381 shutdown_connections 2024-08-19T01:05:15.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.294+0000 7f5f00cb9640 1 -- 172.21.15.17:0/144513381 wait complete. 2024-08-19T01:05:15.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.375+0000 7f13f8eef640 1 -- 172.21.15.17:0/3388584111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4100750 msgr2=0x7f13f41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:15.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.375+0000 7f13f8eef640 1 --2- 172.21.15.17:0/3388584111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4100750 0x7f13f41047a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f13e8009880 tx=0x7f13e802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.375+0000 7f13f8eef640 1 -- 172.21.15.17:0/3388584111 shutdown_connections 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.375+0000 7f13f8eef640 1 --2- 172.21.15.17:0/3388584111 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f4100750 0x7f13f41047a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.375+0000 7f13f8eef640 1 --2- 172.21.15.17:0/3388584111 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13f40ffda0 0x7f13f4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.375+0000 7f13f8eef640 1 -- 172.21.15.17:0/3388584111 >> 172.21.15.17:0/3388584111 conn(0x7f13f40fb840 msgr2=0x7f13f40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.375+0000 7f13f8eef640 1 -- 172.21.15.17:0/3388584111 shutdown_connections 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.375+0000 7f13f8eef640 1 -- 172.21.15.17:0/3388584111 wait complete. 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.376+0000 7f13f8eef640 1 Processor -- start 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.376+0000 7f13f8eef640 1 -- start start 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.376+0000 7f13f8eef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f40ffda0 0x7f13f419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.376+0000 7f13f8eef640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13f4100750 0x7f13f419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.376+0000 7f13f8eef640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f419c380 con 0x7f13f40ffda0 2024-08-19T01:05:15.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.376+0000 7f13f8eef640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f4195910 con 0x7f13f4100750 2024-08-19T01:05:15.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.376+0000 7f13f259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f40ffda0 0x7f13f419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:15.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.376+0000 7f13f259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f40ffda0 0x7f13f419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42934/0 (socket says 172.21.15.17:42934) 2024-08-19T01:05:15.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.376+0000 7f13f259c640 1 -- 172.21.15.17:0/2050211122 learned_addr learned my addr 172.21.15.17:0/2050211122 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:15.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.377+0000 7f13f1d9b640 1 --2- 172.21.15.17:0/2050211122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13f4100750 0x7f13f419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:15.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.377+0000 7f13f259c640 1 -- 172.21.15.17:0/2050211122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13f4100750 msgr2=0x7f13f419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:15.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.377+0000 7f13f259c640 1 --2- 172.21.15.17:0/2050211122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13f4100750 0x7f13f419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.377+0000 7f13f259c640 1 -- 172.21.15.17:0/2050211122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8009560 con 0x7f13f40ffda0 2024-08-19T01:05:15.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.377+0000 7f13f259c640 1 --2- 172.21.15.17:0/2050211122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f40ffda0 0x7f13f419b820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13e400d8d0 tx=0x7f13e400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:15.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.377+0000 7f13e37fe640 1 -- 172.21.15.17:0/2050211122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13e4009c00 con 0x7f13f40ffda0 2024-08-19T01:05:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.377+0000 7f13e37fe640 1 -- 172.21.15.17:0/2050211122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13e4009d60 con 0x7f13f40ffda0 2024-08-19T01:05:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.377+0000 7f13f8eef640 1 -- 172.21.15.17:0/2050211122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f4195bf0 con 0x7f13f40ffda0 2024-08-19T01:05:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.377+0000 7f13e37fe640 1 -- 172.21.15.17:0/2050211122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13e40049d0 con 0x7f13f40ffda0 2024-08-19T01:05:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.377+0000 7f13f8eef640 1 -- 172.21.15.17:0/2050211122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f4196110 con 0x7f13f40ffda0 2024-08-19T01:05:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.378+0000 7f13f8eef640 1 -- 172.21.15.17:0/2050211122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f4101280 con 0x7f13f40ffda0 2024-08-19T01:05:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.379+0000 7f13e37fe640 1 -- 172.21.15.17:0/2050211122 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f13e4004c90 con 0x7f13f40ffda0 2024-08-19T01:05:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.379+0000 7f13e37fe640 1 --2- 172.21.15.17:0/2050211122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13dc06e170 0x7f13dc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.379+0000 7f13e37fe640 1 -- 172.21.15.17:0/2050211122 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f13e408df00 con 0x7f13f40ffda0 2024-08-19T01:05:15.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.379+0000 7f13f1d9b640 1 --2- 172.21.15.17:0/2050211122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13dc06e170 0x7f13dc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:15.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.380+0000 7f13f1d9b640 1 --2- 172.21.15.17:0/2050211122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13dc06e170 0x7f13dc070630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13e8000c00 tx=0x7f13e8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:15.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.384+0000 7f13e37fe640 1 -- 172.21.15.17:0/2050211122 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f13e40571e0 con 0x7f13f40ffda0 2024-08-19T01:05:15.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.640+0000 7f13f8eef640 1 -- 172.21.15.17:0/2050211122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f13f4100180 con 0x7f13f40ffda0 2024-08-19T01:05:15.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.640+0000 7f13e37fe640 1 -- 172.21.15.17:0/2050211122 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f13e405a8a0 con 0x7f13f40ffda0 2024-08-19T01:05:15.642 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:05:15.643 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:05:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:05:15.643 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:05:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:05:15.643 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:05:15.643 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:05:15.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.643+0000 7f13f8eef640 1 -- 172.21.15.17:0/2050211122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13dc06e170 msgr2=0x7f13dc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:15.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.643+0000 7f13f8eef640 1 --2- 172.21.15.17:0/2050211122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13dc06e170 0x7f13dc070630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f13e8000c00 tx=0x7f13e8005a20 comp rx=0 tx=0).stop 2024-08-19T01:05:15.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.643+0000 7f13f8eef640 1 -- 172.21.15.17:0/2050211122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f40ffda0 msgr2=0x7f13f419b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:15.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.643+0000 7f13f8eef640 1 --2- 172.21.15.17:0/2050211122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f40ffda0 0x7f13f419b820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f13e400d8d0 tx=0x7f13e400dd90 comp rx=0 tx=0).stop 2024-08-19T01:05:15.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.643+0000 7f13f8eef640 1 -- 172.21.15.17:0/2050211122 shutdown_connections 2024-08-19T01:05:15.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.643+0000 7f13f8eef640 1 --2- 172.21.15.17:0/2050211122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13dc06e170 0x7f13dc070630 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.643+0000 7f13f8eef640 1 --2- 172.21.15.17:0/2050211122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13f4100750 0x7f13f419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.643+0000 7f13f8eef640 1 --2- 172.21.15.17:0/2050211122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13f40ffda0 0x7f13f419b820 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:15.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.643+0000 7f13f8eef640 1 -- 172.21.15.17:0/2050211122 >> 172.21.15.17:0/2050211122 conn(0x7f13f40fb840 msgr2=0x7f13f40fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:15.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.643+0000 7f13f8eef640 1 -- 172.21.15.17:0/2050211122 shutdown_connections 2024-08-19T01:05:15.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:15.643+0000 7f13f8eef640 1 -- 172.21.15.17:0/2050211122 wait complete. 2024-08-19T01:05:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:15 smithi017 ceph-mon[99370]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:15 smithi017 ceph-mon[99370]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:15 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3600005550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:05:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:15 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2050211122' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:05:16.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:15 smithi086 ceph-mon[71303]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:16.097 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:15 smithi086 ceph-mon[71303]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:16.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:15 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3600005550' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:05:16.098 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:15 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2050211122' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:05:17.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:16 smithi017 ceph-mon[99370]: pgmap v194: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:17.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:16 smithi017 ceph-mon[99370]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:17.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:16 smithi086 ceph-mon[71303]: pgmap v194: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:17.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:16 smithi086 ceph-mon[71303]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:18 smithi017 ceph-mon[99370]: pgmap v195: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:05:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:18 smithi086 ceph-mon[71303]: pgmap v195: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:05:21.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:20 smithi017 ceph-mon[99370]: pgmap v196: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:21.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:20 smithi086 ceph-mon[71303]: pgmap v196: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:23.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:22 smithi017 ceph-mon[99370]: pgmap v197: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:23.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:22 smithi086 ceph-mon[71303]: pgmap v197: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:25.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:24 smithi017 ceph-mon[99370]: pgmap v198: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:24 smithi086 ceph-mon[71303]: pgmap v198: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:27.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:26 smithi017 ceph-mon[99370]: pgmap v199: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:26 smithi086 ceph-mon[71303]: pgmap v199: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:29.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:28 smithi017 ceph-mon[99370]: pgmap v200: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:28 smithi086 ceph-mon[71303]: pgmap v200: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:30 smithi017 ceph-mon[99370]: pgmap v201: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:31.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:30 smithi086 ceph-mon[71303]: pgmap v201: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:33.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:32 smithi017 ceph-mon[99370]: pgmap v202: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:33.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:32 smithi086 ceph-mon[71303]: pgmap v202: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:05:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:05:35.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:34 smithi017 ceph-mon[99370]: pgmap v203: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:35.170 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:34 smithi086 ceph-mon[71303]: pgmap v203: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:36 smithi017 ceph-mon[99370]: pgmap v204: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:37.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:36 smithi086 ceph-mon[71303]: pgmap v204: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:38.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:38 smithi017 ceph-mon[99370]: pgmap v205: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:38 smithi086 ceph-mon[71303]: pgmap v205: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:40 smithi017 ceph-mon[99370]: pgmap v206: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:40 smithi086 ceph-mon[71303]: pgmap v206: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:43.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:42 smithi017 ceph-mon[99370]: pgmap v207: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:42 smithi086 ceph-mon[71303]: pgmap v207: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:45.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:44 smithi017 ceph-mon[99370]: pgmap v208: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:44 smithi086 ceph-mon[71303]: pgmap v208: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.739+0000 7fc5e359e640 1 -- 172.21.15.17:0/414258356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5e40ff940 msgr2=0x7fc5e40ffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.739+0000 7fc5e359e640 1 --2- 172.21.15.17:0/414258356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5e40ff940 0x7fc5e40ffda0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009880 tx=0x7fc5cc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:05:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.740+0000 7fc5e359e640 1 -- 172.21.15.17:0/414258356 shutdown_connections 2024-08-19T01:05:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.740+0000 7fc5e359e640 1 --2- 172.21.15.17:0/414258356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5e40ff940 0x7fc5e40ffda0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.740+0000 7fc5e359e640 1 --2- 172.21.15.17:0/414258356 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e4105940 0x7fc5e4105d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.740+0000 7fc5e359e640 1 -- 172.21.15.17:0/414258356 >> 172.21.15.17:0/414258356 conn(0x7fc5e40fb620 msgr2=0x7fc5e40fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.740+0000 7fc5e359e640 1 -- 172.21.15.17:0/414258356 shutdown_connections 2024-08-19T01:05:45.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.740+0000 7fc5e359e640 1 -- 172.21.15.17:0/414258356 wait complete. 2024-08-19T01:05:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.740+0000 7fc5e359e640 1 Processor -- start 2024-08-19T01:05:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.741+0000 7fc5e359e640 1 -- start start 2024-08-19T01:05:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.741+0000 7fc5e359e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e40ff940 0x7fc5e419b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.741+0000 7fc5e359e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5e4105940 0x7fc5e419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:45.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.741+0000 7fc5e359e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e4195730 con 0x7fc5e4105940 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.741+0000 7fc5e359e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e41958a0 con 0x7fc5e40ff940 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.741+0000 7fc5d9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5e4105940 0x7fc5e419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.741+0000 7fc5d9d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5e4105940 0x7fc5e419bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59662/0 (socket says 172.21.15.17:59662) 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.741+0000 7fc5d9d9b640 1 -- 172.21.15.17:0/99115256 learned_addr learned my addr 172.21.15.17:0/99115256 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.741+0000 7fc5e259c640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e40ff940 0x7fc5e419b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.741+0000 7fc5d9d9b640 1 -- 172.21.15.17:0/99115256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e40ff940 msgr2=0x7fc5e419b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.741+0000 7fc5d9d9b640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e40ff940 0x7fc5e419b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.742+0000 7fc5d9d9b640 1 -- 172.21.15.17:0/99115256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc009560 con 0x7fc5e4105940 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.742+0000 7fc5e259c640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e40ff940 0x7fc5e419b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.742+0000 7fc5d9d9b640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5e4105940 0x7fc5e419bb80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc02a9c0 tx=0x7fc5cc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.742+0000 7fc5dbfff640 1 -- 172.21.15.17:0/99115256 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc004aa0 con 0x7fc5e4105940 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.742+0000 7fc5dbfff640 1 -- 172.21.15.17:0/99115256 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5cc004c00 con 0x7fc5e4105940 2024-08-19T01:05:45.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.742+0000 7fc5e359e640 1 -- 172.21.15.17:0/99115256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e4195b20 con 0x7fc5e4105940 2024-08-19T01:05:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.742+0000 7fc5dbfff640 1 -- 172.21.15.17:0/99115256 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc003980 con 0x7fc5e4105940 2024-08-19T01:05:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.742+0000 7fc5e359e640 1 -- 172.21.15.17:0/99115256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e4196010 con 0x7fc5e4105940 2024-08-19T01:05:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.743+0000 7fc5e359e640 1 -- 172.21.15.17:0/99115256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e4101080 con 0x7fc5e4105940 2024-08-19T01:05:45.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.744+0000 7fc5dbfff640 1 -- 172.21.15.17:0/99115256 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc5cc003b20 con 0x7fc5e4105940 2024-08-19T01:05:45.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.744+0000 7fc5dbfff640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5d006e170 0x7fc5d0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:45.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.744+0000 7fc5dbfff640 1 -- 172.21.15.17:0/99115256 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc5cc0af170 con 0x7fc5e4105940 2024-08-19T01:05:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.744+0000 7fc5e259c640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5d006e170 0x7fc5d0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:45.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.745+0000 7fc5e259c640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5d006e170 0x7fc5d0070630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4005fd0 tx=0x7fc5d400b5f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:45.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.749+0000 7fc5dbfff640 1 -- 172.21.15.17:0/99115256 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc5cc0784d0 con 0x7fc5e4105940 2024-08-19T01:05:45.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.941+0000 7fc5e359e640 1 -- 172.21.15.17:0/99115256 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5e4107f40 con 0x7fc5d006e170 2024-08-19T01:05:45.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.942+0000 7fc5dbfff640 1 -- 172.21.15.17:0/99115256 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc5e4107f40 con 0x7fc5d006e170 2024-08-19T01:05:45.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.944+0000 7fc5e359e640 1 -- 172.21.15.17:0/99115256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5d006e170 msgr2=0x7fc5d0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:45.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.944+0000 7fc5e359e640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5d006e170 0x7fc5d0070630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4005fd0 tx=0x7fc5d400b5f0 comp rx=0 tx=0).stop 2024-08-19T01:05:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.944+0000 7fc5e359e640 1 -- 172.21.15.17:0/99115256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5e4105940 msgr2=0x7fc5e419bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.944+0000 7fc5e359e640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5e4105940 0x7fc5e419bb80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc02a9c0 tx=0x7fc5cc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:05:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.944+0000 7fc5e359e640 1 -- 172.21.15.17:0/99115256 shutdown_connections 2024-08-19T01:05:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.944+0000 7fc5e359e640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5d006e170 0x7fc5d0070630 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.944+0000 7fc5e359e640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5e4105940 0x7fc5e419bb80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.944+0000 7fc5e359e640 1 --2- 172.21.15.17:0/99115256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5e40ff940 0x7fc5e419b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.944+0000 7fc5e359e640 1 -- 172.21.15.17:0/99115256 >> 172.21.15.17:0/99115256 conn(0x7fc5e40fb620 msgr2=0x7fc5e40fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.945+0000 7fc5e359e640 1 -- 172.21.15.17:0/99115256 shutdown_connections 2024-08-19T01:05:45.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:45.945+0000 7fc5e359e640 1 -- 172.21.15.17:0/99115256 wait complete. 2024-08-19T01:05:45.958 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:05:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.028+0000 7f0ed78d7640 1 -- 172.21.15.17:0/3400564538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed00fea30 msgr2=0x7f0ed00fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.028+0000 7f0ed78d7640 1 --2- 172.21.15.17:0/3400564538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed00fea30 0x7f0ed00fee90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009880 tx=0x7f0ec002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.028+0000 7f0ed78d7640 1 -- 172.21.15.17:0/3400564538 shutdown_connections 2024-08-19T01:05:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.028+0000 7f0ed78d7640 1 --2- 172.21.15.17:0/3400564538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed00fea30 0x7f0ed00fee90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.028+0000 7f0ed78d7640 1 --2- 172.21.15.17:0/3400564538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed0104a30 0x7f0ed0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.028+0000 7f0ed78d7640 1 -- 172.21.15.17:0/3400564538 >> 172.21.15.17:0/3400564538 conn(0x7f0ed00fa730 msgr2=0x7f0ed00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.028+0000 7f0ed78d7640 1 -- 172.21.15.17:0/3400564538 shutdown_connections 2024-08-19T01:05:46.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.028+0000 7f0ed78d7640 1 -- 172.21.15.17:0/3400564538 wait complete. 2024-08-19T01:05:46.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.029+0000 7f0ed78d7640 1 Processor -- start 2024-08-19T01:05:46.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.029+0000 7f0ed78d7640 1 -- start start 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.029+0000 7f0ed78d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed00fea30 0x7f0ed00fb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.029+0000 7f0ed78d7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed0104a30 0x7f0ed00fb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.029+0000 7f0ed78d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed00fbaf0 con 0x7f0ed00fea30 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.029+0000 7f0ed78d7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed00fbc60 con 0x7f0ed0104a30 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.029+0000 7f0ed5673640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed00fea30 0x7f0ed00fb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.029+0000 7f0ed5673640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed00fea30 0x7f0ed00fb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59690/0 (socket says 172.21.15.17:59690) 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.029+0000 7f0ed5673640 1 -- 172.21.15.17:0/2295307339 learned_addr learned my addr 172.21.15.17:0/2295307339 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.029+0000 7f0ed4e72640 1 --2- 172.21.15.17:0/2295307339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed0104a30 0x7f0ed00fb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.030+0000 7f0ed5673640 1 -- 172.21.15.17:0/2295307339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed0104a30 msgr2=0x7f0ed00fb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.030+0000 7f0ed5673640 1 --2- 172.21.15.17:0/2295307339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed0104a30 0x7f0ed00fb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.030+0000 7f0ed5673640 1 -- 172.21.15.17:0/2295307339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec0009560 con 0x7f0ed00fea30 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.030+0000 7f0ed5673640 1 --2- 172.21.15.17:0/2295307339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed00fea30 0x7f0ed00fb070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00d6f0 tx=0x7f0ecc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:46.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.030+0000 7f0ec67fc640 1 -- 172.21.15.17:0/2295307339 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ecc009a30 con 0x7f0ed00fea30 2024-08-19T01:05:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.030+0000 7f0ed78d7640 1 -- 172.21.15.17:0/2295307339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed01a1cc0 con 0x7f0ed00fea30 2024-08-19T01:05:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.030+0000 7f0ec67fc640 1 -- 172.21.15.17:0/2295307339 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ecc0054e0 con 0x7f0ed00fea30 2024-08-19T01:05:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.030+0000 7f0ed78d7640 1 -- 172.21.15.17:0/2295307339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed01a2020 con 0x7f0ed00fea30 2024-08-19T01:05:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.030+0000 7f0ec67fc640 1 -- 172.21.15.17:0/2295307339 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ecc010460 con 0x7f0ed00fea30 2024-08-19T01:05:46.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.031+0000 7f0ed78d7640 1 -- 172.21.15.17:0/2295307339 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb4005250 con 0x7f0ed00fea30 2024-08-19T01:05:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.032+0000 7f0ec67fc640 1 -- 172.21.15.17:0/2295307339 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0ecc0046c0 con 0x7f0ed00fea30 2024-08-19T01:05:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.032+0000 7f0ec67fc640 1 --2- 172.21.15.17:0/2295307339 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ebc06e170 0x7f0ebc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.032+0000 7f0ec67fc640 1 -- 172.21.15.17:0/2295307339 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0ecc08da50 con 0x7f0ed00fea30 2024-08-19T01:05:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.032+0000 7f0ed4e72640 1 --2- 172.21.15.17:0/2295307339 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ebc06e170 0x7f0ebc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.033+0000 7f0ed4e72640 1 --2- 172.21.15.17:0/2295307339 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ebc06e170 0x7f0ebc070630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009230 tx=0x7f0ec00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:46.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.037+0000 7f0ec67fc640 1 -- 172.21.15.17:0/2295307339 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0ecc056e60 con 0x7f0ed00fea30 2024-08-19T01:05:46.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.232+0000 7f0ed78d7640 1 -- 172.21.15.17:0/2295307339 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0eb4000bc0 con 0x7f0ebc06e170 2024-08-19T01:05:46.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.233+0000 7f0ec67fc640 1 -- 172.21.15.17:0/2295307339 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0eb4000bc0 con 0x7f0ebc06e170 2024-08-19T01:05:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.235+0000 7f0ed78d7640 1 -- 172.21.15.17:0/2295307339 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ebc06e170 msgr2=0x7f0ebc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.235+0000 7f0ed78d7640 1 --2- 172.21.15.17:0/2295307339 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ebc06e170 0x7f0ebc070630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009230 tx=0x7f0ec00058d0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.235+0000 7f0ed78d7640 1 -- 172.21.15.17:0/2295307339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed00fea30 msgr2=0x7f0ed00fb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.235+0000 7f0ed78d7640 1 --2- 172.21.15.17:0/2295307339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed00fea30 0x7f0ed00fb070 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00d6f0 tx=0x7f0ecc00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.235+0000 7f0ed78d7640 1 -- 172.21.15.17:0/2295307339 shutdown_connections 2024-08-19T01:05:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.235+0000 7f0ed78d7640 1 --2- 172.21.15.17:0/2295307339 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ebc06e170 0x7f0ebc070630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.235+0000 7f0ed78d7640 1 --2- 172.21.15.17:0/2295307339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ed0104a30 0x7f0ed00fb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.235+0000 7f0ed78d7640 1 --2- 172.21.15.17:0/2295307339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed00fea30 0x7f0ed00fb070 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.235+0000 7f0ed78d7640 1 -- 172.21.15.17:0/2295307339 >> 172.21.15.17:0/2295307339 conn(0x7f0ed00fa730 msgr2=0x7f0ed0068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.235+0000 7f0ed78d7640 1 -- 172.21.15.17:0/2295307339 shutdown_connections 2024-08-19T01:05:46.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.235+0000 7f0ed78d7640 1 -- 172.21.15.17:0/2295307339 wait complete. 2024-08-19T01:05:46.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.317+0000 7f83238fb640 1 -- 172.21.15.17:0/2626165651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831c100750 msgr2=0x7f831c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.317+0000 7f83238fb640 1 --2- 172.21.15.17:0/2626165651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831c100750 0x7f831c1047a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f830c009880 tx=0x7f830c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.317+0000 7f83238fb640 1 -- 172.21.15.17:0/2626165651 shutdown_connections 2024-08-19T01:05:46.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.317+0000 7f83238fb640 1 --2- 172.21.15.17:0/2626165651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831c100750 0x7f831c1047a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.317+0000 7f83238fb640 1 --2- 172.21.15.17:0/2626165651 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f831c0ffda0 0x7f831c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.317+0000 7f83238fb640 1 -- 172.21.15.17:0/2626165651 >> 172.21.15.17:0/2626165651 conn(0x7f831c0fb840 msgr2=0x7f831c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:46.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.317+0000 7f83238fb640 1 -- 172.21.15.17:0/2626165651 shutdown_connections 2024-08-19T01:05:46.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.317+0000 7f83238fb640 1 -- 172.21.15.17:0/2626165651 wait complete. 2024-08-19T01:05:46.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f83238fb640 1 Processor -- start 2024-08-19T01:05:46.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f83238fb640 1 -- start start 2024-08-19T01:05:46.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f83238fb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831c0ffda0 0x7f831c19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f83238fb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f831c100750 0x7f831c19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f83238fb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c195930 con 0x7f831c0ffda0 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f83238fb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c195a70 con 0x7f831c100750 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f8321697640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831c0ffda0 0x7f831c19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f8321697640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831c0ffda0 0x7f831c19b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59722/0 (socket says 172.21.15.17:59722) 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f8321697640 1 -- 172.21.15.17:0/1276825535 learned_addr learned my addr 172.21.15.17:0/1276825535 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f8321697640 1 -- 172.21.15.17:0/1276825535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f831c100750 msgr2=0x7f831c19be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f8320e96640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f831c100750 0x7f831c19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f8321697640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f831c100750 0x7f831c19be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f8321697640 1 -- 172.21.15.17:0/1276825535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c009560 con 0x7f831c0ffda0 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.318+0000 7f8320e96640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f831c100750 0x7f831c19be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.319+0000 7f8321697640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831c0ffda0 0x7f831c19b8d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f831800d6f0 tx=0x7f831800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:46.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.319+0000 7f83127fc640 1 -- 172.21.15.17:0/1276825535 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8318009a30 con 0x7f831c0ffda0 2024-08-19T01:05:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.319+0000 7f83238fb640 1 -- 172.21.15.17:0/1276825535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c195d50 con 0x7f831c0ffda0 2024-08-19T01:05:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.319+0000 7f83238fb640 1 -- 172.21.15.17:0/1276825535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c1962a0 con 0x7f831c0ffda0 2024-08-19T01:05:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.319+0000 7f83127fc640 1 -- 172.21.15.17:0/1276825535 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83180054e0 con 0x7f831c0ffda0 2024-08-19T01:05:46.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.319+0000 7f83127fc640 1 -- 172.21.15.17:0/1276825535 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8318010460 con 0x7f831c0ffda0 2024-08-19T01:05:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.320+0000 7f83238fb640 1 -- 172.21.15.17:0/1276825535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8300005250 con 0x7f831c0ffda0 2024-08-19T01:05:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.320+0000 7f83127fc640 1 -- 172.21.15.17:0/1276825535 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f83180046c0 con 0x7f831c0ffda0 2024-08-19T01:05:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.321+0000 7f83127fc640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f830806e170 0x7f8308070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.321+0000 7f83127fc640 1 -- 172.21.15.17:0/1276825535 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f831808db00 con 0x7f831c0ffda0 2024-08-19T01:05:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.321+0000 7f8320e96640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f830806e170 0x7f8308070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.322+0000 7f8320e96640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f830806e170 0x7f8308070630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f830c006010 tx=0x7f830c005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:46.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.325+0000 7f83127fc640 1 -- 172.21.15.17:0/1276825535 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8318056e60 con 0x7f831c0ffda0 2024-08-19T01:05:46.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.508+0000 7f83238fb640 1 -- 172.21.15.17:0/1276825535 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8300000bc0 con 0x7f830806e170 2024-08-19T01:05:46.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.518+0000 7f83127fc640 1 -- 172.21.15.17:0/1276825535 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f8300000bc0 con 0x7f830806e170 2024-08-19T01:05:46.520 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:05:46.520 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (7m) 57s ago 17m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:05:46.520 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (17m) 57s ago 17m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:05:46.520 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (16m) 43s ago 16m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:05:46.520 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (4m) 57s ago 17m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:05:46.520 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (4m) 43s ago 16m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:05:46.520 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (6m) 57s ago 17m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:05:46.520 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (62s) 57s ago 12m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:05:46.520 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (79s) 57s ago 12m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (12m) 43s ago 12m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (46s) 43s ago 12m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (9m) 57s ago 19m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (7m) 43s ago 16m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (5m) 57s ago 19m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (5m) 43s ago 16m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (7m) 57s ago 17m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (7m) 43s ago 16m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (4m) 57s ago 15m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (3m) 57s ago 15m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (3m) 57s ago 15m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (2m) 43s ago 14m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:05:46.521 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (2m) 43s ago 14m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:05:46.522 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (97s) 43s ago 13m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:05:46.522 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (7m) 57s ago 17m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:05:46.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.520+0000 7f83238fb640 1 -- 172.21.15.17:0/1276825535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f830806e170 msgr2=0x7f8308070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.520+0000 7f83238fb640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f830806e170 0x7f8308070630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f830c006010 tx=0x7f830c005e60 comp rx=0 tx=0).stop 2024-08-19T01:05:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.520+0000 7f83238fb640 1 -- 172.21.15.17:0/1276825535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831c0ffda0 msgr2=0x7f831c19b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.520+0000 7f83238fb640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831c0ffda0 0x7f831c19b8d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f831800d6f0 tx=0x7f831800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.520+0000 7f83238fb640 1 -- 172.21.15.17:0/1276825535 shutdown_connections 2024-08-19T01:05:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.520+0000 7f83238fb640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f830806e170 0x7f8308070630 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.520+0000 7f83238fb640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f831c100750 0x7f831c19be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.520+0000 7f83238fb640 1 --2- 172.21.15.17:0/1276825535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f831c0ffda0 0x7f831c19b8d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.520+0000 7f83238fb640 1 -- 172.21.15.17:0/1276825535 >> 172.21.15.17:0/1276825535 conn(0x7f831c0fb840 msgr2=0x7f831c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.520+0000 7f83238fb640 1 -- 172.21.15.17:0/1276825535 shutdown_connections 2024-08-19T01:05:46.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.520+0000 7f83238fb640 1 -- 172.21.15.17:0/1276825535 wait complete. 2024-08-19T01:05:46.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.601+0000 7f9e15038640 1 -- 172.21.15.17:0/2559292691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100ff230 msgr2=0x7f9e1010bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.601+0000 7f9e15038640 1 --2- 172.21.15.17:0/2559292691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100ff230 0x7f9e1010bef0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009880 tx=0x7f9e0002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.601+0000 7f9e15038640 1 -- 172.21.15.17:0/2559292691 shutdown_connections 2024-08-19T01:05:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.601+0000 7f9e15038640 1 --2- 172.21.15.17:0/2559292691 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100ff230 0x7f9e1010bef0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.601+0000 7f9e15038640 1 --2- 172.21.15.17:0/2559292691 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e100fe880 0x7f9e100fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.601+0000 7f9e15038640 1 -- 172.21.15.17:0/2559292691 >> 172.21.15.17:0/2559292691 conn(0x7f9e100fa730 msgr2=0x7f9e100fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.601+0000 7f9e15038640 1 -- 172.21.15.17:0/2559292691 shutdown_connections 2024-08-19T01:05:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.601+0000 7f9e15038640 1 -- 172.21.15.17:0/2559292691 wait complete. 2024-08-19T01:05:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.602+0000 7f9e15038640 1 Processor -- start 2024-08-19T01:05:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.602+0000 7f9e15038640 1 -- start start 2024-08-19T01:05:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.602+0000 7f9e15038640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe880 0x7f9e10197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.602+0000 7f9e15038640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e100ff230 0x7f9e101981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.602+0000 7f9e15038640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e101988d0 con 0x7f9e100fe880 2024-08-19T01:05:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.602+0000 7f9e15038640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1019b540 con 0x7f9e100ff230 2024-08-19T01:05:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9e0ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe880 0x7f9e10197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9e0ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe880 0x7f9e10197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59732/0 (socket says 172.21.15.17:59732) 2024-08-19T01:05:46.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9e0ed9d640 1 -- 172.21.15.17:0/1831345780 learned_addr learned my addr 172.21.15.17:0/1831345780 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9e0e59c640 1 --2- 172.21.15.17:0/1831345780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e100ff230 0x7f9e101981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9e0ed9d640 1 -- 172.21.15.17:0/1831345780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e100ff230 msgr2=0x7f9e101981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9e0ed9d640 1 --2- 172.21.15.17:0/1831345780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e100ff230 0x7f9e101981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9e0ed9d640 1 -- 172.21.15.17:0/1831345780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00009560 con 0x7f9e100fe880 2024-08-19T01:05:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9e0ed9d640 1 --2- 172.21.15.17:0/1831345780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe880 0x7f9e10197cb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400d8d0 tx=0x7f9e0400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9df7fff640 1 -- 172.21.15.17:0/1831345780 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0400bea0 con 0x7f9e100fe880 2024-08-19T01:05:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9df7fff640 1 -- 172.21.15.17:0/1831345780 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e04009c00 con 0x7f9e100fe880 2024-08-19T01:05:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9e15038640 1 -- 172.21.15.17:0/1831345780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1019b820 con 0x7f9e100fe880 2024-08-19T01:05:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9df7fff640 1 -- 172.21.15.17:0/1831345780 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0400f710 con 0x7f9e100fe880 2024-08-19T01:05:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.603+0000 7f9e15038640 1 -- 172.21.15.17:0/1831345780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1019bd40 con 0x7f9e100fe880 2024-08-19T01:05:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.604+0000 7f9e15038640 1 -- 172.21.15.17:0/1831345780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e10068d30 con 0x7f9e100fe880 2024-08-19T01:05:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.606+0000 7f9df7fff640 1 -- 172.21.15.17:0/1831345780 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9e0400f990 con 0x7f9e100fe880 2024-08-19T01:05:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.606+0000 7f9df7fff640 1 --2- 172.21.15.17:0/1831345780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9df806e170 0x7f9df8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.606+0000 7f9df7fff640 1 -- 172.21.15.17:0/1831345780 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9e0408de70 con 0x7f9e100fe880 2024-08-19T01:05:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.606+0000 7f9e0e59c640 1 --2- 172.21.15.17:0/1831345780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9df806e170 0x7f9df8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.607+0000 7f9e0e59c640 1 --2- 172.21.15.17:0/1831345780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9df806e170 0x7f9df8070630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009230 tx=0x7f9e000058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:46.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.611+0000 7f9df7fff640 1 -- 172.21.15.17:0/1831345780 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9e04057200 con 0x7f9e100fe880 2024-08-19T01:05:46.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.854+0000 7f9e15038640 1 -- 172.21.15.17:0/1831345780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9e101066f0 con 0x7f9e100fe880 2024-08-19T01:05:46.856 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:46 smithi017 ceph-mon[99370]: pgmap v209: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:46.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.854+0000 7f9df7fff640 1 -- 172.21.15.17:0/1831345780 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f9e0405a8c0 con 0x7f9e100fe880 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:05:46.857 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:05:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:05:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:05:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:05:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:05:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:05:46.858 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:05:46.858 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:05:46.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.856+0000 7f9e15038640 1 -- 172.21.15.17:0/1831345780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9df806e170 msgr2=0x7f9df8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.856+0000 7f9e15038640 1 --2- 172.21.15.17:0/1831345780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9df806e170 0x7f9df8070630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009230 tx=0x7f9e000058d0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.856+0000 7f9e15038640 1 -- 172.21.15.17:0/1831345780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe880 msgr2=0x7f9e10197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.856+0000 7f9e15038640 1 --2- 172.21.15.17:0/1831345780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe880 0x7f9e10197cb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400d8d0 tx=0x7f9e0400dd90 comp rx=0 tx=0).stop 2024-08-19T01:05:46.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.856+0000 7f9e15038640 1 -- 172.21.15.17:0/1831345780 shutdown_connections 2024-08-19T01:05:46.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.856+0000 7f9e15038640 1 --2- 172.21.15.17:0/1831345780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9df806e170 0x7f9df8070630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.856+0000 7f9e15038640 1 --2- 172.21.15.17:0/1831345780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9e100ff230 0x7f9e101981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.856+0000 7f9e15038640 1 --2- 172.21.15.17:0/1831345780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9e100fe880 0x7f9e10197cb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.856+0000 7f9e15038640 1 -- 172.21.15.17:0/1831345780 >> 172.21.15.17:0/1831345780 conn(0x7f9e100fa730 msgr2=0x7f9e100fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:46.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.856+0000 7f9e15038640 1 -- 172.21.15.17:0/1831345780 shutdown_connections 2024-08-19T01:05:46.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.856+0000 7f9e15038640 1 -- 172.21.15.17:0/1831345780 wait complete. 2024-08-19T01:05:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.938+0000 7f5046427640 1 -- 172.21.15.17:0/343170482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040104a30 msgr2=0x7f5040104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.938+0000 7f5046427640 1 --2- 172.21.15.17:0/343170482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040104a30 0x7f5040104e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5030009880 tx=0x7f503002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.938+0000 7f5046427640 1 -- 172.21.15.17:0/343170482 shutdown_connections 2024-08-19T01:05:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.938+0000 7f5046427640 1 --2- 172.21.15.17:0/343170482 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50400fea30 0x7f50400fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.938+0000 7f5046427640 1 --2- 172.21.15.17:0/343170482 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040104a30 0x7f5040104e10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.938+0000 7f5046427640 1 -- 172.21.15.17:0/343170482 >> 172.21.15.17:0/343170482 conn(0x7f50400fa730 msgr2=0x7f50400fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.938+0000 7f5046427640 1 -- 172.21.15.17:0/343170482 shutdown_connections 2024-08-19T01:05:46.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.938+0000 7f5046427640 1 -- 172.21.15.17:0/343170482 wait complete. 2024-08-19T01:05:46.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f5046427640 1 Processor -- start 2024-08-19T01:05:46.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f5046427640 1 -- start start 2024-08-19T01:05:46.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f5046427640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50400fea30 0x7f5040105960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f5046427640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040104a30 0x7f5040105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f5046427640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50401063e0 con 0x7f5040104a30 2024-08-19T01:05:46.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f5046427640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5040106520 con 0x7f50400fea30 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f503f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040104a30 0x7f5040105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f503f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040104a30 0x7f5040105ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38194/0 (socket says 172.21.15.17:38194) 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f503f7fe640 1 -- 172.21.15.17:0/1855059793 learned_addr learned my addr 172.21.15.17:0/1855059793 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f503ffff640 1 --2- 172.21.15.17:0/1855059793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50400fea30 0x7f5040105960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f503f7fe640 1 -- 172.21.15.17:0/1855059793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50400fea30 msgr2=0x7f5040105960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f503f7fe640 1 --2- 172.21.15.17:0/1855059793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50400fea30 0x7f5040105960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.939+0000 7f503f7fe640 1 -- 172.21.15.17:0/1855059793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5030009560 con 0x7f5040104a30 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.940+0000 7f503f7fe640 1 --2- 172.21.15.17:0/1855059793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040104a30 0x7f5040105ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f503400d8d0 tx=0x7f503400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.940+0000 7f503d7fa640 1 -- 172.21.15.17:0/1855059793 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5034009c00 con 0x7f5040104a30 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.940+0000 7f503d7fa640 1 -- 172.21.15.17:0/1855059793 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5034009d60 con 0x7f5040104a30 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.940+0000 7f5046427640 1 -- 172.21.15.17:0/1855059793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50401a1c30 con 0x7f5040104a30 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.940+0000 7f503d7fa640 1 -- 172.21.15.17:0/1855059793 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50340049d0 con 0x7f5040104a30 2024-08-19T01:05:46.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.940+0000 7f5046427640 1 -- 172.21.15.17:0/1855059793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50401a2040 con 0x7f5040104a30 2024-08-19T01:05:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.941+0000 7f5046427640 1 -- 172.21.15.17:0/1855059793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5040100170 con 0x7f5040104a30 2024-08-19T01:05:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.941+0000 7f503d7fa640 1 -- 172.21.15.17:0/1855059793 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5034004c40 con 0x7f5040104a30 2024-08-19T01:05:46.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.942+0000 7f503d7fa640 1 --2- 172.21.15.17:0/1855059793 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502806e170 0x7f5028070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.942+0000 7f503d7fa640 1 -- 172.21.15.17:0/1855059793 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f503408dda0 con 0x7f5040104a30 2024-08-19T01:05:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.942+0000 7f503ffff640 1 --2- 172.21.15.17:0/1855059793 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502806e170 0x7f5028070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:46.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.943+0000 7f503ffff640 1 --2- 172.21.15.17:0/1855059793 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502806e170 0x7f5028070630 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5030009230 tx=0x7f50300058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:46.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:46.947+0000 7f503d7fa640 1 -- 172.21.15.17:0/1855059793 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5034057100 con 0x7f5040104a30 2024-08-19T01:05:47.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.157+0000 7f5046427640 1 -- 172.21.15.17:0/1855059793 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f504010bd60 con 0x7f5040104a30 2024-08-19T01:05:47.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.157+0000 7f503d7fa640 1 -- 172.21.15.17:0/1855059793 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f5034017070 con 0x7f5040104a30 2024-08-19T01:05:47.160 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:05:47.160 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:05:47.160 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:05:47.160 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:05:47.160 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:05:47.160 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:05:47.160 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:05:47.160 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:05:47.160 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:05:47.160 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:05:47.160 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:05:47.161 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:05:47.161 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:05:47.161 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:05:47.161 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:05:47.161 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:05:47.161 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:05:47.161 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:05:47.161 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:05:47.161 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:05:47.162 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:05:47.162 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:05:47.162 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:05:47.162 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:05:47.163 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:05:47.163 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:05:47.163 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:05:47.163 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:05:47.163 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:05:47.163 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:05:47.164 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:05:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:05:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.159+0000 7f5046427640 1 -- 172.21.15.17:0/1855059793 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502806e170 msgr2=0x7f5028070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:47.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.159+0000 7f5046427640 1 --2- 172.21.15.17:0/1855059793 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502806e170 0x7f5028070630 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5030009230 tx=0x7f50300058d0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.159+0000 7f5046427640 1 -- 172.21.15.17:0/1855059793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040104a30 msgr2=0x7f5040105ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.159+0000 7f5046427640 1 --2- 172.21.15.17:0/1855059793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040104a30 0x7f5040105ea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f503400d8d0 tx=0x7f503400dd90 comp rx=0 tx=0).stop 2024-08-19T01:05:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.160+0000 7f5046427640 1 -- 172.21.15.17:0/1855059793 shutdown_connections 2024-08-19T01:05:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.160+0000 7f5046427640 1 --2- 172.21.15.17:0/1855059793 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502806e170 0x7f5028070630 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.160+0000 7f5046427640 1 --2- 172.21.15.17:0/1855059793 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040104a30 0x7f5040105ea0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.160+0000 7f5046427640 1 --2- 172.21.15.17:0/1855059793 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f50400fea30 0x7f5040105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.160+0000 7f5046427640 1 -- 172.21.15.17:0/1855059793 >> 172.21.15.17:0/1855059793 conn(0x7f50400fa730 msgr2=0x7f5040068770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.160+0000 7f5046427640 1 -- 172.21.15.17:0/1855059793 shutdown_connections 2024-08-19T01:05:47.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.160+0000 7f5046427640 1 -- 172.21.15.17:0/1855059793 wait complete. 2024-08-19T01:05:47.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:46 smithi086 ceph-mon[71303]: pgmap v209: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:47.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.243+0000 7fe224cda640 1 -- 172.21.15.17:0/3570234015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe220100d90 msgr2=0x7fe220101170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.243+0000 7fe224cda640 1 --2- 172.21.15.17:0/3570234015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe220100d90 0x7fe220101170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe2100098b0 tx=0x7fe21002a4d0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.243+0000 7fe224cda640 1 -- 172.21.15.17:0/3570234015 shutdown_connections 2024-08-19T01:05:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.243+0000 7fe224cda640 1 --2- 172.21.15.17:0/3570234015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2201016b0 0x7fe220109ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.243+0000 7fe224cda640 1 --2- 172.21.15.17:0/3570234015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe220100d90 0x7fe220101170 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.243+0000 7fe224cda640 1 -- 172.21.15.17:0/3570234015 >> 172.21.15.17:0/3570234015 conn(0x7fe2200fa730 msgr2=0x7fe2200fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.243+0000 7fe224cda640 1 -- 172.21.15.17:0/3570234015 shutdown_connections 2024-08-19T01:05:47.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.243+0000 7fe224cda640 1 -- 172.21.15.17:0/3570234015 wait complete. 2024-08-19T01:05:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.244+0000 7fe224cda640 1 Processor -- start 2024-08-19T01:05:47.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.244+0000 7fe224cda640 1 -- start start 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.244+0000 7fe224cda640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe220100d90 0x7fe22019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.244+0000 7fe224cda640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2201016b0 0x7fe22019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.244+0000 7fe224cda640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22019c3c0 con 0x7fe220100d90 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.244+0000 7fe224cda640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220195950 con 0x7fe2201016b0 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe21e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe220100d90 0x7fe22019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe21e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe220100d90 0x7fe22019b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38204/0 (socket says 172.21.15.17:38204) 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe21e59c640 1 -- 172.21.15.17:0/4040838946 learned_addr learned my addr 172.21.15.17:0/4040838946 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe217fff640 1 --2- 172.21.15.17:0/4040838946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2201016b0 0x7fe22019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe21e59c640 1 -- 172.21.15.17:0/4040838946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2201016b0 msgr2=0x7fe22019bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe21e59c640 1 --2- 172.21.15.17:0/4040838946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2201016b0 0x7fe22019bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe21e59c640 1 -- 172.21.15.17:0/4040838946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe210009560 con 0x7fe220100d90 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe21e59c640 1 --2- 172.21.15.17:0/4040838946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe220100d90 0x7fe22019b860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe210006010 tx=0x7fe2100055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:47.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe2177fe640 1 -- 172.21.15.17:0/4040838946 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2100048d0 con 0x7fe220100d90 2024-08-19T01:05:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe2177fe640 1 -- 172.21.15.17:0/4040838946 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe210031640 con 0x7fe220100d90 2024-08-19T01:05:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe224cda640 1 -- 172.21.15.17:0/4040838946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe220195bd0 con 0x7fe220100d90 2024-08-19T01:05:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe224cda640 1 -- 172.21.15.17:0/4040838946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2201960c0 con 0x7fe220100d90 2024-08-19T01:05:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.245+0000 7fe2177fe640 1 -- 172.21.15.17:0/4040838946 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe210003800 con 0x7fe220100d90 2024-08-19T01:05:47.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.247+0000 7fe224cda640 1 -- 172.21.15.17:0/4040838946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe220068c90 con 0x7fe220100d90 2024-08-19T01:05:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.247+0000 7fe2177fe640 1 -- 172.21.15.17:0/4040838946 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe210003ab0 con 0x7fe220100d90 2024-08-19T01:05:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.247+0000 7fe2177fe640 1 --2- 172.21.15.17:0/4040838946 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe20c06e170 0x7fe20c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.247+0000 7fe2177fe640 1 -- 172.21.15.17:0/4040838946 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe2100af050 con 0x7fe220100d90 2024-08-19T01:05:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.247+0000 7fe217fff640 1 --2- 172.21.15.17:0/4040838946 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe20c06e170 0x7fe20c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:47.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.248+0000 7fe217fff640 1 --2- 172.21.15.17:0/4040838946 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe20c06e170 0x7fe20c070630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe220196dc0 tx=0x7fe208005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:47.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.252+0000 7fe2177fe640 1 -- 172.21.15.17:0/4040838946 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe2100784d0 con 0x7fe220100d90 2024-08-19T01:05:47.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.444+0000 7fe224cda640 1 -- 172.21.15.17:0/4040838946 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe220104400 con 0x7fe20c06e170 2024-08-19T01:05:47.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.445+0000 7fe2177fe640 1 -- 172.21.15.17:0/4040838946 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe220104400 con 0x7fe20c06e170 2024-08-19T01:05:47.447 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:05:47.448 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:05:47.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.447+0000 7fe224cda640 1 -- 172.21.15.17:0/4040838946 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe20c06e170 msgr2=0x7fe20c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:47.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.447+0000 7fe224cda640 1 --2- 172.21.15.17:0/4040838946 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe20c06e170 0x7fe20c070630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe220196dc0 tx=0x7fe208005f90 comp rx=0 tx=0).stop 2024-08-19T01:05:47.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.447+0000 7fe224cda640 1 -- 172.21.15.17:0/4040838946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe220100d90 msgr2=0x7fe22019b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:47.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.447+0000 7fe224cda640 1 --2- 172.21.15.17:0/4040838946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe220100d90 0x7fe22019b860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe210006010 tx=0x7fe2100055a0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.447+0000 7fe224cda640 1 -- 172.21.15.17:0/4040838946 shutdown_connections 2024-08-19T01:05:47.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.447+0000 7fe224cda640 1 --2- 172.21.15.17:0/4040838946 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe20c06e170 0x7fe20c070630 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.447+0000 7fe224cda640 1 --2- 172.21.15.17:0/4040838946 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe2201016b0 0x7fe22019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.447+0000 7fe224cda640 1 --2- 172.21.15.17:0/4040838946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe220100d90 0x7fe22019b860 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.447+0000 7fe224cda640 1 -- 172.21.15.17:0/4040838946 >> 172.21.15.17:0/4040838946 conn(0x7fe2200fa730 msgr2=0x7fe220102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.447+0000 7fe224cda640 1 -- 172.21.15.17:0/4040838946 shutdown_connections 2024-08-19T01:05:47.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.447+0000 7fe224cda640 1 -- 172.21.15.17:0/4040838946 wait complete. 2024-08-19T01:05:47.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.530+0000 7fae1df59640 1 -- 172.21.15.17:0/2343860640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae18104a10 msgr2=0x7fae18104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:47.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.530+0000 7fae1df59640 1 --2- 172.21.15.17:0/2343860640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae18104a10 0x7fae18104df0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fae08009880 tx=0x7fae0802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.530+0000 7fae1df59640 1 -- 172.21.15.17:0/2343860640 shutdown_connections 2024-08-19T01:05:47.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.530+0000 7fae1df59640 1 --2- 172.21.15.17:0/2343860640 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae180fea10 0x7fae180fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.530+0000 7fae1df59640 1 --2- 172.21.15.17:0/2343860640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae18104a10 0x7fae18104df0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.530+0000 7fae1df59640 1 -- 172.21.15.17:0/2343860640 >> 172.21.15.17:0/2343860640 conn(0x7fae180fa730 msgr2=0x7fae180fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:47.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.530+0000 7fae1df59640 1 -- 172.21.15.17:0/2343860640 shutdown_connections 2024-08-19T01:05:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.530+0000 7fae1df59640 1 -- 172.21.15.17:0/2343860640 wait complete. 2024-08-19T01:05:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.531+0000 7fae1df59640 1 Processor -- start 2024-08-19T01:05:47.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.531+0000 7fae1df59640 1 -- start start 2024-08-19T01:05:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.531+0000 7fae1df59640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae180fea10 0x7fae18105940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.531+0000 7fae1df59640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae18104a10 0x7fae18105e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:47.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.531+0000 7fae1df59640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae18107910 con 0x7fae180fea10 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.531+0000 7fae1df59640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae181063c0 con 0x7fae18104a10 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae180fea10 0x7fae18105940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae180fea10 0x7fae18105940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38216/0 (socket says 172.21.15.17:38216) 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae177fe640 1 -- 172.21.15.17:0/3342013152 learned_addr learned my addr 172.21.15.17:0/3342013152 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae0effd640 1 --2- 172.21.15.17:0/3342013152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae18104a10 0x7fae18105e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae177fe640 1 -- 172.21.15.17:0/3342013152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae18104a10 msgr2=0x7fae18105e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae177fe640 1 --2- 172.21.15.17:0/3342013152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae18104a10 0x7fae18105e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae177fe640 1 -- 172.21.15.17:0/3342013152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08009560 con 0x7fae180fea10 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae177fe640 1 --2- 172.21.15.17:0/3342013152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae180fea10 0x7fae18105940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fae08006010 tx=0x7fae080055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae157fa640 1 -- 172.21.15.17:0/3342013152 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae08004aa0 con 0x7fae180fea10 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae1df59640 1 -- 172.21.15.17:0/3342013152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae18106640 con 0x7fae180fea10 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae157fa640 1 -- 172.21.15.17:0/3342013152 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae08004c00 con 0x7fae180fea10 2024-08-19T01:05:47.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae157fa640 1 -- 172.21.15.17:0/3342013152 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae08003a20 con 0x7fae180fea10 2024-08-19T01:05:47.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.532+0000 7fae1df59640 1 -- 172.21.15.17:0/3342013152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae181a1e60 con 0x7fae180fea10 2024-08-19T01:05:47.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.533+0000 7fae1df59640 1 -- 172.21.15.17:0/3342013152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae18100150 con 0x7fae180fea10 2024-08-19T01:05:47.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.534+0000 7fae157fa640 1 -- 172.21.15.17:0/3342013152 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fae08031c90 con 0x7fae180fea10 2024-08-19T01:05:47.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.534+0000 7fae157fa640 1 --2- 172.21.15.17:0/3342013152 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0406e180 0x7fae04070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:05:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.534+0000 7fae157fa640 1 -- 172.21.15.17:0/3342013152 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fae080af420 con 0x7fae180fea10 2024-08-19T01:05:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.534+0000 7fae0effd640 1 --2- 172.21.15.17:0/3342013152 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0406e180 0x7fae04070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:05:47.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.535+0000 7fae0effd640 1 --2- 172.21.15.17:0/3342013152 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0406e180 0x7fae04070640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fae181070c0 tx=0x7fae00005cc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:05:47.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.539+0000 7fae157fa640 1 -- 172.21.15.17:0/3342013152 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fae08078660 con 0x7fae180fea10 2024-08-19T01:05:47.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.789+0000 7fae1df59640 1 -- 172.21.15.17:0/3342013152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fae1810bc80 con 0x7fae180fea10 2024-08-19T01:05:47.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.789+0000 7fae157fa640 1 -- 172.21.15.17:0/3342013152 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7fae0807bd20 con 0x7fae180fea10 2024-08-19T01:05:47.796 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:05:47.796 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:05:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:05:47.796 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:05:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:05:47.796 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:05:47.796 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:05:47.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.791+0000 7fae1df59640 1 -- 172.21.15.17:0/3342013152 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0406e180 msgr2=0x7fae04070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:47.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.791+0000 7fae1df59640 1 --2- 172.21.15.17:0/3342013152 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0406e180 0x7fae04070640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fae181070c0 tx=0x7fae00005cc0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.791+0000 7fae1df59640 1 -- 172.21.15.17:0/3342013152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae180fea10 msgr2=0x7fae18105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:05:47.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.791+0000 7fae1df59640 1 --2- 172.21.15.17:0/3342013152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae180fea10 0x7fae18105940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fae08006010 tx=0x7fae080055a0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.791+0000 7fae1df59640 1 -- 172.21.15.17:0/3342013152 shutdown_connections 2024-08-19T01:05:47.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.791+0000 7fae1df59640 1 --2- 172.21.15.17:0/3342013152 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0406e180 0x7fae04070640 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.791+0000 7fae1df59640 1 --2- 172.21.15.17:0/3342013152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae18104a10 0x7fae18105e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.791+0000 7fae1df59640 1 --2- 172.21.15.17:0/3342013152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae180fea10 0x7fae18105940 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:05:47.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.792+0000 7fae1df59640 1 -- 172.21.15.17:0/3342013152 >> 172.21.15.17:0/3342013152 conn(0x7fae180fa730 msgr2=0x7fae18068780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:05:47.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.792+0000 7fae1df59640 1 -- 172.21.15.17:0/3342013152 shutdown_connections 2024-08-19T01:05:47.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:05:47.792+0000 7fae1df59640 1 -- 172.21.15.17:0/3342013152 wait complete. 2024-08-19T01:05:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:47 smithi017 ceph-mon[99370]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:47 smithi017 ceph-mon[99370]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:47 smithi017 ceph-mon[99370]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:47 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1831345780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:05:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:47 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1855059793' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:05:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:47 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3342013152' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:05:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:47 smithi086 ceph-mon[71303]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:47 smithi086 ceph-mon[71303]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:47 smithi086 ceph-mon[71303]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:47 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1831345780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:05:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:47 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1855059793' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:05:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:47 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3342013152' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:05:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:48 smithi017 ceph-mon[99370]: pgmap v210: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:48 smithi017 ceph-mon[99370]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:05:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:48 smithi086 ceph-mon[71303]: pgmap v210: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:48 smithi086 ceph-mon[71303]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:05:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:05:51.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:50 smithi017 ceph-mon[99370]: pgmap v211: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:51.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:50 smithi086 ceph-mon[71303]: pgmap v211: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:53.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:52 smithi017 ceph-mon[99370]: pgmap v212: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:53.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:52 smithi086 ceph-mon[71303]: pgmap v212: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:55.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:54 smithi017 ceph-mon[99370]: pgmap v213: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:54 smithi086 ceph-mon[71303]: pgmap v213: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:57.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:56 smithi017 ceph-mon[99370]: pgmap v214: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:57.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:56 smithi086 ceph-mon[71303]: pgmap v214: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:59.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:05:58 smithi017 ceph-mon[99370]: pgmap v215: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:05:59.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:05:58 smithi086 ceph-mon[71303]: pgmap v215: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:00 smithi086 ceph-mon[71303]: pgmap v216: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:01.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:00 smithi017 ceph-mon[99370]: pgmap v216: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:03.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:02 smithi017 ceph-mon[99370]: pgmap v217: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:02 smithi086 ceph-mon[71303]: pgmap v217: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:04.101 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:06:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:06:05.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:04 smithi017 ceph-mon[99370]: pgmap v218: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:04 smithi086 ceph-mon[71303]: pgmap v218: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:06 smithi017 ceph-mon[99370]: pgmap v219: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:07.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:06 smithi086 ceph-mon[71303]: pgmap v219: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:08 smithi017 ceph-mon[99370]: pgmap v220: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:08 smithi086 ceph-mon[71303]: pgmap v220: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:11.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:10 smithi017 ceph-mon[99370]: pgmap v221: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:10 smithi086 ceph-mon[71303]: pgmap v221: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:13.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:12 smithi017 ceph-mon[99370]: pgmap v222: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:13.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:12 smithi086 ceph-mon[71303]: pgmap v222: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:15.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:14 smithi017 ceph-mon[99370]: pgmap v223: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:15.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:14 smithi086 ceph-mon[71303]: pgmap v223: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:17.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:16 smithi017 ceph-mon[99370]: pgmap v224: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:17.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:16 smithi086 ceph-mon[71303]: pgmap v224: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:17.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.887+0000 7f0ef5635640 1 -- 172.21.15.17:0/3727744212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef0100d70 msgr2=0x7f0ef0101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:17.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.887+0000 7f0ef5635640 1 --2- 172.21.15.17:0/3727744212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef0100d70 0x7f0ef0101150 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009c20 tx=0x7f0ee002aa00 comp rx=0 tx=0).stop 2024-08-19T01:06:17.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.887+0000 7f0ef5635640 1 -- 172.21.15.17:0/3727744212 shutdown_connections 2024-08-19T01:06:17.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.887+0000 7f0ef5635640 1 --2- 172.21.15.17:0/3727744212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef0101690 0x7f0ef0109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:17.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.887+0000 7f0ef5635640 1 --2- 172.21.15.17:0/3727744212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef0100d70 0x7f0ef0101150 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:17.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.887+0000 7f0ef5635640 1 -- 172.21.15.17:0/3727744212 >> 172.21.15.17:0/3727744212 conn(0x7f0ef00758a0 msgr2=0x7f0ef00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:17.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.887+0000 7f0ef5635640 1 -- 172.21.15.17:0/3727744212 shutdown_connections 2024-08-19T01:06:17.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.887+0000 7f0ef5635640 1 -- 172.21.15.17:0/3727744212 wait complete. 2024-08-19T01:06:17.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.887+0000 7f0ef5635640 1 Processor -- start 2024-08-19T01:06:17.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0ef5635640 1 -- start start 2024-08-19T01:06:17.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0ef5635640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef0100d70 0x7f0ef019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:17.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0ef5635640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef0101690 0x7f0ef019bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:17.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0ef5635640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef019c370 con 0x7f0ef0100d70 2024-08-19T01:06:17.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0ef5635640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0195900 con 0x7f0ef0101690 2024-08-19T01:06:17.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef0100d70 0x7f0ef019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:17.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0eeeffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef0100d70 0x7f0ef019b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53448/0 (socket says 172.21.15.17:53448) 2024-08-19T01:06:17.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0eeeffd640 1 -- 172.21.15.17:0/2222324349 learned_addr learned my addr 172.21.15.17:0/2222324349 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:17.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0eee7fc640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef0101690 0x7f0ef019bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:17.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0eeeffd640 1 -- 172.21.15.17:0/2222324349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef0101690 msgr2=0x7f0ef019bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:17.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0eeeffd640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef0101690 0x7f0ef019bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:17.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0eeeffd640 1 -- 172.21.15.17:0/2222324349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0009900 con 0x7f0ef0100d70 2024-08-19T01:06:17.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0eee7fc640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef0101690 0x7f0ef019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:06:17.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.888+0000 7f0eeeffd640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef0100d70 0x7f0ef019b810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0ee002af20 tx=0x7f0ee002f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:17.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.889+0000 7f0ed7fff640 1 -- 172.21.15.17:0/2222324349 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee003e070 con 0x7f0ef0100d70 2024-08-19T01:06:17.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.889+0000 7f0ef5635640 1 -- 172.21.15.17:0/2222324349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef0195b80 con 0x7f0ef0100d70 2024-08-19T01:06:17.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.889+0000 7f0ed7fff640 1 -- 172.21.15.17:0/2222324349 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0ee002e870 con 0x7f0ef0100d70 2024-08-19T01:06:17.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.889+0000 7f0ed7fff640 1 -- 172.21.15.17:0/2222324349 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ee0004780 con 0x7f0ef0100d70 2024-08-19T01:06:17.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.889+0000 7f0ef5635640 1 -- 172.21.15.17:0/2222324349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef0196070 con 0x7f0ef0100d70 2024-08-19T01:06:17.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.890+0000 7f0ef5635640 1 -- 172.21.15.17:0/2222324349 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef0068450 con 0x7f0ef0100d70 2024-08-19T01:06:17.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.890+0000 7f0ed7fff640 1 -- 172.21.15.17:0/2222324349 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0ee000a040 con 0x7f0ef0100d70 2024-08-19T01:06:17.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.891+0000 7f0ed7fff640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ed806e170 0x7f0ed8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:17.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.891+0000 7f0ed7fff640 1 -- 172.21.15.17:0/2222324349 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0ee00af330 con 0x7f0ef0100d70 2024-08-19T01:06:17.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.891+0000 7f0eee7fc640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ed806e170 0x7f0ed8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:17.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.891+0000 7f0eee7fc640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ed806e170 0x7f0ed8070630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4005d00 tx=0x7f0ee4009550 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:17.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:17.895+0000 7f0ed7fff640 1 -- 172.21.15.17:0/2222324349 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0ee0078610 con 0x7f0ef0100d70 2024-08-19T01:06:18.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.102+0000 7f0ef5635640 1 -- 172.21.15.17:0/2222324349 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ef0104400 con 0x7f0ed806e170 2024-08-19T01:06:18.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.103+0000 7f0ed7fff640 1 -- 172.21.15.17:0/2222324349 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0ef0104400 con 0x7f0ed806e170 2024-08-19T01:06:18.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.105+0000 7f0ef5635640 1 -- 172.21.15.17:0/2222324349 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ed806e170 msgr2=0x7f0ed8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.105+0000 7f0ef5635640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ed806e170 0x7f0ed8070630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4005d00 tx=0x7f0ee4009550 comp rx=0 tx=0).stop 2024-08-19T01:06:18.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.105+0000 7f0ef5635640 1 -- 172.21.15.17:0/2222324349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef0100d70 msgr2=0x7f0ef019b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.105+0000 7f0ef5635640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef0100d70 0x7f0ef019b810 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0ee002af20 tx=0x7f0ee002f890 comp rx=0 tx=0).stop 2024-08-19T01:06:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.105+0000 7f0ef5635640 1 -- 172.21.15.17:0/2222324349 shutdown_connections 2024-08-19T01:06:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.105+0000 7f0ef5635640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ed806e170 0x7f0ed8070630 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.105+0000 7f0ef5635640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0ef0101690 0x7f0ef019bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.105+0000 7f0ef5635640 1 --2- 172.21.15.17:0/2222324349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ef0100d70 0x7f0ef019b810 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.105+0000 7f0ef5635640 1 -- 172.21.15.17:0/2222324349 >> 172.21.15.17:0/2222324349 conn(0x7f0ef00758a0 msgr2=0x7f0ef0101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.105+0000 7f0ef5635640 1 -- 172.21.15.17:0/2222324349 shutdown_connections 2024-08-19T01:06:18.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.106+0000 7f0ef5635640 1 -- 172.21.15.17:0/2222324349 wait complete. 2024-08-19T01:06:18.117 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:06:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.189+0000 7f761d47d640 1 -- 172.21.15.17:0/2371031593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7618100750 msgr2=0x7f76181047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.189+0000 7f761d47d640 1 --2- 172.21.15.17:0/2371031593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7618100750 0x7f76181047a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f760c009880 tx=0x7f760c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.189+0000 7f761d47d640 1 -- 172.21.15.17:0/2371031593 shutdown_connections 2024-08-19T01:06:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.189+0000 7f761d47d640 1 --2- 172.21.15.17:0/2371031593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7618100750 0x7f76181047a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.189+0000 7f761d47d640 1 --2- 172.21.15.17:0/2371031593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76180ffda0 0x7f7618100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.189+0000 7f761d47d640 1 -- 172.21.15.17:0/2371031593 >> 172.21.15.17:0/2371031593 conn(0x7f76180fb840 msgr2=0x7f76180fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.189+0000 7f761d47d640 1 -- 172.21.15.17:0/2371031593 shutdown_connections 2024-08-19T01:06:18.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.189+0000 7f761d47d640 1 -- 172.21.15.17:0/2371031593 wait complete. 2024-08-19T01:06:18.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.190+0000 7f761d47d640 1 Processor -- start 2024-08-19T01:06:18.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.190+0000 7f761d47d640 1 -- start start 2024-08-19T01:06:18.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.190+0000 7f761d47d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76180ffda0 0x7f761819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.190+0000 7f761d47d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7618100750 0x7f761819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.190+0000 7f761d47d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761819c2f0 con 0x7f7618100750 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.190+0000 7f761d47d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7618195910 con 0x7f76180ffda0 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.190+0000 7f76167fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7618100750 0x7f761819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.190+0000 7f76167fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7618100750 0x7f761819bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53474/0 (socket says 172.21.15.17:53474) 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.190+0000 7f76167fc640 1 -- 172.21.15.17:0/493354212 learned_addr learned my addr 172.21.15.17:0/493354212 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.190+0000 7f7616ffd640 1 --2- 172.21.15.17:0/493354212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76180ffda0 0x7f761819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.191+0000 7f76167fc640 1 -- 172.21.15.17:0/493354212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76180ffda0 msgr2=0x7f761819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.191+0000 7f76167fc640 1 --2- 172.21.15.17:0/493354212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76180ffda0 0x7f761819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.191+0000 7f76167fc640 1 -- 172.21.15.17:0/493354212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c009560 con 0x7f7618100750 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.191+0000 7f76167fc640 1 --2- 172.21.15.17:0/493354212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7618100750 0x7f761819bd60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f760c02a9c0 tx=0x7f760c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.191+0000 7f75fffff640 1 -- 172.21.15.17:0/493354212 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f760c004aa0 con 0x7f7618100750 2024-08-19T01:06:18.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.191+0000 7f75fffff640 1 -- 172.21.15.17:0/493354212 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f760c004c00 con 0x7f7618100750 2024-08-19T01:06:18.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.191+0000 7f761d47d640 1 -- 172.21.15.17:0/493354212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7618195b90 con 0x7f7618100750 2024-08-19T01:06:18.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.191+0000 7f75fffff640 1 -- 172.21.15.17:0/493354212 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f760c003ab0 con 0x7f7618100750 2024-08-19T01:06:18.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.191+0000 7f761d47d640 1 -- 172.21.15.17:0/493354212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7618196080 con 0x7f7618100750 2024-08-19T01:06:18.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.192+0000 7f761d47d640 1 -- 172.21.15.17:0/493354212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7618101280 con 0x7f7618100750 2024-08-19T01:06:18.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.192+0000 7f75fffff640 1 -- 172.21.15.17:0/493354212 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f760c031d20 con 0x7f7618100750 2024-08-19T01:06:18.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.193+0000 7f75fffff640 1 --2- 172.21.15.17:0/493354212 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f760006e170 0x7f7600070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:18.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.193+0000 7f75fffff640 1 -- 172.21.15.17:0/493354212 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f760c0af1b0 con 0x7f7618100750 2024-08-19T01:06:18.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.193+0000 7f7616ffd640 1 --2- 172.21.15.17:0/493354212 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f760006e170 0x7f7600070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:18.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.193+0000 7f7616ffd640 1 --2- 172.21.15.17:0/493354212 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f760006e170 0x7f7600070630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7608005e10 tx=0x7f7608005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:18.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.197+0000 7f75fffff640 1 -- 172.21.15.17:0/493354212 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f760c078510 con 0x7f7618100750 2024-08-19T01:06:18.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.390+0000 7f761d47d640 1 -- 172.21.15.17:0/493354212 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f761810cdb0 con 0x7f760006e170 2024-08-19T01:06:18.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.391+0000 7f75fffff640 1 -- 172.21.15.17:0/493354212 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f761810cdb0 con 0x7f760006e170 2024-08-19T01:06:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.393+0000 7f761d47d640 1 -- 172.21.15.17:0/493354212 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f760006e170 msgr2=0x7f7600070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.393+0000 7f761d47d640 1 --2- 172.21.15.17:0/493354212 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f760006e170 0x7f7600070630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7608005e10 tx=0x7f7608005da0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.393+0000 7f761d47d640 1 -- 172.21.15.17:0/493354212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7618100750 msgr2=0x7f761819bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.393+0000 7f761d47d640 1 --2- 172.21.15.17:0/493354212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7618100750 0x7f761819bd60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f760c02a9c0 tx=0x7f760c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.393+0000 7f761d47d640 1 -- 172.21.15.17:0/493354212 shutdown_connections 2024-08-19T01:06:18.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.393+0000 7f761d47d640 1 --2- 172.21.15.17:0/493354212 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f760006e170 0x7f7600070630 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.393+0000 7f761d47d640 1 --2- 172.21.15.17:0/493354212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7618100750 0x7f761819bd60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.393+0000 7f761d47d640 1 --2- 172.21.15.17:0/493354212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76180ffda0 0x7f761819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.393+0000 7f761d47d640 1 -- 172.21.15.17:0/493354212 >> 172.21.15.17:0/493354212 conn(0x7f76180fb840 msgr2=0x7f76180fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.393+0000 7f761d47d640 1 -- 172.21.15.17:0/493354212 shutdown_connections 2024-08-19T01:06:18.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.393+0000 7f761d47d640 1 -- 172.21.15.17:0/493354212 wait complete. 2024-08-19T01:06:18.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.475+0000 7ff5facf8640 1 -- 172.21.15.17:0/759904980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f40ff3d0 msgr2=0x7ff5f40ff7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.475+0000 7ff5facf8640 1 --2- 172.21.15.17:0/759904980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f40ff3d0 0x7ff5f40ff7b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009880 tx=0x7ff5e802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.475+0000 7ff5facf8640 1 -- 172.21.15.17:0/759904980 shutdown_connections 2024-08-19T01:06:18.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.475+0000 7ff5facf8640 1 --2- 172.21.15.17:0/759904980 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f40ffd80 0x7ff5f41038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.475+0000 7ff5facf8640 1 --2- 172.21.15.17:0/759904980 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f40ff3d0 0x7ff5f40ff7b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.475+0000 7ff5facf8640 1 -- 172.21.15.17:0/759904980 >> 172.21.15.17:0/759904980 conn(0x7ff5f40f9e90 msgr2=0x7ff5f40fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:18.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.475+0000 7ff5facf8640 1 -- 172.21.15.17:0/759904980 shutdown_connections 2024-08-19T01:06:18.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.475+0000 7ff5facf8640 1 -- 172.21.15.17:0/759904980 wait complete. 2024-08-19T01:06:18.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.476+0000 7ff5facf8640 1 Processor -- start 2024-08-19T01:06:18.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.476+0000 7ff5facf8640 1 -- start start 2024-08-19T01:06:18.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5facf8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f40ff3d0 0x7ff5f4196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:18.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5facf8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f40ffd80 0x7ff5f41971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:18.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5facf8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f41977b0 con 0x7ff5f40ffd80 2024-08-19T01:06:18.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5facf8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f4197920 con 0x7ff5f40ff3d0 2024-08-19T01:06:18.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5f3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f40ffd80 0x7ff5f41971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:18.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5f3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f40ffd80 0x7ff5f41971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53482/0 (socket says 172.21.15.17:53482) 2024-08-19T01:06:18.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5f3fff640 1 -- 172.21.15.17:0/1443185841 learned_addr learned my addr 172.21.15.17:0/1443185841 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:18.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5f8a94640 1 --2- 172.21.15.17:0/1443185841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f40ff3d0 0x7ff5f4196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:18.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5f3fff640 1 -- 172.21.15.17:0/1443185841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f40ff3d0 msgr2=0x7ff5f4196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5f3fff640 1 --2- 172.21.15.17:0/1443185841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f40ff3d0 0x7ff5f4196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5f3fff640 1 -- 172.21.15.17:0/1443185841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8009560 con 0x7ff5f40ffd80 2024-08-19T01:06:18.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5f3fff640 1 --2- 172.21.15.17:0/1443185841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f40ffd80 0x7ff5f41971e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000b420 tx=0x7ff5e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:18.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5f1ffb640 1 -- 172.21.15.17:0/1443185841 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e0011800 con 0x7ff5f40ffd80 2024-08-19T01:06:18.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.477+0000 7ff5facf8640 1 -- 172.21.15.17:0/1443185841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f419fd10 con 0x7ff5f40ffd80 2024-08-19T01:06:18.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.478+0000 7ff5f1ffb640 1 -- 172.21.15.17:0/1443185841 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5e0011e20 con 0x7ff5f40ffd80 2024-08-19T01:06:18.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.478+0000 7ff5f1ffb640 1 -- 172.21.15.17:0/1443185841 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e000f2e0 con 0x7ff5f40ffd80 2024-08-19T01:06:18.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.478+0000 7ff5facf8640 1 -- 172.21.15.17:0/1443185841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f4194c60 con 0x7ff5f40ffd80 2024-08-19T01:06:18.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.479+0000 7ff5facf8640 1 -- 172.21.15.17:0/1443185841 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f4100420 con 0x7ff5f40ffd80 2024-08-19T01:06:18.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.479+0000 7ff5f1ffb640 1 -- 172.21.15.17:0/1443185841 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff5e0010380 con 0x7ff5f40ffd80 2024-08-19T01:06:18.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.480+0000 7ff5f1ffb640 1 --2- 172.21.15.17:0/1443185841 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5e4072580 0x7ff5e4074a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:18.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.480+0000 7ff5f1ffb640 1 -- 172.21.15.17:0/1443185841 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff5e008da60 con 0x7ff5f40ffd80 2024-08-19T01:06:18.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.480+0000 7ff5f8a94640 1 --2- 172.21.15.17:0/1443185841 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5e4072580 0x7ff5e4074a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:18.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.481+0000 7ff5f8a94640 1 --2- 172.21.15.17:0/1443185841 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5e4072580 0x7ff5e4074a40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009230 tx=0x7ff5e80058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:18.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.484+0000 7ff5f1ffb640 1 -- 172.21.15.17:0/1443185841 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff5e0056d40 con 0x7ff5f40ffd80 2024-08-19T01:06:18.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.668+0000 7ff5facf8640 1 -- 172.21.15.17:0/1443185841 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5f40682a0 con 0x7ff5e4072580 2024-08-19T01:06:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.677+0000 7ff5f1ffb640 1 -- 172.21.15.17:0/1443185841 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7ff5f40682a0 con 0x7ff5e4072580 2024-08-19T01:06:18.680 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (7m) 89s ago 18m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (18m) 89s ago 18m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (17m) 75s ago 17m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (5m) 89s ago 18m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (5m) 75s ago 17m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (7m) 89s ago 18m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (94s) 89s ago 12m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (111s) 89s ago 12m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (12m) 75s ago 12m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (79s) 75s ago 12m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (9m) 89s ago 19m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (8m) 75s ago 17m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:06:18.681 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (6m) 89s ago 19m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:06:18.682 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (6m) 75s ago 17m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:06:18.682 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (8m) 89s ago 18m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:06:18.682 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (8m) 75s ago 17m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:06:18.682 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (4m) 89s ago 16m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:06:18.682 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (4m) 89s ago 16m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:06:18.682 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (3m) 89s ago 15m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:06:18.682 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (3m) 75s ago 15m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:06:18.682 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (2m) 75s ago 14m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:06:18.682 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (2m) 75s ago 14m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:06:18.682 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (7m) 89s ago 17m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:06:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.679+0000 7ff5facf8640 1 -- 172.21.15.17:0/1443185841 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5e4072580 msgr2=0x7ff5e4074a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.679+0000 7ff5facf8640 1 --2- 172.21.15.17:0/1443185841 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5e4072580 0x7ff5e4074a40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009230 tx=0x7ff5e80058d0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.679+0000 7ff5facf8640 1 -- 172.21.15.17:0/1443185841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f40ffd80 msgr2=0x7ff5f41971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.679+0000 7ff5facf8640 1 --2- 172.21.15.17:0/1443185841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f40ffd80 0x7ff5f41971e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff5e000b420 tx=0x7ff5e000b8e0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.679+0000 7ff5facf8640 1 -- 172.21.15.17:0/1443185841 shutdown_connections 2024-08-19T01:06:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.679+0000 7ff5facf8640 1 --2- 172.21.15.17:0/1443185841 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5e4072580 0x7ff5e4074a40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.679+0000 7ff5facf8640 1 --2- 172.21.15.17:0/1443185841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5f40ffd80 0x7ff5f41971e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.679+0000 7ff5facf8640 1 --2- 172.21.15.17:0/1443185841 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5f40ff3d0 0x7ff5f4196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.679+0000 7ff5facf8640 1 -- 172.21.15.17:0/1443185841 >> 172.21.15.17:0/1443185841 conn(0x7ff5f40f9e90 msgr2=0x7ff5f40fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:18.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.679+0000 7ff5facf8640 1 -- 172.21.15.17:0/1443185841 shutdown_connections 2024-08-19T01:06:18.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.680+0000 7ff5facf8640 1 -- 172.21.15.17:0/1443185841 wait complete. 2024-08-19T01:06:18.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.760+0000 7f863f017640 1 -- 172.21.15.17:0/1106482732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86381049f0 msgr2=0x7f8638104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.760+0000 7f863f017640 1 --2- 172.21.15.17:0/1106482732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86381049f0 0x7f8638104dd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8628009880 tx=0x7f862802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.761+0000 7f863f017640 1 -- 172.21.15.17:0/1106482732 shutdown_connections 2024-08-19T01:06:18.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.761+0000 7f863f017640 1 --2- 172.21.15.17:0/1106482732 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86380fe9f0 0x7f86380fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.761+0000 7f863f017640 1 --2- 172.21.15.17:0/1106482732 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86381049f0 0x7f8638104dd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.761+0000 7f863f017640 1 -- 172.21.15.17:0/1106482732 >> 172.21.15.17:0/1106482732 conn(0x7f86380758a0 msgr2=0x7f86380fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:18.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.761+0000 7f863f017640 1 -- 172.21.15.17:0/1106482732 shutdown_connections 2024-08-19T01:06:18.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.761+0000 7f863f017640 1 -- 172.21.15.17:0/1106482732 wait complete. 2024-08-19T01:06:18.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.761+0000 7f863f017640 1 Processor -- start 2024-08-19T01:06:18.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.761+0000 7f863f017640 1 -- start start 2024-08-19T01:06:18.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.761+0000 7f863f017640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86380fe9f0 0x7f863819d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:18.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.761+0000 7f863f017640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86381049f0 0x7f863819def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:18.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.761+0000 7f863f017640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863819e4f0 con 0x7f86381049f0 2024-08-19T01:06:18.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f863f017640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863819e660 con 0x7f86380fe9f0 2024-08-19T01:06:18.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f8637fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86381049f0 0x7f863819def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:18.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f8637fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86381049f0 0x7f863819def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53496/0 (socket says 172.21.15.17:53496) 2024-08-19T01:06:18.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f8637fff640 1 -- 172.21.15.17:0/940756738 learned_addr learned my addr 172.21.15.17:0/940756738 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:18.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f863cdb3640 1 --2- 172.21.15.17:0/940756738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86380fe9f0 0x7f863819d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:18.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f8637fff640 1 -- 172.21.15.17:0/940756738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86380fe9f0 msgr2=0x7f863819d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:18.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f8637fff640 1 --2- 172.21.15.17:0/940756738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86380fe9f0 0x7f863819d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:18.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f8637fff640 1 -- 172.21.15.17:0/940756738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8628009560 con 0x7f86381049f0 2024-08-19T01:06:18.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f8637fff640 1 --2- 172.21.15.17:0/940756738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86381049f0 0x7f863819def0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f862c00c8a0 tx=0x7f862c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:18.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f8635ffb640 1 -- 172.21.15.17:0/940756738 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f862c007b80 con 0x7f86381049f0 2024-08-19T01:06:18.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f8635ffb640 1 -- 172.21.15.17:0/940756738 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f862c007ce0 con 0x7f86381049f0 2024-08-19T01:06:18.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f8635ffb640 1 -- 172.21.15.17:0/940756738 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f862c018810 con 0x7f86381049f0 2024-08-19T01:06:18.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.762+0000 7f863f017640 1 -- 172.21.15.17:0/940756738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8638197ca0 con 0x7f86381049f0 2024-08-19T01:06:18.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.763+0000 7f863f017640 1 -- 172.21.15.17:0/940756738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86381981f0 con 0x7f86381049f0 2024-08-19T01:06:18.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.764+0000 7f863f017640 1 -- 172.21.15.17:0/940756738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8638100130 con 0x7f86381049f0 2024-08-19T01:06:18.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.764+0000 7f8635ffb640 1 -- 172.21.15.17:0/940756738 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f862c018970 con 0x7f86381049f0 2024-08-19T01:06:18.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.765+0000 7f8635ffb640 1 --2- 172.21.15.17:0/940756738 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f862006e170 0x7f8620070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:18.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.765+0000 7f8635ffb640 1 -- 172.21.15.17:0/940756738 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f862c08e200 con 0x7f86381049f0 2024-08-19T01:06:18.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.765+0000 7f863cdb3640 1 --2- 172.21.15.17:0/940756738 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f862006e170 0x7f8620070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:18.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.765+0000 7f863cdb3640 1 --2- 172.21.15.17:0/940756738 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f862006e170 0x7f8620070630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8628009230 tx=0x7f86280058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:18.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:18.769+0000 7f8635ffb640 1 -- 172.21.15.17:0/940756738 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f862c057560 con 0x7f86381049f0 2024-08-19T01:06:19.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.020+0000 7f863f017640 1 -- 172.21.15.17:0/940756738 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f863810bd00 con 0x7f86381049f0 2024-08-19T01:06:19.024 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:18 smithi017 ceph-mon[99370]: pgmap v225: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:19.024 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:06:19.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.020+0000 7f8635ffb640 1 -- 172.21.15.17:0/940756738 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f862c05ac20 con 0x7f86381049f0 2024-08-19T01:06:19.025 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:06:19.026 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:06:19.026 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:06:19.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:06:19.026 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:06:19.026 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:06:19.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:06:19.027 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:06:19.027 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:06:19.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:06:19.027 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:06:19.027 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:06:19.028 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:06:19.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:06:19.028 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:06:19.028 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:06:19.028 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:06:19.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:06:19.029 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:06:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.023+0000 7f863f017640 1 -- 172.21.15.17:0/940756738 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f862006e170 msgr2=0x7f8620070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.023+0000 7f863f017640 1 --2- 172.21.15.17:0/940756738 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f862006e170 0x7f8620070630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8628009230 tx=0x7f86280058d0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.023+0000 7f863f017640 1 -- 172.21.15.17:0/940756738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86381049f0 msgr2=0x7f863819def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.023+0000 7f863f017640 1 --2- 172.21.15.17:0/940756738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86381049f0 0x7f863819def0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f862c00c8a0 tx=0x7f862c00cd60 comp rx=0 tx=0).stop 2024-08-19T01:06:19.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.023+0000 7f863f017640 1 -- 172.21.15.17:0/940756738 shutdown_connections 2024-08-19T01:06:19.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.023+0000 7f863f017640 1 --2- 172.21.15.17:0/940756738 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f862006e170 0x7f8620070630 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.023+0000 7f863f017640 1 --2- 172.21.15.17:0/940756738 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86381049f0 0x7f863819def0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.023+0000 7f863f017640 1 --2- 172.21.15.17:0/940756738 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f86380fe9f0 0x7f863819d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.023+0000 7f863f017640 1 -- 172.21.15.17:0/940756738 >> 172.21.15.17:0/940756738 conn(0x7f86380758a0 msgr2=0x7f8638067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:19.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.023+0000 7f863f017640 1 -- 172.21.15.17:0/940756738 shutdown_connections 2024-08-19T01:06:19.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.023+0000 7f863f017640 1 -- 172.21.15.17:0/940756738 wait complete. 2024-08-19T01:06:19.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.105+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/1164239950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbc40ffda0 msgr2=0x7fcbc4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.105+0000 7fcbc9dc2640 1 --2- 172.21.15.17:0/1164239950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbc40ffda0 0x7fcbc4100180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009880 tx=0x7fcbb402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.105+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/1164239950 shutdown_connections 2024-08-19T01:06:19.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.105+0000 7fcbc9dc2640 1 --2- 172.21.15.17:0/1164239950 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc4100750 0x7fcbc41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.105+0000 7fcbc9dc2640 1 --2- 172.21.15.17:0/1164239950 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbc40ffda0 0x7fcbc4100180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.105+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/1164239950 >> 172.21.15.17:0/1164239950 conn(0x7fcbc40fb840 msgr2=0x7fcbc40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:19.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.105+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/1164239950 shutdown_connections 2024-08-19T01:06:19.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.105+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/1164239950 wait complete. 2024-08-19T01:06:19.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc9dc2640 1 Processor -- start 2024-08-19T01:06:19.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc9dc2640 1 -- start start 2024-08-19T01:06:19.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc9dc2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc40ffda0 0x7fcbc4197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:19.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc9dc2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbc4100750 0x7fcbc4198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:19.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc9dc2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc41988f0 con 0x7fcbc4100750 2024-08-19T01:06:19.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc9dc2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc419b560 con 0x7fcbc40ffda0 2024-08-19T01:06:19.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbc4100750 0x7fcbc4198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:19.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbc4100750 0x7fcbc4198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53516/0 (socket says 172.21.15.17:53516) 2024-08-19T01:06:19.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc2ffd640 1 -- 172.21.15.17:0/4291633203 learned_addr learned my addr 172.21.15.17:0/4291633203 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:19.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc37fe640 1 --2- 172.21.15.17:0/4291633203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc40ffda0 0x7fcbc4197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:19.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc2ffd640 1 -- 172.21.15.17:0/4291633203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc40ffda0 msgr2=0x7fcbc4197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc2ffd640 1 --2- 172.21.15.17:0/4291633203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc40ffda0 0x7fcbc4197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.106+0000 7fcbc2ffd640 1 -- 172.21.15.17:0/4291633203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb4009560 con 0x7fcbc4100750 2024-08-19T01:06:19.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.107+0000 7fcbc2ffd640 1 --2- 172.21.15.17:0/4291633203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbc4100750 0x7fcbc4198210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800d6f0 tx=0x7fcbb800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:19.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.107+0000 7fcbc0ff9640 1 -- 172.21.15.17:0/4291633203 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbb8009a30 con 0x7fcbc4100750 2024-08-19T01:06:19.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.107+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/4291633203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc419b840 con 0x7fcbc4100750 2024-08-19T01:06:19.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.107+0000 7fcbc0ff9640 1 -- 172.21.15.17:0/4291633203 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcbb80054e0 con 0x7fcbc4100750 2024-08-19T01:06:19.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.107+0000 7fcbc0ff9640 1 -- 172.21.15.17:0/4291633203 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbb8010460 con 0x7fcbc4100750 2024-08-19T01:06:19.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.107+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/4291633203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc419bd90 con 0x7fcbc4100750 2024-08-19T01:06:19.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.108+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/4291633203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc4101280 con 0x7fcbc4100750 2024-08-19T01:06:19.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.108+0000 7fcbc0ff9640 1 -- 172.21.15.17:0/4291633203 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcbb8009b90 con 0x7fcbc4100750 2024-08-19T01:06:19.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.109+0000 7fcbc0ff9640 1 --2- 172.21.15.17:0/4291633203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcbac06e170 0x7fcbac070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:19.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.109+0000 7fcbc0ff9640 1 -- 172.21.15.17:0/4291633203 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcbb808dc80 con 0x7fcbc4100750 2024-08-19T01:06:19.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.109+0000 7fcbc37fe640 1 --2- 172.21.15.17:0/4291633203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcbac06e170 0x7fcbac070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:19.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.110+0000 7fcbc37fe640 1 --2- 172.21.15.17:0/4291633203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcbac06e170 0x7fcbac070630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009230 tx=0x7fcbb40058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:19.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.113+0000 7fcbc0ff9640 1 -- 172.21.15.17:0/4291633203 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcbb8057010 con 0x7fcbc4100750 2024-08-19T01:06:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:18 smithi086 ceph-mon[71303]: pgmap v225: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:06:19.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.322+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/4291633203 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcbc4100180 con 0x7fcbc4100750 2024-08-19T01:06:19.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.322+0000 7fcbc0ff9640 1 -- 172.21.15.17:0/4291633203 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7fcbb8020790 con 0x7fcbc4100750 2024-08-19T01:06:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:06:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:06:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:06:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:06:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:06:19.326 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:06:19.326 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:06:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:06:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:06:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:06:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:06:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:06:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:06:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:06:19.327 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:06:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:06:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:06:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:06:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:06:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:06:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:06:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:06:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:06:19.328 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:06:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:06:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:06:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:06:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:06:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:06:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:06:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:06:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:06:19.329 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:06:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:06:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:06:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:06:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:06:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:06:19.330 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:06:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:06:19.330 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:06:19.331 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:06:19.331 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:06:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:06:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.324+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/4291633203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcbac06e170 msgr2=0x7fcbac070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.324+0000 7fcbc9dc2640 1 --2- 172.21.15.17:0/4291633203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcbac06e170 0x7fcbac070630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009230 tx=0x7fcbb40058d0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.324+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/4291633203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbc4100750 msgr2=0x7fcbc4198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.324+0000 7fcbc9dc2640 1 --2- 172.21.15.17:0/4291633203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbc4100750 0x7fcbc4198210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800d6f0 tx=0x7fcbb800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.324+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/4291633203 shutdown_connections 2024-08-19T01:06:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.324+0000 7fcbc9dc2640 1 --2- 172.21.15.17:0/4291633203 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcbac06e170 0x7fcbac070630 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.324+0000 7fcbc9dc2640 1 --2- 172.21.15.17:0/4291633203 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcbc4100750 0x7fcbc4198210 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.324+0000 7fcbc9dc2640 1 --2- 172.21.15.17:0/4291633203 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcbc40ffda0 0x7fcbc4197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.324+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/4291633203 >> 172.21.15.17:0/4291633203 conn(0x7fcbc40fb840 msgr2=0x7fcbc40fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.324+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/4291633203 shutdown_connections 2024-08-19T01:06:19.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.325+0000 7fcbc9dc2640 1 -- 172.21.15.17:0/4291633203 wait complete. 2024-08-19T01:06:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.410+0000 7f919f54e640 1 -- 172.21.15.17:0/3911257183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9198101630 msgr2=0x7f9198109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.410+0000 7f919f54e640 1 --2- 172.21.15.17:0/3911257183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9198101630 0x7f9198109b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f91880098b0 tx=0x7f918802a560 comp rx=0 tx=0).stop 2024-08-19T01:06:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.410+0000 7f919f54e640 1 -- 172.21.15.17:0/3911257183 shutdown_connections 2024-08-19T01:06:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.410+0000 7f919f54e640 1 --2- 172.21.15.17:0/3911257183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9198101630 0x7f9198109b20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.410+0000 7f919f54e640 1 --2- 172.21.15.17:0/3911257183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9198100d10 0x7f91981010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.410+0000 7f919f54e640 1 -- 172.21.15.17:0/3911257183 >> 172.21.15.17:0/3911257183 conn(0x7f91980758a0 msgr2=0x7f91980fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.411+0000 7f919f54e640 1 -- 172.21.15.17:0/3911257183 shutdown_connections 2024-08-19T01:06:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.411+0000 7f919f54e640 1 -- 172.21.15.17:0/3911257183 wait complete. 2024-08-19T01:06:19.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.411+0000 7f919f54e640 1 Processor -- start 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.411+0000 7f919f54e640 1 -- start start 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919f54e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9198100d10 0x7f919819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919f54e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9198101630 0x7f919819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919f54e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919819c3c0 con 0x7f9198101630 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919f54e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91981959e0 con 0x7f9198100d10 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919cae9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9198101630 0x7f919819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919cae9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9198101630 0x7f919819be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53528/0 (socket says 172.21.15.17:53528) 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919cae9640 1 -- 172.21.15.17:0/3991458897 learned_addr learned my addr 172.21.15.17:0/3991458897 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919d2ea640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9198100d10 0x7f919819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919cae9640 1 -- 172.21.15.17:0/3991458897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9198100d10 msgr2=0x7f919819b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919cae9640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9198100d10 0x7f919819b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919cae9640 1 -- 172.21.15.17:0/3991458897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188009560 con 0x7f9198101630 2024-08-19T01:06:19.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919d2ea640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9198100d10 0x7f919819b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:06:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919cae9640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9198101630 0x7f919819be30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9188006010 tx=0x7f91880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f918e7fc640 1 -- 172.21.15.17:0/3991458897 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9188004aa0 con 0x7f9198101630 2024-08-19T01:06:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f918e7fc640 1 -- 172.21.15.17:0/3991458897 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9188004c00 con 0x7f9198101630 2024-08-19T01:06:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.412+0000 7f919f54e640 1 -- 172.21.15.17:0/3991458897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9198195c60 con 0x7f9198101630 2024-08-19T01:06:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.413+0000 7f918e7fc640 1 -- 172.21.15.17:0/3991458897 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9188003a20 con 0x7f9198101630 2024-08-19T01:06:19.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.413+0000 7f919f54e640 1 -- 172.21.15.17:0/3991458897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9198196150 con 0x7f9198101630 2024-08-19T01:06:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.414+0000 7f919f54e640 1 -- 172.21.15.17:0/3991458897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91980684b0 con 0x7f9198101630 2024-08-19T01:06:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.414+0000 7f918e7fc640 1 -- 172.21.15.17:0/3991458897 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9188003cb0 con 0x7f9198101630 2024-08-19T01:06:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.414+0000 7f918e7fc640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f918406e170 0x7f9184070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.415+0000 7f918e7fc640 1 -- 172.21.15.17:0/3991458897 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f91880af330 con 0x7f9198101630 2024-08-19T01:06:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.415+0000 7f919d2ea640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f918406e170 0x7f9184070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:19.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.415+0000 7f919d2ea640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f918406e170 0x7f9184070630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f919400abe0 tx=0x7f919400a5c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:19.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.422+0000 7f918e7fc640 1 -- 172.21.15.17:0/3991458897 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9188078610 con 0x7f9198101630 2024-08-19T01:06:19.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.614+0000 7f919f54e640 1 -- 172.21.15.17:0/3991458897 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f919810cd80 con 0x7f918406e170 2024-08-19T01:06:19.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.615+0000 7f918e7fc640 1 -- 172.21.15.17:0/3991458897 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f919810cd80 con 0x7f918406e170 2024-08-19T01:06:19.618 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:06:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:06:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:06:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:06:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:06:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:06:19.618 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:06:19.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:06:19.619 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:06:19.619 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:06:19.619 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:06:19.619 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:06:19.619 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:06:19.619 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:06:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.618+0000 7f919f54e640 1 -- 172.21.15.17:0/3991458897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f918406e170 msgr2=0x7f9184070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.618+0000 7f919f54e640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f918406e170 0x7f9184070630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f919400abe0 tx=0x7f919400a5c0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.618+0000 7f919f54e640 1 -- 172.21.15.17:0/3991458897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9198101630 msgr2=0x7f919819be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.618+0000 7f919f54e640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9198101630 0x7f919819be30 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9188006010 tx=0x7f91880055a0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.618+0000 7f919f54e640 1 -- 172.21.15.17:0/3991458897 shutdown_connections 2024-08-19T01:06:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.618+0000 7f919f54e640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f918406e170 0x7f9184070630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.618+0000 7f919f54e640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9198101630 0x7f919819be30 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.618+0000 7f919f54e640 1 --2- 172.21.15.17:0/3991458897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9198100d10 0x7f919819b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.618+0000 7f919f54e640 1 -- 172.21.15.17:0/3991458897 >> 172.21.15.17:0/3991458897 conn(0x7f91980758a0 msgr2=0x7f9198101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.618+0000 7f919f54e640 1 -- 172.21.15.17:0/3991458897 shutdown_connections 2024-08-19T01:06:19.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.618+0000 7f919f54e640 1 -- 172.21.15.17:0/3991458897 wait complete. 2024-08-19T01:06:19.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.700+0000 7f14721bb640 1 -- 172.21.15.17:0/3724614550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c104a30 msgr2=0x7f146c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.700+0000 7f14721bb640 1 --2- 172.21.15.17:0/3724614550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c104a30 0x7f146c104e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f145c009880 tx=0x7f145c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.700+0000 7f14721bb640 1 -- 172.21.15.17:0/3724614550 shutdown_connections 2024-08-19T01:06:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.700+0000 7f14721bb640 1 --2- 172.21.15.17:0/3724614550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f146c0fea30 0x7f146c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.700+0000 7f14721bb640 1 --2- 172.21.15.17:0/3724614550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c104a30 0x7f146c104e10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.700+0000 7f14721bb640 1 -- 172.21.15.17:0/3724614550 >> 172.21.15.17:0/3724614550 conn(0x7f146c0fa730 msgr2=0x7f146c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.700+0000 7f14721bb640 1 -- 172.21.15.17:0/3724614550 shutdown_connections 2024-08-19T01:06:19.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.700+0000 7f14721bb640 1 -- 172.21.15.17:0/3724614550 wait complete. 2024-08-19T01:06:19.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.701+0000 7f14721bb640 1 Processor -- start 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.701+0000 7f14721bb640 1 -- start start 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.701+0000 7f14721bb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f146c0fea30 0x7f146c19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.701+0000 7f14721bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c104a30 0x7f146c19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.701+0000 7f14721bb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c19c3b0 con 0x7f146c104a30 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.701+0000 7f14721bb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146c195940 con 0x7f146c0fea30 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.701+0000 7f146affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c104a30 0x7f146c19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f146affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c104a30 0x7f146c19bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53552/0 (socket says 172.21.15.17:53552) 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f146affd640 1 -- 172.21.15.17:0/3763045365 learned_addr learned my addr 172.21.15.17:0/3763045365 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f146b7fe640 1 --2- 172.21.15.17:0/3763045365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f146c0fea30 0x7f146c19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f146affd640 1 -- 172.21.15.17:0/3763045365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f146c0fea30 msgr2=0x7f146c19b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f146affd640 1 --2- 172.21.15.17:0/3763045365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f146c0fea30 0x7f146c19b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f146affd640 1 -- 172.21.15.17:0/3763045365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c009560 con 0x7f146c104a30 2024-08-19T01:06:19.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f146affd640 1 --2- 172.21.15.17:0/3763045365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c104a30 0x7f146c19bd90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f146000d6f0 tx=0x7f146000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:19.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f1468ff9640 1 -- 172.21.15.17:0/3763045365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1460009a30 con 0x7f146c104a30 2024-08-19T01:06:19.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f14721bb640 1 -- 172.21.15.17:0/3763045365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f146c195c20 con 0x7f146c104a30 2024-08-19T01:06:19.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f1468ff9640 1 -- 172.21.15.17:0/3763045365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14600054e0 con 0x7f146c104a30 2024-08-19T01:06:19.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f1468ff9640 1 -- 172.21.15.17:0/3763045365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1460010460 con 0x7f146c104a30 2024-08-19T01:06:19.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.702+0000 7f14721bb640 1 -- 172.21.15.17:0/3763045365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146c196170 con 0x7f146c104a30 2024-08-19T01:06:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.703+0000 7f14721bb640 1 -- 172.21.15.17:0/3763045365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146c100170 con 0x7f146c104a30 2024-08-19T01:06:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.704+0000 7f1468ff9640 1 -- 172.21.15.17:0/3763045365 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1460004ec0 con 0x7f146c104a30 2024-08-19T01:06:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.704+0000 7f1468ff9640 1 --2- 172.21.15.17:0/3763045365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f145406e170 0x7f1454070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.704+0000 7f1468ff9640 1 -- 172.21.15.17:0/3763045365 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f146008ddb0 con 0x7f146c104a30 2024-08-19T01:06:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.704+0000 7f146b7fe640 1 --2- 172.21.15.17:0/3763045365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f145406e170 0x7f1454070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:19.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.705+0000 7f146b7fe640 1 --2- 172.21.15.17:0/3763045365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f145406e170 0x7f1454070630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f145c000c00 tx=0x7f145c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:19.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.709+0000 7f1468ff9640 1 -- 172.21.15.17:0/3763045365 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1460057090 con 0x7f146c104a30 2024-08-19T01:06:19.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.954+0000 7f14721bb640 1 -- 172.21.15.17:0/3763045365 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f146c107fb0 con 0x7f146c104a30 2024-08-19T01:06:19.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.954+0000 7f1468ff9640 1 -- 172.21.15.17:0/3763045365 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f14600201c0 con 0x7f146c104a30 2024-08-19T01:06:19.959 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:06:19.959 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:06:19.959 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:06:19.959 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:06:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:06:19.960 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:06:19.960 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:06:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.956+0000 7f14721bb640 1 -- 172.21.15.17:0/3763045365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f145406e170 msgr2=0x7f1454070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.956+0000 7f14721bb640 1 --2- 172.21.15.17:0/3763045365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f145406e170 0x7f1454070630 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f145c000c00 tx=0x7f145c005a20 comp rx=0 tx=0).stop 2024-08-19T01:06:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.956+0000 7f14721bb640 1 -- 172.21.15.17:0/3763045365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c104a30 msgr2=0x7f146c19bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:19.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.956+0000 7f14721bb640 1 --2- 172.21.15.17:0/3763045365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c104a30 0x7f146c19bd90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f146000d6f0 tx=0x7f146000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.956+0000 7f14721bb640 1 -- 172.21.15.17:0/3763045365 shutdown_connections 2024-08-19T01:06:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.956+0000 7f14721bb640 1 --2- 172.21.15.17:0/3763045365 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f145406e170 0x7f1454070630 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.956+0000 7f14721bb640 1 --2- 172.21.15.17:0/3763045365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f146c104a30 0x7f146c19bd90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.956+0000 7f14721bb640 1 --2- 172.21.15.17:0/3763045365 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f146c0fea30 0x7f146c19b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:19.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.956+0000 7f14721bb640 1 -- 172.21.15.17:0/3763045365 >> 172.21.15.17:0/3763045365 conn(0x7f146c0fa730 msgr2=0x7f146c068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.956+0000 7f14721bb640 1 -- 172.21.15.17:0/3763045365 shutdown_connections 2024-08-19T01:06:19.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:19.956+0000 7f14721bb640 1 -- 172.21.15.17:0/3763045365 wait complete. 2024-08-19T01:06:20.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:19 smithi017 ceph-mon[99370]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:20.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:19 smithi017 ceph-mon[99370]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:20.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:19 smithi017 ceph-mon[99370]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:20.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:19 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/940756738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:06:20.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:19 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4291633203' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:06:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:19 smithi086 ceph-mon[71303]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:19 smithi086 ceph-mon[71303]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:19 smithi086 ceph-mon[71303]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:19 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/940756738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:06:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:19 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4291633203' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:06:21.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:20 smithi017 ceph-mon[99370]: pgmap v226: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:21.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:20 smithi017 ceph-mon[99370]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:21.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:20 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3763045365' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:06:21.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:20 smithi086 ceph-mon[71303]: pgmap v226: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:21.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:20 smithi086 ceph-mon[71303]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:21.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:20 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3763045365' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:06:23.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:22 smithi017 ceph-mon[99370]: pgmap v227: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:23.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:22 smithi086 ceph-mon[71303]: pgmap v227: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:25.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:24 smithi017 ceph-mon[99370]: pgmap v228: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:24 smithi086 ceph-mon[71303]: pgmap v228: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:27.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:26 smithi017 ceph-mon[99370]: pgmap v229: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:26 smithi086 ceph-mon[71303]: pgmap v229: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:29.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:28 smithi017 ceph-mon[99370]: pgmap v230: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:29.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:28 smithi086 ceph-mon[71303]: pgmap v230: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:30 smithi017 ceph-mon[99370]: pgmap v231: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:31.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:30 smithi086 ceph-mon[71303]: pgmap v231: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:33.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:32 smithi017 ceph-mon[99370]: pgmap v232: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:33.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:32 smithi086 ceph-mon[71303]: pgmap v232: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:06:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:06:35.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:34 smithi017 ceph-mon[99370]: pgmap v233: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:35.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:34 smithi086 ceph-mon[71303]: pgmap v233: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:36 smithi017 ceph-mon[99370]: pgmap v234: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:37.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:36 smithi086 ceph-mon[71303]: pgmap v234: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:38 smithi017 ceph-mon[99370]: pgmap v235: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:38 smithi086 ceph-mon[71303]: pgmap v235: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:40 smithi017 ceph-mon[99370]: pgmap v236: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:40 smithi086 ceph-mon[71303]: pgmap v236: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:43.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:42 smithi017 ceph-mon[99370]: pgmap v237: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:42 smithi086 ceph-mon[71303]: pgmap v237: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:44 smithi017 ceph-mon[99370]: pgmap v238: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:44 smithi086 ceph-mon[71303]: pgmap v238: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:46 smithi017 ceph-mon[99370]: pgmap v239: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:46 smithi086 ceph-mon[71303]: pgmap v239: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:47 smithi017 ceph-mon[99370]: pgmap v240: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:47 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:06:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:47 smithi086 ceph-mon[71303]: pgmap v240: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:47 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:06:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.047+0000 7f2a490cf640 1 -- 172.21.15.17:0/774026737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a44100750 msgr2=0x7f2a441047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.047+0000 7f2a490cf640 1 --2- 172.21.15.17:0/774026737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a44100750 0x7f2a441047a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009880 tx=0x7f2a2c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.047+0000 7f2a490cf640 1 -- 172.21.15.17:0/774026737 shutdown_connections 2024-08-19T01:06:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.047+0000 7f2a490cf640 1 --2- 172.21.15.17:0/774026737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a44100750 0x7f2a441047a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.047+0000 7f2a490cf640 1 --2- 172.21.15.17:0/774026737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a440ffda0 0x7f2a44100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.047+0000 7f2a490cf640 1 -- 172.21.15.17:0/774026737 >> 172.21.15.17:0/774026737 conn(0x7f2a440fb840 msgr2=0x7f2a440fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:50.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.047+0000 7f2a490cf640 1 -- 172.21.15.17:0/774026737 shutdown_connections 2024-08-19T01:06:50.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.047+0000 7f2a490cf640 1 -- 172.21.15.17:0/774026737 wait complete. 2024-08-19T01:06:50.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a490cf640 1 Processor -- start 2024-08-19T01:06:50.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a490cf640 1 -- start start 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a490cf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a440ffda0 0x7f2a4419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a490cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a44100750 0x7f2a4419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a490cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4419c380 con 0x7f2a44100750 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a490cf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44195910 con 0x7f2a440ffda0 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a4259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a44100750 0x7f2a4419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a4259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a44100750 0x7f2a4419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45958/0 (socket says 172.21.15.17:45958) 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a4259c640 1 -- 172.21.15.17:0/3718667040 learned_addr learned my addr 172.21.15.17:0/3718667040 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a42d9d640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a440ffda0 0x7f2a4419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a4259c640 1 -- 172.21.15.17:0/3718667040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a440ffda0 msgr2=0x7f2a4419b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a4259c640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a440ffda0 0x7f2a4419b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.048+0000 7f2a4259c640 1 -- 172.21.15.17:0/3718667040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009560 con 0x7f2a44100750 2024-08-19T01:06:50.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.049+0000 7f2a42d9d640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a440ffda0 0x7f2a4419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:06:50.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.049+0000 7f2a4259c640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a44100750 0x7f2a4419bd60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c006010 tx=0x7f2a2c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:50.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.049+0000 7f2a3bfff640 1 -- 172.21.15.17:0/3718667040 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a2c004aa0 con 0x7f2a44100750 2024-08-19T01:06:50.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.049+0000 7f2a3bfff640 1 -- 172.21.15.17:0/3718667040 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a2c004c00 con 0x7f2a44100750 2024-08-19T01:06:50.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.049+0000 7f2a3bfff640 1 -- 172.21.15.17:0/3718667040 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a2c003a20 con 0x7f2a44100750 2024-08-19T01:06:50.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.049+0000 7f2a490cf640 1 -- 172.21.15.17:0/3718667040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a44195b90 con 0x7f2a44100750 2024-08-19T01:06:50.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.049+0000 7f2a490cf640 1 -- 172.21.15.17:0/3718667040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a44196080 con 0x7f2a44100750 2024-08-19T01:06:50.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.050+0000 7f2a490cf640 1 -- 172.21.15.17:0/3718667040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a44101280 con 0x7f2a44100750 2024-08-19T01:06:50.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.051+0000 7f2a3bfff640 1 -- 172.21.15.17:0/3718667040 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2a2c031c90 con 0x7f2a44100750 2024-08-19T01:06:50.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.051+0000 7f2a3bfff640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a3006e180 0x7f2a30070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.051+0000 7f2a42d9d640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a3006e180 0x7f2a30070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.051+0000 7f2a3bfff640 1 -- 172.21.15.17:0/3718667040 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2a2c0af360 con 0x7f2a44100750 2024-08-19T01:06:50.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.052+0000 7f2a42d9d640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a3006e180 0x7f2a30070640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a340058c0 tx=0x7f2a34005ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:50.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.056+0000 7f2a3bfff640 1 -- 172.21.15.17:0/3718667040 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2a2c078640 con 0x7f2a44100750 2024-08-19T01:06:50.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:49 smithi017 ceph-mon[99370]: pgmap v241: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:50.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.249+0000 7f2a490cf640 1 -- 172.21.15.17:0/3718667040 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a4410cdb0 con 0x7f2a3006e180 2024-08-19T01:06:50.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.250+0000 7f2a3bfff640 1 -- 172.21.15.17:0/3718667040 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2a4410cdb0 con 0x7f2a3006e180 2024-08-19T01:06:50.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.252+0000 7f2a490cf640 1 -- 172.21.15.17:0/3718667040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a3006e180 msgr2=0x7f2a30070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.252+0000 7f2a490cf640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a3006e180 0x7f2a30070640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a340058c0 tx=0x7f2a34005ec0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.252+0000 7f2a490cf640 1 -- 172.21.15.17:0/3718667040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a44100750 msgr2=0x7f2a4419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.252+0000 7f2a490cf640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a44100750 0x7f2a4419bd60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c006010 tx=0x7f2a2c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.252+0000 7f2a490cf640 1 -- 172.21.15.17:0/3718667040 shutdown_connections 2024-08-19T01:06:50.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.252+0000 7f2a490cf640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a3006e180 0x7f2a30070640 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.252+0000 7f2a490cf640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a44100750 0x7f2a4419bd60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.252+0000 7f2a490cf640 1 --2- 172.21.15.17:0/3718667040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a440ffda0 0x7f2a4419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.252+0000 7f2a490cf640 1 -- 172.21.15.17:0/3718667040 >> 172.21.15.17:0/3718667040 conn(0x7f2a440fb840 msgr2=0x7f2a440fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:50.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.253+0000 7f2a490cf640 1 -- 172.21.15.17:0/3718667040 shutdown_connections 2024-08-19T01:06:50.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.253+0000 7f2a490cf640 1 -- 172.21.15.17:0/3718667040 wait complete. 2024-08-19T01:06:50.264 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:06:50.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.336+0000 7f63edc34640 1 -- 172.21.15.17:0/2525768564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8100c60 msgr2=0x7f63e8101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.336+0000 7f63edc34640 1 --2- 172.21.15.17:0/2525768564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8100c60 0x7f63e8101040 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f63d80098b0 tx=0x7f63d802a4d0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.336+0000 7f63edc34640 1 -- 172.21.15.17:0/2525768564 shutdown_connections 2024-08-19T01:06:50.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.336+0000 7f63edc34640 1 --2- 172.21.15.17:0/2525768564 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e8101610 0x7f63e8109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.336+0000 7f63edc34640 1 --2- 172.21.15.17:0/2525768564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8100c60 0x7f63e8101040 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.336+0000 7f63edc34640 1 -- 172.21.15.17:0/2525768564 >> 172.21.15.17:0/2525768564 conn(0x7f63e80fa730 msgr2=0x7f63e80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:50.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.336+0000 7f63edc34640 1 -- 172.21.15.17:0/2525768564 shutdown_connections 2024-08-19T01:06:50.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.336+0000 7f63edc34640 1 -- 172.21.15.17:0/2525768564 wait complete. 2024-08-19T01:06:50.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.337+0000 7f63edc34640 1 Processor -- start 2024-08-19T01:06:50.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.337+0000 7f63edc34640 1 -- start start 2024-08-19T01:06:50.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.337+0000 7f63edc34640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8100c60 0x7f63e819b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.337+0000 7f63edc34640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e8101610 0x7f63e819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.337+0000 7f63edc34640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e819c3a0 con 0x7f63e8100c60 2024-08-19T01:06:50.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.337+0000 7f63edc34640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8195930 con 0x7f63e8101610 2024-08-19T01:06:50.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8100c60 0x7f63e819b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8100c60 0x7f63e819b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45984/0 (socket says 172.21.15.17:45984) 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63e77fe640 1 -- 172.21.15.17:0/3847377772 learned_addr learned my addr 172.21.15.17:0/3847377772 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63deffd640 1 --2- 172.21.15.17:0/3847377772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e8101610 0x7f63e819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63e77fe640 1 -- 172.21.15.17:0/3847377772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e8101610 msgr2=0x7f63e819bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63e77fe640 1 --2- 172.21.15.17:0/3847377772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e8101610 0x7f63e819bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63e77fe640 1 -- 172.21.15.17:0/3847377772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d8009560 con 0x7f63e8100c60 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63e77fe640 1 --2- 172.21.15.17:0/3847377772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8100c60 0x7f63e819b840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009230 tx=0x7f63d80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63e57fa640 1 -- 172.21.15.17:0/3847377772 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d8004aa0 con 0x7f63e8100c60 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63edc34640 1 -- 172.21.15.17:0/3847377772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e8195bb0 con 0x7f63e8100c60 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63e57fa640 1 -- 172.21.15.17:0/3847377772 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63d8004c00 con 0x7f63e8100c60 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63e57fa640 1 -- 172.21.15.17:0/3847377772 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d80039f0 con 0x7f63e8100c60 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.338+0000 7f63edc34640 1 -- 172.21.15.17:0/3847377772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e81960a0 con 0x7f63e8100c60 2024-08-19T01:06:50.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.339+0000 7f63edc34640 1 -- 172.21.15.17:0/3847377772 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e8068d30 con 0x7f63e8100c60 2024-08-19T01:06:50.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.340+0000 7f63e57fa640 1 -- 172.21.15.17:0/3847377772 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f63d8031c00 con 0x7f63e8100c60 2024-08-19T01:06:50.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.340+0000 7f63e57fa640 1 --2- 172.21.15.17:0/3847377772 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63d406e180 0x7f63d4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.340+0000 7f63e57fa640 1 -- 172.21.15.17:0/3847377772 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f63d80af2f0 con 0x7f63e8100c60 2024-08-19T01:06:50.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.340+0000 7f63deffd640 1 --2- 172.21.15.17:0/3847377772 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63d406e180 0x7f63d4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.341+0000 7f63deffd640 1 --2- 172.21.15.17:0/3847377772 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63d406e180 0x7f63d4070640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f63e8196da0 tx=0x7f63d000a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:50.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.345+0000 7f63e57fa640 1 -- 172.21.15.17:0/3847377772 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f63d8078680 con 0x7f63e8100c60 2024-08-19T01:06:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:49 smithi086 ceph-mon[71303]: pgmap v241: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:50.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.535+0000 7f63edc34640 1 -- 172.21.15.17:0/3847377772 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f63e8104360 con 0x7f63d406e180 2024-08-19T01:06:50.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.537+0000 7f63e57fa640 1 -- 172.21.15.17:0/3847377772 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f63e8104360 con 0x7f63d406e180 2024-08-19T01:06:50.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.539+0000 7f63edc34640 1 -- 172.21.15.17:0/3847377772 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63d406e180 msgr2=0x7f63d4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.539+0000 7f63edc34640 1 --2- 172.21.15.17:0/3847377772 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63d406e180 0x7f63d4070640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f63e8196da0 tx=0x7f63d000a250 comp rx=0 tx=0).stop 2024-08-19T01:06:50.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.539+0000 7f63edc34640 1 -- 172.21.15.17:0/3847377772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8100c60 msgr2=0x7f63e819b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.539+0000 7f63edc34640 1 --2- 172.21.15.17:0/3847377772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8100c60 0x7f63e819b840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009230 tx=0x7f63d80055a0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.539+0000 7f63edc34640 1 -- 172.21.15.17:0/3847377772 shutdown_connections 2024-08-19T01:06:50.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.539+0000 7f63edc34640 1 --2- 172.21.15.17:0/3847377772 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63d406e180 0x7f63d4070640 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.539+0000 7f63edc34640 1 --2- 172.21.15.17:0/3847377772 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e8101610 0x7f63e819bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.539+0000 7f63edc34640 1 --2- 172.21.15.17:0/3847377772 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e8100c60 0x7f63e819b840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.539+0000 7f63edc34640 1 -- 172.21.15.17:0/3847377772 >> 172.21.15.17:0/3847377772 conn(0x7f63e80fa730 msgr2=0x7f63e8101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:50.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.539+0000 7f63edc34640 1 -- 172.21.15.17:0/3847377772 shutdown_connections 2024-08-19T01:06:50.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.539+0000 7f63edc34640 1 -- 172.21.15.17:0/3847377772 wait complete. 2024-08-19T01:06:50.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.622+0000 7f20fd7b1640 1 -- 172.21.15.17:0/2297717854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f8104a30 msgr2=0x7f20f8104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.622+0000 7f20fd7b1640 1 --2- 172.21.15.17:0/2297717854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f8104a30 0x7f20f8104e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009880 tx=0x7f20f002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.622+0000 7f20fd7b1640 1 -- 172.21.15.17:0/2297717854 shutdown_connections 2024-08-19T01:06:50.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.622+0000 7f20fd7b1640 1 --2- 172.21.15.17:0/2297717854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f80fea30 0x7f20f80fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.622+0000 7f20fd7b1640 1 --2- 172.21.15.17:0/2297717854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f8104a30 0x7f20f8104e10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.622+0000 7f20fd7b1640 1 -- 172.21.15.17:0/2297717854 >> 172.21.15.17:0/2297717854 conn(0x7f20f80fa730 msgr2=0x7f20f80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:50.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.622+0000 7f20fd7b1640 1 -- 172.21.15.17:0/2297717854 shutdown_connections 2024-08-19T01:06:50.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.622+0000 7f20fd7b1640 1 -- 172.21.15.17:0/2297717854 wait complete. 2024-08-19T01:06:50.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.623+0000 7f20fd7b1640 1 Processor -- start 2024-08-19T01:06:50.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.623+0000 7f20fd7b1640 1 -- start start 2024-08-19T01:06:50.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.623+0000 7f20fd7b1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f80fea30 0x7f20f8196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.623+0000 7f20fd7b1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f8104a30 0x7f20f8196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.623+0000 7f20fd7b1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8197550 con 0x7f20f80fea30 2024-08-19T01:06:50.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.623+0000 7f20fd7b1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f81976c0 con 0x7f20f8104a30 2024-08-19T01:06:50.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.623+0000 7f20f6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f80fea30 0x7f20f8196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.623+0000 7f20f6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f80fea30 0x7f20f8196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45994/0 (socket says 172.21.15.17:45994) 2024-08-19T01:06:50.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.623+0000 7f20f6ffd640 1 -- 172.21.15.17:0/205542239 learned_addr learned my addr 172.21.15.17:0/205542239 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:50.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.623+0000 7f20f67fc640 1 --2- 172.21.15.17:0/205542239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f8104a30 0x7f20f8196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.624+0000 7f20f6ffd640 1 -- 172.21.15.17:0/205542239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f8104a30 msgr2=0x7f20f8196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.624+0000 7f20f6ffd640 1 --2- 172.21.15.17:0/205542239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f8104a30 0x7f20f8196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.624+0000 7f20f6ffd640 1 -- 172.21.15.17:0/205542239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f0009560 con 0x7f20f80fea30 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.624+0000 7f20f6ffd640 1 --2- 172.21.15.17:0/205542239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f80fea30 0x7f20f8196a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f20f002a9c0 tx=0x7f20f00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.624+0000 7f20effff640 1 -- 172.21.15.17:0/205542239 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20f0004aa0 con 0x7f20f80fea30 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.624+0000 7f20effff640 1 -- 172.21.15.17:0/205542239 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20f0004c00 con 0x7f20f80fea30 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.624+0000 7f20fd7b1640 1 -- 172.21.15.17:0/205542239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f819fab0 con 0x7f20f80fea30 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.624+0000 7f20effff640 1 -- 172.21.15.17:0/205542239 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20f0003a20 con 0x7f20f80fea30 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.624+0000 7f20fd7b1640 1 -- 172.21.15.17:0/205542239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f819fe10 con 0x7f20f80fea30 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.625+0000 7f20fd7b1640 1 -- 172.21.15.17:0/205542239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f8100170 con 0x7f20f80fea30 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.625+0000 7f20effff640 1 -- 172.21.15.17:0/205542239 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f20f0031c90 con 0x7f20f80fea30 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.626+0000 7f20effff640 1 --2- 172.21.15.17:0/205542239 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20e406e170 0x7f20e4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.626+0000 7f20effff640 1 -- 172.21.15.17:0/205542239 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f20f00af220 con 0x7f20f80fea30 2024-08-19T01:06:50.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.626+0000 7f20f67fc640 1 --2- 172.21.15.17:0/205542239 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20e406e170 0x7f20e4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.626+0000 7f20f67fc640 1 --2- 172.21.15.17:0/205542239 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20e406e170 0x7f20e4070630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20f8068c90 tx=0x7f20e0009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:50.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.630+0000 7f20effff640 1 -- 172.21.15.17:0/205542239 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f20f0078500 con 0x7f20f80fea30 2024-08-19T01:06:50.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.815+0000 7f20fd7b1640 1 -- 172.21.15.17:0/205542239 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f20f8068ab0 con 0x7f20e406e170 2024-08-19T01:06:50.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.827+0000 7f20effff640 1 -- 172.21.15.17:0/205542239 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f20f8068ab0 con 0x7f20e406e170 2024-08-19T01:06:50.829 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:06:50.829 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (8m) 2m ago 18m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:06:50.829 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (19m) 2m ago 19m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:06:50.829 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (18m) 108s ago 18m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:06:50.829 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (5m) 2m ago 18m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:06:50.829 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (5m) 108s ago 17m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:06:50.830 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (7m) 2m ago 18m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:06:50.830 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (2m) 2m ago 13m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:06:50.830 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (2m) 2m ago 13m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:06:50.830 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (13m) 108s ago 13m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:06:50.830 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (111s) 108s ago 13m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:06:50.830 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (10m) 2m ago 20m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:06:50.830 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (8m) 108s ago 17m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:06:50.830 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (6m) 2m ago 20m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:06:50.830 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (6m) 108s ago 17m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:06:50.830 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (8m) 2m ago 18m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:06:50.830 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (8m) 108s ago 17m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:06:50.831 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (5m) 2m ago 16m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:06:50.831 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (4m) 2m ago 16m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:06:50.831 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (4m) 2m ago 16m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:06:50.831 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (3m) 108s ago 15m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:06:50.831 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (3m) 108s ago 15m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:06:50.831 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (2m) 108s ago 14m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:06:50.831 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (8m) 2m ago 18m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:06:50.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.829+0000 7f20fd7b1640 1 -- 172.21.15.17:0/205542239 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20e406e170 msgr2=0x7f20e4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.829+0000 7f20fd7b1640 1 --2- 172.21.15.17:0/205542239 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20e406e170 0x7f20e4070630 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f20f8068c90 tx=0x7f20e0009110 comp rx=0 tx=0).stop 2024-08-19T01:06:50.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.829+0000 7f20fd7b1640 1 -- 172.21.15.17:0/205542239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f80fea30 msgr2=0x7f20f8196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.829+0000 7f20fd7b1640 1 --2- 172.21.15.17:0/205542239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f80fea30 0x7f20f8196a40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f20f002a9c0 tx=0x7f20f00055a0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.829+0000 7f20fd7b1640 1 -- 172.21.15.17:0/205542239 shutdown_connections 2024-08-19T01:06:50.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.829+0000 7f20fd7b1640 1 --2- 172.21.15.17:0/205542239 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20e406e170 0x7f20e4070630 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.829+0000 7f20fd7b1640 1 --2- 172.21.15.17:0/205542239 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20f8104a30 0x7f20f8196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.829+0000 7f20fd7b1640 1 --2- 172.21.15.17:0/205542239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20f80fea30 0x7f20f8196a40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.829+0000 7f20fd7b1640 1 -- 172.21.15.17:0/205542239 >> 172.21.15.17:0/205542239 conn(0x7f20f80fa730 msgr2=0x7f20f80fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:50.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.829+0000 7f20fd7b1640 1 -- 172.21.15.17:0/205542239 shutdown_connections 2024-08-19T01:06:50.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.829+0000 7f20fd7b1640 1 -- 172.21.15.17:0/205542239 wait complete. 2024-08-19T01:06:50.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.909+0000 7f1d622d6640 1 -- 172.21.15.17:0/169536260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d5c100d50 msgr2=0x7f1d5c101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.909+0000 7f1d622d6640 1 --2- 172.21.15.17:0/169536260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d5c100d50 0x7f1d5c101130 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009880 tx=0x7f1d4c02a530 comp rx=0 tx=0).stop 2024-08-19T01:06:50.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.910+0000 7f1d622d6640 1 -- 172.21.15.17:0/169536260 shutdown_connections 2024-08-19T01:06:50.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.910+0000 7f1d622d6640 1 --2- 172.21.15.17:0/169536260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d5c101670 0x7f1d5c109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.910+0000 7f1d622d6640 1 --2- 172.21.15.17:0/169536260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d5c100d50 0x7f1d5c101130 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.910+0000 7f1d622d6640 1 -- 172.21.15.17:0/169536260 >> 172.21.15.17:0/169536260 conn(0x7f1d5c0758a0 msgr2=0x7f1d5c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:50.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.910+0000 7f1d622d6640 1 -- 172.21.15.17:0/169536260 shutdown_connections 2024-08-19T01:06:50.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.910+0000 7f1d622d6640 1 -- 172.21.15.17:0/169536260 wait complete. 2024-08-19T01:06:50.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.910+0000 7f1d622d6640 1 Processor -- start 2024-08-19T01:06:50.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.910+0000 7f1d622d6640 1 -- start start 2024-08-19T01:06:50.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d622d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d5c100d50 0x7f1d5c19b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d622d6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d5c101670 0x7f1d5c19bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d622d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c19c340 con 0x7f1d5c100d50 2024-08-19T01:06:50.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d622d6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c195960 con 0x7f1d5c101670 2024-08-19T01:06:50.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d5c100d50 0x7f1d5c19b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d5bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d5c100d50 0x7f1d5c19b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46010/0 (socket says 172.21.15.17:46010) 2024-08-19T01:06:50.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d5bfff640 1 -- 172.21.15.17:0/3828032226 learned_addr learned my addr 172.21.15.17:0/3828032226 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:50.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d5b7fe640 1 --2- 172.21.15.17:0/3828032226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d5c101670 0x7f1d5c19bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d5bfff640 1 -- 172.21.15.17:0/3828032226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d5c101670 msgr2=0x7f1d5c19bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:50.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d5bfff640 1 --2- 172.21.15.17:0/3828032226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d5c101670 0x7f1d5c19bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:50.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d5bfff640 1 -- 172.21.15.17:0/3828032226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c009560 con 0x7f1d5c100d50 2024-08-19T01:06:50.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d5bfff640 1 --2- 172.21.15.17:0/3828032226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d5c100d50 0x7f1d5c19b870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c005940 tx=0x7f1d4c032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:50.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.911+0000 7f1d597fa640 1 -- 172.21.15.17:0/3828032226 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d4c005220 con 0x7f1d5c100d50 2024-08-19T01:06:50.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.912+0000 7f1d597fa640 1 -- 172.21.15.17:0/3828032226 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d4c005380 con 0x7f1d5c100d50 2024-08-19T01:06:50.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.912+0000 7f1d622d6640 1 -- 172.21.15.17:0/3828032226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5c195be0 con 0x7f1d5c100d50 2024-08-19T01:06:50.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.912+0000 7f1d597fa640 1 -- 172.21.15.17:0/3828032226 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d4c0039b0 con 0x7f1d5c100d50 2024-08-19T01:06:50.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.912+0000 7f1d622d6640 1 -- 172.21.15.17:0/3828032226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5c1960d0 con 0x7f1d5c100d50 2024-08-19T01:06:50.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.913+0000 7f1d622d6640 1 -- 172.21.15.17:0/3828032226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5c068470 con 0x7f1d5c100d50 2024-08-19T01:06:50.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.913+0000 7f1d597fa640 1 -- 172.21.15.17:0/3828032226 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1d4c02ad50 con 0x7f1d5c100d50 2024-08-19T01:06:50.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.914+0000 7f1d597fa640 1 --2- 172.21.15.17:0/3828032226 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1d4406e170 0x7f1d44070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:50.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.914+0000 7f1d597fa640 1 -- 172.21.15.17:0/3828032226 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1d4c0aea80 con 0x7f1d5c100d50 2024-08-19T01:06:50.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.914+0000 7f1d5b7fe640 1 --2- 172.21.15.17:0/3828032226 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1d4406e170 0x7f1d44070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:50.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.914+0000 7f1d5b7fe640 1 --2- 172.21.15.17:0/3828032226 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1d4406e170 0x7f1d44070630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c196dd0 tx=0x7f1d5000a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:50.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:50.918+0000 7f1d597fa640 1 -- 172.21.15.17:0/3828032226 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1d4c077de0 con 0x7f1d5c100d50 2024-08-19T01:06:51.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.161+0000 7f1d622d6640 1 -- 172.21.15.17:0/3828032226 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1d5c1043e0 con 0x7f1d5c100d50 2024-08-19T01:06:51.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:50 smithi017 ceph-mon[99370]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:51.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:50 smithi017 ceph-mon[99370]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:51.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:50 smithi017 ceph-mon[99370]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:51.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.161+0000 7f1d597fa640 1 -- 172.21.15.17:0/3828032226 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f1d4c049350 con 0x7f1d5c100d50 2024-08-19T01:06:51.164 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:06:51.164 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:06:51.164 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:06:51.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:06:51.164 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:06:51.164 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:06:51.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:06:51.165 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:06:51.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.164+0000 7f1d622d6640 1 -- 172.21.15.17:0/3828032226 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1d4406e170 msgr2=0x7f1d44070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.164+0000 7f1d622d6640 1 --2- 172.21.15.17:0/3828032226 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1d4406e170 0x7f1d44070630 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1d5c196dd0 tx=0x7f1d5000a2d0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.164+0000 7f1d622d6640 1 -- 172.21.15.17:0/3828032226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d5c100d50 msgr2=0x7f1d5c19b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.164+0000 7f1d622d6640 1 --2- 172.21.15.17:0/3828032226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d5c100d50 0x7f1d5c19b870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c005940 tx=0x7f1d4c032bd0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.165+0000 7f1d622d6640 1 -- 172.21.15.17:0/3828032226 shutdown_connections 2024-08-19T01:06:51.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.165+0000 7f1d622d6640 1 --2- 172.21.15.17:0/3828032226 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1d4406e170 0x7f1d44070630 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.165+0000 7f1d622d6640 1 --2- 172.21.15.17:0/3828032226 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d5c101670 0x7f1d5c19bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.165+0000 7f1d622d6640 1 --2- 172.21.15.17:0/3828032226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d5c100d50 0x7f1d5c19b870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.165+0000 7f1d622d6640 1 -- 172.21.15.17:0/3828032226 >> 172.21.15.17:0/3828032226 conn(0x7f1d5c0758a0 msgr2=0x7f1d5c101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:51.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.165+0000 7f1d622d6640 1 -- 172.21.15.17:0/3828032226 shutdown_connections 2024-08-19T01:06:51.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.165+0000 7f1d622d6640 1 -- 172.21.15.17:0/3828032226 wait complete. 2024-08-19T01:06:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.248+0000 7ff9a51c2640 1 -- 172.21.15.17:0/457239468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a0100750 msgr2=0x7ff9a01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.248+0000 7ff9a51c2640 1 --2- 172.21.15.17:0/457239468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a0100750 0x7ff9a01047a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff988009880 tx=0x7ff98802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.248+0000 7ff9a51c2640 1 -- 172.21.15.17:0/457239468 shutdown_connections 2024-08-19T01:06:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.248+0000 7ff9a51c2640 1 --2- 172.21.15.17:0/457239468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a0100750 0x7ff9a01047a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.248+0000 7ff9a51c2640 1 --2- 172.21.15.17:0/457239468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a00ffda0 0x7ff9a0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.248+0000 7ff9a51c2640 1 -- 172.21.15.17:0/457239468 >> 172.21.15.17:0/457239468 conn(0x7ff9a00fb840 msgr2=0x7ff9a00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:51.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.248+0000 7ff9a51c2640 1 -- 172.21.15.17:0/457239468 shutdown_connections 2024-08-19T01:06:51.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.248+0000 7ff9a51c2640 1 -- 172.21.15.17:0/457239468 wait complete. 2024-08-19T01:06:51.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff9a51c2640 1 Processor -- start 2024-08-19T01:06:51.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff9a51c2640 1 -- start start 2024-08-19T01:06:51.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff9a51c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a00ffda0 0x7ff9a019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:51.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff9a51c2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a0100750 0x7ff9a019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff9a51c2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0195930 con 0x7ff9a00ffda0 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff9a51c2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0195a70 con 0x7ff9a0100750 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff99ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a00ffda0 0x7ff9a019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff99ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a00ffda0 0x7ff9a019b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46018/0 (socket says 172.21.15.17:46018) 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff99ed9d640 1 -- 172.21.15.17:0/3732278666 learned_addr learned my addr 172.21.15.17:0/3732278666 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff99e59c640 1 --2- 172.21.15.17:0/3732278666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a0100750 0x7ff9a019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff99ed9d640 1 -- 172.21.15.17:0/3732278666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a0100750 msgr2=0x7ff9a019be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.249+0000 7ff99ed9d640 1 --2- 172.21.15.17:0/3732278666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a0100750 0x7ff9a019be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.250+0000 7ff99ed9d640 1 -- 172.21.15.17:0/3732278666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988009560 con 0x7ff9a00ffda0 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.250+0000 7ff99ed9d640 1 --2- 172.21.15.17:0/3732278666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a00ffda0 0x7ff9a019b8d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff99000eb10 tx=0x7ff99000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.250+0000 7ff997fff640 1 -- 172.21.15.17:0/3732278666 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff990004b20 con 0x7ff9a00ffda0 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.250+0000 7ff9a51c2640 1 -- 172.21.15.17:0/3732278666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a0195d50 con 0x7ff9a00ffda0 2024-08-19T01:06:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.250+0000 7ff997fff640 1 -- 172.21.15.17:0/3732278666 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff990004c80 con 0x7ff9a00ffda0 2024-08-19T01:06:51.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.250+0000 7ff997fff640 1 -- 172.21.15.17:0/3732278666 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff990010640 con 0x7ff9a00ffda0 2024-08-19T01:06:51.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.250+0000 7ff9a51c2640 1 -- 172.21.15.17:0/3732278666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a0196270 con 0x7ff9a00ffda0 2024-08-19T01:06:51.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.251+0000 7ff9a51c2640 1 -- 172.21.15.17:0/3732278666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a0101280 con 0x7ff9a00ffda0 2024-08-19T01:06:51.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.252+0000 7ff997fff640 1 -- 172.21.15.17:0/3732278666 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff9900055e0 con 0x7ff9a00ffda0 2024-08-19T01:06:51.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.252+0000 7ff997fff640 1 --2- 172.21.15.17:0/3732278666 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98c06e180 0x7ff98c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:51.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.252+0000 7ff997fff640 1 -- 172.21.15.17:0/3732278666 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff990014070 con 0x7ff9a00ffda0 2024-08-19T01:06:51.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.252+0000 7ff99e59c640 1 --2- 172.21.15.17:0/3732278666 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98c06e180 0x7ff98c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:51.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.253+0000 7ff99e59c640 1 --2- 172.21.15.17:0/3732278666 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98c06e180 0x7ff98c070640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff988009230 tx=0x7ff988005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:51.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.257+0000 7ff997fff640 1 -- 172.21.15.17:0/3732278666 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff990057b70 con 0x7ff9a00ffda0 2024-08-19T01:06:51.435 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:50 smithi086 ceph-mon[71303]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:51.435 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:50 smithi086 ceph-mon[71303]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:51.435 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:50 smithi086 ceph-mon[71303]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:51.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.467+0000 7ff9a51c2640 1 -- 172.21.15.17:0/3732278666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff9a01080b0 con 0x7ff9a00ffda0 2024-08-19T01:06:51.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.467+0000 7ff997fff640 1 -- 172.21.15.17:0/3732278666 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7ff99005b230 con 0x7ff9a00ffda0 2024-08-19T01:06:51.469 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:06:51.469 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:06:51.469 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:06:51.469 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:06:51.470 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:06:51.471 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:06:51.472 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:06:51.473 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:06:51.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.469+0000 7ff9a51c2640 1 -- 172.21.15.17:0/3732278666 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98c06e180 msgr2=0x7ff98c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.469+0000 7ff9a51c2640 1 --2- 172.21.15.17:0/3732278666 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98c06e180 0x7ff98c070640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff988009230 tx=0x7ff988005a20 comp rx=0 tx=0).stop 2024-08-19T01:06:51.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.469+0000 7ff9a51c2640 1 -- 172.21.15.17:0/3732278666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a00ffda0 msgr2=0x7ff9a019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.469+0000 7ff9a51c2640 1 --2- 172.21.15.17:0/3732278666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a00ffda0 0x7ff9a019b8d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff99000eb10 tx=0x7ff99000c2d0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.469+0000 7ff9a51c2640 1 -- 172.21.15.17:0/3732278666 shutdown_connections 2024-08-19T01:06:51.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.469+0000 7ff9a51c2640 1 --2- 172.21.15.17:0/3732278666 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98c06e180 0x7ff98c070640 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.469+0000 7ff9a51c2640 1 --2- 172.21.15.17:0/3732278666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9a0100750 0x7ff9a019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.469+0000 7ff9a51c2640 1 --2- 172.21.15.17:0/3732278666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9a00ffda0 0x7ff9a019b8d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.469+0000 7ff9a51c2640 1 -- 172.21.15.17:0/3732278666 >> 172.21.15.17:0/3732278666 conn(0x7ff9a00fb840 msgr2=0x7ff9a00fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:51.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.469+0000 7ff9a51c2640 1 -- 172.21.15.17:0/3732278666 shutdown_connections 2024-08-19T01:06:51.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.469+0000 7ff9a51c2640 1 -- 172.21.15.17:0/3732278666 wait complete. 2024-08-19T01:06:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.552+0000 7f9d6036b640 1 -- 172.21.15.17:0/2226965342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d58100d30 msgr2=0x7f9d58101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.552+0000 7f9d6036b640 1 --2- 172.21.15.17:0/2226965342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d58100d30 0x7f9d58101110 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9d540098b0 tx=0x7f9d5402a560 comp rx=0 tx=0).stop 2024-08-19T01:06:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.552+0000 7f9d6036b640 1 -- 172.21.15.17:0/2226965342 shutdown_connections 2024-08-19T01:06:51.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.552+0000 7f9d6036b640 1 --2- 172.21.15.17:0/2226965342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d58101650 0x7f9d58109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.552+0000 7f9d6036b640 1 --2- 172.21.15.17:0/2226965342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d58100d30 0x7f9d58101110 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.552+0000 7f9d6036b640 1 -- 172.21.15.17:0/2226965342 >> 172.21.15.17:0/2226965342 conn(0x7f9d580fa730 msgr2=0x7f9d580fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:51.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.552+0000 7f9d6036b640 1 -- 172.21.15.17:0/2226965342 shutdown_connections 2024-08-19T01:06:51.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.552+0000 7f9d6036b640 1 -- 172.21.15.17:0/2226965342 wait complete. 2024-08-19T01:06:51.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d6036b640 1 Processor -- start 2024-08-19T01:06:51.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d6036b640 1 -- start start 2024-08-19T01:06:51.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d6036b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d58100d30 0x7f9d5819b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d6036b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d58101650 0x7f9d5819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d6036b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5819c3d0 con 0x7f9d58100d30 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d6036b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d58195960 con 0x7f9d58101650 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d5e107640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d58100d30 0x7f9d5819b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d5e107640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d58100d30 0x7f9d5819b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46026/0 (socket says 172.21.15.17:46026) 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d5e107640 1 -- 172.21.15.17:0/1057134039 learned_addr learned my addr 172.21.15.17:0/1057134039 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d5d906640 1 --2- 172.21.15.17:0/1057134039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d58101650 0x7f9d5819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d5e107640 1 -- 172.21.15.17:0/1057134039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d58101650 msgr2=0x7f9d5819bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d5e107640 1 --2- 172.21.15.17:0/1057134039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d58101650 0x7f9d5819bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.553+0000 7f9d5e107640 1 -- 172.21.15.17:0/1057134039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54009560 con 0x7f9d58100d30 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.554+0000 7f9d5e107640 1 --2- 172.21.15.17:0/1057134039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d58100d30 0x7f9d5819b870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9d54006010 tx=0x7f9d540055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:51.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.554+0000 7f9d4f7fe640 1 -- 172.21.15.17:0/1057134039 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d54004aa0 con 0x7f9d58100d30 2024-08-19T01:06:51.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.554+0000 7f9d4f7fe640 1 -- 172.21.15.17:0/1057134039 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d54031470 con 0x7f9d58100d30 2024-08-19T01:06:51.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.554+0000 7f9d6036b640 1 -- 172.21.15.17:0/1057134039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d58195be0 con 0x7f9d58100d30 2024-08-19T01:06:51.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.554+0000 7f9d4f7fe640 1 -- 172.21.15.17:0/1057134039 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d54003940 con 0x7f9d58100d30 2024-08-19T01:06:51.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.554+0000 7f9d6036b640 1 -- 172.21.15.17:0/1057134039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d581960d0 con 0x7f9d58100d30 2024-08-19T01:06:51.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.555+0000 7f9d6036b640 1 -- 172.21.15.17:0/1057134039 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d58068cd0 con 0x7f9d58100d30 2024-08-19T01:06:51.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.555+0000 7f9d4f7fe640 1 -- 172.21.15.17:0/1057134039 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9d54031b90 con 0x7f9d58100d30 2024-08-19T01:06:51.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.556+0000 7f9d4f7fe640 1 --2- 172.21.15.17:0/1057134039 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4406e170 0x7f9d44070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:51.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.556+0000 7f9d4f7fe640 1 -- 172.21.15.17:0/1057134039 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9d540af270 con 0x7f9d58100d30 2024-08-19T01:06:51.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.556+0000 7f9d5d906640 1 --2- 172.21.15.17:0/1057134039 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4406e170 0x7f9d44070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:51.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.556+0000 7f9d5d906640 1 --2- 172.21.15.17:0/1057134039 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4406e170 0x7f9d44070630 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9d48005fd0 tx=0x7f9d48005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:51.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.560+0000 7f9d4f7fe640 1 -- 172.21.15.17:0/1057134039 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9d54078550 con 0x7f9d58100d30 2024-08-19T01:06:51.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.754+0000 7f9d6036b640 1 -- 172.21.15.17:0/1057134039 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d581044e0 con 0x7f9d4406e170 2024-08-19T01:06:51.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.755+0000 7f9d4f7fe640 1 -- 172.21.15.17:0/1057134039 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9d581044e0 con 0x7f9d4406e170 2024-08-19T01:06:51.757 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:06:51.757 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:06:51.757 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:06:51.757 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:06:51.757 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:06:51.757 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:06:51.757 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:06:51.757 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:06:51.758 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:06:51.758 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:06:51.758 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:06:51.758 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:06:51.758 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:06:51.758 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:06:51.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.758+0000 7f9d6036b640 1 -- 172.21.15.17:0/1057134039 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4406e170 msgr2=0x7f9d44070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.758+0000 7f9d6036b640 1 --2- 172.21.15.17:0/1057134039 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4406e170 0x7f9d44070630 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9d48005fd0 tx=0x7f9d48005850 comp rx=0 tx=0).stop 2024-08-19T01:06:51.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.758+0000 7f9d6036b640 1 -- 172.21.15.17:0/1057134039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d58100d30 msgr2=0x7f9d5819b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.758+0000 7f9d6036b640 1 --2- 172.21.15.17:0/1057134039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d58100d30 0x7f9d5819b870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9d54006010 tx=0x7f9d540055a0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.758+0000 7f9d6036b640 1 -- 172.21.15.17:0/1057134039 shutdown_connections 2024-08-19T01:06:51.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.758+0000 7f9d6036b640 1 --2- 172.21.15.17:0/1057134039 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9d4406e170 0x7f9d44070630 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.758+0000 7f9d6036b640 1 --2- 172.21.15.17:0/1057134039 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9d58101650 0x7f9d5819bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.758+0000 7f9d6036b640 1 --2- 172.21.15.17:0/1057134039 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9d58100d30 0x7f9d5819b870 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.758+0000 7f9d6036b640 1 -- 172.21.15.17:0/1057134039 >> 172.21.15.17:0/1057134039 conn(0x7f9d580fa730 msgr2=0x7f9d58101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:51.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.758+0000 7f9d6036b640 1 -- 172.21.15.17:0/1057134039 shutdown_connections 2024-08-19T01:06:51.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.758+0000 7f9d6036b640 1 -- 172.21.15.17:0/1057134039 wait complete. 2024-08-19T01:06:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.841+0000 7f797a5c9640 1 -- 172.21.15.17:0/675588820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7974100c60 msgr2=0x7f7974101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.841+0000 7f797a5c9640 1 --2- 172.21.15.17:0/675588820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7974100c60 0x7f7974101040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f79640098b0 tx=0x7f796402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.841+0000 7f797a5c9640 1 -- 172.21.15.17:0/675588820 shutdown_connections 2024-08-19T01:06:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.841+0000 7f797a5c9640 1 --2- 172.21.15.17:0/675588820 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7974101610 0x7f7974109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.841+0000 7f797a5c9640 1 --2- 172.21.15.17:0/675588820 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7974100c60 0x7f7974101040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.841+0000 7f797a5c9640 1 -- 172.21.15.17:0/675588820 >> 172.21.15.17:0/675588820 conn(0x7f79740fa730 msgr2=0x7f79740fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.841+0000 7f797a5c9640 1 -- 172.21.15.17:0/675588820 shutdown_connections 2024-08-19T01:06:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.841+0000 7f797a5c9640 1 -- 172.21.15.17:0/675588820 wait complete. 2024-08-19T01:06:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.841+0000 7f797a5c9640 1 Processor -- start 2024-08-19T01:06:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f797a5c9640 1 -- start start 2024-08-19T01:06:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f797a5c9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7974100c60 0x7f797419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f797a5c9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7974101610 0x7f797419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f797a5c9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797419c3a0 con 0x7f7974100c60 2024-08-19T01:06:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f797a5c9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7974195930 con 0x7f7974101610 2024-08-19T01:06:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f7973fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7974100c60 0x7f797419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f7973fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7974100c60 0x7f797419b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46032/0 (socket says 172.21.15.17:46032) 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f7973fff640 1 -- 172.21.15.17:0/969393643 learned_addr learned my addr 172.21.15.17:0/969393643 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f79737fe640 1 --2- 172.21.15.17:0/969393643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7974101610 0x7f797419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f7973fff640 1 -- 172.21.15.17:0/969393643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7974101610 msgr2=0x7f797419bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f7973fff640 1 --2- 172.21.15.17:0/969393643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7974101610 0x7f797419bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.842+0000 7f7973fff640 1 -- 172.21.15.17:0/969393643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7964009560 con 0x7f7974100c60 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.843+0000 7f7973fff640 1 --2- 172.21.15.17:0/969393643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7974100c60 0x7f797419b840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7964006010 tx=0x7f79640055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.843+0000 7f79717fa640 1 -- 172.21.15.17:0/969393643 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7964004aa0 con 0x7f7974100c60 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.843+0000 7f79717fa640 1 -- 172.21.15.17:0/969393643 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7964031470 con 0x7f7974100c60 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.843+0000 7f797a5c9640 1 -- 172.21.15.17:0/969393643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7974195bb0 con 0x7f7974100c60 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.843+0000 7f79717fa640 1 -- 172.21.15.17:0/969393643 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7964003940 con 0x7f7974100c60 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.843+0000 7f797a5c9640 1 -- 172.21.15.17:0/969393643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79741960a0 con 0x7f7974100c60 2024-08-19T01:06:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.844+0000 7f797a5c9640 1 -- 172.21.15.17:0/969393643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7974068d30 con 0x7f7974100c60 2024-08-19T01:06:51.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.844+0000 7f79717fa640 1 -- 172.21.15.17:0/969393643 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7964031b90 con 0x7f7974100c60 2024-08-19T01:06:51.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.845+0000 7f79717fa640 1 --2- 172.21.15.17:0/969393643 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f795c06e170 0x7f795c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:06:51.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.845+0000 7f79717fa640 1 -- 172.21.15.17:0/969393643 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f79640af2a0 con 0x7f7974100c60 2024-08-19T01:06:51.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.845+0000 7f79737fe640 1 --2- 172.21.15.17:0/969393643 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f795c06e170 0x7f795c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:06:51.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.845+0000 7f79737fe640 1 --2- 172.21.15.17:0/969393643 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f795c06e170 0x7f795c070630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7968005fd0 tx=0x7f7968005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:06:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:51.849+0000 7f79717fa640 1 -- 172.21.15.17:0/969393643 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7964078580 con 0x7f7974100c60 2024-08-19T01:06:52.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.093+0000 7f797a5c9640 1 -- 172.21.15.17:0/969393643 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7974104310 con 0x7f7974100c60 2024-08-19T01:06:52.096 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:51 smithi017 ceph-mon[99370]: pgmap v242: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:52.096 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:51 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3828032226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:06:52.096 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:51 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3732278666' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:06:52.096 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:51 smithi017 ceph-mon[99370]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:52.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.094+0000 7f79717fa640 1 -- 172.21.15.17:0/969393643 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f7964004c00 con 0x7f7974100c60 2024-08-19T01:06:52.096 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:06:52.097 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:06:52.097 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:06:52.097 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:06:52.097 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:06:52.097 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:06:52.097 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:06:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.096+0000 7f797a5c9640 1 -- 172.21.15.17:0/969393643 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f795c06e170 msgr2=0x7f795c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.096+0000 7f797a5c9640 1 --2- 172.21.15.17:0/969393643 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f795c06e170 0x7f795c070630 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7968005fd0 tx=0x7f7968005850 comp rx=0 tx=0).stop 2024-08-19T01:06:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.096+0000 7f797a5c9640 1 -- 172.21.15.17:0/969393643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7974100c60 msgr2=0x7f797419b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:06:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.096+0000 7f797a5c9640 1 --2- 172.21.15.17:0/969393643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7974100c60 0x7f797419b840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7964006010 tx=0x7f79640055a0 comp rx=0 tx=0).stop 2024-08-19T01:06:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.096+0000 7f797a5c9640 1 -- 172.21.15.17:0/969393643 shutdown_connections 2024-08-19T01:06:52.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.096+0000 7f797a5c9640 1 --2- 172.21.15.17:0/969393643 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f795c06e170 0x7f795c070630 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.096+0000 7f797a5c9640 1 --2- 172.21.15.17:0/969393643 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7974101610 0x7f797419bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.096+0000 7f797a5c9640 1 --2- 172.21.15.17:0/969393643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7974100c60 0x7f797419b840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:06:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.096+0000 7f797a5c9640 1 -- 172.21.15.17:0/969393643 >> 172.21.15.17:0/969393643 conn(0x7f79740fa730 msgr2=0x7f7974101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:06:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.096+0000 7f797a5c9640 1 -- 172.21.15.17:0/969393643 shutdown_connections 2024-08-19T01:06:52.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:06:52.096+0000 7f797a5c9640 1 -- 172.21.15.17:0/969393643 wait complete. 2024-08-19T01:06:52.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:51 smithi086 ceph-mon[71303]: pgmap v242: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:52.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:51 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3828032226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:06:52.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:51 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3732278666' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:06:52.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:51 smithi086 ceph-mon[71303]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:06:53.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:52 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/969393643' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:06:53.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:52 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/969393643' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:06:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:53 smithi017 ceph-mon[99370]: pgmap v243: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:54.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:53 smithi086 ceph-mon[71303]: pgmap v243: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:56.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:55 smithi017 ceph-mon[99370]: pgmap v244: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:56.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:55 smithi086 ceph-mon[71303]: pgmap v244: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:57 smithi017 ceph-mon[99370]: pgmap v245: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:06:58.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:57 smithi086 ceph-mon[71303]: pgmap v245: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:06:59 smithi017 ceph-mon[99370]: pgmap v246: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:06:59 smithi086 ceph-mon[71303]: pgmap v246: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:01 smithi017 ceph-mon[99370]: pgmap v247: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:02.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:01 smithi086 ceph-mon[71303]: pgmap v247: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:03.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:02 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:07:03.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:02 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:07:04.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:03 smithi017 ceph-mon[99370]: pgmap v248: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:04.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:03 smithi086 ceph-mon[71303]: pgmap v248: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:06.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:06 smithi017 ceph-mon[99370]: pgmap v249: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:06.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:06 smithi086 ceph-mon[71303]: pgmap v249: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:08 smithi017 ceph-mon[99370]: pgmap v250: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:08.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:08 smithi086 ceph-mon[71303]: pgmap v250: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:10.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:10 smithi017 ceph-mon[99370]: pgmap v251: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:10.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:10 smithi086 ceph-mon[71303]: pgmap v251: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:12.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:12 smithi086 ceph-mon[71303]: pgmap v252: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:12.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:12 smithi017 ceph-mon[99370]: pgmap v252: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:14.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:14 smithi017 ceph-mon[99370]: pgmap v253: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:14.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:14 smithi086 ceph-mon[71303]: pgmap v253: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:16.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:16 smithi017 ceph-mon[99370]: pgmap v254: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:16.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:16 smithi086 ceph-mon[71303]: pgmap v254: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:18 smithi017 ceph-mon[99370]: pgmap v255: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:07:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:18 smithi086 ceph-mon[71303]: pgmap v255: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:07:20.384 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:20 smithi017 ceph-mon[99370]: pgmap v256: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:20.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:20 smithi086 ceph-mon[71303]: pgmap v256: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.192+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/1216658819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b78100d70 msgr2=0x7f1b78101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.192+0000 7f1b7fbbb640 1 --2- 172.21.15.17:0/1216658819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b78100d70 0x7f1b78101150 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009880 tx=0x7f1b7402a530 comp rx=0 tx=0).stop 2024-08-19T01:07:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.192+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/1216658819 shutdown_connections 2024-08-19T01:07:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.192+0000 7f1b7fbbb640 1 --2- 172.21.15.17:0/1216658819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b78101690 0x7f1b78109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.192+0000 7f1b7fbbb640 1 --2- 172.21.15.17:0/1216658819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b78100d70 0x7f1b78101150 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.192+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/1216658819 >> 172.21.15.17:0/1216658819 conn(0x7f1b780758a0 msgr2=0x7f1b780fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.192+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/1216658819 shutdown_connections 2024-08-19T01:07:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.192+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/1216658819 wait complete. 2024-08-19T01:07:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7fbbb640 1 Processor -- start 2024-08-19T01:07:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7fbbb640 1 -- start start 2024-08-19T01:07:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7fbbb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b78100d70 0x7f1b780fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7fbbb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b78101690 0x7f1b780fef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7fbbb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780ff450 con 0x7f1b78100d70 2024-08-19T01:07:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7fbbb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780ff5c0 con 0x7f1b78101690 2024-08-19T01:07:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7d957640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b78100d70 0x7f1b780fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7d957640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b78100d70 0x7f1b780fe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43380/0 (socket says 172.21.15.17:43380) 2024-08-19T01:07:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7d957640 1 -- 172.21.15.17:0/3431343405 learned_addr learned my addr 172.21.15.17:0/3431343405 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7d156640 1 --2- 172.21.15.17:0/3431343405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b78101690 0x7f1b780fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7d957640 1 -- 172.21.15.17:0/3431343405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b78101690 msgr2=0x7f1b780fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7d957640 1 --2- 172.21.15.17:0/3431343405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b78101690 0x7f1b780fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.193+0000 7f1b7d957640 1 -- 172.21.15.17:0/3431343405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b74009560 con 0x7f1b78100d70 2024-08-19T01:07:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.194+0000 7f1b7d957640 1 --2- 172.21.15.17:0/3431343405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b78100d70 0x7f1b780fe9d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b7402aa50 tx=0x7f1b74032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.194+0000 7f1b6effd640 1 -- 172.21.15.17:0/3431343405 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b740037c0 con 0x7f1b78100d70 2024-08-19T01:07:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.194+0000 7f1b6effd640 1 -- 172.21.15.17:0/3431343405 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b74005d50 con 0x7f1b78100d70 2024-08-19T01:07:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.194+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/3431343405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b780ff840 con 0x7f1b78100d70 2024-08-19T01:07:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.194+0000 7f1b6effd640 1 -- 172.21.15.17:0/3431343405 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b7403be30 con 0x7f1b78100d70 2024-08-19T01:07:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.194+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/3431343405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b781a1f00 con 0x7f1b78100d70 2024-08-19T01:07:22.199 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:22 smithi086 ceph-mon[71303]: pgmap v257: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:22.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.195+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/3431343405 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b78068450 con 0x7f1b78100d70 2024-08-19T01:07:22.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.196+0000 7f1b6effd640 1 -- 172.21.15.17:0/3431343405 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1b7402ad50 con 0x7f1b78100d70 2024-08-19T01:07:22.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.196+0000 7f1b6effd640 1 --2- 172.21.15.17:0/3431343405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b6406e110 0x7f1b640705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:22.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.196+0000 7f1b6effd640 1 -- 172.21.15.17:0/3431343405 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1b740aeb70 con 0x7f1b78100d70 2024-08-19T01:07:22.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.196+0000 7f1b7d156640 1 --2- 172.21.15.17:0/3431343405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b6406e110 0x7f1b640705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:22.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.197+0000 7f1b7d156640 1 --2- 172.21.15.17:0/3431343405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b6406e110 0x7f1b640705d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1b78100150 tx=0x7f1b6800b590 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:22.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.201+0000 7f1b6effd640 1 -- 172.21.15.17:0/3431343405 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1b74077e50 con 0x7f1b78100d70 2024-08-19T01:07:22.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.396+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/3431343405 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b780ff840 con 0x7f1b6406e110 2024-08-19T01:07:22.399 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:22 smithi017 ceph-mon[99370]: pgmap v257: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:22.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.398+0000 7f1b6effd640 1 -- 172.21.15.17:0/3431343405 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1b780ff840 con 0x7f1b6406e110 2024-08-19T01:07:22.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.399+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/3431343405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b6406e110 msgr2=0x7f1b640705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.399+0000 7f1b7fbbb640 1 --2- 172.21.15.17:0/3431343405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b6406e110 0x7f1b640705d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1b78100150 tx=0x7f1b6800b590 comp rx=0 tx=0).stop 2024-08-19T01:07:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.399+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/3431343405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b78100d70 msgr2=0x7f1b780fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.399+0000 7f1b7fbbb640 1 --2- 172.21.15.17:0/3431343405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b78100d70 0x7f1b780fe9d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b7402aa50 tx=0x7f1b74032bb0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.400+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/3431343405 shutdown_connections 2024-08-19T01:07:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.400+0000 7f1b7fbbb640 1 --2- 172.21.15.17:0/3431343405 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b6406e110 0x7f1b640705d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.400+0000 7f1b7fbbb640 1 --2- 172.21.15.17:0/3431343405 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b78101690 0x7f1b780fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.400+0000 7f1b7fbbb640 1 --2- 172.21.15.17:0/3431343405 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b78100d70 0x7f1b780fe9d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.400+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/3431343405 >> 172.21.15.17:0/3431343405 conn(0x7f1b780758a0 msgr2=0x7f1b78101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.400+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/3431343405 shutdown_connections 2024-08-19T01:07:22.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.400+0000 7f1b7fbbb640 1 -- 172.21.15.17:0/3431343405 wait complete. 2024-08-19T01:07:22.411 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:07:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.483+0000 7fd228c29640 1 -- 172.21.15.17:0/2514157558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd224105c00 msgr2=0x7fd224105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.483+0000 7fd228c29640 1 --2- 172.21.15.17:0/2514157558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd224105c00 0x7fd224105fe0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd214009c20 tx=0x7fd21402a970 comp rx=0 tx=0).stop 2024-08-19T01:07:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.483+0000 7fd228c29640 1 -- 172.21.15.17:0/2514157558 shutdown_connections 2024-08-19T01:07:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.483+0000 7fd228c29640 1 --2- 172.21.15.17:0/2514157558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd2240ffb50 0x7fd2240fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.483+0000 7fd228c29640 1 --2- 172.21.15.17:0/2514157558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd224105c00 0x7fd224105fe0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.483+0000 7fd228c29640 1 -- 172.21.15.17:0/2514157558 >> 172.21.15.17:0/2514157558 conn(0x7fd2240fb830 msgr2=0x7fd2240fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:22.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.484+0000 7fd228c29640 1 -- 172.21.15.17:0/2514157558 shutdown_connections 2024-08-19T01:07:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.484+0000 7fd228c29640 1 -- 172.21.15.17:0/2514157558 wait complete. 2024-08-19T01:07:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.484+0000 7fd228c29640 1 Processor -- start 2024-08-19T01:07:22.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.484+0000 7fd228c29640 1 -- start start 2024-08-19T01:07:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd228c29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2240ffb50 0x7fd22419b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd228c29640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd224105c00 0x7fd22419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd228c29640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22419c2f0 con 0x7fd2240ffb50 2024-08-19T01:07:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd228c29640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd224195880 con 0x7fd224105c00 2024-08-19T01:07:22.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd22259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2240ffb50 0x7fd22419b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd22259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2240ffb50 0x7fd22419b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43396/0 (socket says 172.21.15.17:43396) 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd22259c640 1 -- 172.21.15.17:0/2470588227 learned_addr learned my addr 172.21.15.17:0/2470588227 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd221d9b640 1 --2- 172.21.15.17:0/2470588227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd224105c00 0x7fd22419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd22259c640 1 -- 172.21.15.17:0/2470588227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd224105c00 msgr2=0x7fd22419bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd22259c640 1 --2- 172.21.15.17:0/2470588227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd224105c00 0x7fd22419bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd22259c640 1 -- 172.21.15.17:0/2470588227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214009900 con 0x7fd2240ffb50 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd22259c640 1 --2- 172.21.15.17:0/2470588227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2240ffb50 0x7fd22419b790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd214032000 tx=0x7fd2140308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd2137fe640 1 -- 172.21.15.17:0/2470588227 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd21402f590 con 0x7fd2240ffb50 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd228c29640 1 -- 172.21.15.17:0/2470588227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd224195b00 con 0x7fd2240ffb50 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.485+0000 7fd2137fe640 1 -- 172.21.15.17:0/2470588227 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd214030ca0 con 0x7fd2240ffb50 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.486+0000 7fd2137fe640 1 -- 172.21.15.17:0/2470588227 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd214039680 con 0x7fd2240ffb50 2024-08-19T01:07:22.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.486+0000 7fd228c29640 1 -- 172.21.15.17:0/2470588227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd224196070 con 0x7fd2240ffb50 2024-08-19T01:07:22.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.487+0000 7fd228c29640 1 -- 172.21.15.17:0/2470588227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd224101200 con 0x7fd2240ffb50 2024-08-19T01:07:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.487+0000 7fd2137fe640 1 -- 172.21.15.17:0/2470588227 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd21400a040 con 0x7fd2240ffb50 2024-08-19T01:07:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.487+0000 7fd2137fe640 1 --2- 172.21.15.17:0/2470588227 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd20c06e180 0x7fd20c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.487+0000 7fd2137fe640 1 -- 172.21.15.17:0/2470588227 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd21402c040 con 0x7fd2240ffb50 2024-08-19T01:07:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.487+0000 7fd221d9b640 1 --2- 172.21.15.17:0/2470588227 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd20c06e180 0x7fd20c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:22.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.488+0000 7fd221d9b640 1 --2- 172.21.15.17:0/2470588227 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd20c06e180 0x7fd20c070640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd224196cf0 tx=0x7fd21800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:22.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.492+0000 7fd2137fe640 1 -- 172.21.15.17:0/2470588227 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd214078720 con 0x7fd2240ffb50 2024-08-19T01:07:22.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.686+0000 7fd228c29640 1 -- 172.21.15.17:0/2470588227 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd22410cdc0 con 0x7fd20c06e180 2024-08-19T01:07:22.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.687+0000 7fd2137fe640 1 -- 172.21.15.17:0/2470588227 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd22410cdc0 con 0x7fd20c06e180 2024-08-19T01:07:22.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.689+0000 7fd228c29640 1 -- 172.21.15.17:0/2470588227 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd20c06e180 msgr2=0x7fd20c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.689+0000 7fd228c29640 1 --2- 172.21.15.17:0/2470588227 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd20c06e180 0x7fd20c070640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd224196cf0 tx=0x7fd21800b390 comp rx=0 tx=0).stop 2024-08-19T01:07:22.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.689+0000 7fd228c29640 1 -- 172.21.15.17:0/2470588227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2240ffb50 msgr2=0x7fd22419b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.689+0000 7fd228c29640 1 --2- 172.21.15.17:0/2470588227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2240ffb50 0x7fd22419b790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd214032000 tx=0x7fd2140308a0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.689+0000 7fd228c29640 1 -- 172.21.15.17:0/2470588227 shutdown_connections 2024-08-19T01:07:22.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.689+0000 7fd228c29640 1 --2- 172.21.15.17:0/2470588227 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd20c06e180 0x7fd20c070640 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.689+0000 7fd228c29640 1 --2- 172.21.15.17:0/2470588227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd224105c00 0x7fd22419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.689+0000 7fd228c29640 1 --2- 172.21.15.17:0/2470588227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2240ffb50 0x7fd22419b790 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.689+0000 7fd228c29640 1 -- 172.21.15.17:0/2470588227 >> 172.21.15.17:0/2470588227 conn(0x7fd2240fb830 msgr2=0x7fd2240fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:22.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.689+0000 7fd228c29640 1 -- 172.21.15.17:0/2470588227 shutdown_connections 2024-08-19T01:07:22.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.689+0000 7fd228c29640 1 -- 172.21.15.17:0/2470588227 wait complete. 2024-08-19T01:07:22.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.772+0000 7f3bf7538640 1 -- 172.21.15.17:0/4073312010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf0100750 msgr2=0x7f3bf01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.772+0000 7f3bf7538640 1 --2- 172.21.15.17:0/4073312010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf0100750 0x7f3bf01047a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009880 tx=0x7f3be002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.772+0000 7f3bf7538640 1 -- 172.21.15.17:0/4073312010 shutdown_connections 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.772+0000 7f3bf7538640 1 --2- 172.21.15.17:0/4073312010 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf0100750 0x7f3bf01047a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.772+0000 7f3bf7538640 1 --2- 172.21.15.17:0/4073312010 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bf00ffda0 0x7f3bf0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.772+0000 7f3bf7538640 1 -- 172.21.15.17:0/4073312010 >> 172.21.15.17:0/4073312010 conn(0x7f3bf00fb840 msgr2=0x7f3bf00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.772+0000 7f3bf7538640 1 -- 172.21.15.17:0/4073312010 shutdown_connections 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.772+0000 7f3bf7538640 1 -- 172.21.15.17:0/4073312010 wait complete. 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf7538640 1 Processor -- start 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf7538640 1 -- start start 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf7538640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bf00ffda0 0x7f3bf019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf7538640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf0100750 0x7f3bf019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf7538640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0195930 con 0x7f3bf0100750 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf7538640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0195a70 con 0x7f3bf00ffda0 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf4ad3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf0100750 0x7f3bf019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:22.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf4ad3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf0100750 0x7f3bf019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43418/0 (socket says 172.21.15.17:43418) 2024-08-19T01:07:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf4ad3640 1 -- 172.21.15.17:0/2969687658 learned_addr learned my addr 172.21.15.17:0/2969687658 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf52d4640 1 --2- 172.21.15.17:0/2969687658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bf00ffda0 0x7f3bf019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf4ad3640 1 -- 172.21.15.17:0/2969687658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bf00ffda0 msgr2=0x7f3bf019b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf4ad3640 1 --2- 172.21.15.17:0/2969687658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bf00ffda0 0x7f3bf019b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.773+0000 7f3bf4ad3640 1 -- 172.21.15.17:0/2969687658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be0009560 con 0x7f3bf0100750 2024-08-19T01:07:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.774+0000 7f3bf4ad3640 1 --2- 172.21.15.17:0/2969687658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf0100750 0x7f3bf019be10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3be002a9c0 tx=0x7f3be00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.774+0000 7f3be67fc640 1 -- 172.21.15.17:0/2969687658 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be0004aa0 con 0x7f3bf0100750 2024-08-19T01:07:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.774+0000 7f3be67fc640 1 -- 172.21.15.17:0/2969687658 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3be0004c00 con 0x7f3bf0100750 2024-08-19T01:07:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.774+0000 7f3be67fc640 1 -- 172.21.15.17:0/2969687658 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3be0003980 con 0x7f3bf0100750 2024-08-19T01:07:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.774+0000 7f3bf7538640 1 -- 172.21.15.17:0/2969687658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf0195cf0 con 0x7f3bf0100750 2024-08-19T01:07:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.774+0000 7f3bf7538640 1 -- 172.21.15.17:0/2969687658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf01961e0 con 0x7f3bf0100750 2024-08-19T01:07:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.775+0000 7f3bf7538640 1 -- 172.21.15.17:0/2969687658 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf0101280 con 0x7f3bf0100750 2024-08-19T01:07:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.775+0000 7f3be67fc640 1 -- 172.21.15.17:0/2969687658 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3be0003b20 con 0x7f3bf0100750 2024-08-19T01:07:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.776+0000 7f3be67fc640 1 --2- 172.21.15.17:0/2969687658 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3bdc06e170 0x7f3bdc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.776+0000 7f3bf52d4640 1 --2- 172.21.15.17:0/2969687658 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3bdc06e170 0x7f3bdc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.776+0000 7f3be67fc640 1 -- 172.21.15.17:0/2969687658 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3be00af080 con 0x7f3bf0100750 2024-08-19T01:07:22.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.777+0000 7f3bf52d4640 1 --2- 172.21.15.17:0/2969687658 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3bdc06e170 0x7f3bdc070630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3bec005fd0 tx=0x7f3bec00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:22.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.781+0000 7f3be67fc640 1 -- 172.21.15.17:0/2969687658 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3be0078490 con 0x7f3bf0100750 2024-08-19T01:07:22.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.966+0000 7f3bf7538640 1 -- 172.21.15.17:0/2969687658 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bf010cdd0 con 0x7f3bdc06e170 2024-08-19T01:07:22.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.975+0000 7f3be67fc640 1 -- 172.21.15.17:0/2969687658 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3bf010cdd0 con 0x7f3bdc06e170 2024-08-19T01:07:22.977 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (8m) 2m ago 19m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (19m) 2m ago 19m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (18m) 2m ago 18m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (6m) 2m ago 19m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (6m) 2m ago 18m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (8m) 2m ago 19m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (2m) 2m ago 13m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (2m) 2m ago 13m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (13m) 2m ago 13m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (2m) 2m ago 13m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (10m) 2m ago 20m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:07:22.978 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (9m) 2m ago 18m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:07:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (7m) 2m ago 20m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:07:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (7m) 2m ago 18m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:07:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (9m) 2m ago 19m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:07:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (9m) 2m ago 18m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:07:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (6m) 2m ago 17m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:07:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (5m) 2m ago 17m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:07:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (4m) 2m ago 16m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:07:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (4m) 2m ago 16m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:07:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (3m) 2m ago 15m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:07:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (3m) 2m ago 15m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:07:22.979 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (8m) 2m ago 18m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:07:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.977+0000 7f3bf7538640 1 -- 172.21.15.17:0/2969687658 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3bdc06e170 msgr2=0x7f3bdc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.977+0000 7f3bf7538640 1 --2- 172.21.15.17:0/2969687658 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3bdc06e170 0x7f3bdc070630 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3bec005fd0 tx=0x7f3bec00b390 comp rx=0 tx=0).stop 2024-08-19T01:07:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.977+0000 7f3bf7538640 1 -- 172.21.15.17:0/2969687658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf0100750 msgr2=0x7f3bf019be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.978+0000 7f3bf7538640 1 --2- 172.21.15.17:0/2969687658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf0100750 0x7f3bf019be10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3be002a9c0 tx=0x7f3be00055a0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.978+0000 7f3bf7538640 1 -- 172.21.15.17:0/2969687658 shutdown_connections 2024-08-19T01:07:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.978+0000 7f3bf7538640 1 --2- 172.21.15.17:0/2969687658 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3bdc06e170 0x7f3bdc070630 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.978+0000 7f3bf7538640 1 --2- 172.21.15.17:0/2969687658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3bf0100750 0x7f3bf019be10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.978+0000 7f3bf7538640 1 --2- 172.21.15.17:0/2969687658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3bf00ffda0 0x7f3bf019b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.978+0000 7f3bf7538640 1 -- 172.21.15.17:0/2969687658 >> 172.21.15.17:0/2969687658 conn(0x7f3bf00fb840 msgr2=0x7f3bf00fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.978+0000 7f3bf7538640 1 -- 172.21.15.17:0/2969687658 shutdown_connections 2024-08-19T01:07:22.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:22.978+0000 7f3bf7538640 1 -- 172.21.15.17:0/2969687658 wait complete. 2024-08-19T01:07:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.059+0000 7f8c820b5640 1 -- 172.21.15.17:0/1972048620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c1049f0 msgr2=0x7f8c7c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.059+0000 7f8c820b5640 1 --2- 172.21.15.17:0/1972048620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c1049f0 0x7f8c7c104dd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c009880 tx=0x7f8c6c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.059+0000 7f8c820b5640 1 -- 172.21.15.17:0/1972048620 shutdown_connections 2024-08-19T01:07:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.059+0000 7f8c820b5640 1 --2- 172.21.15.17:0/1972048620 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c7c0fe9f0 0x7f8c7c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.059+0000 7f8c820b5640 1 --2- 172.21.15.17:0/1972048620 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c1049f0 0x7f8c7c104dd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.059+0000 7f8c820b5640 1 -- 172.21.15.17:0/1972048620 >> 172.21.15.17:0/1972048620 conn(0x7f8c7c0758a0 msgr2=0x7f8c7c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.059+0000 7f8c820b5640 1 -- 172.21.15.17:0/1972048620 shutdown_connections 2024-08-19T01:07:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.059+0000 7f8c820b5640 1 -- 172.21.15.17:0/1972048620 wait complete. 2024-08-19T01:07:23.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.060+0000 7f8c820b5640 1 Processor -- start 2024-08-19T01:07:23.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.060+0000 7f8c820b5640 1 -- start start 2024-08-19T01:07:23.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.060+0000 7f8c820b5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c7c0fe9f0 0x7f8c7c196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.060+0000 7f8c820b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c1049f0 0x7f8c7c196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.060+0000 7f8c820b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c197490 con 0x7f8c7c1049f0 2024-08-19T01:07:23.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.060+0000 7f8c820b5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c197600 con 0x7f8c7c0fe9f0 2024-08-19T01:07:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.060+0000 7f8c7affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c1049f0 0x7f8c7c196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.060+0000 7f8c7affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c1049f0 0x7f8c7c196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43442/0 (socket says 172.21.15.17:43442) 2024-08-19T01:07:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.060+0000 7f8c7affd640 1 -- 172.21.15.17:0/1262102130 learned_addr learned my addr 172.21.15.17:0/1262102130 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.060+0000 7f8c7b7fe640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c7c0fe9f0 0x7f8c7c196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.061+0000 7f8c7affd640 1 -- 172.21.15.17:0/1262102130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c7c0fe9f0 msgr2=0x7f8c7c196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.061+0000 7f8c7affd640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c7c0fe9f0 0x7f8c7c196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.061+0000 7f8c7affd640 1 -- 172.21.15.17:0/1262102130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c009560 con 0x7f8c7c1049f0 2024-08-19T01:07:23.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.061+0000 7f8c7b7fe640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c7c0fe9f0 0x7f8c7c196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:07:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.061+0000 7f8c7affd640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c1049f0 0x7f8c7c196ec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000d6f0 tx=0x7f8c7000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.061+0000 7f8c78ff9640 1 -- 172.21.15.17:0/1262102130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c70009a30 con 0x7f8c7c1049f0 2024-08-19T01:07:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.061+0000 7f8c820b5640 1 -- 172.21.15.17:0/1262102130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c19f9f0 con 0x7f8c7c1049f0 2024-08-19T01:07:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.061+0000 7f8c78ff9640 1 -- 172.21.15.17:0/1262102130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c700054e0 con 0x7f8c7c1049f0 2024-08-19T01:07:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.061+0000 7f8c78ff9640 1 -- 172.21.15.17:0/1262102130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c70010460 con 0x7f8c7c1049f0 2024-08-19T01:07:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.061+0000 7f8c820b5640 1 -- 172.21.15.17:0/1262102130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c19fe60 con 0x7f8c7c1049f0 2024-08-19T01:07:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.062+0000 7f8c820b5640 1 -- 172.21.15.17:0/1262102130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c100130 con 0x7f8c7c1049f0 2024-08-19T01:07:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.063+0000 7f8c78ff9640 1 -- 172.21.15.17:0/1262102130 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8c70009b90 con 0x7f8c7c1049f0 2024-08-19T01:07:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.063+0000 7f8c78ff9640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c6406e170 0x7f8c64070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.063+0000 7f8c78ff9640 1 -- 172.21.15.17:0/1262102130 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8c7008dc50 con 0x7f8c7c1049f0 2024-08-19T01:07:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.063+0000 7f8c7b7fe640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c6406e170 0x7f8c64070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.064+0000 7f8c7b7fe640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c6406e170 0x7f8c64070630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c000c00 tx=0x7f8c6c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:23.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.067+0000 7f8c78ff9640 1 -- 172.21.15.17:0/1262102130 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8c70056fb0 con 0x7f8c7c1049f0 2024-08-19T01:07:23.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.311+0000 7f8c820b5640 1 -- 172.21.15.17:0/1262102130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c7c107000 con 0x7f8c7c1049f0 2024-08-19T01:07:23.314 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:23 smithi017 ceph-mon[99370]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:23.314 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:23 smithi017 ceph-mon[99370]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:23.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.312+0000 7f8c78ff9640 1 -- 172.21.15.17:0/1262102130 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f8c70017350 con 0x7f8c7c1049f0 2024-08-19T01:07:23.314 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:07:23.314 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:07:23.314 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:07:23.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:07:23.315 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:07:23.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:07:23.316 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:07:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.314+0000 7f8c820b5640 1 -- 172.21.15.17:0/1262102130 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c6406e170 msgr2=0x7f8c64070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.314+0000 7f8c820b5640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c6406e170 0x7f8c64070630 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c000c00 tx=0x7f8c6c005a20 comp rx=0 tx=0).stop 2024-08-19T01:07:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.314+0000 7f8c820b5640 1 -- 172.21.15.17:0/1262102130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c1049f0 msgr2=0x7f8c7c196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.314+0000 7f8c820b5640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c1049f0 0x7f8c7c196ec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8c7000d6f0 tx=0x7f8c7000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.314+0000 7f8c820b5640 1 -- 172.21.15.17:0/1262102130 shutdown_connections 2024-08-19T01:07:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.314+0000 7f8c820b5640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c6406e170 0x7f8c64070630 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.314+0000 7f8c820b5640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c7c1049f0 0x7f8c7c196ec0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.314+0000 7f8c820b5640 1 --2- 172.21.15.17:0/1262102130 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c7c0fe9f0 0x7f8c7c196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.314+0000 7f8c820b5640 1 -- 172.21.15.17:0/1262102130 >> 172.21.15.17:0/1262102130 conn(0x7f8c7c0758a0 msgr2=0x7f8c7c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.314+0000 7f8c820b5640 1 -- 172.21.15.17:0/1262102130 shutdown_connections 2024-08-19T01:07:23.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.314+0000 7f8c820b5640 1 -- 172.21.15.17:0/1262102130 wait complete. 2024-08-19T01:07:23.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.396+0000 7f396b3ce640 1 -- 172.21.15.17:0/3226045642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3964100cb0 msgr2=0x7f3964101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.396+0000 7f396b3ce640 1 --2- 172.21.15.17:0/3226045642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3964100cb0 0x7f3964101090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3954009880 tx=0x7f395402a530 comp rx=0 tx=0).stop 2024-08-19T01:07:23.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.396+0000 7f396b3ce640 1 -- 172.21.15.17:0/3226045642 shutdown_connections 2024-08-19T01:07:23.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.396+0000 7f396b3ce640 1 --2- 172.21.15.17:0/3226045642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39641015d0 0x7f3964109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.396+0000 7f396b3ce640 1 --2- 172.21.15.17:0/3226045642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3964100cb0 0x7f3964101090 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.396+0000 7f396b3ce640 1 -- 172.21.15.17:0/3226045642 >> 172.21.15.17:0/3226045642 conn(0x7f39640758a0 msgr2=0x7f39640fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:23.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.397+0000 7f396b3ce640 1 -- 172.21.15.17:0/3226045642 shutdown_connections 2024-08-19T01:07:23.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.397+0000 7f396b3ce640 1 -- 172.21.15.17:0/3226045642 wait complete. 2024-08-19T01:07:23.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.397+0000 7f396b3ce640 1 Processor -- start 2024-08-19T01:07:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.397+0000 7f396b3ce640 1 -- start start 2024-08-19T01:07:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.397+0000 7f396b3ce640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3964100cb0 0x7f396419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.397+0000 7f396b3ce640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39641015d0 0x7f396419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.397+0000 7f396b3ce640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396419c3d0 con 0x7f3964100cb0 2024-08-19T01:07:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.397+0000 7f396b3ce640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3964195960 con 0x7f39641015d0 2024-08-19T01:07:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f396916a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3964100cb0 0x7f396419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f396916a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3964100cb0 0x7f396419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43450/0 (socket says 172.21.15.17:43450) 2024-08-19T01:07:23.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f396916a640 1 -- 172.21.15.17:0/870188263 learned_addr learned my addr 172.21.15.17:0/870188263 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f3968969640 1 --2- 172.21.15.17:0/870188263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39641015d0 0x7f396419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f396916a640 1 -- 172.21.15.17:0/870188263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39641015d0 msgr2=0x7f396419bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f396916a640 1 --2- 172.21.15.17:0/870188263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39641015d0 0x7f396419bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f396916a640 1 -- 172.21.15.17:0/870188263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3954009560 con 0x7f3964100cb0 2024-08-19T01:07:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f396916a640 1 --2- 172.21.15.17:0/870188263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3964100cb0 0x7f396419b870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3954006010 tx=0x7f39540055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f39627fc640 1 -- 172.21.15.17:0/870188263 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39540048d0 con 0x7f3964100cb0 2024-08-19T01:07:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f396b3ce640 1 -- 172.21.15.17:0/870188263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3964195be0 con 0x7f3964100cb0 2024-08-19T01:07:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f39627fc640 1 -- 172.21.15.17:0/870188263 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3954031640 con 0x7f3964100cb0 2024-08-19T01:07:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f39627fc640 1 -- 172.21.15.17:0/870188263 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3954003820 con 0x7f3964100cb0 2024-08-19T01:07:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.398+0000 7f396b3ce640 1 -- 172.21.15.17:0/870188263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39641960d0 con 0x7f3964100cb0 2024-08-19T01:07:23.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.399+0000 7f396b3ce640 1 -- 172.21.15.17:0/870188263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3964068510 con 0x7f3964100cb0 2024-08-19T01:07:23.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.400+0000 7f39627fc640 1 -- 172.21.15.17:0/870188263 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f395402ad50 con 0x7f3964100cb0 2024-08-19T01:07:23.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.400+0000 7f39627fc640 1 --2- 172.21.15.17:0/870188263 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f394c06e180 0x7f394c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.400+0000 7f39627fc640 1 -- 172.21.15.17:0/870188263 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f39540aee50 con 0x7f3964100cb0 2024-08-19T01:07:23.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.400+0000 7f3968969640 1 --2- 172.21.15.17:0/870188263 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f394c06e180 0x7f394c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.401+0000 7f3968969640 1 --2- 172.21.15.17:0/870188263 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f394c06e180 0x7f394c070640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3964196dd0 tx=0x7f3958005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:23.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.405+0000 7f39627fc640 1 -- 172.21.15.17:0/870188263 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f39540781e0 con 0x7f3964100cb0 2024-08-19T01:07:23.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:23 smithi086 ceph-mon[71303]: from='client.34540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:23.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:23 smithi086 ceph-mon[71303]: from='client.34544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.618+0000 7f396b3ce640 1 -- 172.21.15.17:0/870188263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3964104340 con 0x7f3964100cb0 2024-08-19T01:07:23.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.618+0000 7f39627fc640 1 -- 172.21.15.17:0/870188263 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f395407b8a0 con 0x7f3964100cb0 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:07:23.621 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:07:23.622 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:07:23.623 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:07:23.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:07:23.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:07:23.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:07:23.624 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:07:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:07:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.621+0000 7f396b3ce640 1 -- 172.21.15.17:0/870188263 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f394c06e180 msgr2=0x7f394c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.621+0000 7f396b3ce640 1 --2- 172.21.15.17:0/870188263 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f394c06e180 0x7f394c070640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3964196dd0 tx=0x7f3958005f90 comp rx=0 tx=0).stop 2024-08-19T01:07:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.621+0000 7f396b3ce640 1 -- 172.21.15.17:0/870188263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3964100cb0 msgr2=0x7f396419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.621+0000 7f396b3ce640 1 --2- 172.21.15.17:0/870188263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3964100cb0 0x7f396419b870 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3954006010 tx=0x7f39540055a0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.621+0000 7f396b3ce640 1 -- 172.21.15.17:0/870188263 shutdown_connections 2024-08-19T01:07:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.621+0000 7f396b3ce640 1 --2- 172.21.15.17:0/870188263 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f394c06e180 0x7f394c070640 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.621+0000 7f396b3ce640 1 --2- 172.21.15.17:0/870188263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f39641015d0 0x7f396419bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.621+0000 7f396b3ce640 1 --2- 172.21.15.17:0/870188263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3964100cb0 0x7f396419b870 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.621+0000 7f396b3ce640 1 -- 172.21.15.17:0/870188263 >> 172.21.15.17:0/870188263 conn(0x7f39640758a0 msgr2=0x7f3964101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.621+0000 7f396b3ce640 1 -- 172.21.15.17:0/870188263 shutdown_connections 2024-08-19T01:07:23.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.621+0000 7f396b3ce640 1 -- 172.21.15.17:0/870188263 wait complete. 2024-08-19T01:07:23.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.704+0000 7f17bfea7640 1 -- 172.21.15.17:0/2821810122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8101610 msgr2=0x7f17b8109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.704+0000 7f17bfea7640 1 --2- 172.21.15.17:0/2821810122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8101610 0x7f17b8109b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f17b40098b0 tx=0x7f17b402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.704+0000 7f17bfea7640 1 -- 172.21.15.17:0/2821810122 shutdown_connections 2024-08-19T01:07:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.704+0000 7f17bfea7640 1 --2- 172.21.15.17:0/2821810122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8101610 0x7f17b8109b00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.704+0000 7f17bfea7640 1 --2- 172.21.15.17:0/2821810122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17b8100c60 0x7f17b8101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.704+0000 7f17bfea7640 1 -- 172.21.15.17:0/2821810122 >> 172.21.15.17:0/2821810122 conn(0x7f17b80fa730 msgr2=0x7f17b80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.704+0000 7f17bfea7640 1 -- 172.21.15.17:0/2821810122 shutdown_connections 2024-08-19T01:07:23.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.704+0000 7f17bfea7640 1 -- 172.21.15.17:0/2821810122 wait complete. 2024-08-19T01:07:23.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.705+0000 7f17bfea7640 1 Processor -- start 2024-08-19T01:07:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.705+0000 7f17bfea7640 1 -- start start 2024-08-19T01:07:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.705+0000 7f17bfea7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8100c60 0x7f17b819b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.705+0000 7f17bfea7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17b8101610 0x7f17b819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.705+0000 7f17bfea7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b819c3c0 con 0x7f17b8100c60 2024-08-19T01:07:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.705+0000 7f17bfea7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8195950 con 0x7f17b8101610 2024-08-19T01:07:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.705+0000 7f17bdc43640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8100c60 0x7f17b819b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.705+0000 7f17bdc43640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8100c60 0x7f17b819b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43470/0 (socket says 172.21.15.17:43470) 2024-08-19T01:07:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.705+0000 7f17bdc43640 1 -- 172.21.15.17:0/156629267 learned_addr learned my addr 172.21.15.17:0/156629267 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.705+0000 7f17bd442640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17b8101610 0x7f17b819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.706+0000 7f17bdc43640 1 -- 172.21.15.17:0/156629267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17b8101610 msgr2=0x7f17b819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.706+0000 7f17bdc43640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17b8101610 0x7f17b819bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.706+0000 7f17bdc43640 1 -- 172.21.15.17:0/156629267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4009560 con 0x7f17b8100c60 2024-08-19T01:07:23.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.706+0000 7f17bd442640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17b8101610 0x7f17b819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:07:23.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.706+0000 7f17bdc43640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8100c60 0x7f17b819b860 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00d8d0 tx=0x7f17ac00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:23.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.706+0000 7f17aaffd640 1 -- 172.21.15.17:0/156629267 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17ac009c00 con 0x7f17b8100c60 2024-08-19T01:07:23.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.706+0000 7f17aaffd640 1 -- 172.21.15.17:0/156629267 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17ac009d60 con 0x7f17b8100c60 2024-08-19T01:07:23.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.706+0000 7f17aaffd640 1 -- 172.21.15.17:0/156629267 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17ac0049d0 con 0x7f17b8100c60 2024-08-19T01:07:23.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.706+0000 7f17bfea7640 1 -- 172.21.15.17:0/156629267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b8195c30 con 0x7f17b8100c60 2024-08-19T01:07:23.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.706+0000 7f17bfea7640 1 -- 172.21.15.17:0/156629267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b8196100 con 0x7f17b8100c60 2024-08-19T01:07:23.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.707+0000 7f17bfea7640 1 -- 172.21.15.17:0/156629267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b8068d30 con 0x7f17b8100c60 2024-08-19T01:07:23.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.708+0000 7f17aaffd640 1 -- 172.21.15.17:0/156629267 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f17ac004c40 con 0x7f17b8100c60 2024-08-19T01:07:23.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.708+0000 7f17aaffd640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f17a406e170 0x7f17a4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.708+0000 7f17aaffd640 1 -- 172.21.15.17:0/156629267 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f17ac08ded0 con 0x7f17b8100c60 2024-08-19T01:07:23.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.708+0000 7f17bd442640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f17a406e170 0x7f17a4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.709+0000 7f17bd442640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f17a406e170 0x7f17a4070630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009230 tx=0x7f17b4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:23.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.713+0000 7f17aaffd640 1 -- 172.21.15.17:0/156629267 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f17ac0571b0 con 0x7f17b8100c60 2024-08-19T01:07:23.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.904+0000 7f17bfea7640 1 -- 172.21.15.17:0/156629267 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17b810cdb0 con 0x7f17a406e170 2024-08-19T01:07:23.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.905+0000 7f17aaffd640 1 -- 172.21.15.17:0/156629267 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f17b810cdb0 con 0x7f17a406e170 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:07:23.907 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:07:23.908 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:07:23.908 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:07:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.908+0000 7f17bfea7640 1 -- 172.21.15.17:0/156629267 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f17a406e170 msgr2=0x7f17a4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.908+0000 7f17bfea7640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f17a406e170 0x7f17a4070630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009230 tx=0x7f17b4005a20 comp rx=0 tx=0).stop 2024-08-19T01:07:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.908+0000 7f17bfea7640 1 -- 172.21.15.17:0/156629267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8100c60 msgr2=0x7f17b819b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.908+0000 7f17bfea7640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8100c60 0x7f17b819b860 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00d8d0 tx=0x7f17ac00dd90 comp rx=0 tx=0).stop 2024-08-19T01:07:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.908+0000 7f17bfea7640 1 -- 172.21.15.17:0/156629267 shutdown_connections 2024-08-19T01:07:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.908+0000 7f17bfea7640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f17a406e170 0x7f17a4070630 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.908+0000 7f17bfea7640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f17b8101610 0x7f17b819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.908+0000 7f17bfea7640 1 --2- 172.21.15.17:0/156629267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f17b8100c60 0x7f17b819b860 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.908+0000 7f17bfea7640 1 -- 172.21.15.17:0/156629267 >> 172.21.15.17:0/156629267 conn(0x7f17b80fa730 msgr2=0x7f17b8101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:23.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.908+0000 7f17bfea7640 1 -- 172.21.15.17:0/156629267 shutdown_connections 2024-08-19T01:07:23.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.908+0000 7f17bfea7640 1 -- 172.21.15.17:0/156629267 wait complete. 2024-08-19T01:07:23.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.990+0000 7f354b394640 1 -- 172.21.15.17:0/1557218020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35440ffda0 msgr2=0x7f3544100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.990+0000 7f354b394640 1 --2- 172.21.15.17:0/1557218020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35440ffda0 0x7f3544100180 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3540009880 tx=0x7f354002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.990+0000 7f354b394640 1 -- 172.21.15.17:0/1557218020 shutdown_connections 2024-08-19T01:07:23.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.990+0000 7f354b394640 1 --2- 172.21.15.17:0/1557218020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3544100750 0x7f35441047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.990+0000 7f354b394640 1 --2- 172.21.15.17:0/1557218020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35440ffda0 0x7f3544100180 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.990+0000 7f354b394640 1 -- 172.21.15.17:0/1557218020 >> 172.21.15.17:0/1557218020 conn(0x7f35440fb840 msgr2=0x7f35440fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:23.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.990+0000 7f354b394640 1 -- 172.21.15.17:0/1557218020 shutdown_connections 2024-08-19T01:07:23.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.990+0000 7f354b394640 1 -- 172.21.15.17:0/1557218020 wait complete. 2024-08-19T01:07:23.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354b394640 1 Processor -- start 2024-08-19T01:07:23.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354b394640 1 -- start start 2024-08-19T01:07:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354b394640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35440ffda0 0x7f35440727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354b394640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3544100750 0x7f3544072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354b394640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544073230 con 0x7f3544100750 2024-08-19T01:07:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354b394640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3544073370 con 0x7f35440ffda0 2024-08-19T01:07:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354892f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3544100750 0x7f3544072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354892f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3544100750 0x7f3544072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43488/0 (socket says 172.21.15.17:43488) 2024-08-19T01:07:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354892f640 1 -- 172.21.15.17:0/2569205986 learned_addr learned my addr 172.21.15.17:0/2569205986 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f3549130640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35440ffda0 0x7f35440727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354892f640 1 -- 172.21.15.17:0/2569205986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35440ffda0 msgr2=0x7f35440727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354892f640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35440ffda0 0x7f35440727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:23.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f354892f640 1 -- 172.21.15.17:0/2569205986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540009560 con 0x7f3544100750 2024-08-19T01:07:23.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.991+0000 7f3549130640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35440ffda0 0x7f35440727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:07:23.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.992+0000 7f354892f640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3544100750 0x7f3544072cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f353400d6f0 tx=0x7f353400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:23.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.992+0000 7f353a7fc640 1 -- 172.21.15.17:0/2569205986 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3534009a30 con 0x7f3544100750 2024-08-19T01:07:23.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.992+0000 7f353a7fc640 1 -- 172.21.15.17:0/2569205986 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35340054e0 con 0x7f3544100750 2024-08-19T01:07:23.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.992+0000 7f354b394640 1 -- 172.21.15.17:0/2569205986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35441a1db0 con 0x7f3544100750 2024-08-19T01:07:23.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.992+0000 7f353a7fc640 1 -- 172.21.15.17:0/2569205986 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3534010460 con 0x7f3544100750 2024-08-19T01:07:23.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.992+0000 7f354b394640 1 -- 172.21.15.17:0/2569205986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35441a21c0 con 0x7f3544100750 2024-08-19T01:07:23.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.993+0000 7f354b394640 1 -- 172.21.15.17:0/2569205986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3544101280 con 0x7f3544100750 2024-08-19T01:07:23.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.993+0000 7f353a7fc640 1 -- 172.21.15.17:0/2569205986 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3534009b90 con 0x7f3544100750 2024-08-19T01:07:23.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.994+0000 7f353a7fc640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f353006e170 0x7f3530070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:23.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.994+0000 7f353a7fc640 1 -- 172.21.15.17:0/2569205986 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f353408dc80 con 0x7f3544100750 2024-08-19T01:07:23.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.994+0000 7f3549130640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f353006e170 0x7f3530070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:23.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.995+0000 7f3549130640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f353006e170 0x7f3530070630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3540006010 tx=0x7f3540005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:24.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:23.998+0000 7f353a7fc640 1 -- 172.21.15.17:0/2569205986 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3534056fe0 con 0x7f3544100750 2024-08-19T01:07:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:24 smithi017 ceph-mon[99370]: pgmap v258: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:24 smithi017 ceph-mon[99370]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:24 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1262102130' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:07:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:24 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/870188263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:07:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:24 smithi017 ceph-mon[99370]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:24.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.240+0000 7f354b394640 1 -- 172.21.15.17:0/2569205986 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f35441080b0 con 0x7f3544100750 2024-08-19T01:07:24.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.241+0000 7f353a7fc640 1 -- 172.21.15.17:0/2569205986 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f3534020090 con 0x7f3544100750 2024-08-19T01:07:24.243 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:07:24.243 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:07:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:07:24.243 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:07:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:07:24.243 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:07:24.243 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:07:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.243+0000 7f354b394640 1 -- 172.21.15.17:0/2569205986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f353006e170 msgr2=0x7f3530070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.243+0000 7f354b394640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f353006e170 0x7f3530070630 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3540006010 tx=0x7f3540005e60 comp rx=0 tx=0).stop 2024-08-19T01:07:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.243+0000 7f354b394640 1 -- 172.21.15.17:0/2569205986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3544100750 msgr2=0x7f3544072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.243+0000 7f354b394640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3544100750 0x7f3544072cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f353400d6f0 tx=0x7f353400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:07:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.243+0000 7f354b394640 1 -- 172.21.15.17:0/2569205986 shutdown_connections 2024-08-19T01:07:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.243+0000 7f354b394640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f353006e170 0x7f3530070630 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:24.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.243+0000 7f354b394640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3544100750 0x7f3544072cf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.243+0000 7f354b394640 1 --2- 172.21.15.17:0/2569205986 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35440ffda0 0x7f35440727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.243+0000 7f354b394640 1 -- 172.21.15.17:0/2569205986 >> 172.21.15.17:0/2569205986 conn(0x7f35440fb840 msgr2=0x7f35440fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.243+0000 7f354b394640 1 -- 172.21.15.17:0/2569205986 shutdown_connections 2024-08-19T01:07:24.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:24.243+0000 7f354b394640 1 -- 172.21.15.17:0/2569205986 wait complete. 2024-08-19T01:07:24.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:24 smithi086 ceph-mon[71303]: pgmap v258: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:24.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:24 smithi086 ceph-mon[71303]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:24.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:24 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1262102130' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:07:24.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:24 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/870188263' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:07:24.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:24 smithi086 ceph-mon[71303]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:25.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:25 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2569205986' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:07:25.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:25 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2569205986' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:07:26.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:26 smithi017 ceph-mon[99370]: pgmap v259: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:26.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:26 smithi086 ceph-mon[71303]: pgmap v259: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:28.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:28 smithi017 ceph-mon[99370]: pgmap v260: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:28.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:28 smithi086 ceph-mon[71303]: pgmap v260: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:30.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:30 smithi017 ceph-mon[99370]: pgmap v261: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:30.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:30 smithi086 ceph-mon[71303]: pgmap v261: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:32.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:32 smithi017 ceph-mon[99370]: pgmap v262: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:32.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:32 smithi086 ceph-mon[71303]: pgmap v262: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:07:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:07:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:34 smithi017 ceph-mon[99370]: pgmap v263: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:34.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:34 smithi086 ceph-mon[71303]: pgmap v263: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:36.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:36 smithi017 ceph-mon[99370]: pgmap v264: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:36.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:36 smithi086 ceph-mon[71303]: pgmap v264: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:38.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:38 smithi017 ceph-mon[99370]: pgmap v265: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:38 smithi086 ceph-mon[71303]: pgmap v265: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:40.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:40 smithi017 ceph-mon[99370]: pgmap v266: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:40 smithi086 ceph-mon[71303]: pgmap v266: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:42 smithi017 ceph-mon[99370]: pgmap v267: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:42 smithi086 ceph-mon[71303]: pgmap v267: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:44.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:44 smithi017 ceph-mon[99370]: pgmap v268: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:44.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:44 smithi086 ceph-mon[71303]: pgmap v268: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:46 smithi017 ceph-mon[99370]: pgmap v269: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:46.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:46 smithi086 ceph-mon[71303]: pgmap v269: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:48 smithi017 ceph-mon[99370]: pgmap v270: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:07:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:48 smithi086 ceph-mon[71303]: pgmap v270: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:07:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:50 smithi017 ceph-mon[99370]: pgmap v271: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:50.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:50 smithi086 ceph-mon[71303]: pgmap v271: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:52.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:52 smithi017 ceph-mon[99370]: pgmap v272: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:52.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:52 smithi086 ceph-mon[71303]: pgmap v272: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:54.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.337+0000 7f231f34d640 1 -- 172.21.15.17:0/3968104281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23180ffda0 msgr2=0x7f2318100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:54.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.337+0000 7f231f34d640 1 --2- 172.21.15.17:0/3968104281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23180ffda0 0x7f2318100180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2314009880 tx=0x7f231402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.337+0000 7f231f34d640 1 -- 172.21.15.17:0/3968104281 shutdown_connections 2024-08-19T01:07:54.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.337+0000 7f231f34d640 1 --2- 172.21.15.17:0/3968104281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2318100750 0x7f23181047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.337+0000 7f231f34d640 1 --2- 172.21.15.17:0/3968104281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23180ffda0 0x7f2318100180 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.337+0000 7f231f34d640 1 -- 172.21.15.17:0/3968104281 >> 172.21.15.17:0/3968104281 conn(0x7f23180fb840 msgr2=0x7f23180fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:54.342 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:54 smithi017 ceph-mon[99370]: pgmap v273: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:54.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.338+0000 7f231f34d640 1 -- 172.21.15.17:0/3968104281 shutdown_connections 2024-08-19T01:07:54.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.338+0000 7f231f34d640 1 -- 172.21.15.17:0/3968104281 wait complete. 2024-08-19T01:07:54.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.338+0000 7f231f34d640 1 Processor -- start 2024-08-19T01:07:54.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231f34d640 1 -- start start 2024-08-19T01:07:54.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231f34d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180ffda0 0x7f231819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:54.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231f34d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2318100750 0x7f231819bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:54.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231f34d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318195a10 con 0x7f2318100750 2024-08-19T01:07:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231f34d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318195b50 con 0x7f23180ffda0 2024-08-19T01:07:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231c8e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2318100750 0x7f231819bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231c8e8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2318100750 0x7f231819bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58484/0 (socket says 172.21.15.17:58484) 2024-08-19T01:07:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231c8e8640 1 -- 172.21.15.17:0/509565717 learned_addr learned my addr 172.21.15.17:0/509565717 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231d0e9640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180ffda0 0x7f231819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231c8e8640 1 -- 172.21.15.17:0/509565717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180ffda0 msgr2=0x7f231819b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231c8e8640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180ffda0 0x7f231819b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231c8e8640 1 -- 172.21.15.17:0/509565717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2314009560 con 0x7f2318100750 2024-08-19T01:07:54.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.339+0000 7f231d0e9640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180ffda0 0x7f231819b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:07:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.340+0000 7f231c8e8640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2318100750 0x7f231819bef0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f230800d6f0 tx=0x7f230800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.340+0000 7f230e7fc640 1 -- 172.21.15.17:0/509565717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2308009a30 con 0x7f2318100750 2024-08-19T01:07:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.340+0000 7f230e7fc640 1 -- 172.21.15.17:0/509565717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f23080054e0 con 0x7f2318100750 2024-08-19T01:07:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.340+0000 7f231f34d640 1 -- 172.21.15.17:0/509565717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2318195e30 con 0x7f2318100750 2024-08-19T01:07:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.340+0000 7f230e7fc640 1 -- 172.21.15.17:0/509565717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2308010460 con 0x7f2318100750 2024-08-19T01:07:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.340+0000 7f231f34d640 1 -- 172.21.15.17:0/509565717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2318196380 con 0x7f2318100750 2024-08-19T01:07:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.341+0000 7f231f34d640 1 -- 172.21.15.17:0/509565717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2318101280 con 0x7f2318100750 2024-08-19T01:07:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.341+0000 7f230e7fc640 1 -- 172.21.15.17:0/509565717 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2308009b90 con 0x7f2318100750 2024-08-19T01:07:54.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.342+0000 7f230e7fc640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f230406e170 0x7f2304070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.342+0000 7f230e7fc640 1 -- 172.21.15.17:0/509565717 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f230808dd30 con 0x7f2318100750 2024-08-19T01:07:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.342+0000 7f231d0e9640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f230406e170 0x7f2304070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.343+0000 7f231d0e9640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f230406e170 0x7f2304070630 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2314006010 tx=0x7f2314005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.346+0000 7f230e7fc640 1 -- 172.21.15.17:0/509565717 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2308057010 con 0x7f2318100750 2024-08-19T01:07:54.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:54 smithi086 ceph-mon[71303]: pgmap v273: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:54.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.538+0000 7f231f34d640 1 -- 172.21.15.17:0/509565717 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f231810cdd0 con 0x7f230406e170 2024-08-19T01:07:54.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.539+0000 7f230e7fc640 1 -- 172.21.15.17:0/509565717 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f231810cdd0 con 0x7f230406e170 2024-08-19T01:07:54.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.541+0000 7f231f34d640 1 -- 172.21.15.17:0/509565717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f230406e170 msgr2=0x7f2304070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:54.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.541+0000 7f231f34d640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f230406e170 0x7f2304070630 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2314006010 tx=0x7f2314005e60 comp rx=0 tx=0).stop 2024-08-19T01:07:54.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.541+0000 7f231f34d640 1 -- 172.21.15.17:0/509565717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2318100750 msgr2=0x7f231819bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:54.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.541+0000 7f231f34d640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2318100750 0x7f231819bef0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f230800d6f0 tx=0x7f230800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.541+0000 7f231f34d640 1 -- 172.21.15.17:0/509565717 shutdown_connections 2024-08-19T01:07:54.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.541+0000 7f231f34d640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f230406e170 0x7f2304070630 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.541+0000 7f231f34d640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2318100750 0x7f231819bef0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.541+0000 7f231f34d640 1 --2- 172.21.15.17:0/509565717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23180ffda0 0x7f231819b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.541+0000 7f231f34d640 1 -- 172.21.15.17:0/509565717 >> 172.21.15.17:0/509565717 conn(0x7f23180fb840 msgr2=0x7f23180fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:54.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.542+0000 7f231f34d640 1 -- 172.21.15.17:0/509565717 shutdown_connections 2024-08-19T01:07:54.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.542+0000 7f231f34d640 1 -- 172.21.15.17:0/509565717 wait complete. 2024-08-19T01:07:54.554 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:07:54.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.625+0000 7fb1289cf640 1 -- 172.21.15.17:0/3385266074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb124100c60 msgr2=0x7fb124101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:54.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.625+0000 7fb1289cf640 1 --2- 172.21.15.17:0/3385266074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb124100c60 0x7fb124101040 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb114009c50 tx=0x7fb11402a9a0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.625+0000 7fb1289cf640 1 -- 172.21.15.17:0/3385266074 shutdown_connections 2024-08-19T01:07:54.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.626+0000 7fb1289cf640 1 --2- 172.21.15.17:0/3385266074 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb124101610 0x7fb124109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.626+0000 7fb1289cf640 1 --2- 172.21.15.17:0/3385266074 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb124100c60 0x7fb124101040 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.626+0000 7fb1289cf640 1 -- 172.21.15.17:0/3385266074 >> 172.21.15.17:0/3385266074 conn(0x7fb1240fa730 msgr2=0x7fb1240fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:54.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.626+0000 7fb1289cf640 1 -- 172.21.15.17:0/3385266074 shutdown_connections 2024-08-19T01:07:54.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.626+0000 7fb1289cf640 1 -- 172.21.15.17:0/3385266074 wait complete. 2024-08-19T01:07:54.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.626+0000 7fb1289cf640 1 Processor -- start 2024-08-19T01:07:54.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.626+0000 7fb1289cf640 1 -- start start 2024-08-19T01:07:54.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb1289cf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb124100c60 0x7fb12419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:54.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb1289cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb124101610 0x7fb12419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:54.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb1289cf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12419c3a0 con 0x7fb124101610 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb1289cf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb124195930 con 0x7fb124100c60 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb121d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb124101610 0x7fb12419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb121d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb124101610 0x7fb12419bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58498/0 (socket says 172.21.15.17:58498) 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb121d9b640 1 -- 172.21.15.17:0/2634114968 learned_addr learned my addr 172.21.15.17:0/2634114968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb12259c640 1 --2- 172.21.15.17:0/2634114968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb124100c60 0x7fb12419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb121d9b640 1 -- 172.21.15.17:0/2634114968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb124100c60 msgr2=0x7fb12419b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb121d9b640 1 --2- 172.21.15.17:0/2634114968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb124100c60 0x7fb12419b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb121d9b640 1 -- 172.21.15.17:0/2634114968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114009900 con 0x7fb124101610 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb121d9b640 1 --2- 172.21.15.17:0/2634114968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb124101610 0x7fb12419bd80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00e970 tx=0x7fb10c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb11b7fe640 1 -- 172.21.15.17:0/2634114968 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10c00cc90 con 0x7fb124101610 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb11b7fe640 1 -- 172.21.15.17:0/2634114968 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb10c00cdf0 con 0x7fb124101610 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.627+0000 7fb1289cf640 1 -- 172.21.15.17:0/2634114968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb124195c10 con 0x7fb124101610 2024-08-19T01:07:54.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.628+0000 7fb11b7fe640 1 -- 172.21.15.17:0/2634114968 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10c010430 con 0x7fb124101610 2024-08-19T01:07:54.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.628+0000 7fb1289cf640 1 -- 172.21.15.17:0/2634114968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb124196160 con 0x7fb124101610 2024-08-19T01:07:54.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.629+0000 7fb1289cf640 1 -- 172.21.15.17:0/2634114968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb124068d30 con 0x7fb124101610 2024-08-19T01:07:54.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.630+0000 7fb11b7fe640 1 -- 172.21.15.17:0/2634114968 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb10c0046c0 con 0x7fb124101610 2024-08-19T01:07:54.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.630+0000 7fb11b7fe640 1 --2- 172.21.15.17:0/2634114968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb11006e170 0x7fb110070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:54.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.630+0000 7fb11b7fe640 1 -- 172.21.15.17:0/2634114968 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb10c014070 con 0x7fb124101610 2024-08-19T01:07:54.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.630+0000 7fb12259c640 1 --2- 172.21.15.17:0/2634114968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb11006e170 0x7fb110070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:54.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.631+0000 7fb12259c640 1 --2- 172.21.15.17:0/2634114968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb11006e170 0x7fb110070630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1140098d0 tx=0x7fb114009800 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:54.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.636+0000 7fb11b7fe640 1 -- 172.21.15.17:0/2634114968 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb10c057a60 con 0x7fb124101610 2024-08-19T01:07:54.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.827+0000 7fb1289cf640 1 -- 172.21.15.17:0/2634114968 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb12410cdd0 con 0x7fb11006e170 2024-08-19T01:07:54.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.828+0000 7fb11b7fe640 1 -- 172.21.15.17:0/2634114968 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb12410cdd0 con 0x7fb11006e170 2024-08-19T01:07:54.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.830+0000 7fb1289cf640 1 -- 172.21.15.17:0/2634114968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb11006e170 msgr2=0x7fb110070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:54.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.830+0000 7fb1289cf640 1 --2- 172.21.15.17:0/2634114968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb11006e170 0x7fb110070630 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1140098d0 tx=0x7fb114009800 comp rx=0 tx=0).stop 2024-08-19T01:07:54.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.830+0000 7fb1289cf640 1 -- 172.21.15.17:0/2634114968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb124101610 msgr2=0x7fb12419bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:54.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.830+0000 7fb1289cf640 1 --2- 172.21.15.17:0/2634114968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb124101610 0x7fb12419bd80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00e970 tx=0x7fb10c00ed70 comp rx=0 tx=0).stop 2024-08-19T01:07:54.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.830+0000 7fb1289cf640 1 -- 172.21.15.17:0/2634114968 shutdown_connections 2024-08-19T01:07:54.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.830+0000 7fb1289cf640 1 --2- 172.21.15.17:0/2634114968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb11006e170 0x7fb110070630 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.830+0000 7fb1289cf640 1 --2- 172.21.15.17:0/2634114968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb124101610 0x7fb12419bd80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.830+0000 7fb1289cf640 1 --2- 172.21.15.17:0/2634114968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb124100c60 0x7fb12419b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.830+0000 7fb1289cf640 1 -- 172.21.15.17:0/2634114968 >> 172.21.15.17:0/2634114968 conn(0x7fb1240fa730 msgr2=0x7fb124101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:54.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.830+0000 7fb1289cf640 1 -- 172.21.15.17:0/2634114968 shutdown_connections 2024-08-19T01:07:54.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.830+0000 7fb1289cf640 1 -- 172.21.15.17:0/2634114968 wait complete. 2024-08-19T01:07:54.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.912+0000 7f5530a36640 1 -- 172.21.15.17:0/3955580444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f552c0ffda0 msgr2=0x7f552c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:54.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.912+0000 7f5530a36640 1 --2- 172.21.15.17:0/3955580444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f552c0ffda0 0x7f552c100180 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f551c009880 tx=0x7f551c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.912+0000 7f5530a36640 1 -- 172.21.15.17:0/3955580444 shutdown_connections 2024-08-19T01:07:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.912+0000 7f5530a36640 1 --2- 172.21.15.17:0/3955580444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c100750 0x7f552c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.912+0000 7f5530a36640 1 --2- 172.21.15.17:0/3955580444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f552c0ffda0 0x7f552c100180 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.912+0000 7f5530a36640 1 -- 172.21.15.17:0/3955580444 >> 172.21.15.17:0/3955580444 conn(0x7f552c0fb840 msgr2=0x7f552c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:54.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.912+0000 7f5530a36640 1 -- 172.21.15.17:0/3955580444 shutdown_connections 2024-08-19T01:07:54.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.912+0000 7f5530a36640 1 -- 172.21.15.17:0/3955580444 wait complete. 2024-08-19T01:07:54.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.913+0000 7f5530a36640 1 Processor -- start 2024-08-19T01:07:54.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.913+0000 7f5530a36640 1 -- start start 2024-08-19T01:07:54.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.913+0000 7f5530a36640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c0ffda0 0x7f552c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:54.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.913+0000 7f5530a36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f552c100750 0x7f552c19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:54.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.913+0000 7f5530a36640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c195a10 con 0x7f552c100750 2024-08-19T01:07:54.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.913+0000 7f5530a36640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552c195b50 con 0x7f552c0ffda0 2024-08-19T01:07:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.913+0000 7f5529d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f552c100750 0x7f552c19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.913+0000 7f5529d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f552c100750 0x7f552c19bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58510/0 (socket says 172.21.15.17:58510) 2024-08-19T01:07:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.913+0000 7f5529d9b640 1 -- 172.21.15.17:0/1695929525 learned_addr learned my addr 172.21.15.17:0/1695929525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.913+0000 7f552a59c640 1 --2- 172.21.15.17:0/1695929525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c0ffda0 0x7f552c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.914+0000 7f5529d9b640 1 -- 172.21.15.17:0/1695929525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c0ffda0 msgr2=0x7f552c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.914+0000 7f5529d9b640 1 --2- 172.21.15.17:0/1695929525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c0ffda0 0x7f552c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.914+0000 7f5529d9b640 1 -- 172.21.15.17:0/1695929525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c009560 con 0x7f552c100750 2024-08-19T01:07:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.914+0000 7f5529d9b640 1 --2- 172.21.15.17:0/1695929525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f552c100750 0x7f552c19bef0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f552000d6f0 tx=0x7f552000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.914+0000 7f551b7fe640 1 -- 172.21.15.17:0/1695929525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5520009a30 con 0x7f552c100750 2024-08-19T01:07:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.914+0000 7f551b7fe640 1 -- 172.21.15.17:0/1695929525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55200054e0 con 0x7f552c100750 2024-08-19T01:07:54.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.914+0000 7f5530a36640 1 -- 172.21.15.17:0/1695929525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552c195e30 con 0x7f552c100750 2024-08-19T01:07:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.914+0000 7f551b7fe640 1 -- 172.21.15.17:0/1695929525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5520010460 con 0x7f552c100750 2024-08-19T01:07:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.914+0000 7f5530a36640 1 -- 172.21.15.17:0/1695929525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552c196380 con 0x7f552c100750 2024-08-19T01:07:54.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.915+0000 7f5530a36640 1 -- 172.21.15.17:0/1695929525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552c101280 con 0x7f552c100750 2024-08-19T01:07:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.916+0000 7f551b7fe640 1 -- 172.21.15.17:0/1695929525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5520004ec0 con 0x7f552c100750 2024-08-19T01:07:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.916+0000 7f551b7fe640 1 --2- 172.21.15.17:0/1695929525 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f551406e170 0x7f5514070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.916+0000 7f551b7fe640 1 -- 172.21.15.17:0/1695929525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f552008dd00 con 0x7f552c100750 2024-08-19T01:07:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.916+0000 7f552a59c640 1 --2- 172.21.15.17:0/1695929525 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f551406e170 0x7f5514070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.917+0000 7f552a59c640 1 --2- 172.21.15.17:0/1695929525 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f551406e170 0x7f5514070630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f551c009230 tx=0x7f551c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:54.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:54.921+0000 7f551b7fe640 1 -- 172.21.15.17:0/1695929525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5520092070 con 0x7f552c100750 2024-08-19T01:07:55.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.106+0000 7f5530a36640 1 -- 172.21.15.17:0/1695929525 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f552c196f40 con 0x7f551406e170 2024-08-19T01:07:55.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.115+0000 7f551b7fe640 1 -- 172.21.15.17:0/1695929525 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f552c196f40 con 0x7f551406e170 2024-08-19T01:07:55.118 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:07:55.118 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (9m) 3m ago 19m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:07:55.118 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (20m) 3m ago 20m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:07:55.118 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (19m) 2m ago 19m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:07:55.118 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (6m) 3m ago 20m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:07:55.118 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (6m) 2m ago 19m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (8m) 3m ago 19m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (3m) 3m ago 14m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (3m) 3m ago 14m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (14m) 2m ago 14m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (2m) 2m ago 14m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (11m) 3m ago 21m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (10m) 2m ago 18m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (7m) 3m ago 21m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (7m) 2m ago 18m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (9m) 3m ago 19m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (9m) 2m ago 18m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:07:55.119 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (6m) 3m ago 18m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:07:55.120 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (6m) 3m ago 17m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:07:55.120 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (5m) 3m ago 17m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:07:55.120 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (4m) 2m ago 16m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:07:55.120 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (4m) 2m ago 16m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:07:55.120 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (3m) 2m ago 15m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:07:55.120 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (9m) 3m ago 19m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:07:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.117+0000 7f5530a36640 1 -- 172.21.15.17:0/1695929525 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f551406e170 msgr2=0x7f5514070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.117+0000 7f5530a36640 1 --2- 172.21.15.17:0/1695929525 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f551406e170 0x7f5514070630 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f551c009230 tx=0x7f551c0058d0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.117+0000 7f5530a36640 1 -- 172.21.15.17:0/1695929525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f552c100750 msgr2=0x7f552c19bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.117+0000 7f5530a36640 1 --2- 172.21.15.17:0/1695929525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f552c100750 0x7f552c19bef0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f552000d6f0 tx=0x7f552000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.117+0000 7f5530a36640 1 -- 172.21.15.17:0/1695929525 shutdown_connections 2024-08-19T01:07:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.117+0000 7f5530a36640 1 --2- 172.21.15.17:0/1695929525 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f551406e170 0x7f5514070630 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.117+0000 7f5530a36640 1 --2- 172.21.15.17:0/1695929525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f552c100750 0x7f552c19bef0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.117+0000 7f5530a36640 1 --2- 172.21.15.17:0/1695929525 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f552c0ffda0 0x7f552c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.117+0000 7f5530a36640 1 -- 172.21.15.17:0/1695929525 >> 172.21.15.17:0/1695929525 conn(0x7f552c0fb840 msgr2=0x7f552c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.117+0000 7f5530a36640 1 -- 172.21.15.17:0/1695929525 shutdown_connections 2024-08-19T01:07:55.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.117+0000 7f5530a36640 1 -- 172.21.15.17:0/1695929525 wait complete. 2024-08-19T01:07:55.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:55 smithi017 ceph-mon[99370]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:55.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:55 smithi017 ceph-mon[99370]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.198+0000 7fc9d9c91640 1 -- 172.21.15.17:0/3919173901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9d4104a30 msgr2=0x7fc9d4104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.198+0000 7fc9d9c91640 1 --2- 172.21.15.17:0/3919173901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9d4104a30 0x7fc9d4104e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009880 tx=0x7fc9c402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.198+0000 7fc9d9c91640 1 -- 172.21.15.17:0/3919173901 shutdown_connections 2024-08-19T01:07:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.198+0000 7fc9d9c91640 1 --2- 172.21.15.17:0/3919173901 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40fea30 0x7fc9d40fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.198+0000 7fc9d9c91640 1 --2- 172.21.15.17:0/3919173901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9d4104a30 0x7fc9d4104e10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.198+0000 7fc9d9c91640 1 -- 172.21.15.17:0/3919173901 >> 172.21.15.17:0/3919173901 conn(0x7fc9d40fa730 msgr2=0x7fc9d40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.198+0000 7fc9d9c91640 1 -- 172.21.15.17:0/3919173901 shutdown_connections 2024-08-19T01:07:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.198+0000 7fc9d9c91640 1 -- 172.21.15.17:0/3919173901 wait complete. 2024-08-19T01:07:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.199+0000 7fc9d9c91640 1 Processor -- start 2024-08-19T01:07:55.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.199+0000 7fc9d9c91640 1 -- start start 2024-08-19T01:07:55.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.199+0000 7fc9d9c91640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40fea30 0x7fc9d419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:55.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.199+0000 7fc9d9c91640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9d4104a30 0x7fc9d419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:55.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.199+0000 7fc9d9c91640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d4195890 con 0x7fc9d4104a30 2024-08-19T01:07:55.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.199+0000 7fc9d9c91640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d41959d0 con 0x7fc9d40fea30 2024-08-19T01:07:55.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9caffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9d4104a30 0x7fc9d419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:55.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9caffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9d4104a30 0x7fc9d419bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58528/0 (socket says 172.21.15.17:58528) 2024-08-19T01:07:55.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9caffd640 1 -- 172.21.15.17:0/292501007 learned_addr learned my addr 172.21.15.17:0/292501007 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:55.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9d37fe640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40fea30 0x7fc9d419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:55.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9caffd640 1 -- 172.21.15.17:0/292501007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40fea30 msgr2=0x7fc9d419b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9caffd640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40fea30 0x7fc9d419b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9caffd640 1 -- 172.21.15.17:0/292501007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c4009560 con 0x7fc9d4104a30 2024-08-19T01:07:55.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9d37fe640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40fea30 0x7fc9d419b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:07:55.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9caffd640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9d4104a30 0x7fc9d419bd70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00d8d0 tx=0x7fc9bc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:55.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9d17fa640 1 -- 172.21.15.17:0/292501007 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9bc00bea0 con 0x7fc9d4104a30 2024-08-19T01:07:55.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9d17fa640 1 -- 172.21.15.17:0/292501007 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9bc009c00 con 0x7fc9d4104a30 2024-08-19T01:07:55.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9d9c91640 1 -- 172.21.15.17:0/292501007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d4195cb0 con 0x7fc9d4104a30 2024-08-19T01:07:55.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9d17fa640 1 -- 172.21.15.17:0/292501007 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9bc00f710 con 0x7fc9d4104a30 2024-08-19T01:07:55.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.200+0000 7fc9d9c91640 1 -- 172.21.15.17:0/292501007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d4196200 con 0x7fc9d4104a30 2024-08-19T01:07:55.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.201+0000 7fc9d9c91640 1 -- 172.21.15.17:0/292501007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d4100170 con 0x7fc9d4104a30 2024-08-19T01:07:55.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.202+0000 7fc9d17fa640 1 -- 172.21.15.17:0/292501007 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc9bc00f990 con 0x7fc9d4104a30 2024-08-19T01:07:55.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.202+0000 7fc9d17fa640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc9c006e170 0x7fc9c0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:55.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.202+0000 7fc9d17fa640 1 -- 172.21.15.17:0/292501007 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc9bc08df20 con 0x7fc9d4104a30 2024-08-19T01:07:55.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.202+0000 7fc9d37fe640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc9c006e170 0x7fc9c0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:55.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.203+0000 7fc9d37fe640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc9c006e170 0x7fc9c0070630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4000c00 tx=0x7fc9c4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:55.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.207+0000 7fc9d17fa640 1 -- 172.21.15.17:0/292501007 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc9bc0c2df0 con 0x7fc9d4104a30 2024-08-19T01:07:55.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:55 smithi086 ceph-mon[71303]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:55.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:55 smithi086 ceph-mon[71303]: from='client.34572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.460+0000 7fc9d9c91640 1 -- 172.21.15.17:0/292501007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc9d410bca0 con 0x7fc9d4104a30 2024-08-19T01:07:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.461+0000 7fc9d17fa640 1 -- 172.21.15.17:0/292501007 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7fc9bc057200 con 0x7fc9d4104a30 2024-08-19T01:07:55.465 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:07:55.465 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:07:55.465 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:07:55.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:07:55.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:07:55.466 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:07:55.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:07:55.466 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:07:55.466 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:07:55.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:07:55.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:07:55.467 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:07:55.467 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:07:55.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:07:55.467 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:07:55.467 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:07:55.467 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:07:55.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:07:55.468 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:07:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.463+0000 7fc9d9c91640 1 -- 172.21.15.17:0/292501007 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc9c006e170 msgr2=0x7fc9c0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.463+0000 7fc9d9c91640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc9c006e170 0x7fc9c0070630 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4000c00 tx=0x7fc9c4005a20 comp rx=0 tx=0).stop 2024-08-19T01:07:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.463+0000 7fc9d9c91640 1 -- 172.21.15.17:0/292501007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9d4104a30 msgr2=0x7fc9d419bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.463+0000 7fc9d9c91640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9d4104a30 0x7fc9d419bd70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00d8d0 tx=0x7fc9bc00dd90 comp rx=0 tx=0).stop 2024-08-19T01:07:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.463+0000 7fc9d9c91640 1 -- 172.21.15.17:0/292501007 shutdown_connections 2024-08-19T01:07:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.463+0000 7fc9d9c91640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc9c006e170 0x7fc9c0070630 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.463+0000 7fc9d9c91640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc9d4104a30 0x7fc9d419bd70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.463+0000 7fc9d9c91640 1 --2- 172.21.15.17:0/292501007 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc9d40fea30 0x7fc9d419b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.463+0000 7fc9d9c91640 1 -- 172.21.15.17:0/292501007 >> 172.21.15.17:0/292501007 conn(0x7fc9d40fa730 msgr2=0x7fc9d4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.463+0000 7fc9d9c91640 1 -- 172.21.15.17:0/292501007 shutdown_connections 2024-08-19T01:07:55.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.463+0000 7fc9d9c91640 1 -- 172.21.15.17:0/292501007 wait complete. 2024-08-19T01:07:55.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.545+0000 7f3b82ce3640 1 -- 172.21.15.17:0/3496832246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c100cb0 msgr2=0x7f3b7c101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.545+0000 7f3b82ce3640 1 --2- 172.21.15.17:0/3496832246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c100cb0 0x7f3b7c101090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009880 tx=0x7f3b7802a530 comp rx=0 tx=0).stop 2024-08-19T01:07:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.545+0000 7f3b82ce3640 1 -- 172.21.15.17:0/3496832246 shutdown_connections 2024-08-19T01:07:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.545+0000 7f3b82ce3640 1 --2- 172.21.15.17:0/3496832246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b7c1015d0 0x7f3b7c109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.545+0000 7f3b82ce3640 1 --2- 172.21.15.17:0/3496832246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c100cb0 0x7f3b7c101090 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.545+0000 7f3b82ce3640 1 -- 172.21.15.17:0/3496832246 >> 172.21.15.17:0/3496832246 conn(0x7f3b7c0758a0 msgr2=0x7f3b7c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.545+0000 7f3b82ce3640 1 -- 172.21.15.17:0/3496832246 shutdown_connections 2024-08-19T01:07:55.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.546+0000 7f3b82ce3640 1 -- 172.21.15.17:0/3496832246 wait complete. 2024-08-19T01:07:55.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.546+0000 7f3b82ce3640 1 Processor -- start 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.546+0000 7f3b82ce3640 1 -- start start 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.546+0000 7f3b82ce3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b7c100cb0 0x7f3b7c19b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.546+0000 7f3b82ce3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c1015d0 0x7f3b7c19bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.546+0000 7f3b82ce3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c19c3d0 con 0x7f3b7c1015d0 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.546+0000 7f3b82ce3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c195960 con 0x7f3b7c100cb0 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.546+0000 7f3b73fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c1015d0 0x7f3b7c19bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.546+0000 7f3b73fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c1015d0 0x7f3b7c19bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58546/0 (socket says 172.21.15.17:58546) 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.546+0000 7f3b73fff640 1 -- 172.21.15.17:0/1741880976 learned_addr learned my addr 172.21.15.17:0/1741880976 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.547+0000 7f3b80a7f640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b7c100cb0 0x7f3b7c19b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.547+0000 7f3b73fff640 1 -- 172.21.15.17:0/1741880976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b7c100cb0 msgr2=0x7f3b7c19b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.547+0000 7f3b73fff640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b7c100cb0 0x7f3b7c19b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.547+0000 7f3b73fff640 1 -- 172.21.15.17:0/1741880976 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b78009560 con 0x7f3b7c1015d0 2024-08-19T01:07:55.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.547+0000 7f3b80a7f640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b7c100cb0 0x7f3b7c19b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:07:55.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.547+0000 7f3b73fff640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c1015d0 0x7f3b7c19bdb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00d6d0 tx=0x7f3b6c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:55.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.547+0000 7f3b71ffb640 1 -- 172.21.15.17:0/1741880976 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c0051f0 con 0x7f3b7c1015d0 2024-08-19T01:07:55.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.547+0000 7f3b71ffb640 1 -- 172.21.15.17:0/1741880976 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b6c009ce0 con 0x7f3b7c1015d0 2024-08-19T01:07:55.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.547+0000 7f3b82ce3640 1 -- 172.21.15.17:0/1741880976 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c195c40 con 0x7f3b7c1015d0 2024-08-19T01:07:55.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.547+0000 7f3b71ffb640 1 -- 172.21.15.17:0/1741880976 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c004db0 con 0x7f3b7c1015d0 2024-08-19T01:07:55.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.547+0000 7f3b82ce3640 1 -- 172.21.15.17:0/1741880976 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c196190 con 0x7f3b7c1015d0 2024-08-19T01:07:55.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.548+0000 7f3b82ce3640 1 -- 172.21.15.17:0/1741880976 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c068510 con 0x7f3b7c1015d0 2024-08-19T01:07:55.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.549+0000 7f3b71ffb640 1 -- 172.21.15.17:0/1741880976 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3b6c009820 con 0x7f3b7c1015d0 2024-08-19T01:07:55.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.549+0000 7f3b71ffb640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b6406e170 0x7f3b64070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:55.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.549+0000 7f3b71ffb640 1 -- 172.21.15.17:0/1741880976 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3b6c08db20 con 0x7f3b7c1015d0 2024-08-19T01:07:55.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.549+0000 7f3b80a7f640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b6406e170 0x7f3b64070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:55.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.550+0000 7f3b80a7f640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b6406e170 0x7f3b64070630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b78006010 tx=0x7f3b78005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:55.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.553+0000 7f3b71ffb640 1 -- 172.21.15.17:0/1741880976 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3b6c056e80 con 0x7f3b7c1015d0 2024-08-19T01:07:55.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.765+0000 7f3b82ce3640 1 -- 172.21.15.17:0/1741880976 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3b7c101090 con 0x7f3b7c1015d0 2024-08-19T01:07:55.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.766+0000 7f3b71ffb640 1 -- 172.21.15.17:0/1741880976 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f3b6c017070 con 0x7f3b7c1015d0 2024-08-19T01:07:55.769 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:07:55.769 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:07:55.769 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:07:55.769 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:07:55.769 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:07:55.769 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:07:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:07:55.771 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:07:55.772 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:07:55.772 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:07:55.772 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:07:55.772 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:07:55.772 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:07:55.772 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:07:55.772 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:07:55.772 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:07:55.772 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:07:55.773 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:07:55.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.769+0000 7f3b82ce3640 1 -- 172.21.15.17:0/1741880976 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b6406e170 msgr2=0x7f3b64070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.769+0000 7f3b82ce3640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b6406e170 0x7f3b64070630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3b78006010 tx=0x7f3b78005e60 comp rx=0 tx=0).stop 2024-08-19T01:07:55.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.769+0000 7f3b82ce3640 1 -- 172.21.15.17:0/1741880976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c1015d0 msgr2=0x7f3b7c19bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.769+0000 7f3b82ce3640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c1015d0 0x7f3b7c19bdb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00d6d0 tx=0x7f3b6c00db90 comp rx=0 tx=0).stop 2024-08-19T01:07:55.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.769+0000 7f3b82ce3640 1 -- 172.21.15.17:0/1741880976 shutdown_connections 2024-08-19T01:07:55.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.769+0000 7f3b82ce3640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b6406e170 0x7f3b64070630 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.769+0000 7f3b82ce3640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b7c1015d0 0x7f3b7c19bdb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.769+0000 7f3b82ce3640 1 --2- 172.21.15.17:0/1741880976 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b7c100cb0 0x7f3b7c19b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.769+0000 7f3b82ce3640 1 -- 172.21.15.17:0/1741880976 >> 172.21.15.17:0/1741880976 conn(0x7f3b7c0758a0 msgr2=0x7f3b7c101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:55.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.769+0000 7f3b82ce3640 1 -- 172.21.15.17:0/1741880976 shutdown_connections 2024-08-19T01:07:55.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.769+0000 7f3b82ce3640 1 -- 172.21.15.17:0/1741880976 wait complete. 2024-08-19T01:07:55.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.853+0000 7f4c7ca49640 1 -- 172.21.15.17:0/692241895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c780fea30 msgr2=0x7f4c780fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.853+0000 7f4c7ca49640 1 --2- 172.21.15.17:0/692241895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c780fea30 0x7f4c780fee90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009880 tx=0x7f4c6c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.853+0000 7f4c7ca49640 1 -- 172.21.15.17:0/692241895 shutdown_connections 2024-08-19T01:07:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.853+0000 7f4c7ca49640 1 --2- 172.21.15.17:0/692241895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c780fea30 0x7f4c780fee90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.853+0000 7f4c7ca49640 1 --2- 172.21.15.17:0/692241895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c78104a30 0x7f4c78104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.853+0000 7f4c7ca49640 1 -- 172.21.15.17:0/692241895 >> 172.21.15.17:0/692241895 conn(0x7f4c780fa730 msgr2=0x7f4c780fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.853+0000 7f4c7ca49640 1 -- 172.21.15.17:0/692241895 shutdown_connections 2024-08-19T01:07:55.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.853+0000 7f4c7ca49640 1 -- 172.21.15.17:0/692241895 wait complete. 2024-08-19T01:07:55.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.854+0000 7f4c7ca49640 1 Processor -- start 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.854+0000 7f4c7ca49640 1 -- start start 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.854+0000 7f4c7ca49640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c780fea30 0x7f4c7819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.854+0000 7f4c7ca49640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c78104a30 0x7f4c7819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.854+0000 7f4c7ca49640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78197ac0 con 0x7f4c780fea30 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.854+0000 7f4c7ca49640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c78197c00 con 0x7f4c78104a30 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.854+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c780fea30 0x7f4c7819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.854+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c780fea30 0x7f4c7819da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58568/0 (socket says 172.21.15.17:58568) 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.854+0000 7f4c7659c640 1 -- 172.21.15.17:0/3053320610 learned_addr learned my addr 172.21.15.17:0/3053320610 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.854+0000 7f4c75d9b640 1 --2- 172.21.15.17:0/3053320610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c78104a30 0x7f4c7819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.855+0000 7f4c7659c640 1 -- 172.21.15.17:0/3053320610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c78104a30 msgr2=0x7f4c7819dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.855+0000 7f4c7659c640 1 --2- 172.21.15.17:0/3053320610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c78104a30 0x7f4c7819dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:55.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.855+0000 7f4c7659c640 1 -- 172.21.15.17:0/3053320610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c009560 con 0x7f4c780fea30 2024-08-19T01:07:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.855+0000 7f4c7659c640 1 --2- 172.21.15.17:0/3053320610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c780fea30 0x7f4c7819da60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800d8d0 tx=0x7f4c6800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.855+0000 7f4c677fe640 1 -- 172.21.15.17:0/3053320610 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c6800bea0 con 0x7f4c780fea30 2024-08-19T01:07:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.855+0000 7f4c7ca49640 1 -- 172.21.15.17:0/3053320610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c78197ee0 con 0x7f4c780fea30 2024-08-19T01:07:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.855+0000 7f4c677fe640 1 -- 172.21.15.17:0/3053320610 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c68009c00 con 0x7f4c780fea30 2024-08-19T01:07:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.855+0000 7f4c677fe640 1 -- 172.21.15.17:0/3053320610 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c6800f710 con 0x7f4c780fea30 2024-08-19T01:07:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.855+0000 7f4c7ca49640 1 -- 172.21.15.17:0/3053320610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c78198400 con 0x7f4c780fea30 2024-08-19T01:07:55.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.856+0000 7f4c7ca49640 1 -- 172.21.15.17:0/3053320610 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c78100170 con 0x7f4c780fea30 2024-08-19T01:07:55.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.857+0000 7f4c677fe640 1 -- 172.21.15.17:0/3053320610 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4c6800f990 con 0x7f4c780fea30 2024-08-19T01:07:55.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.857+0000 7f4c677fe640 1 --2- 172.21.15.17:0/3053320610 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4c6006e170 0x7f4c60070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:55.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.857+0000 7f4c677fe640 1 -- 172.21.15.17:0/3053320610 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4c6808df30 con 0x7f4c780fea30 2024-08-19T01:07:55.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.857+0000 7f4c75d9b640 1 --2- 172.21.15.17:0/3053320610 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4c6006e170 0x7f4c60070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:55.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.858+0000 7f4c75d9b640 1 --2- 172.21.15.17:0/3053320610 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4c6006e170 0x7f4c60070630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c000c00 tx=0x7f4c6c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:55.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:55.862+0000 7f4c677fe640 1 -- 172.21.15.17:0/3053320610 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4c680c2df0 con 0x7f4c780fea30 2024-08-19T01:07:56.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.054+0000 7f4c7ca49640 1 -- 172.21.15.17:0/3053320610 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c7810bca0 con 0x7f4c6006e170 2024-08-19T01:07:56.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.055+0000 7f4c677fe640 1 -- 172.21.15.17:0/3053320610 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4c7810bca0 con 0x7f4c6006e170 2024-08-19T01:07:56.058 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:07:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:07:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:07:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:07:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:07:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:07:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:07:56.058 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:07:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:07:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:07:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:07:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:07:56.059 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:07:56.059 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:07:56.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.057+0000 7f4c7ca49640 1 -- 172.21.15.17:0/3053320610 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4c6006e170 msgr2=0x7f4c60070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:56.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.057+0000 7f4c7ca49640 1 --2- 172.21.15.17:0/3053320610 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4c6006e170 0x7f4c60070630 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c000c00 tx=0x7f4c6c005a20 comp rx=0 tx=0).stop 2024-08-19T01:07:56.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.057+0000 7f4c7ca49640 1 -- 172.21.15.17:0/3053320610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c780fea30 msgr2=0x7f4c7819da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:56.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.057+0000 7f4c7ca49640 1 --2- 172.21.15.17:0/3053320610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c780fea30 0x7f4c7819da60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800d8d0 tx=0x7f4c6800dd90 comp rx=0 tx=0).stop 2024-08-19T01:07:56.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.057+0000 7f4c7ca49640 1 -- 172.21.15.17:0/3053320610 shutdown_connections 2024-08-19T01:07:56.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.057+0000 7f4c7ca49640 1 --2- 172.21.15.17:0/3053320610 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4c6006e170 0x7f4c60070630 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:56.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.057+0000 7f4c7ca49640 1 --2- 172.21.15.17:0/3053320610 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4c78104a30 0x7f4c7819dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:56.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.057+0000 7f4c7ca49640 1 --2- 172.21.15.17:0/3053320610 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4c780fea30 0x7f4c7819da60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:56.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.057+0000 7f4c7ca49640 1 -- 172.21.15.17:0/3053320610 >> 172.21.15.17:0/3053320610 conn(0x7f4c780fa730 msgr2=0x7f4c780fba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:56.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.057+0000 7f4c7ca49640 1 -- 172.21.15.17:0/3053320610 shutdown_connections 2024-08-19T01:07:56.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.057+0000 7f4c7ca49640 1 -- 172.21.15.17:0/3053320610 wait complete. 2024-08-19T01:07:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.141+0000 7fe7c5047640 1 -- 172.21.15.17:0/3376410907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c00fea30 msgr2=0x7fe7c00fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.141+0000 7fe7c5047640 1 --2- 172.21.15.17:0/3376410907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c00fea30 0x7fe7c00fee90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009880 tx=0x7fe7a802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:07:56.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.141+0000 7fe7c5047640 1 -- 172.21.15.17:0/3376410907 shutdown_connections 2024-08-19T01:07:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.141+0000 7fe7c5047640 1 --2- 172.21.15.17:0/3376410907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c00fea30 0x7fe7c00fee90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.141+0000 7fe7c5047640 1 --2- 172.21.15.17:0/3376410907 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7c0104a30 0x7fe7c0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.141+0000 7fe7c5047640 1 -- 172.21.15.17:0/3376410907 >> 172.21.15.17:0/3376410907 conn(0x7fe7c00fa730 msgr2=0x7fe7c00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.141+0000 7fe7c5047640 1 -- 172.21.15.17:0/3376410907 shutdown_connections 2024-08-19T01:07:56.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.141+0000 7fe7c5047640 1 -- 172.21.15.17:0/3376410907 wait complete. 2024-08-19T01:07:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.142+0000 7fe7c5047640 1 Processor -- start 2024-08-19T01:07:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.142+0000 7fe7c5047640 1 -- start start 2024-08-19T01:07:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.142+0000 7fe7c5047640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7c00fea30 0x7fe7c019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.142+0000 7fe7c5047640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c0104a30 0x7fe7c019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:56.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.142+0000 7fe7c5047640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c019c360 con 0x7fe7c0104a30 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.142+0000 7fe7c5047640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c01958f0 con 0x7fe7c00fea30 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c0104a30 0x7fe7c019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c0104a30 0x7fe7c019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58586/0 (socket says 172.21.15.17:58586) 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7be59c640 1 -- 172.21.15.17:0/1786631859 learned_addr learned my addr 172.21.15.17:0/1786631859 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7bed9d640 1 --2- 172.21.15.17:0/1786631859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7c00fea30 0x7fe7c019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7be59c640 1 -- 172.21.15.17:0/1786631859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7c00fea30 msgr2=0x7fe7c019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7be59c640 1 --2- 172.21.15.17:0/1786631859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7c00fea30 0x7fe7c019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7be59c640 1 -- 172.21.15.17:0/1786631859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a8009560 con 0x7fe7c0104a30 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7be59c640 1 --2- 172.21.15.17:0/1786631859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c0104a30 0x7fe7c019bd40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe7a802a9c0 tx=0x7fe7a80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7b7fff640 1 -- 172.21.15.17:0/1786631859 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7a8004aa0 con 0x7fe7c0104a30 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7b7fff640 1 -- 172.21.15.17:0/1786631859 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe7a8004c00 con 0x7fe7c0104a30 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7c5047640 1 -- 172.21.15.17:0/1786631859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c0195b70 con 0x7fe7c0104a30 2024-08-19T01:07:56.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7b7fff640 1 -- 172.21.15.17:0/1786631859 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7a8003980 con 0x7fe7c0104a30 2024-08-19T01:07:56.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.143+0000 7fe7c5047640 1 -- 172.21.15.17:0/1786631859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c0196060 con 0x7fe7c0104a30 2024-08-19T01:07:56.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.145+0000 7fe7c5047640 1 -- 172.21.15.17:0/1786631859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c0100170 con 0x7fe7c0104a30 2024-08-19T01:07:56.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.145+0000 7fe7b7fff640 1 -- 172.21.15.17:0/1786631859 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe7a8003bf0 con 0x7fe7c0104a30 2024-08-19T01:07:56.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.145+0000 7fe7b7fff640 1 --2- 172.21.15.17:0/1786631859 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe7ac06e170 0x7fe7ac070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:07:56.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.145+0000 7fe7b7fff640 1 -- 172.21.15.17:0/1786631859 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe7a80af280 con 0x7fe7c0104a30 2024-08-19T01:07:56.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.145+0000 7fe7bed9d640 1 --2- 172.21.15.17:0/1786631859 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe7ac06e170 0x7fe7ac070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:07:56.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.146+0000 7fe7bed9d640 1 --2- 172.21.15.17:0/1786631859 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe7ac06e170 0x7fe7ac070630 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0005fd0 tx=0x7fe7b0009870 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:07:56.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.150+0000 7fe7b7fff640 1 -- 172.21.15.17:0/1786631859 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe7a80785d0 con 0x7fe7c0104a30 2024-08-19T01:07:56.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.390+0000 7fe7c5047640 1 -- 172.21.15.17:0/1786631859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe7c0107fd0 con 0x7fe7c0104a30 2024-08-19T01:07:56.393 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:56 smithi017 ceph-mon[99370]: pgmap v274: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:56.393 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:56 smithi017 ceph-mon[99370]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:56.393 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:56 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/292501007' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:07:56.393 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:56 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1741880976' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:07:56.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.390+0000 7fe7b7fff640 1 -- 172.21.15.17:0/1786631859 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7fe7a807bc90 con 0x7fe7c0104a30 2024-08-19T01:07:56.394 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:07:56.394 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:07:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:07:56.394 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:07:56.394 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:07:56.394 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:07:56.395 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:07:56.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.392+0000 7fe7c5047640 1 -- 172.21.15.17:0/1786631859 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe7ac06e170 msgr2=0x7fe7ac070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:56.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.392+0000 7fe7c5047640 1 --2- 172.21.15.17:0/1786631859 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe7ac06e170 0x7fe7ac070630 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0005fd0 tx=0x7fe7b0009870 comp rx=0 tx=0).stop 2024-08-19T01:07:56.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.392+0000 7fe7c5047640 1 -- 172.21.15.17:0/1786631859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c0104a30 msgr2=0x7fe7c019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:07:56.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.392+0000 7fe7c5047640 1 --2- 172.21.15.17:0/1786631859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c0104a30 0x7fe7c019bd40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe7a802a9c0 tx=0x7fe7a80055a0 comp rx=0 tx=0).stop 2024-08-19T01:07:56.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.392+0000 7fe7c5047640 1 -- 172.21.15.17:0/1786631859 shutdown_connections 2024-08-19T01:07:56.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.392+0000 7fe7c5047640 1 --2- 172.21.15.17:0/1786631859 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe7ac06e170 0x7fe7ac070630 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:56.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.392+0000 7fe7c5047640 1 --2- 172.21.15.17:0/1786631859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7c0104a30 0x7fe7c019bd40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:56.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.392+0000 7fe7c5047640 1 --2- 172.21.15.17:0/1786631859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7c00fea30 0x7fe7c019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:07:56.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.392+0000 7fe7c5047640 1 -- 172.21.15.17:0/1786631859 >> 172.21.15.17:0/1786631859 conn(0x7fe7c00fa730 msgr2=0x7fe7c0068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:07:56.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.392+0000 7fe7c5047640 1 -- 172.21.15.17:0/1786631859 shutdown_connections 2024-08-19T01:07:56.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:07:56.393+0000 7fe7c5047640 1 -- 172.21.15.17:0/1786631859 wait complete. 2024-08-19T01:07:56.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:56 smithi086 ceph-mon[71303]: pgmap v274: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:56.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:56 smithi086 ceph-mon[71303]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:56.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:56 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/292501007' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:07:56.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:56 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1741880976' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:07:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:57 smithi017 ceph-mon[99370]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:57 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1786631859' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:07:57.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:57 smithi086 ceph-mon[71303]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:07:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:57 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1786631859' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:07:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:07:58 smithi017 ceph-mon[99370]: pgmap v275: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:07:58.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:07:58 smithi086 ceph-mon[71303]: pgmap v275: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:00 smithi017 ceph-mon[99370]: pgmap v276: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:00 smithi086 ceph-mon[71303]: pgmap v276: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:02 smithi017 ceph-mon[99370]: pgmap v277: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:02.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:02 smithi086 ceph-mon[71303]: pgmap v277: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:03.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:08:03.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:08:04.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:04 smithi017 ceph-mon[99370]: pgmap v278: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:04.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:04 smithi086 ceph-mon[71303]: pgmap v278: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:06.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:06 smithi017 ceph-mon[99370]: pgmap v279: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:06.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:06 smithi086 ceph-mon[71303]: pgmap v279: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:08 smithi017 ceph-mon[99370]: pgmap v280: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:08.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:08 smithi086 ceph-mon[71303]: pgmap v280: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:10.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:10 smithi017 ceph-mon[99370]: pgmap v281: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:10.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:10 smithi086 ceph-mon[71303]: pgmap v281: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:12.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:12 smithi017 ceph-mon[99370]: pgmap v282: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:12.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:12 smithi086 ceph-mon[71303]: pgmap v282: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:14.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:14 smithi017 ceph-mon[99370]: pgmap v283: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:14.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:14 smithi086 ceph-mon[71303]: pgmap v283: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:16.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:16 smithi017 ceph-mon[99370]: pgmap v284: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:16.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:16 smithi086 ceph-mon[71303]: pgmap v284: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:18 smithi017 ceph-mon[99370]: pgmap v285: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:08:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:18 smithi086 ceph-mon[71303]: pgmap v285: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:08:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:20 smithi017 ceph-mon[99370]: pgmap v286: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:20.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:20 smithi086 ceph-mon[71303]: pgmap v286: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:22.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:22 smithi017 ceph-mon[99370]: pgmap v287: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:22.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:22 smithi086 ceph-mon[71303]: pgmap v287: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:24.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:24 smithi017 ceph-mon[99370]: pgmap v288: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:24.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:24 smithi086 ceph-mon[71303]: pgmap v288: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:26.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:26 smithi017 ceph-mon[99370]: pgmap v289: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:26.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:26 smithi086 ceph-mon[71303]: pgmap v289: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:26.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.490+0000 7fef9f356640 1 -- 172.21.15.17:0/699538849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef980ff250 msgr2=0x7fef9810bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:26.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.490+0000 7fef9f356640 1 --2- 172.21.15.17:0/699538849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef980ff250 0x7fef9810bf10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fef88009880 tx=0x7fef8802a490 comp rx=0 tx=0).stop 2024-08-19T01:08:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.490+0000 7fef9f356640 1 -- 172.21.15.17:0/699538849 shutdown_connections 2024-08-19T01:08:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.490+0000 7fef9f356640 1 --2- 172.21.15.17:0/699538849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef980ff250 0x7fef9810bf10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.490+0000 7fef9f356640 1 --2- 172.21.15.17:0/699538849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef980fe8a0 0x7fef980fec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.490+0000 7fef9f356640 1 -- 172.21.15.17:0/699538849 >> 172.21.15.17:0/699538849 conn(0x7fef980758a0 msgr2=0x7fef980fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.490+0000 7fef9f356640 1 -- 172.21.15.17:0/699538849 shutdown_connections 2024-08-19T01:08:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.490+0000 7fef9f356640 1 -- 172.21.15.17:0/699538849 wait complete. 2024-08-19T01:08:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.491+0000 7fef9f356640 1 Processor -- start 2024-08-19T01:08:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.491+0000 7fef9f356640 1 -- start start 2024-08-19T01:08:26.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.491+0000 7fef9f356640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef980fe8a0 0x7fef9819d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.491+0000 7fef9f356640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef980ff250 0x7fef9819dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.491+0000 7fef9f356640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9819e470 con 0x7fef980ff250 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.491+0000 7fef9f356640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef98197a90 con 0x7fef980fe8a0 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.492+0000 7fef9c8f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef980ff250 0x7fef9819dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.492+0000 7fef9c8f1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef980ff250 0x7fef9819dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59772/0 (socket says 172.21.15.17:59772) 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.492+0000 7fef9c8f1640 1 -- 172.21.15.17:0/2308392781 learned_addr learned my addr 172.21.15.17:0/2308392781 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.492+0000 7fef9d0f2640 1 --2- 172.21.15.17:0/2308392781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef980fe8a0 0x7fef9819d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.492+0000 7fef9c8f1640 1 -- 172.21.15.17:0/2308392781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef980fe8a0 msgr2=0x7fef9819d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.492+0000 7fef9c8f1640 1 --2- 172.21.15.17:0/2308392781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef980fe8a0 0x7fef9819d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.492+0000 7fef9c8f1640 1 -- 172.21.15.17:0/2308392781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef88009560 con 0x7fef980ff250 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.492+0000 7fef9c8f1640 1 --2- 172.21.15.17:0/2308392781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef980ff250 0x7fef9819dee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fef8802a9b0 tx=0x7fef880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.492+0000 7fef8e7fc640 1 -- 172.21.15.17:0/2308392781 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef88004aa0 con 0x7fef980ff250 2024-08-19T01:08:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.492+0000 7fef8e7fc640 1 -- 172.21.15.17:0/2308392781 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef88004c00 con 0x7fef980ff250 2024-08-19T01:08:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.492+0000 7fef9f356640 1 -- 172.21.15.17:0/2308392781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef98197d70 con 0x7fef980ff250 2024-08-19T01:08:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.493+0000 7fef8e7fc640 1 -- 172.21.15.17:0/2308392781 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef88003a20 con 0x7fef980ff250 2024-08-19T01:08:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.493+0000 7fef9f356640 1 -- 172.21.15.17:0/2308392781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef981982c0 con 0x7fef980ff250 2024-08-19T01:08:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.494+0000 7fef8e7fc640 1 -- 172.21.15.17:0/2308392781 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fef88031c90 con 0x7fef980ff250 2024-08-19T01:08:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.494+0000 7fef9f356640 1 -- 172.21.15.17:0/2308392781 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef980684b0 con 0x7fef980ff250 2024-08-19T01:08:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.495+0000 7fef8e7fc640 1 --2- 172.21.15.17:0/2308392781 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fef8406e170 0x7fef84070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.495+0000 7fef8e7fc640 1 -- 172.21.15.17:0/2308392781 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fef880af130 con 0x7fef980ff250 2024-08-19T01:08:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.495+0000 7fef9d0f2640 1 --2- 172.21.15.17:0/2308392781 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fef8406e170 0x7fef84070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:26.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.496+0000 7fef9d0f2640 1 --2- 172.21.15.17:0/2308392781 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fef8406e170 0x7fef84070630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef9400abe0 tx=0x7fef9400a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:26.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.500+0000 7fef8e7fc640 1 -- 172.21.15.17:0/2308392781 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fef88078490 con 0x7fef980ff250 2024-08-19T01:08:26.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.719+0000 7fef9f356640 1 -- 172.21.15.17:0/2308392781 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef9810eed0 con 0x7fef8406e170 2024-08-19T01:08:26.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.721+0000 7fef8e7fc640 1 -- 172.21.15.17:0/2308392781 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fef9810eed0 con 0x7fef8406e170 2024-08-19T01:08:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.723+0000 7fef9f356640 1 -- 172.21.15.17:0/2308392781 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fef8406e170 msgr2=0x7fef84070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.723+0000 7fef9f356640 1 --2- 172.21.15.17:0/2308392781 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fef8406e170 0x7fef84070630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef9400abe0 tx=0x7fef9400a2d0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.723+0000 7fef9f356640 1 -- 172.21.15.17:0/2308392781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef980ff250 msgr2=0x7fef9819dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.723+0000 7fef9f356640 1 --2- 172.21.15.17:0/2308392781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef980ff250 0x7fef9819dee0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fef8802a9b0 tx=0x7fef880055a0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.723+0000 7fef9f356640 1 -- 172.21.15.17:0/2308392781 shutdown_connections 2024-08-19T01:08:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.723+0000 7fef9f356640 1 --2- 172.21.15.17:0/2308392781 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fef8406e170 0x7fef84070630 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.723+0000 7fef9f356640 1 --2- 172.21.15.17:0/2308392781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fef980ff250 0x7fef9819dee0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.723+0000 7fef9f356640 1 --2- 172.21.15.17:0/2308392781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fef980fe8a0 0x7fef9819d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.723+0000 7fef9f356640 1 -- 172.21.15.17:0/2308392781 >> 172.21.15.17:0/2308392781 conn(0x7fef980758a0 msgr2=0x7fef980fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.723+0000 7fef9f356640 1 -- 172.21.15.17:0/2308392781 shutdown_connections 2024-08-19T01:08:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.723+0000 7fef9f356640 1 -- 172.21.15.17:0/2308392781 wait complete. 2024-08-19T01:08:26.734 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:08:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.806+0000 7f70d1046640 1 -- 172.21.15.17:0/2558772511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70cc0fea30 msgr2=0x7f70cc0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.806+0000 7f70d1046640 1 --2- 172.21.15.17:0/2558772511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70cc0fea30 0x7f70cc0fee90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009880 tx=0x7f70b402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.806+0000 7f70d1046640 1 -- 172.21.15.17:0/2558772511 shutdown_connections 2024-08-19T01:08:26.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.806+0000 7f70d1046640 1 --2- 172.21.15.17:0/2558772511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70cc0fea30 0x7f70cc0fee90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.806+0000 7f70d1046640 1 --2- 172.21.15.17:0/2558772511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70cc104a30 0x7f70cc104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.806+0000 7f70d1046640 1 -- 172.21.15.17:0/2558772511 >> 172.21.15.17:0/2558772511 conn(0x7f70cc0fa730 msgr2=0x7f70cc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.806+0000 7f70d1046640 1 -- 172.21.15.17:0/2558772511 shutdown_connections 2024-08-19T01:08:26.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.806+0000 7f70d1046640 1 -- 172.21.15.17:0/2558772511 wait complete. 2024-08-19T01:08:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.807+0000 7f70d1046640 1 Processor -- start 2024-08-19T01:08:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.807+0000 7f70d1046640 1 -- start start 2024-08-19T01:08:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.807+0000 7f70d1046640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70cc0fea30 0x7f70cc19d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:26.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.807+0000 7f70d1046640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70cc104a30 0x7f70cc19def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.807+0000 7f70d1046640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc19e580 con 0x7f70cc104a30 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.807+0000 7f70d1046640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc197b00 con 0x7f70cc0fea30 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.807+0000 7f70c259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70cc104a30 0x7f70cc19def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70c259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70cc104a30 0x7f70cc19def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39932/0 (socket says 172.21.15.17:39932) 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70c259c640 1 -- 172.21.15.17:0/2237454582 learned_addr learned my addr 172.21.15.17:0/2237454582 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70cad9d640 1 --2- 172.21.15.17:0/2237454582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70cc0fea30 0x7f70cc19d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70c259c640 1 -- 172.21.15.17:0/2237454582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70cc0fea30 msgr2=0x7f70cc19d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70c259c640 1 --2- 172.21.15.17:0/2237454582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70cc0fea30 0x7f70cc19d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70c259c640 1 -- 172.21.15.17:0/2237454582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b4009560 con 0x7f70cc104a30 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70c259c640 1 --2- 172.21.15.17:0/2237454582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70cc104a30 0x7f70cc19def0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70b402a9c0 tx=0x7f70b40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70c8d99640 1 -- 172.21.15.17:0/2237454582 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70b4004aa0 con 0x7f70cc104a30 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70c8d99640 1 -- 172.21.15.17:0/2237454582 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70b4004c00 con 0x7f70cc104a30 2024-08-19T01:08:26.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70d1046640 1 -- 172.21.15.17:0/2237454582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70cc197d80 con 0x7f70cc104a30 2024-08-19T01:08:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70c8d99640 1 -- 172.21.15.17:0/2237454582 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70b4003980 con 0x7f70cc104a30 2024-08-19T01:08:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.808+0000 7f70d1046640 1 -- 172.21.15.17:0/2237454582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc198270 con 0x7f70cc104a30 2024-08-19T01:08:26.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.809+0000 7f70d1046640 1 -- 172.21.15.17:0/2237454582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70cc100170 con 0x7f70cc104a30 2024-08-19T01:08:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.810+0000 7f70c8d99640 1 -- 172.21.15.17:0/2237454582 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f70b4003bf0 con 0x7f70cc104a30 2024-08-19T01:08:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.810+0000 7f70c8d99640 1 --2- 172.21.15.17:0/2237454582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70b806e170 0x7f70b8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.810+0000 7f70c8d99640 1 -- 172.21.15.17:0/2237454582 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f70b40af160 con 0x7f70cc104a30 2024-08-19T01:08:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.810+0000 7f70cad9d640 1 --2- 172.21.15.17:0/2237454582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70b806e170 0x7f70b8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:26.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.811+0000 7f70cad9d640 1 --2- 172.21.15.17:0/2237454582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70b806e170 0x7f70b8070630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f70bc005fd0 tx=0x7f70bc00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:26.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:26.815+0000 7f70c8d99640 1 -- 172.21.15.17:0/2237454582 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f70b40784f0 con 0x7f70cc104a30 2024-08-19T01:08:27.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.007+0000 7f70d1046640 1 -- 172.21.15.17:0/2237454582 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70cc10bd30 con 0x7f70b806e170 2024-08-19T01:08:27.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.009+0000 7f70c8d99640 1 -- 172.21.15.17:0/2237454582 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f70cc10bd30 con 0x7f70b806e170 2024-08-19T01:08:27.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.011+0000 7f70d1046640 1 -- 172.21.15.17:0/2237454582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70b806e170 msgr2=0x7f70b8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.011+0000 7f70d1046640 1 --2- 172.21.15.17:0/2237454582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70b806e170 0x7f70b8070630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f70bc005fd0 tx=0x7f70bc00b390 comp rx=0 tx=0).stop 2024-08-19T01:08:27.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.011+0000 7f70d1046640 1 -- 172.21.15.17:0/2237454582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70cc104a30 msgr2=0x7f70cc19def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.011+0000 7f70d1046640 1 --2- 172.21.15.17:0/2237454582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70cc104a30 0x7f70cc19def0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f70b402a9c0 tx=0x7f70b40055a0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.011+0000 7f70d1046640 1 -- 172.21.15.17:0/2237454582 shutdown_connections 2024-08-19T01:08:27.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.011+0000 7f70d1046640 1 --2- 172.21.15.17:0/2237454582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70b806e170 0x7f70b8070630 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.011+0000 7f70d1046640 1 --2- 172.21.15.17:0/2237454582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70cc104a30 0x7f70cc19def0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.011+0000 7f70d1046640 1 --2- 172.21.15.17:0/2237454582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70cc0fea30 0x7f70cc19d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.011+0000 7f70d1046640 1 -- 172.21.15.17:0/2237454582 >> 172.21.15.17:0/2237454582 conn(0x7f70cc0fa730 msgr2=0x7f70cc0fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:27.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.011+0000 7f70d1046640 1 -- 172.21.15.17:0/2237454582 shutdown_connections 2024-08-19T01:08:27.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.011+0000 7f70d1046640 1 -- 172.21.15.17:0/2237454582 wait complete. 2024-08-19T01:08:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.093+0000 7ff562ac8640 1 -- 172.21.15.17:0/3367178260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff55c1016d0 msgr2=0x7ff55c109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.093+0000 7ff562ac8640 1 --2- 172.21.15.17:0/3367178260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff55c1016d0 0x7ff55c109bc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff544009880 tx=0x7ff54402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.093+0000 7ff562ac8640 1 -- 172.21.15.17:0/3367178260 shutdown_connections 2024-08-19T01:08:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.093+0000 7ff562ac8640 1 --2- 172.21.15.17:0/3367178260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff55c1016d0 0x7ff55c109bc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.093+0000 7ff562ac8640 1 --2- 172.21.15.17:0/3367178260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff55c100db0 0x7ff55c101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.093+0000 7ff562ac8640 1 -- 172.21.15.17:0/3367178260 >> 172.21.15.17:0/3367178260 conn(0x7ff55c0fa730 msgr2=0x7ff55c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.094+0000 7ff562ac8640 1 -- 172.21.15.17:0/3367178260 shutdown_connections 2024-08-19T01:08:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.094+0000 7ff562ac8640 1 -- 172.21.15.17:0/3367178260 wait complete. 2024-08-19T01:08:27.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.094+0000 7ff562ac8640 1 Processor -- start 2024-08-19T01:08:27.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.094+0000 7ff562ac8640 1 -- start start 2024-08-19T01:08:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.094+0000 7ff562ac8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff55c100db0 0x7ff55c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.094+0000 7ff562ac8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff55c1016d0 0x7ff55c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.094+0000 7ff562ac8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c19c2f0 con 0x7ff55c1016d0 2024-08-19T01:08:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.094+0000 7ff562ac8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c195910 con 0x7ff55c100db0 2024-08-19T01:08:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff55c1016d0 0x7ff55c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff55bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff55c1016d0 0x7ff55c19bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39944/0 (socket says 172.21.15.17:39944) 2024-08-19T01:08:27.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff55bfff640 1 -- 172.21.15.17:0/3225046768 learned_addr learned my addr 172.21.15.17:0/3225046768 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff560864640 1 --2- 172.21.15.17:0/3225046768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff55c100db0 0x7ff55c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff55bfff640 1 -- 172.21.15.17:0/3225046768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff55c100db0 msgr2=0x7ff55c19b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff55bfff640 1 --2- 172.21.15.17:0/3225046768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff55c100db0 0x7ff55c19b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff55bfff640 1 -- 172.21.15.17:0/3225046768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544009560 con 0x7ff55c1016d0 2024-08-19T01:08:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff55bfff640 1 --2- 172.21.15.17:0/3225046768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff55c1016d0 0x7ff55c19bd60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff544005940 tx=0x7ff544032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff559ffb640 1 -- 172.21.15.17:0/3225046768 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff544005220 con 0x7ff55c1016d0 2024-08-19T01:08:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff559ffb640 1 -- 172.21.15.17:0/3225046768 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff544005380 con 0x7ff55c1016d0 2024-08-19T01:08:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff562ac8640 1 -- 172.21.15.17:0/3225046768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c195b90 con 0x7ff55c1016d0 2024-08-19T01:08:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.095+0000 7ff559ffb640 1 -- 172.21.15.17:0/3225046768 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5440039b0 con 0x7ff55c1016d0 2024-08-19T01:08:27.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.096+0000 7ff562ac8640 1 -- 172.21.15.17:0/3225046768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c196080 con 0x7ff55c1016d0 2024-08-19T01:08:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.097+0000 7ff562ac8640 1 -- 172.21.15.17:0/3225046768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55c068c70 con 0x7ff55c1016d0 2024-08-19T01:08:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.097+0000 7ff559ffb640 1 -- 172.21.15.17:0/3225046768 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff544004c10 con 0x7ff55c1016d0 2024-08-19T01:08:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.098+0000 7ff559ffb640 1 --2- 172.21.15.17:0/3225046768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff54806e170 0x7ff548070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.098+0000 7ff559ffb640 1 -- 172.21.15.17:0/3225046768 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff5440aee80 con 0x7ff55c1016d0 2024-08-19T01:08:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.098+0000 7ff560864640 1 --2- 172.21.15.17:0/3225046768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff54806e170 0x7ff548070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:27.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.098+0000 7ff560864640 1 --2- 172.21.15.17:0/3225046768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff54806e170 0x7ff548070630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff55400abe0 tx=0x7ff55400a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:27.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.102+0000 7ff559ffb640 1 -- 172.21.15.17:0/3225046768 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff544078160 con 0x7ff55c1016d0 2024-08-19T01:08:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.288+0000 7ff562ac8640 1 -- 172.21.15.17:0/3225046768 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff55c10cdb0 con 0x7ff54806e170 2024-08-19T01:08:27.290 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:27 smithi017 ceph-mon[99370]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:08:27.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.298+0000 7ff559ffb640 1 -- 172.21.15.17:0/3225046768 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ff55c10cdb0 con 0x7ff54806e170 2024-08-19T01:08:27.300 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:08:27.300 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (9m) 3m ago 20m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:08:27.300 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (20m) 3m ago 20m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:08:27.300 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (19m) 3m ago 19m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:08:27.300 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (7m) 3m ago 20m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:08:27.300 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (7m) 3m ago 19m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:08:27.300 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (9m) 3m ago 20m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:08:27.300 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (3m) 3m ago 14m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:08:27.300 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (4m) 3m ago 15m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:08:27.300 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (14m) 3m ago 14m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:08:27.300 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (3m) 3m ago 14m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (11m) 3m ago 21m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (10m) 3m ago 19m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (8m) 3m ago 21m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (8m) 3m ago 19m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (10m) 3m ago 20m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (10m) 3m ago 19m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 3m ago 18m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (6m) 3m ago 18m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (5m) 3m ago 17m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (5m) 3m ago 17m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (4m) 3m ago 16m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:08:27.301 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (4m) 3m ago 16m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:08:27.302 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (10m) 3m ago 19m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:08:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.300+0000 7ff562ac8640 1 -- 172.21.15.17:0/3225046768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff54806e170 msgr2=0x7ff548070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.300+0000 7ff562ac8640 1 --2- 172.21.15.17:0/3225046768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff54806e170 0x7ff548070630 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff55400abe0 tx=0x7ff55400a2d0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.300+0000 7ff562ac8640 1 -- 172.21.15.17:0/3225046768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff55c1016d0 msgr2=0x7ff55c19bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.300+0000 7ff562ac8640 1 --2- 172.21.15.17:0/3225046768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff55c1016d0 0x7ff55c19bd60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff544005940 tx=0x7ff544032bd0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.300+0000 7ff562ac8640 1 -- 172.21.15.17:0/3225046768 shutdown_connections 2024-08-19T01:08:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.300+0000 7ff562ac8640 1 --2- 172.21.15.17:0/3225046768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff54806e170 0x7ff548070630 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.300+0000 7ff562ac8640 1 --2- 172.21.15.17:0/3225046768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff55c1016d0 0x7ff55c19bd60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.300+0000 7ff562ac8640 1 --2- 172.21.15.17:0/3225046768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff55c100db0 0x7ff55c19b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.300+0000 7ff562ac8640 1 -- 172.21.15.17:0/3225046768 >> 172.21.15.17:0/3225046768 conn(0x7ff55c0fa730 msgr2=0x7ff55c1020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.300+0000 7ff562ac8640 1 -- 172.21.15.17:0/3225046768 shutdown_connections 2024-08-19T01:08:27.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.300+0000 7ff562ac8640 1 -- 172.21.15.17:0/3225046768 wait complete. 2024-08-19T01:08:27.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.380+0000 7f5c226bb640 1 -- 172.21.15.17:0/2619486845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1c0ff230 msgr2=0x7f5c1c10bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.380+0000 7f5c226bb640 1 --2- 172.21.15.17:0/2619486845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1c0ff230 0x7f5c1c10bef0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009880 tx=0x7f5c1002a4b0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.381+0000 7f5c226bb640 1 -- 172.21.15.17:0/2619486845 shutdown_connections 2024-08-19T01:08:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.381+0000 7f5c226bb640 1 --2- 172.21.15.17:0/2619486845 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1c0ff230 0x7f5c1c10bef0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.381+0000 7f5c226bb640 1 --2- 172.21.15.17:0/2619486845 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c1c0fe880 0x7f5c1c0fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.381+0000 7f5c226bb640 1 -- 172.21.15.17:0/2619486845 >> 172.21.15.17:0/2619486845 conn(0x7f5c1c0fa730 msgr2=0x7f5c1c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.381+0000 7f5c226bb640 1 -- 172.21.15.17:0/2619486845 shutdown_connections 2024-08-19T01:08:27.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.381+0000 7f5c226bb640 1 -- 172.21.15.17:0/2619486845 wait complete. 2024-08-19T01:08:27.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.381+0000 7f5c226bb640 1 Processor -- start 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.381+0000 7f5c226bb640 1 -- start start 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c226bb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c1c0fe880 0x7f5c1c197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c226bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1c0ff230 0x7f5c1c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c226bb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c198840 con 0x7f5c1c0ff230 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c226bb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c1989b0 con 0x7f5c1c0fe880 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c1b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1c0ff230 0x7f5c1c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c1b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1c0ff230 0x7f5c1c1981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39960/0 (socket says 172.21.15.17:39960) 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c1b7fe640 1 -- 172.21.15.17:0/2127437801 learned_addr learned my addr 172.21.15.17:0/2127437801 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c1bfff640 1 --2- 172.21.15.17:0/2127437801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c1c0fe880 0x7f5c1c197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c1b7fe640 1 -- 172.21.15.17:0/2127437801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c1c0fe880 msgr2=0x7f5c1c197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c1b7fe640 1 --2- 172.21.15.17:0/2127437801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c1c0fe880 0x7f5c1c197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c1b7fe640 1 -- 172.21.15.17:0/2127437801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c10009560 con 0x7f5c1c0ff230 2024-08-19T01:08:27.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c1b7fe640 1 --2- 172.21.15.17:0/2127437801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1c0ff230 0x7f5c1c1981f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c10006010 tx=0x7f5c100055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:27.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.382+0000 7f5c197fa640 1 -- 172.21.15.17:0/2127437801 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c10004aa0 con 0x7f5c1c0ff230 2024-08-19T01:08:27.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.383+0000 7f5c226bb640 1 -- 172.21.15.17:0/2127437801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1c19b690 con 0x7f5c1c0ff230 2024-08-19T01:08:27.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.383+0000 7f5c197fa640 1 -- 172.21.15.17:0/2127437801 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c10004c00 con 0x7f5c1c0ff230 2024-08-19T01:08:27.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.383+0000 7f5c197fa640 1 -- 172.21.15.17:0/2127437801 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c10003a20 con 0x7f5c1c0ff230 2024-08-19T01:08:27.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.383+0000 7f5c226bb640 1 -- 172.21.15.17:0/2127437801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c19bbe0 con 0x7f5c1c0ff230 2024-08-19T01:08:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.384+0000 7f5c226bb640 1 -- 172.21.15.17:0/2127437801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c068d30 con 0x7f5c1c0ff230 2024-08-19T01:08:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.384+0000 7f5c197fa640 1 -- 172.21.15.17:0/2127437801 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5c10003ca0 con 0x7f5c1c0ff230 2024-08-19T01:08:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.384+0000 7f5c197fa640 1 --2- 172.21.15.17:0/2127437801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c0406e180 0x7f5c04070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.385+0000 7f5c197fa640 1 -- 172.21.15.17:0/2127437801 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5c100af340 con 0x7f5c1c0ff230 2024-08-19T01:08:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.385+0000 7f5c1bfff640 1 --2- 172.21.15.17:0/2127437801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c0406e180 0x7f5c04070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:27.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.385+0000 7f5c1bfff640 1 --2- 172.21.15.17:0/2127437801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c0406e180 0x7f5c04070640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c005e10 tx=0x7f5c0c005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:27.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.389+0000 7f5c197fa640 1 -- 172.21.15.17:0/2127437801 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5c10078620 con 0x7f5c1c0ff230 2024-08-19T01:08:27.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:27 smithi086 ceph-mon[71303]: from='client.34596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:08:27.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.636+0000 7f5c226bb640 1 -- 172.21.15.17:0/2127437801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c1c106790 con 0x7f5c1c0ff230 2024-08-19T01:08:27.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.636+0000 7f5c197fa640 1 -- 172.21.15.17:0/2127437801 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f5c1007bce0 con 0x7f5c1c0ff230 2024-08-19T01:08:27.638 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:08:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:08:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:08:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:08:27.638 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:08:27.639 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:08:27.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:08:27.640 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:08:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.639+0000 7f5c226bb640 1 -- 172.21.15.17:0/2127437801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c0406e180 msgr2=0x7f5c04070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.639+0000 7f5c226bb640 1 --2- 172.21.15.17:0/2127437801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c0406e180 0x7f5c04070640 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c005e10 tx=0x7f5c0c005da0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.639+0000 7f5c226bb640 1 -- 172.21.15.17:0/2127437801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1c0ff230 msgr2=0x7f5c1c1981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.639+0000 7f5c226bb640 1 --2- 172.21.15.17:0/2127437801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1c0ff230 0x7f5c1c1981f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c10006010 tx=0x7f5c100055a0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.639+0000 7f5c226bb640 1 -- 172.21.15.17:0/2127437801 shutdown_connections 2024-08-19T01:08:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.639+0000 7f5c226bb640 1 --2- 172.21.15.17:0/2127437801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c0406e180 0x7f5c04070640 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.639+0000 7f5c226bb640 1 --2- 172.21.15.17:0/2127437801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c1c0ff230 0x7f5c1c1981f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.639+0000 7f5c226bb640 1 --2- 172.21.15.17:0/2127437801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c1c0fe880 0x7f5c1c197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.639+0000 7f5c226bb640 1 -- 172.21.15.17:0/2127437801 >> 172.21.15.17:0/2127437801 conn(0x7f5c1c0fa730 msgr2=0x7f5c1c0fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.639+0000 7f5c226bb640 1 -- 172.21.15.17:0/2127437801 shutdown_connections 2024-08-19T01:08:27.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.639+0000 7f5c226bb640 1 -- 172.21.15.17:0/2127437801 wait complete. 2024-08-19T01:08:27.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.721+0000 7fe9ae6db640 1 -- 172.21.15.17:0/127899681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a80fea30 msgr2=0x7fe9a80fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.721+0000 7fe9ae6db640 1 --2- 172.21.15.17:0/127899681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a80fea30 0x7fe9a80fee90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe990009880 tx=0x7fe99002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.721+0000 7fe9ae6db640 1 -- 172.21.15.17:0/127899681 shutdown_connections 2024-08-19T01:08:27.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.721+0000 7fe9ae6db640 1 --2- 172.21.15.17:0/127899681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a80fea30 0x7fe9a80fee90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.721+0000 7fe9ae6db640 1 --2- 172.21.15.17:0/127899681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a8104a30 0x7fe9a8104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.721+0000 7fe9ae6db640 1 -- 172.21.15.17:0/127899681 >> 172.21.15.17:0/127899681 conn(0x7fe9a80fa730 msgr2=0x7fe9a80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:27.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.721+0000 7fe9ae6db640 1 -- 172.21.15.17:0/127899681 shutdown_connections 2024-08-19T01:08:27.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.721+0000 7fe9ae6db640 1 -- 172.21.15.17:0/127899681 wait complete. 2024-08-19T01:08:27.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.722+0000 7fe9ae6db640 1 Processor -- start 2024-08-19T01:08:27.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.722+0000 7fe9ae6db640 1 -- start start 2024-08-19T01:08:27.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.722+0000 7fe9ae6db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a80fea30 0x7fe9a819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:27.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.722+0000 7fe9ae6db640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a8104a30 0x7fe9a819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:27.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.722+0000 7fe9ae6db640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a819c3b0 con 0x7fe9a80fea30 2024-08-19T01:08:27.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.722+0000 7fe9ae6db640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a8195940 con 0x7fe9a8104a30 2024-08-19T01:08:27.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.722+0000 7fe9a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a80fea30 0x7fe9a819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:27.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.722+0000 7fe9a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a80fea30 0x7fe9a819b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39988/0 (socket says 172.21.15.17:39988) 2024-08-19T01:08:27.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.722+0000 7fe9a7fff640 1 -- 172.21.15.17:0/2345422510 learned_addr learned my addr 172.21.15.17:0/2345422510 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:27.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.722+0000 7fe9a77fe640 1 --2- 172.21.15.17:0/2345422510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a8104a30 0x7fe9a819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:27.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.723+0000 7fe9a7fff640 1 -- 172.21.15.17:0/2345422510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a8104a30 msgr2=0x7fe9a819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.723+0000 7fe9a7fff640 1 --2- 172.21.15.17:0/2345422510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a8104a30 0x7fe9a819bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.723+0000 7fe9a7fff640 1 -- 172.21.15.17:0/2345422510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe990009560 con 0x7fe9a80fea30 2024-08-19T01:08:27.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.723+0000 7fe9a7fff640 1 --2- 172.21.15.17:0/2345422510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a80fea30 0x7fe9a819b850 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe99800d6f0 tx=0x7fe99800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:27.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.723+0000 7fe9a57fa640 1 -- 172.21.15.17:0/2345422510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe998009a30 con 0x7fe9a80fea30 2024-08-19T01:08:27.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.723+0000 7fe9ae6db640 1 -- 172.21.15.17:0/2345422510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a8195c20 con 0x7fe9a80fea30 2024-08-19T01:08:27.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.723+0000 7fe9a57fa640 1 -- 172.21.15.17:0/2345422510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9980054e0 con 0x7fe9a80fea30 2024-08-19T01:08:27.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.723+0000 7fe9a57fa640 1 -- 172.21.15.17:0/2345422510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe998010460 con 0x7fe9a80fea30 2024-08-19T01:08:27.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.723+0000 7fe9ae6db640 1 -- 172.21.15.17:0/2345422510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a8196140 con 0x7fe9a80fea30 2024-08-19T01:08:27.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.724+0000 7fe9ae6db640 1 -- 172.21.15.17:0/2345422510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a8100170 con 0x7fe9a80fea30 2024-08-19T01:08:27.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.725+0000 7fe9a57fa640 1 -- 172.21.15.17:0/2345422510 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe998009b90 con 0x7fe9a80fea30 2024-08-19T01:08:27.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.725+0000 7fe9a57fa640 1 --2- 172.21.15.17:0/2345422510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe99406e170 0x7fe994070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:27.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.725+0000 7fe9a57fa640 1 -- 172.21.15.17:0/2345422510 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe99808dd30 con 0x7fe9a80fea30 2024-08-19T01:08:27.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.725+0000 7fe9a77fe640 1 --2- 172.21.15.17:0/2345422510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe99406e170 0x7fe994070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:27.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.726+0000 7fe9a77fe640 1 --2- 172.21.15.17:0/2345422510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe99406e170 0x7fe994070630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe990000c00 tx=0x7fe990005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:27.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.729+0000 7fe9a57fa640 1 -- 172.21.15.17:0/2345422510 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe998057010 con 0x7fe9a80fea30 2024-08-19T01:08:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.940+0000 7fe9ae6db640 1 -- 172.21.15.17:0/2345422510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe9a8107fb0 con 0x7fe9a80fea30 2024-08-19T01:08:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.941+0000 7fe9a57fa640 1 -- 172.21.15.17:0/2345422510 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7fe998020790 con 0x7fe9a80fea30 2024-08-19T01:08:27.943 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:08:27.943 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:08:27.943 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:08:27.943 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:08:27.943 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:08:27.943 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:08:27.943 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:08:27.943 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:08:27.943 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:08:27.944 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:08:27.945 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:08:27.946 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:08:27.946 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:08:27.946 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:08:27.946 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:08:27.946 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:08:27.946 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:08:27.946 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.943+0000 7fe9ae6db640 1 -- 172.21.15.17:0/2345422510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe99406e170 msgr2=0x7fe994070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.943+0000 7fe9ae6db640 1 --2- 172.21.15.17:0/2345422510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe99406e170 0x7fe994070630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe990000c00 tx=0x7fe990005a20 comp rx=0 tx=0).stop 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.943+0000 7fe9ae6db640 1 -- 172.21.15.17:0/2345422510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a80fea30 msgr2=0x7fe9a819b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.943+0000 7fe9ae6db640 1 --2- 172.21.15.17:0/2345422510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a80fea30 0x7fe9a819b850 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe99800d6f0 tx=0x7fe99800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.943+0000 7fe9ae6db640 1 -- 172.21.15.17:0/2345422510 shutdown_connections 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.943+0000 7fe9ae6db640 1 --2- 172.21.15.17:0/2345422510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe99406e170 0x7fe994070630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.943+0000 7fe9ae6db640 1 --2- 172.21.15.17:0/2345422510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9a8104a30 0x7fe9a819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.943+0000 7fe9ae6db640 1 --2- 172.21.15.17:0/2345422510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9a80fea30 0x7fe9a819b850 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.943+0000 7fe9ae6db640 1 -- 172.21.15.17:0/2345422510 >> 172.21.15.17:0/2345422510 conn(0x7fe9a80fa730 msgr2=0x7fe9a8068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.943+0000 7fe9ae6db640 1 -- 172.21.15.17:0/2345422510 shutdown_connections 2024-08-19T01:08:27.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:27.943+0000 7fe9ae6db640 1 -- 172.21.15.17:0/2345422510 wait complete. 2024-08-19T01:08:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.026+0000 7ffa73050640 1 -- 172.21.15.17:0/426594246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c100750 msgr2=0x7ffa6c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.026+0000 7ffa73050640 1 --2- 172.21.15.17:0/426594246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c100750 0x7ffa6c1047a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009880 tx=0x7ffa5802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.026+0000 7ffa73050640 1 -- 172.21.15.17:0/426594246 shutdown_connections 2024-08-19T01:08:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.026+0000 7ffa73050640 1 --2- 172.21.15.17:0/426594246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c100750 0x7ffa6c1047a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.026+0000 7ffa73050640 1 --2- 172.21.15.17:0/426594246 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c0ffda0 0x7ffa6c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.026+0000 7ffa73050640 1 -- 172.21.15.17:0/426594246 >> 172.21.15.17:0/426594246 conn(0x7ffa6c0fb840 msgr2=0x7ffa6c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.026+0000 7ffa73050640 1 -- 172.21.15.17:0/426594246 shutdown_connections 2024-08-19T01:08:28.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.026+0000 7ffa73050640 1 -- 172.21.15.17:0/426594246 wait complete. 2024-08-19T01:08:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa73050640 1 Processor -- start 2024-08-19T01:08:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa73050640 1 -- start start 2024-08-19T01:08:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa73050640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0ffda0 0x7ffa6c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa73050640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c100750 0x7ffa6c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa73050640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c073230 con 0x7ffa6c0ffda0 2024-08-19T01:08:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa73050640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0733a0 con 0x7ffa6c100750 2024-08-19T01:08:28.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa70dec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0ffda0 0x7ffa6c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa70dec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0ffda0 0x7ffa6c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40008/0 (socket says 172.21.15.17:40008) 2024-08-19T01:08:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa70dec640 1 -- 172.21.15.17:0/1921846183 learned_addr learned my addr 172.21.15.17:0/1921846183 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa6bfff640 1 --2- 172.21.15.17:0/1921846183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c100750 0x7ffa6c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa70dec640 1 -- 172.21.15.17:0/1921846183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c100750 msgr2=0x7ffa6c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa70dec640 1 --2- 172.21.15.17:0/1921846183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c100750 0x7ffa6c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa70dec640 1 -- 172.21.15.17:0/1921846183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa58009560 con 0x7ffa6c0ffda0 2024-08-19T01:08:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.027+0000 7ffa70dec640 1 --2- 172.21.15.17:0/1921846183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0ffda0 0x7ffa6c0727b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000b420 tx=0x7ffa6000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.028+0000 7ffa69ffb640 1 -- 172.21.15.17:0/1921846183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa60011800 con 0x7ffa6c0ffda0 2024-08-19T01:08:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.028+0000 7ffa73050640 1 -- 172.21.15.17:0/1921846183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c1a1d90 con 0x7ffa6c0ffda0 2024-08-19T01:08:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.028+0000 7ffa69ffb640 1 -- 172.21.15.17:0/1921846183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa60011e20 con 0x7ffa6c0ffda0 2024-08-19T01:08:28.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.028+0000 7ffa69ffb640 1 -- 172.21.15.17:0/1921846183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa6000f2e0 con 0x7ffa6c0ffda0 2024-08-19T01:08:28.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.028+0000 7ffa73050640 1 -- 172.21.15.17:0/1921846183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c1a20f0 con 0x7ffa6c0ffda0 2024-08-19T01:08:28.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.029+0000 7ffa73050640 1 -- 172.21.15.17:0/1921846183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c101280 con 0x7ffa6c0ffda0 2024-08-19T01:08:28.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.029+0000 7ffa69ffb640 1 -- 172.21.15.17:0/1921846183 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ffa60010380 con 0x7ffa6c0ffda0 2024-08-19T01:08:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.030+0000 7ffa69ffb640 1 --2- 172.21.15.17:0/1921846183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5c06e170 0x7ffa5c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.030+0000 7ffa69ffb640 1 -- 172.21.15.17:0/1921846183 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ffa6008daf0 con 0x7ffa6c0ffda0 2024-08-19T01:08:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.030+0000 7ffa6bfff640 1 --2- 172.21.15.17:0/1921846183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5c06e170 0x7ffa5c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:28.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.030+0000 7ffa6bfff640 1 --2- 172.21.15.17:0/1921846183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5c06e170 0x7ffa5c070630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa58000c00 tx=0x7ffa58005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:28.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.034+0000 7ffa69ffb640 1 -- 172.21.15.17:0/1921846183 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ffa60056dd0 con 0x7ffa6c0ffda0 2024-08-19T01:08:28.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.226+0000 7ffa73050640 1 -- 172.21.15.17:0/1921846183 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa6c073d50 con 0x7ffa5c06e170 2024-08-19T01:08:28.229 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:28 smithi017 ceph-mon[99370]: pgmap v290: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:28.229 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:28 smithi017 ceph-mon[99370]: from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:08:28.229 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:28 smithi017 ceph-mon[99370]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:08:28.229 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:28 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2127437801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:08:28.229 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:28 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2345422510' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:08:28.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.228+0000 7ffa69ffb640 1 -- 172.21.15.17:0/1921846183 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ffa6c073d50 con 0x7ffa5c06e170 2024-08-19T01:08:28.230 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:08:28.230 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:08:28.230 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:08:28.230 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:08:28.230 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:08:28.230 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:08:28.230 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:08:28.230 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:08:28.230 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:08:28.230 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:08:28.230 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:08:28.231 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:08:28.231 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:08:28.231 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:08:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.230+0000 7ffa73050640 1 -- 172.21.15.17:0/1921846183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5c06e170 msgr2=0x7ffa5c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.230+0000 7ffa73050640 1 --2- 172.21.15.17:0/1921846183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5c06e170 0x7ffa5c070630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ffa58000c00 tx=0x7ffa58005a20 comp rx=0 tx=0).stop 2024-08-19T01:08:28.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.230+0000 7ffa73050640 1 -- 172.21.15.17:0/1921846183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0ffda0 msgr2=0x7ffa6c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:28.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.230+0000 7ffa73050640 1 --2- 172.21.15.17:0/1921846183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0ffda0 0x7ffa6c0727b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000b420 tx=0x7ffa6000b8e0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.230+0000 7ffa73050640 1 -- 172.21.15.17:0/1921846183 shutdown_connections 2024-08-19T01:08:28.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.230+0000 7ffa73050640 1 --2- 172.21.15.17:0/1921846183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffa5c06e170 0x7ffa5c070630 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.230+0000 7ffa73050640 1 --2- 172.21.15.17:0/1921846183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffa6c100750 0x7ffa6c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.230+0000 7ffa73050640 1 --2- 172.21.15.17:0/1921846183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffa6c0ffda0 0x7ffa6c0727b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.230+0000 7ffa73050640 1 -- 172.21.15.17:0/1921846183 >> 172.21.15.17:0/1921846183 conn(0x7ffa6c0fb840 msgr2=0x7ffa6c0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:28.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.230+0000 7ffa73050640 1 -- 172.21.15.17:0/1921846183 shutdown_connections 2024-08-19T01:08:28.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.231+0000 7ffa73050640 1 -- 172.21.15.17:0/1921846183 wait complete. 2024-08-19T01:08:28.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.312+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/1338848082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c740ffda0 msgr2=0x7f1c74100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:28.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.312+0000 7f1c7aa3d640 1 --2- 172.21.15.17:0/1338848082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c740ffda0 0x7f1c74100180 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009880 tx=0x7f1c6402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.312+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/1338848082 shutdown_connections 2024-08-19T01:08:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.312+0000 7f1c7aa3d640 1 --2- 172.21.15.17:0/1338848082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c74100750 0x7f1c741047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.312+0000 7f1c7aa3d640 1 --2- 172.21.15.17:0/1338848082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c740ffda0 0x7f1c74100180 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.312+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/1338848082 >> 172.21.15.17:0/1338848082 conn(0x7f1c740fb840 msgr2=0x7f1c740fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.312+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/1338848082 shutdown_connections 2024-08-19T01:08:28.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.312+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/1338848082 wait complete. 2024-08-19T01:08:28.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.313+0000 7f1c7aa3d640 1 Processor -- start 2024-08-19T01:08:28.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.313+0000 7f1c7aa3d640 1 -- start start 2024-08-19T01:08:28.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.313+0000 7f1c7aa3d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c740ffda0 0x7f1c7419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.313+0000 7f1c7aa3d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c74100750 0x7f1c7419be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.313+0000 7f1c7aa3d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7419c480 con 0x7f1c740ffda0 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.313+0000 7f1c7aa3d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c74195a10 con 0x7f1c74100750 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c73fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c740ffda0 0x7f1c7419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c73fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c740ffda0 0x7f1c7419b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40038/0 (socket says 172.21.15.17:40038) 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c73fff640 1 -- 172.21.15.17:0/2320517171 learned_addr learned my addr 172.21.15.17:0/2320517171 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c737fe640 1 --2- 172.21.15.17:0/2320517171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c74100750 0x7f1c7419be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c73fff640 1 -- 172.21.15.17:0/2320517171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c74100750 msgr2=0x7f1c7419be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c73fff640 1 --2- 172.21.15.17:0/2320517171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c74100750 0x7f1c7419be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c73fff640 1 -- 172.21.15.17:0/2320517171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c64009560 con 0x7f1c740ffda0 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c73fff640 1 --2- 172.21.15.17:0/2320517171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c740ffda0 0x7f1c7419b920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1c6402a9c0 tx=0x7f1c640055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c717fa640 1 -- 172.21.15.17:0/2320517171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c64004aa0 con 0x7f1c740ffda0 2024-08-19T01:08:28.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/2320517171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c74195c90 con 0x7f1c740ffda0 2024-08-19T01:08:28.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c717fa640 1 -- 172.21.15.17:0/2320517171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c64004c00 con 0x7f1c740ffda0 2024-08-19T01:08:28.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c717fa640 1 -- 172.21.15.17:0/2320517171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c64003a20 con 0x7f1c740ffda0 2024-08-19T01:08:28.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.314+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/2320517171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c74196180 con 0x7f1c740ffda0 2024-08-19T01:08:28.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.316+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/2320517171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c74101280 con 0x7f1c740ffda0 2024-08-19T01:08:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.316+0000 7f1c717fa640 1 -- 172.21.15.17:0/2320517171 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1c64031c90 con 0x7f1c740ffda0 2024-08-19T01:08:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.316+0000 7f1c717fa640 1 --2- 172.21.15.17:0/2320517171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c5c06e170 0x7f1c5c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.316+0000 7f1c717fa640 1 -- 172.21.15.17:0/2320517171 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1c640af220 con 0x7f1c740ffda0 2024-08-19T01:08:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.316+0000 7f1c737fe640 1 --2- 172.21.15.17:0/2320517171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c5c06e170 0x7f1c5c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:28.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.317+0000 7f1c737fe640 1 --2- 172.21.15.17:0/2320517171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c5c06e170 0x7f1c5c070630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1c74196e80 tx=0x7f1c68009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:28.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.321+0000 7f1c717fa640 1 -- 172.21.15.17:0/2320517171 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1c64078500 con 0x7f1c740ffda0 2024-08-19T01:08:28.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:28 smithi086 ceph-mon[71303]: pgmap v290: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:28.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:28 smithi086 ceph-mon[71303]: from='client.34600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:08:28.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:28 smithi086 ceph-mon[71303]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:08:28.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:28 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2127437801' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:08:28.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:28 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2345422510' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:08:28.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.563+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/2320517171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1c74108100 con 0x7f1c740ffda0 2024-08-19T01:08:28.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.564+0000 7f1c717fa640 1 -- 172.21.15.17:0/2320517171 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f1c6407bbc0 con 0x7f1c740ffda0 2024-08-19T01:08:28.566 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:08:28.566 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:08:28.566 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:08:28.566 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:08:28.566 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:08:28.566 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:08:28.566 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:08:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.566+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/2320517171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c5c06e170 msgr2=0x7f1c5c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.566+0000 7f1c7aa3d640 1 --2- 172.21.15.17:0/2320517171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c5c06e170 0x7f1c5c070630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1c74196e80 tx=0x7f1c68009110 comp rx=0 tx=0).stop 2024-08-19T01:08:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.566+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/2320517171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c740ffda0 msgr2=0x7f1c7419b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.566+0000 7f1c7aa3d640 1 --2- 172.21.15.17:0/2320517171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c740ffda0 0x7f1c7419b920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1c6402a9c0 tx=0x7f1c640055a0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.566+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/2320517171 shutdown_connections 2024-08-19T01:08:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.566+0000 7f1c7aa3d640 1 --2- 172.21.15.17:0/2320517171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c5c06e170 0x7f1c5c070630 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.566+0000 7f1c7aa3d640 1 --2- 172.21.15.17:0/2320517171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c74100750 0x7f1c7419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.566+0000 7f1c7aa3d640 1 --2- 172.21.15.17:0/2320517171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c740ffda0 0x7f1c7419b920 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.566+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/2320517171 >> 172.21.15.17:0/2320517171 conn(0x7f1c740fb840 msgr2=0x7f1c740fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:28.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.566+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/2320517171 shutdown_connections 2024-08-19T01:08:28.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:28.566+0000 7f1c7aa3d640 1 -- 172.21.15.17:0/2320517171 wait complete. 2024-08-19T01:08:29.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:29 smithi017 ceph-mon[99370]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:08:29.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:29 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2320517171' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:08:29.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:29 smithi086 ceph-mon[71303]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:08:29.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:29 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2320517171' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:08:30.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:30 smithi017 ceph-mon[99370]: pgmap v291: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:30.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:30 smithi086 ceph-mon[71303]: pgmap v291: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:32 smithi017 ceph-mon[99370]: pgmap v292: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:32 smithi086 ceph-mon[71303]: pgmap v292: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:08:33.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:08:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:34 smithi017 ceph-mon[99370]: pgmap v293: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:34 smithi086 ceph-mon[71303]: pgmap v293: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:36.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:36 smithi017 ceph-mon[99370]: pgmap v294: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:36 smithi086 ceph-mon[71303]: pgmap v294: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:38.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:38 smithi017 ceph-mon[99370]: pgmap v295: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:38 smithi086 ceph-mon[71303]: pgmap v295: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:40 smithi017 ceph-mon[99370]: pgmap v296: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:40 smithi086 ceph-mon[71303]: pgmap v296: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:42 smithi017 ceph-mon[99370]: pgmap v297: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:42 smithi086 ceph-mon[71303]: pgmap v297: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:44 smithi017 ceph-mon[99370]: pgmap v298: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:44 smithi086 ceph-mon[71303]: pgmap v298: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:46.845 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:46 smithi017 ceph-mon[99370]: pgmap v299: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:46 smithi086 ceph-mon[71303]: pgmap v299: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:48 smithi086 ceph-mon[71303]: pgmap v300: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:08:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:48 smithi017 ceph-mon[99370]: pgmap v300: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:08:50.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:50 smithi017 ceph-mon[99370]: pgmap v301: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:50 smithi086 ceph-mon[71303]: pgmap v301: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:52.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:52 smithi017 ceph-mon[99370]: pgmap v302: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:52 smithi086 ceph-mon[71303]: pgmap v302: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:54.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:54 smithi017 ceph-mon[99370]: pgmap v303: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:54 smithi086 ceph-mon[71303]: pgmap v303: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:56.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:56 smithi017 ceph-mon[99370]: pgmap v304: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:56 smithi086 ceph-mon[71303]: pgmap v304: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.662+0000 7fe6244b6640 1 -- 172.21.15.17:0/42175838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c1015d0 msgr2=0x7fe61c109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.662+0000 7fe6244b6640 1 --2- 172.21.15.17:0/42175838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c1015d0 0x7fe61c109ac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009880 tx=0x7fe60c02a530 comp rx=0 tx=0).stop 2024-08-19T01:08:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.662+0000 7fe6244b6640 1 -- 172.21.15.17:0/42175838 shutdown_connections 2024-08-19T01:08:58.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.662+0000 7fe6244b6640 1 --2- 172.21.15.17:0/42175838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c1015d0 0x7fe61c109ac0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.662+0000 7fe6244b6640 1 --2- 172.21.15.17:0/42175838 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe61c100cb0 0x7fe61c101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.662+0000 7fe6244b6640 1 -- 172.21.15.17:0/42175838 >> 172.21.15.17:0/42175838 conn(0x7fe61c0758a0 msgr2=0x7fe61c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.662+0000 7fe6244b6640 1 -- 172.21.15.17:0/42175838 shutdown_connections 2024-08-19T01:08:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.662+0000 7fe6244b6640 1 -- 172.21.15.17:0/42175838 wait complete. 2024-08-19T01:08:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.662+0000 7fe6244b6640 1 Processor -- start 2024-08-19T01:08:58.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.662+0000 7fe6244b6640 1 -- start start 2024-08-19T01:08:58.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe6244b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c100cb0 0x7fe61c0fe910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:58.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe6244b6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe61c1015d0 0x7fe61c0fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:58.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe6244b6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c0ff390 con 0x7fe61c100cb0 2024-08-19T01:08:58.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe6244b6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c0ff500 con 0x7fe61c1015d0 2024-08-19T01:08:58.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe622252640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c100cb0 0x7fe61c0fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:58.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe622252640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c100cb0 0x7fe61c0fe910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40824/0 (socket says 172.21.15.17:40824) 2024-08-19T01:08:58.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe622252640 1 -- 172.21.15.17:0/2324352595 learned_addr learned my addr 172.21.15.17:0/2324352595 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:58.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe621a51640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe61c1015d0 0x7fe61c0fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:58.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe622252640 1 -- 172.21.15.17:0/2324352595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe61c1015d0 msgr2=0x7fe61c0fee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:58.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe622252640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe61c1015d0 0x7fe61c0fee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:58.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe622252640 1 -- 172.21.15.17:0/2324352595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c009560 con 0x7fe61c100cb0 2024-08-19T01:08:58.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe621a51640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe61c1015d0 0x7fe61c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:08:58.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.663+0000 7fe622252640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c100cb0 0x7fe61c0fe910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe61800e970 tx=0x7fe61800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:58.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.664+0000 7fe6137fe640 1 -- 172.21.15.17:0/2324352595 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe61800cc90 con 0x7fe61c100cb0 2024-08-19T01:08:58.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.664+0000 7fe6137fe640 1 -- 172.21.15.17:0/2324352595 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe61800cdf0 con 0x7fe61c100cb0 2024-08-19T01:08:58.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.664+0000 7fe6137fe640 1 -- 172.21.15.17:0/2324352595 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe618010430 con 0x7fe61c100cb0 2024-08-19T01:08:58.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.664+0000 7fe6244b6640 1 -- 172.21.15.17:0/2324352595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c1a1cc0 con 0x7fe61c100cb0 2024-08-19T01:08:58.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.664+0000 7fe6244b6640 1 -- 172.21.15.17:0/2324352595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c1a2020 con 0x7fe61c100cb0 2024-08-19T01:08:58.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.665+0000 7fe6244b6640 1 -- 172.21.15.17:0/2324352595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c068510 con 0x7fe61c100cb0 2024-08-19T01:08:58.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.665+0000 7fe6137fe640 1 -- 172.21.15.17:0/2324352595 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe6180046c0 con 0x7fe61c100cb0 2024-08-19T01:08:58.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.666+0000 7fe6137fe640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe60806e170 0x7fe608070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:58.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.666+0000 7fe6137fe640 1 -- 172.21.15.17:0/2324352595 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe618014070 con 0x7fe61c100cb0 2024-08-19T01:08:58.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.666+0000 7fe621a51640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe60806e170 0x7fe608070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:58.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.666+0000 7fe621a51640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe60806e170 0x7fe608070630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe60c006010 tx=0x7fe60c005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:58.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.670+0000 7fe6137fe640 1 -- 172.21.15.17:0/2324352595 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe618057a50 con 0x7fe61c100cb0 2024-08-19T01:08:58.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.865+0000 7fe6244b6640 1 -- 172.21.15.17:0/2324352595 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe61c10cda0 con 0x7fe60806e170 2024-08-19T01:08:58.868 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:58 smithi017 ceph-mon[99370]: pgmap v305: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:58.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.867+0000 7fe6137fe640 1 -- 172.21.15.17:0/2324352595 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe61c10cda0 con 0x7fe60806e170 2024-08-19T01:08:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.868+0000 7fe6244b6640 1 -- 172.21.15.17:0/2324352595 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe60806e170 msgr2=0x7fe608070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.869+0000 7fe6244b6640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe60806e170 0x7fe608070630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe60c006010 tx=0x7fe60c005e60 comp rx=0 tx=0).stop 2024-08-19T01:08:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.869+0000 7fe6244b6640 1 -- 172.21.15.17:0/2324352595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c100cb0 msgr2=0x7fe61c0fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.869+0000 7fe6244b6640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c100cb0 0x7fe61c0fe910 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe61800e970 tx=0x7fe61800ed70 comp rx=0 tx=0).stop 2024-08-19T01:08:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.869+0000 7fe6244b6640 1 -- 172.21.15.17:0/2324352595 shutdown_connections 2024-08-19T01:08:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.869+0000 7fe6244b6640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe60806e170 0x7fe608070630 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.869+0000 7fe6244b6640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe61c1015d0 0x7fe61c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.869+0000 7fe6244b6640 1 --2- 172.21.15.17:0/2324352595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe61c100cb0 0x7fe61c0fe910 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.869+0000 7fe6244b6640 1 -- 172.21.15.17:0/2324352595 >> 172.21.15.17:0/2324352595 conn(0x7fe61c0758a0 msgr2=0x7fe61c101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.869+0000 7fe6244b6640 1 -- 172.21.15.17:0/2324352595 shutdown_connections 2024-08-19T01:08:58.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.869+0000 7fe6244b6640 1 -- 172.21.15.17:0/2324352595 wait complete. 2024-08-19T01:08:58.880 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:08:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:58 smithi086 ceph-mon[71303]: pgmap v305: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:08:58.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.952+0000 7f654cfe2640 1 -- 172.21.15.17:0/2320489227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6548101610 msgr2=0x7f6548109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:58.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.952+0000 7f654cfe2640 1 --2- 172.21.15.17:0/2320489227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6548101610 0x7f6548109b00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f653c0098b0 tx=0x7f653c02a4d0 comp rx=0 tx=0).stop 2024-08-19T01:08:58.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.952+0000 7f654cfe2640 1 -- 172.21.15.17:0/2320489227 shutdown_connections 2024-08-19T01:08:58.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.952+0000 7f654cfe2640 1 --2- 172.21.15.17:0/2320489227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6548101610 0x7f6548109b00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:58.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.952+0000 7f654cfe2640 1 --2- 172.21.15.17:0/2320489227 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6548100c60 0x7f6548101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:58.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.952+0000 7f654cfe2640 1 -- 172.21.15.17:0/2320489227 >> 172.21.15.17:0/2320489227 conn(0x7f65480fa730 msgr2=0x7f65480fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:58.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.952+0000 7f654cfe2640 1 -- 172.21.15.17:0/2320489227 shutdown_connections 2024-08-19T01:08:58.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.952+0000 7f654cfe2640 1 -- 172.21.15.17:0/2320489227 wait complete. 2024-08-19T01:08:58.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f654cfe2640 1 Processor -- start 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f654cfe2640 1 -- start start 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f654cfe2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6548100c60 0x7f654819b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f654cfe2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6548101610 0x7f654819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f654cfe2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654819c330 con 0x7f6548101610 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f654cfe2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6548195950 con 0x7f6548100c60 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f6545d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6548101610 0x7f654819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f6545d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6548101610 0x7f654819bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40838/0 (socket says 172.21.15.17:40838) 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f6545d9b640 1 -- 172.21.15.17:0/3614985428 learned_addr learned my addr 172.21.15.17:0/3614985428 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f654659c640 1 --2- 172.21.15.17:0/3614985428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6548100c60 0x7f654819b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f6545d9b640 1 -- 172.21.15.17:0/3614985428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6548100c60 msgr2=0x7f654819b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f6545d9b640 1 --2- 172.21.15.17:0/3614985428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6548100c60 0x7f654819b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f6545d9b640 1 -- 172.21.15.17:0/3614985428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c009560 con 0x7f6548101610 2024-08-19T01:08:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.953+0000 7f6545d9b640 1 --2- 172.21.15.17:0/3614985428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6548101610 0x7f654819bda0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f653c006010 tx=0x7f653c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.954+0000 7f65377fe640 1 -- 172.21.15.17:0/3614985428 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f653c004aa0 con 0x7f6548101610 2024-08-19T01:08:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.954+0000 7f654cfe2640 1 -- 172.21.15.17:0/3614985428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6548195bd0 con 0x7f6548101610 2024-08-19T01:08:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.954+0000 7f65377fe640 1 -- 172.21.15.17:0/3614985428 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f653c004c00 con 0x7f6548101610 2024-08-19T01:08:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.954+0000 7f65377fe640 1 -- 172.21.15.17:0/3614985428 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f653c003a20 con 0x7f6548101610 2024-08-19T01:08:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.954+0000 7f654cfe2640 1 -- 172.21.15.17:0/3614985428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65481960c0 con 0x7f6548101610 2024-08-19T01:08:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.955+0000 7f654cfe2640 1 -- 172.21.15.17:0/3614985428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6548068d30 con 0x7f6548101610 2024-08-19T01:08:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.955+0000 7f65377fe640 1 -- 172.21.15.17:0/3614985428 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f653c003c90 con 0x7f6548101610 2024-08-19T01:08:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.956+0000 7f65377fe640 1 --2- 172.21.15.17:0/3614985428 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f653006e170 0x7f6530070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.956+0000 7f65377fe640 1 -- 172.21.15.17:0/3614985428 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f653c0af350 con 0x7f6548101610 2024-08-19T01:08:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.956+0000 7f654659c640 1 --2- 172.21.15.17:0/3614985428 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f653006e170 0x7f6530070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.956+0000 7f654659c640 1 --2- 172.21.15.17:0/3614985428 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f653006e170 0x7f6530070630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f653800ba40 tx=0x7f6538005cc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:58.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:58.960+0000 7f65377fe640 1 -- 172.21.15.17:0/3614985428 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f653c078630 con 0x7f6548101610 2024-08-19T01:08:59.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.153+0000 7f654cfe2640 1 -- 172.21.15.17:0/3614985428 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f654810cdb0 con 0x7f653006e170 2024-08-19T01:08:59.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.155+0000 7f65377fe640 1 -- 172.21.15.17:0/3614985428 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f654810cdb0 con 0x7f653006e170 2024-08-19T01:08:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.157+0000 7f654cfe2640 1 -- 172.21.15.17:0/3614985428 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f653006e170 msgr2=0x7f6530070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.157+0000 7f654cfe2640 1 --2- 172.21.15.17:0/3614985428 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f653006e170 0x7f6530070630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f653800ba40 tx=0x7f6538005cc0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.157+0000 7f654cfe2640 1 -- 172.21.15.17:0/3614985428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6548101610 msgr2=0x7f654819bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.157+0000 7f654cfe2640 1 --2- 172.21.15.17:0/3614985428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6548101610 0x7f654819bda0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f653c006010 tx=0x7f653c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.157+0000 7f654cfe2640 1 -- 172.21.15.17:0/3614985428 shutdown_connections 2024-08-19T01:08:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.157+0000 7f654cfe2640 1 --2- 172.21.15.17:0/3614985428 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f653006e170 0x7f6530070630 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.157+0000 7f654cfe2640 1 --2- 172.21.15.17:0/3614985428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6548101610 0x7f654819bda0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.157+0000 7f654cfe2640 1 --2- 172.21.15.17:0/3614985428 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6548100c60 0x7f654819b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.157+0000 7f654cfe2640 1 -- 172.21.15.17:0/3614985428 >> 172.21.15.17:0/3614985428 conn(0x7f65480fa730 msgr2=0x7f6548101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.157+0000 7f654cfe2640 1 -- 172.21.15.17:0/3614985428 shutdown_connections 2024-08-19T01:08:59.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.157+0000 7f654cfe2640 1 -- 172.21.15.17:0/3614985428 wait complete. 2024-08-19T01:08:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.240+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/3507036879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b84101610 msgr2=0x7f8b84109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.240+0000 7f8b8b8d1640 1 --2- 172.21.15.17:0/3507036879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b84101610 0x7f8b84109b00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8b780098b0 tx=0x7f8b7802a4d0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.240+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/3507036879 shutdown_connections 2024-08-19T01:08:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.240+0000 7f8b8b8d1640 1 --2- 172.21.15.17:0/3507036879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b84101610 0x7f8b84109b00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.240+0000 7f8b8b8d1640 1 --2- 172.21.15.17:0/3507036879 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b84100c60 0x7f8b84101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.240+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/3507036879 >> 172.21.15.17:0/3507036879 conn(0x7f8b840fa730 msgr2=0x7f8b840fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.240+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/3507036879 shutdown_connections 2024-08-19T01:08:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.240+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/3507036879 wait complete. 2024-08-19T01:08:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.240+0000 7f8b8b8d1640 1 Processor -- start 2024-08-19T01:08:59.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8b8d1640 1 -- start start 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8b8d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b84100c60 0x7f8b840fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8b8d1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b84101610 0x7f8b840fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8b8d1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840ff3d0 con 0x7f8b84100c60 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8b8d1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840ff540 con 0x7f8b84101610 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8966d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b84100c60 0x7f8b840fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8966d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b84100c60 0x7f8b840fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40848/0 (socket says 172.21.15.17:40848) 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8966d640 1 -- 172.21.15.17:0/1802586807 learned_addr learned my addr 172.21.15.17:0/1802586807 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b88e6c640 1 --2- 172.21.15.17:0/1802586807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b84101610 0x7f8b840fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8966d640 1 -- 172.21.15.17:0/1802586807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b84101610 msgr2=0x7f8b840fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8966d640 1 --2- 172.21.15.17:0/1802586807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b84101610 0x7f8b840fee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8966d640 1 -- 172.21.15.17:0/1802586807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b78009560 con 0x7f8b84100c60 2024-08-19T01:08:59.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.241+0000 7f8b8966d640 1 --2- 172.21.15.17:0/1802586807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b84100c60 0x7f8b840fe950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000d6f0 tx=0x7f8b8000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:59.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.242+0000 7f8b767fc640 1 -- 172.21.15.17:0/1802586807 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b80009a30 con 0x7f8b84100c60 2024-08-19T01:08:59.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.242+0000 7f8b767fc640 1 -- 172.21.15.17:0/1802586807 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b800054e0 con 0x7f8b84100c60 2024-08-19T01:08:59.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.242+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/1802586807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b841a1cf0 con 0x7f8b84100c60 2024-08-19T01:08:59.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.242+0000 7f8b767fc640 1 -- 172.21.15.17:0/1802586807 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b80010460 con 0x7f8b84100c60 2024-08-19T01:08:59.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.242+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/1802586807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b841a2050 con 0x7f8b84100c60 2024-08-19T01:08:59.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.243+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/1802586807 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b84068d30 con 0x7f8b84100c60 2024-08-19T01:08:59.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.243+0000 7f8b767fc640 1 -- 172.21.15.17:0/1802586807 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8b80009b90 con 0x7f8b84100c60 2024-08-19T01:08:59.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.243+0000 7f8b767fc640 1 --2- 172.21.15.17:0/1802586807 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8b7006e180 0x7f8b70070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:59.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.244+0000 7f8b767fc640 1 -- 172.21.15.17:0/1802586807 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8b8008dbd0 con 0x7f8b84100c60 2024-08-19T01:08:59.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.244+0000 7f8b88e6c640 1 --2- 172.21.15.17:0/1802586807 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8b7006e180 0x7f8b70070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:59.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.244+0000 7f8b88e6c640 1 --2- 172.21.15.17:0/1802586807 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8b7006e180 0x7f8b70070640 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8b78009880 tx=0x7f8b78005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:59.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.248+0000 7f8b767fc640 1 -- 172.21.15.17:0/1802586807 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8b80056fe0 con 0x7f8b84100c60 2024-08-19T01:08:59.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.429+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/1802586807 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b841043a0 con 0x7f8b7006e180 2024-08-19T01:08:59.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.439+0000 7f8b767fc640 1 -- 172.21.15.17:0/1802586807 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f8b841043a0 con 0x7f8b7006e180 2024-08-19T01:08:59.441 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:08:59.441 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (10m) 4m ago 20m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:08:59.441 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (21m) 4m ago 21m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:08:59.441 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (20m) 3m ago 20m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:08:59.441 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (8m) 4m ago 21m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:08:59.441 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (7m) 3m ago 20m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:08:59.441 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (9m) 4m ago 20m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:08:59.441 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (4m) 4m ago 15m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:08:59.441 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (4m) 4m ago 15m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (15m) 3m ago 15m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (3m) 3m ago 15m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (12m) 4m ago 22m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (11m) 3m ago 19m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (9m) 4m ago 22m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (8m) 3m ago 19m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (10m) 4m ago 21m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (10m) 3m ago 20m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (7m) 4m ago 19m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (7m) 4m ago 18m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (6m) 4m ago 18m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (5m) 3m ago 17m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:08:59.442 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (5m) 3m ago 17m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:08:59.443 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (4m) 3m ago 17m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:08:59.443 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (10m) 4m ago 20m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:08:59.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.441+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/1802586807 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8b7006e180 msgr2=0x7f8b70070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.441+0000 7f8b8b8d1640 1 --2- 172.21.15.17:0/1802586807 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8b7006e180 0x7f8b70070640 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8b78009880 tx=0x7f8b78005a20 comp rx=0 tx=0).stop 2024-08-19T01:08:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.441+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/1802586807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b84100c60 msgr2=0x7f8b840fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.441+0000 7f8b8b8d1640 1 --2- 172.21.15.17:0/1802586807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b84100c60 0x7f8b840fe950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000d6f0 tx=0x7f8b8000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.441+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/1802586807 shutdown_connections 2024-08-19T01:08:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.441+0000 7f8b8b8d1640 1 --2- 172.21.15.17:0/1802586807 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8b7006e180 0x7f8b70070640 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.441+0000 7f8b8b8d1640 1 --2- 172.21.15.17:0/1802586807 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8b84101610 0x7f8b840fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.441+0000 7f8b8b8d1640 1 --2- 172.21.15.17:0/1802586807 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b84100c60 0x7f8b840fe950 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.441+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/1802586807 >> 172.21.15.17:0/1802586807 conn(0x7f8b840fa730 msgr2=0x7f8b84101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.441+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/1802586807 shutdown_connections 2024-08-19T01:08:59.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.441+0000 7f8b8b8d1640 1 -- 172.21.15.17:0/1802586807 wait complete. 2024-08-19T01:08:59.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.522+0000 7fa8f7a33640 1 -- 172.21.15.17:0/1322879064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f01015d0 msgr2=0x7fa8f0109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.522+0000 7fa8f7a33640 1 --2- 172.21.15.17:0/1322879064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f01015d0 0x7fa8f0109ac0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0009880 tx=0x7fa8e002a530 comp rx=0 tx=0).stop 2024-08-19T01:08:59.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.522+0000 7fa8f7a33640 1 -- 172.21.15.17:0/1322879064 shutdown_connections 2024-08-19T01:08:59.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.522+0000 7fa8f7a33640 1 --2- 172.21.15.17:0/1322879064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f01015d0 0x7fa8f0109ac0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.522+0000 7fa8f7a33640 1 --2- 172.21.15.17:0/1322879064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f0100cb0 0x7fa8f0101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.522+0000 7fa8f7a33640 1 -- 172.21.15.17:0/1322879064 >> 172.21.15.17:0/1322879064 conn(0x7fa8f00758a0 msgr2=0x7fa8f00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:59.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.522+0000 7fa8f7a33640 1 -- 172.21.15.17:0/1322879064 shutdown_connections 2024-08-19T01:08:59.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.522+0000 7fa8f7a33640 1 -- 172.21.15.17:0/1322879064 wait complete. 2024-08-19T01:08:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f7a33640 1 Processor -- start 2024-08-19T01:08:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f7a33640 1 -- start start 2024-08-19T01:08:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f7a33640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f0100cb0 0x7fa8f019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f7a33640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f01015d0 0x7fa8f019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f7a33640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f019c3b0 con 0x7fa8f01015d0 2024-08-19T01:08:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f7a33640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8f0195940 con 0x7fa8f0100cb0 2024-08-19T01:08:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f4fce640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f01015d0 0x7fa8f019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f4fce640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f01015d0 0x7fa8f019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40874/0 (socket says 172.21.15.17:40874) 2024-08-19T01:08:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f4fce640 1 -- 172.21.15.17:0/192300138 learned_addr learned my addr 172.21.15.17:0/192300138 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f57cf640 1 --2- 172.21.15.17:0/192300138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f0100cb0 0x7fa8f019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f4fce640 1 -- 172.21.15.17:0/192300138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f0100cb0 msgr2=0x7fa8f019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f4fce640 1 --2- 172.21.15.17:0/192300138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f0100cb0 0x7fa8f019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.523+0000 7fa8f4fce640 1 -- 172.21.15.17:0/192300138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e0009560 con 0x7fa8f01015d0 2024-08-19T01:08:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.524+0000 7fa8f4fce640 1 --2- 172.21.15.17:0/192300138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f01015d0 0x7fa8f019bd90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa8e002aa50 tx=0x7fa8e00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.524+0000 7fa8e67fc640 1 -- 172.21.15.17:0/192300138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8e00048d0 con 0x7fa8f01015d0 2024-08-19T01:08:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.524+0000 7fa8e67fc640 1 -- 172.21.15.17:0/192300138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa8e0031640 con 0x7fa8f01015d0 2024-08-19T01:08:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.524+0000 7fa8f7a33640 1 -- 172.21.15.17:0/192300138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8f0195bc0 con 0x7fa8f01015d0 2024-08-19T01:08:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.524+0000 7fa8e67fc640 1 -- 172.21.15.17:0/192300138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8e0003820 con 0x7fa8f01015d0 2024-08-19T01:08:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.524+0000 7fa8f7a33640 1 -- 172.21.15.17:0/192300138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8f01960b0 con 0x7fa8f01015d0 2024-08-19T01:08:59.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.525+0000 7fa8f7a33640 1 -- 172.21.15.17:0/192300138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8f0068510 con 0x7fa8f01015d0 2024-08-19T01:08:59.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.525+0000 7fa8e67fc640 1 -- 172.21.15.17:0/192300138 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa8e002ad50 con 0x7fa8f01015d0 2024-08-19T01:08:59.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.526+0000 7fa8e67fc640 1 --2- 172.21.15.17:0/192300138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa8dc06e170 0x7fa8dc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:59.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.526+0000 7fa8e67fc640 1 -- 172.21.15.17:0/192300138 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa8e00aed80 con 0x7fa8f01015d0 2024-08-19T01:08:59.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.526+0000 7fa8f57cf640 1 --2- 172.21.15.17:0/192300138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa8dc06e170 0x7fa8dc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.527+0000 7fa8f57cf640 1 --2- 172.21.15.17:0/192300138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa8dc06e170 0x7fa8dc070630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec005fd0 tx=0x7fa8ec009500 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.530+0000 7fa8e67fc640 1 -- 172.21.15.17:0/192300138 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa8e00780e0 con 0x7fa8f01015d0 2024-08-19T01:08:59.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:08:59 smithi017 ceph-mon[99370]: from='client.34624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:08:59.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.779+0000 7fa8f7a33640 1 -- 172.21.15.17:0/192300138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa8f0101090 con 0x7fa8f01015d0 2024-08-19T01:08:59.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.779+0000 7fa8e67fc640 1 -- 172.21.15.17:0/192300138 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7fa8e007b7a0 con 0x7fa8f01015d0 2024-08-19T01:08:59.781 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:08:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:08:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:08:59.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:08:59.782 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:08:59.783 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:08:59.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.781+0000 7fa8f7a33640 1 -- 172.21.15.17:0/192300138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa8dc06e170 msgr2=0x7fa8dc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.781+0000 7fa8f7a33640 1 --2- 172.21.15.17:0/192300138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa8dc06e170 0x7fa8dc070630 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec005fd0 tx=0x7fa8ec009500 comp rx=0 tx=0).stop 2024-08-19T01:08:59.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.781+0000 7fa8f7a33640 1 -- 172.21.15.17:0/192300138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f01015d0 msgr2=0x7fa8f019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.781+0000 7fa8f7a33640 1 --2- 172.21.15.17:0/192300138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f01015d0 0x7fa8f019bd90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa8e002aa50 tx=0x7fa8e00055a0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.781+0000 7fa8f7a33640 1 -- 172.21.15.17:0/192300138 shutdown_connections 2024-08-19T01:08:59.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.781+0000 7fa8f7a33640 1 --2- 172.21.15.17:0/192300138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa8dc06e170 0x7fa8dc070630 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.781+0000 7fa8f7a33640 1 --2- 172.21.15.17:0/192300138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa8f01015d0 0x7fa8f019bd90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.781+0000 7fa8f7a33640 1 --2- 172.21.15.17:0/192300138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa8f0100cb0 0x7fa8f019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.781+0000 7fa8f7a33640 1 -- 172.21.15.17:0/192300138 >> 172.21.15.17:0/192300138 conn(0x7fa8f00758a0 msgr2=0x7fa8f0101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:59.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.781+0000 7fa8f7a33640 1 -- 172.21.15.17:0/192300138 shutdown_connections 2024-08-19T01:08:59.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.781+0000 7fa8f7a33640 1 -- 172.21.15.17:0/192300138 wait complete. 2024-08-19T01:08:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.864+0000 7fe6a7270640 1 -- 172.21.15.17:0/2558892212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a0100750 msgr2=0x7fe6a01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.864+0000 7fe6a7270640 1 --2- 172.21.15.17:0/2558892212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a0100750 0x7fe6a01047a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe690009880 tx=0x7fe69002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.864+0000 7fe6a7270640 1 -- 172.21.15.17:0/2558892212 shutdown_connections 2024-08-19T01:08:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.864+0000 7fe6a7270640 1 --2- 172.21.15.17:0/2558892212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a0100750 0x7fe6a01047a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.864+0000 7fe6a7270640 1 --2- 172.21.15.17:0/2558892212 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a00ffda0 0x7fe6a0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.864+0000 7fe6a7270640 1 -- 172.21.15.17:0/2558892212 >> 172.21.15.17:0/2558892212 conn(0x7fe6a00fb840 msgr2=0x7fe6a00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.864+0000 7fe6a7270640 1 -- 172.21.15.17:0/2558892212 shutdown_connections 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.864+0000 7fe6a7270640 1 -- 172.21.15.17:0/2558892212 wait complete. 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.864+0000 7fe6a7270640 1 Processor -- start 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a7270640 1 -- start start 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a7270640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a00ffda0 0x7fe6a00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a7270640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a0100750 0x7fe6a0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a7270640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a0073230 con 0x7fe6a00ffda0 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a7270640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a00733a0 con 0x7fe6a0100750 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a500c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a00ffda0 0x7fe6a00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a500c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a00ffda0 0x7fe6a00727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40896/0 (socket says 172.21.15.17:40896) 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a500c640 1 -- 172.21.15.17:0/1239809556 learned_addr learned my addr 172.21.15.17:0/1239809556 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a480b640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a0100750 0x7fe6a0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:59.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a500c640 1 -- 172.21.15.17:0/1239809556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a0100750 msgr2=0x7fe6a0072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:08:59.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a500c640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a0100750 0x7fe6a0072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:08:59.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a500c640 1 -- 172.21.15.17:0/1239809556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe690009560 con 0x7fe6a00ffda0 2024-08-19T01:08:59.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a480b640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a0100750 0x7fe6a0072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:08:59.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.865+0000 7fe6a500c640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a00ffda0 0x7fe6a00727b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00b420 tx=0x7fe69c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:59.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.866+0000 7fe6967fc640 1 -- 172.21.15.17:0/1239809556 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe69c011800 con 0x7fe6a00ffda0 2024-08-19T01:08:59.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.866+0000 7fe6967fc640 1 -- 172.21.15.17:0/1239809556 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe69c011e20 con 0x7fe6a00ffda0 2024-08-19T01:08:59.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.866+0000 7fe6a7270640 1 -- 172.21.15.17:0/1239809556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a01a1d90 con 0x7fe6a00ffda0 2024-08-19T01:08:59.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.866+0000 7fe6967fc640 1 -- 172.21.15.17:0/1239809556 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe69c00f2e0 con 0x7fe6a00ffda0 2024-08-19T01:08:59.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.866+0000 7fe6a7270640 1 -- 172.21.15.17:0/1239809556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a01a20f0 con 0x7fe6a00ffda0 2024-08-19T01:08:59.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.867+0000 7fe6a7270640 1 -- 172.21.15.17:0/1239809556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a0101280 con 0x7fe6a00ffda0 2024-08-19T01:08:59.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.867+0000 7fe6967fc640 1 -- 172.21.15.17:0/1239809556 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe69c010380 con 0x7fe6a00ffda0 2024-08-19T01:08:59.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.868+0000 7fe6967fc640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe68c06e170 0x7fe68c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:08:59.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.868+0000 7fe6967fc640 1 -- 172.21.15.17:0/1239809556 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe69c08da50 con 0x7fe6a00ffda0 2024-08-19T01:08:59.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.868+0000 7fe6a480b640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe68c06e170 0x7fe68c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:08:59.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.868+0000 7fe6a480b640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe68c06e170 0x7fe68c070630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe690000c00 tx=0x7fe690005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:08:59.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:08:59.872+0000 7fe6967fc640 1 -- 172.21.15.17:0/1239809556 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe69c056db0 con 0x7fe6a00ffda0 2024-08-19T01:08:59.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:08:59 smithi086 ceph-mon[71303]: from='client.34624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:00.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.084+0000 7fe6a7270640 1 -- 172.21.15.17:0/1239809556 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe6a0073560 con 0x7fe6a00ffda0 2024-08-19T01:09:00.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.085+0000 7fe6967fc640 1 -- 172.21.15.17:0/1239809556 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7fe69c05a470 con 0x7fe6a00ffda0 2024-08-19T01:09:00.087 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:09:00.087 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:09:00.087 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:09:00.087 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:09:00.087 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:09:00.088 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:09:00.089 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:09:00.090 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:09:00.090 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:09:00.090 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:09:00.090 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:09:00.090 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:09:00.090 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:09:00.090 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:09:00.090 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:09:00.090 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:09:00.090 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:09:00.090 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:09:00.091 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:09:00.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.087+0000 7fe6a7270640 1 -- 172.21.15.17:0/1239809556 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe68c06e170 msgr2=0x7fe68c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:00.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.087+0000 7fe6a7270640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe68c06e170 0x7fe68c070630 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe690000c00 tx=0x7fe690005a20 comp rx=0 tx=0).stop 2024-08-19T01:09:00.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.087+0000 7fe6a7270640 1 -- 172.21.15.17:0/1239809556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a00ffda0 msgr2=0x7fe6a00727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:00.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.087+0000 7fe6a7270640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a00ffda0 0x7fe6a00727b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe69c00b420 tx=0x7fe69c00b8e0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.087+0000 7fe6a7270640 1 -- 172.21.15.17:0/1239809556 shutdown_connections 2024-08-19T01:09:00.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.087+0000 7fe6a7270640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe68c06e170 0x7fe68c070630 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.087+0000 7fe6a7270640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe6a0100750 0x7fe6a0072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.087+0000 7fe6a7270640 1 --2- 172.21.15.17:0/1239809556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe6a00ffda0 0x7fe6a00727b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.087+0000 7fe6a7270640 1 -- 172.21.15.17:0/1239809556 >> 172.21.15.17:0/1239809556 conn(0x7fe6a00fb840 msgr2=0x7fe6a00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:00.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.087+0000 7fe6a7270640 1 -- 172.21.15.17:0/1239809556 shutdown_connections 2024-08-19T01:09:00.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.087+0000 7fe6a7270640 1 -- 172.21.15.17:0/1239809556 wait complete. 2024-08-19T01:09:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.170+0000 7f6b65aa4640 1 -- 172.21.15.17:0/1183374704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b60100c60 msgr2=0x7f6b60101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.170+0000 7f6b65aa4640 1 --2- 172.21.15.17:0/1183374704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b60100c60 0x7f6b60101040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b480098b0 tx=0x7f6b4802a4d0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.170+0000 7f6b65aa4640 1 -- 172.21.15.17:0/1183374704 shutdown_connections 2024-08-19T01:09:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.170+0000 7f6b65aa4640 1 --2- 172.21.15.17:0/1183374704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b60101610 0x7f6b60109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.170+0000 7f6b65aa4640 1 --2- 172.21.15.17:0/1183374704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b60100c60 0x7f6b60101040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.170+0000 7f6b65aa4640 1 -- 172.21.15.17:0/1183374704 >> 172.21.15.17:0/1183374704 conn(0x7f6b600fa730 msgr2=0x7f6b600fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:00.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.170+0000 7f6b65aa4640 1 -- 172.21.15.17:0/1183374704 shutdown_connections 2024-08-19T01:09:00.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.170+0000 7f6b65aa4640 1 -- 172.21.15.17:0/1183374704 wait complete. 2024-08-19T01:09:00.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.171+0000 7f6b65aa4640 1 Processor -- start 2024-08-19T01:09:00.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.171+0000 7f6b65aa4640 1 -- start start 2024-08-19T01:09:00.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.171+0000 7f6b65aa4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b60100c60 0x7f6b6019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:00.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.171+0000 7f6b65aa4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b60101610 0x7f6b6019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:00.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.171+0000 7f6b65aa4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6019c380 con 0x7f6b60101610 2024-08-19T01:09:00.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.171+0000 7f6b65aa4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60195910 con 0x7f6b60100c60 2024-08-19T01:09:00.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.171+0000 7f6b5effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b60101610 0x7f6b6019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.171+0000 7f6b5effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b60101610 0x7f6b6019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40914/0 (socket says 172.21.15.17:40914) 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.171+0000 7f6b5effd640 1 -- 172.21.15.17:0/2537710488 learned_addr learned my addr 172.21.15.17:0/2537710488 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.171+0000 7f6b5f7fe640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b60100c60 0x7f6b6019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.172+0000 7f6b5effd640 1 -- 172.21.15.17:0/2537710488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b60100c60 msgr2=0x7f6b6019b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.172+0000 7f6b5effd640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b60100c60 0x7f6b6019b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.172+0000 7f6b5effd640 1 -- 172.21.15.17:0/2537710488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b48009560 con 0x7f6b60101610 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.172+0000 7f6b5f7fe640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b60100c60 0x7f6b6019b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.172+0000 7f6b5effd640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b60101610 0x7f6b6019bd60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000d8d0 tx=0x7f6b5000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.172+0000 7f6b5cff9640 1 -- 172.21.15.17:0/2537710488 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5000bea0 con 0x7f6b60101610 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.172+0000 7f6b65aa4640 1 -- 172.21.15.17:0/2537710488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b60195bf0 con 0x7f6b60101610 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.172+0000 7f6b5cff9640 1 -- 172.21.15.17:0/2537710488 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6b50009c00 con 0x7f6b60101610 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.172+0000 7f6b5cff9640 1 -- 172.21.15.17:0/2537710488 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5000f710 con 0x7f6b60101610 2024-08-19T01:09:00.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.172+0000 7f6b65aa4640 1 -- 172.21.15.17:0/2537710488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b60196140 con 0x7f6b60101610 2024-08-19T01:09:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.173+0000 7f6b65aa4640 1 -- 172.21.15.17:0/2537710488 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b60068d30 con 0x7f6b60101610 2024-08-19T01:09:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.173+0000 7f6b5cff9640 1 -- 172.21.15.17:0/2537710488 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6b5000f990 con 0x7f6b60101610 2024-08-19T01:09:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.174+0000 7f6b5cff9640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b4c06e170 0x7f6b4c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:00.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.174+0000 7f6b5cff9640 1 -- 172.21.15.17:0/2537710488 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6b5008df20 con 0x7f6b60101610 2024-08-19T01:09:00.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.174+0000 7f6b5f7fe640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b4c06e170 0x7f6b4c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:00.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.174+0000 7f6b5f7fe640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b4c06e170 0x7f6b4c070630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009230 tx=0x7f6b48005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:00.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.178+0000 7f6b5cff9640 1 -- 172.21.15.17:0/2537710488 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6b500c2df0 con 0x7f6b60101610 2024-08-19T01:09:00.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.371+0000 7f6b65aa4640 1 -- 172.21.15.17:0/2537710488 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b6010cdb0 con 0x7f6b4c06e170 2024-08-19T01:09:00.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.372+0000 7f6b5cff9640 1 -- 172.21.15.17:0/2537710488 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6b6010cdb0 con 0x7f6b4c06e170 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:09:00.374 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:09:00.375 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:09:00.375 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:09:00.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.374+0000 7f6b65aa4640 1 -- 172.21.15.17:0/2537710488 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b4c06e170 msgr2=0x7f6b4c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:00.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.374+0000 7f6b65aa4640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b4c06e170 0x7f6b4c070630 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009230 tx=0x7f6b48005a20 comp rx=0 tx=0).stop 2024-08-19T01:09:00.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.374+0000 7f6b65aa4640 1 -- 172.21.15.17:0/2537710488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b60101610 msgr2=0x7f6b6019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:00.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.374+0000 7f6b65aa4640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b60101610 0x7f6b6019bd60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000d8d0 tx=0x7f6b5000dd90 comp rx=0 tx=0).stop 2024-08-19T01:09:00.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.374+0000 7f6b65aa4640 1 -- 172.21.15.17:0/2537710488 shutdown_connections 2024-08-19T01:09:00.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.374+0000 7f6b65aa4640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6b4c06e170 0x7f6b4c070630 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.374+0000 7f6b65aa4640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6b60101610 0x7f6b6019bd60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.374+0000 7f6b65aa4640 1 --2- 172.21.15.17:0/2537710488 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6b60100c60 0x7f6b6019b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.374+0000 7f6b65aa4640 1 -- 172.21.15.17:0/2537710488 >> 172.21.15.17:0/2537710488 conn(0x7f6b600fa730 msgr2=0x7f6b60101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:00.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.374+0000 7f6b65aa4640 1 -- 172.21.15.17:0/2537710488 shutdown_connections 2024-08-19T01:09:00.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.374+0000 7f6b65aa4640 1 -- 172.21.15.17:0/2537710488 wait complete. 2024-08-19T01:09:00.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.455+0000 7fe3c76f3640 1 -- 172.21.15.17:0/880944401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3c00fe9f0 msgr2=0x7fe3c00fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:00.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.455+0000 7fe3c76f3640 1 --2- 172.21.15.17:0/880944401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3c00fe9f0 0x7fe3c00fee50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4009880 tx=0x7fe3b402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.455+0000 7fe3c76f3640 1 -- 172.21.15.17:0/880944401 shutdown_connections 2024-08-19T01:09:00.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.455+0000 7fe3c76f3640 1 --2- 172.21.15.17:0/880944401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3c00fe9f0 0x7fe3c00fee50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.455+0000 7fe3c76f3640 1 --2- 172.21.15.17:0/880944401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c01049f0 0x7fe3c0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.455+0000 7fe3c76f3640 1 -- 172.21.15.17:0/880944401 >> 172.21.15.17:0/880944401 conn(0x7fe3c00758a0 msgr2=0x7fe3c00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:00.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.456+0000 7fe3c76f3640 1 -- 172.21.15.17:0/880944401 shutdown_connections 2024-08-19T01:09:00.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.456+0000 7fe3c76f3640 1 -- 172.21.15.17:0/880944401 wait complete. 2024-08-19T01:09:00.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.456+0000 7fe3c76f3640 1 Processor -- start 2024-08-19T01:09:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.456+0000 7fe3c76f3640 1 -- start start 2024-08-19T01:09:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.456+0000 7fe3c76f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3c00fe9f0 0x7fe3c019da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.456+0000 7fe3c76f3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c01049f0 0x7fe3c019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.456+0000 7fe3c76f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c0197b40 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.456+0000 7fe3c76f3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c0197cb0 con 0x7fe3c01049f0 2024-08-19T01:09:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3c548f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3c00fe9f0 0x7fe3c019da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3c548f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3c00fe9f0 0x7fe3c019da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40930/0 (socket says 172.21.15.17:40930) 2024-08-19T01:09:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3c548f640 1 -- 172.21.15.17:0/366472423 learned_addr learned my addr 172.21.15.17:0/366472423 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:09:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3c4c8e640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c01049f0 0x7fe3c019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3c548f640 1 -- 172.21.15.17:0/366472423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c01049f0 msgr2=0x7fe3c019df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3c548f640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c01049f0 0x7fe3c019df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3c548f640 1 -- 172.21.15.17:0/366472423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4009560 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3c4c8e640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c01049f0 0x7fe3c019df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:09:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3c548f640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3c00fe9f0 0x7fe3c019da50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe3b000ea30 tx=0x7fe3b000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3be7fc640 1 -- 172.21.15.17:0/366472423 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b000cdb0 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3c76f3640 1 -- 172.21.15.17:0/366472423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c0197f90 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3be7fc640 1 -- 172.21.15.17:0/366472423 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe3b0011930 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3be7fc640 1 -- 172.21.15.17:0/366472423 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b001aa30 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.457+0000 7fe3c76f3640 1 -- 172.21.15.17:0/366472423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c01984b0 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.458+0000 7fe3c76f3640 1 -- 172.21.15.17:0/366472423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c0100130 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.459+0000 7fe3be7fc640 1 -- 172.21.15.17:0/366472423 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe3b001aca0 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.459+0000 7fe3be7fc640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe3a806e170 0x7fe3a8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:00.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.459+0000 7fe3be7fc640 1 -- 172.21.15.17:0/366472423 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe3b008e8b0 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.459+0000 7fe3c4c8e640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe3a806e170 0x7fe3a8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:00.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.460+0000 7fe3c4c8e640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe3a806e170 0x7fe3a8070630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4000c00 tx=0x7fe3b4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:00.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.464+0000 7fe3be7fc640 1 -- 172.21.15.17:0/366472423 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe3b0057b90 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:00 smithi017 ceph-mon[99370]: pgmap v306: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:00.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:00 smithi017 ceph-mon[99370]: from='client.34628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:00.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:00 smithi017 ceph-mon[99370]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:00.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:00 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/192300138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:09:00.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:00 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1239809556' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:09:00.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.708+0000 7fe3c76f3640 1 -- 172.21.15.17:0/366472423 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe3c0198700 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.708+0000 7fe3be7fc640 1 -- 172.21.15.17:0/366472423 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7fe3b005b250 con 0x7fe3c00fe9f0 2024-08-19T01:09:00.710 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:09:00.710 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:09:00.711 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:09:00.711 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:09:00.711 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:09:00.711 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:09:00.711 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:09:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.711+0000 7fe3c76f3640 1 -- 172.21.15.17:0/366472423 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe3a806e170 msgr2=0x7fe3a8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.711+0000 7fe3c76f3640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe3a806e170 0x7fe3a8070630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe3b4000c00 tx=0x7fe3b4005a20 comp rx=0 tx=0).stop 2024-08-19T01:09:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.711+0000 7fe3c76f3640 1 -- 172.21.15.17:0/366472423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3c00fe9f0 msgr2=0x7fe3c019da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.711+0000 7fe3c76f3640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3c00fe9f0 0x7fe3c019da50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe3b000ea30 tx=0x7fe3b000eef0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.711+0000 7fe3c76f3640 1 -- 172.21.15.17:0/366472423 shutdown_connections 2024-08-19T01:09:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.711+0000 7fe3c76f3640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe3a806e170 0x7fe3a8070630 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.711+0000 7fe3c76f3640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe3c01049f0 0x7fe3c019df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.711+0000 7fe3c76f3640 1 --2- 172.21.15.17:0/366472423 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3c00fe9f0 0x7fe3c019da50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.711+0000 7fe3c76f3640 1 -- 172.21.15.17:0/366472423 >> 172.21.15.17:0/366472423 conn(0x7fe3c00758a0 msgr2=0x7fe3c0102160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.711+0000 7fe3c76f3640 1 -- 172.21.15.17:0/366472423 shutdown_connections 2024-08-19T01:09:00.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:00.711+0000 7fe3c76f3640 1 -- 172.21.15.17:0/366472423 wait complete. 2024-08-19T01:09:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:00 smithi086 ceph-mon[71303]: pgmap v306: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:00 smithi086 ceph-mon[71303]: from='client.34628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:00 smithi086 ceph-mon[71303]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:00 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/192300138' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:09:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:00 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1239809556' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:09:01.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:01 smithi017 ceph-mon[99370]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:01.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:01 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/366472423' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:09:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:01 smithi086 ceph-mon[71303]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:01 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/366472423' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:09:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:02 smithi017 ceph-mon[99370]: pgmap v307: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:02.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:02 smithi086 ceph-mon[71303]: pgmap v307: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:03.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:09:03.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:09:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:04 smithi017 ceph-mon[99370]: pgmap v308: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:04.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:04 smithi086 ceph-mon[71303]: pgmap v308: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:06 smithi017 ceph-mon[99370]: pgmap v309: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:06 smithi086 ceph-mon[71303]: pgmap v309: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:08.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:08 smithi017 ceph-mon[99370]: pgmap v310: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:08.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:08 smithi086 ceph-mon[71303]: pgmap v310: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:10 smithi017 ceph-mon[99370]: pgmap v311: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:10 smithi086 ceph-mon[71303]: pgmap v311: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:12 smithi017 ceph-mon[99370]: pgmap v312: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:12 smithi086 ceph-mon[71303]: pgmap v312: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:14.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:14 smithi017 ceph-mon[99370]: pgmap v313: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:14.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:14 smithi086 ceph-mon[71303]: pgmap v313: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:16.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:16 smithi017 ceph-mon[99370]: pgmap v314: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:16 smithi086 ceph-mon[71303]: pgmap v314: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:18.872 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:18 smithi086 ceph-mon[71303]: pgmap v315: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:18.872 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:09:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:18 smithi017 ceph-mon[99370]: pgmap v315: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:09:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:20 smithi017 ceph-mon[99370]: pgmap v316: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:20 smithi086 ceph-mon[71303]: pgmap v316: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:22.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:22 smithi017 ceph-mon[99370]: pgmap v317: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:22 smithi086 ceph-mon[71303]: pgmap v317: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:24.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:24 smithi017 ceph-mon[99370]: pgmap v318: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:24.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:24 smithi086 ceph-mon[71303]: pgmap v318: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:26.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:26 smithi086 ceph-mon[71303]: pgmap v319: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:26 smithi017 ceph-mon[99370]: pgmap v319: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:28.834 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:28 smithi017 ceph-mon[99370]: pgmap v320: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:28 smithi086 ceph-mon[71303]: pgmap v320: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:30.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.805+0000 7f8132845640 1 -- 172.21.15.17:0/3575617872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f812c100750 msgr2=0x7f812c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:30.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.805+0000 7f8132845640 1 --2- 172.21.15.17:0/3575617872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f812c100750 0x7f812c1047a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8120009880 tx=0x7f812002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:09:30.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.805+0000 7f8132845640 1 -- 172.21.15.17:0/3575617872 shutdown_connections 2024-08-19T01:09:30.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.805+0000 7f8132845640 1 --2- 172.21.15.17:0/3575617872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f812c100750 0x7f812c1047a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:30.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.805+0000 7f8132845640 1 --2- 172.21.15.17:0/3575617872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c0ffda0 0x7f812c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:30.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.805+0000 7f8132845640 1 -- 172.21.15.17:0/3575617872 >> 172.21.15.17:0/3575617872 conn(0x7f812c0fb840 msgr2=0x7f812c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:30.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.805+0000 7f8132845640 1 -- 172.21.15.17:0/3575617872 shutdown_connections 2024-08-19T01:09:30.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.805+0000 7f8132845640 1 -- 172.21.15.17:0/3575617872 wait complete. 2024-08-19T01:09:30.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.806+0000 7f8132845640 1 Processor -- start 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.806+0000 7f8132845640 1 -- start start 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f8132845640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c0ffda0 0x7f812c19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f8132845640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f812c100750 0x7f812c19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f8132845640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c195930 con 0x7f812c100750 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f8132845640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812c195a70 con 0x7f812c0ffda0 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f812b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f812c100750 0x7f812c19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f812b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f812c100750 0x7f812c19be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49386/0 (socket says 172.21.15.17:49386) 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f812b7fe640 1 -- 172.21.15.17:0/1423407698 learned_addr learned my addr 172.21.15.17:0/1423407698 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f812bfff640 1 --2- 172.21.15.17:0/1423407698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c0ffda0 0x7f812c19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f812b7fe640 1 -- 172.21.15.17:0/1423407698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c0ffda0 msgr2=0x7f812c19b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f812b7fe640 1 --2- 172.21.15.17:0/1423407698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c0ffda0 0x7f812c19b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:30.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f812b7fe640 1 -- 172.21.15.17:0/1423407698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009560 con 0x7f812c100750 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.807+0000 7f812b7fe640 1 --2- 172.21.15.17:0/1423407698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f812c100750 0x7f812c19be10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8120006010 tx=0x7f81200055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.808+0000 7f81297fa640 1 -- 172.21.15.17:0/1423407698 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8120004aa0 con 0x7f812c100750 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.808+0000 7f8132845640 1 -- 172.21.15.17:0/1423407698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c195cf0 con 0x7f812c100750 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.808+0000 7f81297fa640 1 -- 172.21.15.17:0/1423407698 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8120031470 con 0x7f812c100750 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.808+0000 7f81297fa640 1 -- 172.21.15.17:0/1423407698 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8120003940 con 0x7f812c100750 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.808+0000 7f8132845640 1 -- 172.21.15.17:0/1423407698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f812c1961e0 con 0x7f812c100750 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.809+0000 7f8132845640 1 -- 172.21.15.17:0/1423407698 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812c101280 con 0x7f812c100750 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.809+0000 7f81297fa640 1 -- 172.21.15.17:0/1423407698 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8120031b90 con 0x7f812c100750 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.810+0000 7f81297fa640 1 --2- 172.21.15.17:0/1423407698 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f811406e180 0x7f8114070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.810+0000 7f81297fa640 1 -- 172.21.15.17:0/1423407698 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f81200af2b0 con 0x7f812c100750 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.810+0000 7f812bfff640 1 --2- 172.21.15.17:0/1423407698 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f811406e180 0x7f8114070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:30.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.811+0000 7f812bfff640 1 --2- 172.21.15.17:0/1423407698 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f811406e180 0x7f8114070640 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f811c005fd0 tx=0x7f811c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:30.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:30.815+0000 7f81297fa640 1 -- 172.21.15.17:0/1423407698 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f81200785a0 con 0x7f812c100750 2024-08-19T01:09:30.818 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:30 smithi017 ceph-mon[99370]: pgmap v321: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:30 smithi086 ceph-mon[71303]: pgmap v321: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.009+0000 7f8132845640 1 -- 172.21.15.17:0/1423407698 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f812c10cdd0 con 0x7f811406e180 2024-08-19T01:09:31.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.010+0000 7f81297fa640 1 -- 172.21.15.17:0/1423407698 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f812c10cdd0 con 0x7f811406e180 2024-08-19T01:09:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.012+0000 7f8132845640 1 -- 172.21.15.17:0/1423407698 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f811406e180 msgr2=0x7f8114070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.012+0000 7f8132845640 1 --2- 172.21.15.17:0/1423407698 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f811406e180 0x7f8114070640 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f811c005fd0 tx=0x7f811c00b390 comp rx=0 tx=0).stop 2024-08-19T01:09:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.012+0000 7f8132845640 1 -- 172.21.15.17:0/1423407698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f812c100750 msgr2=0x7f812c19be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.012+0000 7f8132845640 1 --2- 172.21.15.17:0/1423407698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f812c100750 0x7f812c19be10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8120006010 tx=0x7f81200055a0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.012+0000 7f8132845640 1 -- 172.21.15.17:0/1423407698 shutdown_connections 2024-08-19T01:09:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.012+0000 7f8132845640 1 --2- 172.21.15.17:0/1423407698 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f811406e180 0x7f8114070640 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.012+0000 7f8132845640 1 --2- 172.21.15.17:0/1423407698 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f812c100750 0x7f812c19be10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.012+0000 7f8132845640 1 --2- 172.21.15.17:0/1423407698 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f812c0ffda0 0x7f812c19b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.012+0000 7f8132845640 1 -- 172.21.15.17:0/1423407698 >> 172.21.15.17:0/1423407698 conn(0x7f812c0fb840 msgr2=0x7f812c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.012+0000 7f8132845640 1 -- 172.21.15.17:0/1423407698 shutdown_connections 2024-08-19T01:09:31.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.012+0000 7f8132845640 1 -- 172.21.15.17:0/1423407698 wait complete. 2024-08-19T01:09:31.024 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:09:31.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.095+0000 7f1ab4d06640 1 -- 172.21.15.17:0/1279518143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab00fea30 msgr2=0x7f1ab00fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.095+0000 7f1ab4d06640 1 --2- 172.21.15.17:0/1279518143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab00fea30 0x7f1ab00fee90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1a98009880 tx=0x7f1a9802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.096+0000 7f1ab4d06640 1 -- 172.21.15.17:0/1279518143 shutdown_connections 2024-08-19T01:09:31.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.096+0000 7f1ab4d06640 1 --2- 172.21.15.17:0/1279518143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab00fea30 0x7f1ab00fee90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.096+0000 7f1ab4d06640 1 --2- 172.21.15.17:0/1279518143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ab0104a30 0x7f1ab0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.096+0000 7f1ab4d06640 1 -- 172.21.15.17:0/1279518143 >> 172.21.15.17:0/1279518143 conn(0x7f1ab00fa730 msgr2=0x7f1ab00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:31.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.096+0000 7f1ab4d06640 1 -- 172.21.15.17:0/1279518143 shutdown_connections 2024-08-19T01:09:31.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.096+0000 7f1ab4d06640 1 -- 172.21.15.17:0/1279518143 wait complete. 2024-08-19T01:09:31.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1ab4d06640 1 Processor -- start 2024-08-19T01:09:31.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1ab4d06640 1 -- start start 2024-08-19T01:09:31.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1ab4d06640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab00fea30 0x7f1ab019a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:31.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1ab4d06640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ab0104a30 0x7f1ab019ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:31.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1ab4d06640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab0194800 con 0x7f1ab00fea30 2024-08-19T01:09:31.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1ab4d06640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab0194970 con 0x7f1ab0104a30 2024-08-19T01:09:31.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1aae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab00fea30 0x7f1ab019a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:31.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1aae59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab00fea30 0x7f1ab019a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49402/0 (socket says 172.21.15.17:49402) 2024-08-19T01:09:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1aae59c640 1 -- 172.21.15.17:0/825164280 learned_addr learned my addr 172.21.15.17:0/825164280 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:09:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1aae59c640 1 -- 172.21.15.17:0/825164280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ab0104a30 msgr2=0x7f1ab019ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1aae59c640 1 --2- 172.21.15.17:0/825164280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ab0104a30 0x7f1ab019ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.097+0000 7f1aae59c640 1 -- 172.21.15.17:0/825164280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a98009560 con 0x7f1ab00fea30 2024-08-19T01:09:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.098+0000 7f1aae59c640 1 --2- 172.21.15.17:0/825164280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab00fea30 0x7f1ab019a710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000db80 tx=0x7f1aa000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.098+0000 7f1aa77fe640 1 -- 172.21.15.17:0/825164280 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aa000de40 con 0x7f1ab00fea30 2024-08-19T01:09:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.098+0000 7f1aa77fe640 1 -- 172.21.15.17:0/825164280 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1aa0003e30 con 0x7f1ab00fea30 2024-08-19T01:09:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.098+0000 7f1ab4d06640 1 -- 172.21.15.17:0/825164280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab0194c50 con 0x7f1ab00fea30 2024-08-19T01:09:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.098+0000 7f1aa77fe640 1 -- 172.21.15.17:0/825164280 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aa0010830 con 0x7f1ab00fea30 2024-08-19T01:09:31.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.098+0000 7f1ab4d06640 1 -- 172.21.15.17:0/825164280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab01951a0 con 0x7f1ab00fea30 2024-08-19T01:09:31.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.099+0000 7f1ab4d06640 1 -- 172.21.15.17:0/825164280 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab0100170 con 0x7f1ab00fea30 2024-08-19T01:09:31.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.099+0000 7f1aa77fe640 1 -- 172.21.15.17:0/825164280 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1aa0004020 con 0x7f1ab00fea30 2024-08-19T01:09:31.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.100+0000 7f1aa77fe640 1 --2- 172.21.15.17:0/825164280 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9c06e180 0x7f1a9c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:31.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.100+0000 7f1aa77fe640 1 -- 172.21.15.17:0/825164280 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1aa008e520 con 0x7f1ab00fea30 2024-08-19T01:09:31.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.100+0000 7f1aadd9b640 1 --2- 172.21.15.17:0/825164280 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9c06e180 0x7f1a9c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:31.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.100+0000 7f1aadd9b640 1 --2- 172.21.15.17:0/825164280 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9c06e180 0x7f1a9c070640 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1a9802a9c0 tx=0x7f1a98000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.104+0000 7f1aa77fe640 1 -- 172.21.15.17:0/825164280 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1aa0057800 con 0x7f1ab00fea30 2024-08-19T01:09:31.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.295+0000 7f1ab4d06640 1 -- 172.21.15.17:0/825164280 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ab0195d10 con 0x7f1a9c06e180 2024-08-19T01:09:31.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.297+0000 7f1aa77fe640 1 -- 172.21.15.17:0/825164280 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1ab0195d10 con 0x7f1a9c06e180 2024-08-19T01:09:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.299+0000 7f1ab4d06640 1 -- 172.21.15.17:0/825164280 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9c06e180 msgr2=0x7f1a9c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.299+0000 7f1ab4d06640 1 --2- 172.21.15.17:0/825164280 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9c06e180 0x7f1a9c070640 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1a9802a9c0 tx=0x7f1a98000bc0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.299+0000 7f1ab4d06640 1 -- 172.21.15.17:0/825164280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab00fea30 msgr2=0x7f1ab019a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.299+0000 7f1ab4d06640 1 --2- 172.21.15.17:0/825164280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab00fea30 0x7f1ab019a710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000db80 tx=0x7f1aa000b630 comp rx=0 tx=0).stop 2024-08-19T01:09:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.299+0000 7f1ab4d06640 1 -- 172.21.15.17:0/825164280 shutdown_connections 2024-08-19T01:09:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.299+0000 7f1ab4d06640 1 --2- 172.21.15.17:0/825164280 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9c06e180 0x7f1a9c070640 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.299+0000 7f1ab4d06640 1 --2- 172.21.15.17:0/825164280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ab0104a30 0x7f1ab019ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.299+0000 7f1ab4d06640 1 --2- 172.21.15.17:0/825164280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ab00fea30 0x7f1ab019a710 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.299+0000 7f1ab4d06640 1 -- 172.21.15.17:0/825164280 >> 172.21.15.17:0/825164280 conn(0x7f1ab00fa730 msgr2=0x7f1ab00fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.299+0000 7f1ab4d06640 1 -- 172.21.15.17:0/825164280 shutdown_connections 2024-08-19T01:09:31.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.299+0000 7f1ab4d06640 1 -- 172.21.15.17:0/825164280 wait complete. 2024-08-19T01:09:31.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.381+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1145735914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe764104b50 msgr2=0x7fe764104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.381+0000 7fe76a3d3640 1 --2- 172.21.15.17:0/1145735914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe764104b50 0x7fe764104f30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe754009880 tx=0x7fe75402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.381+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1145735914 shutdown_connections 2024-08-19T01:09:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.381+0000 7fe76a3d3640 1 --2- 172.21.15.17:0/1145735914 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7640fdf70 0x7fe7640fe3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.381+0000 7fe76a3d3640 1 --2- 172.21.15.17:0/1145735914 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe764104b50 0x7fe764104f30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.381+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1145735914 >> 172.21.15.17:0/1145735914 conn(0x7fe7640f9ec0 msgr2=0x7fe7640fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.382+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1145735914 shutdown_connections 2024-08-19T01:09:31.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.382+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1145735914 wait complete. 2024-08-19T01:09:31.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.382+0000 7fe76a3d3640 1 Processor -- start 2024-08-19T01:09:31.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.382+0000 7fe76a3d3640 1 -- start start 2024-08-19T01:09:31.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe76a3d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7640fdf70 0x7fe7640ff150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:31.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe76a3d3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe764104b50 0x7fe7640ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:31.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe76a3d3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640ffbd0 con 0x7fe7640fdf70 2024-08-19T01:09:31.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe76a3d3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640ffd40 con 0x7fe764104b50 2024-08-19T01:09:31.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe763fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7640fdf70 0x7fe7640ff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:31.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe763fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7640fdf70 0x7fe7640ff150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49424/0 (socket says 172.21.15.17:49424) 2024-08-19T01:09:31.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe763fff640 1 -- 172.21.15.17:0/1439596312 learned_addr learned my addr 172.21.15.17:0/1439596312 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:09:31.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe7637fe640 1 --2- 172.21.15.17:0/1439596312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe764104b50 0x7fe7640ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:31.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe763fff640 1 -- 172.21.15.17:0/1439596312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe764104b50 msgr2=0x7fe7640ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe763fff640 1 --2- 172.21.15.17:0/1439596312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe764104b50 0x7fe7640ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe763fff640 1 -- 172.21.15.17:0/1439596312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe754009560 con 0x7fe7640fdf70 2024-08-19T01:09:31.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.383+0000 7fe763fff640 1 --2- 172.21.15.17:0/1439596312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7640fdf70 0x7fe7640ff150 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe75402a9c0 tx=0x7fe7540055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:31.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.384+0000 7fe7617fa640 1 -- 172.21.15.17:0/1439596312 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7540048d0 con 0x7fe7640fdf70 2024-08-19T01:09:31.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.384+0000 7fe7617fa640 1 -- 172.21.15.17:0/1439596312 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe754031640 con 0x7fe7640fdf70 2024-08-19T01:09:31.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.384+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1439596312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7640fffc0 con 0x7fe7640fdf70 2024-08-19T01:09:31.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.384+0000 7fe7617fa640 1 -- 172.21.15.17:0/1439596312 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7540038d0 con 0x7fe7640fdf70 2024-08-19T01:09:31.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.384+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1439596312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7641a1ff0 con 0x7fe7640fdf70 2024-08-19T01:09:31.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.385+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1439596312 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7640fe3d0 con 0x7fe7640fdf70 2024-08-19T01:09:31.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.385+0000 7fe7617fa640 1 -- 172.21.15.17:0/1439596312 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe754003b90 con 0x7fe7640fdf70 2024-08-19T01:09:31.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.386+0000 7fe7617fa640 1 --2- 172.21.15.17:0/1439596312 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe74c06e170 0x7fe74c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:31.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.386+0000 7fe7617fa640 1 -- 172.21.15.17:0/1439596312 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe7540aef10 con 0x7fe7640fdf70 2024-08-19T01:09:31.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.386+0000 7fe7637fe640 1 --2- 172.21.15.17:0/1439596312 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe74c06e170 0x7fe74c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:31.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.386+0000 7fe7637fe640 1 --2- 172.21.15.17:0/1439596312 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe74c06e170 0x7fe74c070630 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe7641008d0 tx=0x7fe758005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:31.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.390+0000 7fe7617fa640 1 -- 172.21.15.17:0/1439596312 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe7540782a0 con 0x7fe7640fdf70 2024-08-19T01:09:31.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.575+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1439596312 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7640fffc0 con 0x7fe74c06e170 2024-08-19T01:09:31.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.584+0000 7fe7617fa640 1 -- 172.21.15.17:0/1439596312 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fe7640fffc0 con 0x7fe74c06e170 2024-08-19T01:09:31.587 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:09:31.587 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (10m) 4m ago 21m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:09:31.587 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (21m) 4m ago 21m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:09:31.587 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (20m) 4m ago 20m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:09:31.587 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (8m) 4m ago 21m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:09:31.587 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (8m) 4m ago 20m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (10m) 4m ago 21m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (4m) 4m ago 15m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (5m) 4m ago 16m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (15m) 4m ago 15m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (4m) 4m ago 16m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (12m) 4m ago 22m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (11m) 4m ago 20m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (9m) 4m ago 23m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (9m) 4m ago 20m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (11m) 4m ago 21m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (11m) 4m ago 20m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (8m) 4m ago 19m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (7m) 4m ago 19m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:09:31.588 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (7m) 4m ago 18m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:09:31.589 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (6m) 4m ago 18m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:09:31.589 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (5m) 4m ago 17m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:09:31.589 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (5m) 4m ago 17m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:09:31.589 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (11m) 4m ago 21m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:09:31.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.586+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1439596312 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe74c06e170 msgr2=0x7fe74c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.586+0000 7fe76a3d3640 1 --2- 172.21.15.17:0/1439596312 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe74c06e170 0x7fe74c070630 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe7641008d0 tx=0x7fe758005f90 comp rx=0 tx=0).stop 2024-08-19T01:09:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.586+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1439596312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7640fdf70 msgr2=0x7fe7640ff150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.586+0000 7fe76a3d3640 1 --2- 172.21.15.17:0/1439596312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7640fdf70 0x7fe7640ff150 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe75402a9c0 tx=0x7fe7540055a0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.586+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1439596312 shutdown_connections 2024-08-19T01:09:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.586+0000 7fe76a3d3640 1 --2- 172.21.15.17:0/1439596312 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe74c06e170 0x7fe74c070630 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.586+0000 7fe76a3d3640 1 --2- 172.21.15.17:0/1439596312 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe764104b50 0x7fe7640ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.586+0000 7fe76a3d3640 1 --2- 172.21.15.17:0/1439596312 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe7640fdf70 0x7fe7640ff150 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.586+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1439596312 >> 172.21.15.17:0/1439596312 conn(0x7fe7640f9ec0 msgr2=0x7fe7640fb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.586+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1439596312 shutdown_connections 2024-08-19T01:09:31.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.586+0000 7fe76a3d3640 1 -- 172.21.15.17:0/1439596312 wait complete. 2024-08-19T01:09:31.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.667+0000 7f97724c7640 1 -- 172.21.15.17:0/3852287758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f976c0fe900 msgr2=0x7f976c0fece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.667+0000 7f97724c7640 1 --2- 172.21.15.17:0/3852287758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f976c0fe900 0x7f976c0fece0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f975c009880 tx=0x7f975c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.667+0000 7f97724c7640 1 -- 172.21.15.17:0/3852287758 shutdown_connections 2024-08-19T01:09:31.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.667+0000 7f97724c7640 1 --2- 172.21.15.17:0/3852287758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976c0ff220 0x7f976c10bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.667+0000 7f97724c7640 1 --2- 172.21.15.17:0/3852287758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f976c0fe900 0x7f976c0fece0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.667+0000 7f97724c7640 1 -- 172.21.15.17:0/3852287758 >> 172.21.15.17:0/3852287758 conn(0x7f976c0fa730 msgr2=0x7f976c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:31.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.668+0000 7f97724c7640 1 -- 172.21.15.17:0/3852287758 shutdown_connections 2024-08-19T01:09:31.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.668+0000 7f97724c7640 1 -- 172.21.15.17:0/3852287758 wait complete. 2024-08-19T01:09:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.668+0000 7f97724c7640 1 Processor -- start 2024-08-19T01:09:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.668+0000 7f97724c7640 1 -- start start 2024-08-19T01:09:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.669+0000 7f97724c7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976c0fe900 0x7f976c197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.669+0000 7f97724c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f976c0ff220 0x7f976c1981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.669+0000 7f97724c7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c1988c0 con 0x7f976c0ff220 2024-08-19T01:09:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.669+0000 7f97724c7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c19b530 con 0x7f976c0fe900 2024-08-19T01:09:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.669+0000 7f976b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f976c0ff220 0x7f976c1981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.669+0000 7f976b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f976c0ff220 0x7f976c1981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49442/0 (socket says 172.21.15.17:49442) 2024-08-19T01:09:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.669+0000 7f976b7fe640 1 -- 172.21.15.17:0/1131143234 learned_addr learned my addr 172.21.15.17:0/1131143234 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:09:31.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.669+0000 7f976bfff640 1 --2- 172.21.15.17:0/1131143234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976c0fe900 0x7f976c197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.669+0000 7f976b7fe640 1 -- 172.21.15.17:0/1131143234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976c0fe900 msgr2=0x7f976c197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.669+0000 7f976b7fe640 1 --2- 172.21.15.17:0/1131143234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976c0fe900 0x7f976c197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.669+0000 7f976b7fe640 1 -- 172.21.15.17:0/1131143234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c009560 con 0x7f976c0ff220 2024-08-19T01:09:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.670+0000 7f976b7fe640 1 --2- 172.21.15.17:0/1131143234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f976c0ff220 0x7f976c1981e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f976000c8f0 tx=0x7f976000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.670+0000 7f97697fa640 1 -- 172.21.15.17:0/1131143234 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9760007b80 con 0x7f976c0ff220 2024-08-19T01:09:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.670+0000 7f97697fa640 1 -- 172.21.15.17:0/1131143234 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f97600054e0 con 0x7f976c0ff220 2024-08-19T01:09:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.670+0000 7f97724c7640 1 -- 172.21.15.17:0/1131143234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c19b810 con 0x7f976c0ff220 2024-08-19T01:09:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.670+0000 7f97697fa640 1 -- 172.21.15.17:0/1131143234 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f976000f450 con 0x7f976c0ff220 2024-08-19T01:09:31.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.670+0000 7f97724c7640 1 -- 172.21.15.17:0/1131143234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c19bd60 con 0x7f976c0ff220 2024-08-19T01:09:31.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.671+0000 7f97724c7640 1 -- 172.21.15.17:0/1131143234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976c068cb0 con 0x7f976c0ff220 2024-08-19T01:09:31.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.672+0000 7f97697fa640 1 -- 172.21.15.17:0/1131143234 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9760004f60 con 0x7f976c0ff220 2024-08-19T01:09:31.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.672+0000 7f97697fa640 1 --2- 172.21.15.17:0/1131143234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f975406e180 0x7f9754070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:31.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.672+0000 7f97697fa640 1 -- 172.21.15.17:0/1131143234 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f976008dfe0 con 0x7f976c0ff220 2024-08-19T01:09:31.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.672+0000 7f976bfff640 1 --2- 172.21.15.17:0/1131143234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f975406e180 0x7f9754070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:31.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.673+0000 7f976bfff640 1 --2- 172.21.15.17:0/1131143234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f975406e180 0x7f9754070640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f975c009230 tx=0x7f975c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:31.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.677+0000 7f97697fa640 1 -- 172.21.15.17:0/1131143234 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f97600c2df0 con 0x7f976c0ff220 2024-08-19T01:09:31.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.919+0000 7f97724c7640 1 -- 172.21.15.17:0/1131143234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f976c198fc0 con 0x7f976c0ff220 2024-08-19T01:09:31.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.920+0000 7f97697fa640 1 -- 172.21.15.17:0/1131143234 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f97600572d0 con 0x7f976c0ff220 2024-08-19T01:09:31.923 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:09:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:09:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:09:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:09:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:09:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:09:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:09:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:09:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:09:31.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:09:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:09:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:09:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:09:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:09:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:09:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:09:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:09:31.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:09:31.924 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:09:31.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.922+0000 7f97724c7640 1 -- 172.21.15.17:0/1131143234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f975406e180 msgr2=0x7f9754070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.922+0000 7f97724c7640 1 --2- 172.21.15.17:0/1131143234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f975406e180 0x7f9754070640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f975c009230 tx=0x7f975c005a20 comp rx=0 tx=0).stop 2024-08-19T01:09:31.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.922+0000 7f97724c7640 1 -- 172.21.15.17:0/1131143234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f976c0ff220 msgr2=0x7f976c1981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:31.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.922+0000 7f97724c7640 1 --2- 172.21.15.17:0/1131143234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f976c0ff220 0x7f976c1981e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f976000c8f0 tx=0x7f976000cdb0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.922+0000 7f97724c7640 1 -- 172.21.15.17:0/1131143234 shutdown_connections 2024-08-19T01:09:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.922+0000 7f97724c7640 1 --2- 172.21.15.17:0/1131143234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f975406e180 0x7f9754070640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.922+0000 7f97724c7640 1 --2- 172.21.15.17:0/1131143234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f976c0ff220 0x7f976c1981e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.922+0000 7f97724c7640 1 --2- 172.21.15.17:0/1131143234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f976c0fe900 0x7f976c197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.922+0000 7f97724c7640 1 -- 172.21.15.17:0/1131143234 >> 172.21.15.17:0/1131143234 conn(0x7f976c0fa730 msgr2=0x7f976c0fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.922+0000 7f97724c7640 1 -- 172.21.15.17:0/1131143234 shutdown_connections 2024-08-19T01:09:31.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:31.922+0000 7f97724c7640 1 -- 172.21.15.17:0/1131143234 wait complete. 2024-08-19T01:09:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.004+0000 7f779354e640 1 -- 172.21.15.17:0/2537447734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f778c104a30 msgr2=0x7f778c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.004+0000 7f779354e640 1 --2- 172.21.15.17:0/2537447734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f778c104a30 0x7f778c104e10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7788009880 tx=0x7f778802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.004+0000 7f779354e640 1 -- 172.21.15.17:0/2537447734 shutdown_connections 2024-08-19T01:09:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.004+0000 7f779354e640 1 --2- 172.21.15.17:0/2537447734 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f778c0fea30 0x7f778c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.004+0000 7f779354e640 1 --2- 172.21.15.17:0/2537447734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f778c104a30 0x7f778c104e10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.004+0000 7f779354e640 1 -- 172.21.15.17:0/2537447734 >> 172.21.15.17:0/2537447734 conn(0x7f778c0fa730 msgr2=0x7f778c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.004+0000 7f779354e640 1 -- 172.21.15.17:0/2537447734 shutdown_connections 2024-08-19T01:09:32.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.004+0000 7f779354e640 1 -- 172.21.15.17:0/2537447734 wait complete. 2024-08-19T01:09:32.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f779354e640 1 Processor -- start 2024-08-19T01:09:32.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f779354e640 1 -- start start 2024-08-19T01:09:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f779354e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f778c0fea30 0x7f778c19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f779354e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f778c104a30 0x7f778c19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f779354e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c19c3b0 con 0x7f778c0fea30 2024-08-19T01:09:32.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f779354e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c195940 con 0x7f778c104a30 2024-08-19T01:09:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f77912ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f778c0fea30 0x7f778c19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f77912ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f778c0fea30 0x7f778c19b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49462/0 (socket says 172.21.15.17:49462) 2024-08-19T01:09:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f77912ea640 1 -- 172.21.15.17:0/623776197 learned_addr learned my addr 172.21.15.17:0/623776197 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:09:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f7790ae9640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f778c104a30 0x7f778c19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f77912ea640 1 -- 172.21.15.17:0/623776197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f778c104a30 msgr2=0x7f778c19bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.005+0000 7f77912ea640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f778c104a30 0x7f778c19bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.006+0000 7f77912ea640 1 -- 172.21.15.17:0/623776197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788009560 con 0x7f778c0fea30 2024-08-19T01:09:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.006+0000 7f7790ae9640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f778c104a30 0x7f778c19bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:09:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.006+0000 7f77912ea640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f778c0fea30 0x7f778c19b850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f778802a9c0 tx=0x7f77880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.006+0000 7f77827fc640 1 -- 172.21.15.17:0/623776197 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7788004aa0 con 0x7f778c0fea30 2024-08-19T01:09:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.006+0000 7f77827fc640 1 -- 172.21.15.17:0/623776197 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7788004c00 con 0x7f778c0fea30 2024-08-19T01:09:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.006+0000 7f779354e640 1 -- 172.21.15.17:0/623776197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c195bc0 con 0x7f778c0fea30 2024-08-19T01:09:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.006+0000 7f77827fc640 1 -- 172.21.15.17:0/623776197 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7788003980 con 0x7f778c0fea30 2024-08-19T01:09:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.006+0000 7f779354e640 1 -- 172.21.15.17:0/623776197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c1960b0 con 0x7f778c0fea30 2024-08-19T01:09:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.007+0000 7f779354e640 1 -- 172.21.15.17:0/623776197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778c100170 con 0x7f778c0fea30 2024-08-19T01:09:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.008+0000 7f77827fc640 1 -- 172.21.15.17:0/623776197 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7788003bf0 con 0x7f778c0fea30 2024-08-19T01:09:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.008+0000 7f77827fc640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f777806e170 0x7f7778070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.008+0000 7f77827fc640 1 -- 172.21.15.17:0/623776197 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f77880af210 con 0x7f778c0fea30 2024-08-19T01:09:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.008+0000 7f7790ae9640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f777806e170 0x7f7778070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.008+0000 7f7790ae9640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f777806e170 0x7f7778070630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f777c0058c0 tx=0x7f777c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.012+0000 7f77827fc640 1 -- 172.21.15.17:0/623776197 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f77880784f0 con 0x7f778c0fea30 2024-08-19T01:09:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.225+0000 7f779354e640 1 -- 172.21.15.17:0/623776197 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f778c107fb0 con 0x7f778c0fea30 2024-08-19T01:09:32.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.225+0000 7f77827fc640 1 -- 172.21.15.17:0/623776197 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f778807bbb0 con 0x7f778c0fea30 2024-08-19T01:09:32.228 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:09:32.229 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:09:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:09:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:09:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:09:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:09:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:09:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:09:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:09:32.230 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:09:32.231 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:09:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:09:32.232 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:09:32.232 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:09:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:09:32.232 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:09:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:09:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:09:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:09:32.232 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:09:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:09:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.227+0000 7f779354e640 1 -- 172.21.15.17:0/623776197 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f777806e170 msgr2=0x7f7778070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.227+0000 7f779354e640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f777806e170 0x7f7778070630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f777c0058c0 tx=0x7f777c005850 comp rx=0 tx=0).stop 2024-08-19T01:09:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.227+0000 7f779354e640 1 -- 172.21.15.17:0/623776197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f778c0fea30 msgr2=0x7f778c19b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.227+0000 7f779354e640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f778c0fea30 0x7f778c19b850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f778802a9c0 tx=0x7f77880055a0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.227+0000 7f779354e640 1 -- 172.21.15.17:0/623776197 shutdown_connections 2024-08-19T01:09:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.227+0000 7f779354e640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f777806e170 0x7f7778070630 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.227+0000 7f779354e640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f778c104a30 0x7f778c19bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.227+0000 7f779354e640 1 --2- 172.21.15.17:0/623776197 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f778c0fea30 0x7f778c19b850 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.227+0000 7f779354e640 1 -- 172.21.15.17:0/623776197 >> 172.21.15.17:0/623776197 conn(0x7f778c0fa730 msgr2=0x7f778c068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.227+0000 7f779354e640 1 -- 172.21.15.17:0/623776197 shutdown_connections 2024-08-19T01:09:32.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.227+0000 7f779354e640 1 -- 172.21.15.17:0/623776197 wait complete. 2024-08-19T01:09:32.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.310+0000 7f144dc14640 1 -- 172.21.15.17:0/1840558563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14480fea20 msgr2=0x7f14480fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.310+0000 7f144dc14640 1 --2- 172.21.15.17:0/1840558563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14480fea20 0x7f14480fee80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1430009880 tx=0x7f143002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.310+0000 7f144dc14640 1 -- 172.21.15.17:0/1840558563 shutdown_connections 2024-08-19T01:09:32.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.310+0000 7f144dc14640 1 --2- 172.21.15.17:0/1840558563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14480fea20 0x7f14480fee80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.310+0000 7f144dc14640 1 --2- 172.21.15.17:0/1840558563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1448104a20 0x7f1448104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.310+0000 7f144dc14640 1 -- 172.21.15.17:0/1840558563 >> 172.21.15.17:0/1840558563 conn(0x7f14480fa700 msgr2=0x7f14480fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:32.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.310+0000 7f144dc14640 1 -- 172.21.15.17:0/1840558563 shutdown_connections 2024-08-19T01:09:32.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.310+0000 7f144dc14640 1 -- 172.21.15.17:0/1840558563 wait complete. 2024-08-19T01:09:32.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.311+0000 7f144dc14640 1 Processor -- start 2024-08-19T01:09:32.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.311+0000 7f144dc14640 1 -- start start 2024-08-19T01:09:32.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.311+0000 7f144dc14640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14480fea20 0x7f144819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:32.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.311+0000 7f144dc14640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1448104a20 0x7f144819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:32.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.311+0000 7f144dc14640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144819c350 con 0x7f14480fea20 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.311+0000 7f144dc14640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14481958e0 con 0x7f1448104a20 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f14477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14480fea20 0x7f144819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f14477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14480fea20 0x7f144819b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49482/0 (socket says 172.21.15.17:49482) 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f14477fe640 1 -- 172.21.15.17:0/3752999108 learned_addr learned my addr 172.21.15.17:0/3752999108 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f143effd640 1 --2- 172.21.15.17:0/3752999108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1448104a20 0x7f144819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f14477fe640 1 -- 172.21.15.17:0/3752999108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1448104a20 msgr2=0x7f144819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f14477fe640 1 --2- 172.21.15.17:0/3752999108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1448104a20 0x7f144819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f14477fe640 1 -- 172.21.15.17:0/3752999108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430009560 con 0x7f14480fea20 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f14477fe640 1 --2- 172.21.15.17:0/3752999108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14480fea20 0x7f144819b7f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f143800d8d0 tx=0x7f143800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f14457fa640 1 -- 172.21.15.17:0/3752999108 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f143800bea0 con 0x7f14480fea20 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f14457fa640 1 -- 172.21.15.17:0/3752999108 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1438009c00 con 0x7f14480fea20 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f144dc14640 1 -- 172.21.15.17:0/3752999108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1448195bc0 con 0x7f14480fea20 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f14457fa640 1 -- 172.21.15.17:0/3752999108 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f143800f710 con 0x7f14480fea20 2024-08-19T01:09:32.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.312+0000 7f144dc14640 1 -- 172.21.15.17:0/3752999108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14481960e0 con 0x7f14480fea20 2024-08-19T01:09:32.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.313+0000 7f144dc14640 1 -- 172.21.15.17:0/3752999108 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1448100160 con 0x7f14480fea20 2024-08-19T01:09:32.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.314+0000 7f14457fa640 1 -- 172.21.15.17:0/3752999108 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1438010460 con 0x7f14480fea20 2024-08-19T01:09:32.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.314+0000 7f14457fa640 1 --2- 172.21.15.17:0/3752999108 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f143406e170 0x7f1434070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:32.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.314+0000 7f14457fa640 1 -- 172.21.15.17:0/3752999108 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f143808de60 con 0x7f14480fea20 2024-08-19T01:09:32.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.314+0000 7f143effd640 1 --2- 172.21.15.17:0/3752999108 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f143406e170 0x7f1434070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:32.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.315+0000 7f143effd640 1 --2- 172.21.15.17:0/3752999108 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f143406e170 0x7f1434070630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1430000c00 tx=0x7f1430005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:32.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.319+0000 7f14457fa640 1 -- 172.21.15.17:0/3752999108 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f14380571c0 con 0x7f14480fea20 2024-08-19T01:09:32.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.510+0000 7f144dc14640 1 -- 172.21.15.17:0/3752999108 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f144810bc90 con 0x7f143406e170 2024-08-19T01:09:32.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.512+0000 7f14457fa640 1 -- 172.21.15.17:0/3752999108 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f144810bc90 con 0x7f143406e170 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:09:32.515 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:09:32.516 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:09:32.516 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:09:32.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.514+0000 7f144dc14640 1 -- 172.21.15.17:0/3752999108 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f143406e170 msgr2=0x7f1434070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.514+0000 7f144dc14640 1 --2- 172.21.15.17:0/3752999108 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f143406e170 0x7f1434070630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1430000c00 tx=0x7f1430005a20 comp rx=0 tx=0).stop 2024-08-19T01:09:32.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.514+0000 7f144dc14640 1 -- 172.21.15.17:0/3752999108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14480fea20 msgr2=0x7f144819b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.514+0000 7f144dc14640 1 --2- 172.21.15.17:0/3752999108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14480fea20 0x7f144819b7f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f143800d8d0 tx=0x7f143800dd90 comp rx=0 tx=0).stop 2024-08-19T01:09:32.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.514+0000 7f144dc14640 1 -- 172.21.15.17:0/3752999108 shutdown_connections 2024-08-19T01:09:32.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.514+0000 7f144dc14640 1 --2- 172.21.15.17:0/3752999108 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f143406e170 0x7f1434070630 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.514+0000 7f144dc14640 1 --2- 172.21.15.17:0/3752999108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1448104a20 0x7f144819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.514+0000 7f144dc14640 1 --2- 172.21.15.17:0/3752999108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14480fea20 0x7f144819b7f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.514+0000 7f144dc14640 1 -- 172.21.15.17:0/3752999108 >> 172.21.15.17:0/3752999108 conn(0x7f14480fa700 msgr2=0x7f1448068c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:32.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.514+0000 7f144dc14640 1 -- 172.21.15.17:0/3752999108 shutdown_connections 2024-08-19T01:09:32.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.514+0000 7f144dc14640 1 -- 172.21.15.17:0/3752999108 wait complete. 2024-08-19T01:09:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.598+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/1232582603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a181049f0 msgr2=0x7f3a18104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.598+0000 7f3a1ea5a640 1 --2- 172.21.15.17:0/1232582603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a181049f0 0x7f3a18104dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009880 tx=0x7f3a0802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.598+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/1232582603 shutdown_connections 2024-08-19T01:09:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.598+0000 7f3a1ea5a640 1 --2- 172.21.15.17:0/1232582603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a180fe9f0 0x7f3a180fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.598+0000 7f3a1ea5a640 1 --2- 172.21.15.17:0/1232582603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a181049f0 0x7f3a18104dd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.598+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/1232582603 >> 172.21.15.17:0/1232582603 conn(0x7f3a180758a0 msgr2=0x7f3a180fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.598+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/1232582603 shutdown_connections 2024-08-19T01:09:32.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.598+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/1232582603 wait complete. 2024-08-19T01:09:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.598+0000 7f3a1ea5a640 1 Processor -- start 2024-08-19T01:09:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.598+0000 7f3a1ea5a640 1 -- start start 2024-08-19T01:09:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a1ea5a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a180fe9f0 0x7f3a18196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a1ea5a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a181049f0 0x7f3a18196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a1ea5a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a18197410 con 0x7f3a181049f0 2024-08-19T01:09:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a1ea5a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a18197550 con 0x7f3a180fe9f0 2024-08-19T01:09:32.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a181049f0 0x7f3a18196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a177fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a181049f0 0x7f3a18196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49504/0 (socket says 172.21.15.17:49504) 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a177fe640 1 -- 172.21.15.17:0/2873710654 learned_addr learned my addr 172.21.15.17:0/2873710654 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a17fff640 1 --2- 172.21.15.17:0/2873710654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a180fe9f0 0x7f3a18196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a177fe640 1 -- 172.21.15.17:0/2873710654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a180fe9f0 msgr2=0x7f3a18196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a177fe640 1 --2- 172.21.15.17:0/2873710654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a180fe9f0 0x7f3a18196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a177fe640 1 -- 172.21.15.17:0/2873710654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08009560 con 0x7f3a181049f0 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.599+0000 7f3a177fe640 1 --2- 172.21.15.17:0/2873710654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a181049f0 0x7f3a18196e80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c8a0 tx=0x7f3a0c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.600+0000 7f3a157fa640 1 -- 172.21.15.17:0/2873710654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a0c007b80 con 0x7f3a181049f0 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.600+0000 7f3a157fa640 1 -- 172.21.15.17:0/2873710654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a0c007ce0 con 0x7f3a181049f0 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.600+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/2873710654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1819f9b0 con 0x7f3a181049f0 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.600+0000 7f3a157fa640 1 -- 172.21.15.17:0/2873710654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a0c018810 con 0x7f3a181049f0 2024-08-19T01:09:32.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.600+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/2873710654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1819fdc0 con 0x7f3a181049f0 2024-08-19T01:09:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.601+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/2873710654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a18100130 con 0x7f3a181049f0 2024-08-19T01:09:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.601+0000 7f3a157fa640 1 -- 172.21.15.17:0/2873710654 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3a0c018970 con 0x7f3a181049f0 2024-08-19T01:09:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.602+0000 7f3a157fa640 1 --2- 172.21.15.17:0/2873710654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a0006e170 0x7f3a00070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:09:32.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.602+0000 7f3a157fa640 1 -- 172.21.15.17:0/2873710654 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3a0c08e2f0 con 0x7f3a181049f0 2024-08-19T01:09:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.602+0000 7f3a17fff640 1 --2- 172.21.15.17:0/2873710654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a0006e170 0x7f3a00070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:09:32.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.602+0000 7f3a17fff640 1 --2- 172.21.15.17:0/2873710654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a0006e170 0x7f3a00070630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a08000c00 tx=0x7f3a08005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:09:32.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.607+0000 7f3a157fa640 1 -- 172.21.15.17:0/2873710654 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3a0c057650 con 0x7f3a181049f0 2024-08-19T01:09:32.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.853+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/2873710654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3a180fee50 con 0x7f3a181049f0 2024-08-19T01:09:32.856 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:32 smithi017 ceph-mon[99370]: pgmap v322: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:32.856 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:32 smithi017 ceph-mon[99370]: from='client.34652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:32.856 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:32 smithi017 ceph-mon[99370]: from='client.34656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:32.856 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:32 smithi017 ceph-mon[99370]: from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:32.856 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:32 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1131143234' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:09:32.856 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:32 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/623776197' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:09:32.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.853+0000 7f3a157fa640 1 -- 172.21.15.17:0/2873710654 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f3a0c05ad10 con 0x7f3a181049f0 2024-08-19T01:09:32.857 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:09:32.857 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:09:32.857 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:09:32.857 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:09:32.857 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:09:32.857 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:09:32.857 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:09:32.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.855+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/2873710654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a0006e170 msgr2=0x7f3a00070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.855+0000 7f3a1ea5a640 1 --2- 172.21.15.17:0/2873710654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a0006e170 0x7f3a00070630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a08000c00 tx=0x7f3a08005a20 comp rx=0 tx=0).stop 2024-08-19T01:09:32.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.855+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/2873710654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a181049f0 msgr2=0x7f3a18196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:09:32.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.855+0000 7f3a1ea5a640 1 --2- 172.21.15.17:0/2873710654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a181049f0 0x7f3a18196e80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c8a0 tx=0x7f3a0c00cd60 comp rx=0 tx=0).stop 2024-08-19T01:09:32.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.855+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/2873710654 shutdown_connections 2024-08-19T01:09:32.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.855+0000 7f3a1ea5a640 1 --2- 172.21.15.17:0/2873710654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a0006e170 0x7f3a00070630 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.855+0000 7f3a1ea5a640 1 --2- 172.21.15.17:0/2873710654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a181049f0 0x7f3a18196e80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.855+0000 7f3a1ea5a640 1 --2- 172.21.15.17:0/2873710654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a180fe9f0 0x7f3a18196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:09:32.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.855+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/2873710654 >> 172.21.15.17:0/2873710654 conn(0x7f3a180758a0 msgr2=0x7f3a180fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:09:32.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.855+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/2873710654 shutdown_connections 2024-08-19T01:09:32.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:09:32.855+0000 7f3a1ea5a640 1 -- 172.21.15.17:0/2873710654 wait complete. 2024-08-19T01:09:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:32 smithi086 ceph-mon[71303]: pgmap v322: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:32 smithi086 ceph-mon[71303]: from='client.34652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:32 smithi086 ceph-mon[71303]: from='client.34656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:32 smithi086 ceph-mon[71303]: from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:32 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1131143234' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:09:32.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:32 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/623776197' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:09:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:33 smithi017 ceph-mon[99370]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:33 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2873710654' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:09:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:09:33.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:33 smithi086 ceph-mon[71303]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:09:33.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:33 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2873710654' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:09:33.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:09:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:34 smithi017 ceph-mon[99370]: pgmap v323: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:34 smithi086 ceph-mon[71303]: pgmap v323: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:36.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:36 smithi017 ceph-mon[99370]: pgmap v324: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:36 smithi086 ceph-mon[71303]: pgmap v324: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:38.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:38 smithi017 ceph-mon[99370]: pgmap v325: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:38 smithi086 ceph-mon[71303]: pgmap v325: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:40 smithi017 ceph-mon[99370]: pgmap v326: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:40 smithi086 ceph-mon[71303]: pgmap v326: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:42 smithi017 ceph-mon[99370]: pgmap v327: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:42 smithi086 ceph-mon[71303]: pgmap v327: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:44 smithi017 ceph-mon[99370]: pgmap v328: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:44 smithi086 ceph-mon[71303]: pgmap v328: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:46.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:46 smithi017 ceph-mon[99370]: pgmap v329: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:46 smithi086 ceph-mon[71303]: pgmap v329: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:48 smithi017 ceph-mon[99370]: pgmap v330: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:09:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:48 smithi086 ceph-mon[71303]: pgmap v330: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:09:50.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:50 smithi017 ceph-mon[99370]: pgmap v331: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:50 smithi086 ceph-mon[71303]: pgmap v331: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:52.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:52 smithi017 ceph-mon[99370]: pgmap v332: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:52 smithi086 ceph-mon[71303]: pgmap v332: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:54.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:54 smithi017 ceph-mon[99370]: pgmap v333: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:54 smithi086 ceph-mon[71303]: pgmap v333: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:56.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:56 smithi017 ceph-mon[99370]: pgmap v334: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:56.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:56 smithi086 ceph-mon[71303]: pgmap v334: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:09:58 smithi017 ceph-mon[99370]: pgmap v335: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:09:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:09:58 smithi086 ceph-mon[71303]: pgmap v335: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:09:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:10:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:09:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:10:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:09:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-08-19T01:10:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:09:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:10:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:09:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:10:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:09:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:10:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:09:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-08-19T01:10:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-mon[99370]: pgmap v336: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-mon[99370]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:10:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-mon[99370]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:10:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-mon[99370]: fs cephfs is degraded 2024-08-19T01:10:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-mon[99370]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:10:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-mon[99370]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:10:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-mon[99370]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:10:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:00 smithi017 ceph-mon[99370]: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:10:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:00 smithi086 ceph-mon[71303]: pgmap v336: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:00 smithi086 ceph-mon[71303]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:10:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:00 smithi086 ceph-mon[71303]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:10:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:00 smithi086 ceph-mon[71303]: fs cephfs is degraded 2024-08-19T01:10:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:00 smithi086 ceph-mon[71303]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:10:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:00 smithi086 ceph-mon[71303]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:10:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:00 smithi086 ceph-mon[71303]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:10:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:00 smithi086 ceph-mon[71303]: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:10:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:02 smithi017 ceph-mon[99370]: pgmap v337: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:02 smithi086 ceph-mon[71303]: pgmap v337: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:02.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.953+0000 7f6c2ac85640 1 -- 172.21.15.17:0/2350669826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c240ffda0 msgr2=0x7f6c24100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:02.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.953+0000 7f6c2ac85640 1 --2- 172.21.15.17:0/2350669826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c240ffda0 0x7f6c24100180 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009880 tx=0x7f6c1802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:10:02.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.953+0000 7f6c2ac85640 1 -- 172.21.15.17:0/2350669826 shutdown_connections 2024-08-19T01:10:02.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.953+0000 7f6c2ac85640 1 --2- 172.21.15.17:0/2350669826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c24100750 0x7f6c241047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:02.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.953+0000 7f6c2ac85640 1 --2- 172.21.15.17:0/2350669826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c240ffda0 0x7f6c24100180 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:02.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.953+0000 7f6c2ac85640 1 -- 172.21.15.17:0/2350669826 >> 172.21.15.17:0/2350669826 conn(0x7f6c240fb840 msgr2=0x7f6c240fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:02.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.953+0000 7f6c2ac85640 1 -- 172.21.15.17:0/2350669826 shutdown_connections 2024-08-19T01:10:02.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.953+0000 7f6c2ac85640 1 -- 172.21.15.17:0/2350669826 wait complete. 2024-08-19T01:10:02.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.954+0000 7f6c2ac85640 1 Processor -- start 2024-08-19T01:10:02.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.954+0000 7f6c2ac85640 1 -- start start 2024-08-19T01:10:02.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.954+0000 7f6c2ac85640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c240ffda0 0x7f6c240727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:02.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.954+0000 7f6c2ac85640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c24100750 0x7f6c24072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:02.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.954+0000 7f6c2ac85640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c24073230 con 0x7f6c24100750 2024-08-19T01:10:02.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.954+0000 7f6c2ac85640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c24073370 con 0x7f6c240ffda0 2024-08-19T01:10:02.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.954+0000 7f6c23fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c24100750 0x7f6c24072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:02.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.954+0000 7f6c23fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c24100750 0x7f6c24072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34372/0 (socket says 172.21.15.17:34372) 2024-08-19T01:10:02.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.954+0000 7f6c23fff640 1 -- 172.21.15.17:0/4256434421 learned_addr learned my addr 172.21.15.17:0/4256434421 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:02.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.955+0000 7f6c28a21640 1 --2- 172.21.15.17:0/4256434421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c240ffda0 0x7f6c240727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:02.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.955+0000 7f6c23fff640 1 -- 172.21.15.17:0/4256434421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c240ffda0 msgr2=0x7f6c240727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:02.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.955+0000 7f6c23fff640 1 --2- 172.21.15.17:0/4256434421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c240ffda0 0x7f6c240727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:02.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.955+0000 7f6c23fff640 1 -- 172.21.15.17:0/4256434421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c18009560 con 0x7f6c24100750 2024-08-19T01:10:02.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.955+0000 7f6c23fff640 1 --2- 172.21.15.17:0/4256434421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c24100750 0x7f6c24072cf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000d6f0 tx=0x7f6c1000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:02.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.955+0000 7f6c21ffb640 1 -- 172.21.15.17:0/4256434421 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c10009a30 con 0x7f6c24100750 2024-08-19T01:10:02.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.955+0000 7f6c21ffb640 1 -- 172.21.15.17:0/4256434421 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c100054e0 con 0x7f6c24100750 2024-08-19T01:10:02.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.955+0000 7f6c21ffb640 1 -- 172.21.15.17:0/4256434421 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c10010460 con 0x7f6c24100750 2024-08-19T01:10:02.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.955+0000 7f6c2ac85640 1 -- 172.21.15.17:0/4256434421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c241a1db0 con 0x7f6c24100750 2024-08-19T01:10:02.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.956+0000 7f6c2ac85640 1 -- 172.21.15.17:0/4256434421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c241a2110 con 0x7f6c24100750 2024-08-19T01:10:02.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.957+0000 7f6c21ffb640 1 -- 172.21.15.17:0/4256434421 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6c10009b90 con 0x7f6c24100750 2024-08-19T01:10:02.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.957+0000 7f6c2ac85640 1 -- 172.21.15.17:0/4256434421 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c24101280 con 0x7f6c24100750 2024-08-19T01:10:02.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.958+0000 7f6c21ffb640 1 --2- 172.21.15.17:0/4256434421 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6c1406e170 0x7f6c14070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:02.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.958+0000 7f6c21ffb640 1 -- 172.21.15.17:0/4256434421 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6c1008dc80 con 0x7f6c24100750 2024-08-19T01:10:02.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.958+0000 7f6c28a21640 1 --2- 172.21.15.17:0/4256434421 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6c1406e170 0x7f6c14070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:02.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.959+0000 7f6c28a21640 1 --2- 172.21.15.17:0/4256434421 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6c1406e170 0x7f6c14070630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6c18000c00 tx=0x7f6c18005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:02.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:02.963+0000 7f6c21ffb640 1 -- 172.21.15.17:0/4256434421 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6c10056fe0 con 0x7f6c24100750 2024-08-19T01:10:03.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.156+0000 7f6c2ac85640 1 -- 172.21.15.17:0/4256434421 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c24073530 con 0x7f6c1406e170 2024-08-19T01:10:03.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.158+0000 7f6c21ffb640 1 -- 172.21.15.17:0/4256434421 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6c24073530 con 0x7f6c1406e170 2024-08-19T01:10:03.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.160+0000 7f6c2ac85640 1 -- 172.21.15.17:0/4256434421 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6c1406e170 msgr2=0x7f6c14070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.160+0000 7f6c2ac85640 1 --2- 172.21.15.17:0/4256434421 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6c1406e170 0x7f6c14070630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6c18000c00 tx=0x7f6c18005a20 comp rx=0 tx=0).stop 2024-08-19T01:10:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.160+0000 7f6c2ac85640 1 -- 172.21.15.17:0/4256434421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c24100750 msgr2=0x7f6c24072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.160+0000 7f6c2ac85640 1 --2- 172.21.15.17:0/4256434421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c24100750 0x7f6c24072cf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000d6f0 tx=0x7f6c1000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.160+0000 7f6c2ac85640 1 -- 172.21.15.17:0/4256434421 shutdown_connections 2024-08-19T01:10:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.160+0000 7f6c2ac85640 1 --2- 172.21.15.17:0/4256434421 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6c1406e170 0x7f6c14070630 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.160+0000 7f6c2ac85640 1 --2- 172.21.15.17:0/4256434421 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6c24100750 0x7f6c24072cf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.160+0000 7f6c2ac85640 1 --2- 172.21.15.17:0/4256434421 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6c240ffda0 0x7f6c240727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.160+0000 7f6c2ac85640 1 -- 172.21.15.17:0/4256434421 >> 172.21.15.17:0/4256434421 conn(0x7f6c240fb840 msgr2=0x7f6c240fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.160+0000 7f6c2ac85640 1 -- 172.21.15.17:0/4256434421 shutdown_connections 2024-08-19T01:10:03.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.161+0000 7f6c2ac85640 1 -- 172.21.15.17:0/4256434421 wait complete. 2024-08-19T01:10:03.172 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:10:03.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.245+0000 7fd64c57d640 1 -- 172.21.15.17:0/1722779672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd644104a30 msgr2=0x7fd644104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.245+0000 7fd64c57d640 1 --2- 172.21.15.17:0/1722779672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd644104a30 0x7fd644104e10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd640009880 tx=0x7fd64002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.245+0000 7fd64c57d640 1 -- 172.21.15.17:0/1722779672 shutdown_connections 2024-08-19T01:10:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.245+0000 7fd64c57d640 1 --2- 172.21.15.17:0/1722779672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6440fea30 0x7fd6440fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.245+0000 7fd64c57d640 1 --2- 172.21.15.17:0/1722779672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd644104a30 0x7fd644104e10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.245+0000 7fd64c57d640 1 -- 172.21.15.17:0/1722779672 >> 172.21.15.17:0/1722779672 conn(0x7fd6440fa730 msgr2=0x7fd6440fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.245+0000 7fd64c57d640 1 -- 172.21.15.17:0/1722779672 shutdown_connections 2024-08-19T01:10:03.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.245+0000 7fd64c57d640 1 -- 172.21.15.17:0/1722779672 wait complete. 2024-08-19T01:10:03.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.246+0000 7fd64c57d640 1 Processor -- start 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.246+0000 7fd64c57d640 1 -- start start 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.246+0000 7fd64c57d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6440fea30 0x7fd644196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.246+0000 7fd64c57d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd644104a30 0x7fd644196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd64c57d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd644197490 con 0x7fd644104a30 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd64c57d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd644197600 con 0x7fd6440fea30 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd649b18640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd644104a30 0x7fd644196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd649b18640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd644104a30 0x7fd644196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34392/0 (socket says 172.21.15.17:34392) 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd649b18640 1 -- 172.21.15.17:0/3958620703 learned_addr learned my addr 172.21.15.17:0/3958620703 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd64a319640 1 --2- 172.21.15.17:0/3958620703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6440fea30 0x7fd644196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd649b18640 1 -- 172.21.15.17:0/3958620703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6440fea30 msgr2=0x7fd644196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd649b18640 1 --2- 172.21.15.17:0/3958620703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6440fea30 0x7fd644196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd649b18640 1 -- 172.21.15.17:0/3958620703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640009560 con 0x7fd644104a30 2024-08-19T01:10:03.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd649b18640 1 --2- 172.21.15.17:0/3958620703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd644104a30 0x7fd644196ec0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd63400d6f0 tx=0x7fd63400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:03.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd63b7fe640 1 -- 172.21.15.17:0/3958620703 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd634009a30 con 0x7fd644104a30 2024-08-19T01:10:03.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd63b7fe640 1 -- 172.21.15.17:0/3958620703 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6340054e0 con 0x7fd644104a30 2024-08-19T01:10:03.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd64c57d640 1 -- 172.21.15.17:0/3958620703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64419f9f0 con 0x7fd644104a30 2024-08-19T01:10:03.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.247+0000 7fd63b7fe640 1 -- 172.21.15.17:0/3958620703 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd634010460 con 0x7fd644104a30 2024-08-19T01:10:03.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.248+0000 7fd64c57d640 1 -- 172.21.15.17:0/3958620703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64419fe60 con 0x7fd644104a30 2024-08-19T01:10:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.248+0000 7fd64c57d640 1 -- 172.21.15.17:0/3958620703 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd644100170 con 0x7fd644104a30 2024-08-19T01:10:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.249+0000 7fd63b7fe640 1 -- 172.21.15.17:0/3958620703 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd634009b90 con 0x7fd644104a30 2024-08-19T01:10:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.250+0000 7fd63b7fe640 1 --2- 172.21.15.17:0/3958620703 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd63006e170 0x7fd630070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.250+0000 7fd63b7fe640 1 -- 172.21.15.17:0/3958620703 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd63408dd30 con 0x7fd644104a30 2024-08-19T01:10:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.250+0000 7fd64a319640 1 --2- 172.21.15.17:0/3958620703 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd63006e170 0x7fd630070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:03.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.250+0000 7fd64a319640 1 --2- 172.21.15.17:0/3958620703 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd63006e170 0x7fd630070630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd640000c00 tx=0x7fd640005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:03.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.254+0000 7fd63b7fe640 1 -- 172.21.15.17:0/3958620703 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd634057010 con 0x7fd644104a30 2024-08-19T01:10:03.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.447+0000 7fd64c57d640 1 -- 172.21.15.17:0/3958620703 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd644107010 con 0x7fd63006e170 2024-08-19T01:10:03.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.448+0000 7fd63b7fe640 1 -- 172.21.15.17:0/3958620703 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd644107010 con 0x7fd63006e170 2024-08-19T01:10:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.450+0000 7fd64c57d640 1 -- 172.21.15.17:0/3958620703 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd63006e170 msgr2=0x7fd630070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.450+0000 7fd64c57d640 1 --2- 172.21.15.17:0/3958620703 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd63006e170 0x7fd630070630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd640000c00 tx=0x7fd640005a20 comp rx=0 tx=0).stop 2024-08-19T01:10:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.450+0000 7fd64c57d640 1 -- 172.21.15.17:0/3958620703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd644104a30 msgr2=0x7fd644196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.450+0000 7fd64c57d640 1 --2- 172.21.15.17:0/3958620703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd644104a30 0x7fd644196ec0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd63400d6f0 tx=0x7fd63400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.450+0000 7fd64c57d640 1 -- 172.21.15.17:0/3958620703 shutdown_connections 2024-08-19T01:10:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.450+0000 7fd64c57d640 1 --2- 172.21.15.17:0/3958620703 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd63006e170 0x7fd630070630 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.450+0000 7fd64c57d640 1 --2- 172.21.15.17:0/3958620703 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd644104a30 0x7fd644196ec0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.450+0000 7fd64c57d640 1 --2- 172.21.15.17:0/3958620703 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6440fea30 0x7fd644196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.450+0000 7fd64c57d640 1 -- 172.21.15.17:0/3958620703 >> 172.21.15.17:0/3958620703 conn(0x7fd6440fa730 msgr2=0x7fd6440fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.450+0000 7fd64c57d640 1 -- 172.21.15.17:0/3958620703 shutdown_connections 2024-08-19T01:10:03.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.450+0000 7fd64c57d640 1 -- 172.21.15.17:0/3958620703 wait complete. 2024-08-19T01:10:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.534+0000 7f10683f7640 1 -- 172.21.15.17:0/3052056658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600ffda0 msgr2=0x7f1060100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.534+0000 7f10683f7640 1 --2- 172.21.15.17:0/3052056658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600ffda0 0x7f1060100180 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f105c009880 tx=0x7f105c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.535+0000 7f10683f7640 1 -- 172.21.15.17:0/3052056658 shutdown_connections 2024-08-19T01:10:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.535+0000 7f10683f7640 1 --2- 172.21.15.17:0/3052056658 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1060100750 0x7f10601047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.535+0000 7f10683f7640 1 --2- 172.21.15.17:0/3052056658 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f10600ffda0 0x7f1060100180 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.535+0000 7f10683f7640 1 -- 172.21.15.17:0/3052056658 >> 172.21.15.17:0/3052056658 conn(0x7f10600fb840 msgr2=0x7f10600fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.535+0000 7f10683f7640 1 -- 172.21.15.17:0/3052056658 shutdown_connections 2024-08-19T01:10:03.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.535+0000 7f10683f7640 1 -- 172.21.15.17:0/3052056658 wait complete. 2024-08-19T01:10:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.535+0000 7f10683f7640 1 Processor -- start 2024-08-19T01:10:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.535+0000 7f10683f7640 1 -- start start 2024-08-19T01:10:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f10683f7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10600ffda0 0x7f106019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f10683f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1060100750 0x7f106019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f10683f7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106019c2d0 con 0x7f1060100750 2024-08-19T01:10:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f10683f7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10601958f0 con 0x7f10600ffda0 2024-08-19T01:10:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f1065992640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1060100750 0x7f106019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f1065992640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1060100750 0x7f106019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34418/0 (socket says 172.21.15.17:34418) 2024-08-19T01:10:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f1065992640 1 -- 172.21.15.17:0/2488440429 learned_addr learned my addr 172.21.15.17:0/2488440429 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f1066193640 1 --2- 172.21.15.17:0/2488440429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10600ffda0 0x7f106019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:03.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f1065992640 1 -- 172.21.15.17:0/2488440429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10600ffda0 msgr2=0x7f106019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f1065992640 1 --2- 172.21.15.17:0/2488440429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10600ffda0 0x7f106019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f1065992640 1 -- 172.21.15.17:0/2488440429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c009560 con 0x7f1060100750 2024-08-19T01:10:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f1065992640 1 --2- 172.21.15.17:0/2488440429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1060100750 0x7f106019bd40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f105000c8a0 tx=0x7f105000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f10577fe640 1 -- 172.21.15.17:0/2488440429 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1050007b80 con 0x7f1060100750 2024-08-19T01:10:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f10683f7640 1 -- 172.21.15.17:0/2488440429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1060195bd0 con 0x7f1060100750 2024-08-19T01:10:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f10577fe640 1 -- 172.21.15.17:0/2488440429 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1050007ce0 con 0x7f1060100750 2024-08-19T01:10:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.536+0000 7f10577fe640 1 -- 172.21.15.17:0/2488440429 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1050018810 con 0x7f1060100750 2024-08-19T01:10:03.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.537+0000 7f10683f7640 1 -- 172.21.15.17:0/2488440429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1060196120 con 0x7f1060100750 2024-08-19T01:10:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.537+0000 7f10683f7640 1 -- 172.21.15.17:0/2488440429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1060101280 con 0x7f1060100750 2024-08-19T01:10:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.538+0000 7f10577fe640 1 -- 172.21.15.17:0/2488440429 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1050018a80 con 0x7f1060100750 2024-08-19T01:10:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.539+0000 7f10577fe640 1 --2- 172.21.15.17:0/2488440429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f104c06e170 0x7f104c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.539+0000 7f10577fe640 1 -- 172.21.15.17:0/2488440429 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f105008e3e0 con 0x7f1060100750 2024-08-19T01:10:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.539+0000 7f1066193640 1 --2- 172.21.15.17:0/2488440429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f104c06e170 0x7f104c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:03.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.539+0000 7f1066193640 1 --2- 172.21.15.17:0/2488440429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f104c06e170 0x7f104c070630 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f105c000c00 tx=0x7f105c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:03.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.543+0000 7f10577fe640 1 -- 172.21.15.17:0/2488440429 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1050057770 con 0x7f1060100750 2024-08-19T01:10:03.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.726+0000 7f10683f7640 1 -- 172.21.15.17:0/2488440429 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f106010cdb0 con 0x7f104c06e170 2024-08-19T01:10:03.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.736+0000 7f10577fe640 1 -- 172.21.15.17:0/2488440429 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f106010cdb0 con 0x7f104c06e170 2024-08-19T01:10:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:10:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (11m) 5m ago 21m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:10:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (22m) 5m ago 22m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:10:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (21m) 5m ago 21m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:10:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (9m) 5m ago 22m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:10:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (9m) 5m ago 21m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:10:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (10m) 5m ago 21m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:10:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (5m) 5m ago 16m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:10:03.738 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (5m) 5m ago 16m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (16m) 5m ago 16m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (5m) 5m ago 16m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (13m) 5m ago 23m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (12m) 5m ago 21m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (10m) 5m ago 23m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (9m) 5m ago 20m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (12m) 5m ago 22m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (11m) 5m ago 21m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (8m) 5m ago 20m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (8m) 5m ago 19m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (7m) 5m ago 19m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (6m) 5m ago 18m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (6m) 5m ago 18m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:10:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (5m) 5m ago 18m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:10:03.740 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (11m) 5m ago 21m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:10:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.738+0000 7f10683f7640 1 -- 172.21.15.17:0/2488440429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f104c06e170 msgr2=0x7f104c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.738+0000 7f10683f7640 1 --2- 172.21.15.17:0/2488440429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f104c06e170 0x7f104c070630 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f105c000c00 tx=0x7f105c005a20 comp rx=0 tx=0).stop 2024-08-19T01:10:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.738+0000 7f10683f7640 1 -- 172.21.15.17:0/2488440429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1060100750 msgr2=0x7f106019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.738+0000 7f10683f7640 1 --2- 172.21.15.17:0/2488440429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1060100750 0x7f106019bd40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f105000c8a0 tx=0x7f105000cd60 comp rx=0 tx=0).stop 2024-08-19T01:10:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.738+0000 7f10683f7640 1 -- 172.21.15.17:0/2488440429 shutdown_connections 2024-08-19T01:10:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.738+0000 7f10683f7640 1 --2- 172.21.15.17:0/2488440429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f104c06e170 0x7f104c070630 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.738+0000 7f10683f7640 1 --2- 172.21.15.17:0/2488440429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1060100750 0x7f106019bd40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.738+0000 7f10683f7640 1 --2- 172.21.15.17:0/2488440429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10600ffda0 0x7f106019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.738+0000 7f10683f7640 1 -- 172.21.15.17:0/2488440429 >> 172.21.15.17:0/2488440429 conn(0x7f10600fb840 msgr2=0x7f10600fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.738+0000 7f10683f7640 1 -- 172.21.15.17:0/2488440429 shutdown_connections 2024-08-19T01:10:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.738+0000 7f10683f7640 1 -- 172.21.15.17:0/2488440429 wait complete. 2024-08-19T01:10:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.819+0000 7facd76b8640 1 -- 172.21.15.17:0/1607322993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facd00ff400 msgr2=0x7facd01038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.819+0000 7facd76b8640 1 --2- 172.21.15.17:0/1607322993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facd00ff400 0x7facd01038d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7facc0009880 tx=0x7facc002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.819+0000 7facd76b8640 1 -- 172.21.15.17:0/1607322993 shutdown_connections 2024-08-19T01:10:03.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.819+0000 7facd76b8640 1 --2- 172.21.15.17:0/1607322993 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facd00ff400 0x7facd01038d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.819+0000 7facd76b8640 1 --2- 172.21.15.17:0/1607322993 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facd00fea50 0x7facd00fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.819+0000 7facd76b8640 1 -- 172.21.15.17:0/1607322993 >> 172.21.15.17:0/1607322993 conn(0x7facd00fa730 msgr2=0x7facd00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:03.822 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:10:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.819+0000 7facd76b8640 1 -- 172.21.15.17:0/1607322993 shutdown_connections 2024-08-19T01:10:03.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.819+0000 7facd76b8640 1 -- 172.21.15.17:0/1607322993 wait complete. 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.820+0000 7facd76b8640 1 Processor -- start 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.820+0000 7facd76b8640 1 -- start start 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.820+0000 7facd76b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facd00fea50 0x7facd019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.820+0000 7facd76b8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facd00ff400 0x7facd019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.820+0000 7facd76b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd019cdb0 con 0x7facd00fea50 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.820+0000 7facd76b8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd01a0b20 con 0x7facd00ff400 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.820+0000 7facd5454640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facd00fea50 0x7facd019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facd5454640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facd00fea50 0x7facd019c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34432/0 (socket says 172.21.15.17:34432) 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facd5454640 1 -- 172.21.15.17:0/1568595442 learned_addr learned my addr 172.21.15.17:0/1568595442 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facd4c53640 1 --2- 172.21.15.17:0/1568595442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facd00ff400 0x7facd019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facd5454640 1 -- 172.21.15.17:0/1568595442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facd00ff400 msgr2=0x7facd019c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facd5454640 1 --2- 172.21.15.17:0/1568595442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facd00ff400 0x7facd019c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:03.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facd5454640 1 -- 172.21.15.17:0/1568595442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc0009560 con 0x7facd00fea50 2024-08-19T01:10:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facd5454640 1 --2- 172.21.15.17:0/1568595442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facd00fea50 0x7facd019c1e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faccc00c810 tx=0x7faccc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facc67fc640 1 -- 172.21.15.17:0/1568595442 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faccc0041f0 con 0x7facd00fea50 2024-08-19T01:10:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facd76b8640 1 -- 172.21.15.17:0/1568595442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd01a0e00 con 0x7facd00fea50 2024-08-19T01:10:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facc67fc640 1 -- 172.21.15.17:0/1568595442 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faccc007e70 con 0x7facd00fea50 2024-08-19T01:10:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facc67fc640 1 -- 172.21.15.17:0/1568595442 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faccc0049d0 con 0x7facd00fea50 2024-08-19T01:10:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.821+0000 7facd76b8640 1 -- 172.21.15.17:0/1568595442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd01a1320 con 0x7facd00fea50 2024-08-19T01:10:03.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.822+0000 7facd76b8640 1 -- 172.21.15.17:0/1568595442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd0068d30 con 0x7facd00fea50 2024-08-19T01:10:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.823+0000 7facc67fc640 1 -- 172.21.15.17:0/1568595442 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7faccc0079b0 con 0x7facd00fea50 2024-08-19T01:10:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.824+0000 7facc67fc640 1 --2- 172.21.15.17:0/1568595442 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facbc06e170 0x7facbc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.824+0000 7facc67fc640 1 -- 172.21.15.17:0/1568595442 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7faccc08df70 con 0x7facd00fea50 2024-08-19T01:10:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.824+0000 7facd4c53640 1 --2- 172.21.15.17:0/1568595442 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facbc06e170 0x7facbc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:03.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.824+0000 7facd4c53640 1 --2- 172.21.15.17:0/1568595442 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facbc06e170 0x7facbc070630 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7facc0009230 tx=0x7facc00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:03.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:03.828+0000 7facc67fc640 1 -- 172.21.15.17:0/1568595442 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7faccc0c2df0 con 0x7facd00fea50 2024-08-19T01:10:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:10:04.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.071+0000 7facd76b8640 1 -- 172.21.15.17:0/1568595442 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7facd00fee30 con 0x7facd00fea50 2024-08-19T01:10:04.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.071+0000 7facc67fc640 1 -- 172.21.15.17:0/1568595442 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7faccc0572a0 con 0x7facd00fea50 2024-08-19T01:10:04.074 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:10:04.074 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:10:04.074 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:10:04.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:10:04.074 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:10:04.074 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:10:04.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:10:04.074 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:10:04.074 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:10:04.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:10:04.075 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:10:04.075 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:10:04.075 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:10:04.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:10:04.075 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:10:04.075 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:10:04.075 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:10:04.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:10:04.075 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:10:04.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.074+0000 7facd76b8640 1 -- 172.21.15.17:0/1568595442 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facbc06e170 msgr2=0x7facbc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.074+0000 7facd76b8640 1 --2- 172.21.15.17:0/1568595442 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facbc06e170 0x7facbc070630 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7facc0009230 tx=0x7facc00058d0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.074+0000 7facd76b8640 1 -- 172.21.15.17:0/1568595442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facd00fea50 msgr2=0x7facd019c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.074+0000 7facd76b8640 1 --2- 172.21.15.17:0/1568595442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facd00fea50 0x7facd019c1e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7faccc00c810 tx=0x7faccc00ccd0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.074+0000 7facd76b8640 1 -- 172.21.15.17:0/1568595442 shutdown_connections 2024-08-19T01:10:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.074+0000 7facd76b8640 1 --2- 172.21.15.17:0/1568595442 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facbc06e170 0x7facbc070630 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.074+0000 7facd76b8640 1 --2- 172.21.15.17:0/1568595442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facd00ff400 0x7facd019c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.074+0000 7facd76b8640 1 --2- 172.21.15.17:0/1568595442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facd00fea50 0x7facd019c1e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.074+0000 7facd76b8640 1 -- 172.21.15.17:0/1568595442 >> 172.21.15.17:0/1568595442 conn(0x7facd00fa730 msgr2=0x7facd010d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.074+0000 7facd76b8640 1 -- 172.21.15.17:0/1568595442 shutdown_connections 2024-08-19T01:10:04.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.074+0000 7facd76b8640 1 -- 172.21.15.17:0/1568595442 wait complete. 2024-08-19T01:10:04.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.155+0000 7fe1ea181640 1 -- 172.21.15.17:0/357607630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e4101f70 msgr2=0x7fe1e4102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.155+0000 7fe1ea181640 1 --2- 172.21.15.17:0/357607630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e4101f70 0x7fe1e4102350 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009880 tx=0x7fe1cc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.156+0000 7fe1ea181640 1 -- 172.21.15.17:0/357607630 shutdown_connections 2024-08-19T01:10:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.156+0000 7fe1ea181640 1 --2- 172.21.15.17:0/357607630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1e4102920 0x7fe1e4106970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.156+0000 7fe1ea181640 1 --2- 172.21.15.17:0/357607630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e4101f70 0x7fe1e4102350 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.156+0000 7fe1ea181640 1 -- 172.21.15.17:0/357607630 >> 172.21.15.17:0/357607630 conn(0x7fe1e40fd9f0 msgr2=0x7fe1e40ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.156+0000 7fe1ea181640 1 -- 172.21.15.17:0/357607630 shutdown_connections 2024-08-19T01:10:04.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.156+0000 7fe1ea181640 1 -- 172.21.15.17:0/357607630 wait complete. 2024-08-19T01:10:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.156+0000 7fe1ea181640 1 Processor -- start 2024-08-19T01:10:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.156+0000 7fe1ea181640 1 -- start start 2024-08-19T01:10:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1ea181640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e4101f70 0x7fe1e4197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1ea181640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1e4102920 0x7fe1e41982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1ea181640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e4198960 con 0x7fe1e4101f70 2024-08-19T01:10:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1ea181640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e419c6d0 con 0x7fe1e4102920 2024-08-19T01:10:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1e37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e4101f70 0x7fe1e4197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1e37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e4101f70 0x7fe1e4197d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34444/0 (socket says 172.21.15.17:34444) 2024-08-19T01:10:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1e37fe640 1 -- 172.21.15.17:0/1519399708 learned_addr learned my addr 172.21.15.17:0/1519399708 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:04.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1e2ffd640 1 --2- 172.21.15.17:0/1519399708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1e4102920 0x7fe1e41982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1e37fe640 1 -- 172.21.15.17:0/1519399708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1e4102920 msgr2=0x7fe1e41982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1e37fe640 1 --2- 172.21.15.17:0/1519399708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1e4102920 0x7fe1e41982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1e37fe640 1 -- 172.21.15.17:0/1519399708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc009560 con 0x7fe1e4101f70 2024-08-19T01:10:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1e37fe640 1 --2- 172.21.15.17:0/1519399708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e4101f70 0x7fe1e4197d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc006010 tx=0x7fe1cc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1e0ff9640 1 -- 172.21.15.17:0/1519399708 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1cc004aa0 con 0x7fe1e4101f70 2024-08-19T01:10:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1e0ff9640 1 -- 172.21.15.17:0/1519399708 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1cc004c00 con 0x7fe1e4101f70 2024-08-19T01:10:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1ea181640 1 -- 172.21.15.17:0/1519399708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e419c950 con 0x7fe1e4101f70 2024-08-19T01:10:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.157+0000 7fe1e0ff9640 1 -- 172.21.15.17:0/1519399708 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1cc003a20 con 0x7fe1e4101f70 2024-08-19T01:10:04.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.158+0000 7fe1ea181640 1 -- 172.21.15.17:0/1519399708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e419ce40 con 0x7fe1e4101f70 2024-08-19T01:10:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.158+0000 7fe1ea181640 1 -- 172.21.15.17:0/1519399708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e4103450 con 0x7fe1e4101f70 2024-08-19T01:10:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.159+0000 7fe1e0ff9640 1 -- 172.21.15.17:0/1519399708 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe1cc031c90 con 0x7fe1e4101f70 2024-08-19T01:10:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.159+0000 7fe1e0ff9640 1 --2- 172.21.15.17:0/1519399708 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe1d006e180 0x7fe1d0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.160+0000 7fe1e0ff9640 1 -- 172.21.15.17:0/1519399708 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe1cc0af2b0 con 0x7fe1e4101f70 2024-08-19T01:10:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.160+0000 7fe1e2ffd640 1 --2- 172.21.15.17:0/1519399708 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe1d006e180 0x7fe1d0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:04.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.160+0000 7fe1e2ffd640 1 --2- 172.21.15.17:0/1519399708 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe1d006e180 0x7fe1d0070640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4199340 tx=0x7fe1d4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:04.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.164+0000 7fe1e0ff9640 1 -- 172.21.15.17:0/1519399708 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe1cc078610 con 0x7fe1e4101f70 2024-08-19T01:10:04.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.375+0000 7fe1ea181640 1 -- 172.21.15.17:0/1519399708 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe1e41023d0 con 0x7fe1e4101f70 2024-08-19T01:10:04.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.376+0000 7fe1e0ff9640 1 -- 172.21.15.17:0/1519399708 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7fe1cc07bcd0 con 0x7fe1e4101f70 2024-08-19T01:10:04.378 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:10:04.378 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:10:04.378 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:10:04.378 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:10:04.378 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:10:04.378 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:10:04.378 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:10:04.379 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:10:04.380 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:10:04.381 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:10:04.381 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:10:04.381 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:10:04.381 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:10:04.381 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:10:04.381 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:10:04.381 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:10:04.381 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:10:04.381 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:10:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:10:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.378+0000 7fe1ea181640 1 -- 172.21.15.17:0/1519399708 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe1d006e180 msgr2=0x7fe1d0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.378+0000 7fe1ea181640 1 --2- 172.21.15.17:0/1519399708 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe1d006e180 0x7fe1d0070640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4199340 tx=0x7fe1d4008040 comp rx=0 tx=0).stop 2024-08-19T01:10:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.378+0000 7fe1ea181640 1 -- 172.21.15.17:0/1519399708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e4101f70 msgr2=0x7fe1e4197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.378+0000 7fe1ea181640 1 --2- 172.21.15.17:0/1519399708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e4101f70 0x7fe1e4197d90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc006010 tx=0x7fe1cc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.378+0000 7fe1ea181640 1 -- 172.21.15.17:0/1519399708 shutdown_connections 2024-08-19T01:10:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.378+0000 7fe1ea181640 1 --2- 172.21.15.17:0/1519399708 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe1d006e180 0x7fe1d0070640 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.378+0000 7fe1ea181640 1 --2- 172.21.15.17:0/1519399708 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe1e4102920 0x7fe1e41982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.378+0000 7fe1ea181640 1 --2- 172.21.15.17:0/1519399708 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe1e4101f70 0x7fe1e4197d90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.378+0000 7fe1ea181640 1 -- 172.21.15.17:0/1519399708 >> 172.21.15.17:0/1519399708 conn(0x7fe1e40fd9f0 msgr2=0x7fe1e40fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.378+0000 7fe1ea181640 1 -- 172.21.15.17:0/1519399708 shutdown_connections 2024-08-19T01:10:04.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.378+0000 7fe1ea181640 1 -- 172.21.15.17:0/1519399708 wait complete. 2024-08-19T01:10:04.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.462+0000 7f612b360640 1 -- 172.21.15.17:0/3311579401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6124100750 msgr2=0x7f61241047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.462+0000 7f612b360640 1 --2- 172.21.15.17:0/3311579401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6124100750 0x7f61241047a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6118009880 tx=0x7f611802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.462+0000 7f612b360640 1 -- 172.21.15.17:0/3311579401 shutdown_connections 2024-08-19T01:10:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.462+0000 7f612b360640 1 --2- 172.21.15.17:0/3311579401 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6124100750 0x7f61241047a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.462+0000 7f612b360640 1 --2- 172.21.15.17:0/3311579401 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61240ffda0 0x7f6124100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.462+0000 7f612b360640 1 -- 172.21.15.17:0/3311579401 >> 172.21.15.17:0/3311579401 conn(0x7f61240fb840 msgr2=0x7f61240fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.462+0000 7f612b360640 1 -- 172.21.15.17:0/3311579401 shutdown_connections 2024-08-19T01:10:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.462+0000 7f612b360640 1 -- 172.21.15.17:0/3311579401 wait complete. 2024-08-19T01:10:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.463+0000 7f612b360640 1 Processor -- start 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.463+0000 7f612b360640 1 -- start start 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.463+0000 7f612b360640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61240ffda0 0x7f612419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.463+0000 7f612b360640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6124100750 0x7f612419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.463+0000 7f612b360640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612419c380 con 0x7f61240ffda0 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.463+0000 7f612b360640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6124195910 con 0x7f6124100750 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.463+0000 7f61290fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61240ffda0 0x7f612419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.463+0000 7f61290fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61240ffda0 0x7f612419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34456/0 (socket says 172.21.15.17:34456) 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.463+0000 7f61290fc640 1 -- 172.21.15.17:0/481422 learned_addr learned my addr 172.21.15.17:0/481422 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.463+0000 7f61288fb640 1 --2- 172.21.15.17:0/481422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6124100750 0x7f612419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.464+0000 7f61290fc640 1 -- 172.21.15.17:0/481422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6124100750 msgr2=0x7f612419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.464+0000 7f61290fc640 1 --2- 172.21.15.17:0/481422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6124100750 0x7f612419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.464+0000 7f61290fc640 1 -- 172.21.15.17:0/481422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118009560 con 0x7f61240ffda0 2024-08-19T01:10:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.464+0000 7f61290fc640 1 --2- 172.21.15.17:0/481422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61240ffda0 0x7f612419b820 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f611c00c810 tx=0x7f611c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.464+0000 7f61227fc640 1 -- 172.21.15.17:0/481422 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611c0041f0 con 0x7f61240ffda0 2024-08-19T01:10:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.464+0000 7f61227fc640 1 -- 172.21.15.17:0/481422 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f611c007e70 con 0x7f61240ffda0 2024-08-19T01:10:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.464+0000 7f612b360640 1 -- 172.21.15.17:0/481422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6124195bf0 con 0x7f61240ffda0 2024-08-19T01:10:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.464+0000 7f61227fc640 1 -- 172.21.15.17:0/481422 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f611c0049d0 con 0x7f61240ffda0 2024-08-19T01:10:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.464+0000 7f612b360640 1 -- 172.21.15.17:0/481422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6124196110 con 0x7f61240ffda0 2024-08-19T01:10:04.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.465+0000 7f612b360640 1 -- 172.21.15.17:0/481422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6124101280 con 0x7f61240ffda0 2024-08-19T01:10:04.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.466+0000 7f61227fc640 1 -- 172.21.15.17:0/481422 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f611c0079b0 con 0x7f61240ffda0 2024-08-19T01:10:04.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.466+0000 7f61227fc640 1 --2- 172.21.15.17:0/481422 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f610c06e180 0x7f610c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:04.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.466+0000 7f61227fc640 1 -- 172.21.15.17:0/481422 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f611c08df10 con 0x7f61240ffda0 2024-08-19T01:10:04.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.466+0000 7f61288fb640 1 --2- 172.21.15.17:0/481422 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f610c06e180 0x7f610c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:04.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.467+0000 7f61288fb640 1 --2- 172.21.15.17:0/481422 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f610c06e180 0x7f610c070640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6118009230 tx=0x7f6118005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:04.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.471+0000 7f61227fc640 1 -- 172.21.15.17:0/481422 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f611c0572a0 con 0x7f61240ffda0 2024-08-19T01:10:04.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.661+0000 7f612b360640 1 -- 172.21.15.17:0/481422 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6124108120 con 0x7f610c06e180 2024-08-19T01:10:04.664 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:04 smithi017 ceph-mon[99370]: pgmap v338: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:04.664 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:04 smithi017 ceph-mon[99370]: from='client.34680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:04.664 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:04 smithi017 ceph-mon[99370]: from='client.34684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:04.664 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:04 smithi017 ceph-mon[99370]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:04.664 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:04 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1568595442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:10:04.664 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:04 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1519399708' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:10:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.663+0000 7f61227fc640 1 -- 172.21.15.17:0/481422 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6124108120 con 0x7f610c06e180 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:10:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:10:04.666 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:10:04.666 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:10:04.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.664+0000 7f612b360640 1 -- 172.21.15.17:0/481422 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f610c06e180 msgr2=0x7f610c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.664+0000 7f612b360640 1 --2- 172.21.15.17:0/481422 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f610c06e180 0x7f610c070640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6118009230 tx=0x7f6118005a20 comp rx=0 tx=0).stop 2024-08-19T01:10:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.664+0000 7f612b360640 1 -- 172.21.15.17:0/481422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61240ffda0 msgr2=0x7f612419b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.664+0000 7f612b360640 1 --2- 172.21.15.17:0/481422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61240ffda0 0x7f612419b820 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f611c00c810 tx=0x7f611c00ccd0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.665+0000 7f612b360640 1 -- 172.21.15.17:0/481422 shutdown_connections 2024-08-19T01:10:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.665+0000 7f612b360640 1 --2- 172.21.15.17:0/481422 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f610c06e180 0x7f610c070640 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.665+0000 7f612b360640 1 --2- 172.21.15.17:0/481422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6124100750 0x7f612419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.665+0000 7f612b360640 1 --2- 172.21.15.17:0/481422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61240ffda0 0x7f612419b820 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.665+0000 7f612b360640 1 -- 172.21.15.17:0/481422 >> 172.21.15.17:0/481422 conn(0x7f61240fb840 msgr2=0x7f61240fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.665+0000 7f612b360640 1 -- 172.21.15.17:0/481422 shutdown_connections 2024-08-19T01:10:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.665+0000 7f612b360640 1 -- 172.21.15.17:0/481422 wait complete. 2024-08-19T01:10:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.747+0000 7fcd43ed2640 1 -- 172.21.15.17:0/227200285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd3c105bf0 msgr2=0x7fcd3c105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.747+0000 7fcd43ed2640 1 --2- 172.21.15.17:0/227200285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd3c105bf0 0x7fcd3c105fd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009880 tx=0x7fcd3402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.747+0000 7fcd43ed2640 1 -- 172.21.15.17:0/227200285 shutdown_connections 2024-08-19T01:10:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.747+0000 7fcd43ed2640 1 --2- 172.21.15.17:0/227200285 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd3c0ffb40 0x7fcd3c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.747+0000 7fcd43ed2640 1 --2- 172.21.15.17:0/227200285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd3c105bf0 0x7fcd3c105fd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.747+0000 7fcd43ed2640 1 -- 172.21.15.17:0/227200285 >> 172.21.15.17:0/227200285 conn(0x7fcd3c0fb860 msgr2=0x7fcd3c0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.747+0000 7fcd43ed2640 1 -- 172.21.15.17:0/227200285 shutdown_connections 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.747+0000 7fcd43ed2640 1 -- 172.21.15.17:0/227200285 wait complete. 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd43ed2640 1 Processor -- start 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd43ed2640 1 -- start start 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd43ed2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd3c0ffb40 0x7fcd3c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd43ed2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd3c105bf0 0x7fcd3c19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd43ed2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c19c470 con 0x7fcd3c0ffb40 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd43ed2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c195a50 con 0x7fcd3c105bf0 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd41c6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd3c0ffb40 0x7fcd3c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd41c6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd3c0ffb40 0x7fcd3c19b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34482/0 (socket says 172.21.15.17:34482) 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd41c6e640 1 -- 172.21.15.17:0/2611659113 learned_addr learned my addr 172.21.15.17:0/2611659113 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd4146d640 1 --2- 172.21.15.17:0/2611659113 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd3c105bf0 0x7fcd3c19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:04.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd41c6e640 1 -- 172.21.15.17:0/2611659113 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd3c105bf0 msgr2=0x7fcd3c19be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.748+0000 7fcd41c6e640 1 --2- 172.21.15.17:0/2611659113 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd3c105bf0 0x7fcd3c19be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.749+0000 7fcd41c6e640 1 -- 172.21.15.17:0/2611659113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd34009560 con 0x7fcd3c0ffb40 2024-08-19T01:10:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.749+0000 7fcd41c6e640 1 --2- 172.21.15.17:0/2611659113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd3c0ffb40 0x7fcd3c19b910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcd3402a9c0 tx=0x7fcd340055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.749+0000 7fcd3affd640 1 -- 172.21.15.17:0/2611659113 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd34004aa0 con 0x7fcd3c0ffb40 2024-08-19T01:10:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.749+0000 7fcd3affd640 1 -- 172.21.15.17:0/2611659113 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcd34004c00 con 0x7fcd3c0ffb40 2024-08-19T01:10:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.749+0000 7fcd43ed2640 1 -- 172.21.15.17:0/2611659113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c195cd0 con 0x7fcd3c0ffb40 2024-08-19T01:10:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.749+0000 7fcd3affd640 1 -- 172.21.15.17:0/2611659113 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd34003a20 con 0x7fcd3c0ffb40 2024-08-19T01:10:04.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.749+0000 7fcd43ed2640 1 -- 172.21.15.17:0/2611659113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c196240 con 0x7fcd3c0ffb40 2024-08-19T01:10:04.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.750+0000 7fcd43ed2640 1 -- 172.21.15.17:0/2611659113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c1011f0 con 0x7fcd3c0ffb40 2024-08-19T01:10:04.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.750+0000 7fcd3affd640 1 -- 172.21.15.17:0/2611659113 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcd34031c90 con 0x7fcd3c0ffb40 2024-08-19T01:10:04.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.751+0000 7fcd3affd640 1 --2- 172.21.15.17:0/2611659113 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd2406e170 0x7fcd24070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:04.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.751+0000 7fcd3affd640 1 -- 172.21.15.17:0/2611659113 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcd340af140 con 0x7fcd3c0ffb40 2024-08-19T01:10:04.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.751+0000 7fcd4146d640 1 --2- 172.21.15.17:0/2611659113 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd2406e170 0x7fcd24070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:04.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.751+0000 7fcd4146d640 1 --2- 172.21.15.17:0/2611659113 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd2406e170 0x7fcd24070630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c196e70 tx=0x7fcd30009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:04.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:04.755+0000 7fcd3affd640 1 -- 172.21.15.17:0/2611659113 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcd340784a0 con 0x7fcd3c0ffb40 2024-08-19T01:10:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:04 smithi086 ceph-mon[71303]: pgmap v338: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:04 smithi086 ceph-mon[71303]: from='client.34680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:04 smithi086 ceph-mon[71303]: from='client.34684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:04 smithi086 ceph-mon[71303]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:04 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1568595442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:10:04.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:04 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1519399708' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:10:05.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.000+0000 7fcd43ed2640 1 -- 172.21.15.17:0/2611659113 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcd3c100020 con 0x7fcd3c0ffb40 2024-08-19T01:10:05.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.001+0000 7fcd3affd640 1 -- 172.21.15.17:0/2611659113 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7fcd3407bb60 con 0x7fcd3c0ffb40 2024-08-19T01:10:05.003 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:10:05.003 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:10:05.003 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:10:05.003 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:10:05.003 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:10:05.003 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:10:05.003 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:10:05.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.003+0000 7fcd43ed2640 1 -- 172.21.15.17:0/2611659113 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd2406e170 msgr2=0x7fcd24070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:05.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.003+0000 7fcd43ed2640 1 --2- 172.21.15.17:0/2611659113 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd2406e170 0x7fcd24070630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c196e70 tx=0x7fcd30009110 comp rx=0 tx=0).stop 2024-08-19T01:10:05.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.003+0000 7fcd43ed2640 1 -- 172.21.15.17:0/2611659113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd3c0ffb40 msgr2=0x7fcd3c19b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:05.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.003+0000 7fcd43ed2640 1 --2- 172.21.15.17:0/2611659113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd3c0ffb40 0x7fcd3c19b910 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcd3402a9c0 tx=0x7fcd340055a0 comp rx=0 tx=0).stop 2024-08-19T01:10:05.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.003+0000 7fcd43ed2640 1 -- 172.21.15.17:0/2611659113 shutdown_connections 2024-08-19T01:10:05.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.003+0000 7fcd43ed2640 1 --2- 172.21.15.17:0/2611659113 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcd2406e170 0x7fcd24070630 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:05.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.003+0000 7fcd43ed2640 1 --2- 172.21.15.17:0/2611659113 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcd3c105bf0 0x7fcd3c19be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:05.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.003+0000 7fcd43ed2640 1 --2- 172.21.15.17:0/2611659113 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcd3c0ffb40 0x7fcd3c19b910 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:05.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.003+0000 7fcd43ed2640 1 -- 172.21.15.17:0/2611659113 >> 172.21.15.17:0/2611659113 conn(0x7fcd3c0fb860 msgr2=0x7fcd3c0fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:05.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.003+0000 7fcd43ed2640 1 -- 172.21.15.17:0/2611659113 shutdown_connections 2024-08-19T01:10:05.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:05.003+0000 7fcd43ed2640 1 -- 172.21.15.17:0/2611659113 wait complete. 2024-08-19T01:10:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:05 smithi017 ceph-mon[99370]: from='client.34700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:05 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2611659113' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:10:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:05 smithi086 ceph-mon[71303]: from='client.34700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:05 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2611659113' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:10:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:06 smithi017 ceph-mon[99370]: pgmap v339: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:06 smithi086 ceph-mon[71303]: pgmap v339: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:08.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:08 smithi017 ceph-mon[99370]: pgmap v340: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:08.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:08 smithi086 ceph-mon[71303]: pgmap v340: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:10 smithi017 ceph-mon[99370]: pgmap v341: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:10 smithi086 ceph-mon[71303]: pgmap v341: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:12 smithi017 ceph-mon[99370]: pgmap v342: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:12 smithi086 ceph-mon[71303]: pgmap v342: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:14.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:14 smithi017 ceph-mon[99370]: pgmap v343: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:14.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:14 smithi086 ceph-mon[71303]: pgmap v343: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:16.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:16 smithi017 ceph-mon[99370]: pgmap v344: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:16.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:16 smithi086 ceph-mon[71303]: pgmap v344: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:18 smithi017 ceph-mon[99370]: pgmap v345: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:18.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:10:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:18 smithi086 ceph-mon[71303]: pgmap v345: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:10:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:20 smithi017 ceph-mon[99370]: pgmap v346: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:20 smithi086 ceph-mon[71303]: pgmap v346: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:22.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:22 smithi017 ceph-mon[99370]: pgmap v347: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:22 smithi086 ceph-mon[71303]: pgmap v347: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:24.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:24 smithi017 ceph-mon[99370]: pgmap v348: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:24.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:24 smithi086 ceph-mon[71303]: pgmap v348: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:26 smithi017 ceph-mon[99370]: pgmap v349: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:26 smithi086 ceph-mon[71303]: pgmap v349: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:28 smithi017 ceph-mon[99370]: pgmap v350: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:28.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:28 smithi086 ceph-mon[71303]: pgmap v350: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:30.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:30 smithi017 ceph-mon[99370]: pgmap v351: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:30 smithi086 ceph-mon[71303]: pgmap v351: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:32 smithi017 ceph-mon[99370]: pgmap v352: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:32 smithi086 ceph-mon[71303]: pgmap v352: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:10:33.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:10:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:34 smithi017 ceph-mon[99370]: pgmap v353: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:34 smithi086 ceph-mon[71303]: pgmap v353: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:35.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.098+0000 7f9f83872640 1 -- 172.21.15.17:0/570997381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f7c101610 msgr2=0x7f9f7c109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.098+0000 7f9f83872640 1 --2- 172.21.15.17:0/570997381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f7c101610 0x7f9f7c109b00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c0098b0 tx=0x7f9f6c02a4d0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.098+0000 7f9f83872640 1 -- 172.21.15.17:0/570997381 shutdown_connections 2024-08-19T01:10:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.098+0000 7f9f83872640 1 --2- 172.21.15.17:0/570997381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f7c101610 0x7f9f7c109b00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.098+0000 7f9f83872640 1 --2- 172.21.15.17:0/570997381 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f7c100c60 0x7f9f7c101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.098+0000 7f9f83872640 1 -- 172.21.15.17:0/570997381 >> 172.21.15.17:0/570997381 conn(0x7f9f7c0fa730 msgr2=0x7f9f7c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.098+0000 7f9f83872640 1 -- 172.21.15.17:0/570997381 shutdown_connections 2024-08-19T01:10:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.098+0000 7f9f83872640 1 -- 172.21.15.17:0/570997381 wait complete. 2024-08-19T01:10:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.098+0000 7f9f83872640 1 Processor -- start 2024-08-19T01:10:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.098+0000 7f9f83872640 1 -- start start 2024-08-19T01:10:35.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f83872640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f7c100c60 0x7f9f7c0fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f83872640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f7c101610 0x7f9f7c0fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f83872640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0ff3d0 con 0x7f9f7c100c60 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f83872640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c0ff540 con 0x7f9f7c101610 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f8160e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f7c100c60 0x7f9f7c0fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f8160e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f7c100c60 0x7f9f7c0fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41130/0 (socket says 172.21.15.17:41130) 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f8160e640 1 -- 172.21.15.17:0/3193247897 learned_addr learned my addr 172.21.15.17:0/3193247897 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f80e0d640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f7c101610 0x7f9f7c0fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f8160e640 1 -- 172.21.15.17:0/3193247897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f7c101610 msgr2=0x7f9f7c0fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f8160e640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f7c101610 0x7f9f7c0fee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f8160e640 1 -- 172.21.15.17:0/3193247897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f6c009560 con 0x7f9f7c100c60 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f80e0d640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f7c101610 0x7f9f7c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:10:35.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f8160e640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f7c100c60 0x7f9f7c0fe950 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800d6f0 tx=0x7f9f7800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.099+0000 7f9f727fc640 1 -- 172.21.15.17:0/3193247897 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f78009a30 con 0x7f9f7c100c60 2024-08-19T01:10:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.100+0000 7f9f83872640 1 -- 172.21.15.17:0/3193247897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c1a1cf0 con 0x7f9f7c100c60 2024-08-19T01:10:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.100+0000 7f9f727fc640 1 -- 172.21.15.17:0/3193247897 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f780054e0 con 0x7f9f7c100c60 2024-08-19T01:10:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.100+0000 7f9f727fc640 1 -- 172.21.15.17:0/3193247897 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f78010460 con 0x7f9f7c100c60 2024-08-19T01:10:35.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.100+0000 7f9f83872640 1 -- 172.21.15.17:0/3193247897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7c1a2050 con 0x7f9f7c100c60 2024-08-19T01:10:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.101+0000 7f9f83872640 1 -- 172.21.15.17:0/3193247897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7c068d30 con 0x7f9f7c100c60 2024-08-19T01:10:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.101+0000 7f9f727fc640 1 -- 172.21.15.17:0/3193247897 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9f78009b90 con 0x7f9f7c100c60 2024-08-19T01:10:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.102+0000 7f9f727fc640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f6806e180 0x7f9f68070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.102+0000 7f9f727fc640 1 -- 172.21.15.17:0/3193247897 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9f7808dc80 con 0x7f9f7c100c60 2024-08-19T01:10:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.102+0000 7f9f80e0d640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f6806e180 0x7f9f68070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.102+0000 7f9f80e0d640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f6806e180 0x7f9f68070640 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c000c00 tx=0x7f9f6c0041a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:35.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.107+0000 7f9f727fc640 1 -- 172.21.15.17:0/3193247897 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9f78056fe0 con 0x7f9f7c100c60 2024-08-19T01:10:35.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.299+0000 7f9f83872640 1 -- 172.21.15.17:0/3193247897 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f7c10cdd0 con 0x7f9f6806e180 2024-08-19T01:10:35.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.300+0000 7f9f727fc640 1 -- 172.21.15.17:0/3193247897 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9f7c10cdd0 con 0x7f9f6806e180 2024-08-19T01:10:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.302+0000 7f9f83872640 1 -- 172.21.15.17:0/3193247897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f6806e180 msgr2=0x7f9f68070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.302+0000 7f9f83872640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f6806e180 0x7f9f68070640 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c000c00 tx=0x7f9f6c0041a0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.302+0000 7f9f83872640 1 -- 172.21.15.17:0/3193247897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f7c100c60 msgr2=0x7f9f7c0fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.302+0000 7f9f83872640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f7c100c60 0x7f9f7c0fe950 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800d6f0 tx=0x7f9f7800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.302+0000 7f9f83872640 1 -- 172.21.15.17:0/3193247897 shutdown_connections 2024-08-19T01:10:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.302+0000 7f9f83872640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f6806e180 0x7f9f68070640 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.302+0000 7f9f83872640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f7c101610 0x7f9f7c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.302+0000 7f9f83872640 1 --2- 172.21.15.17:0/3193247897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f7c100c60 0x7f9f7c0fe950 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.302+0000 7f9f83872640 1 -- 172.21.15.17:0/3193247897 >> 172.21.15.17:0/3193247897 conn(0x7f9f7c0fa730 msgr2=0x7f9f7c101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.303+0000 7f9f83872640 1 -- 172.21.15.17:0/3193247897 shutdown_connections 2024-08-19T01:10:35.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.303+0000 7f9f83872640 1 -- 172.21.15.17:0/3193247897 wait complete. 2024-08-19T01:10:35.313 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:10:35.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.385+0000 7f2abfcda640 1 -- 172.21.15.17:0/2286846518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab8104a30 msgr2=0x7f2ab8104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.385+0000 7f2abfcda640 1 --2- 172.21.15.17:0/2286846518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab8104a30 0x7f2ab8104e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009880 tx=0x7f2ab002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.385+0000 7f2abfcda640 1 -- 172.21.15.17:0/2286846518 shutdown_connections 2024-08-19T01:10:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.385+0000 7f2abfcda640 1 --2- 172.21.15.17:0/2286846518 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ab80fea30 0x7f2ab80fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.385+0000 7f2abfcda640 1 --2- 172.21.15.17:0/2286846518 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab8104a30 0x7f2ab8104e10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.385+0000 7f2abfcda640 1 -- 172.21.15.17:0/2286846518 >> 172.21.15.17:0/2286846518 conn(0x7f2ab80fa730 msgr2=0x7f2ab80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.386+0000 7f2abfcda640 1 -- 172.21.15.17:0/2286846518 shutdown_connections 2024-08-19T01:10:35.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.386+0000 7f2abfcda640 1 -- 172.21.15.17:0/2286846518 wait complete. 2024-08-19T01:10:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.386+0000 7f2abfcda640 1 Processor -- start 2024-08-19T01:10:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.386+0000 7f2abfcda640 1 -- start start 2024-08-19T01:10:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.386+0000 7f2abfcda640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab80fea30 0x7f2ab819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.386+0000 7f2abfcda640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ab8104a30 0x7f2ab819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.386+0000 7f2abfcda640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab81958e0 con 0x7f2ab80fea30 2024-08-19T01:10:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.386+0000 7f2abfcda640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab8195a50 con 0x7f2ab8104a30 2024-08-19T01:10:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.386+0000 7f2abda76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab80fea30 0x7f2ab819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.386+0000 7f2abda76640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab80fea30 0x7f2ab819b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41144/0 (socket says 172.21.15.17:41144) 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.386+0000 7f2abda76640 1 -- 172.21.15.17:0/3401388812 learned_addr learned my addr 172.21.15.17:0/3401388812 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.387+0000 7f2abd275640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ab8104a30 0x7f2ab819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.387+0000 7f2abda76640 1 -- 172.21.15.17:0/3401388812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ab8104a30 msgr2=0x7f2ab819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.387+0000 7f2abda76640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ab8104a30 0x7f2ab819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.387+0000 7f2abda76640 1 -- 172.21.15.17:0/3401388812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0009560 con 0x7f2ab80fea30 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.387+0000 7f2abd275640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ab8104a30 0x7f2ab819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.387+0000 7f2abda76640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab80fea30 0x7f2ab819b7f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0006010 tx=0x7f2ab00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.387+0000 7f2ab6ffd640 1 -- 172.21.15.17:0/3401388812 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ab0004aa0 con 0x7f2ab80fea30 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.387+0000 7f2ab6ffd640 1 -- 172.21.15.17:0/3401388812 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ab0031470 con 0x7f2ab80fea30 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.387+0000 7f2abfcda640 1 -- 172.21.15.17:0/3401388812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab8195cd0 con 0x7f2ab80fea30 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.387+0000 7f2ab6ffd640 1 -- 172.21.15.17:0/3401388812 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ab0003940 con 0x7f2ab80fea30 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.387+0000 7f2abfcda640 1 -- 172.21.15.17:0/3401388812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab81961c0 con 0x7f2ab80fea30 2024-08-19T01:10:35.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.388+0000 7f2abfcda640 1 -- 172.21.15.17:0/3401388812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab8100170 con 0x7f2ab80fea30 2024-08-19T01:10:35.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.389+0000 7f2ab6ffd640 1 -- 172.21.15.17:0/3401388812 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2ab0031b90 con 0x7f2ab80fea30 2024-08-19T01:10:35.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.389+0000 7f2ab6ffd640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aa006e180 0x7f2aa0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.389+0000 7f2ab6ffd640 1 -- 172.21.15.17:0/3401388812 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2ab00af2c0 con 0x7f2ab80fea30 2024-08-19T01:10:35.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.389+0000 7f2abd275640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aa006e180 0x7f2aa0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.390+0000 7f2abd275640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aa006e180 0x7f2aa0070640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0058c0 tx=0x7f2aac005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:35.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.394+0000 7f2ab6ffd640 1 -- 172.21.15.17:0/3401388812 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2ab00785a0 con 0x7f2ab80fea30 2024-08-19T01:10:35.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.592+0000 7f2abfcda640 1 -- 172.21.15.17:0/3401388812 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ab810bca0 con 0x7f2aa006e180 2024-08-19T01:10:35.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.593+0000 7f2ab6ffd640 1 -- 172.21.15.17:0/3401388812 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2ab810bca0 con 0x7f2aa006e180 2024-08-19T01:10:35.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.596+0000 7f2abfcda640 1 -- 172.21.15.17:0/3401388812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aa006e180 msgr2=0x7f2aa0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.596+0000 7f2abfcda640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aa006e180 0x7f2aa0070640 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0058c0 tx=0x7f2aac005850 comp rx=0 tx=0).stop 2024-08-19T01:10:35.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.596+0000 7f2abfcda640 1 -- 172.21.15.17:0/3401388812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab80fea30 msgr2=0x7f2ab819b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.596+0000 7f2abfcda640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab80fea30 0x7f2ab819b7f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0006010 tx=0x7f2ab00055a0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.596+0000 7f2abfcda640 1 -- 172.21.15.17:0/3401388812 shutdown_connections 2024-08-19T01:10:35.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.596+0000 7f2abfcda640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aa006e180 0x7f2aa0070640 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.596+0000 7f2abfcda640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2ab8104a30 0x7f2ab819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.596+0000 7f2abfcda640 1 --2- 172.21.15.17:0/3401388812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2ab80fea30 0x7f2ab819b7f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.596+0000 7f2abfcda640 1 -- 172.21.15.17:0/3401388812 >> 172.21.15.17:0/3401388812 conn(0x7f2ab80fa730 msgr2=0x7f2ab80fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:35.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.596+0000 7f2abfcda640 1 -- 172.21.15.17:0/3401388812 shutdown_connections 2024-08-19T01:10:35.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.596+0000 7f2abfcda640 1 -- 172.21.15.17:0/3401388812 wait complete. 2024-08-19T01:10:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.679+0000 7f63e64e5640 1 -- 172.21.15.17:0/2549241671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e0100cb0 msgr2=0x7f63e0101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.679+0000 7f63e64e5640 1 --2- 172.21.15.17:0/2549241671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e0100cb0 0x7f63e0101090 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009880 tx=0x7f63d002a530 comp rx=0 tx=0).stop 2024-08-19T01:10:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.679+0000 7f63e64e5640 1 -- 172.21.15.17:0/2549241671 shutdown_connections 2024-08-19T01:10:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.679+0000 7f63e64e5640 1 --2- 172.21.15.17:0/2549241671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e01015d0 0x7f63e0109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.679+0000 7f63e64e5640 1 --2- 172.21.15.17:0/2549241671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e0100cb0 0x7f63e0101090 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.679+0000 7f63e64e5640 1 -- 172.21.15.17:0/2549241671 >> 172.21.15.17:0/2549241671 conn(0x7f63e00758a0 msgr2=0x7f63e00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:35.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.679+0000 7f63e64e5640 1 -- 172.21.15.17:0/2549241671 shutdown_connections 2024-08-19T01:10:35.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.679+0000 7f63e64e5640 1 -- 172.21.15.17:0/2549241671 wait complete. 2024-08-19T01:10:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.680+0000 7f63e64e5640 1 Processor -- start 2024-08-19T01:10:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.680+0000 7f63e64e5640 1 -- start start 2024-08-19T01:10:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.680+0000 7f63e64e5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e0100cb0 0x7f63e00fe910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.680+0000 7f63e64e5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e01015d0 0x7f63e00fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.680+0000 7f63e64e5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00ff390 con 0x7f63e0100cb0 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.680+0000 7f63e64e5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e00ff500 con 0x7f63e01015d0 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.680+0000 7f63dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e0100cb0 0x7f63e00fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.680+0000 7f63dffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e0100cb0 0x7f63e00fe910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41162/0 (socket says 172.21.15.17:41162) 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.680+0000 7f63dffff640 1 -- 172.21.15.17:0/1364356403 learned_addr learned my addr 172.21.15.17:0/1364356403 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.681+0000 7f63df7fe640 1 --2- 172.21.15.17:0/1364356403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e01015d0 0x7f63e00fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.681+0000 7f63dffff640 1 -- 172.21.15.17:0/1364356403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e01015d0 msgr2=0x7f63e00fee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.681+0000 7f63dffff640 1 --2- 172.21.15.17:0/1364356403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e01015d0 0x7f63e00fee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.681+0000 7f63dffff640 1 -- 172.21.15.17:0/1364356403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0009560 con 0x7f63e0100cb0 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.681+0000 7f63dffff640 1 --2- 172.21.15.17:0/1364356403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e0100cb0 0x7f63e00fe910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f63d0006010 tx=0x7f63d00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.681+0000 7f63dd7fa640 1 -- 172.21.15.17:0/1364356403 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d00048d0 con 0x7f63e0100cb0 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.681+0000 7f63dd7fa640 1 -- 172.21.15.17:0/1364356403 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63d0031640 con 0x7f63e0100cb0 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.681+0000 7f63e64e5640 1 -- 172.21.15.17:0/1364356403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e00ff780 con 0x7f63e0100cb0 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.681+0000 7f63dd7fa640 1 -- 172.21.15.17:0/1364356403 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63d0003820 con 0x7f63e0100cb0 2024-08-19T01:10:35.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.681+0000 7f63e64e5640 1 -- 172.21.15.17:0/1364356403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e01a1f60 con 0x7f63e0100cb0 2024-08-19T01:10:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.682+0000 7f63e64e5640 1 -- 172.21.15.17:0/1364356403 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e0068510 con 0x7f63e0100cb0 2024-08-19T01:10:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.683+0000 7f63dd7fa640 1 -- 172.21.15.17:0/1364356403 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f63d002ad50 con 0x7f63e0100cb0 2024-08-19T01:10:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.683+0000 7f63dd7fa640 1 --2- 172.21.15.17:0/1364356403 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63c806e180 0x7f63c8070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.683+0000 7f63dd7fa640 1 -- 172.21.15.17:0/1364356403 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f63d00aecb0 con 0x7f63e0100cb0 2024-08-19T01:10:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.683+0000 7f63df7fe640 1 --2- 172.21.15.17:0/1364356403 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63c806e180 0x7f63c8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.684+0000 7f63df7fe640 1 --2- 172.21.15.17:0/1364356403 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63c806e180 0x7f63c8070640 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f63e0100090 tx=0x7f63d4005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:35.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.687+0000 7f63dd7fa640 1 -- 172.21.15.17:0/1364356403 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f63d0078040 con 0x7f63e0100cb0 2024-08-19T01:10:35.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.872+0000 7f63e64e5640 1 -- 172.21.15.17:0/1364356403 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f63e00ff780 con 0x7f63c806e180 2024-08-19T01:10:35.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.881+0000 7f63dd7fa640 1 -- 172.21.15.17:0/1364356403 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f63e00ff780 con 0x7f63c806e180 2024-08-19T01:10:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:10:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (11m) 5m ago 22m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:10:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (22m) 5m ago 22m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:10:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (21m) 5m ago 21m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:10:35.883 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (9m) 5m ago 22m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (9m) 5m ago 21m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (11m) 5m ago 22m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (5m) 5m ago 17m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (6m) 5m ago 17m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (17m) 5m ago 17m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (5m) 5m ago 17m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (13m) 5m ago 23m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (12m) 5m ago 21m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (10m) 5m ago 24m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (10m) 5m ago 21m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (12m) 5m ago 22m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (12m) 5m ago 21m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (9m) 5m ago 20m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:10:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (8m) 5m ago 20m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:10:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (8m) 5m ago 19m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:10:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (7m) 5m ago 19m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:10:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (6m) 5m ago 19m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:10:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (6m) 5m ago 18m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:10:35.885 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (12m) 5m ago 22m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:10:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.883+0000 7f63e64e5640 1 -- 172.21.15.17:0/1364356403 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63c806e180 msgr2=0x7f63c8070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.883+0000 7f63e64e5640 1 --2- 172.21.15.17:0/1364356403 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63c806e180 0x7f63c8070640 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f63e0100090 tx=0x7f63d4005f90 comp rx=0 tx=0).stop 2024-08-19T01:10:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.883+0000 7f63e64e5640 1 -- 172.21.15.17:0/1364356403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e0100cb0 msgr2=0x7f63e00fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.883+0000 7f63e64e5640 1 --2- 172.21.15.17:0/1364356403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e0100cb0 0x7f63e00fe910 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f63d0006010 tx=0x7f63d00055a0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.883+0000 7f63e64e5640 1 -- 172.21.15.17:0/1364356403 shutdown_connections 2024-08-19T01:10:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.883+0000 7f63e64e5640 1 --2- 172.21.15.17:0/1364356403 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f63c806e180 0x7f63c8070640 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.883+0000 7f63e64e5640 1 --2- 172.21.15.17:0/1364356403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63e01015d0 0x7f63e00fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.883+0000 7f63e64e5640 1 --2- 172.21.15.17:0/1364356403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63e0100cb0 0x7f63e00fe910 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.883+0000 7f63e64e5640 1 -- 172.21.15.17:0/1364356403 >> 172.21.15.17:0/1364356403 conn(0x7f63e00758a0 msgr2=0x7f63e0101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.883+0000 7f63e64e5640 1 -- 172.21.15.17:0/1364356403 shutdown_connections 2024-08-19T01:10:35.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.883+0000 7f63e64e5640 1 -- 172.21.15.17:0/1364356403 wait complete. 2024-08-19T01:10:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.964+0000 7f147f82b640 1 -- 172.21.15.17:0/3799398681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1478100d50 msgr2=0x7f1478101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.964+0000 7f147f82b640 1 --2- 172.21.15.17:0/3799398681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1478100d50 0x7f1478101130 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1474009880 tx=0x7f147402a530 comp rx=0 tx=0).stop 2024-08-19T01:10:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.964+0000 7f147f82b640 1 -- 172.21.15.17:0/3799398681 shutdown_connections 2024-08-19T01:10:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.964+0000 7f147f82b640 1 --2- 172.21.15.17:0/3799398681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1478101670 0x7f1478109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.964+0000 7f147f82b640 1 --2- 172.21.15.17:0/3799398681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1478100d50 0x7f1478101130 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.964+0000 7f147f82b640 1 -- 172.21.15.17:0/3799398681 >> 172.21.15.17:0/3799398681 conn(0x7f14780758a0 msgr2=0x7f14780fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.965+0000 7f147f82b640 1 -- 172.21.15.17:0/3799398681 shutdown_connections 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.965+0000 7f147f82b640 1 -- 172.21.15.17:0/3799398681 wait complete. 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.965+0000 7f147f82b640 1 Processor -- start 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.965+0000 7f147f82b640 1 -- start start 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.965+0000 7f147f82b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1478100d50 0x7f1478197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.965+0000 7f147f82b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1478101670 0x7f1478198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.965+0000 7f147f82b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14781988e0 con 0x7f1478100d50 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.965+0000 7f147f82b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147819c650 con 0x7f1478101670 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.965+0000 7f147d5c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1478100d50 0x7f1478197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f147d5c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1478100d50 0x7f1478197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41172/0 (socket says 172.21.15.17:41172) 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f147d5c7640 1 -- 172.21.15.17:0/656648495 learned_addr learned my addr 172.21.15.17:0/656648495 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f147cdc6640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1478101670 0x7f1478198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f147d5c7640 1 -- 172.21.15.17:0/656648495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1478101670 msgr2=0x7f1478198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f147d5c7640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1478101670 0x7f1478198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f147d5c7640 1 -- 172.21.15.17:0/656648495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1474009560 con 0x7f1478100d50 2024-08-19T01:10:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f147cdc6640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1478101670 0x7f1478198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:10:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f147d5c7640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1478100d50 0x7f1478197d10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1474005940 tx=0x7f1474032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f146e7fc640 1 -- 172.21.15.17:0/656648495 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1474005220 con 0x7f1478100d50 2024-08-19T01:10:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f146e7fc640 1 -- 172.21.15.17:0/656648495 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1474005380 con 0x7f1478100d50 2024-08-19T01:10:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f147f82b640 1 -- 172.21.15.17:0/656648495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147819c8d0 con 0x7f1478100d50 2024-08-19T01:10:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f146e7fc640 1 -- 172.21.15.17:0/656648495 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1474003a50 con 0x7f1478100d50 2024-08-19T01:10:35.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.966+0000 7f147f82b640 1 -- 172.21.15.17:0/656648495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147819cdc0 con 0x7f1478100d50 2024-08-19T01:10:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.967+0000 7f147f82b640 1 -- 172.21.15.17:0/656648495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1478068470 con 0x7f1478100d50 2024-08-19T01:10:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.968+0000 7f146e7fc640 1 -- 172.21.15.17:0/656648495 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f147402ad50 con 0x7f1478100d50 2024-08-19T01:10:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.968+0000 7f146e7fc640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f146406e170 0x7f1464070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.968+0000 7f146e7fc640 1 -- 172.21.15.17:0/656648495 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f14740aec80 con 0x7f1478100d50 2024-08-19T01:10:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.968+0000 7f147cdc6640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f146406e170 0x7f1464070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.969+0000 7f147cdc6640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f146406e170 0x7f1464070630 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14781992c0 tx=0x7f1468005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:35.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:35.972+0000 7f146e7fc640 1 -- 172.21.15.17:0/656648495 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1474077f60 con 0x7f1478100d50 2024-08-19T01:10:36.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.216+0000 7f147f82b640 1 -- 172.21.15.17:0/656648495 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1478101130 con 0x7f1478100d50 2024-08-19T01:10:36.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.217+0000 7f146e7fc640 1 -- 172.21.15.17:0/656648495 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f147407b620 con 0x7f1478100d50 2024-08-19T01:10:36.219 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:10:36.219 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:10:36.219 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:10:36.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:10:36.219 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:10:36.219 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:10:36.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:10:36.220 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:10:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.219+0000 7f147f82b640 1 -- 172.21.15.17:0/656648495 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f146406e170 msgr2=0x7f1464070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.219+0000 7f147f82b640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f146406e170 0x7f1464070630 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14781992c0 tx=0x7f1468005d30 comp rx=0 tx=0).stop 2024-08-19T01:10:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.219+0000 7f147f82b640 1 -- 172.21.15.17:0/656648495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1478100d50 msgr2=0x7f1478197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.219+0000 7f147f82b640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1478100d50 0x7f1478197d10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1474005940 tx=0x7f1474032bd0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.219+0000 7f147f82b640 1 -- 172.21.15.17:0/656648495 shutdown_connections 2024-08-19T01:10:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.219+0000 7f147f82b640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f146406e170 0x7f1464070630 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.219+0000 7f147f82b640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1478101670 0x7f1478198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.219+0000 7f147f82b640 1 --2- 172.21.15.17:0/656648495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1478100d50 0x7f1478197d10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.219+0000 7f147f82b640 1 -- 172.21.15.17:0/656648495 >> 172.21.15.17:0/656648495 conn(0x7f14780758a0 msgr2=0x7f14780fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.219+0000 7f147f82b640 1 -- 172.21.15.17:0/656648495 shutdown_connections 2024-08-19T01:10:36.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.219+0000 7f147f82b640 1 -- 172.21.15.17:0/656648495 wait complete. 2024-08-19T01:10:36.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.300+0000 7f628521d640 1 -- 172.21.15.17:0/206368774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62801049f0 msgr2=0x7f6280104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.300+0000 7f628521d640 1 --2- 172.21.15.17:0/206368774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62801049f0 0x7f6280104dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6268009880 tx=0x7f626802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.300+0000 7f628521d640 1 -- 172.21.15.17:0/206368774 shutdown_connections 2024-08-19T01:10:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.300+0000 7f628521d640 1 --2- 172.21.15.17:0/206368774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62800fe9f0 0x7f62800fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.300+0000 7f628521d640 1 --2- 172.21.15.17:0/206368774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62801049f0 0x7f6280104dd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.300+0000 7f628521d640 1 -- 172.21.15.17:0/206368774 >> 172.21.15.17:0/206368774 conn(0x7f62800758a0 msgr2=0x7f62800fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.300+0000 7f628521d640 1 -- 172.21.15.17:0/206368774 shutdown_connections 2024-08-19T01:10:36.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.300+0000 7f628521d640 1 -- 172.21.15.17:0/206368774 wait complete. 2024-08-19T01:10:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.301+0000 7f628521d640 1 Processor -- start 2024-08-19T01:10:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.301+0000 7f628521d640 1 -- start start 2024-08-19T01:10:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.301+0000 7f628521d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62800fe9f0 0x7f6280196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f628521d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62801049f0 0x7f6280196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f628521d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6280197490 con 0x7f62800fe9f0 2024-08-19T01:10:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f628521d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6280197600 con 0x7f62801049f0 2024-08-19T01:10:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f627ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62800fe9f0 0x7f6280196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f627ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62800fe9f0 0x7f6280196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41190/0 (socket says 172.21.15.17:41190) 2024-08-19T01:10:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f627ed9d640 1 -- 172.21.15.17:0/1473479182 learned_addr learned my addr 172.21.15.17:0/1473479182 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f627e59c640 1 --2- 172.21.15.17:0/1473479182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62801049f0 0x7f6280196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:36.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f627ed9d640 1 -- 172.21.15.17:0/1473479182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62801049f0 msgr2=0x7f6280196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f627ed9d640 1 --2- 172.21.15.17:0/1473479182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62801049f0 0x7f6280196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f627ed9d640 1 -- 172.21.15.17:0/1473479182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6268009560 con 0x7f62800fe9f0 2024-08-19T01:10:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f627ed9d640 1 --2- 172.21.15.17:0/1473479182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62800fe9f0 0x7f6280196980 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f626802a9c0 tx=0x7f62680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f6277fff640 1 -- 172.21.15.17:0/1473479182 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6268004aa0 con 0x7f62800fe9f0 2024-08-19T01:10:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f628521d640 1 -- 172.21.15.17:0/1473479182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628019f9f0 con 0x7f62800fe9f0 2024-08-19T01:10:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f6277fff640 1 -- 172.21.15.17:0/1473479182 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6268004c00 con 0x7f62800fe9f0 2024-08-19T01:10:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f6277fff640 1 -- 172.21.15.17:0/1473479182 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6268003980 con 0x7f62800fe9f0 2024-08-19T01:10:36.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.302+0000 7f628521d640 1 -- 172.21.15.17:0/1473479182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628019fd50 con 0x7f62800fe9f0 2024-08-19T01:10:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.303+0000 7f628521d640 1 -- 172.21.15.17:0/1473479182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6280100130 con 0x7f62800fe9f0 2024-08-19T01:10:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.304+0000 7f6277fff640 1 -- 172.21.15.17:0/1473479182 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6268003bf0 con 0x7f62800fe9f0 2024-08-19T01:10:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.304+0000 7f6277fff640 1 --2- 172.21.15.17:0/1473479182 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f626c06e170 0x7f626c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.305+0000 7f6277fff640 1 -- 172.21.15.17:0/1473479182 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f62680af200 con 0x7f62800fe9f0 2024-08-19T01:10:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.305+0000 7f627e59c640 1 --2- 172.21.15.17:0/1473479182 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f626c06e170 0x7f626c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:36.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.305+0000 7f627e59c640 1 --2- 172.21.15.17:0/1473479182 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f626c06e170 0x7f626c070630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6280068470 tx=0x7f627000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:36.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.309+0000 7f6277fff640 1 -- 172.21.15.17:0/1473479182 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f62680784f0 con 0x7f62800fe9f0 2024-08-19T01:10:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.520+0000 7f628521d640 1 -- 172.21.15.17:0/1473479182 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6280068220 con 0x7f62800fe9f0 2024-08-19T01:10:36.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.520+0000 7f6277fff640 1 -- 172.21.15.17:0/1473479182 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f626807bbb0 con 0x7f62800fe9f0 2024-08-19T01:10:36.522 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:10:36.523 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:10:36.524 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:10:36.525 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:10:36.526 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:10:36.526 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:10:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:10:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.522+0000 7f628521d640 1 -- 172.21.15.17:0/1473479182 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f626c06e170 msgr2=0x7f626c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.522+0000 7f628521d640 1 --2- 172.21.15.17:0/1473479182 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f626c06e170 0x7f626c070630 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6280068470 tx=0x7f627000b390 comp rx=0 tx=0).stop 2024-08-19T01:10:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.522+0000 7f628521d640 1 -- 172.21.15.17:0/1473479182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62800fe9f0 msgr2=0x7f6280196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.522+0000 7f628521d640 1 --2- 172.21.15.17:0/1473479182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62800fe9f0 0x7f6280196980 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f626802a9c0 tx=0x7f62680055a0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.522+0000 7f628521d640 1 -- 172.21.15.17:0/1473479182 shutdown_connections 2024-08-19T01:10:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.522+0000 7f628521d640 1 --2- 172.21.15.17:0/1473479182 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f626c06e170 0x7f626c070630 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.522+0000 7f628521d640 1 --2- 172.21.15.17:0/1473479182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62801049f0 0x7f6280196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.522+0000 7f628521d640 1 --2- 172.21.15.17:0/1473479182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62800fe9f0 0x7f6280196980 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.522+0000 7f628521d640 1 -- 172.21.15.17:0/1473479182 >> 172.21.15.17:0/1473479182 conn(0x7f62800758a0 msgr2=0x7f62800fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.523+0000 7f628521d640 1 -- 172.21.15.17:0/1473479182 shutdown_connections 2024-08-19T01:10:36.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.523+0000 7f628521d640 1 -- 172.21.15.17:0/1473479182 wait complete. 2024-08-19T01:10:36.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.606+0000 7f2c90635640 1 -- 172.21.15.17:0/612173229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c88100750 msgr2=0x7f2c881047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.606+0000 7f2c90635640 1 --2- 172.21.15.17:0/612173229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c88100750 0x7f2c881047a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2c78009880 tx=0x7f2c7802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.606+0000 7f2c90635640 1 -- 172.21.15.17:0/612173229 shutdown_connections 2024-08-19T01:10:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.606+0000 7f2c90635640 1 --2- 172.21.15.17:0/612173229 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c88100750 0x7f2c881047a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.606+0000 7f2c90635640 1 --2- 172.21.15.17:0/612173229 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c880ffda0 0x7f2c88100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.606+0000 7f2c90635640 1 -- 172.21.15.17:0/612173229 >> 172.21.15.17:0/612173229 conn(0x7f2c880fb840 msgr2=0x7f2c880fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.606+0000 7f2c90635640 1 -- 172.21.15.17:0/612173229 shutdown_connections 2024-08-19T01:10:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.606+0000 7f2c90635640 1 -- 172.21.15.17:0/612173229 wait complete. 2024-08-19T01:10:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c90635640 1 Processor -- start 2024-08-19T01:10:36.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c90635640 1 -- start start 2024-08-19T01:10:36.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c90635640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c880ffda0 0x7f2c8819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c90635640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c88100750 0x7f2c8819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c90635640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8819c2f0 con 0x7f2c880ffda0 2024-08-19T01:10:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c90635640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c88195910 con 0x7f2c88100750 2024-08-19T01:10:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c8e3d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c880ffda0 0x7f2c8819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c8e3d1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c880ffda0 0x7f2c8819b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41212/0 (socket says 172.21.15.17:41212) 2024-08-19T01:10:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c8e3d1640 1 -- 172.21.15.17:0/2918955015 learned_addr learned my addr 172.21.15.17:0/2918955015 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c8dbd0640 1 --2- 172.21.15.17:0/2918955015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c88100750 0x7f2c8819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c8e3d1640 1 -- 172.21.15.17:0/2918955015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c88100750 msgr2=0x7f2c8819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c8e3d1640 1 --2- 172.21.15.17:0/2918955015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c88100750 0x7f2c8819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.607+0000 7f2c8e3d1640 1 -- 172.21.15.17:0/2918955015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c78009560 con 0x7f2c880ffda0 2024-08-19T01:10:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.608+0000 7f2c8e3d1640 1 --2- 172.21.15.17:0/2918955015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c880ffda0 0x7f2c8819b820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400c8a0 tx=0x7f2c8400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.608+0000 7f2c7f7fe640 1 -- 172.21.15.17:0/2918955015 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c84007b80 con 0x7f2c880ffda0 2024-08-19T01:10:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.608+0000 7f2c7f7fe640 1 -- 172.21.15.17:0/2918955015 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c84007ce0 con 0x7f2c880ffda0 2024-08-19T01:10:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.608+0000 7f2c90635640 1 -- 172.21.15.17:0/2918955015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c88195bf0 con 0x7f2c880ffda0 2024-08-19T01:10:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.608+0000 7f2c7f7fe640 1 -- 172.21.15.17:0/2918955015 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c84018810 con 0x7f2c880ffda0 2024-08-19T01:10:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.608+0000 7f2c90635640 1 -- 172.21.15.17:0/2918955015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c88196110 con 0x7f2c880ffda0 2024-08-19T01:10:36.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.609+0000 7f2c90635640 1 -- 172.21.15.17:0/2918955015 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c88101280 con 0x7f2c880ffda0 2024-08-19T01:10:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.609+0000 7f2c7f7fe640 1 -- 172.21.15.17:0/2918955015 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2c84018a80 con 0x7f2c880ffda0 2024-08-19T01:10:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.610+0000 7f2c7f7fe640 1 --2- 172.21.15.17:0/2918955015 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2c7406e170 0x7f2c74070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.610+0000 7f2c7f7fe640 1 -- 172.21.15.17:0/2918955015 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2c8408e440 con 0x7f2c880ffda0 2024-08-19T01:10:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.610+0000 7f2c8dbd0640 1 --2- 172.21.15.17:0/2918955015 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2c7406e170 0x7f2c74070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:36.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.610+0000 7f2c8dbd0640 1 --2- 172.21.15.17:0/2918955015 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2c7406e170 0x7f2c74070630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c78000c00 tx=0x7f2c78005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:36.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.614+0000 7f2c7f7fe640 1 -- 172.21.15.17:0/2918955015 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2c84057680 con 0x7f2c880ffda0 2024-08-19T01:10:36.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.807+0000 7f2c90635640 1 -- 172.21.15.17:0/2918955015 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c8810cdb0 con 0x7f2c7406e170 2024-08-19T01:10:36.809 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:36 smithi017 ceph-mon[99370]: pgmap v354: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:36.809 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:36 smithi017 ceph-mon[99370]: from='client.34708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:36.809 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:36 smithi017 ceph-mon[99370]: from='client.34712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:36.809 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:36 smithi017 ceph-mon[99370]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:36.809 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:36 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/656648495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:10:36.809 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:36 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1473479182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:10:36.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.808+0000 7f2c7f7fe640 1 -- 172.21.15.17:0/2918955015 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2c8810cdb0 con 0x7f2c7406e170 2024-08-19T01:10:36.810 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:10:36.810 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:10:36.810 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:10:36.810 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:10:36.810 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:10:36.811 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:10:36.811 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:10:36.811 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:10:36.811 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:10:36.811 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:10:36.811 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:10:36.811 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:10:36.811 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:10:36.811 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:10:36.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.810+0000 7f2c90635640 1 -- 172.21.15.17:0/2918955015 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2c7406e170 msgr2=0x7f2c74070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.810+0000 7f2c90635640 1 --2- 172.21.15.17:0/2918955015 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2c7406e170 0x7f2c74070630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c78000c00 tx=0x7f2c78005a20 comp rx=0 tx=0).stop 2024-08-19T01:10:36.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.810+0000 7f2c90635640 1 -- 172.21.15.17:0/2918955015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c880ffda0 msgr2=0x7f2c8819b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.810+0000 7f2c90635640 1 --2- 172.21.15.17:0/2918955015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c880ffda0 0x7f2c8819b820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2c8400c8a0 tx=0x7f2c8400cd60 comp rx=0 tx=0).stop 2024-08-19T01:10:36.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.810+0000 7f2c90635640 1 -- 172.21.15.17:0/2918955015 shutdown_connections 2024-08-19T01:10:36.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.810+0000 7f2c90635640 1 --2- 172.21.15.17:0/2918955015 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2c7406e170 0x7f2c74070630 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.810+0000 7f2c90635640 1 --2- 172.21.15.17:0/2918955015 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2c88100750 0x7f2c8819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.810+0000 7f2c90635640 1 --2- 172.21.15.17:0/2918955015 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2c880ffda0 0x7f2c8819b820 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.810+0000 7f2c90635640 1 -- 172.21.15.17:0/2918955015 >> 172.21.15.17:0/2918955015 conn(0x7f2c880fb840 msgr2=0x7f2c880fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:36.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.810+0000 7f2c90635640 1 -- 172.21.15.17:0/2918955015 shutdown_connections 2024-08-19T01:10:36.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.810+0000 7f2c90635640 1 -- 172.21.15.17:0/2918955015 wait complete. 2024-08-19T01:10:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.892+0000 7f697bb31640 1 -- 172.21.15.17:0/2775472217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740fe9f0 msgr2=0x7f69740fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.892+0000 7f697bb31640 1 --2- 172.21.15.17:0/2775472217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740fe9f0 0x7f69740fee50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6970009880 tx=0x7f697002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 -- 172.21.15.17:0/2775472217 shutdown_connections 2024-08-19T01:10:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 --2- 172.21.15.17:0/2775472217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740fe9f0 0x7f69740fee50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 --2- 172.21.15.17:0/2775472217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69741049f0 0x7f6974104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 -- 172.21.15.17:0/2775472217 >> 172.21.15.17:0/2775472217 conn(0x7f69740758a0 msgr2=0x7f69740fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 -- 172.21.15.17:0/2775472217 shutdown_connections 2024-08-19T01:10:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 -- 172.21.15.17:0/2775472217 wait complete. 2024-08-19T01:10:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 Processor -- start 2024-08-19T01:10:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 -- start start 2024-08-19T01:10:36.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69740fe9f0 0x7f6974196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69741049f0 0x7f6974196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6974197430 con 0x7f69741049f0 2024-08-19T01:10:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.893+0000 7f697bb31640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69741975a0 con 0x7f69740fe9f0 2024-08-19T01:10:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f69790cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69741049f0 0x7f6974196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f69790cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69741049f0 0x7f6974196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40002/0 (socket says 172.21.15.17:40002) 2024-08-19T01:10:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f69790cc640 1 -- 172.21.15.17:0/1031674609 learned_addr learned my addr 172.21.15.17:0/1031674609 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:10:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f69798cd640 1 --2- 172.21.15.17:0/1031674609 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69740fe9f0 0x7f6974196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f69790cc640 1 -- 172.21.15.17:0/1031674609 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69740fe9f0 msgr2=0x7f6974196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:36.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f69790cc640 1 --2- 172.21.15.17:0/1031674609 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69740fe9f0 0x7f6974196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f69790cc640 1 -- 172.21.15.17:0/1031674609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009560 con 0x7f69741049f0 2024-08-19T01:10:36.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f69790cc640 1 --2- 172.21.15.17:0/1031674609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69741049f0 0x7f6974196e60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6970006010 tx=0x7f69700055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f696affd640 1 -- 172.21.15.17:0/1031674609 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6970004aa0 con 0x7f69741049f0 2024-08-19T01:10:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f696affd640 1 -- 172.21.15.17:0/1031674609 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6970031470 con 0x7f69741049f0 2024-08-19T01:10:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f697bb31640 1 -- 172.21.15.17:0/1031674609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f697419f990 con 0x7f69741049f0 2024-08-19T01:10:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f696affd640 1 -- 172.21.15.17:0/1031674609 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6970003940 con 0x7f69741049f0 2024-08-19T01:10:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.894+0000 7f697bb31640 1 -- 172.21.15.17:0/1031674609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697419fcf0 con 0x7f69741049f0 2024-08-19T01:10:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.895+0000 7f697bb31640 1 -- 172.21.15.17:0/1031674609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6974100130 con 0x7f69741049f0 2024-08-19T01:10:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.896+0000 7f696affd640 1 -- 172.21.15.17:0/1031674609 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6970031b90 con 0x7f69741049f0 2024-08-19T01:10:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.896+0000 7f696affd640 1 --2- 172.21.15.17:0/1031674609 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f696006e180 0x7f6960070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:10:36.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.896+0000 7f696affd640 1 -- 172.21.15.17:0/1031674609 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f69700af130 con 0x7f69741049f0 2024-08-19T01:10:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.896+0000 7f69798cd640 1 --2- 172.21.15.17:0/1031674609 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f696006e180 0x7f6960070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:10:36.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.897+0000 7f69798cd640 1 --2- 172.21.15.17:0/1031674609 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f696006e180 0x7f6960070640 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f696400bbe0 tx=0x7f696400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:10:36.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:36.901+0000 7f696affd640 1 -- 172.21.15.17:0/1031674609 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6970078540 con 0x7f69741049f0 2024-08-19T01:10:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:36 smithi086 ceph-mon[71303]: pgmap v354: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:36 smithi086 ceph-mon[71303]: from='client.34708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:36 smithi086 ceph-mon[71303]: from='client.34712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:36 smithi086 ceph-mon[71303]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:36 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/656648495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:10:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:36 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1473479182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:10:37.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.154+0000 7f697bb31640 1 -- 172.21.15.17:0/1031674609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6974106f80 con 0x7f69741049f0 2024-08-19T01:10:37.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.154+0000 7f696affd640 1 -- 172.21.15.17:0/1031674609 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f6970004c00 con 0x7f69741049f0 2024-08-19T01:10:37.156 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:10:37.156 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:10:37.156 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:10:37.156 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:10:37.157 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:10:37.157 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:10:37.157 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:10:37.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.156+0000 7f697bb31640 1 -- 172.21.15.17:0/1031674609 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f696006e180 msgr2=0x7f6960070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:37.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.156+0000 7f697bb31640 1 --2- 172.21.15.17:0/1031674609 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f696006e180 0x7f6960070640 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f696400bbe0 tx=0x7f696400b390 comp rx=0 tx=0).stop 2024-08-19T01:10:37.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.156+0000 7f697bb31640 1 -- 172.21.15.17:0/1031674609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69741049f0 msgr2=0x7f6974196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:10:37.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.156+0000 7f697bb31640 1 --2- 172.21.15.17:0/1031674609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69741049f0 0x7f6974196e60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6970006010 tx=0x7f69700055a0 comp rx=0 tx=0).stop 2024-08-19T01:10:37.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.157+0000 7f697bb31640 1 -- 172.21.15.17:0/1031674609 shutdown_connections 2024-08-19T01:10:37.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.157+0000 7f697bb31640 1 --2- 172.21.15.17:0/1031674609 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f696006e180 0x7f6960070640 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:37.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.157+0000 7f697bb31640 1 --2- 172.21.15.17:0/1031674609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69741049f0 0x7f6974196e60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:37.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.157+0000 7f697bb31640 1 --2- 172.21.15.17:0/1031674609 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69740fe9f0 0x7f6974196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:10:37.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.157+0000 7f697bb31640 1 -- 172.21.15.17:0/1031674609 >> 172.21.15.17:0/1031674609 conn(0x7f69740758a0 msgr2=0x7f69740fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:10:37.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.157+0000 7f697bb31640 1 -- 172.21.15.17:0/1031674609 shutdown_connections 2024-08-19T01:10:37.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:10:37.157+0000 7f697bb31640 1 -- 172.21.15.17:0/1031674609 wait complete. 2024-08-19T01:10:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:37 smithi086 ceph-mon[71303]: from='client.34728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:37 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1031674609' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:10:38.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:37 smithi017 ceph-mon[99370]: from='client.34728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:10:38.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:37 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1031674609' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:10:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:38 smithi086 ceph-mon[71303]: pgmap v355: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:38 smithi017 ceph-mon[99370]: pgmap v355: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:40 smithi086 ceph-mon[71303]: pgmap v356: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:40 smithi017 ceph-mon[99370]: pgmap v356: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:42 smithi086 ceph-mon[71303]: pgmap v357: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:43.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:42 smithi017 ceph-mon[99370]: pgmap v357: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:44 smithi017 ceph-mon[99370]: pgmap v358: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:44 smithi086 ceph-mon[71303]: pgmap v358: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:46 smithi017 ceph-mon[99370]: pgmap v359: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:46 smithi086 ceph-mon[71303]: pgmap v359: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:48.998 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:48 smithi086 ceph-mon[71303]: pgmap v360: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:48.998 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:10:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:48 smithi017 ceph-mon[99370]: pgmap v360: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:10:51.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:50 smithi017 ceph-mon[99370]: pgmap v361: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:51.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:50 smithi086 ceph-mon[71303]: pgmap v361: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:53.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:52 smithi017 ceph-mon[99370]: pgmap v362: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:53.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:52 smithi086 ceph-mon[71303]: pgmap v362: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:55.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:54 smithi017 ceph-mon[99370]: pgmap v363: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:54 smithi086 ceph-mon[71303]: pgmap v363: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:57.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:56 smithi017 ceph-mon[99370]: pgmap v364: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:57.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:56 smithi086 ceph-mon[71303]: pgmap v364: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:58.985 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:10:58 smithi017 ceph-mon[99370]: pgmap v365: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:10:59.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:10:58 smithi086 ceph-mon[71303]: pgmap v365: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:00 smithi086 ceph-mon[71303]: pgmap v366: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:01.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:00 smithi017 ceph-mon[99370]: pgmap v366: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:03.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:02 smithi017 ceph-mon[99370]: pgmap v367: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:02 smithi086 ceph-mon[71303]: pgmap v367: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:04.134 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:11:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:11:05.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:04 smithi017 ceph-mon[99370]: pgmap v368: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:04 smithi086 ceph-mon[71303]: pgmap v368: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:07.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:06 smithi017 ceph-mon[99370]: pgmap v369: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:07.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:06 smithi086 ceph-mon[71303]: pgmap v369: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:07.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.252+0000 7f023809b640 1 -- 172.21.15.17:0/79099261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02300ffb50 msgr2=0x7f02300fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.252+0000 7f023809b640 1 --2- 172.21.15.17:0/79099261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02300ffb50 0x7f02300fffb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0220009880 tx=0x7f022002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.252+0000 7f023809b640 1 -- 172.21.15.17:0/79099261 shutdown_connections 2024-08-19T01:11:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.252+0000 7f023809b640 1 --2- 172.21.15.17:0/79099261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02300ffb50 0x7f02300fffb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.252+0000 7f023809b640 1 --2- 172.21.15.17:0/79099261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0230105c00 0x7f0230105fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.252+0000 7f023809b640 1 -- 172.21.15.17:0/79099261 >> 172.21.15.17:0/79099261 conn(0x7f02300fb830 msgr2=0x7f02300fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.253+0000 7f023809b640 1 -- 172.21.15.17:0/79099261 shutdown_connections 2024-08-19T01:11:07.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.253+0000 7f023809b640 1 -- 172.21.15.17:0/79099261 wait complete. 2024-08-19T01:11:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.253+0000 7f023809b640 1 Processor -- start 2024-08-19T01:11:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f023809b640 1 -- start start 2024-08-19T01:11:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f023809b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02300ffb50 0x7f023019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f023809b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0230105c00 0x7f023019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:07.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f023809b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023019c2f0 con 0x7f02300ffb50 2024-08-19T01:11:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f023809b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230195880 con 0x7f0230105c00 2024-08-19T01:11:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f0235e37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02300ffb50 0x7f023019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f0235e37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02300ffb50 0x7f023019b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51062/0 (socket says 172.21.15.17:51062) 2024-08-19T01:11:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f0235e37640 1 -- 172.21.15.17:0/2323756382 learned_addr learned my addr 172.21.15.17:0/2323756382 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f0235636640 1 --2- 172.21.15.17:0/2323756382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0230105c00 0x7f023019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f0235e37640 1 -- 172.21.15.17:0/2323756382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0230105c00 msgr2=0x7f023019bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f0235e37640 1 --2- 172.21.15.17:0/2323756382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0230105c00 0x7f023019bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.254+0000 7f0235e37640 1 -- 172.21.15.17:0/2323756382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0220009560 con 0x7f02300ffb50 2024-08-19T01:11:07.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.255+0000 7f0235e37640 1 --2- 172.21.15.17:0/2323756382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02300ffb50 0x7f023019b790 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f022c00d6f0 tx=0x7f022c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.255+0000 7f0226ffd640 1 -- 172.21.15.17:0/2323756382 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f022c009a30 con 0x7f02300ffb50 2024-08-19T01:11:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.255+0000 7f0226ffd640 1 -- 172.21.15.17:0/2323756382 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f022c0054e0 con 0x7f02300ffb50 2024-08-19T01:11:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.255+0000 7f023809b640 1 -- 172.21.15.17:0/2323756382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0230195b60 con 0x7f02300ffb50 2024-08-19T01:11:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.255+0000 7f0226ffd640 1 -- 172.21.15.17:0/2323756382 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f022c010460 con 0x7f02300ffb50 2024-08-19T01:11:07.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.255+0000 7f023809b640 1 -- 172.21.15.17:0/2323756382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0230196100 con 0x7f02300ffb50 2024-08-19T01:11:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.256+0000 7f023809b640 1 -- 172.21.15.17:0/2323756382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0230101200 con 0x7f02300ffb50 2024-08-19T01:11:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.256+0000 7f0226ffd640 1 -- 172.21.15.17:0/2323756382 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f022c009b90 con 0x7f02300ffb50 2024-08-19T01:11:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.257+0000 7f0226ffd640 1 --2- 172.21.15.17:0/2323756382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f021c06e170 0x7f021c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.257+0000 7f0226ffd640 1 -- 172.21.15.17:0/2323756382 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f022c08dc80 con 0x7f02300ffb50 2024-08-19T01:11:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.257+0000 7f0235636640 1 --2- 172.21.15.17:0/2323756382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f021c06e170 0x7f021c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:07.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.257+0000 7f0235636640 1 --2- 172.21.15.17:0/2323756382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f021c06e170 0x7f021c070630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0220000c00 tx=0x7f0220005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:07.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.261+0000 7f0226ffd640 1 -- 172.21.15.17:0/2323756382 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f022c056fe0 con 0x7f02300ffb50 2024-08-19T01:11:07.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.455+0000 7f023809b640 1 -- 172.21.15.17:0/2323756382 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0230108090 con 0x7f021c06e170 2024-08-19T01:11:07.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.456+0000 7f0226ffd640 1 -- 172.21.15.17:0/2323756382 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0230108090 con 0x7f021c06e170 2024-08-19T01:11:07.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.458+0000 7f023809b640 1 -- 172.21.15.17:0/2323756382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f021c06e170 msgr2=0x7f021c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:07.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.458+0000 7f023809b640 1 --2- 172.21.15.17:0/2323756382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f021c06e170 0x7f021c070630 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0220000c00 tx=0x7f0220005a20 comp rx=0 tx=0).stop 2024-08-19T01:11:07.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.458+0000 7f023809b640 1 -- 172.21.15.17:0/2323756382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02300ffb50 msgr2=0x7f023019b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:07.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.458+0000 7f023809b640 1 --2- 172.21.15.17:0/2323756382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02300ffb50 0x7f023019b790 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f022c00d6f0 tx=0x7f022c00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.458+0000 7f023809b640 1 -- 172.21.15.17:0/2323756382 shutdown_connections 2024-08-19T01:11:07.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.458+0000 7f023809b640 1 --2- 172.21.15.17:0/2323756382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f021c06e170 0x7f021c070630 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.458+0000 7f023809b640 1 --2- 172.21.15.17:0/2323756382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0230105c00 0x7f023019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.458+0000 7f023809b640 1 --2- 172.21.15.17:0/2323756382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02300ffb50 0x7f023019b790 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.458+0000 7f023809b640 1 -- 172.21.15.17:0/2323756382 >> 172.21.15.17:0/2323756382 conn(0x7f02300fb830 msgr2=0x7f02300fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:07.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.458+0000 7f023809b640 1 -- 172.21.15.17:0/2323756382 shutdown_connections 2024-08-19T01:11:07.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.458+0000 7f023809b640 1 -- 172.21.15.17:0/2323756382 wait complete. 2024-08-19T01:11:07.469 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:11:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.542+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1950766302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c104b50 msgr2=0x7f8c1c104f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.542+0000 7f8c22b3c640 1 --2- 172.21.15.17:0/1950766302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c104b50 0x7f8c1c104f30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009880 tx=0x7f8c1002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.542+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1950766302 shutdown_connections 2024-08-19T01:11:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.542+0000 7f8c22b3c640 1 --2- 172.21.15.17:0/1950766302 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c1c0fdf70 0x7f8c1c0fe3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.542+0000 7f8c22b3c640 1 --2- 172.21.15.17:0/1950766302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c104b50 0x7f8c1c104f30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.542+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1950766302 >> 172.21.15.17:0/1950766302 conn(0x7f8c1c0f9ec0 msgr2=0x7f8c1c0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.542+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1950766302 shutdown_connections 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.542+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1950766302 wait complete. 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.542+0000 7f8c22b3c640 1 Processor -- start 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c22b3c640 1 -- start start 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c22b3c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c1c0fdf70 0x7f8c1c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c22b3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c104b50 0x7f8c1c19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c22b3c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c19c460 con 0x7f8c1c104b50 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c22b3c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c1959f0 con 0x7f8c1c0fdf70 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c1bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c104b50 0x7f8c1c19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c1bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c104b50 0x7f8c1c19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51080/0 (socket says 172.21.15.17:51080) 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c1bfff640 1 -- 172.21.15.17:0/1848309628 learned_addr learned my addr 172.21.15.17:0/1848309628 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:07.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c208d8640 1 --2- 172.21.15.17:0/1848309628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c1c0fdf70 0x7f8c1c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c1bfff640 1 -- 172.21.15.17:0/1848309628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c1c0fdf70 msgr2=0x7f8c1c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c1bfff640 1 --2- 172.21.15.17:0/1848309628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c1c0fdf70 0x7f8c1c19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c1bfff640 1 -- 172.21.15.17:0/1848309628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10009560 con 0x7f8c1c104b50 2024-08-19T01:11:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.543+0000 7f8c1bfff640 1 --2- 172.21.15.17:0/1848309628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c104b50 0x7f8c1c19be40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800d6f0 tx=0x7f8c0800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.544+0000 7f8c19ffb640 1 -- 172.21.15.17:0/1848309628 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c08009a30 con 0x7f8c1c104b50 2024-08-19T01:11:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.544+0000 7f8c19ffb640 1 -- 172.21.15.17:0/1848309628 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8c080054e0 con 0x7f8c1c104b50 2024-08-19T01:11:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.544+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1848309628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c195cd0 con 0x7f8c1c104b50 2024-08-19T01:11:07.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.544+0000 7f8c19ffb640 1 -- 172.21.15.17:0/1848309628 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c08010460 con 0x7f8c1c104b50 2024-08-19T01:11:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.544+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1848309628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c196220 con 0x7f8c1c104b50 2024-08-19T01:11:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.545+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1848309628 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c101290 con 0x7f8c1c104b50 2024-08-19T01:11:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.546+0000 7f8c19ffb640 1 -- 172.21.15.17:0/1848309628 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8c08009b90 con 0x7f8c1c104b50 2024-08-19T01:11:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.546+0000 7f8c19ffb640 1 --2- 172.21.15.17:0/1848309628 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c0c06e170 0x7f8c0c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.546+0000 7f8c19ffb640 1 -- 172.21.15.17:0/1848309628 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8c0808dd20 con 0x7f8c1c104b50 2024-08-19T01:11:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.546+0000 7f8c208d8640 1 --2- 172.21.15.17:0/1848309628 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c0c06e170 0x7f8c0c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.547+0000 7f8c208d8640 1 --2- 172.21.15.17:0/1848309628 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c0c06e170 0x7f8c0c070630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c10000c00 tx=0x7f8c10005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:07.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.551+0000 7f8c19ffb640 1 -- 172.21.15.17:0/1848309628 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8c08056fe0 con 0x7f8c1c104b50 2024-08-19T01:11:07.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.743+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1848309628 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c1c10ceb0 con 0x7f8c0c06e170 2024-08-19T01:11:07.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.744+0000 7f8c19ffb640 1 -- 172.21.15.17:0/1848309628 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8c1c10ceb0 con 0x7f8c0c06e170 2024-08-19T01:11:07.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.746+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1848309628 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c0c06e170 msgr2=0x7f8c0c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:07.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.746+0000 7f8c22b3c640 1 --2- 172.21.15.17:0/1848309628 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c0c06e170 0x7f8c0c070630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c10000c00 tx=0x7f8c10005a20 comp rx=0 tx=0).stop 2024-08-19T01:11:07.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.746+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1848309628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c104b50 msgr2=0x7f8c1c19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:07.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.746+0000 7f8c22b3c640 1 --2- 172.21.15.17:0/1848309628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c104b50 0x7f8c1c19be40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800d6f0 tx=0x7f8c0800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.746+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1848309628 shutdown_connections 2024-08-19T01:11:07.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.746+0000 7f8c22b3c640 1 --2- 172.21.15.17:0/1848309628 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8c0c06e170 0x7f8c0c070630 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.746+0000 7f8c22b3c640 1 --2- 172.21.15.17:0/1848309628 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8c1c104b50 0x7f8c1c19be40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.746+0000 7f8c22b3c640 1 --2- 172.21.15.17:0/1848309628 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8c1c0fdf70 0x7f8c1c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.746+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1848309628 >> 172.21.15.17:0/1848309628 conn(0x7f8c1c0f9ec0 msgr2=0x7f8c1c0fb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:07.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.747+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1848309628 shutdown_connections 2024-08-19T01:11:07.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.747+0000 7f8c22b3c640 1 -- 172.21.15.17:0/1848309628 wait complete. 2024-08-19T01:11:07.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.829+0000 7f4518430640 1 -- 172.21.15.17:0/1374481253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45100fe9f0 msgr2=0x7f45100fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:07.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.829+0000 7f4518430640 1 --2- 172.21.15.17:0/1374481253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45100fe9f0 0x7f45100fee50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4504009880 tx=0x7f450402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 -- 172.21.15.17:0/1374481253 shutdown_connections 2024-08-19T01:11:07.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 --2- 172.21.15.17:0/1374481253 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45100fe9f0 0x7f45100fee50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 --2- 172.21.15.17:0/1374481253 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45101049f0 0x7f4510104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 -- 172.21.15.17:0/1374481253 >> 172.21.15.17:0/1374481253 conn(0x7f45100758a0 msgr2=0x7f45100fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:07.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 -- 172.21.15.17:0/1374481253 shutdown_connections 2024-08-19T01:11:07.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 -- 172.21.15.17:0/1374481253 wait complete. 2024-08-19T01:11:07.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 Processor -- start 2024-08-19T01:11:07.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 -- start start 2024-08-19T01:11:07.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45100fe9f0 0x7f45100fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:07.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45101049f0 0x7f45100fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100fb800 con 0x7f45100fe9f0 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.830+0000 7f4518430640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100fb940 con 0x7f45101049f0 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f45161cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45100fe9f0 0x7f45100fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f45161cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45100fe9f0 0x7f45100fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51096/0 (socket says 172.21.15.17:51096) 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f45161cc640 1 -- 172.21.15.17:0/1520320619 learned_addr learned my addr 172.21.15.17:0/1520320619 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f45159cb640 1 --2- 172.21.15.17:0/1520320619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45101049f0 0x7f45100fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f45161cc640 1 -- 172.21.15.17:0/1520320619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45101049f0 msgr2=0x7f45100fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f45161cc640 1 --2- 172.21.15.17:0/1520320619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45101049f0 0x7f45100fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f45161cc640 1 -- 172.21.15.17:0/1520320619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504009560 con 0x7f45100fe9f0 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f45161cc640 1 --2- 172.21.15.17:0/1520320619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45100fe9f0 0x7f45100fad80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f450000cc60 tx=0x7f450000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f450f7fe640 1 -- 172.21.15.17:0/1520320619 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4500004b20 con 0x7f45100fe9f0 2024-08-19T01:11:07.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f450f7fe640 1 -- 172.21.15.17:0/1520320619 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4500004c80 con 0x7f45100fe9f0 2024-08-19T01:11:07.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f4518430640 1 -- 172.21.15.17:0/1520320619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45101a1ca0 con 0x7f45100fe9f0 2024-08-19T01:11:07.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.831+0000 7f450f7fe640 1 -- 172.21.15.17:0/1520320619 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f450000f640 con 0x7f45100fe9f0 2024-08-19T01:11:07.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.832+0000 7f4518430640 1 -- 172.21.15.17:0/1520320619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45101a2050 con 0x7f45100fe9f0 2024-08-19T01:11:07.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.833+0000 7f4518430640 1 -- 172.21.15.17:0/1520320619 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45100fbbc0 con 0x7f45100fe9f0 2024-08-19T01:11:07.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.833+0000 7f450f7fe640 1 -- 172.21.15.17:0/1520320619 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f45000055e0 con 0x7f45100fe9f0 2024-08-19T01:11:07.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.833+0000 7f450f7fe640 1 --2- 172.21.15.17:0/1520320619 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f44f806e170 0x7f44f8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:07.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.834+0000 7f450f7fe640 1 -- 172.21.15.17:0/1520320619 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f450008e2c0 con 0x7f45100fe9f0 2024-08-19T01:11:07.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.834+0000 7f45159cb640 1 --2- 172.21.15.17:0/1520320619 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f44f806e170 0x7f44f8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:07.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.834+0000 7f45159cb640 1 --2- 172.21.15.17:0/1520320619 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f44f806e170 0x7f44f8070630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4504000c00 tx=0x7f4504005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:07.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:07.838+0000 7f450f7fe640 1 -- 172.21.15.17:0/1520320619 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4500057620 con 0x7f45100fe9f0 2024-08-19T01:11:08.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.023+0000 7f4518430640 1 -- 172.21.15.17:0/1520320619 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f451010bc80 con 0x7f44f806e170 2024-08-19T01:11:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.033+0000 7f450f7fe640 1 -- 172.21.15.17:0/1520320619 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f451010bc80 con 0x7f44f806e170 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (12m) 6m ago 23m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (23m) 6m ago 23m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (22m) 6m ago 22m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (10m) 6m ago 23m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (10m) 6m ago 22m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (12m) 6m ago 22m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (6m) 6m ago 17m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (6m) 6m ago 17m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (17m) 6m ago 17m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (6m) 6m ago 17m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:11:08.035 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (14m) 6m ago 24m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:11:08.036 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (13m) 6m ago 22m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:11:08.036 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (11m) 6m ago 24m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:11:08.036 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (10m) 6m ago 22m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:11:08.036 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (13m) 6m ago 23m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:11:08.036 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (13m) 6m ago 22m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:11:08.036 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (9m) 6m ago 21m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:11:08.036 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (9m) 6m ago 20m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:11:08.036 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (8m) 6m ago 20m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:11:08.036 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (8m) 6m ago 20m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:11:08.036 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (7m) 6m ago 19m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:11:08.036 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (6m) 6m ago 19m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:11:08.037 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (12m) 6m ago 22m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:11:08.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.034+0000 7f4518430640 1 -- 172.21.15.17:0/1520320619 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f44f806e170 msgr2=0x7f44f8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.034+0000 7f4518430640 1 --2- 172.21.15.17:0/1520320619 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f44f806e170 0x7f44f8070630 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4504000c00 tx=0x7f4504005a20 comp rx=0 tx=0).stop 2024-08-19T01:11:08.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.034+0000 7f4518430640 1 -- 172.21.15.17:0/1520320619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45100fe9f0 msgr2=0x7f45100fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.034+0000 7f4518430640 1 --2- 172.21.15.17:0/1520320619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45100fe9f0 0x7f45100fad80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f450000cc60 tx=0x7f450000a620 comp rx=0 tx=0).stop 2024-08-19T01:11:08.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.035+0000 7f4518430640 1 -- 172.21.15.17:0/1520320619 shutdown_connections 2024-08-19T01:11:08.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.035+0000 7f4518430640 1 --2- 172.21.15.17:0/1520320619 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f44f806e170 0x7f44f8070630 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.035+0000 7f4518430640 1 --2- 172.21.15.17:0/1520320619 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45101049f0 0x7f45100fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.035+0000 7f4518430640 1 --2- 172.21.15.17:0/1520320619 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45100fe9f0 0x7f45100fad80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.035+0000 7f4518430640 1 -- 172.21.15.17:0/1520320619 >> 172.21.15.17:0/1520320619 conn(0x7f45100758a0 msgr2=0x7f45100fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:08.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.035+0000 7f4518430640 1 -- 172.21.15.17:0/1520320619 shutdown_connections 2024-08-19T01:11:08.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.035+0000 7f4518430640 1 -- 172.21.15.17:0/1520320619 wait complete. 2024-08-19T01:11:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.115+0000 7efe76de1640 1 -- 172.21.15.17:0/3993924818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe700fea30 msgr2=0x7efe700fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.115+0000 7efe76de1640 1 --2- 172.21.15.17:0/3993924818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe700fea30 0x7efe700fee90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efe5c009880 tx=0x7efe5c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.115+0000 7efe76de1640 1 -- 172.21.15.17:0/3993924818 shutdown_connections 2024-08-19T01:11:08.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.115+0000 7efe76de1640 1 --2- 172.21.15.17:0/3993924818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe700fea30 0x7efe700fee90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.115+0000 7efe76de1640 1 --2- 172.21.15.17:0/3993924818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe70104a30 0x7efe70104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.115+0000 7efe76de1640 1 -- 172.21.15.17:0/3993924818 >> 172.21.15.17:0/3993924818 conn(0x7efe700fa730 msgr2=0x7efe700fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:08.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.115+0000 7efe76de1640 1 -- 172.21.15.17:0/3993924818 shutdown_connections 2024-08-19T01:11:08.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.115+0000 7efe76de1640 1 -- 172.21.15.17:0/3993924818 wait complete. 2024-08-19T01:11:08.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.116+0000 7efe76de1640 1 Processor -- start 2024-08-19T01:11:08.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.116+0000 7efe76de1640 1 -- start start 2024-08-19T01:11:08.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.116+0000 7efe76de1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe700fea30 0x7efe70196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:08.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.116+0000 7efe76de1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe70104a30 0x7efe70196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:08.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.116+0000 7efe76de1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe70197470 con 0x7efe700fea30 2024-08-19T01:11:08.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.116+0000 7efe76de1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe701975e0 con 0x7efe70104a30 2024-08-19T01:11:08.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.116+0000 7efe74b7d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe700fea30 0x7efe70196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:08.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.116+0000 7efe74b7d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe700fea30 0x7efe70196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51114/0 (socket says 172.21.15.17:51114) 2024-08-19T01:11:08.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.117+0000 7efe74b7d640 1 -- 172.21.15.17:0/1943919709 learned_addr learned my addr 172.21.15.17:0/1943919709 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:08.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.117+0000 7efe6ffff640 1 --2- 172.21.15.17:0/1943919709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe70104a30 0x7efe70196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:08.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.117+0000 7efe74b7d640 1 -- 172.21.15.17:0/1943919709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe70104a30 msgr2=0x7efe70196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.117+0000 7efe74b7d640 1 --2- 172.21.15.17:0/1943919709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe70104a30 0x7efe70196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.117+0000 7efe74b7d640 1 -- 172.21.15.17:0/1943919709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c009560 con 0x7efe700fea30 2024-08-19T01:11:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.117+0000 7efe74b7d640 1 --2- 172.21.15.17:0/1943919709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe700fea30 0x7efe70196960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efe6400c8f0 tx=0x7efe6400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.117+0000 7efe6dffb640 1 -- 172.21.15.17:0/1943919709 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe64007b80 con 0x7efe700fea30 2024-08-19T01:11:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.117+0000 7efe6dffb640 1 -- 172.21.15.17:0/1943919709 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe640054e0 con 0x7efe700fea30 2024-08-19T01:11:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.117+0000 7efe6dffb640 1 -- 172.21.15.17:0/1943919709 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe6400f450 con 0x7efe700fea30 2024-08-19T01:11:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.117+0000 7efe76de1640 1 -- 172.21.15.17:0/1943919709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7019f9d0 con 0x7efe700fea30 2024-08-19T01:11:08.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.118+0000 7efe76de1640 1 -- 172.21.15.17:0/1943919709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7019fde0 con 0x7efe700fea30 2024-08-19T01:11:08.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.118+0000 7efe76de1640 1 -- 172.21.15.17:0/1943919709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe70100170 con 0x7efe700fea30 2024-08-19T01:11:08.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.119+0000 7efe6dffb640 1 -- 172.21.15.17:0/1943919709 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efe64004f60 con 0x7efe700fea30 2024-08-19T01:11:08.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.120+0000 7efe6dffb640 1 --2- 172.21.15.17:0/1943919709 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe6006e170 0x7efe60070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:08.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.120+0000 7efe6dffb640 1 -- 172.21.15.17:0/1943919709 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efe6408dff0 con 0x7efe700fea30 2024-08-19T01:11:08.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.120+0000 7efe6ffff640 1 --2- 172.21.15.17:0/1943919709 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe6006e170 0x7efe60070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:08.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.120+0000 7efe6ffff640 1 --2- 172.21.15.17:0/1943919709 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe6006e170 0x7efe60070630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efe5c000c00 tx=0x7efe5c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:08.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.125+0000 7efe6dffb640 1 -- 172.21.15.17:0/1943919709 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efe640572d0 con 0x7efe700fea30 2024-08-19T01:11:08.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.375+0000 7efe76de1640 1 -- 172.21.15.17:0/1943919709 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efe70068aa0 con 0x7efe700fea30 2024-08-19T01:11:08.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.376+0000 7efe6dffb640 1 -- 172.21.15.17:0/1943919709 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7efe6405a990 con 0x7efe700fea30 2024-08-19T01:11:08.378 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:11:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:11:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:11:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:11:08.378 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:11:08.379 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:11:08.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:11:08.380 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:11:08.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.378+0000 7efe76de1640 1 -- 172.21.15.17:0/1943919709 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe6006e170 msgr2=0x7efe60070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.378+0000 7efe76de1640 1 --2- 172.21.15.17:0/1943919709 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe6006e170 0x7efe60070630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7efe5c000c00 tx=0x7efe5c005a20 comp rx=0 tx=0).stop 2024-08-19T01:11:08.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.378+0000 7efe76de1640 1 -- 172.21.15.17:0/1943919709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe700fea30 msgr2=0x7efe70196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.378+0000 7efe76de1640 1 --2- 172.21.15.17:0/1943919709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe700fea30 0x7efe70196960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efe6400c8f0 tx=0x7efe6400cdb0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.379+0000 7efe76de1640 1 -- 172.21.15.17:0/1943919709 shutdown_connections 2024-08-19T01:11:08.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.379+0000 7efe76de1640 1 --2- 172.21.15.17:0/1943919709 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe6006e170 0x7efe60070630 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.379+0000 7efe76de1640 1 --2- 172.21.15.17:0/1943919709 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe70104a30 0x7efe70196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.379+0000 7efe76de1640 1 --2- 172.21.15.17:0/1943919709 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe700fea30 0x7efe70196960 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.379+0000 7efe76de1640 1 -- 172.21.15.17:0/1943919709 >> 172.21.15.17:0/1943919709 conn(0x7efe700fa730 msgr2=0x7efe700fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:08.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.379+0000 7efe76de1640 1 -- 172.21.15.17:0/1943919709 shutdown_connections 2024-08-19T01:11:08.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.379+0000 7efe76de1640 1 -- 172.21.15.17:0/1943919709 wait complete. 2024-08-19T01:11:08.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.460+0000 7f897d63b640 1 -- 172.21.15.17:0/1014680826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8978105bf0 msgr2=0x7f8978105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.460+0000 7f897d63b640 1 --2- 172.21.15.17:0/1014680826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8978105bf0 0x7f8978105fd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8970009c20 tx=0x7f897002a970 comp rx=0 tx=0).stop 2024-08-19T01:11:08.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.460+0000 7f897d63b640 1 -- 172.21.15.17:0/1014680826 shutdown_connections 2024-08-19T01:11:08.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.460+0000 7f897d63b640 1 --2- 172.21.15.17:0/1014680826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89780ffb40 0x7f89780fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.460+0000 7f897d63b640 1 --2- 172.21.15.17:0/1014680826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8978105bf0 0x7f8978105fd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.460+0000 7f897d63b640 1 -- 172.21.15.17:0/1014680826 >> 172.21.15.17:0/1014680826 conn(0x7f89780fb860 msgr2=0x7f89780fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:08.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.460+0000 7f897d63b640 1 -- 172.21.15.17:0/1014680826 shutdown_connections 2024-08-19T01:11:08.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.460+0000 7f897d63b640 1 -- 172.21.15.17:0/1014680826 wait complete. 2024-08-19T01:11:08.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.461+0000 7f897d63b640 1 Processor -- start 2024-08-19T01:11:08.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.461+0000 7f897d63b640 1 -- start start 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.461+0000 7f897d63b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89780ffb40 0x7f897819b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.461+0000 7f897d63b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8978105bf0 0x7f897819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.461+0000 7f897d63b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897819c340 con 0x7f89780ffb40 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.461+0000 7f897d63b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89781958d0 con 0x7f8978105bf0 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.461+0000 7f8976ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89780ffb40 0x7f897819b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.461+0000 7f8976ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89780ffb40 0x7f897819b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51132/0 (socket says 172.21.15.17:51132) 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.461+0000 7f8976ffd640 1 -- 172.21.15.17:0/2026455348 learned_addr learned my addr 172.21.15.17:0/2026455348 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.462+0000 7f89767fc640 1 --2- 172.21.15.17:0/2026455348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8978105bf0 0x7f897819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.462+0000 7f8976ffd640 1 -- 172.21.15.17:0/2026455348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8978105bf0 msgr2=0x7f897819bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.462+0000 7f8976ffd640 1 --2- 172.21.15.17:0/2026455348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8978105bf0 0x7f897819bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.462+0000 7f8976ffd640 1 -- 172.21.15.17:0/2026455348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970009900 con 0x7f89780ffb40 2024-08-19T01:11:08.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.462+0000 7f8976ffd640 1 --2- 172.21.15.17:0/2026455348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89780ffb40 0x7f897819b7e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8970032000 tx=0x7f89700308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:08.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.462+0000 7f896ffff640 1 -- 172.21.15.17:0/2026455348 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897002f590 con 0x7f89780ffb40 2024-08-19T01:11:08.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.462+0000 7f897d63b640 1 -- 172.21.15.17:0/2026455348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8978195b50 con 0x7f89780ffb40 2024-08-19T01:11:08.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.462+0000 7f896ffff640 1 -- 172.21.15.17:0/2026455348 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8970030ca0 con 0x7f89780ffb40 2024-08-19T01:11:08.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.462+0000 7f896ffff640 1 -- 172.21.15.17:0/2026455348 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8970039680 con 0x7f89780ffb40 2024-08-19T01:11:08.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.462+0000 7f897d63b640 1 -- 172.21.15.17:0/2026455348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89781960c0 con 0x7f89780ffb40 2024-08-19T01:11:08.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.463+0000 7f897d63b640 1 -- 172.21.15.17:0/2026455348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89781011f0 con 0x7f89780ffb40 2024-08-19T01:11:08.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.464+0000 7f896ffff640 1 -- 172.21.15.17:0/2026455348 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f897000a040 con 0x7f89780ffb40 2024-08-19T01:11:08.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.464+0000 7f896ffff640 1 --2- 172.21.15.17:0/2026455348 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f896406e180 0x7f8964070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:08.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.464+0000 7f896ffff640 1 -- 172.21.15.17:0/2026455348 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f897002c040 con 0x7f89780ffb40 2024-08-19T01:11:08.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.464+0000 7f89767fc640 1 --2- 172.21.15.17:0/2026455348 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f896406e180 0x7f8964070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:08.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.465+0000 7f89767fc640 1 --2- 172.21.15.17:0/2026455348 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f896406e180 0x7f8964070640 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8978196d40 tx=0x7f896000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:08.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.469+0000 7f896ffff640 1 -- 172.21.15.17:0/2026455348 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f89700787c0 con 0x7f89780ffb40 2024-08-19T01:11:08.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.681+0000 7f897d63b640 1 -- 172.21.15.17:0/2026455348 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8978108010 con 0x7f89780ffb40 2024-08-19T01:11:08.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.681+0000 7f896ffff640 1 -- 172.21.15.17:0/2026455348 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f897007be80 con 0x7f89780ffb40 2024-08-19T01:11:08.683 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:11:08.683 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:11:08.683 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:11:08.683 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:11:08.683 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:11:08.684 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:11:08.685 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:11:08.686 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:11:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:11:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:11:08.686 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:11:08.686 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:11:08.686 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:11:08.686 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:11:08.686 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:11:08.686 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:11:08.687 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:11:08.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.683+0000 7f897d63b640 1 -- 172.21.15.17:0/2026455348 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f896406e180 msgr2=0x7f8964070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.683+0000 7f897d63b640 1 --2- 172.21.15.17:0/2026455348 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f896406e180 0x7f8964070640 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8978196d40 tx=0x7f896000b390 comp rx=0 tx=0).stop 2024-08-19T01:11:08.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.683+0000 7f897d63b640 1 -- 172.21.15.17:0/2026455348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89780ffb40 msgr2=0x7f897819b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.683+0000 7f897d63b640 1 --2- 172.21.15.17:0/2026455348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89780ffb40 0x7f897819b7e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8970032000 tx=0x7f89700308a0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.683+0000 7f897d63b640 1 -- 172.21.15.17:0/2026455348 shutdown_connections 2024-08-19T01:11:08.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.683+0000 7f897d63b640 1 --2- 172.21.15.17:0/2026455348 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f896406e180 0x7f8964070640 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.683+0000 7f897d63b640 1 --2- 172.21.15.17:0/2026455348 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8978105bf0 0x7f897819bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.683+0000 7f897d63b640 1 --2- 172.21.15.17:0/2026455348 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89780ffb40 0x7f897819b7e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.683+0000 7f897d63b640 1 -- 172.21.15.17:0/2026455348 >> 172.21.15.17:0/2026455348 conn(0x7f89780fb860 msgr2=0x7f89780fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:08.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.683+0000 7f897d63b640 1 -- 172.21.15.17:0/2026455348 shutdown_connections 2024-08-19T01:11:08.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.683+0000 7f897d63b640 1 -- 172.21.15.17:0/2026455348 wait complete. 2024-08-19T01:11:08.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.767+0000 7f06172e9640 1 -- 172.21.15.17:0/1231175468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0610101610 msgr2=0x7f0610109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.767+0000 7f06172e9640 1 --2- 172.21.15.17:0/1231175468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0610101610 0x7f0610109b00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f06040098b0 tx=0x7f060402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.767+0000 7f06172e9640 1 -- 172.21.15.17:0/1231175468 shutdown_connections 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.767+0000 7f06172e9640 1 --2- 172.21.15.17:0/1231175468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0610101610 0x7f0610109b00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.767+0000 7f06172e9640 1 --2- 172.21.15.17:0/1231175468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0610100c60 0x7f0610101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.767+0000 7f06172e9640 1 -- 172.21.15.17:0/1231175468 >> 172.21.15.17:0/1231175468 conn(0x7f06100fa730 msgr2=0x7f06100fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.767+0000 7f06172e9640 1 -- 172.21.15.17:0/1231175468 shutdown_connections 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.767+0000 7f06172e9640 1 -- 172.21.15.17:0/1231175468 wait complete. 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.767+0000 7f06172e9640 1 Processor -- start 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.767+0000 7f06172e9640 1 -- start start 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f06172e9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0610100c60 0x7f061019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f06172e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0610101610 0x7f061019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:08.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f06172e9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061019c3c0 con 0x7f0610101610 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f06172e9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0610195950 con 0x7f0610100c60 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f0614884640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0610101610 0x7f061019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f0614884640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0610101610 0x7f061019bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51150/0 (socket says 172.21.15.17:51150) 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f0614884640 1 -- 172.21.15.17:0/1381108776 learned_addr learned my addr 172.21.15.17:0/1381108776 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f0615085640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0610100c60 0x7f061019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f0614884640 1 -- 172.21.15.17:0/1381108776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0610100c60 msgr2=0x7f061019b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f0614884640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0610100c60 0x7f061019b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f0614884640 1 -- 172.21.15.17:0/1381108776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0604009560 con 0x7f0610101610 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f0615085640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0610100c60 0x7f061019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f0614884640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0610101610 0x7f061019bda0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0604006010 tx=0x7f06040055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.768+0000 7f060e7fc640 1 -- 172.21.15.17:0/1381108776 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0604004aa0 con 0x7f0610101610 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.769+0000 7f060e7fc640 1 -- 172.21.15.17:0/1381108776 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0604004c00 con 0x7f0610101610 2024-08-19T01:11:08.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.769+0000 7f06172e9640 1 -- 172.21.15.17:0/1381108776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0610195bd0 con 0x7f0610101610 2024-08-19T01:11:08.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.769+0000 7f060e7fc640 1 -- 172.21.15.17:0/1381108776 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0604003a20 con 0x7f0610101610 2024-08-19T01:11:08.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.769+0000 7f06172e9640 1 -- 172.21.15.17:0/1381108776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06101960c0 con 0x7f0610101610 2024-08-19T01:11:08.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.770+0000 7f06172e9640 1 -- 172.21.15.17:0/1381108776 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0610068d30 con 0x7f0610101610 2024-08-19T01:11:08.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.770+0000 7f060e7fc640 1 -- 172.21.15.17:0/1381108776 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0604003ba0 con 0x7f0610101610 2024-08-19T01:11:08.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.771+0000 7f060e7fc640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05f806e170 0x7f05f8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:08.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.771+0000 7f060e7fc640 1 -- 172.21.15.17:0/1381108776 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f06040af270 con 0x7f0610101610 2024-08-19T01:11:08.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.771+0000 7f0615085640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05f806e170 0x7f05f8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:08.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.771+0000 7f0615085640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05f806e170 0x7f05f8070630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0600005c40 tx=0x7f06000082f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:08.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.775+0000 7f060e7fc640 1 -- 172.21.15.17:0/1381108776 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f06040785d0 con 0x7f0610101610 2024-08-19T01:11:08.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.967+0000 7f06172e9640 1 -- 172.21.15.17:0/1381108776 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f061010cdb0 con 0x7f05f806e170 2024-08-19T01:11:08.970 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:08 smithi017 ceph-mon[99370]: pgmap v370: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:08.970 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:08 smithi017 ceph-mon[99370]: from='client.34736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:08.970 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:08 smithi017 ceph-mon[99370]: from='client.34740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:08.970 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:08 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1943919709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:11:08.970 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:08 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2026455348' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:11:08.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.968+0000 7f060e7fc640 1 -- 172.21.15.17:0/1381108776 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f061010cdb0 con 0x7f05f806e170 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:11:08.971 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:11:08.972 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:11:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.970+0000 7f06172e9640 1 -- 172.21.15.17:0/1381108776 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05f806e170 msgr2=0x7f05f8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.970+0000 7f06172e9640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05f806e170 0x7f05f8070630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0600005c40 tx=0x7f06000082f0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.970+0000 7f06172e9640 1 -- 172.21.15.17:0/1381108776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0610101610 msgr2=0x7f061019bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.970+0000 7f06172e9640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0610101610 0x7f061019bda0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0604006010 tx=0x7f06040055a0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.970+0000 7f06172e9640 1 -- 172.21.15.17:0/1381108776 shutdown_connections 2024-08-19T01:11:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.970+0000 7f06172e9640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05f806e170 0x7f05f8070630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.970+0000 7f06172e9640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0610101610 0x7f061019bda0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.970+0000 7f06172e9640 1 --2- 172.21.15.17:0/1381108776 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0610100c60 0x7f061019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.970+0000 7f06172e9640 1 -- 172.21.15.17:0/1381108776 >> 172.21.15.17:0/1381108776 conn(0x7f06100fa730 msgr2=0x7f0610101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.971+0000 7f06172e9640 1 -- 172.21.15.17:0/1381108776 shutdown_connections 2024-08-19T01:11:08.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:08.971+0000 7f06172e9640 1 -- 172.21.15.17:0/1381108776 wait complete. 2024-08-19T01:11:09.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.053+0000 7f185125d640 1 -- 172.21.15.17:0/2507787903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f184c0fe9f0 msgr2=0x7f184c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.053+0000 7f185125d640 1 --2- 172.21.15.17:0/2507787903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f184c0fe9f0 0x7f184c0fee50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f183c009880 tx=0x7f183c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:11:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.053+0000 7f185125d640 1 -- 172.21.15.17:0/2507787903 shutdown_connections 2024-08-19T01:11:09.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.053+0000 7f185125d640 1 --2- 172.21.15.17:0/2507787903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f184c0fe9f0 0x7f184c0fee50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:09.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.053+0000 7f185125d640 1 --2- 172.21.15.17:0/2507787903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f184c1049f0 0x7f184c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:09.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.053+0000 7f185125d640 1 -- 172.21.15.17:0/2507787903 >> 172.21.15.17:0/2507787903 conn(0x7f184c0758a0 msgr2=0x7f184c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:09.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.053+0000 7f185125d640 1 -- 172.21.15.17:0/2507787903 shutdown_connections 2024-08-19T01:11:09.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.053+0000 7f185125d640 1 -- 172.21.15.17:0/2507787903 wait complete. 2024-08-19T01:11:09.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.054+0000 7f185125d640 1 Processor -- start 2024-08-19T01:11:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.054+0000 7f185125d640 1 -- start start 2024-08-19T01:11:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f185125d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f184c0fe9f0 0x7f184c0fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f185125d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f184c1049f0 0x7f184c0fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f185125d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c0fb800 con 0x7f184c0fe9f0 2024-08-19T01:11:09.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f185125d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c0fb940 con 0x7f184c1049f0 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f184ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f184c0fe9f0 0x7f184c0fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f184ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f184c0fe9f0 0x7f184c0fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51172/0 (socket says 172.21.15.17:51172) 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f184ad9d640 1 -- 172.21.15.17:0/1856815786 learned_addr learned my addr 172.21.15.17:0/1856815786 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f184a59c640 1 --2- 172.21.15.17:0/1856815786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f184c1049f0 0x7f184c0fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f184ad9d640 1 -- 172.21.15.17:0/1856815786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f184c1049f0 msgr2=0x7f184c0fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f184ad9d640 1 --2- 172.21.15.17:0/1856815786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f184c1049f0 0x7f184c0fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f184ad9d640 1 -- 172.21.15.17:0/1856815786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c009560 con 0x7f184c0fe9f0 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f184ad9d640 1 --2- 172.21.15.17:0/1856815786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f184c0fe9f0 0x7f184c0fad80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f184000d6f0 tx=0x7f184000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f1833fff640 1 -- 172.21.15.17:0/1856815786 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1840009a30 con 0x7f184c0fe9f0 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f185125d640 1 -- 172.21.15.17:0/1856815786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184c1a1ca0 con 0x7f184c0fe9f0 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f1833fff640 1 -- 172.21.15.17:0/1856815786 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18400054e0 con 0x7f184c0fe9f0 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.055+0000 7f1833fff640 1 -- 172.21.15.17:0/1856815786 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1840010460 con 0x7f184c0fe9f0 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.056+0000 7f185125d640 1 -- 172.21.15.17:0/1856815786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184c1a2050 con 0x7f184c0fe9f0 2024-08-19T01:11:09.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.056+0000 7f185125d640 1 -- 172.21.15.17:0/1856815786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c100130 con 0x7f184c0fe9f0 2024-08-19T01:11:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.057+0000 7f1833fff640 1 -- 172.21.15.17:0/1856815786 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1840009b90 con 0x7f184c0fe9f0 2024-08-19T01:11:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.057+0000 7f1833fff640 1 --2- 172.21.15.17:0/1856815786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f183406e170 0x7f1834070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.058+0000 7f1833fff640 1 -- 172.21.15.17:0/1856815786 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f184008dc70 con 0x7f184c0fe9f0 2024-08-19T01:11:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.058+0000 7f184a59c640 1 --2- 172.21.15.17:0/1856815786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f183406e170 0x7f1834070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.058+0000 7f184a59c640 1 --2- 172.21.15.17:0/1856815786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f183406e170 0x7f1834070630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f183c009230 tx=0x7f183c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:09.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.062+0000 7f1833fff640 1 -- 172.21.15.17:0/1856815786 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1840057000 con 0x7f184c0fe9f0 2024-08-19T01:11:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:08 smithi086 ceph-mon[71303]: pgmap v370: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:08 smithi086 ceph-mon[71303]: from='client.34736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:08 smithi086 ceph-mon[71303]: from='client.34740 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:08 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1943919709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:11:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:08 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2026455348' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:11:09.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.307+0000 7f185125d640 1 -- 172.21.15.17:0/1856815786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f184c0fee50 con 0x7f184c0fe9f0 2024-08-19T01:11:09.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.307+0000 7f1833fff640 1 -- 172.21.15.17:0/1856815786 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f18400171c0 con 0x7f184c0fe9f0 2024-08-19T01:11:09.309 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:11:09.310 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:11:09.310 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:11:09.310 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:11:09.310 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:11:09.310 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:11:09.310 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:11:09.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.309+0000 7f185125d640 1 -- 172.21.15.17:0/1856815786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f183406e170 msgr2=0x7f1834070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:09.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.309+0000 7f185125d640 1 --2- 172.21.15.17:0/1856815786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f183406e170 0x7f1834070630 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f183c009230 tx=0x7f183c0058d0 comp rx=0 tx=0).stop 2024-08-19T01:11:09.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.310+0000 7f185125d640 1 -- 172.21.15.17:0/1856815786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f184c0fe9f0 msgr2=0x7f184c0fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:09.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.310+0000 7f185125d640 1 --2- 172.21.15.17:0/1856815786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f184c0fe9f0 0x7f184c0fad80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f184000d6f0 tx=0x7f184000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:11:09.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.310+0000 7f185125d640 1 -- 172.21.15.17:0/1856815786 shutdown_connections 2024-08-19T01:11:09.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.310+0000 7f185125d640 1 --2- 172.21.15.17:0/1856815786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f183406e170 0x7f1834070630 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:09.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.310+0000 7f185125d640 1 --2- 172.21.15.17:0/1856815786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f184c1049f0 0x7f184c0fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:09.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.310+0000 7f185125d640 1 --2- 172.21.15.17:0/1856815786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f184c0fe9f0 0x7f184c0fad80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:09.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.310+0000 7f185125d640 1 -- 172.21.15.17:0/1856815786 >> 172.21.15.17:0/1856815786 conn(0x7f184c0758a0 msgr2=0x7f184c0fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:09.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.310+0000 7f185125d640 1 -- 172.21.15.17:0/1856815786 shutdown_connections 2024-08-19T01:11:09.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:09.310+0000 7f185125d640 1 -- 172.21.15.17:0/1856815786 wait complete. 2024-08-19T01:11:10.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:09 smithi017 ceph-mon[99370]: from='client.34744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:10.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:09 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1856815786' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:11:10.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:09 smithi086 ceph-mon[71303]: from='client.34744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:10.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:09 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1856815786' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:11:11.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:10 smithi017 ceph-mon[99370]: from='client.34756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:11.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:10 smithi017 ceph-mon[99370]: pgmap v371: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:10 smithi086 ceph-mon[71303]: from='client.34756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:10 smithi086 ceph-mon[71303]: pgmap v371: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:13.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:12 smithi017 ceph-mon[99370]: pgmap v372: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:13.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:12 smithi086 ceph-mon[71303]: pgmap v372: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:15.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:14 smithi017 ceph-mon[99370]: pgmap v373: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:15.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:14 smithi086 ceph-mon[71303]: pgmap v373: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:17.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:16 smithi017 ceph-mon[99370]: pgmap v374: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:17.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:16 smithi086 ceph-mon[71303]: pgmap v374: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:18 smithi017 ceph-mon[99370]: pgmap v375: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:11:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:18 smithi086 ceph-mon[71303]: pgmap v375: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:11:21.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:20 smithi017 ceph-mon[99370]: pgmap v376: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:21.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:20 smithi086 ceph-mon[71303]: pgmap v376: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:23.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:22 smithi017 ceph-mon[99370]: pgmap v377: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:23.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:22 smithi086 ceph-mon[71303]: pgmap v377: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:25.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:24 smithi017 ceph-mon[99370]: pgmap v378: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:24 smithi086 ceph-mon[71303]: pgmap v378: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:27.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:26 smithi017 ceph-mon[99370]: pgmap v379: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:26 smithi086 ceph-mon[71303]: pgmap v379: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:29.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:28 smithi017 ceph-mon[99370]: pgmap v380: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:28 smithi086 ceph-mon[71303]: pgmap v380: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:31.036 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:30 smithi086 ceph-mon[71303]: pgmap v381: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:30 smithi017 ceph-mon[99370]: pgmap v381: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:33.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:32 smithi017 ceph-mon[99370]: pgmap v382: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:33.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:32 smithi086 ceph-mon[71303]: pgmap v382: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:11:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:11:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:34 smithi017 ceph-mon[99370]: pgmap v383: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:35.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:34 smithi086 ceph-mon[71303]: pgmap v383: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:36 smithi017 ceph-mon[99370]: pgmap v384: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:37.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:36 smithi086 ceph-mon[71303]: pgmap v384: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:38 smithi017 ceph-mon[99370]: pgmap v385: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:39.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:38 smithi086 ceph-mon[71303]: pgmap v385: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.405+0000 7f7fcc371640 1 -- 172.21.15.17:0/3945719532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc4101610 msgr2=0x7f7fc4109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.405+0000 7f7fcc371640 1 --2- 172.21.15.17:0/3945719532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc4101610 0x7f7fc4109b00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40098b0 tx=0x7f7fb402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.405+0000 7f7fcc371640 1 -- 172.21.15.17:0/3945719532 shutdown_connections 2024-08-19T01:11:39.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.405+0000 7f7fcc371640 1 --2- 172.21.15.17:0/3945719532 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc4101610 0x7f7fc4109b00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.405+0000 7f7fcc371640 1 --2- 172.21.15.17:0/3945719532 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc4100c60 0x7f7fc4101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.405+0000 7f7fcc371640 1 -- 172.21.15.17:0/3945719532 >> 172.21.15.17:0/3945719532 conn(0x7f7fc40fa730 msgr2=0x7f7fc40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:39.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.405+0000 7f7fcc371640 1 -- 172.21.15.17:0/3945719532 shutdown_connections 2024-08-19T01:11:39.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.405+0000 7f7fcc371640 1 -- 172.21.15.17:0/3945719532 wait complete. 2024-08-19T01:11:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.406+0000 7f7fcc371640 1 Processor -- start 2024-08-19T01:11:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.406+0000 7f7fcc371640 1 -- start start 2024-08-19T01:11:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.406+0000 7f7fcc371640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc4100c60 0x7f7fc419b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.406+0000 7f7fcc371640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc4101610 0x7f7fc419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.406+0000 7f7fcc371640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc419c3c0 con 0x7f7fc4101610 2024-08-19T01:11:39.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.406+0000 7f7fcc371640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc4195950 con 0x7f7fc4100c60 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.406+0000 7f7fc990c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc4101610 0x7f7fc419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.406+0000 7f7fc990c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc4101610 0x7f7fc419bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45962/0 (socket says 172.21.15.17:45962) 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.406+0000 7f7fc990c640 1 -- 172.21.15.17:0/2748247 learned_addr learned my addr 172.21.15.17:0/2748247 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.406+0000 7f7fca10d640 1 --2- 172.21.15.17:0/2748247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc4100c60 0x7f7fc419b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.407+0000 7f7fc990c640 1 -- 172.21.15.17:0/2748247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc4100c60 msgr2=0x7f7fc419b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.407+0000 7f7fc990c640 1 --2- 172.21.15.17:0/2748247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc4100c60 0x7f7fc419b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.407+0000 7f7fc990c640 1 -- 172.21.15.17:0/2748247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4009560 con 0x7f7fc4101610 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.407+0000 7f7fc990c640 1 --2- 172.21.15.17:0/2748247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc4101610 0x7f7fc419bda0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4006010 tx=0x7f7fb40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.407+0000 7f7fbb7fe640 1 -- 172.21.15.17:0/2748247 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fb4004aa0 con 0x7f7fc4101610 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.407+0000 7f7fbb7fe640 1 -- 172.21.15.17:0/2748247 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fb4031470 con 0x7f7fc4101610 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.407+0000 7f7fcc371640 1 -- 172.21.15.17:0/2748247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc4195bd0 con 0x7f7fc4101610 2024-08-19T01:11:39.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.407+0000 7f7fbb7fe640 1 -- 172.21.15.17:0/2748247 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fb4003940 con 0x7f7fc4101610 2024-08-19T01:11:39.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.407+0000 7f7fcc371640 1 -- 172.21.15.17:0/2748247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc41960c0 con 0x7f7fc4101610 2024-08-19T01:11:39.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.408+0000 7f7fcc371640 1 -- 172.21.15.17:0/2748247 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc4068d30 con 0x7f7fc4101610 2024-08-19T01:11:39.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.409+0000 7f7fbb7fe640 1 -- 172.21.15.17:0/2748247 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7fb4031b90 con 0x7f7fc4101610 2024-08-19T01:11:39.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.409+0000 7f7fbb7fe640 1 --2- 172.21.15.17:0/2748247 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 0x7f7fb0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:39.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.409+0000 7f7fbb7fe640 1 -- 172.21.15.17:0/2748247 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7fb40af1c0 con 0x7f7fc4101610 2024-08-19T01:11:39.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.410+0000 7f7fca10d640 1 --2- 172.21.15.17:0/2748247 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 0x7f7fb0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:39.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.410+0000 7f7fca10d640 1 --2- 172.21.15.17:0/2748247 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 0x7f7fb0070630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000bbe0 tx=0x7f7fc000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:39.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.414+0000 7f7fbb7fe640 1 -- 172.21.15.17:0/2748247 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7fb4078550 con 0x7f7fc4101610 2024-08-19T01:11:39.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.606+0000 7f7fcc371640 1 -- 172.21.15.17:0/2748247 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fc410cdb0 con 0x7f7fb006e170 2024-08-19T01:11:39.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.607+0000 7f7fbb7fe640 1 -- 172.21.15.17:0/2748247 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7fc410cdb0 con 0x7f7fb006e170 2024-08-19T01:11:39.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.609+0000 7f7fcc371640 1 -- 172.21.15.17:0/2748247 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 msgr2=0x7f7fb0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.609+0000 7f7fcc371640 1 --2- 172.21.15.17:0/2748247 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 0x7f7fb0070630 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000bbe0 tx=0x7f7fc000b390 comp rx=0 tx=0).stop 2024-08-19T01:11:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.609+0000 7f7fcc371640 1 -- 172.21.15.17:0/2748247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc4101610 msgr2=0x7f7fc419bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.609+0000 7f7fcc371640 1 --2- 172.21.15.17:0/2748247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc4101610 0x7f7fc419bda0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4006010 tx=0x7f7fb40055a0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.609+0000 7f7fcc371640 1 -- 172.21.15.17:0/2748247 shutdown_connections 2024-08-19T01:11:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.609+0000 7f7fcc371640 1 --2- 172.21.15.17:0/2748247 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 0x7f7fb0070630 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.609+0000 7f7fcc371640 1 --2- 172.21.15.17:0/2748247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc4101610 0x7f7fc419bda0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.609+0000 7f7fcc371640 1 --2- 172.21.15.17:0/2748247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc4100c60 0x7f7fc419b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.609+0000 7f7fcc371640 1 -- 172.21.15.17:0/2748247 >> 172.21.15.17:0/2748247 conn(0x7f7fc40fa730 msgr2=0x7f7fc4101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.609+0000 7f7fcc371640 1 -- 172.21.15.17:0/2748247 shutdown_connections 2024-08-19T01:11:39.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.610+0000 7f7fcc371640 1 -- 172.21.15.17:0/2748247 wait complete. 2024-08-19T01:11:39.620 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:11:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.692+0000 7f4683ca4640 1 -- 172.21.15.17:0/591894903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c1016b0 msgr2=0x7f467c109ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.692+0000 7f4683ca4640 1 --2- 172.21.15.17:0/591894903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c1016b0 0x7f467c109ba0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f466c009880 tx=0x7f466c02a530 comp rx=0 tx=0).stop 2024-08-19T01:11:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.692+0000 7f4683ca4640 1 -- 172.21.15.17:0/591894903 shutdown_connections 2024-08-19T01:11:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.692+0000 7f4683ca4640 1 --2- 172.21.15.17:0/591894903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c1016b0 0x7f467c109ba0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.692+0000 7f4683ca4640 1 --2- 172.21.15.17:0/591894903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c100d90 0x7f467c101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.692+0000 7f4683ca4640 1 -- 172.21.15.17:0/591894903 >> 172.21.15.17:0/591894903 conn(0x7f467c0fa730 msgr2=0x7f467c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.692+0000 7f4683ca4640 1 -- 172.21.15.17:0/591894903 shutdown_connections 2024-08-19T01:11:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.692+0000 7f4683ca4640 1 -- 172.21.15.17:0/591894903 wait complete. 2024-08-19T01:11:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.693+0000 7f4683ca4640 1 Processor -- start 2024-08-19T01:11:39.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.693+0000 7f4683ca4640 1 -- start start 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.693+0000 7f4683ca4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c100d90 0x7f467c0fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.693+0000 7f4683ca4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c1016b0 0x7f467c0fef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.693+0000 7f4683ca4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0ff470 con 0x7f467c100d90 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.693+0000 7f4683ca4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0ff5e0 con 0x7f467c1016b0 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.693+0000 7f4681a40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c100d90 0x7f467c0fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.693+0000 7f4681a40640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c100d90 0x7f467c0fe9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45974/0 (socket says 172.21.15.17:45974) 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.693+0000 7f4681a40640 1 -- 172.21.15.17:0/880063814 learned_addr learned my addr 172.21.15.17:0/880063814 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.693+0000 7f468123f640 1 --2- 172.21.15.17:0/880063814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c1016b0 0x7f467c0fef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.694+0000 7f4681a40640 1 -- 172.21.15.17:0/880063814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c1016b0 msgr2=0x7f467c0fef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.694+0000 7f4681a40640 1 --2- 172.21.15.17:0/880063814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c1016b0 0x7f467c0fef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.694+0000 7f4681a40640 1 -- 172.21.15.17:0/880063814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c009560 con 0x7f467c100d90 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.694+0000 7f4681a40640 1 --2- 172.21.15.17:0/880063814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c100d90 0x7f467c0fe9f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f467800d8d0 tx=0x7f467800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.694+0000 7f4672ffd640 1 -- 172.21.15.17:0/880063814 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4678009c00 con 0x7f467c100d90 2024-08-19T01:11:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.694+0000 7f4672ffd640 1 -- 172.21.15.17:0/880063814 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4678009d60 con 0x7f467c100d90 2024-08-19T01:11:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.694+0000 7f4683ca4640 1 -- 172.21.15.17:0/880063814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c1a1ce0 con 0x7f467c100d90 2024-08-19T01:11:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.694+0000 7f4672ffd640 1 -- 172.21.15.17:0/880063814 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46780049d0 con 0x7f467c100d90 2024-08-19T01:11:39.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.694+0000 7f4683ca4640 1 -- 172.21.15.17:0/880063814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c1a2040 con 0x7f467c100d90 2024-08-19T01:11:39.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.695+0000 7f4683ca4640 1 -- 172.21.15.17:0/880063814 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c068c70 con 0x7f467c100d90 2024-08-19T01:11:39.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.695+0000 7f4672ffd640 1 -- 172.21.15.17:0/880063814 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4678004c90 con 0x7f467c100d90 2024-08-19T01:11:39.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.696+0000 7f4672ffd640 1 --2- 172.21.15.17:0/880063814 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466806e170 0x7f4668070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:39.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.696+0000 7f4672ffd640 1 -- 172.21.15.17:0/880063814 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f467808ded0 con 0x7f467c100d90 2024-08-19T01:11:39.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.696+0000 7f468123f640 1 --2- 172.21.15.17:0/880063814 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466806e170 0x7f4668070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:39.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.696+0000 7f468123f640 1 --2- 172.21.15.17:0/880063814 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466806e170 0x7f4668070630 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f466c031440 tx=0x7f466c005b70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:39.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.700+0000 7f4672ffd640 1 -- 172.21.15.17:0/880063814 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f46780571b0 con 0x7f467c100d90 2024-08-19T01:11:39.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.893+0000 7f4683ca4640 1 -- 172.21.15.17:0/880063814 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f467c0ff7a0 con 0x7f466806e170 2024-08-19T01:11:39.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.894+0000 7f4672ffd640 1 -- 172.21.15.17:0/880063814 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f467c0ff7a0 con 0x7f466806e170 2024-08-19T01:11:39.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.896+0000 7f4683ca4640 1 -- 172.21.15.17:0/880063814 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466806e170 msgr2=0x7f4668070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:39.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.896+0000 7f4683ca4640 1 --2- 172.21.15.17:0/880063814 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466806e170 0x7f4668070630 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f466c031440 tx=0x7f466c005b70 comp rx=0 tx=0).stop 2024-08-19T01:11:39.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.896+0000 7f4683ca4640 1 -- 172.21.15.17:0/880063814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c100d90 msgr2=0x7f467c0fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:39.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.896+0000 7f4683ca4640 1 --2- 172.21.15.17:0/880063814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c100d90 0x7f467c0fe9f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f467800d8d0 tx=0x7f467800dd90 comp rx=0 tx=0).stop 2024-08-19T01:11:39.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.896+0000 7f4683ca4640 1 -- 172.21.15.17:0/880063814 shutdown_connections 2024-08-19T01:11:39.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.896+0000 7f4683ca4640 1 --2- 172.21.15.17:0/880063814 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466806e170 0x7f4668070630 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.896+0000 7f4683ca4640 1 --2- 172.21.15.17:0/880063814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c1016b0 0x7f467c0fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.896+0000 7f4683ca4640 1 --2- 172.21.15.17:0/880063814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c100d90 0x7f467c0fe9f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.896+0000 7f4683ca4640 1 -- 172.21.15.17:0/880063814 >> 172.21.15.17:0/880063814 conn(0x7f467c0fa730 msgr2=0x7f467c101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:39.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.896+0000 7f4683ca4640 1 -- 172.21.15.17:0/880063814 shutdown_connections 2024-08-19T01:11:39.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.896+0000 7f4683ca4640 1 -- 172.21.15.17:0/880063814 wait complete. 2024-08-19T01:11:39.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.978+0000 7f7a54fcf640 1 -- 172.21.15.17:0/1552461388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a500fe410 msgr2=0x7f7a500fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:39.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.978+0000 7f7a54fcf640 1 --2- 172.21.15.17:0/1552461388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a500fe410 0x7f7a500fe7f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009880 tx=0x7f7a4002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.978+0000 7f7a54fcf640 1 -- 172.21.15.17:0/1552461388 shutdown_connections 2024-08-19T01:11:39.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.978+0000 7f7a54fcf640 1 --2- 172.21.15.17:0/1552461388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a500fedc0 0x7f7a50102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.978+0000 7f7a54fcf640 1 --2- 172.21.15.17:0/1552461388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a500fe410 0x7f7a500fe7f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.978+0000 7f7a54fcf640 1 -- 172.21.15.17:0/1552461388 >> 172.21.15.17:0/1552461388 conn(0x7f7a500f9e90 msgr2=0x7f7a500fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:39.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.978+0000 7f7a54fcf640 1 -- 172.21.15.17:0/1552461388 shutdown_connections 2024-08-19T01:11:39.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.978+0000 7f7a54fcf640 1 -- 172.21.15.17:0/1552461388 wait complete. 2024-08-19T01:11:39.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.979+0000 7f7a54fcf640 1 Processor -- start 2024-08-19T01:11:39.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.979+0000 7f7a54fcf640 1 -- start start 2024-08-19T01:11:39.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.979+0000 7f7a54fcf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a500fe410 0x7f7a5019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.979+0000 7f7a54fcf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a500fedc0 0x7f7a5019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.979+0000 7f7a54fcf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5019c3d0 con 0x7f7a500fedc0 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.979+0000 7f7a54fcf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a50195960 con 0x7f7a500fe410 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.979+0000 7f7a4dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a500fedc0 0x7f7a5019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.979+0000 7f7a4dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a500fedc0 0x7f7a5019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45994/0 (socket says 172.21.15.17:45994) 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.979+0000 7f7a4dd9b640 1 -- 172.21.15.17:0/2020800719 learned_addr learned my addr 172.21.15.17:0/2020800719 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.979+0000 7f7a4e59c640 1 --2- 172.21.15.17:0/2020800719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a500fe410 0x7f7a5019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.980+0000 7f7a4dd9b640 1 -- 172.21.15.17:0/2020800719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a500fe410 msgr2=0x7f7a5019b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.980+0000 7f7a4dd9b640 1 --2- 172.21.15.17:0/2020800719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a500fe410 0x7f7a5019b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.980+0000 7f7a4dd9b640 1 -- 172.21.15.17:0/2020800719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40009560 con 0x7f7a500fedc0 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.980+0000 7f7a4dd9b640 1 --2- 172.21.15.17:0/2020800719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a500fedc0 0x7f7a5019bdb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400db40 tx=0x7f7a4400a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:39.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.980+0000 7f7a3f7fe640 1 -- 172.21.15.17:0/2020800719 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4400ae60 con 0x7f7a500fedc0 2024-08-19T01:11:39.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.980+0000 7f7a3f7fe640 1 -- 172.21.15.17:0/2020800719 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7a440054e0 con 0x7f7a500fedc0 2024-08-19T01:11:39.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.980+0000 7f7a54fcf640 1 -- 172.21.15.17:0/2020800719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a50195c40 con 0x7f7a500fedc0 2024-08-19T01:11:39.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.980+0000 7f7a3f7fe640 1 -- 172.21.15.17:0/2020800719 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4400e710 con 0x7f7a500fedc0 2024-08-19T01:11:39.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.980+0000 7f7a54fcf640 1 -- 172.21.15.17:0/2020800719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a50196190 con 0x7f7a500fedc0 2024-08-19T01:11:39.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.981+0000 7f7a54fcf640 1 -- 172.21.15.17:0/2020800719 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a500ff8f0 con 0x7f7a500fedc0 2024-08-19T01:11:39.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.982+0000 7f7a3f7fe640 1 -- 172.21.15.17:0/2020800719 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7a440046c0 con 0x7f7a500fedc0 2024-08-19T01:11:39.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.982+0000 7f7a3f7fe640 1 --2- 172.21.15.17:0/2020800719 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7a3806e180 0x7f7a38070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:39.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.982+0000 7f7a3f7fe640 1 -- 172.21.15.17:0/2020800719 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7a4408e260 con 0x7f7a500fedc0 2024-08-19T01:11:39.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.982+0000 7f7a4e59c640 1 --2- 172.21.15.17:0/2020800719 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7a3806e180 0x7f7a38070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:39.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.983+0000 7f7a4e59c640 1 --2- 172.21.15.17:0/2020800719 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7a3806e180 0x7f7a38070640 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009230 tx=0x7f7a40005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:39.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:39.987+0000 7f7a3f7fe640 1 -- 172.21.15.17:0/2020800719 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7a440575f0 con 0x7f7a500fedc0 2024-08-19T01:11:40.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.171+0000 7f7a54fcf640 1 -- 172.21.15.17:0/2020800719 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a5010abc0 con 0x7f7a3806e180 2024-08-19T01:11:40.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.181+0000 7f7a3f7fe640 1 -- 172.21.15.17:0/2020800719 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7a5010abc0 con 0x7f7a3806e180 2024-08-19T01:11:40.183 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:11:40.183 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (12m) 6m ago 23m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:11:40.183 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (23m) 6m ago 23m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:11:40.183 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (22m) 6m ago 22m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:11:40.183 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (10m) 6m ago 23m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:11:40.183 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (10m) 6m ago 22m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:11:40.183 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (12m) 6m ago 23m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (6m) 6m ago 18m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (7m) 6m ago 18m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (18m) 6m ago 18m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (6m) 6m ago 18m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (14m) 6m ago 25m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (13m) 6m ago 22m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (11m) 6m ago 25m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (11m) 6m ago 22m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (13m) 6m ago 23m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (13m) 6m ago 22m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (10m) 6m ago 21m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (9m) 6m ago 21m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (9m) 6m ago 20m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (8m) 6m ago 20m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:11:40.184 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (8m) 6m ago 20m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:11:40.185 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (7m) 6m ago 19m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:11:40.185 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (13m) 6m ago 23m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:11:40.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.183+0000 7f7a54fcf640 1 -- 172.21.15.17:0/2020800719 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7a3806e180 msgr2=0x7f7a38070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.183+0000 7f7a54fcf640 1 --2- 172.21.15.17:0/2020800719 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7a3806e180 0x7f7a38070640 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009230 tx=0x7f7a40005a20 comp rx=0 tx=0).stop 2024-08-19T01:11:40.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.183+0000 7f7a54fcf640 1 -- 172.21.15.17:0/2020800719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a500fedc0 msgr2=0x7f7a5019bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.183+0000 7f7a54fcf640 1 --2- 172.21.15.17:0/2020800719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a500fedc0 0x7f7a5019bdb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400db40 tx=0x7f7a4400a250 comp rx=0 tx=0).stop 2024-08-19T01:11:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.183+0000 7f7a54fcf640 1 -- 172.21.15.17:0/2020800719 shutdown_connections 2024-08-19T01:11:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.183+0000 7f7a54fcf640 1 --2- 172.21.15.17:0/2020800719 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7a3806e180 0x7f7a38070640 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.183+0000 7f7a54fcf640 1 --2- 172.21.15.17:0/2020800719 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7a500fedc0 0x7f7a5019bdb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.183+0000 7f7a54fcf640 1 --2- 172.21.15.17:0/2020800719 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7a500fe410 0x7f7a5019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.183+0000 7f7a54fcf640 1 -- 172.21.15.17:0/2020800719 >> 172.21.15.17:0/2020800719 conn(0x7f7a500f9e90 msgr2=0x7f7a500fb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.183+0000 7f7a54fcf640 1 -- 172.21.15.17:0/2020800719 shutdown_connections 2024-08-19T01:11:40.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.183+0000 7f7a54fcf640 1 -- 172.21.15.17:0/2020800719 wait complete. 2024-08-19T01:11:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.265+0000 7fa003217640 1 -- 172.21.15.17:0/687094599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc104a30 msgr2=0x7f9ffc104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.265+0000 7fa003217640 1 --2- 172.21.15.17:0/687094599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc104a30 0x7f9ffc104e10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009880 tx=0x7f9fec02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.265+0000 7fa003217640 1 -- 172.21.15.17:0/687094599 shutdown_connections 2024-08-19T01:11:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.265+0000 7fa003217640 1 --2- 172.21.15.17:0/687094599 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ffc0fea30 0x7f9ffc0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.265+0000 7fa003217640 1 --2- 172.21.15.17:0/687094599 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc104a30 0x7f9ffc104e10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.265+0000 7fa003217640 1 -- 172.21.15.17:0/687094599 >> 172.21.15.17:0/687094599 conn(0x7f9ffc0fa730 msgr2=0x7f9ffc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.265+0000 7fa003217640 1 -- 172.21.15.17:0/687094599 shutdown_connections 2024-08-19T01:11:40.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.265+0000 7fa003217640 1 -- 172.21.15.17:0/687094599 wait complete. 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7fa003217640 1 Processor -- start 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7fa003217640 1 -- start start 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7fa003217640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ffc0fea30 0x7f9ffc1968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7fa003217640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc104a30 0x7f9ffc196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7fa003217640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc1973d0 con 0x7f9ffc104a30 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7fa003217640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc197540 con 0x7f9ffc0fea30 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7f9ffbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc104a30 0x7f9ffc196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7f9ffbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc104a30 0x7f9ffc196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46014/0 (socket says 172.21.15.17:46014) 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7f9ffbfff640 1 -- 172.21.15.17:0/2362783559 learned_addr learned my addr 172.21.15.17:0/2362783559 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7fa000fb3640 1 --2- 172.21.15.17:0/2362783559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ffc0fea30 0x7f9ffc1968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7f9ffbfff640 1 -- 172.21.15.17:0/2362783559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ffc0fea30 msgr2=0x7f9ffc1968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7f9ffbfff640 1 --2- 172.21.15.17:0/2362783559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ffc0fea30 0x7f9ffc1968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.266+0000 7f9ffbfff640 1 -- 172.21.15.17:0/2362783559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec009560 con 0x7f9ffc104a30 2024-08-19T01:11:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.267+0000 7f9ffbfff640 1 --2- 172.21.15.17:0/2362783559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc104a30 0x7f9ffc196e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000e970 tx=0x7f9ff000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.267+0000 7f9ff9ffb640 1 -- 172.21.15.17:0/2362783559 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff000cc90 con 0x7f9ffc104a30 2024-08-19T01:11:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.267+0000 7fa003217640 1 -- 172.21.15.17:0/2362783559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ffc19f930 con 0x7f9ffc104a30 2024-08-19T01:11:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.267+0000 7f9ff9ffb640 1 -- 172.21.15.17:0/2362783559 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ff000cdf0 con 0x7f9ffc104a30 2024-08-19T01:11:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.267+0000 7f9ff9ffb640 1 -- 172.21.15.17:0/2362783559 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff0018810 con 0x7f9ffc104a30 2024-08-19T01:11:40.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.267+0000 7fa003217640 1 -- 172.21.15.17:0/2362783559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc19fda0 con 0x7f9ffc104a30 2024-08-19T01:11:40.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.268+0000 7fa003217640 1 -- 172.21.15.17:0/2362783559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ffc100170 con 0x7f9ffc104a30 2024-08-19T01:11:40.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.269+0000 7f9ff9ffb640 1 -- 172.21.15.17:0/2362783559 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9ff0010c10 con 0x7f9ffc104a30 2024-08-19T01:11:40.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.269+0000 7f9ff9ffb640 1 --2- 172.21.15.17:0/2362783559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fe406e170 0x7f9fe4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:40.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.270+0000 7f9ff9ffb640 1 -- 172.21.15.17:0/2362783559 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9ff0014070 con 0x7f9ffc104a30 2024-08-19T01:11:40.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.270+0000 7fa000fb3640 1 --2- 172.21.15.17:0/2362783559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fe406e170 0x7f9fe4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:40.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.270+0000 7fa000fb3640 1 --2- 172.21.15.17:0/2362783559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fe406e170 0x7f9fe4070630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9fec000c00 tx=0x7f9fec005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:40.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.274+0000 7f9ff9ffb640 1 -- 172.21.15.17:0/2362783559 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9ff0053df0 con 0x7f9ffc104a30 2024-08-19T01:11:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.518+0000 7fa003217640 1 -- 172.21.15.17:0/2362783559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ffc101ce0 con 0x7f9ffc104a30 2024-08-19T01:11:40.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.518+0000 7f9ff9ffb640 1 -- 172.21.15.17:0/2362783559 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f9ff005b4d0 con 0x7f9ffc104a30 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:11:40.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:11:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:11:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:11:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:11:40.522 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:11:40.522 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:11:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.520+0000 7fa003217640 1 -- 172.21.15.17:0/2362783559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fe406e170 msgr2=0x7f9fe4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.520+0000 7fa003217640 1 --2- 172.21.15.17:0/2362783559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fe406e170 0x7f9fe4070630 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9fec000c00 tx=0x7f9fec005a20 comp rx=0 tx=0).stop 2024-08-19T01:11:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.520+0000 7fa003217640 1 -- 172.21.15.17:0/2362783559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc104a30 msgr2=0x7f9ffc196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.520+0000 7fa003217640 1 --2- 172.21.15.17:0/2362783559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc104a30 0x7f9ffc196e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000e970 tx=0x7f9ff000ee30 comp rx=0 tx=0).stop 2024-08-19T01:11:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.521+0000 7fa003217640 1 -- 172.21.15.17:0/2362783559 shutdown_connections 2024-08-19T01:11:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.521+0000 7fa003217640 1 --2- 172.21.15.17:0/2362783559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fe406e170 0x7f9fe4070630 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.521+0000 7fa003217640 1 --2- 172.21.15.17:0/2362783559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ffc104a30 0x7f9ffc196e00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.521+0000 7fa003217640 1 --2- 172.21.15.17:0/2362783559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ffc0fea30 0x7f9ffc1968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.521+0000 7fa003217640 1 -- 172.21.15.17:0/2362783559 >> 172.21.15.17:0/2362783559 conn(0x7f9ffc0fa730 msgr2=0x7f9ffc0fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.521+0000 7fa003217640 1 -- 172.21.15.17:0/2362783559 shutdown_connections 2024-08-19T01:11:40.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.521+0000 7fa003217640 1 -- 172.21.15.17:0/2362783559 wait complete. 2024-08-19T01:11:40.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.603+0000 7faccba0e640 1 -- 172.21.15.17:0/1450512923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facc40fea30 msgr2=0x7facc40fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.603+0000 7faccba0e640 1 --2- 172.21.15.17:0/1450512923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facc40fea30 0x7facc40fee90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7facb8009880 tx=0x7facb802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.603+0000 7faccba0e640 1 -- 172.21.15.17:0/1450512923 shutdown_connections 2024-08-19T01:11:40.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.603+0000 7faccba0e640 1 --2- 172.21.15.17:0/1450512923 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facc40fea30 0x7facc40fee90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.603+0000 7faccba0e640 1 --2- 172.21.15.17:0/1450512923 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facc4104a30 0x7facc4104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.603+0000 7faccba0e640 1 -- 172.21.15.17:0/1450512923 >> 172.21.15.17:0/1450512923 conn(0x7facc40fa730 msgr2=0x7facc40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:40.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.603+0000 7faccba0e640 1 -- 172.21.15.17:0/1450512923 shutdown_connections 2024-08-19T01:11:40.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.603+0000 7faccba0e640 1 -- 172.21.15.17:0/1450512923 wait complete. 2024-08-19T01:11:40.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.603+0000 7faccba0e640 1 Processor -- start 2024-08-19T01:11:40.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.603+0000 7faccba0e640 1 -- start start 2024-08-19T01:11:40.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7faccba0e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facc40fea30 0x7facc419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:40.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7faccba0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facc4104a30 0x7facc419bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:40.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7faccba0e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc419c520 con 0x7facc4104a30 2024-08-19T01:11:40.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7faccba0e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc4195ab0 con 0x7facc40fea30 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facc8fa9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facc4104a30 0x7facc419bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facc8fa9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facc4104a30 0x7facc419bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46036/0 (socket says 172.21.15.17:46036) 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facc8fa9640 1 -- 172.21.15.17:0/4290334087 learned_addr learned my addr 172.21.15.17:0/4290334087 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facc97aa640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facc40fea30 0x7facc419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facc8fa9640 1 -- 172.21.15.17:0/4290334087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facc40fea30 msgr2=0x7facc419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facc8fa9640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facc40fea30 0x7facc419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facc8fa9640 1 -- 172.21.15.17:0/4290334087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb8009560 con 0x7facc4104a30 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facc97aa640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facc40fea30 0x7facc419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facc8fa9640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facc4104a30 0x7facc419bf00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7facb802a9c0 tx=0x7facb80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facb67fc640 1 -- 172.21.15.17:0/4290334087 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb8004aa0 con 0x7facc4104a30 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facb67fc640 1 -- 172.21.15.17:0/4290334087 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7facb8004c00 con 0x7facc4104a30 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7faccba0e640 1 -- 172.21.15.17:0/4290334087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc4195d30 con 0x7facc4104a30 2024-08-19T01:11:40.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.604+0000 7facb67fc640 1 -- 172.21.15.17:0/4290334087 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7facb8003ab0 con 0x7facc4104a30 2024-08-19T01:11:40.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.605+0000 7faccba0e640 1 -- 172.21.15.17:0/4290334087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc4196220 con 0x7facc4104a30 2024-08-19T01:11:40.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.605+0000 7faccba0e640 1 -- 172.21.15.17:0/4290334087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc4100170 con 0x7facc4104a30 2024-08-19T01:11:40.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.606+0000 7facb67fc640 1 -- 172.21.15.17:0/4290334087 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7facb8003c10 con 0x7facc4104a30 2024-08-19T01:11:40.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.606+0000 7facb67fc640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facb006e170 0x7facb0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:40.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.606+0000 7facb67fc640 1 -- 172.21.15.17:0/4290334087 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7facb80af1b0 con 0x7facc4104a30 2024-08-19T01:11:40.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.607+0000 7facc97aa640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facb006e170 0x7facb0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:40.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.607+0000 7facc97aa640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facb006e170 0x7facb0070630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7facc0006fd0 tx=0x7facc0008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:40.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.611+0000 7facb67fc640 1 -- 172.21.15.17:0/4290334087 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7facb8078510 con 0x7facc4104a30 2024-08-19T01:11:40.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.824+0000 7faccba0e640 1 -- 172.21.15.17:0/4290334087 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7facc40fef10 con 0x7facc4104a30 2024-08-19T01:11:40.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.824+0000 7facb67fc640 1 -- 172.21.15.17:0/4290334087 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7facb807bbd0 con 0x7facc4104a30 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:11:40.827 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:11:40.828 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:11:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:11:40.830 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:11:40.830 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:11:40.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.826+0000 7faccba0e640 1 -- 172.21.15.17:0/4290334087 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facb006e170 msgr2=0x7facb0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.826+0000 7faccba0e640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facb006e170 0x7facb0070630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7facc0006fd0 tx=0x7facc0008040 comp rx=0 tx=0).stop 2024-08-19T01:11:40.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.826+0000 7faccba0e640 1 -- 172.21.15.17:0/4290334087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facc4104a30 msgr2=0x7facc419bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.826+0000 7faccba0e640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facc4104a30 0x7facc419bf00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7facb802a9c0 tx=0x7facb80055a0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.826+0000 7faccba0e640 1 -- 172.21.15.17:0/4290334087 shutdown_connections 2024-08-19T01:11:40.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.827+0000 7faccba0e640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7facb006e170 0x7facb0070630 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.827+0000 7faccba0e640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7facc4104a30 0x7facc419bf00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.827+0000 7faccba0e640 1 --2- 172.21.15.17:0/4290334087 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7facc40fea30 0x7facc419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.827+0000 7faccba0e640 1 -- 172.21.15.17:0/4290334087 >> 172.21.15.17:0/4290334087 conn(0x7facc40fa730 msgr2=0x7facc40fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:40.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.827+0000 7faccba0e640 1 -- 172.21.15.17:0/4290334087 shutdown_connections 2024-08-19T01:11:40.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.827+0000 7faccba0e640 1 -- 172.21.15.17:0/4290334087 wait complete. 2024-08-19T01:11:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.910+0000 7f4ae9088640 1 -- 172.21.15.17:0/1881781925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae4100750 msgr2=0x7f4ae41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.910+0000 7f4ae9088640 1 --2- 172.21.15.17:0/1881781925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae4100750 0x7f4ae41047a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009880 tx=0x7f4acc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.910+0000 7f4ae9088640 1 -- 172.21.15.17:0/1881781925 shutdown_connections 2024-08-19T01:11:40.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.910+0000 7f4ae9088640 1 --2- 172.21.15.17:0/1881781925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae4100750 0x7f4ae41047a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.910+0000 7f4ae9088640 1 --2- 172.21.15.17:0/1881781925 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae40ffda0 0x7f4ae4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.910+0000 7f4ae9088640 1 -- 172.21.15.17:0/1881781925 >> 172.21.15.17:0/1881781925 conn(0x7f4ae40fb840 msgr2=0x7f4ae40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.910+0000 7f4ae9088640 1 -- 172.21.15.17:0/1881781925 shutdown_connections 2024-08-19T01:11:40.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.910+0000 7f4ae9088640 1 -- 172.21.15.17:0/1881781925 wait complete. 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.911+0000 7f4ae9088640 1 Processor -- start 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.911+0000 7f4ae9088640 1 -- start start 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.911+0000 7f4ae9088640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae40ffda0 0x7f4ae419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.911+0000 7f4ae9088640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae4100750 0x7f4ae419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.911+0000 7f4ae9088640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae419c2f0 con 0x7f4ae4100750 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.911+0000 7f4ae9088640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4195910 con 0x7f4ae40ffda0 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.911+0000 7f4adbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae4100750 0x7f4ae419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.911+0000 7f4adbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae4100750 0x7f4ae419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46054/0 (socket says 172.21.15.17:46054) 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.911+0000 7f4adbfff640 1 -- 172.21.15.17:0/3283221921 learned_addr learned my addr 172.21.15.17:0/3283221921 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.911+0000 7f4ae2d9d640 1 --2- 172.21.15.17:0/3283221921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae40ffda0 0x7f4ae419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.912+0000 7f4adbfff640 1 -- 172.21.15.17:0/3283221921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae40ffda0 msgr2=0x7f4ae419b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:40.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.912+0000 7f4adbfff640 1 --2- 172.21.15.17:0/3283221921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae40ffda0 0x7f4ae419b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.912+0000 7f4adbfff640 1 -- 172.21.15.17:0/3283221921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc009560 con 0x7f4ae4100750 2024-08-19T01:11:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.912+0000 7f4adbfff640 1 --2- 172.21.15.17:0/3283221921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae4100750 0x7f4ae419bd60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4acc02a9c0 tx=0x7f4acc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.912+0000 7f4ae0d99640 1 -- 172.21.15.17:0/3283221921 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4acc004aa0 con 0x7f4ae4100750 2024-08-19T01:11:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.912+0000 7f4ae9088640 1 -- 172.21.15.17:0/3283221921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae4195b90 con 0x7f4ae4100750 2024-08-19T01:11:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.912+0000 7f4ae0d99640 1 -- 172.21.15.17:0/3283221921 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4acc004c00 con 0x7f4ae4100750 2024-08-19T01:11:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.912+0000 7f4ae0d99640 1 -- 172.21.15.17:0/3283221921 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4acc003a20 con 0x7f4ae4100750 2024-08-19T01:11:40.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.912+0000 7f4ae9088640 1 -- 172.21.15.17:0/3283221921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae4196080 con 0x7f4ae4100750 2024-08-19T01:11:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.913+0000 7f4ae9088640 1 -- 172.21.15.17:0/3283221921 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae4101280 con 0x7f4ae4100750 2024-08-19T01:11:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.914+0000 7f4ae0d99640 1 -- 172.21.15.17:0/3283221921 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4acc031c90 con 0x7f4ae4100750 2024-08-19T01:11:40.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.914+0000 7f4ae0d99640 1 --2- 172.21.15.17:0/3283221921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ad006e170 0x7f4ad0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:40.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.914+0000 7f4ae0d99640 1 -- 172.21.15.17:0/3283221921 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4acc0af220 con 0x7f4ae4100750 2024-08-19T01:11:40.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.914+0000 7f4ae2d9d640 1 --2- 172.21.15.17:0/3283221921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ad006e170 0x7f4ad0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:40.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.915+0000 7f4ae2d9d640 1 --2- 172.21.15.17:0/3283221921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ad006e170 0x7f4ad0070630 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400abe0 tx=0x7f4ad400a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:40.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:40.918+0000 7f4ae0d99640 1 -- 172.21.15.17:0/3283221921 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4acc078500 con 0x7f4ae4100750 2024-08-19T01:11:41.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.114+0000 7f4ae9088640 1 -- 172.21.15.17:0/3283221921 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ae4196ec0 con 0x7f4ad006e170 2024-08-19T01:11:41.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:40 smithi017 ceph-mon[99370]: pgmap v386: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:41.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:40 smithi017 ceph-mon[99370]: from='client.34764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:41.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:40 smithi017 ceph-mon[99370]: from='client.34768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:41.117 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:40 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2362783559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:11:41.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.116+0000 7f4ae0d99640 1 -- 172.21.15.17:0/3283221921 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4ae4196ec0 con 0x7f4ad006e170 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:11:41.118 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:11:41.119 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:11:41.119 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:11:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.118+0000 7f4ae9088640 1 -- 172.21.15.17:0/3283221921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ad006e170 msgr2=0x7f4ad0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.118+0000 7f4ae9088640 1 --2- 172.21.15.17:0/3283221921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ad006e170 0x7f4ad0070630 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400abe0 tx=0x7f4ad400a2d0 comp rx=0 tx=0).stop 2024-08-19T01:11:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.118+0000 7f4ae9088640 1 -- 172.21.15.17:0/3283221921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae4100750 msgr2=0x7f4ae419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.118+0000 7f4ae9088640 1 --2- 172.21.15.17:0/3283221921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae4100750 0x7f4ae419bd60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4acc02a9c0 tx=0x7f4acc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:11:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.118+0000 7f4ae9088640 1 -- 172.21.15.17:0/3283221921 shutdown_connections 2024-08-19T01:11:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.118+0000 7f4ae9088640 1 --2- 172.21.15.17:0/3283221921 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ad006e170 0x7f4ad0070630 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:41.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.118+0000 7f4ae9088640 1 --2- 172.21.15.17:0/3283221921 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ae4100750 0x7f4ae419bd60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.118+0000 7f4ae9088640 1 --2- 172.21.15.17:0/3283221921 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ae40ffda0 0x7f4ae419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.118+0000 7f4ae9088640 1 -- 172.21.15.17:0/3283221921 >> 172.21.15.17:0/3283221921 conn(0x7f4ae40fb840 msgr2=0x7f4ae40fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.118+0000 7f4ae9088640 1 -- 172.21.15.17:0/3283221921 shutdown_connections 2024-08-19T01:11:41.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.118+0000 7f4ae9088640 1 -- 172.21.15.17:0/3283221921 wait complete. 2024-08-19T01:11:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:40 smithi086 ceph-mon[71303]: pgmap v386: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:40 smithi086 ceph-mon[71303]: from='client.34764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:40 smithi086 ceph-mon[71303]: from='client.34768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:40 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2362783559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:11:41.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.201+0000 7f0d093a1640 1 -- 172.21.15.17:0/3051240232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04101400 msgr2=0x7f0d041098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:41.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.201+0000 7f0d093a1640 1 --2- 172.21.15.17:0/3051240232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04101400 0x7f0d041098f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009880 tx=0x7f0cf802a530 comp rx=0 tx=0).stop 2024-08-19T01:11:41.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.201+0000 7f0d093a1640 1 -- 172.21.15.17:0/3051240232 shutdown_connections 2024-08-19T01:11:41.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.201+0000 7f0d093a1640 1 --2- 172.21.15.17:0/3051240232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04101400 0x7f0d041098f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:41.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.201+0000 7f0d093a1640 1 --2- 172.21.15.17:0/3051240232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d04100ae0 0x7f0d04100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:41.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.201+0000 7f0d093a1640 1 -- 172.21.15.17:0/3051240232 >> 172.21.15.17:0/3051240232 conn(0x7f0d040fa4e0 msgr2=0x7f0d040fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:41.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.201+0000 7f0d093a1640 1 -- 172.21.15.17:0/3051240232 shutdown_connections 2024-08-19T01:11:41.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.201+0000 7f0d093a1640 1 -- 172.21.15.17:0/3051240232 wait complete. 2024-08-19T01:11:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.202+0000 7f0d093a1640 1 Processor -- start 2024-08-19T01:11:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.202+0000 7f0d093a1640 1 -- start start 2024-08-19T01:11:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.202+0000 7f0d093a1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04100ae0 0x7f0d0419d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.202+0000 7f0d093a1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d04101400 0x7f0d0419deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.202+0000 7f0d093a1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d041979d0 con 0x7f0d04100ae0 2024-08-19T01:11:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.202+0000 7f0d093a1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d04197b10 con 0x7f0d04101400 2024-08-19T01:11:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04100ae0 0x7f0d0419d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:41.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d03fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04100ae0 0x7f0d0419d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46074/0 (socket says 172.21.15.17:46074) 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d03fff640 1 -- 172.21.15.17:0/35075759 learned_addr learned my addr 172.21.15.17:0/35075759 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d037fe640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d04101400 0x7f0d0419deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d03fff640 1 -- 172.21.15.17:0/35075759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d04101400 msgr2=0x7f0d0419deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d03fff640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d04101400 0x7f0d0419deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d03fff640 1 -- 172.21.15.17:0/35075759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8009560 con 0x7f0d04100ae0 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d037fe640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d04101400 0x7f0d0419deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d03fff640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04100ae0 0x7f0d0419d970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400e970 tx=0x7f0cf400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d017fa640 1 -- 172.21.15.17:0/35075759 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf400cc90 con 0x7f0d04100ae0 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d093a1640 1 -- 172.21.15.17:0/35075759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d04197df0 con 0x7f0d04100ae0 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d017fa640 1 -- 172.21.15.17:0/35075759 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0cf400cdf0 con 0x7f0d04100ae0 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d017fa640 1 -- 172.21.15.17:0/35075759 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf4018810 con 0x7f0d04100ae0 2024-08-19T01:11:41.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.203+0000 7f0d093a1640 1 -- 172.21.15.17:0/35075759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d04198310 con 0x7f0d04100ae0 2024-08-19T01:11:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.204+0000 7f0d093a1640 1 -- 172.21.15.17:0/35075759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d04068d30 con 0x7f0d04100ae0 2024-08-19T01:11:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.205+0000 7f0d017fa640 1 -- 172.21.15.17:0/35075759 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0cf4010c10 con 0x7f0d04100ae0 2024-08-19T01:11:41.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.205+0000 7f0d017fa640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0cec06e170 0x7f0cec070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:11:41.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.205+0000 7f0d017fa640 1 -- 172.21.15.17:0/35075759 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0cf4014070 con 0x7f0d04100ae0 2024-08-19T01:11:41.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.205+0000 7f0d037fe640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0cec06e170 0x7f0cec070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:11:41.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.206+0000 7f0d037fe640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0cec06e170 0x7f0cec070630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8000c00 tx=0x7f0cf8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:11:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.210+0000 7f0d017fa640 1 -- 172.21.15.17:0/35075759 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0cf4053df0 con 0x7f0d04100ae0 2024-08-19T01:11:41.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.453+0000 7f0d093a1640 1 -- 172.21.15.17:0/35075759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0d0410cbb0 con 0x7f0d04100ae0 2024-08-19T01:11:41.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.453+0000 7f0d017fa640 1 -- 172.21.15.17:0/35075759 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f0cf405b4d0 con 0x7f0d04100ae0 2024-08-19T01:11:41.456 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:11:41.456 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:11:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:11:41.456 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:11:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:11:41.456 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:11:41.456 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:11:41.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.455+0000 7f0d093a1640 1 -- 172.21.15.17:0/35075759 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0cec06e170 msgr2=0x7f0cec070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:41.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.455+0000 7f0d093a1640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0cec06e170 0x7f0cec070630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8000c00 tx=0x7f0cf8005a20 comp rx=0 tx=0).stop 2024-08-19T01:11:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.455+0000 7f0d093a1640 1 -- 172.21.15.17:0/35075759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04100ae0 msgr2=0x7f0d0419d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:11:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.455+0000 7f0d093a1640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04100ae0 0x7f0d0419d970 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400e970 tx=0x7f0cf400ee30 comp rx=0 tx=0).stop 2024-08-19T01:11:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.456+0000 7f0d093a1640 1 -- 172.21.15.17:0/35075759 shutdown_connections 2024-08-19T01:11:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.456+0000 7f0d093a1640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0cec06e170 0x7f0cec070630 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.456+0000 7f0d093a1640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0d04101400 0x7f0d0419deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.456+0000 7f0d093a1640 1 --2- 172.21.15.17:0/35075759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0d04100ae0 0x7f0d0419d970 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:11:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.456+0000 7f0d093a1640 1 -- 172.21.15.17:0/35075759 >> 172.21.15.17:0/35075759 conn(0x7f0d040fa4e0 msgr2=0x7f0d04109440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:11:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.456+0000 7f0d093a1640 1 -- 172.21.15.17:0/35075759 shutdown_connections 2024-08-19T01:11:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:11:41.456+0000 7f0d093a1640 1 -- 172.21.15.17:0/35075759 wait complete. 2024-08-19T01:11:42.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:41 smithi017 ceph-mon[99370]: from='client.34772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:42.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:41 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4290334087' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:11:42.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:41 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/35075759' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:11:42.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:41 smithi086 ceph-mon[71303]: from='client.34772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:42.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:41 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4290334087' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:11:42.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:41 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/35075759' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:11:43.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:42 smithi017 ceph-mon[99370]: pgmap v387: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:43.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:42 smithi017 ceph-mon[99370]: from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:42 smithi086 ceph-mon[71303]: pgmap v387: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:42 smithi086 ceph-mon[71303]: from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:11:45.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:44 smithi017 ceph-mon[99370]: pgmap v388: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:44 smithi086 ceph-mon[71303]: pgmap v388: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:46 smithi017 ceph-mon[99370]: pgmap v389: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:46 smithi086 ceph-mon[71303]: pgmap v389: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:48 smithi017 ceph-mon[99370]: pgmap v390: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:11:49.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:48 smithi086 ceph-mon[71303]: pgmap v390: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:11:51.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:50 smithi017 ceph-mon[99370]: pgmap v391: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:51.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:50 smithi086 ceph-mon[71303]: pgmap v391: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:53.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:52 smithi017 ceph-mon[99370]: pgmap v392: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:53.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:52 smithi086 ceph-mon[71303]: pgmap v392: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:55.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:54 smithi017 ceph-mon[99370]: pgmap v393: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:54 smithi086 ceph-mon[71303]: pgmap v393: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:57.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:56 smithi017 ceph-mon[99370]: pgmap v394: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:57.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:56 smithi086 ceph-mon[71303]: pgmap v394: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:59.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:11:58 smithi017 ceph-mon[99370]: pgmap v395: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:11:59.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:11:58 smithi086 ceph-mon[71303]: pgmap v395: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:01.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:00 smithi017 ceph-mon[99370]: pgmap v396: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:01.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:00 smithi086 ceph-mon[71303]: pgmap v396: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:03.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:02 smithi017 ceph-mon[99370]: pgmap v397: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:02 smithi086 ceph-mon[71303]: pgmap v397: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:12:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:12:05.146 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:04 smithi017 ceph-mon[99370]: pgmap v398: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:04 smithi086 ceph-mon[71303]: pgmap v398: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:06 smithi086 ceph-mon[71303]: pgmap v399: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:06 smithi017 ceph-mon[99370]: pgmap v399: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:08 smithi017 ceph-mon[99370]: pgmap v400: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:08 smithi086 ceph-mon[71303]: pgmap v400: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:11.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:10 smithi017 ceph-mon[99370]: pgmap v401: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:10 smithi086 ceph-mon[71303]: pgmap v401: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:11.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.551+0000 7f29f9ad9640 1 -- 172.21.15.17:0/200004661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f4100cb0 msgr2=0x7f29f4101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:11.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.551+0000 7f29f9ad9640 1 --2- 172.21.15.17:0/200004661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f4100cb0 0x7f29f4101090 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009880 tx=0x7f29e402a530 comp rx=0 tx=0).stop 2024-08-19T01:12:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.551+0000 7f29f9ad9640 1 -- 172.21.15.17:0/200004661 shutdown_connections 2024-08-19T01:12:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.551+0000 7f29f9ad9640 1 --2- 172.21.15.17:0/200004661 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f41015d0 0x7f29f4109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.551+0000 7f29f9ad9640 1 --2- 172.21.15.17:0/200004661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f4100cb0 0x7f29f4101090 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.551+0000 7f29f9ad9640 1 -- 172.21.15.17:0/200004661 >> 172.21.15.17:0/200004661 conn(0x7f29f40758a0 msgr2=0x7f29f40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.551+0000 7f29f9ad9640 1 -- 172.21.15.17:0/200004661 shutdown_connections 2024-08-19T01:12:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.551+0000 7f29f9ad9640 1 -- 172.21.15.17:0/200004661 wait complete. 2024-08-19T01:12:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.551+0000 7f29f9ad9640 1 Processor -- start 2024-08-19T01:12:11.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.551+0000 7f29f9ad9640 1 -- start start 2024-08-19T01:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.552+0000 7f29f9ad9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f4100cb0 0x7f29f419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.552+0000 7f29f9ad9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f41015d0 0x7f29f419bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.552+0000 7f29f9ad9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f419c410 con 0x7f29f41015d0 2024-08-19T01:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.552+0000 7f29f9ad9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f41959a0 con 0x7f29f4100cb0 2024-08-19T01:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.552+0000 7f29eaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f41015d0 0x7f29f419bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:11.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.552+0000 7f29eaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f41015d0 0x7f29f419bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41448/0 (socket says 172.21.15.17:41448) 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.552+0000 7f29eaffd640 1 -- 172.21.15.17:0/3832299117 learned_addr learned my addr 172.21.15.17:0/3832299117 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.552+0000 7f29f37fe640 1 --2- 172.21.15.17:0/3832299117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f4100cb0 0x7f29f419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.552+0000 7f29eaffd640 1 -- 172.21.15.17:0/3832299117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f4100cb0 msgr2=0x7f29f419b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.552+0000 7f29eaffd640 1 --2- 172.21.15.17:0/3832299117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f4100cb0 0x7f29f419b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.552+0000 7f29eaffd640 1 -- 172.21.15.17:0/3832299117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009560 con 0x7f29f41015d0 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.553+0000 7f29eaffd640 1 --2- 172.21.15.17:0/3832299117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f41015d0 0x7f29f419bdf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00d6c0 tx=0x7f29dc00db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.553+0000 7f29f17fa640 1 -- 172.21.15.17:0/3832299117 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29dc0099f0 con 0x7f29f41015d0 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.553+0000 7f29f17fa640 1 -- 172.21.15.17:0/3832299117 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29dc009b50 con 0x7f29f41015d0 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.553+0000 7f29f9ad9640 1 -- 172.21.15.17:0/3832299117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f4195c80 con 0x7f29f41015d0 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.553+0000 7f29f17fa640 1 -- 172.21.15.17:0/3832299117 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29dc00f6f0 con 0x7f29f41015d0 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.553+0000 7f29f9ad9640 1 -- 172.21.15.17:0/3832299117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f41961d0 con 0x7f29f41015d0 2024-08-19T01:12:11.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.554+0000 7f29f9ad9640 1 -- 172.21.15.17:0/3832299117 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f4068510 con 0x7f29f41015d0 2024-08-19T01:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.555+0000 7f29f17fa640 1 -- 172.21.15.17:0/3832299117 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f29dc009cc0 con 0x7f29f41015d0 2024-08-19T01:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.555+0000 7f29f17fa640 1 --2- 172.21.15.17:0/3832299117 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29e006e180 0x7f29e0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:11.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.555+0000 7f29f17fa640 1 -- 172.21.15.17:0/3832299117 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f29dc08ddc0 con 0x7f29f41015d0 2024-08-19T01:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.555+0000 7f29f37fe640 1 --2- 172.21.15.17:0/3832299117 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29e006e180 0x7f29e0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:11.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.556+0000 7f29f37fe640 1 --2- 172.21.15.17:0/3832299117 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29e006e180 0x7f29e0070640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009230 tx=0x7f29e4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:11.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.561+0000 7f29f17fa640 1 -- 172.21.15.17:0/3832299117 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f29dc057150 con 0x7f29f41015d0 2024-08-19T01:12:11.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.752+0000 7f29f9ad9640 1 -- 172.21.15.17:0/3832299117 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29f410cd80 con 0x7f29e006e180 2024-08-19T01:12:11.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.753+0000 7f29f17fa640 1 -- 172.21.15.17:0/3832299117 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f29f410cd80 con 0x7f29e006e180 2024-08-19T01:12:11.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.755+0000 7f29f9ad9640 1 -- 172.21.15.17:0/3832299117 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29e006e180 msgr2=0x7f29e0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:11.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.755+0000 7f29f9ad9640 1 --2- 172.21.15.17:0/3832299117 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29e006e180 0x7f29e0070640 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009230 tx=0x7f29e4005a20 comp rx=0 tx=0).stop 2024-08-19T01:12:11.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.755+0000 7f29f9ad9640 1 -- 172.21.15.17:0/3832299117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f41015d0 msgr2=0x7f29f419bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:11.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.755+0000 7f29f9ad9640 1 --2- 172.21.15.17:0/3832299117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f41015d0 0x7f29f419bdf0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f29dc00d6c0 tx=0x7f29dc00db80 comp rx=0 tx=0).stop 2024-08-19T01:12:11.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.755+0000 7f29f9ad9640 1 -- 172.21.15.17:0/3832299117 shutdown_connections 2024-08-19T01:12:11.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.755+0000 7f29f9ad9640 1 --2- 172.21.15.17:0/3832299117 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29e006e180 0x7f29e0070640 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:11.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.755+0000 7f29f9ad9640 1 --2- 172.21.15.17:0/3832299117 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f41015d0 0x7f29f419bdf0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:11.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.755+0000 7f29f9ad9640 1 --2- 172.21.15.17:0/3832299117 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f4100cb0 0x7f29f419b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:11.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.755+0000 7f29f9ad9640 1 -- 172.21.15.17:0/3832299117 >> 172.21.15.17:0/3832299117 conn(0x7f29f40758a0 msgr2=0x7f29f4101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:11.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.755+0000 7f29f9ad9640 1 -- 172.21.15.17:0/3832299117 shutdown_connections 2024-08-19T01:12:11.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.755+0000 7f29f9ad9640 1 -- 172.21.15.17:0/3832299117 wait complete. 2024-08-19T01:12:11.766 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:12:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.838+0000 7fac9c682640 1 -- 172.21.15.17:0/337641329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100c60 msgr2=0x7fac94101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.838+0000 7fac9c682640 1 --2- 172.21.15.17:0/337641329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100c60 0x7fac94101040 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fac840098b0 tx=0x7fac8402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:12:11.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.838+0000 7fac9c682640 1 -- 172.21.15.17:0/337641329 shutdown_connections 2024-08-19T01:12:11.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.838+0000 7fac9c682640 1 --2- 172.21.15.17:0/337641329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94101610 0x7fac94109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:11.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.838+0000 7fac9c682640 1 --2- 172.21.15.17:0/337641329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100c60 0x7fac94101040 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:11.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.838+0000 7fac9c682640 1 -- 172.21.15.17:0/337641329 >> 172.21.15.17:0/337641329 conn(0x7fac940fa730 msgr2=0x7fac940fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:11.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.839+0000 7fac9c682640 1 -- 172.21.15.17:0/337641329 shutdown_connections 2024-08-19T01:12:11.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.839+0000 7fac9c682640 1 -- 172.21.15.17:0/337641329 wait complete. 2024-08-19T01:12:11.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.839+0000 7fac9c682640 1 Processor -- start 2024-08-19T01:12:11.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.839+0000 7fac9c682640 1 -- start start 2024-08-19T01:12:11.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.839+0000 7fac9c682640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100c60 0x7fac94197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:11.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.839+0000 7fac9c682640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94101610 0x7fac94198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:11.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.839+0000 7fac9c682640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac94198ad0 con 0x7fac94100c60 2024-08-19T01:12:11.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.839+0000 7fac9c682640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9419c840 con 0x7fac94101610 2024-08-19T01:12:11.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.840+0000 7fac9a41e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100c60 0x7fac94197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:11.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.840+0000 7fac9a41e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100c60 0x7fac94197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41476/0 (socket says 172.21.15.17:41476) 2024-08-19T01:12:11.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.840+0000 7fac9a41e640 1 -- 172.21.15.17:0/1351520982 learned_addr learned my addr 172.21.15.17:0/1351520982 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:11.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.840+0000 7fac99c1d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94101610 0x7fac94198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:11.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.840+0000 7fac9a41e640 1 -- 172.21.15.17:0/1351520982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94101610 msgr2=0x7fac94198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:11.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.840+0000 7fac9a41e640 1 --2- 172.21.15.17:0/1351520982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94101610 0x7fac94198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:11.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.840+0000 7fac9a41e640 1 -- 172.21.15.17:0/1351520982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac84009560 con 0x7fac94100c60 2024-08-19T01:12:11.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.840+0000 7fac99c1d640 1 --2- 172.21.15.17:0/1351520982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94101610 0x7fac94198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T01:12:11.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.840+0000 7fac9a41e640 1 --2- 172.21.15.17:0/1351520982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100c60 0x7fac94197f00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fac84006010 tx=0x7fac840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:11.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.841+0000 7fac8b7fe640 1 -- 172.21.15.17:0/1351520982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac84004aa0 con 0x7fac94100c60 2024-08-19T01:12:11.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.841+0000 7fac8b7fe640 1 -- 172.21.15.17:0/1351520982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac84004c00 con 0x7fac94100c60 2024-08-19T01:12:11.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.841+0000 7fac9c682640 1 -- 172.21.15.17:0/1351520982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9419cac0 con 0x7fac94100c60 2024-08-19T01:12:11.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.842+0000 7fac8b7fe640 1 -- 172.21.15.17:0/1351520982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac84003940 con 0x7fac94100c60 2024-08-19T01:12:11.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.842+0000 7fac9c682640 1 -- 172.21.15.17:0/1351520982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9419cfb0 con 0x7fac94100c60 2024-08-19T01:12:11.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.843+0000 7fac8b7fe640 1 -- 172.21.15.17:0/1351520982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fac84003bb0 con 0x7fac94100c60 2024-08-19T01:12:11.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.843+0000 7fac9c682640 1 -- 172.21.15.17:0/1351520982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac94068d30 con 0x7fac94100c60 2024-08-19T01:12:11.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.844+0000 7fac8b7fe640 1 --2- 172.21.15.17:0/1351520982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac8006e170 0x7fac80070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:11.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.844+0000 7fac8b7fe640 1 -- 172.21.15.17:0/1351520982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fac840af210 con 0x7fac94100c60 2024-08-19T01:12:11.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.844+0000 7fac99c1d640 1 --2- 172.21.15.17:0/1351520982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac8006e170 0x7fac80070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:11.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.844+0000 7fac99c1d640 1 --2- 172.21.15.17:0/1351520982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac8006e170 0x7fac80070630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac941994b0 tx=0x7fac90009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:11.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:11.848+0000 7fac8b7fe640 1 -- 172.21.15.17:0/1351520982 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fac84078570 con 0x7fac94100c60 2024-08-19T01:12:12.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.040+0000 7fac9c682640 1 -- 172.21.15.17:0/1351520982 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac94199260 con 0x7fac8006e170 2024-08-19T01:12:12.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.041+0000 7fac8b7fe640 1 -- 172.21.15.17:0/1351520982 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fac94199260 con 0x7fac8006e170 2024-08-19T01:12:12.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.043+0000 7fac9c682640 1 -- 172.21.15.17:0/1351520982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac8006e170 msgr2=0x7fac80070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.043+0000 7fac9c682640 1 --2- 172.21.15.17:0/1351520982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac8006e170 0x7fac80070630 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac941994b0 tx=0x7fac90009110 comp rx=0 tx=0).stop 2024-08-19T01:12:12.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.043+0000 7fac9c682640 1 -- 172.21.15.17:0/1351520982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100c60 msgr2=0x7fac94197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.043+0000 7fac9c682640 1 --2- 172.21.15.17:0/1351520982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100c60 0x7fac94197f00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fac84006010 tx=0x7fac840055a0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.043+0000 7fac9c682640 1 -- 172.21.15.17:0/1351520982 shutdown_connections 2024-08-19T01:12:12.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.043+0000 7fac9c682640 1 --2- 172.21.15.17:0/1351520982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac8006e170 0x7fac80070630 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.043+0000 7fac9c682640 1 --2- 172.21.15.17:0/1351520982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac94101610 0x7fac94198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.043+0000 7fac9c682640 1 --2- 172.21.15.17:0/1351520982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100c60 0x7fac94197f00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.043+0000 7fac9c682640 1 -- 172.21.15.17:0/1351520982 >> 172.21.15.17:0/1351520982 conn(0x7fac940fa730 msgr2=0x7fac940fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:12.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.043+0000 7fac9c682640 1 -- 172.21.15.17:0/1351520982 shutdown_connections 2024-08-19T01:12:12.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.043+0000 7fac9c682640 1 -- 172.21.15.17:0/1351520982 wait complete. 2024-08-19T01:12:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.125+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/154390140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd49c105bf0 msgr2=0x7fd49c105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.125+0000 7fd4a2a3e640 1 --2- 172.21.15.17:0/154390140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd49c105bf0 0x7fd49c105fd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009880 tx=0x7fd48c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.125+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/154390140 shutdown_connections 2024-08-19T01:12:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.125+0000 7fd4a2a3e640 1 --2- 172.21.15.17:0/154390140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c0ffb40 0x7fd49c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.125+0000 7fd4a2a3e640 1 --2- 172.21.15.17:0/154390140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd49c105bf0 0x7fd49c105fd0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.125+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/154390140 >> 172.21.15.17:0/154390140 conn(0x7fd49c0fb860 msgr2=0x7fd49c0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.125+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/154390140 shutdown_connections 2024-08-19T01:12:12.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.125+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/154390140 wait complete. 2024-08-19T01:12:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.126+0000 7fd4a2a3e640 1 Processor -- start 2024-08-19T01:12:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.126+0000 7fd4a2a3e640 1 -- start start 2024-08-19T01:12:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.126+0000 7fd4a2a3e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd49c0ffb40 0x7fd49c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.126+0000 7fd4a2a3e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c105bf0 0x7fd49c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.126+0000 7fd4a2a3e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c073230 con 0x7fd49c0ffb40 2024-08-19T01:12:12.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.126+0000 7fd4a2a3e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49c0733a0 con 0x7fd49c105bf0 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.126+0000 7fd49bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd49c0ffb40 0x7fd49c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.126+0000 7fd49bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd49c0ffb40 0x7fd49c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41506/0 (socket says 172.21.15.17:41506) 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.126+0000 7fd49bfff640 1 -- 172.21.15.17:0/4176435554 learned_addr learned my addr 172.21.15.17:0/4176435554 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.126+0000 7fd49b7fe640 1 --2- 172.21.15.17:0/4176435554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c105bf0 0x7fd49c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.127+0000 7fd49bfff640 1 -- 172.21.15.17:0/4176435554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c105bf0 msgr2=0x7fd49c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.127+0000 7fd49bfff640 1 --2- 172.21.15.17:0/4176435554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c105bf0 0x7fd49c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.127+0000 7fd49bfff640 1 -- 172.21.15.17:0/4176435554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c009560 con 0x7fd49c0ffb40 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.127+0000 7fd49bfff640 1 --2- 172.21.15.17:0/4176435554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd49c0ffb40 0x7fd49c0727b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd48c02a9c0 tx=0x7fd48c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.127+0000 7fd4997fa640 1 -- 172.21.15.17:0/4176435554 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd48c004aa0 con 0x7fd49c0ffb40 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.127+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/4176435554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49c073620 con 0x7fd49c0ffb40 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.127+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/4176435554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49c1a1f30 con 0x7fd49c0ffb40 2024-08-19T01:12:12.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.127+0000 7fd4997fa640 1 -- 172.21.15.17:0/4176435554 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd48c004c00 con 0x7fd49c0ffb40 2024-08-19T01:12:12.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.127+0000 7fd4997fa640 1 -- 172.21.15.17:0/4176435554 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd48c003980 con 0x7fd49c0ffb40 2024-08-19T01:12:12.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.129+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/4176435554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd488005250 con 0x7fd49c0ffb40 2024-08-19T01:12:12.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.129+0000 7fd4997fa640 1 -- 172.21.15.17:0/4176435554 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd48c003be0 con 0x7fd49c0ffb40 2024-08-19T01:12:12.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.129+0000 7fd4997fa640 1 --2- 172.21.15.17:0/4176435554 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd48406e170 0x7fd484070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:12.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.129+0000 7fd4997fa640 1 -- 172.21.15.17:0/4176435554 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd48c0aedd0 con 0x7fd49c0ffb40 2024-08-19T01:12:12.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.129+0000 7fd49b7fe640 1 --2- 172.21.15.17:0/4176435554 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd48406e170 0x7fd484070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:12.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.130+0000 7fd49b7fe640 1 --2- 172.21.15.17:0/4176435554 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd48406e170 0x7fd484070630 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd49c073f30 tx=0x7fd49000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:12.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.134+0000 7fd4997fa640 1 -- 172.21.15.17:0/4176435554 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd48c0781e0 con 0x7fd49c0ffb40 2024-08-19T01:12:12.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.317+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/4176435554 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd488000bc0 con 0x7fd48406e170 2024-08-19T01:12:12.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.327+0000 7fd4997fa640 1 -- 172.21.15.17:0/4176435554 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd488000bc0 con 0x7fd48406e170 2024-08-19T01:12:12.329 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:12:12.329 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (13m) 7m ago 24m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:12:12.329 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (24m) 7m ago 24m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:12:12.329 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (23m) 7m ago 23m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:12:12.329 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (11m) 7m ago 24m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:12:12.329 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (11m) 7m ago 23m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:12:12.329 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (13m) 7m ago 23m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:12:12.329 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (7m) 7m ago 18m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:12:12.329 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (7m) 7m ago 18m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:12:12.329 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (18m) 7m ago 18m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (7m) 7m ago 18m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (15m) 7m ago 25m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (14m) 7m ago 23m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (12m) 7m ago 25m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (11m) 7m ago 23m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (14m) 7m ago 24m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (14m) 7m ago 23m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (10m) 7m ago 22m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (10m) 7m ago 21m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (9m) 7m ago 21m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (9m) 7m ago 21m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (8m) 7m ago 20m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (8m) 7m ago 20m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:12:12.330 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (13m) 7m ago 23m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:12:12.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.329+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/4176435554 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd48406e170 msgr2=0x7fd484070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.329+0000 7fd4a2a3e640 1 --2- 172.21.15.17:0/4176435554 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd48406e170 0x7fd484070630 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd49c073f30 tx=0x7fd49000b390 comp rx=0 tx=0).stop 2024-08-19T01:12:12.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.329+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/4176435554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd49c0ffb40 msgr2=0x7fd49c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.329+0000 7fd4a2a3e640 1 --2- 172.21.15.17:0/4176435554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd49c0ffb40 0x7fd49c0727b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd48c02a9c0 tx=0x7fd48c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.329+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/4176435554 shutdown_connections 2024-08-19T01:12:12.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.329+0000 7fd4a2a3e640 1 --2- 172.21.15.17:0/4176435554 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd48406e170 0x7fd484070630 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.330+0000 7fd4a2a3e640 1 --2- 172.21.15.17:0/4176435554 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd49c105bf0 0x7fd49c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.330+0000 7fd4a2a3e640 1 --2- 172.21.15.17:0/4176435554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd49c0ffb40 0x7fd49c0727b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.330+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/4176435554 >> 172.21.15.17:0/4176435554 conn(0x7fd49c0fb860 msgr2=0x7fd49c0fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:12.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.330+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/4176435554 shutdown_connections 2024-08-19T01:12:12.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.330+0000 7fd4a2a3e640 1 -- 172.21.15.17:0/4176435554 wait complete. 2024-08-19T01:12:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.412+0000 7f777fe5d640 1 -- 172.21.15.17:0/2826246774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77781007d0 msgr2=0x7f7778104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.412+0000 7f777fe5d640 1 --2- 172.21.15.17:0/2826246774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77781007d0 0x7f7778104820 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f776c009880 tx=0x7f776c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.412+0000 7f777fe5d640 1 -- 172.21.15.17:0/2826246774 shutdown_connections 2024-08-19T01:12:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.412+0000 7f777fe5d640 1 --2- 172.21.15.17:0/2826246774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77781007d0 0x7f7778104820 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.412+0000 7f777fe5d640 1 --2- 172.21.15.17:0/2826246774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77780ffe20 0x7f7778100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.412+0000 7f777fe5d640 1 -- 172.21.15.17:0/2826246774 >> 172.21.15.17:0/2826246774 conn(0x7f77780fb900 msgr2=0x7f77780fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.412+0000 7f777fe5d640 1 -- 172.21.15.17:0/2826246774 shutdown_connections 2024-08-19T01:12:12.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.412+0000 7f777fe5d640 1 -- 172.21.15.17:0/2826246774 wait complete. 2024-08-19T01:12:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.413+0000 7f777fe5d640 1 Processor -- start 2024-08-19T01:12:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.413+0000 7f777fe5d640 1 -- start start 2024-08-19T01:12:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.413+0000 7f777fe5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77780ffe20 0x7f777819b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:12.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.413+0000 7f777fe5d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77781007d0 0x7f777819be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.413+0000 7f777fe5d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777819c420 con 0x7f77780ffe20 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.413+0000 7f777fe5d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77781959b0 con 0x7f77781007d0 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f777dbf9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77780ffe20 0x7f777819b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f777dbf9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77780ffe20 0x7f777819b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41538/0 (socket says 172.21.15.17:41538) 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f777dbf9640 1 -- 172.21.15.17:0/4207531884 learned_addr learned my addr 172.21.15.17:0/4207531884 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f777d3f8640 1 --2- 172.21.15.17:0/4207531884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77781007d0 0x7f777819be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f777dbf9640 1 -- 172.21.15.17:0/4207531884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77781007d0 msgr2=0x7f777819be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f777dbf9640 1 --2- 172.21.15.17:0/4207531884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77781007d0 0x7f777819be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f777dbf9640 1 -- 172.21.15.17:0/4207531884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c009560 con 0x7f77780ffe20 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f777dbf9640 1 --2- 172.21.15.17:0/4207531884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77780ffe20 0x7f777819b8c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f777000d6f0 tx=0x7f777000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f7776ffd640 1 -- 172.21.15.17:0/4207531884 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7770009a30 con 0x7f77780ffe20 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f7776ffd640 1 -- 172.21.15.17:0/4207531884 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f77700054e0 con 0x7f77780ffe20 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f777fe5d640 1 -- 172.21.15.17:0/4207531884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7778195c90 con 0x7f77780ffe20 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f7776ffd640 1 -- 172.21.15.17:0/4207531884 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7770010460 con 0x7f77780ffe20 2024-08-19T01:12:12.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.414+0000 7f777fe5d640 1 -- 172.21.15.17:0/4207531884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77781961b0 con 0x7f77780ffe20 2024-08-19T01:12:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.416+0000 7f777fe5d640 1 -- 172.21.15.17:0/4207531884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7778101300 con 0x7f77780ffe20 2024-08-19T01:12:12.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.416+0000 7f7776ffd640 1 -- 172.21.15.17:0/4207531884 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7770009b90 con 0x7f77780ffe20 2024-08-19T01:12:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.417+0000 7f7776ffd640 1 --2- 172.21.15.17:0/4207531884 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f776006e170 0x7f7760070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.417+0000 7f7776ffd640 1 -- 172.21.15.17:0/4207531884 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f777008db10 con 0x7f77780ffe20 2024-08-19T01:12:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.417+0000 7f777d3f8640 1 --2- 172.21.15.17:0/4207531884 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f776006e170 0x7f7760070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:12.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.417+0000 7f777d3f8640 1 --2- 172.21.15.17:0/4207531884 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f776006e170 0x7f7760070630 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f776c009230 tx=0x7f776c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:12.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.421+0000 7f7776ffd640 1 -- 172.21.15.17:0/4207531884 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7770056f10 con 0x7f77780ffe20 2024-08-19T01:12:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.670+0000 7f777fe5d640 1 -- 172.21.15.17:0/4207531884 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7778108190 con 0x7f77780ffe20 2024-08-19T01:12:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.670+0000 7f7776ffd640 1 -- 172.21.15.17:0/4207531884 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f7770017350 con 0x7f77780ffe20 2024-08-19T01:12:12.672 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:12:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:12:12.672 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:12:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:12:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:12:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:12:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:12:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:12:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:12:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:12:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:12:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:12:12.673 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:12:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:12:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:12:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:12:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:12:12.674 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:12:12.674 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:12:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.673+0000 7f777fe5d640 1 -- 172.21.15.17:0/4207531884 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f776006e170 msgr2=0x7f7760070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.673+0000 7f777fe5d640 1 --2- 172.21.15.17:0/4207531884 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f776006e170 0x7f7760070630 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f776c009230 tx=0x7f776c0058d0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.673+0000 7f777fe5d640 1 -- 172.21.15.17:0/4207531884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77780ffe20 msgr2=0x7f777819b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.673+0000 7f777fe5d640 1 --2- 172.21.15.17:0/4207531884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77780ffe20 0x7f777819b8c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f777000d6f0 tx=0x7f777000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.673+0000 7f777fe5d640 1 -- 172.21.15.17:0/4207531884 shutdown_connections 2024-08-19T01:12:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.673+0000 7f777fe5d640 1 --2- 172.21.15.17:0/4207531884 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f776006e170 0x7f7760070630 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.673+0000 7f777fe5d640 1 --2- 172.21.15.17:0/4207531884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f77781007d0 0x7f777819be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.673+0000 7f777fe5d640 1 --2- 172.21.15.17:0/4207531884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f77780ffe20 0x7f777819b8c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.673+0000 7f777fe5d640 1 -- 172.21.15.17:0/4207531884 >> 172.21.15.17:0/4207531884 conn(0x7f77780fb900 msgr2=0x7f77780fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:12.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.673+0000 7f777fe5d640 1 -- 172.21.15.17:0/4207531884 shutdown_connections 2024-08-19T01:12:12.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.673+0000 7f777fe5d640 1 -- 172.21.15.17:0/4207531884 wait complete. 2024-08-19T01:12:12.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.755+0000 7fa4fc94d640 1 -- 172.21.15.17:0/725453992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f80fea30 msgr2=0x7fa4f80fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.755+0000 7fa4fc94d640 1 --2- 172.21.15.17:0/725453992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f80fea30 0x7fa4f80fee90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009880 tx=0x7fa4e802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.755+0000 7fa4fc94d640 1 -- 172.21.15.17:0/725453992 shutdown_connections 2024-08-19T01:12:12.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.755+0000 7fa4fc94d640 1 --2- 172.21.15.17:0/725453992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f80fea30 0x7fa4f80fee90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.755+0000 7fa4fc94d640 1 --2- 172.21.15.17:0/725453992 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4f8104a30 0x7fa4f8104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.755+0000 7fa4fc94d640 1 -- 172.21.15.17:0/725453992 >> 172.21.15.17:0/725453992 conn(0x7fa4f80fa730 msgr2=0x7fa4f80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:12.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.755+0000 7fa4fc94d640 1 -- 172.21.15.17:0/725453992 shutdown_connections 2024-08-19T01:12:12.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.755+0000 7fa4fc94d640 1 -- 172.21.15.17:0/725453992 wait complete. 2024-08-19T01:12:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4fc94d640 1 Processor -- start 2024-08-19T01:12:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4fc94d640 1 -- start start 2024-08-19T01:12:12.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4fc94d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f80fea30 0x7fa4f819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:12.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4fc94d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4f8104a30 0x7fa4f819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:12.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4fc94d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f819c2d0 con 0x7fa4f80fea30 2024-08-19T01:12:12.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4fc94d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f81958f0 con 0x7fa4f8104a30 2024-08-19T01:12:12.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4f659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f80fea30 0x7fa4f819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:12.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4f659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f80fea30 0x7fa4f819b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41562/0 (socket says 172.21.15.17:41562) 2024-08-19T01:12:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4f659c640 1 -- 172.21.15.17:0/3355196582 learned_addr learned my addr 172.21.15.17:0/3355196582 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4f5d9b640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4f8104a30 0x7fa4f819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4f659c640 1 -- 172.21.15.17:0/3355196582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4f8104a30 msgr2=0x7fa4f819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4f659c640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4f8104a30 0x7fa4f819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4f659c640 1 -- 172.21.15.17:0/3355196582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e8009560 con 0x7fa4f80fea30 2024-08-19T01:12:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.756+0000 7fa4f5d9b640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4f8104a30 0x7fa4f819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:12:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.757+0000 7fa4f659c640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f80fea30 0x7fa4f819b800 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000c8a0 tx=0x7fa4e000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.757+0000 7fa4ef7fe640 1 -- 172.21.15.17:0/3355196582 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4e0007b80 con 0x7fa4f80fea30 2024-08-19T01:12:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.757+0000 7fa4ef7fe640 1 -- 172.21.15.17:0/3355196582 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa4e0007ce0 con 0x7fa4f80fea30 2024-08-19T01:12:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.757+0000 7fa4fc94d640 1 -- 172.21.15.17:0/3355196582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f8195bd0 con 0x7fa4f80fea30 2024-08-19T01:12:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.757+0000 7fa4ef7fe640 1 -- 172.21.15.17:0/3355196582 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4e0018810 con 0x7fa4f80fea30 2024-08-19T01:12:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.757+0000 7fa4fc94d640 1 -- 172.21.15.17:0/3355196582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f81960f0 con 0x7fa4f80fea30 2024-08-19T01:12:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.758+0000 7fa4fc94d640 1 -- 172.21.15.17:0/3355196582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f8100170 con 0x7fa4f80fea30 2024-08-19T01:12:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.758+0000 7fa4ef7fe640 1 -- 172.21.15.17:0/3355196582 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa4e0018a80 con 0x7fa4f80fea30 2024-08-19T01:12:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.759+0000 7fa4ef7fe640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4e406e170 0x7fa4e4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.759+0000 7fa4ef7fe640 1 -- 172.21.15.17:0/3355196582 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa4e008e3e0 con 0x7fa4f80fea30 2024-08-19T01:12:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.759+0000 7fa4f5d9b640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4e406e170 0x7fa4e4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.759+0000 7fa4f5d9b640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4e406e170 0x7fa4e4070630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8000c00 tx=0x7fa4e8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.763+0000 7fa4ef7fe640 1 -- 172.21.15.17:0/3355196582 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa4e0057770 con 0x7fa4f80fea30 2024-08-19T01:12:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:12 smithi017 ceph-mon[99370]: pgmap v402: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:12 smithi017 ceph-mon[99370]: from='client.34792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:12 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4207531884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:12:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.977+0000 7fa4fc94d640 1 -- 172.21.15.17:0/3355196582 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa4f8107fd0 con 0x7fa4f80fea30 2024-08-19T01:12:12.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.977+0000 7fa4ef7fe640 1 -- 172.21.15.17:0/3355196582 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7fa4e005ae30 con 0x7fa4f80fea30 2024-08-19T01:12:12.979 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:12:12.979 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:12:12.980 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:12:12.980 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:12:12.980 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:12:12.980 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:12:12.980 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:12:12.980 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:12:12.980 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:12:12.980 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:12:12.980 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:12:12.980 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:12:12.981 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:12:12.981 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:12:12.981 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:12:12.981 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:12:12.981 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:12:12.982 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:12:12.983 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:12:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:12:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.979+0000 7fa4fc94d640 1 -- 172.21.15.17:0/3355196582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4e406e170 msgr2=0x7fa4e4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.979+0000 7fa4fc94d640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4e406e170 0x7fa4e4070630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8000c00 tx=0x7fa4e8005a20 comp rx=0 tx=0).stop 2024-08-19T01:12:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.979+0000 7fa4fc94d640 1 -- 172.21.15.17:0/3355196582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f80fea30 msgr2=0x7fa4f819b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.979+0000 7fa4fc94d640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f80fea30 0x7fa4f819b800 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000c8a0 tx=0x7fa4e000cd60 comp rx=0 tx=0).stop 2024-08-19T01:12:12.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.980+0000 7fa4fc94d640 1 -- 172.21.15.17:0/3355196582 shutdown_connections 2024-08-19T01:12:12.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.980+0000 7fa4fc94d640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa4e406e170 0x7fa4e4070630 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.980+0000 7fa4fc94d640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa4f8104a30 0x7fa4f819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.980+0000 7fa4fc94d640 1 --2- 172.21.15.17:0/3355196582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa4f80fea30 0x7fa4f819b800 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:12.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.980+0000 7fa4fc94d640 1 -- 172.21.15.17:0/3355196582 >> 172.21.15.17:0/3355196582 conn(0x7fa4f80fa730 msgr2=0x7fa4f8068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:12.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.980+0000 7fa4fc94d640 1 -- 172.21.15.17:0/3355196582 shutdown_connections 2024-08-19T01:12:12.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:12.980+0000 7fa4fc94d640 1 -- 172.21.15.17:0/3355196582 wait complete. 2024-08-19T01:12:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.063+0000 7f2217c85640 1 -- 172.21.15.17:0/449414826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210104a30 msgr2=0x7f2210104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:13.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.063+0000 7f2217c85640 1 --2- 172.21.15.17:0/449414826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210104a30 0x7f2210104e10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f220c009c20 tx=0x7f220c02a970 comp rx=0 tx=0).stop 2024-08-19T01:12:13.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.063+0000 7f2217c85640 1 -- 172.21.15.17:0/449414826 shutdown_connections 2024-08-19T01:12:13.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.063+0000 7f2217c85640 1 --2- 172.21.15.17:0/449414826 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100fea30 0x7f22100fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.063+0000 7f2217c85640 1 --2- 172.21.15.17:0/449414826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210104a30 0x7f2210104e10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.063+0000 7f2217c85640 1 -- 172.21.15.17:0/449414826 >> 172.21.15.17:0/449414826 conn(0x7f22100fa730 msgr2=0x7f22100fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:13.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.063+0000 7f2217c85640 1 -- 172.21.15.17:0/449414826 shutdown_connections 2024-08-19T01:12:13.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.063+0000 7f2217c85640 1 -- 172.21.15.17:0/449414826 wait complete. 2024-08-19T01:12:13.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.064+0000 7f2217c85640 1 Processor -- start 2024-08-19T01:12:13.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.064+0000 7f2217c85640 1 -- start start 2024-08-19T01:12:13.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.064+0000 7f2217c85640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100fea30 0x7f2210196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:13.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.064+0000 7f2217c85640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210104a30 0x7f2210196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:13.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.064+0000 7f2217c85640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2210197550 con 0x7f2210104a30 2024-08-19T01:12:13.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.064+0000 7f2217c85640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22101976c0 con 0x7f22100fea30 2024-08-19T01:12:13.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.064+0000 7f2215220640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210104a30 0x7f2210196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:13.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.064+0000 7f2215220640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210104a30 0x7f2210196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41578/0 (socket says 172.21.15.17:41578) 2024-08-19T01:12:13.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.064+0000 7f2215220640 1 -- 172.21.15.17:0/2383100286 learned_addr learned my addr 172.21.15.17:0/2383100286 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:13.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.065+0000 7f2215a21640 1 --2- 172.21.15.17:0/2383100286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100fea30 0x7f2210196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:13.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.065+0000 7f2215220640 1 -- 172.21.15.17:0/2383100286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100fea30 msgr2=0x7f2210196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:13.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.065+0000 7f2215220640 1 --2- 172.21.15.17:0/2383100286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100fea30 0x7f2210196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.065+0000 7f2215220640 1 -- 172.21.15.17:0/2383100286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c009900 con 0x7f2210104a30 2024-08-19T01:12:13.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.065+0000 7f2215220640 1 --2- 172.21.15.17:0/2383100286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210104a30 0x7f2210196f80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f220000b420 tx=0x7f220000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.065+0000 7f2206ffd640 1 -- 172.21.15.17:0/2383100286 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2200011800 con 0x7f2210104a30 2024-08-19T01:12:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.065+0000 7f2217c85640 1 -- 172.21.15.17:0/2383100286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221019fab0 con 0x7f2210104a30 2024-08-19T01:12:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.065+0000 7f2206ffd640 1 -- 172.21.15.17:0/2383100286 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2200011e20 con 0x7f2210104a30 2024-08-19T01:12:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.065+0000 7f2206ffd640 1 -- 172.21.15.17:0/2383100286 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f220000f2e0 con 0x7f2210104a30 2024-08-19T01:12:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.065+0000 7f2217c85640 1 -- 172.21.15.17:0/2383100286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221019ff20 con 0x7f2210104a30 2024-08-19T01:12:13.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.066+0000 7f2217c85640 1 -- 172.21.15.17:0/2383100286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2210100170 con 0x7f2210104a30 2024-08-19T01:12:13.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.067+0000 7f2206ffd640 1 -- 172.21.15.17:0/2383100286 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2200010380 con 0x7f2210104a30 2024-08-19T01:12:13.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.067+0000 7f2206ffd640 1 --2- 172.21.15.17:0/2383100286 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f21fc06e170 0x7f21fc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:13.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.068+0000 7f2206ffd640 1 -- 172.21.15.17:0/2383100286 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f220008da60 con 0x7f2210104a30 2024-08-19T01:12:13.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.068+0000 7f2215a21640 1 --2- 172.21.15.17:0/2383100286 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f21fc06e170 0x7f21fc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:13.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.068+0000 7f2215a21640 1 --2- 172.21.15.17:0/2383100286 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f21fc06e170 0x7f21fc070630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f220c000f80 tx=0x7f220c03d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:13.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.072+0000 7f2206ffd640 1 -- 172.21.15.17:0/2383100286 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2200056d40 con 0x7f2210104a30 2024-08-19T01:12:13.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:12 smithi086 ceph-mon[71303]: pgmap v402: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:13.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:12 smithi086 ceph-mon[71303]: from='client.34792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:13.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:12 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4207531884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:12:13.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.264+0000 7f2217c85640 1 -- 172.21.15.17:0/2383100286 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2210107010 con 0x7f21fc06e170 2024-08-19T01:12:13.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.265+0000 7f2206ffd640 1 -- 172.21.15.17:0/2383100286 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2210107010 con 0x7f21fc06e170 2024-08-19T01:12:13.267 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:12:13.267 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:12:13.268 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:12:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.268+0000 7f2217c85640 1 -- 172.21.15.17:0/2383100286 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f21fc06e170 msgr2=0x7f21fc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.268+0000 7f2217c85640 1 --2- 172.21.15.17:0/2383100286 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f21fc06e170 0x7f21fc070630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f220c000f80 tx=0x7f220c03d040 comp rx=0 tx=0).stop 2024-08-19T01:12:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.268+0000 7f2217c85640 1 -- 172.21.15.17:0/2383100286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210104a30 msgr2=0x7f2210196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.268+0000 7f2217c85640 1 --2- 172.21.15.17:0/2383100286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210104a30 0x7f2210196f80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f220000b420 tx=0x7f220000b8e0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.268+0000 7f2217c85640 1 -- 172.21.15.17:0/2383100286 shutdown_connections 2024-08-19T01:12:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.268+0000 7f2217c85640 1 --2- 172.21.15.17:0/2383100286 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f21fc06e170 0x7f21fc070630 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.268+0000 7f2217c85640 1 --2- 172.21.15.17:0/2383100286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2210104a30 0x7f2210196f80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.268+0000 7f2217c85640 1 --2- 172.21.15.17:0/2383100286 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f22100fea30 0x7f2210196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.268+0000 7f2217c85640 1 -- 172.21.15.17:0/2383100286 >> 172.21.15.17:0/2383100286 conn(0x7f22100fa730 msgr2=0x7f22100fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.269+0000 7f2217c85640 1 -- 172.21.15.17:0/2383100286 shutdown_connections 2024-08-19T01:12:13.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.269+0000 7f2217c85640 1 -- 172.21.15.17:0/2383100286 wait complete. 2024-08-19T01:12:13.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.352+0000 7f36af354640 1 -- 172.21.15.17:0/784140543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8100d30 msgr2=0x7f36a8101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:13.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.352+0000 7f36af354640 1 --2- 172.21.15.17:0/784140543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8100d30 0x7f36a8101110 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3698009c20 tx=0x7f369802aa00 comp rx=0 tx=0).stop 2024-08-19T01:12:13.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.352+0000 7f36af354640 1 -- 172.21.15.17:0/784140543 shutdown_connections 2024-08-19T01:12:13.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.352+0000 7f36af354640 1 --2- 172.21.15.17:0/784140543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36a8101650 0x7f36a8109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.352+0000 7f36af354640 1 --2- 172.21.15.17:0/784140543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8100d30 0x7f36a8101110 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.352+0000 7f36af354640 1 -- 172.21.15.17:0/784140543 >> 172.21.15.17:0/784140543 conn(0x7f36a80758a0 msgr2=0x7f36a80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:13.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.352+0000 7f36af354640 1 -- 172.21.15.17:0/784140543 shutdown_connections 2024-08-19T01:12:13.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.352+0000 7f36af354640 1 -- 172.21.15.17:0/784140543 wait complete. 2024-08-19T01:12:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.352+0000 7f36af354640 1 Processor -- start 2024-08-19T01:12:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.352+0000 7f36af354640 1 -- start start 2024-08-19T01:12:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36af354640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36a8100d30 0x7f36a819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36af354640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101650 0x7f36a819bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36af354640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a819c4f0 con 0x7f36a8101650 2024-08-19T01:12:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36af354640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8195a80 con 0x7f36a8100d30 2024-08-19T01:12:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36ac8ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101650 0x7f36a819bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:13.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36ac8ef640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101650 0x7f36a819bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41594/0 (socket says 172.21.15.17:41594) 2024-08-19T01:12:13.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36ac8ef640 1 -- 172.21.15.17:0/44065855 learned_addr learned my addr 172.21.15.17:0/44065855 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:13.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36ad0f0640 1 --2- 172.21.15.17:0/44065855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36a8100d30 0x7f36a819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:13.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36ac8ef640 1 -- 172.21.15.17:0/44065855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36a8100d30 msgr2=0x7f36a819b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:13.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36ac8ef640 1 --2- 172.21.15.17:0/44065855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36a8100d30 0x7f36a819b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36ac8ef640 1 -- 172.21.15.17:0/44065855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698009900 con 0x7f36a8101650 2024-08-19T01:12:13.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36ac8ef640 1 --2- 172.21.15.17:0/44065855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101650 0x7f36a819bed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f369c00b420 tx=0x7f369c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:13.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36a67fc640 1 -- 172.21.15.17:0/44065855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f369c011800 con 0x7f36a8101650 2024-08-19T01:12:13.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36a67fc640 1 -- 172.21.15.17:0/44065855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f369c011e20 con 0x7f36a8101650 2024-08-19T01:12:13.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.353+0000 7f36af354640 1 -- 172.21.15.17:0/44065855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a8195d60 con 0x7f36a8101650 2024-08-19T01:12:13.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.354+0000 7f36a67fc640 1 -- 172.21.15.17:0/44065855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f369c00f2e0 con 0x7f36a8101650 2024-08-19T01:12:13.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.354+0000 7f36af354640 1 -- 172.21.15.17:0/44065855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a81962b0 con 0x7f36a8101650 2024-08-19T01:12:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.355+0000 7f36af354640 1 -- 172.21.15.17:0/44065855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a8068490 con 0x7f36a8101650 2024-08-19T01:12:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.355+0000 7f36a67fc640 1 -- 172.21.15.17:0/44065855 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f369c010380 con 0x7f36a8101650 2024-08-19T01:12:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.356+0000 7f36a67fc640 1 --2- 172.21.15.17:0/44065855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f369006e170 0x7f3690070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.356+0000 7f36a67fc640 1 -- 172.21.15.17:0/44065855 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f369c08daf0 con 0x7f36a8101650 2024-08-19T01:12:13.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.356+0000 7f36ad0f0640 1 --2- 172.21.15.17:0/44065855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f369006e170 0x7f3690070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:13.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.356+0000 7f36ad0f0640 1 --2- 172.21.15.17:0/44065855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f369006e170 0x7f3690070630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3698000f80 tx=0x7f369803b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:13.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.360+0000 7f36a67fc640 1 -- 172.21.15.17:0/44065855 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f369c056dd0 con 0x7f36a8101650 2024-08-19T01:12:13.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.605+0000 7f36af354640 1 -- 172.21.15.17:0/44065855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f36a8104420 con 0x7f36a8101650 2024-08-19T01:12:13.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.605+0000 7f36a67fc640 1 -- 172.21.15.17:0/44065855 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f369c05a490 con 0x7f36a8101650 2024-08-19T01:12:13.607 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:12:13.607 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:12:13.608 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:12:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:12:13.608 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:12:13.608 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:12:13.608 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:12:13.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.608+0000 7f36af354640 1 -- 172.21.15.17:0/44065855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f369006e170 msgr2=0x7f3690070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:13.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.608+0000 7f36af354640 1 --2- 172.21.15.17:0/44065855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f369006e170 0x7f3690070630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3698000f80 tx=0x7f369803b040 comp rx=0 tx=0).stop 2024-08-19T01:12:13.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.608+0000 7f36af354640 1 -- 172.21.15.17:0/44065855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101650 msgr2=0x7f36a819bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:13.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.608+0000 7f36af354640 1 --2- 172.21.15.17:0/44065855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101650 0x7f36a819bed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f369c00b420 tx=0x7f369c00b8e0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.608+0000 7f36af354640 1 -- 172.21.15.17:0/44065855 shutdown_connections 2024-08-19T01:12:13.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.608+0000 7f36af354640 1 --2- 172.21.15.17:0/44065855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f369006e170 0x7f3690070630 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.608+0000 7f36af354640 1 --2- 172.21.15.17:0/44065855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36a8101650 0x7f36a819bed0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.608+0000 7f36af354640 1 --2- 172.21.15.17:0/44065855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36a8100d30 0x7f36a819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:13.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.608+0000 7f36af354640 1 -- 172.21.15.17:0/44065855 >> 172.21.15.17:0/44065855 conn(0x7f36a80758a0 msgr2=0x7f36a8101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:13.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.608+0000 7f36af354640 1 -- 172.21.15.17:0/44065855 shutdown_connections 2024-08-19T01:12:13.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:13.608+0000 7f36af354640 1 -- 172.21.15.17:0/44065855 wait complete. 2024-08-19T01:12:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:13 smithi017 ceph-mon[99370]: from='client.34796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:13 smithi017 ceph-mon[99370]: from='client.34800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:13 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3355196582' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:12:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:13 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/44065855' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:12:14.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:13 smithi086 ceph-mon[71303]: from='client.34796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:14.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:13 smithi086 ceph-mon[71303]: from='client.34800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:14.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:13 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3355196582' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:12:14.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:13 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/44065855' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:12:15.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:14 smithi017 ceph-mon[99370]: pgmap v403: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:15.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:14 smithi017 ceph-mon[99370]: from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:15.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:14 smithi086 ceph-mon[71303]: pgmap v403: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:15.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:14 smithi086 ceph-mon[71303]: from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:17.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:16 smithi017 ceph-mon[99370]: pgmap v404: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:17.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:16 smithi086 ceph-mon[71303]: pgmap v404: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:18 smithi017 ceph-mon[99370]: pgmap v405: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:12:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:18 smithi086 ceph-mon[71303]: pgmap v405: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:12:21.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:20 smithi017 ceph-mon[99370]: pgmap v406: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:21.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:20 smithi086 ceph-mon[71303]: pgmap v406: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:23.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:22 smithi017 ceph-mon[99370]: pgmap v407: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:23.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:22 smithi086 ceph-mon[71303]: pgmap v407: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:25.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:24 smithi017 ceph-mon[99370]: pgmap v408: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:24 smithi086 ceph-mon[71303]: pgmap v408: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:27.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:26 smithi017 ceph-mon[99370]: pgmap v409: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:26 smithi086 ceph-mon[71303]: pgmap v409: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:29.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:28 smithi017 ceph-mon[99370]: pgmap v410: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:28 smithi086 ceph-mon[71303]: pgmap v410: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:30 smithi017 ceph-mon[99370]: pgmap v411: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:31.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:30 smithi086 ceph-mon[71303]: pgmap v411: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:33.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:32 smithi017 ceph-mon[99370]: pgmap v412: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:33.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:32 smithi086 ceph-mon[71303]: pgmap v412: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:12:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:12:35.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:34 smithi017 ceph-mon[99370]: pgmap v413: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:35.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:34 smithi086 ceph-mon[71303]: pgmap v413: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:36 smithi017 ceph-mon[99370]: pgmap v414: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:37.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:36 smithi086 ceph-mon[71303]: pgmap v414: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:38 smithi017 ceph-mon[99370]: pgmap v415: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:38 smithi086 ceph-mon[71303]: pgmap v415: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:40 smithi017 ceph-mon[99370]: pgmap v416: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:40 smithi086 ceph-mon[71303]: pgmap v416: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:43.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:42 smithi017 ceph-mon[99370]: pgmap v417: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:42 smithi086 ceph-mon[71303]: pgmap v417: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:43.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.703+0000 7f67eaad1640 1 -- 172.21.15.17:0/497937680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e40728e0 msgr2=0x7f67e4072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:43.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.703+0000 7f67eaad1640 1 --2- 172.21.15.17:0/497937680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e40728e0 0x7f67e4072cc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009880 tx=0x7f67d802a530 comp rx=0 tx=0).stop 2024-08-19T01:12:43.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.703+0000 7f67eaad1640 1 -- 172.21.15.17:0/497937680 shutdown_connections 2024-08-19T01:12:43.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.703+0000 7f67eaad1640 1 --2- 172.21.15.17:0/497937680 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67e4073200 0x7f67e410be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:43.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.703+0000 7f67eaad1640 1 --2- 172.21.15.17:0/497937680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e40728e0 0x7f67e4072cc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:43.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.703+0000 7f67eaad1640 1 -- 172.21.15.17:0/497937680 >> 172.21.15.17:0/497937680 conn(0x7f67e40fb840 msgr2=0x7f67e40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.703+0000 7f67eaad1640 1 -- 172.21.15.17:0/497937680 shutdown_connections 2024-08-19T01:12:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.704+0000 7f67eaad1640 1 -- 172.21.15.17:0/497937680 wait complete. 2024-08-19T01:12:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.704+0000 7f67eaad1640 1 Processor -- start 2024-08-19T01:12:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.704+0000 7f67eaad1640 1 -- start start 2024-08-19T01:12:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.704+0000 7f67eaad1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67e40728e0 0x7f67e4197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.704+0000 7f67eaad1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4073200 0x7f67e41982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.704+0000 7f67eaad1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e4198940 con 0x7f67e4073200 2024-08-19T01:12:43.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.704+0000 7f67eaad1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e419c6b0 con 0x7f67e40728e0 2024-08-19T01:12:43.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4073200 0x7f67e41982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:43.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4073200 0x7f67e41982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57680/0 (socket says 172.21.15.17:57680) 2024-08-19T01:12:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67e3fff640 1 -- 172.21.15.17:0/2968079269 learned_addr learned my addr 172.21.15.17:0/2968079269 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67e886d640 1 --2- 172.21.15.17:0/2968079269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67e40728e0 0x7f67e4197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67e3fff640 1 -- 172.21.15.17:0/2968079269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67e40728e0 msgr2=0x7f67e4197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67e3fff640 1 --2- 172.21.15.17:0/2968079269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67e40728e0 0x7f67e4197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67e3fff640 1 -- 172.21.15.17:0/2968079269 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d8009560 con 0x7f67e4073200 2024-08-19T01:12:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67e3fff640 1 --2- 172.21.15.17:0/2968079269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4073200 0x7f67e41982b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f67d000d6f0 tx=0x7f67d000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67e1ffb640 1 -- 172.21.15.17:0/2968079269 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67d0009a30 con 0x7f67e4073200 2024-08-19T01:12:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67e1ffb640 1 -- 172.21.15.17:0/2968079269 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f67d00054e0 con 0x7f67e4073200 2024-08-19T01:12:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67eaad1640 1 -- 172.21.15.17:0/2968079269 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e419c990 con 0x7f67e4073200 2024-08-19T01:12:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.705+0000 7f67e1ffb640 1 -- 172.21.15.17:0/2968079269 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67d0010460 con 0x7f67e4073200 2024-08-19T01:12:43.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.706+0000 7f67eaad1640 1 -- 172.21.15.17:0/2968079269 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e419cee0 con 0x7f67e4073200 2024-08-19T01:12:43.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.707+0000 7f67eaad1640 1 -- 172.21.15.17:0/2968079269 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e4073f90 con 0x7f67e4073200 2024-08-19T01:12:43.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.707+0000 7f67e1ffb640 1 -- 172.21.15.17:0/2968079269 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f67d0009b90 con 0x7f67e4073200 2024-08-19T01:12:43.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.708+0000 7f67e1ffb640 1 --2- 172.21.15.17:0/2968079269 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f67d406e170 0x7f67d4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:43.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.708+0000 7f67e1ffb640 1 -- 172.21.15.17:0/2968079269 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f67d008dc80 con 0x7f67e4073200 2024-08-19T01:12:43.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.708+0000 7f67e886d640 1 --2- 172.21.15.17:0/2968079269 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f67d406e170 0x7f67d4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:43.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.709+0000 7f67e886d640 1 --2- 172.21.15.17:0/2968079269 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f67d406e170 0x7f67d4070630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f67d8000c00 tx=0x7f67d8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:43.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.713+0000 7f67e1ffb640 1 -- 172.21.15.17:0/2968079269 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f67d0056fe0 con 0x7f67e4073200 2024-08-19T01:12:43.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.910+0000 7f67eaad1640 1 -- 172.21.15.17:0/2968079269 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f67e410f000 con 0x7f67d406e170 2024-08-19T01:12:43.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.911+0000 7f67e1ffb640 1 -- 172.21.15.17:0/2968079269 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f67e410f000 con 0x7f67d406e170 2024-08-19T01:12:43.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.914+0000 7f67eaad1640 1 -- 172.21.15.17:0/2968079269 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f67d406e170 msgr2=0x7f67d4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:43.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.914+0000 7f67eaad1640 1 --2- 172.21.15.17:0/2968079269 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f67d406e170 0x7f67d4070630 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f67d8000c00 tx=0x7f67d8005a20 comp rx=0 tx=0).stop 2024-08-19T01:12:43.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.914+0000 7f67eaad1640 1 -- 172.21.15.17:0/2968079269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4073200 msgr2=0x7f67e41982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:43.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.914+0000 7f67eaad1640 1 --2- 172.21.15.17:0/2968079269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4073200 0x7f67e41982b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f67d000d6f0 tx=0x7f67d000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:12:43.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.914+0000 7f67eaad1640 1 -- 172.21.15.17:0/2968079269 shutdown_connections 2024-08-19T01:12:43.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.914+0000 7f67eaad1640 1 --2- 172.21.15.17:0/2968079269 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f67d406e170 0x7f67d4070630 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:43.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.914+0000 7f67eaad1640 1 --2- 172.21.15.17:0/2968079269 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67e4073200 0x7f67e41982b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:43.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.914+0000 7f67eaad1640 1 --2- 172.21.15.17:0/2968079269 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67e40728e0 0x7f67e4197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:43.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.914+0000 7f67eaad1640 1 -- 172.21.15.17:0/2968079269 >> 172.21.15.17:0/2968079269 conn(0x7f67e40fb840 msgr2=0x7f67e4104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:43.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.914+0000 7f67eaad1640 1 -- 172.21.15.17:0/2968079269 shutdown_connections 2024-08-19T01:12:43.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.914+0000 7f67eaad1640 1 -- 172.21.15.17:0/2968079269 wait complete. 2024-08-19T01:12:43.925 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:12:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.997+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2261279681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91b80fea30 msgr2=0x7f91b80fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.997+0000 7f91bf8cb640 1 --2- 172.21.15.17:0/2261279681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91b80fea30 0x7f91b80fee90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009880 tx=0x7f91a802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:12:43.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.997+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2261279681 shutdown_connections 2024-08-19T01:12:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.997+0000 7f91bf8cb640 1 --2- 172.21.15.17:0/2261279681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91b80fea30 0x7f91b80fee90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.997+0000 7f91bf8cb640 1 --2- 172.21.15.17:0/2261279681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91b8104a30 0x7f91b8104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.997+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2261279681 >> 172.21.15.17:0/2261279681 conn(0x7f91b80fa730 msgr2=0x7f91b80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.997+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2261279681 shutdown_connections 2024-08-19T01:12:44.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.997+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2261279681 wait complete. 2024-08-19T01:12:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.998+0000 7f91bf8cb640 1 Processor -- start 2024-08-19T01:12:44.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.998+0000 7f91bf8cb640 1 -- start start 2024-08-19T01:12:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.998+0000 7f91bf8cb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91b80fea30 0x7f91b819a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.998+0000 7f91bf8cb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91b8104a30 0x7f91b819adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.998+0000 7f91bf8cb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b819b3d0 con 0x7f91b80fea30 2024-08-19T01:12:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.998+0000 7f91bf8cb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8194960 con 0x7f91b8104a30 2024-08-19T01:12:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.999+0000 7f91bd667640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91b80fea30 0x7f91b819a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.999+0000 7f91bd667640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91b80fea30 0x7f91b819a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57698/0 (socket says 172.21.15.17:57698) 2024-08-19T01:12:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.999+0000 7f91bd667640 1 -- 172.21.15.17:0/2913303052 learned_addr learned my addr 172.21.15.17:0/2913303052 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.999+0000 7f91bce66640 1 --2- 172.21.15.17:0/2913303052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91b8104a30 0x7f91b819adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.999+0000 7f91bd667640 1 -- 172.21.15.17:0/2913303052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91b8104a30 msgr2=0x7f91b819adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.999+0000 7f91bd667640 1 --2- 172.21.15.17:0/2913303052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91b8104a30 0x7f91b819adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.999+0000 7f91bd667640 1 -- 172.21.15.17:0/2913303052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009560 con 0x7f91b80fea30 2024-08-19T01:12:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.999+0000 7f91bd667640 1 --2- 172.21.15.17:0/2913303052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91b80fea30 0x7f91b819a870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f91b400b420 tx=0x7f91b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.999+0000 7f91ae7fc640 1 -- 172.21.15.17:0/2913303052 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b4011800 con 0x7f91b80fea30 2024-08-19T01:12:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.999+0000 7f91ae7fc640 1 -- 172.21.15.17:0/2913303052 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91b4011e20 con 0x7f91b80fea30 2024-08-19T01:12:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:43.999+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2913303052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b8194c40 con 0x7f91b80fea30 2024-08-19T01:12:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.000+0000 7f91ae7fc640 1 -- 172.21.15.17:0/2913303052 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b400f2e0 con 0x7f91b80fea30 2024-08-19T01:12:44.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.000+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2913303052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b8195160 con 0x7f91b80fea30 2024-08-19T01:12:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.001+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2913303052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b8100170 con 0x7f91b80fea30 2024-08-19T01:12:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.002+0000 7f91ae7fc640 1 -- 172.21.15.17:0/2913303052 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f91b4010380 con 0x7f91b80fea30 2024-08-19T01:12:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.002+0000 7f91ae7fc640 1 --2- 172.21.15.17:0/2913303052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91a406e170 0x7f91a4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.002+0000 7f91ae7fc640 1 -- 172.21.15.17:0/2913303052 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f91b408da90 con 0x7f91b80fea30 2024-08-19T01:12:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.002+0000 7f91bce66640 1 --2- 172.21.15.17:0/2913303052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91a406e170 0x7f91a4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.003+0000 7f91bce66640 1 --2- 172.21.15.17:0/2913303052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91a406e170 0x7f91a4070630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009230 tx=0x7f91a80058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:44.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.007+0000 7f91ae7fc640 1 -- 172.21.15.17:0/2913303052 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f91b4056d70 con 0x7f91b80fea30 2024-08-19T01:12:44.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.201+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2913303052 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91b810bd20 con 0x7f91a406e170 2024-08-19T01:12:44.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.203+0000 7f91ae7fc640 1 -- 172.21.15.17:0/2913303052 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f91b810bd20 con 0x7f91a406e170 2024-08-19T01:12:44.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.205+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2913303052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91a406e170 msgr2=0x7f91a4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.205+0000 7f91bf8cb640 1 --2- 172.21.15.17:0/2913303052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91a406e170 0x7f91a4070630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009230 tx=0x7f91a80058d0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.205+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2913303052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91b80fea30 msgr2=0x7f91b819a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.205+0000 7f91bf8cb640 1 --2- 172.21.15.17:0/2913303052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91b80fea30 0x7f91b819a870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f91b400b420 tx=0x7f91b400b8e0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.205+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2913303052 shutdown_connections 2024-08-19T01:12:44.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.205+0000 7f91bf8cb640 1 --2- 172.21.15.17:0/2913303052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91a406e170 0x7f91a4070630 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.205+0000 7f91bf8cb640 1 --2- 172.21.15.17:0/2913303052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91b8104a30 0x7f91b819adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.205+0000 7f91bf8cb640 1 --2- 172.21.15.17:0/2913303052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91b80fea30 0x7f91b819a870 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.205+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2913303052 >> 172.21.15.17:0/2913303052 conn(0x7f91b80fa730 msgr2=0x7f91b80fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:44.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.205+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2913303052 shutdown_connections 2024-08-19T01:12:44.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.205+0000 7f91bf8cb640 1 -- 172.21.15.17:0/2913303052 wait complete. 2024-08-19T01:12:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.287+0000 7fca5da15640 1 -- 172.21.15.17:0/3960123948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca580febe0 msgr2=0x7fca58104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.287+0000 7fca5da15640 1 --2- 172.21.15.17:0/3960123948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca580febe0 0x7fca58104720 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fca40009880 tx=0x7fca4002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.287+0000 7fca5da15640 1 -- 172.21.15.17:0/3960123948 shutdown_connections 2024-08-19T01:12:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.287+0000 7fca5da15640 1 --2- 172.21.15.17:0/3960123948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca580febe0 0x7fca58104720 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.287+0000 7fca5da15640 1 --2- 172.21.15.17:0/3960123948 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca580fe230 0x7fca580fe610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.287+0000 7fca5da15640 1 -- 172.21.15.17:0/3960123948 >> 172.21.15.17:0/3960123948 conn(0x7fca580f9e40 msgr2=0x7fca580fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:44.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.287+0000 7fca5da15640 1 -- 172.21.15.17:0/3960123948 shutdown_connections 2024-08-19T01:12:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.287+0000 7fca5da15640 1 -- 172.21.15.17:0/3960123948 wait complete. 2024-08-19T01:12:44.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.287+0000 7fca5da15640 1 Processor -- start 2024-08-19T01:12:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca5da15640 1 -- start start 2024-08-19T01:12:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca5da15640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca580fe230 0x7fca580ff1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca5da15640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca580febe0 0x7fca580ff6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca5da15640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580ffc30 con 0x7fca580fe230 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca5da15640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580ffda0 con 0x7fca580febe0 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca56ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca580fe230 0x7fca580ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca56ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca580fe230 0x7fca580ff1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57724/0 (socket says 172.21.15.17:57724) 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca56ffd640 1 -- 172.21.15.17:0/749790622 learned_addr learned my addr 172.21.15.17:0/749790622 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca567fc640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca580febe0 0x7fca580ff6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca56ffd640 1 -- 172.21.15.17:0/749790622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca580febe0 msgr2=0x7fca580ff6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca56ffd640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca580febe0 0x7fca580ff6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca56ffd640 1 -- 172.21.15.17:0/749790622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca40009560 con 0x7fca580fe230 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.288+0000 7fca567fc640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca580febe0 0x7fca580ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.289+0000 7fca56ffd640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca580fe230 0x7fca580ff1b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fca4800c8f0 tx=0x7fca4800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.289+0000 7fca5ca13640 1 -- 172.21.15.17:0/749790622 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca48007b80 con 0x7fca580fe230 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.289+0000 7fca5ca13640 1 -- 172.21.15.17:0/749790622 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fca480054e0 con 0x7fca580fe230 2024-08-19T01:12:44.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.289+0000 7fca5da15640 1 -- 172.21.15.17:0/749790622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca581a1cd0 con 0x7fca580fe230 2024-08-19T01:12:44.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.289+0000 7fca5da15640 1 -- 172.21.15.17:0/749790622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca581a2030 con 0x7fca580fe230 2024-08-19T01:12:44.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.289+0000 7fca5ca13640 1 -- 172.21.15.17:0/749790622 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca4800f450 con 0x7fca580fe230 2024-08-19T01:12:44.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.290+0000 7fca5da15640 1 -- 172.21.15.17:0/749790622 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca581012f0 con 0x7fca580fe230 2024-08-19T01:12:44.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.291+0000 7fca5ca13640 1 -- 172.21.15.17:0/749790622 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fca48004f60 con 0x7fca580fe230 2024-08-19T01:12:44.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.291+0000 7fca5ca13640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fca4406e170 0x7fca44070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.291+0000 7fca5ca13640 1 -- 172.21.15.17:0/749790622 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fca4808dff0 con 0x7fca580fe230 2024-08-19T01:12:44.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.291+0000 7fca567fc640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fca4406e170 0x7fca44070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.292+0000 7fca567fc640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fca4406e170 0x7fca44070630 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca40005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:44.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.295+0000 7fca5ca13640 1 -- 172.21.15.17:0/749790622 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fca480572d0 con 0x7fca580fe230 2024-08-19T01:12:44.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.481+0000 7fca5da15640 1 -- 172.21.15.17:0/749790622 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fca58100750 con 0x7fca4406e170 2024-08-19T01:12:44.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.491+0000 7fca5ca13640 1 -- 172.21.15.17:0/749790622 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fca58100750 con 0x7fca4406e170 2024-08-19T01:12:44.493 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:12:44.493 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (14m) 7m ago 24m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:12:44.493 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (24m) 7m ago 24m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:12:44.493 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (23m) 7m ago 23m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:12:44.493 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (11m) 7m ago 24m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:12:44.493 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (11m) 7m ago 23m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:12:44.493 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (13m) 7m ago 24m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:12:44.493 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (8m) 7m ago 19m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:12:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (8m) 7m ago 19m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:12:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (19m) 7m ago 19m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:12:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (7m) 7m ago 19m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:12:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (15m) 7m ago 26m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:12:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (14m) 7m ago 23m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:12:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (12m) 7m ago 26m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:12:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (12m) 7m ago 23m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:12:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (14m) 7m ago 24m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:12:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (14m) 7m ago 23m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:12:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (11m) 7m ago 22m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:12:44.494 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (10m) 7m ago 22m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:12:44.495 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (10m) 7m ago 21m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:12:44.495 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (9m) 7m ago 21m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:12:44.495 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (9m) 7m ago 21m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:12:44.495 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (8m) 7m ago 20m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:12:44.495 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (14m) 7m ago 24m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:12:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.493+0000 7fca5da15640 1 -- 172.21.15.17:0/749790622 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fca4406e170 msgr2=0x7fca44070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.493+0000 7fca5da15640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fca4406e170 0x7fca44070630 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca40005a20 comp rx=0 tx=0).stop 2024-08-19T01:12:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.493+0000 7fca5da15640 1 -- 172.21.15.17:0/749790622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca580fe230 msgr2=0x7fca580ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.493+0000 7fca5da15640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca580fe230 0x7fca580ff1b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fca4800c8f0 tx=0x7fca4800cdb0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.493+0000 7fca5da15640 1 -- 172.21.15.17:0/749790622 shutdown_connections 2024-08-19T01:12:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.493+0000 7fca5da15640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fca4406e170 0x7fca44070630 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.493+0000 7fca5da15640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fca580febe0 0x7fca580ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.493+0000 7fca5da15640 1 --2- 172.21.15.17:0/749790622 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca580fe230 0x7fca580ff1b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.493+0000 7fca5da15640 1 -- 172.21.15.17:0/749790622 >> 172.21.15.17:0/749790622 conn(0x7fca580f9e40 msgr2=0x7fca580fb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.494+0000 7fca5da15640 1 -- 172.21.15.17:0/749790622 shutdown_connections 2024-08-19T01:12:44.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.494+0000 7fca5da15640 1 -- 172.21.15.17:0/749790622 wait complete. 2024-08-19T01:12:44.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.574+0000 7fbbef05b640 1 -- 172.21.15.17:0/3034746211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8100750 msgr2=0x7fbbe81047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.574+0000 7fbbef05b640 1 --2- 172.21.15.17:0/3034746211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8100750 0x7fbbe81047a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009880 tx=0x7fbbdc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.575+0000 7fbbef05b640 1 -- 172.21.15.17:0/3034746211 shutdown_connections 2024-08-19T01:12:44.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.575+0000 7fbbef05b640 1 --2- 172.21.15.17:0/3034746211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8100750 0x7fbbe81047a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.575+0000 7fbbef05b640 1 --2- 172.21.15.17:0/3034746211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe80ffda0 0x7fbbe8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.575+0000 7fbbef05b640 1 -- 172.21.15.17:0/3034746211 >> 172.21.15.17:0/3034746211 conn(0x7fbbe80fb860 msgr2=0x7fbbe80fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:44.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.575+0000 7fbbef05b640 1 -- 172.21.15.17:0/3034746211 shutdown_connections 2024-08-19T01:12:44.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.575+0000 7fbbef05b640 1 -- 172.21.15.17:0/3034746211 wait complete. 2024-08-19T01:12:44.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.575+0000 7fbbef05b640 1 Processor -- start 2024-08-19T01:12:44.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbef05b640 1 -- start start 2024-08-19T01:12:44.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbef05b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe80ffda0 0x7fbbe819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbef05b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8100750 0x7fbbe819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbef05b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe819c380 con 0x7fbbe8100750 2024-08-19T01:12:44.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbef05b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe8195910 con 0x7fbbe80ffda0 2024-08-19T01:12:44.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbe7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8100750 0x7fbbe819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbe7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8100750 0x7fbbe819bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57754/0 (socket says 172.21.15.17:57754) 2024-08-19T01:12:44.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbe7fff640 1 -- 172.21.15.17:0/2119046816 learned_addr learned my addr 172.21.15.17:0/2119046816 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbecdf7640 1 --2- 172.21.15.17:0/2119046816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe80ffda0 0x7fbbe819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbe7fff640 1 -- 172.21.15.17:0/2119046816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe80ffda0 msgr2=0x7fbbe819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbe7fff640 1 --2- 172.21.15.17:0/2119046816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe80ffda0 0x7fbbe819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.576+0000 7fbbe7fff640 1 -- 172.21.15.17:0/2119046816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc009560 con 0x7fbbe8100750 2024-08-19T01:12:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.577+0000 7fbbe7fff640 1 --2- 172.21.15.17:0/2119046816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8100750 0x7fbbe819bd60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc02a9c0 tx=0x7fbbdc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.577+0000 7fbbe5ffb640 1 -- 172.21.15.17:0/2119046816 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbdc004aa0 con 0x7fbbe8100750 2024-08-19T01:12:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.577+0000 7fbbe5ffb640 1 -- 172.21.15.17:0/2119046816 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbdc004c00 con 0x7fbbe8100750 2024-08-19T01:12:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.577+0000 7fbbef05b640 1 -- 172.21.15.17:0/2119046816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe8195b90 con 0x7fbbe8100750 2024-08-19T01:12:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.577+0000 7fbbe5ffb640 1 -- 172.21.15.17:0/2119046816 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbdc003980 con 0x7fbbe8100750 2024-08-19T01:12:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.577+0000 7fbbef05b640 1 -- 172.21.15.17:0/2119046816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe8196030 con 0x7fbbe8100750 2024-08-19T01:12:44.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.578+0000 7fbbef05b640 1 -- 172.21.15.17:0/2119046816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe8101280 con 0x7fbbe8100750 2024-08-19T01:12:44.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.579+0000 7fbbe5ffb640 1 -- 172.21.15.17:0/2119046816 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbbdc003bf0 con 0x7fbbe8100750 2024-08-19T01:12:44.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.579+0000 7fbbe5ffb640 1 --2- 172.21.15.17:0/2119046816 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbd006e170 0x7fbbd0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.580+0000 7fbbe5ffb640 1 -- 172.21.15.17:0/2119046816 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fbbdc0af210 con 0x7fbbe8100750 2024-08-19T01:12:44.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.580+0000 7fbbecdf7640 1 --2- 172.21.15.17:0/2119046816 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbd006e170 0x7fbbd0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.580+0000 7fbbecdf7640 1 --2- 172.21.15.17:0/2119046816 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbd006e170 0x7fbbd0070630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8005fd0 tx=0x7fbbd80098b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:44.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.584+0000 7fbbe5ffb640 1 -- 172.21.15.17:0/2119046816 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbbdc0784f0 con 0x7fbbe8100750 2024-08-19T01:12:44.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.826+0000 7fbbef05b640 1 -- 172.21.15.17:0/2119046816 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbbe8100180 con 0x7fbbe8100750 2024-08-19T01:12:44.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.827+0000 7fbbe5ffb640 1 -- 172.21.15.17:0/2119046816 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7fbbdc07bbb0 con 0x7fbbe8100750 2024-08-19T01:12:44.829 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:12:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:12:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:12:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:12:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:12:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:12:44.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:12:44.830 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:12:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.829+0000 7fbbef05b640 1 -- 172.21.15.17:0/2119046816 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbd006e170 msgr2=0x7fbbd0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.829+0000 7fbbef05b640 1 --2- 172.21.15.17:0/2119046816 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbd006e170 0x7fbbd0070630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8005fd0 tx=0x7fbbd80098b0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.829+0000 7fbbef05b640 1 -- 172.21.15.17:0/2119046816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8100750 msgr2=0x7fbbe819bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.829+0000 7fbbef05b640 1 --2- 172.21.15.17:0/2119046816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8100750 0x7fbbe819bd60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc02a9c0 tx=0x7fbbdc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.829+0000 7fbbef05b640 1 -- 172.21.15.17:0/2119046816 shutdown_connections 2024-08-19T01:12:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.829+0000 7fbbef05b640 1 --2- 172.21.15.17:0/2119046816 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbd006e170 0x7fbbd0070630 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.829+0000 7fbbef05b640 1 --2- 172.21.15.17:0/2119046816 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbbe8100750 0x7fbbe819bd60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.829+0000 7fbbef05b640 1 --2- 172.21.15.17:0/2119046816 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbbe80ffda0 0x7fbbe819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.829+0000 7fbbef05b640 1 -- 172.21.15.17:0/2119046816 >> 172.21.15.17:0/2119046816 conn(0x7fbbe80fb860 msgr2=0x7fbbe80fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.829+0000 7fbbef05b640 1 -- 172.21.15.17:0/2119046816 shutdown_connections 2024-08-19T01:12:44.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.829+0000 7fbbef05b640 1 -- 172.21.15.17:0/2119046816 wait complete. 2024-08-19T01:12:44.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.910+0000 7fc5e14f7640 1 -- 172.21.15.17:0/1314441407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0fe9f0 msgr2=0x7fc5dc0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.910+0000 7fc5e14f7640 1 --2- 172.21.15.17:0/1314441407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0fe9f0 0x7fc5dc0fee50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009880 tx=0x7fc5d002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.910+0000 7fc5e14f7640 1 -- 172.21.15.17:0/1314441407 shutdown_connections 2024-08-19T01:12:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.910+0000 7fc5e14f7640 1 --2- 172.21.15.17:0/1314441407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0fe9f0 0x7fc5dc0fee50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.910+0000 7fc5e14f7640 1 --2- 172.21.15.17:0/1314441407 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5dc1049f0 0x7fc5dc104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.910+0000 7fc5e14f7640 1 -- 172.21.15.17:0/1314441407 >> 172.21.15.17:0/1314441407 conn(0x7fc5dc0758a0 msgr2=0x7fc5dc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.910+0000 7fc5e14f7640 1 -- 172.21.15.17:0/1314441407 shutdown_connections 2024-08-19T01:12:44.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.910+0000 7fc5e14f7640 1 -- 172.21.15.17:0/1314441407 wait complete. 2024-08-19T01:12:44.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.911+0000 7fc5e14f7640 1 Processor -- start 2024-08-19T01:12:44.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.911+0000 7fc5e14f7640 1 -- start start 2024-08-19T01:12:44.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5e14f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0fe9f0 0x7fc5dc196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5e14f7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5dc1049f0 0x7fc5dc196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5e14f7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc197490 con 0x7fc5dc0fe9f0 2024-08-19T01:12:44.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5e14f7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5dc197600 con 0x7fc5dc1049f0 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0fe9f0 0x7fc5dc196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0fe9f0 0x7fc5dc196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57762/0 (socket says 172.21.15.17:57762) 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5daffd640 1 -- 172.21.15.17:0/2763112633 learned_addr learned my addr 172.21.15.17:0/2763112633 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5da7fc640 1 --2- 172.21.15.17:0/2763112633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5dc1049f0 0x7fc5dc196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5daffd640 1 -- 172.21.15.17:0/2763112633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5dc1049f0 msgr2=0x7fc5dc196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5daffd640 1 --2- 172.21.15.17:0/2763112633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5dc1049f0 0x7fc5dc196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5daffd640 1 -- 172.21.15.17:0/2763112633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d0009560 con 0x7fc5dc0fe9f0 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5daffd640 1 --2- 172.21.15.17:0/2763112633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0fe9f0 0x7fc5dc196980 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00e970 tx=0x7fc5cc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5c3fff640 1 -- 172.21.15.17:0/2763112633 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc00cc90 con 0x7fc5dc0fe9f0 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5e14f7640 1 -- 172.21.15.17:0/2763112633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5dc19f9f0 con 0x7fc5dc0fe9f0 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5c3fff640 1 -- 172.21.15.17:0/2763112633 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5cc00cdf0 con 0x7fc5dc0fe9f0 2024-08-19T01:12:44.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.912+0000 7fc5c3fff640 1 -- 172.21.15.17:0/2763112633 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc010430 con 0x7fc5dc0fe9f0 2024-08-19T01:12:44.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.913+0000 7fc5e14f7640 1 -- 172.21.15.17:0/2763112633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5dc19fe00 con 0x7fc5dc0fe9f0 2024-08-19T01:12:44.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.914+0000 7fc5e14f7640 1 -- 172.21.15.17:0/2763112633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5dc100130 con 0x7fc5dc0fe9f0 2024-08-19T01:12:44.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.914+0000 7fc5c3fff640 1 -- 172.21.15.17:0/2763112633 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc5cc0046c0 con 0x7fc5dc0fe9f0 2024-08-19T01:12:44.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.915+0000 7fc5c3fff640 1 --2- 172.21.15.17:0/2763112633 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5c406e170 0x7fc5c4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:44.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.915+0000 7fc5c3fff640 1 -- 172.21.15.17:0/2763112633 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc5cc014070 con 0x7fc5dc0fe9f0 2024-08-19T01:12:44.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.915+0000 7fc5da7fc640 1 --2- 172.21.15.17:0/2763112633 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5c406e170 0x7fc5c4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:44.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.915+0000 7fc5da7fc640 1 --2- 172.21.15.17:0/2763112633 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5c406e170 0x7fc5c4070630 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0000c00 tx=0x7fc5d0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:44.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:44.919+0000 7fc5c3fff640 1 -- 172.21.15.17:0/2763112633 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc5cc057a60 con 0x7fc5dc0fe9f0 2024-08-19T01:12:45.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.131+0000 7fc5e14f7640 1 -- 172.21.15.17:0/2763112633 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc5dc0682c0 con 0x7fc5dc0fe9f0 2024-08-19T01:12:45.133 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:44 smithi017 ceph-mon[99370]: pgmap v418: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:45.133 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:44 smithi017 ceph-mon[99370]: from='client.34820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:45.133 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:44 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2119046816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:12:45.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.131+0000 7fc5c3fff640 1 -- 172.21.15.17:0/2763112633 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7fc5cc05b120 con 0x7fc5dc0fe9f0 2024-08-19T01:12:45.134 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:12:45.134 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:12:45.134 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:12:45.134 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:12:45.134 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:12:45.134 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:12:45.134 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:12:45.135 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:12:45.136 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:12:45.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:12:45.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:12:45.137 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:12:45.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:12:45.137 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:12:45.137 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:12:45.137 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:12:45.137 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:12:45.137 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:12:45.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.134+0000 7fc5e14f7640 1 -- 172.21.15.17:0/2763112633 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5c406e170 msgr2=0x7fc5c4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:45.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.134+0000 7fc5e14f7640 1 --2- 172.21.15.17:0/2763112633 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5c406e170 0x7fc5c4070630 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0000c00 tx=0x7fc5d0005a20 comp rx=0 tx=0).stop 2024-08-19T01:12:45.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.134+0000 7fc5e14f7640 1 -- 172.21.15.17:0/2763112633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0fe9f0 msgr2=0x7fc5dc196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:45.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.134+0000 7fc5e14f7640 1 --2- 172.21.15.17:0/2763112633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0fe9f0 0x7fc5dc196980 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc00e970 tx=0x7fc5cc00ed70 comp rx=0 tx=0).stop 2024-08-19T01:12:45.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.134+0000 7fc5e14f7640 1 -- 172.21.15.17:0/2763112633 shutdown_connections 2024-08-19T01:12:45.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.134+0000 7fc5e14f7640 1 --2- 172.21.15.17:0/2763112633 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc5c406e170 0x7fc5c4070630 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.134+0000 7fc5e14f7640 1 --2- 172.21.15.17:0/2763112633 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc5dc1049f0 0x7fc5dc196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.134+0000 7fc5e14f7640 1 --2- 172.21.15.17:0/2763112633 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc5dc0fe9f0 0x7fc5dc196980 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.134+0000 7fc5e14f7640 1 -- 172.21.15.17:0/2763112633 >> 172.21.15.17:0/2763112633 conn(0x7fc5dc0758a0 msgr2=0x7fc5dc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:45.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.134+0000 7fc5e14f7640 1 -- 172.21.15.17:0/2763112633 shutdown_connections 2024-08-19T01:12:45.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.134+0000 7fc5e14f7640 1 -- 172.21.15.17:0/2763112633 wait complete. 2024-08-19T01:12:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:44 smithi086 ceph-mon[71303]: pgmap v418: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:44 smithi086 ceph-mon[71303]: from='client.34820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:44 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2119046816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:12:45.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.217+0000 7f76f8b17640 1 -- 172.21.15.17:0/3907390874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f4104a10 msgr2=0x7f76f4104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.217+0000 7f76f8b17640 1 --2- 172.21.15.17:0/3907390874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f4104a10 0x7f76f4104df0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009880 tx=0x7f76e402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.217+0000 7f76f8b17640 1 -- 172.21.15.17:0/3907390874 shutdown_connections 2024-08-19T01:12:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.217+0000 7f76f8b17640 1 --2- 172.21.15.17:0/3907390874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f40fea10 0x7f76f40fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.217+0000 7f76f8b17640 1 --2- 172.21.15.17:0/3907390874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f4104a10 0x7f76f4104df0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.217+0000 7f76f8b17640 1 -- 172.21.15.17:0/3907390874 >> 172.21.15.17:0/3907390874 conn(0x7f76f40fa730 msgr2=0x7f76f40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.218+0000 7f76f8b17640 1 -- 172.21.15.17:0/3907390874 shutdown_connections 2024-08-19T01:12:45.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.218+0000 7f76f8b17640 1 -- 172.21.15.17:0/3907390874 wait complete. 2024-08-19T01:12:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.218+0000 7f76f8b17640 1 Processor -- start 2024-08-19T01:12:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.218+0000 7f76f8b17640 1 -- start start 2024-08-19T01:12:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.218+0000 7f76f8b17640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f40fea10 0x7f76f419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f8b17640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f4104a10 0x7f76f419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f8b17640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f419c3d0 con 0x7f76f4104a10 2024-08-19T01:12:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f8b17640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f4195960 con 0x7f76f40fea10 2024-08-19T01:12:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f4104a10 0x7f76f419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f4104a10 0x7f76f419bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57782/0 (socket says 172.21.15.17:57782) 2024-08-19T01:12:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f1d9b640 1 -- 172.21.15.17:0/4249964493 learned_addr learned my addr 172.21.15.17:0/4249964493 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:45.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f259c640 1 --2- 172.21.15.17:0/4249964493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f40fea10 0x7f76f419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f1d9b640 1 -- 172.21.15.17:0/4249964493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f40fea10 msgr2=0x7f76f419b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f1d9b640 1 --2- 172.21.15.17:0/4249964493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f40fea10 0x7f76f419b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f1d9b640 1 -- 172.21.15.17:0/4249964493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e4009560 con 0x7f76f4104a10 2024-08-19T01:12:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f1d9b640 1 --2- 172.21.15.17:0/4249964493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f4104a10 0x7f76f419bdb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f76e800e970 tx=0x7f76e800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76e37fe640 1 -- 172.21.15.17:0/4249964493 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e800cc90 con 0x7f76f4104a10 2024-08-19T01:12:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f8b17640 1 -- 172.21.15.17:0/4249964493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f4195c40 con 0x7f76f4104a10 2024-08-19T01:12:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76e37fe640 1 -- 172.21.15.17:0/4249964493 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f76e800cdf0 con 0x7f76f4104a10 2024-08-19T01:12:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76e37fe640 1 -- 172.21.15.17:0/4249964493 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76e8010430 con 0x7f76f4104a10 2024-08-19T01:12:45.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.219+0000 7f76f8b17640 1 -- 172.21.15.17:0/4249964493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f4196190 con 0x7f76f4104a10 2024-08-19T01:12:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.220+0000 7f76f8b17640 1 -- 172.21.15.17:0/4249964493 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f4100150 con 0x7f76f4104a10 2024-08-19T01:12:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.221+0000 7f76e37fe640 1 -- 172.21.15.17:0/4249964493 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f76e80046c0 con 0x7f76f4104a10 2024-08-19T01:12:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.221+0000 7f76e37fe640 1 --2- 172.21.15.17:0/4249964493 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f76dc06e170 0x7f76dc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.221+0000 7f76e37fe640 1 -- 172.21.15.17:0/4249964493 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f76e8014070 con 0x7f76f4104a10 2024-08-19T01:12:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.221+0000 7f76f259c640 1 --2- 172.21.15.17:0/4249964493 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f76dc06e170 0x7f76dc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:45.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.222+0000 7f76f259c640 1 --2- 172.21.15.17:0/4249964493 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f76dc06e170 0x7f76dc070630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f76e4000c00 tx=0x7f76e4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:45.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.226+0000 7f76e37fe640 1 -- 172.21.15.17:0/4249964493 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f76e8057a50 con 0x7f76f4104a10 2024-08-19T01:12:45.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.417+0000 7f76f8b17640 1 -- 172.21.15.17:0/4249964493 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76f410bca0 con 0x7f76dc06e170 2024-08-19T01:12:45.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.418+0000 7f76e37fe640 1 -- 172.21.15.17:0/4249964493 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f76f410bca0 con 0x7f76dc06e170 2024-08-19T01:12:45.420 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:12:45.420 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:12:45.420 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:12:45.421 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:12:45.421 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:12:45.421 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:12:45.421 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:12:45.421 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:12:45.421 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:12:45.421 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:12:45.421 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:12:45.421 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:12:45.421 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:12:45.421 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:12:45.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.420+0000 7f76f8b17640 1 -- 172.21.15.17:0/4249964493 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f76dc06e170 msgr2=0x7f76dc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.420+0000 7f76f8b17640 1 --2- 172.21.15.17:0/4249964493 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f76dc06e170 0x7f76dc070630 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f76e4000c00 tx=0x7f76e4005a20 comp rx=0 tx=0).stop 2024-08-19T01:12:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.420+0000 7f76f8b17640 1 -- 172.21.15.17:0/4249964493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f4104a10 msgr2=0x7f76f419bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.420+0000 7f76f8b17640 1 --2- 172.21.15.17:0/4249964493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f4104a10 0x7f76f419bdb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f76e800e970 tx=0x7f76e800ed70 comp rx=0 tx=0).stop 2024-08-19T01:12:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.420+0000 7f76f8b17640 1 -- 172.21.15.17:0/4249964493 shutdown_connections 2024-08-19T01:12:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.420+0000 7f76f8b17640 1 --2- 172.21.15.17:0/4249964493 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f76dc06e170 0x7f76dc070630 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.420+0000 7f76f8b17640 1 --2- 172.21.15.17:0/4249964493 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76f4104a10 0x7f76f419bdb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.420+0000 7f76f8b17640 1 --2- 172.21.15.17:0/4249964493 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76f40fea10 0x7f76f419b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.420+0000 7f76f8b17640 1 -- 172.21.15.17:0/4249964493 >> 172.21.15.17:0/4249964493 conn(0x7f76f40fa730 msgr2=0x7f76f4068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.421+0000 7f76f8b17640 1 -- 172.21.15.17:0/4249964493 shutdown_connections 2024-08-19T01:12:45.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.421+0000 7f76f8b17640 1 -- 172.21.15.17:0/4249964493 wait complete. 2024-08-19T01:12:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.503+0000 7f79df940640 1 -- 172.21.15.17:0/2148128753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d8100750 msgr2=0x7f79d81047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.503+0000 7f79df940640 1 --2- 172.21.15.17:0/2148128753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d8100750 0x7f79d81047a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009880 tx=0x7f79cc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.503+0000 7f79df940640 1 -- 172.21.15.17:0/2148128753 shutdown_connections 2024-08-19T01:12:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.503+0000 7f79df940640 1 --2- 172.21.15.17:0/2148128753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d8100750 0x7f79d81047a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.503+0000 7f79df940640 1 --2- 172.21.15.17:0/2148128753 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79d80ffda0 0x7f79d8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.503+0000 7f79df940640 1 -- 172.21.15.17:0/2148128753 >> 172.21.15.17:0/2148128753 conn(0x7f79d80fb840 msgr2=0x7f79d80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:45.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.503+0000 7f79df940640 1 -- 172.21.15.17:0/2148128753 shutdown_connections 2024-08-19T01:12:45.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.503+0000 7f79df940640 1 -- 172.21.15.17:0/2148128753 wait complete. 2024-08-19T01:12:45.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79df940640 1 Processor -- start 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79df940640 1 -- start start 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79df940640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79d80ffda0 0x7f79d819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79df940640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d8100750 0x7f79d819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79df940640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8195930 con 0x7f79d8100750 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79df940640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8195a70 con 0x7f79d80ffda0 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79dcedb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d8100750 0x7f79d819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79dcedb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d8100750 0x7f79d819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57792/0 (socket says 172.21.15.17:57792) 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79dcedb640 1 -- 172.21.15.17:0/33864334 learned_addr learned my addr 172.21.15.17:0/33864334 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79dd6dc640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79d80ffda0 0x7f79d819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79dcedb640 1 -- 172.21.15.17:0/33864334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79d80ffda0 msgr2=0x7f79d819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79dcedb640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79d80ffda0 0x7f79d819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79dcedb640 1 -- 172.21.15.17:0/33864334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc009560 con 0x7f79d8100750 2024-08-19T01:12:45.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.504+0000 7f79dd6dc640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79d80ffda0 0x7f79d819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:12:45.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.505+0000 7f79dcedb640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d8100750 0x7f79d819be10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79cc02a9c0 tx=0x7f79cc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:45.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.505+0000 7f79d67fc640 1 -- 172.21.15.17:0/33864334 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc004aa0 con 0x7f79d8100750 2024-08-19T01:12:45.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.505+0000 7f79d67fc640 1 -- 172.21.15.17:0/33864334 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79cc004c00 con 0x7f79d8100750 2024-08-19T01:12:45.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.505+0000 7f79df940640 1 -- 172.21.15.17:0/33864334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d8195cf0 con 0x7f79d8100750 2024-08-19T01:12:45.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.505+0000 7f79d67fc640 1 -- 172.21.15.17:0/33864334 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79cc003980 con 0x7f79d8100750 2024-08-19T01:12:45.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.505+0000 7f79df940640 1 -- 172.21.15.17:0/33864334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d81961e0 con 0x7f79d8100750 2024-08-19T01:12:45.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.506+0000 7f79df940640 1 -- 172.21.15.17:0/33864334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d8101280 con 0x7f79d8100750 2024-08-19T01:12:45.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.506+0000 7f79d67fc640 1 -- 172.21.15.17:0/33864334 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f79cc003b00 con 0x7f79d8100750 2024-08-19T01:12:45.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.507+0000 7f79d67fc640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f79c006e170 0x7f79c0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:12:45.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.507+0000 7f79d67fc640 1 -- 172.21.15.17:0/33864334 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f79cc0af160 con 0x7f79d8100750 2024-08-19T01:12:45.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.507+0000 7f79dd6dc640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f79c006e170 0x7f79c0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:12:45.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.507+0000 7f79dd6dc640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f79c006e170 0x7f79c0070630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f79c8005fd0 tx=0x7f79c80093e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:12:45.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.511+0000 7f79d67fc640 1 -- 172.21.15.17:0/33864334 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f79cc0784c0 con 0x7f79d8100750 2024-08-19T01:12:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.756+0000 7f79df940640 1 -- 172.21.15.17:0/33864334 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f79d8196ec0 con 0x7f79d8100750 2024-08-19T01:12:45.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.756+0000 7f79d67fc640 1 -- 172.21.15.17:0/33864334 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f79cc07bb80 con 0x7f79d8100750 2024-08-19T01:12:45.759 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:12:45.759 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:12:45.759 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:12:45.759 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:12:45.759 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:12:45.759 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:12:45.759 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:12:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.758+0000 7f79df940640 1 -- 172.21.15.17:0/33864334 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f79c006e170 msgr2=0x7f79c0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.758+0000 7f79df940640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f79c006e170 0x7f79c0070630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f79c8005fd0 tx=0x7f79c80093e0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.758+0000 7f79df940640 1 -- 172.21.15.17:0/33864334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d8100750 msgr2=0x7f79d819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:12:45.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.758+0000 7f79df940640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d8100750 0x7f79d819be10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79cc02a9c0 tx=0x7f79cc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.758+0000 7f79df940640 1 -- 172.21.15.17:0/33864334 shutdown_connections 2024-08-19T01:12:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.758+0000 7f79df940640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f79c006e170 0x7f79c0070630 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.758+0000 7f79df940640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79d8100750 0x7f79d819be10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.758+0000 7f79df940640 1 --2- 172.21.15.17:0/33864334 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79d80ffda0 0x7f79d819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:12:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.758+0000 7f79df940640 1 -- 172.21.15.17:0/33864334 >> 172.21.15.17:0/33864334 conn(0x7f79d80fb840 msgr2=0x7f79d80fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:12:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.758+0000 7f79df940640 1 -- 172.21.15.17:0/33864334 shutdown_connections 2024-08-19T01:12:45.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:12:45.759+0000 7f79df940640 1 -- 172.21.15.17:0/33864334 wait complete. 2024-08-19T01:12:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:45 smithi017 ceph-mon[99370]: from='client.34824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:45 smithi017 ceph-mon[99370]: from='client.34828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:45 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2763112633' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:12:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:45 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/33864334' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:12:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:45 smithi086 ceph-mon[71303]: from='client.34824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:45 smithi086 ceph-mon[71303]: from='client.34828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:45 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2763112633' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:12:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:45 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/33864334' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:12:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:46 smithi017 ceph-mon[99370]: pgmap v419: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:46 smithi017 ceph-mon[99370]: from='client.34840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:46 smithi086 ceph-mon[71303]: pgmap v419: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:46 smithi086 ceph-mon[71303]: from='client.34840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:12:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:48 smithi017 ceph-mon[99370]: pgmap v420: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:12:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:48 smithi086 ceph-mon[71303]: pgmap v420: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:12:51.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:50 smithi017 ceph-mon[99370]: pgmap v421: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:51.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:50 smithi086 ceph-mon[71303]: pgmap v421: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:53.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:52 smithi017 ceph-mon[99370]: pgmap v422: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:53.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:52 smithi086 ceph-mon[71303]: pgmap v422: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:55.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:54 smithi017 ceph-mon[99370]: pgmap v423: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:54 smithi086 ceph-mon[71303]: pgmap v423: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:57.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:56 smithi017 ceph-mon[99370]: pgmap v424: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:57.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:56 smithi086 ceph-mon[71303]: pgmap v424: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:59.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:12:58 smithi017 ceph-mon[99370]: pgmap v425: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:12:59.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:12:58 smithi086 ceph-mon[71303]: pgmap v425: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:01.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:00 smithi017 ceph-mon[99370]: pgmap v426: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:01.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:00 smithi086 ceph-mon[71303]: pgmap v426: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:03.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:02 smithi017 ceph-mon[99370]: pgmap v427: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:03.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:02 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:13:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:02 smithi086 ceph-mon[71303]: pgmap v427: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:02 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:13:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:04 smithi086 ceph-mon[71303]: pgmap v428: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:05.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:04 smithi017 ceph-mon[99370]: pgmap v428: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:07.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:06 smithi086 ceph-mon[71303]: pgmap v429: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:07.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:06 smithi017 ceph-mon[99370]: pgmap v429: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:09.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:08 smithi086 ceph-mon[71303]: pgmap v430: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:08 smithi017 ceph-mon[99370]: pgmap v430: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:10 smithi086 ceph-mon[71303]: pgmap v431: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:11.245 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:10 smithi017 ceph-mon[99370]: pgmap v431: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:13.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:12 smithi086 ceph-mon[71303]: pgmap v432: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:12 smithi017 ceph-mon[99370]: pgmap v432: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:14 smithi017 ceph-mon[99370]: pgmap v433: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:15.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:14 smithi086 ceph-mon[71303]: pgmap v433: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:15.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.854+0000 7ff6fa5af640 1 -- 172.21.15.17:0/641626137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6f40ffda0 msgr2=0x7ff6f4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:15.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.854+0000 7ff6fa5af640 1 --2- 172.21.15.17:0/641626137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6f40ffda0 0x7ff6f4100180 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009880 tx=0x7ff6e402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:13:15.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.854+0000 7ff6fa5af640 1 -- 172.21.15.17:0/641626137 shutdown_connections 2024-08-19T01:13:15.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.854+0000 7ff6fa5af640 1 --2- 172.21.15.17:0/641626137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f4100750 0x7ff6f41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:15.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.854+0000 7ff6fa5af640 1 --2- 172.21.15.17:0/641626137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6f40ffda0 0x7ff6f4100180 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:15.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.854+0000 7ff6fa5af640 1 -- 172.21.15.17:0/641626137 >> 172.21.15.17:0/641626137 conn(0x7ff6f40fb840 msgr2=0x7ff6f40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:15.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.854+0000 7ff6fa5af640 1 -- 172.21.15.17:0/641626137 shutdown_connections 2024-08-19T01:13:15.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.854+0000 7ff6fa5af640 1 -- 172.21.15.17:0/641626137 wait complete. 2024-08-19T01:13:15.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.855+0000 7ff6fa5af640 1 Processor -- start 2024-08-19T01:13:15.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.855+0000 7ff6fa5af640 1 -- start start 2024-08-19T01:13:15.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.855+0000 7ff6fa5af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f40ffda0 0x7ff6f419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:15.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.855+0000 7ff6fa5af640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6f4100750 0x7ff6f419bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:15.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.855+0000 7ff6fa5af640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4195a10 con 0x7ff6f4100750 2024-08-19T01:13:15.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.855+0000 7ff6fa5af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4195b50 con 0x7ff6f40ffda0 2024-08-19T01:13:15.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.855+0000 7ff6f37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6f4100750 0x7ff6f419bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.855+0000 7ff6f37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6f4100750 0x7ff6f419bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58028/0 (socket says 172.21.15.17:58028) 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.855+0000 7ff6f37fe640 1 -- 172.21.15.17:0/1524334510 learned_addr learned my addr 172.21.15.17:0/1524334510 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.855+0000 7ff6f3fff640 1 --2- 172.21.15.17:0/1524334510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f40ffda0 0x7ff6f419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.856+0000 7ff6f37fe640 1 -- 172.21.15.17:0/1524334510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f40ffda0 msgr2=0x7ff6f419b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.856+0000 7ff6f37fe640 1 --2- 172.21.15.17:0/1524334510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f40ffda0 0x7ff6f419b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.856+0000 7ff6f37fe640 1 -- 172.21.15.17:0/1524334510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e4009560 con 0x7ff6f4100750 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.856+0000 7ff6f37fe640 1 --2- 172.21.15.17:0/1524334510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6f4100750 0x7ff6f419bef0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800e970 tx=0x7ff6e800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.856+0000 7ff6f17fa640 1 -- 172.21.15.17:0/1524334510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6e800cc90 con 0x7ff6f4100750 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.856+0000 7ff6f17fa640 1 -- 172.21.15.17:0/1524334510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6e800cdf0 con 0x7ff6f4100750 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.856+0000 7ff6fa5af640 1 -- 172.21.15.17:0/1524334510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f4195e30 con 0x7ff6f4100750 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.856+0000 7ff6f17fa640 1 -- 172.21.15.17:0/1524334510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6e8010430 con 0x7ff6f4100750 2024-08-19T01:13:15.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.856+0000 7ff6fa5af640 1 -- 172.21.15.17:0/1524334510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f4196380 con 0x7ff6f4100750 2024-08-19T01:13:15.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.857+0000 7ff6fa5af640 1 -- 172.21.15.17:0/1524334510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f4101280 con 0x7ff6f4100750 2024-08-19T01:13:15.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.858+0000 7ff6f17fa640 1 -- 172.21.15.17:0/1524334510 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff6e80046c0 con 0x7ff6f4100750 2024-08-19T01:13:15.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.858+0000 7ff6f17fa640 1 --2- 172.21.15.17:0/1524334510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff6dc06e170 0x7ff6dc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:15.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.858+0000 7ff6f17fa640 1 -- 172.21.15.17:0/1524334510 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff6e8014070 con 0x7ff6f4100750 2024-08-19T01:13:15.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.858+0000 7ff6f3fff640 1 --2- 172.21.15.17:0/1524334510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff6dc06e170 0x7ff6dc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:15.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.859+0000 7ff6f3fff640 1 --2- 172.21.15.17:0/1524334510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff6dc06e170 0x7ff6dc070630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4000c00 tx=0x7ff6e4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:15.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:15.863+0000 7ff6f17fa640 1 -- 172.21.15.17:0/1524334510 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff6e8057a50 con 0x7ff6f4100750 2024-08-19T01:13:16.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.058+0000 7ff6fa5af640 1 -- 172.21.15.17:0/1524334510 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6f4196fb0 con 0x7ff6dc06e170 2024-08-19T01:13:16.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.059+0000 7ff6f17fa640 1 -- 172.21.15.17:0/1524334510 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff6f4196fb0 con 0x7ff6dc06e170 2024-08-19T01:13:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.061+0000 7ff6fa5af640 1 -- 172.21.15.17:0/1524334510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff6dc06e170 msgr2=0x7ff6dc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.061+0000 7ff6fa5af640 1 --2- 172.21.15.17:0/1524334510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff6dc06e170 0x7ff6dc070630 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4000c00 tx=0x7ff6e4005a20 comp rx=0 tx=0).stop 2024-08-19T01:13:16.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.061+0000 7ff6fa5af640 1 -- 172.21.15.17:0/1524334510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6f4100750 msgr2=0x7ff6f419bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.061+0000 7ff6fa5af640 1 --2- 172.21.15.17:0/1524334510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6f4100750 0x7ff6f419bef0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800e970 tx=0x7ff6e800ed70 comp rx=0 tx=0).stop 2024-08-19T01:13:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.061+0000 7ff6fa5af640 1 -- 172.21.15.17:0/1524334510 shutdown_connections 2024-08-19T01:13:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.061+0000 7ff6fa5af640 1 --2- 172.21.15.17:0/1524334510 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff6dc06e170 0x7ff6dc070630 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.061+0000 7ff6fa5af640 1 --2- 172.21.15.17:0/1524334510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6f4100750 0x7ff6f419bef0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.061+0000 7ff6fa5af640 1 --2- 172.21.15.17:0/1524334510 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff6f40ffda0 0x7ff6f419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.061+0000 7ff6fa5af640 1 -- 172.21.15.17:0/1524334510 >> 172.21.15.17:0/1524334510 conn(0x7ff6f40fb840 msgr2=0x7ff6f40fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.062+0000 7ff6fa5af640 1 -- 172.21.15.17:0/1524334510 shutdown_connections 2024-08-19T01:13:16.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.062+0000 7ff6fa5af640 1 -- 172.21.15.17:0/1524334510 wait complete. 2024-08-19T01:13:16.072 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:13:16.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.144+0000 7f38f5e43640 1 -- 172.21.15.17:0/38565260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f0072850 msgr2=0x7f38f0072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.144+0000 7f38f5e43640 1 --2- 172.21.15.17:0/38565260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f0072850 0x7f38f0072c30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f38e0009880 tx=0x7f38e002a530 comp rx=0 tx=0).stop 2024-08-19T01:13:16.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.144+0000 7f38f5e43640 1 -- 172.21.15.17:0/38565260 shutdown_connections 2024-08-19T01:13:16.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.144+0000 7f38f5e43640 1 --2- 172.21.15.17:0/38565260 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f0073170 0x7f38f0110610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.144+0000 7f38f5e43640 1 --2- 172.21.15.17:0/38565260 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f0072850 0x7f38f0072c30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.144+0000 7f38f5e43640 1 -- 172.21.15.17:0/38565260 >> 172.21.15.17:0/38565260 conn(0x7f38f00fb840 msgr2=0x7f38f00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:16.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.144+0000 7f38f5e43640 1 -- 172.21.15.17:0/38565260 shutdown_connections 2024-08-19T01:13:16.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.145+0000 7f38f5e43640 1 -- 172.21.15.17:0/38565260 wait complete. 2024-08-19T01:13:16.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.145+0000 7f38f5e43640 1 Processor -- start 2024-08-19T01:13:16.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.145+0000 7f38f5e43640 1 -- start start 2024-08-19T01:13:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38f5e43640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f0072850 0x7f38f019c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38f5e43640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f0073170 0x7f38f019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38f5e43640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f019cd30 con 0x7f38f0072850 2024-08-19T01:13:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38f5e43640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f01a0aa0 con 0x7f38f0073170 2024-08-19T01:13:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38ef7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f0072850 0x7f38f019c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38ef7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f0072850 0x7f38f019c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58050/0 (socket says 172.21.15.17:58050) 2024-08-19T01:13:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38ef7fe640 1 -- 172.21.15.17:0/2473433027 learned_addr learned my addr 172.21.15.17:0/2473433027 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38e6ffd640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f0073170 0x7f38f019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38ef7fe640 1 -- 172.21.15.17:0/2473433027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f0073170 msgr2=0x7f38f019c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38ef7fe640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f0073170 0x7f38f019c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38ef7fe640 1 -- 172.21.15.17:0/2473433027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e0009560 con 0x7f38f0072850 2024-08-19T01:13:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38e6ffd640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f0073170 0x7f38f019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:13:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38ef7fe640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f0072850 0x7f38f019c160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f38e0005940 tx=0x7f38e0032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38ed7fa640 1 -- 172.21.15.17:0/2473433027 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38e0005220 con 0x7f38f0072850 2024-08-19T01:13:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38ed7fa640 1 -- 172.21.15.17:0/2473433027 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38e0005380 con 0x7f38f0072850 2024-08-19T01:13:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38f5e43640 1 -- 172.21.15.17:0/2473433027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f01a0d20 con 0x7f38f0072850 2024-08-19T01:13:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.146+0000 7f38ed7fa640 1 -- 172.21.15.17:0/2473433027 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38e0003a50 con 0x7f38f0072850 2024-08-19T01:13:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.147+0000 7f38f5e43640 1 -- 172.21.15.17:0/2473433027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f01a1270 con 0x7f38f0072850 2024-08-19T01:13:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.147+0000 7f38f5e43640 1 -- 172.21.15.17:0/2473433027 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f0073f90 con 0x7f38f0072850 2024-08-19T01:13:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.148+0000 7f38ed7fa640 1 -- 172.21.15.17:0/2473433027 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f38e002ad50 con 0x7f38f0072850 2024-08-19T01:13:16.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.148+0000 7f38ed7fa640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f38dc06e170 0x7f38dc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:16.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.149+0000 7f38ed7fa640 1 -- 172.21.15.17:0/2473433027 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f38e00aec20 con 0x7f38f0072850 2024-08-19T01:13:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.149+0000 7f38e6ffd640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f38dc06e170 0x7f38dc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.149+0000 7f38e6ffd640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f38dc06e170 0x7f38dc070630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f38d8006fd0 tx=0x7f38d8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.153+0000 7f38ed7fa640 1 -- 172.21.15.17:0/2473433027 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f38e0077f00 con 0x7f38f0072850 2024-08-19T01:13:16.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.345+0000 7f38f5e43640 1 -- 172.21.15.17:0/2473433027 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f38f01133f0 con 0x7f38dc06e170 2024-08-19T01:13:16.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.347+0000 7f38ed7fa640 1 -- 172.21.15.17:0/2473433027 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f38f01133f0 con 0x7f38dc06e170 2024-08-19T01:13:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.349+0000 7f38f5e43640 1 -- 172.21.15.17:0/2473433027 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f38dc06e170 msgr2=0x7f38dc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.349+0000 7f38f5e43640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f38dc06e170 0x7f38dc070630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f38d8006fd0 tx=0x7f38d8008040 comp rx=0 tx=0).stop 2024-08-19T01:13:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.349+0000 7f38f5e43640 1 -- 172.21.15.17:0/2473433027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f0072850 msgr2=0x7f38f019c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.349+0000 7f38f5e43640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f0072850 0x7f38f019c160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f38e0005940 tx=0x7f38e0032bd0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.349+0000 7f38f5e43640 1 -- 172.21.15.17:0/2473433027 shutdown_connections 2024-08-19T01:13:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.349+0000 7f38f5e43640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f38dc06e170 0x7f38dc070630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.349+0000 7f38f5e43640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38f0073170 0x7f38f019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.349+0000 7f38f5e43640 1 --2- 172.21.15.17:0/2473433027 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f0072850 0x7f38f019c160 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.349+0000 7f38f5e43640 1 -- 172.21.15.17:0/2473433027 >> 172.21.15.17:0/2473433027 conn(0x7f38f00fb840 msgr2=0x7f38f00ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:16.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.349+0000 7f38f5e43640 1 -- 172.21.15.17:0/2473433027 shutdown_connections 2024-08-19T01:13:16.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.349+0000 7f38f5e43640 1 -- 172.21.15.17:0/2473433027 wait complete. 2024-08-19T01:13:16.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.433+0000 7f4707036640 1 -- 172.21.15.17:0/831659135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47000ffda0 msgr2=0x7f4700100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.433+0000 7f4707036640 1 --2- 172.21.15.17:0/831659135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47000ffda0 0x7f4700100180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009880 tx=0x7f46f002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.433+0000 7f4707036640 1 -- 172.21.15.17:0/831659135 shutdown_connections 2024-08-19T01:13:16.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.433+0000 7f4707036640 1 --2- 172.21.15.17:0/831659135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4700100750 0x7f47001047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.433+0000 7f4707036640 1 --2- 172.21.15.17:0/831659135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47000ffda0 0x7f4700100180 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.433+0000 7f4707036640 1 -- 172.21.15.17:0/831659135 >> 172.21.15.17:0/831659135 conn(0x7f47000fb840 msgr2=0x7f47000fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:16.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.433+0000 7f4707036640 1 -- 172.21.15.17:0/831659135 shutdown_connections 2024-08-19T01:13:16.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.433+0000 7f4707036640 1 -- 172.21.15.17:0/831659135 wait complete. 2024-08-19T01:13:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.433+0000 7f4707036640 1 Processor -- start 2024-08-19T01:13:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.433+0000 7f4707036640 1 -- start start 2024-08-19T01:13:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f4707036640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47000ffda0 0x7f4700197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f4707036640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4700100750 0x7f4700198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f4707036640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47001988f0 con 0x7f4700100750 2024-08-19T01:13:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f4707036640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470019b560 con 0x7f47000ffda0 2024-08-19T01:13:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f46fffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4700100750 0x7f4700198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f46fffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4700100750 0x7f4700198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58078/0 (socket says 172.21.15.17:58078) 2024-08-19T01:13:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f46fffff640 1 -- 172.21.15.17:0/219181663 learned_addr learned my addr 172.21.15.17:0/219181663 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:16.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f46fffff640 1 -- 172.21.15.17:0/219181663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47000ffda0 msgr2=0x7f4700197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f4704dd2640 1 --2- 172.21.15.17:0/219181663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47000ffda0 0x7f4700197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f46fffff640 1 --2- 172.21.15.17:0/219181663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47000ffda0 0x7f4700197cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f46fffff640 1 -- 172.21.15.17:0/219181663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0009560 con 0x7f4700100750 2024-08-19T01:13:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f46fffff640 1 --2- 172.21.15.17:0/219181663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4700100750 0x7f4700198210 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f46f400c810 tx=0x7f46f400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f46fdffb640 1 -- 172.21.15.17:0/219181663 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f40041f0 con 0x7f4700100750 2024-08-19T01:13:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f46fdffb640 1 -- 172.21.15.17:0/219181663 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46f4007e70 con 0x7f4700100750 2024-08-19T01:13:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f4707036640 1 -- 172.21.15.17:0/219181663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470019b840 con 0x7f4700100750 2024-08-19T01:13:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.434+0000 7f46fdffb640 1 -- 172.21.15.17:0/219181663 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46f40049d0 con 0x7f4700100750 2024-08-19T01:13:16.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.435+0000 7f4707036640 1 -- 172.21.15.17:0/219181663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470019bd90 con 0x7f4700100750 2024-08-19T01:13:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.435+0000 7f4707036640 1 -- 172.21.15.17:0/219181663 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4700101280 con 0x7f4700100750 2024-08-19T01:13:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.436+0000 7f46fdffb640 1 -- 172.21.15.17:0/219181663 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f46f40079b0 con 0x7f4700100750 2024-08-19T01:13:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.436+0000 7f46fdffb640 1 --2- 172.21.15.17:0/219181663 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f46e806e170 0x7f46e8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.436+0000 7f46fdffb640 1 -- 172.21.15.17:0/219181663 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f46f408dfc0 con 0x7f4700100750 2024-08-19T01:13:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.436+0000 7f4704dd2640 1 --2- 172.21.15.17:0/219181663 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f46e806e170 0x7f46e8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:16.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.437+0000 7f4704dd2640 1 --2- 172.21.15.17:0/219181663 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f46e806e170 0x7f46e8070630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f46f0000c00 tx=0x7f46f0004120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:16.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.441+0000 7f46fdffb640 1 -- 172.21.15.17:0/219181663 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f46f40572a0 con 0x7f4700100750 2024-08-19T01:13:16.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.624+0000 7f4707036640 1 -- 172.21.15.17:0/219181663 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4700073f10 con 0x7f46e806e170 2024-08-19T01:13:16.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.634+0000 7f46fdffb640 1 -- 172.21.15.17:0/219181663 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f4700073f10 con 0x7f46e806e170 2024-08-19T01:13:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:13:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (14m) 8m ago 25m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:13:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (25m) 8m ago 25m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:13:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (24m) 8m ago 24m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:13:16.636 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (12m) 8m ago 25m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (12m) 8m ago 24m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (14m) 8m ago 24m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (8m) 8m ago 19m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (8m) 8m ago 19m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (19m) 8m ago 19m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (8m) 8m ago 19m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (16m) 8m ago 26m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (15m) 8m ago 24m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (13m) 8m ago 26m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (12m) 8m ago 24m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (15m) 8m ago 25m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (15m) 8m ago 24m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:13:16.637 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (11m) 8m ago 23m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:13:16.638 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (11m) 8m ago 22m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:13:16.638 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (10m) 8m ago 22m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:13:16.638 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (10m) 8m ago 22m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:13:16.638 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (9m) 8m ago 21m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:13:16.638 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (9m) 8m ago 21m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:13:16.638 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (14m) 8m ago 24m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:13:16.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.636+0000 7f4707036640 1 -- 172.21.15.17:0/219181663 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f46e806e170 msgr2=0x7f46e8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.636+0000 7f4707036640 1 --2- 172.21.15.17:0/219181663 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f46e806e170 0x7f46e8070630 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f46f0000c00 tx=0x7f46f0004120 comp rx=0 tx=0).stop 2024-08-19T01:13:16.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.636+0000 7f4707036640 1 -- 172.21.15.17:0/219181663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4700100750 msgr2=0x7f4700198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.636+0000 7f4707036640 1 --2- 172.21.15.17:0/219181663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4700100750 0x7f4700198210 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f46f400c810 tx=0x7f46f400ccd0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.636+0000 7f4707036640 1 -- 172.21.15.17:0/219181663 shutdown_connections 2024-08-19T01:13:16.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.636+0000 7f4707036640 1 --2- 172.21.15.17:0/219181663 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f46e806e170 0x7f46e8070630 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.636+0000 7f4707036640 1 --2- 172.21.15.17:0/219181663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4700100750 0x7f4700198210 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.636+0000 7f4707036640 1 --2- 172.21.15.17:0/219181663 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47000ffda0 0x7f4700197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.636+0000 7f4707036640 1 -- 172.21.15.17:0/219181663 >> 172.21.15.17:0/219181663 conn(0x7f47000fb840 msgr2=0x7f47000fc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:16.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.636+0000 7f4707036640 1 -- 172.21.15.17:0/219181663 shutdown_connections 2024-08-19T01:13:16.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.636+0000 7f4707036640 1 -- 172.21.15.17:0/219181663 wait complete. 2024-08-19T01:13:16.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.717+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3534063953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed4100c60 msgr2=0x7f5ed4101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.717+0000 7f5eda7b9640 1 --2- 172.21.15.17:0/3534063953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed4100c60 0x7f5ed4101040 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5ec40098b0 tx=0x7f5ec402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.717+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3534063953 shutdown_connections 2024-08-19T01:13:16.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.717+0000 7f5eda7b9640 1 --2- 172.21.15.17:0/3534063953 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4101610 0x7f5ed4109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.717+0000 7f5eda7b9640 1 --2- 172.21.15.17:0/3534063953 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed4100c60 0x7f5ed4101040 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.717+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3534063953 >> 172.21.15.17:0/3534063953 conn(0x7f5ed40fa730 msgr2=0x7f5ed40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:16.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.717+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3534063953 shutdown_connections 2024-08-19T01:13:16.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.717+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3534063953 wait complete. 2024-08-19T01:13:16.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.718+0000 7f5eda7b9640 1 Processor -- start 2024-08-19T01:13:16.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.718+0000 7f5eda7b9640 1 -- start start 2024-08-19T01:13:16.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.718+0000 7f5eda7b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed4100c60 0x7f5ed419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:16.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.718+0000 7f5eda7b9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4101610 0x7f5ed419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:16.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.718+0000 7f5eda7b9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed419c3a0 con 0x7f5ed4100c60 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.718+0000 7f5eda7b9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4195930 con 0x7f5ed4101610 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5ed3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed4100c60 0x7f5ed419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5ed3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed4100c60 0x7f5ed419b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36540/0 (socket says 172.21.15.17:36540) 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5ed3fff640 1 -- 172.21.15.17:0/3955657323 learned_addr learned my addr 172.21.15.17:0/3955657323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5ed37fe640 1 --2- 172.21.15.17:0/3955657323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4101610 0x7f5ed419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5ed3fff640 1 -- 172.21.15.17:0/3955657323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4101610 msgr2=0x7f5ed419bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5ed3fff640 1 --2- 172.21.15.17:0/3955657323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4101610 0x7f5ed419bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5ed3fff640 1 -- 172.21.15.17:0/3955657323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4009560 con 0x7f5ed4100c60 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5ed3fff640 1 --2- 172.21.15.17:0/3955657323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed4100c60 0x7f5ed419b840 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4006010 tx=0x7f5ec40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5ed17fa640 1 -- 172.21.15.17:0/3955657323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ec4004aa0 con 0x7f5ed4100c60 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5ed17fa640 1 -- 172.21.15.17:0/3955657323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5ec4031470 con 0x7f5ed4100c60 2024-08-19T01:13:16.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3955657323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed4195bb0 con 0x7f5ed4100c60 2024-08-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5ed17fa640 1 -- 172.21.15.17:0/3955657323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ec4003940 con 0x7f5ed4100c60 2024-08-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.719+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3955657323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed41960a0 con 0x7f5ed4100c60 2024-08-19T01:13:16.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.721+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3955657323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed4068d30 con 0x7f5ed4100c60 2024-08-19T01:13:16.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.721+0000 7f5ed17fa640 1 -- 172.21.15.17:0/3955657323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5ec4031b90 con 0x7f5ed4100c60 2024-08-19T01:13:16.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.722+0000 7f5ed17fa640 1 --2- 172.21.15.17:0/3955657323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ebc06e170 0x7f5ebc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:16.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.722+0000 7f5ed17fa640 1 -- 172.21.15.17:0/3955657323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5ec40af120 con 0x7f5ed4100c60 2024-08-19T01:13:16.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.722+0000 7f5ed37fe640 1 --2- 172.21.15.17:0/3955657323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ebc06e170 0x7f5ebc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:16.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.722+0000 7f5ed37fe640 1 --2- 172.21.15.17:0/3955657323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ebc06e170 0x7f5ebc070630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4196da0 tx=0x7f5ec800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:16.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.727+0000 7f5ed17fa640 1 -- 172.21.15.17:0/3955657323 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5ec4078530 con 0x7f5ed4100c60 2024-08-19T01:13:16.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.972+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3955657323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5ed4104310 con 0x7f5ed4100c60 2024-08-19T01:13:16.974 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:16 smithi017 ceph-mon[99370]: pgmap v434: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:16.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.972+0000 7f5ed17fa640 1 -- 172.21.15.17:0/3955657323 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f5ec4004c00 con 0x7f5ed4100c60 2024-08-19T01:13:16.974 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:13:16.975 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:13:16.975 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:13:16.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:13:16.975 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:13:16.975 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:13:16.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:13:16.975 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:13:16.975 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:13:16.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:13:16.975 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:13:16.976 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:13:16.976 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:13:16.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:13:16.976 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:13:16.976 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:13:16.976 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:13:16.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:13:16.976 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:13:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.974+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3955657323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ebc06e170 msgr2=0x7f5ebc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.974+0000 7f5eda7b9640 1 --2- 172.21.15.17:0/3955657323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ebc06e170 0x7f5ebc070630 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4196da0 tx=0x7f5ec800b390 comp rx=0 tx=0).stop 2024-08-19T01:13:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.974+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3955657323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed4100c60 msgr2=0x7f5ed419b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.974+0000 7f5eda7b9640 1 --2- 172.21.15.17:0/3955657323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed4100c60 0x7f5ed419b840 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4006010 tx=0x7f5ec40055a0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.974+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3955657323 shutdown_connections 2024-08-19T01:13:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.974+0000 7f5eda7b9640 1 --2- 172.21.15.17:0/3955657323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5ebc06e170 0x7f5ebc070630 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.974+0000 7f5eda7b9640 1 --2- 172.21.15.17:0/3955657323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5ed4101610 0x7f5ed419bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.974+0000 7f5eda7b9640 1 --2- 172.21.15.17:0/3955657323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ed4100c60 0x7f5ed419b840 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.974+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3955657323 >> 172.21.15.17:0/3955657323 conn(0x7f5ed40fa730 msgr2=0x7f5ed4101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.974+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3955657323 shutdown_connections 2024-08-19T01:13:16.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:16.974+0000 7f5eda7b9640 1 -- 172.21.15.17:0/3955657323 wait complete. 2024-08-19T01:13:17.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.057+0000 7f6487f72640 1 -- 172.21.15.17:0/3406093716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64800fea20 msgr2=0x7f64800fee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.057+0000 7f6487f72640 1 --2- 172.21.15.17:0/3406093716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64800fea20 0x7f64800fee80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6474009900 tx=0x7f647402c6e0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.057+0000 7f6487f72640 1 -- 172.21.15.17:0/3406093716 shutdown_connections 2024-08-19T01:13:17.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.057+0000 7f6487f72640 1 --2- 172.21.15.17:0/3406093716 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64800fea20 0x7f64800fee80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.057+0000 7f6487f72640 1 --2- 172.21.15.17:0/3406093716 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6480104a20 0x7f6480104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.057+0000 7f6487f72640 1 -- 172.21.15.17:0/3406093716 >> 172.21.15.17:0/3406093716 conn(0x7f64800fa700 msgr2=0x7f64800fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.057+0000 7f6487f72640 1 -- 172.21.15.17:0/3406093716 shutdown_connections 2024-08-19T01:13:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.057+0000 7f6487f72640 1 -- 172.21.15.17:0/3406093716 wait complete. 2024-08-19T01:13:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.057+0000 7f6487f72640 1 Processor -- start 2024-08-19T01:13:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.057+0000 7f6487f72640 1 -- start start 2024-08-19T01:13:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6487f72640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64800fea20 0x7f6480199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6487f72640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6480104a20 0x7f6480199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6487f72640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6480193750 con 0x7f64800fea20 2024-08-19T01:13:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6487f72640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64801938c0 con 0x7f6480104a20 2024-08-19T01:13:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6485d0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64800fea20 0x7f6480199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6485d0e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64800fea20 0x7f6480199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36556/0 (socket says 172.21.15.17:36556) 2024-08-19T01:13:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6485d0e640 1 -- 172.21.15.17:0/1526644026 learned_addr learned my addr 172.21.15.17:0/1526644026 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f648550d640 1 --2- 172.21.15.17:0/1526644026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6480104a20 0x7f6480199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6485d0e640 1 -- 172.21.15.17:0/1526644026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6480104a20 msgr2=0x7f6480199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6485d0e640 1 --2- 172.21.15.17:0/1526644026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6480104a20 0x7f6480199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6485d0e640 1 -- 172.21.15.17:0/1526644026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474009560 con 0x7f64800fea20 2024-08-19T01:13:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6485d0e640 1 --2- 172.21.15.17:0/1526644026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64800fea20 0x7f6480199660 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d6f0 tx=0x7f647c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6472ffd640 1 -- 172.21.15.17:0/1526644026 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f647c009a30 con 0x7f64800fea20 2024-08-19T01:13:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.058+0000 7f6472ffd640 1 -- 172.21.15.17:0/1526644026 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f647c0054e0 con 0x7f64800fea20 2024-08-19T01:13:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.059+0000 7f6487f72640 1 -- 172.21.15.17:0/1526644026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6480193ba0 con 0x7f64800fea20 2024-08-19T01:13:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.059+0000 7f6472ffd640 1 -- 172.21.15.17:0/1526644026 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f647c010460 con 0x7f64800fea20 2024-08-19T01:13:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.059+0000 7f6487f72640 1 -- 172.21.15.17:0/1526644026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64801940c0 con 0x7f64800fea20 2024-08-19T01:13:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.060+0000 7f6487f72640 1 -- 172.21.15.17:0/1526644026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6480100160 con 0x7f64800fea20 2024-08-19T01:13:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.060+0000 7f6472ffd640 1 -- 172.21.15.17:0/1526644026 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f647c009b90 con 0x7f64800fea20 2024-08-19T01:13:17.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.060+0000 7f6472ffd640 1 --2- 172.21.15.17:0/1526644026 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f646c06e180 0x7f646c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:17.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.061+0000 7f6472ffd640 1 -- 172.21.15.17:0/1526644026 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f647c08dc80 con 0x7f64800fea20 2024-08-19T01:13:17.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.061+0000 7f648550d640 1 --2- 172.21.15.17:0/1526644026 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f646c06e180 0x7f646c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:17.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.061+0000 7f648550d640 1 --2- 172.21.15.17:0/1526644026 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f646c06e180 0x7f646c070640 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6474000c00 tx=0x7f6474005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:17.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.065+0000 7f6472ffd640 1 -- 172.21.15.17:0/1526644026 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f647c056fe0 con 0x7f64800fea20 2024-08-19T01:13:17.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.276+0000 7f6487f72640 1 -- 172.21.15.17:0/1526644026 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6480194c60 con 0x7f64800fea20 2024-08-19T01:13:17.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.276+0000 7f6472ffd640 1 -- 172.21.15.17:0/1526644026 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f647c020070 con 0x7f64800fea20 2024-08-19T01:13:17.279 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:13:17.279 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:13:17.279 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:13:17.279 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:13:17.279 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:13:17.279 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:13:17.279 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:13:17.279 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:13:17.279 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:13:17.279 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:13:17.280 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:13:17.281 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:13:17.282 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:13:17.282 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:13:17.282 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:13:17.282 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:13:17.282 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:13:17.282 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:13:17.282 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.278+0000 7f6487f72640 1 -- 172.21.15.17:0/1526644026 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f646c06e180 msgr2=0x7f646c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.278+0000 7f6487f72640 1 --2- 172.21.15.17:0/1526644026 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f646c06e180 0x7f646c070640 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6474000c00 tx=0x7f6474005e30 comp rx=0 tx=0).stop 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.278+0000 7f6487f72640 1 -- 172.21.15.17:0/1526644026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64800fea20 msgr2=0x7f6480199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.278+0000 7f6487f72640 1 --2- 172.21.15.17:0/1526644026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64800fea20 0x7f6480199660 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f647c00d6f0 tx=0x7f647c00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.279+0000 7f6487f72640 1 -- 172.21.15.17:0/1526644026 shutdown_connections 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.279+0000 7f6487f72640 1 --2- 172.21.15.17:0/1526644026 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f646c06e180 0x7f646c070640 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.279+0000 7f6487f72640 1 --2- 172.21.15.17:0/1526644026 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6480104a20 0x7f6480199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.279+0000 7f6487f72640 1 --2- 172.21.15.17:0/1526644026 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f64800fea20 0x7f6480199660 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.279+0000 7f6487f72640 1 -- 172.21.15.17:0/1526644026 >> 172.21.15.17:0/1526644026 conn(0x7f64800fa700 msgr2=0x7f64800fb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.279+0000 7f6487f72640 1 -- 172.21.15.17:0/1526644026 shutdown_connections 2024-08-19T01:13:17.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.279+0000 7f6487f72640 1 -- 172.21.15.17:0/1526644026 wait complete. 2024-08-19T01:13:17.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.363+0000 7f15ad295640 1 -- 172.21.15.17:0/1910788721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a8100750 msgr2=0x7f15a81047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.363+0000 7f15ad295640 1 --2- 172.21.15.17:0/1910788721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a8100750 0x7f15a81047a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f159c009880 tx=0x7f159c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.363+0000 7f15ad295640 1 -- 172.21.15.17:0/1910788721 shutdown_connections 2024-08-19T01:13:17.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.363+0000 7f15ad295640 1 --2- 172.21.15.17:0/1910788721 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a8100750 0x7f15a81047a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.363+0000 7f15ad295640 1 --2- 172.21.15.17:0/1910788721 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15a80ffda0 0x7f15a8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.363+0000 7f15ad295640 1 -- 172.21.15.17:0/1910788721 >> 172.21.15.17:0/1910788721 conn(0x7f15a80fb840 msgr2=0x7f15a80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:17.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.363+0000 7f15ad295640 1 -- 172.21.15.17:0/1910788721 shutdown_connections 2024-08-19T01:13:17.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.363+0000 7f15ad295640 1 -- 172.21.15.17:0/1910788721 wait complete. 2024-08-19T01:13:17.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.363+0000 7f15ad295640 1 Processor -- start 2024-08-19T01:13:17.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15ad295640 1 -- start start 2024-08-19T01:13:17.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15ad295640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15a80ffda0 0x7f15a80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:17.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15ad295640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a8100750 0x7f15a8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:17.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15ad295640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8073230 con 0x7f15a8100750 2024-08-19T01:13:17.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15ad295640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8073370 con 0x7f15a80ffda0 2024-08-19T01:13:17.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15a67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a8100750 0x7f15a8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:17.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15a67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a8100750 0x7f15a8072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36580/0 (socket says 172.21.15.17:36580) 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15a67fc640 1 -- 172.21.15.17:0/655116876 learned_addr learned my addr 172.21.15.17:0/655116876 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15a6ffd640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15a80ffda0 0x7f15a80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15a67fc640 1 -- 172.21.15.17:0/655116876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15a80ffda0 msgr2=0x7f15a80727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15a67fc640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15a80ffda0 0x7f15a80727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15a67fc640 1 -- 172.21.15.17:0/655116876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c009560 con 0x7f15a8100750 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15a6ffd640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15a80ffda0 0x7f15a80727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.364+0000 7f15a67fc640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a8100750 0x7f15a8072cf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f159c02a9c0 tx=0x7f159c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.365+0000 7f158ffff640 1 -- 172.21.15.17:0/655116876 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f159c004aa0 con 0x7f15a8100750 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.365+0000 7f158ffff640 1 -- 172.21.15.17:0/655116876 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f159c004c00 con 0x7f15a8100750 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.365+0000 7f15ad295640 1 -- 172.21.15.17:0/655116876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a80735f0 con 0x7f15a8100750 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.365+0000 7f158ffff640 1 -- 172.21.15.17:0/655116876 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f159c003980 con 0x7f15a8100750 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.365+0000 7f15ad295640 1 -- 172.21.15.17:0/655116876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a81a2000 con 0x7f15a8100750 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.366+0000 7f15ad295640 1 -- 172.21.15.17:0/655116876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a8101280 con 0x7f15a8100750 2024-08-19T01:13:17.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.366+0000 7f158ffff640 1 -- 172.21.15.17:0/655116876 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f159c003bf0 con 0x7f15a8100750 2024-08-19T01:13:17.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.367+0000 7f158ffff640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f159006e170 0x7f1590070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:17.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.367+0000 7f158ffff640 1 -- 172.21.15.17:0/655116876 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f159c0af1f0 con 0x7f15a8100750 2024-08-19T01:13:17.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.367+0000 7f15a6ffd640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f159006e170 0x7f1590070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:17.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.367+0000 7f15a6ffd640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f159006e170 0x7f1590070630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1598009b40 tx=0x7f1598005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:17.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.371+0000 7f158ffff640 1 -- 172.21.15.17:0/655116876 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f159c0784d0 con 0x7f15a8100750 2024-08-19T01:13:17.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:16 smithi086 ceph-mon[71303]: pgmap v434: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:17.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.562+0000 7f15ad295640 1 -- 172.21.15.17:0/655116876 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f15a8108120 con 0x7f159006e170 2024-08-19T01:13:17.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.564+0000 7f158ffff640 1 -- 172.21.15.17:0/655116876 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f15a8108120 con 0x7f159006e170 2024-08-19T01:13:17.566 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:13:17.567 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:13:17.568 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:13:17.568 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:13:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.566+0000 7f15ad295640 1 -- 172.21.15.17:0/655116876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f159006e170 msgr2=0x7f1590070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.566+0000 7f15ad295640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f159006e170 0x7f1590070630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1598009b40 tx=0x7f1598005e50 comp rx=0 tx=0).stop 2024-08-19T01:13:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.566+0000 7f15ad295640 1 -- 172.21.15.17:0/655116876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a8100750 msgr2=0x7f15a8072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.566+0000 7f15ad295640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a8100750 0x7f15a8072cf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f159c02a9c0 tx=0x7f159c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.566+0000 7f15ad295640 1 -- 172.21.15.17:0/655116876 shutdown_connections 2024-08-19T01:13:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.566+0000 7f15ad295640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f159006e170 0x7f1590070630 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.566+0000 7f15ad295640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15a8100750 0x7f15a8072cf0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.566+0000 7f15ad295640 1 --2- 172.21.15.17:0/655116876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15a80ffda0 0x7f15a80727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.566+0000 7f15ad295640 1 -- 172.21.15.17:0/655116876 >> 172.21.15.17:0/655116876 conn(0x7f15a80fb840 msgr2=0x7f15a80fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:17.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.567+0000 7f15ad295640 1 -- 172.21.15.17:0/655116876 shutdown_connections 2024-08-19T01:13:17.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.567+0000 7f15ad295640 1 -- 172.21.15.17:0/655116876 wait complete. 2024-08-19T01:13:17.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.648+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3205849336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd4100d50 msgr2=0x7f5cd4101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.648+0000 7f5cdb7d3640 1 --2- 172.21.15.17:0/3205849336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd4100d50 0x7f5cd4101130 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009880 tx=0x7f5cd002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.648+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3205849336 shutdown_connections 2024-08-19T01:13:17.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.648+0000 7f5cdb7d3640 1 --2- 172.21.15.17:0/3205849336 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd4101670 0x7f5cd4109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.648+0000 7f5cdb7d3640 1 --2- 172.21.15.17:0/3205849336 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd4100d50 0x7f5cd4101130 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.648+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3205849336 >> 172.21.15.17:0/3205849336 conn(0x7f5cd40fa730 msgr2=0x7f5cd40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:17.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.648+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3205849336 shutdown_connections 2024-08-19T01:13:17.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.648+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3205849336 wait complete. 2024-08-19T01:13:17.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.649+0000 7f5cdb7d3640 1 Processor -- start 2024-08-19T01:13:17.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.649+0000 7f5cdb7d3640 1 -- start start 2024-08-19T01:13:17.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.649+0000 7f5cdb7d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd4100d50 0x7f5cd419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:17.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.649+0000 7f5cdb7d3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd4101670 0x7f5cd419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:17.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.649+0000 7f5cdb7d3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd419c340 con 0x7f5cd4100d50 2024-08-19T01:13:17.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.649+0000 7f5cdb7d3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41958d0 con 0x7f5cd4101670 2024-08-19T01:13:17.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.649+0000 7f5cd956f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd4100d50 0x7f5cd419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.649+0000 7f5cd956f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd4100d50 0x7f5cd419b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36606/0 (socket says 172.21.15.17:36606) 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.649+0000 7f5cd956f640 1 -- 172.21.15.17:0/3037813295 learned_addr learned my addr 172.21.15.17:0/3037813295 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.650+0000 7f5cd8d6e640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd4101670 0x7f5cd419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.650+0000 7f5cd956f640 1 -- 172.21.15.17:0/3037813295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd4101670 msgr2=0x7f5cd419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.650+0000 7f5cd956f640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd4101670 0x7f5cd419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.650+0000 7f5cd956f640 1 -- 172.21.15.17:0/3037813295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0009560 con 0x7f5cd4100d50 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.650+0000 7f5cd8d6e640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd4101670 0x7f5cd419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.650+0000 7f5cd956f640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd4100d50 0x7f5cd419b7e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0006010 tx=0x7f5cd00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.650+0000 7f5cca7fc640 1 -- 172.21.15.17:0/3037813295 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd0004aa0 con 0x7f5cd4100d50 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.650+0000 7f5cca7fc640 1 -- 172.21.15.17:0/3037813295 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5cd0004c00 con 0x7f5cd4100d50 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.650+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3037813295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd4195bb0 con 0x7f5cd4100d50 2024-08-19T01:13:17.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.650+0000 7f5cca7fc640 1 -- 172.21.15.17:0/3037813295 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cd0003a20 con 0x7f5cd4100d50 2024-08-19T01:13:17.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.650+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3037813295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd4196100 con 0x7f5cd4100d50 2024-08-19T01:13:17.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.651+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3037813295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd4068cd0 con 0x7f5cd4100d50 2024-08-19T01:13:17.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.652+0000 7f5cca7fc640 1 -- 172.21.15.17:0/3037813295 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5cd0031c90 con 0x7f5cd4100d50 2024-08-19T01:13:17.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.652+0000 7f5cca7fc640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5cc006e180 0x7f5cc0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:17.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.652+0000 7f5cca7fc640 1 -- 172.21.15.17:0/3037813295 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5cd00af290 con 0x7f5cd4100d50 2024-08-19T01:13:17.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.652+0000 7f5cd8d6e640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5cc006e180 0x7f5cc0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:17.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.653+0000 7f5cd8d6e640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5cc006e180 0x7f5cc0070640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4196d40 tx=0x7f5cc4005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:17.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.657+0000 7f5cca7fc640 1 -- 172.21.15.17:0/3037813295 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5cd00785f0 con 0x7f5cd4100d50 2024-08-19T01:13:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.898+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3037813295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5cd4101130 con 0x7f5cd4100d50 2024-08-19T01:13:17.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.899+0000 7f5cca7fc640 1 -- 172.21.15.17:0/3037813295 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f5cd007bcb0 con 0x7f5cd4100d50 2024-08-19T01:13:17.901 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:13:17.901 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:13:17.901 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:13:17.901 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:13:17.901 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:13:17.902 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:13:17.902 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:13:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.901+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3037813295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5cc006e180 msgr2=0x7f5cc0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.901+0000 7f5cdb7d3640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5cc006e180 0x7f5cc0070640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4196d40 tx=0x7f5cc4005d30 comp rx=0 tx=0).stop 2024-08-19T01:13:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.901+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3037813295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd4100d50 msgr2=0x7f5cd419b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.901+0000 7f5cdb7d3640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd4100d50 0x7f5cd419b7e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0006010 tx=0x7f5cd00055a0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.901+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3037813295 shutdown_connections 2024-08-19T01:13:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.901+0000 7f5cdb7d3640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5cc006e180 0x7f5cc0070640 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.901+0000 7f5cdb7d3640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5cd4101670 0x7f5cd419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.901+0000 7f5cdb7d3640 1 --2- 172.21.15.17:0/3037813295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5cd4100d50 0x7f5cd419b7e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.901+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3037813295 >> 172.21.15.17:0/3037813295 conn(0x7f5cd40fa730 msgr2=0x7f5cd4101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.901+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3037813295 shutdown_connections 2024-08-19T01:13:17.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:17.901+0000 7f5cdb7d3640 1 -- 172.21.15.17:0/3037813295 wait complete. 2024-08-19T01:13:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:17 smithi017 ceph-mon[99370]: from='client.34848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:17 smithi017 ceph-mon[99370]: from='client.34852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:17 smithi017 ceph-mon[99370]: from='client.34856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:17 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3955657323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:13:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:17 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1526644026' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:13:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:17 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3037813295' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:13:18.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:17 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:13:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:17 smithi086 ceph-mon[71303]: from='client.34848 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:17 smithi086 ceph-mon[71303]: from='client.34852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:17 smithi086 ceph-mon[71303]: from='client.34856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:17 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3955657323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:13:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:17 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1526644026' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:13:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:17 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3037813295' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:13:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:17 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:13:19.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:18 smithi017 ceph-mon[99370]: pgmap v435: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:19.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:18 smithi017 ceph-mon[99370]: from='client.34868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:19.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:18 smithi086 ceph-mon[71303]: pgmap v435: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:19.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:18 smithi086 ceph-mon[71303]: from='client.34868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:21.414 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:20 smithi017 ceph-mon[99370]: pgmap v436: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:21.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:20 smithi086 ceph-mon[71303]: pgmap v436: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:23.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:22 smithi086 ceph-mon[71303]: pgmap v437: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:23.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:22 smithi017 ceph-mon[99370]: pgmap v437: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:25.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:24 smithi017 ceph-mon[99370]: pgmap v438: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:25.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:24 smithi086 ceph-mon[71303]: pgmap v438: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:27.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:26 smithi017 ceph-mon[99370]: pgmap v439: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:27.615 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:26 smithi086 ceph-mon[71303]: pgmap v439: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:29.235 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:28 smithi017 ceph-mon[99370]: pgmap v440: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:29.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:28 smithi086 ceph-mon[71303]: pgmap v440: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:31.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:30 smithi017 ceph-mon[99370]: pgmap v441: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:31.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:30 smithi086 ceph-mon[71303]: pgmap v441: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:32 smithi017 ceph-mon[99370]: pgmap v442: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:32 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:13:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:32 smithi086 ceph-mon[71303]: pgmap v442: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:32 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:13:35.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:34 smithi017 ceph-mon[99370]: pgmap v443: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:34 smithi086 ceph-mon[71303]: pgmap v443: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:37.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:36 smithi017 ceph-mon[99370]: pgmap v444: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:36 smithi086 ceph-mon[71303]: pgmap v444: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:39.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:38 smithi017 ceph-mon[99370]: pgmap v445: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:38 smithi086 ceph-mon[71303]: pgmap v445: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:40.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:40 smithi017 ceph-mon[99370]: pgmap v446: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:40 smithi086 ceph-mon[71303]: pgmap v446: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:42 smithi017 ceph-mon[99370]: pgmap v447: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:42 smithi086 ceph-mon[71303]: pgmap v447: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:44.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:44 smithi017 ceph-mon[99370]: pgmap v448: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:44.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:44 smithi086 ceph-mon[71303]: pgmap v448: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:46 smithi017 ceph-mon[99370]: pgmap v449: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:46.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:46 smithi086 ceph-mon[71303]: pgmap v449: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:48.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.006+0000 7fb19c84b640 1 -- 172.21.15.17:0/720418805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1980fea30 msgr2=0x7fb1980fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.006+0000 7fb19c84b640 1 --2- 172.21.15.17:0/720418805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1980fea30 0x7fb1980fee90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb180009880 tx=0x7fb18002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.006+0000 7fb19c84b640 1 -- 172.21.15.17:0/720418805 shutdown_connections 2024-08-19T01:13:48.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.006+0000 7fb19c84b640 1 --2- 172.21.15.17:0/720418805 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1980fea30 0x7fb1980fee90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.006+0000 7fb19c84b640 1 --2- 172.21.15.17:0/720418805 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb198104a30 0x7fb198104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.006+0000 7fb19c84b640 1 -- 172.21.15.17:0/720418805 >> 172.21.15.17:0/720418805 conn(0x7fb1980fa730 msgr2=0x7fb1980fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:48.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.006+0000 7fb19c84b640 1 -- 172.21.15.17:0/720418805 shutdown_connections 2024-08-19T01:13:48.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.006+0000 7fb19c84b640 1 -- 172.21.15.17:0/720418805 wait complete. 2024-08-19T01:13:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.007+0000 7fb19c84b640 1 Processor -- start 2024-08-19T01:13:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.007+0000 7fb19c84b640 1 -- start start 2024-08-19T01:13:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.007+0000 7fb19c84b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1980fea30 0x7fb19819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.007+0000 7fb19c84b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb198104a30 0x7fb19819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.007+0000 7fb19c84b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19819c360 con 0x7fb1980fea30 2024-08-19T01:13:48.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.007+0000 7fb19c84b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981958f0 con 0x7fb198104a30 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb19659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1980fea30 0x7fb19819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb19659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1980fea30 0x7fb19819b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54352/0 (socket says 172.21.15.17:54352) 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb19659c640 1 -- 172.21.15.17:0/3771357462 learned_addr learned my addr 172.21.15.17:0/3771357462 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb195d9b640 1 --2- 172.21.15.17:0/3771357462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb198104a30 0x7fb19819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb19659c640 1 -- 172.21.15.17:0/3771357462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb198104a30 msgr2=0x7fb19819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb19659c640 1 --2- 172.21.15.17:0/3771357462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb198104a30 0x7fb19819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb19659c640 1 -- 172.21.15.17:0/3771357462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb180009560 con 0x7fb1980fea30 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb19659c640 1 --2- 172.21.15.17:0/3771357462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1980fea30 0x7fb19819b800 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb18800d8d0 tx=0x7fb18800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb18f7fe640 1 -- 172.21.15.17:0/3771357462 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb18800bea0 con 0x7fb1980fea30 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb18f7fe640 1 -- 172.21.15.17:0/3771357462 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb188009c00 con 0x7fb1980fea30 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb19c84b640 1 -- 172.21.15.17:0/3771357462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb198195bd0 con 0x7fb1980fea30 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb18f7fe640 1 -- 172.21.15.17:0/3771357462 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb18800f710 con 0x7fb1980fea30 2024-08-19T01:13:48.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.008+0000 7fb19c84b640 1 -- 172.21.15.17:0/3771357462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1981960f0 con 0x7fb1980fea30 2024-08-19T01:13:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.009+0000 7fb19c84b640 1 -- 172.21.15.17:0/3771357462 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb198100170 con 0x7fb1980fea30 2024-08-19T01:13:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.010+0000 7fb18f7fe640 1 -- 172.21.15.17:0/3771357462 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb18800f990 con 0x7fb1980fea30 2024-08-19T01:13:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.010+0000 7fb18f7fe640 1 --2- 172.21.15.17:0/3771357462 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb18406e170 0x7fb184070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.011+0000 7fb18f7fe640 1 -- 172.21.15.17:0/3771357462 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb18808de70 con 0x7fb1980fea30 2024-08-19T01:13:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.011+0000 7fb195d9b640 1 --2- 172.21.15.17:0/3771357462 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb18406e170 0x7fb184070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.011+0000 7fb195d9b640 1 --2- 172.21.15.17:0/3771357462 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb18406e170 0x7fb184070630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb180009230 tx=0x7fb1800058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:48.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.015+0000 7fb18f7fe640 1 -- 172.21.15.17:0/3771357462 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb188057200 con 0x7fb1980fea30 2024-08-19T01:13:48.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.209+0000 7fb19c84b640 1 -- 172.21.15.17:0/3771357462 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb198108040 con 0x7fb18406e170 2024-08-19T01:13:48.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.210+0000 7fb18f7fe640 1 -- 172.21.15.17:0/3771357462 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb198108040 con 0x7fb18406e170 2024-08-19T01:13:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.212+0000 7fb19c84b640 1 -- 172.21.15.17:0/3771357462 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb18406e170 msgr2=0x7fb184070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.212+0000 7fb19c84b640 1 --2- 172.21.15.17:0/3771357462 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb18406e170 0x7fb184070630 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb180009230 tx=0x7fb1800058d0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.212+0000 7fb19c84b640 1 -- 172.21.15.17:0/3771357462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1980fea30 msgr2=0x7fb19819b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.212+0000 7fb19c84b640 1 --2- 172.21.15.17:0/3771357462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1980fea30 0x7fb19819b800 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb18800d8d0 tx=0x7fb18800dd90 comp rx=0 tx=0).stop 2024-08-19T01:13:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.212+0000 7fb19c84b640 1 -- 172.21.15.17:0/3771357462 shutdown_connections 2024-08-19T01:13:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.212+0000 7fb19c84b640 1 --2- 172.21.15.17:0/3771357462 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb18406e170 0x7fb184070630 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.212+0000 7fb19c84b640 1 --2- 172.21.15.17:0/3771357462 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb198104a30 0x7fb19819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.212+0000 7fb19c84b640 1 --2- 172.21.15.17:0/3771357462 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb1980fea30 0x7fb19819b800 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.212+0000 7fb19c84b640 1 -- 172.21.15.17:0/3771357462 >> 172.21.15.17:0/3771357462 conn(0x7fb1980fa730 msgr2=0x7fb198068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.212+0000 7fb19c84b640 1 -- 172.21.15.17:0/3771357462 shutdown_connections 2024-08-19T01:13:48.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.212+0000 7fb19c84b640 1 -- 172.21.15.17:0/3771357462 wait complete. 2024-08-19T01:13:48.223 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:13:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.295+0000 7f1fe928c640 1 -- 172.21.15.17:0/2955963697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe4100750 msgr2=0x7f1fe41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.295+0000 7f1fe928c640 1 --2- 172.21.15.17:0/2955963697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe4100750 0x7f1fe41047a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8009880 tx=0x7f1fd802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.298 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:48 smithi017 ceph-mon[99370]: pgmap v450: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:48.298 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:13:48.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.295+0000 7f1fe928c640 1 -- 172.21.15.17:0/2955963697 shutdown_connections 2024-08-19T01:13:48.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.295+0000 7f1fe928c640 1 --2- 172.21.15.17:0/2955963697 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe4100750 0x7f1fe41047a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.295+0000 7f1fe928c640 1 --2- 172.21.15.17:0/2955963697 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fe40ffda0 0x7f1fe4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.295+0000 7f1fe928c640 1 -- 172.21.15.17:0/2955963697 >> 172.21.15.17:0/2955963697 conn(0x7f1fe40fb840 msgr2=0x7f1fe40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.295+0000 7f1fe928c640 1 -- 172.21.15.17:0/2955963697 shutdown_connections 2024-08-19T01:13:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.296+0000 7f1fe928c640 1 -- 172.21.15.17:0/2955963697 wait complete. 2024-08-19T01:13:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.296+0000 7f1fe928c640 1 Processor -- start 2024-08-19T01:13:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.296+0000 7f1fe928c640 1 -- start start 2024-08-19T01:13:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe928c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe40ffda0 0x7f1fe4193730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe928c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fe4100750 0x7f1fe4193c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe928c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe41941b0 con 0x7f1fe40ffda0 2024-08-19T01:13:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe928c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe4194320 con 0x7f1fe4100750 2024-08-19T01:13:48.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe40ffda0 0x7f1fe4193730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe40ffda0 0x7f1fe4193730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54364/0 (socket says 172.21.15.17:54364) 2024-08-19T01:13:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe2ffd640 1 -- 172.21.15.17:0/766325321 learned_addr learned my addr 172.21.15.17:0/766325321 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe27fc640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fe4100750 0x7f1fe4193c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe2ffd640 1 -- 172.21.15.17:0/766325321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fe4100750 msgr2=0x7f1fe4193c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe2ffd640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fe4100750 0x7f1fe4193c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe2ffd640 1 -- 172.21.15.17:0/766325321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8009560 con 0x7f1fe40ffda0 2024-08-19T01:13:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe27fc640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fe4100750 0x7f1fe4193c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:13:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe2ffd640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe40ffda0 0x7f1fe4193730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c8a0 tx=0x7f1fd400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fcbfff640 1 -- 172.21.15.17:0/766325321 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd4007b80 con 0x7f1fe40ffda0 2024-08-19T01:13:48.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.297+0000 7f1fe928c640 1 -- 172.21.15.17:0/766325321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe41a6090 con 0x7f1fe40ffda0 2024-08-19T01:13:48.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.298+0000 7f1fcbfff640 1 -- 172.21.15.17:0/766325321 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fd4007ce0 con 0x7f1fe40ffda0 2024-08-19T01:13:48.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.298+0000 7f1fcbfff640 1 -- 172.21.15.17:0/766325321 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fd4018810 con 0x7f1fe40ffda0 2024-08-19T01:13:48.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.298+0000 7f1fe928c640 1 -- 172.21.15.17:0/766325321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe41a63f0 con 0x7f1fe40ffda0 2024-08-19T01:13:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.299+0000 7f1fe928c640 1 -- 172.21.15.17:0/766325321 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe4101280 con 0x7f1fe40ffda0 2024-08-19T01:13:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.299+0000 7f1fcbfff640 1 -- 172.21.15.17:0/766325321 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1fd4018a80 con 0x7f1fe40ffda0 2024-08-19T01:13:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.300+0000 7f1fcbfff640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1fcc06e180 0x7f1fcc070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.300+0000 7f1fcbfff640 1 -- 172.21.15.17:0/766325321 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1fd408e310 con 0x7f1fe40ffda0 2024-08-19T01:13:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.300+0000 7f1fe27fc640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1fcc06e180 0x7f1fcc070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.300+0000 7f1fe27fc640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1fcc06e180 0x7f1fcc070640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8000c00 tx=0x7f1fd8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:48.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.304+0000 7f1fcbfff640 1 -- 172.21.15.17:0/766325321 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1fd40575f0 con 0x7f1fe40ffda0 2024-08-19T01:13:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:48 smithi086 ceph-mon[71303]: pgmap v450: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:13:48.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.495+0000 7f1fe928c640 1 -- 172.21.15.17:0/766325321 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fe4073e90 con 0x7f1fcc06e180 2024-08-19T01:13:48.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.496+0000 7f1fcbfff640 1 -- 172.21.15.17:0/766325321 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1fe4073e90 con 0x7f1fcc06e180 2024-08-19T01:13:48.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.498+0000 7f1fe928c640 1 -- 172.21.15.17:0/766325321 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1fcc06e180 msgr2=0x7f1fcc070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.498+0000 7f1fe928c640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1fcc06e180 0x7f1fcc070640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1fd8000c00 tx=0x7f1fd8005a20 comp rx=0 tx=0).stop 2024-08-19T01:13:48.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.498+0000 7f1fe928c640 1 -- 172.21.15.17:0/766325321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe40ffda0 msgr2=0x7f1fe4193730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.498+0000 7f1fe928c640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe40ffda0 0x7f1fe4193730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c8a0 tx=0x7f1fd400cd60 comp rx=0 tx=0).stop 2024-08-19T01:13:48.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.498+0000 7f1fe928c640 1 -- 172.21.15.17:0/766325321 shutdown_connections 2024-08-19T01:13:48.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.498+0000 7f1fe928c640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1fcc06e180 0x7f1fcc070640 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.498+0000 7f1fe928c640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fe4100750 0x7f1fe4193c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.498+0000 7f1fe928c640 1 --2- 172.21.15.17:0/766325321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe40ffda0 0x7f1fe4193730 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.498+0000 7f1fe928c640 1 -- 172.21.15.17:0/766325321 >> 172.21.15.17:0/766325321 conn(0x7f1fe40fb840 msgr2=0x7f1fe40fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:48.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.498+0000 7f1fe928c640 1 -- 172.21.15.17:0/766325321 shutdown_connections 2024-08-19T01:13:48.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.498+0000 7f1fe928c640 1 -- 172.21.15.17:0/766325321 wait complete. 2024-08-19T01:13:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.580+0000 7fad3a60f640 1 -- 172.21.15.17:0/1619946642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad34100750 msgr2=0x7fad341047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.580+0000 7fad3a60f640 1 --2- 172.21.15.17:0/1619946642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad34100750 0x7fad341047a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fad28009880 tx=0x7fad2802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.580+0000 7fad3a60f640 1 -- 172.21.15.17:0/1619946642 shutdown_connections 2024-08-19T01:13:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.580+0000 7fad3a60f640 1 --2- 172.21.15.17:0/1619946642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad34100750 0x7fad341047a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.580+0000 7fad3a60f640 1 --2- 172.21.15.17:0/1619946642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad340ffda0 0x7fad34100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.580+0000 7fad3a60f640 1 -- 172.21.15.17:0/1619946642 >> 172.21.15.17:0/1619946642 conn(0x7fad340fb840 msgr2=0x7fad340fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.580+0000 7fad3a60f640 1 -- 172.21.15.17:0/1619946642 shutdown_connections 2024-08-19T01:13:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.580+0000 7fad3a60f640 1 -- 172.21.15.17:0/1619946642 wait complete. 2024-08-19T01:13:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.580+0000 7fad3a60f640 1 Processor -- start 2024-08-19T01:13:48.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.580+0000 7fad3a60f640 1 -- start start 2024-08-19T01:13:48.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.581+0000 7fad3a60f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad340ffda0 0x7fad340727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.581+0000 7fad3a60f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad34100750 0x7fad34072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.581+0000 7fad3a60f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad34074780 con 0x7fad340ffda0 2024-08-19T01:13:48.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.581+0000 7fad3a60f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad34073230 con 0x7fad34100750 2024-08-19T01:13:48.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.581+0000 7fad33fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad340ffda0 0x7fad340727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.581+0000 7fad33fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad340ffda0 0x7fad340727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54392/0 (socket says 172.21.15.17:54392) 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.581+0000 7fad33fff640 1 -- 172.21.15.17:0/4049698741 learned_addr learned my addr 172.21.15.17:0/4049698741 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.581+0000 7fad337fe640 1 --2- 172.21.15.17:0/4049698741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad34100750 0x7fad34072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.581+0000 7fad33fff640 1 -- 172.21.15.17:0/4049698741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad34100750 msgr2=0x7fad34072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.581+0000 7fad33fff640 1 --2- 172.21.15.17:0/4049698741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad34100750 0x7fad34072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.581+0000 7fad33fff640 1 -- 172.21.15.17:0/4049698741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad28009560 con 0x7fad340ffda0 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.582+0000 7fad33fff640 1 --2- 172.21.15.17:0/4049698741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad340ffda0 0x7fad340727b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c8a0 tx=0x7fad2400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.582+0000 7fad317fa640 1 -- 172.21.15.17:0/4049698741 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad24007b80 con 0x7fad340ffda0 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.582+0000 7fad3a60f640 1 -- 172.21.15.17:0/4049698741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad34073510 con 0x7fad340ffda0 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.582+0000 7fad317fa640 1 -- 172.21.15.17:0/4049698741 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad24007ce0 con 0x7fad340ffda0 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.582+0000 7fad317fa640 1 -- 172.21.15.17:0/4049698741 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad24018810 con 0x7fad340ffda0 2024-08-19T01:13:48.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.582+0000 7fad3a60f640 1 -- 172.21.15.17:0/4049698741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad341a1f10 con 0x7fad340ffda0 2024-08-19T01:13:48.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.583+0000 7fad3a60f640 1 -- 172.21.15.17:0/4049698741 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad34101280 con 0x7fad340ffda0 2024-08-19T01:13:48.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.584+0000 7fad317fa640 1 -- 172.21.15.17:0/4049698741 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fad24018a80 con 0x7fad340ffda0 2024-08-19T01:13:48.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.584+0000 7fad317fa640 1 --2- 172.21.15.17:0/4049698741 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad1c06e180 0x7fad1c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.584+0000 7fad317fa640 1 -- 172.21.15.17:0/4049698741 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fad2408e350 con 0x7fad340ffda0 2024-08-19T01:13:48.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.584+0000 7fad337fe640 1 --2- 172.21.15.17:0/4049698741 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad1c06e180 0x7fad1c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.585+0000 7fad337fe640 1 --2- 172.21.15.17:0/4049698741 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad1c06e180 0x7fad1c070640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fad28009230 tx=0x7fad28005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:48.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.589+0000 7fad317fa640 1 -- 172.21.15.17:0/4049698741 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fad240576e0 con 0x7fad340ffda0 2024-08-19T01:13:48.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.773+0000 7fad3a60f640 1 -- 172.21.15.17:0/4049698741 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fad34073d80 con 0x7fad1c06e180 2024-08-19T01:13:48.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.782+0000 7fad317fa640 1 -- 172.21.15.17:0/4049698741 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fad34073d80 con 0x7fad1c06e180 2024-08-19T01:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (15m) 8m ago 25m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (25m) 8m ago 25m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (24m) 8m ago 24m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (12m) 8m ago 25m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:13:48.784 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (12m) 8m ago 24m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (14m) 8m ago 25m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (9m) 8m ago 20m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (9m) 8m ago 20m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (20m) 8m ago 20m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (8m) 8m ago 20m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (17m) 8m ago 27m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (15m) 8m ago 24m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (13m) 8m ago 27m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (13m) 8m ago 24m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (15m) 8m ago 25m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (15m) 8m ago 24m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (12m) 8m ago 23m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:13:48.785 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (11m) 8m ago 23m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (11m) 8m ago 23m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (10m) 8m ago 22m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (10m) 8m ago 22m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (9m) 8m ago 21m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:13:48.786 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (15m) 8m ago 25m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:13:48.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.784+0000 7fad3a60f640 1 -- 172.21.15.17:0/4049698741 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad1c06e180 msgr2=0x7fad1c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.784+0000 7fad3a60f640 1 --2- 172.21.15.17:0/4049698741 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad1c06e180 0x7fad1c070640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fad28009230 tx=0x7fad28005a20 comp rx=0 tx=0).stop 2024-08-19T01:13:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.784+0000 7fad3a60f640 1 -- 172.21.15.17:0/4049698741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad340ffda0 msgr2=0x7fad340727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.784+0000 7fad3a60f640 1 --2- 172.21.15.17:0/4049698741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad340ffda0 0x7fad340727b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fad2400c8a0 tx=0x7fad2400cd60 comp rx=0 tx=0).stop 2024-08-19T01:13:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.784+0000 7fad3a60f640 1 -- 172.21.15.17:0/4049698741 shutdown_connections 2024-08-19T01:13:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.784+0000 7fad3a60f640 1 --2- 172.21.15.17:0/4049698741 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad1c06e180 0x7fad1c070640 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.784+0000 7fad3a60f640 1 --2- 172.21.15.17:0/4049698741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad34100750 0x7fad34072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.784+0000 7fad3a60f640 1 --2- 172.21.15.17:0/4049698741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad340ffda0 0x7fad340727b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.784+0000 7fad3a60f640 1 -- 172.21.15.17:0/4049698741 >> 172.21.15.17:0/4049698741 conn(0x7fad340fb840 msgr2=0x7fad340fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.784+0000 7fad3a60f640 1 -- 172.21.15.17:0/4049698741 shutdown_connections 2024-08-19T01:13:48.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.784+0000 7fad3a60f640 1 -- 172.21.15.17:0/4049698741 wait complete. 2024-08-19T01:13:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.864+0000 7f4e4e552640 1 -- 172.21.15.17:0/1069005258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e481049f0 msgr2=0x7f4e48104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.864+0000 7f4e4e552640 1 --2- 172.21.15.17:0/1069005258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e481049f0 0x7f4e48104dd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009880 tx=0x7f4e3802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.865+0000 7f4e4e552640 1 -- 172.21.15.17:0/1069005258 shutdown_connections 2024-08-19T01:13:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.865+0000 7f4e4e552640 1 --2- 172.21.15.17:0/1069005258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e480fe9f0 0x7f4e480fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.865+0000 7f4e4e552640 1 --2- 172.21.15.17:0/1069005258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e481049f0 0x7f4e48104dd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.865+0000 7f4e4e552640 1 -- 172.21.15.17:0/1069005258 >> 172.21.15.17:0/1069005258 conn(0x7f4e480758a0 msgr2=0x7f4e480fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.865+0000 7f4e4e552640 1 -- 172.21.15.17:0/1069005258 shutdown_connections 2024-08-19T01:13:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.865+0000 7f4e4e552640 1 -- 172.21.15.17:0/1069005258 wait complete. 2024-08-19T01:13:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.865+0000 7f4e4e552640 1 Processor -- start 2024-08-19T01:13:48.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.865+0000 7f4e4e552640 1 -- start start 2024-08-19T01:13:48.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.866+0000 7f4e4e552640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e480fe9f0 0x7f4e4819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.866+0000 7f4e4e552640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e481049f0 0x7f4e4819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.866+0000 7f4e4e552640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e481958f0 con 0x7f4e481049f0 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.866+0000 7f4e4e552640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48195a30 con 0x7f4e480fe9f0 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.866+0000 7f4e477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e481049f0 0x7f4e4819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.866+0000 7f4e477fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e481049f0 0x7f4e4819bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54404/0 (socket says 172.21.15.17:54404) 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.866+0000 7f4e477fe640 1 -- 172.21.15.17:0/3910138465 learned_addr learned my addr 172.21.15.17:0/3910138465 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.866+0000 7f4e47fff640 1 --2- 172.21.15.17:0/3910138465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e480fe9f0 0x7f4e4819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.866+0000 7f4e477fe640 1 -- 172.21.15.17:0/3910138465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e480fe9f0 msgr2=0x7f4e4819b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.866+0000 7f4e477fe640 1 --2- 172.21.15.17:0/3910138465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e480fe9f0 0x7f4e4819b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.866+0000 7f4e477fe640 1 -- 172.21.15.17:0/3910138465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e38009560 con 0x7f4e481049f0 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.867+0000 7f4e477fe640 1 --2- 172.21.15.17:0/3910138465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e481049f0 0x7f4e4819bdd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00d8d0 tx=0x7f4e3c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.867+0000 7f4e457fa640 1 -- 172.21.15.17:0/3910138465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e3c00bea0 con 0x7f4e481049f0 2024-08-19T01:13:48.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.867+0000 7f4e457fa640 1 -- 172.21.15.17:0/3910138465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e3c009c00 con 0x7f4e481049f0 2024-08-19T01:13:48.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.867+0000 7f4e4e552640 1 -- 172.21.15.17:0/3910138465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e48195d10 con 0x7f4e481049f0 2024-08-19T01:13:48.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.867+0000 7f4e457fa640 1 -- 172.21.15.17:0/3910138465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e3c00f710 con 0x7f4e481049f0 2024-08-19T01:13:48.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.867+0000 7f4e4e552640 1 -- 172.21.15.17:0/3910138465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e48196260 con 0x7f4e481049f0 2024-08-19T01:13:48.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.868+0000 7f4e4e552640 1 -- 172.21.15.17:0/3910138465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e48100130 con 0x7f4e481049f0 2024-08-19T01:13:48.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.868+0000 7f4e457fa640 1 -- 172.21.15.17:0/3910138465 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4e3c00f990 con 0x7f4e481049f0 2024-08-19T01:13:48.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.869+0000 7f4e457fa640 1 --2- 172.21.15.17:0/3910138465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e3006e170 0x7f4e30070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:48.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.869+0000 7f4e457fa640 1 -- 172.21.15.17:0/3910138465 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4e3c08de70 con 0x7f4e481049f0 2024-08-19T01:13:48.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.869+0000 7f4e47fff640 1 --2- 172.21.15.17:0/3910138465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e3006e170 0x7f4e30070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:48.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.870+0000 7f4e47fff640 1 --2- 172.21.15.17:0/3910138465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e3006e170 0x7f4e30070630 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009230 tx=0x7f4e380058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:48.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:48.874+0000 7f4e457fa640 1 -- 172.21.15.17:0/3910138465 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4e3c057200 con 0x7f4e481049f0 2024-08-19T01:13:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.118+0000 7f4e4e552640 1 -- 172.21.15.17:0/3910138465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4e4810bc60 con 0x7f4e481049f0 2024-08-19T01:13:49.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.118+0000 7f4e457fa640 1 -- 172.21.15.17:0/3910138465 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f4e3c05a8c0 con 0x7f4e481049f0 2024-08-19T01:13:49.120 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:13:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:13:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:13:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:13:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:13:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:13:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:13:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:13:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:13:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:13:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:13:49.121 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:13:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:13:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:13:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:13:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:13:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:13:49.122 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:13:49.122 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:13:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.121+0000 7f4e4e552640 1 -- 172.21.15.17:0/3910138465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e3006e170 msgr2=0x7f4e30070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.121+0000 7f4e4e552640 1 --2- 172.21.15.17:0/3910138465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e3006e170 0x7f4e30070630 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4e38009230 tx=0x7f4e380058d0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.121+0000 7f4e4e552640 1 -- 172.21.15.17:0/3910138465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e481049f0 msgr2=0x7f4e4819bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.121+0000 7f4e4e552640 1 --2- 172.21.15.17:0/3910138465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e481049f0 0x7f4e4819bdd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00d8d0 tx=0x7f4e3c00dd90 comp rx=0 tx=0).stop 2024-08-19T01:13:49.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.121+0000 7f4e4e552640 1 -- 172.21.15.17:0/3910138465 shutdown_connections 2024-08-19T01:13:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.121+0000 7f4e4e552640 1 --2- 172.21.15.17:0/3910138465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e3006e170 0x7f4e30070630 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.121+0000 7f4e4e552640 1 --2- 172.21.15.17:0/3910138465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e481049f0 0x7f4e4819bdd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.121+0000 7f4e4e552640 1 --2- 172.21.15.17:0/3910138465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e480fe9f0 0x7f4e4819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.121+0000 7f4e4e552640 1 -- 172.21.15.17:0/3910138465 >> 172.21.15.17:0/3910138465 conn(0x7f4e480758a0 msgr2=0x7f4e48067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.121+0000 7f4e4e552640 1 -- 172.21.15.17:0/3910138465 shutdown_connections 2024-08-19T01:13:49.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.121+0000 7f4e4e552640 1 -- 172.21.15.17:0/3910138465 wait complete. 2024-08-19T01:13:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.202+0000 7f912b372640 1 -- 172.21.15.17:0/1637544335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91240fe9f0 msgr2=0x7f91240fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.202+0000 7f912b372640 1 --2- 172.21.15.17:0/1637544335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91240fe9f0 0x7f91240fee50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9118009880 tx=0x7f911802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.203+0000 7f912b372640 1 -- 172.21.15.17:0/1637544335 shutdown_connections 2024-08-19T01:13:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.203+0000 7f912b372640 1 --2- 172.21.15.17:0/1637544335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91240fe9f0 0x7f91240fee50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.203+0000 7f912b372640 1 --2- 172.21.15.17:0/1637544335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91241049f0 0x7f9124104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.203+0000 7f912b372640 1 -- 172.21.15.17:0/1637544335 >> 172.21.15.17:0/1637544335 conn(0x7f91240758a0 msgr2=0x7f91240fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.203+0000 7f912b372640 1 -- 172.21.15.17:0/1637544335 shutdown_connections 2024-08-19T01:13:49.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.203+0000 7f912b372640 1 -- 172.21.15.17:0/1637544335 wait complete. 2024-08-19T01:13:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.203+0000 7f912b372640 1 Processor -- start 2024-08-19T01:13:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.203+0000 7f912b372640 1 -- start start 2024-08-19T01:13:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912b372640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91240fe9f0 0x7f912419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912b372640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91241049f0 0x7f912419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912b372640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9124195900 con 0x7f91240fe9f0 2024-08-19T01:13:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912b372640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9124195a40 con 0x7f91241049f0 2024-08-19T01:13:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912910e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91240fe9f0 0x7f912419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912910e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91240fe9f0 0x7f912419b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54412/0 (socket says 172.21.15.17:54412) 2024-08-19T01:13:49.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912910e640 1 -- 172.21.15.17:0/3375680402 learned_addr learned my addr 172.21.15.17:0/3375680402 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912890d640 1 --2- 172.21.15.17:0/3375680402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91241049f0 0x7f912419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912910e640 1 -- 172.21.15.17:0/3375680402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91241049f0 msgr2=0x7f912419bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912910e640 1 --2- 172.21.15.17:0/3375680402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91241049f0 0x7f912419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912910e640 1 -- 172.21.15.17:0/3375680402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118009560 con 0x7f91240fe9f0 2024-08-19T01:13:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912910e640 1 --2- 172.21.15.17:0/3375680402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91240fe9f0 0x7f912419b8a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f912000d6f0 tx=0x7f912000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f91167fc640 1 -- 172.21.15.17:0/3375680402 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9120009a30 con 0x7f91240fe9f0 2024-08-19T01:13:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f91167fc640 1 -- 172.21.15.17:0/3375680402 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91200054e0 con 0x7f91240fe9f0 2024-08-19T01:13:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912b372640 1 -- 172.21.15.17:0/3375680402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9124195d20 con 0x7f91240fe9f0 2024-08-19T01:13:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f91167fc640 1 -- 172.21.15.17:0/3375680402 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9120010460 con 0x7f91240fe9f0 2024-08-19T01:13:49.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.204+0000 7f912b372640 1 -- 172.21.15.17:0/3375680402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9124196270 con 0x7f91240fe9f0 2024-08-19T01:13:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.205+0000 7f912b372640 1 -- 172.21.15.17:0/3375680402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9124100130 con 0x7f91240fe9f0 2024-08-19T01:13:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.206+0000 7f91167fc640 1 -- 172.21.15.17:0/3375680402 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9120009b90 con 0x7f91240fe9f0 2024-08-19T01:13:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.206+0000 7f91167fc640 1 --2- 172.21.15.17:0/3375680402 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f911006e170 0x7f9110070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.207+0000 7f91167fc640 1 -- 172.21.15.17:0/3375680402 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f912008dc80 con 0x7f91240fe9f0 2024-08-19T01:13:49.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.207+0000 7f912890d640 1 --2- 172.21.15.17:0/3375680402 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f911006e170 0x7f9110070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:49.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.207+0000 7f912890d640 1 --2- 172.21.15.17:0/3375680402 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f911006e170 0x7f9110070630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9118000c00 tx=0x7f9118004040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:49.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.211+0000 7f91167fc640 1 -- 172.21.15.17:0/3375680402 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9120056fe0 con 0x7f91240fe9f0 2024-08-19T01:13:49.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.422+0000 7f912b372640 1 -- 172.21.15.17:0/3375680402 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f91240fee50 con 0x7f91240fe9f0 2024-08-19T01:13:49.424 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:49 smithi017 ceph-mon[99370]: from='client.34876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:49.424 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:49 smithi017 ceph-mon[99370]: from='client.34880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:49.424 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:49 smithi017 ceph-mon[99370]: from='client.34884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:49.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.422+0000 7f91167fc640 1 -- 172.21.15.17:0/3375680402 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f9120020070 con 0x7f91240fe9f0 2024-08-19T01:13:49.425 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:13:49.425 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:13:49.425 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:13:49.425 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:13:49.425 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:13:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:13:49.425 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:13:49.425 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:13:49.425 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:13:49.425 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:13:49.426 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:13:49.427 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:13:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:13:49.428 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:13:49.428 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:13:49.428 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:13:49.428 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:13:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:13:49.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.425+0000 7f912b372640 1 -- 172.21.15.17:0/3375680402 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f911006e170 msgr2=0x7f9110070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.425+0000 7f912b372640 1 --2- 172.21.15.17:0/3375680402 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f911006e170 0x7f9110070630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9118000c00 tx=0x7f9118004040 comp rx=0 tx=0).stop 2024-08-19T01:13:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.425+0000 7f912b372640 1 -- 172.21.15.17:0/3375680402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91240fe9f0 msgr2=0x7f912419b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.425+0000 7f912b372640 1 --2- 172.21.15.17:0/3375680402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91240fe9f0 0x7f912419b8a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f912000d6f0 tx=0x7f912000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.425+0000 7f912b372640 1 -- 172.21.15.17:0/3375680402 shutdown_connections 2024-08-19T01:13:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.425+0000 7f912b372640 1 --2- 172.21.15.17:0/3375680402 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f911006e170 0x7f9110070630 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.425+0000 7f912b372640 1 --2- 172.21.15.17:0/3375680402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91241049f0 0x7f912419bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.425+0000 7f912b372640 1 --2- 172.21.15.17:0/3375680402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91240fe9f0 0x7f912419b8a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.425+0000 7f912b372640 1 -- 172.21.15.17:0/3375680402 >> 172.21.15.17:0/3375680402 conn(0x7f91240758a0 msgr2=0x7f91240fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.425+0000 7f912b372640 1 -- 172.21.15.17:0/3375680402 shutdown_connections 2024-08-19T01:13:49.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.425+0000 7f912b372640 1 -- 172.21.15.17:0/3375680402 wait complete. 2024-08-19T01:13:49.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:49 smithi086 ceph-mon[71303]: from='client.34876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:49.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:49 smithi086 ceph-mon[71303]: from='client.34880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:49.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:49 smithi086 ceph-mon[71303]: from='client.34884 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.508+0000 7fade77b1640 1 -- 172.21.15.17:0/3639329519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade0100750 msgr2=0x7fade01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.508+0000 7fade77b1640 1 --2- 172.21.15.17:0/3639329519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade0100750 0x7fade01047a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009880 tx=0x7fadd402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.508+0000 7fade77b1640 1 -- 172.21.15.17:0/3639329519 shutdown_connections 2024-08-19T01:13:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.508+0000 7fade77b1640 1 --2- 172.21.15.17:0/3639329519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade0100750 0x7fade01047a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.508+0000 7fade77b1640 1 --2- 172.21.15.17:0/3639329519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fade00ffda0 0x7fade0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.508+0000 7fade77b1640 1 -- 172.21.15.17:0/3639329519 >> 172.21.15.17:0/3639329519 conn(0x7fade00fb840 msgr2=0x7fade00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.508+0000 7fade77b1640 1 -- 172.21.15.17:0/3639329519 shutdown_connections 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.508+0000 7fade77b1640 1 -- 172.21.15.17:0/3639329519 wait complete. 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.509+0000 7fade77b1640 1 Processor -- start 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.509+0000 7fade77b1640 1 -- start start 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.509+0000 7fade77b1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade00ffda0 0x7fade019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.509+0000 7fade77b1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fade0100750 0x7fade019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.509+0000 7fade77b1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade0195930 con 0x7fade00ffda0 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.509+0000 7fade77b1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade0195a70 con 0x7fade0100750 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.509+0000 7fade554d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade00ffda0 0x7fade019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:49.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.509+0000 7fade554d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade00ffda0 0x7fade019b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54432/0 (socket says 172.21.15.17:54432) 2024-08-19T01:13:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.509+0000 7fade554d640 1 -- 172.21.15.17:0/953075725 learned_addr learned my addr 172.21.15.17:0/953075725 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:49.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.510+0000 7fade4d4c640 1 --2- 172.21.15.17:0/953075725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fade0100750 0x7fade019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.510+0000 7fade554d640 1 -- 172.21.15.17:0/953075725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fade0100750 msgr2=0x7fade019be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.510+0000 7fade554d640 1 --2- 172.21.15.17:0/953075725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fade0100750 0x7fade019be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.510+0000 7fade554d640 1 -- 172.21.15.17:0/953075725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd4009560 con 0x7fade00ffda0 2024-08-19T01:13:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.510+0000 7fade554d640 1 --2- 172.21.15.17:0/953075725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade00ffda0 0x7fade019b8d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fadd000cc60 tx=0x7fadd000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.510+0000 7fadde7fc640 1 -- 172.21.15.17:0/953075725 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadd0004b20 con 0x7fade00ffda0 2024-08-19T01:13:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.510+0000 7fade77b1640 1 -- 172.21.15.17:0/953075725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade0195d50 con 0x7fade00ffda0 2024-08-19T01:13:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.510+0000 7fadde7fc640 1 -- 172.21.15.17:0/953075725 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadd0004c80 con 0x7fade00ffda0 2024-08-19T01:13:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.510+0000 7fadde7fc640 1 -- 172.21.15.17:0/953075725 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadd000f640 con 0x7fade00ffda0 2024-08-19T01:13:49.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.510+0000 7fade77b1640 1 -- 172.21.15.17:0/953075725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade0196270 con 0x7fade00ffda0 2024-08-19T01:13:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.511+0000 7fade77b1640 1 -- 172.21.15.17:0/953075725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade0101280 con 0x7fade00ffda0 2024-08-19T01:13:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.512+0000 7fadde7fc640 1 -- 172.21.15.17:0/953075725 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fadd00055e0 con 0x7fade00ffda0 2024-08-19T01:13:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.512+0000 7fadde7fc640 1 --2- 172.21.15.17:0/953075725 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fadc806e180 0x7fadc8070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.512+0000 7fadde7fc640 1 -- 172.21.15.17:0/953075725 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fadd008e310 con 0x7fade00ffda0 2024-08-19T01:13:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.512+0000 7fade4d4c640 1 --2- 172.21.15.17:0/953075725 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fadc806e180 0x7fadc8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.513+0000 7fade4d4c640 1 --2- 172.21.15.17:0/953075725 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fadc806e180 0x7fadc8070640 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009230 tx=0x7fadd4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:49.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.516+0000 7fadde7fc640 1 -- 172.21.15.17:0/953075725 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fadd00576a0 con 0x7fade00ffda0 2024-08-19T01:13:49.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.707+0000 7fade77b1640 1 -- 172.21.15.17:0/953075725 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fade010cdd0 con 0x7fadc806e180 2024-08-19T01:13:49.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.708+0000 7fadde7fc640 1 -- 172.21.15.17:0/953075725 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fade010cdd0 con 0x7fadc806e180 2024-08-19T01:13:49.710 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:13:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:13:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:13:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:13:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:13:49.710 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:13:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:13:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:13:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:13:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:13:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:13:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:13:49.711 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:13:49.711 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:13:49.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.710+0000 7fade77b1640 1 -- 172.21.15.17:0/953075725 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fadc806e180 msgr2=0x7fadc8070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.710+0000 7fade77b1640 1 --2- 172.21.15.17:0/953075725 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fadc806e180 0x7fadc8070640 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009230 tx=0x7fadd4005a20 comp rx=0 tx=0).stop 2024-08-19T01:13:49.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.710+0000 7fade77b1640 1 -- 172.21.15.17:0/953075725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade00ffda0 msgr2=0x7fade019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.710+0000 7fade77b1640 1 --2- 172.21.15.17:0/953075725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade00ffda0 0x7fade019b8d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fadd000cc60 tx=0x7fadd000a620 comp rx=0 tx=0).stop 2024-08-19T01:13:49.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.710+0000 7fade77b1640 1 -- 172.21.15.17:0/953075725 shutdown_connections 2024-08-19T01:13:49.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.710+0000 7fade77b1640 1 --2- 172.21.15.17:0/953075725 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fadc806e180 0x7fadc8070640 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.710+0000 7fade77b1640 1 --2- 172.21.15.17:0/953075725 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fade0100750 0x7fade019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.710+0000 7fade77b1640 1 --2- 172.21.15.17:0/953075725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fade00ffda0 0x7fade019b8d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.710+0000 7fade77b1640 1 -- 172.21.15.17:0/953075725 >> 172.21.15.17:0/953075725 conn(0x7fade00fb840 msgr2=0x7fade00fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:49.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.710+0000 7fade77b1640 1 -- 172.21.15.17:0/953075725 shutdown_connections 2024-08-19T01:13:49.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.710+0000 7fade77b1640 1 -- 172.21.15.17:0/953075725 wait complete. 2024-08-19T01:13:49.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.792+0000 7f1ab2633640 1 -- 172.21.15.17:0/395252402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aac100750 msgr2=0x7f1aac1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.792+0000 7f1ab2633640 1 --2- 172.21.15.17:0/395252402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aac100750 0x7f1aac1047a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009880 tx=0x7f1aa002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.792+0000 7f1ab2633640 1 -- 172.21.15.17:0/395252402 shutdown_connections 2024-08-19T01:13:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.792+0000 7f1ab2633640 1 --2- 172.21.15.17:0/395252402 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aac100750 0x7f1aac1047a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.792+0000 7f1ab2633640 1 --2- 172.21.15.17:0/395252402 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1aac0ffda0 0x7f1aac100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.792+0000 7f1ab2633640 1 -- 172.21.15.17:0/395252402 >> 172.21.15.17:0/395252402 conn(0x7f1aac0fb840 msgr2=0x7f1aac0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.792+0000 7f1ab2633640 1 -- 172.21.15.17:0/395252402 shutdown_connections 2024-08-19T01:13:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.792+0000 7f1ab2633640 1 -- 172.21.15.17:0/395252402 wait complete. 2024-08-19T01:13:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.793+0000 7f1ab2633640 1 Processor -- start 2024-08-19T01:13:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.793+0000 7f1ab2633640 1 -- start start 2024-08-19T01:13:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.793+0000 7f1ab2633640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1aac0ffda0 0x7f1aac19d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:49.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.793+0000 7f1ab2633640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aac100750 0x7f1aac19dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:49.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.793+0000 7f1ab2633640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac19e570 con 0x7f1aac100750 2024-08-19T01:13:49.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.793+0000 7f1ab2633640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac197b40 con 0x7f1aac0ffda0 2024-08-19T01:13:49.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.793+0000 7f1aab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aac100750 0x7f1aac19dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:49.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.793+0000 7f1aab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aac100750 0x7f1aac19dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54452/0 (socket says 172.21.15.17:54452) 2024-08-19T01:13:49.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.793+0000 7f1aab7fe640 1 -- 172.21.15.17:0/108147603 learned_addr learned my addr 172.21.15.17:0/108147603 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:13:49.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.793+0000 7f1aabfff640 1 --2- 172.21.15.17:0/108147603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1aac0ffda0 0x7f1aac19d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:49.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.794+0000 7f1aab7fe640 1 -- 172.21.15.17:0/108147603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1aac0ffda0 msgr2=0x7f1aac19d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:49.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.794+0000 7f1aab7fe640 1 --2- 172.21.15.17:0/108147603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1aac0ffda0 0x7f1aac19d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:49.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.794+0000 7f1aab7fe640 1 -- 172.21.15.17:0/108147603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa0009560 con 0x7f1aac100750 2024-08-19T01:13:49.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.794+0000 7f1aab7fe640 1 --2- 172.21.15.17:0/108147603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aac100750 0x7f1aac19dee0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1aa002a9c0 tx=0x7f1aa00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.794+0000 7f1aa97fa640 1 -- 172.21.15.17:0/108147603 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aa0004aa0 con 0x7f1aac100750 2024-08-19T01:13:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.794+0000 7f1aa97fa640 1 -- 172.21.15.17:0/108147603 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1aa0004c00 con 0x7f1aac100750 2024-08-19T01:13:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.794+0000 7f1ab2633640 1 -- 172.21.15.17:0/108147603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac197dc0 con 0x7f1aac100750 2024-08-19T01:13:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.794+0000 7f1aa97fa640 1 -- 172.21.15.17:0/108147603 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1aa0003980 con 0x7f1aac100750 2024-08-19T01:13:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.794+0000 7f1ab2633640 1 -- 172.21.15.17:0/108147603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac1982b0 con 0x7f1aac100750 2024-08-19T01:13:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.795+0000 7f1ab2633640 1 -- 172.21.15.17:0/108147603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac101280 con 0x7f1aac100750 2024-08-19T01:13:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.796+0000 7f1aa97fa640 1 -- 172.21.15.17:0/108147603 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1aa0003bf0 con 0x7f1aac100750 2024-08-19T01:13:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.796+0000 7f1aa97fa640 1 --2- 172.21.15.17:0/108147603 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9406e170 0x7f1a94070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:13:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.796+0000 7f1aa97fa640 1 -- 172.21.15.17:0/108147603 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1aa00af160 con 0x7f1aac100750 2024-08-19T01:13:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.796+0000 7f1aabfff640 1 --2- 172.21.15.17:0/108147603 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9406e170 0x7f1a94070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:13:49.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.797+0000 7f1aabfff640 1 --2- 172.21.15.17:0/108147603 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9406e170 0x7f1a94070630 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c005d00 tx=0x7f1a9c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:13:49.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:49.801+0000 7f1aa97fa640 1 -- 172.21.15.17:0/108147603 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1aa00784f0 con 0x7f1aac100750 2024-08-19T01:13:50.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.042+0000 7f1ab2633640 1 -- 172.21.15.17:0/108147603 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1aac100180 con 0x7f1aac100750 2024-08-19T01:13:50.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.042+0000 7f1aa97fa640 1 -- 172.21.15.17:0/108147603 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f1aa007bbb0 con 0x7f1aac100750 2024-08-19T01:13:50.044 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:13:50.044 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:13:50.045 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:13:50.045 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:13:50.045 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:13:50.045 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:13:50.045 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:13:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.045+0000 7f1ab2633640 1 -- 172.21.15.17:0/108147603 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9406e170 msgr2=0x7f1a94070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.045+0000 7f1ab2633640 1 --2- 172.21.15.17:0/108147603 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9406e170 0x7f1a94070630 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c005d00 tx=0x7f1a9c00b410 comp rx=0 tx=0).stop 2024-08-19T01:13:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.045+0000 7f1ab2633640 1 -- 172.21.15.17:0/108147603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aac100750 msgr2=0x7f1aac19dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:13:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.045+0000 7f1ab2633640 1 --2- 172.21.15.17:0/108147603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aac100750 0x7f1aac19dee0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1aa002a9c0 tx=0x7f1aa00055a0 comp rx=0 tx=0).stop 2024-08-19T01:13:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.045+0000 7f1ab2633640 1 -- 172.21.15.17:0/108147603 shutdown_connections 2024-08-19T01:13:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.045+0000 7f1ab2633640 1 --2- 172.21.15.17:0/108147603 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a9406e170 0x7f1a94070630 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.045+0000 7f1ab2633640 1 --2- 172.21.15.17:0/108147603 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1aac100750 0x7f1aac19dee0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.045+0000 7f1ab2633640 1 --2- 172.21.15.17:0/108147603 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1aac0ffda0 0x7f1aac19d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:13:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.045+0000 7f1ab2633640 1 -- 172.21.15.17:0/108147603 >> 172.21.15.17:0/108147603 conn(0x7f1aac0fb840 msgr2=0x7f1aac0fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:13:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.045+0000 7f1ab2633640 1 -- 172.21.15.17:0/108147603 shutdown_connections 2024-08-19T01:13:50.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:13:50.045+0000 7f1ab2633640 1 -- 172.21.15.17:0/108147603 wait complete. 2024-08-19T01:13:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:50 smithi017 ceph-mon[99370]: pgmap v451: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:50 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3910138465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:13:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:50 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3375680402' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:13:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:50 smithi017 ceph-mon[99370]: from='client.34896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:50 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/108147603' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:13:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:50 smithi086 ceph-mon[71303]: pgmap v451: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:50 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3910138465' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:13:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:50 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3375680402' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:13:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:50 smithi086 ceph-mon[71303]: from='client.34896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:13:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:50 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/108147603' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:13:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:52 smithi017 ceph-mon[99370]: pgmap v452: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:52.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:52 smithi086 ceph-mon[71303]: pgmap v452: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:54 smithi017 ceph-mon[99370]: pgmap v453: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:54.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:54 smithi086 ceph-mon[71303]: pgmap v453: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:56.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:56 smithi017 ceph-mon[99370]: pgmap v454: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:56.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:56 smithi086 ceph-mon[71303]: pgmap v454: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:13:58 smithi017 ceph-mon[99370]: pgmap v455: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:13:58.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:13:58 smithi086 ceph-mon[71303]: pgmap v455: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:00 smithi017 ceph-mon[99370]: pgmap v456: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:00.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:00 smithi086 ceph-mon[71303]: pgmap v456: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:02 smithi017 ceph-mon[99370]: pgmap v457: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:02.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:02 smithi086 ceph-mon[71303]: pgmap v457: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:03.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:14:03.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:14:04.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:04 smithi017 ceph-mon[99370]: pgmap v458: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:04.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:04 smithi086 ceph-mon[71303]: pgmap v458: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:06.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:06 smithi017 ceph-mon[99370]: pgmap v459: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:06.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:06 smithi086 ceph-mon[71303]: pgmap v459: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:08 smithi017 ceph-mon[99370]: pgmap v460: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:08.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:08 smithi086 ceph-mon[71303]: pgmap v460: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:10.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:10 smithi017 ceph-mon[99370]: pgmap v461: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:10.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:10 smithi086 ceph-mon[71303]: pgmap v461: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:12.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:12 smithi017 ceph-mon[99370]: pgmap v462: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:12.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:12 smithi086 ceph-mon[71303]: pgmap v462: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:14.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:14 smithi017 ceph-mon[99370]: pgmap v463: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:14.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:14 smithi086 ceph-mon[71303]: pgmap v463: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:16.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:16 smithi017 ceph-mon[99370]: pgmap v464: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:16.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:16 smithi086 ceph-mon[71303]: pgmap v464: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:18 smithi017 ceph-mon[99370]: pgmap v465: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:14:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:18 smithi086 ceph-mon[71303]: pgmap v465: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:14:20.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.141+0000 7ff782fe0640 1 -- 172.21.15.17:0/4177323422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101610 msgr2=0x7ff77c109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.141+0000 7ff782fe0640 1 --2- 172.21.15.17:0/4177323422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101610 0x7ff77c109b00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff7680098b0 tx=0x7ff76802a4d0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.141+0000 7ff782fe0640 1 -- 172.21.15.17:0/4177323422 shutdown_connections 2024-08-19T01:14:20.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.141+0000 7ff782fe0640 1 --2- 172.21.15.17:0/4177323422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101610 0x7ff77c109b00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.141+0000 7ff782fe0640 1 --2- 172.21.15.17:0/4177323422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff77c100c60 0x7ff77c101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.141+0000 7ff782fe0640 1 -- 172.21.15.17:0/4177323422 >> 172.21.15.17:0/4177323422 conn(0x7ff77c0fa730 msgr2=0x7ff77c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.141+0000 7ff782fe0640 1 -- 172.21.15.17:0/4177323422 shutdown_connections 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.141+0000 7ff782fe0640 1 -- 172.21.15.17:0/4177323422 wait complete. 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.141+0000 7ff782fe0640 1 Processor -- start 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.141+0000 7ff782fe0640 1 -- start start 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff782fe0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff77c100c60 0x7ff77c0fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff782fe0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101610 0x7ff77c0fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff782fe0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0ff3d0 con 0x7ff77c101610 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff782fe0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0ff540 con 0x7ff77c100c60 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101610 0x7ff77c0fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101610 0x7ff77c0fee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44088/0 (socket says 172.21.15.17:44088) 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff77bfff640 1 -- 172.21.15.17:0/2466011696 learned_addr learned my addr 172.21.15.17:0/2466011696 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff780d7c640 1 --2- 172.21.15.17:0/2466011696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff77c100c60 0x7ff77c0fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff77bfff640 1 -- 172.21.15.17:0/2466011696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff77c100c60 msgr2=0x7ff77c0fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff77bfff640 1 --2- 172.21.15.17:0/2466011696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff77c100c60 0x7ff77c0fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff77bfff640 1 -- 172.21.15.17:0/2466011696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff768009560 con 0x7ff77c101610 2024-08-19T01:14:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.142+0000 7ff77bfff640 1 --2- 172.21.15.17:0/2466011696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101610 0x7ff77c0fee90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff768009230 tx=0x7ff7680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.143+0000 7ff779ffb640 1 -- 172.21.15.17:0/2466011696 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff768004aa0 con 0x7ff77c101610 2024-08-19T01:14:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.143+0000 7ff779ffb640 1 -- 172.21.15.17:0/2466011696 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff768031470 con 0x7ff77c101610 2024-08-19T01:14:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.143+0000 7ff782fe0640 1 -- 172.21.15.17:0/2466011696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77c0ff7c0 con 0x7ff77c101610 2024-08-19T01:14:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.143+0000 7ff779ffb640 1 -- 172.21.15.17:0/2466011696 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7680039e0 con 0x7ff77c101610 2024-08-19T01:14:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.143+0000 7ff782fe0640 1 -- 172.21.15.17:0/2466011696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c1a1f70 con 0x7ff77c101610 2024-08-19T01:14:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.144+0000 7ff782fe0640 1 -- 172.21.15.17:0/2466011696 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c068d30 con 0x7ff77c101610 2024-08-19T01:14:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.145+0000 7ff779ffb640 1 -- 172.21.15.17:0/2466011696 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff768003c50 con 0x7ff77c101610 2024-08-19T01:14:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.145+0000 7ff779ffb640 1 --2- 172.21.15.17:0/2466011696 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff76c06e180 0x7ff76c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:20.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.145+0000 7ff779ffb640 1 -- 172.21.15.17:0/2466011696 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff7680aefc0 con 0x7ff77c101610 2024-08-19T01:14:20.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.145+0000 7ff780d7c640 1 --2- 172.21.15.17:0/2466011696 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff76c06e180 0x7ff76c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:20.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.146+0000 7ff780d7c640 1 --2- 172.21.15.17:0/2466011696 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff76c06e180 0x7ff76c070640 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff770005fd0 tx=0x7ff770005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:20.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.150+0000 7ff779ffb640 1 -- 172.21.15.17:0/2466011696 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff768078320 con 0x7ff77c101610 2024-08-19T01:14:20.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.344+0000 7ff782fe0640 1 -- 172.21.15.17:0/2466011696 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff77c0ff7c0 con 0x7ff76c06e180 2024-08-19T01:14:20.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.345+0000 7ff779ffb640 1 -- 172.21.15.17:0/2466011696 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff77c0ff7c0 con 0x7ff76c06e180 2024-08-19T01:14:20.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.347+0000 7ff782fe0640 1 -- 172.21.15.17:0/2466011696 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff76c06e180 msgr2=0x7ff76c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.347+0000 7ff782fe0640 1 --2- 172.21.15.17:0/2466011696 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff76c06e180 0x7ff76c070640 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff770005fd0 tx=0x7ff770005850 comp rx=0 tx=0).stop 2024-08-19T01:14:20.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.347+0000 7ff782fe0640 1 -- 172.21.15.17:0/2466011696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101610 msgr2=0x7ff77c0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.347+0000 7ff782fe0640 1 --2- 172.21.15.17:0/2466011696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101610 0x7ff77c0fee90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff768009230 tx=0x7ff7680055a0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.347+0000 7ff782fe0640 1 -- 172.21.15.17:0/2466011696 shutdown_connections 2024-08-19T01:14:20.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.347+0000 7ff782fe0640 1 --2- 172.21.15.17:0/2466011696 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff76c06e180 0x7ff76c070640 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.347+0000 7ff782fe0640 1 --2- 172.21.15.17:0/2466011696 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff77c101610 0x7ff77c0fee90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.347+0000 7ff782fe0640 1 --2- 172.21.15.17:0/2466011696 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff77c100c60 0x7ff77c0fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.347+0000 7ff782fe0640 1 -- 172.21.15.17:0/2466011696 >> 172.21.15.17:0/2466011696 conn(0x7ff77c0fa730 msgr2=0x7ff77c101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:20.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.347+0000 7ff782fe0640 1 -- 172.21.15.17:0/2466011696 shutdown_connections 2024-08-19T01:14:20.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.347+0000 7ff782fe0640 1 -- 172.21.15.17:0/2466011696 wait complete. 2024-08-19T01:14:20.358 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:14:20.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.429+0000 7f74c2b81640 1 -- 172.21.15.17:0/96972195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc0ffda0 msgr2=0x7f74bc100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.430+0000 7f74c2b81640 1 --2- 172.21.15.17:0/96972195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc0ffda0 0x7f74bc100180 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009880 tx=0x7f74b002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.430+0000 7f74c2b81640 1 -- 172.21.15.17:0/96972195 shutdown_connections 2024-08-19T01:14:20.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.430+0000 7f74c2b81640 1 --2- 172.21.15.17:0/96972195 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc100750 0x7f74bc1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.430+0000 7f74c2b81640 1 --2- 172.21.15.17:0/96972195 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc0ffda0 0x7f74bc100180 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.430+0000 7f74c2b81640 1 -- 172.21.15.17:0/96972195 >> 172.21.15.17:0/96972195 conn(0x7f74bc0fb840 msgr2=0x7f74bc0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:20.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:20 smithi017 ceph-mon[99370]: pgmap v466: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:20.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.430+0000 7f74c2b81640 1 -- 172.21.15.17:0/96972195 shutdown_connections 2024-08-19T01:14:20.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.430+0000 7f74c2b81640 1 -- 172.21.15.17:0/96972195 wait complete. 2024-08-19T01:14:20.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.430+0000 7f74c2b81640 1 Processor -- start 2024-08-19T01:14:20.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.430+0000 7f74c2b81640 1 -- start start 2024-08-19T01:14:20.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74c2b81640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc0ffda0 0x7f74bc19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:20.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74c2b81640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100750 0x7f74bc19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:20.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74c2b81640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc195a10 con 0x7f74bc100750 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74c2b81640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc195b50 con 0x7f74bc0ffda0 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100750 0x7f74bc19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74bbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100750 0x7f74bc19bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44114/0 (socket says 172.21.15.17:44114) 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74bbfff640 1 -- 172.21.15.17:0/3524104494 learned_addr learned my addr 172.21.15.17:0/3524104494 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74c091d640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc0ffda0 0x7f74bc19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74bbfff640 1 -- 172.21.15.17:0/3524104494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc0ffda0 msgr2=0x7f74bc19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74bbfff640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc0ffda0 0x7f74bc19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74bbfff640 1 -- 172.21.15.17:0/3524104494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0009560 con 0x7f74bc100750 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74c091d640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc0ffda0 0x7f74bc19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.431+0000 7f74bbfff640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100750 0x7f74bc19bef0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f74a800d6f0 tx=0x7f74a800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.432+0000 7f74b9ffb640 1 -- 172.21.15.17:0/3524104494 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74a8009a30 con 0x7f74bc100750 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.432+0000 7f74b9ffb640 1 -- 172.21.15.17:0/3524104494 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74a80054e0 con 0x7f74bc100750 2024-08-19T01:14:20.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.432+0000 7f74c2b81640 1 -- 172.21.15.17:0/3524104494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74bc195e30 con 0x7f74bc100750 2024-08-19T01:14:20.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.432+0000 7f74b9ffb640 1 -- 172.21.15.17:0/3524104494 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74a8010460 con 0x7f74bc100750 2024-08-19T01:14:20.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.432+0000 7f74c2b81640 1 -- 172.21.15.17:0/3524104494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc196380 con 0x7f74bc100750 2024-08-19T01:14:20.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.433+0000 7f74c2b81640 1 -- 172.21.15.17:0/3524104494 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74bc101280 con 0x7f74bc100750 2024-08-19T01:14:20.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.433+0000 7f74b9ffb640 1 -- 172.21.15.17:0/3524104494 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f74a8009b90 con 0x7f74bc100750 2024-08-19T01:14:20.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.434+0000 7f74b9ffb640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74ac06e180 0x7f74ac070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:20.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.434+0000 7f74b9ffb640 1 -- 172.21.15.17:0/3524104494 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f74a808ddd0 con 0x7f74bc100750 2024-08-19T01:14:20.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.434+0000 7f74c091d640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74ac06e180 0x7f74ac070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:20.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.434+0000 7f74c091d640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74ac06e180 0x7f74ac070640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f74b0000c00 tx=0x7f74b0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:20.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.438+0000 7f74b9ffb640 1 -- 172.21.15.17:0/3524104494 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f74a8057010 con 0x7f74bc100750 2024-08-19T01:14:20.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:20 smithi086 ceph-mon[71303]: pgmap v466: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:20.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.633+0000 7f74c2b81640 1 -- 172.21.15.17:0/3524104494 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74bc196fe0 con 0x7f74ac06e180 2024-08-19T01:14:20.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.634+0000 7f74b9ffb640 1 -- 172.21.15.17:0/3524104494 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f74bc196fe0 con 0x7f74ac06e180 2024-08-19T01:14:20.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.636+0000 7f74c2b81640 1 -- 172.21.15.17:0/3524104494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74ac06e180 msgr2=0x7f74ac070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.636+0000 7f74c2b81640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74ac06e180 0x7f74ac070640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f74b0000c00 tx=0x7f74b0005a20 comp rx=0 tx=0).stop 2024-08-19T01:14:20.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.636+0000 7f74c2b81640 1 -- 172.21.15.17:0/3524104494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100750 msgr2=0x7f74bc19bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.636+0000 7f74c2b81640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100750 0x7f74bc19bef0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f74a800d6f0 tx=0x7f74a800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.636+0000 7f74c2b81640 1 -- 172.21.15.17:0/3524104494 shutdown_connections 2024-08-19T01:14:20.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.636+0000 7f74c2b81640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f74ac06e180 0x7f74ac070640 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.636+0000 7f74c2b81640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74bc100750 0x7f74bc19bef0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.636+0000 7f74c2b81640 1 --2- 172.21.15.17:0/3524104494 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74bc0ffda0 0x7f74bc19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.636+0000 7f74c2b81640 1 -- 172.21.15.17:0/3524104494 >> 172.21.15.17:0/3524104494 conn(0x7f74bc0fb840 msgr2=0x7f74bc0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:20.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.636+0000 7f74c2b81640 1 -- 172.21.15.17:0/3524104494 shutdown_connections 2024-08-19T01:14:20.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.636+0000 7f74c2b81640 1 -- 172.21.15.17:0/3524104494 wait complete. 2024-08-19T01:14:20.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.720+0000 7fdd1ee36640 1 -- 172.21.15.17:0/584695325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd180fe400 msgr2=0x7fdd180fe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.720+0000 7fdd1ee36640 1 --2- 172.21.15.17:0/584695325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd180fe400 0x7fdd180fe7e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009880 tx=0x7fdd0c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.720+0000 7fdd1ee36640 1 -- 172.21.15.17:0/584695325 shutdown_connections 2024-08-19T01:14:20.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.720+0000 7fdd1ee36640 1 --2- 172.21.15.17:0/584695325 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd180fedb0 0x7fdd18102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.720+0000 7fdd1ee36640 1 --2- 172.21.15.17:0/584695325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd180fe400 0x7fdd180fe7e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.720+0000 7fdd1ee36640 1 -- 172.21.15.17:0/584695325 >> 172.21.15.17:0/584695325 conn(0x7fdd180f9ec0 msgr2=0x7fdd180fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.720+0000 7fdd1ee36640 1 -- 172.21.15.17:0/584695325 shutdown_connections 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.720+0000 7fdd1ee36640 1 -- 172.21.15.17:0/584695325 wait complete. 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.720+0000 7fdd1ee36640 1 Processor -- start 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.720+0000 7fdd1ee36640 1 -- start start 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd1ee36640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd180fe400 0x7fdd1819a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd1ee36640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd180fedb0 0x7fdd1819ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd1ee36640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1819b3a0 con 0x7fdd180fe400 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd1ee36640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd18194930 con 0x7fdd180fedb0 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd1cbd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd180fe400 0x7fdd1819a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd1cbd2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd180fe400 0x7fdd1819a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44126/0 (socket says 172.21.15.17:44126) 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd1cbd2640 1 -- 172.21.15.17:0/2503404801 learned_addr learned my addr 172.21.15.17:0/2503404801 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd17fff640 1 --2- 172.21.15.17:0/2503404801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd180fedb0 0x7fdd1819ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd1cbd2640 1 -- 172.21.15.17:0/2503404801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd180fedb0 msgr2=0x7fdd1819ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd1cbd2640 1 --2- 172.21.15.17:0/2503404801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd180fedb0 0x7fdd1819ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd1cbd2640 1 -- 172.21.15.17:0/2503404801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c009560 con 0x7fdd180fe400 2024-08-19T01:14:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd1cbd2640 1 --2- 172.21.15.17:0/2503404801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd180fe400 0x7fdd1819a840 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c02a9c0 tx=0x7fdd0c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd15ffb640 1 -- 172.21.15.17:0/2503404801 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd0c004aa0 con 0x7fdd180fe400 2024-08-19T01:14:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.721+0000 7fdd15ffb640 1 -- 172.21.15.17:0/2503404801 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd0c004c00 con 0x7fdd180fe400 2024-08-19T01:14:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.722+0000 7fdd1ee36640 1 -- 172.21.15.17:0/2503404801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd18194bb0 con 0x7fdd180fe400 2024-08-19T01:14:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.722+0000 7fdd15ffb640 1 -- 172.21.15.17:0/2503404801 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd0c003ab0 con 0x7fdd180fe400 2024-08-19T01:14:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.722+0000 7fdd1ee36640 1 -- 172.21.15.17:0/2503404801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd181950a0 con 0x7fdd180fe400 2024-08-19T01:14:20.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.723+0000 7fdd1ee36640 1 -- 172.21.15.17:0/2503404801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd180ff8e0 con 0x7fdd180fe400 2024-08-19T01:14:20.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.723+0000 7fdd15ffb640 1 -- 172.21.15.17:0/2503404801 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdd0c031d20 con 0x7fdd180fe400 2024-08-19T01:14:20.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.724+0000 7fdd15ffb640 1 --2- 172.21.15.17:0/2503404801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd0806e170 0x7fdd08070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:20.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.724+0000 7fdd15ffb640 1 -- 172.21.15.17:0/2503404801 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdd0c0af270 con 0x7fdd180fe400 2024-08-19T01:14:20.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.724+0000 7fdd17fff640 1 --2- 172.21.15.17:0/2503404801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd0806e170 0x7fdd08070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:20.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.724+0000 7fdd17fff640 1 --2- 172.21.15.17:0/2503404801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd0806e170 0x7fdd08070630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdd18195da0 tx=0x7fdd04008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:20.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.728+0000 7fdd15ffb640 1 -- 172.21.15.17:0/2503404801 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdd0c078550 con 0x7fdd180fe400 2024-08-19T01:14:20.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.912+0000 7fdd1ee36640 1 -- 172.21.15.17:0/2503404801 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd18106760 con 0x7fdd0806e170 2024-08-19T01:14:20.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.921+0000 7fdd15ffb640 1 -- 172.21.15.17:0/2503404801 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fdd18106760 con 0x7fdd0806e170 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (15m) 9m ago 26m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (26m) 9m ago 26m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (25m) 9m ago 25m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (13m) 9m ago 26m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (13m) 9m ago 25m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (15m) 9m ago 26m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (9m) 9m ago 20m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (9m) 9m ago 20m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (20m) 9m ago 20m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (9m) 9m ago 20m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:14:20.924 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (17m) 9m ago 27m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (16m) 9m ago 25m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (14m) 9m ago 27m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (14m) 9m ago 25m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (16m) 9m ago 26m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (16m) 9m ago 25m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (13m) 9m ago 24m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (12m) 9m ago 24m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (11m) 9m ago 23m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (11m) 9m ago 23m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (10m) 9m ago 22m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (10m) 9m ago 22m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:14:20.925 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (15m) 9m ago 25m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:14:20.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.923+0000 7fdd1ee36640 1 -- 172.21.15.17:0/2503404801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd0806e170 msgr2=0x7fdd08070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.923+0000 7fdd1ee36640 1 --2- 172.21.15.17:0/2503404801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd0806e170 0x7fdd08070630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdd18195da0 tx=0x7fdd04008040 comp rx=0 tx=0).stop 2024-08-19T01:14:20.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.923+0000 7fdd1ee36640 1 -- 172.21.15.17:0/2503404801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd180fe400 msgr2=0x7fdd1819a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:20.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.923+0000 7fdd1ee36640 1 --2- 172.21.15.17:0/2503404801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd180fe400 0x7fdd1819a840 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c02a9c0 tx=0x7fdd0c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.924+0000 7fdd1ee36640 1 -- 172.21.15.17:0/2503404801 shutdown_connections 2024-08-19T01:14:20.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.924+0000 7fdd1ee36640 1 --2- 172.21.15.17:0/2503404801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd0806e170 0x7fdd08070630 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.924+0000 7fdd1ee36640 1 --2- 172.21.15.17:0/2503404801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd180fedb0 0x7fdd1819ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.924+0000 7fdd1ee36640 1 --2- 172.21.15.17:0/2503404801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd180fe400 0x7fdd1819a840 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:20.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.924+0000 7fdd1ee36640 1 -- 172.21.15.17:0/2503404801 >> 172.21.15.17:0/2503404801 conn(0x7fdd180f9ec0 msgr2=0x7fdd180fb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:20.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.924+0000 7fdd1ee36640 1 -- 172.21.15.17:0/2503404801 shutdown_connections 2024-08-19T01:14:20.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:20.924+0000 7fdd1ee36640 1 -- 172.21.15.17:0/2503404801 wait complete. 2024-08-19T01:14:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.005+0000 7f1ed1640640 1 -- 172.21.15.17:0/2481430706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ecc104a30 msgr2=0x7f1ecc104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.005+0000 7f1ed1640640 1 --2- 172.21.15.17:0/2481430706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ecc104a30 0x7f1ecc104e10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc009c20 tx=0x7f1ebc02a970 comp rx=0 tx=0).stop 2024-08-19T01:14:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.005+0000 7f1ed1640640 1 -- 172.21.15.17:0/2481430706 shutdown_connections 2024-08-19T01:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.005+0000 7f1ed1640640 1 --2- 172.21.15.17:0/2481430706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ecc0fea30 0x7f1ecc0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.005+0000 7f1ed1640640 1 --2- 172.21.15.17:0/2481430706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ecc104a30 0x7f1ecc104e10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.005+0000 7f1ed1640640 1 -- 172.21.15.17:0/2481430706 >> 172.21.15.17:0/2481430706 conn(0x7f1ecc0fa730 msgr2=0x7f1ecc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.005+0000 7f1ed1640640 1 -- 172.21.15.17:0/2481430706 shutdown_connections 2024-08-19T01:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.005+0000 7f1ed1640640 1 -- 172.21.15.17:0/2481430706 wait complete. 2024-08-19T01:14:21.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.006+0000 7f1ed1640640 1 Processor -- start 2024-08-19T01:14:21.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.006+0000 7f1ed1640640 1 -- start start 2024-08-19T01:14:21.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.006+0000 7f1ed1640640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ecc0fea30 0x7f1ecc19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.006+0000 7f1ed1640640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ecc104a30 0x7f1ecc19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.006+0000 7f1ed1640640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc19c3c0 con 0x7f1ecc104a30 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.006+0000 7f1ed1640640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc195890 con 0x7f1ecc0fea30 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.006+0000 7f1eca7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ecc104a30 0x7f1ecc19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.006+0000 7f1eca7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ecc104a30 0x7f1ecc19bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44142/0 (socket says 172.21.15.17:44142) 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.006+0000 7f1eca7fc640 1 -- 172.21.15.17:0/3865728764 learned_addr learned my addr 172.21.15.17:0/3865728764 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.006+0000 7f1ecaffd640 1 --2- 172.21.15.17:0/3865728764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ecc0fea30 0x7f1ecc19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.007+0000 7f1eca7fc640 1 -- 172.21.15.17:0/3865728764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ecc0fea30 msgr2=0x7f1ecc19b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.007+0000 7f1eca7fc640 1 --2- 172.21.15.17:0/3865728764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ecc0fea30 0x7f1ecc19b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.007+0000 7f1eca7fc640 1 -- 172.21.15.17:0/3865728764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc009900 con 0x7f1ecc104a30 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.007+0000 7f1eca7fc640 1 --2- 172.21.15.17:0/3865728764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ecc104a30 0x7f1ecc19bd70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400c8a0 tx=0x7f1eb400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:21.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.007+0000 7f1ec3fff640 1 -- 172.21.15.17:0/3865728764 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eb4007b80 con 0x7f1ecc104a30 2024-08-19T01:14:21.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.007+0000 7f1ec3fff640 1 -- 172.21.15.17:0/3865728764 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1eb4007ce0 con 0x7f1ecc104a30 2024-08-19T01:14:21.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.007+0000 7f1ed1640640 1 -- 172.21.15.17:0/3865728764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ecc195b70 con 0x7f1ecc104a30 2024-08-19T01:14:21.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.007+0000 7f1ed1640640 1 -- 172.21.15.17:0/3865728764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc1960c0 con 0x7f1ecc104a30 2024-08-19T01:14:21.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.007+0000 7f1ec3fff640 1 -- 172.21.15.17:0/3865728764 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eb4018810 con 0x7f1ecc104a30 2024-08-19T01:14:21.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.008+0000 7f1ed1640640 1 -- 172.21.15.17:0/3865728764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc100170 con 0x7f1ecc104a30 2024-08-19T01:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.009+0000 7f1ec3fff640 1 -- 172.21.15.17:0/3865728764 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1eb400f450 con 0x7f1ecc104a30 2024-08-19T01:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.010+0000 7f1ec3fff640 1 --2- 172.21.15.17:0/3865728764 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1eb806e170 0x7f1eb8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.010+0000 7f1ec3fff640 1 -- 172.21.15.17:0/3865728764 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1eb408e2a0 con 0x7f1ecc104a30 2024-08-19T01:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.010+0000 7f1ecaffd640 1 --2- 172.21.15.17:0/3865728764 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1eb806e170 0x7f1eb8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.010+0000 7f1ecaffd640 1 --2- 172.21.15.17:0/3865728764 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1eb806e170 0x7f1eb8070630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc000f80 tx=0x7f1ebc03d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:21.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.014+0000 7f1ec3fff640 1 -- 172.21.15.17:0/3865728764 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1eb4057580 con 0x7f1ecc104a30 2024-08-19T01:14:21.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.258+0000 7f1ed1640640 1 -- 172.21.15.17:0/3865728764 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1ecc10bca0 con 0x7f1ecc104a30 2024-08-19T01:14:21.260 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:21 smithi017 ceph-mon[99370]: from='client.34904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:21.261 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:21 smithi017 ceph-mon[99370]: from='client.34908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:21.261 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:21 smithi017 ceph-mon[99370]: from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:21.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.259+0000 7f1ec3fff640 1 -- 172.21.15.17:0/3865728764 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f1eb405ac40 con 0x7f1ecc104a30 2024-08-19T01:14:21.261 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:14:21.261 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:14:21.261 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:14:21.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:14:21.261 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:14:21.262 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:14:21.263 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:14:21.263 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:14:21.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.261+0000 7f1ed1640640 1 -- 172.21.15.17:0/3865728764 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1eb806e170 msgr2=0x7f1eb8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.261+0000 7f1ed1640640 1 --2- 172.21.15.17:0/3865728764 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1eb806e170 0x7f1eb8070630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc000f80 tx=0x7f1ebc03d040 comp rx=0 tx=0).stop 2024-08-19T01:14:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.261+0000 7f1ed1640640 1 -- 172.21.15.17:0/3865728764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ecc104a30 msgr2=0x7f1ecc19bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.261+0000 7f1ed1640640 1 --2- 172.21.15.17:0/3865728764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ecc104a30 0x7f1ecc19bd70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400c8a0 tx=0x7f1eb400cd60 comp rx=0 tx=0).stop 2024-08-19T01:14:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.261+0000 7f1ed1640640 1 -- 172.21.15.17:0/3865728764 shutdown_connections 2024-08-19T01:14:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.261+0000 7f1ed1640640 1 --2- 172.21.15.17:0/3865728764 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1eb806e170 0x7f1eb8070630 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.261+0000 7f1ed1640640 1 --2- 172.21.15.17:0/3865728764 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1ecc104a30 0x7f1ecc19bd70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.261+0000 7f1ed1640640 1 --2- 172.21.15.17:0/3865728764 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1ecc0fea30 0x7f1ecc19b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.261+0000 7f1ed1640640 1 -- 172.21.15.17:0/3865728764 >> 172.21.15.17:0/3865728764 conn(0x7f1ecc0fa730 msgr2=0x7f1ecc068770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.261+0000 7f1ed1640640 1 -- 172.21.15.17:0/3865728764 shutdown_connections 2024-08-19T01:14:21.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.261+0000 7f1ed1640640 1 -- 172.21.15.17:0/3865728764 wait complete. 2024-08-19T01:14:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.342+0000 7f34b1aee640 1 -- 172.21.15.17:0/861901148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac1049f0 msgr2=0x7f34ac104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.342+0000 7f34b1aee640 1 --2- 172.21.15.17:0/861901148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac1049f0 0x7f34ac104dd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f349c009880 tx=0x7f349c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.343+0000 7f34b1aee640 1 -- 172.21.15.17:0/861901148 shutdown_connections 2024-08-19T01:14:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.343+0000 7f34b1aee640 1 --2- 172.21.15.17:0/861901148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34ac0fe9f0 0x7f34ac0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.343+0000 7f34b1aee640 1 --2- 172.21.15.17:0/861901148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac1049f0 0x7f34ac104dd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.343+0000 7f34b1aee640 1 -- 172.21.15.17:0/861901148 >> 172.21.15.17:0/861901148 conn(0x7f34ac0758a0 msgr2=0x7f34ac0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.343+0000 7f34b1aee640 1 -- 172.21.15.17:0/861901148 shutdown_connections 2024-08-19T01:14:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.343+0000 7f34b1aee640 1 -- 172.21.15.17:0/861901148 wait complete. 2024-08-19T01:14:21.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.343+0000 7f34b1aee640 1 Processor -- start 2024-08-19T01:14:21.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.343+0000 7f34b1aee640 1 -- start start 2024-08-19T01:14:21.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34b1aee640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac0fe9f0 0x7f34ac0fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34b1aee640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34ac1049f0 0x7f34ac0fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34b1aee640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0fb800 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34b1aee640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0fb940 con 0x7f34ac1049f0 2024-08-19T01:14:21.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac0fe9f0 0x7f34ac0fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34ab7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac0fe9f0 0x7f34ac0fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44164/0 (socket says 172.21.15.17:44164) 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34ab7fe640 1 -- 172.21.15.17:0/3891111166 learned_addr learned my addr 172.21.15.17:0/3891111166 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34aaffd640 1 --2- 172.21.15.17:0/3891111166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34ac1049f0 0x7f34ac0fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34ab7fe640 1 -- 172.21.15.17:0/3891111166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34ac1049f0 msgr2=0x7f34ac0fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34ab7fe640 1 --2- 172.21.15.17:0/3891111166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34ac1049f0 0x7f34ac0fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34ab7fe640 1 -- 172.21.15.17:0/3891111166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c009560 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34ab7fe640 1 --2- 172.21.15.17:0/3891111166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac0fe9f0 0x7f34ac0fad80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f349c02a9c0 tx=0x7f349c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34a8ff9640 1 -- 172.21.15.17:0/3891111166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349c004aa0 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34b1aee640 1 -- 172.21.15.17:0/3891111166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac0fbbc0 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34a8ff9640 1 -- 172.21.15.17:0/3891111166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f349c004c00 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.344+0000 7f34a8ff9640 1 -- 172.21.15.17:0/3891111166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f349c003980 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.345+0000 7f34b1aee640 1 -- 172.21.15.17:0/3891111166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac1a2040 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.346+0000 7f34b1aee640 1 -- 172.21.15.17:0/3891111166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac100130 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.346+0000 7f34a8ff9640 1 -- 172.21.15.17:0/3891111166 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f349c003bf0 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.347+0000 7f34a8ff9640 1 --2- 172.21.15.17:0/3891111166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f349406e170 0x7f3494070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.347+0000 7f34aaffd640 1 --2- 172.21.15.17:0/3891111166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f349406e170 0x7f3494070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.347+0000 7f34a8ff9640 1 -- 172.21.15.17:0/3891111166 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f349c0af1f0 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.347+0000 7f34aaffd640 1 --2- 172.21.15.17:0/3891111166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f349406e170 0x7f3494070630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f34a0005fd0 tx=0x7f34a0005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:21.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.351+0000 7f34a8ff9640 1 -- 172.21.15.17:0/3891111166 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f349c0784d0 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:21 smithi086 ceph-mon[71303]: from='client.34904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:21.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:21 smithi086 ceph-mon[71303]: from='client.34908 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:21.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:21 smithi086 ceph-mon[71303]: from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:21.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.561+0000 7f34b1aee640 1 -- 172.21.15.17:0/3891111166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f34ac0fee50 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.562+0000 7f34a8ff9640 1 -- 172.21.15.17:0/3891111166 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f349c07bb90 con 0x7f34ac0fe9f0 2024-08-19T01:14:21.564 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:14:21.564 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:14:21.564 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:14:21.564 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:14:21.565 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:14:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:14:21.565 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:14:21.565 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:14:21.565 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:14:21.565 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:14:21.565 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:14:21.565 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:14:21.565 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:14:21.565 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:14:21.565 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:14:21.566 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:14:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:14:21.568 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:14:21.568 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:14:21.568 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:14:21.568 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:14:21.568 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:14:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.564+0000 7f34b1aee640 1 -- 172.21.15.17:0/3891111166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f349406e170 msgr2=0x7f3494070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.564+0000 7f34b1aee640 1 --2- 172.21.15.17:0/3891111166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f349406e170 0x7f3494070630 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f34a0005fd0 tx=0x7f34a0005850 comp rx=0 tx=0).stop 2024-08-19T01:14:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.564+0000 7f34b1aee640 1 -- 172.21.15.17:0/3891111166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac0fe9f0 msgr2=0x7f34ac0fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.564+0000 7f34b1aee640 1 --2- 172.21.15.17:0/3891111166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac0fe9f0 0x7f34ac0fad80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f349c02a9c0 tx=0x7f349c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.564+0000 7f34b1aee640 1 -- 172.21.15.17:0/3891111166 shutdown_connections 2024-08-19T01:14:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.564+0000 7f34b1aee640 1 --2- 172.21.15.17:0/3891111166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f349406e170 0x7f3494070630 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.564+0000 7f34b1aee640 1 --2- 172.21.15.17:0/3891111166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f34ac1049f0 0x7f34ac0fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.564+0000 7f34b1aee640 1 --2- 172.21.15.17:0/3891111166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34ac0fe9f0 0x7f34ac0fad80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.564+0000 7f34b1aee640 1 -- 172.21.15.17:0/3891111166 >> 172.21.15.17:0/3891111166 conn(0x7f34ac0758a0 msgr2=0x7f34ac0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.564+0000 7f34b1aee640 1 -- 172.21.15.17:0/3891111166 shutdown_connections 2024-08-19T01:14:21.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.564+0000 7f34b1aee640 1 -- 172.21.15.17:0/3891111166 wait complete. 2024-08-19T01:14:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.647+0000 7f0bf0633640 1 -- 172.21.15.17:0/2318889485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100c60 msgr2=0x7f0be8101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.647+0000 7f0bf0633640 1 --2- 172.21.15.17:0/2318889485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100c60 0x7f0be8101040 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0be40098b0 tx=0x7f0be402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.647+0000 7f0bf0633640 1 -- 172.21.15.17:0/2318889485 shutdown_connections 2024-08-19T01:14:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.647+0000 7f0bf0633640 1 --2- 172.21.15.17:0/2318889485 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be8101610 0x7f0be8109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.647+0000 7f0bf0633640 1 --2- 172.21.15.17:0/2318889485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100c60 0x7f0be8101040 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.647+0000 7f0bf0633640 1 -- 172.21.15.17:0/2318889485 >> 172.21.15.17:0/2318889485 conn(0x7f0be80fa730 msgr2=0x7f0be80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.647+0000 7f0bf0633640 1 -- 172.21.15.17:0/2318889485 shutdown_connections 2024-08-19T01:14:21.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.648+0000 7f0bf0633640 1 -- 172.21.15.17:0/2318889485 wait complete. 2024-08-19T01:14:21.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.648+0000 7f0bf0633640 1 Processor -- start 2024-08-19T01:14:21.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.648+0000 7f0bf0633640 1 -- start start 2024-08-19T01:14:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.648+0000 7f0bf0633640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100c60 0x7f0be8197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.648+0000 7f0bf0633640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be8101610 0x7f0be8198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.648+0000 7f0bf0633640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be8198910 con 0x7f0be8100c60 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.648+0000 7f0bf0633640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be819c680 con 0x7f0be8101610 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.648+0000 7f0bee3cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100c60 0x7f0be8197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.648+0000 7f0bee3cf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100c60 0x7f0be8197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44180/0 (socket says 172.21.15.17:44180) 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.648+0000 7f0bee3cf640 1 -- 172.21.15.17:0/1867505819 learned_addr learned my addr 172.21.15.17:0/1867505819 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.649+0000 7f0bedbce640 1 --2- 172.21.15.17:0/1867505819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be8101610 0x7f0be8198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.649+0000 7f0bee3cf640 1 -- 172.21.15.17:0/1867505819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be8101610 msgr2=0x7f0be8198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.649+0000 7f0bee3cf640 1 --2- 172.21.15.17:0/1867505819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be8101610 0x7f0be8198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.649+0000 7f0bee3cf640 1 -- 172.21.15.17:0/1867505819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be4009560 con 0x7f0be8100c60 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.649+0000 7f0bee3cf640 1 --2- 172.21.15.17:0/1867505819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100c60 0x7f0be8197d40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0be4006010 tx=0x7f0be40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.649+0000 7f0bdf7fe640 1 -- 172.21.15.17:0/1867505819 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be4004aa0 con 0x7f0be8100c60 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.649+0000 7f0bdf7fe640 1 -- 172.21.15.17:0/1867505819 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0be4031470 con 0x7f0be8100c60 2024-08-19T01:14:21.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.649+0000 7f0bdf7fe640 1 -- 172.21.15.17:0/1867505819 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be4003940 con 0x7f0be8100c60 2024-08-19T01:14:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.649+0000 7f0bf0633640 1 -- 172.21.15.17:0/1867505819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be819c900 con 0x7f0be8100c60 2024-08-19T01:14:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.649+0000 7f0bf0633640 1 -- 172.21.15.17:0/1867505819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be819cdf0 con 0x7f0be8100c60 2024-08-19T01:14:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.650+0000 7f0bf0633640 1 -- 172.21.15.17:0/1867505819 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be8068d30 con 0x7f0be8100c60 2024-08-19T01:14:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.651+0000 7f0bdf7fe640 1 -- 172.21.15.17:0/1867505819 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0be4031b90 con 0x7f0be8100c60 2024-08-19T01:14:21.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.651+0000 7f0bdf7fe640 1 --2- 172.21.15.17:0/1867505819 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bd406e170 0x7f0bd4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.651+0000 7f0bdf7fe640 1 -- 172.21.15.17:0/1867505819 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0be40af300 con 0x7f0be8100c60 2024-08-19T01:14:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.651+0000 7f0bedbce640 1 --2- 172.21.15.17:0/1867505819 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bd406e170 0x7f0bd4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.652+0000 7f0bedbce640 1 --2- 172.21.15.17:0/1867505819 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bd406e170 0x7f0bd4070630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005fd0 tx=0x7f0bd8005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:21.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.656+0000 7f0bdf7fe640 1 -- 172.21.15.17:0/1867505819 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0be4078580 con 0x7f0be8100c60 2024-08-19T01:14:21.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.848+0000 7f0bf0633640 1 -- 172.21.15.17:0/1867505819 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0be81990a0 con 0x7f0bd406e170 2024-08-19T01:14:21.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.849+0000 7f0bdf7fe640 1 -- 172.21.15.17:0/1867505819 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0be81990a0 con 0x7f0bd406e170 2024-08-19T01:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:14:21.851 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:14:21.852 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:14:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.852+0000 7f0bf0633640 1 -- 172.21.15.17:0/1867505819 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bd406e170 msgr2=0x7f0bd4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.852+0000 7f0bf0633640 1 --2- 172.21.15.17:0/1867505819 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bd406e170 0x7f0bd4070630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005fd0 tx=0x7f0bd8005850 comp rx=0 tx=0).stop 2024-08-19T01:14:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.852+0000 7f0bf0633640 1 -- 172.21.15.17:0/1867505819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100c60 msgr2=0x7f0be8197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.852+0000 7f0bf0633640 1 --2- 172.21.15.17:0/1867505819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100c60 0x7f0be8197d40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0be4006010 tx=0x7f0be40055a0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.852+0000 7f0bf0633640 1 -- 172.21.15.17:0/1867505819 shutdown_connections 2024-08-19T01:14:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.852+0000 7f0bf0633640 1 --2- 172.21.15.17:0/1867505819 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0bd406e170 0x7f0bd4070630 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.852+0000 7f0bf0633640 1 --2- 172.21.15.17:0/1867505819 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0be8101610 0x7f0be8198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.852+0000 7f0bf0633640 1 --2- 172.21.15.17:0/1867505819 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0be8100c60 0x7f0be8197d40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.852+0000 7f0bf0633640 1 -- 172.21.15.17:0/1867505819 >> 172.21.15.17:0/1867505819 conn(0x7f0be80fa730 msgr2=0x7f0be80ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.852+0000 7f0bf0633640 1 -- 172.21.15.17:0/1867505819 shutdown_connections 2024-08-19T01:14:21.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.852+0000 7f0bf0633640 1 -- 172.21.15.17:0/1867505819 wait complete. 2024-08-19T01:14:21.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.934+0000 7f753b4b9640 1 -- 172.21.15.17:0/2829265687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75340ffda0 msgr2=0x7f7534100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.934+0000 7f753b4b9640 1 --2- 172.21.15.17:0/2829265687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75340ffda0 0x7f7534100180 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7530009880 tx=0x7f753002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.934+0000 7f753b4b9640 1 -- 172.21.15.17:0/2829265687 shutdown_connections 2024-08-19T01:14:21.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.934+0000 7f753b4b9640 1 --2- 172.21.15.17:0/2829265687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7534100750 0x7f75341047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.934+0000 7f753b4b9640 1 --2- 172.21.15.17:0/2829265687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f75340ffda0 0x7f7534100180 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.934+0000 7f753b4b9640 1 -- 172.21.15.17:0/2829265687 >> 172.21.15.17:0/2829265687 conn(0x7f75340fb840 msgr2=0x7f75340fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.934+0000 7f753b4b9640 1 -- 172.21.15.17:0/2829265687 shutdown_connections 2024-08-19T01:14:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.934+0000 7f753b4b9640 1 -- 172.21.15.17:0/2829265687 wait complete. 2024-08-19T01:14:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f753b4b9640 1 Processor -- start 2024-08-19T01:14:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f753b4b9640 1 -- start start 2024-08-19T01:14:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f753b4b9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75340ffda0 0x7f753419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f753b4b9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7534100750 0x7f753419bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f753b4b9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534195a10 con 0x7f7534100750 2024-08-19T01:14:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f753b4b9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7534195b50 con 0x7f75340ffda0 2024-08-19T01:14:21.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f7538a54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7534100750 0x7f753419bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f7538a54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7534100750 0x7f753419bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44196/0 (socket says 172.21.15.17:44196) 2024-08-19T01:14:21.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f7538a54640 1 -- 172.21.15.17:0/3724104018 learned_addr learned my addr 172.21.15.17:0/3724104018 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:21.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f7539255640 1 --2- 172.21.15.17:0/3724104018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75340ffda0 0x7f753419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f7538a54640 1 -- 172.21.15.17:0/3724104018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75340ffda0 msgr2=0x7f753419b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:21.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f7538a54640 1 --2- 172.21.15.17:0/3724104018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75340ffda0 0x7f753419b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:21.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.935+0000 7f7538a54640 1 -- 172.21.15.17:0/3724104018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530009560 con 0x7f7534100750 2024-08-19T01:14:21.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.936+0000 7f7538a54640 1 --2- 172.21.15.17:0/3724104018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7534100750 0x7f753419bef0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f752400c8f0 tx=0x7f752400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:21.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.936+0000 7f752a7fc640 1 -- 172.21.15.17:0/3724104018 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7524007b80 con 0x7f7534100750 2024-08-19T01:14:21.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.936+0000 7f753b4b9640 1 -- 172.21.15.17:0/3724104018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7534195e30 con 0x7f7534100750 2024-08-19T01:14:21.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.936+0000 7f752a7fc640 1 -- 172.21.15.17:0/3724104018 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75240054e0 con 0x7f7534100750 2024-08-19T01:14:21.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.936+0000 7f752a7fc640 1 -- 172.21.15.17:0/3724104018 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f752400f450 con 0x7f7534100750 2024-08-19T01:14:21.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.936+0000 7f753b4b9640 1 -- 172.21.15.17:0/3724104018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7534196380 con 0x7f7534100750 2024-08-19T01:14:21.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.937+0000 7f753b4b9640 1 -- 172.21.15.17:0/3724104018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7534101280 con 0x7f7534100750 2024-08-19T01:14:21.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.937+0000 7f752a7fc640 1 -- 172.21.15.17:0/3724104018 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7524004f60 con 0x7f7534100750 2024-08-19T01:14:21.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.938+0000 7f752a7fc640 1 --2- 172.21.15.17:0/3724104018 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f752006e170 0x7f7520070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:21.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.938+0000 7f752a7fc640 1 -- 172.21.15.17:0/3724104018 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f752408dff0 con 0x7f7534100750 2024-08-19T01:14:21.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.938+0000 7f7539255640 1 --2- 172.21.15.17:0/3724104018 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f752006e170 0x7f7520070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:21.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.938+0000 7f7539255640 1 --2- 172.21.15.17:0/3724104018 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f752006e170 0x7f7520070630 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7530000c00 tx=0x7f7530005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:21.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:21.942+0000 7f752a7fc640 1 -- 172.21.15.17:0/3724104018 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f75240572d0 con 0x7f7534100750 2024-08-19T01:14:22.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.185+0000 7f753b4b9640 1 -- 172.21.15.17:0/3724104018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7534196f70 con 0x7f7534100750 2024-08-19T01:14:22.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.186+0000 7f752a7fc640 1 -- 172.21.15.17:0/3724104018 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f752405a990 con 0x7f7534100750 2024-08-19T01:14:22.188 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:14:22.188 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:14:22.188 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:14:22.188 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:14:22.188 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:14:22.188 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:14:22.189 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:14:22.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.188+0000 7f753b4b9640 1 -- 172.21.15.17:0/3724104018 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f752006e170 msgr2=0x7f7520070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:22.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.188+0000 7f753b4b9640 1 --2- 172.21.15.17:0/3724104018 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f752006e170 0x7f7520070630 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7530000c00 tx=0x7f7530005a20 comp rx=0 tx=0).stop 2024-08-19T01:14:22.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.188+0000 7f753b4b9640 1 -- 172.21.15.17:0/3724104018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7534100750 msgr2=0x7f753419bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:22.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.188+0000 7f753b4b9640 1 --2- 172.21.15.17:0/3724104018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7534100750 0x7f753419bef0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f752400c8f0 tx=0x7f752400cdb0 comp rx=0 tx=0).stop 2024-08-19T01:14:22.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.188+0000 7f753b4b9640 1 -- 172.21.15.17:0/3724104018 shutdown_connections 2024-08-19T01:14:22.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.188+0000 7f753b4b9640 1 --2- 172.21.15.17:0/3724104018 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f752006e170 0x7f7520070630 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:22.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.188+0000 7f753b4b9640 1 --2- 172.21.15.17:0/3724104018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7534100750 0x7f753419bef0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:22.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.188+0000 7f753b4b9640 1 --2- 172.21.15.17:0/3724104018 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f75340ffda0 0x7f753419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:22.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.188+0000 7f753b4b9640 1 -- 172.21.15.17:0/3724104018 >> 172.21.15.17:0/3724104018 conn(0x7f75340fb840 msgr2=0x7f75340fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:22.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.188+0000 7f753b4b9640 1 -- 172.21.15.17:0/3724104018 shutdown_connections 2024-08-19T01:14:22.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:22.188+0000 7f753b4b9640 1 -- 172.21.15.17:0/3724104018 wait complete. 2024-08-19T01:14:22.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:22 smithi017 ceph-mon[99370]: pgmap v467: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:22.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:22 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3865728764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:14:22.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:22 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3891111166' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:14:22.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:22 smithi017 ceph-mon[99370]: from='client.34924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:22.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:22 smithi086 ceph-mon[71303]: pgmap v467: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:22.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:22 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3865728764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:14:22.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:22 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3891111166' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:14:22.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:22 smithi086 ceph-mon[71303]: from='client.34924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:23.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:23 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3724104018' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:14:23.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:23 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3724104018' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:14:24.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:24 smithi017 ceph-mon[99370]: pgmap v468: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:24.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:24 smithi086 ceph-mon[71303]: pgmap v468: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:26.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:26 smithi017 ceph-mon[99370]: pgmap v469: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:26.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:26 smithi086 ceph-mon[71303]: pgmap v469: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:28.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:28 smithi086 ceph-mon[71303]: pgmap v470: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:28.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:28 smithi017 ceph-mon[99370]: pgmap v470: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:30.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:30 smithi086 ceph-mon[71303]: pgmap v471: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:30.485 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:30 smithi017 ceph-mon[99370]: pgmap v471: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:32.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:32 smithi086 ceph-mon[71303]: pgmap v472: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:32.603 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:32 smithi017 ceph-mon[99370]: pgmap v472: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:14:33.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:14:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:34 smithi086 ceph-mon[71303]: pgmap v473: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:34.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:34 smithi017 ceph-mon[99370]: pgmap v473: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:36.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:36 smithi017 ceph-mon[99370]: pgmap v474: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:36.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:36 smithi086 ceph-mon[71303]: pgmap v474: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:38.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:38 smithi017 ceph-mon[99370]: pgmap v475: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:38.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:38 smithi086 ceph-mon[71303]: pgmap v475: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:40 smithi017 ceph-mon[99370]: pgmap v476: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:40 smithi086 ceph-mon[71303]: pgmap v476: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:42 smithi017 ceph-mon[99370]: pgmap v477: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:42 smithi086 ceph-mon[71303]: pgmap v477: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:44 smithi017 ceph-mon[99370]: pgmap v478: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:44 smithi086 ceph-mon[71303]: pgmap v478: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:46.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:46 smithi017 ceph-mon[99370]: pgmap v479: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:46 smithi086 ceph-mon[71303]: pgmap v479: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:48 smithi017 ceph-mon[99370]: pgmap v480: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:14:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:48 smithi086 ceph-mon[71303]: pgmap v480: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:14:50.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:50 smithi017 ceph-mon[99370]: pgmap v481: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:50 smithi086 ceph-mon[71303]: pgmap v481: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:52.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.284+0000 7f26e9c8c640 1 -- 172.21.15.17:0/4082792814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26e4101670 msgr2=0x7f26e4109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:52.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.284+0000 7f26e9c8c640 1 --2- 172.21.15.17:0/4082792814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26e4101670 0x7f26e4109b60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009880 tx=0x7f26d802a530 comp rx=0 tx=0).stop 2024-08-19T01:14:52.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.284+0000 7f26e9c8c640 1 -- 172.21.15.17:0/4082792814 shutdown_connections 2024-08-19T01:14:52.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.284+0000 7f26e9c8c640 1 --2- 172.21.15.17:0/4082792814 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26e4101670 0x7f26e4109b60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.284+0000 7f26e9c8c640 1 --2- 172.21.15.17:0/4082792814 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26e4100d50 0x7f26e4101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.284+0000 7f26e9c8c640 1 -- 172.21.15.17:0/4082792814 >> 172.21.15.17:0/4082792814 conn(0x7f26e40758a0 msgr2=0x7f26e40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:52.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.284+0000 7f26e9c8c640 1 -- 172.21.15.17:0/4082792814 shutdown_connections 2024-08-19T01:14:52.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.284+0000 7f26e9c8c640 1 -- 172.21.15.17:0/4082792814 wait complete. 2024-08-19T01:14:52.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.284+0000 7f26e9c8c640 1 Processor -- start 2024-08-19T01:14:52.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.285+0000 7f26e9c8c640 1 -- start start 2024-08-19T01:14:52.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.285+0000 7f26e9c8c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26e4100d50 0x7f26e419b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:52.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.285+0000 7f26e9c8c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26e4101670 0x7f26e419bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:52.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.285+0000 7f26e9c8c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e41959c0 con 0x7f26e4100d50 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.285+0000 7f26e9c8c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e4195b00 con 0x7f26e4101670 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.285+0000 7f26e37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26e4100d50 0x7f26e419b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.285+0000 7f26e37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26e4100d50 0x7f26e419b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53390/0 (socket says 172.21.15.17:53390) 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.285+0000 7f26e37fe640 1 -- 172.21.15.17:0/2982423391 learned_addr learned my addr 172.21.15.17:0/2982423391 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.285+0000 7f26e2ffd640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26e4101670 0x7f26e419bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.285+0000 7f26e37fe640 1 -- 172.21.15.17:0/2982423391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26e4101670 msgr2=0x7f26e419bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.285+0000 7f26e37fe640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26e4101670 0x7f26e419bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.286+0000 7f26e37fe640 1 -- 172.21.15.17:0/2982423391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d8009560 con 0x7f26e4100d50 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.286+0000 7f26e2ffd640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26e4101670 0x7f26e419bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.286+0000 7f26e37fe640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26e4100d50 0x7f26e419b960 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f26d400d6f0 tx=0x7f26d400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.286+0000 7f26e0ff9640 1 -- 172.21.15.17:0/2982423391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d4009a30 con 0x7f26e4100d50 2024-08-19T01:14:52.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.286+0000 7f26e0ff9640 1 -- 172.21.15.17:0/2982423391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f26d40054e0 con 0x7f26e4100d50 2024-08-19T01:14:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.286+0000 7f26e9c8c640 1 -- 172.21.15.17:0/2982423391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e4195de0 con 0x7f26e4100d50 2024-08-19T01:14:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.286+0000 7f26e0ff9640 1 -- 172.21.15.17:0/2982423391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26d4010460 con 0x7f26e4100d50 2024-08-19T01:14:52.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.286+0000 7f26e9c8c640 1 -- 172.21.15.17:0/2982423391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e4196300 con 0x7f26e4100d50 2024-08-19T01:14:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.287+0000 7f26e9c8c640 1 -- 172.21.15.17:0/2982423391 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e4068470 con 0x7f26e4100d50 2024-08-19T01:14:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.288+0000 7f26e0ff9640 1 -- 172.21.15.17:0/2982423391 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f26d4004ec0 con 0x7f26e4100d50 2024-08-19T01:14:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.288+0000 7f26e0ff9640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f26cc06e170 0x7f26cc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.288+0000 7f26e0ff9640 1 -- 172.21.15.17:0/2982423391 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f26d408dca0 con 0x7f26e4100d50 2024-08-19T01:14:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.288+0000 7f26e2ffd640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f26cc06e170 0x7f26cc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:52.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.289+0000 7f26e2ffd640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f26cc06e170 0x7f26cc070630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f26d8031440 tx=0x7f26d8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:52.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.293+0000 7f26e0ff9640 1 -- 172.21.15.17:0/2982423391 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f26d4092070 con 0x7f26e4100d50 2024-08-19T01:14:52.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.490+0000 7f26e9c8c640 1 -- 172.21.15.17:0/2982423391 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26e410cda0 con 0x7f26cc06e170 2024-08-19T01:14:52.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.491+0000 7f26e0ff9640 1 -- 172.21.15.17:0/2982423391 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f26e410cda0 con 0x7f26cc06e170 2024-08-19T01:14:52.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.493+0000 7f26e9c8c640 1 -- 172.21.15.17:0/2982423391 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f26cc06e170 msgr2=0x7f26cc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:52.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.493+0000 7f26e9c8c640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f26cc06e170 0x7f26cc070630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f26d8031440 tx=0x7f26d8005a20 comp rx=0 tx=0).stop 2024-08-19T01:14:52.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.493+0000 7f26e9c8c640 1 -- 172.21.15.17:0/2982423391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26e4100d50 msgr2=0x7f26e419b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.493+0000 7f26e9c8c640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26e4100d50 0x7f26e419b960 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f26d400d6f0 tx=0x7f26d400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.493+0000 7f26e9c8c640 1 -- 172.21.15.17:0/2982423391 shutdown_connections 2024-08-19T01:14:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.493+0000 7f26e9c8c640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f26cc06e170 0x7f26cc070630 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.493+0000 7f26e9c8c640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f26e4101670 0x7f26e419bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.493+0000 7f26e9c8c640 1 --2- 172.21.15.17:0/2982423391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26e4100d50 0x7f26e419b960 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.493+0000 7f26e9c8c640 1 -- 172.21.15.17:0/2982423391 >> 172.21.15.17:0/2982423391 conn(0x7f26e40758a0 msgr2=0x7f26e4101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.493+0000 7f26e9c8c640 1 -- 172.21.15.17:0/2982423391 shutdown_connections 2024-08-19T01:14:52.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.493+0000 7f26e9c8c640 1 -- 172.21.15.17:0/2982423391 wait complete. 2024-08-19T01:14:52.504 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:14:52.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.577+0000 7f7032464640 1 -- 172.21.15.17:0/265516080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702c0fea30 msgr2=0x7f702c0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:52.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.577+0000 7f7032464640 1 --2- 172.21.15.17:0/265516080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702c0fea30 0x7f702c0fee90 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7020009880 tx=0x7f702002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.577+0000 7f7032464640 1 -- 172.21.15.17:0/265516080 shutdown_connections 2024-08-19T01:14:52.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.577+0000 7f7032464640 1 --2- 172.21.15.17:0/265516080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702c0fea30 0x7f702c0fee90 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.577+0000 7f7032464640 1 --2- 172.21.15.17:0/265516080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702c104a30 0x7f702c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.577+0000 7f7032464640 1 -- 172.21.15.17:0/265516080 >> 172.21.15.17:0/265516080 conn(0x7f702c0fa730 msgr2=0x7f702c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:52.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.577+0000 7f7032464640 1 -- 172.21.15.17:0/265516080 shutdown_connections 2024-08-19T01:14:52.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.577+0000 7f7032464640 1 -- 172.21.15.17:0/265516080 wait complete. 2024-08-19T01:14:52.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.578+0000 7f7032464640 1 Processor -- start 2024-08-19T01:14:52.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.578+0000 7f7032464640 1 -- start start 2024-08-19T01:14:52.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.578+0000 7f7032464640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702c0fea30 0x7f702c196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.578+0000 7f7032464640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702c104a30 0x7f702c196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.578+0000 7f7032464640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c197470 con 0x7f702c0fea30 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.578+0000 7f7032464640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c1975e0 con 0x7f702c104a30 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.578+0000 7f702bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702c0fea30 0x7f702c196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.578+0000 7f702bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702c0fea30 0x7f702c196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53400/0 (socket says 172.21.15.17:53400) 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.578+0000 7f702bfff640 1 -- 172.21.15.17:0/1380252790 learned_addr learned my addr 172.21.15.17:0/1380252790 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.579+0000 7f702b7fe640 1 --2- 172.21.15.17:0/1380252790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702c104a30 0x7f702c196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.579+0000 7f702bfff640 1 -- 172.21.15.17:0/1380252790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702c104a30 msgr2=0x7f702c196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.579+0000 7f702bfff640 1 --2- 172.21.15.17:0/1380252790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702c104a30 0x7f702c196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.579+0000 7f702bfff640 1 -- 172.21.15.17:0/1380252790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7020009560 con 0x7f702c0fea30 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.579+0000 7f702bfff640 1 --2- 172.21.15.17:0/1380252790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702c0fea30 0x7f702c196960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f701c00c8f0 tx=0x7f701c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:52.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.579+0000 7f70297fa640 1 -- 172.21.15.17:0/1380252790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f701c007b80 con 0x7f702c0fea30 2024-08-19T01:14:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.579+0000 7f7032464640 1 -- 172.21.15.17:0/1380252790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c19f9d0 con 0x7f702c0fea30 2024-08-19T01:14:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.579+0000 7f70297fa640 1 -- 172.21.15.17:0/1380252790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f701c0054e0 con 0x7f702c0fea30 2024-08-19T01:14:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.579+0000 7f70297fa640 1 -- 172.21.15.17:0/1380252790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f701c00f450 con 0x7f702c0fea30 2024-08-19T01:14:52.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.579+0000 7f7032464640 1 -- 172.21.15.17:0/1380252790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c19fde0 con 0x7f702c0fea30 2024-08-19T01:14:52.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.580+0000 7f7032464640 1 -- 172.21.15.17:0/1380252790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c100170 con 0x7f702c0fea30 2024-08-19T01:14:52.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.581+0000 7f70297fa640 1 -- 172.21.15.17:0/1380252790 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f701c004f60 con 0x7f702c0fea30 2024-08-19T01:14:52.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.581+0000 7f70297fa640 1 --2- 172.21.15.17:0/1380252790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f701406e170 0x7f7014070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:52.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.581+0000 7f70297fa640 1 -- 172.21.15.17:0/1380252790 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f701c08dff0 con 0x7f702c0fea30 2024-08-19T01:14:52.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.581+0000 7f702b7fe640 1 --2- 172.21.15.17:0/1380252790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f701406e170 0x7f7014070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:52.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.582+0000 7f702b7fe640 1 --2- 172.21.15.17:0/1380252790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f701406e170 0x7f7014070630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7020000c00 tx=0x7f7020005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:52.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.585+0000 7f70297fa640 1 -- 172.21.15.17:0/1380252790 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f701c0572d0 con 0x7f702c0fea30 2024-08-19T01:14:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.777+0000 7f7032464640 1 -- 172.21.15.17:0/1380252790 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f702c1977a0 con 0x7f701406e170 2024-08-19T01:14:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.778+0000 7f70297fa640 1 -- 172.21.15.17:0/1380252790 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f702c1977a0 con 0x7f701406e170 2024-08-19T01:14:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.780+0000 7f7032464640 1 -- 172.21.15.17:0/1380252790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f701406e170 msgr2=0x7f7014070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.780+0000 7f7032464640 1 --2- 172.21.15.17:0/1380252790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f701406e170 0x7f7014070630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7020000c00 tx=0x7f7020005a20 comp rx=0 tx=0).stop 2024-08-19T01:14:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.780+0000 7f7032464640 1 -- 172.21.15.17:0/1380252790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702c0fea30 msgr2=0x7f702c196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.780+0000 7f7032464640 1 --2- 172.21.15.17:0/1380252790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702c0fea30 0x7f702c196960 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f701c00c8f0 tx=0x7f701c00cdb0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.781+0000 7f7032464640 1 -- 172.21.15.17:0/1380252790 shutdown_connections 2024-08-19T01:14:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.781+0000 7f7032464640 1 --2- 172.21.15.17:0/1380252790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f701406e170 0x7f7014070630 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.781+0000 7f7032464640 1 --2- 172.21.15.17:0/1380252790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f702c104a30 0x7f702c196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.781+0000 7f7032464640 1 --2- 172.21.15.17:0/1380252790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f702c0fea30 0x7f702c196960 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.781+0000 7f7032464640 1 -- 172.21.15.17:0/1380252790 >> 172.21.15.17:0/1380252790 conn(0x7f702c0fa730 msgr2=0x7f702c0fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.781+0000 7f7032464640 1 -- 172.21.15.17:0/1380252790 shutdown_connections 2024-08-19T01:14:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.781+0000 7f7032464640 1 -- 172.21.15.17:0/1380252790 wait complete. 2024-08-19T01:14:52.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.862+0000 7f4343619640 1 -- 172.21.15.17:0/2102396558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f433c0fea30 msgr2=0x7f433c0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.862+0000 7f4343619640 1 --2- 172.21.15.17:0/2102396558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f433c0fea30 0x7f433c0fee90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f432c009880 tx=0x7f432c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.863+0000 7f4343619640 1 -- 172.21.15.17:0/2102396558 shutdown_connections 2024-08-19T01:14:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.863+0000 7f4343619640 1 --2- 172.21.15.17:0/2102396558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f433c0fea30 0x7f433c0fee90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.863+0000 7f4343619640 1 --2- 172.21.15.17:0/2102396558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f433c104a30 0x7f433c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.863+0000 7f4343619640 1 -- 172.21.15.17:0/2102396558 >> 172.21.15.17:0/2102396558 conn(0x7f433c0fa730 msgr2=0x7f433c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:52.865 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:52 smithi017 ceph-mon[99370]: pgmap v482: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.863+0000 7f4343619640 1 -- 172.21.15.17:0/2102396558 shutdown_connections 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.863+0000 7f4343619640 1 -- 172.21.15.17:0/2102396558 wait complete. 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.863+0000 7f4343619640 1 Processor -- start 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.863+0000 7f4343619640 1 -- start start 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f4343619640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f433c0fea30 0x7f433c0fb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f4343619640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f433c104a30 0x7f433c0fb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f4343619640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c0fba80 con 0x7f433c104a30 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f4343619640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c0fbbf0 con 0x7f433c0fea30 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f4340bb4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f433c104a30 0x7f433c0fb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f4340bb4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f433c104a30 0x7f433c0fb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53406/0 (socket says 172.21.15.17:53406) 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f4340bb4640 1 -- 172.21.15.17:0/23288080 learned_addr learned my addr 172.21.15.17:0/23288080 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:52.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f43413b5640 1 --2- 172.21.15.17:0/23288080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f433c0fea30 0x7f433c0fb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f4340bb4640 1 -- 172.21.15.17:0/23288080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f433c0fea30 msgr2=0x7f433c0fb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f4340bb4640 1 --2- 172.21.15.17:0/23288080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f433c0fea30 0x7f433c0fb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f4340bb4640 1 -- 172.21.15.17:0/23288080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c009560 con 0x7f433c104a30 2024-08-19T01:14:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.864+0000 7f4340bb4640 1 --2- 172.21.15.17:0/23288080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f433c104a30 0x7f433c0fb540 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f432c02a9c0 tx=0x7f432c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.865+0000 7f43327fc640 1 -- 172.21.15.17:0/23288080 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f432c004aa0 con 0x7f433c104a30 2024-08-19T01:14:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.865+0000 7f43327fc640 1 -- 172.21.15.17:0/23288080 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f432c004c00 con 0x7f433c104a30 2024-08-19T01:14:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.865+0000 7f4343619640 1 -- 172.21.15.17:0/23288080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c0fbe70 con 0x7f433c104a30 2024-08-19T01:14:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.865+0000 7f43327fc640 1 -- 172.21.15.17:0/23288080 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f432c003980 con 0x7f433c104a30 2024-08-19T01:14:52.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.865+0000 7f4343619640 1 -- 172.21.15.17:0/23288080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c1a1ef0 con 0x7f433c104a30 2024-08-19T01:14:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.866+0000 7f4343619640 1 -- 172.21.15.17:0/23288080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433c100170 con 0x7f433c104a30 2024-08-19T01:14:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.866+0000 7f43327fc640 1 -- 172.21.15.17:0/23288080 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f432c003bf0 con 0x7f433c104a30 2024-08-19T01:14:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.867+0000 7f43327fc640 1 --2- 172.21.15.17:0/23288080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f432806e170 0x7f4328070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.867+0000 7f43327fc640 1 -- 172.21.15.17:0/23288080 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f432c0aefb0 con 0x7f433c104a30 2024-08-19T01:14:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.867+0000 7f43413b5640 1 --2- 172.21.15.17:0/23288080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f432806e170 0x7f4328070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:52.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.867+0000 7f43413b5640 1 --2- 172.21.15.17:0/23288080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f432806e170 0x7f4328070630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4338005d00 tx=0x7f433800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:52.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:52.871+0000 7f43327fc640 1 -- 172.21.15.17:0/23288080 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f432c078340 con 0x7f433c104a30 2024-08-19T01:14:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:52 smithi086 ceph-mon[71303]: pgmap v482: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:53.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.057+0000 7f4343619640 1 -- 172.21.15.17:0/23288080 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f433c0fbe70 con 0x7f432806e170 2024-08-19T01:14:53.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.066+0000 7f43327fc640 1 -- 172.21.15.17:0/23288080 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f433c0fbe70 con 0x7f432806e170 2024-08-19T01:14:53.068 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (16m) 10m ago 26m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (27m) 10m ago 27m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (26m) 9m ago 26m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (13m) 10m ago 27m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (13m) 9m ago 25m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (15m) 10m ago 26m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (10m) 10m ago 21m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (10m) 10m ago 21m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (21m) 9m ago 21m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (9m) 9m ago 21m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (18m) 10m ago 28m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (17m) 9m ago 25m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:14:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (14m) 10m ago 28m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:14:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (14m) 9m ago 25m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:14:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (16m) 10m ago 26m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:14:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (16m) 9m ago 25m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:14:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (13m) 10m ago 25m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:14:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (12m) 10m ago 24m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:14:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (12m) 10m ago 24m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:14:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (11m) 9m ago 23m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:14:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (11m) 9m ago 23m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:14:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (10m) 9m ago 22m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:14:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (16m) 10m ago 26m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:14:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.069+0000 7f4343619640 1 -- 172.21.15.17:0/23288080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f432806e170 msgr2=0x7f4328070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.069+0000 7f4343619640 1 --2- 172.21.15.17:0/23288080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f432806e170 0x7f4328070630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4338005d00 tx=0x7f433800b410 comp rx=0 tx=0).stop 2024-08-19T01:14:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.069+0000 7f4343619640 1 -- 172.21.15.17:0/23288080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f433c104a30 msgr2=0x7f433c0fb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.069+0000 7f4343619640 1 --2- 172.21.15.17:0/23288080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f433c104a30 0x7f433c0fb540 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f432c02a9c0 tx=0x7f432c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.069+0000 7f4343619640 1 -- 172.21.15.17:0/23288080 shutdown_connections 2024-08-19T01:14:53.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.069+0000 7f4343619640 1 --2- 172.21.15.17:0/23288080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f432806e170 0x7f4328070630 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.069+0000 7f4343619640 1 --2- 172.21.15.17:0/23288080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f433c104a30 0x7f433c0fb540 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.069+0000 7f4343619640 1 --2- 172.21.15.17:0/23288080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f433c0fea30 0x7f433c0fb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.069+0000 7f4343619640 1 -- 172.21.15.17:0/23288080 >> 172.21.15.17:0/23288080 conn(0x7f433c0fa730 msgr2=0x7f433c068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:53.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.069+0000 7f4343619640 1 -- 172.21.15.17:0/23288080 shutdown_connections 2024-08-19T01:14:53.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.069+0000 7f4343619640 1 -- 172.21.15.17:0/23288080 wait complete. 2024-08-19T01:14:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.150+0000 7f0590ecf640 1 -- 172.21.15.17:0/786663013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f058c1049f0 msgr2=0x7f058c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.150+0000 7f0590ecf640 1 --2- 172.21.15.17:0/786663013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f058c1049f0 0x7f058c104dd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f057c009880 tx=0x7f057c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.150+0000 7f0590ecf640 1 -- 172.21.15.17:0/786663013 shutdown_connections 2024-08-19T01:14:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.150+0000 7f0590ecf640 1 --2- 172.21.15.17:0/786663013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f058c0fe9f0 0x7f058c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.150+0000 7f0590ecf640 1 --2- 172.21.15.17:0/786663013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f058c1049f0 0x7f058c104dd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.150+0000 7f0590ecf640 1 -- 172.21.15.17:0/786663013 >> 172.21.15.17:0/786663013 conn(0x7f058c0758a0 msgr2=0x7f058c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.150+0000 7f0590ecf640 1 -- 172.21.15.17:0/786663013 shutdown_connections 2024-08-19T01:14:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.150+0000 7f0590ecf640 1 -- 172.21.15.17:0/786663013 wait complete. 2024-08-19T01:14:53.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.151+0000 7f0590ecf640 1 Processor -- start 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.151+0000 7f0590ecf640 1 -- start start 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.151+0000 7f0590ecf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f058c0fe9f0 0x7f058c196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.151+0000 7f0590ecf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f058c1049f0 0x7f058c196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.151+0000 7f0590ecf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c1974a0 con 0x7f058c0fe9f0 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.151+0000 7f0590ecf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c1975e0 con 0x7f058c1049f0 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.151+0000 7f058a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f058c0fe9f0 0x7f058c196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.151+0000 7f058a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f058c0fe9f0 0x7f058c196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53418/0 (socket says 172.21.15.17:53418) 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.151+0000 7f058a59c640 1 -- 172.21.15.17:0/310974727 learned_addr learned my addr 172.21.15.17:0/310974727 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.152+0000 7f0589d9b640 1 --2- 172.21.15.17:0/310974727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f058c1049f0 0x7f058c196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.152+0000 7f058a59c640 1 -- 172.21.15.17:0/310974727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f058c1049f0 msgr2=0x7f058c196e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.152+0000 7f058a59c640 1 --2- 172.21.15.17:0/310974727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f058c1049f0 0x7f058c196e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.152+0000 7f058a59c640 1 -- 172.21.15.17:0/310974727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c009560 con 0x7f058c0fe9f0 2024-08-19T01:14:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.152+0000 7f058a59c640 1 --2- 172.21.15.17:0/310974727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f058c0fe9f0 0x7f058c196940 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f057c006010 tx=0x7f057c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.152+0000 7f057b7fe640 1 -- 172.21.15.17:0/310974727 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f057c004aa0 con 0x7f058c0fe9f0 2024-08-19T01:14:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.152+0000 7f0590ecf640 1 -- 172.21.15.17:0/310974727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c19f9b0 con 0x7f058c0fe9f0 2024-08-19T01:14:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.152+0000 7f057b7fe640 1 -- 172.21.15.17:0/310974727 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f057c031470 con 0x7f058c0fe9f0 2024-08-19T01:14:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.152+0000 7f057b7fe640 1 -- 172.21.15.17:0/310974727 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f057c003940 con 0x7f058c0fe9f0 2024-08-19T01:14:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.152+0000 7f0590ecf640 1 -- 172.21.15.17:0/310974727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c19fdc0 con 0x7f058c0fe9f0 2024-08-19T01:14:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.153+0000 7f0590ecf640 1 -- 172.21.15.17:0/310974727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c100130 con 0x7f058c0fe9f0 2024-08-19T01:14:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.154+0000 7f057b7fe640 1 -- 172.21.15.17:0/310974727 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f057c003bc0 con 0x7f058c0fe9f0 2024-08-19T01:14:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.155+0000 7f057b7fe640 1 --2- 172.21.15.17:0/310974727 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f057406e180 0x7f0574070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.155+0000 7f0589d9b640 1 --2- 172.21.15.17:0/310974727 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f057406e180 0x7f0574070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.155+0000 7f057b7fe640 1 -- 172.21.15.17:0/310974727 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f057c0af1c0 con 0x7f058c0fe9f0 2024-08-19T01:14:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.155+0000 7f0589d9b640 1 --2- 172.21.15.17:0/310974727 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f057406e180 0x7f0574070640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f058c0687f0 tx=0x7f058000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:53.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.161+0000 7f057b7fe640 1 -- 172.21.15.17:0/310974727 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f057c078550 con 0x7f058c0fe9f0 2024-08-19T01:14:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.409+0000 7f0590ecf640 1 -- 172.21.15.17:0/310974727 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f058c0fee50 con 0x7f058c0fe9f0 2024-08-19T01:14:53.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.409+0000 7f057b7fe640 1 -- 172.21.15.17:0/310974727 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f057c07bc10 con 0x7f058c0fe9f0 2024-08-19T01:14:53.411 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:14:53.412 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:14:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:14:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:14:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:14:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:14:53.413 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:14:53.413 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:14:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.412+0000 7f0590ecf640 1 -- 172.21.15.17:0/310974727 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f057406e180 msgr2=0x7f0574070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.412+0000 7f0590ecf640 1 --2- 172.21.15.17:0/310974727 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f057406e180 0x7f0574070640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f058c0687f0 tx=0x7f058000b410 comp rx=0 tx=0).stop 2024-08-19T01:14:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.412+0000 7f0590ecf640 1 -- 172.21.15.17:0/310974727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f058c0fe9f0 msgr2=0x7f058c196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.412+0000 7f0590ecf640 1 --2- 172.21.15.17:0/310974727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f058c0fe9f0 0x7f058c196940 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f057c006010 tx=0x7f057c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.412+0000 7f0590ecf640 1 -- 172.21.15.17:0/310974727 shutdown_connections 2024-08-19T01:14:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.412+0000 7f0590ecf640 1 --2- 172.21.15.17:0/310974727 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f057406e180 0x7f0574070640 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.412+0000 7f0590ecf640 1 --2- 172.21.15.17:0/310974727 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f058c1049f0 0x7f058c196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.412+0000 7f0590ecf640 1 --2- 172.21.15.17:0/310974727 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f058c0fe9f0 0x7f058c196940 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.412+0000 7f0590ecf640 1 -- 172.21.15.17:0/310974727 >> 172.21.15.17:0/310974727 conn(0x7f058c0758a0 msgr2=0x7f058c0fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:53.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.412+0000 7f0590ecf640 1 -- 172.21.15.17:0/310974727 shutdown_connections 2024-08-19T01:14:53.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.412+0000 7f0590ecf640 1 -- 172.21.15.17:0/310974727 wait complete. 2024-08-19T01:14:53.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.494+0000 7f82f8835640 1 -- 172.21.15.17:0/1512623858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f41015d0 msgr2=0x7f82f4109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.494+0000 7f82f8835640 1 --2- 172.21.15.17:0/1512623858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f41015d0 0x7f82f4109ac0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009880 tx=0x7f82dc02a530 comp rx=0 tx=0).stop 2024-08-19T01:14:53.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.495+0000 7f82f8835640 1 -- 172.21.15.17:0/1512623858 shutdown_connections 2024-08-19T01:14:53.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.495+0000 7f82f8835640 1 --2- 172.21.15.17:0/1512623858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f41015d0 0x7f82f4109ac0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.495+0000 7f82f8835640 1 --2- 172.21.15.17:0/1512623858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f4100cb0 0x7f82f4101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.495+0000 7f82f8835640 1 -- 172.21.15.17:0/1512623858 >> 172.21.15.17:0/1512623858 conn(0x7f82f40758a0 msgr2=0x7f82f40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:53.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.495+0000 7f82f8835640 1 -- 172.21.15.17:0/1512623858 shutdown_connections 2024-08-19T01:14:53.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.495+0000 7f82f8835640 1 -- 172.21.15.17:0/1512623858 wait complete. 2024-08-19T01:14:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.495+0000 7f82f8835640 1 Processor -- start 2024-08-19T01:14:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.495+0000 7f82f8835640 1 -- start start 2024-08-19T01:14:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f8835640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100cb0 0x7f82f4197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f8835640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f41015d0 0x7f82f4198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f8835640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f41988e0 con 0x7f82f4100cb0 2024-08-19T01:14:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f8835640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f419c650 con 0x7f82f41015d0 2024-08-19T01:14:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100cb0 0x7f82f4197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100cb0 0x7f82f4197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53442/0 (socket says 172.21.15.17:53442) 2024-08-19T01:14:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f259c640 1 -- 172.21.15.17:0/2159315604 learned_addr learned my addr 172.21.15.17:0/2159315604 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f1d9b640 1 --2- 172.21.15.17:0/2159315604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f41015d0 0x7f82f4198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:53.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f259c640 1 -- 172.21.15.17:0/2159315604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f41015d0 msgr2=0x7f82f4198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f259c640 1 --2- 172.21.15.17:0/2159315604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f41015d0 0x7f82f4198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f259c640 1 -- 172.21.15.17:0/2159315604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc009560 con 0x7f82f4100cb0 2024-08-19T01:14:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f259c640 1 --2- 172.21.15.17:0/2159315604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100cb0 0x7f82f4197d10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f82e400ea00 tx=0x7f82e400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82eb7fe640 1 -- 172.21.15.17:0/2159315604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82e400cd50 con 0x7f82f4100cb0 2024-08-19T01:14:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f8835640 1 -- 172.21.15.17:0/2159315604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f419c930 con 0x7f82f4100cb0 2024-08-19T01:14:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82eb7fe640 1 -- 172.21.15.17:0/2159315604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f82e4005020 con 0x7f82f4100cb0 2024-08-19T01:14:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82eb7fe640 1 -- 172.21.15.17:0/2159315604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82e40116a0 con 0x7f82f4100cb0 2024-08-19T01:14:53.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.496+0000 7f82f8835640 1 -- 172.21.15.17:0/2159315604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f419ce80 con 0x7f82f4100cb0 2024-08-19T01:14:53.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.497+0000 7f82f8835640 1 -- 172.21.15.17:0/2159315604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f4068510 con 0x7f82f4100cb0 2024-08-19T01:14:53.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.498+0000 7f82eb7fe640 1 -- 172.21.15.17:0/2159315604 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f82e4005190 con 0x7f82f4100cb0 2024-08-19T01:14:53.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.498+0000 7f82eb7fe640 1 --2- 172.21.15.17:0/2159315604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82e006e170 0x7f82e0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:53.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.498+0000 7f82eb7fe640 1 -- 172.21.15.17:0/2159315604 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f82e408e550 con 0x7f82f4100cb0 2024-08-19T01:14:53.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.498+0000 7f82f1d9b640 1 --2- 172.21.15.17:0/2159315604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82e006e170 0x7f82e0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:53.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.499+0000 7f82f1d9b640 1 --2- 172.21.15.17:0/2159315604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82e006e170 0x7f82e0070630 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f82dc000c00 tx=0x7f82dc004040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:53.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.503+0000 7f82eb7fe640 1 -- 172.21.15.17:0/2159315604 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f82e4057830 con 0x7f82f4100cb0 2024-08-19T01:14:53.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:53 smithi017 ceph-mon[99370]: from='client.34932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:53.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:53 smithi017 ceph-mon[99370]: from='client.34936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:53.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:53 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/310974727' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:14:53.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.717+0000 7f82f8835640 1 -- 172.21.15.17:0/2159315604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f82f4101090 con 0x7f82f4100cb0 2024-08-19T01:14:53.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.718+0000 7f82eb7fe640 1 -- 172.21.15.17:0/2159315604 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f82e401f790 con 0x7f82f4100cb0 2024-08-19T01:14:53.720 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:14:53.720 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:14:53.720 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:14:53.720 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:14:53.720 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:14:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:14:53.720 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:14:53.720 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:14:53.720 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:14:53.720 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:14:53.720 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:14:53.721 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:14:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:14:53.723 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:14:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:14:53.723 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:14:53.723 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:14:53.723 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:14:53.723 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.720+0000 7f82f8835640 1 -- 172.21.15.17:0/2159315604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82e006e170 msgr2=0x7f82e0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.720+0000 7f82f8835640 1 --2- 172.21.15.17:0/2159315604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82e006e170 0x7f82e0070630 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f82dc000c00 tx=0x7f82dc004040 comp rx=0 tx=0).stop 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.720+0000 7f82f8835640 1 -- 172.21.15.17:0/2159315604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100cb0 msgr2=0x7f82f4197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.720+0000 7f82f8835640 1 --2- 172.21.15.17:0/2159315604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100cb0 0x7f82f4197d10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f82e400ea00 tx=0x7f82e400eec0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.720+0000 7f82f8835640 1 -- 172.21.15.17:0/2159315604 shutdown_connections 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.720+0000 7f82f8835640 1 --2- 172.21.15.17:0/2159315604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82e006e170 0x7f82e0070630 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.720+0000 7f82f8835640 1 --2- 172.21.15.17:0/2159315604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f41015d0 0x7f82f4198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.720+0000 7f82f8835640 1 --2- 172.21.15.17:0/2159315604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100cb0 0x7f82f4197d10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.720+0000 7f82f8835640 1 -- 172.21.15.17:0/2159315604 >> 172.21.15.17:0/2159315604 conn(0x7f82f40758a0 msgr2=0x7f82f40ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.720+0000 7f82f8835640 1 -- 172.21.15.17:0/2159315604 shutdown_connections 2024-08-19T01:14:53.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.720+0000 7f82f8835640 1 -- 172.21.15.17:0/2159315604 wait complete. 2024-08-19T01:14:53.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.803+0000 7f304a2a9640 1 -- 172.21.15.17:0/1217208148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30440fe290 msgr2=0x7f30440fe670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.803+0000 7f304a2a9640 1 --2- 172.21.15.17:0/1217208148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30440fe290 0x7f30440fe670 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3034009880 tx=0x7f303402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.803+0000 7f304a2a9640 1 -- 172.21.15.17:0/1217208148 shutdown_connections 2024-08-19T01:14:53.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.803+0000 7f304a2a9640 1 --2- 172.21.15.17:0/1217208148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30440fec40 0x7f3044104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.803+0000 7f304a2a9640 1 --2- 172.21.15.17:0/1217208148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30440fe290 0x7f30440fe670 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.803+0000 7f304a2a9640 1 -- 172.21.15.17:0/1217208148 >> 172.21.15.17:0/1217208148 conn(0x7f30440f9ec0 msgr2=0x7f30440fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:53.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.803+0000 7f304a2a9640 1 -- 172.21.15.17:0/1217208148 shutdown_connections 2024-08-19T01:14:53.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.803+0000 7f304a2a9640 1 -- 172.21.15.17:0/1217208148 wait complete. 2024-08-19T01:14:53.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.804+0000 7f304a2a9640 1 Processor -- start 2024-08-19T01:14:53.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.804+0000 7f304a2a9640 1 -- start start 2024-08-19T01:14:53.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.804+0000 7f304a2a9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30440fe290 0x7f30440ff210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:53.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.804+0000 7f304a2a9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30440fec40 0x7f30440ff750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:53.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.804+0000 7f304a2a9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30440ffc90 con 0x7f30440fec40 2024-08-19T01:14:53.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.804+0000 7f304a2a9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30440ffe00 con 0x7f30440fe290 2024-08-19T01:14:53.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f30437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30440fec40 0x7f30440ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:53.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f30437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30440fec40 0x7f30440ff750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53456/0 (socket says 172.21.15.17:53456) 2024-08-19T01:14:53.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f30437fe640 1 -- 172.21.15.17:0/2774348020 learned_addr learned my addr 172.21.15.17:0/2774348020 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:53.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f3043fff640 1 --2- 172.21.15.17:0/2774348020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30440fe290 0x7f30440ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:53.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f30437fe640 1 -- 172.21.15.17:0/2774348020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30440fe290 msgr2=0x7f30440ff210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:53.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f30437fe640 1 --2- 172.21.15.17:0/2774348020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30440fe290 0x7f30440ff210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:53.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f30437fe640 1 -- 172.21.15.17:0/2774348020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3034009560 con 0x7f30440fec40 2024-08-19T01:14:53.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f30437fe640 1 --2- 172.21.15.17:0/2774348020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30440fec40 0x7f30440ff750 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f303800d6f0 tx=0x7f303800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:53.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f30417fa640 1 -- 172.21.15.17:0/2774348020 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3038009a30 con 0x7f30440fec40 2024-08-19T01:14:53.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f30417fa640 1 -- 172.21.15.17:0/2774348020 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f30380054e0 con 0x7f30440fec40 2024-08-19T01:14:53.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f304a2a9640 1 -- 172.21.15.17:0/2774348020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30441a1d10 con 0x7f30440fec40 2024-08-19T01:14:53.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f30417fa640 1 -- 172.21.15.17:0/2774348020 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3038010460 con 0x7f30440fec40 2024-08-19T01:14:53.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.805+0000 7f304a2a9640 1 -- 172.21.15.17:0/2774348020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30441a2070 con 0x7f30440fec40 2024-08-19T01:14:53.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.807+0000 7f304a2a9640 1 -- 172.21.15.17:0/2774348020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3044101350 con 0x7f30440fec40 2024-08-19T01:14:53.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.807+0000 7f30417fa640 1 -- 172.21.15.17:0/2774348020 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3038009b90 con 0x7f30440fec40 2024-08-19T01:14:53.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.807+0000 7f30417fa640 1 --2- 172.21.15.17:0/2774348020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f302c06e170 0x7f302c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:53.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.807+0000 7f30417fa640 1 -- 172.21.15.17:0/2774348020 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f303808dbd0 con 0x7f30440fec40 2024-08-19T01:14:53.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.807+0000 7f3043fff640 1 --2- 172.21.15.17:0/2774348020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f302c06e170 0x7f302c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:53.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.808+0000 7f3043fff640 1 --2- 172.21.15.17:0/2774348020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f302c06e170 0x7f302c070630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3034009230 tx=0x7f30340058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:53.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:53.812+0000 7f30417fa640 1 -- 172.21.15.17:0/2774348020 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3038056fe0 con 0x7f30440fec40 2024-08-19T01:14:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:53 smithi086 ceph-mon[71303]: from='client.34932 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:53 smithi086 ceph-mon[71303]: from='client.34936 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:53 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/310974727' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:14:54.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.003+0000 7f304a2a9640 1 -- 172.21.15.17:0/2774348020 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3044108130 con 0x7f302c06e170 2024-08-19T01:14:54.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.004+0000 7f30417fa640 1 -- 172.21.15.17:0/2774348020 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f3044108130 con 0x7f302c06e170 2024-08-19T01:14:54.006 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:14:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:14:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:14:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:14:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:14:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:14:54.006 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:14:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:14:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:14:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:14:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:14:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:14:54.007 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:14:54.007 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:14:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.007+0000 7f304a2a9640 1 -- 172.21.15.17:0/2774348020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f302c06e170 msgr2=0x7f302c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.007+0000 7f304a2a9640 1 --2- 172.21.15.17:0/2774348020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f302c06e170 0x7f302c070630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3034009230 tx=0x7f30340058d0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.007+0000 7f304a2a9640 1 -- 172.21.15.17:0/2774348020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30440fec40 msgr2=0x7f30440ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.007+0000 7f304a2a9640 1 --2- 172.21.15.17:0/2774348020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30440fec40 0x7f30440ff750 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f303800d6f0 tx=0x7f303800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.007+0000 7f304a2a9640 1 -- 172.21.15.17:0/2774348020 shutdown_connections 2024-08-19T01:14:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.007+0000 7f304a2a9640 1 --2- 172.21.15.17:0/2774348020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f302c06e170 0x7f302c070630 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.007+0000 7f304a2a9640 1 --2- 172.21.15.17:0/2774348020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30440fec40 0x7f30440ff750 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.007+0000 7f304a2a9640 1 --2- 172.21.15.17:0/2774348020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f30440fe290 0x7f30440ff210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.007+0000 7f304a2a9640 1 -- 172.21.15.17:0/2774348020 >> 172.21.15.17:0/2774348020 conn(0x7f30440f9ec0 msgr2=0x7f30440fb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.007+0000 7f304a2a9640 1 -- 172.21.15.17:0/2774348020 shutdown_connections 2024-08-19T01:14:54.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.007+0000 7f304a2a9640 1 -- 172.21.15.17:0/2774348020 wait complete. 2024-08-19T01:14:54.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.089+0000 7fe71cf25640 1 -- 172.21.15.17:0/817679271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe718100750 msgr2=0x7fe7181047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:54.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.089+0000 7fe71cf25640 1 --2- 172.21.15.17:0/817679271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe718100750 0x7fe7181047a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe70c009880 tx=0x7fe70c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.089+0000 7fe71cf25640 1 -- 172.21.15.17:0/817679271 shutdown_connections 2024-08-19T01:14:54.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.089+0000 7fe71cf25640 1 --2- 172.21.15.17:0/817679271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe718100750 0x7fe7181047a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.089+0000 7fe71cf25640 1 --2- 172.21.15.17:0/817679271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7180ffda0 0x7fe718100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.089+0000 7fe71cf25640 1 -- 172.21.15.17:0/817679271 >> 172.21.15.17:0/817679271 conn(0x7fe7180fb840 msgr2=0x7fe7180fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:54.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.090+0000 7fe71cf25640 1 -- 172.21.15.17:0/817679271 shutdown_connections 2024-08-19T01:14:54.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.090+0000 7fe71cf25640 1 -- 172.21.15.17:0/817679271 wait complete. 2024-08-19T01:14:54.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.090+0000 7fe71cf25640 1 Processor -- start 2024-08-19T01:14:54.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.090+0000 7fe71cf25640 1 -- start start 2024-08-19T01:14:54.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.090+0000 7fe71cf25640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7180ffda0 0x7fe71819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:54.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.090+0000 7fe71cf25640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe718100750 0x7fe71819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:54.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe71cf25640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe718195930 con 0x7fe718100750 2024-08-19T01:14:54.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe71cf25640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe718195a70 con 0x7fe7180ffda0 2024-08-19T01:14:54.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe715d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe718100750 0x7fe71819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:54.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe715d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe718100750 0x7fe71819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53488/0 (socket says 172.21.15.17:53488) 2024-08-19T01:14:54.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe715d9b640 1 -- 172.21.15.17:0/1084359511 learned_addr learned my addr 172.21.15.17:0/1084359511 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:14:54.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe71659c640 1 --2- 172.21.15.17:0/1084359511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7180ffda0 0x7fe71819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:54.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe715d9b640 1 -- 172.21.15.17:0/1084359511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7180ffda0 msgr2=0x7fe71819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:54.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe715d9b640 1 --2- 172.21.15.17:0/1084359511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7180ffda0 0x7fe71819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe715d9b640 1 -- 172.21.15.17:0/1084359511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c009560 con 0x7fe718100750 2024-08-19T01:14:54.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe715d9b640 1 --2- 172.21.15.17:0/1084359511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe718100750 0x7fe71819be10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe70c02a9c0 tx=0x7fe70c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:54.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe7077fe640 1 -- 172.21.15.17:0/1084359511 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe70c0048d0 con 0x7fe718100750 2024-08-19T01:14:54.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe7077fe640 1 -- 172.21.15.17:0/1084359511 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe70c031640 con 0x7fe718100750 2024-08-19T01:14:54.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe71cf25640 1 -- 172.21.15.17:0/1084359511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe718195cf0 con 0x7fe718100750 2024-08-19T01:14:54.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe7077fe640 1 -- 172.21.15.17:0/1084359511 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe70c0038d0 con 0x7fe718100750 2024-08-19T01:14:54.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.091+0000 7fe71cf25640 1 -- 172.21.15.17:0/1084359511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7181961e0 con 0x7fe718100750 2024-08-19T01:14:54.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.092+0000 7fe71cf25640 1 -- 172.21.15.17:0/1084359511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe718101280 con 0x7fe718100750 2024-08-19T01:14:54.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.093+0000 7fe7077fe640 1 -- 172.21.15.17:0/1084359511 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe70c003b90 con 0x7fe718100750 2024-08-19T01:14:54.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.093+0000 7fe7077fe640 1 --2- 172.21.15.17:0/1084359511 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe70006e170 0x7fe700070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:14:54.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.093+0000 7fe7077fe640 1 -- 172.21.15.17:0/1084359511 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe70c0af150 con 0x7fe718100750 2024-08-19T01:14:54.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.093+0000 7fe71659c640 1 --2- 172.21.15.17:0/1084359511 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe70006e170 0x7fe700070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:14:54.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.094+0000 7fe71659c640 1 --2- 172.21.15.17:0/1084359511 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe70006e170 0x7fe700070630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe708009b40 tx=0x7fe708005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:14:54.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.098+0000 7fe7077fe640 1 -- 172.21.15.17:0/1084359511 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe70c078430 con 0x7fe718100750 2024-08-19T01:14:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.347+0000 7fe71cf25640 1 -- 172.21.15.17:0/1084359511 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe7181080b0 con 0x7fe718100750 2024-08-19T01:14:54.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.347+0000 7fe7077fe640 1 -- 172.21.15.17:0/1084359511 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7fe70c07baf0 con 0x7fe718100750 2024-08-19T01:14:54.350 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:14:54.350 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:14:54.350 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:14:54.350 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:14:54.350 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:14:54.350 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:14:54.350 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:14:54.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.350+0000 7fe71cf25640 1 -- 172.21.15.17:0/1084359511 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe70006e170 msgr2=0x7fe700070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:54.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.350+0000 7fe71cf25640 1 --2- 172.21.15.17:0/1084359511 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe70006e170 0x7fe700070630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe708009b40 tx=0x7fe708005f90 comp rx=0 tx=0).stop 2024-08-19T01:14:54.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.350+0000 7fe71cf25640 1 -- 172.21.15.17:0/1084359511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe718100750 msgr2=0x7fe71819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:14:54.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.350+0000 7fe71cf25640 1 --2- 172.21.15.17:0/1084359511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe718100750 0x7fe71819be10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe70c02a9c0 tx=0x7fe70c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.350+0000 7fe71cf25640 1 -- 172.21.15.17:0/1084359511 shutdown_connections 2024-08-19T01:14:54.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.350+0000 7fe71cf25640 1 --2- 172.21.15.17:0/1084359511 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe70006e170 0x7fe700070630 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.350+0000 7fe71cf25640 1 --2- 172.21.15.17:0/1084359511 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe718100750 0x7fe71819be10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.350+0000 7fe71cf25640 1 --2- 172.21.15.17:0/1084359511 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe7180ffda0 0x7fe71819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:14:54.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.350+0000 7fe71cf25640 1 -- 172.21.15.17:0/1084359511 >> 172.21.15.17:0/1084359511 conn(0x7fe7180fb840 msgr2=0x7fe7180fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:14:54.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.350+0000 7fe71cf25640 1 -- 172.21.15.17:0/1084359511 shutdown_connections 2024-08-19T01:14:54.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:14:54.350+0000 7fe71cf25640 1 -- 172.21.15.17:0/1084359511 wait complete. 2024-08-19T01:14:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:54 smithi017 ceph-mon[99370]: from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:54 smithi017 ceph-mon[99370]: pgmap v483: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:54 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2159315604' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:14:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:54 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1084359511' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:14:54.703 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:54 smithi086 ceph-mon[71303]: from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:54.704 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:54 smithi086 ceph-mon[71303]: pgmap v483: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:54.704 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:54 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2159315604' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:14:54.704 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:54 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1084359511' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:14:55.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:55 smithi017 ceph-mon[99370]: from='client.34952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:55.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:55 smithi086 ceph-mon[71303]: from='client.34952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:14:56.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:56 smithi017 ceph-mon[99370]: pgmap v484: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:56 smithi086 ceph-mon[71303]: pgmap v484: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:14:58 smithi017 ceph-mon[99370]: pgmap v485: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:14:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:14:58 smithi086 ceph-mon[71303]: pgmap v485: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:00 smithi017 ceph-mon[99370]: pgmap v486: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:00 smithi086 ceph-mon[71303]: pgmap v486: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:02 smithi017 ceph-mon[99370]: pgmap v487: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:02 smithi086 ceph-mon[71303]: pgmap v487: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:03.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:15:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:15:04.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:04 smithi017 ceph-mon[99370]: pgmap v488: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:04.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:04 smithi086 ceph-mon[71303]: pgmap v488: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:06.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:06 smithi017 ceph-mon[99370]: pgmap v489: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:06 smithi086 ceph-mon[71303]: pgmap v489: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:08.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:08 smithi017 ceph-mon[99370]: pgmap v490: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:08.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:08 smithi086 ceph-mon[71303]: pgmap v490: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:10.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:10 smithi017 ceph-mon[99370]: pgmap v491: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:10 smithi086 ceph-mon[71303]: pgmap v491: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:12.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:12 smithi017 ceph-mon[99370]: pgmap v492: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:12.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:12 smithi086 ceph-mon[71303]: pgmap v492: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:14.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:14 smithi017 ceph-mon[99370]: pgmap v493: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:14.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:14 smithi086 ceph-mon[71303]: pgmap v493: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:16.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:16 smithi017 ceph-mon[99370]: pgmap v494: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:16.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:16 smithi086 ceph-mon[71303]: pgmap v494: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:18 smithi017 ceph-mon[99370]: pgmap v495: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:15:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:18 smithi086 ceph-mon[71303]: pgmap v495: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:15:20.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:20 smithi017 ceph-mon[99370]: pgmap v496: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:20.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:20 smithi086 ceph-mon[71303]: pgmap v496: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:22.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:22 smithi017 ceph-mon[99370]: pgmap v497: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:22 smithi086 ceph-mon[71303]: pgmap v497: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:24.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.445+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/3882612242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f940ffda0 msgr2=0x7f4f94100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:24.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.445+0000 7f4f9c6a9640 1 --2- 172.21.15.17:0/3882612242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f940ffda0 0x7f4f94100180 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009880 tx=0x7f4f9002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.446+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/3882612242 shutdown_connections 2024-08-19T01:15:24.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.446+0000 7f4f9c6a9640 1 --2- 172.21.15.17:0/3882612242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f94100750 0x7f4f941047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.446+0000 7f4f9c6a9640 1 --2- 172.21.15.17:0/3882612242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f940ffda0 0x7f4f94100180 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.446+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/3882612242 >> 172.21.15.17:0/3882612242 conn(0x7f4f940fb840 msgr2=0x7f4f940fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:24.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.446+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/3882612242 shutdown_connections 2024-08-19T01:15:24.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.446+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/3882612242 wait complete. 2024-08-19T01:15:24.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.446+0000 7f4f9c6a9640 1 Processor -- start 2024-08-19T01:15:24.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.446+0000 7f4f9c6a9640 1 -- start start 2024-08-19T01:15:24.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9c6a9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f940ffda0 0x7f4f9419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:24.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9c6a9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f94100750 0x7f4f9419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:24.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9c6a9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9419c2d0 con 0x7f4f940ffda0 2024-08-19T01:15:24.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9c6a9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f941958f0 con 0x7f4f94100750 2024-08-19T01:15:24.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9a445640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f940ffda0 0x7f4f9419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:24.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9a445640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f940ffda0 0x7f4f9419b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60968/0 (socket says 172.21.15.17:60968) 2024-08-19T01:15:24.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9a445640 1 -- 172.21.15.17:0/2108699382 learned_addr learned my addr 172.21.15.17:0/2108699382 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:24.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f99c44640 1 --2- 172.21.15.17:0/2108699382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f94100750 0x7f4f9419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:24.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9a445640 1 -- 172.21.15.17:0/2108699382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f94100750 msgr2=0x7f4f9419bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:24.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9a445640 1 --2- 172.21.15.17:0/2108699382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f94100750 0x7f4f9419bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9a445640 1 -- 172.21.15.17:0/2108699382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90009560 con 0x7f4f940ffda0 2024-08-19T01:15:24.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9a445640 1 --2- 172.21.15.17:0/2108699382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f940ffda0 0x7f4f9419b800 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4f9002a9c0 tx=0x7f4f900055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:24.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f8b7fe640 1 -- 172.21.15.17:0/2108699382 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f90004aa0 con 0x7f4f940ffda0 2024-08-19T01:15:24.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.447+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/2108699382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f94195b70 con 0x7f4f940ffda0 2024-08-19T01:15:24.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.448+0000 7f4f8b7fe640 1 -- 172.21.15.17:0/2108699382 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f90004c00 con 0x7f4f940ffda0 2024-08-19T01:15:24.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.448+0000 7f4f8b7fe640 1 -- 172.21.15.17:0/2108699382 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f90003a20 con 0x7f4f940ffda0 2024-08-19T01:15:24.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.448+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/2108699382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f94196060 con 0x7f4f940ffda0 2024-08-19T01:15:24.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.449+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/2108699382 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f94101280 con 0x7f4f940ffda0 2024-08-19T01:15:24.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.449+0000 7f4f8b7fe640 1 -- 172.21.15.17:0/2108699382 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4f90031c90 con 0x7f4f940ffda0 2024-08-19T01:15:24.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.450+0000 7f4f8b7fe640 1 --2- 172.21.15.17:0/2108699382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f8006e170 0x7f4f80070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:24.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.450+0000 7f4f8b7fe640 1 -- 172.21.15.17:0/2108699382 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4f900af150 con 0x7f4f940ffda0 2024-08-19T01:15:24.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.450+0000 7f4f99c44640 1 --2- 172.21.15.17:0/2108699382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f8006e170 0x7f4f80070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:24.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.450+0000 7f4f99c44640 1 --2- 172.21.15.17:0/2108699382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f8006e170 0x7f4f80070630 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4f94196d60 tx=0x7f4f8400a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:24.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.454+0000 7f4f8b7fe640 1 -- 172.21.15.17:0/2108699382 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4f900784b0 con 0x7f4f940ffda0 2024-08-19T01:15:24.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.647+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/2108699382 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f9410cdb0 con 0x7f4f8006e170 2024-08-19T01:15:24.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.648+0000 7f4f8b7fe640 1 -- 172.21.15.17:0/2108699382 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4f9410cdb0 con 0x7f4f8006e170 2024-08-19T01:15:24.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.650+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/2108699382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f8006e170 msgr2=0x7f4f80070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:24.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.650+0000 7f4f9c6a9640 1 --2- 172.21.15.17:0/2108699382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f8006e170 0x7f4f80070630 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4f94196d60 tx=0x7f4f8400a2d0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.650+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/2108699382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f940ffda0 msgr2=0x7f4f9419b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:24.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.650+0000 7f4f9c6a9640 1 --2- 172.21.15.17:0/2108699382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f940ffda0 0x7f4f9419b800 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4f9002a9c0 tx=0x7f4f900055a0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.650+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/2108699382 shutdown_connections 2024-08-19T01:15:24.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.650+0000 7f4f9c6a9640 1 --2- 172.21.15.17:0/2108699382 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f8006e170 0x7f4f80070630 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.650+0000 7f4f9c6a9640 1 --2- 172.21.15.17:0/2108699382 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f94100750 0x7f4f9419bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.650+0000 7f4f9c6a9640 1 --2- 172.21.15.17:0/2108699382 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f940ffda0 0x7f4f9419b800 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.650+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/2108699382 >> 172.21.15.17:0/2108699382 conn(0x7f4f940fb840 msgr2=0x7f4f940fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:24.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.650+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/2108699382 shutdown_connections 2024-08-19T01:15:24.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.650+0000 7f4f9c6a9640 1 -- 172.21.15.17:0/2108699382 wait complete. 2024-08-19T01:15:24.661 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:15:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.733+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1430086205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c840ffda0 msgr2=0x7f0c84100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.733+0000 7f0c8c6b3640 1 --2- 172.21.15.17:0/1430086205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c840ffda0 0x7f0c84100180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0c80009880 tx=0x7f0c8002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.733+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1430086205 shutdown_connections 2024-08-19T01:15:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.733+0000 7f0c8c6b3640 1 --2- 172.21.15.17:0/1430086205 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c84100750 0x7f0c841047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.733+0000 7f0c8c6b3640 1 --2- 172.21.15.17:0/1430086205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c840ffda0 0x7f0c84100180 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.733+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1430086205 >> 172.21.15.17:0/1430086205 conn(0x7f0c840fb840 msgr2=0x7f0c840fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.734+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1430086205 shutdown_connections 2024-08-19T01:15:24.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.734+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1430086205 wait complete. 2024-08-19T01:15:24.736 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:24 smithi017 ceph-mon[99370]: pgmap v498: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:24.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.734+0000 7f0c8c6b3640 1 Processor -- start 2024-08-19T01:15:24.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.734+0000 7f0c8c6b3640 1 -- start start 2024-08-19T01:15:24.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.734+0000 7f0c8c6b3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c840ffda0 0x7f0c840727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:24.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.734+0000 7f0c8c6b3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c84100750 0x7f0c84072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:24.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.734+0000 7f0c8c6b3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c84074780 con 0x7f0c840ffda0 2024-08-19T01:15:24.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.734+0000 7f0c8c6b3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c84073230 con 0x7f0c84100750 2024-08-19T01:15:24.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.734+0000 7f0c8a44f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c840ffda0 0x7f0c840727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:24.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c8a44f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c840ffda0 0x7f0c840727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60988/0 (socket says 172.21.15.17:60988) 2024-08-19T01:15:24.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c8a44f640 1 -- 172.21.15.17:0/1922533535 learned_addr learned my addr 172.21.15.17:0/1922533535 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:24.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c89c4e640 1 --2- 172.21.15.17:0/1922533535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c84100750 0x7f0c84072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:24.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c8a44f640 1 -- 172.21.15.17:0/1922533535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c84100750 msgr2=0x7f0c84072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:24.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c8a44f640 1 --2- 172.21.15.17:0/1922533535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c84100750 0x7f0c84072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c8a44f640 1 -- 172.21.15.17:0/1922533535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c80009560 con 0x7f0c840ffda0 2024-08-19T01:15:24.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c8a44f640 1 --2- 172.21.15.17:0/1922533535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c840ffda0 0x7f0c840727b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0c8002a9c0 tx=0x7f0c800055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:24.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c7b7fe640 1 -- 172.21.15.17:0/1922533535 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c80004aa0 con 0x7f0c840ffda0 2024-08-19T01:15:24.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1922533535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c840734b0 con 0x7f0c840ffda0 2024-08-19T01:15:24.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c7b7fe640 1 -- 172.21.15.17:0/1922533535 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c80004c00 con 0x7f0c840ffda0 2024-08-19T01:15:24.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c7b7fe640 1 -- 172.21.15.17:0/1922533535 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c80003ab0 con 0x7f0c840ffda0 2024-08-19T01:15:24.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.735+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1922533535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c841a1e90 con 0x7f0c840ffda0 2024-08-19T01:15:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.737+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1922533535 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c84101280 con 0x7f0c840ffda0 2024-08-19T01:15:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.737+0000 7f0c7b7fe640 1 -- 172.21.15.17:0/1922533535 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0c80003ce0 con 0x7f0c840ffda0 2024-08-19T01:15:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.737+0000 7f0c7b7fe640 1 --2- 172.21.15.17:0/1922533535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0c7006e170 0x7f0c70070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.737+0000 7f0c7b7fe640 1 -- 172.21.15.17:0/1922533535 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0c800af2a0 con 0x7f0c840ffda0 2024-08-19T01:15:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.737+0000 7f0c89c4e640 1 --2- 172.21.15.17:0/1922533535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0c7006e170 0x7f0c70070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:24.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.738+0000 7f0c89c4e640 1 --2- 172.21.15.17:0/1922533535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0c7006e170 0x7f0c70070630 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c74005e10 tx=0x7f0c74005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:24.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.742+0000 7f0c7b7fe640 1 -- 172.21.15.17:0/1922533535 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0c80078580 con 0x7f0c840ffda0 2024-08-19T01:15:24.892 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:24 smithi086 ceph-mon[71303]: pgmap v498: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:24.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.935+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1922533535 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c84073ce0 con 0x7f0c7006e170 2024-08-19T01:15:24.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.936+0000 7f0c7b7fe640 1 -- 172.21.15.17:0/1922533535 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0c84073ce0 con 0x7f0c7006e170 2024-08-19T01:15:24.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.938+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1922533535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0c7006e170 msgr2=0x7f0c70070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:24.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.938+0000 7f0c8c6b3640 1 --2- 172.21.15.17:0/1922533535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0c7006e170 0x7f0c70070630 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c74005e10 tx=0x7f0c74005da0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.938+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1922533535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c840ffda0 msgr2=0x7f0c840727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:24.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.938+0000 7f0c8c6b3640 1 --2- 172.21.15.17:0/1922533535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c840ffda0 0x7f0c840727b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0c8002a9c0 tx=0x7f0c800055a0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.938+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1922533535 shutdown_connections 2024-08-19T01:15:24.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.938+0000 7f0c8c6b3640 1 --2- 172.21.15.17:0/1922533535 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0c7006e170 0x7f0c70070630 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.938+0000 7f0c8c6b3640 1 --2- 172.21.15.17:0/1922533535 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0c84100750 0x7f0c84072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.938+0000 7f0c8c6b3640 1 --2- 172.21.15.17:0/1922533535 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0c840ffda0 0x7f0c840727b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:24.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.938+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1922533535 >> 172.21.15.17:0/1922533535 conn(0x7f0c840fb840 msgr2=0x7f0c840fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:24.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.938+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1922533535 shutdown_connections 2024-08-19T01:15:24.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:24.938+0000 7f0c8c6b3640 1 -- 172.21.15.17:0/1922533535 wait complete. 2024-08-19T01:15:25.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.020+0000 7f7dc7367640 1 -- 172.21.15.17:0/3589382602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc00ffda0 msgr2=0x7f7dc0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.020+0000 7f7dc7367640 1 --2- 172.21.15.17:0/3589382602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc00ffda0 0x7f7dc0100180 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc009880 tx=0x7f7dbc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.020+0000 7f7dc7367640 1 -- 172.21.15.17:0/3589382602 shutdown_connections 2024-08-19T01:15:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.020+0000 7f7dc7367640 1 --2- 172.21.15.17:0/3589382602 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100750 0x7f7dc01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.020+0000 7f7dc7367640 1 --2- 172.21.15.17:0/3589382602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc00ffda0 0x7f7dc0100180 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.020+0000 7f7dc7367640 1 -- 172.21.15.17:0/3589382602 >> 172.21.15.17:0/3589382602 conn(0x7f7dc00fb840 msgr2=0x7f7dc00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.020+0000 7f7dc7367640 1 -- 172.21.15.17:0/3589382602 shutdown_connections 2024-08-19T01:15:25.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.020+0000 7f7dc7367640 1 -- 172.21.15.17:0/3589382602 wait complete. 2024-08-19T01:15:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.021+0000 7f7dc7367640 1 Processor -- start 2024-08-19T01:15:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.021+0000 7f7dc7367640 1 -- start start 2024-08-19T01:15:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.021+0000 7f7dc7367640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc00ffda0 0x7f7dc00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.021+0000 7f7dc7367640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100750 0x7f7dc0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.021+0000 7f7dc7367640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc0073230 con 0x7f7dc00ffda0 2024-08-19T01:15:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.021+0000 7f7dc7367640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc0073370 con 0x7f7dc0100750 2024-08-19T01:15:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.021+0000 7f7dc5103640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc00ffda0 0x7f7dc00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.021+0000 7f7dc5103640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc00ffda0 0x7f7dc00727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32780/0 (socket says 172.21.15.17:32780) 2024-08-19T01:15:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.021+0000 7f7dc5103640 1 -- 172.21.15.17:0/1952929144 learned_addr learned my addr 172.21.15.17:0/1952929144 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:25.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.021+0000 7f7dc4902640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100750 0x7f7dc0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.022+0000 7f7dc5103640 1 -- 172.21.15.17:0/1952929144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100750 msgr2=0x7f7dc0072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.022+0000 7f7dc5103640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100750 0x7f7dc0072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.022+0000 7f7dc5103640 1 -- 172.21.15.17:0/1952929144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc009560 con 0x7f7dc00ffda0 2024-08-19T01:15:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.022+0000 7f7dc4902640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100750 0x7f7dc0072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T01:15:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.022+0000 7f7dc5103640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc00ffda0 0x7f7dc00727b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc02a9c0 tx=0x7f7dbc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.022+0000 7f7db67fc640 1 -- 172.21.15.17:0/1952929144 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dbc004aa0 con 0x7f7dc00ffda0 2024-08-19T01:15:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.022+0000 7f7dc7367640 1 -- 172.21.15.17:0/1952929144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc00735f0 con 0x7f7dc00ffda0 2024-08-19T01:15:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.022+0000 7f7db67fc640 1 -- 172.21.15.17:0/1952929144 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7dbc004c00 con 0x7f7dc00ffda0 2024-08-19T01:15:25.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.022+0000 7f7db67fc640 1 -- 172.21.15.17:0/1952929144 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7dbc003980 con 0x7f7dc00ffda0 2024-08-19T01:15:25.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.022+0000 7f7dc7367640 1 -- 172.21.15.17:0/1952929144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc01a2090 con 0x7f7dc00ffda0 2024-08-19T01:15:25.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.023+0000 7f7dc7367640 1 -- 172.21.15.17:0/1952929144 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc0101280 con 0x7f7dc00ffda0 2024-08-19T01:15:25.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.024+0000 7f7db67fc640 1 -- 172.21.15.17:0/1952929144 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7dbc003bc0 con 0x7f7dc00ffda0 2024-08-19T01:15:25.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.025+0000 7f7db67fc640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7dac06e170 0x7f7dac070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.025+0000 7f7db67fc640 1 -- 172.21.15.17:0/1952929144 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7dbc0af0b0 con 0x7f7dc00ffda0 2024-08-19T01:15:25.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.025+0000 7f7dc4902640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7dac06e170 0x7f7dac070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.025+0000 7f7dc4902640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7dac06e170 0x7f7dac070630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0074240 tx=0x7f7db000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:25.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.029+0000 7f7db67fc640 1 -- 172.21.15.17:0/1952929144 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7dbc0784c0 con 0x7f7dc00ffda0 2024-08-19T01:15:25.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.213+0000 7f7dc7367640 1 -- 172.21.15.17:0/1952929144 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7dc010cdd0 con 0x7f7dac06e170 2024-08-19T01:15:25.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.222+0000 7f7db67fc640 1 -- 172.21.15.17:0/1952929144 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7dc010cdd0 con 0x7f7dac06e170 2024-08-19T01:15:25.224 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:15:25.224 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (16m) 10m ago 27m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:15:25.224 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (27m) 10m ago 27m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (26m) 10m ago 26m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (14m) 10m ago 27m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (14m) 10m ago 26m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (16m) 10m ago 27m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (10m) 10m ago 21m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (10m) 10m ago 21m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (21m) 10m ago 21m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (10m) 10m ago 21m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (18m) 10m ago 28m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (17m) 10m ago 26m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (15m) 10m ago 28m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (15m) 10m ago 26m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:15:25.225 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (17m) 10m ago 27m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:15:25.226 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (17m) 10m ago 26m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:15:25.226 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (14m) 10m ago 25m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:15:25.226 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (13m) 10m ago 25m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:15:25.226 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (12m) 10m ago 24m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:15:25.226 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (12m) 10m ago 24m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:15:25.226 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (11m) 10m ago 23m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:15:25.226 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (11m) 10m ago 23m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:15:25.226 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (17m) 10m ago 26m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:15:25.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.224+0000 7f7dc7367640 1 -- 172.21.15.17:0/1952929144 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7dac06e170 msgr2=0x7f7dac070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.224+0000 7f7dc7367640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7dac06e170 0x7f7dac070630 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0074240 tx=0x7f7db000b390 comp rx=0 tx=0).stop 2024-08-19T01:15:25.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.224+0000 7f7dc7367640 1 -- 172.21.15.17:0/1952929144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc00ffda0 msgr2=0x7f7dc00727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.224+0000 7f7dc7367640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc00ffda0 0x7f7dc00727b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc02a9c0 tx=0x7f7dbc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.224+0000 7f7dc7367640 1 -- 172.21.15.17:0/1952929144 shutdown_connections 2024-08-19T01:15:25.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.224+0000 7f7dc7367640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7dac06e170 0x7f7dac070630 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.224+0000 7f7dc7367640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7dc0100750 0x7f7dc0072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.224+0000 7f7dc7367640 1 --2- 172.21.15.17:0/1952929144 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7dc00ffda0 0x7f7dc00727b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.224+0000 7f7dc7367640 1 -- 172.21.15.17:0/1952929144 >> 172.21.15.17:0/1952929144 conn(0x7f7dc00fb840 msgr2=0x7f7dc00fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:25.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.224+0000 7f7dc7367640 1 -- 172.21.15.17:0/1952929144 shutdown_connections 2024-08-19T01:15:25.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.225+0000 7f7dc7367640 1 -- 172.21.15.17:0/1952929144 wait complete. 2024-08-19T01:15:25.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.305+0000 7fb35d995640 1 -- 172.21.15.17:0/1508785690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3581015d0 msgr2=0x7fb358109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.305+0000 7fb35d995640 1 --2- 172.21.15.17:0/1508785690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3581015d0 0x7fb358109ac0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009880 tx=0x7fb34c02a530 comp rx=0 tx=0).stop 2024-08-19T01:15:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.305+0000 7fb35d995640 1 -- 172.21.15.17:0/1508785690 shutdown_connections 2024-08-19T01:15:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.305+0000 7fb35d995640 1 --2- 172.21.15.17:0/1508785690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3581015d0 0x7fb358109ac0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.305+0000 7fb35d995640 1 --2- 172.21.15.17:0/1508785690 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb358100cb0 0x7fb358101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.305+0000 7fb35d995640 1 -- 172.21.15.17:0/1508785690 >> 172.21.15.17:0/1508785690 conn(0x7fb3580758a0 msgr2=0x7fb3580fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.306+0000 7fb35d995640 1 -- 172.21.15.17:0/1508785690 shutdown_connections 2024-08-19T01:15:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.306+0000 7fb35d995640 1 -- 172.21.15.17:0/1508785690 wait complete. 2024-08-19T01:15:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.306+0000 7fb35d995640 1 Processor -- start 2024-08-19T01:15:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.306+0000 7fb35d995640 1 -- start start 2024-08-19T01:15:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb35d995640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb358100cb0 0x7fb35819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb35d995640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3581015d0 0x7fb35819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb35d995640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35819c3b0 con 0x7fb3581015d0 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb35d995640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb358195940 con 0x7fb358100cb0 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb3567fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3581015d0 0x7fb35819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb3567fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3581015d0 0x7fb35819bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32802/0 (socket says 172.21.15.17:32802) 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb3567fc640 1 -- 172.21.15.17:0/2370922833 learned_addr learned my addr 172.21.15.17:0/2370922833 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb356ffd640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb358100cb0 0x7fb35819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb3567fc640 1 -- 172.21.15.17:0/2370922833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb358100cb0 msgr2=0x7fb35819b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb3567fc640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb358100cb0 0x7fb35819b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb3567fc640 1 -- 172.21.15.17:0/2370922833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c009560 con 0x7fb3581015d0 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb356ffd640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb358100cb0 0x7fb35819b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.307+0000 7fb3567fc640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3581015d0 0x7fb35819bd90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb34c02aa50 tx=0x7fb34c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.308+0000 7fb35c993640 1 -- 172.21.15.17:0/2370922833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb34c0048d0 con 0x7fb3581015d0 2024-08-19T01:15:25.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.308+0000 7fb35d995640 1 -- 172.21.15.17:0/2370922833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb358195bc0 con 0x7fb3581015d0 2024-08-19T01:15:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.308+0000 7fb35c993640 1 -- 172.21.15.17:0/2370922833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb34c031640 con 0x7fb3581015d0 2024-08-19T01:15:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.308+0000 7fb35c993640 1 -- 172.21.15.17:0/2370922833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb34c0038d0 con 0x7fb3581015d0 2024-08-19T01:15:25.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.308+0000 7fb35d995640 1 -- 172.21.15.17:0/2370922833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3581960b0 con 0x7fb3581015d0 2024-08-19T01:15:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.309+0000 7fb35d995640 1 -- 172.21.15.17:0/2370922833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb358068510 con 0x7fb3581015d0 2024-08-19T01:15:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.309+0000 7fb35c993640 1 -- 172.21.15.17:0/2370922833 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb34c02ad50 con 0x7fb3581015d0 2024-08-19T01:15:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.310+0000 7fb35c993640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb34006e170 0x7fb340070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.310+0000 7fb35c993640 1 -- 172.21.15.17:0/2370922833 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb34c0aef20 con 0x7fb3581015d0 2024-08-19T01:15:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.310+0000 7fb356ffd640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb34006e170 0x7fb340070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.310+0000 7fb356ffd640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb34006e170 0x7fb340070630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb3480058c0 tx=0x7fb348005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:25.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.314+0000 7fb35c993640 1 -- 172.21.15.17:0/2370922833 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb34c0e3df0 con 0x7fb3581015d0 2024-08-19T01:15:25.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.560+0000 7fb35d995640 1 -- 172.21.15.17:0/2370922833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb358101090 con 0x7fb3581015d0 2024-08-19T01:15:25.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.560+0000 7fb35c993640 1 -- 172.21.15.17:0/2370922833 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7fb34c078200 con 0x7fb3581015d0 2024-08-19T01:15:25.562 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:15:25.562 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:15:25.563 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:15:25.564 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:15:25.564 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:15:25.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:15:25.564 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:15:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.562+0000 7fb35d995640 1 -- 172.21.15.17:0/2370922833 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb34006e170 msgr2=0x7fb340070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.562+0000 7fb35d995640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb34006e170 0x7fb340070630 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb3480058c0 tx=0x7fb348005850 comp rx=0 tx=0).stop 2024-08-19T01:15:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.562+0000 7fb35d995640 1 -- 172.21.15.17:0/2370922833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3581015d0 msgr2=0x7fb35819bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.562+0000 7fb35d995640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3581015d0 0x7fb35819bd90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb34c02aa50 tx=0x7fb34c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.562+0000 7fb35d995640 1 -- 172.21.15.17:0/2370922833 shutdown_connections 2024-08-19T01:15:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.562+0000 7fb35d995640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb34006e170 0x7fb340070630 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.562+0000 7fb35d995640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3581015d0 0x7fb35819bd90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.562+0000 7fb35d995640 1 --2- 172.21.15.17:0/2370922833 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb358100cb0 0x7fb35819b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.562+0000 7fb35d995640 1 -- 172.21.15.17:0/2370922833 >> 172.21.15.17:0/2370922833 conn(0x7fb3580758a0 msgr2=0x7fb358101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.562+0000 7fb35d995640 1 -- 172.21.15.17:0/2370922833 shutdown_connections 2024-08-19T01:15:25.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.562+0000 7fb35d995640 1 -- 172.21.15.17:0/2370922833 wait complete. 2024-08-19T01:15:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.645+0000 7f194c7b5640 1 -- 172.21.15.17:0/3964963321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19441015d0 msgr2=0x7f1944109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.645+0000 7f194c7b5640 1 --2- 172.21.15.17:0/3964963321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19441015d0 0x7f1944109ac0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1934009880 tx=0x7f193402a530 comp rx=0 tx=0).stop 2024-08-19T01:15:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.646+0000 7f194c7b5640 1 -- 172.21.15.17:0/3964963321 shutdown_connections 2024-08-19T01:15:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.646+0000 7f194c7b5640 1 --2- 172.21.15.17:0/3964963321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19441015d0 0x7f1944109ac0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.646+0000 7f194c7b5640 1 --2- 172.21.15.17:0/3964963321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1944100cb0 0x7f1944101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.646+0000 7f194c7b5640 1 -- 172.21.15.17:0/3964963321 >> 172.21.15.17:0/3964963321 conn(0x7f19440758a0 msgr2=0x7f19440fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.646+0000 7f194c7b5640 1 -- 172.21.15.17:0/3964963321 shutdown_connections 2024-08-19T01:15:25.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.646+0000 7f194c7b5640 1 -- 172.21.15.17:0/3964963321 wait complete. 2024-08-19T01:15:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.646+0000 7f194c7b5640 1 Processor -- start 2024-08-19T01:15:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.646+0000 7f194c7b5640 1 -- start start 2024-08-19T01:15:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f194c7b5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1944100cb0 0x7f194419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f194c7b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19441015d0 0x7f194419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f194c7b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194419c3b0 con 0x7f19441015d0 2024-08-19T01:15:25.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f194c7b5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1944195940 con 0x7f1944100cb0 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f1949d50640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19441015d0 0x7f194419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f1949d50640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19441015d0 0x7f194419bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32830/0 (socket says 172.21.15.17:32830) 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f1949d50640 1 -- 172.21.15.17:0/1263644005 learned_addr learned my addr 172.21.15.17:0/1263644005 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f194a551640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1944100cb0 0x7f194419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f1949d50640 1 -- 172.21.15.17:0/1263644005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1944100cb0 msgr2=0x7f194419b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f1949d50640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1944100cb0 0x7f194419b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f1949d50640 1 -- 172.21.15.17:0/1263644005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1934009560 con 0x7f19441015d0 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f194a551640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1944100cb0 0x7f194419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f1949d50640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19441015d0 0x7f194419bd90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1934006010 tx=0x7f19340055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f193b7fe640 1 -- 172.21.15.17:0/1263644005 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1934004aa0 con 0x7f19441015d0 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f193b7fe640 1 -- 172.21.15.17:0/1263644005 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1934004c00 con 0x7f19441015d0 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f194c7b5640 1 -- 172.21.15.17:0/1263644005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1944195bc0 con 0x7f19441015d0 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.647+0000 7f193b7fe640 1 -- 172.21.15.17:0/1263644005 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19340039b0 con 0x7f19441015d0 2024-08-19T01:15:25.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.648+0000 7f194c7b5640 1 -- 172.21.15.17:0/1263644005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19441960b0 con 0x7f19441015d0 2024-08-19T01:15:25.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.649+0000 7f194c7b5640 1 -- 172.21.15.17:0/1263644005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1944068510 con 0x7f19441015d0 2024-08-19T01:15:25.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.649+0000 7f193b7fe640 1 -- 172.21.15.17:0/1263644005 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f193402ad50 con 0x7f19441015d0 2024-08-19T01:15:25.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.650+0000 7f193b7fe640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f193006e180 0x7f1930070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.650+0000 7f193b7fe640 1 -- 172.21.15.17:0/1263644005 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f19340aef80 con 0x7f19441015d0 2024-08-19T01:15:25.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.650+0000 7f194a551640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f193006e180 0x7f1930070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.650+0000 7f194a551640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f193006e180 0x7f1930070640 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f19400058c0 tx=0x7f1940005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:25.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.654+0000 7f193b7fe640 1 -- 172.21.15.17:0/1263644005 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1934078240 con 0x7f19441015d0 2024-08-19T01:15:25.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.866+0000 7f194c7b5640 1 -- 172.21.15.17:0/1263644005 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1944101090 con 0x7f19441015d0 2024-08-19T01:15:25.869 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:25 smithi017 ceph-mon[99370]: from='client.34960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:25.869 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:25 smithi017 ceph-mon[99370]: from='client.34964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:25.869 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:25 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2370922833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:15:25.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.866+0000 7f193b7fe640 1 -- 172.21.15.17:0/1263644005 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f193404a790 con 0x7f19441015d0 2024-08-19T01:15:25.870 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:15:25.870 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:15:25.870 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:15:25.870 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:15:25.871 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:15:25.872 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:15:25.873 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:15:25.874 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:15:25.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.869+0000 7f194c7b5640 1 -- 172.21.15.17:0/1263644005 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f193006e180 msgr2=0x7f1930070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.869+0000 7f194c7b5640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f193006e180 0x7f1930070640 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f19400058c0 tx=0x7f1940005d30 comp rx=0 tx=0).stop 2024-08-19T01:15:25.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.869+0000 7f194c7b5640 1 -- 172.21.15.17:0/1263644005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19441015d0 msgr2=0x7f194419bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.869+0000 7f194c7b5640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19441015d0 0x7f194419bd90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1934006010 tx=0x7f19340055a0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.869+0000 7f194c7b5640 1 -- 172.21.15.17:0/1263644005 shutdown_connections 2024-08-19T01:15:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.869+0000 7f194c7b5640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f193006e180 0x7f1930070640 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.869+0000 7f194c7b5640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19441015d0 0x7f194419bd90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.869+0000 7f194c7b5640 1 --2- 172.21.15.17:0/1263644005 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1944100cb0 0x7f194419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.869+0000 7f194c7b5640 1 -- 172.21.15.17:0/1263644005 >> 172.21.15.17:0/1263644005 conn(0x7f19440758a0 msgr2=0x7f1944101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.869+0000 7f194c7b5640 1 -- 172.21.15.17:0/1263644005 shutdown_connections 2024-08-19T01:15:25.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.869+0000 7f194c7b5640 1 -- 172.21.15.17:0/1263644005 wait complete. 2024-08-19T01:15:25.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:25 smithi086 ceph-mon[71303]: from='client.34960 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:25.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:25 smithi086 ceph-mon[71303]: from='client.34964 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:25.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:25 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2370922833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:15:25.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.952+0000 7f529642a640 1 -- 172.21.15.17:0/1516667389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52900ffb40 msgr2=0x7f52900fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.952+0000 7f529642a640 1 --2- 172.21.15.17:0/1516667389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52900ffb40 0x7f52900fffa0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5284009880 tx=0x7f528402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.952+0000 7f529642a640 1 -- 172.21.15.17:0/1516667389 shutdown_connections 2024-08-19T01:15:25.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.952+0000 7f529642a640 1 --2- 172.21.15.17:0/1516667389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52900ffb40 0x7f52900fffa0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.952+0000 7f529642a640 1 --2- 172.21.15.17:0/1516667389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5290105bf0 0x7f5290105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.952+0000 7f529642a640 1 -- 172.21.15.17:0/1516667389 >> 172.21.15.17:0/1516667389 conn(0x7f52900fb860 msgr2=0x7f52900fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:25.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.952+0000 7f529642a640 1 -- 172.21.15.17:0/1516667389 shutdown_connections 2024-08-19T01:15:25.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.952+0000 7f529642a640 1 -- 172.21.15.17:0/1516667389 wait complete. 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.953+0000 7f529642a640 1 Processor -- start 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.953+0000 7f529642a640 1 -- start start 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.953+0000 7f529642a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52900ffb40 0x7f529019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.953+0000 7f529642a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5290105bf0 0x7f529019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.953+0000 7f529642a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529019c320 con 0x7f5290105bf0 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.953+0000 7f529642a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52901958b0 con 0x7f52900ffb40 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.953+0000 7f528f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5290105bf0 0x7f529019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.953+0000 7f528f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5290105bf0 0x7f529019bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32858/0 (socket says 172.21.15.17:32858) 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.953+0000 7f528f7fe640 1 -- 172.21.15.17:0/3472124906 learned_addr learned my addr 172.21.15.17:0/3472124906 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.954+0000 7f528ffff640 1 --2- 172.21.15.17:0/3472124906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52900ffb40 0x7f529019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.954+0000 7f528f7fe640 1 -- 172.21.15.17:0/3472124906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52900ffb40 msgr2=0x7f529019b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:25.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.954+0000 7f528f7fe640 1 --2- 172.21.15.17:0/3472124906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52900ffb40 0x7f529019b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.954+0000 7f528f7fe640 1 -- 172.21.15.17:0/3472124906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284009560 con 0x7f5290105bf0 2024-08-19T01:15:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.954+0000 7f528f7fe640 1 --2- 172.21.15.17:0/3472124906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5290105bf0 0x7f529019bd00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f528402a9c0 tx=0x7f52840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.954+0000 7f528d7fa640 1 -- 172.21.15.17:0/3472124906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52840048d0 con 0x7f5290105bf0 2024-08-19T01:15:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.954+0000 7f528d7fa640 1 -- 172.21.15.17:0/3472124906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5284031640 con 0x7f5290105bf0 2024-08-19T01:15:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.954+0000 7f529642a640 1 -- 172.21.15.17:0/3472124906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5290195b30 con 0x7f5290105bf0 2024-08-19T01:15:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.954+0000 7f528d7fa640 1 -- 172.21.15.17:0/3472124906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52840038d0 con 0x7f5290105bf0 2024-08-19T01:15:25.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.954+0000 7f529642a640 1 -- 172.21.15.17:0/3472124906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52901960a0 con 0x7f5290105bf0 2024-08-19T01:15:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.955+0000 7f529642a640 1 -- 172.21.15.17:0/3472124906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52901011f0 con 0x7f5290105bf0 2024-08-19T01:15:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.956+0000 7f528d7fa640 1 -- 172.21.15.17:0/3472124906 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5284003b90 con 0x7f5290105bf0 2024-08-19T01:15:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.956+0000 7f528d7fa640 1 --2- 172.21.15.17:0/3472124906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f527806e170 0x7f5278070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.956+0000 7f528d7fa640 1 -- 172.21.15.17:0/3472124906 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f52840af150 con 0x7f5290105bf0 2024-08-19T01:15:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.956+0000 7f528ffff640 1 --2- 172.21.15.17:0/3472124906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f527806e170 0x7f5278070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:25.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.957+0000 7f528ffff640 1 --2- 172.21.15.17:0/3472124906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f527806e170 0x7f5278070630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5280009b60 tx=0x7f5280005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:25.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:25.961+0000 7f528d7fa640 1 -- 172.21.15.17:0/3472124906 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5284078430 con 0x7f5290105bf0 2024-08-19T01:15:26.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.151+0000 7f529642a640 1 -- 172.21.15.17:0/3472124906 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f529010cdb0 con 0x7f527806e170 2024-08-19T01:15:26.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.152+0000 7f528d7fa640 1 -- 172.21.15.17:0/3472124906 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f529010cdb0 con 0x7f527806e170 2024-08-19T01:15:26.155 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:15:26.155 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:15:26.155 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:15:26.155 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:15:26.155 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:15:26.155 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:15:26.155 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:15:26.155 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:15:26.155 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:15:26.155 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:15:26.156 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:15:26.156 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:15:26.156 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:15:26.156 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:15:26.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.154+0000 7f529642a640 1 -- 172.21.15.17:0/3472124906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f527806e170 msgr2=0x7f5278070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:26.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.154+0000 7f529642a640 1 --2- 172.21.15.17:0/3472124906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f527806e170 0x7f5278070630 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5280009b60 tx=0x7f5280005f90 comp rx=0 tx=0).stop 2024-08-19T01:15:26.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.154+0000 7f529642a640 1 -- 172.21.15.17:0/3472124906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5290105bf0 msgr2=0x7f529019bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:26.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.154+0000 7f529642a640 1 --2- 172.21.15.17:0/3472124906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5290105bf0 0x7f529019bd00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f528402a9c0 tx=0x7f52840055a0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.155+0000 7f529642a640 1 -- 172.21.15.17:0/3472124906 shutdown_connections 2024-08-19T01:15:26.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.155+0000 7f529642a640 1 --2- 172.21.15.17:0/3472124906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f527806e170 0x7f5278070630 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.155+0000 7f529642a640 1 --2- 172.21.15.17:0/3472124906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5290105bf0 0x7f529019bd00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.155+0000 7f529642a640 1 --2- 172.21.15.17:0/3472124906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f52900ffb40 0x7f529019b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.155+0000 7f529642a640 1 -- 172.21.15.17:0/3472124906 >> 172.21.15.17:0/3472124906 conn(0x7f52900fb860 msgr2=0x7f52900fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:26.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.155+0000 7f529642a640 1 -- 172.21.15.17:0/3472124906 shutdown_connections 2024-08-19T01:15:26.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.155+0000 7f529642a640 1 -- 172.21.15.17:0/3472124906 wait complete. 2024-08-19T01:15:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.236+0000 7f74706df640 1 -- 172.21.15.17:0/1225909978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74680fe9f0 msgr2=0x7f74680fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.236+0000 7f74706df640 1 --2- 172.21.15.17:0/1225909978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74680fe9f0 0x7f74680fee50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f745c009880 tx=0x7f745c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 -- 172.21.15.17:0/1225909978 shutdown_connections 2024-08-19T01:15:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 --2- 172.21.15.17:0/1225909978 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74680fe9f0 0x7f74680fee50 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 --2- 172.21.15.17:0/1225909978 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74681049f0 0x7f7468104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 -- 172.21.15.17:0/1225909978 >> 172.21.15.17:0/1225909978 conn(0x7f74680758a0 msgr2=0x7f74680fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 -- 172.21.15.17:0/1225909978 shutdown_connections 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 -- 172.21.15.17:0/1225909978 wait complete. 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 Processor -- start 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 -- start start 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74680fe9f0 0x7f746819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74681049f0 0x7f746819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746819c4a0 con 0x7f74680fe9f0 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f74706df640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7468195970 con 0x7f74681049f0 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.237+0000 7f746e47b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74680fe9f0 0x7f746819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f746e47b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74680fe9f0 0x7f746819b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:32888/0 (socket says 172.21.15.17:32888) 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f746e47b640 1 -- 172.21.15.17:0/3526125487 learned_addr learned my addr 172.21.15.17:0/3526125487 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f746dc7a640 1 --2- 172.21.15.17:0/3526125487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74681049f0 0x7f746819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f746e47b640 1 -- 172.21.15.17:0/3526125487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74681049f0 msgr2=0x7f746819be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f746e47b640 1 --2- 172.21.15.17:0/3526125487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74681049f0 0x7f746819be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f746e47b640 1 -- 172.21.15.17:0/3526125487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c009560 con 0x7f74680fe9f0 2024-08-19T01:15:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f746e47b640 1 --2- 172.21.15.17:0/3526125487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74680fe9f0 0x7f746819b910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f745800cc60 tx=0x7f745800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f74677fe640 1 -- 172.21.15.17:0/3526125487 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f745800f450 con 0x7f74680fe9f0 2024-08-19T01:15:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f74677fe640 1 -- 172.21.15.17:0/3526125487 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f745800fa70 con 0x7f74680fe9f0 2024-08-19T01:15:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f74706df640 1 -- 172.21.15.17:0/3526125487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7468195c50 con 0x7f74680fe9f0 2024-08-19T01:15:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f74677fe640 1 -- 172.21.15.17:0/3526125487 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7458018b80 con 0x7f74680fe9f0 2024-08-19T01:15:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.238+0000 7f74706df640 1 -- 172.21.15.17:0/3526125487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7468196170 con 0x7f74680fe9f0 2024-08-19T01:15:26.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.239+0000 7f74706df640 1 -- 172.21.15.17:0/3526125487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7468100130 con 0x7f74680fe9f0 2024-08-19T01:15:26.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.240+0000 7f74677fe640 1 -- 172.21.15.17:0/3526125487 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7458018ce0 con 0x7f74680fe9f0 2024-08-19T01:15:26.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.240+0000 7f74677fe640 1 --2- 172.21.15.17:0/3526125487 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f745006e170 0x7f7450070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:26.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.240+0000 7f74677fe640 1 -- 172.21.15.17:0/3526125487 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f745808e5c0 con 0x7f74680fe9f0 2024-08-19T01:15:26.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.240+0000 7f746dc7a640 1 --2- 172.21.15.17:0/3526125487 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f745006e170 0x7f7450070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:26.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.241+0000 7f746dc7a640 1 --2- 172.21.15.17:0/3526125487 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f745006e170 0x7f7450070630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f745c009230 tx=0x7f745c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:26.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.245+0000 7f74677fe640 1 -- 172.21.15.17:0/3526125487 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7458057920 con 0x7f74680fe9f0 2024-08-19T01:15:26.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.490+0000 7f74706df640 1 -- 172.21.15.17:0/3526125487 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f746810bc90 con 0x7f74680fe9f0 2024-08-19T01:15:26.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.491+0000 7f74677fe640 1 -- 172.21.15.17:0/3526125487 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f745805afe0 con 0x7f74680fe9f0 2024-08-19T01:15:26.493 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:15:26.493 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:15:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:15:26.493 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:15:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:15:26.493 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:15:26.493 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:15:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.493+0000 7f74706df640 1 -- 172.21.15.17:0/3526125487 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f745006e170 msgr2=0x7f7450070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.493+0000 7f74706df640 1 --2- 172.21.15.17:0/3526125487 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f745006e170 0x7f7450070630 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f745c009230 tx=0x7f745c0058d0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.493+0000 7f74706df640 1 -- 172.21.15.17:0/3526125487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74680fe9f0 msgr2=0x7f746819b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.493+0000 7f74706df640 1 --2- 172.21.15.17:0/3526125487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74680fe9f0 0x7f746819b910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f745800cc60 tx=0x7f745800a620 comp rx=0 tx=0).stop 2024-08-19T01:15:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.493+0000 7f74706df640 1 -- 172.21.15.17:0/3526125487 shutdown_connections 2024-08-19T01:15:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.493+0000 7f74706df640 1 --2- 172.21.15.17:0/3526125487 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f745006e170 0x7f7450070630 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.493+0000 7f74706df640 1 --2- 172.21.15.17:0/3526125487 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74681049f0 0x7f746819be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.493+0000 7f74706df640 1 --2- 172.21.15.17:0/3526125487 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74680fe9f0 0x7f746819b910 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.493+0000 7f74706df640 1 -- 172.21.15.17:0/3526125487 >> 172.21.15.17:0/3526125487 conn(0x7f74680758a0 msgr2=0x7f74680fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:26.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.493+0000 7f74706df640 1 -- 172.21.15.17:0/3526125487 shutdown_connections 2024-08-19T01:15:26.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:26.493+0000 7f74706df640 1 -- 172.21.15.17:0/3526125487 wait complete. 2024-08-19T01:15:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:26 smithi017 ceph-mon[99370]: pgmap v499: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:26 smithi017 ceph-mon[99370]: from='client.34968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:26 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1263644005' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:15:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:26 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3526125487' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:15:26.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:26 smithi086 ceph-mon[71303]: pgmap v499: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:26 smithi086 ceph-mon[71303]: from='client.34968 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:26 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1263644005' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:15:26.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:26 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3526125487' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:15:27.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:27 smithi017 ceph-mon[99370]: from='client.34980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:27.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:27 smithi086 ceph-mon[71303]: from='client.34980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:28 smithi017 ceph-mon[99370]: pgmap v500: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:28.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:28 smithi086 ceph-mon[71303]: pgmap v500: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:30.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:30 smithi017 ceph-mon[99370]: pgmap v501: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:30.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:30 smithi086 ceph-mon[71303]: pgmap v501: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:32 smithi017 ceph-mon[99370]: pgmap v502: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:32 smithi086 ceph-mon[71303]: pgmap v502: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:15:33.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:15:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:34 smithi017 ceph-mon[99370]: pgmap v503: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:34 smithi086 ceph-mon[71303]: pgmap v503: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:36.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:36 smithi017 ceph-mon[99370]: pgmap v504: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:36 smithi086 ceph-mon[71303]: pgmap v504: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:38.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:38 smithi017 ceph-mon[99370]: pgmap v505: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:38.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:38 smithi086 ceph-mon[71303]: pgmap v505: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:40 smithi017 ceph-mon[99370]: pgmap v506: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:40.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:40 smithi086 ceph-mon[71303]: pgmap v506: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:42.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:42 smithi017 ceph-mon[99370]: pgmap v507: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:42.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:42 smithi086 ceph-mon[71303]: pgmap v507: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:44 smithi017 ceph-mon[99370]: pgmap v508: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:44 smithi086 ceph-mon[71303]: pgmap v508: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:46.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:46 smithi017 ceph-mon[99370]: pgmap v509: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:46 smithi086 ceph-mon[71303]: pgmap v509: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:48 smithi017 ceph-mon[99370]: pgmap v510: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:15:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:48 smithi086 ceph-mon[71303]: pgmap v510: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:15:50.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:50 smithi017 ceph-mon[99370]: pgmap v511: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:50 smithi086 ceph-mon[71303]: pgmap v511: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:52.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:52 smithi017 ceph-mon[99370]: pgmap v512: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:52 smithi086 ceph-mon[71303]: pgmap v512: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:54.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:54 smithi017 ceph-mon[99370]: pgmap v513: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:54 smithi086 ceph-mon[71303]: pgmap v513: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:56.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.588+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1759773187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100750 msgr2=0x7f4a241047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:56.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.588+0000 7f4a2a95c640 1 --2- 172.21.15.17:0/1759773187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100750 0x7f4a241047a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009880 tx=0x7f4a1802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.588+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1759773187 shutdown_connections 2024-08-19T01:15:56.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.589+0000 7f4a2a95c640 1 --2- 172.21.15.17:0/1759773187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100750 0x7f4a241047a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.589+0000 7f4a2a95c640 1 --2- 172.21.15.17:0/1759773187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a240ffda0 0x7f4a24100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.589+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1759773187 >> 172.21.15.17:0/1759773187 conn(0x7f4a240fb840 msgr2=0x7f4a240fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:56.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.589+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1759773187 shutdown_connections 2024-08-19T01:15:56.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.589+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1759773187 wait complete. 2024-08-19T01:15:56.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.589+0000 7f4a2a95c640 1 Processor -- start 2024-08-19T01:15:56.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a2a95c640 1 -- start start 2024-08-19T01:15:56.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a2a95c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a240ffda0 0x7f4a2419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:56.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a2a95c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100750 0x7f4a2419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a2a95c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2419c380 con 0x7f4a24100750 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a2a95c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a24195910 con 0x7f4a240ffda0 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100750 0x7f4a2419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a237fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100750 0x7f4a2419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60944/0 (socket says 172.21.15.17:60944) 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a237fe640 1 -- 172.21.15.17:0/1377947739 learned_addr learned my addr 172.21.15.17:0/1377947739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a23fff640 1 --2- 172.21.15.17:0/1377947739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a240ffda0 0x7f4a2419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a237fe640 1 -- 172.21.15.17:0/1377947739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a240ffda0 msgr2=0x7f4a2419b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a237fe640 1 --2- 172.21.15.17:0/1377947739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a240ffda0 0x7f4a2419b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.590+0000 7f4a237fe640 1 -- 172.21.15.17:0/1377947739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009560 con 0x7f4a24100750 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.591+0000 7f4a237fe640 1 --2- 172.21.15.17:0/1377947739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100750 0x7f4a2419bd60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4a1802a9c0 tx=0x7f4a180055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.591+0000 7f4a217fa640 1 -- 172.21.15.17:0/1377947739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a18004aa0 con 0x7f4a24100750 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.591+0000 7f4a217fa640 1 -- 172.21.15.17:0/1377947739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a18004c00 con 0x7f4a24100750 2024-08-19T01:15:56.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.591+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1377947739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a24195b90 con 0x7f4a24100750 2024-08-19T01:15:56.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.591+0000 7f4a217fa640 1 -- 172.21.15.17:0/1377947739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a18003980 con 0x7f4a24100750 2024-08-19T01:15:56.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.591+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1377947739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a24196080 con 0x7f4a24100750 2024-08-19T01:15:56.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.592+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1377947739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a24101280 con 0x7f4a24100750 2024-08-19T01:15:56.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.593+0000 7f4a217fa640 1 -- 172.21.15.17:0/1377947739 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4a18003bf0 con 0x7f4a24100750 2024-08-19T01:15:56.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.593+0000 7f4a217fa640 1 --2- 172.21.15.17:0/1377947739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4a0c06e170 0x7f4a0c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:56.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.593+0000 7f4a217fa640 1 -- 172.21.15.17:0/1377947739 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4a180af210 con 0x7f4a24100750 2024-08-19T01:15:56.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.593+0000 7f4a23fff640 1 --2- 172.21.15.17:0/1377947739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4a0c06e170 0x7f4a0c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:56.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.594+0000 7f4a23fff640 1 --2- 172.21.15.17:0/1377947739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4a0c06e170 0x7f4a0c070630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a14005fd0 tx=0x7f4a14005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:56.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.598+0000 7f4a217fa640 1 -- 172.21.15.17:0/1377947739 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4a180784f0 con 0x7f4a24100750 2024-08-19T01:15:56.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.791+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1377947739 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a2410cdb0 con 0x7f4a0c06e170 2024-08-19T01:15:56.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.792+0000 7f4a217fa640 1 -- 172.21.15.17:0/1377947739 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4a2410cdb0 con 0x7f4a0c06e170 2024-08-19T01:15:56.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.794+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1377947739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4a0c06e170 msgr2=0x7f4a0c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:56.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.794+0000 7f4a2a95c640 1 --2- 172.21.15.17:0/1377947739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4a0c06e170 0x7f4a0c070630 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4a14005fd0 tx=0x7f4a14005850 comp rx=0 tx=0).stop 2024-08-19T01:15:56.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.794+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1377947739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100750 msgr2=0x7f4a2419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:56.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.794+0000 7f4a2a95c640 1 --2- 172.21.15.17:0/1377947739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100750 0x7f4a2419bd60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4a1802a9c0 tx=0x7f4a180055a0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.794+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1377947739 shutdown_connections 2024-08-19T01:15:56.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.794+0000 7f4a2a95c640 1 --2- 172.21.15.17:0/1377947739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4a0c06e170 0x7f4a0c070630 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.794+0000 7f4a2a95c640 1 --2- 172.21.15.17:0/1377947739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a24100750 0x7f4a2419bd60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.794+0000 7f4a2a95c640 1 --2- 172.21.15.17:0/1377947739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4a240ffda0 0x7f4a2419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.794+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1377947739 >> 172.21.15.17:0/1377947739 conn(0x7f4a240fb840 msgr2=0x7f4a240fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:56.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.794+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1377947739 shutdown_connections 2024-08-19T01:15:56.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.794+0000 7f4a2a95c640 1 -- 172.21.15.17:0/1377947739 wait complete. 2024-08-19T01:15:56.805 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:15:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.878+0000 7f82fa581640 1 -- 172.21.15.17:0/4023574597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f40ffda0 msgr2=0x7f82f4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:56.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.878+0000 7f82fa581640 1 --2- 172.21.15.17:0/4023574597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f40ffda0 0x7f82f4100180 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009880 tx=0x7f82e402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.880 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:56 smithi017 ceph-mon[99370]: pgmap v514: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.878+0000 7f82fa581640 1 -- 172.21.15.17:0/4023574597 shutdown_connections 2024-08-19T01:15:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.878+0000 7f82fa581640 1 --2- 172.21.15.17:0/4023574597 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f4100750 0x7f82f41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.878+0000 7f82fa581640 1 --2- 172.21.15.17:0/4023574597 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f40ffda0 0x7f82f4100180 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.878+0000 7f82fa581640 1 -- 172.21.15.17:0/4023574597 >> 172.21.15.17:0/4023574597 conn(0x7f82f40fb840 msgr2=0x7f82f40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:56.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.878+0000 7f82fa581640 1 -- 172.21.15.17:0/4023574597 shutdown_connections 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.878+0000 7f82fa581640 1 -- 172.21.15.17:0/4023574597 wait complete. 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.879+0000 7f82fa581640 1 Processor -- start 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.879+0000 7f82fa581640 1 -- start start 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.879+0000 7f82fa581640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f40ffda0 0x7f82f419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.879+0000 7f82fa581640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100750 0x7f82f419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.879+0000 7f82fa581640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f419c360 con 0x7f82f4100750 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.879+0000 7f82fa581640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f41958f0 con 0x7f82f40ffda0 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.879+0000 7f82f37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100750 0x7f82f419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.879+0000 7f82f37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100750 0x7f82f419bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41148/0 (socket says 172.21.15.17:41148) 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.879+0000 7f82f37fe640 1 -- 172.21.15.17:0/1496996677 learned_addr learned my addr 172.21.15.17:0/1496996677 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.879+0000 7f82f3fff640 1 --2- 172.21.15.17:0/1496996677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f40ffda0 0x7f82f419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.880+0000 7f82f37fe640 1 -- 172.21.15.17:0/1496996677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f40ffda0 msgr2=0x7f82f419b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:56.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.880+0000 7f82f37fe640 1 --2- 172.21.15.17:0/1496996677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f40ffda0 0x7f82f419b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:56.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.880+0000 7f82f37fe640 1 -- 172.21.15.17:0/1496996677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e4009560 con 0x7f82f4100750 2024-08-19T01:15:56.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.880+0000 7f82f37fe640 1 --2- 172.21.15.17:0/1496996677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100750 0x7f82f419bd40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f82e800d8d0 tx=0x7f82e800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:56.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.880+0000 7f82f17fa640 1 -- 172.21.15.17:0/1496996677 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82e800bea0 con 0x7f82f4100750 2024-08-19T01:15:56.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.880+0000 7f82f17fa640 1 -- 172.21.15.17:0/1496996677 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f82e8009c00 con 0x7f82f4100750 2024-08-19T01:15:56.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.880+0000 7f82f17fa640 1 -- 172.21.15.17:0/1496996677 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82e800f710 con 0x7f82f4100750 2024-08-19T01:15:56.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.880+0000 7f82fa581640 1 -- 172.21.15.17:0/1496996677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f4195bd0 con 0x7f82f4100750 2024-08-19T01:15:56.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.880+0000 7f82fa581640 1 -- 172.21.15.17:0/1496996677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f4196120 con 0x7f82f4100750 2024-08-19T01:15:56.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.882+0000 7f82fa581640 1 -- 172.21.15.17:0/1496996677 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f4101280 con 0x7f82f4100750 2024-08-19T01:15:56.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.882+0000 7f82f17fa640 1 -- 172.21.15.17:0/1496996677 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f82e8010460 con 0x7f82f4100750 2024-08-19T01:15:56.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.882+0000 7f82f17fa640 1 --2- 172.21.15.17:0/1496996677 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82dc06e180 0x7f82dc070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:56.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.882+0000 7f82f17fa640 1 -- 172.21.15.17:0/1496996677 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f82e808dd80 con 0x7f82f4100750 2024-08-19T01:15:56.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.882+0000 7f82f3fff640 1 --2- 172.21.15.17:0/1496996677 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82dc06e180 0x7f82dc070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:56.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.883+0000 7f82f3fff640 1 --2- 172.21.15.17:0/1496996677 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82dc06e180 0x7f82dc070640 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009230 tx=0x7f82e4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:56.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:56.887+0000 7f82f17fa640 1 -- 172.21.15.17:0/1496996677 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f82e8057190 con 0x7f82f4100750 2024-08-19T01:15:56.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:56 smithi086 ceph-mon[71303]: pgmap v514: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:57.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.079+0000 7f82fa581640 1 -- 172.21.15.17:0/1496996677 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f82f410cdb0 con 0x7f82dc06e180 2024-08-19T01:15:57.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.080+0000 7f82f17fa640 1 -- 172.21.15.17:0/1496996677 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f82f410cdb0 con 0x7f82dc06e180 2024-08-19T01:15:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.082+0000 7f82fa581640 1 -- 172.21.15.17:0/1496996677 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82dc06e180 msgr2=0x7f82dc070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.082+0000 7f82fa581640 1 --2- 172.21.15.17:0/1496996677 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82dc06e180 0x7f82dc070640 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009230 tx=0x7f82e4005a20 comp rx=0 tx=0).stop 2024-08-19T01:15:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.082+0000 7f82fa581640 1 -- 172.21.15.17:0/1496996677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100750 msgr2=0x7f82f419bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.082+0000 7f82fa581640 1 --2- 172.21.15.17:0/1496996677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100750 0x7f82f419bd40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f82e800d8d0 tx=0x7f82e800dd90 comp rx=0 tx=0).stop 2024-08-19T01:15:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.082+0000 7f82fa581640 1 -- 172.21.15.17:0/1496996677 shutdown_connections 2024-08-19T01:15:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.082+0000 7f82fa581640 1 --2- 172.21.15.17:0/1496996677 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f82dc06e180 0x7f82dc070640 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.082+0000 7f82fa581640 1 --2- 172.21.15.17:0/1496996677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f82f4100750 0x7f82f419bd40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.082+0000 7f82fa581640 1 --2- 172.21.15.17:0/1496996677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f82f40ffda0 0x7f82f419b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.082+0000 7f82fa581640 1 -- 172.21.15.17:0/1496996677 >> 172.21.15.17:0/1496996677 conn(0x7f82f40fb840 msgr2=0x7f82f40fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.082+0000 7f82fa581640 1 -- 172.21.15.17:0/1496996677 shutdown_connections 2024-08-19T01:15:57.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.082+0000 7f82fa581640 1 -- 172.21.15.17:0/1496996677 wait complete. 2024-08-19T01:15:57.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.165+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/3662742232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc8100750 msgr2=0x7f0dc81047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.165+0000 7f0dcdb6f640 1 --2- 172.21.15.17:0/3662742232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc8100750 0x7f0dc81047a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009880 tx=0x7f0db002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.165+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/3662742232 shutdown_connections 2024-08-19T01:15:57.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.165+0000 7f0dcdb6f640 1 --2- 172.21.15.17:0/3662742232 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc8100750 0x7f0dc81047a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.165+0000 7f0dcdb6f640 1 --2- 172.21.15.17:0/3662742232 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc80ffda0 0x7f0dc8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.165+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/3662742232 >> 172.21.15.17:0/3662742232 conn(0x7f0dc80fb840 msgr2=0x7f0dc80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:57.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.165+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/3662742232 shutdown_connections 2024-08-19T01:15:57.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.165+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/3662742232 wait complete. 2024-08-19T01:15:57.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.166+0000 7f0dcdb6f640 1 Processor -- start 2024-08-19T01:15:57.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.166+0000 7f0dcdb6f640 1 -- start start 2024-08-19T01:15:57.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.166+0000 7f0dcdb6f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc80ffda0 0x7f0dc819dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:57.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.166+0000 7f0dcdb6f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc8100750 0x7f0dc819dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:57.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.166+0000 7f0dcdb6f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc8197b60 con 0x7f0dc80ffda0 2024-08-19T01:15:57.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.166+0000 7f0dcdb6f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc8197ca0 con 0x7f0dc8100750 2024-08-19T01:15:57.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc80ffda0 0x7f0dc819dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:57.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dc77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc80ffda0 0x7f0dc819dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41174/0 (socket says 172.21.15.17:41174) 2024-08-19T01:15:57.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dc77fe640 1 -- 172.21.15.17:0/655613571 learned_addr learned my addr 172.21.15.17:0/655613571 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:57.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dbeffd640 1 --2- 172.21.15.17:0/655613571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc8100750 0x7f0dc819dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:57.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dc77fe640 1 -- 172.21.15.17:0/655613571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc8100750 msgr2=0x7f0dc819dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dc77fe640 1 --2- 172.21.15.17:0/655613571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc8100750 0x7f0dc819dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dc77fe640 1 -- 172.21.15.17:0/655613571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db0009560 con 0x7f0dc80ffda0 2024-08-19T01:15:57.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dc77fe640 1 --2- 172.21.15.17:0/655613571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc80ffda0 0x7f0dc819dab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0db800d6f0 tx=0x7f0db800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:57.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dc57fa640 1 -- 172.21.15.17:0/655613571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0db8009a30 con 0x7f0dc80ffda0 2024-08-19T01:15:57.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/655613571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc8197f80 con 0x7f0dc80ffda0 2024-08-19T01:15:57.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dc57fa640 1 -- 172.21.15.17:0/655613571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0db80054e0 con 0x7f0dc80ffda0 2024-08-19T01:15:57.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dc57fa640 1 -- 172.21.15.17:0/655613571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0db8010460 con 0x7f0dc80ffda0 2024-08-19T01:15:57.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.167+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/655613571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc81984a0 con 0x7f0dc80ffda0 2024-08-19T01:15:57.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.168+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/655613571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc8101280 con 0x7f0dc80ffda0 2024-08-19T01:15:57.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.169+0000 7f0dc57fa640 1 -- 172.21.15.17:0/655613571 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0db8009b90 con 0x7f0dc80ffda0 2024-08-19T01:15:57.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.170+0000 7f0dc57fa640 1 --2- 172.21.15.17:0/655613571 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db406e170 0x7f0db4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:57.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.170+0000 7f0dbeffd640 1 --2- 172.21.15.17:0/655613571 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db406e170 0x7f0db4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:57.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.170+0000 7f0dc57fa640 1 -- 172.21.15.17:0/655613571 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0db808dc80 con 0x7f0dc80ffda0 2024-08-19T01:15:57.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.170+0000 7f0dbeffd640 1 --2- 172.21.15.17:0/655613571 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db406e170 0x7f0db4070630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009230 tx=0x7f0db00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:57.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.174+0000 7f0dc57fa640 1 -- 172.21.15.17:0/655613571 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0db8057010 con 0x7f0dc80ffda0 2024-08-19T01:15:57.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.359+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/655613571 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0dc8199040 con 0x7f0db406e170 2024-08-19T01:15:57.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.369+0000 7f0dc57fa640 1 -- 172.21.15.17:0/655613571 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0dc8199040 con 0x7f0db406e170 2024-08-19T01:15:57.371 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:15:57.371 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (17m) 11m ago 27m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:15:57.371 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (28m) 11m ago 28m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:15:57.371 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (27m) 10m ago 27m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:15:57.371 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (15m) 11m ago 28m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:15:57.371 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (14m) 10m ago 27m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:15:57.371 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (16m) 11m ago 27m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (11m) 11m ago 22m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (11m) 11m ago 22m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (22m) 10m ago 22m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (10m) 10m ago 22m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (19m) 11m ago 29m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (18m) 10m ago 26m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (16m) 11m ago 29m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (15m) 10m ago 26m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (17m) 11m ago 28m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (17m) 10m ago 26m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (14m) 11m ago 26m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (14m) 11m ago 25m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:15:57.372 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (13m) 11m ago 25m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:15:57.373 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (12m) 10m ago 24m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:15:57.373 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (12m) 10m ago 24m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:15:57.373 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (11m) 10m ago 24m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:15:57.373 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (17m) 11m ago 27m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:15:57.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.371+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/655613571 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db406e170 msgr2=0x7f0db4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.371+0000 7f0dcdb6f640 1 --2- 172.21.15.17:0/655613571 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db406e170 0x7f0db4070630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009230 tx=0x7f0db00058d0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.371+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/655613571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc80ffda0 msgr2=0x7f0dc819dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.371+0000 7f0dcdb6f640 1 --2- 172.21.15.17:0/655613571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc80ffda0 0x7f0dc819dab0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0db800d6f0 tx=0x7f0db800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.371+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/655613571 shutdown_connections 2024-08-19T01:15:57.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.371+0000 7f0dcdb6f640 1 --2- 172.21.15.17:0/655613571 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db406e170 0x7f0db4070630 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.371+0000 7f0dcdb6f640 1 --2- 172.21.15.17:0/655613571 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dc8100750 0x7f0dc819dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.371+0000 7f0dcdb6f640 1 --2- 172.21.15.17:0/655613571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dc80ffda0 0x7f0dc819dab0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.371+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/655613571 >> 172.21.15.17:0/655613571 conn(0x7f0dc80fb840 msgr2=0x7f0dc80fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:57.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.371+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/655613571 shutdown_connections 2024-08-19T01:15:57.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.371+0000 7f0dcdb6f640 1 -- 172.21.15.17:0/655613571 wait complete. 2024-08-19T01:15:57.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.452+0000 7f32fa169640 1 -- 172.21.15.17:0/676803439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32f4101670 msgr2=0x7f32f4109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.452+0000 7f32fa169640 1 --2- 172.21.15.17:0/676803439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32f4101670 0x7f32f4109b60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009880 tx=0x7f32dc02a540 comp rx=0 tx=0).stop 2024-08-19T01:15:57.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.452+0000 7f32fa169640 1 -- 172.21.15.17:0/676803439 shutdown_connections 2024-08-19T01:15:57.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.452+0000 7f32fa169640 1 --2- 172.21.15.17:0/676803439 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32f4101670 0x7f32f4109b60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.452+0000 7f32fa169640 1 --2- 172.21.15.17:0/676803439 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32f4100d50 0x7f32f4101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.452+0000 7f32fa169640 1 -- 172.21.15.17:0/676803439 >> 172.21.15.17:0/676803439 conn(0x7f32f40758a0 msgr2=0x7f32f40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:57.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.452+0000 7f32fa169640 1 -- 172.21.15.17:0/676803439 shutdown_connections 2024-08-19T01:15:57.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.452+0000 7f32fa169640 1 -- 172.21.15.17:0/676803439 wait complete. 2024-08-19T01:15:57.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.453+0000 7f32fa169640 1 Processor -- start 2024-08-19T01:15:57.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.453+0000 7f32fa169640 1 -- start start 2024-08-19T01:15:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.453+0000 7f32fa169640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32f4100d50 0x7f32f419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.453+0000 7f32fa169640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32f4101670 0x7f32f419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.453+0000 7f32fa169640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f419c320 con 0x7f32f4101670 2024-08-19T01:15:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.453+0000 7f32fa169640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4195940 con 0x7f32f4100d50 2024-08-19T01:15:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32eaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32f4101670 0x7f32f419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32eaffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32f4101670 0x7f32f419bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41194/0 (socket says 172.21.15.17:41194) 2024-08-19T01:15:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32eaffd640 1 -- 172.21.15.17:0/165551394 learned_addr learned my addr 172.21.15.17:0/165551394 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32f37fe640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32f4100d50 0x7f32f419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32eaffd640 1 -- 172.21.15.17:0/165551394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32f4100d50 msgr2=0x7f32f419b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32eaffd640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32f4100d50 0x7f32f419b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32eaffd640 1 -- 172.21.15.17:0/165551394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc009560 con 0x7f32f4101670 2024-08-19T01:15:57.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32f37fe640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32f4100d50 0x7f32f419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:15:57.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32eaffd640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32f4101670 0x7f32f419bd90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f32dc005940 tx=0x7f32dc032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:57.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32f17fa640 1 -- 172.21.15.17:0/165551394 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32dc005220 con 0x7f32f4101670 2024-08-19T01:15:57.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32fa169640 1 -- 172.21.15.17:0/165551394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f4195bc0 con 0x7f32f4101670 2024-08-19T01:15:57.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32f17fa640 1 -- 172.21.15.17:0/165551394 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32dc005380 con 0x7f32f4101670 2024-08-19T01:15:57.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32f17fa640 1 -- 172.21.15.17:0/165551394 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32dc003a50 con 0x7f32f4101670 2024-08-19T01:15:57.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.454+0000 7f32fa169640 1 -- 172.21.15.17:0/165551394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f41960b0 con 0x7f32f4101670 2024-08-19T01:15:57.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.455+0000 7f32fa169640 1 -- 172.21.15.17:0/165551394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f4068470 con 0x7f32f4101670 2024-08-19T01:15:57.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.456+0000 7f32f17fa640 1 -- 172.21.15.17:0/165551394 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f32dc004c80 con 0x7f32f4101670 2024-08-19T01:15:57.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.456+0000 7f32f17fa640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32e006e170 0x7f32e0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:57.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.456+0000 7f32f17fa640 1 -- 172.21.15.17:0/165551394 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f32dc0aee80 con 0x7f32f4101670 2024-08-19T01:15:57.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.456+0000 7f32f37fe640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32e006e170 0x7f32e0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:57.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.457+0000 7f32f37fe640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32e006e170 0x7f32e0070630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f32e400abe0 tx=0x7f32e400a5c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:57.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.461+0000 7f32f17fa640 1 -- 172.21.15.17:0/165551394 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f32dc0781e0 con 0x7f32f4101670 2024-08-19T01:15:57.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.704+0000 7f32fa169640 1 -- 172.21.15.17:0/165551394 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f32f4104400 con 0x7f32f4101670 2024-08-19T01:15:57.706 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:57 smithi017 ceph-mon[99370]: from='client.34988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:57.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.705+0000 7f32f17fa640 1 -- 172.21.15.17:0/165551394 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f32dc049350 con 0x7f32f4101670 2024-08-19T01:15:57.707 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:15:57.707 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:15:57.707 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:15:57.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:15:57.707 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:15:57.707 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:15:57.708 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:15:57.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.706+0000 7f32fa169640 1 -- 172.21.15.17:0/165551394 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32e006e170 msgr2=0x7f32e0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.706+0000 7f32fa169640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32e006e170 0x7f32e0070630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f32e400abe0 tx=0x7f32e400a5c0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.707+0000 7f32fa169640 1 -- 172.21.15.17:0/165551394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32f4101670 msgr2=0x7f32f419bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.707+0000 7f32fa169640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32f4101670 0x7f32f419bd90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f32dc005940 tx=0x7f32dc032bd0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.707+0000 7f32fa169640 1 -- 172.21.15.17:0/165551394 shutdown_connections 2024-08-19T01:15:57.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.707+0000 7f32fa169640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f32e006e170 0x7f32e0070630 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.707+0000 7f32fa169640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32f4101670 0x7f32f419bd90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.707+0000 7f32fa169640 1 --2- 172.21.15.17:0/165551394 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32f4100d50 0x7f32f419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.707+0000 7f32fa169640 1 -- 172.21.15.17:0/165551394 >> 172.21.15.17:0/165551394 conn(0x7f32f40758a0 msgr2=0x7f32f4101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:57.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.707+0000 7f32fa169640 1 -- 172.21.15.17:0/165551394 shutdown_connections 2024-08-19T01:15:57.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.707+0000 7f32fa169640 1 -- 172.21.15.17:0/165551394 wait complete. 2024-08-19T01:15:57.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.789+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/3216559037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a94101610 msgr2=0x7f2a94109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.789+0000 7f2a9b1b8640 1 --2- 172.21.15.17:0/3216559037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a94101610 0x7f2a94109b00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0098b0 tx=0x7f2a7c02a4d0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.789+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/3216559037 shutdown_connections 2024-08-19T01:15:57.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.789+0000 7f2a9b1b8640 1 --2- 172.21.15.17:0/3216559037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a94101610 0x7f2a94109b00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.789+0000 7f2a9b1b8640 1 --2- 172.21.15.17:0/3216559037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a94100c60 0x7f2a94101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.789+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/3216559037 >> 172.21.15.17:0/3216559037 conn(0x7f2a940fa730 msgr2=0x7f2a940fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:57.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.789+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/3216559037 shutdown_connections 2024-08-19T01:15:57.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.789+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/3216559037 wait complete. 2024-08-19T01:15:57.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.789+0000 7f2a9b1b8640 1 Processor -- start 2024-08-19T01:15:57.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a9b1b8640 1 -- start start 2024-08-19T01:15:57.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a9b1b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a94100c60 0x7f2a940fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:57.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a9b1b8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a94101610 0x7f2a940fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:57.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a9b1b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940ff3d0 con 0x7f2a94100c60 2024-08-19T01:15:57.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a9b1b8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a940ff540 con 0x7f2a94101610 2024-08-19T01:15:57.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a98f54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a94100c60 0x7f2a940fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:57.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a98f54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a94100c60 0x7f2a940fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41208/0 (socket says 172.21.15.17:41208) 2024-08-19T01:15:57.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a98f54640 1 -- 172.21.15.17:0/2528986211 learned_addr learned my addr 172.21.15.17:0/2528986211 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:57.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a93fff640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a94101610 0x7f2a940fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:57.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a98f54640 1 -- 172.21.15.17:0/2528986211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a94101610 msgr2=0x7f2a940fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:57.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a98f54640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a94101610 0x7f2a940fee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:57.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a98f54640 1 -- 172.21.15.17:0/2528986211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c009560 con 0x7f2a94100c60 2024-08-19T01:15:57.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a93fff640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a94101610 0x7f2a940fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:15:57.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.790+0000 7f2a98f54640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a94100c60 0x7f2a940fe950 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400cc60 tx=0x7f2a8400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:57.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.791+0000 7f2a91ffb640 1 -- 172.21.15.17:0/2528986211 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a84004b20 con 0x7f2a94100c60 2024-08-19T01:15:57.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.791+0000 7f2a91ffb640 1 -- 172.21.15.17:0/2528986211 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2a84004c80 con 0x7f2a94100c60 2024-08-19T01:15:57.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.791+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/2528986211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a941a1cf0 con 0x7f2a94100c60 2024-08-19T01:15:57.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.791+0000 7f2a91ffb640 1 -- 172.21.15.17:0/2528986211 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a8400f640 con 0x7f2a94100c60 2024-08-19T01:15:57.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.791+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/2528986211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a941a2050 con 0x7f2a94100c60 2024-08-19T01:15:57.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.792+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/2528986211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a94068d30 con 0x7f2a94100c60 2024-08-19T01:15:57.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.792+0000 7f2a91ffb640 1 -- 172.21.15.17:0/2528986211 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2a840055e0 con 0x7f2a94100c60 2024-08-19T01:15:57.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.793+0000 7f2a91ffb640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a8006e170 0x7f2a80070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:57.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.793+0000 7f2a91ffb640 1 -- 172.21.15.17:0/2528986211 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2a8408e3c0 con 0x7f2a94100c60 2024-08-19T01:15:57.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.793+0000 7f2a93fff640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a8006e170 0x7f2a80070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:57.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.793+0000 7f2a93fff640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a8006e170 0x7f2a80070630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c000c00 tx=0x7f2a7c005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:57.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:57.797+0000 7f2a91ffb640 1 -- 172.21.15.17:0/2528986211 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2a840576a0 con 0x7f2a94100c60 2024-08-19T01:15:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:57 smithi086 ceph-mon[71303]: from='client.34988 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:58.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.007+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/2528986211 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2a941043b0 con 0x7f2a94100c60 2024-08-19T01:15:58.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.008+0000 7f2a91ffb640 1 -- 172.21.15.17:0/2528986211 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f2a8405ad60 con 0x7f2a94100c60 2024-08-19T01:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:15:58.010 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:15:58.011 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:15:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:15:58.013 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:15:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:15:58.013 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:15:58.013 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:15:58.013 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:15:58.013 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:15:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:15:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.010+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/2528986211 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a8006e170 msgr2=0x7f2a80070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.011+0000 7f2a9b1b8640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a8006e170 0x7f2a80070630 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c000c00 tx=0x7f2a7c005e60 comp rx=0 tx=0).stop 2024-08-19T01:15:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.011+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/2528986211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a94100c60 msgr2=0x7f2a940fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.011+0000 7f2a9b1b8640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a94100c60 0x7f2a940fe950 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2a8400cc60 tx=0x7f2a8400a620 comp rx=0 tx=0).stop 2024-08-19T01:15:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.011+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/2528986211 shutdown_connections 2024-08-19T01:15:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.011+0000 7f2a9b1b8640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2a8006e170 0x7f2a80070630 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.011+0000 7f2a9b1b8640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2a94101610 0x7f2a940fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.011+0000 7f2a9b1b8640 1 --2- 172.21.15.17:0/2528986211 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2a94100c60 0x7f2a940fe950 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.011+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/2528986211 >> 172.21.15.17:0/2528986211 conn(0x7f2a940fa730 msgr2=0x7f2a94101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:58.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.011+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/2528986211 shutdown_connections 2024-08-19T01:15:58.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.011+0000 7f2a9b1b8640 1 -- 172.21.15.17:0/2528986211 wait complete. 2024-08-19T01:15:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.095+0000 7f57b96f7640 1 -- 172.21.15.17:0/2845748321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b4100750 msgr2=0x7f57b41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.095+0000 7f57b96f7640 1 --2- 172.21.15.17:0/2845748321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b4100750 0x7f57b41047a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009880 tx=0x7f57a802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.095+0000 7f57b96f7640 1 -- 172.21.15.17:0/2845748321 shutdown_connections 2024-08-19T01:15:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.095+0000 7f57b96f7640 1 --2- 172.21.15.17:0/2845748321 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b4100750 0x7f57b41047a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.095+0000 7f57b96f7640 1 --2- 172.21.15.17:0/2845748321 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b40ffda0 0x7f57b4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.095+0000 7f57b96f7640 1 -- 172.21.15.17:0/2845748321 >> 172.21.15.17:0/2845748321 conn(0x7f57b40fb840 msgr2=0x7f57b40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.095+0000 7f57b96f7640 1 -- 172.21.15.17:0/2845748321 shutdown_connections 2024-08-19T01:15:58.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.095+0000 7f57b96f7640 1 -- 172.21.15.17:0/2845748321 wait complete. 2024-08-19T01:15:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.096+0000 7f57b96f7640 1 Processor -- start 2024-08-19T01:15:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.096+0000 7f57b96f7640 1 -- start start 2024-08-19T01:15:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.096+0000 7f57b96f7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b40ffda0 0x7f57b40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.096+0000 7f57b96f7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b4100750 0x7f57b4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.096+0000 7f57b96f7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b4073230 con 0x7f57b4100750 2024-08-19T01:15:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.096+0000 7f57b96f7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b4073370 con 0x7f57b40ffda0 2024-08-19T01:15:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.096+0000 7f57b27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b4100750 0x7f57b4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.096+0000 7f57b27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b4100750 0x7f57b4072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41232/0 (socket says 172.21.15.17:41232) 2024-08-19T01:15:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.096+0000 7f57b27fc640 1 -- 172.21.15.17:0/2916240681 learned_addr learned my addr 172.21.15.17:0/2916240681 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.096+0000 7f57b2ffd640 1 --2- 172.21.15.17:0/2916240681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b40ffda0 0x7f57b40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:58.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.097+0000 7f57b27fc640 1 -- 172.21.15.17:0/2916240681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b40ffda0 msgr2=0x7f57b40727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.097+0000 7f57b27fc640 1 --2- 172.21.15.17:0/2916240681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b40ffda0 0x7f57b40727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.097+0000 7f57b27fc640 1 -- 172.21.15.17:0/2916240681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a8009560 con 0x7f57b4100750 2024-08-19T01:15:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.097+0000 7f57b27fc640 1 --2- 172.21.15.17:0/2916240681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b4100750 0x7f57b4072cf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f57a802a9c0 tx=0x7f57a80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.097+0000 7f579bfff640 1 -- 172.21.15.17:0/2916240681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57a80048d0 con 0x7f57b4100750 2024-08-19T01:15:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.097+0000 7f579bfff640 1 -- 172.21.15.17:0/2916240681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57a8031640 con 0x7f57b4100750 2024-08-19T01:15:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.097+0000 7f57b96f7640 1 -- 172.21.15.17:0/2916240681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b40735f0 con 0x7f57b4100750 2024-08-19T01:15:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.097+0000 7f579bfff640 1 -- 172.21.15.17:0/2916240681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57a80038d0 con 0x7f57b4100750 2024-08-19T01:15:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.097+0000 7f57b96f7640 1 -- 172.21.15.17:0/2916240681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b41a2000 con 0x7f57b4100750 2024-08-19T01:15:58.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.098+0000 7f57b96f7640 1 -- 172.21.15.17:0/2916240681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b4101280 con 0x7f57b4100750 2024-08-19T01:15:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.099+0000 7f579bfff640 1 -- 172.21.15.17:0/2916240681 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f57a8004a30 con 0x7f57b4100750 2024-08-19T01:15:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.099+0000 7f579bfff640 1 --2- 172.21.15.17:0/2916240681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f579c06e170 0x7f579c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.099+0000 7f579bfff640 1 -- 172.21.15.17:0/2916240681 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f57a80aef90 con 0x7f57b4100750 2024-08-19T01:15:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.099+0000 7f57b2ffd640 1 --2- 172.21.15.17:0/2916240681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f579c06e170 0x7f579c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:58.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.100+0000 7f57b2ffd640 1 --2- 172.21.15.17:0/2916240681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f579c06e170 0x7f579c070630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009bd0 tx=0x7f57a4005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:58.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.103+0000 7f579bfff640 1 -- 172.21.15.17:0/2916240681 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f57a80783a0 con 0x7f57b4100750 2024-08-19T01:15:58.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.295+0000 7f57b96f7640 1 -- 172.21.15.17:0/2916240681 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57b4108150 con 0x7f579c06e170 2024-08-19T01:15:58.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.296+0000 7f579bfff640 1 -- 172.21.15.17:0/2916240681 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f57b4108150 con 0x7f579c06e170 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:15:58.299 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:15:58.300 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:15:58.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.298+0000 7f57b96f7640 1 -- 172.21.15.17:0/2916240681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f579c06e170 msgr2=0x7f579c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:58.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.298+0000 7f57b96f7640 1 --2- 172.21.15.17:0/2916240681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f579c06e170 0x7f579c070630 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009bd0 tx=0x7f57a4005f90 comp rx=0 tx=0).stop 2024-08-19T01:15:58.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.298+0000 7f57b96f7640 1 -- 172.21.15.17:0/2916240681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b4100750 msgr2=0x7f57b4072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:58.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.298+0000 7f57b96f7640 1 --2- 172.21.15.17:0/2916240681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b4100750 0x7f57b4072cf0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f57a802a9c0 tx=0x7f57a80055a0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.299+0000 7f57b96f7640 1 -- 172.21.15.17:0/2916240681 shutdown_connections 2024-08-19T01:15:58.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.299+0000 7f57b96f7640 1 --2- 172.21.15.17:0/2916240681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f579c06e170 0x7f579c070630 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.299+0000 7f57b96f7640 1 --2- 172.21.15.17:0/2916240681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b4100750 0x7f57b4072cf0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.299+0000 7f57b96f7640 1 --2- 172.21.15.17:0/2916240681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b40ffda0 0x7f57b40727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.299+0000 7f57b96f7640 1 -- 172.21.15.17:0/2916240681 >> 172.21.15.17:0/2916240681 conn(0x7f57b40fb840 msgr2=0x7f57b40fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:58.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.299+0000 7f57b96f7640 1 -- 172.21.15.17:0/2916240681 shutdown_connections 2024-08-19T01:15:58.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.299+0000 7f57b96f7640 1 -- 172.21.15.17:0/2916240681 wait complete. 2024-08-19T01:15:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.380+0000 7f61b8d95640 1 -- 172.21.15.17:0/3344360030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b41049f0 msgr2=0x7f61b4104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.380+0000 7f61b8d95640 1 --2- 172.21.15.17:0/3344360030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b41049f0 0x7f61b4104dd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009880 tx=0x7f61a402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.381+0000 7f61b8d95640 1 -- 172.21.15.17:0/3344360030 shutdown_connections 2024-08-19T01:15:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.381+0000 7f61b8d95640 1 --2- 172.21.15.17:0/3344360030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b40fe9f0 0x7f61b40fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.381+0000 7f61b8d95640 1 --2- 172.21.15.17:0/3344360030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b41049f0 0x7f61b4104dd0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.381+0000 7f61b8d95640 1 -- 172.21.15.17:0/3344360030 >> 172.21.15.17:0/3344360030 conn(0x7f61b40758a0 msgr2=0x7f61b40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.381+0000 7f61b8d95640 1 -- 172.21.15.17:0/3344360030 shutdown_connections 2024-08-19T01:15:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.381+0000 7f61b8d95640 1 -- 172.21.15.17:0/3344360030 wait complete. 2024-08-19T01:15:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.381+0000 7f61b8d95640 1 Processor -- start 2024-08-19T01:15:58.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.381+0000 7f61b8d95640 1 -- start start 2024-08-19T01:15:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b8d95640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b40fe9f0 0x7f61b419b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b8d95640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b41049f0 0x7f61b419be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b8d95640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b4195960 con 0x7f61b40fe9f0 2024-08-19T01:15:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b8d95640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b4195aa0 con 0x7f61b41049f0 2024-08-19T01:15:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b40fe9f0 0x7f61b419b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b40fe9f0 0x7f61b419b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41248/0 (socket says 172.21.15.17:41248) 2024-08-19T01:15:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b259c640 1 -- 172.21.15.17:0/1487524225 learned_addr learned my addr 172.21.15.17:0/1487524225 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:15:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b1d9b640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b41049f0 0x7f61b419be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:58.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b259c640 1 -- 172.21.15.17:0/1487524225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b41049f0 msgr2=0x7f61b419be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b259c640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b41049f0 0x7f61b419be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b259c640 1 -- 172.21.15.17:0/1487524225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4009560 con 0x7f61b40fe9f0 2024-08-19T01:15:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b1d9b640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b41049f0 0x7f61b419be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:15:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61b259c640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b40fe9f0 0x7f61b419b900 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f61a402a9c0 tx=0x7f61a40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.382+0000 7f61ab7fe640 1 -- 172.21.15.17:0/1487524225 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61a4004aa0 con 0x7f61b40fe9f0 2024-08-19T01:15:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.383+0000 7f61ab7fe640 1 -- 172.21.15.17:0/1487524225 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61a4004c00 con 0x7f61b40fe9f0 2024-08-19T01:15:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.383+0000 7f61b8d95640 1 -- 172.21.15.17:0/1487524225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b4195d20 con 0x7f61b40fe9f0 2024-08-19T01:15:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.383+0000 7f61ab7fe640 1 -- 172.21.15.17:0/1487524225 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61a4003980 con 0x7f61b40fe9f0 2024-08-19T01:15:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.383+0000 7f61b8d95640 1 -- 172.21.15.17:0/1487524225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b4196210 con 0x7f61b40fe9f0 2024-08-19T01:15:58.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.384+0000 7f61b8d95640 1 -- 172.21.15.17:0/1487524225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b4100130 con 0x7f61b40fe9f0 2024-08-19T01:15:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.384+0000 7f61ab7fe640 1 -- 172.21.15.17:0/1487524225 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f61a4003bf0 con 0x7f61b40fe9f0 2024-08-19T01:15:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.385+0000 7f61ab7fe640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61a006e170 0x7f61a0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:15:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.385+0000 7f61ab7fe640 1 -- 172.21.15.17:0/1487524225 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f61a40af210 con 0x7f61b40fe9f0 2024-08-19T01:15:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.385+0000 7f61b1d9b640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61a006e170 0x7f61a0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:15:58.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.385+0000 7f61b1d9b640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61a006e170 0x7f61a0070630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f61b41971b0 tx=0x7f619c005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:15:58.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.389+0000 7f61ab7fe640 1 -- 172.21.15.17:0/1487524225 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f61a40784f0 con 0x7f61b40fe9f0 2024-08-19T01:15:58.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.632+0000 7f61b8d95640 1 -- 172.21.15.17:0/1487524225 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f61b410bc80 con 0x7f61b40fe9f0 2024-08-19T01:15:58.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.632+0000 7f61ab7fe640 1 -- 172.21.15.17:0/1487524225 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f61a407bbb0 con 0x7f61b40fe9f0 2024-08-19T01:15:58.634 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:15:58.635 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:15:58.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.634+0000 7f61b8d95640 1 -- 172.21.15.17:0/1487524225 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61a006e170 msgr2=0x7f61a0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:58.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.634+0000 7f61b8d95640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61a006e170 0x7f61a0070630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f61b41971b0 tx=0x7f619c005e50 comp rx=0 tx=0).stop 2024-08-19T01:15:58.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.634+0000 7f61b8d95640 1 -- 172.21.15.17:0/1487524225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b40fe9f0 msgr2=0x7f61b419b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:15:58.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.634+0000 7f61b8d95640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b40fe9f0 0x7f61b419b900 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f61a402a9c0 tx=0x7f61a40055a0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.634+0000 7f61b8d95640 1 -- 172.21.15.17:0/1487524225 shutdown_connections 2024-08-19T01:15:58.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.634+0000 7f61b8d95640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61a006e170 0x7f61a0070630 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.634+0000 7f61b8d95640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f61b41049f0 0x7f61b419be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.634+0000 7f61b8d95640 1 --2- 172.21.15.17:0/1487524225 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f61b40fe9f0 0x7f61b419b900 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:15:58.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.634+0000 7f61b8d95640 1 -- 172.21.15.17:0/1487524225 >> 172.21.15.17:0/1487524225 conn(0x7f61b40758a0 msgr2=0x7f61b40fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:15:58.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.635+0000 7f61b8d95640 1 -- 172.21.15.17:0/1487524225 shutdown_connections 2024-08-19T01:15:58.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:15:58.635+0000 7f61b8d95640 1 -- 172.21.15.17:0/1487524225 wait complete. 2024-08-19T01:15:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:58 smithi017 ceph-mon[99370]: from='client.34992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:58 smithi017 ceph-mon[99370]: pgmap v515: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:58 smithi017 ceph-mon[99370]: from='client.34996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:58 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/165551394' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:15:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:58 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2528986211' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:15:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:58 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1487524225' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:15:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:58 smithi086 ceph-mon[71303]: from='client.34992 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:58 smithi086 ceph-mon[71303]: pgmap v515: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:15:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:58 smithi086 ceph-mon[71303]: from='client.34996 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:15:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:58 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/165551394' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:15:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:58 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2528986211' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:15:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:58 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1487524225' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:15:59.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:15:59 smithi086 ceph-mon[71303]: from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:16:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:15:59 smithi017 ceph-mon[99370]: from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:16:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:00 smithi086 ceph-mon[71303]: pgmap v516: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:01.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:00 smithi017 ceph-mon[99370]: pgmap v516: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:02 smithi086 ceph-mon[71303]: pgmap v517: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:03.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:02 smithi017 ceph-mon[99370]: pgmap v517: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:16:04.127 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:16:05.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:04 smithi017 ceph-mon[99370]: pgmap v518: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:04 smithi086 ceph-mon[71303]: pgmap v518: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:06 smithi017 ceph-mon[99370]: pgmap v519: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:07.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:06 smithi086 ceph-mon[71303]: pgmap v519: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:08 smithi017 ceph-mon[99370]: pgmap v520: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:08 smithi086 ceph-mon[71303]: pgmap v520: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:10.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:10 smithi086 ceph-mon[71303]: pgmap v521: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:11.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:10 smithi017 ceph-mon[99370]: pgmap v521: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:13.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:12 smithi017 ceph-mon[99370]: pgmap v522: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:13.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:12 smithi086 ceph-mon[71303]: pgmap v522: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:15.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:14 smithi017 ceph-mon[99370]: pgmap v523: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:15.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:14 smithi086 ceph-mon[71303]: pgmap v523: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:17.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:16 smithi017 ceph-mon[99370]: pgmap v524: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:17.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:16 smithi086 ceph-mon[71303]: pgmap v524: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:18 smithi017 ceph-mon[99370]: pgmap v525: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:16:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:18 smithi086 ceph-mon[71303]: pgmap v525: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:16:20.998 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:20 smithi086 ceph-mon[71303]: pgmap v526: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:21.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:20 smithi017 ceph-mon[99370]: pgmap v526: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:23.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:22 smithi017 ceph-mon[99370]: pgmap v527: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:23.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:22 smithi086 ceph-mon[71303]: pgmap v527: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:25.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:24 smithi017 ceph-mon[99370]: pgmap v528: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:24 smithi086 ceph-mon[71303]: pgmap v528: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:27.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:26 smithi017 ceph-mon[99370]: pgmap v529: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:26 smithi086 ceph-mon[71303]: pgmap v529: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.732+0000 7ff4bf689640 1 -- 172.21.15.17:0/321664589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b80fe8a0 msgr2=0x7ff4b80fec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.732+0000 7ff4bf689640 1 --2- 172.21.15.17:0/321664589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b80fe8a0 0x7ff4b80fec80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4009880 tx=0x7ff4b402a490 comp rx=0 tx=0).stop 2024-08-19T01:16:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.732+0000 7ff4bf689640 1 -- 172.21.15.17:0/321664589 shutdown_connections 2024-08-19T01:16:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.732+0000 7ff4bf689640 1 --2- 172.21.15.17:0/321664589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4b80ff250 0x7ff4b810bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.732+0000 7ff4bf689640 1 --2- 172.21.15.17:0/321664589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b80fe8a0 0x7ff4b80fec80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.732+0000 7ff4bf689640 1 -- 172.21.15.17:0/321664589 >> 172.21.15.17:0/321664589 conn(0x7ff4b80758a0 msgr2=0x7ff4b80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:28.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.732+0000 7ff4bf689640 1 -- 172.21.15.17:0/321664589 shutdown_connections 2024-08-19T01:16:28.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.732+0000 7ff4bf689640 1 -- 172.21.15.17:0/321664589 wait complete. 2024-08-19T01:16:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.732+0000 7ff4bf689640 1 Processor -- start 2024-08-19T01:16:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.732+0000 7ff4bf689640 1 -- start start 2024-08-19T01:16:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bf689640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b80fe8a0 0x7ff4b8197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bf689640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4b80ff250 0x7ff4b8198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bf689640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b81988e0 con 0x7ff4b80fe8a0 2024-08-19T01:16:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bf689640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b819b550 con 0x7ff4b80ff250 2024-08-19T01:16:28.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bd425640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b80fe8a0 0x7ff4b8197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bd425640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b80fe8a0 0x7ff4b8197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40664/0 (socket says 172.21.15.17:40664) 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bd425640 1 -- 172.21.15.17:0/1882153483 learned_addr learned my addr 172.21.15.17:0/1882153483 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bcc24640 1 --2- 172.21.15.17:0/1882153483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4b80ff250 0x7ff4b8198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bd425640 1 -- 172.21.15.17:0/1882153483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4b80ff250 msgr2=0x7ff4b8198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bd425640 1 --2- 172.21.15.17:0/1882153483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4b80ff250 0x7ff4b8198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bd425640 1 -- 172.21.15.17:0/1882153483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b4009560 con 0x7ff4b80fe8a0 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.733+0000 7ff4bd425640 1 --2- 172.21.15.17:0/1882153483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b80fe8a0 0x7ff4b8197cc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4006010 tx=0x7ff4b40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.734+0000 7ff4ae7fc640 1 -- 172.21.15.17:0/1882153483 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b4004aa0 con 0x7ff4b80fe8a0 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.734+0000 7ff4ae7fc640 1 -- 172.21.15.17:0/1882153483 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4b4031470 con 0x7ff4b80fe8a0 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.734+0000 7ff4bf689640 1 -- 172.21.15.17:0/1882153483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b819b830 con 0x7ff4b80fe8a0 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.734+0000 7ff4ae7fc640 1 -- 172.21.15.17:0/1882153483 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4b4003940 con 0x7ff4b80fe8a0 2024-08-19T01:16:28.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.734+0000 7ff4bf689640 1 -- 172.21.15.17:0/1882153483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b819bd80 con 0x7ff4b80fe8a0 2024-08-19T01:16:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.735+0000 7ff4bf689640 1 -- 172.21.15.17:0/1882153483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b80684b0 con 0x7ff4b80fe8a0 2024-08-19T01:16:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.735+0000 7ff4ae7fc640 1 -- 172.21.15.17:0/1882153483 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff4b4031b90 con 0x7ff4b80fe8a0 2024-08-19T01:16:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.736+0000 7ff4ae7fc640 1 --2- 172.21.15.17:0/1882153483 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4a406e180 0x7ff4a4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:28.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.736+0000 7ff4ae7fc640 1 -- 172.21.15.17:0/1882153483 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff4b40af130 con 0x7ff4b80fe8a0 2024-08-19T01:16:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.736+0000 7ff4bcc24640 1 --2- 172.21.15.17:0/1882153483 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4a406e180 0x7ff4a4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:28.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.737+0000 7ff4bcc24640 1 --2- 172.21.15.17:0/1882153483 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4a406e180 0x7ff4a4070640 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8199230 tx=0x7ff4a800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:28.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.741+0000 7ff4ae7fc640 1 -- 172.21.15.17:0/1882153483 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff4b4078540 con 0x7ff4b80fe8a0 2024-08-19T01:16:28.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.932+0000 7ff4bf689640 1 -- 172.21.15.17:0/1882153483 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4b810eed0 con 0x7ff4a406e180 2024-08-19T01:16:28.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.933+0000 7ff4ae7fc640 1 -- 172.21.15.17:0/1882153483 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff4b810eed0 con 0x7ff4a406e180 2024-08-19T01:16:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.935+0000 7ff4bf689640 1 -- 172.21.15.17:0/1882153483 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4a406e180 msgr2=0x7ff4a4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.935+0000 7ff4bf689640 1 --2- 172.21.15.17:0/1882153483 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4a406e180 0x7ff4a4070640 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8199230 tx=0x7ff4a800b390 comp rx=0 tx=0).stop 2024-08-19T01:16:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.935+0000 7ff4bf689640 1 -- 172.21.15.17:0/1882153483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b80fe8a0 msgr2=0x7ff4b8197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.935+0000 7ff4bf689640 1 --2- 172.21.15.17:0/1882153483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b80fe8a0 0x7ff4b8197cc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4006010 tx=0x7ff4b40055a0 comp rx=0 tx=0).stop 2024-08-19T01:16:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.935+0000 7ff4bf689640 1 -- 172.21.15.17:0/1882153483 shutdown_connections 2024-08-19T01:16:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.935+0000 7ff4bf689640 1 --2- 172.21.15.17:0/1882153483 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4a406e180 0x7ff4a4070640 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.935+0000 7ff4bf689640 1 --2- 172.21.15.17:0/1882153483 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4b80ff250 0x7ff4b8198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.935+0000 7ff4bf689640 1 --2- 172.21.15.17:0/1882153483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4b80fe8a0 0x7ff4b8197cc0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.935+0000 7ff4bf689640 1 -- 172.21.15.17:0/1882153483 >> 172.21.15.17:0/1882153483 conn(0x7ff4b80758a0 msgr2=0x7ff4b80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.935+0000 7ff4bf689640 1 -- 172.21.15.17:0/1882153483 shutdown_connections 2024-08-19T01:16:28.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:28.935+0000 7ff4bf689640 1 -- 172.21.15.17:0/1882153483 wait complete. 2024-08-19T01:16:28.946 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:16:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.020+0000 7fae2624c640 1 -- 172.21.15.17:0/1447114199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae200ffda0 msgr2=0x7fae20100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.020+0000 7fae2624c640 1 --2- 172.21.15.17:0/1447114199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae200ffda0 0x7fae20100180 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fae10009880 tx=0x7fae1002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.020+0000 7fae2624c640 1 -- 172.21.15.17:0/1447114199 shutdown_connections 2024-08-19T01:16:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.020+0000 7fae2624c640 1 --2- 172.21.15.17:0/1447114199 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae20100750 0x7fae201047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.020+0000 7fae2624c640 1 --2- 172.21.15.17:0/1447114199 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae200ffda0 0x7fae20100180 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.020+0000 7fae2624c640 1 -- 172.21.15.17:0/1447114199 >> 172.21.15.17:0/1447114199 conn(0x7fae200fb840 msgr2=0x7fae200fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:29.024 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:28 smithi017 ceph-mon[99370]: pgmap v530: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.020+0000 7fae2624c640 1 -- 172.21.15.17:0/1447114199 shutdown_connections 2024-08-19T01:16:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.020+0000 7fae2624c640 1 -- 172.21.15.17:0/1447114199 wait complete. 2024-08-19T01:16:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.021+0000 7fae2624c640 1 Processor -- start 2024-08-19T01:16:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.021+0000 7fae2624c640 1 -- start start 2024-08-19T01:16:29.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.021+0000 7fae2624c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae200ffda0 0x7fae2019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.021+0000 7fae2624c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae20100750 0x7fae2019bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.021+0000 7fae2624c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2019c2d0 con 0x7fae20100750 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.021+0000 7fae2624c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae201958f0 con 0x7fae200ffda0 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae1effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae20100750 0x7fae2019bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae1effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae20100750 0x7fae2019bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40684/0 (socket says 172.21.15.17:40684) 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae1effd640 1 -- 172.21.15.17:0/117618761 learned_addr learned my addr 172.21.15.17:0/117618761 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae1f7fe640 1 --2- 172.21.15.17:0/117618761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae200ffda0 0x7fae2019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae1effd640 1 -- 172.21.15.17:0/117618761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae200ffda0 msgr2=0x7fae2019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae1effd640 1 --2- 172.21.15.17:0/117618761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae200ffda0 0x7fae2019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae1effd640 1 -- 172.21.15.17:0/117618761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae10009560 con 0x7fae20100750 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae1effd640 1 --2- 172.21.15.17:0/117618761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae20100750 0x7fae2019bd40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fae1400c8a0 tx=0x7fae1400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae1cff9640 1 -- 172.21.15.17:0/117618761 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae14007b80 con 0x7fae20100750 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae1cff9640 1 -- 172.21.15.17:0/117618761 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae14007ce0 con 0x7fae20100750 2024-08-19T01:16:29.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae2624c640 1 -- 172.21.15.17:0/117618761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae20195bd0 con 0x7fae20100750 2024-08-19T01:16:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae1cff9640 1 -- 172.21.15.17:0/117618761 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae14018810 con 0x7fae20100750 2024-08-19T01:16:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.022+0000 7fae2624c640 1 -- 172.21.15.17:0/117618761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae20196120 con 0x7fae20100750 2024-08-19T01:16:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.023+0000 7fae2624c640 1 -- 172.21.15.17:0/117618761 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae20101280 con 0x7fae20100750 2024-08-19T01:16:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.024+0000 7fae1cff9640 1 -- 172.21.15.17:0/117618761 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fae14018970 con 0x7fae20100750 2024-08-19T01:16:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.024+0000 7fae1cff9640 1 --2- 172.21.15.17:0/117618761 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0806e170 0x7fae08070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.024+0000 7fae1cff9640 1 -- 172.21.15.17:0/117618761 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fae1408e240 con 0x7fae20100750 2024-08-19T01:16:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.025+0000 7fae1f7fe640 1 --2- 172.21.15.17:0/117618761 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0806e170 0x7fae08070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.025+0000 7fae1f7fe640 1 --2- 172.21.15.17:0/117618761 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0806e170 0x7fae08070630 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fae10000c00 tx=0x7fae10005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:29.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.029+0000 7fae1cff9640 1 -- 172.21.15.17:0/117618761 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fae140575a0 con 0x7fae20100750 2024-08-19T01:16:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:28 smithi086 ceph-mon[71303]: pgmap v530: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:29.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.221+0000 7fae2624c640 1 -- 172.21.15.17:0/117618761 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae2010cdb0 con 0x7fae0806e170 2024-08-19T01:16:29.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.222+0000 7fae1cff9640 1 -- 172.21.15.17:0/117618761 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fae2010cdb0 con 0x7fae0806e170 2024-08-19T01:16:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.224+0000 7fae2624c640 1 -- 172.21.15.17:0/117618761 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0806e170 msgr2=0x7fae08070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.224+0000 7fae2624c640 1 --2- 172.21.15.17:0/117618761 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0806e170 0x7fae08070630 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fae10000c00 tx=0x7fae10005a20 comp rx=0 tx=0).stop 2024-08-19T01:16:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.224+0000 7fae2624c640 1 -- 172.21.15.17:0/117618761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae20100750 msgr2=0x7fae2019bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.224+0000 7fae2624c640 1 --2- 172.21.15.17:0/117618761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae20100750 0x7fae2019bd40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fae1400c8a0 tx=0x7fae1400cd60 comp rx=0 tx=0).stop 2024-08-19T01:16:29.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.224+0000 7fae2624c640 1 -- 172.21.15.17:0/117618761 shutdown_connections 2024-08-19T01:16:29.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.224+0000 7fae2624c640 1 --2- 172.21.15.17:0/117618761 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fae0806e170 0x7fae08070630 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.224+0000 7fae2624c640 1 --2- 172.21.15.17:0/117618761 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae20100750 0x7fae2019bd40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.224+0000 7fae2624c640 1 --2- 172.21.15.17:0/117618761 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fae200ffda0 0x7fae2019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.224+0000 7fae2624c640 1 -- 172.21.15.17:0/117618761 >> 172.21.15.17:0/117618761 conn(0x7fae200fb840 msgr2=0x7fae200fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:29.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.224+0000 7fae2624c640 1 -- 172.21.15.17:0/117618761 shutdown_connections 2024-08-19T01:16:29.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.224+0000 7fae2624c640 1 -- 172.21.15.17:0/117618761 wait complete. 2024-08-19T01:16:29.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.306+0000 7ff2b0388640 1 -- 172.21.15.17:0/1260277675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2a80fea30 msgr2=0x7ff2a80fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.306+0000 7ff2b0388640 1 --2- 172.21.15.17:0/1260277675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2a80fea30 0x7ff2a80fee90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009880 tx=0x7ff29c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.306+0000 7ff2b0388640 1 -- 172.21.15.17:0/1260277675 shutdown_connections 2024-08-19T01:16:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.306+0000 7ff2b0388640 1 --2- 172.21.15.17:0/1260277675 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2a80fea30 0x7ff2a80fee90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.306+0000 7ff2b0388640 1 --2- 172.21.15.17:0/1260277675 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a8104a30 0x7ff2a8104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.306+0000 7ff2b0388640 1 -- 172.21.15.17:0/1260277675 >> 172.21.15.17:0/1260277675 conn(0x7ff2a80fa730 msgr2=0x7ff2a80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.307+0000 7ff2b0388640 1 -- 172.21.15.17:0/1260277675 shutdown_connections 2024-08-19T01:16:29.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.307+0000 7ff2b0388640 1 -- 172.21.15.17:0/1260277675 wait complete. 2024-08-19T01:16:29.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.307+0000 7ff2b0388640 1 Processor -- start 2024-08-19T01:16:29.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.307+0000 7ff2b0388640 1 -- start start 2024-08-19T01:16:29.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.307+0000 7ff2b0388640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2a80fea30 0x7ff2a81099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.307+0000 7ff2b0388640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a8104a30 0x7ff2a8109f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.307+0000 7ff2b0388640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a810a440 con 0x7ff2a80fea30 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.307+0000 7ff2b0388640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a810a5b0 con 0x7ff2a8104a30 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2ae124640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2a80fea30 0x7ff2a81099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2ae124640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2a80fea30 0x7ff2a81099c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40706/0 (socket says 172.21.15.17:40706) 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2ae124640 1 -- 172.21.15.17:0/729076164 learned_addr learned my addr 172.21.15.17:0/729076164 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2ad923640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a8104a30 0x7ff2a8109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2ae124640 1 -- 172.21.15.17:0/729076164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a8104a30 msgr2=0x7ff2a8109f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2ae124640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a8104a30 0x7ff2a8109f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2ae124640 1 -- 172.21.15.17:0/729076164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c009560 con 0x7ff2a80fea30 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2ad923640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a8104a30 0x7ff2a8109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2ae124640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2a80fea30 0x7ff2a81099c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff29800ea30 tx=0x7ff29800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2a77fe640 1 -- 172.21.15.17:0/729076164 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff29800cdb0 con 0x7ff2a80fea30 2024-08-19T01:16:29.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2a77fe640 1 -- 172.21.15.17:0/729076164 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff298011930 con 0x7ff2a80fea30 2024-08-19T01:16:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.308+0000 7ff2b0388640 1 -- 172.21.15.17:0/729076164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a81a1c90 con 0x7ff2a80fea30 2024-08-19T01:16:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.309+0000 7ff2a77fe640 1 -- 172.21.15.17:0/729076164 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff29801aa30 con 0x7ff2a80fea30 2024-08-19T01:16:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.309+0000 7ff2b0388640 1 -- 172.21.15.17:0/729076164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a81a1ff0 con 0x7ff2a80fea30 2024-08-19T01:16:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.310+0000 7ff2b0388640 1 -- 172.21.15.17:0/729076164 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a8100170 con 0x7ff2a80fea30 2024-08-19T01:16:29.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.310+0000 7ff2a77fe640 1 -- 172.21.15.17:0/729076164 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff29801aca0 con 0x7ff2a80fea30 2024-08-19T01:16:29.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.311+0000 7ff2a77fe640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff29006e180 0x7ff290070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.311+0000 7ff2a77fe640 1 -- 172.21.15.17:0/729076164 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff29808e8b0 con 0x7ff2a80fea30 2024-08-19T01:16:29.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.311+0000 7ff2ad923640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff29006e180 0x7ff290070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.311+0000 7ff2ad923640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff29006e180 0x7ff290070640 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff29c000c00 tx=0x7ff29c0041a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:29.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.315+0000 7ff2a77fe640 1 -- 172.21.15.17:0/729076164 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff298057b90 con 0x7ff2a80fea30 2024-08-19T01:16:29.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.498+0000 7ff2b0388640 1 -- 172.21.15.17:0/729076164 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2a810a770 con 0x7ff29006e180 2024-08-19T01:16:29.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.508+0000 7ff2a77fe640 1 -- 172.21.15.17:0/729076164 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ff2a810a770 con 0x7ff29006e180 2024-08-19T01:16:29.510 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:16:29.510 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (17m) 11m ago 28m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:16:29.510 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (28m) 11m ago 28m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:16:29.510 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (27m) 11m ago 27m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:16:29.510 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (15m) 11m ago 28m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:16:29.510 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (15m) 11m ago 27m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:16:29.510 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (17m) 11m ago 28m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:16:29.510 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (11m) 11m ago 22m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:16:29.510 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (12m) 11m ago 23m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (22m) 11m ago 22m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (11m) 11m ago 23m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (19m) 11m ago 29m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (18m) 11m ago 27m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (16m) 11m ago 29m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (16m) 11m ago 27m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (18m) 11m ago 28m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (18m) 11m ago 27m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (15m) 11m ago 26m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (14m) 11m ago 26m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (14m) 11m ago 25m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (13m) 11m ago 25m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:16:29.511 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (12m) 11m ago 24m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:16:29.512 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (12m) 11m ago 24m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:16:29.512 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (18m) 11m ago 28m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:16:29.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.510+0000 7ff2b0388640 1 -- 172.21.15.17:0/729076164 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff29006e180 msgr2=0x7ff290070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.510+0000 7ff2b0388640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff29006e180 0x7ff290070640 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff29c000c00 tx=0x7ff29c0041a0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.510+0000 7ff2b0388640 1 -- 172.21.15.17:0/729076164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2a80fea30 msgr2=0x7ff2a81099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.510+0000 7ff2b0388640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2a80fea30 0x7ff2a81099c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff29800ea30 tx=0x7ff29800eef0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.510+0000 7ff2b0388640 1 -- 172.21.15.17:0/729076164 shutdown_connections 2024-08-19T01:16:29.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.510+0000 7ff2b0388640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff29006e180 0x7ff290070640 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.510+0000 7ff2b0388640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2a8104a30 0x7ff2a8109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.510+0000 7ff2b0388640 1 --2- 172.21.15.17:0/729076164 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2a80fea30 0x7ff2a81099c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.510+0000 7ff2b0388640 1 -- 172.21.15.17:0/729076164 >> 172.21.15.17:0/729076164 conn(0x7ff2a80fa730 msgr2=0x7ff2a80fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:29.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.510+0000 7ff2b0388640 1 -- 172.21.15.17:0/729076164 shutdown_connections 2024-08-19T01:16:29.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.510+0000 7ff2b0388640 1 -- 172.21.15.17:0/729076164 wait complete. 2024-08-19T01:16:29.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.593+0000 7f1b58135640 1 -- 172.21.15.17:0/3340558077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b501049f0 msgr2=0x7f1b50104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.593+0000 7f1b58135640 1 --2- 172.21.15.17:0/3340558077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b501049f0 0x7f1b50104dd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009880 tx=0x7f1b4c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.593+0000 7f1b58135640 1 -- 172.21.15.17:0/3340558077 shutdown_connections 2024-08-19T01:16:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.593+0000 7f1b58135640 1 --2- 172.21.15.17:0/3340558077 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b500fe9f0 0x7f1b500fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.593+0000 7f1b58135640 1 --2- 172.21.15.17:0/3340558077 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b501049f0 0x7f1b50104dd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.593+0000 7f1b58135640 1 -- 172.21.15.17:0/3340558077 >> 172.21.15.17:0/3340558077 conn(0x7f1b500758a0 msgr2=0x7f1b500fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.593+0000 7f1b58135640 1 -- 172.21.15.17:0/3340558077 shutdown_connections 2024-08-19T01:16:29.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.594+0000 7f1b58135640 1 -- 172.21.15.17:0/3340558077 wait complete. 2024-08-19T01:16:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.594+0000 7f1b58135640 1 Processor -- start 2024-08-19T01:16:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.594+0000 7f1b58135640 1 -- start start 2024-08-19T01:16:29.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.594+0000 7f1b58135640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b500fe9f0 0x7f1b50105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.594+0000 7f1b58135640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b501049f0 0x7f1b50105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.594+0000 7f1b58135640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b501063a0 con 0x7f1b500fe9f0 2024-08-19T01:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.594+0000 7f1b58135640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50106510 con 0x7f1b501049f0 2024-08-19T01:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.595+0000 7f1b55ed1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b500fe9f0 0x7f1b50105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.595+0000 7f1b55ed1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b500fe9f0 0x7f1b50105920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40730/0 (socket says 172.21.15.17:40730) 2024-08-19T01:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.595+0000 7f1b55ed1640 1 -- 172.21.15.17:0/129674357 learned_addr learned my addr 172.21.15.17:0/129674357 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.595+0000 7f1b556d0640 1 --2- 172.21.15.17:0/129674357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b501049f0 0x7f1b50105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.595+0000 7f1b55ed1640 1 -- 172.21.15.17:0/129674357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b501049f0 msgr2=0x7f1b50105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.595+0000 7f1b55ed1640 1 --2- 172.21.15.17:0/129674357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b501049f0 0x7f1b50105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.595+0000 7f1b55ed1640 1 -- 172.21.15.17:0/129674357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c009560 con 0x7f1b500fe9f0 2024-08-19T01:16:29.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.595+0000 7f1b55ed1640 1 --2- 172.21.15.17:0/129674357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b500fe9f0 0x7f1b50105920 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c02a9c0 tx=0x7f1b4c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.595+0000 7f1b46ffd640 1 -- 172.21.15.17:0/129674357 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4c004aa0 con 0x7f1b500fe9f0 2024-08-19T01:16:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.596+0000 7f1b58135640 1 -- 172.21.15.17:0/129674357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b50106790 con 0x7f1b500fe9f0 2024-08-19T01:16:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.596+0000 7f1b46ffd640 1 -- 172.21.15.17:0/129674357 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b4c004c00 con 0x7f1b500fe9f0 2024-08-19T01:16:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.596+0000 7f1b46ffd640 1 -- 172.21.15.17:0/129674357 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4c0038f0 con 0x7f1b500fe9f0 2024-08-19T01:16:29.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.596+0000 7f1b58135640 1 -- 172.21.15.17:0/129674357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b501a1ed0 con 0x7f1b500fe9f0 2024-08-19T01:16:29.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.597+0000 7f1b58135640 1 -- 172.21.15.17:0/129674357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b50100130 con 0x7f1b500fe9f0 2024-08-19T01:16:29.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.598+0000 7f1b46ffd640 1 -- 172.21.15.17:0/129674357 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1b4c003b80 con 0x7f1b500fe9f0 2024-08-19T01:16:29.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.598+0000 7f1b46ffd640 1 --2- 172.21.15.17:0/129674357 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b3c06e170 0x7f1b3c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.598+0000 7f1b46ffd640 1 -- 172.21.15.17:0/129674357 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1b4c0aefc0 con 0x7f1b500fe9f0 2024-08-19T01:16:29.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.598+0000 7f1b556d0640 1 --2- 172.21.15.17:0/129674357 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b3c06e170 0x7f1b3c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.599+0000 7f1b556d0640 1 --2- 172.21.15.17:0/129674357 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b3c06e170 0x7f1b3c070630 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1b501070a0 tx=0x7f1b4000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:29.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.606+0000 7f1b46ffd640 1 -- 172.21.15.17:0/129674357 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1b4c0783d0 con 0x7f1b500fe9f0 2024-08-19T01:16:29.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.854+0000 7f1b58135640 1 -- 172.21.15.17:0/129674357 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1b501066d0 con 0x7f1b500fe9f0 2024-08-19T01:16:29.858 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:29 smithi017 ceph-mon[99370]: from='client.35016 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:16:29.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.854+0000 7f1b46ffd640 1 -- 172.21.15.17:0/129674357 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f1b4c07ba90 con 0x7f1b500fe9f0 2024-08-19T01:16:29.858 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:16:29.858 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:16:29.859 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:16:29.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:16:29.859 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:16:29.859 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:16:29.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:16:29.859 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:16:29.859 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:16:29.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:16:29.859 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:16:29.859 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:16:29.860 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:16:29.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:16:29.860 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:16:29.860 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:16:29.860 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:16:29.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:16:29.860 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:16:29.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.857+0000 7f1b58135640 1 -- 172.21.15.17:0/129674357 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b3c06e170 msgr2=0x7f1b3c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.857+0000 7f1b58135640 1 --2- 172.21.15.17:0/129674357 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b3c06e170 0x7f1b3c070630 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1b501070a0 tx=0x7f1b4000b410 comp rx=0 tx=0).stop 2024-08-19T01:16:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.857+0000 7f1b58135640 1 -- 172.21.15.17:0/129674357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b500fe9f0 msgr2=0x7f1b50105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.857+0000 7f1b58135640 1 --2- 172.21.15.17:0/129674357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b500fe9f0 0x7f1b50105920 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c02a9c0 tx=0x7f1b4c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.857+0000 7f1b58135640 1 -- 172.21.15.17:0/129674357 shutdown_connections 2024-08-19T01:16:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.857+0000 7f1b58135640 1 --2- 172.21.15.17:0/129674357 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1b3c06e170 0x7f1b3c070630 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.857+0000 7f1b58135640 1 --2- 172.21.15.17:0/129674357 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1b501049f0 0x7f1b50105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.857+0000 7f1b58135640 1 --2- 172.21.15.17:0/129674357 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b500fe9f0 0x7f1b50105920 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.857+0000 7f1b58135640 1 -- 172.21.15.17:0/129674357 >> 172.21.15.17:0/129674357 conn(0x7f1b500758a0 msgr2=0x7f1b50067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.857+0000 7f1b58135640 1 -- 172.21.15.17:0/129674357 shutdown_connections 2024-08-19T01:16:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.857+0000 7f1b58135640 1 -- 172.21.15.17:0/129674357 wait complete. 2024-08-19T01:16:29.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.938+0000 7f4ff81fa640 1 -- 172.21.15.17:0/1911934327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff0100d50 msgr2=0x7f4ff0101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.938+0000 7f4ff81fa640 1 --2- 172.21.15.17:0/1911934327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff0100d50 0x7f4ff0101130 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009c20 tx=0x7f4fec02a970 comp rx=0 tx=0).stop 2024-08-19T01:16:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.938+0000 7f4ff81fa640 1 -- 172.21.15.17:0/1911934327 shutdown_connections 2024-08-19T01:16:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.938+0000 7f4ff81fa640 1 --2- 172.21.15.17:0/1911934327 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ff0101670 0x7f4ff0109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.938+0000 7f4ff81fa640 1 --2- 172.21.15.17:0/1911934327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff0100d50 0x7f4ff0101130 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.938+0000 7f4ff81fa640 1 -- 172.21.15.17:0/1911934327 >> 172.21.15.17:0/1911934327 conn(0x7f4ff00fa730 msgr2=0x7f4ff00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.938+0000 7f4ff81fa640 1 -- 172.21.15.17:0/1911934327 shutdown_connections 2024-08-19T01:16:29.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.938+0000 7f4ff81fa640 1 -- 172.21.15.17:0/1911934327 wait complete. 2024-08-19T01:16:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.939+0000 7f4ff81fa640 1 Processor -- start 2024-08-19T01:16:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.939+0000 7f4ff81fa640 1 -- start start 2024-08-19T01:16:29.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.939+0000 7f4ff81fa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff0100d50 0x7f4ff019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.939+0000 7f4ff81fa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ff0101670 0x7f4ff019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.939+0000 7f4ff81fa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff019c320 con 0x7f4ff0100d50 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.939+0000 7f4ff81fa640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff01958b0 con 0x7f4ff0101670 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.939+0000 7f4ff5f96640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff0100d50 0x7f4ff019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.939+0000 7f4ff5f96640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff0100d50 0x7f4ff019b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40740/0 (socket says 172.21.15.17:40740) 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.939+0000 7f4ff5f96640 1 -- 172.21.15.17:0/4084005064 learned_addr learned my addr 172.21.15.17:0/4084005064 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.940+0000 7f4ff5795640 1 --2- 172.21.15.17:0/4084005064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ff0101670 0x7f4ff019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.940+0000 7f4ff5f96640 1 -- 172.21.15.17:0/4084005064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ff0101670 msgr2=0x7f4ff019bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.940+0000 7f4ff5f96640 1 --2- 172.21.15.17:0/4084005064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ff0101670 0x7f4ff019bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.940+0000 7f4ff5f96640 1 -- 172.21.15.17:0/4084005064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec009900 con 0x7f4ff0100d50 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.940+0000 7f4ff5f96640 1 --2- 172.21.15.17:0/4084005064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff0100d50 0x7f4ff019b7c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4fec032000 tx=0x7f4fec0308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:29.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.940+0000 7f4fe6ffd640 1 -- 172.21.15.17:0/4084005064 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fec02f590 con 0x7f4ff0100d50 2024-08-19T01:16:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.940+0000 7f4fe6ffd640 1 -- 172.21.15.17:0/4084005064 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4fec030ca0 con 0x7f4ff0100d50 2024-08-19T01:16:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.940+0000 7f4ff81fa640 1 -- 172.21.15.17:0/4084005064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff0195b90 con 0x7f4ff0100d50 2024-08-19T01:16:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.940+0000 7f4fe6ffd640 1 -- 172.21.15.17:0/4084005064 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fec039680 con 0x7f4ff0100d50 2024-08-19T01:16:29.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.940+0000 7f4ff81fa640 1 -- 172.21.15.17:0/4084005064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff01960e0 con 0x7f4ff0100d50 2024-08-19T01:16:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.941+0000 7f4ff81fa640 1 -- 172.21.15.17:0/4084005064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff0068cd0 con 0x7f4ff0100d50 2024-08-19T01:16:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.942+0000 7f4fe6ffd640 1 -- 172.21.15.17:0/4084005064 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4fec00a040 con 0x7f4ff0100d50 2024-08-19T01:16:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.942+0000 7f4fe6ffd640 1 --2- 172.21.15.17:0/4084005064 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fdc06e180 0x7f4fdc070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.942+0000 7f4fe6ffd640 1 -- 172.21.15.17:0/4084005064 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4fec02c040 con 0x7f4ff0100d50 2024-08-19T01:16:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.942+0000 7f4ff5795640 1 --2- 172.21.15.17:0/4084005064 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fdc06e180 0x7f4fdc070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:29.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.943+0000 7f4ff5795640 1 --2- 172.21.15.17:0/4084005064 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fdc06e180 0x7f4fdc070640 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0005fd0 tx=0x7f4fe0005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:29.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:29.947+0000 7f4fe6ffd640 1 -- 172.21.15.17:0/4084005064 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4fec0787a0 con 0x7f4ff0100d50 2024-08-19T01:16:30.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.155+0000 7f4ff81fa640 1 -- 172.21.15.17:0/4084005064 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4ff01043e0 con 0x7f4ff0100d50 2024-08-19T01:16:30.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.156+0000 7f4fe6ffd640 1 -- 172.21.15.17:0/4084005064 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f4fec07be60 con 0x7f4ff0100d50 2024-08-19T01:16:30.158 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:16:30.158 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:16:30.158 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:16:30.158 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:16:30.158 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:16:30.159 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:16:30.160 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:16:30.161 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:16:30.161 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:16:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:16:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:16:30.161 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:16:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:16:30.161 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:16:30.161 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:16:30.161 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:16:30.161 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:16:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:16:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.158+0000 7f4ff81fa640 1 -- 172.21.15.17:0/4084005064 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fdc06e180 msgr2=0x7f4fdc070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.158+0000 7f4ff81fa640 1 --2- 172.21.15.17:0/4084005064 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fdc06e180 0x7f4fdc070640 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0005fd0 tx=0x7f4fe0005850 comp rx=0 tx=0).stop 2024-08-19T01:16:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.158+0000 7f4ff81fa640 1 -- 172.21.15.17:0/4084005064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff0100d50 msgr2=0x7f4ff019b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.158+0000 7f4ff81fa640 1 --2- 172.21.15.17:0/4084005064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff0100d50 0x7f4ff019b7c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4fec032000 tx=0x7f4fec0308a0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.158+0000 7f4ff81fa640 1 -- 172.21.15.17:0/4084005064 shutdown_connections 2024-08-19T01:16:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.158+0000 7f4ff81fa640 1 --2- 172.21.15.17:0/4084005064 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fdc06e180 0x7f4fdc070640 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.158+0000 7f4ff81fa640 1 --2- 172.21.15.17:0/4084005064 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ff0101670 0x7f4ff019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.158+0000 7f4ff81fa640 1 --2- 172.21.15.17:0/4084005064 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ff0100d50 0x7f4ff019b7c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.158+0000 7f4ff81fa640 1 -- 172.21.15.17:0/4084005064 >> 172.21.15.17:0/4084005064 conn(0x7f4ff00fa730 msgr2=0x7f4ff0101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:30.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.158+0000 7f4ff81fa640 1 -- 172.21.15.17:0/4084005064 shutdown_connections 2024-08-19T01:16:30.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.158+0000 7f4ff81fa640 1 -- 172.21.15.17:0/4084005064 wait complete. 2024-08-19T01:16:30.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:29 smithi086 ceph-mon[71303]: from='client.35016 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:16:30.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.242+0000 7f7e684c8640 1 -- 172.21.15.17:0/2401805657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e60104a30 msgr2=0x7f7e60104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:30.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.242+0000 7f7e684c8640 1 --2- 172.21.15.17:0/2401805657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e60104a30 0x7f7e60104e10 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009880 tx=0x7f7e5802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.242+0000 7f7e684c8640 1 -- 172.21.15.17:0/2401805657 shutdown_connections 2024-08-19T01:16:30.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.242+0000 7f7e684c8640 1 --2- 172.21.15.17:0/2401805657 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e600fea30 0x7f7e600fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.242+0000 7f7e684c8640 1 --2- 172.21.15.17:0/2401805657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e60104a30 0x7f7e60104e10 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.242+0000 7f7e684c8640 1 -- 172.21.15.17:0/2401805657 >> 172.21.15.17:0/2401805657 conn(0x7f7e600fa730 msgr2=0x7f7e600fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:30.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.242+0000 7f7e684c8640 1 -- 172.21.15.17:0/2401805657 shutdown_connections 2024-08-19T01:16:30.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.242+0000 7f7e684c8640 1 -- 172.21.15.17:0/2401805657 wait complete. 2024-08-19T01:16:30.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.243+0000 7f7e684c8640 1 Processor -- start 2024-08-19T01:16:30.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.243+0000 7f7e684c8640 1 -- start start 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.243+0000 7f7e684c8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e600fea30 0x7f7e6019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.243+0000 7f7e684c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e60104a30 0x7f7e6019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.243+0000 7f7e684c8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6019c3b0 con 0x7f7e60104a30 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.243+0000 7f7e684c8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60195940 con 0x7f7e600fea30 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.243+0000 7f7e65a63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e60104a30 0x7f7e6019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.243+0000 7f7e65a63640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e60104a30 0x7f7e6019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40748/0 (socket says 172.21.15.17:40748) 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.243+0000 7f7e65a63640 1 -- 172.21.15.17:0/1661522122 learned_addr learned my addr 172.21.15.17:0/1661522122 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.243+0000 7f7e66264640 1 --2- 172.21.15.17:0/1661522122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e600fea30 0x7f7e6019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.244+0000 7f7e65a63640 1 -- 172.21.15.17:0/1661522122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e600fea30 msgr2=0x7f7e6019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.244+0000 7f7e65a63640 1 --2- 172.21.15.17:0/1661522122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e600fea30 0x7f7e6019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.244+0000 7f7e65a63640 1 -- 172.21.15.17:0/1661522122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e58009560 con 0x7f7e60104a30 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.244+0000 7f7e65a63640 1 --2- 172.21.15.17:0/1661522122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e60104a30 0x7f7e6019bd90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400d6f0 tx=0x7f7e5400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.244+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1661522122 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e54009a30 con 0x7f7e60104a30 2024-08-19T01:16:30.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.244+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1661522122 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e540054e0 con 0x7f7e60104a30 2024-08-19T01:16:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.244+0000 7f7e684c8640 1 -- 172.21.15.17:0/1661522122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e60195c20 con 0x7f7e60104a30 2024-08-19T01:16:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.244+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1661522122 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e54010460 con 0x7f7e60104a30 2024-08-19T01:16:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.244+0000 7f7e684c8640 1 -- 172.21.15.17:0/1661522122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e60196170 con 0x7f7e60104a30 2024-08-19T01:16:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.245+0000 7f7e684c8640 1 -- 172.21.15.17:0/1661522122 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e60100170 con 0x7f7e60104a30 2024-08-19T01:16:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.246+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1661522122 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7e54009b90 con 0x7f7e60104a30 2024-08-19T01:16:30.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.246+0000 7f7e5f7fe640 1 --2- 172.21.15.17:0/1661522122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e4806e180 0x7f7e48070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:30.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.246+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1661522122 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7e5408dc90 con 0x7f7e60104a30 2024-08-19T01:16:30.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.246+0000 7f7e66264640 1 --2- 172.21.15.17:0/1661522122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e4806e180 0x7f7e48070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:30.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.247+0000 7f7e66264640 1 --2- 172.21.15.17:0/1661522122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e4806e180 0x7f7e48070640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009230 tx=0x7f7e58005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:30.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.251+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1661522122 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7e54057020 con 0x7f7e60104a30 2024-08-19T01:16:30.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.441+0000 7f7e684c8640 1 -- 172.21.15.17:0/1661522122 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e6010bcc0 con 0x7f7e4806e180 2024-08-19T01:16:30.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.443+0000 7f7e5f7fe640 1 -- 172.21.15.17:0/1661522122 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7e6010bcc0 con 0x7f7e4806e180 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:16:30.445 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:16:30.446 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:16:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.445+0000 7f7e684c8640 1 -- 172.21.15.17:0/1661522122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e4806e180 msgr2=0x7f7e48070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.445+0000 7f7e684c8640 1 --2- 172.21.15.17:0/1661522122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e4806e180 0x7f7e48070640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009230 tx=0x7f7e58005a20 comp rx=0 tx=0).stop 2024-08-19T01:16:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.445+0000 7f7e684c8640 1 -- 172.21.15.17:0/1661522122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e60104a30 msgr2=0x7f7e6019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.445+0000 7f7e684c8640 1 --2- 172.21.15.17:0/1661522122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e60104a30 0x7f7e6019bd90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400d6f0 tx=0x7f7e5400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.445+0000 7f7e684c8640 1 -- 172.21.15.17:0/1661522122 shutdown_connections 2024-08-19T01:16:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.445+0000 7f7e684c8640 1 --2- 172.21.15.17:0/1661522122 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7e4806e180 0x7f7e48070640 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.445+0000 7f7e684c8640 1 --2- 172.21.15.17:0/1661522122 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e60104a30 0x7f7e6019bd90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.445+0000 7f7e684c8640 1 --2- 172.21.15.17:0/1661522122 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7e600fea30 0x7f7e6019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.445+0000 7f7e684c8640 1 -- 172.21.15.17:0/1661522122 >> 172.21.15.17:0/1661522122 conn(0x7f7e600fa730 msgr2=0x7f7e60068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.445+0000 7f7e684c8640 1 -- 172.21.15.17:0/1661522122 shutdown_connections 2024-08-19T01:16:30.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.445+0000 7f7e684c8640 1 -- 172.21.15.17:0/1661522122 wait complete. 2024-08-19T01:16:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.526+0000 7fc660797640 1 -- 172.21.15.17:0/2135934799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6580fedc0 msgr2=0x7fc658102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.526+0000 7fc660797640 1 --2- 172.21.15.17:0/2135934799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6580fedc0 0x7fc658102e10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc648009880 tx=0x7fc64802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.526+0000 7fc660797640 1 -- 172.21.15.17:0/2135934799 shutdown_connections 2024-08-19T01:16:30.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.526+0000 7fc660797640 1 --2- 172.21.15.17:0/2135934799 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6580fedc0 0x7fc658102e10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.526+0000 7fc660797640 1 --2- 172.21.15.17:0/2135934799 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6580fe410 0x7fc6580fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.526+0000 7fc660797640 1 -- 172.21.15.17:0/2135934799 >> 172.21.15.17:0/2135934799 conn(0x7fc6580f9e90 msgr2=0x7fc6580fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:30.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.526+0000 7fc660797640 1 -- 172.21.15.17:0/2135934799 shutdown_connections 2024-08-19T01:16:30.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.526+0000 7fc660797640 1 -- 172.21.15.17:0/2135934799 wait complete. 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.527+0000 7fc660797640 1 Processor -- start 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.527+0000 7fc660797640 1 -- start start 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.527+0000 7fc660797640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6580fe410 0x7fc65819b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.527+0000 7fc660797640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6580fedc0 0x7fc65819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.527+0000 7fc660797640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65819c3c0 con 0x7fc6580fe410 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.527+0000 7fc660797640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc658195950 con 0x7fc6580fedc0 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.527+0000 7fc65e533640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6580fe410 0x7fc65819b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.527+0000 7fc65e533640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6580fe410 0x7fc65819b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40766/0 (socket says 172.21.15.17:40766) 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.527+0000 7fc65e533640 1 -- 172.21.15.17:0/1448091156 learned_addr learned my addr 172.21.15.17:0/1448091156 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.528+0000 7fc65dd32640 1 --2- 172.21.15.17:0/1448091156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6580fedc0 0x7fc65819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.528+0000 7fc65e533640 1 -- 172.21.15.17:0/1448091156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6580fedc0 msgr2=0x7fc65819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.528+0000 7fc65e533640 1 --2- 172.21.15.17:0/1448091156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6580fedc0 0x7fc65819bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.528+0000 7fc65e533640 1 -- 172.21.15.17:0/1448091156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc648009560 con 0x7fc6580fe410 2024-08-19T01:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.528+0000 7fc65e533640 1 --2- 172.21.15.17:0/1448091156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6580fe410 0x7fc65819b860 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc65400db40 tx=0x7fc65400a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.528+0000 7fc64f7fe640 1 -- 172.21.15.17:0/1448091156 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc65400ae60 con 0x7fc6580fe410 2024-08-19T01:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.528+0000 7fc64f7fe640 1 -- 172.21.15.17:0/1448091156 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6540054e0 con 0x7fc6580fe410 2024-08-19T01:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.528+0000 7fc660797640 1 -- 172.21.15.17:0/1448091156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc658195c30 con 0x7fc6580fe410 2024-08-19T01:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.528+0000 7fc64f7fe640 1 -- 172.21.15.17:0/1448091156 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc65400e710 con 0x7fc6580fe410 2024-08-19T01:16:30.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.528+0000 7fc660797640 1 -- 172.21.15.17:0/1448091156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc658196150 con 0x7fc6580fe410 2024-08-19T01:16:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.529+0000 7fc660797640 1 -- 172.21.15.17:0/1448091156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6580ff8f0 con 0x7fc6580fe410 2024-08-19T01:16:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.530+0000 7fc64f7fe640 1 -- 172.21.15.17:0/1448091156 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc6540046c0 con 0x7fc6580fe410 2024-08-19T01:16:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.530+0000 7fc64f7fe640 1 --2- 172.21.15.17:0/1448091156 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc64406e170 0x7fc644070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:16:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.530+0000 7fc65dd32640 1 --2- 172.21.15.17:0/1448091156 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc64406e170 0x7fc644070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:16:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.530+0000 7fc64f7fe640 1 -- 172.21.15.17:0/1448091156 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc65408e310 con 0x7fc6580fe410 2024-08-19T01:16:30.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.531+0000 7fc65dd32640 1 --2- 172.21.15.17:0/1448091156 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc64406e170 0x7fc644070630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc648000c00 tx=0x7fc648005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:16:30.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.535+0000 7fc64f7fe640 1 -- 172.21.15.17:0/1448091156 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc6540575f0 con 0x7fc6580fe410 2024-08-19T01:16:30.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.779+0000 7fc660797640 1 -- 172.21.15.17:0/1448091156 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc6580fe7f0 con 0x7fc6580fe410 2024-08-19T01:16:30.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.779+0000 7fc64f7fe640 1 -- 172.21.15.17:0/1448091156 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7fc65405acb0 con 0x7fc6580fe410 2024-08-19T01:16:30.781 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:16:30.781 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:16:30.781 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:16:30.781 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:16:30.781 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:16:30.781 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:16:30.782 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:16:30.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.781+0000 7fc660797640 1 -- 172.21.15.17:0/1448091156 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc64406e170 msgr2=0x7fc644070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:30.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.781+0000 7fc660797640 1 --2- 172.21.15.17:0/1448091156 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc64406e170 0x7fc644070630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc648000c00 tx=0x7fc648005a20 comp rx=0 tx=0).stop 2024-08-19T01:16:30.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.781+0000 7fc660797640 1 -- 172.21.15.17:0/1448091156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6580fe410 msgr2=0x7fc65819b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:16:30.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.781+0000 7fc660797640 1 --2- 172.21.15.17:0/1448091156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6580fe410 0x7fc65819b860 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc65400db40 tx=0x7fc65400a250 comp rx=0 tx=0).stop 2024-08-19T01:16:30.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.781+0000 7fc660797640 1 -- 172.21.15.17:0/1448091156 shutdown_connections 2024-08-19T01:16:30.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.781+0000 7fc660797640 1 --2- 172.21.15.17:0/1448091156 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc64406e170 0x7fc644070630 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.781+0000 7fc660797640 1 --2- 172.21.15.17:0/1448091156 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6580fedc0 0x7fc65819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.781+0000 7fc660797640 1 --2- 172.21.15.17:0/1448091156 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6580fe410 0x7fc65819b860 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:16:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.781+0000 7fc660797640 1 -- 172.21.15.17:0/1448091156 >> 172.21.15.17:0/1448091156 conn(0x7fc6580f9e90 msgr2=0x7fc6580fb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:16:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.781+0000 7fc660797640 1 -- 172.21.15.17:0/1448091156 shutdown_connections 2024-08-19T01:16:30.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:16:30.781+0000 7fc660797640 1 -- 172.21.15.17:0/1448091156 wait complete. 2024-08-19T01:16:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:30 smithi017 ceph-mon[99370]: pgmap v531: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:30 smithi017 ceph-mon[99370]: from='client.35020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:16:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:30 smithi017 ceph-mon[99370]: from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:16:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:30 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/129674357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:16:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:30 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4084005064' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:16:31.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:30 smithi086 ceph-mon[71303]: pgmap v531: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:31.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:30 smithi086 ceph-mon[71303]: from='client.35020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:16:31.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:30 smithi086 ceph-mon[71303]: from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:16:31.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:30 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/129674357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:16:31.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:30 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4084005064' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:16:32.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:31 smithi017 ceph-mon[99370]: from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:16:32.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:31 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1448091156' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:16:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:31 smithi086 ceph-mon[71303]: from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:16:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:31 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1448091156' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:16:33.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:32 smithi017 ceph-mon[99370]: pgmap v532: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:33.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:32 smithi086 ceph-mon[71303]: pgmap v532: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:16:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:16:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:34 smithi017 ceph-mon[99370]: pgmap v533: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:35.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:34 smithi086 ceph-mon[71303]: pgmap v533: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:36 smithi017 ceph-mon[99370]: pgmap v534: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:37.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:36 smithi086 ceph-mon[71303]: pgmap v534: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:38 smithi017 ceph-mon[99370]: pgmap v535: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:38 smithi086 ceph-mon[71303]: pgmap v535: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:41.149 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:40 smithi086 ceph-mon[71303]: pgmap v536: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:40 smithi017 ceph-mon[99370]: pgmap v536: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:43.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:42 smithi017 ceph-mon[99370]: pgmap v537: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:42 smithi086 ceph-mon[71303]: pgmap v537: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:44 smithi017 ceph-mon[99370]: pgmap v538: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:44 smithi086 ceph-mon[71303]: pgmap v538: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:46 smithi017 ceph-mon[99370]: pgmap v539: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:46 smithi086 ceph-mon[71303]: pgmap v539: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:48 smithi017 ceph-mon[99370]: pgmap v540: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:16:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:48 smithi086 ceph-mon[71303]: pgmap v540: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:16:51.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:50 smithi017 ceph-mon[99370]: pgmap v541: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:51.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:50 smithi086 ceph-mon[71303]: pgmap v541: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:53.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:52 smithi017 ceph-mon[99370]: pgmap v542: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:53.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:52 smithi086 ceph-mon[71303]: pgmap v542: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:55.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:54 smithi017 ceph-mon[99370]: pgmap v543: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:54 smithi086 ceph-mon[71303]: pgmap v543: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:57.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:56 smithi017 ceph-mon[99370]: pgmap v544: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:57.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:56 smithi086 ceph-mon[71303]: pgmap v544: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:59.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:16:58 smithi017 ceph-mon[99370]: pgmap v545: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:16:59.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:16:58 smithi086 ceph-mon[71303]: pgmap v545: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:00.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.876+0000 7f7d0e52a640 1 -- 172.21.15.17:0/2760804242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d080ffb50 msgr2=0x7f7d080fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.876+0000 7f7d0e52a640 1 --2- 172.21.15.17:0/2760804242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d080ffb50 0x7f7d080fffb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009880 tx=0x7f7cfc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:17:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.876+0000 7f7d0e52a640 1 -- 172.21.15.17:0/2760804242 shutdown_connections 2024-08-19T01:17:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.876+0000 7f7d0e52a640 1 --2- 172.21.15.17:0/2760804242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d080ffb50 0x7f7d080fffb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.876+0000 7f7d0e52a640 1 --2- 172.21.15.17:0/2760804242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08105c00 0x7f7d08105fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.876+0000 7f7d0e52a640 1 -- 172.21.15.17:0/2760804242 >> 172.21.15.17:0/2760804242 conn(0x7f7d080fb830 msgr2=0x7f7d080fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.876+0000 7f7d0e52a640 1 -- 172.21.15.17:0/2760804242 shutdown_connections 2024-08-19T01:17:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.876+0000 7f7d0e52a640 1 -- 172.21.15.17:0/2760804242 wait complete. 2024-08-19T01:17:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.877+0000 7f7d0e52a640 1 Processor -- start 2024-08-19T01:17:00.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.877+0000 7f7d0e52a640 1 -- start start 2024-08-19T01:17:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.877+0000 7f7d0e52a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d080ffb50 0x7f7d0819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:00.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.877+0000 7f7d0e52a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08105c00 0x7f7d0819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.877+0000 7f7d0e52a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0819c390 con 0x7f7d080ffb50 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.877+0000 7f7d0e52a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d08195920 con 0x7f7d08105c00 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.877+0000 7f7d07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d080ffb50 0x7f7d0819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.877+0000 7f7d07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d080ffb50 0x7f7d0819b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49752/0 (socket says 172.21.15.17:49752) 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.877+0000 7f7d07fff640 1 -- 172.21.15.17:0/558759255 learned_addr learned my addr 172.21.15.17:0/558759255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.877+0000 7f7d077fe640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08105c00 0x7f7d0819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.878+0000 7f7d07fff640 1 -- 172.21.15.17:0/558759255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08105c00 msgr2=0x7f7d0819bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.878+0000 7f7d07fff640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08105c00 0x7f7d0819bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.878+0000 7f7d07fff640 1 -- 172.21.15.17:0/558759255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc009560 con 0x7f7d080ffb50 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.878+0000 7f7d077fe640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08105c00 0x7f7d0819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.878+0000 7f7d07fff640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d080ffb50 0x7f7d0819b830 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800d8d0 tx=0x7f7cf800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:00.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.878+0000 7f7d057fa640 1 -- 172.21.15.17:0/558759255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cf800bea0 con 0x7f7d080ffb50 2024-08-19T01:17:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.878+0000 7f7d0e52a640 1 -- 172.21.15.17:0/558759255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d08195c00 con 0x7f7d080ffb50 2024-08-19T01:17:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.878+0000 7f7d057fa640 1 -- 172.21.15.17:0/558759255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7cf8009c00 con 0x7f7d080ffb50 2024-08-19T01:17:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.878+0000 7f7d057fa640 1 -- 172.21.15.17:0/558759255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cf800f710 con 0x7f7d080ffb50 2024-08-19T01:17:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.878+0000 7f7d0e52a640 1 -- 172.21.15.17:0/558759255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d08196120 con 0x7f7d080ffb50 2024-08-19T01:17:00.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.879+0000 7f7d0e52a640 1 -- 172.21.15.17:0/558759255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d08101200 con 0x7f7d080ffb50 2024-08-19T01:17:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.880+0000 7f7d057fa640 1 -- 172.21.15.17:0/558759255 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7cf800f990 con 0x7f7d080ffb50 2024-08-19T01:17:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.880+0000 7f7d057fa640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf006e180 0x7f7cf0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.880+0000 7f7d077fe640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf006e180 0x7f7cf0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.880+0000 7f7d057fa640 1 -- 172.21.15.17:0/558759255 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7cf808df20 con 0x7f7d080ffb50 2024-08-19T01:17:00.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.881+0000 7f7d077fe640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf006e180 0x7f7cf0070640 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc000c00 tx=0x7f7cfc005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:00.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:00.885+0000 7f7d057fa640 1 -- 172.21.15.17:0/558759255 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7cf80c2df0 con 0x7f7d080ffb50 2024-08-19T01:17:01.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.085+0000 7f7d0e52a640 1 -- 172.21.15.17:0/558759255 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d0810cda0 con 0x7f7cf006e180 2024-08-19T01:17:01.088 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:00 smithi017 ceph-mon[99370]: pgmap v546: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:01.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.087+0000 7f7d057fa640 1 -- 172.21.15.17:0/558759255 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7d0810cda0 con 0x7f7cf006e180 2024-08-19T01:17:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.089+0000 7f7d0e52a640 1 -- 172.21.15.17:0/558759255 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf006e180 msgr2=0x7f7cf0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.089+0000 7f7d0e52a640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf006e180 0x7f7cf0070640 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc000c00 tx=0x7f7cfc005a20 comp rx=0 tx=0).stop 2024-08-19T01:17:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.089+0000 7f7d0e52a640 1 -- 172.21.15.17:0/558759255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d080ffb50 msgr2=0x7f7d0819b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.089+0000 7f7d0e52a640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d080ffb50 0x7f7d0819b830 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800d8d0 tx=0x7f7cf800dd90 comp rx=0 tx=0).stop 2024-08-19T01:17:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.089+0000 7f7d0e52a640 1 -- 172.21.15.17:0/558759255 shutdown_connections 2024-08-19T01:17:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.089+0000 7f7d0e52a640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf006e180 0x7f7cf0070640 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.089+0000 7f7d0e52a640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08105c00 0x7f7d0819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.089+0000 7f7d0e52a640 1 --2- 172.21.15.17:0/558759255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d080ffb50 0x7f7d0819b830 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.089+0000 7f7d0e52a640 1 -- 172.21.15.17:0/558759255 >> 172.21.15.17:0/558759255 conn(0x7f7d080fb830 msgr2=0x7f7d080fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.089+0000 7f7d0e52a640 1 -- 172.21.15.17:0/558759255 shutdown_connections 2024-08-19T01:17:01.091 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.089+0000 7f7d0e52a640 1 -- 172.21.15.17:0/558759255 wait complete. 2024-08-19T01:17:01.099 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:17:01.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.172+0000 7f06ead0a640 1 -- 172.21.15.17:0/4254320471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e40fea30 msgr2=0x7f06e40fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.172+0000 7f06ead0a640 1 --2- 172.21.15.17:0/4254320471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e40fea30 0x7f06e40fee90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009880 tx=0x7f06d802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.172+0000 7f06ead0a640 1 -- 172.21.15.17:0/4254320471 shutdown_connections 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.172+0000 7f06ead0a640 1 --2- 172.21.15.17:0/4254320471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e40fea30 0x7f06e40fee90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.172+0000 7f06ead0a640 1 --2- 172.21.15.17:0/4254320471 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e4104a30 0x7f06e4104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.172+0000 7f06ead0a640 1 -- 172.21.15.17:0/4254320471 >> 172.21.15.17:0/4254320471 conn(0x7f06e40fa730 msgr2=0x7f06e40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.172+0000 7f06ead0a640 1 -- 172.21.15.17:0/4254320471 shutdown_connections 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.172+0000 7f06ead0a640 1 -- 172.21.15.17:0/4254320471 wait complete. 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.173+0000 7f06ead0a640 1 Processor -- start 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.173+0000 7f06ead0a640 1 -- start start 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.173+0000 7f06ead0a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e40fea30 0x7f06e4196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.173+0000 7f06ead0a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4104a30 0x7f06e4196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.173+0000 7f06ead0a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4197430 con 0x7f06e4104a30 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.173+0000 7f06ead0a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e41975a0 con 0x7f06e40fea30 2024-08-19T01:17:01.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.173+0000 7f06e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4104a30 0x7f06e4196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.173+0000 7f06e3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4104a30 0x7f06e4196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49762/0 (socket says 172.21.15.17:49762) 2024-08-19T01:17:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.173+0000 7f06e3fff640 1 -- 172.21.15.17:0/308414409 learned_addr learned my addr 172.21.15.17:0/308414409 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.174+0000 7f06e8aa6640 1 --2- 172.21.15.17:0/308414409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e40fea30 0x7f06e4196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.174+0000 7f06e3fff640 1 -- 172.21.15.17:0/308414409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e40fea30 msgr2=0x7f06e4196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.174+0000 7f06e3fff640 1 --2- 172.21.15.17:0/308414409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e40fea30 0x7f06e4196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.174+0000 7f06e3fff640 1 -- 172.21.15.17:0/308414409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d8009560 con 0x7f06e4104a30 2024-08-19T01:17:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.174+0000 7f06e3fff640 1 --2- 172.21.15.17:0/308414409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4104a30 0x7f06e4196e60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f06d802a9c0 tx=0x7f06d80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.174+0000 7f06e1ffb640 1 -- 172.21.15.17:0/308414409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06d8004aa0 con 0x7f06e4104a30 2024-08-19T01:17:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.174+0000 7f06e1ffb640 1 -- 172.21.15.17:0/308414409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06d8004c00 con 0x7f06e4104a30 2024-08-19T01:17:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.174+0000 7f06ead0a640 1 -- 172.21.15.17:0/308414409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e419f990 con 0x7f06e4104a30 2024-08-19T01:17:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.174+0000 7f06e1ffb640 1 -- 172.21.15.17:0/308414409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06d8003980 con 0x7f06e4104a30 2024-08-19T01:17:01.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.174+0000 7f06ead0a640 1 -- 172.21.15.17:0/308414409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e419fcf0 con 0x7f06e4104a30 2024-08-19T01:17:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.175+0000 7f06ead0a640 1 -- 172.21.15.17:0/308414409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e4100170 con 0x7f06e4104a30 2024-08-19T01:17:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.176+0000 7f06e1ffb640 1 -- 172.21.15.17:0/308414409 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f06d8003b20 con 0x7f06e4104a30 2024-08-19T01:17:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.176+0000 7f06e1ffb640 1 --2- 172.21.15.17:0/308414409 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06cc06e170 0x7f06cc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.177+0000 7f06e1ffb640 1 -- 172.21.15.17:0/308414409 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f06d80af130 con 0x7f06e4104a30 2024-08-19T01:17:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.177+0000 7f06e8aa6640 1 --2- 172.21.15.17:0/308414409 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06cc06e170 0x7f06cc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:01.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.177+0000 7f06e8aa6640 1 --2- 172.21.15.17:0/308414409 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06cc06e170 0x7f06cc070630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f06d4005fd0 tx=0x7f06d400b590 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:01.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.181+0000 7f06e1ffb640 1 -- 172.21.15.17:0/308414409 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f06d8078490 con 0x7f06e4104a30 2024-08-19T01:17:01.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:00 smithi086 ceph-mon[71303]: pgmap v546: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:01.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.372+0000 7f06ead0a640 1 -- 172.21.15.17:0/308414409 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f06e410bca0 con 0x7f06cc06e170 2024-08-19T01:17:01.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.373+0000 7f06e1ffb640 1 -- 172.21.15.17:0/308414409 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f06e410bca0 con 0x7f06cc06e170 2024-08-19T01:17:01.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.376+0000 7f06ead0a640 1 -- 172.21.15.17:0/308414409 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06cc06e170 msgr2=0x7f06cc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.376+0000 7f06ead0a640 1 --2- 172.21.15.17:0/308414409 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06cc06e170 0x7f06cc070630 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f06d4005fd0 tx=0x7f06d400b590 comp rx=0 tx=0).stop 2024-08-19T01:17:01.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.376+0000 7f06ead0a640 1 -- 172.21.15.17:0/308414409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4104a30 msgr2=0x7f06e4196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.376+0000 7f06ead0a640 1 --2- 172.21.15.17:0/308414409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4104a30 0x7f06e4196e60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f06d802a9c0 tx=0x7f06d80055a0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.376+0000 7f06ead0a640 1 -- 172.21.15.17:0/308414409 shutdown_connections 2024-08-19T01:17:01.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.376+0000 7f06ead0a640 1 --2- 172.21.15.17:0/308414409 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06cc06e170 0x7f06cc070630 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.376+0000 7f06ead0a640 1 --2- 172.21.15.17:0/308414409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06e4104a30 0x7f06e4196e60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.376+0000 7f06ead0a640 1 --2- 172.21.15.17:0/308414409 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06e40fea30 0x7f06e4196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.376+0000 7f06ead0a640 1 -- 172.21.15.17:0/308414409 >> 172.21.15.17:0/308414409 conn(0x7f06e40fa730 msgr2=0x7f06e40fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:01.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.376+0000 7f06ead0a640 1 -- 172.21.15.17:0/308414409 shutdown_connections 2024-08-19T01:17:01.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.376+0000 7f06ead0a640 1 -- 172.21.15.17:0/308414409 wait complete. 2024-08-19T01:17:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.458+0000 7fdd54408640 1 -- 172.21.15.17:0/1748047789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd4c101690 msgr2=0x7fdd4c109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.458+0000 7fdd54408640 1 --2- 172.21.15.17:0/1748047789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd4c101690 0x7fdd4c109b80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009880 tx=0x7fdd3c02a530 comp rx=0 tx=0).stop 2024-08-19T01:17:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 -- 172.21.15.17:0/1748047789 shutdown_connections 2024-08-19T01:17:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 --2- 172.21.15.17:0/1748047789 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd4c101690 0x7fdd4c109b80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 --2- 172.21.15.17:0/1748047789 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd4c100d70 0x7fdd4c101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 -- 172.21.15.17:0/1748047789 >> 172.21.15.17:0/1748047789 conn(0x7fdd4c0758a0 msgr2=0x7fdd4c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 -- 172.21.15.17:0/1748047789 shutdown_connections 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 -- 172.21.15.17:0/1748047789 wait complete. 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 Processor -- start 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 -- start start 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd4c100d70 0x7fdd4c0fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd4c101690 0x7fdd4c0fef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c0ff450 con 0x7fdd4c100d70 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd54408640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c0ff5c0 con 0x7fdd4c101690 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.459+0000 7fdd521a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd4c100d70 0x7fdd4c0fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd521a4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd4c100d70 0x7fdd4c0fe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49780/0 (socket says 172.21.15.17:49780) 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd521a4640 1 -- 172.21.15.17:0/1139075158 learned_addr learned my addr 172.21.15.17:0/1139075158 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:01.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd519a3640 1 --2- 172.21.15.17:0/1139075158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd4c101690 0x7fdd4c0fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd521a4640 1 -- 172.21.15.17:0/1139075158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd4c101690 msgr2=0x7fdd4c0fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd521a4640 1 --2- 172.21.15.17:0/1139075158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd4c101690 0x7fdd4c0fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd521a4640 1 -- 172.21.15.17:0/1139075158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c009560 con 0x7fdd4c100d70 2024-08-19T01:17:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd521a4640 1 --2- 172.21.15.17:0/1139075158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd4c100d70 0x7fdd4c0fe9d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800d6f0 tx=0x7fdd4800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd437fe640 1 -- 172.21.15.17:0/1139075158 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd48009a30 con 0x7fdd4c100d70 2024-08-19T01:17:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd54408640 1 -- 172.21.15.17:0/1139075158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4c1a1ca0 con 0x7fdd4c100d70 2024-08-19T01:17:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd437fe640 1 -- 172.21.15.17:0/1139075158 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd480054e0 con 0x7fdd4c100d70 2024-08-19T01:17:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd437fe640 1 -- 172.21.15.17:0/1139075158 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd48010460 con 0x7fdd4c100d70 2024-08-19T01:17:01.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.460+0000 7fdd54408640 1 -- 172.21.15.17:0/1139075158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c1a2000 con 0x7fdd4c100d70 2024-08-19T01:17:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.461+0000 7fdd54408640 1 -- 172.21.15.17:0/1139075158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4c068450 con 0x7fdd4c100d70 2024-08-19T01:17:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.462+0000 7fdd437fe640 1 -- 172.21.15.17:0/1139075158 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdd48009b90 con 0x7fdd4c100d70 2024-08-19T01:17:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.462+0000 7fdd437fe640 1 --2- 172.21.15.17:0/1139075158 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd3806e170 0x7fdd38070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.462+0000 7fdd437fe640 1 -- 172.21.15.17:0/1139075158 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdd4808dc80 con 0x7fdd4c100d70 2024-08-19T01:17:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.462+0000 7fdd519a3640 1 --2- 172.21.15.17:0/1139075158 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd3806e170 0x7fdd38070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:01.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.463+0000 7fdd519a3640 1 --2- 172.21.15.17:0/1139075158 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd3806e170 0x7fdd38070630 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c031440 tx=0x7fdd3c005b70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.467+0000 7fdd437fe640 1 -- 172.21.15.17:0/1139075158 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdd48056fe0 con 0x7fdd4c100d70 2024-08-19T01:17:01.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.655+0000 7fdd54408640 1 -- 172.21.15.17:0/1139075158 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd4c104480 con 0x7fdd3806e170 2024-08-19T01:17:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.666+0000 7fdd437fe640 1 -- 172.21.15.17:0/1139075158 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fdd4c104480 con 0x7fdd3806e170 2024-08-19T01:17:01.669 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:17:01.669 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (18m) 12m ago 28m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:17:01.669 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (29m) 12m ago 29m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:17:01.669 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (28m) 11m ago 28m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:17:01.669 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (16m) 12m ago 29m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:17:01.670 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (15m) 11m ago 28m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:17:01.670 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (17m) 12m ago 28m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:17:01.670 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (12m) 12m ago 23m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:17:01.670 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (12m) 12m ago 23m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:17:01.670 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (23m) 11m ago 23m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:17:01.670 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (12m) 11m ago 23m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:17:01.670 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (20m) 12m ago 30m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:17:01.670 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (19m) 11m ago 27m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:17:01.670 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (17m) 12m ago 30m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:17:01.671 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (16m) 11m ago 27m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:17:01.671 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (18m) 12m ago 29m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:17:01.671 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (18m) 11m ago 28m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:17:01.671 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (15m) 12m ago 27m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:17:01.671 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (15m) 12m ago 26m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:17:01.671 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (14m) 12m ago 26m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:17:01.671 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (13m) 11m ago 25m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:17:01.671 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (13m) 11m ago 25m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:17:01.671 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (12m) 11m ago 25m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:17:01.671 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (18m) 12m ago 28m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:17:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.668+0000 7fdd54408640 1 -- 172.21.15.17:0/1139075158 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd3806e170 msgr2=0x7fdd38070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.668+0000 7fdd54408640 1 --2- 172.21.15.17:0/1139075158 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd3806e170 0x7fdd38070630 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c031440 tx=0x7fdd3c005b70 comp rx=0 tx=0).stop 2024-08-19T01:17:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.668+0000 7fdd54408640 1 -- 172.21.15.17:0/1139075158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd4c100d70 msgr2=0x7fdd4c0fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.668+0000 7fdd54408640 1 --2- 172.21.15.17:0/1139075158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd4c100d70 0x7fdd4c0fe9d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800d6f0 tx=0x7fdd4800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.668+0000 7fdd54408640 1 -- 172.21.15.17:0/1139075158 shutdown_connections 2024-08-19T01:17:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.668+0000 7fdd54408640 1 --2- 172.21.15.17:0/1139075158 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdd3806e170 0x7fdd38070630 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.668+0000 7fdd54408640 1 --2- 172.21.15.17:0/1139075158 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdd4c101690 0x7fdd4c0fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.668+0000 7fdd54408640 1 --2- 172.21.15.17:0/1139075158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdd4c100d70 0x7fdd4c0fe9d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.668+0000 7fdd54408640 1 -- 172.21.15.17:0/1139075158 >> 172.21.15.17:0/1139075158 conn(0x7fdd4c0758a0 msgr2=0x7fdd4c101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.668+0000 7fdd54408640 1 -- 172.21.15.17:0/1139075158 shutdown_connections 2024-08-19T01:17:01.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.668+0000 7fdd54408640 1 -- 172.21.15.17:0/1139075158 wait complete. 2024-08-19T01:17:01.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.749+0000 7f5fed32d640 1 -- 172.21.15.17:0/293746303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fe81049f0 msgr2=0x7f5fe8104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.749+0000 7f5fed32d640 1 --2- 172.21.15.17:0/293746303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fe81049f0 0x7f5fe8104dd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8009880 tx=0x7f5fd802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.749+0000 7f5fed32d640 1 -- 172.21.15.17:0/293746303 shutdown_connections 2024-08-19T01:17:01.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.749+0000 7f5fed32d640 1 --2- 172.21.15.17:0/293746303 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe80fe9f0 0x7f5fe80fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.749+0000 7f5fed32d640 1 --2- 172.21.15.17:0/293746303 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fe81049f0 0x7f5fe8104dd0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.749+0000 7f5fed32d640 1 -- 172.21.15.17:0/293746303 >> 172.21.15.17:0/293746303 conn(0x7f5fe80758a0 msgr2=0x7f5fe80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:01.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.749+0000 7f5fed32d640 1 -- 172.21.15.17:0/293746303 shutdown_connections 2024-08-19T01:17:01.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.749+0000 7f5fed32d640 1 -- 172.21.15.17:0/293746303 wait complete. 2024-08-19T01:17:01.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.750+0000 7f5fed32d640 1 Processor -- start 2024-08-19T01:17:01.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.750+0000 7f5fed32d640 1 -- start start 2024-08-19T01:17:01.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.750+0000 7f5fed32d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fe80fe9f0 0x7f5fe8105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:01.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.750+0000 7f5fed32d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe81049f0 0x7f5fe8105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:01.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.750+0000 7f5fed32d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe81063a0 con 0x7f5fe80fe9f0 2024-08-19T01:17:01.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.750+0000 7f5fed32d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe81064e0 con 0x7f5fe81049f0 2024-08-19T01:17:01.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fe6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fe80fe9f0 0x7f5fe8105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:01.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fe6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fe80fe9f0 0x7f5fe8105920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49794/0 (socket says 172.21.15.17:49794) 2024-08-19T01:17:01.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fe6ffd640 1 -- 172.21.15.17:0/1912563266 learned_addr learned my addr 172.21.15.17:0/1912563266 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fe67fc640 1 --2- 172.21.15.17:0/1912563266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe81049f0 0x7f5fe8105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fe6ffd640 1 -- 172.21.15.17:0/1912563266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe81049f0 msgr2=0x7f5fe8105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fe6ffd640 1 --2- 172.21.15.17:0/1912563266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe81049f0 0x7f5fe8105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fe6ffd640 1 -- 172.21.15.17:0/1912563266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd8009560 con 0x7f5fe80fe9f0 2024-08-19T01:17:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fe6ffd640 1 --2- 172.21.15.17:0/1912563266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fe80fe9f0 0x7f5fe8105920 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5fd802a9c0 tx=0x7f5fd80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fcffff640 1 -- 172.21.15.17:0/1912563266 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fd8004aa0 con 0x7f5fe80fe9f0 2024-08-19T01:17:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fcffff640 1 -- 172.21.15.17:0/1912563266 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5fd8004c00 con 0x7f5fe80fe9f0 2024-08-19T01:17:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fed32d640 1 -- 172.21.15.17:0/1912563266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe8106760 con 0x7f5fe80fe9f0 2024-08-19T01:17:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fcffff640 1 -- 172.21.15.17:0/1912563266 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fd8003980 con 0x7f5fe80fe9f0 2024-08-19T01:17:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.751+0000 7f5fed32d640 1 -- 172.21.15.17:0/1912563266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe81a1f60 con 0x7f5fe80fe9f0 2024-08-19T01:17:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.752+0000 7f5fed32d640 1 -- 172.21.15.17:0/1912563266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe8100130 con 0x7f5fe80fe9f0 2024-08-19T01:17:01.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.753+0000 7f5fcffff640 1 -- 172.21.15.17:0/1912563266 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5fd8003bf0 con 0x7f5fe80fe9f0 2024-08-19T01:17:01.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.753+0000 7f5fcffff640 1 --2- 172.21.15.17:0/1912563266 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fd006e170 0x7f5fd0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:01.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.753+0000 7f5fcffff640 1 -- 172.21.15.17:0/1912563266 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5fd80af290 con 0x7f5fe80fe9f0 2024-08-19T01:17:01.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.753+0000 7f5fe67fc640 1 --2- 172.21.15.17:0/1912563266 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fd006e170 0x7f5fd0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:01.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.754+0000 7f5fe67fc640 1 --2- 172.21.15.17:0/1912563266 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fd006e170 0x7f5fd0070630 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc005fd0 tx=0x7f5fdc009470 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:01.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:01.758+0000 7f5fcffff640 1 -- 172.21.15.17:0/1912563266 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5fd80784d0 con 0x7f5fe80fe9f0 2024-08-19T01:17:02.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.005+0000 7f5fed32d640 1 -- 172.21.15.17:0/1912563266 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5fe80fee50 con 0x7f5fe80fe9f0 2024-08-19T01:17:02.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.006+0000 7f5fcffff640 1 -- 172.21.15.17:0/1912563266 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f5fd807bb90 con 0x7f5fe80fe9f0 2024-08-19T01:17:02.008 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:17:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:17:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:17:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:17:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:17:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:17:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:17:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:17:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:17:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:17:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:17:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:17:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:17:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:17:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:17:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:17:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:17:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:17:02.009 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:17:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.008+0000 7f5fed32d640 1 -- 172.21.15.17:0/1912563266 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fd006e170 msgr2=0x7f5fd0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.008+0000 7f5fed32d640 1 --2- 172.21.15.17:0/1912563266 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fd006e170 0x7f5fd0070630 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc005fd0 tx=0x7f5fdc009470 comp rx=0 tx=0).stop 2024-08-19T01:17:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.008+0000 7f5fed32d640 1 -- 172.21.15.17:0/1912563266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fe80fe9f0 msgr2=0x7f5fe8105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.008+0000 7f5fed32d640 1 --2- 172.21.15.17:0/1912563266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fe80fe9f0 0x7f5fe8105920 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5fd802a9c0 tx=0x7f5fd80055a0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.008+0000 7f5fed32d640 1 -- 172.21.15.17:0/1912563266 shutdown_connections 2024-08-19T01:17:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.008+0000 7f5fed32d640 1 --2- 172.21.15.17:0/1912563266 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fd006e170 0x7f5fd0070630 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.008+0000 7f5fed32d640 1 --2- 172.21.15.17:0/1912563266 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fe81049f0 0x7f5fe8105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.008+0000 7f5fed32d640 1 --2- 172.21.15.17:0/1912563266 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fe80fe9f0 0x7f5fe8105920 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.008+0000 7f5fed32d640 1 -- 172.21.15.17:0/1912563266 >> 172.21.15.17:0/1912563266 conn(0x7f5fe80758a0 msgr2=0x7f5fe8067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.008+0000 7f5fed32d640 1 -- 172.21.15.17:0/1912563266 shutdown_connections 2024-08-19T01:17:02.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.008+0000 7f5fed32d640 1 -- 172.21.15.17:0/1912563266 wait complete. 2024-08-19T01:17:02.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.090+0000 7f0542d65640 1 -- 172.21.15.17:0/2493463767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f053c101610 msgr2=0x7f053c109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.090+0000 7f0542d65640 1 --2- 172.21.15.17:0/2493463767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f053c101610 0x7f053c109b00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f05280098b0 tx=0x7f052802a4d0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.090+0000 7f0542d65640 1 -- 172.21.15.17:0/2493463767 shutdown_connections 2024-08-19T01:17:02.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.090+0000 7f0542d65640 1 --2- 172.21.15.17:0/2493463767 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f053c101610 0x7f053c109b00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.090+0000 7f0542d65640 1 --2- 172.21.15.17:0/2493463767 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f053c100c60 0x7f053c101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.090+0000 7f0542d65640 1 -- 172.21.15.17:0/2493463767 >> 172.21.15.17:0/2493463767 conn(0x7f053c0fa730 msgr2=0x7f053c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:02.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.090+0000 7f0542d65640 1 -- 172.21.15.17:0/2493463767 shutdown_connections 2024-08-19T01:17:02.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.090+0000 7f0542d65640 1 -- 172.21.15.17:0/2493463767 wait complete. 2024-08-19T01:17:02.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0542d65640 1 Processor -- start 2024-08-19T01:17:02.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0542d65640 1 -- start start 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0542d65640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f053c100c60 0x7f053c0fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0542d65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f053c101610 0x7f053c0fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0542d65640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c100920 con 0x7f053c100c60 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0542d65640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c0ff3d0 con 0x7f053c101610 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0540b01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f053c100c60 0x7f053c0fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0540b01640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f053c100c60 0x7f053c0fe950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49812/0 (socket says 172.21.15.17:49812) 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0540b01640 1 -- 172.21.15.17:0/1099606818 learned_addr learned my addr 172.21.15.17:0/1099606818 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0540b01640 1 -- 172.21.15.17:0/1099606818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f053c101610 msgr2=0x7f053c0fee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0540b01640 1 --2- 172.21.15.17:0/1099606818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f053c101610 0x7f053c0fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.091+0000 7f0540b01640 1 -- 172.21.15.17:0/1099606818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009560 con 0x7f053c100c60 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.092+0000 7f0540b01640 1 --2- 172.21.15.17:0/1099606818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f053c100c60 0x7f053c0fe950 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f053000c8a0 tx=0x7f053000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.092+0000 7f0539ffb640 1 -- 172.21.15.17:0/1099606818 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0530007b80 con 0x7f053c100c60 2024-08-19T01:17:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.092+0000 7f0542d65640 1 -- 172.21.15.17:0/1099606818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c0ff6b0 con 0x7f053c100c60 2024-08-19T01:17:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.092+0000 7f0539ffb640 1 -- 172.21.15.17:0/1099606818 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0530007ce0 con 0x7f053c100c60 2024-08-19T01:17:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.092+0000 7f0539ffb640 1 -- 172.21.15.17:0/1099606818 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0530018810 con 0x7f053c100c60 2024-08-19T01:17:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.092+0000 7f0542d65640 1 -- 172.21.15.17:0/1099606818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c1a1fb0 con 0x7f053c100c60 2024-08-19T01:17:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.093+0000 7f0542d65640 1 -- 172.21.15.17:0/1099606818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c068d30 con 0x7f053c100c60 2024-08-19T01:17:02.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.093+0000 7f0539ffb640 1 -- 172.21.15.17:0/1099606818 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0530018a80 con 0x7f053c100c60 2024-08-19T01:17:02.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.094+0000 7f0539ffb640 1 --2- 172.21.15.17:0/1099606818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 0x7f052c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:02.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.094+0000 7f053bfff640 1 --2- 172.21.15.17:0/1099606818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 0x7f052c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:02.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.094+0000 7f0539ffb640 1 -- 172.21.15.17:0/1099606818 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f053008e370 con 0x7f053c100c60 2024-08-19T01:17:02.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.094+0000 7f053bfff640 1 --2- 172.21.15.17:0/1099606818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 0x7f052c070630 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f052802a9f0 tx=0x7f0528000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:02.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.098+0000 7f0539ffb640 1 -- 172.21.15.17:0/1099606818 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0530057700 con 0x7f053c100c60 2024-08-19T01:17:02.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.309+0000 7f0542d65640 1 -- 172.21.15.17:0/1099606818 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f053c10cdb0 con 0x7f053c100c60 2024-08-19T01:17:02.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.310+0000 7f0539ffb640 1 -- 172.21.15.17:0/1099606818 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f053005adc0 con 0x7f053c100c60 2024-08-19T01:17:02.312 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:17:02.312 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:17:02.312 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:17:02.312 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:17:02.312 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:17:02.313 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:17:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:17:02.315 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:17:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:17:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.312+0000 7f0542d65640 1 -- 172.21.15.17:0/1099606818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 msgr2=0x7f052c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.312+0000 7f0542d65640 1 --2- 172.21.15.17:0/1099606818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 0x7f052c070630 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f052802a9f0 tx=0x7f0528000bc0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.312+0000 7f0542d65640 1 -- 172.21.15.17:0/1099606818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f053c100c60 msgr2=0x7f053c0fe950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.312+0000 7f0542d65640 1 --2- 172.21.15.17:0/1099606818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f053c100c60 0x7f053c0fe950 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f053000c8a0 tx=0x7f053000cd60 comp rx=0 tx=0).stop 2024-08-19T01:17:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.312+0000 7f0542d65640 1 -- 172.21.15.17:0/1099606818 shutdown_connections 2024-08-19T01:17:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.312+0000 7f0542d65640 1 --2- 172.21.15.17:0/1099606818 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 0x7f052c070630 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.312+0000 7f0542d65640 1 --2- 172.21.15.17:0/1099606818 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f053c101610 0x7f053c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.312+0000 7f0542d65640 1 --2- 172.21.15.17:0/1099606818 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f053c100c60 0x7f053c0fe950 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.312+0000 7f0542d65640 1 -- 172.21.15.17:0/1099606818 >> 172.21.15.17:0/1099606818 conn(0x7f053c0fa730 msgr2=0x7f053c101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.312+0000 7f0542d65640 1 -- 172.21.15.17:0/1099606818 shutdown_connections 2024-08-19T01:17:02.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.312+0000 7f0542d65640 1 -- 172.21.15.17:0/1099606818 wait complete. 2024-08-19T01:17:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.395+0000 7f6771ef2640 1 -- 172.21.15.17:0/3393215881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676c0fdf80 msgr2=0x7f676c0fe3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.395+0000 7f6771ef2640 1 --2- 172.21.15.17:0/3393215881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676c0fdf80 0x7f676c0fe3e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6754009880 tx=0x7f675402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.395+0000 7f6771ef2640 1 -- 172.21.15.17:0/3393215881 shutdown_connections 2024-08-19T01:17:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.395+0000 7f6771ef2640 1 --2- 172.21.15.17:0/3393215881 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676c0fdf80 0x7f676c0fe3e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.395+0000 7f6771ef2640 1 --2- 172.21.15.17:0/3393215881 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f676c104b60 0x7f676c104f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.395+0000 7f6771ef2640 1 -- 172.21.15.17:0/3393215881 >> 172.21.15.17:0/3393215881 conn(0x7f676c0f9e90 msgr2=0x7f676c0fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.395+0000 7f6771ef2640 1 -- 172.21.15.17:0/3393215881 shutdown_connections 2024-08-19T01:17:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.395+0000 7f6771ef2640 1 -- 172.21.15.17:0/3393215881 wait complete. 2024-08-19T01:17:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.396+0000 7f6771ef2640 1 Processor -- start 2024-08-19T01:17:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.396+0000 7f6771ef2640 1 -- start start 2024-08-19T01:17:02.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.396+0000 7f6771ef2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f676c0fdf80 0x7f676c19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:02.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.396+0000 7f6771ef2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676c104b60 0x7f676c19bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:02.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.396+0000 7f6771ef2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c19c4f0 con 0x7f676c104b60 2024-08-19T01:17:02.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.396+0000 7f6771ef2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c195a80 con 0x7f676c0fdf80 2024-08-19T01:17:02.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.396+0000 7f6762ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676c104b60 0x7f676c19bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:02.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.396+0000 7f6762ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676c104b60 0x7f676c19bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49824/0 (socket says 172.21.15.17:49824) 2024-08-19T01:17:02.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.396+0000 7f6762ffd640 1 -- 172.21.15.17:0/4285230504 learned_addr learned my addr 172.21.15.17:0/4285230504 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:02.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.397+0000 7f6762ffd640 1 -- 172.21.15.17:0/4285230504 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f676c0fdf80 msgr2=0x7f676c19b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.397+0000 7f6762ffd640 1 --2- 172.21.15.17:0/4285230504 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f676c0fdf80 0x7f676c19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.397+0000 7f6762ffd640 1 -- 172.21.15.17:0/4285230504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6754009560 con 0x7f676c104b60 2024-08-19T01:17:02.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.397+0000 7f6762ffd640 1 --2- 172.21.15.17:0/4285230504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676c104b60 0x7f676c19bed0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f675402a9c0 tx=0x7f67540055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:02.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.397+0000 7f67697fa640 1 -- 172.21.15.17:0/4285230504 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6754004aa0 con 0x7f676c104b60 2024-08-19T01:17:02.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.397+0000 7f6771ef2640 1 -- 172.21.15.17:0/4285230504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c195d00 con 0x7f676c104b60 2024-08-19T01:17:02.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.397+0000 7f67697fa640 1 -- 172.21.15.17:0/4285230504 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6754004c00 con 0x7f676c104b60 2024-08-19T01:17:02.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.397+0000 7f67697fa640 1 -- 172.21.15.17:0/4285230504 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6754003980 con 0x7f676c104b60 2024-08-19T01:17:02.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.397+0000 7f6771ef2640 1 -- 172.21.15.17:0/4285230504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676c1961f0 con 0x7f676c104b60 2024-08-19T01:17:02.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.398+0000 7f6771ef2640 1 -- 172.21.15.17:0/4285230504 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676c1012a0 con 0x7f676c104b60 2024-08-19T01:17:02.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.399+0000 7f67697fa640 1 -- 172.21.15.17:0/4285230504 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6754003bf0 con 0x7f676c104b60 2024-08-19T01:17:02.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.399+0000 7f67697fa640 1 --2- 172.21.15.17:0/4285230504 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f675806e170 0x7f6758070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:02.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.399+0000 7f67697fa640 1 -- 172.21.15.17:0/4285230504 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f67540af210 con 0x7f676c104b60 2024-08-19T01:17:02.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.399+0000 7f676b7fe640 1 --2- 172.21.15.17:0/4285230504 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f675806e170 0x7f6758070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:02.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.400+0000 7f676b7fe640 1 --2- 172.21.15.17:0/4285230504 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f675806e170 0x7f6758070630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f675c005fd0 tx=0x7f675c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:02.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.404+0000 7f67697fa640 1 -- 172.21.15.17:0/4285230504 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f67540784f0 con 0x7f676c104b60 2024-08-19T01:17:02.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.597+0000 7f6771ef2640 1 -- 172.21.15.17:0/4285230504 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f676c10cec0 con 0x7f675806e170 2024-08-19T01:17:02.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.598+0000 7f67697fa640 1 -- 172.21.15.17:0/4285230504 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f676c10cec0 con 0x7f675806e170 2024-08-19T01:17:02.600 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:17:02.600 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:17:02.600 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:17:02.600 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:17:02.600 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:17:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:17:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:17:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:17:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:17:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:17:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:17:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:17:02.601 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:17:02.601 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:17:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.600+0000 7f6771ef2640 1 -- 172.21.15.17:0/4285230504 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f675806e170 msgr2=0x7f6758070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.600+0000 7f6771ef2640 1 --2- 172.21.15.17:0/4285230504 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f675806e170 0x7f6758070630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f675c005fd0 tx=0x7f675c005850 comp rx=0 tx=0).stop 2024-08-19T01:17:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.600+0000 7f6771ef2640 1 -- 172.21.15.17:0/4285230504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676c104b60 msgr2=0x7f676c19bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.600+0000 7f6771ef2640 1 --2- 172.21.15.17:0/4285230504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676c104b60 0x7f676c19bed0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f675402a9c0 tx=0x7f67540055a0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.600+0000 7f6771ef2640 1 -- 172.21.15.17:0/4285230504 shutdown_connections 2024-08-19T01:17:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.600+0000 7f6771ef2640 1 --2- 172.21.15.17:0/4285230504 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f675806e170 0x7f6758070630 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.600+0000 7f6771ef2640 1 --2- 172.21.15.17:0/4285230504 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f676c104b60 0x7f676c19bed0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.600+0000 7f6771ef2640 1 --2- 172.21.15.17:0/4285230504 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f676c0fdf80 0x7f676c19b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.600+0000 7f6771ef2640 1 -- 172.21.15.17:0/4285230504 >> 172.21.15.17:0/4285230504 conn(0x7f676c0f9e90 msgr2=0x7f676c0fafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.600+0000 7f6771ef2640 1 -- 172.21.15.17:0/4285230504 shutdown_connections 2024-08-19T01:17:02.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.600+0000 7f6771ef2640 1 -- 172.21.15.17:0/4285230504 wait complete. 2024-08-19T01:17:02.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.682+0000 7f8f52b65640 1 -- 172.21.15.17:0/1730359842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f4c0ffda0 msgr2=0x7f8f4c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.682+0000 7f8f52b65640 1 --2- 172.21.15.17:0/1730359842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f4c0ffda0 0x7f8f4c100180 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c009880 tx=0x7f8f3c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.682+0000 7f8f52b65640 1 -- 172.21.15.17:0/1730359842 shutdown_connections 2024-08-19T01:17:02.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.682+0000 7f8f52b65640 1 --2- 172.21.15.17:0/1730359842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c100750 0x7f8f4c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.682+0000 7f8f52b65640 1 --2- 172.21.15.17:0/1730359842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f4c0ffda0 0x7f8f4c100180 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.682+0000 7f8f52b65640 1 -- 172.21.15.17:0/1730359842 >> 172.21.15.17:0/1730359842 conn(0x7f8f4c0fb840 msgr2=0x7f8f4c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:02.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.682+0000 7f8f52b65640 1 -- 172.21.15.17:0/1730359842 shutdown_connections 2024-08-19T01:17:02.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.682+0000 7f8f52b65640 1 -- 172.21.15.17:0/1730359842 wait complete. 2024-08-19T01:17:02.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.682+0000 7f8f52b65640 1 Processor -- start 2024-08-19T01:17:02.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f52b65640 1 -- start start 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f52b65640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f4c0ffda0 0x7f8f4c19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f52b65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c100750 0x7f8f4c19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f52b65640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c19c360 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f52b65640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c1958f0 con 0x7f8f4c100750 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f50901640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f4c0ffda0 0x7f8f4c19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f50901640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f4c0ffda0 0x7f8f4c19b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49838/0 (socket says 172.21.15.17:49838) 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f50901640 1 -- 172.21.15.17:0/3422395216 learned_addr learned my addr 172.21.15.17:0/3422395216 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f4bfff640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c100750 0x7f8f4c19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f50901640 1 -- 172.21.15.17:0/3422395216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c100750 msgr2=0x7f8f4c19bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f50901640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c100750 0x7f8f4c19bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f50901640 1 -- 172.21.15.17:0/3422395216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c009560 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f4bfff640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c100750 0x7f8f4c19bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:17:02.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.683+0000 7f8f50901640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f4c0ffda0 0x7f8f4c19b800 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c02a9c0 tx=0x7f8f3c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:02.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.684+0000 7f8f49ffb640 1 -- 172.21.15.17:0/3422395216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f3c004aa0 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.684+0000 7f8f49ffb640 1 -- 172.21.15.17:0/3422395216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f3c004c00 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.684+0000 7f8f52b65640 1 -- 172.21.15.17:0/3422395216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c195b70 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.684+0000 7f8f49ffb640 1 -- 172.21.15.17:0/3422395216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f3c003980 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.684+0000 7f8f52b65640 1 -- 172.21.15.17:0/3422395216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c196060 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.685+0000 7f8f52b65640 1 -- 172.21.15.17:0/3422395216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4c101280 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.685+0000 7f8f49ffb640 1 -- 172.21.15.17:0/3422395216 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8f3c003b20 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.686+0000 7f8f49ffb640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8f3806e170 0x7f8f38070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:02.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.686+0000 7f8f49ffb640 1 -- 172.21.15.17:0/3422395216 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8f3c0af130 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.686+0000 7f8f4bfff640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8f3806e170 0x7f8f38070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:02.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.686+0000 7f8f4bfff640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8f3806e170 0x7f8f38070630 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8f34005d00 tx=0x7f8f34009550 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:02.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.690+0000 7f8f49ffb640 1 -- 172.21.15.17:0/3422395216 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8f3c078490 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:02 smithi017 ceph-mon[99370]: from='client.35044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:02 smithi017 ceph-mon[99370]: pgmap v547: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:02 smithi017 ceph-mon[99370]: from='client.35048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:02 smithi017 ceph-mon[99370]: from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:02 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1912563266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:17:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:02 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1099606818' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:17:02.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.938+0000 7f8f52b65640 1 -- 172.21.15.17:0/3422395216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8f4c100180 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.939+0000 7f8f49ffb640 1 -- 172.21.15.17:0/3422395216 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f8f3c07bb50 con 0x7f8f4c0ffda0 2024-08-19T01:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:17:02.941 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:17:02.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.941+0000 7f8f52b65640 1 -- 172.21.15.17:0/3422395216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8f3806e170 msgr2=0x7f8f38070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.941+0000 7f8f52b65640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8f3806e170 0x7f8f38070630 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8f34005d00 tx=0x7f8f34009550 comp rx=0 tx=0).stop 2024-08-19T01:17:02.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.941+0000 7f8f52b65640 1 -- 172.21.15.17:0/3422395216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f4c0ffda0 msgr2=0x7f8f4c19b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:02.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.941+0000 7f8f52b65640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f4c0ffda0 0x7f8f4c19b800 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c02a9c0 tx=0x7f8f3c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.941+0000 7f8f52b65640 1 -- 172.21.15.17:0/3422395216 shutdown_connections 2024-08-19T01:17:02.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.941+0000 7f8f52b65640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8f3806e170 0x7f8f38070630 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.941+0000 7f8f52b65640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8f4c100750 0x7f8f4c19bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.941+0000 7f8f52b65640 1 --2- 172.21.15.17:0/3422395216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8f4c0ffda0 0x7f8f4c19b800 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:02.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.941+0000 7f8f52b65640 1 -- 172.21.15.17:0/3422395216 >> 172.21.15.17:0/3422395216 conn(0x7f8f4c0fb840 msgr2=0x7f8f4c0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:02.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.942+0000 7f8f52b65640 1 -- 172.21.15.17:0/3422395216 shutdown_connections 2024-08-19T01:17:02.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:02.942+0000 7f8f52b65640 1 -- 172.21.15.17:0/3422395216 wait complete. 2024-08-19T01:17:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:02 smithi086 ceph-mon[71303]: from='client.35044 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:02 smithi086 ceph-mon[71303]: pgmap v547: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:02 smithi086 ceph-mon[71303]: from='client.35048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:02 smithi086 ceph-mon[71303]: from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:02 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1912563266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:17:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:02 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1099606818' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:17:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:03 smithi017 ceph-mon[99370]: from='client.35064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:17:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:03 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3422395216' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:17:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:03 smithi086 ceph-mon[71303]: from='client.35064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:17:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:03 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3422395216' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:17:05.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:04 smithi017 ceph-mon[99370]: pgmap v548: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:04 smithi086 ceph-mon[71303]: pgmap v548: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:06.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:06 smithi086 ceph-mon[71303]: pgmap v549: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:06 smithi017 ceph-mon[99370]: pgmap v549: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:08 smithi017 ceph-mon[99370]: pgmap v550: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:08 smithi086 ceph-mon[71303]: pgmap v550: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:11.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:10 smithi017 ceph-mon[99370]: pgmap v551: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:10 smithi086 ceph-mon[71303]: pgmap v551: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:13.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:12 smithi017 ceph-mon[99370]: pgmap v552: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:13.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:12 smithi086 ceph-mon[71303]: pgmap v552: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:15.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:14 smithi017 ceph-mon[99370]: pgmap v553: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:15.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:14 smithi086 ceph-mon[71303]: pgmap v553: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:17.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:16 smithi017 ceph-mon[99370]: pgmap v554: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:17.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:16 smithi086 ceph-mon[71303]: pgmap v554: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:18 smithi017 ceph-mon[99370]: pgmap v555: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:17:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:18 smithi086 ceph-mon[71303]: pgmap v555: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:17:21.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:20 smithi017 ceph-mon[99370]: pgmap v556: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:21.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:20 smithi086 ceph-mon[71303]: pgmap v556: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:23.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:22 smithi017 ceph-mon[99370]: pgmap v557: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:23.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:22 smithi086 ceph-mon[71303]: pgmap v557: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:25.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:24 smithi017 ceph-mon[99370]: pgmap v558: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:24 smithi086 ceph-mon[71303]: pgmap v558: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:27.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:26 smithi017 ceph-mon[99370]: pgmap v559: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:26 smithi086 ceph-mon[71303]: pgmap v559: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:29.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:28 smithi017 ceph-mon[99370]: pgmap v560: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:28 smithi086 ceph-mon[71303]: pgmap v560: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:30 smithi017 ceph-mon[99370]: pgmap v561: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:31.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:30 smithi086 ceph-mon[71303]: pgmap v561: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.037+0000 7fc31dd72640 1 -- 172.21.15.17:0/3465689248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc318104a30 msgr2=0x7fc318104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.037+0000 7fc31dd72640 1 --2- 172.21.15.17:0/3465689248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc318104a30 0x7fc318104e10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc308009880 tx=0x7fc30802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.037+0000 7fc31dd72640 1 -- 172.21.15.17:0/3465689248 shutdown_connections 2024-08-19T01:17:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.037+0000 7fc31dd72640 1 --2- 172.21.15.17:0/3465689248 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3180fea30 0x7fc3180fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.037+0000 7fc31dd72640 1 --2- 172.21.15.17:0/3465689248 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc318104a30 0x7fc318104e10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.037+0000 7fc31dd72640 1 -- 172.21.15.17:0/3465689248 >> 172.21.15.17:0/3465689248 conn(0x7fc3180fa730 msgr2=0x7fc3180fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.037+0000 7fc31dd72640 1 -- 172.21.15.17:0/3465689248 shutdown_connections 2024-08-19T01:17:33.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.037+0000 7fc31dd72640 1 -- 172.21.15.17:0/3465689248 wait complete. 2024-08-19T01:17:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.038+0000 7fc31dd72640 1 Processor -- start 2024-08-19T01:17:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.038+0000 7fc31dd72640 1 -- start start 2024-08-19T01:17:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.038+0000 7fc31dd72640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3180fea30 0x7fc31819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.038+0000 7fc31dd72640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc318104a30 0x7fc31819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.038+0000 7fc31dd72640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318195890 con 0x7fc318104a30 2024-08-19T01:17:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.038+0000 7fc31dd72640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3181959d0 con 0x7fc3180fea30 2024-08-19T01:17:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.038+0000 7fc316ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc318104a30 0x7fc31819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc316ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc318104a30 0x7fc31819bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57780/0 (socket says 172.21.15.17:57780) 2024-08-19T01:17:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc316ffd640 1 -- 172.21.15.17:0/266030947 learned_addr learned my addr 172.21.15.17:0/266030947 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc3177fe640 1 --2- 172.21.15.17:0/266030947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3180fea30 0x7fc31819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc316ffd640 1 -- 172.21.15.17:0/266030947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3180fea30 msgr2=0x7fc31819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc316ffd640 1 --2- 172.21.15.17:0/266030947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3180fea30 0x7fc31819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc316ffd640 1 -- 172.21.15.17:0/266030947 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308009560 con 0x7fc318104a30 2024-08-19T01:17:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc316ffd640 1 --2- 172.21.15.17:0/266030947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc318104a30 0x7fc31819bd70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c810 tx=0x7fc30c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc314ff9640 1 -- 172.21.15.17:0/266030947 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc30c0041f0 con 0x7fc318104a30 2024-08-19T01:17:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc314ff9640 1 -- 172.21.15.17:0/266030947 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc30c007e70 con 0x7fc318104a30 2024-08-19T01:17:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc31dd72640 1 -- 172.21.15.17:0/266030947 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc318195cb0 con 0x7fc318104a30 2024-08-19T01:17:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc314ff9640 1 -- 172.21.15.17:0/266030947 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc30c0049d0 con 0x7fc318104a30 2024-08-19T01:17:33.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.039+0000 7fc31dd72640 1 -- 172.21.15.17:0/266030947 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc318196200 con 0x7fc318104a30 2024-08-19T01:17:33.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.040+0000 7fc31dd72640 1 -- 172.21.15.17:0/266030947 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc318100170 con 0x7fc318104a30 2024-08-19T01:17:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.041+0000 7fc314ff9640 1 -- 172.21.15.17:0/266030947 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc30c0079b0 con 0x7fc318104a30 2024-08-19T01:17:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.042+0000 7fc314ff9640 1 --2- 172.21.15.17:0/266030947 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30006e180 0x7fc300070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.042+0000 7fc314ff9640 1 -- 172.21.15.17:0/266030947 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc30c08dfc0 con 0x7fc318104a30 2024-08-19T01:17:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.042+0000 7fc3177fe640 1 --2- 172.21.15.17:0/266030947 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30006e180 0x7fc300070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.042+0000 7fc3177fe640 1 --2- 172.21.15.17:0/266030947 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30006e180 0x7fc300070640 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc308000c00 tx=0x7fc308031420 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:33.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.046+0000 7fc314ff9640 1 -- 172.21.15.17:0/266030947 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc30c0572a0 con 0x7fc318104a30 2024-08-19T01:17:33.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:32 smithi017 ceph-mon[99370]: pgmap v562: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:33.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:32 smithi086 ceph-mon[71303]: pgmap v562: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:33.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.239+0000 7fc31dd72640 1 -- 172.21.15.17:0/266030947 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3181964d0 con 0x7fc30006e180 2024-08-19T01:17:33.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.240+0000 7fc314ff9640 1 -- 172.21.15.17:0/266030947 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc3181964d0 con 0x7fc30006e180 2024-08-19T01:17:33.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.242+0000 7fc31dd72640 1 -- 172.21.15.17:0/266030947 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30006e180 msgr2=0x7fc300070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.242+0000 7fc31dd72640 1 --2- 172.21.15.17:0/266030947 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30006e180 0x7fc300070640 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc308000c00 tx=0x7fc308031420 comp rx=0 tx=0).stop 2024-08-19T01:17:33.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.242+0000 7fc31dd72640 1 -- 172.21.15.17:0/266030947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc318104a30 msgr2=0x7fc31819bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.242+0000 7fc31dd72640 1 --2- 172.21.15.17:0/266030947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc318104a30 0x7fc31819bd70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00c810 tx=0x7fc30c00ccd0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.242+0000 7fc31dd72640 1 -- 172.21.15.17:0/266030947 shutdown_connections 2024-08-19T01:17:33.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.242+0000 7fc31dd72640 1 --2- 172.21.15.17:0/266030947 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc30006e180 0x7fc300070640 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.242+0000 7fc31dd72640 1 --2- 172.21.15.17:0/266030947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc318104a30 0x7fc31819bd70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.242+0000 7fc31dd72640 1 --2- 172.21.15.17:0/266030947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc3180fea30 0x7fc31819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.242+0000 7fc31dd72640 1 -- 172.21.15.17:0/266030947 >> 172.21.15.17:0/266030947 conn(0x7fc3180fa730 msgr2=0x7fc318068770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:33.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.242+0000 7fc31dd72640 1 -- 172.21.15.17:0/266030947 shutdown_connections 2024-08-19T01:17:33.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.242+0000 7fc31dd72640 1 -- 172.21.15.17:0/266030947 wait complete. 2024-08-19T01:17:33.253 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:17:33.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.325+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2221209673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b0104a30 msgr2=0x7ff9b0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.325+0000 7ff9b4f4f640 1 --2- 172.21.15.17:0/2221209673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b0104a30 0x7ff9b0104e10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009880 tx=0x7ff9a002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.325+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2221209673 shutdown_connections 2024-08-19T01:17:33.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.325+0000 7ff9b4f4f640 1 --2- 172.21.15.17:0/2221209673 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9b00fea30 0x7ff9b00fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.325+0000 7ff9b4f4f640 1 --2- 172.21.15.17:0/2221209673 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b0104a30 0x7ff9b0104e10 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.325+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2221209673 >> 172.21.15.17:0/2221209673 conn(0x7ff9b00fa730 msgr2=0x7ff9b00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:33.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.325+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2221209673 shutdown_connections 2024-08-19T01:17:33.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.325+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2221209673 wait complete. 2024-08-19T01:17:33.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.326+0000 7ff9b4f4f640 1 Processor -- start 2024-08-19T01:17:33.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.326+0000 7ff9b4f4f640 1 -- start start 2024-08-19T01:17:33.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.326+0000 7ff9b4f4f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9b00fea30 0x7ff9b019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.326+0000 7ff9b4f4f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b0104a30 0x7ff9b019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.326+0000 7ff9b4f4f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b019c410 con 0x7ff9b0104a30 2024-08-19T01:17:33.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.326+0000 7ff9b4f4f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b01959a0 con 0x7ff9b00fea30 2024-08-19T01:17:33.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b0104a30 0x7ff9b019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9a7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b0104a30 0x7ff9b019bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57802/0 (socket says 172.21.15.17:57802) 2024-08-19T01:17:33.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9a7fff640 1 -- 172.21.15.17:0/2589627347 learned_addr learned my addr 172.21.15.17:0/2589627347 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:33.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9ae59c640 1 --2- 172.21.15.17:0/2589627347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9b00fea30 0x7ff9b019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9a7fff640 1 -- 172.21.15.17:0/2589627347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9b00fea30 msgr2=0x7ff9b019b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9a7fff640 1 --2- 172.21.15.17:0/2589627347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9b00fea30 0x7ff9b019b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9a7fff640 1 -- 172.21.15.17:0/2589627347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0009560 con 0x7ff9b0104a30 2024-08-19T01:17:33.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9a7fff640 1 --2- 172.21.15.17:0/2589627347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b0104a30 0x7ff9b019bdf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff99800e970 tx=0x7ff99800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:33.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9a77fe640 1 -- 172.21.15.17:0/2589627347 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff99800cc90 con 0x7ff9b0104a30 2024-08-19T01:17:33.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2589627347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b0195c80 con 0x7ff9b0104a30 2024-08-19T01:17:33.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9a77fe640 1 -- 172.21.15.17:0/2589627347 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff99800cdf0 con 0x7ff9b0104a30 2024-08-19T01:17:33.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9a77fe640 1 -- 172.21.15.17:0/2589627347 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff998010430 con 0x7ff9b0104a30 2024-08-19T01:17:33.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.327+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2589627347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b01961d0 con 0x7ff9b0104a30 2024-08-19T01:17:33.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.328+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2589627347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b0100170 con 0x7ff9b0104a30 2024-08-19T01:17:33.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.329+0000 7ff9a77fe640 1 -- 172.21.15.17:0/2589627347 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff9980046c0 con 0x7ff9b0104a30 2024-08-19T01:17:33.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.329+0000 7ff9a77fe640 1 --2- 172.21.15.17:0/2589627347 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff99c06e170 0x7ff99c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.329+0000 7ff9a77fe640 1 -- 172.21.15.17:0/2589627347 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff998014070 con 0x7ff9b0104a30 2024-08-19T01:17:33.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.329+0000 7ff9ae59c640 1 --2- 172.21.15.17:0/2589627347 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff99c06e170 0x7ff99c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.330+0000 7ff9ae59c640 1 --2- 172.21.15.17:0/2589627347 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff99c06e170 0x7ff99c070630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0000c00 tx=0x7ff9a0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:33.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.334+0000 7ff9a77fe640 1 -- 172.21.15.17:0/2589627347 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff998057a20 con 0x7ff9b0104a30 2024-08-19T01:17:33.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.526+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2589627347 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9b010bcc0 con 0x7ff99c06e170 2024-08-19T01:17:33.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.528+0000 7ff9a77fe640 1 -- 172.21.15.17:0/2589627347 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff9b010bcc0 con 0x7ff99c06e170 2024-08-19T01:17:33.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.530+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2589627347 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff99c06e170 msgr2=0x7ff99c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.530+0000 7ff9b4f4f640 1 --2- 172.21.15.17:0/2589627347 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff99c06e170 0x7ff99c070630 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0000c00 tx=0x7ff9a0005a20 comp rx=0 tx=0).stop 2024-08-19T01:17:33.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.530+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2589627347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b0104a30 msgr2=0x7ff9b019bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.530+0000 7ff9b4f4f640 1 --2- 172.21.15.17:0/2589627347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b0104a30 0x7ff9b019bdf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff99800e970 tx=0x7ff99800ed70 comp rx=0 tx=0).stop 2024-08-19T01:17:33.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.530+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2589627347 shutdown_connections 2024-08-19T01:17:33.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.530+0000 7ff9b4f4f640 1 --2- 172.21.15.17:0/2589627347 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff99c06e170 0x7ff99c070630 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.530+0000 7ff9b4f4f640 1 --2- 172.21.15.17:0/2589627347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9b0104a30 0x7ff9b019bdf0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.530+0000 7ff9b4f4f640 1 --2- 172.21.15.17:0/2589627347 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9b00fea30 0x7ff9b019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.530+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2589627347 >> 172.21.15.17:0/2589627347 conn(0x7ff9b00fa730 msgr2=0x7ff9b00fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:33.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.530+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2589627347 shutdown_connections 2024-08-19T01:17:33.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.530+0000 7ff9b4f4f640 1 -- 172.21.15.17:0/2589627347 wait complete. 2024-08-19T01:17:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.613+0000 7fda64c23640 1 -- 172.21.15.17:0/1299325877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda60104a30 msgr2=0x7fda60104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.613+0000 7fda64c23640 1 --2- 172.21.15.17:0/1299325877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda60104a30 0x7fda60104e10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fda48009880 tx=0x7fda4802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.613+0000 7fda64c23640 1 -- 172.21.15.17:0/1299325877 shutdown_connections 2024-08-19T01:17:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.613+0000 7fda64c23640 1 --2- 172.21.15.17:0/1299325877 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fea30 0x7fda600fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.613+0000 7fda64c23640 1 --2- 172.21.15.17:0/1299325877 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda60104a30 0x7fda60104e10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.613+0000 7fda64c23640 1 -- 172.21.15.17:0/1299325877 >> 172.21.15.17:0/1299325877 conn(0x7fda600fa730 msgr2=0x7fda600fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.613+0000 7fda64c23640 1 -- 172.21.15.17:0/1299325877 shutdown_connections 2024-08-19T01:17:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.613+0000 7fda64c23640 1 -- 172.21.15.17:0/1299325877 wait complete. 2024-08-19T01:17:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda64c23640 1 Processor -- start 2024-08-19T01:17:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda64c23640 1 -- start start 2024-08-19T01:17:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda64c23640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fea30 0x7fda60100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda64c23640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda60104a30 0x7fda60100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda64c23640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda60101080 con 0x7fda60104a30 2024-08-19T01:17:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda64c23640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda601011f0 con 0x7fda600fea30 2024-08-19T01:17:33.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda5dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda60104a30 0x7fda60100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda5dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda60104a30 0x7fda60100b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57818/0 (socket says 172.21.15.17:57818) 2024-08-19T01:17:33.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda5dd9b640 1 -- 172.21.15.17:0/3123873052 learned_addr learned my addr 172.21.15.17:0/3123873052 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:33.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda5e59c640 1 --2- 172.21.15.17:0/3123873052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fea30 0x7fda60100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda5dd9b640 1 -- 172.21.15.17:0/3123873052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fea30 msgr2=0x7fda60100600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda5dd9b640 1 --2- 172.21.15.17:0/3123873052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fea30 0x7fda60100600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.614+0000 7fda5dd9b640 1 -- 172.21.15.17:0/3123873052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48009560 con 0x7fda60104a30 2024-08-19T01:17:33.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.615+0000 7fda5dd9b640 1 --2- 172.21.15.17:0/3123873052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda60104a30 0x7fda60100b40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fda5000c8f0 tx=0x7fda5000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:33.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.615+0000 7fda577fe640 1 -- 172.21.15.17:0/3123873052 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda50007b80 con 0x7fda60104a30 2024-08-19T01:17:33.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.615+0000 7fda577fe640 1 -- 172.21.15.17:0/3123873052 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda500054e0 con 0x7fda60104a30 2024-08-19T01:17:33.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.615+0000 7fda64c23640 1 -- 172.21.15.17:0/3123873052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda601a1d20 con 0x7fda60104a30 2024-08-19T01:17:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.615+0000 7fda577fe640 1 -- 172.21.15.17:0/3123873052 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda5000f450 con 0x7fda60104a30 2024-08-19T01:17:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.615+0000 7fda64c23640 1 -- 172.21.15.17:0/3123873052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda601a2080 con 0x7fda60104a30 2024-08-19T01:17:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.616+0000 7fda64c23640 1 -- 172.21.15.17:0/3123873052 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda60100170 con 0x7fda60104a30 2024-08-19T01:17:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.616+0000 7fda577fe640 1 -- 172.21.15.17:0/3123873052 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fda50004f60 con 0x7fda60104a30 2024-08-19T01:17:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.617+0000 7fda577fe640 1 --2- 172.21.15.17:0/3123873052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4c06e170 0x7fda4c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.617+0000 7fda577fe640 1 -- 172.21.15.17:0/3123873052 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fda5008dec0 con 0x7fda60104a30 2024-08-19T01:17:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.617+0000 7fda5e59c640 1 --2- 172.21.15.17:0/3123873052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4c06e170 0x7fda4c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.617+0000 7fda5e59c640 1 --2- 172.21.15.17:0/3123873052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4c06e170 0x7fda4c070630 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fda48009230 tx=0x7fda480058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:33.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.621+0000 7fda577fe640 1 -- 172.21.15.17:0/3123873052 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fda500572d0 con 0x7fda60104a30 2024-08-19T01:17:33.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.805+0000 7fda64c23640 1 -- 172.21.15.17:0/3123873052 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda6010bcc0 con 0x7fda4c06e170 2024-08-19T01:17:33.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.814+0000 7fda577fe640 1 -- 172.21.15.17:0/3123873052 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fda6010bcc0 con 0x7fda4c06e170 2024-08-19T01:17:33.816 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (18m) 12m ago 29m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (29m) 12m ago 29m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (28m) 12m ago 28m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (16m) 12m ago 29m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (16m) 12m ago 28m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (18m) 12m ago 29m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (12m) 12m ago 24m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (13m) 12m ago 24m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (23m) 12m ago 23m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (12m) 12m ago 24m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (20m) 12m ago 30m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:17:33.817 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (19m) 12m ago 28m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:17:33.818 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (17m) 12m ago 31m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:17:33.818 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (17m) 12m ago 28m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:17:33.818 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (19m) 12m ago 29m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:17:33.818 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (19m) 12m ago 28m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:17:33.818 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (16m) 12m ago 27m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:17:33.818 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (15m) 12m ago 27m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:17:33.818 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (15m) 12m ago 26m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:17:33.818 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (14m) 12m ago 26m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:17:33.818 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (13m) 12m ago 26m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:17:33.818 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (13m) 12m ago 25m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:17:33.818 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (19m) 12m ago 29m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:17:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.817+0000 7fda64c23640 1 -- 172.21.15.17:0/3123873052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4c06e170 msgr2=0x7fda4c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.817+0000 7fda64c23640 1 --2- 172.21.15.17:0/3123873052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4c06e170 0x7fda4c070630 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fda48009230 tx=0x7fda480058d0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.817+0000 7fda64c23640 1 -- 172.21.15.17:0/3123873052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda60104a30 msgr2=0x7fda60100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.817+0000 7fda64c23640 1 --2- 172.21.15.17:0/3123873052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda60104a30 0x7fda60100b40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fda5000c8f0 tx=0x7fda5000cdb0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.817+0000 7fda64c23640 1 -- 172.21.15.17:0/3123873052 shutdown_connections 2024-08-19T01:17:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.817+0000 7fda64c23640 1 --2- 172.21.15.17:0/3123873052 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4c06e170 0x7fda4c070630 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.817+0000 7fda64c23640 1 --2- 172.21.15.17:0/3123873052 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda60104a30 0x7fda60100b40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.817+0000 7fda64c23640 1 --2- 172.21.15.17:0/3123873052 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fea30 0x7fda60100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.817+0000 7fda64c23640 1 -- 172.21.15.17:0/3123873052 >> 172.21.15.17:0/3123873052 conn(0x7fda600fa730 msgr2=0x7fda600fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.817+0000 7fda64c23640 1 -- 172.21.15.17:0/3123873052 shutdown_connections 2024-08-19T01:17:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.817+0000 7fda64c23640 1 -- 172.21.15.17:0/3123873052 wait complete. 2024-08-19T01:17:33.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.899+0000 7fb5e306c640 1 -- 172.21.15.17:0/3755295445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5dc0ff7b0 msgr2=0x7fb5dc0ffb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.899+0000 7fb5e306c640 1 --2- 172.21.15.17:0/3755295445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5dc0ff7b0 0x7fb5dc0ffb90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009880 tx=0x7fb5cc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.899+0000 7fb5e306c640 1 -- 172.21.15.17:0/3755295445 shutdown_connections 2024-08-19T01:17:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.899+0000 7fb5e306c640 1 --2- 172.21.15.17:0/3755295445 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc100160 0x7fb5dc1036a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.899+0000 7fb5e306c640 1 --2- 172.21.15.17:0/3755295445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5dc0ff7b0 0x7fb5dc0ffb90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.899+0000 7fb5e306c640 1 -- 172.21.15.17:0/3755295445 >> 172.21.15.17:0/3755295445 conn(0x7fb5dc0f9a60 msgr2=0x7fb5dc0fbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.899+0000 7fb5e306c640 1 -- 172.21.15.17:0/3755295445 shutdown_connections 2024-08-19T01:17:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.899+0000 7fb5e306c640 1 -- 172.21.15.17:0/3755295445 wait complete. 2024-08-19T01:17:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.900+0000 7fb5e306c640 1 Processor -- start 2024-08-19T01:17:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.900+0000 7fb5e306c640 1 -- start start 2024-08-19T01:17:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.900+0000 7fb5e306c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc0ff7b0 0x7fb5dc100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.900+0000 7fb5e306c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5dc100160 0x7fb5dc100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.900+0000 7fb5e306c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc1011c0 con 0x7fb5dc100160 2024-08-19T01:17:33.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.900+0000 7fb5e306c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc101300 con 0x7fb5dc0ff7b0 2024-08-19T01:17:33.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.900+0000 7fb5dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5dc100160 0x7fb5dc100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.900+0000 7fb5dbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5dc100160 0x7fb5dc100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57838/0 (socket says 172.21.15.17:57838) 2024-08-19T01:17:33.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.900+0000 7fb5dbfff640 1 -- 172.21.15.17:0/3413429153 learned_addr learned my addr 172.21.15.17:0/3413429153 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:33.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.901+0000 7fb5e0e08640 1 --2- 172.21.15.17:0/3413429153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc0ff7b0 0x7fb5dc100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.901+0000 7fb5dbfff640 1 -- 172.21.15.17:0/3413429153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc0ff7b0 msgr2=0x7fb5dc100740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:33.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.901+0000 7fb5dbfff640 1 --2- 172.21.15.17:0/3413429153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc0ff7b0 0x7fb5dc100740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:33.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.901+0000 7fb5dbfff640 1 -- 172.21.15.17:0/3413429153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc009560 con 0x7fb5dc100160 2024-08-19T01:17:33.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.901+0000 7fb5dbfff640 1 --2- 172.21.15.17:0/3413429153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5dc100160 0x7fb5dc100c80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400c8f0 tx=0x7fb5c400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:33.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.901+0000 7fb5d9ffb640 1 -- 172.21.15.17:0/3413429153 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c4007b80 con 0x7fb5dc100160 2024-08-19T01:17:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.901+0000 7fb5d9ffb640 1 -- 172.21.15.17:0/3413429153 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5c40054e0 con 0x7fb5dc100160 2024-08-19T01:17:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.901+0000 7fb5e306c640 1 -- 172.21.15.17:0/3413429153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc1a1d30 con 0x7fb5dc100160 2024-08-19T01:17:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.901+0000 7fb5d9ffb640 1 -- 172.21.15.17:0/3413429153 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c400f450 con 0x7fb5dc100160 2024-08-19T01:17:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.901+0000 7fb5e306c640 1 -- 172.21.15.17:0/3413429153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc1a2140 con 0x7fb5dc100160 2024-08-19T01:17:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.902+0000 7fb5e306c640 1 -- 172.21.15.17:0/3413429153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc0fe020 con 0x7fb5dc100160 2024-08-19T01:17:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.903+0000 7fb5d9ffb640 1 -- 172.21.15.17:0/3413429153 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb5c4004f80 con 0x7fb5dc100160 2024-08-19T01:17:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.903+0000 7fb5d9ffb640 1 --2- 172.21.15.17:0/3413429153 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb5c806e170 0x7fb5c8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.903+0000 7fb5d9ffb640 1 -- 172.21.15.17:0/3413429153 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb5c408de50 con 0x7fb5dc100160 2024-08-19T01:17:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.903+0000 7fb5e0e08640 1 --2- 172.21.15.17:0/3413429153 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb5c806e170 0x7fb5c8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:33.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.904+0000 7fb5e0e08640 1 --2- 172.21.15.17:0/3413429153 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb5c806e170 0x7fb5c8070630 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009230 tx=0x7fb5cc0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:33.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:33.908+0000 7fb5d9ffb640 1 -- 172.21.15.17:0/3413429153 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb5c4057260 con 0x7fb5dc100160 2024-08-19T01:17:34.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.150+0000 7fb5e306c640 1 -- 172.21.15.17:0/3413429153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb5dc0ffb90 con 0x7fb5dc100160 2024-08-19T01:17:34.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:17:34.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.151+0000 7fb5d9ffb640 1 -- 172.21.15.17:0/3413429153 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7fb5c401d070 con 0x7fb5dc100160 2024-08-19T01:17:34.153 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:17:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:17:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:17:34.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:17:34.154 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:17:34.155 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:17:34.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.153+0000 7fb5e306c640 1 -- 172.21.15.17:0/3413429153 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb5c806e170 msgr2=0x7fb5c8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.153+0000 7fb5e306c640 1 --2- 172.21.15.17:0/3413429153 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb5c806e170 0x7fb5c8070630 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc009230 tx=0x7fb5cc0058d0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.153+0000 7fb5e306c640 1 -- 172.21.15.17:0/3413429153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5dc100160 msgr2=0x7fb5dc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.153+0000 7fb5e306c640 1 --2- 172.21.15.17:0/3413429153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5dc100160 0x7fb5dc100c80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb5c400c8f0 tx=0x7fb5c400cdb0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.154+0000 7fb5e306c640 1 -- 172.21.15.17:0/3413429153 shutdown_connections 2024-08-19T01:17:34.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.154+0000 7fb5e306c640 1 --2- 172.21.15.17:0/3413429153 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb5c806e170 0x7fb5c8070630 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.154+0000 7fb5e306c640 1 --2- 172.21.15.17:0/3413429153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5dc100160 0x7fb5dc100c80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.154+0000 7fb5e306c640 1 --2- 172.21.15.17:0/3413429153 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5dc0ff7b0 0x7fb5dc100740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.154+0000 7fb5e306c640 1 -- 172.21.15.17:0/3413429153 >> 172.21.15.17:0/3413429153 conn(0x7fb5dc0f9a60 msgr2=0x7fb5dc0fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:34.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.154+0000 7fb5e306c640 1 -- 172.21.15.17:0/3413429153 shutdown_connections 2024-08-19T01:17:34.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.154+0000 7fb5e306c640 1 -- 172.21.15.17:0/3413429153 wait complete. 2024-08-19T01:17:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:17:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.237+0000 7fc8542c7640 1 -- 172.21.15.17:0/2787365001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc84c100750 msgr2=0x7fc84c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.237+0000 7fc8542c7640 1 --2- 172.21.15.17:0/2787365001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc84c100750 0x7fc84c1047a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc83c009880 tx=0x7fc83c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.237+0000 7fc8542c7640 1 -- 172.21.15.17:0/2787365001 shutdown_connections 2024-08-19T01:17:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.237+0000 7fc8542c7640 1 --2- 172.21.15.17:0/2787365001 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc84c100750 0x7fc84c1047a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.237+0000 7fc8542c7640 1 --2- 172.21.15.17:0/2787365001 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c0ffda0 0x7fc84c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.237+0000 7fc8542c7640 1 -- 172.21.15.17:0/2787365001 >> 172.21.15.17:0/2787365001 conn(0x7fc84c0fb840 msgr2=0x7fc84c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.237+0000 7fc8542c7640 1 -- 172.21.15.17:0/2787365001 shutdown_connections 2024-08-19T01:17:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.237+0000 7fc8542c7640 1 -- 172.21.15.17:0/2787365001 wait complete. 2024-08-19T01:17:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.238+0000 7fc8542c7640 1 Processor -- start 2024-08-19T01:17:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.238+0000 7fc8542c7640 1 -- start start 2024-08-19T01:17:34.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.238+0000 7fc8542c7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c0ffda0 0x7fc84c19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.238+0000 7fc8542c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc84c100750 0x7fc84c19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.238+0000 7fc8542c7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c195930 con 0x7fc84c100750 2024-08-19T01:17:34.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.238+0000 7fc8542c7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c195a70 con 0x7fc84c0ffda0 2024-08-19T01:17:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.238+0000 7fc851862640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc84c100750 0x7fc84c19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.238+0000 7fc851862640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc84c100750 0x7fc84c19be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57858/0 (socket says 172.21.15.17:57858) 2024-08-19T01:17:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.238+0000 7fc851862640 1 -- 172.21.15.17:0/835259790 learned_addr learned my addr 172.21.15.17:0/835259790 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:34.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.238+0000 7fc852063640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c0ffda0 0x7fc84c19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.239+0000 7fc851862640 1 -- 172.21.15.17:0/835259790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c0ffda0 msgr2=0x7fc84c19b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.239+0000 7fc851862640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c0ffda0 0x7fc84c19b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.239+0000 7fc851862640 1 -- 172.21.15.17:0/835259790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c009560 con 0x7fc84c100750 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.239+0000 7fc852063640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c0ffda0 0x7fc84c19b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.239+0000 7fc851862640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc84c100750 0x7fc84c19be10 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc83c006010 tx=0x7fc83c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.239+0000 7fc8437fe640 1 -- 172.21.15.17:0/835259790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc83c004aa0 con 0x7fc84c100750 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.239+0000 7fc8437fe640 1 -- 172.21.15.17:0/835259790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc83c004c00 con 0x7fc84c100750 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.239+0000 7fc8542c7640 1 -- 172.21.15.17:0/835259790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84c195cf0 con 0x7fc84c100750 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.239+0000 7fc8437fe640 1 -- 172.21.15.17:0/835259790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc83c003a20 con 0x7fc84c100750 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.239+0000 7fc8542c7640 1 -- 172.21.15.17:0/835259790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c1961e0 con 0x7fc84c100750 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.240+0000 7fc8542c7640 1 -- 172.21.15.17:0/835259790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c101280 con 0x7fc84c100750 2024-08-19T01:17:34.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.241+0000 7fc8437fe640 1 -- 172.21.15.17:0/835259790 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc83c031c90 con 0x7fc84c100750 2024-08-19T01:17:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.241+0000 7fc8437fe640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc83806e180 0x7fc838070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.241+0000 7fc8437fe640 1 -- 172.21.15.17:0/835259790 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc83c0af2b0 con 0x7fc84c100750 2024-08-19T01:17:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.241+0000 7fc852063640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc83806e180 0x7fc838070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:34.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.242+0000 7fc852063640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc83806e180 0x7fc838070640 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc848005fd0 tx=0x7fc848005ea0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:34.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.246+0000 7fc8437fe640 1 -- 172.21.15.17:0/835259790 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc83c078610 con 0x7fc84c100750 2024-08-19T01:17:34.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.457+0000 7fc8542c7640 1 -- 172.21.15.17:0/835259790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc84c196ec0 con 0x7fc84c100750 2024-08-19T01:17:34.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.457+0000 7fc8437fe640 1 -- 172.21.15.17:0/835259790 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7fc83c07bcd0 con 0x7fc84c100750 2024-08-19T01:17:34.459 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:17:34.459 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:17:34.460 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:17:34.461 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:17:34.462 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:17:34.462 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:17:34.462 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:17:34.462 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:17:34.462 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:17:34.462 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:17:34.462 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:17:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:17:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:17:34.462 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:17:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:17:34.463 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:17:34.463 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:17:34.463 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:17:34.463 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:17:34.463 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:17:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.459+0000 7fc8542c7640 1 -- 172.21.15.17:0/835259790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc83806e180 msgr2=0x7fc838070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.459+0000 7fc8542c7640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc83806e180 0x7fc838070640 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc848005fd0 tx=0x7fc848005ea0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.459+0000 7fc8542c7640 1 -- 172.21.15.17:0/835259790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc84c100750 msgr2=0x7fc84c19be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.459+0000 7fc8542c7640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc84c100750 0x7fc84c19be10 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc83c006010 tx=0x7fc83c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.459+0000 7fc8542c7640 1 -- 172.21.15.17:0/835259790 shutdown_connections 2024-08-19T01:17:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.459+0000 7fc8542c7640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc83806e180 0x7fc838070640 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.459+0000 7fc8542c7640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc84c100750 0x7fc84c19be10 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.459+0000 7fc8542c7640 1 --2- 172.21.15.17:0/835259790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc84c0ffda0 0x7fc84c19b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.459+0000 7fc8542c7640 1 -- 172.21.15.17:0/835259790 >> 172.21.15.17:0/835259790 conn(0x7fc84c0fb840 msgr2=0x7fc84c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.459+0000 7fc8542c7640 1 -- 172.21.15.17:0/835259790 shutdown_connections 2024-08-19T01:17:34.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.459+0000 7fc8542c7640 1 -- 172.21.15.17:0/835259790 wait complete. 2024-08-19T01:17:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.542+0000 7fe033aa5640 1 -- 172.21.15.17:0/528517811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe02c0ffb00 msgr2=0x7fe02c0fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.542+0000 7fe033aa5640 1 --2- 172.21.15.17:0/528517811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe02c0ffb00 0x7fe02c0fff60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe020009880 tx=0x7fe02002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.542+0000 7fe033aa5640 1 -- 172.21.15.17:0/528517811 shutdown_connections 2024-08-19T01:17:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.542+0000 7fe033aa5640 1 --2- 172.21.15.17:0/528517811 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe02c0ffb00 0x7fe02c0fff60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.542+0000 7fe033aa5640 1 --2- 172.21.15.17:0/528517811 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe02c105b90 0x7fe02c105f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.542+0000 7fe033aa5640 1 -- 172.21.15.17:0/528517811 >> 172.21.15.17:0/528517811 conn(0x7fe02c0fb840 msgr2=0x7fe02c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.542+0000 7fe033aa5640 1 -- 172.21.15.17:0/528517811 shutdown_connections 2024-08-19T01:17:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.542+0000 7fe033aa5640 1 -- 172.21.15.17:0/528517811 wait complete. 2024-08-19T01:17:34.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.543+0000 7fe033aa5640 1 Processor -- start 2024-08-19T01:17:34.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.543+0000 7fe033aa5640 1 -- start start 2024-08-19T01:17:34.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.543+0000 7fe033aa5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe02c0ffb00 0x7fe02c19b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:34.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.543+0000 7fe033aa5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe02c105b90 0x7fe02c19bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:34.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.543+0000 7fe033aa5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c19c3c0 con 0x7fe02c105b90 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.543+0000 7fe033aa5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c195950 con 0x7fe02c0ffb00 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.543+0000 7fe031040640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe02c105b90 0x7fe02c19bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.543+0000 7fe031040640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe02c105b90 0x7fe02c19bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57874/0 (socket says 172.21.15.17:57874) 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.543+0000 7fe031040640 1 -- 172.21.15.17:0/2765946415 learned_addr learned my addr 172.21.15.17:0/2765946415 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.544+0000 7fe031841640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe02c0ffb00 0x7fe02c19b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.544+0000 7fe031040640 1 -- 172.21.15.17:0/2765946415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe02c0ffb00 msgr2=0x7fe02c19b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.544+0000 7fe031040640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe02c0ffb00 0x7fe02c19b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.544+0000 7fe031040640 1 -- 172.21.15.17:0/2765946415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe020009560 con 0x7fe02c105b90 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.544+0000 7fe031841640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe02c0ffb00 0x7fe02c19b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.544+0000 7fe031040640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe02c105b90 0x7fe02c19bda0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe02002a9c0 tx=0x7fe0200055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.544+0000 7fe02affd640 1 -- 172.21.15.17:0/2765946415 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe020004aa0 con 0x7fe02c105b90 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.544+0000 7fe033aa5640 1 -- 172.21.15.17:0/2765946415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02c195bd0 con 0x7fe02c105b90 2024-08-19T01:17:34.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.544+0000 7fe02affd640 1 -- 172.21.15.17:0/2765946415 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe020004c00 con 0x7fe02c105b90 2024-08-19T01:17:34.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.544+0000 7fe02affd640 1 -- 172.21.15.17:0/2765946415 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe020003ab0 con 0x7fe02c105b90 2024-08-19T01:17:34.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.544+0000 7fe033aa5640 1 -- 172.21.15.17:0/2765946415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c1960c0 con 0x7fe02c105b90 2024-08-19T01:17:34.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.545+0000 7fe033aa5640 1 -- 172.21.15.17:0/2765946415 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02c101200 con 0x7fe02c105b90 2024-08-19T01:17:34.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.546+0000 7fe02affd640 1 -- 172.21.15.17:0/2765946415 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe020031d20 con 0x7fe02c105b90 2024-08-19T01:17:34.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.546+0000 7fe02affd640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe01406e170 0x7fe014070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:34.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.546+0000 7fe02affd640 1 -- 172.21.15.17:0/2765946415 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe0200af270 con 0x7fe02c105b90 2024-08-19T01:17:34.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.546+0000 7fe031841640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe01406e170 0x7fe014070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:34.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.547+0000 7fe031841640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe01406e170 0x7fe014070630 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe01c005c40 tx=0x7fe01c0082f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:34.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.551+0000 7fe02affd640 1 -- 172.21.15.17:0/2765946415 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe020078550 con 0x7fe02c105b90 2024-08-19T01:17:34.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.742+0000 7fe033aa5640 1 -- 172.21.15.17:0/2765946415 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe02c1080e0 con 0x7fe01406e170 2024-08-19T01:17:34.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.743+0000 7fe02affd640 1 -- 172.21.15.17:0/2765946415 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe02c1080e0 con 0x7fe01406e170 2024-08-19T01:17:34.745 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:17:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:17:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:17:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:17:34.745 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:17:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:17:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:17:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:17:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:17:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:17:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:17:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:17:34.746 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:17:34.746 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:17:34.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.745+0000 7fe033aa5640 1 -- 172.21.15.17:0/2765946415 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe01406e170 msgr2=0x7fe014070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.745+0000 7fe033aa5640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe01406e170 0x7fe014070630 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe01c005c40 tx=0x7fe01c0082f0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.745+0000 7fe033aa5640 1 -- 172.21.15.17:0/2765946415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe02c105b90 msgr2=0x7fe02c19bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.745+0000 7fe033aa5640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe02c105b90 0x7fe02c19bda0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe02002a9c0 tx=0x7fe0200055a0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.745+0000 7fe033aa5640 1 -- 172.21.15.17:0/2765946415 shutdown_connections 2024-08-19T01:17:34.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.745+0000 7fe033aa5640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe01406e170 0x7fe014070630 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.745+0000 7fe033aa5640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe02c105b90 0x7fe02c19bda0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.745+0000 7fe033aa5640 1 --2- 172.21.15.17:0/2765946415 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe02c0ffb00 0x7fe02c19b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.745+0000 7fe033aa5640 1 -- 172.21.15.17:0/2765946415 >> 172.21.15.17:0/2765946415 conn(0x7fe02c0fb840 msgr2=0x7fe02c0fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:34.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.745+0000 7fe033aa5640 1 -- 172.21.15.17:0/2765946415 shutdown_connections 2024-08-19T01:17:34.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.745+0000 7fe033aa5640 1 -- 172.21.15.17:0/2765946415 wait complete. 2024-08-19T01:17:34.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.827+0000 7f5c45846640 1 -- 172.21.15.17:0/2394668218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c40100d50 msgr2=0x7f5c40101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.827+0000 7f5c45846640 1 --2- 172.21.15.17:0/2394668218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c40100d50 0x7f5c40101130 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5c30009880 tx=0x7f5c3002a530 comp rx=0 tx=0).stop 2024-08-19T01:17:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.827+0000 7f5c45846640 1 -- 172.21.15.17:0/2394668218 shutdown_connections 2024-08-19T01:17:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.827+0000 7f5c45846640 1 --2- 172.21.15.17:0/2394668218 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40101670 0x7f5c40109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.827+0000 7f5c45846640 1 --2- 172.21.15.17:0/2394668218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c40100d50 0x7f5c40101130 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.827+0000 7f5c45846640 1 -- 172.21.15.17:0/2394668218 >> 172.21.15.17:0/2394668218 conn(0x7f5c400758a0 msgr2=0x7f5c400fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.828+0000 7f5c45846640 1 -- 172.21.15.17:0/2394668218 shutdown_connections 2024-08-19T01:17:34.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.828+0000 7f5c45846640 1 -- 172.21.15.17:0/2394668218 wait complete. 2024-08-19T01:17:34.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.828+0000 7f5c45846640 1 Processor -- start 2024-08-19T01:17:34.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.828+0000 7f5c45846640 1 -- start start 2024-08-19T01:17:34.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c45846640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40100d50 0x7f5c400fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:34.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c45846640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c40101670 0x7f5c400feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:34.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c45846640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40100980 con 0x7f5c40101670 2024-08-19T01:17:34.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c45846640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400ff430 con 0x7f5c40100d50 2024-08-19T01:17:34.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c3e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c40101670 0x7f5c400feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:34.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c3e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c40101670 0x7f5c400feef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:57898/0 (socket says 172.21.15.17:57898) 2024-08-19T01:17:34.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c3e7fc640 1 -- 172.21.15.17:0/2055244344 learned_addr learned my addr 172.21.15.17:0/2055244344 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:17:34.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c3effd640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40100d50 0x7f5c400fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:34.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c3e7fc640 1 -- 172.21.15.17:0/2055244344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40100d50 msgr2=0x7f5c400fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:34.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c3e7fc640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40100d50 0x7f5c400fe9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:34.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c3e7fc640 1 -- 172.21.15.17:0/2055244344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c30009560 con 0x7f5c40101670 2024-08-19T01:17:34.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c3effd640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40100d50 0x7f5c400fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:17:34.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c3e7fc640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c40101670 0x7f5c400feef0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c8a0 tx=0x7f5c3400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:34.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c44844640 1 -- 172.21.15.17:0/2055244344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c34007b80 con 0x7f5c40101670 2024-08-19T01:17:34.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c45846640 1 -- 172.21.15.17:0/2055244344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c400ff710 con 0x7f5c40101670 2024-08-19T01:17:34.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c44844640 1 -- 172.21.15.17:0/2055244344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c34007ce0 con 0x7f5c40101670 2024-08-19T01:17:34.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c44844640 1 -- 172.21.15.17:0/2055244344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c34018810 con 0x7f5c40101670 2024-08-19T01:17:34.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.829+0000 7f5c45846640 1 -- 172.21.15.17:0/2055244344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c401a1fc0 con 0x7f5c40101670 2024-08-19T01:17:34.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.831+0000 7f5c45846640 1 -- 172.21.15.17:0/2055244344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40068470 con 0x7f5c40101670 2024-08-19T01:17:34.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.831+0000 7f5c44844640 1 -- 172.21.15.17:0/2055244344 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5c34018970 con 0x7f5c40101670 2024-08-19T01:17:34.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.832+0000 7f5c44844640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c2806e170 0x7f5c28070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:17:34.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.832+0000 7f5c3effd640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c2806e170 0x7f5c28070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:17:34.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.832+0000 7f5c44844640 1 -- 172.21.15.17:0/2055244344 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5c3408e2f0 con 0x7f5c40101670 2024-08-19T01:17:34.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.832+0000 7f5c3effd640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c2806e170 0x7f5c28070630 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5c30006010 tx=0x7f5c30031400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:17:34.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:34.836+0000 7f5c44844640 1 -- 172.21.15.17:0/2055244344 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5c34057650 con 0x7f5c40101670 2024-08-19T01:17:35.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:34 smithi017 ceph-mon[99370]: pgmap v563: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:35.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:34 smithi017 ceph-mon[99370]: from='client.35072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:35.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:34 smithi017 ceph-mon[99370]: from='client.35076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:35.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:34 smithi017 ceph-mon[99370]: from='client.35080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:35.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:34 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3413429153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:17:35.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:34 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/835259790' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:17:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.080+0000 7f5c45846640 1 -- 172.21.15.17:0/2055244344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5c4010cd80 con 0x7f5c40101670 2024-08-19T01:17:35.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.080+0000 7f5c44844640 1 -- 172.21.15.17:0/2055244344 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f5c3405ad10 con 0x7f5c40101670 2024-08-19T01:17:35.082 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:17:35.083 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:17:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:17:35.083 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:17:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:17:35.083 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:17:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:17:35.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.082+0000 7f5c45846640 1 -- 172.21.15.17:0/2055244344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c2806e170 msgr2=0x7f5c28070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.082+0000 7f5c45846640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c2806e170 0x7f5c28070630 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5c30006010 tx=0x7f5c30031400 comp rx=0 tx=0).stop 2024-08-19T01:17:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.082+0000 7f5c45846640 1 -- 172.21.15.17:0/2055244344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c40101670 msgr2=0x7f5c400feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:17:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.082+0000 7f5c45846640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c40101670 0x7f5c400feef0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400c8a0 tx=0x7f5c3400cd60 comp rx=0 tx=0).stop 2024-08-19T01:17:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.082+0000 7f5c45846640 1 -- 172.21.15.17:0/2055244344 shutdown_connections 2024-08-19T01:17:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.082+0000 7f5c45846640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c2806e170 0x7f5c28070630 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.082+0000 7f5c45846640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c40101670 0x7f5c400feef0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.083+0000 7f5c45846640 1 --2- 172.21.15.17:0/2055244344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c40100d50 0x7f5c400fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:17:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.083+0000 7f5c45846640 1 -- 172.21.15.17:0/2055244344 >> 172.21.15.17:0/2055244344 conn(0x7f5c400758a0 msgr2=0x7f5c40101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:17:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.083+0000 7f5c45846640 1 -- 172.21.15.17:0/2055244344 shutdown_connections 2024-08-19T01:17:35.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:17:35.083+0000 7f5c45846640 1 -- 172.21.15.17:0/2055244344 wait complete. 2024-08-19T01:17:35.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:34 smithi086 ceph-mon[71303]: pgmap v563: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:35.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:34 smithi086 ceph-mon[71303]: from='client.35072 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:35.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:34 smithi086 ceph-mon[71303]: from='client.35076 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:35.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:34 smithi086 ceph-mon[71303]: from='client.35080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:35.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:34 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3413429153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:17:35.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:34 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/835259790' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:17:35.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:35 smithi017 ceph-mon[99370]: from='client.35092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:35.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:35 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2055244344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:17:36.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:35 smithi086 ceph-mon[71303]: from='client.35092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:17:36.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:35 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2055244344' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:17:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:36 smithi017 ceph-mon[99370]: pgmap v564: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:37.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:36 smithi086 ceph-mon[71303]: pgmap v564: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:39.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:38 smithi017 ceph-mon[99370]: pgmap v565: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:39.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:38 smithi086 ceph-mon[71303]: pgmap v565: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:41.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:40 smithi017 ceph-mon[99370]: pgmap v566: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:41.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:40 smithi086 ceph-mon[71303]: pgmap v566: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:43.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:42 smithi017 ceph-mon[99370]: pgmap v567: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:43.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:42 smithi086 ceph-mon[71303]: pgmap v567: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:45.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:44 smithi017 ceph-mon[99370]: pgmap v568: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:45.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:44 smithi086 ceph-mon[71303]: pgmap v568: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:46 smithi017 ceph-mon[99370]: pgmap v569: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:47.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:46 smithi086 ceph-mon[71303]: pgmap v569: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:48 smithi017 ceph-mon[99370]: pgmap v570: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:17:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:48 smithi086 ceph-mon[71303]: pgmap v570: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:17:51.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:50 smithi017 ceph-mon[99370]: pgmap v571: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:51.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:50 smithi086 ceph-mon[71303]: pgmap v571: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:53.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:52 smithi017 ceph-mon[99370]: pgmap v572: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:53.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:52 smithi086 ceph-mon[71303]: pgmap v572: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:55.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:54 smithi017 ceph-mon[99370]: pgmap v573: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:55.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:54 smithi086 ceph-mon[71303]: pgmap v573: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:57.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:56 smithi017 ceph-mon[99370]: pgmap v574: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:57.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:56 smithi086 ceph-mon[71303]: pgmap v574: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:59.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:17:58 smithi017 ceph-mon[99370]: pgmap v575: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:17:59.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:17:58 smithi086 ceph-mon[71303]: pgmap v575: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:01.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:00 smithi017 ceph-mon[99370]: pgmap v576: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:01.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:00 smithi086 ceph-mon[71303]: pgmap v576: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:03.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:02 smithi017 ceph-mon[99370]: pgmap v577: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:02 smithi086 ceph-mon[71303]: pgmap v577: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:18:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:18:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.176+0000 7f360facb640 1 -- 172.21.15.17:0/3922496463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36080fe840 msgr2=0x7f36080fec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.176+0000 7f360facb640 1 --2- 172.21.15.17:0/3922496463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36080fe840 0x7f36080fec20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3600009880 tx=0x7f360002a490 comp rx=0 tx=0).stop 2024-08-19T01:18:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.176+0000 7f360facb640 1 -- 172.21.15.17:0/3922496463 shutdown_connections 2024-08-19T01:18:05.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.176+0000 7f360facb640 1 --2- 172.21.15.17:0/3922496463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36080ff1f0 0x7f360810beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.179 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:04 smithi017 ceph-mon[99370]: pgmap v578: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:05.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.176+0000 7f360facb640 1 --2- 172.21.15.17:0/3922496463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36080fe840 0x7f36080fec20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.176+0000 7f360facb640 1 -- 172.21.15.17:0/3922496463 >> 172.21.15.17:0/3922496463 conn(0x7f36080758a0 msgr2=0x7f36080fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:05.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.176+0000 7f360facb640 1 -- 172.21.15.17:0/3922496463 shutdown_connections 2024-08-19T01:18:05.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.176+0000 7f360facb640 1 -- 172.21.15.17:0/3922496463 wait complete. 2024-08-19T01:18:05.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360facb640 1 Processor -- start 2024-08-19T01:18:05.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360facb640 1 -- start start 2024-08-19T01:18:05.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360facb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36080fe840 0x7f360819d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:05.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360facb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36080ff1f0 0x7f360819df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:05.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360facb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360819e520 con 0x7f36080fe840 2024-08-19T01:18:05.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360facb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3608197ab0 con 0x7f36080ff1f0 2024-08-19T01:18:05.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360d867640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36080fe840 0x7f360819d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:05.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360d867640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36080fe840 0x7f360819d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42172/0 (socket says 172.21.15.17:42172) 2024-08-19T01:18:05.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360d867640 1 -- 172.21.15.17:0/3675572760 learned_addr learned my addr 172.21.15.17:0/3675572760 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:05.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360d066640 1 --2- 172.21.15.17:0/3675572760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36080ff1f0 0x7f360819df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:05.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360d867640 1 -- 172.21.15.17:0/3675572760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36080ff1f0 msgr2=0x7f360819df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360d867640 1 --2- 172.21.15.17:0/3675572760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36080ff1f0 0x7f360819df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.177+0000 7f360d867640 1 -- 172.21.15.17:0/3675572760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3600009560 con 0x7f36080fe840 2024-08-19T01:18:05.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.178+0000 7f360d867640 1 --2- 172.21.15.17:0/3675572760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36080fe840 0x7f360819d9c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3600006010 tx=0x7f36000055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:05.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.178+0000 7f3606ffd640 1 -- 172.21.15.17:0/3675572760 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3600004aa0 con 0x7f36080fe840 2024-08-19T01:18:05.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.178+0000 7f3606ffd640 1 -- 172.21.15.17:0/3675572760 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3600031470 con 0x7f36080fe840 2024-08-19T01:18:05.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.178+0000 7f360facb640 1 -- 172.21.15.17:0/3675572760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3608197d30 con 0x7f36080fe840 2024-08-19T01:18:05.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.178+0000 7f3606ffd640 1 -- 172.21.15.17:0/3675572760 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3600003940 con 0x7f36080fe840 2024-08-19T01:18:05.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.178+0000 7f360facb640 1 -- 172.21.15.17:0/3675572760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3608198280 con 0x7f36080fe840 2024-08-19T01:18:05.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.179+0000 7f360facb640 1 -- 172.21.15.17:0/3675572760 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3608068510 con 0x7f36080fe840 2024-08-19T01:18:05.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.179+0000 7f3606ffd640 1 -- 172.21.15.17:0/3675572760 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3600031b90 con 0x7f36080fe840 2024-08-19T01:18:05.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.180+0000 7f3606ffd640 1 --2- 172.21.15.17:0/3675572760 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35f006e180 0x7f35f0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:05.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.180+0000 7f3606ffd640 1 -- 172.21.15.17:0/3675572760 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f36000af270 con 0x7f36080fe840 2024-08-19T01:18:05.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.180+0000 7f360d066640 1 --2- 172.21.15.17:0/3675572760 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35f006e180 0x7f35f0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:05.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.181+0000 7f360d066640 1 --2- 172.21.15.17:0/3675572760 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35f006e180 0x7f35f0070640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3608198f20 tx=0x7f35fc00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:05.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.185+0000 7f3606ffd640 1 -- 172.21.15.17:0/3675572760 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f36000785a0 con 0x7f36080fe840 2024-08-19T01:18:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:04 smithi086 ceph-mon[71303]: pgmap v578: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:05.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.381+0000 7f360facb640 1 -- 172.21.15.17:0/3675572760 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36081067a0 con 0x7f35f006e180 2024-08-19T01:18:05.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.382+0000 7f3606ffd640 1 -- 172.21.15.17:0/3675572760 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f36081067a0 con 0x7f35f006e180 2024-08-19T01:18:05.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.384+0000 7f360facb640 1 -- 172.21.15.17:0/3675572760 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35f006e180 msgr2=0x7f35f0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.384+0000 7f360facb640 1 --2- 172.21.15.17:0/3675572760 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35f006e180 0x7f35f0070640 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3608198f20 tx=0x7f35fc00b390 comp rx=0 tx=0).stop 2024-08-19T01:18:05.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.384+0000 7f360facb640 1 -- 172.21.15.17:0/3675572760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36080fe840 msgr2=0x7f360819d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.384+0000 7f360facb640 1 --2- 172.21.15.17:0/3675572760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36080fe840 0x7f360819d9c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3600006010 tx=0x7f36000055a0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.384+0000 7f360facb640 1 -- 172.21.15.17:0/3675572760 shutdown_connections 2024-08-19T01:18:05.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.384+0000 7f360facb640 1 --2- 172.21.15.17:0/3675572760 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35f006e180 0x7f35f0070640 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.384+0000 7f360facb640 1 --2- 172.21.15.17:0/3675572760 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36080ff1f0 0x7f360819df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.384+0000 7f360facb640 1 --2- 172.21.15.17:0/3675572760 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36080fe840 0x7f360819d9c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.384+0000 7f360facb640 1 -- 172.21.15.17:0/3675572760 >> 172.21.15.17:0/3675572760 conn(0x7f36080758a0 msgr2=0x7f36080fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:05.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.384+0000 7f360facb640 1 -- 172.21.15.17:0/3675572760 shutdown_connections 2024-08-19T01:18:05.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.384+0000 7f360facb640 1 -- 172.21.15.17:0/3675572760 wait complete. 2024-08-19T01:18:05.432 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:18:05.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.468+0000 7f193bf49640 1 -- 172.21.15.17:0/2793109731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1934100750 msgr2=0x7f19341047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.468+0000 7f193bf49640 1 --2- 172.21.15.17:0/2793109731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1934100750 0x7f19341047a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1924009880 tx=0x7f192402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.468+0000 7f193bf49640 1 -- 172.21.15.17:0/2793109731 shutdown_connections 2024-08-19T01:18:05.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.468+0000 7f193bf49640 1 --2- 172.21.15.17:0/2793109731 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1934100750 0x7f19341047a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.468+0000 7f193bf49640 1 --2- 172.21.15.17:0/2793109731 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f19340ffda0 0x7f1934100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.468+0000 7f193bf49640 1 -- 172.21.15.17:0/2793109731 >> 172.21.15.17:0/2793109731 conn(0x7f19340fb840 msgr2=0x7f19340fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:05.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.468+0000 7f193bf49640 1 -- 172.21.15.17:0/2793109731 shutdown_connections 2024-08-19T01:18:05.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.468+0000 7f193bf49640 1 -- 172.21.15.17:0/2793109731 wait complete. 2024-08-19T01:18:05.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.469+0000 7f193bf49640 1 Processor -- start 2024-08-19T01:18:05.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.469+0000 7f193bf49640 1 -- start start 2024-08-19T01:18:05.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.469+0000 7f193bf49640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19340ffda0 0x7f19340727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:05.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.469+0000 7f193bf49640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1934100750 0x7f1934072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:05.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.469+0000 7f193bf49640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1934073230 con 0x7f19340ffda0 2024-08-19T01:18:05.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.469+0000 7f193bf49640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19340733a0 con 0x7f1934100750 2024-08-19T01:18:05.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.469+0000 7f1939ce5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19340ffda0 0x7f19340727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:05.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.469+0000 7f1939ce5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19340ffda0 0x7f19340727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42202/0 (socket says 172.21.15.17:42202) 2024-08-19T01:18:05.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.469+0000 7f1939ce5640 1 -- 172.21.15.17:0/1422244849 learned_addr learned my addr 172.21.15.17:0/1422244849 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:05.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.470+0000 7f19394e4640 1 --2- 172.21.15.17:0/1422244849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1934100750 0x7f1934072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:05.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.470+0000 7f1939ce5640 1 -- 172.21.15.17:0/1422244849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1934100750 msgr2=0x7f1934072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.470+0000 7f1939ce5640 1 --2- 172.21.15.17:0/1422244849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1934100750 0x7f1934072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.470+0000 7f1939ce5640 1 -- 172.21.15.17:0/1422244849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009560 con 0x7f19340ffda0 2024-08-19T01:18:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.470+0000 7f1939ce5640 1 --2- 172.21.15.17:0/1422244849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19340ffda0 0x7f19340727b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f193000d8d0 tx=0x7f193000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.470+0000 7f192affd640 1 -- 172.21.15.17:0/1422244849 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f193000bea0 con 0x7f19340ffda0 2024-08-19T01:18:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.470+0000 7f192affd640 1 -- 172.21.15.17:0/1422244849 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1930009c00 con 0x7f19340ffda0 2024-08-19T01:18:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.470+0000 7f192affd640 1 -- 172.21.15.17:0/1422244849 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f193000f710 con 0x7f19340ffda0 2024-08-19T01:18:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.470+0000 7f193bf49640 1 -- 172.21.15.17:0/1422244849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19341a1c90 con 0x7f19340ffda0 2024-08-19T01:18:05.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.470+0000 7f193bf49640 1 -- 172.21.15.17:0/1422244849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19341a1ff0 con 0x7f19340ffda0 2024-08-19T01:18:05.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.471+0000 7f193bf49640 1 -- 172.21.15.17:0/1422244849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1934101280 con 0x7f19340ffda0 2024-08-19T01:18:05.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.472+0000 7f192affd640 1 -- 172.21.15.17:0/1422244849 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f193000f990 con 0x7f19340ffda0 2024-08-19T01:18:05.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.472+0000 7f192affd640 1 --2- 172.21.15.17:0/1422244849 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f192006e170 0x7f1920070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:05.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.472+0000 7f192affd640 1 -- 172.21.15.17:0/1422244849 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f193008df20 con 0x7f19340ffda0 2024-08-19T01:18:05.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.472+0000 7f19394e4640 1 --2- 172.21.15.17:0/1422244849 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f192006e170 0x7f1920070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:05.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.473+0000 7f19394e4640 1 --2- 172.21.15.17:0/1422244849 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f192006e170 0x7f1920070630 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1924000c00 tx=0x7f1924004040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:05.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.476+0000 7f192affd640 1 -- 172.21.15.17:0/1422244849 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f19300c2df0 con 0x7f19340ffda0 2024-08-19T01:18:05.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.669+0000 7f193bf49640 1 -- 172.21.15.17:0/1422244849 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f193410cdb0 con 0x7f192006e170 2024-08-19T01:18:05.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.670+0000 7f192affd640 1 -- 172.21.15.17:0/1422244849 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f193410cdb0 con 0x7f192006e170 2024-08-19T01:18:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.672+0000 7f193bf49640 1 -- 172.21.15.17:0/1422244849 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f192006e170 msgr2=0x7f1920070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.672+0000 7f193bf49640 1 --2- 172.21.15.17:0/1422244849 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f192006e170 0x7f1920070630 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1924000c00 tx=0x7f1924004040 comp rx=0 tx=0).stop 2024-08-19T01:18:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.672+0000 7f193bf49640 1 -- 172.21.15.17:0/1422244849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19340ffda0 msgr2=0x7f19340727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.672+0000 7f193bf49640 1 --2- 172.21.15.17:0/1422244849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19340ffda0 0x7f19340727b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f193000d8d0 tx=0x7f193000dd90 comp rx=0 tx=0).stop 2024-08-19T01:18:05.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.672+0000 7f193bf49640 1 -- 172.21.15.17:0/1422244849 shutdown_connections 2024-08-19T01:18:05.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.672+0000 7f193bf49640 1 --2- 172.21.15.17:0/1422244849 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f192006e170 0x7f1920070630 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.672+0000 7f193bf49640 1 --2- 172.21.15.17:0/1422244849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1934100750 0x7f1934072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.672+0000 7f193bf49640 1 --2- 172.21.15.17:0/1422244849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f19340ffda0 0x7f19340727b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.672+0000 7f193bf49640 1 -- 172.21.15.17:0/1422244849 >> 172.21.15.17:0/1422244849 conn(0x7f19340fb840 msgr2=0x7f19340fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:05.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.672+0000 7f193bf49640 1 -- 172.21.15.17:0/1422244849 shutdown_connections 2024-08-19T01:18:05.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.672+0000 7f193bf49640 1 -- 172.21.15.17:0/1422244849 wait complete. 2024-08-19T01:18:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.755+0000 7fd32bac5640 1 -- 172.21.15.17:0/2863075544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd324100750 msgr2=0x7fd3241047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.755+0000 7fd32bac5640 1 --2- 172.21.15.17:0/2863075544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd324100750 0x7fd3241047a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd318009880 tx=0x7fd31802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.755+0000 7fd32bac5640 1 -- 172.21.15.17:0/2863075544 shutdown_connections 2024-08-19T01:18:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.755+0000 7fd32bac5640 1 --2- 172.21.15.17:0/2863075544 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd324100750 0x7fd3241047a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.755+0000 7fd32bac5640 1 --2- 172.21.15.17:0/2863075544 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3240ffda0 0x7fd324100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.755+0000 7fd32bac5640 1 -- 172.21.15.17:0/2863075544 >> 172.21.15.17:0/2863075544 conn(0x7fd3240fb840 msgr2=0x7fd3240fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.755+0000 7fd32bac5640 1 -- 172.21.15.17:0/2863075544 shutdown_connections 2024-08-19T01:18:05.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.755+0000 7fd32bac5640 1 -- 172.21.15.17:0/2863075544 wait complete. 2024-08-19T01:18:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.755+0000 7fd32bac5640 1 Processor -- start 2024-08-19T01:18:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd32bac5640 1 -- start start 2024-08-19T01:18:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd32bac5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3240ffda0 0x7fd32419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd32bac5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd324100750 0x7fd32419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd32bac5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324195930 con 0x7fd324100750 2024-08-19T01:18:05.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd32bac5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324195a70 con 0x7fd3240ffda0 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd329060640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd324100750 0x7fd32419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd329060640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd324100750 0x7fd32419be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42226/0 (socket says 172.21.15.17:42226) 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd329060640 1 -- 172.21.15.17:0/3347412051 learned_addr learned my addr 172.21.15.17:0/3347412051 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd329861640 1 --2- 172.21.15.17:0/3347412051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3240ffda0 0x7fd32419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd329060640 1 -- 172.21.15.17:0/3347412051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3240ffda0 msgr2=0x7fd32419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd329060640 1 --2- 172.21.15.17:0/3347412051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3240ffda0 0x7fd32419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd329060640 1 -- 172.21.15.17:0/3347412051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318009560 con 0x7fd324100750 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.756+0000 7fd329060640 1 --2- 172.21.15.17:0/3347412051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd324100750 0x7fd32419be10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd31802a9c0 tx=0x7fd3180055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.757+0000 7fd316ffd640 1 -- 172.21.15.17:0/3347412051 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd318004aa0 con 0x7fd324100750 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.757+0000 7fd32bac5640 1 -- 172.21.15.17:0/3347412051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd324195cf0 con 0x7fd324100750 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.757+0000 7fd316ffd640 1 -- 172.21.15.17:0/3347412051 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd318004c00 con 0x7fd324100750 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.757+0000 7fd316ffd640 1 -- 172.21.15.17:0/3347412051 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd318003980 con 0x7fd324100750 2024-08-19T01:18:05.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.757+0000 7fd32bac5640 1 -- 172.21.15.17:0/3347412051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3241961e0 con 0x7fd324100750 2024-08-19T01:18:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.758+0000 7fd32bac5640 1 -- 172.21.15.17:0/3347412051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd324101280 con 0x7fd324100750 2024-08-19T01:18:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.759+0000 7fd316ffd640 1 -- 172.21.15.17:0/3347412051 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd318003bf0 con 0x7fd324100750 2024-08-19T01:18:05.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.759+0000 7fd316ffd640 1 --2- 172.21.15.17:0/3347412051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd31006e170 0x7fd310070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:05.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.759+0000 7fd316ffd640 1 -- 172.21.15.17:0/3347412051 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd3180af160 con 0x7fd324100750 2024-08-19T01:18:05.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.759+0000 7fd329861640 1 --2- 172.21.15.17:0/3347412051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd31006e170 0x7fd310070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:05.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.760+0000 7fd329861640 1 --2- 172.21.15.17:0/3347412051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd31006e170 0x7fd310070630 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd320005fd0 tx=0x7fd32000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:05.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.764+0000 7fd316ffd640 1 -- 172.21.15.17:0/3347412051 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd3180784f0 con 0x7fd324100750 2024-08-19T01:18:05.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.947+0000 7fd32bac5640 1 -- 172.21.15.17:0/3347412051 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd32410cdd0 con 0x7fd31006e170 2024-08-19T01:18:05.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.957+0000 7fd316ffd640 1 -- 172.21.15.17:0/3347412051 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd32410cdd0 con 0x7fd31006e170 2024-08-19T01:18:05.959 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:18:05.959 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (19m) 13m ago 29m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:18:05.959 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (30m) 13m ago 30m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:18:05.959 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (29m) 13m ago 29m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:18:05.959 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (17m) 13m ago 30m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:18:05.959 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (17m) 13m ago 29m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:18:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (19m) 13m ago 29m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:18:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (13m) 13m ago 24m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:18:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (13m) 13m ago 24m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:18:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (24m) 13m ago 24m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:18:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (13m) 13m ago 24m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:18:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (21m) 13m ago 31m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:18:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (20m) 13m ago 29m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:18:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (18m) 13m ago 31m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:18:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (17m) 13m ago 28m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:18:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (20m) 13m ago 30m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:18:05.960 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (19m) 13m ago 29m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:18:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (16m) 13m ago 28m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:18:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (16m) 13m ago 27m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:18:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (15m) 13m ago 27m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:18:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (15m) 13m ago 26m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:18:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (14m) 13m ago 26m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:18:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (13m) 13m ago 26m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:18:05.961 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (19m) 13m ago 29m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:18:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.959+0000 7fd32bac5640 1 -- 172.21.15.17:0/3347412051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd31006e170 msgr2=0x7fd310070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.959+0000 7fd32bac5640 1 --2- 172.21.15.17:0/3347412051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd31006e170 0x7fd310070630 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd320005fd0 tx=0x7fd32000b390 comp rx=0 tx=0).stop 2024-08-19T01:18:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.959+0000 7fd32bac5640 1 -- 172.21.15.17:0/3347412051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd324100750 msgr2=0x7fd32419be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.959+0000 7fd32bac5640 1 --2- 172.21.15.17:0/3347412051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd324100750 0x7fd32419be10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd31802a9c0 tx=0x7fd3180055a0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.959+0000 7fd32bac5640 1 -- 172.21.15.17:0/3347412051 shutdown_connections 2024-08-19T01:18:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.959+0000 7fd32bac5640 1 --2- 172.21.15.17:0/3347412051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd31006e170 0x7fd310070630 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.959+0000 7fd32bac5640 1 --2- 172.21.15.17:0/3347412051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd324100750 0x7fd32419be10 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.959+0000 7fd32bac5640 1 --2- 172.21.15.17:0/3347412051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3240ffda0 0x7fd32419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.959+0000 7fd32bac5640 1 -- 172.21.15.17:0/3347412051 >> 172.21.15.17:0/3347412051 conn(0x7fd3240fb840 msgr2=0x7fd3240fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.959+0000 7fd32bac5640 1 -- 172.21.15.17:0/3347412051 shutdown_connections 2024-08-19T01:18:05.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:05.959+0000 7fd32bac5640 1 -- 172.21.15.17:0/3347412051 wait complete. 2024-08-19T01:18:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.040+0000 7f9b1ef87640 1 -- 172.21.15.17:0/1563691084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b180ffda0 msgr2=0x7f9b18100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.040+0000 7f9b1ef87640 1 --2- 172.21.15.17:0/1563691084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b180ffda0 0x7f9b18100180 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f9b10009c20 tx=0x7f9b1002a970 comp rx=0 tx=0).stop 2024-08-19T01:18:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.040+0000 7f9b1ef87640 1 -- 172.21.15.17:0/1563691084 shutdown_connections 2024-08-19T01:18:06.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.040+0000 7f9b1ef87640 1 --2- 172.21.15.17:0/1563691084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b18100750 0x7f9b181047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.040+0000 7f9b1ef87640 1 --2- 172.21.15.17:0/1563691084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b180ffda0 0x7f9b18100180 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.040+0000 7f9b1ef87640 1 -- 172.21.15.17:0/1563691084 >> 172.21.15.17:0/1563691084 conn(0x7f9b180fb840 msgr2=0x7f9b180fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:06.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.040+0000 7f9b1ef87640 1 -- 172.21.15.17:0/1563691084 shutdown_connections 2024-08-19T01:18:06.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.040+0000 7f9b1ef87640 1 -- 172.21.15.17:0/1563691084 wait complete. 2024-08-19T01:18:06.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b1ef87640 1 Processor -- start 2024-08-19T01:18:06.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b1ef87640 1 -- start start 2024-08-19T01:18:06.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b1ef87640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b180ffda0 0x7f9b180727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b1ef87640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b18100750 0x7f9b18072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b1ef87640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18073230 con 0x7f9b18100750 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b1ef87640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180733a0 con 0x7f9b180ffda0 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b17fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b18100750 0x7f9b18072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b17fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b18100750 0x7f9b18072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42232/0 (socket says 172.21.15.17:42232) 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b17fff640 1 -- 172.21.15.17:0/2303186526 learned_addr learned my addr 172.21.15.17:0/2303186526 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b1cd23640 1 --2- 172.21.15.17:0/2303186526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b180ffda0 0x7f9b180727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b17fff640 1 -- 172.21.15.17:0/2303186526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b180ffda0 msgr2=0x7f9b180727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b17fff640 1 --2- 172.21.15.17:0/2303186526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b180ffda0 0x7f9b180727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.041+0000 7f9b17fff640 1 -- 172.21.15.17:0/2303186526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10009900 con 0x7f9b18100750 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.042+0000 7f9b17fff640 1 --2- 172.21.15.17:0/2303186526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b18100750 0x7f9b18072cf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800b420 tx=0x7f9b0800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:06.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.042+0000 7f9b15ffb640 1 -- 172.21.15.17:0/2303186526 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b08011800 con 0x7f9b18100750 2024-08-19T01:18:06.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.042+0000 7f9b15ffb640 1 -- 172.21.15.17:0/2303186526 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9b08011e20 con 0x7f9b18100750 2024-08-19T01:18:06.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.042+0000 7f9b1ef87640 1 -- 172.21.15.17:0/2303186526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b181a1d90 con 0x7f9b18100750 2024-08-19T01:18:06.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.042+0000 7f9b15ffb640 1 -- 172.21.15.17:0/2303186526 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b0800f2e0 con 0x7f9b18100750 2024-08-19T01:18:06.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.042+0000 7f9b1ef87640 1 -- 172.21.15.17:0/2303186526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b181a20f0 con 0x7f9b18100750 2024-08-19T01:18:06.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.043+0000 7f9b1ef87640 1 -- 172.21.15.17:0/2303186526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b18101280 con 0x7f9b18100750 2024-08-19T01:18:06.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.044+0000 7f9b15ffb640 1 -- 172.21.15.17:0/2303186526 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9b08010380 con 0x7f9b18100750 2024-08-19T01:18:06.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.044+0000 7f9b15ffb640 1 --2- 172.21.15.17:0/2303186526 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9b0406e180 0x7f9b04070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.044+0000 7f9b1cd23640 1 --2- 172.21.15.17:0/2303186526 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9b0406e180 0x7f9b04070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.044+0000 7f9b15ffb640 1 -- 172.21.15.17:0/2303186526 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9b0808db50 con 0x7f9b18100750 2024-08-19T01:18:06.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.045+0000 7f9b1cd23640 1 --2- 172.21.15.17:0/2303186526 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9b0406e180 0x7f9b04070640 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9b10000f80 tx=0x7f9b10009360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:06.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.049+0000 7f9b15ffb640 1 -- 172.21.15.17:0/2303186526 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9b08056dd0 con 0x7f9b18100750 2024-08-19T01:18:06.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.297+0000 7f9b1ef87640 1 -- 172.21.15.17:0/2303186526 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9b181080b0 con 0x7f9b18100750 2024-08-19T01:18:06.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.298+0000 7f9b15ffb640 1 -- 172.21.15.17:0/2303186526 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f9b0805a490 con 0x7f9b18100750 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:18:06.300 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:18:06.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:18:06.301 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:18:06.301 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:18:06.301 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:18:06.301 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:18:06.301 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:18:06.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.300+0000 7f9b1ef87640 1 -- 172.21.15.17:0/2303186526 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9b0406e180 msgr2=0x7f9b04070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.300+0000 7f9b1ef87640 1 --2- 172.21.15.17:0/2303186526 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9b0406e180 0x7f9b04070640 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9b10000f80 tx=0x7f9b10009360 comp rx=0 tx=0).stop 2024-08-19T01:18:06.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.300+0000 7f9b1ef87640 1 -- 172.21.15.17:0/2303186526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b18100750 msgr2=0x7f9b18072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.300+0000 7f9b1ef87640 1 --2- 172.21.15.17:0/2303186526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b18100750 0x7f9b18072cf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800b420 tx=0x7f9b0800b8e0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.300+0000 7f9b1ef87640 1 -- 172.21.15.17:0/2303186526 shutdown_connections 2024-08-19T01:18:06.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.300+0000 7f9b1ef87640 1 --2- 172.21.15.17:0/2303186526 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9b0406e180 0x7f9b04070640 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.300+0000 7f9b1ef87640 1 --2- 172.21.15.17:0/2303186526 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9b18100750 0x7f9b18072cf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.300+0000 7f9b1ef87640 1 --2- 172.21.15.17:0/2303186526 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9b180ffda0 0x7f9b180727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.300+0000 7f9b1ef87640 1 -- 172.21.15.17:0/2303186526 >> 172.21.15.17:0/2303186526 conn(0x7f9b180fb840 msgr2=0x7f9b180fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:06.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.300+0000 7f9b1ef87640 1 -- 172.21.15.17:0/2303186526 shutdown_connections 2024-08-19T01:18:06.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.300+0000 7f9b1ef87640 1 -- 172.21.15.17:0/2303186526 wait complete. 2024-08-19T01:18:06.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.382+0000 7fcb54bae640 1 -- 172.21.15.17:0/13489915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb50105c00 msgr2=0x7fcb50105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.382+0000 7fcb54bae640 1 --2- 172.21.15.17:0/13489915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb50105c00 0x7fcb50105fe0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009c20 tx=0x7fcb4002a970 comp rx=0 tx=0).stop 2024-08-19T01:18:06.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.382+0000 7fcb54bae640 1 -- 172.21.15.17:0/13489915 shutdown_connections 2024-08-19T01:18:06.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.382+0000 7fcb54bae640 1 --2- 172.21.15.17:0/13489915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb500ffb50 0x7fcb500fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.382+0000 7fcb54bae640 1 --2- 172.21.15.17:0/13489915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb50105c00 0x7fcb50105fe0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.382+0000 7fcb54bae640 1 -- 172.21.15.17:0/13489915 >> 172.21.15.17:0/13489915 conn(0x7fcb500fb830 msgr2=0x7fcb500fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:06.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.383+0000 7fcb54bae640 1 -- 172.21.15.17:0/13489915 shutdown_connections 2024-08-19T01:18:06.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.383+0000 7fcb54bae640 1 -- 172.21.15.17:0/13489915 wait complete. 2024-08-19T01:18:06.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.383+0000 7fcb54bae640 1 Processor -- start 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.383+0000 7fcb54bae640 1 -- start start 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.383+0000 7fcb54bae640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb500ffb50 0x7fcb5019b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.383+0000 7fcb54bae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb50105c00 0x7fcb5019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb54bae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5019c2c0 con 0x7fcb50105c00 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb54bae640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb501958e0 con 0x7fcb500ffb50 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb4dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb50105c00 0x7fcb5019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb4dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb50105c00 0x7fcb5019bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42260/0 (socket says 172.21.15.17:42260) 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb4dd9b640 1 -- 172.21.15.17:0/3751845968 learned_addr learned my addr 172.21.15.17:0/3751845968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb4e59c640 1 --2- 172.21.15.17:0/3751845968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb500ffb50 0x7fcb5019b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb4dd9b640 1 -- 172.21.15.17:0/3751845968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb500ffb50 msgr2=0x7fcb5019b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb4dd9b640 1 --2- 172.21.15.17:0/3751845968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb500ffb50 0x7fcb5019b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb4dd9b640 1 -- 172.21.15.17:0/3751845968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40009900 con 0x7fcb50105c00 2024-08-19T01:18:06.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb4dd9b640 1 --2- 172.21.15.17:0/3751845968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb50105c00 0x7fcb5019bd30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c8a0 tx=0x7fcb4400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:06.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb3f7fe640 1 -- 172.21.15.17:0/3751845968 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb44007b80 con 0x7fcb50105c00 2024-08-19T01:18:06.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb3f7fe640 1 -- 172.21.15.17:0/3751845968 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb44007ce0 con 0x7fcb50105c00 2024-08-19T01:18:06.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb54bae640 1 -- 172.21.15.17:0/3751845968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb50195bc0 con 0x7fcb50105c00 2024-08-19T01:18:06.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb3f7fe640 1 -- 172.21.15.17:0/3751845968 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb44018810 con 0x7fcb50105c00 2024-08-19T01:18:06.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.384+0000 7fcb54bae640 1 -- 172.21.15.17:0/3751845968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb50196190 con 0x7fcb50105c00 2024-08-19T01:18:06.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.385+0000 7fcb54bae640 1 -- 172.21.15.17:0/3751845968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb50101200 con 0x7fcb50105c00 2024-08-19T01:18:06.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.386+0000 7fcb3f7fe640 1 -- 172.21.15.17:0/3751845968 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcb44018970 con 0x7fcb50105c00 2024-08-19T01:18:06.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.386+0000 7fcb3f7fe640 1 --2- 172.21.15.17:0/3751845968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb3806e170 0x7fcb38070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.387+0000 7fcb3f7fe640 1 -- 172.21.15.17:0/3751845968 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcb4408e200 con 0x7fcb50105c00 2024-08-19T01:18:06.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.387+0000 7fcb4e59c640 1 --2- 172.21.15.17:0/3751845968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb3806e170 0x7fcb38070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.387+0000 7fcb4e59c640 1 --2- 172.21.15.17:0/3751845968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb3806e170 0x7fcb38070630 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcb40000f80 tx=0x7fcb4003d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:06.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.391+0000 7fcb3f7fe640 1 -- 172.21.15.17:0/3751845968 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcb44057560 con 0x7fcb50105c00 2024-08-19T01:18:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.600+0000 7fcb54bae640 1 -- 172.21.15.17:0/3751845968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcb500fffb0 con 0x7fcb50105c00 2024-08-19T01:18:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.600+0000 7fcb3f7fe640 1 -- 172.21.15.17:0/3751845968 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7fcb4405ac20 con 0x7fcb50105c00 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:18:06.603 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:18:06.604 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:18:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:18:06.606 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:18:06.606 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:18:06.606 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:18:06.606 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.602+0000 7fcb54bae640 1 -- 172.21.15.17:0/3751845968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb3806e170 msgr2=0x7fcb38070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.602+0000 7fcb54bae640 1 --2- 172.21.15.17:0/3751845968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb3806e170 0x7fcb38070630 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcb40000f80 tx=0x7fcb4003d040 comp rx=0 tx=0).stop 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.602+0000 7fcb54bae640 1 -- 172.21.15.17:0/3751845968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb50105c00 msgr2=0x7fcb5019bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.602+0000 7fcb54bae640 1 --2- 172.21.15.17:0/3751845968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb50105c00 0x7fcb5019bd30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400c8a0 tx=0x7fcb4400cd60 comp rx=0 tx=0).stop 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.602+0000 7fcb54bae640 1 -- 172.21.15.17:0/3751845968 shutdown_connections 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.602+0000 7fcb54bae640 1 --2- 172.21.15.17:0/3751845968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb3806e170 0x7fcb38070630 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.602+0000 7fcb54bae640 1 --2- 172.21.15.17:0/3751845968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb50105c00 0x7fcb5019bd30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.602+0000 7fcb54bae640 1 --2- 172.21.15.17:0/3751845968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb500ffb50 0x7fcb5019b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.602+0000 7fcb54bae640 1 -- 172.21.15.17:0/3751845968 >> 172.21.15.17:0/3751845968 conn(0x7fcb500fb830 msgr2=0x7fcb500fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.603+0000 7fcb54bae640 1 -- 172.21.15.17:0/3751845968 shutdown_connections 2024-08-19T01:18:06.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.603+0000 7fcb54bae640 1 -- 172.21.15.17:0/3751845968 wait complete. 2024-08-19T01:18:06.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.685+0000 7f232e4cc640 1 -- 172.21.15.17:0/3158316971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2328100750 msgr2=0x7f23281047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.685+0000 7f232e4cc640 1 --2- 172.21.15.17:0/3158316971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2328100750 0x7f23281047a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f231c009880 tx=0x7f231c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.685+0000 7f232e4cc640 1 -- 172.21.15.17:0/3158316971 shutdown_connections 2024-08-19T01:18:06.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.685+0000 7f232e4cc640 1 --2- 172.21.15.17:0/3158316971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2328100750 0x7f23281047a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.685+0000 7f232e4cc640 1 --2- 172.21.15.17:0/3158316971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f23280ffda0 0x7f2328100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.685+0000 7f232e4cc640 1 -- 172.21.15.17:0/3158316971 >> 172.21.15.17:0/3158316971 conn(0x7f23280fb840 msgr2=0x7f23280fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:06.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.685+0000 7f232e4cc640 1 -- 172.21.15.17:0/3158316971 shutdown_connections 2024-08-19T01:18:06.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.685+0000 7f232e4cc640 1 -- 172.21.15.17:0/3158316971 wait complete. 2024-08-19T01:18:06.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.686+0000 7f232e4cc640 1 Processor -- start 2024-08-19T01:18:06.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.686+0000 7f232e4cc640 1 -- start start 2024-08-19T01:18:06.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.686+0000 7f232e4cc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23280ffda0 0x7f232819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.686+0000 7f232e4cc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2328100750 0x7f232819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.686+0000 7f232e4cc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2328195930 con 0x7f23280ffda0 2024-08-19T01:18:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.686+0000 7f232e4cc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2328195a70 con 0x7f2328100750 2024-08-19T01:18:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.686+0000 7f2327fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23280ffda0 0x7f232819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.686+0000 7f2327fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23280ffda0 0x7f232819b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42278/0 (socket says 172.21.15.17:42278) 2024-08-19T01:18:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.686+0000 7f2327fff640 1 -- 172.21.15.17:0/332511806 learned_addr learned my addr 172.21.15.17:0/332511806 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.686+0000 7f23277fe640 1 --2- 172.21.15.17:0/332511806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2328100750 0x7f232819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.687+0000 7f2327fff640 1 -- 172.21.15.17:0/332511806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2328100750 msgr2=0x7f232819be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.687+0000 7f2327fff640 1 --2- 172.21.15.17:0/332511806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2328100750 0x7f232819be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.687+0000 7f2327fff640 1 -- 172.21.15.17:0/332511806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c009560 con 0x7f23280ffda0 2024-08-19T01:18:06.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.687+0000 7f2327fff640 1 --2- 172.21.15.17:0/332511806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23280ffda0 0x7f232819b8d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f231800e970 tx=0x7f231800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.687+0000 7f23257fa640 1 -- 172.21.15.17:0/332511806 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231800cc90 con 0x7f23280ffda0 2024-08-19T01:18:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.687+0000 7f23257fa640 1 -- 172.21.15.17:0/332511806 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f231800cdf0 con 0x7f23280ffda0 2024-08-19T01:18:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.687+0000 7f232e4cc640 1 -- 172.21.15.17:0/332511806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2328195d50 con 0x7f23280ffda0 2024-08-19T01:18:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.687+0000 7f23257fa640 1 -- 172.21.15.17:0/332511806 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2318010430 con 0x7f23280ffda0 2024-08-19T01:18:06.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.687+0000 7f232e4cc640 1 -- 172.21.15.17:0/332511806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2328196270 con 0x7f23280ffda0 2024-08-19T01:18:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.688+0000 7f232e4cc640 1 -- 172.21.15.17:0/332511806 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2328101280 con 0x7f23280ffda0 2024-08-19T01:18:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.688+0000 7f23257fa640 1 -- 172.21.15.17:0/332511806 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f23180046c0 con 0x7f23280ffda0 2024-08-19T01:18:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.689+0000 7f23257fa640 1 --2- 172.21.15.17:0/332511806 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f231006e170 0x7f2310070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.689+0000 7f23257fa640 1 -- 172.21.15.17:0/332511806 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2318014070 con 0x7f23280ffda0 2024-08-19T01:18:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.689+0000 7f23277fe640 1 --2- 172.21.15.17:0/332511806 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f231006e170 0x7f2310070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.689+0000 7f23277fe640 1 --2- 172.21.15.17:0/332511806 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f231006e170 0x7f2310070630 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f231c009230 tx=0x7f231c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:06.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.693+0000 7f23257fa640 1 -- 172.21.15.17:0/332511806 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2318057950 con 0x7f23280ffda0 2024-08-19T01:18:06.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.884+0000 7f232e4cc640 1 -- 172.21.15.17:0/332511806 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f232810cdd0 con 0x7f231006e170 2024-08-19T01:18:06.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.885+0000 7f23257fa640 1 -- 172.21.15.17:0/332511806 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f232810cdd0 con 0x7f231006e170 2024-08-19T01:18:06.887 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:18:06.888 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:18:06.889 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:18:06.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.888+0000 7f232e4cc640 1 -- 172.21.15.17:0/332511806 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f231006e170 msgr2=0x7f2310070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.888+0000 7f232e4cc640 1 --2- 172.21.15.17:0/332511806 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f231006e170 0x7f2310070630 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f231c009230 tx=0x7f231c0058d0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.888+0000 7f232e4cc640 1 -- 172.21.15.17:0/332511806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23280ffda0 msgr2=0x7f232819b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.888+0000 7f232e4cc640 1 --2- 172.21.15.17:0/332511806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23280ffda0 0x7f232819b8d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f231800e970 tx=0x7f231800ed70 comp rx=0 tx=0).stop 2024-08-19T01:18:06.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.888+0000 7f232e4cc640 1 -- 172.21.15.17:0/332511806 shutdown_connections 2024-08-19T01:18:06.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.888+0000 7f232e4cc640 1 --2- 172.21.15.17:0/332511806 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f231006e170 0x7f2310070630 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.888+0000 7f232e4cc640 1 --2- 172.21.15.17:0/332511806 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2328100750 0x7f232819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.888+0000 7f232e4cc640 1 --2- 172.21.15.17:0/332511806 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23280ffda0 0x7f232819b8d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.888+0000 7f232e4cc640 1 -- 172.21.15.17:0/332511806 >> 172.21.15.17:0/332511806 conn(0x7f23280fb840 msgr2=0x7f23280fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:06.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.888+0000 7f232e4cc640 1 -- 172.21.15.17:0/332511806 shutdown_connections 2024-08-19T01:18:06.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.888+0000 7f232e4cc640 1 -- 172.21.15.17:0/332511806 wait complete. 2024-08-19T01:18:06.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.971+0000 7fb5087f8640 1 -- 172.21.15.17:0/2947484066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5000fe9f0 msgr2=0x7fb5000fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.971+0000 7fb5087f8640 1 --2- 172.21.15.17:0/2947484066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5000fe9f0 0x7fb5000fee50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009880 tx=0x7fb4f002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.971+0000 7fb5087f8640 1 -- 172.21.15.17:0/2947484066 shutdown_connections 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.971+0000 7fb5087f8640 1 --2- 172.21.15.17:0/2947484066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5000fe9f0 0x7fb5000fee50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.971+0000 7fb5087f8640 1 --2- 172.21.15.17:0/2947484066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5001049f0 0x7fb500104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.971+0000 7fb5087f8640 1 -- 172.21.15.17:0/2947484066 >> 172.21.15.17:0/2947484066 conn(0x7fb5000758a0 msgr2=0x7fb5000fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.971+0000 7fb5087f8640 1 -- 172.21.15.17:0/2947484066 shutdown_connections 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.971+0000 7fb5087f8640 1 -- 172.21.15.17:0/2947484066 wait complete. 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.971+0000 7fb5087f8640 1 Processor -- start 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.971+0000 7fb5087f8640 1 -- start start 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb5087f8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5000fe9f0 0x7fb50019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb5087f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5001049f0 0x7fb50019bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb5087f8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5001959e0 con 0x7fb5001049f0 2024-08-19T01:18:06.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb5087f8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb500195b20 con 0x7fb5000fe9f0 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb505d93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5001049f0 0x7fb50019bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb505d93640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5001049f0 0x7fb50019bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36136/0 (socket says 172.21.15.17:36136) 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb505d93640 1 -- 172.21.15.17:0/44188241 learned_addr learned my addr 172.21.15.17:0/44188241 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb506594640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5000fe9f0 0x7fb50019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb505d93640 1 -- 172.21.15.17:0/44188241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5000fe9f0 msgr2=0x7fb50019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb505d93640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5000fe9f0 0x7fb50019b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb505d93640 1 -- 172.21.15.17:0/44188241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f0009560 con 0x7fb5001049f0 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb506594640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5000fe9f0 0x7fb50019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb505d93640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5001049f0 0x7fb50019bec0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb4f002a9c0 tx=0x7fb4f00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb4f77fe640 1 -- 172.21.15.17:0/44188241 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4f0004aa0 con 0x7fb5001049f0 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb4f77fe640 1 -- 172.21.15.17:0/44188241 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb4f0004c00 con 0x7fb5001049f0 2024-08-19T01:18:06.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb5087f8640 1 -- 172.21.15.17:0/44188241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb500195da0 con 0x7fb5001049f0 2024-08-19T01:18:06.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb4f77fe640 1 -- 172.21.15.17:0/44188241 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4f0003980 con 0x7fb5001049f0 2024-08-19T01:18:06.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.972+0000 7fb5087f8640 1 -- 172.21.15.17:0/44188241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb500196290 con 0x7fb5001049f0 2024-08-19T01:18:06.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.973+0000 7fb5087f8640 1 -- 172.21.15.17:0/44188241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb500100130 con 0x7fb5001049f0 2024-08-19T01:18:06.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.974+0000 7fb4f77fe640 1 -- 172.21.15.17:0/44188241 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb4f0003bf0 con 0x7fb5001049f0 2024-08-19T01:18:06.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.974+0000 7fb4f77fe640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb4ec06e170 0x7fb4ec070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:06.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.975+0000 7fb4f77fe640 1 -- 172.21.15.17:0/44188241 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb4f00af210 con 0x7fb5001049f0 2024-08-19T01:18:06.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.975+0000 7fb506594640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb4ec06e170 0x7fb4ec070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:06.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.975+0000 7fb506594640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb4ec06e170 0x7fb4ec070630 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009b40 tx=0x7fb4fc005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:06.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:06.979+0000 7fb4f77fe640 1 -- 172.21.15.17:0/44188241 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb4f00784f0 con 0x7fb5001049f0 2024-08-19T01:18:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:06 smithi017 ceph-mon[99370]: pgmap v579: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:06 smithi017 ceph-mon[99370]: from='client.35100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:06 smithi017 ceph-mon[99370]: from='client.35104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:06 smithi017 ceph-mon[99370]: from='client.35108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:06 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2303186526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:18:07.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:06 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3751845968' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:18:07.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:06 smithi086 ceph-mon[71303]: pgmap v579: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:07.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:06 smithi086 ceph-mon[71303]: from='client.35100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:07.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:06 smithi086 ceph-mon[71303]: from='client.35104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:07.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:06 smithi086 ceph-mon[71303]: from='client.35108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:07.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:06 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2303186526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:18:07.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:06 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3751845968' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:18:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.224+0000 7fb5087f8640 1 -- 172.21.15.17:0/44188241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb500196f70 con 0x7fb5001049f0 2024-08-19T01:18:07.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.224+0000 7fb4f77fe640 1 -- 172.21.15.17:0/44188241 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7fb4f007bbb0 con 0x7fb5001049f0 2024-08-19T01:18:07.226 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:18:07.227 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:18:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:18:07.227 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:18:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:18:07.227 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:18:07.227 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:18:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.226+0000 7fb5087f8640 1 -- 172.21.15.17:0/44188241 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb4ec06e170 msgr2=0x7fb4ec070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:07.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.226+0000 7fb5087f8640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb4ec06e170 0x7fb4ec070630 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009b40 tx=0x7fb4fc005e50 comp rx=0 tx=0).stop 2024-08-19T01:18:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.226+0000 7fb5087f8640 1 -- 172.21.15.17:0/44188241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5001049f0 msgr2=0x7fb50019bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.226+0000 7fb5087f8640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5001049f0 0x7fb50019bec0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb4f002a9c0 tx=0x7fb4f00055a0 comp rx=0 tx=0).stop 2024-08-19T01:18:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.226+0000 7fb5087f8640 1 -- 172.21.15.17:0/44188241 shutdown_connections 2024-08-19T01:18:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.226+0000 7fb5087f8640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb4ec06e170 0x7fb4ec070630 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.226+0000 7fb5087f8640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5001049f0 0x7fb50019bec0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.226+0000 7fb5087f8640 1 --2- 172.21.15.17:0/44188241 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb5000fe9f0 0x7fb50019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.226+0000 7fb5087f8640 1 -- 172.21.15.17:0/44188241 >> 172.21.15.17:0/44188241 conn(0x7fb5000758a0 msgr2=0x7fb5000fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.227+0000 7fb5087f8640 1 -- 172.21.15.17:0/44188241 shutdown_connections 2024-08-19T01:18:07.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:07.227+0000 7fb5087f8640 1 -- 172.21.15.17:0/44188241 wait complete. 2024-08-19T01:18:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:07 smithi017 ceph-mon[99370]: from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:07 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/44188241' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:18:08.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:07 smithi086 ceph-mon[71303]: from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:08.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:07 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/44188241' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:18:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:08 smithi017 ceph-mon[99370]: pgmap v580: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:08 smithi086 ceph-mon[71303]: pgmap v580: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:11.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:10 smithi017 ceph-mon[99370]: pgmap v581: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:11.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:10 smithi086 ceph-mon[71303]: pgmap v581: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:13.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:12 smithi017 ceph-mon[99370]: pgmap v582: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:13.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:12 smithi086 ceph-mon[71303]: pgmap v582: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:15.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:14 smithi017 ceph-mon[99370]: pgmap v583: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:15.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:14 smithi086 ceph-mon[71303]: pgmap v583: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:17.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:16 smithi017 ceph-mon[99370]: pgmap v584: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:17.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:16 smithi086 ceph-mon[71303]: pgmap v584: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:18 smithi017 ceph-mon[99370]: pgmap v585: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:18:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:18 smithi086 ceph-mon[71303]: pgmap v585: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:18:21.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:20 smithi017 ceph-mon[99370]: pgmap v586: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:21.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:20 smithi086 ceph-mon[71303]: pgmap v586: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:23.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:22 smithi017 ceph-mon[99370]: pgmap v587: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:23.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:22 smithi086 ceph-mon[71303]: pgmap v587: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:25.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:24 smithi017 ceph-mon[99370]: pgmap v588: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:25.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:24 smithi086 ceph-mon[71303]: pgmap v588: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:26 smithi086 ceph-mon[71303]: pgmap v589: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:27.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:26 smithi017 ceph-mon[99370]: pgmap v589: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:28 smithi086 ceph-mon[71303]: pgmap v590: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:29.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:28 smithi017 ceph-mon[99370]: pgmap v590: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:31.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:30 smithi086 ceph-mon[71303]: pgmap v591: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:31.235 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:30 smithi017 ceph-mon[99370]: pgmap v591: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:33.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:32 smithi086 ceph-mon[71303]: pgmap v592: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:33.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:32 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:18:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:32 smithi017 ceph-mon[99370]: pgmap v592: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:32 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:18:35.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:34 smithi017 ceph-mon[99370]: pgmap v593: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:34 smithi086 ceph-mon[71303]: pgmap v593: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:37.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.322+0000 7f74098f2640 1 -- 172.21.15.17:0/3190170573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74040ffb30 msgr2=0x7f74040fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:37.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.322+0000 7f74098f2640 1 --2- 172.21.15.17:0/3190170573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74040ffb30 0x7f74040fff90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009880 tx=0x7f73f802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.322+0000 7f74098f2640 1 -- 172.21.15.17:0/3190170573 shutdown_connections 2024-08-19T01:18:37.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.322+0000 7f74098f2640 1 --2- 172.21.15.17:0/3190170573 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74040ffb30 0x7f74040fff90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.322+0000 7f74098f2640 1 --2- 172.21.15.17:0/3190170573 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7404105be0 0x7f7404105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.322+0000 7f74098f2640 1 -- 172.21.15.17:0/3190170573 >> 172.21.15.17:0/3190170573 conn(0x7f74040fb810 msgr2=0x7f74040fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:37.326 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:36 smithi017 ceph-mon[99370]: pgmap v594: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:37.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.322+0000 7f74098f2640 1 -- 172.21.15.17:0/3190170573 shutdown_connections 2024-08-19T01:18:37.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.322+0000 7f74098f2640 1 -- 172.21.15.17:0/3190170573 wait complete. 2024-08-19T01:18:37.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.323+0000 7f74098f2640 1 Processor -- start 2024-08-19T01:18:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.323+0000 7f74098f2640 1 -- start start 2024-08-19T01:18:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.323+0000 7f74098f2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74040ffb30 0x7f740419b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.323+0000 7f74098f2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7404105be0 0x7f740419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.323+0000 7f74098f2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740419c330 con 0x7f7404105be0 2024-08-19T01:18:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.323+0000 7f74098f2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74041958c0 con 0x7f74040ffb30 2024-08-19T01:18:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.323+0000 7f74027fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7404105be0 0x7f740419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.323+0000 7f74027fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7404105be0 0x7f740419bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44092/0 (socket says 172.21.15.17:44092) 2024-08-19T01:18:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.323+0000 7f74027fc640 1 -- 172.21.15.17:0/2962542854 learned_addr learned my addr 172.21.15.17:0/2962542854 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.323+0000 7f7402ffd640 1 --2- 172.21.15.17:0/2962542854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74040ffb30 0x7f740419b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.324+0000 7f74027fc640 1 -- 172.21.15.17:0/2962542854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74040ffb30 msgr2=0x7f740419b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:37.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.324+0000 7f74027fc640 1 --2- 172.21.15.17:0/2962542854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74040ffb30 0x7f740419b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.324+0000 7f74027fc640 1 -- 172.21.15.17:0/2962542854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8009560 con 0x7f7404105be0 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.324+0000 7f74027fc640 1 --2- 172.21.15.17:0/2962542854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7404105be0 0x7f740419bd10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f73f802a9c0 tx=0x7f73f80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.324+0000 7f74088f0640 1 -- 172.21.15.17:0/2962542854 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f8004aa0 con 0x7f7404105be0 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.324+0000 7f74088f0640 1 -- 172.21.15.17:0/2962542854 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f73f8004c00 con 0x7f7404105be0 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.324+0000 7f74098f2640 1 -- 172.21.15.17:0/2962542854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7404195b40 con 0x7f7404105be0 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.324+0000 7f74088f0640 1 -- 172.21.15.17:0/2962542854 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f8003ab0 con 0x7f7404105be0 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.324+0000 7f74098f2640 1 -- 172.21.15.17:0/2962542854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74041960b0 con 0x7f7404105be0 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.325+0000 7f74098f2640 1 -- 172.21.15.17:0/2962542854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74041011e0 con 0x7f7404105be0 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.326+0000 7f74088f0640 1 -- 172.21.15.17:0/2962542854 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f73f8003cb0 con 0x7f7404105be0 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.326+0000 7f74088f0640 1 --2- 172.21.15.17:0/2962542854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f73ec06e170 0x7f73ec070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.326+0000 7f74088f0640 1 -- 172.21.15.17:0/2962542854 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f73f80af0f0 con 0x7f7404105be0 2024-08-19T01:18:37.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.326+0000 7f7402ffd640 1 --2- 172.21.15.17:0/2962542854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f73ec06e170 0x7f73ec070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:37.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.327+0000 7f7402ffd640 1 --2- 172.21.15.17:0/2962542854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f73ec06e170 0x7f73ec070630 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f73f4005c40 tx=0x7f73f400a570 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:37.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.331+0000 7f74088f0640 1 -- 172.21.15.17:0/2962542854 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f73f8078500 con 0x7f7404105be0 2024-08-19T01:18:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:36 smithi086 ceph-mon[71303]: pgmap v594: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:37.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.523+0000 7f74098f2640 1 -- 172.21.15.17:0/2962542854 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f740410cda0 con 0x7f73ec06e170 2024-08-19T01:18:37.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.524+0000 7f74088f0640 1 -- 172.21.15.17:0/2962542854 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f740410cda0 con 0x7f73ec06e170 2024-08-19T01:18:37.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.526+0000 7f74098f2640 1 -- 172.21.15.17:0/2962542854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f73ec06e170 msgr2=0x7f73ec070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.526+0000 7f74098f2640 1 --2- 172.21.15.17:0/2962542854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f73ec06e170 0x7f73ec070630 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f73f4005c40 tx=0x7f73f400a570 comp rx=0 tx=0).stop 2024-08-19T01:18:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.526+0000 7f74098f2640 1 -- 172.21.15.17:0/2962542854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7404105be0 msgr2=0x7f740419bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.526+0000 7f74098f2640 1 --2- 172.21.15.17:0/2962542854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7404105be0 0x7f740419bd10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f73f802a9c0 tx=0x7f73f80055a0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.526+0000 7f74098f2640 1 -- 172.21.15.17:0/2962542854 shutdown_connections 2024-08-19T01:18:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.526+0000 7f74098f2640 1 --2- 172.21.15.17:0/2962542854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f73ec06e170 0x7f73ec070630 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.526+0000 7f74098f2640 1 --2- 172.21.15.17:0/2962542854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7404105be0 0x7f740419bd10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.526+0000 7f74098f2640 1 --2- 172.21.15.17:0/2962542854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f74040ffb30 0x7f740419b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.526+0000 7f74098f2640 1 -- 172.21.15.17:0/2962542854 >> 172.21.15.17:0/2962542854 conn(0x7f74040fb810 msgr2=0x7f74040fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.527+0000 7f74098f2640 1 -- 172.21.15.17:0/2962542854 shutdown_connections 2024-08-19T01:18:37.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.527+0000 7f74098f2640 1 -- 172.21.15.17:0/2962542854 wait complete. 2024-08-19T01:18:37.538 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:18:37.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.609+0000 7f91410af640 1 -- 172.21.15.17:0/3675599247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913c0fe9f0 msgr2=0x7f913c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:37.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.609+0000 7f91410af640 1 --2- 172.21.15.17:0/3675599247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913c0fe9f0 0x7f913c0fee50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9130009880 tx=0x7f913002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.609+0000 7f91410af640 1 -- 172.21.15.17:0/3675599247 shutdown_connections 2024-08-19T01:18:37.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.609+0000 7f91410af640 1 --2- 172.21.15.17:0/3675599247 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913c0fe9f0 0x7f913c0fee50 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.609+0000 7f91410af640 1 --2- 172.21.15.17:0/3675599247 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f913c1049f0 0x7f913c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.609+0000 7f91410af640 1 -- 172.21.15.17:0/3675599247 >> 172.21.15.17:0/3675599247 conn(0x7f913c0758a0 msgr2=0x7f913c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.609+0000 7f91410af640 1 -- 172.21.15.17:0/3675599247 shutdown_connections 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.609+0000 7f91410af640 1 -- 172.21.15.17:0/3675599247 wait complete. 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.610+0000 7f91410af640 1 Processor -- start 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.610+0000 7f91410af640 1 -- start start 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f91410af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f913c0fe9f0 0x7f913c19da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f91410af640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913c1049f0 0x7f913c19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f91410af640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c197b40 con 0x7f913c1049f0 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f91410af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c197cb0 con 0x7f913c0fe9f0 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f913a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913c1049f0 0x7f913c19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f913a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913c1049f0 0x7f913c19df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44118/0 (socket says 172.21.15.17:44118) 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f913a59c640 1 -- 172.21.15.17:0/3722025737 learned_addr learned my addr 172.21.15.17:0/3722025737 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:37.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f913ad9d640 1 --2- 172.21.15.17:0/3722025737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f913c0fe9f0 0x7f913c19da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:37.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f913a59c640 1 -- 172.21.15.17:0/3722025737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f913c0fe9f0 msgr2=0x7f913c19da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:37.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f913a59c640 1 --2- 172.21.15.17:0/3722025737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f913c0fe9f0 0x7f913c19da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f913a59c640 1 -- 172.21.15.17:0/3722025737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9130009560 con 0x7f913c1049f0 2024-08-19T01:18:37.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f913a59c640 1 --2- 172.21.15.17:0/3722025737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913c1049f0 0x7f913c19df90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9130006010 tx=0x7f91300055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:37.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.611+0000 7f9123fff640 1 -- 172.21.15.17:0/3722025737 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9130004aa0 con 0x7f913c1049f0 2024-08-19T01:18:37.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.612+0000 7f9123fff640 1 -- 172.21.15.17:0/3722025737 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9130031470 con 0x7f913c1049f0 2024-08-19T01:18:37.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.612+0000 7f91410af640 1 -- 172.21.15.17:0/3722025737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c197f30 con 0x7f913c1049f0 2024-08-19T01:18:37.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.612+0000 7f9123fff640 1 -- 172.21.15.17:0/3722025737 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9130003940 con 0x7f913c1049f0 2024-08-19T01:18:37.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.612+0000 7f91410af640 1 -- 172.21.15.17:0/3722025737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c198420 con 0x7f913c1049f0 2024-08-19T01:18:37.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.613+0000 7f91410af640 1 -- 172.21.15.17:0/3722025737 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c100130 con 0x7f913c1049f0 2024-08-19T01:18:37.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.613+0000 7f9123fff640 1 -- 172.21.15.17:0/3722025737 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9130031b90 con 0x7f913c1049f0 2024-08-19T01:18:37.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.614+0000 7f9123fff640 1 --2- 172.21.15.17:0/3722025737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f912406e180 0x7f9124070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:37.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.614+0000 7f9123fff640 1 -- 172.21.15.17:0/3722025737 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f91300af240 con 0x7f913c1049f0 2024-08-19T01:18:37.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.614+0000 7f913ad9d640 1 --2- 172.21.15.17:0/3722025737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f912406e180 0x7f9124070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:37.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.614+0000 7f913ad9d640 1 --2- 172.21.15.17:0/3722025737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f912406e180 0x7f9124070640 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f912c005d00 tx=0x7f912c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:37.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.618+0000 7f9123fff640 1 -- 172.21.15.17:0/3722025737 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9130078570 con 0x7f913c1049f0 2024-08-19T01:18:37.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.810+0000 7f91410af640 1 -- 172.21.15.17:0/3722025737 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f913c198fe0 con 0x7f912406e180 2024-08-19T01:18:37.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.811+0000 7f9123fff640 1 -- 172.21.15.17:0/3722025737 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f913c198fe0 con 0x7f912406e180 2024-08-19T01:18:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.814+0000 7f91410af640 1 -- 172.21.15.17:0/3722025737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f912406e180 msgr2=0x7f9124070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.814+0000 7f91410af640 1 --2- 172.21.15.17:0/3722025737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f912406e180 0x7f9124070640 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f912c005d00 tx=0x7f912c00b410 comp rx=0 tx=0).stop 2024-08-19T01:18:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.814+0000 7f91410af640 1 -- 172.21.15.17:0/3722025737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913c1049f0 msgr2=0x7f913c19df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.814+0000 7f91410af640 1 --2- 172.21.15.17:0/3722025737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913c1049f0 0x7f913c19df90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9130006010 tx=0x7f91300055a0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.814+0000 7f91410af640 1 -- 172.21.15.17:0/3722025737 shutdown_connections 2024-08-19T01:18:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.814+0000 7f91410af640 1 --2- 172.21.15.17:0/3722025737 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f912406e180 0x7f9124070640 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.814+0000 7f91410af640 1 --2- 172.21.15.17:0/3722025737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f913c1049f0 0x7f913c19df90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.814+0000 7f91410af640 1 --2- 172.21.15.17:0/3722025737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f913c0fe9f0 0x7f913c19da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.814+0000 7f91410af640 1 -- 172.21.15.17:0/3722025737 >> 172.21.15.17:0/3722025737 conn(0x7f913c0758a0 msgr2=0x7f913c102160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.814+0000 7f91410af640 1 -- 172.21.15.17:0/3722025737 shutdown_connections 2024-08-19T01:18:37.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.814+0000 7f91410af640 1 -- 172.21.15.17:0/3722025737 wait complete. 2024-08-19T01:18:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.895+0000 7f9a4780b640 1 -- 172.21.15.17:0/2991841176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a40101670 msgr2=0x7f9a40109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.895+0000 7f9a4780b640 1 --2- 172.21.15.17:0/2991841176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a40101670 0x7f9a40109b60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009880 tx=0x7f9a3402a530 comp rx=0 tx=0).stop 2024-08-19T01:18:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.896+0000 7f9a4780b640 1 -- 172.21.15.17:0/2991841176 shutdown_connections 2024-08-19T01:18:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.896+0000 7f9a4780b640 1 --2- 172.21.15.17:0/2991841176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a40101670 0x7f9a40109b60 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.896+0000 7f9a4780b640 1 --2- 172.21.15.17:0/2991841176 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a40100d50 0x7f9a40101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.896+0000 7f9a4780b640 1 -- 172.21.15.17:0/2991841176 >> 172.21.15.17:0/2991841176 conn(0x7f9a400758a0 msgr2=0x7f9a400fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.896+0000 7f9a4780b640 1 -- 172.21.15.17:0/2991841176 shutdown_connections 2024-08-19T01:18:37.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.896+0000 7f9a4780b640 1 -- 172.21.15.17:0/2991841176 wait complete. 2024-08-19T01:18:37.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.896+0000 7f9a4780b640 1 Processor -- start 2024-08-19T01:18:37.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.896+0000 7f9a4780b640 1 -- start start 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a4780b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a40100d50 0x7f9a400fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a4780b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a40101670 0x7f9a400feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a4780b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400ff430 con 0x7f9a40101670 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a4780b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400ff570 con 0x7f9a40100d50 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a44da6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a40101670 0x7f9a400feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a44da6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a40101670 0x7f9a400feef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44134/0 (socket says 172.21.15.17:44134) 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a44da6640 1 -- 172.21.15.17:0/2559357892 learned_addr learned my addr 172.21.15.17:0/2559357892 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a455a7640 1 --2- 172.21.15.17:0/2559357892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a40100d50 0x7f9a400fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a44da6640 1 -- 172.21.15.17:0/2559357892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a40100d50 msgr2=0x7f9a400fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a44da6640 1 --2- 172.21.15.17:0/2559357892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a40100d50 0x7f9a400fe9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a44da6640 1 -- 172.21.15.17:0/2559357892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34009560 con 0x7f9a40101670 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a44da6640 1 --2- 172.21.15.17:0/2559357892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a40101670 0x7f9a400feef0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9a34005940 tx=0x7f9a34032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.897+0000 7f9a3e7fc640 1 -- 172.21.15.17:0/2559357892 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a34005220 con 0x7f9a40101670 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.898+0000 7f9a3e7fc640 1 -- 172.21.15.17:0/2559357892 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a34005380 con 0x7f9a40101670 2024-08-19T01:18:37.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.898+0000 7f9a4780b640 1 -- 172.21.15.17:0/2559357892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a400ff7f0 con 0x7f9a40101670 2024-08-19T01:18:37.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.898+0000 7f9a3e7fc640 1 -- 172.21.15.17:0/2559357892 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a34003a50 con 0x7f9a40101670 2024-08-19T01:18:37.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.898+0000 7f9a4780b640 1 -- 172.21.15.17:0/2559357892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a401a2090 con 0x7f9a40101670 2024-08-19T01:18:37.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.899+0000 7f9a4780b640 1 -- 172.21.15.17:0/2559357892 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a40068470 con 0x7f9a40101670 2024-08-19T01:18:37.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.899+0000 7f9a3e7fc640 1 -- 172.21.15.17:0/2559357892 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9a3402ad50 con 0x7f9a40101670 2024-08-19T01:18:37.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.899+0000 7f9a3e7fc640 1 --2- 172.21.15.17:0/2559357892 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a2806e170 0x7f9a28070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:37.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.900+0000 7f9a3e7fc640 1 -- 172.21.15.17:0/2559357892 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9a340aebb0 con 0x7f9a40101670 2024-08-19T01:18:37.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.900+0000 7f9a455a7640 1 --2- 172.21.15.17:0/2559357892 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a2806e170 0x7f9a28070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:37.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.900+0000 7f9a455a7640 1 --2- 172.21.15.17:0/2559357892 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a2806e170 0x7f9a28070630 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9a30005c40 tx=0x7f9a3000a390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:37.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:37.904+0000 7f9a3e7fc640 1 -- 172.21.15.17:0/2559357892 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9a340b5080 con 0x7f9a40101670 2024-08-19T01:18:38.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.090+0000 7f9a4780b640 1 -- 172.21.15.17:0/2559357892 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a4010cda0 con 0x7f9a2806e170 2024-08-19T01:18:38.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.099+0000 7f9a3e7fc640 1 -- 172.21.15.17:0/2559357892 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9a4010cda0 con 0x7f9a2806e170 2024-08-19T01:18:38.102 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:18:38.102 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (19m) 13m ago 30m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:18:38.102 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (30m) 13m ago 30m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:18:38.102 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (29m) 13m ago 29m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:18:38.103 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (17m) 13m ago 30m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:18:38.103 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (17m) 13m ago 29m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:18:38.103 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (19m) 13m ago 30m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:18:38.103 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (13m) 13m ago 25m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:18:38.103 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (14m) 13m ago 25m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:18:38.103 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (25m) 13m ago 25m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:18:38.103 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (13m) 13m ago 25m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:18:38.103 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (21m) 13m ago 32m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:18:38.103 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (20m) 13m ago 29m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:18:38.104 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (18m) 13m ago 32m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:18:38.104 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (18m) 13m ago 29m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:18:38.104 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (20m) 13m ago 30m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:18:38.104 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (20m) 13m ago 29m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:18:38.104 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (17m) 13m ago 28m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:18:38.104 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (16m) 13m ago 28m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:18:38.104 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (16m) 13m ago 27m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:18:38.104 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (15m) 13m ago 27m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:18:38.104 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (15m) 13m ago 27m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:18:38.104 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (14m) 13m ago 26m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:18:38.104 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (20m) 13m ago 30m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:18:38.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.101+0000 7f9a4780b640 1 -- 172.21.15.17:0/2559357892 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a2806e170 msgr2=0x7f9a28070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.101+0000 7f9a4780b640 1 --2- 172.21.15.17:0/2559357892 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a2806e170 0x7f9a28070630 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9a30005c40 tx=0x7f9a3000a390 comp rx=0 tx=0).stop 2024-08-19T01:18:38.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.101+0000 7f9a4780b640 1 -- 172.21.15.17:0/2559357892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a40101670 msgr2=0x7f9a400feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.101+0000 7f9a4780b640 1 --2- 172.21.15.17:0/2559357892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a40101670 0x7f9a400feef0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9a34005940 tx=0x7f9a34032bd0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.101+0000 7f9a4780b640 1 -- 172.21.15.17:0/2559357892 shutdown_connections 2024-08-19T01:18:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.101+0000 7f9a4780b640 1 --2- 172.21.15.17:0/2559357892 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a2806e170 0x7f9a28070630 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.101+0000 7f9a4780b640 1 --2- 172.21.15.17:0/2559357892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9a40101670 0x7f9a400feef0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.101+0000 7f9a4780b640 1 --2- 172.21.15.17:0/2559357892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9a40100d50 0x7f9a400fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.101+0000 7f9a4780b640 1 -- 172.21.15.17:0/2559357892 >> 172.21.15.17:0/2559357892 conn(0x7f9a400758a0 msgr2=0x7f9a40101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.101+0000 7f9a4780b640 1 -- 172.21.15.17:0/2559357892 shutdown_connections 2024-08-19T01:18:38.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.101+0000 7f9a4780b640 1 -- 172.21.15.17:0/2559357892 wait complete. 2024-08-19T01:18:38.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.182+0000 7f2f61a9a640 1 -- 172.21.15.17:0/1702125915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c105bf0 msgr2=0x7f2f5c105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.182+0000 7f2f61a9a640 1 --2- 172.21.15.17:0/1702125915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c105bf0 0x7f2f5c105fd0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009880 tx=0x7f2f4c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.182+0000 7f2f61a9a640 1 -- 172.21.15.17:0/1702125915 shutdown_connections 2024-08-19T01:18:38.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.182+0000 7f2f61a9a640 1 --2- 172.21.15.17:0/1702125915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f5c0ffb40 0x7f2f5c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.182+0000 7f2f61a9a640 1 --2- 172.21.15.17:0/1702125915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c105bf0 0x7f2f5c105fd0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.182+0000 7f2f61a9a640 1 -- 172.21.15.17:0/1702125915 >> 172.21.15.17:0/1702125915 conn(0x7f2f5c0fb860 msgr2=0x7f2f5c0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:38.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.182+0000 7f2f61a9a640 1 -- 172.21.15.17:0/1702125915 shutdown_connections 2024-08-19T01:18:38.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.182+0000 7f2f61a9a640 1 -- 172.21.15.17:0/1702125915 wait complete. 2024-08-19T01:18:38.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.183+0000 7f2f61a9a640 1 Processor -- start 2024-08-19T01:18:38.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.183+0000 7f2f61a9a640 1 -- start start 2024-08-19T01:18:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.183+0000 7f2f61a9a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f5c0ffb40 0x7f2f5c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.183+0000 7f2f61a9a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c105bf0 0x7f2f5c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.183+0000 7f2f61a9a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c073230 con 0x7f2f5c105bf0 2024-08-19T01:18:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.183+0000 7f2f61a9a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5c0733a0 con 0x7f2f5c0ffb40 2024-08-19T01:18:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.183+0000 7f2f52ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c105bf0 0x7f2f5c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.183+0000 7f2f52ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c105bf0 0x7f2f5c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44156/0 (socket says 172.21.15.17:44156) 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.183+0000 7f2f52ffd640 1 -- 172.21.15.17:0/2428489373 learned_addr learned my addr 172.21.15.17:0/2428489373 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.184+0000 7f2f5b7fe640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f5c0ffb40 0x7f2f5c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.184+0000 7f2f52ffd640 1 -- 172.21.15.17:0/2428489373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f5c0ffb40 msgr2=0x7f2f5c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.184+0000 7f2f52ffd640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f5c0ffb40 0x7f2f5c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.184+0000 7f2f52ffd640 1 -- 172.21.15.17:0/2428489373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c009560 con 0x7f2f5c105bf0 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.184+0000 7f2f5b7fe640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f5c0ffb40 0x7f2f5c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.184+0000 7f2f52ffd640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c105bf0 0x7f2f5c072cf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400d6f0 tx=0x7f2f4400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.184+0000 7f2f597fa640 1 -- 172.21.15.17:0/2428489373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f44009a30 con 0x7f2f5c105bf0 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.184+0000 7f2f61a9a640 1 -- 172.21.15.17:0/2428489373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c1a1c70 con 0x7f2f5c105bf0 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.184+0000 7f2f597fa640 1 -- 172.21.15.17:0/2428489373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f440054e0 con 0x7f2f5c105bf0 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.184+0000 7f2f597fa640 1 -- 172.21.15.17:0/2428489373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f44010460 con 0x7f2f5c105bf0 2024-08-19T01:18:38.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.184+0000 7f2f61a9a640 1 -- 172.21.15.17:0/2428489373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5c1a2050 con 0x7f2f5c105bf0 2024-08-19T01:18:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.185+0000 7f2f61a9a640 1 -- 172.21.15.17:0/2428489373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5c1011f0 con 0x7f2f5c105bf0 2024-08-19T01:18:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.186+0000 7f2f597fa640 1 -- 172.21.15.17:0/2428489373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2f44009b90 con 0x7f2f5c105bf0 2024-08-19T01:18:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.186+0000 7f2f597fa640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f4806e180 0x7f2f48070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.186+0000 7f2f597fa640 1 -- 172.21.15.17:0/2428489373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2f4408dd30 con 0x7f2f5c105bf0 2024-08-19T01:18:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.186+0000 7f2f5b7fe640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f4806e180 0x7f2f48070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.187+0000 7f2f5b7fe640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f4806e180 0x7f2f48070640 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c000c00 tx=0x7f2f4c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:38.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.190+0000 7f2f597fa640 1 -- 172.21.15.17:0/2428489373 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2f44057010 con 0x7f2f5c105bf0 2024-08-19T01:18:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.439+0000 7f2f61a9a640 1 -- 172.21.15.17:0/2428489373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2f5c073560 con 0x7f2f5c105bf0 2024-08-19T01:18:38.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.439+0000 7f2f597fa640 1 -- 172.21.15.17:0/2428489373 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f2f44017350 con 0x7f2f5c105bf0 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:18:38.443 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:18:38.444 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:18:38.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.442+0000 7f2f61a9a640 1 -- 172.21.15.17:0/2428489373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f4806e180 msgr2=0x7f2f48070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.442+0000 7f2f61a9a640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f4806e180 0x7f2f48070640 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c000c00 tx=0x7f2f4c005a20 comp rx=0 tx=0).stop 2024-08-19T01:18:38.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.442+0000 7f2f61a9a640 1 -- 172.21.15.17:0/2428489373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c105bf0 msgr2=0x7f2f5c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.442+0000 7f2f61a9a640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c105bf0 0x7f2f5c072cf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400d6f0 tx=0x7f2f4400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.442+0000 7f2f61a9a640 1 -- 172.21.15.17:0/2428489373 shutdown_connections 2024-08-19T01:18:38.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.442+0000 7f2f61a9a640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f4806e180 0x7f2f48070640 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.442+0000 7f2f61a9a640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f5c105bf0 0x7f2f5c072cf0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.442+0000 7f2f61a9a640 1 --2- 172.21.15.17:0/2428489373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f5c0ffb40 0x7f2f5c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.442+0000 7f2f61a9a640 1 -- 172.21.15.17:0/2428489373 >> 172.21.15.17:0/2428489373 conn(0x7f2f5c0fb860 msgr2=0x7f2f5c0fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:38.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.443+0000 7f2f61a9a640 1 -- 172.21.15.17:0/2428489373 shutdown_connections 2024-08-19T01:18:38.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.443+0000 7f2f61a9a640 1 -- 172.21.15.17:0/2428489373 wait complete. 2024-08-19T01:18:38.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.524+0000 7f286b949640 1 -- 172.21.15.17:0/3241133666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28640fea30 msgr2=0x7f28640fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.524+0000 7f286b949640 1 --2- 172.21.15.17:0/3241133666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28640fea30 0x7f28640fee90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2858009880 tx=0x7f285802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.524+0000 7f286b949640 1 -- 172.21.15.17:0/3241133666 shutdown_connections 2024-08-19T01:18:38.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.524+0000 7f286b949640 1 --2- 172.21.15.17:0/3241133666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28640fea30 0x7f28640fee90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.524+0000 7f286b949640 1 --2- 172.21.15.17:0/3241133666 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2864104a30 0x7f2864104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.524+0000 7f286b949640 1 -- 172.21.15.17:0/3241133666 >> 172.21.15.17:0/3241133666 conn(0x7f28640fa730 msgr2=0x7f28640fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:38.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.524+0000 7f286b949640 1 -- 172.21.15.17:0/3241133666 shutdown_connections 2024-08-19T01:18:38.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.524+0000 7f286b949640 1 -- 172.21.15.17:0/3241133666 wait complete. 2024-08-19T01:18:38.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f286b949640 1 Processor -- start 2024-08-19T01:18:38.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f286b949640 1 -- start start 2024-08-19T01:18:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f286b949640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28640fea30 0x7f28640fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f286b949640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2864104a30 0x7f28640fb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f286b949640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28640fbad0 con 0x7f2864104a30 2024-08-19T01:18:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f286b949640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28640fbc40 con 0x7f28640fea30 2024-08-19T01:18:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f2868ee4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2864104a30 0x7f28640fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f2868ee4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2864104a30 0x7f28640fb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44172/0 (socket says 172.21.15.17:44172) 2024-08-19T01:18:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f2868ee4640 1 -- 172.21.15.17:0/851745070 learned_addr learned my addr 172.21.15.17:0/851745070 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f28696e5640 1 --2- 172.21.15.17:0/851745070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28640fea30 0x7f28640fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f2868ee4640 1 -- 172.21.15.17:0/851745070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28640fea30 msgr2=0x7f28640fb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f2868ee4640 1 --2- 172.21.15.17:0/851745070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28640fea30 0x7f28640fb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.525+0000 7f2868ee4640 1 -- 172.21.15.17:0/851745070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2858009560 con 0x7f2864104a30 2024-08-19T01:18:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.526+0000 7f2868ee4640 1 --2- 172.21.15.17:0/851745070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2864104a30 0x7f28640fb590 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f285802a9c0 tx=0x7f28580055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.526+0000 7f28567fc640 1 -- 172.21.15.17:0/851745070 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2858004aa0 con 0x7f2864104a30 2024-08-19T01:18:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.526+0000 7f28567fc640 1 -- 172.21.15.17:0/851745070 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2858004c00 con 0x7f2864104a30 2024-08-19T01:18:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.526+0000 7f286b949640 1 -- 172.21.15.17:0/851745070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28640fbec0 con 0x7f2864104a30 2024-08-19T01:18:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.526+0000 7f28567fc640 1 -- 172.21.15.17:0/851745070 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2858003980 con 0x7f2864104a30 2024-08-19T01:18:38.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.526+0000 7f286b949640 1 -- 172.21.15.17:0/851745070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28641a1f40 con 0x7f2864104a30 2024-08-19T01:18:38.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.527+0000 7f286b949640 1 -- 172.21.15.17:0/851745070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2864100170 con 0x7f2864104a30 2024-08-19T01:18:38.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.527+0000 7f28567fc640 1 -- 172.21.15.17:0/851745070 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2858003bf0 con 0x7f2864104a30 2024-08-19T01:18:38.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.528+0000 7f28567fc640 1 --2- 172.21.15.17:0/851745070 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f285006e170 0x7f2850070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:38.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.528+0000 7f28567fc640 1 -- 172.21.15.17:0/851745070 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f28580af060 con 0x7f2864104a30 2024-08-19T01:18:38.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.528+0000 7f28696e5640 1 --2- 172.21.15.17:0/851745070 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f285006e170 0x7f2850070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:38.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.528+0000 7f28696e5640 1 --2- 172.21.15.17:0/851745070 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f285006e170 0x7f2850070630 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2860005fd0 tx=0x7f2860005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:38.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.532+0000 7f28567fc640 1 -- 172.21.15.17:0/851745070 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2858078340 con 0x7f2864104a30 2024-08-19T01:18:38.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.744+0000 7f286b949640 1 -- 172.21.15.17:0/851745070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f28640fee90 con 0x7f2864104a30 2024-08-19T01:18:38.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.744+0000 7f28567fc640 1 -- 172.21.15.17:0/851745070 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f285807ba00 con 0x7f2864104a30 2024-08-19T01:18:38.748 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:18:38.748 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:18:38.748 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:18:38.748 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:18:38.748 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:18:38.749 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:18:38.749 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:18:38.749 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:18:38.749 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:18:38.749 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:18:38.750 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:18:38.750 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:18:38.750 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:18:38.750 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:18:38.751 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:18:38.751 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:18:38.751 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:18:38.751 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:18:38.751 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:18:38.751 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:18:38.752 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:18:38.752 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:18:38.752 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:18:38.752 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:18:38.752 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:18:38.753 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:18:38.753 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:18:38.753 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:18:38.753 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:18:38.753 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:18:38.754 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:18:38.754 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:18:38.754 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:18:38.754 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:18:38.754 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:18:38.755 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:18:38.755 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:18:38.755 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:18:38.755 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:18:38.755 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:18:38.756 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:18:38.756 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:18:38.756 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:18:38.758 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:18:38.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.746+0000 7f286b949640 1 -- 172.21.15.17:0/851745070 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f285006e170 msgr2=0x7f2850070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.746+0000 7f286b949640 1 --2- 172.21.15.17:0/851745070 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f285006e170 0x7f2850070630 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2860005fd0 tx=0x7f2860005850 comp rx=0 tx=0).stop 2024-08-19T01:18:38.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.746+0000 7f286b949640 1 -- 172.21.15.17:0/851745070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2864104a30 msgr2=0x7f28640fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.746+0000 7f286b949640 1 --2- 172.21.15.17:0/851745070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2864104a30 0x7f28640fb590 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f285802a9c0 tx=0x7f28580055a0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.746+0000 7f286b949640 1 -- 172.21.15.17:0/851745070 shutdown_connections 2024-08-19T01:18:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.746+0000 7f286b949640 1 --2- 172.21.15.17:0/851745070 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f285006e170 0x7f2850070630 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.746+0000 7f286b949640 1 --2- 172.21.15.17:0/851745070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2864104a30 0x7f28640fb590 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.746+0000 7f286b949640 1 --2- 172.21.15.17:0/851745070 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f28640fea30 0x7f28640fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.746+0000 7f286b949640 1 -- 172.21.15.17:0/851745070 >> 172.21.15.17:0/851745070 conn(0x7f28640fa730 msgr2=0x7f2864068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:38.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.746+0000 7f286b949640 1 -- 172.21.15.17:0/851745070 shutdown_connections 2024-08-19T01:18:38.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.746+0000 7f286b949640 1 -- 172.21.15.17:0/851745070 wait complete. 2024-08-19T01:18:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.830+0000 7f6665a38640 1 -- 172.21.15.17:0/452855860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6660104a30 msgr2=0x7f6660104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.830+0000 7f6665a38640 1 --2- 172.21.15.17:0/452855860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6660104a30 0x7f6660104e10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6650009880 tx=0x7f665002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.830+0000 7f6665a38640 1 -- 172.21.15.17:0/452855860 shutdown_connections 2024-08-19T01:18:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.830+0000 7f6665a38640 1 --2- 172.21.15.17:0/452855860 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66600fea30 0x7f66600fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.830+0000 7f6665a38640 1 --2- 172.21.15.17:0/452855860 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6660104a30 0x7f6660104e10 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.830+0000 7f6665a38640 1 -- 172.21.15.17:0/452855860 >> 172.21.15.17:0/452855860 conn(0x7f66600fa730 msgr2=0x7f66600fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.830+0000 7f6665a38640 1 -- 172.21.15.17:0/452855860 shutdown_connections 2024-08-19T01:18:38.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.830+0000 7f6665a38640 1 -- 172.21.15.17:0/452855860 wait complete. 2024-08-19T01:18:38.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.830+0000 7f6665a38640 1 Processor -- start 2024-08-19T01:18:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.830+0000 7f6665a38640 1 -- start start 2024-08-19T01:18:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f6665a38640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66600fea30 0x7f666019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:38.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f6665a38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6660104a30 0x7f666019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f6665a38640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666019c410 con 0x7f6660104a30 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f6665a38640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66601959a0 con 0x7f66600fea30 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f665e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6660104a30 0x7f666019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f665e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6660104a30 0x7f666019bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44192/0 (socket says 172.21.15.17:44192) 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f665e7fc640 1 -- 172.21.15.17:0/1008408785 learned_addr learned my addr 172.21.15.17:0/1008408785 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f665effd640 1 --2- 172.21.15.17:0/1008408785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66600fea30 0x7f666019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f665e7fc640 1 -- 172.21.15.17:0/1008408785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66600fea30 msgr2=0x7f666019b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f665e7fc640 1 --2- 172.21.15.17:0/1008408785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66600fea30 0x7f666019b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f665e7fc640 1 -- 172.21.15.17:0/1008408785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6650009560 con 0x7f6660104a30 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f665e7fc640 1 --2- 172.21.15.17:0/1008408785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6660104a30 0x7f666019bdf0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f665400d6f0 tx=0x7f665400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f6664a36640 1 -- 172.21.15.17:0/1008408785 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6654009a30 con 0x7f6660104a30 2024-08-19T01:18:38.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.831+0000 7f6664a36640 1 -- 172.21.15.17:0/1008408785 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66540054e0 con 0x7f6660104a30 2024-08-19T01:18:38.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.832+0000 7f6665a38640 1 -- 172.21.15.17:0/1008408785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6660195c80 con 0x7f6660104a30 2024-08-19T01:18:38.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.832+0000 7f6664a36640 1 -- 172.21.15.17:0/1008408785 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6654010460 con 0x7f6660104a30 2024-08-19T01:18:38.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.832+0000 7f6665a38640 1 -- 172.21.15.17:0/1008408785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66601961d0 con 0x7f6660104a30 2024-08-19T01:18:38.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.833+0000 7f6665a38640 1 -- 172.21.15.17:0/1008408785 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6660100170 con 0x7f6660104a30 2024-08-19T01:18:38.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.833+0000 7f6664a36640 1 -- 172.21.15.17:0/1008408785 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6654009b90 con 0x7f6660104a30 2024-08-19T01:18:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.834+0000 7f6664a36640 1 --2- 172.21.15.17:0/1008408785 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f664806e170 0x7f6648070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.834+0000 7f6664a36640 1 -- 172.21.15.17:0/1008408785 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f665408dd60 con 0x7f6660104a30 2024-08-19T01:18:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.834+0000 7f665effd640 1 --2- 172.21.15.17:0/1008408785 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f664806e170 0x7f6648070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:38.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.834+0000 7f665effd640 1 --2- 172.21.15.17:0/1008408785 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f664806e170 0x7f6648070630 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6650000c00 tx=0x7f6650004040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:38.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:38.838+0000 7f6664a36640 1 -- 172.21.15.17:0/1008408785 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6654057040 con 0x7f6660104a30 2024-08-19T01:18:39.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.030+0000 7f6665a38640 1 -- 172.21.15.17:0/1008408785 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f666010bcc0 con 0x7f664806e170 2024-08-19T01:18:39.033 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:38 smithi017 ceph-mon[99370]: pgmap v595: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:39.033 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:38 smithi017 ceph-mon[99370]: from='client.35128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:39.033 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:38 smithi017 ceph-mon[99370]: from='client.35132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:39.033 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:38 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2428489373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:18:39.033 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:38 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/851745070' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:18:39.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.031+0000 7f6664a36640 1 -- 172.21.15.17:0/1008408785 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f666010bcc0 con 0x7f664806e170 2024-08-19T01:18:39.034 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:18:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:18:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:18:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:18:39.034 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:18:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:18:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:18:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:18:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:18:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:18:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:18:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:18:39.035 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:18:39.035 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:18:39.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.033+0000 7f6665a38640 1 -- 172.21.15.17:0/1008408785 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f664806e170 msgr2=0x7f6648070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:39.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.033+0000 7f6665a38640 1 --2- 172.21.15.17:0/1008408785 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f664806e170 0x7f6648070630 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6650000c00 tx=0x7f6650004040 comp rx=0 tx=0).stop 2024-08-19T01:18:39.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.033+0000 7f6665a38640 1 -- 172.21.15.17:0/1008408785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6660104a30 msgr2=0x7f666019bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:39.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.033+0000 7f6665a38640 1 --2- 172.21.15.17:0/1008408785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6660104a30 0x7f666019bdf0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f665400d6f0 tx=0x7f665400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.033+0000 7f6665a38640 1 -- 172.21.15.17:0/1008408785 shutdown_connections 2024-08-19T01:18:39.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.033+0000 7f6665a38640 1 --2- 172.21.15.17:0/1008408785 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f664806e170 0x7f6648070630 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.033+0000 7f6665a38640 1 --2- 172.21.15.17:0/1008408785 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6660104a30 0x7f666019bdf0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.033+0000 7f6665a38640 1 --2- 172.21.15.17:0/1008408785 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66600fea30 0x7f666019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.033+0000 7f6665a38640 1 -- 172.21.15.17:0/1008408785 >> 172.21.15.17:0/1008408785 conn(0x7f66600fa730 msgr2=0x7f66600fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:39.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.033+0000 7f6665a38640 1 -- 172.21.15.17:0/1008408785 shutdown_connections 2024-08-19T01:18:39.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.033+0000 7f6665a38640 1 -- 172.21.15.17:0/1008408785 wait complete. 2024-08-19T01:18:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.115+0000 7fab2bbd5640 1 -- 172.21.15.17:0/1698538059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24100d50 msgr2=0x7fab24101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:39.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.115+0000 7fab2bbd5640 1 --2- 172.21.15.17:0/1698538059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24100d50 0x7fab24101130 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fab20009880 tx=0x7fab2002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.115+0000 7fab2bbd5640 1 -- 172.21.15.17:0/1698538059 shutdown_connections 2024-08-19T01:18:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.115+0000 7fab2bbd5640 1 --2- 172.21.15.17:0/1698538059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab24101670 0x7fab24109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.115+0000 7fab2bbd5640 1 --2- 172.21.15.17:0/1698538059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24100d50 0x7fab24101130 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.115+0000 7fab2bbd5640 1 -- 172.21.15.17:0/1698538059 >> 172.21.15.17:0/1698538059 conn(0x7fab240fa730 msgr2=0x7fab240fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:39.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.115+0000 7fab2bbd5640 1 -- 172.21.15.17:0/1698538059 shutdown_connections 2024-08-19T01:18:39.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.115+0000 7fab2bbd5640 1 -- 172.21.15.17:0/1698538059 wait complete. 2024-08-19T01:18:39.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab2bbd5640 1 Processor -- start 2024-08-19T01:18:39.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab2bbd5640 1 -- start start 2024-08-19T01:18:39.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab2bbd5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24100d50 0x7fab240fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:39.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab2bbd5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab24101670 0x7fab240feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:39.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab2bbd5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240ff430 con 0x7fab24100d50 2024-08-19T01:18:39.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab2bbd5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240ff5a0 con 0x7fab24101670 2024-08-19T01:18:39.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab29971640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24100d50 0x7fab240fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab29971640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24100d50 0x7fab240fe9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44198/0 (socket says 172.21.15.17:44198) 2024-08-19T01:18:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab29971640 1 -- 172.21.15.17:0/3908443251 learned_addr learned my addr 172.21.15.17:0/3908443251 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:18:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab29170640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab24101670 0x7fab240feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab29971640 1 -- 172.21.15.17:0/3908443251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab24101670 msgr2=0x7fab240feef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab29971640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab24101670 0x7fab240feef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab29971640 1 -- 172.21.15.17:0/3908443251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab20009560 con 0x7fab24100d50 2024-08-19T01:18:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.116+0000 7fab29170640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab24101670 0x7fab240feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:18:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.117+0000 7fab29971640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24100d50 0x7fab240fe9b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fab2002a9c0 tx=0x7fab200055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.117+0000 7fab1affd640 1 -- 172.21.15.17:0/3908443251 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab20004aa0 con 0x7fab24100d50 2024-08-19T01:18:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.117+0000 7fab1affd640 1 -- 172.21.15.17:0/3908443251 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab20004c00 con 0x7fab24100d50 2024-08-19T01:18:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.117+0000 7fab2bbd5640 1 -- 172.21.15.17:0/3908443251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab241a1c50 con 0x7fab24100d50 2024-08-19T01:18:39.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.117+0000 7fab1affd640 1 -- 172.21.15.17:0/3908443251 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab20003980 con 0x7fab24100d50 2024-08-19T01:18:39.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.117+0000 7fab2bbd5640 1 -- 172.21.15.17:0/3908443251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab241a1fb0 con 0x7fab24100d50 2024-08-19T01:18:39.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.118+0000 7fab2bbd5640 1 -- 172.21.15.17:0/3908443251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab24068cd0 con 0x7fab24100d50 2024-08-19T01:18:39.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.118+0000 7fab1affd640 1 -- 172.21.15.17:0/3908443251 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fab20003ae0 con 0x7fab24100d50 2024-08-19T01:18:39.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.119+0000 7fab1affd640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fab1006e170 0x7fab10070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:18:39.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.119+0000 7fab1affd640 1 -- 172.21.15.17:0/3908443251 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fab200af130 con 0x7fab24100d50 2024-08-19T01:18:39.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.119+0000 7fab29170640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fab1006e170 0x7fab10070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:18:39.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.119+0000 7fab29170640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fab1006e170 0x7fab10070630 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab140058c0 tx=0x7fab14005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:18:39.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.123+0000 7fab1affd640 1 -- 172.21.15.17:0/3908443251 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fab20078490 con 0x7fab24100d50 2024-08-19T01:18:39.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.365+0000 7fab2bbd5640 1 -- 172.21.15.17:0/3908443251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fab241043a0 con 0x7fab24100d50 2024-08-19T01:18:39.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.366+0000 7fab1affd640 1 -- 172.21.15.17:0/3908443251 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7fab2007bb50 con 0x7fab24100d50 2024-08-19T01:18:39.369 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:18:39.369 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:18:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:18:39.369 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:18:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:18:39.369 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:18:39.369 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:18:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.368+0000 7fab2bbd5640 1 -- 172.21.15.17:0/3908443251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fab1006e170 msgr2=0x7fab10070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.368+0000 7fab2bbd5640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fab1006e170 0x7fab10070630 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fab140058c0 tx=0x7fab14005850 comp rx=0 tx=0).stop 2024-08-19T01:18:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.368+0000 7fab2bbd5640 1 -- 172.21.15.17:0/3908443251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24100d50 msgr2=0x7fab240fe9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:18:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.368+0000 7fab2bbd5640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24100d50 0x7fab240fe9b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fab2002a9c0 tx=0x7fab200055a0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.368+0000 7fab2bbd5640 1 -- 172.21.15.17:0/3908443251 shutdown_connections 2024-08-19T01:18:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.368+0000 7fab2bbd5640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fab1006e170 0x7fab10070630 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.368+0000 7fab2bbd5640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fab24101670 0x7fab240feef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.368+0000 7fab2bbd5640 1 --2- 172.21.15.17:0/3908443251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab24100d50 0x7fab240fe9b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:18:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.368+0000 7fab2bbd5640 1 -- 172.21.15.17:0/3908443251 >> 172.21.15.17:0/3908443251 conn(0x7fab240fa730 msgr2=0x7fab24101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:18:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.368+0000 7fab2bbd5640 1 -- 172.21.15.17:0/3908443251 shutdown_connections 2024-08-19T01:18:39.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:18:39.368+0000 7fab2bbd5640 1 -- 172.21.15.17:0/3908443251 wait complete. 2024-08-19T01:18:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:38 smithi086 ceph-mon[71303]: pgmap v595: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:38 smithi086 ceph-mon[71303]: from='client.35128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:38 smithi086 ceph-mon[71303]: from='client.35132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:38 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2428489373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:18:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:38 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/851745070' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:18:40.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:39 smithi017 ceph-mon[99370]: from='client.35136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:40.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:39 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3908443251' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:18:40.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:39 smithi086 ceph-mon[71303]: from='client.35136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:39 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3908443251' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:18:41.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:40 smithi017 ceph-mon[99370]: from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:41.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:40 smithi017 ceph-mon[99370]: pgmap v596: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:41.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:40 smithi086 ceph-mon[71303]: from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:18:41.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:40 smithi086 ceph-mon[71303]: pgmap v596: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:43.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:42 smithi017 ceph-mon[99370]: pgmap v597: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:43.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:42 smithi086 ceph-mon[71303]: pgmap v597: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:45.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:44 smithi017 ceph-mon[99370]: pgmap v598: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:45.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:44 smithi086 ceph-mon[71303]: pgmap v598: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:47.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:46 smithi017 ceph-mon[99370]: pgmap v599: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:47.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:46 smithi086 ceph-mon[71303]: pgmap v599: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:48.232 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:47 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:18:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:47 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:18:49.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:48 smithi017 ceph-mon[99370]: pgmap v600: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:49.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:48 smithi086 ceph-mon[71303]: pgmap v600: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:51.248 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:50 smithi086 ceph-mon[71303]: pgmap v601: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:51.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:50 smithi017 ceph-mon[99370]: pgmap v601: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:53.316 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:52 smithi086 ceph-mon[71303]: pgmap v602: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:53.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:52 smithi017 ceph-mon[99370]: pgmap v602: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:55.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:54 smithi017 ceph-mon[99370]: pgmap v603: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:55.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:54 smithi086 ceph-mon[71303]: pgmap v603: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:56 smithi017 ceph-mon[99370]: pgmap v604: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:56 smithi086 ceph-mon[71303]: pgmap v604: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:59.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:18:58 smithi017 ceph-mon[99370]: pgmap v605: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:18:59.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:18:58 smithi086 ceph-mon[71303]: pgmap v605: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:00 smithi017 ceph-mon[99370]: pgmap v606: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:01.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:00 smithi086 ceph-mon[71303]: pgmap v606: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:03.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:02 smithi017 ceph-mon[99370]: pgmap v607: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:03.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:02 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:19:03.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:02 smithi086 ceph-mon[71303]: pgmap v607: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:03.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:02 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:19:05.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:04 smithi017 ceph-mon[99370]: pgmap v608: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:05.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:04 smithi086 ceph-mon[71303]: pgmap v608: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:07.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:06 smithi017 ceph-mon[99370]: pgmap v609: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:06 smithi086 ceph-mon[71303]: pgmap v609: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:09 smithi017 ceph-mon[99370]: pgmap v610: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:09.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:09 smithi086 ceph-mon[71303]: pgmap v610: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:09.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.464+0000 7f56c88d3640 1 -- 172.21.15.17:0/3920937344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c40fe9f0 msgr2=0x7f56c40fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:09.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.464+0000 7f56c88d3640 1 --2- 172.21.15.17:0/3920937344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c40fe9f0 0x7f56c40fee50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009880 tx=0x7f56ac02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.464+0000 7f56c88d3640 1 -- 172.21.15.17:0/3920937344 shutdown_connections 2024-08-19T01:19:09.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.464+0000 7f56c88d3640 1 --2- 172.21.15.17:0/3920937344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c40fe9f0 0x7f56c40fee50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.464+0000 7f56c88d3640 1 --2- 172.21.15.17:0/3920937344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56c41049f0 0x7f56c4104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.464+0000 7f56c88d3640 1 -- 172.21.15.17:0/3920937344 >> 172.21.15.17:0/3920937344 conn(0x7f56c40758a0 msgr2=0x7f56c40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:09.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.464+0000 7f56c88d3640 1 -- 172.21.15.17:0/3920937344 shutdown_connections 2024-08-19T01:19:09.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.464+0000 7f56c88d3640 1 -- 172.21.15.17:0/3920937344 wait complete. 2024-08-19T01:19:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.465+0000 7f56c88d3640 1 Processor -- start 2024-08-19T01:19:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.465+0000 7f56c88d3640 1 -- start start 2024-08-19T01:19:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c88d3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c40fe9f0 0x7f56c419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c88d3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56c41049f0 0x7f56c419bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c88d3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c41959e0 con 0x7f56c40fe9f0 2024-08-19T01:19:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c88d3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c4195b20 con 0x7f56c41049f0 2024-08-19T01:19:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c40fe9f0 0x7f56c419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c40fe9f0 0x7f56c419b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58136/0 (socket says 172.21.15.17:58136) 2024-08-19T01:19:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c259c640 1 -- 172.21.15.17:0/2259998846 learned_addr learned my addr 172.21.15.17:0/2259998846 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c1d9b640 1 --2- 172.21.15.17:0/2259998846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56c41049f0 0x7f56c419bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:09.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c259c640 1 -- 172.21.15.17:0/2259998846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56c41049f0 msgr2=0x7f56c419bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:09.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c259c640 1 --2- 172.21.15.17:0/2259998846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56c41049f0 0x7f56c419bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c259c640 1 -- 172.21.15.17:0/2259998846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac009560 con 0x7f56c40fe9f0 2024-08-19T01:19:09.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56c259c640 1 --2- 172.21.15.17:0/2259998846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c40fe9f0 0x7f56c419b980 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f56b400d8d0 tx=0x7f56b400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:09.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.466+0000 7f56bb7fe640 1 -- 172.21.15.17:0/2259998846 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56b400bea0 con 0x7f56c40fe9f0 2024-08-19T01:19:09.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.467+0000 7f56bb7fe640 1 -- 172.21.15.17:0/2259998846 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56b4009c00 con 0x7f56c40fe9f0 2024-08-19T01:19:09.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.467+0000 7f56bb7fe640 1 -- 172.21.15.17:0/2259998846 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56b400f710 con 0x7f56c40fe9f0 2024-08-19T01:19:09.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.467+0000 7f56c88d3640 1 -- 172.21.15.17:0/2259998846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c4195e00 con 0x7f56c40fe9f0 2024-08-19T01:19:09.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.467+0000 7f56c88d3640 1 -- 172.21.15.17:0/2259998846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c4196320 con 0x7f56c40fe9f0 2024-08-19T01:19:09.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.468+0000 7f56c88d3640 1 -- 172.21.15.17:0/2259998846 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c4100130 con 0x7f56c40fe9f0 2024-08-19T01:19:09.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.468+0000 7f56bb7fe640 1 -- 172.21.15.17:0/2259998846 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f56b400f990 con 0x7f56c40fe9f0 2024-08-19T01:19:09.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.469+0000 7f56bb7fe640 1 --2- 172.21.15.17:0/2259998846 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f56b006e170 0x7f56b0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:09.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.469+0000 7f56bb7fe640 1 -- 172.21.15.17:0/2259998846 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f56b408de70 con 0x7f56c40fe9f0 2024-08-19T01:19:09.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.469+0000 7f56c1d9b640 1 --2- 172.21.15.17:0/2259998846 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f56b006e170 0x7f56b0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:09.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.469+0000 7f56c1d9b640 1 --2- 172.21.15.17:0/2259998846 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f56b006e170 0x7f56b0070630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009230 tx=0x7f56ac0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:09.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.473+0000 7f56bb7fe640 1 -- 172.21.15.17:0/2259998846 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f56b4057200 con 0x7f56c40fe9f0 2024-08-19T01:19:09.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.667+0000 7f56c88d3640 1 -- 172.21.15.17:0/2259998846 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56c410bc60 con 0x7f56b006e170 2024-08-19T01:19:09.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.669+0000 7f56bb7fe640 1 -- 172.21.15.17:0/2259998846 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f56c410bc60 con 0x7f56b006e170 2024-08-19T01:19:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.670+0000 7f56c88d3640 1 -- 172.21.15.17:0/2259998846 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f56b006e170 msgr2=0x7f56b0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.670+0000 7f56c88d3640 1 --2- 172.21.15.17:0/2259998846 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f56b006e170 0x7f56b0070630 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009230 tx=0x7f56ac0058d0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.670+0000 7f56c88d3640 1 -- 172.21.15.17:0/2259998846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c40fe9f0 msgr2=0x7f56c419b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.670+0000 7f56c88d3640 1 --2- 172.21.15.17:0/2259998846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c40fe9f0 0x7f56c419b980 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f56b400d8d0 tx=0x7f56b400dd90 comp rx=0 tx=0).stop 2024-08-19T01:19:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.670+0000 7f56c88d3640 1 -- 172.21.15.17:0/2259998846 shutdown_connections 2024-08-19T01:19:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.671+0000 7f56c88d3640 1 --2- 172.21.15.17:0/2259998846 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f56b006e170 0x7f56b0070630 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.671+0000 7f56c88d3640 1 --2- 172.21.15.17:0/2259998846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f56c41049f0 0x7f56c419bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.671+0000 7f56c88d3640 1 --2- 172.21.15.17:0/2259998846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56c40fe9f0 0x7f56c419b980 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.671+0000 7f56c88d3640 1 -- 172.21.15.17:0/2259998846 >> 172.21.15.17:0/2259998846 conn(0x7f56c40758a0 msgr2=0x7f56c40fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:09.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.671+0000 7f56c88d3640 1 -- 172.21.15.17:0/2259998846 shutdown_connections 2024-08-19T01:19:09.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.671+0000 7f56c88d3640 1 -- 172.21.15.17:0/2259998846 wait complete. 2024-08-19T01:19:09.682 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:19:09.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.754+0000 7f0535efb640 1 -- 172.21.15.17:0/575800384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05300ffda0 msgr2=0x7f0530100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:09.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.754+0000 7f0535efb640 1 --2- 172.21.15.17:0/575800384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05300ffda0 0x7f0530100180 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0520009880 tx=0x7f052002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.754+0000 7f0535efb640 1 -- 172.21.15.17:0/575800384 shutdown_connections 2024-08-19T01:19:09.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.754+0000 7f0535efb640 1 --2- 172.21.15.17:0/575800384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0530100750 0x7f05301047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.754+0000 7f0535efb640 1 --2- 172.21.15.17:0/575800384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05300ffda0 0x7f0530100180 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.754+0000 7f0535efb640 1 -- 172.21.15.17:0/575800384 >> 172.21.15.17:0/575800384 conn(0x7f05300fb840 msgr2=0x7f05300fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:09.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.754+0000 7f0535efb640 1 -- 172.21.15.17:0/575800384 shutdown_connections 2024-08-19T01:19:09.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.754+0000 7f0535efb640 1 -- 172.21.15.17:0/575800384 wait complete. 2024-08-19T01:19:09.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.755+0000 7f0535efb640 1 Processor -- start 2024-08-19T01:19:09.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.755+0000 7f0535efb640 1 -- start start 2024-08-19T01:19:09.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.755+0000 7f0535efb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05300ffda0 0x7f053019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:09.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.755+0000 7f0535efb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0530100750 0x7f053019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:09.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.755+0000 7f0535efb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0530195a10 con 0x7f0530100750 2024-08-19T01:19:09.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.755+0000 7f0535efb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0530195b50 con 0x7f05300ffda0 2024-08-19T01:19:09.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.755+0000 7f052effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0530100750 0x7f053019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:09.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.755+0000 7f052effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0530100750 0x7f053019bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58152/0 (socket says 172.21.15.17:58152) 2024-08-19T01:19:09.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.755+0000 7f052effd640 1 -- 172.21.15.17:0/297881586 learned_addr learned my addr 172.21.15.17:0/297881586 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:09.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.755+0000 7f052f7fe640 1 --2- 172.21.15.17:0/297881586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05300ffda0 0x7f053019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:09.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.756+0000 7f052effd640 1 -- 172.21.15.17:0/297881586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05300ffda0 msgr2=0x7f053019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:09.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.756+0000 7f052effd640 1 --2- 172.21.15.17:0/297881586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05300ffda0 0x7f053019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.756+0000 7f052effd640 1 -- 172.21.15.17:0/297881586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520009560 con 0x7f0530100750 2024-08-19T01:19:09.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.756+0000 7f052effd640 1 --2- 172.21.15.17:0/297881586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0530100750 0x7f053019bef0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f052400d6f0 tx=0x7f052400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:09.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.756+0000 7f052cff9640 1 -- 172.21.15.17:0/297881586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0524009a30 con 0x7f0530100750 2024-08-19T01:19:09.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.756+0000 7f052cff9640 1 -- 172.21.15.17:0/297881586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05240054e0 con 0x7f0530100750 2024-08-19T01:19:09.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.756+0000 7f0535efb640 1 -- 172.21.15.17:0/297881586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0530195e30 con 0x7f0530100750 2024-08-19T01:19:09.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.756+0000 7f052cff9640 1 -- 172.21.15.17:0/297881586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0524010460 con 0x7f0530100750 2024-08-19T01:19:09.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.756+0000 7f0535efb640 1 -- 172.21.15.17:0/297881586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0530196380 con 0x7f0530100750 2024-08-19T01:19:09.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.757+0000 7f0535efb640 1 -- 172.21.15.17:0/297881586 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0530101280 con 0x7f0530100750 2024-08-19T01:19:09.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.758+0000 7f052cff9640 1 -- 172.21.15.17:0/297881586 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0524009b90 con 0x7f0530100750 2024-08-19T01:19:09.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.758+0000 7f052cff9640 1 --2- 172.21.15.17:0/297881586 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f051806e170 0x7f0518070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:09.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.758+0000 7f052cff9640 1 -- 172.21.15.17:0/297881586 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f052408dd30 con 0x7f0530100750 2024-08-19T01:19:09.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.759+0000 7f052f7fe640 1 --2- 172.21.15.17:0/297881586 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f051806e170 0x7f0518070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:09.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.759+0000 7f052f7fe640 1 --2- 172.21.15.17:0/297881586 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f051806e170 0x7f0518070630 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0520000c00 tx=0x7f0520005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:09.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.763+0000 7f052cff9640 1 -- 172.21.15.17:0/297881586 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0524057010 con 0x7f0530100750 2024-08-19T01:19:09.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.955+0000 7f0535efb640 1 -- 172.21.15.17:0/297881586 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0530196fe0 con 0x7f051806e170 2024-08-19T01:19:09.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.956+0000 7f052cff9640 1 -- 172.21.15.17:0/297881586 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0530196fe0 con 0x7f051806e170 2024-08-19T01:19:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.958+0000 7f0535efb640 1 -- 172.21.15.17:0/297881586 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f051806e170 msgr2=0x7f0518070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:09.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.958+0000 7f0535efb640 1 --2- 172.21.15.17:0/297881586 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f051806e170 0x7f0518070630 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0520000c00 tx=0x7f0520005a20 comp rx=0 tx=0).stop 2024-08-19T01:19:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.958+0000 7f0535efb640 1 -- 172.21.15.17:0/297881586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0530100750 msgr2=0x7f053019bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.958+0000 7f0535efb640 1 --2- 172.21.15.17:0/297881586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0530100750 0x7f053019bef0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f052400d6f0 tx=0x7f052400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.958+0000 7f0535efb640 1 -- 172.21.15.17:0/297881586 shutdown_connections 2024-08-19T01:19:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.958+0000 7f0535efb640 1 --2- 172.21.15.17:0/297881586 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f051806e170 0x7f0518070630 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.958+0000 7f0535efb640 1 --2- 172.21.15.17:0/297881586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0530100750 0x7f053019bef0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.958+0000 7f0535efb640 1 --2- 172.21.15.17:0/297881586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05300ffda0 0x7f053019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.958+0000 7f0535efb640 1 -- 172.21.15.17:0/297881586 >> 172.21.15.17:0/297881586 conn(0x7f05300fb840 msgr2=0x7f05300fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.958+0000 7f0535efb640 1 -- 172.21.15.17:0/297881586 shutdown_connections 2024-08-19T01:19:09.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:09.958+0000 7f0535efb640 1 -- 172.21.15.17:0/297881586 wait complete. 2024-08-19T01:19:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.040+0000 7fb302dd0640 1 -- 172.21.15.17:0/2104693974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc0fea30 msgr2=0x7fb2fc0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.040+0000 7fb302dd0640 1 --2- 172.21.15.17:0/2104693974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc0fea30 0x7fb2fc0fee90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8009880 tx=0x7fb2e802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.040+0000 7fb302dd0640 1 -- 172.21.15.17:0/2104693974 shutdown_connections 2024-08-19T01:19:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.040+0000 7fb302dd0640 1 --2- 172.21.15.17:0/2104693974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc0fea30 0x7fb2fc0fee90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.040+0000 7fb302dd0640 1 --2- 172.21.15.17:0/2104693974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2fc104a30 0x7fb2fc104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.040+0000 7fb302dd0640 1 -- 172.21.15.17:0/2104693974 >> 172.21.15.17:0/2104693974 conn(0x7fb2fc0fa730 msgr2=0x7fb2fc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.040+0000 7fb302dd0640 1 -- 172.21.15.17:0/2104693974 shutdown_connections 2024-08-19T01:19:10.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.040+0000 7fb302dd0640 1 -- 172.21.15.17:0/2104693974 wait complete. 2024-08-19T01:19:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.041+0000 7fb302dd0640 1 Processor -- start 2024-08-19T01:19:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.041+0000 7fb302dd0640 1 -- start start 2024-08-19T01:19:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.041+0000 7fb302dd0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2fc0fea30 0x7fb2fc0fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.041+0000 7fb302dd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc104a30 0x7fb2fc0fb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.041+0000 7fb302dd0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0fbad0 con 0x7fb2fc104a30 2024-08-19T01:19:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.041+0000 7fb302dd0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2fc0fbc40 con 0x7fb2fc0fea30 2024-08-19T01:19:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.041+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc104a30 0x7fb2fc0fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.041+0000 7fb2fbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc104a30 0x7fb2fc0fb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58166/0 (socket says 172.21.15.17:58166) 2024-08-19T01:19:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.041+0000 7fb2fbfff640 1 -- 172.21.15.17:0/3844342906 learned_addr learned my addr 172.21.15.17:0/3844342906 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.041+0000 7fb300b6c640 1 --2- 172.21.15.17:0/3844342906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2fc0fea30 0x7fb2fc0fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.042+0000 7fb2fbfff640 1 -- 172.21.15.17:0/3844342906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2fc0fea30 msgr2=0x7fb2fc0fb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.042+0000 7fb2fbfff640 1 --2- 172.21.15.17:0/3844342906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2fc0fea30 0x7fb2fc0fb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.042+0000 7fb2fbfff640 1 -- 172.21.15.17:0/3844342906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e8009560 con 0x7fb2fc104a30 2024-08-19T01:19:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.042+0000 7fb2fbfff640 1 --2- 172.21.15.17:0/3844342906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc104a30 0x7fb2fc0fb590 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb2e802a9c0 tx=0x7fb2e80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.042+0000 7fb2f9ffb640 1 -- 172.21.15.17:0/3844342906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e8004aa0 con 0x7fb2fc104a30 2024-08-19T01:19:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.042+0000 7fb2f9ffb640 1 -- 172.21.15.17:0/3844342906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb2e8004c00 con 0x7fb2fc104a30 2024-08-19T01:19:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.042+0000 7fb302dd0640 1 -- 172.21.15.17:0/3844342906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2fc0fbec0 con 0x7fb2fc104a30 2024-08-19T01:19:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.042+0000 7fb2f9ffb640 1 -- 172.21.15.17:0/3844342906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2e8003980 con 0x7fb2fc104a30 2024-08-19T01:19:10.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.042+0000 7fb302dd0640 1 -- 172.21.15.17:0/3844342906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2fc1a1f40 con 0x7fb2fc104a30 2024-08-19T01:19:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.043+0000 7fb302dd0640 1 -- 172.21.15.17:0/3844342906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc100170 con 0x7fb2fc104a30 2024-08-19T01:19:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.044+0000 7fb2f9ffb640 1 -- 172.21.15.17:0/3844342906 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb2e8003b00 con 0x7fb2fc104a30 2024-08-19T01:19:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.044+0000 7fb2f9ffb640 1 --2- 172.21.15.17:0/3844342906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb2ec06e170 0x7fb2ec070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.045+0000 7fb2f9ffb640 1 -- 172.21.15.17:0/3844342906 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb2e80aef00 con 0x7fb2fc104a30 2024-08-19T01:19:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.045+0000 7fb300b6c640 1 --2- 172.21.15.17:0/3844342906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb2ec06e170 0x7fb2ec070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.045+0000 7fb300b6c640 1 --2- 172.21.15.17:0/3844342906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb2ec06e170 0x7fb2ec070630 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0005fd0 tx=0x7fb2f000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:10.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.049+0000 7fb2f9ffb640 1 -- 172.21.15.17:0/3844342906 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb2e8078310 con 0x7fb2fc104a30 2024-08-19T01:19:10.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.234+0000 7fb302dd0640 1 -- 172.21.15.17:0/3844342906 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2fc0fbec0 con 0x7fb2ec06e170 2024-08-19T01:19:10.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.244+0000 7fb2f9ffb640 1 -- 172.21.15.17:0/3844342906 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb2fc0fbec0 con 0x7fb2ec06e170 2024-08-19T01:19:10.246 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:19:10.246 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (20m) 14m ago 31m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:19:10.246 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (31m) 14m ago 31m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:19:10.246 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (30m) 14m ago 30m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:19:10.246 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (18m) 14m ago 31m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (18m) 14m ago 30m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (20m) 14m ago 30m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (14m) 14m ago 25m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (14m) 14m ago 25m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (25m) 14m ago 25m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (14m) 14m ago 25m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (22m) 14m ago 32m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (21m) 14m ago 30m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (19m) 14m ago 32m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (18m) 14m ago 30m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (21m) 14m ago 31m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (21m) 14m ago 30m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (17m) 14m ago 29m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:19:10.247 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (17m) 14m ago 28m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:19:10.248 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (16m) 14m ago 28m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:19:10.248 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (16m) 14m ago 28m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:19:10.248 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (15m) 14m ago 27m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:19:10.248 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (15m) 14m ago 27m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:19:10.248 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (20m) 14m ago 30m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:19:10.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.246+0000 7fb302dd0640 1 -- 172.21.15.17:0/3844342906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb2ec06e170 msgr2=0x7fb2ec070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.246+0000 7fb302dd0640 1 --2- 172.21.15.17:0/3844342906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb2ec06e170 0x7fb2ec070630 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0005fd0 tx=0x7fb2f000b390 comp rx=0 tx=0).stop 2024-08-19T01:19:10.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.246+0000 7fb302dd0640 1 -- 172.21.15.17:0/3844342906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc104a30 msgr2=0x7fb2fc0fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.246+0000 7fb302dd0640 1 --2- 172.21.15.17:0/3844342906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc104a30 0x7fb2fc0fb590 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb2e802a9c0 tx=0x7fb2e80055a0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.246+0000 7fb302dd0640 1 -- 172.21.15.17:0/3844342906 shutdown_connections 2024-08-19T01:19:10.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.246+0000 7fb302dd0640 1 --2- 172.21.15.17:0/3844342906 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb2ec06e170 0x7fb2ec070630 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.246+0000 7fb302dd0640 1 --2- 172.21.15.17:0/3844342906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb2fc104a30 0x7fb2fc0fb590 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.246+0000 7fb302dd0640 1 --2- 172.21.15.17:0/3844342906 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb2fc0fea30 0x7fb2fc0fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.246+0000 7fb302dd0640 1 -- 172.21.15.17:0/3844342906 >> 172.21.15.17:0/3844342906 conn(0x7fb2fc0fa730 msgr2=0x7fb2fc068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:10.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.246+0000 7fb302dd0640 1 -- 172.21.15.17:0/3844342906 shutdown_connections 2024-08-19T01:19:10.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.246+0000 7fb302dd0640 1 -- 172.21.15.17:0/3844342906 wait complete. 2024-08-19T01:19:10.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.327+0000 7f70d6c75640 1 -- 172.21.15.17:0/1067545086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0104a30 msgr2=0x7f70d0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.327+0000 7f70d6c75640 1 --2- 172.21.15.17:0/1067545086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0104a30 0x7f70d0104e10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009880 tx=0x7f70c402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.327+0000 7f70d6c75640 1 -- 172.21.15.17:0/1067545086 shutdown_connections 2024-08-19T01:19:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.327+0000 7f70d6c75640 1 --2- 172.21.15.17:0/1067545086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70d00fea30 0x7f70d00fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.327+0000 7f70d6c75640 1 --2- 172.21.15.17:0/1067545086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0104a30 0x7f70d0104e10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.327+0000 7f70d6c75640 1 -- 172.21.15.17:0/1067545086 >> 172.21.15.17:0/1067545086 conn(0x7f70d00fa730 msgr2=0x7f70d00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.327+0000 7f70d6c75640 1 -- 172.21.15.17:0/1067545086 shutdown_connections 2024-08-19T01:19:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.327+0000 7f70d6c75640 1 -- 172.21.15.17:0/1067545086 wait complete. 2024-08-19T01:19:10.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.328+0000 7f70d6c75640 1 Processor -- start 2024-08-19T01:19:10.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.328+0000 7f70d6c75640 1 -- start start 2024-08-19T01:19:10.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.328+0000 7f70d6c75640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70d00fea30 0x7f70d00fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.328+0000 7f70d6c75640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0104a30 0x7f70d00fb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.328+0000 7f70d6c75640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00fbad0 con 0x7f70d0104a30 2024-08-19T01:19:10.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.328+0000 7f70d6c75640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00fbc40 con 0x7f70d00fea30 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.328+0000 7f70cffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0104a30 0x7f70d00fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.328+0000 7f70cffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0104a30 0x7f70d00fb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58188/0 (socket says 172.21.15.17:58188) 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.328+0000 7f70cffff640 1 -- 172.21.15.17:0/3955418497 learned_addr learned my addr 172.21.15.17:0/3955418497 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.328+0000 7f70d4a11640 1 --2- 172.21.15.17:0/3955418497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70d00fea30 0x7f70d00fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.329+0000 7f70cffff640 1 -- 172.21.15.17:0/3955418497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70d00fea30 msgr2=0x7f70d00fb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.329+0000 7f70cffff640 1 --2- 172.21.15.17:0/3955418497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70d00fea30 0x7f70d00fb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.329+0000 7f70cffff640 1 -- 172.21.15.17:0/3955418497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c4009560 con 0x7f70d0104a30 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.329+0000 7f70cffff640 1 --2- 172.21.15.17:0/3955418497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0104a30 0x7f70d00fb590 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00d6f0 tx=0x7f70bc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.329+0000 7f70cdffb640 1 -- 172.21.15.17:0/3955418497 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70bc009a30 con 0x7f70d0104a30 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.329+0000 7f70cdffb640 1 -- 172.21.15.17:0/3955418497 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70bc0054e0 con 0x7f70d0104a30 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.329+0000 7f70d6c75640 1 -- 172.21.15.17:0/3955418497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d01a1cc0 con 0x7f70d0104a30 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.329+0000 7f70cdffb640 1 -- 172.21.15.17:0/3955418497 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70bc010460 con 0x7f70d0104a30 2024-08-19T01:19:10.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.329+0000 7f70d6c75640 1 -- 172.21.15.17:0/3955418497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d01a2020 con 0x7f70d0104a30 2024-08-19T01:19:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.330+0000 7f70d6c75640 1 -- 172.21.15.17:0/3955418497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d0100170 con 0x7f70d0104a30 2024-08-19T01:19:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.331+0000 7f70cdffb640 1 -- 172.21.15.17:0/3955418497 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f70bc009b90 con 0x7f70d0104a30 2024-08-19T01:19:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.332+0000 7f70cdffb640 1 --2- 172.21.15.17:0/3955418497 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70c006e170 0x7f70c0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.332+0000 7f70cdffb640 1 -- 172.21.15.17:0/3955418497 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f70bc08dc80 con 0x7f70d0104a30 2024-08-19T01:19:10.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.332+0000 7f70d4a11640 1 --2- 172.21.15.17:0/3955418497 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70c006e170 0x7f70c0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.332+0000 7f70d4a11640 1 --2- 172.21.15.17:0/3955418497 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70c006e170 0x7f70c0070630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009230 tx=0x7f70c40058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:10.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.336+0000 7f70cdffb640 1 -- 172.21.15.17:0/3955418497 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f70bc057010 con 0x7f70d0104a30 2024-08-19T01:19:10.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.583+0000 7f70d6c75640 1 -- 172.21.15.17:0/3955418497 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f70d00fee90 con 0x7f70d0104a30 2024-08-19T01:19:10.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.583+0000 7f70cdffb640 1 -- 172.21.15.17:0/3955418497 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f70bc017350 con 0x7f70d0104a30 2024-08-19T01:19:10.585 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:19:10.585 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:19:10.586 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:19:10.587 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:19:10.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:19:10.587 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:19:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.586+0000 7f70d6c75640 1 -- 172.21.15.17:0/3955418497 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70c006e170 msgr2=0x7f70c0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.586+0000 7f70d6c75640 1 --2- 172.21.15.17:0/3955418497 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70c006e170 0x7f70c0070630 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f70c4009230 tx=0x7f70c40058d0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.586+0000 7f70d6c75640 1 -- 172.21.15.17:0/3955418497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0104a30 msgr2=0x7f70d00fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.586+0000 7f70d6c75640 1 --2- 172.21.15.17:0/3955418497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0104a30 0x7f70d00fb590 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00d6f0 tx=0x7f70bc00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.586+0000 7f70d6c75640 1 -- 172.21.15.17:0/3955418497 shutdown_connections 2024-08-19T01:19:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.586+0000 7f70d6c75640 1 --2- 172.21.15.17:0/3955418497 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f70c006e170 0x7f70c0070630 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.586+0000 7f70d6c75640 1 --2- 172.21.15.17:0/3955418497 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70d0104a30 0x7f70d00fb590 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.586+0000 7f70d6c75640 1 --2- 172.21.15.17:0/3955418497 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f70d00fea30 0x7f70d00fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.586+0000 7f70d6c75640 1 -- 172.21.15.17:0/3955418497 >> 172.21.15.17:0/3955418497 conn(0x7f70d00fa730 msgr2=0x7f70d0068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.586+0000 7f70d6c75640 1 -- 172.21.15.17:0/3955418497 shutdown_connections 2024-08-19T01:19:10.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.586+0000 7f70d6c75640 1 -- 172.21.15.17:0/3955418497 wait complete. 2024-08-19T01:19:10.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.667+0000 7fa7f3e73640 1 -- 172.21.15.17:0/999145968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ec0ffb50 msgr2=0x7fa7ec0fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.667+0000 7fa7f3e73640 1 --2- 172.21.15.17:0/999145968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ec0ffb50 0x7fa7ec0fffb0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009880 tx=0x7fa7e002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.667+0000 7fa7f3e73640 1 -- 172.21.15.17:0/999145968 shutdown_connections 2024-08-19T01:19:10.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.667+0000 7fa7f3e73640 1 --2- 172.21.15.17:0/999145968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ec0ffb50 0x7fa7ec0fffb0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.667+0000 7fa7f3e73640 1 --2- 172.21.15.17:0/999145968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ec105c00 0x7fa7ec105fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.667+0000 7fa7f3e73640 1 -- 172.21.15.17:0/999145968 >> 172.21.15.17:0/999145968 conn(0x7fa7ec0fb830 msgr2=0x7fa7ec0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:10.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.668+0000 7fa7f3e73640 1 -- 172.21.15.17:0/999145968 shutdown_connections 2024-08-19T01:19:10.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.668+0000 7fa7f3e73640 1 -- 172.21.15.17:0/999145968 wait complete. 2024-08-19T01:19:10.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.668+0000 7fa7f3e73640 1 Processor -- start 2024-08-19T01:19:10.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.668+0000 7fa7f3e73640 1 -- start start 2024-08-19T01:19:10.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.668+0000 7fa7f3e73640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ec0ffb50 0x7fa7ec19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.668+0000 7fa7f3e73640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ec105c00 0x7fa7ec19be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.668+0000 7fa7f3e73640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec19c450 con 0x7fa7ec105c00 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.668+0000 7fa7f3e73640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec1959e0 con 0x7fa7ec0ffb50 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7f140e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ec105c00 0x7fa7ec19be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7f140e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ec105c00 0x7fa7ec19be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58204/0 (socket says 172.21.15.17:58204) 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7f140e640 1 -- 172.21.15.17:0/3348566353 learned_addr learned my addr 172.21.15.17:0/3348566353 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7f1c0f640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ec0ffb50 0x7fa7ec19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7f140e640 1 -- 172.21.15.17:0/3348566353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ec0ffb50 msgr2=0x7fa7ec19b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7f140e640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ec0ffb50 0x7fa7ec19b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7f140e640 1 -- 172.21.15.17:0/3348566353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009560 con 0x7fa7ec105c00 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7f1c0f640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ec0ffb50 0x7fa7ec19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7f140e640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ec105c00 0x7fa7ec19be30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa7e002a9c0 tx=0x7fa7e00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:10.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7eaffd640 1 -- 172.21.15.17:0/3348566353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e0004aa0 con 0x7fa7ec105c00 2024-08-19T01:19:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7eaffd640 1 -- 172.21.15.17:0/3348566353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa7e0004c00 con 0x7fa7ec105c00 2024-08-19T01:19:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7f3e73640 1 -- 172.21.15.17:0/3348566353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec195c60 con 0x7fa7ec105c00 2024-08-19T01:19:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7eaffd640 1 -- 172.21.15.17:0/3348566353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e0003ab0 con 0x7fa7ec105c00 2024-08-19T01:19:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.669+0000 7fa7f3e73640 1 -- 172.21.15.17:0/3348566353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec1961d0 con 0x7fa7ec105c00 2024-08-19T01:19:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.670+0000 7fa7f3e73640 1 -- 172.21.15.17:0/3348566353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec101200 con 0x7fa7ec105c00 2024-08-19T01:19:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.671+0000 7fa7eaffd640 1 -- 172.21.15.17:0/3348566353 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa7e0003ce0 con 0x7fa7ec105c00 2024-08-19T01:19:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.671+0000 7fa7eaffd640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa7d406e170 0x7fa7d4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.671+0000 7fa7f1c0f640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa7d406e170 0x7fa7d4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.672+0000 7fa7eaffd640 1 -- 172.21.15.17:0/3348566353 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa7e00af260 con 0x7fa7ec105c00 2024-08-19T01:19:10.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.672+0000 7fa7f1c0f640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa7d406e170 0x7fa7d4070630 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc007eb0 tx=0x7fa7dc0073c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:10.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.676+0000 7fa7eaffd640 1 -- 172.21.15.17:0/3348566353 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa7e0078540 con 0x7fa7ec105c00 2024-08-19T01:19:10.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.888+0000 7fa7f3e73640 1 -- 172.21.15.17:0/3348566353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa7ec108020 con 0x7fa7ec105c00 2024-08-19T01:19:10.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.889+0000 7fa7eaffd640 1 -- 172.21.15.17:0/3348566353 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7fa7e007bc00 con 0x7fa7ec105c00 2024-08-19T01:19:10.891 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:19:10.891 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:19:10.891 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:19:10.891 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:19:10.891 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:19:10.891 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:19:10.892 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:19:10.893 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:19:10.894 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:19:10.894 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:19:10.894 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:19:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:19:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:19:10.894 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:19:10.894 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:19:10.894 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:19:10.894 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:19:10.894 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:19:10.894 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:19:10.895 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:19:10.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.891+0000 7fa7f3e73640 1 -- 172.21.15.17:0/3348566353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa7d406e170 msgr2=0x7fa7d4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.891+0000 7fa7f3e73640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa7d406e170 0x7fa7d4070630 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc007eb0 tx=0x7fa7dc0073c0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.891+0000 7fa7f3e73640 1 -- 172.21.15.17:0/3348566353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ec105c00 msgr2=0x7fa7ec19be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.891+0000 7fa7f3e73640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ec105c00 0x7fa7ec19be30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa7e002a9c0 tx=0x7fa7e00055a0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.891+0000 7fa7f3e73640 1 -- 172.21.15.17:0/3348566353 shutdown_connections 2024-08-19T01:19:10.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.891+0000 7fa7f3e73640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa7d406e170 0x7fa7d4070630 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.891+0000 7fa7f3e73640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7ec105c00 0x7fa7ec19be30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.891+0000 7fa7f3e73640 1 --2- 172.21.15.17:0/3348566353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7ec0ffb50 0x7fa7ec19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.891+0000 7fa7f3e73640 1 -- 172.21.15.17:0/3348566353 >> 172.21.15.17:0/3348566353 conn(0x7fa7ec0fb830 msgr2=0x7fa7ec0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:10.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.891+0000 7fa7f3e73640 1 -- 172.21.15.17:0/3348566353 shutdown_connections 2024-08-19T01:19:10.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.891+0000 7fa7f3e73640 1 -- 172.21.15.17:0/3348566353 wait complete. 2024-08-19T01:19:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.974+0000 7f0dd44ea640 1 -- 172.21.15.17:0/3585408656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dcc101630 msgr2=0x7f0dcc109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.974+0000 7f0dd44ea640 1 --2- 172.21.15.17:0/3585408656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dcc101630 0x7f0dcc109b20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0098b0 tx=0x7f0dbc02a560 comp rx=0 tx=0).stop 2024-08-19T01:19:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 -- 172.21.15.17:0/3585408656 shutdown_connections 2024-08-19T01:19:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 --2- 172.21.15.17:0/3585408656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dcc101630 0x7f0dcc109b20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 --2- 172.21.15.17:0/3585408656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dcc100d10 0x7f0dcc1010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 -- 172.21.15.17:0/3585408656 >> 172.21.15.17:0/3585408656 conn(0x7f0dcc0758a0 msgr2=0x7f0dcc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 -- 172.21.15.17:0/3585408656 shutdown_connections 2024-08-19T01:19:10.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 -- 172.21.15.17:0/3585408656 wait complete. 2024-08-19T01:19:10.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 Processor -- start 2024-08-19T01:19:10.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 -- start start 2024-08-19T01:19:10.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dcc100d10 0x7f0dcc19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dcc101630 0x7f0dcc19be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc19c450 con 0x7f0dcc101630 2024-08-19T01:19:10.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.975+0000 7f0dd44ea640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc1959e0 con 0x7f0dcc100d10 2024-08-19T01:19:10.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dd1a85640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dcc101630 0x7f0dcc19be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dd1a85640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dcc101630 0x7f0dcc19be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58218/0 (socket says 172.21.15.17:58218) 2024-08-19T01:19:10.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dd1a85640 1 -- 172.21.15.17:0/1493187829 learned_addr learned my addr 172.21.15.17:0/1493187829 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:10.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dd2286640 1 --2- 172.21.15.17:0/1493187829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dcc100d10 0x7f0dcc19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dd1a85640 1 -- 172.21.15.17:0/1493187829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dcc100d10 msgr2=0x7f0dcc19b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:10.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dd1a85640 1 --2- 172.21.15.17:0/1493187829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dcc100d10 0x7f0dcc19b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:10.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dd1a85640 1 -- 172.21.15.17:0/1493187829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc009560 con 0x7f0dcc101630 2024-08-19T01:19:10.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dd1a85640 1 --2- 172.21.15.17:0/1493187829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dcc101630 0x7f0dcc19be30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc006010 tx=0x7f0dbc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:10.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dc37fe640 1 -- 172.21.15.17:0/1493187829 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dbc004aa0 con 0x7f0dcc101630 2024-08-19T01:19:10.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dc37fe640 1 -- 172.21.15.17:0/1493187829 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0dbc031470 con 0x7f0dcc101630 2024-08-19T01:19:10.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dd44ea640 1 -- 172.21.15.17:0/1493187829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc195c60 con 0x7f0dcc101630 2024-08-19T01:19:10.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dc37fe640 1 -- 172.21.15.17:0/1493187829 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dbc003940 con 0x7f0dcc101630 2024-08-19T01:19:10.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.976+0000 7f0dd44ea640 1 -- 172.21.15.17:0/1493187829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc196150 con 0x7f0dcc101630 2024-08-19T01:19:10.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.978+0000 7f0dd44ea640 1 -- 172.21.15.17:0/1493187829 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc0684b0 con 0x7f0dcc101630 2024-08-19T01:19:10.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.978+0000 7f0dc37fe640 1 -- 172.21.15.17:0/1493187829 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0dbc031b90 con 0x7f0dcc101630 2024-08-19T01:19:10.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.979+0000 7f0dc37fe640 1 --2- 172.21.15.17:0/1493187829 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db806e170 0x7f0db8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:10.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.979+0000 7f0dc37fe640 1 -- 172.21.15.17:0/1493187829 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0dbc0af260 con 0x7f0dcc101630 2024-08-19T01:19:10.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.979+0000 7f0dd2286640 1 --2- 172.21.15.17:0/1493187829 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db806e170 0x7f0db8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:10.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.979+0000 7f0dd2286640 1 --2- 172.21.15.17:0/1493187829 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db806e170 0x7f0db8070630 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8005d00 tx=0x7f0dc800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:10.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:10.983+0000 7f0dc37fe640 1 -- 172.21.15.17:0/1493187829 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0dbc078550 con 0x7f0dcc101630 2024-08-19T01:19:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.177+0000 7f0dd44ea640 1 -- 172.21.15.17:0/1493187829 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0dcc10cd80 con 0x7f0db806e170 2024-08-19T01:19:11.179 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:11 smithi017 ceph-mon[99370]: pgmap v611: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:11.179 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:11 smithi017 ceph-mon[99370]: from='client.35156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:11.179 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:11 smithi017 ceph-mon[99370]: from='client.35160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:11.179 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:11 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3955418497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:19:11.179 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:11 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3348566353' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:19:11.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.178+0000 7f0dc37fe640 1 -- 172.21.15.17:0/1493187829 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0dcc10cd80 con 0x7f0db806e170 2024-08-19T01:19:11.180 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:19:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:19:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:19:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:19:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:19:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:19:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:19:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:19:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:19:11.180 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:19:11.181 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:19:11.181 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:19:11.181 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:19:11.181 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:19:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.180+0000 7f0dd44ea640 1 -- 172.21.15.17:0/1493187829 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db806e170 msgr2=0x7f0db8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.180+0000 7f0dd44ea640 1 --2- 172.21.15.17:0/1493187829 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db806e170 0x7f0db8070630 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8005d00 tx=0x7f0dc800b410 comp rx=0 tx=0).stop 2024-08-19T01:19:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.180+0000 7f0dd44ea640 1 -- 172.21.15.17:0/1493187829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dcc101630 msgr2=0x7f0dcc19be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.180+0000 7f0dd44ea640 1 --2- 172.21.15.17:0/1493187829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dcc101630 0x7f0dcc19be30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc006010 tx=0x7f0dbc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.180+0000 7f0dd44ea640 1 -- 172.21.15.17:0/1493187829 shutdown_connections 2024-08-19T01:19:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.180+0000 7f0dd44ea640 1 --2- 172.21.15.17:0/1493187829 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0db806e170 0x7f0db8070630 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.180+0000 7f0dd44ea640 1 --2- 172.21.15.17:0/1493187829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0dcc101630 0x7f0dcc19be30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.180+0000 7f0dd44ea640 1 --2- 172.21.15.17:0/1493187829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0dcc100d10 0x7f0dcc19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.180+0000 7f0dd44ea640 1 -- 172.21.15.17:0/1493187829 >> 172.21.15.17:0/1493187829 conn(0x7f0dcc0758a0 msgr2=0x7f0dcc101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.180+0000 7f0dd44ea640 1 -- 172.21.15.17:0/1493187829 shutdown_connections 2024-08-19T01:19:11.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.180+0000 7f0dd44ea640 1 -- 172.21.15.17:0/1493187829 wait complete. 2024-08-19T01:19:11.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.262+0000 7f7904e0d640 1 -- 172.21.15.17:0/801754849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7900104a30 msgr2=0x7f7900104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:11.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.262+0000 7f7904e0d640 1 --2- 172.21.15.17:0/801754849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7900104a30 0x7f7900104e10 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009880 tx=0x7f78f002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.262+0000 7f7904e0d640 1 -- 172.21.15.17:0/801754849 shutdown_connections 2024-08-19T01:19:11.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.262+0000 7f7904e0d640 1 --2- 172.21.15.17:0/801754849 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f79000fea30 0x7f79000fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.262+0000 7f7904e0d640 1 --2- 172.21.15.17:0/801754849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7900104a30 0x7f7900104e10 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.262+0000 7f7904e0d640 1 -- 172.21.15.17:0/801754849 >> 172.21.15.17:0/801754849 conn(0x7f79000fa730 msgr2=0x7f79000fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:11.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.262+0000 7f7904e0d640 1 -- 172.21.15.17:0/801754849 shutdown_connections 2024-08-19T01:19:11.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.262+0000 7f7904e0d640 1 -- 172.21.15.17:0/801754849 wait complete. 2024-08-19T01:19:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.263+0000 7f7904e0d640 1 Processor -- start 2024-08-19T01:19:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.263+0000 7f7904e0d640 1 -- start start 2024-08-19T01:19:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.263+0000 7f7904e0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79000fea30 0x7f790019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.263+0000 7f7904e0d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900104a30 0x7f790019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.263+0000 7f7904e0d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7900195890 con 0x7f79000fea30 2024-08-19T01:19:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.263+0000 7f7904e0d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79001959d0 con 0x7f7900104a30 2024-08-19T01:19:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f78fe59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79000fea30 0x7f790019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f78fe59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79000fea30 0x7f790019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58238/0 (socket says 172.21.15.17:58238) 2024-08-19T01:19:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f78fe59c640 1 -- 172.21.15.17:0/1001679330 learned_addr learned my addr 172.21.15.17:0/1001679330 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:11.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f78fdd9b640 1 --2- 172.21.15.17:0/1001679330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900104a30 0x7f790019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f78fe59c640 1 -- 172.21.15.17:0/1001679330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900104a30 msgr2=0x7f790019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f78fe59c640 1 --2- 172.21.15.17:0/1001679330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900104a30 0x7f790019bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f78fe59c640 1 -- 172.21.15.17:0/1001679330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f0009560 con 0x7f79000fea30 2024-08-19T01:19:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f78fe59c640 1 --2- 172.21.15.17:0/1001679330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79000fea30 0x7f790019b830 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f78f002a9c0 tx=0x7f78f00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f78ef7fe640 1 -- 172.21.15.17:0/1001679330 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78f0004aa0 con 0x7f79000fea30 2024-08-19T01:19:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f78ef7fe640 1 -- 172.21.15.17:0/1001679330 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f78f0004c00 con 0x7f79000fea30 2024-08-19T01:19:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f7904e0d640 1 -- 172.21.15.17:0/1001679330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7900195c50 con 0x7f79000fea30 2024-08-19T01:19:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f78ef7fe640 1 -- 172.21.15.17:0/1001679330 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78f0003980 con 0x7f79000fea30 2024-08-19T01:19:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.264+0000 7f7904e0d640 1 -- 172.21.15.17:0/1001679330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7900196140 con 0x7f79000fea30 2024-08-19T01:19:11.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.265+0000 7f7904e0d640 1 -- 172.21.15.17:0/1001679330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7900100170 con 0x7f79000fea30 2024-08-19T01:19:11.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.266+0000 7f78ef7fe640 1 -- 172.21.15.17:0/1001679330 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f78f0003bf0 con 0x7f79000fea30 2024-08-19T01:19:11.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.266+0000 7f78ef7fe640 1 --2- 172.21.15.17:0/1001679330 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f78e806e170 0x7f78e8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:11.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.266+0000 7f78ef7fe640 1 -- 172.21.15.17:0/1001679330 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f78f00af210 con 0x7f79000fea30 2024-08-19T01:19:11.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.266+0000 7f78fdd9b640 1 --2- 172.21.15.17:0/1001679330 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f78e806e170 0x7f78e8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:11.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.267+0000 7f78fdd9b640 1 --2- 172.21.15.17:0/1001679330 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f78e806e170 0x7f78e8070630 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f79001970e0 tx=0x7f78f400b590 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:11.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.271+0000 7f78ef7fe640 1 -- 172.21.15.17:0/1001679330 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f78f00784f0 con 0x7f79000fea30 2024-08-19T01:19:11.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:11 smithi086 ceph-mon[71303]: pgmap v611: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:11.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:11 smithi086 ceph-mon[71303]: from='client.35156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:11.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:11 smithi086 ceph-mon[71303]: from='client.35160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:11.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:11 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3955418497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:19:11.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:11 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3348566353' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:19:11.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.516+0000 7f7904e0d640 1 -- 172.21.15.17:0/1001679330 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f79000fee90 con 0x7f79000fea30 2024-08-19T01:19:11.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.516+0000 7f78ef7fe640 1 -- 172.21.15.17:0/1001679330 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f78f007bbb0 con 0x7f79000fea30 2024-08-19T01:19:11.519 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:19:11.519 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:19:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:19:11.519 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:19:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:19:11.519 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:19:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:19:11.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.518+0000 7f7904e0d640 1 -- 172.21.15.17:0/1001679330 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f78e806e170 msgr2=0x7f78e8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:11.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.518+0000 7f7904e0d640 1 --2- 172.21.15.17:0/1001679330 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f78e806e170 0x7f78e8070630 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f79001970e0 tx=0x7f78f400b590 comp rx=0 tx=0).stop 2024-08-19T01:19:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.518+0000 7f7904e0d640 1 -- 172.21.15.17:0/1001679330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79000fea30 msgr2=0x7f790019b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.518+0000 7f7904e0d640 1 --2- 172.21.15.17:0/1001679330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79000fea30 0x7f790019b830 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f78f002a9c0 tx=0x7f78f00055a0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.518+0000 7f7904e0d640 1 -- 172.21.15.17:0/1001679330 shutdown_connections 2024-08-19T01:19:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.518+0000 7f7904e0d640 1 --2- 172.21.15.17:0/1001679330 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f78e806e170 0x7f78e8070630 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.518+0000 7f7904e0d640 1 --2- 172.21.15.17:0/1001679330 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7900104a30 0x7f790019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.518+0000 7f7904e0d640 1 --2- 172.21.15.17:0/1001679330 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79000fea30 0x7f790019b830 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.518+0000 7f7904e0d640 1 -- 172.21.15.17:0/1001679330 >> 172.21.15.17:0/1001679330 conn(0x7f79000fa730 msgr2=0x7f7900068770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.519+0000 7f7904e0d640 1 -- 172.21.15.17:0/1001679330 shutdown_connections 2024-08-19T01:19:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:11.519+0000 7f7904e0d640 1 -- 172.21.15.17:0/1001679330 wait complete. 2024-08-19T01:19:12.270 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:12 smithi017 ceph-mon[99370]: from='client.35164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:12.271 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:12 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1001679330' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:19:12.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:12 smithi086 ceph-mon[71303]: from='client.35164 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:12.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:12 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1001679330' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:19:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:13 smithi017 ceph-mon[99370]: pgmap v612: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:13 smithi017 ceph-mon[99370]: from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:13.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:13 smithi086 ceph-mon[71303]: pgmap v612: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:13.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:13 smithi086 ceph-mon[71303]: from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:15 smithi017 ceph-mon[99370]: pgmap v613: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:15.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:15 smithi086 ceph-mon[71303]: pgmap v613: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:17.356 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:17 smithi017 ceph-mon[99370]: pgmap v614: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:17.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:17 smithi086 ceph-mon[71303]: pgmap v614: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:19:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:19:19.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:19 smithi017 ceph-mon[99370]: pgmap v615: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:19.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:19 smithi086 ceph-mon[71303]: pgmap v615: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:21.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:21 smithi017 ceph-mon[99370]: pgmap v616: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:21.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:21 smithi086 ceph-mon[71303]: pgmap v616: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:23.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:23 smithi017 ceph-mon[99370]: pgmap v617: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:23.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:23 smithi086 ceph-mon[71303]: pgmap v617: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:25.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:25 smithi017 ceph-mon[99370]: pgmap v618: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:25.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:25 smithi086 ceph-mon[71303]: pgmap v618: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:27.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:27 smithi017 ceph-mon[99370]: pgmap v619: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:27.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:27 smithi086 ceph-mon[71303]: pgmap v619: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:29 smithi086 ceph-mon[71303]: pgmap v620: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:29.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:29 smithi017 ceph-mon[99370]: pgmap v620: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:31.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:31 smithi017 ceph-mon[99370]: pgmap v621: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:31.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:31 smithi086 ceph-mon[71303]: pgmap v621: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:32 smithi017 ceph-mon[99370]: pgmap v622: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:32.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:32 smithi086 ceph-mon[71303]: pgmap v622: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:33.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:19:33.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:19:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:34 smithi017 ceph-mon[99370]: pgmap v623: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:34.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:34 smithi086 ceph-mon[71303]: pgmap v623: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:36.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:36 smithi017 ceph-mon[99370]: pgmap v624: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:36.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:36 smithi086 ceph-mon[71303]: pgmap v624: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:38.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:38 smithi017 ceph-mon[99370]: pgmap v625: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:38.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:38 smithi086 ceph-mon[71303]: pgmap v625: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:40.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:40 smithi017 ceph-mon[99370]: pgmap v626: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:40.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:40 smithi086 ceph-mon[71303]: pgmap v626: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:41.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.617+0000 7f35dbda3640 1 -- 172.21.15.17:0/929631768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35d40ffda0 msgr2=0x7f35d4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:41.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.617+0000 7f35dbda3640 1 --2- 172.21.15.17:0/929631768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35d40ffda0 0x7f35d4100180 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009880 tx=0x7f35d002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.617+0000 7f35dbda3640 1 -- 172.21.15.17:0/929631768 shutdown_connections 2024-08-19T01:19:41.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.617+0000 7f35dbda3640 1 --2- 172.21.15.17:0/929631768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35d4100750 0x7f35d41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.617+0000 7f35dbda3640 1 --2- 172.21.15.17:0/929631768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35d40ffda0 0x7f35d4100180 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.617+0000 7f35dbda3640 1 -- 172.21.15.17:0/929631768 >> 172.21.15.17:0/929631768 conn(0x7f35d40fb840 msgr2=0x7f35d40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:41.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.617+0000 7f35dbda3640 1 -- 172.21.15.17:0/929631768 shutdown_connections 2024-08-19T01:19:41.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.617+0000 7f35dbda3640 1 -- 172.21.15.17:0/929631768 wait complete. 2024-08-19T01:19:41.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35dbda3640 1 Processor -- start 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35dbda3640 1 -- start start 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35dbda3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35d40ffda0 0x7f35d40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35dbda3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35d4100750 0x7f35d4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35dbda3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4074780 con 0x7f35d40ffda0 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35dbda3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d4073230 con 0x7f35d4100750 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35d9b3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35d40ffda0 0x7f35d40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35d9b3f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35d40ffda0 0x7f35d40727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40994/0 (socket says 172.21.15.17:40994) 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35d9b3f640 1 -- 172.21.15.17:0/4268147398 learned_addr learned my addr 172.21.15.17:0/4268147398 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35d933e640 1 --2- 172.21.15.17:0/4268147398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35d4100750 0x7f35d4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35d9b3f640 1 -- 172.21.15.17:0/4268147398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35d4100750 msgr2=0x7f35d4072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35d9b3f640 1 --2- 172.21.15.17:0/4268147398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35d4100750 0x7f35d4072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.618+0000 7f35d9b3f640 1 -- 172.21.15.17:0/4268147398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d0009560 con 0x7f35d40ffda0 2024-08-19T01:19:41.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.619+0000 7f35d9b3f640 1 --2- 172.21.15.17:0/4268147398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35d40ffda0 0x7f35d40727b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f35d002a9c0 tx=0x7f35d00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:41.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.619+0000 7f35caffd640 1 -- 172.21.15.17:0/4268147398 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d0004aa0 con 0x7f35d40ffda0 2024-08-19T01:19:41.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.619+0000 7f35caffd640 1 -- 172.21.15.17:0/4268147398 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35d0004c00 con 0x7f35d40ffda0 2024-08-19T01:19:41.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.619+0000 7f35dbda3640 1 -- 172.21.15.17:0/4268147398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d40734b0 con 0x7f35d40ffda0 2024-08-19T01:19:41.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.619+0000 7f35caffd640 1 -- 172.21.15.17:0/4268147398 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d0003ab0 con 0x7f35d40ffda0 2024-08-19T01:19:41.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.619+0000 7f35dbda3640 1 -- 172.21.15.17:0/4268147398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d41a1e90 con 0x7f35d40ffda0 2024-08-19T01:19:41.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.620+0000 7f35dbda3640 1 -- 172.21.15.17:0/4268147398 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d4101280 con 0x7f35d40ffda0 2024-08-19T01:19:41.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.621+0000 7f35caffd640 1 -- 172.21.15.17:0/4268147398 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f35d0031d20 con 0x7f35d40ffda0 2024-08-19T01:19:41.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.621+0000 7f35caffd640 1 --2- 172.21.15.17:0/4268147398 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35c006e170 0x7f35c0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:41.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.621+0000 7f35caffd640 1 -- 172.21.15.17:0/4268147398 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f35d00af1b0 con 0x7f35d40ffda0 2024-08-19T01:19:41.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.621+0000 7f35d933e640 1 --2- 172.21.15.17:0/4268147398 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35c006e170 0x7f35c0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:41.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.622+0000 7f35d933e640 1 --2- 172.21.15.17:0/4268147398 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35c006e170 0x7f35c0070630 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f35c4005e10 tx=0x7f35c4005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:41.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.626+0000 7f35caffd640 1 -- 172.21.15.17:0/4268147398 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f35d0078510 con 0x7f35d40ffda0 2024-08-19T01:19:41.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.818+0000 7f35dbda3640 1 -- 172.21.15.17:0/4268147398 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35d410cdb0 con 0x7f35c006e170 2024-08-19T01:19:41.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.819+0000 7f35caffd640 1 -- 172.21.15.17:0/4268147398 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f35d410cdb0 con 0x7f35c006e170 2024-08-19T01:19:41.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.821+0000 7f35dbda3640 1 -- 172.21.15.17:0/4268147398 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35c006e170 msgr2=0x7f35c0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:41.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.821+0000 7f35dbda3640 1 --2- 172.21.15.17:0/4268147398 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35c006e170 0x7f35c0070630 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f35c4005e10 tx=0x7f35c4005da0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.821+0000 7f35dbda3640 1 -- 172.21.15.17:0/4268147398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35d40ffda0 msgr2=0x7f35d40727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:41.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.821+0000 7f35dbda3640 1 --2- 172.21.15.17:0/4268147398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35d40ffda0 0x7f35d40727b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f35d002a9c0 tx=0x7f35d00055a0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.821+0000 7f35dbda3640 1 -- 172.21.15.17:0/4268147398 shutdown_connections 2024-08-19T01:19:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.821+0000 7f35dbda3640 1 --2- 172.21.15.17:0/4268147398 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f35c006e170 0x7f35c0070630 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.821+0000 7f35dbda3640 1 --2- 172.21.15.17:0/4268147398 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f35d4100750 0x7f35d4072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.821+0000 7f35dbda3640 1 --2- 172.21.15.17:0/4268147398 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35d40ffda0 0x7f35d40727b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.821+0000 7f35dbda3640 1 -- 172.21.15.17:0/4268147398 >> 172.21.15.17:0/4268147398 conn(0x7f35d40fb840 msgr2=0x7f35d40fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.821+0000 7f35dbda3640 1 -- 172.21.15.17:0/4268147398 shutdown_connections 2024-08-19T01:19:41.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.821+0000 7f35dbda3640 1 -- 172.21.15.17:0/4268147398 wait complete. 2024-08-19T01:19:41.832 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:19:41.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.906+0000 7f60cbecf640 1 -- 172.21.15.17:0/2101346828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c4100c60 msgr2=0x7f60c4101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:41.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.906+0000 7f60cbecf640 1 --2- 172.21.15.17:0/2101346828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c4100c60 0x7f60c4101040 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f60c00098b0 tx=0x7f60c002a4d0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.906+0000 7f60cbecf640 1 -- 172.21.15.17:0/2101346828 shutdown_connections 2024-08-19T01:19:41.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.906+0000 7f60cbecf640 1 --2- 172.21.15.17:0/2101346828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60c4101610 0x7f60c4109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.906+0000 7f60cbecf640 1 --2- 172.21.15.17:0/2101346828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c4100c60 0x7f60c4101040 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.906+0000 7f60cbecf640 1 -- 172.21.15.17:0/2101346828 >> 172.21.15.17:0/2101346828 conn(0x7f60c40fa730 msgr2=0x7f60c40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:41.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.906+0000 7f60cbecf640 1 -- 172.21.15.17:0/2101346828 shutdown_connections 2024-08-19T01:19:41.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.906+0000 7f60cbecf640 1 -- 172.21.15.17:0/2101346828 wait complete. 2024-08-19T01:19:41.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60cbecf640 1 Processor -- start 2024-08-19T01:19:41.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60cbecf640 1 -- start start 2024-08-19T01:19:41.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60cbecf640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60c4100c60 0x7f60c419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:41.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60cbecf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c4101610 0x7f60c419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60cbecf640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c419c3a0 con 0x7f60c4101610 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60cbecf640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c4195930 con 0x7f60c4100c60 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60c946a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c4101610 0x7f60c419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60c946a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c4101610 0x7f60c419bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41014/0 (socket says 172.21.15.17:41014) 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60c946a640 1 -- 172.21.15.17:0/1557384812 learned_addr learned my addr 172.21.15.17:0/1557384812 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60c9c6b640 1 --2- 172.21.15.17:0/1557384812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60c4100c60 0x7f60c419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60c946a640 1 -- 172.21.15.17:0/1557384812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60c4100c60 msgr2=0x7f60c419b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60c946a640 1 --2- 172.21.15.17:0/1557384812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60c4100c60 0x7f60c419b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.907+0000 7f60c946a640 1 -- 172.21.15.17:0/1557384812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0009560 con 0x7f60c4101610 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.908+0000 7f60c946a640 1 --2- 172.21.15.17:0/1557384812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c4101610 0x7f60c419bd80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f60b400c8f0 tx=0x7f60b400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.908+0000 7f60baffd640 1 -- 172.21.15.17:0/1557384812 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60b4007b80 con 0x7f60c4101610 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.908+0000 7f60baffd640 1 -- 172.21.15.17:0/1557384812 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60b40054e0 con 0x7f60c4101610 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.908+0000 7f60cbecf640 1 -- 172.21.15.17:0/1557384812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c4195c10 con 0x7f60c4101610 2024-08-19T01:19:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.908+0000 7f60baffd640 1 -- 172.21.15.17:0/1557384812 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60b400f450 con 0x7f60c4101610 2024-08-19T01:19:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.908+0000 7f60cbecf640 1 -- 172.21.15.17:0/1557384812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c4196160 con 0x7f60c4101610 2024-08-19T01:19:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.909+0000 7f60cbecf640 1 -- 172.21.15.17:0/1557384812 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c4068d30 con 0x7f60c4101610 2024-08-19T01:19:41.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.909+0000 7f60baffd640 1 -- 172.21.15.17:0/1557384812 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f60b4004f60 con 0x7f60c4101610 2024-08-19T01:19:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.910+0000 7f60baffd640 1 --2- 172.21.15.17:0/1557384812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f60b006e170 0x7f60b0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.910+0000 7f60baffd640 1 -- 172.21.15.17:0/1557384812 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f60b408df40 con 0x7f60c4101610 2024-08-19T01:19:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.910+0000 7f60c9c6b640 1 --2- 172.21.15.17:0/1557384812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f60b006e170 0x7f60b0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.910+0000 7f60c9c6b640 1 --2- 172.21.15.17:0/1557384812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f60b006e170 0x7f60b0070630 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009880 tx=0x7f60c00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:41.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:41.914+0000 7f60baffd640 1 -- 172.21.15.17:0/1557384812 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f60b40c2df0 con 0x7f60c4101610 2024-08-19T01:19:42.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.105+0000 7f60cbecf640 1 -- 172.21.15.17:0/1557384812 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60c410cdd0 con 0x7f60b006e170 2024-08-19T01:19:42.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.106+0000 7f60baffd640 1 -- 172.21.15.17:0/1557384812 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f60c410cdd0 con 0x7f60b006e170 2024-08-19T01:19:42.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.108+0000 7f60cbecf640 1 -- 172.21.15.17:0/1557384812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f60b006e170 msgr2=0x7f60b0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.108+0000 7f60cbecf640 1 --2- 172.21.15.17:0/1557384812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f60b006e170 0x7f60b0070630 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f60c0009880 tx=0x7f60c00058d0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.108+0000 7f60cbecf640 1 -- 172.21.15.17:0/1557384812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c4101610 msgr2=0x7f60c419bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.108+0000 7f60cbecf640 1 --2- 172.21.15.17:0/1557384812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c4101610 0x7f60c419bd80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f60b400c8f0 tx=0x7f60b400cdb0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.108+0000 7f60cbecf640 1 -- 172.21.15.17:0/1557384812 shutdown_connections 2024-08-19T01:19:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.108+0000 7f60cbecf640 1 --2- 172.21.15.17:0/1557384812 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f60b006e170 0x7f60b0070630 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.108+0000 7f60cbecf640 1 --2- 172.21.15.17:0/1557384812 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f60c4101610 0x7f60c419bd80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.108+0000 7f60cbecf640 1 --2- 172.21.15.17:0/1557384812 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f60c4100c60 0x7f60c419b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.108+0000 7f60cbecf640 1 -- 172.21.15.17:0/1557384812 >> 172.21.15.17:0/1557384812 conn(0x7f60c40fa730 msgr2=0x7f60c4101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.108+0000 7f60cbecf640 1 -- 172.21.15.17:0/1557384812 shutdown_connections 2024-08-19T01:19:42.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.109+0000 7f60cbecf640 1 -- 172.21.15.17:0/1557384812 wait complete. 2024-08-19T01:19:42.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.191+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3884631520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f580fe9f0 msgr2=0x7f1f580fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:42.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.191+0000 7f1f5cf32640 1 --2- 172.21.15.17:0/3884631520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f580fe9f0 0x7f1f580fee50 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009880 tx=0x7f1f4c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.191+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3884631520 shutdown_connections 2024-08-19T01:19:42.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.191+0000 7f1f5cf32640 1 --2- 172.21.15.17:0/3884631520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f580fe9f0 0x7f1f580fee50 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.191+0000 7f1f5cf32640 1 --2- 172.21.15.17:0/3884631520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f581049f0 0x7f1f58104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.191+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3884631520 >> 172.21.15.17:0/3884631520 conn(0x7f1f580758a0 msgr2=0x7f1f580fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:42.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.191+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3884631520 shutdown_connections 2024-08-19T01:19:42.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.191+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3884631520 wait complete. 2024-08-19T01:19:42.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.192+0000 7f1f5cf32640 1 Processor -- start 2024-08-19T01:19:42.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.192+0000 7f1f5cf32640 1 -- start start 2024-08-19T01:19:42.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.192+0000 7f1f5cf32640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f580fe9f0 0x7f1f58109980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.192+0000 7f1f5cf32640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f581049f0 0x7f1f58109ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.192+0000 7f1f5cf32640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5810a400 con 0x7f1f580fe9f0 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.192+0000 7f1f5cf32640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5810a570 con 0x7f1f581049f0 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.192+0000 7f1f5659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f580fe9f0 0x7f1f58109980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.192+0000 7f1f5659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f580fe9f0 0x7f1f58109980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41024/0 (socket says 172.21.15.17:41024) 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.192+0000 7f1f5659c640 1 -- 172.21.15.17:0/3036963173 learned_addr learned my addr 172.21.15.17:0/3036963173 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.192+0000 7f1f55d9b640 1 --2- 172.21.15.17:0/3036963173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f581049f0 0x7f1f58109ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.193+0000 7f1f5659c640 1 -- 172.21.15.17:0/3036963173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f581049f0 msgr2=0x7f1f58109ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.193+0000 7f1f5659c640 1 --2- 172.21.15.17:0/3036963173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f581049f0 0x7f1f58109ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.193+0000 7f1f5659c640 1 -- 172.21.15.17:0/3036963173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c009560 con 0x7f1f580fe9f0 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.193+0000 7f1f5659c640 1 --2- 172.21.15.17:0/3036963173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f580fe9f0 0x7f1f58109980 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800b420 tx=0x7f1f4800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.193+0000 7f1f477fe640 1 -- 172.21.15.17:0/3036963173 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f48011800 con 0x7f1f580fe9f0 2024-08-19T01:19:42.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.193+0000 7f1f477fe640 1 -- 172.21.15.17:0/3036963173 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f48011e20 con 0x7f1f580fe9f0 2024-08-19T01:19:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.193+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3036963173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f581a1dd0 con 0x7f1f580fe9f0 2024-08-19T01:19:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.193+0000 7f1f477fe640 1 -- 172.21.15.17:0/3036963173 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f4800f2e0 con 0x7f1f580fe9f0 2024-08-19T01:19:42.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.193+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3036963173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f581a2130 con 0x7f1f580fe9f0 2024-08-19T01:19:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.194+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3036963173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f58100130 con 0x7f1f580fe9f0 2024-08-19T01:19:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.194+0000 7f1f477fe640 1 -- 172.21.15.17:0/3036963173 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1f48010380 con 0x7f1f580fe9f0 2024-08-19T01:19:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.195+0000 7f1f477fe640 1 --2- 172.21.15.17:0/3036963173 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f4006e170 0x7f1f40070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.195+0000 7f1f477fe640 1 -- 172.21.15.17:0/3036963173 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1f4808da60 con 0x7f1f580fe9f0 2024-08-19T01:19:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.195+0000 7f1f55d9b640 1 --2- 172.21.15.17:0/3036963173 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f4006e170 0x7f1f40070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:42.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.195+0000 7f1f55d9b640 1 --2- 172.21.15.17:0/3036963173 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f4006e170 0x7f1f40070630 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c000c00 tx=0x7f1f4c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:42.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.199+0000 7f1f477fe640 1 -- 172.21.15.17:0/3036963173 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1f48056dc0 con 0x7f1f580fe9f0 2024-08-19T01:19:42.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.380+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3036963173 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f5810afc0 con 0x7f1f4006e170 2024-08-19T01:19:42.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.390+0000 7f1f477fe640 1 -- 172.21.15.17:0/3036963173 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f1f5810afc0 con 0x7f1f4006e170 2024-08-19T01:19:42.392 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:19:42.392 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (21m) 14m ago 31m 24.9M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:19:42.392 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (31m) 14m ago 31m 9499k - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:19:42.392 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (30m) 14m ago 30m 9118k - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:19:42.392 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (18m) 14m ago 31m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (18m) 14m ago 30m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (20m) 14m ago 31m 80.4M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (14m) 14m ago 26m 13.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (15m) 14m ago 26m 13.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (26m) 14m ago 26m 12.3M - 18.2.4-721-gbaa926de e6c292a6bc95 77498c7476a9 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (14m) 14m ago 26m 13.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (22m) 14m ago 33m 504M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (21m) 14m ago 30m 442M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (19m) 14m ago 33m 52.8M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (19m) 14m ago 30m 45.3M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (21m) 14m ago 31m 15.5M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (21m) 14m ago 30m 15.2M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (18m) 14m ago 29m 88.1M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:19:42.393 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (17m) 14m ago 29m 90.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:19:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (17m) 14m ago 28m 78.8M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:19:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (16m) 14m ago 28m 91.3M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:19:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (16m) 14m ago 28m 86.8M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:19:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (15m) 14m ago 27m 85.7M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:19:42.394 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (21m) 14m ago 31m 64.2M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:19:42.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.393+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3036963173 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f4006e170 msgr2=0x7f1f40070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:42.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.393+0000 7f1f5cf32640 1 --2- 172.21.15.17:0/3036963173 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f4006e170 0x7f1f40070630 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c000c00 tx=0x7f1f4c005a20 comp rx=0 tx=0).stop 2024-08-19T01:19:42.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.393+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3036963173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f580fe9f0 msgr2=0x7f1f58109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:42.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.393+0000 7f1f5cf32640 1 --2- 172.21.15.17:0/3036963173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f580fe9f0 0x7f1f58109980 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800b420 tx=0x7f1f4800b8e0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.393+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3036963173 shutdown_connections 2024-08-19T01:19:42.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.393+0000 7f1f5cf32640 1 --2- 172.21.15.17:0/3036963173 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f4006e170 0x7f1f40070630 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.393+0000 7f1f5cf32640 1 --2- 172.21.15.17:0/3036963173 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1f581049f0 0x7f1f58109ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.393+0000 7f1f5cf32640 1 --2- 172.21.15.17:0/3036963173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1f580fe9f0 0x7f1f58109980 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.393+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3036963173 >> 172.21.15.17:0/3036963173 conn(0x7f1f580758a0 msgr2=0x7f1f580fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:42.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.393+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3036963173 shutdown_connections 2024-08-19T01:19:42.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.393+0000 7f1f5cf32640 1 -- 172.21.15.17:0/3036963173 wait complete. 2024-08-19T01:19:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.473+0000 7f034772d640 1 -- 172.21.15.17:0/3998092301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03400fe9f0 msgr2=0x7f03400fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.473+0000 7f034772d640 1 --2- 172.21.15.17:0/3998092301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03400fe9f0 0x7f03400fee50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0334009880 tx=0x7f033402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.474+0000 7f034772d640 1 -- 172.21.15.17:0/3998092301 shutdown_connections 2024-08-19T01:19:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.474+0000 7f034772d640 1 --2- 172.21.15.17:0/3998092301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03400fe9f0 0x7f03400fee50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.474+0000 7f034772d640 1 --2- 172.21.15.17:0/3998092301 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03401049f0 0x7f0340104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.474+0000 7f034772d640 1 -- 172.21.15.17:0/3998092301 >> 172.21.15.17:0/3998092301 conn(0x7f03400758a0 msgr2=0x7f03400fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.474+0000 7f034772d640 1 -- 172.21.15.17:0/3998092301 shutdown_connections 2024-08-19T01:19:42.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.474+0000 7f034772d640 1 -- 172.21.15.17:0/3998092301 wait complete. 2024-08-19T01:19:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.474+0000 7f034772d640 1 Processor -- start 2024-08-19T01:19:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f034772d640 1 -- start start 2024-08-19T01:19:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f034772d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03400fe9f0 0x7f0340196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f034772d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03401049f0 0x7f0340196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f034772d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03401973a0 con 0x7f03401049f0 2024-08-19T01:19:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f034772d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0340197510 con 0x7f03400fe9f0 2024-08-19T01:19:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f0344cc8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03401049f0 0x7f0340196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f0344cc8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03401049f0 0x7f0340196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41044/0 (socket says 172.21.15.17:41044) 2024-08-19T01:19:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f0344cc8640 1 -- 172.21.15.17:0/4285885171 learned_addr learned my addr 172.21.15.17:0/4285885171 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f03454c9640 1 --2- 172.21.15.17:0/4285885171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03400fe9f0 0x7f0340196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:42.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f0344cc8640 1 -- 172.21.15.17:0/4285885171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03400fe9f0 msgr2=0x7f0340196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f0344cc8640 1 --2- 172.21.15.17:0/4285885171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03400fe9f0 0x7f0340196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.475+0000 7f0344cc8640 1 -- 172.21.15.17:0/4285885171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0334009560 con 0x7f03401049f0 2024-08-19T01:19:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.476+0000 7f0344cc8640 1 --2- 172.21.15.17:0/4285885171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03401049f0 0x7f0340196e60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f033402a9c0 tx=0x7f03340055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.476+0000 7f033e7fc640 1 -- 172.21.15.17:0/4285885171 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0334004aa0 con 0x7f03401049f0 2024-08-19T01:19:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.476+0000 7f033e7fc640 1 -- 172.21.15.17:0/4285885171 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0334004c00 con 0x7f03401049f0 2024-08-19T01:19:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.476+0000 7f034772d640 1 -- 172.21.15.17:0/4285885171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0340197790 con 0x7f03401049f0 2024-08-19T01:19:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.476+0000 7f033e7fc640 1 -- 172.21.15.17:0/4285885171 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0334003ab0 con 0x7f03401049f0 2024-08-19T01:19:42.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.476+0000 7f034772d640 1 -- 172.21.15.17:0/4285885171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034019fc70 con 0x7f03401049f0 2024-08-19T01:19:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.477+0000 7f034772d640 1 -- 172.21.15.17:0/4285885171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0340100130 con 0x7f03401049f0 2024-08-19T01:19:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.477+0000 7f033e7fc640 1 -- 172.21.15.17:0/4285885171 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0334003cb0 con 0x7f03401049f0 2024-08-19T01:19:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.478+0000 7f033e7fc640 1 --2- 172.21.15.17:0/4285885171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f032806e170 0x7f0328070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.478+0000 7f033e7fc640 1 -- 172.21.15.17:0/4285885171 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f03340af020 con 0x7f03401049f0 2024-08-19T01:19:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.478+0000 7f03454c9640 1 --2- 172.21.15.17:0/4285885171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f032806e170 0x7f0328070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:42.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.478+0000 7f03454c9640 1 --2- 172.21.15.17:0/4285885171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f032806e170 0x7f0328070630 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0330005e10 tx=0x7f0330005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:42.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.482+0000 7f033e7fc640 1 -- 172.21.15.17:0/4285885171 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0334078380 con 0x7f03401049f0 2024-08-19T01:19:42.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.732+0000 7f034772d640 1 -- 172.21.15.17:0/4285885171 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0340107020 con 0x7f03401049f0 2024-08-19T01:19:42.734 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:42 smithi017 ceph-mon[99370]: pgmap v627: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:42.734 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:42 smithi017 ceph-mon[99370]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:42.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.732+0000 7f033e7fc640 1 -- 172.21.15.17:0/4285885171 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+828 (secure 0 0 0) 0x7f033407ba40 con 0x7f03401049f0 2024-08-19T01:19:42.735 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:19:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:19:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:19:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:19:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:19:42.735 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 3 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 18.2.4-721-gbaa926de (baa926deef3d9e81dd31b10a4ae9969a5fbce5ae) reef (stable)": 1, 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 13 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:19:42.736 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:19:42.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.734+0000 7f034772d640 1 -- 172.21.15.17:0/4285885171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f032806e170 msgr2=0x7f0328070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:42.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.734+0000 7f034772d640 1 --2- 172.21.15.17:0/4285885171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f032806e170 0x7f0328070630 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0330005e10 tx=0x7f0330005da0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.734+0000 7f034772d640 1 -- 172.21.15.17:0/4285885171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03401049f0 msgr2=0x7f0340196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:42.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.734+0000 7f034772d640 1 --2- 172.21.15.17:0/4285885171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03401049f0 0x7f0340196e60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f033402a9c0 tx=0x7f03340055a0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.734+0000 7f034772d640 1 -- 172.21.15.17:0/4285885171 shutdown_connections 2024-08-19T01:19:42.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.734+0000 7f034772d640 1 --2- 172.21.15.17:0/4285885171 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f032806e170 0x7f0328070630 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.734+0000 7f034772d640 1 --2- 172.21.15.17:0/4285885171 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03401049f0 0x7f0340196e60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.734+0000 7f034772d640 1 --2- 172.21.15.17:0/4285885171 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03400fe9f0 0x7f0340196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:42.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.734+0000 7f034772d640 1 -- 172.21.15.17:0/4285885171 >> 172.21.15.17:0/4285885171 conn(0x7f03400758a0 msgr2=0x7f03400fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:42.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.734+0000 7f034772d640 1 -- 172.21.15.17:0/4285885171 shutdown_connections 2024-08-19T01:19:42.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.735+0000 7f034772d640 1 -- 172.21.15.17:0/4285885171 wait complete. 2024-08-19T01:19:42.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.818+0000 7f98e0645640 1 -- 172.21.15.17:0/4141674422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98d8105bf0 msgr2=0x7f98d8105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.818+0000 7f98e0645640 1 --2- 172.21.15.17:0/4141674422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98d8105bf0 0x7f98d8105fd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009c20 tx=0x7f98c802a970 comp rx=0 tx=0).stop 2024-08-19T01:19:43.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.818+0000 7f98e0645640 1 -- 172.21.15.17:0/4141674422 shutdown_connections 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.818+0000 7f98e0645640 1 --2- 172.21.15.17:0/4141674422 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d80ffb40 0x7f98d80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.818+0000 7f98e0645640 1 --2- 172.21.15.17:0/4141674422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98d8105bf0 0x7f98d8105fd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.818+0000 7f98e0645640 1 -- 172.21.15.17:0/4141674422 >> 172.21.15.17:0/4141674422 conn(0x7f98d80fb7e0 msgr2=0x7f98d80fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.818+0000 7f98e0645640 1 -- 172.21.15.17:0/4141674422 shutdown_connections 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.818+0000 7f98e0645640 1 -- 172.21.15.17:0/4141674422 wait complete. 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.818+0000 7f98e0645640 1 Processor -- start 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98e0645640 1 -- start start 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98e0645640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98d80ffb40 0x7f98d80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98e0645640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d8105bf0 0x7f98d8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98e0645640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d8073230 con 0x7f98d80ffb40 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98e0645640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80733a0 con 0x7f98d8105bf0 2024-08-19T01:19:43.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98de3e1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98d80ffb40 0x7f98d80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98de3e1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98d80ffb40 0x7f98d80727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41064/0 (socket says 172.21.15.17:41064) 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98de3e1640 1 -- 172.21.15.17:0/3759340792 learned_addr learned my addr 172.21.15.17:0/3759340792 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98ddbe0640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d8105bf0 0x7f98d8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98de3e1640 1 -- 172.21.15.17:0/3759340792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d8105bf0 msgr2=0x7f98d8072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98de3e1640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d8105bf0 0x7f98d8072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98de3e1640 1 -- 172.21.15.17:0/3759340792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8009900 con 0x7f98d80ffb40 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98ddbe0640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d8105bf0 0x7f98d8072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.819+0000 7f98de3e1640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98d80ffb40 0x7f98d80727b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f98c802ae90 tx=0x7f98c80308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.820+0000 7f98d77fe640 1 -- 172.21.15.17:0/3759340792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98c802f590 con 0x7f98d80ffb40 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.820+0000 7f98e0645640 1 -- 172.21.15.17:0/3759340792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d8073620 con 0x7f98d80ffb40 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.820+0000 7f98d77fe640 1 -- 172.21.15.17:0/3759340792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98c8030ca0 con 0x7f98d80ffb40 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.820+0000 7f98d77fe640 1 -- 172.21.15.17:0/3759340792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98c8039680 con 0x7f98d80ffb40 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.820+0000 7f98e0645640 1 -- 172.21.15.17:0/3759340792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d81a1f50 con 0x7f98d80ffb40 2024-08-19T01:19:43.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.821+0000 7f98e0645640 1 -- 172.21.15.17:0/3759340792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d81011f0 con 0x7f98d80ffb40 2024-08-19T01:19:43.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.821+0000 7f98d77fe640 1 -- 172.21.15.17:0/3759340792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f98c800a040 con 0x7f98d80ffb40 2024-08-19T01:19:43.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.822+0000 7f98d77fe640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f98c006e170 0x7f98c0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:43.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.822+0000 7f98d77fe640 1 -- 172.21.15.17:0/3759340792 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f98c802c040 con 0x7f98d80ffb40 2024-08-19T01:19:43.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.822+0000 7f98ddbe0640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f98c006e170 0x7f98c0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:43.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.822+0000 7f98ddbe0640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f98c006e170 0x7f98c0070630 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98d8073f30 tx=0x7f98cc005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:43.178 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:42 smithi086 ceph-mon[71303]: pgmap v627: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:43.178 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:42 smithi086 ceph-mon[71303]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:42.830+0000 7f98d77fe640 1 -- 172.21.15.17:0/3759340792 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f98c8078830 con 0x7f98d80ffb40 2024-08-19T01:19:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.043+0000 7f98e0645640 1 -- 172.21.15.17:0/3759340792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f98d8073620 con 0x7f98d80ffb40 2024-08-19T01:19:43.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.044+0000 7f98d77fe640 1 -- 172.21.15.17:0/3759340792 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1909 (secure 0 0 0) 0x7f98d8073620 con 0x7f98d80ffb40 2024-08-19T01:19:43.179 INFO:teuthology.orchestra.run.smithi017.stdout:e30 2024-08-19T01:19:43.179 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:05:00:525013+0000 2024-08-19T01:19:43.179 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:19:43.179 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:19:43.179 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:19:43.179 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:19:43.179 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:19:43.179 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:19:43.179 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:19:43.180 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:19:43.181 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:19:43.181 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:19:43.181 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:19:43.181 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:19:43.181 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:19:43.181 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:19:43.181 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:19:43.181 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:19:43.181 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:19:43.181 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:19:43.181 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:19:43.182 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:19:43.182 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:19:43.182 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:19:43.182 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:19:43.182 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:19:43.182 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:19:43.182 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:19:43.182 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44309} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/1724223979,v1:172.21.15.86:6827/1724223979] compat {c=[1],r=[1],i=[7ff]}] 2024-08-19T01:19:43.182 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:19:43.185 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:19:43.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.046+0000 7f98e0645640 1 -- 172.21.15.17:0/3759340792 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f98c006e170 msgr2=0x7f98c0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.046+0000 7f98e0645640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f98c006e170 0x7f98c0070630 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98d8073f30 tx=0x7f98cc005d30 comp rx=0 tx=0).stop 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.046+0000 7f98e0645640 1 -- 172.21.15.17:0/3759340792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98d80ffb40 msgr2=0x7f98d80727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.046+0000 7f98e0645640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98d80ffb40 0x7f98d80727b0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f98c802ae90 tx=0x7f98c80308a0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.046+0000 7f98e0645640 1 -- 172.21.15.17:0/3759340792 shutdown_connections 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.046+0000 7f98e0645640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f98c006e170 0x7f98c0070630 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.046+0000 7f98e0645640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f98d8105bf0 0x7f98d8072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.046+0000 7f98e0645640 1 --2- 172.21.15.17:0/3759340792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f98d80ffb40 0x7f98d80727b0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.046+0000 7f98e0645640 1 -- 172.21.15.17:0/3759340792 >> 172.21.15.17:0/3759340792 conn(0x7f98d80fb7e0 msgr2=0x7f98d80fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.046+0000 7f98e0645640 1 -- 172.21.15.17:0/3759340792 shutdown_connections 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.046+0000 7f98e0645640 1 -- 172.21.15.17:0/3759340792 wait complete. 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.129+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3506208650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f68104a30 msgr2=0x7f0f68104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.129+0000 7f0f6e2ca640 1 --2- 172.21.15.17:0/3506208650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f68104a30 0x7f0f68104e10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0f58009880 tx=0x7f0f5802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.129+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3506208650 shutdown_connections 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.129+0000 7f0f6e2ca640 1 --2- 172.21.15.17:0/3506208650 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f680fea30 0x7f0f680fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.129+0000 7f0f6e2ca640 1 --2- 172.21.15.17:0/3506208650 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f68104a30 0x7f0f68104e10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.129+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3506208650 >> 172.21.15.17:0/3506208650 conn(0x7f0f680fa730 msgr2=0x7f0f680fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.129+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3506208650 shutdown_connections 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.129+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3506208650 wait complete. 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f6e2ca640 1 Processor -- start 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f6e2ca640 1 -- start start 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f6e2ca640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f680fea30 0x7f0f68196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f6e2ca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f68104a30 0x7f0f68196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f6e2ca640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f68197490 con 0x7f0f68104a30 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f6e2ca640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f68197600 con 0x7f0f680fea30 2024-08-19T01:19:43.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f68104a30 0x7f0f68196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f677fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f68104a30 0x7f0f68196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41088/0 (socket says 172.21.15.17:41088) 2024-08-19T01:19:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f677fe640 1 -- 172.21.15.17:0/3530122096 learned_addr learned my addr 172.21.15.17:0/3530122096 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f67fff640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f680fea30 0x7f0f68196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f677fe640 1 -- 172.21.15.17:0/3530122096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f680fea30 msgr2=0x7f0f68196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f677fe640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f680fea30 0x7f0f68196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f677fe640 1 -- 172.21.15.17:0/3530122096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f58009560 con 0x7f0f68104a30 2024-08-19T01:19:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.130+0000 7f0f67fff640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f680fea30 0x7f0f68196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:19:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.131+0000 7f0f677fe640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f68104a30 0x7f0f68196ec0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00d6f0 tx=0x7f0f5c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:43.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.131+0000 7f0f657fa640 1 -- 172.21.15.17:0/3530122096 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f5c009a30 con 0x7f0f68104a30 2024-08-19T01:19:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.131+0000 7f0f657fa640 1 -- 172.21.15.17:0/3530122096 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f5c0054e0 con 0x7f0f68104a30 2024-08-19T01:19:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.131+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3530122096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6819f9f0 con 0x7f0f68104a30 2024-08-19T01:19:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.131+0000 7f0f657fa640 1 -- 172.21.15.17:0/3530122096 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f5c010460 con 0x7f0f68104a30 2024-08-19T01:19:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.131+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3530122096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6819fe60 con 0x7f0f68104a30 2024-08-19T01:19:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.132+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3530122096 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f68100170 con 0x7f0f68104a30 2024-08-19T01:19:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.132+0000 7f0f657fa640 1 -- 172.21.15.17:0/3530122096 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0f5c009b90 con 0x7f0f68104a30 2024-08-19T01:19:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.133+0000 7f0f657fa640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0f5006e170 0x7f0f50070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.133+0000 7f0f657fa640 1 -- 172.21.15.17:0/3530122096 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0f5c08dd30 con 0x7f0f68104a30 2024-08-19T01:19:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.133+0000 7f0f67fff640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0f5006e170 0x7f0f50070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.133+0000 7f0f67fff640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0f5006e170 0x7f0f50070630 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0f58006010 tx=0x7f0f58005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:43.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.137+0000 7f0f657fa640 1 -- 172.21.15.17:0/3530122096 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0f5c057010 con 0x7f0f68104a30 2024-08-19T01:19:43.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.329+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3530122096 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f68107040 con 0x7f0f5006e170 2024-08-19T01:19:43.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.330+0000 7f0f657fa640 1 -- 172.21.15.17:0/3530122096 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0f68107040 con 0x7f0f5006e170 2024-08-19T01:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "crash", 2024-08-19T01:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:19:43.332 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr" 2024-08-19T01:19:43.333 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:19:43.333 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "15/23 daemons upgraded", 2024-08-19T01:19:43.333 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:19:43.333 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:19:43.333 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:19:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.332+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3530122096 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0f5006e170 msgr2=0x7f0f50070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.332+0000 7f0f6e2ca640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0f5006e170 0x7f0f50070630 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0f58006010 tx=0x7f0f58005e60 comp rx=0 tx=0).stop 2024-08-19T01:19:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.332+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3530122096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f68104a30 msgr2=0x7f0f68196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.332+0000 7f0f6e2ca640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f68104a30 0x7f0f68196ec0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00d6f0 tx=0x7f0f5c00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.332+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3530122096 shutdown_connections 2024-08-19T01:19:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.332+0000 7f0f6e2ca640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0f5006e170 0x7f0f50070630 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.332+0000 7f0f6e2ca640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f68104a30 0x7f0f68196ec0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.332+0000 7f0f6e2ca640 1 --2- 172.21.15.17:0/3530122096 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0f680fea30 0x7f0f68196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.332+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3530122096 >> 172.21.15.17:0/3530122096 conn(0x7f0f680fa730 msgr2=0x7f0f680fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:43.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.332+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3530122096 shutdown_connections 2024-08-19T01:19:43.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.332+0000 7f0f6e2ca640 1 -- 172.21.15.17:0/3530122096 wait complete. 2024-08-19T01:19:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.414+0000 7feba68e3640 1 -- 172.21.15.17:0/272966245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba0101610 msgr2=0x7feba0109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.414+0000 7feba68e3640 1 --2- 172.21.15.17:0/272966245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba0101610 0x7feba0109b00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7feb940098b0 tx=0x7feb9402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.414+0000 7feba68e3640 1 -- 172.21.15.17:0/272966245 shutdown_connections 2024-08-19T01:19:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.414+0000 7feba68e3640 1 --2- 172.21.15.17:0/272966245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba0101610 0x7feba0109b00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.414+0000 7feba68e3640 1 --2- 172.21.15.17:0/272966245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feba0100c60 0x7feba0101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.414+0000 7feba68e3640 1 -- 172.21.15.17:0/272966245 >> 172.21.15.17:0/272966245 conn(0x7feba00fa730 msgr2=0x7feba00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.414+0000 7feba68e3640 1 -- 172.21.15.17:0/272966245 shutdown_connections 2024-08-19T01:19:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.414+0000 7feba68e3640 1 -- 172.21.15.17:0/272966245 wait complete. 2024-08-19T01:19:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.415+0000 7feba68e3640 1 Processor -- start 2024-08-19T01:19:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.415+0000 7feba68e3640 1 -- start start 2024-08-19T01:19:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.415+0000 7feba68e3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba0100c60 0x7feba019b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.415+0000 7feba68e3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feba0101610 0x7feba019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.415+0000 7feba68e3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba019c3e0 con 0x7feba0100c60 2024-08-19T01:19:43.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.415+0000 7feba68e3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba0195970 con 0x7feba0101610 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.415+0000 7feb9ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba0100c60 0x7feba019b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feb9ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba0100c60 0x7feba019b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41098/0 (socket says 172.21.15.17:41098) 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feb9ffff640 1 -- 172.21.15.17:0/4178015681 learned_addr learned my addr 172.21.15.17:0/4178015681 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feb9f7fe640 1 --2- 172.21.15.17:0/4178015681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feba0101610 0x7feba019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feb9ffff640 1 -- 172.21.15.17:0/4178015681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feba0101610 msgr2=0x7feba019bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feb9ffff640 1 --2- 172.21.15.17:0/4178015681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feba0101610 0x7feba019bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feb9ffff640 1 -- 172.21.15.17:0/4178015681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94009560 con 0x7feba0100c60 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feb9ffff640 1 --2- 172.21.15.17:0/4178015681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba0100c60 0x7feba019b880 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7feb9000d6f0 tx=0x7feb9000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feb9d7fa640 1 -- 172.21.15.17:0/4178015681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb90009a30 con 0x7feba0100c60 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feb9d7fa640 1 -- 172.21.15.17:0/4178015681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb900054e0 con 0x7feba0100c60 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feba68e3640 1 -- 172.21.15.17:0/4178015681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba0195c50 con 0x7feba0100c60 2024-08-19T01:19:43.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feb9d7fa640 1 -- 172.21.15.17:0/4178015681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb90010460 con 0x7feba0100c60 2024-08-19T01:19:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.416+0000 7feba68e3640 1 -- 172.21.15.17:0/4178015681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba0196170 con 0x7feba0100c60 2024-08-19T01:19:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.417+0000 7feba68e3640 1 -- 172.21.15.17:0/4178015681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba0068d30 con 0x7feba0100c60 2024-08-19T01:19:43.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.418+0000 7feb9d7fa640 1 -- 172.21.15.17:0/4178015681 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7feb90009b90 con 0x7feba0100c60 2024-08-19T01:19:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.418+0000 7feb9d7fa640 1 --2- 172.21.15.17:0/4178015681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb8806e170 0x7feb88070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:19:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.418+0000 7feb9f7fe640 1 --2- 172.21.15.17:0/4178015681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb8806e170 0x7feb88070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:19:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.418+0000 7feb9d7fa640 1 -- 172.21.15.17:0/4178015681 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6586+0+0 (secure 0 0 0) 0x7feb9008dbd0 con 0x7feba0100c60 2024-08-19T01:19:43.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.419+0000 7feb9f7fe640 1 --2- 172.21.15.17:0/4178015681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb8806e170 0x7feb88070630 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feb94009880 tx=0x7feb940058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:19:43.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.423+0000 7feb9d7fa640 1 -- 172.21.15.17:0/4178015681 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7feb90056fe0 con 0x7feba0100c60 2024-08-19T01:19:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.667+0000 7feba68e3640 1 -- 172.21.15.17:0/4178015681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7feba0101040 con 0x7feba0100c60 2024-08-19T01:19:43.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.668+0000 7feb9d7fa640 1 -- 172.21.15.17:0/4178015681 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7feb90020090 con 0x7feba0100c60 2024-08-19T01:19:43.670 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:19:43.670 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:19:43.670 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:19:43.670 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:19:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:19:43.671 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:19:43.671 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:19:43.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.670+0000 7feba68e3640 1 -- 172.21.15.17:0/4178015681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb8806e170 msgr2=0x7feb88070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.670+0000 7feba68e3640 1 --2- 172.21.15.17:0/4178015681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb8806e170 0x7feb88070630 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7feb94009880 tx=0x7feb940058d0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.670+0000 7feba68e3640 1 -- 172.21.15.17:0/4178015681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba0100c60 msgr2=0x7feba019b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:19:43.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.670+0000 7feba68e3640 1 --2- 172.21.15.17:0/4178015681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba0100c60 0x7feba019b880 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7feb9000d6f0 tx=0x7feb9000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.670+0000 7feba68e3640 1 -- 172.21.15.17:0/4178015681 shutdown_connections 2024-08-19T01:19:43.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.670+0000 7feba68e3640 1 --2- 172.21.15.17:0/4178015681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb8806e170 0x7feb88070630 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.670+0000 7feba68e3640 1 --2- 172.21.15.17:0/4178015681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feba0101610 0x7feba019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.670+0000 7feba68e3640 1 --2- 172.21.15.17:0/4178015681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feba0100c60 0x7feba019b880 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:19:43.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.670+0000 7feba68e3640 1 -- 172.21.15.17:0/4178015681 >> 172.21.15.17:0/4178015681 conn(0x7feba00fa730 msgr2=0x7feba0101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:19:43.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.670+0000 7feba68e3640 1 -- 172.21.15.17:0/4178015681 shutdown_connections 2024-08-19T01:19:43.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:19:43.670+0000 7feba68e3640 1 -- 172.21.15.17:0/4178015681 wait complete. 2024-08-19T01:19:43.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:43 smithi017 ceph-mon[99370]: from='client.35188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:43.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:43 smithi017 ceph-mon[99370]: from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:43.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:43 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4285885171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:19:43.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:43 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3759340792' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:19:43.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:43 smithi086 ceph-mon[71303]: from='client.35188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:43.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:43 smithi086 ceph-mon[71303]: from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:43.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:43 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4285885171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:19:43.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:43 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3759340792' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:19:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:44 smithi017 ceph-mon[99370]: pgmap v628: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:44 smithi017 ceph-mon[99370]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:44.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:44 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4178015681' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:19:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:44 smithi086 ceph-mon[71303]: pgmap v628: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:44 smithi086 ceph-mon[71303]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:19:44.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:44 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4178015681' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:19:46.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:46 smithi017 ceph-mon[99370]: pgmap v629: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:46.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:46 smithi086 ceph-mon[71303]: pgmap v629: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:48 smithi017 ceph-mon[99370]: pgmap v630: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:19:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:48 smithi086 ceph-mon[71303]: pgmap v630: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:19:50.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:50 smithi017 ceph-mon[99370]: pgmap v631: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:50.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:50 smithi086 ceph-mon[71303]: pgmap v631: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:52.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:52 smithi017 ceph-mon[99370]: pgmap v632: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:52.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:52 smithi086 ceph-mon[71303]: pgmap v632: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:54.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:54 smithi017 ceph-mon[99370]: pgmap v633: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:54 smithi086 ceph-mon[71303]: pgmap v633: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:56.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:56 smithi017 ceph-mon[99370]: pgmap v634: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:56 smithi086 ceph-mon[71303]: pgmap v634: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:58.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:19:58 smithi017 ceph-mon[99370]: pgmap v635: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:19:58.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:19:58 smithi086 ceph-mon[71303]: pgmap v635: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:20:00.000+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:20:00.874 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:00 smithi086 ceph-mon[71303]: pgmap v636: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:00.874 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:00 smithi086 ceph-mon[71303]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:20:00.874 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:20:00.874 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:20:00.874 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:00.874 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:20:00.874 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:00.875 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:00.875 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:00.875 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:00 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:00 smithi017 ceph-mon[99370]: pgmap v636: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:00 smithi017 ceph-mon[99370]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:20:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:20:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:20:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:20:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:00 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:01.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:01 smithi017 ceph-mon[99370]: pgmap v637: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:01.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:01 smithi017 ceph-mon[99370]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-08-19T01:20:01.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:01 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:01.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:01 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.oncasl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:20:01.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:01 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:20:01.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:01 smithi086 ceph-mon[71303]: pgmap v637: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:01 smithi086 ceph-mon[71303]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-08-19T01:20:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:01 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:01 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi086.oncasl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-19T01:20:01.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:01 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:20:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:02 smithi017 ceph-mon[99370]: Upgrade: Updating mds.cephfs.smithi086.oncasl 2024-08-19T01:20:02.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:02 smithi017 ceph-mon[99370]: Deploying daemon mds.cephfs.smithi086.oncasl on smithi086 2024-08-19T01:20:02.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:02 smithi086 ceph-mon[71303]: Upgrade: Updating mds.cephfs.smithi086.oncasl 2024-08-19T01:20:02.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:02 smithi086 ceph-mon[71303]: Deploying daemon mds.cephfs.smithi086.oncasl on smithi086 2024-08-19T01:20:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:03 smithi086 ceph-mon[71303]: pgmap v638: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:20:04.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:03 smithi017 ceph-mon[99370]: pgmap v638: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:04.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:04.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:20:05.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:04 smithi017 ceph-mon[99370]: osdmap e85: 6 total, 6 up, 6 in 2024-08-19T01:20:05.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:04 smithi017 ceph-mon[99370]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-08-19T01:20:05.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:04 smithi086 ceph-mon[71303]: osdmap e85: 6 total, 6 up, 6 in 2024-08-19T01:20:05.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:04 smithi086 ceph-mon[71303]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-08-19T01:20:06.382 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:05 smithi086 ceph-mon[71303]: pgmap v640: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:06.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:05 smithi017 ceph-mon[99370]: pgmap v640: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:08.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:07 smithi086 ceph-mon[71303]: pgmap v641: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:08.204 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:07 smithi017 ceph-mon[99370]: pgmap v641: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:08 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] up:boot 2024-08-19T01:20:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:08 smithi086 ceph-mon[71303]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:20:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T01:20:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:20:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:08 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] up:boot 2024-08-19T01:20:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:08 smithi017 ceph-mon[99370]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:20:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T01:20:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:20:09.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:09.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:09.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:09.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:10.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:10 smithi086 ceph-mon[71303]: pgmap v642: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:10.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:10 smithi017 ceph-mon[99370]: pgmap v642: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:11 smithi017 ceph-mon[99370]: pgmap v643: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:12.309 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:11 smithi086 ceph-mon[71303]: pgmap v643: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:12.309 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:12.309 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:12.309 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:12.309 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:13.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.754+0000 7f5887bec640 1 -- 172.21.15.17:0/207521257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5880104b60 msgr2=0x7f5880104f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:13.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.754+0000 7f5887bec640 1 --2- 172.21.15.17:0/207521257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5880104b60 0x7f5880104f40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f587c009880 tx=0x7f587c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:13.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.754+0000 7f5887bec640 1 -- 172.21.15.17:0/207521257 shutdown_connections 2024-08-19T01:20:13.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.754+0000 7f5887bec640 1 --2- 172.21.15.17:0/207521257 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58800fdf80 0x7f58800fe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:13.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.754+0000 7f5887bec640 1 --2- 172.21.15.17:0/207521257 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5880104b60 0x7f5880104f40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:13.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.754+0000 7f5887bec640 1 -- 172.21.15.17:0/207521257 >> 172.21.15.17:0/207521257 conn(0x7f58800f9e70 msgr2=0x7f58800fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:13.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.754+0000 7f5887bec640 1 -- 172.21.15.17:0/207521257 shutdown_connections 2024-08-19T01:20:13.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.754+0000 7f5887bec640 1 -- 172.21.15.17:0/207521257 wait complete. 2024-08-19T01:20:13.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.755+0000 7f5887bec640 1 Processor -- start 2024-08-19T01:20:13.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.755+0000 7f5887bec640 1 -- start start 2024-08-19T01:20:13.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.755+0000 7f5887bec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58800fdf80 0x7f588019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:13.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.755+0000 7f5887bec640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5880104b60 0x7f588019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:13.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.755+0000 7f5887bec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588019c3e0 con 0x7f58800fdf80 2024-08-19T01:20:13.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.755+0000 7f5887bec640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5880195a00 con 0x7f5880104b60 2024-08-19T01:20:13.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.755+0000 7f5885988640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58800fdf80 0x7f588019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:13.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.755+0000 7f5885988640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58800fdf80 0x7f588019b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40858/0 (socket says 172.21.15.17:40858) 2024-08-19T01:20:13.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.755+0000 7f5885988640 1 -- 172.21.15.17:0/1555146166 learned_addr learned my addr 172.21.15.17:0/1555146166 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:13.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.755+0000 7f5885187640 1 --2- 172.21.15.17:0/1555146166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5880104b60 0x7f588019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:13.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.756+0000 7f5885988640 1 -- 172.21.15.17:0/1555146166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5880104b60 msgr2=0x7f588019be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:13.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.756+0000 7f5885988640 1 --2- 172.21.15.17:0/1555146166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5880104b60 0x7f588019be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:13.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.756+0000 7f5885988640 1 -- 172.21.15.17:0/1555146166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c009560 con 0x7f58800fdf80 2024-08-19T01:20:13.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.756+0000 7f5885988640 1 --2- 172.21.15.17:0/1555146166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58800fdf80 0x7f588019b910 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f587c02a9c0 tx=0x7f587c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:13.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.756+0000 7f5876ffd640 1 -- 172.21.15.17:0/1555146166 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f587c004aa0 con 0x7f58800fdf80 2024-08-19T01:20:13.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.756+0000 7f5876ffd640 1 -- 172.21.15.17:0/1555146166 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f587c004c00 con 0x7f58800fdf80 2024-08-19T01:20:13.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.756+0000 7f5887bec640 1 -- 172.21.15.17:0/1555146166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5880195c80 con 0x7f58800fdf80 2024-08-19T01:20:13.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.756+0000 7f5876ffd640 1 -- 172.21.15.17:0/1555146166 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f587c003a20 con 0x7f58800fdf80 2024-08-19T01:20:13.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.756+0000 7f5887bec640 1 -- 172.21.15.17:0/1555146166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5880196170 con 0x7f58800fdf80 2024-08-19T01:20:13.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.757+0000 7f5887bec640 1 -- 172.21.15.17:0/1555146166 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58801012a0 con 0x7f58800fdf80 2024-08-19T01:20:13.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.758+0000 7f5876ffd640 1 -- 172.21.15.17:0/1555146166 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f587c031c90 con 0x7f58800fdf80 2024-08-19T01:20:13.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.758+0000 7f5876ffd640 1 --2- 172.21.15.17:0/1555146166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f586c06e170 0x7f586c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:13.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.758+0000 7f5876ffd640 1 -- 172.21.15.17:0/1555146166 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f587c0af140 con 0x7f58800fdf80 2024-08-19T01:20:13.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.758+0000 7f5885187640 1 --2- 172.21.15.17:0/1555146166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f586c06e170 0x7f586c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:13.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.759+0000 7f5885187640 1 --2- 172.21.15.17:0/1555146166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f586c06e170 0x7f586c070630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5880196e70 tx=0x7f587000a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:13.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.763+0000 7f5876ffd640 1 -- 172.21.15.17:0/1555146166 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f587c0784a0 con 0x7f58800fdf80 2024-08-19T01:20:13.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.956+0000 7f5887bec640 1 -- 172.21.15.17:0/1555146166 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5880196f10 con 0x7f586c06e170 2024-08-19T01:20:13.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.957+0000 7f5876ffd640 1 -- 172.21.15.17:0/1555146166 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f5880196f10 con 0x7f586c06e170 2024-08-19T01:20:13.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.959+0000 7f5887bec640 1 -- 172.21.15.17:0/1555146166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f586c06e170 msgr2=0x7f586c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.959+0000 7f5887bec640 1 --2- 172.21.15.17:0/1555146166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f586c06e170 0x7f586c070630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5880196e70 tx=0x7f587000a2d0 comp rx=0 tx=0).stop 2024-08-19T01:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.959+0000 7f5887bec640 1 -- 172.21.15.17:0/1555146166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58800fdf80 msgr2=0x7f588019b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.959+0000 7f5887bec640 1 --2- 172.21.15.17:0/1555146166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58800fdf80 0x7f588019b910 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f587c02a9c0 tx=0x7f587c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.960+0000 7f5887bec640 1 -- 172.21.15.17:0/1555146166 shutdown_connections 2024-08-19T01:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.960+0000 7f5887bec640 1 --2- 172.21.15.17:0/1555146166 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f586c06e170 0x7f586c070630 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.960+0000 7f5887bec640 1 --2- 172.21.15.17:0/1555146166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5880104b60 0x7f588019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.960+0000 7f5887bec640 1 --2- 172.21.15.17:0/1555146166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58800fdf80 0x7f588019b910 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.960+0000 7f5887bec640 1 -- 172.21.15.17:0/1555146166 >> 172.21.15.17:0/1555146166 conn(0x7f58800f9e70 msgr2=0x7f58800fab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.960+0000 7f5887bec640 1 -- 172.21.15.17:0/1555146166 shutdown_connections 2024-08-19T01:20:13.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:13.960+0000 7f5887bec640 1 -- 172.21.15.17:0/1555146166 wait complete. 2024-08-19T01:20:13.971 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:20:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.043+0000 7ff265d00640 1 -- 172.21.15.17:0/4081319102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2600fe9f0 msgr2=0x7ff2600fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.043+0000 7ff265d00640 1 --2- 172.21.15.17:0/4081319102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2600fe9f0 0x7ff2600fee50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff248009880 tx=0x7ff24802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.044+0000 7ff265d00640 1 -- 172.21.15.17:0/4081319102 shutdown_connections 2024-08-19T01:20:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.044+0000 7ff265d00640 1 --2- 172.21.15.17:0/4081319102 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2600fe9f0 0x7ff2600fee50 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.044+0000 7ff265d00640 1 --2- 172.21.15.17:0/4081319102 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2601049f0 0x7ff260104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.044+0000 7ff265d00640 1 -- 172.21.15.17:0/4081319102 >> 172.21.15.17:0/4081319102 conn(0x7ff2600758a0 msgr2=0x7ff2600fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:14.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.044+0000 7ff265d00640 1 -- 172.21.15.17:0/4081319102 shutdown_connections 2024-08-19T01:20:14.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.044+0000 7ff265d00640 1 -- 172.21.15.17:0/4081319102 wait complete. 2024-08-19T01:20:14.048 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:13 smithi017 ceph-mon[99370]: pgmap v644: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:14.048 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:13 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:14.048 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:13 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:14.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.044+0000 7ff265d00640 1 Processor -- start 2024-08-19T01:20:14.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.044+0000 7ff265d00640 1 -- start start 2024-08-19T01:20:14.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff265d00640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2600fe9f0 0x7ff260196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff265d00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2601049f0 0x7ff260196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff265d00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff260197430 con 0x7ff2601049f0 2024-08-19T01:20:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff265d00640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2601975a0 con 0x7ff2600fe9f0 2024-08-19T01:20:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff256ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2601049f0 0x7ff260196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff256ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2601049f0 0x7ff260196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40882/0 (socket says 172.21.15.17:40882) 2024-08-19T01:20:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff256ffd640 1 -- 172.21.15.17:0/2056792251 learned_addr learned my addr 172.21.15.17:0/2056792251 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff25f7fe640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2600fe9f0 0x7ff260196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff256ffd640 1 -- 172.21.15.17:0/2056792251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2600fe9f0 msgr2=0x7ff260196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff256ffd640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2600fe9f0 0x7ff260196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff256ffd640 1 -- 172.21.15.17:0/2056792251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff248009560 con 0x7ff2601049f0 2024-08-19T01:20:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff25f7fe640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2600fe9f0 0x7ff260196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T01:20:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.045+0000 7ff256ffd640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2601049f0 0x7ff260196e60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff24802a9c0 tx=0x7ff2480055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.046+0000 7ff25d7fa640 1 -- 172.21.15.17:0/2056792251 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2480048d0 con 0x7ff2601049f0 2024-08-19T01:20:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.046+0000 7ff25d7fa640 1 -- 172.21.15.17:0/2056792251 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff248031640 con 0x7ff2601049f0 2024-08-19T01:20:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.046+0000 7ff265d00640 1 -- 172.21.15.17:0/2056792251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26019f990 con 0x7ff2601049f0 2024-08-19T01:20:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.046+0000 7ff25d7fa640 1 -- 172.21.15.17:0/2056792251 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2480038d0 con 0x7ff2601049f0 2024-08-19T01:20:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.046+0000 7ff265d00640 1 -- 172.21.15.17:0/2056792251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26019fcf0 con 0x7ff2601049f0 2024-08-19T01:20:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.047+0000 7ff265d00640 1 -- 172.21.15.17:0/2056792251 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff260100130 con 0x7ff2601049f0 2024-08-19T01:20:14.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.047+0000 7ff25d7fa640 1 -- 172.21.15.17:0/2056792251 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff248003b90 con 0x7ff2601049f0 2024-08-19T01:20:14.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.048+0000 7ff25d7fa640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff24c06e170 0x7ff24c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.048+0000 7ff25d7fa640 1 -- 172.21.15.17:0/2056792251 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff2480af0a0 con 0x7ff2601049f0 2024-08-19T01:20:14.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.048+0000 7ff25f7fe640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff24c06e170 0x7ff24c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.048+0000 7ff25f7fe640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff24c06e170 0x7ff24c070630 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff250009fc0 tx=0x7ff250005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:14.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.052+0000 7ff25d7fa640 1 -- 172.21.15.17:0/2056792251 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff248078430 con 0x7ff2601049f0 2024-08-19T01:20:14.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.244+0000 7ff265d00640 1 -- 172.21.15.17:0/2056792251 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff26010bc60 con 0x7ff24c06e170 2024-08-19T01:20:14.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.245+0000 7ff25d7fa640 1 -- 172.21.15.17:0/2056792251 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ff26010bc60 con 0x7ff24c06e170 2024-08-19T01:20:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.247+0000 7ff265d00640 1 -- 172.21.15.17:0/2056792251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff24c06e170 msgr2=0x7ff24c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.247+0000 7ff265d00640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff24c06e170 0x7ff24c070630 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff250009fc0 tx=0x7ff250005f90 comp rx=0 tx=0).stop 2024-08-19T01:20:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.247+0000 7ff265d00640 1 -- 172.21.15.17:0/2056792251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2601049f0 msgr2=0x7ff260196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.247+0000 7ff265d00640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2601049f0 0x7ff260196e60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff24802a9c0 tx=0x7ff2480055a0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.247+0000 7ff265d00640 1 -- 172.21.15.17:0/2056792251 shutdown_connections 2024-08-19T01:20:14.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.247+0000 7ff265d00640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff24c06e170 0x7ff24c070630 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.247+0000 7ff265d00640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff2601049f0 0x7ff260196e60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.247+0000 7ff265d00640 1 --2- 172.21.15.17:0/2056792251 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff2600fe9f0 0x7ff260196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.247+0000 7ff265d00640 1 -- 172.21.15.17:0/2056792251 >> 172.21.15.17:0/2056792251 conn(0x7ff2600758a0 msgr2=0x7ff2600fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:14.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.247+0000 7ff265d00640 1 -- 172.21.15.17:0/2056792251 shutdown_connections 2024-08-19T01:20:14.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.247+0000 7ff265d00640 1 -- 172.21.15.17:0/2056792251 wait complete. 2024-08-19T01:20:14.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.329+0000 7f3794fd9640 1 -- 172.21.15.17:0/2025852259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3790100d50 msgr2=0x7f3790101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.329+0000 7f3794fd9640 1 --2- 172.21.15.17:0/2025852259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3790100d50 0x7f3790101130 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3780009880 tx=0x7f378002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.329+0000 7f3794fd9640 1 -- 172.21.15.17:0/2025852259 shutdown_connections 2024-08-19T01:20:14.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.329+0000 7f3794fd9640 1 --2- 172.21.15.17:0/2025852259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3790101670 0x7f3790109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.329+0000 7f3794fd9640 1 --2- 172.21.15.17:0/2025852259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3790100d50 0x7f3790101130 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.329+0000 7f3794fd9640 1 -- 172.21.15.17:0/2025852259 >> 172.21.15.17:0/2025852259 conn(0x7f37900fa730 msgr2=0x7f37900fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:14.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.329+0000 7f3794fd9640 1 -- 172.21.15.17:0/2025852259 shutdown_connections 2024-08-19T01:20:14.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.329+0000 7f3794fd9640 1 -- 172.21.15.17:0/2025852259 wait complete. 2024-08-19T01:20:14.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.330+0000 7f3794fd9640 1 Processor -- start 2024-08-19T01:20:14.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.330+0000 7f3794fd9640 1 -- start start 2024-08-19T01:20:14.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.330+0000 7f3794fd9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3790100d50 0x7f379019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.330+0000 7f3794fd9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3790101670 0x7f379019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.330+0000 7f3794fd9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790195970 con 0x7f3790101670 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.330+0000 7f3794fd9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790195ab0 con 0x7f3790100d50 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.330+0000 7f378dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3790101670 0x7f379019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.330+0000 7f378dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3790101670 0x7f379019be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40896/0 (socket says 172.21.15.17:40896) 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.330+0000 7f378dd9b640 1 -- 172.21.15.17:0/650164404 learned_addr learned my addr 172.21.15.17:0/650164404 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.330+0000 7f378e59c640 1 --2- 172.21.15.17:0/650164404 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3790100d50 0x7f379019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.331+0000 7f378dd9b640 1 -- 172.21.15.17:0/650164404 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3790100d50 msgr2=0x7f379019b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.331+0000 7f378dd9b640 1 --2- 172.21.15.17:0/650164404 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3790100d50 0x7f379019b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.331+0000 7f378dd9b640 1 -- 172.21.15.17:0/650164404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3780009560 con 0x7f3790101670 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.331+0000 7f378dd9b640 1 --2- 172.21.15.17:0/650164404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3790101670 0x7f379019be50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f378400b420 tx=0x7f378400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:14.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.331+0000 7f377f7fe640 1 -- 172.21.15.17:0/650164404 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3784011800 con 0x7f3790101670 2024-08-19T01:20:14.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.331+0000 7f3794fd9640 1 -- 172.21.15.17:0/650164404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3790195d90 con 0x7f3790101670 2024-08-19T01:20:14.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.331+0000 7f377f7fe640 1 -- 172.21.15.17:0/650164404 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3784011e20 con 0x7f3790101670 2024-08-19T01:20:14.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.331+0000 7f3794fd9640 1 -- 172.21.15.17:0/650164404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37901962e0 con 0x7f3790101670 2024-08-19T01:20:14.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.331+0000 7f377f7fe640 1 -- 172.21.15.17:0/650164404 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f378400f2e0 con 0x7f3790101670 2024-08-19T01:20:14.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.332+0000 7f3794fd9640 1 -- 172.21.15.17:0/650164404 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3790068cd0 con 0x7f3790101670 2024-08-19T01:20:14.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.333+0000 7f377f7fe640 1 -- 172.21.15.17:0/650164404 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3784010380 con 0x7f3790101670 2024-08-19T01:20:14.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.333+0000 7f377f7fe640 1 --2- 172.21.15.17:0/650164404 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f377806e180 0x7f3778070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.333+0000 7f377f7fe640 1 -- 172.21.15.17:0/650164404 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f378408da60 con 0x7f3790101670 2024-08-19T01:20:14.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.333+0000 7f378e59c640 1 --2- 172.21.15.17:0/650164404 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f377806e180 0x7f3778070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.334+0000 7f378e59c640 1 --2- 172.21.15.17:0/650164404 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f377806e180 0x7f3778070640 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3780009230 tx=0x7f3780005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:14.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.338+0000 7f377f7fe640 1 -- 172.21.15.17:0/650164404 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3784056d40 con 0x7f3790101670 2024-08-19T01:20:14.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:13 smithi086 ceph-mon[71303]: pgmap v644: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:14.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:13 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:14.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:13 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:20:14.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.522+0000 7f3794fd9640 1 -- 172.21.15.17:0/650164404 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3790196610 con 0x7f377806e180 2024-08-19T01:20:14.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.532+0000 7f377f7fe640 1 -- 172.21.15.17:0/650164404 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3790196610 con 0x7f377806e180 2024-08-19T01:20:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:20:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (21m) 1s ago 32m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:20:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (32m) 1s ago 32m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:20:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (31m) 3s ago 31m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:20:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (19m) 1s ago 32m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:20:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (19m) 3s ago 31m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:20:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (21m) 1s ago 31m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:20:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (15m) 1s ago 26m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:20:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (15m) 1s ago 26m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:20:14.535 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (6s) 3s ago 26m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (15m) 3s ago 26m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (23m) 1s ago 33m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (22m) 3s ago 31m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (20m) 1s ago 33m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (19m) 3s ago 31m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (22m) 1s ago 32m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (22m) 3s ago 31m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (18m) 1s ago 30m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (18m) 1s ago 29m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (17m) 1s ago 29m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (17m) 3s ago 29m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (16m) 3s ago 28m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:20:14.536 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (16m) 3s ago 28m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:20:14.537 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (21m) 1s ago 31m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:20:14.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.534+0000 7f3794fd9640 1 -- 172.21.15.17:0/650164404 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f377806e180 msgr2=0x7f3778070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.534+0000 7f3794fd9640 1 --2- 172.21.15.17:0/650164404 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f377806e180 0x7f3778070640 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3780009230 tx=0x7f3780005a20 comp rx=0 tx=0).stop 2024-08-19T01:20:14.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.534+0000 7f3794fd9640 1 -- 172.21.15.17:0/650164404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3790101670 msgr2=0x7f379019be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.534+0000 7f3794fd9640 1 --2- 172.21.15.17:0/650164404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3790101670 0x7f379019be50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f378400b420 tx=0x7f378400b8e0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.534+0000 7f3794fd9640 1 -- 172.21.15.17:0/650164404 shutdown_connections 2024-08-19T01:20:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.534+0000 7f3794fd9640 1 --2- 172.21.15.17:0/650164404 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f377806e180 0x7f3778070640 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.534+0000 7f3794fd9640 1 --2- 172.21.15.17:0/650164404 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3790101670 0x7f379019be50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.534+0000 7f3794fd9640 1 --2- 172.21.15.17:0/650164404 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3790100d50 0x7f379019b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.534+0000 7f3794fd9640 1 -- 172.21.15.17:0/650164404 >> 172.21.15.17:0/650164404 conn(0x7f37900fa730 msgr2=0x7f3790102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.534+0000 7f3794fd9640 1 -- 172.21.15.17:0/650164404 shutdown_connections 2024-08-19T01:20:14.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.534+0000 7f3794fd9640 1 -- 172.21.15.17:0/650164404 wait complete. 2024-08-19T01:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.617+0000 7f697a77c640 1 -- 172.21.15.17:0/491867636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740ffda0 msgr2=0x7f6974100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.617+0000 7f697a77c640 1 --2- 172.21.15.17:0/491867636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740ffda0 0x7f6974100180 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6964009880 tx=0x7f696402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.617+0000 7f697a77c640 1 -- 172.21.15.17:0/491867636 shutdown_connections 2024-08-19T01:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.617+0000 7f697a77c640 1 --2- 172.21.15.17:0/491867636 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974100750 0x7f69741047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.617+0000 7f697a77c640 1 --2- 172.21.15.17:0/491867636 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740ffda0 0x7f6974100180 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.617+0000 7f697a77c640 1 -- 172.21.15.17:0/491867636 >> 172.21.15.17:0/491867636 conn(0x7f69740fb840 msgr2=0x7f69740fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.617+0000 7f697a77c640 1 -- 172.21.15.17:0/491867636 shutdown_connections 2024-08-19T01:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.617+0000 7f697a77c640 1 -- 172.21.15.17:0/491867636 wait complete. 2024-08-19T01:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.618+0000 7f697a77c640 1 Processor -- start 2024-08-19T01:20:14.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.618+0000 7f697a77c640 1 -- start start 2024-08-19T01:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.618+0000 7f697a77c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740ffda0 0x7f697419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.618+0000 7f697a77c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974100750 0x7f697419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.618+0000 7f697a77c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6974197b40 con 0x7f69740ffda0 2024-08-19T01:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.618+0000 7f697a77c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6974197cb0 con 0x7f6974100750 2024-08-19T01:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f6973fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740ffda0 0x7f697419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f6973fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740ffda0 0x7f697419da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40916/0 (socket says 172.21.15.17:40916) 2024-08-19T01:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f6973fff640 1 -- 172.21.15.17:0/1715974124 learned_addr learned my addr 172.21.15.17:0/1715974124 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f69737fe640 1 --2- 172.21.15.17:0/1715974124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974100750 0x7f697419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f6973fff640 1 -- 172.21.15.17:0/1715974124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974100750 msgr2=0x7f697419df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f6973fff640 1 --2- 172.21.15.17:0/1715974124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974100750 0x7f697419df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f6973fff640 1 -- 172.21.15.17:0/1715974124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6964009560 con 0x7f69740ffda0 2024-08-19T01:20:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f6973fff640 1 --2- 172.21.15.17:0/1715974124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740ffda0 0x7f697419da50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f696402a9c0 tx=0x7f69640055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f69717fa640 1 -- 172.21.15.17:0/1715974124 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6964004aa0 con 0x7f69740ffda0 2024-08-19T01:20:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f69717fa640 1 -- 172.21.15.17:0/1715974124 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6964004c00 con 0x7f69740ffda0 2024-08-19T01:20:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f697a77c640 1 -- 172.21.15.17:0/1715974124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6974197f30 con 0x7f69740ffda0 2024-08-19T01:20:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f69717fa640 1 -- 172.21.15.17:0/1715974124 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69640038f0 con 0x7f69740ffda0 2024-08-19T01:20:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.619+0000 7f697a77c640 1 -- 172.21.15.17:0/1715974124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6974198420 con 0x7f69740ffda0 2024-08-19T01:20:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.620+0000 7f697a77c640 1 -- 172.21.15.17:0/1715974124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6974101280 con 0x7f69740ffda0 2024-08-19T01:20:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.622+0000 7f69717fa640 1 -- 172.21.15.17:0/1715974124 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6964003bd0 con 0x7f69740ffda0 2024-08-19T01:20:14.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.622+0000 7f69717fa640 1 --2- 172.21.15.17:0/1715974124 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f695c06e170 0x7f695c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.622+0000 7f69717fa640 1 -- 172.21.15.17:0/1715974124 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f69640af850 con 0x7f69740ffda0 2024-08-19T01:20:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.622+0000 7f69737fe640 1 --2- 172.21.15.17:0/1715974124 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f695c06e170 0x7f695c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.623+0000 7f69737fe640 1 --2- 172.21.15.17:0/1715974124 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f695c06e170 0x7f695c070630 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6974072700 tx=0x7f696800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:14.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.626+0000 7f69717fa640 1 -- 172.21.15.17:0/1715974124 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6964078c60 con 0x7f69740ffda0 2024-08-19T01:20:14.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.870+0000 7f697a77c640 1 -- 172.21.15.17:0/1715974124 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6974100180 con 0x7f69740ffda0 2024-08-19T01:20:14.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.871+0000 7f69717fa640 1 -- 172.21.15.17:0/1715974124 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f696407c320 con 0x7f69740ffda0 2024-08-19T01:20:14.874 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:20:14.874 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:20:14.874 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:20:14.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:20:14.875 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:20:14.875 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:20:14.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:20:14.875 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:20:14.875 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:20:14.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:20:14.876 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:20:14.876 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:20:14.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:20:14.876 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:20:14.876 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:20:14.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:20:14.876 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:20:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.873+0000 7f697a77c640 1 -- 172.21.15.17:0/1715974124 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f695c06e170 msgr2=0x7f695c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.873+0000 7f697a77c640 1 --2- 172.21.15.17:0/1715974124 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f695c06e170 0x7f695c070630 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6974072700 tx=0x7f696800b390 comp rx=0 tx=0).stop 2024-08-19T01:20:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.873+0000 7f697a77c640 1 -- 172.21.15.17:0/1715974124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740ffda0 msgr2=0x7f697419da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.873+0000 7f697a77c640 1 --2- 172.21.15.17:0/1715974124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740ffda0 0x7f697419da50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f696402a9c0 tx=0x7f69640055a0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.873+0000 7f697a77c640 1 -- 172.21.15.17:0/1715974124 shutdown_connections 2024-08-19T01:20:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.873+0000 7f697a77c640 1 --2- 172.21.15.17:0/1715974124 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f695c06e170 0x7f695c070630 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.873+0000 7f697a77c640 1 --2- 172.21.15.17:0/1715974124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6974100750 0x7f697419df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.873+0000 7f697a77c640 1 --2- 172.21.15.17:0/1715974124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69740ffda0 0x7f697419da50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.873+0000 7f697a77c640 1 -- 172.21.15.17:0/1715974124 >> 172.21.15.17:0/1715974124 conn(0x7f69740fb840 msgr2=0x7f69740fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:14.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.873+0000 7f697a77c640 1 -- 172.21.15.17:0/1715974124 shutdown_connections 2024-08-19T01:20:14.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.873+0000 7f697a77c640 1 -- 172.21.15.17:0/1715974124 wait complete. 2024-08-19T01:20:14.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.955+0000 7f85f34f0640 1 -- 172.21.15.17:0/3228692169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ec0fea30 msgr2=0x7f85ec0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.955+0000 7f85f34f0640 1 --2- 172.21.15.17:0/3228692169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ec0fea30 0x7f85ec0fee90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009880 tx=0x7f85dc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.955+0000 7f85f34f0640 1 -- 172.21.15.17:0/3228692169 shutdown_connections 2024-08-19T01:20:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.955+0000 7f85f34f0640 1 --2- 172.21.15.17:0/3228692169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ec0fea30 0x7f85ec0fee90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.955+0000 7f85f34f0640 1 --2- 172.21.15.17:0/3228692169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ec104a30 0x7f85ec104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.955+0000 7f85f34f0640 1 -- 172.21.15.17:0/3228692169 >> 172.21.15.17:0/3228692169 conn(0x7f85ec0fa730 msgr2=0x7f85ec0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.955+0000 7f85f34f0640 1 -- 172.21.15.17:0/3228692169 shutdown_connections 2024-08-19T01:20:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.955+0000 7f85f34f0640 1 -- 172.21.15.17:0/3228692169 wait complete. 2024-08-19T01:20:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f34f0640 1 Processor -- start 2024-08-19T01:20:14.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f34f0640 1 -- start start 2024-08-19T01:20:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f34f0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ec0fea30 0x7f85ec19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f34f0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ec104a30 0x7f85ec19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f34f0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec19c360 con 0x7f85ec104a30 2024-08-19T01:20:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f34f0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec1958f0 con 0x7f85ec0fea30 2024-08-19T01:20:14.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f0a8b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ec104a30 0x7f85ec19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f0a8b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ec104a30 0x7f85ec19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40932/0 (socket says 172.21.15.17:40932) 2024-08-19T01:20:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f0a8b640 1 -- 172.21.15.17:0/101685856 learned_addr learned my addr 172.21.15.17:0/101685856 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f128c640 1 --2- 172.21.15.17:0/101685856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ec0fea30 0x7f85ec19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f0a8b640 1 -- 172.21.15.17:0/101685856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ec0fea30 msgr2=0x7f85ec19b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.956+0000 7f85f0a8b640 1 --2- 172.21.15.17:0/101685856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ec0fea30 0x7f85ec19b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.957+0000 7f85f0a8b640 1 -- 172.21.15.17:0/101685856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc009560 con 0x7f85ec104a30 2024-08-19T01:20:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.957+0000 7f85f0a8b640 1 --2- 172.21.15.17:0/101685856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ec104a30 0x7f85ec19bd40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f85dc02a9c0 tx=0x7f85dc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.957+0000 7f85e27fc640 1 -- 172.21.15.17:0/101685856 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85dc004aa0 con 0x7f85ec104a30 2024-08-19T01:20:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.957+0000 7f85f34f0640 1 -- 172.21.15.17:0/101685856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec195b70 con 0x7f85ec104a30 2024-08-19T01:20:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.957+0000 7f85e27fc640 1 -- 172.21.15.17:0/101685856 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85dc004c00 con 0x7f85ec104a30 2024-08-19T01:20:14.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.957+0000 7f85e27fc640 1 -- 172.21.15.17:0/101685856 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85dc003980 con 0x7f85ec104a30 2024-08-19T01:20:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.957+0000 7f85f34f0640 1 -- 172.21.15.17:0/101685856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec196060 con 0x7f85ec104a30 2024-08-19T01:20:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.958+0000 7f85f34f0640 1 -- 172.21.15.17:0/101685856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec100170 con 0x7f85ec104a30 2024-08-19T01:20:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.958+0000 7f85e27fc640 1 -- 172.21.15.17:0/101685856 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f85dc003bf0 con 0x7f85ec104a30 2024-08-19T01:20:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.959+0000 7f85e27fc640 1 --2- 172.21.15.17:0/101685856 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f85d806e170 0x7f85d8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.959+0000 7f85e27fc640 1 -- 172.21.15.17:0/101685856 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f85dc0af160 con 0x7f85ec104a30 2024-08-19T01:20:14.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.959+0000 7f85f128c640 1 --2- 172.21.15.17:0/101685856 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f85d806e170 0x7f85d8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.960+0000 7f85f128c640 1 --2- 172.21.15.17:0/101685856 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f85d806e170 0x7f85d8070630 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f85e8005d00 tx=0x7f85e800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:14.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:14.963+0000 7f85e27fc640 1 -- 172.21.15.17:0/101685856 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f85dc0784f0 con 0x7f85ec104a30 2024-08-19T01:20:15.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.174+0000 7f85f34f0640 1 -- 172.21.15.17:0/101685856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f85ec0fee90 con 0x7f85ec104a30 2024-08-19T01:20:15.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:14 smithi017 ceph-mon[99370]: from='client.35214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:15.178 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:14 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1715974124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:15.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.174+0000 7f85e27fc640 1 -- 172.21.15.17:0/101685856 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f85dc07bbb0 con 0x7f85ec104a30 2024-08-19T01:20:15.178 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:20:15.179 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:20:15.180 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:20:15.181 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:20:15.182 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:20:15.182 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:20:15.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.176+0000 7f85f34f0640 1 -- 172.21.15.17:0/101685856 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f85d806e170 msgr2=0x7f85d8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.176+0000 7f85f34f0640 1 --2- 172.21.15.17:0/101685856 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f85d806e170 0x7f85d8070630 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f85e8005d00 tx=0x7f85e800b410 comp rx=0 tx=0).stop 2024-08-19T01:20:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.176+0000 7f85f34f0640 1 -- 172.21.15.17:0/101685856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ec104a30 msgr2=0x7f85ec19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.176+0000 7f85f34f0640 1 --2- 172.21.15.17:0/101685856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ec104a30 0x7f85ec19bd40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f85dc02a9c0 tx=0x7f85dc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.176+0000 7f85f34f0640 1 -- 172.21.15.17:0/101685856 shutdown_connections 2024-08-19T01:20:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.176+0000 7f85f34f0640 1 --2- 172.21.15.17:0/101685856 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f85d806e170 0x7f85d8070630 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.176+0000 7f85f34f0640 1 --2- 172.21.15.17:0/101685856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ec104a30 0x7f85ec19bd40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.176+0000 7f85f34f0640 1 --2- 172.21.15.17:0/101685856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85ec0fea30 0x7f85ec19b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.176+0000 7f85f34f0640 1 -- 172.21.15.17:0/101685856 >> 172.21.15.17:0/101685856 conn(0x7f85ec0fa730 msgr2=0x7f85ec068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.176+0000 7f85f34f0640 1 -- 172.21.15.17:0/101685856 shutdown_connections 2024-08-19T01:20:15.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.177+0000 7f85f34f0640 1 -- 172.21.15.17:0/101685856 wait complete. 2024-08-19T01:20:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.260+0000 7fd4086b4640 1 -- 172.21.15.17:0/78553779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4001016d0 msgr2=0x7fd400109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.260+0000 7fd4086b4640 1 --2- 172.21.15.17:0/78553779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4001016d0 0x7fd400109bc0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009880 tx=0x7fd3f002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.260+0000 7fd4086b4640 1 -- 172.21.15.17:0/78553779 shutdown_connections 2024-08-19T01:20:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.260+0000 7fd4086b4640 1 --2- 172.21.15.17:0/78553779 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4001016d0 0x7fd400109bc0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.260+0000 7fd4086b4640 1 --2- 172.21.15.17:0/78553779 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd400100db0 0x7fd400101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.260+0000 7fd4086b4640 1 -- 172.21.15.17:0/78553779 >> 172.21.15.17:0/78553779 conn(0x7fd4000fa730 msgr2=0x7fd4000fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.260+0000 7fd4086b4640 1 -- 172.21.15.17:0/78553779 shutdown_connections 2024-08-19T01:20:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.260+0000 7fd4086b4640 1 -- 172.21.15.17:0/78553779 wait complete. 2024-08-19T01:20:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.261+0000 7fd4086b4640 1 Processor -- start 2024-08-19T01:20:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.261+0000 7fd4086b4640 1 -- start start 2024-08-19T01:20:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.261+0000 7fd4086b4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd400100db0 0x7fd4000fea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.261+0000 7fd4086b4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4001016d0 0x7fd4000fef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.261+0000 7fd4086b4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000ff490 con 0x7fd4001016d0 2024-08-19T01:20:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.261+0000 7fd4086b4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000ff600 con 0x7fd400100db0 2024-08-19T01:20:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.261+0000 7fd405c4f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4001016d0 0x7fd4000fef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.261+0000 7fd406450640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd400100db0 0x7fd4000fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.261+0000 7fd405c4f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4001016d0 0x7fd4000fef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40940/0 (socket says 172.21.15.17:40940) 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.261+0000 7fd405c4f640 1 -- 172.21.15.17:0/2103936531 learned_addr learned my addr 172.21.15.17:0/2103936531 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.262+0000 7fd405c4f640 1 -- 172.21.15.17:0/2103936531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd400100db0 msgr2=0x7fd4000fea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.262+0000 7fd405c4f640 1 --2- 172.21.15.17:0/2103936531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd400100db0 0x7fd4000fea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.262+0000 7fd405c4f640 1 -- 172.21.15.17:0/2103936531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0009560 con 0x7fd4001016d0 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.262+0000 7fd405c4f640 1 --2- 172.21.15.17:0/2103936531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4001016d0 0x7fd4000fef50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0006010 tx=0x7fd3f0032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.262+0000 7fd3f77fe640 1 -- 172.21.15.17:0/2103936531 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f00051f0 con 0x7fd4001016d0 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.262+0000 7fd3f77fe640 1 -- 172.21.15.17:0/2103936531 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3f0005d50 con 0x7fd4001016d0 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.262+0000 7fd4086b4640 1 -- 172.21.15.17:0/2103936531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4000ff880 con 0x7fd4001016d0 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.262+0000 7fd3f77fe640 1 -- 172.21.15.17:0/2103936531 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f00039e0 con 0x7fd4001016d0 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.262+0000 7fd4086b4640 1 -- 172.21.15.17:0/2103936531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4001a1f30 con 0x7fd4001016d0 2024-08-19T01:20:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.263+0000 7fd4086b4640 1 -- 172.21.15.17:0/2103936531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd400068c70 con 0x7fd4001016d0 2024-08-19T01:20:15.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.264+0000 7fd3f77fe640 1 -- 172.21.15.17:0/2103936531 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd3f0004c10 con 0x7fd4001016d0 2024-08-19T01:20:15.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.264+0000 7fd3f77fe640 1 --2- 172.21.15.17:0/2103936531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3ec06e180 0x7fd3ec070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:15.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.265+0000 7fd3f77fe640 1 -- 172.21.15.17:0/2103936531 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd3f00aea50 con 0x7fd4001016d0 2024-08-19T01:20:15.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.265+0000 7fd406450640 1 --2- 172.21.15.17:0/2103936531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3ec06e180 0x7fd3ec070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:15.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.265+0000 7fd406450640 1 --2- 172.21.15.17:0/2103936531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3ec06e180 0x7fd3ec070640 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc005d00 tx=0x7fd3fc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:15.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.269+0000 7fd3f77fe640 1 -- 172.21.15.17:0/2103936531 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd3f0077d40 con 0x7fd4001016d0 2024-08-19T01:20:15.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:15 smithi086 ceph-mon[71303]: from='client.35214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:15.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:15 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1715974124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:15.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.462+0000 7fd4086b4640 1 -- 172.21.15.17:0/2103936531 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4000ff880 con 0x7fd3ec06e180 2024-08-19T01:20:15.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.463+0000 7fd3f77fe640 1 -- 172.21.15.17:0/2103936531 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd4000ff880 con 0x7fd3ec06e180 2024-08-19T01:20:15.466 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:20:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:20:15.466 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:20:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:20:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:20:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:20:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:20:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:20:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:20:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:20:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:20:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:20:15.467 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:20:15.468 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:20:15.468 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:20:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.465+0000 7fd4086b4640 1 -- 172.21.15.17:0/2103936531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3ec06e180 msgr2=0x7fd3ec070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.465+0000 7fd4086b4640 1 --2- 172.21.15.17:0/2103936531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3ec06e180 0x7fd3ec070640 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc005d00 tx=0x7fd3fc00b410 comp rx=0 tx=0).stop 2024-08-19T01:20:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.466+0000 7fd4086b4640 1 -- 172.21.15.17:0/2103936531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4001016d0 msgr2=0x7fd4000fef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.466+0000 7fd4086b4640 1 --2- 172.21.15.17:0/2103936531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4001016d0 0x7fd4000fef50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0006010 tx=0x7fd3f0032bb0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.466+0000 7fd4086b4640 1 -- 172.21.15.17:0/2103936531 shutdown_connections 2024-08-19T01:20:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.466+0000 7fd4086b4640 1 --2- 172.21.15.17:0/2103936531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3ec06e180 0x7fd3ec070640 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.466+0000 7fd4086b4640 1 --2- 172.21.15.17:0/2103936531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4001016d0 0x7fd4000fef50 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.466+0000 7fd4086b4640 1 --2- 172.21.15.17:0/2103936531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd400100db0 0x7fd4000fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.466+0000 7fd4086b4640 1 -- 172.21.15.17:0/2103936531 >> 172.21.15.17:0/2103936531 conn(0x7fd4000fa730 msgr2=0x7fd400102040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:15.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.466+0000 7fd4086b4640 1 -- 172.21.15.17:0/2103936531 shutdown_connections 2024-08-19T01:20:15.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.466+0000 7fd4086b4640 1 -- 172.21.15.17:0/2103936531 wait complete. 2024-08-19T01:20:15.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.548+0000 7fe8b330b640 1 -- 172.21.15.17:0/822049025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8ac104a30 msgr2=0x7fe8ac104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:15.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.548+0000 7fe8b330b640 1 --2- 172.21.15.17:0/822049025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8ac104a30 0x7fe8ac104e10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009880 tx=0x7fe8a802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.548+0000 7fe8b330b640 1 -- 172.21.15.17:0/822049025 shutdown_connections 2024-08-19T01:20:15.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.548+0000 7fe8b330b640 1 --2- 172.21.15.17:0/822049025 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac0fea30 0x7fe8ac0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.548+0000 7fe8b330b640 1 --2- 172.21.15.17:0/822049025 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8ac104a30 0x7fe8ac104e10 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.548+0000 7fe8b330b640 1 -- 172.21.15.17:0/822049025 >> 172.21.15.17:0/822049025 conn(0x7fe8ac0fa730 msgr2=0x7fe8ac0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:15.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.548+0000 7fe8b330b640 1 -- 172.21.15.17:0/822049025 shutdown_connections 2024-08-19T01:20:15.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.548+0000 7fe8b330b640 1 -- 172.21.15.17:0/822049025 wait complete. 2024-08-19T01:20:15.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.549+0000 7fe8b330b640 1 Processor -- start 2024-08-19T01:20:15.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.549+0000 7fe8b330b640 1 -- start start 2024-08-19T01:20:15.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.549+0000 7fe8b330b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8ac0fea30 0x7fe8ac19da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:15.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.549+0000 7fe8b330b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac104a30 0x7fe8ac19df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:15.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.549+0000 7fe8b330b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac19e5a0 con 0x7fe8ac0fea30 2024-08-19T01:20:15.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.549+0000 7fe8b330b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac197b30 con 0x7fe8ac104a30 2024-08-19T01:20:15.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.549+0000 7fe8b10a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8ac0fea30 0x7fe8ac19da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:15.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.549+0000 7fe8b10a7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8ac0fea30 0x7fe8ac19da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:40958/0 (socket says 172.21.15.17:40958) 2024-08-19T01:20:15.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.549+0000 7fe8b10a7640 1 -- 172.21.15.17:0/1802135427 learned_addr learned my addr 172.21.15.17:0/1802135427 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:15.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.549+0000 7fe8b08a6640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac104a30 0x7fe8ac19df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:15.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.550+0000 7fe8b10a7640 1 -- 172.21.15.17:0/1802135427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac104a30 msgr2=0x7fe8ac19df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:15.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.550+0000 7fe8b10a7640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac104a30 0x7fe8ac19df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.550+0000 7fe8b10a7640 1 -- 172.21.15.17:0/1802135427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a8009560 con 0x7fe8ac0fea30 2024-08-19T01:20:15.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.550+0000 7fe8b08a6640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac104a30 0x7fe8ac19df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T01:20:15.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.550+0000 7fe8b10a7640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8ac0fea30 0x7fe8ac19da40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe8a802a9c0 tx=0x7fe8a80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:15.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.550+0000 7fe8a27fc640 1 -- 172.21.15.17:0/1802135427 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a80048d0 con 0x7fe8ac0fea30 2024-08-19T01:20:15.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.550+0000 7fe8b330b640 1 -- 172.21.15.17:0/1802135427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac197db0 con 0x7fe8ac0fea30 2024-08-19T01:20:15.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.550+0000 7fe8a27fc640 1 -- 172.21.15.17:0/1802135427 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe8a8031640 con 0x7fe8ac0fea30 2024-08-19T01:20:15.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.550+0000 7fe8a27fc640 1 -- 172.21.15.17:0/1802135427 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a80038d0 con 0x7fe8ac0fea30 2024-08-19T01:20:15.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.550+0000 7fe8b330b640 1 -- 172.21.15.17:0/1802135427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac1982a0 con 0x7fe8ac0fea30 2024-08-19T01:20:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.551+0000 7fe8b330b640 1 -- 172.21.15.17:0/1802135427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac100170 con 0x7fe8ac0fea30 2024-08-19T01:20:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.552+0000 7fe8a27fc640 1 -- 172.21.15.17:0/1802135427 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe8a8003b90 con 0x7fe8ac0fea30 2024-08-19T01:20:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.552+0000 7fe8a27fc640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe89806e170 0x7fe898070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.552+0000 7fe8a27fc640 1 -- 172.21.15.17:0/1802135427 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe8a80af140 con 0x7fe8ac0fea30 2024-08-19T01:20:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.552+0000 7fe8b08a6640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe89806e170 0x7fe898070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:15.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.553+0000 7fe8b08a6640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe89806e170 0x7fe898070630 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac198fa0 tx=0x7fe89c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:15.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.557+0000 7fe8a27fc640 1 -- 172.21.15.17:0/1802135427 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe8a8078430 con 0x7fe8ac0fea30 2024-08-19T01:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.802+0000 7fe8b330b640 1 -- 172.21.15.17:0/1802135427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe8ac0fee90 con 0x7fe8ac0fea30 2024-08-19T01:20:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.803+0000 7fe8a27fc640 1 -- 172.21.15.17:0/1802135427 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7fe8a807baf0 con 0x7fe8ac0fea30 2024-08-19T01:20:15.806 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:20:15.806 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:20:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:20:15.806 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:20:15.806 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:20:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:20:15.808 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:20:15.808 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:20:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:20:15.808 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:20:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:20:15.808 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:20:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.805+0000 7fe8b330b640 1 -- 172.21.15.17:0/1802135427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe89806e170 msgr2=0x7fe898070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.805+0000 7fe8b330b640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe89806e170 0x7fe898070630 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac198fa0 tx=0x7fe89c005f90 comp rx=0 tx=0).stop 2024-08-19T01:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.805+0000 7fe8b330b640 1 -- 172.21.15.17:0/1802135427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8ac0fea30 msgr2=0x7fe8ac19da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.805+0000 7fe8b330b640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8ac0fea30 0x7fe8ac19da40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe8a802a9c0 tx=0x7fe8a80055a0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.805+0000 7fe8b330b640 1 -- 172.21.15.17:0/1802135427 shutdown_connections 2024-08-19T01:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.805+0000 7fe8b330b640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe89806e170 0x7fe898070630 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.805+0000 7fe8b330b640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe8ac104a30 0x7fe8ac19df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.805+0000 7fe8b330b640 1 --2- 172.21.15.17:0/1802135427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe8ac0fea30 0x7fe8ac19da40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.805+0000 7fe8b330b640 1 -- 172.21.15.17:0/1802135427 >> 172.21.15.17:0/1802135427 conn(0x7fe8ac0fa730 msgr2=0x7fe8ac0fb840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.805+0000 7fe8b330b640 1 -- 172.21.15.17:0/1802135427 shutdown_connections 2024-08-19T01:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:15.805+0000 7fe8b330b640 1 -- 172.21.15.17:0/1802135427 wait complete. 2024-08-19T01:20:16.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:16 smithi017 ceph-mon[99370]: pgmap v645: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:16.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:16 smithi017 ceph-mon[99370]: from='client.35218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:16.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:16 smithi017 ceph-mon[99370]: from='client.35222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:16.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:16 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/101685856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:20:16.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:16 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1802135427' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:20:16.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:16 smithi086 ceph-mon[71303]: pgmap v645: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:16.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:16 smithi086 ceph-mon[71303]: from='client.35218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:16.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:16 smithi086 ceph-mon[71303]: from='client.35222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:16.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:16 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/101685856' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:20:16.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:16 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1802135427' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:20:17.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:17 smithi017 ceph-mon[99370]: from='client.35234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:17.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:17 smithi086 ceph-mon[71303]: from='client.35234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:18.409 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:18 smithi017 ceph-mon[99370]: pgmap v646: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:18.409 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:20:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:18 smithi086 ceph-mon[71303]: pgmap v646: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:20:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:20 smithi017 ceph-mon[99370]: pgmap v647: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:20.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:20 smithi086 ceph-mon[71303]: pgmap v647: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:22.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:22 smithi017 ceph-mon[99370]: pgmap v648: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:22.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:22 smithi086 ceph-mon[71303]: pgmap v648: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:24.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:24 smithi017 ceph-mon[99370]: pgmap v649: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:24.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:24 smithi086 ceph-mon[71303]: pgmap v649: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:26 smithi086 ceph-mon[71303]: pgmap v650: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:26.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:26 smithi017 ceph-mon[99370]: pgmap v650: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:28.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:28 smithi017 ceph-mon[99370]: pgmap v651: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:28.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:28 smithi086 ceph-mon[71303]: pgmap v651: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:30.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:30 smithi086 ceph-mon[71303]: pgmap v652: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:30.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:30 smithi017 ceph-mon[99370]: pgmap v652: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:32.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:32 smithi017 ceph-mon[99370]: pgmap v653: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:32.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:32 smithi086 ceph-mon[71303]: pgmap v653: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:20:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:20:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:34 smithi017 ceph-mon[99370]: pgmap v654: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:34 smithi086 ceph-mon[71303]: pgmap v654: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:36.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:36 smithi017 ceph-mon[99370]: pgmap v655: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:36.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:36 smithi086 ceph-mon[71303]: pgmap v655: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:38.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:38 smithi017 ceph-mon[99370]: pgmap v656: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:38 smithi086 ceph-mon[71303]: pgmap v656: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:40.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:40 smithi017 ceph-mon[99370]: pgmap v657: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:40 smithi086 ceph-mon[71303]: pgmap v657: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:42 smithi017 ceph-mon[99370]: pgmap v658: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:42 smithi086 ceph-mon[71303]: pgmap v658: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:44.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:44 smithi017 ceph-mon[99370]: pgmap v659: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:44.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:44 smithi086 ceph-mon[71303]: pgmap v659: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:45.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:45 smithi017 ceph-mon[99370]: pgmap v660: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:45.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:45 smithi086 ceph-mon[71303]: pgmap v660: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:45.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.902+0000 7f0e16c74640 1 -- 172.21.15.17:0/3868089689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e10100d50 msgr2=0x7f0e10101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:45.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.902+0000 7f0e16c74640 1 --2- 172.21.15.17:0/3868089689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e10100d50 0x7f0e10101130 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009880 tx=0x7f0e0402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:45.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.902+0000 7f0e16c74640 1 -- 172.21.15.17:0/3868089689 shutdown_connections 2024-08-19T01:20:45.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.902+0000 7f0e16c74640 1 --2- 172.21.15.17:0/3868089689 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e10101670 0x7f0e10109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:45.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.902+0000 7f0e16c74640 1 --2- 172.21.15.17:0/3868089689 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e10100d50 0x7f0e10101130 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:45.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.902+0000 7f0e16c74640 1 -- 172.21.15.17:0/3868089689 >> 172.21.15.17:0/3868089689 conn(0x7f0e100fa730 msgr2=0x7f0e100fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:45.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.903+0000 7f0e16c74640 1 -- 172.21.15.17:0/3868089689 shutdown_connections 2024-08-19T01:20:45.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.903+0000 7f0e16c74640 1 -- 172.21.15.17:0/3868089689 wait complete. 2024-08-19T01:20:45.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.903+0000 7f0e16c74640 1 Processor -- start 2024-08-19T01:20:45.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.903+0000 7f0e16c74640 1 -- start start 2024-08-19T01:20:45.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.903+0000 7f0e16c74640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e10100d50 0x7f0e100fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:45.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.903+0000 7f0e16c74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e10101670 0x7f0e100feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:45.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.903+0000 7f0e16c74640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100ff430 con 0x7f0e10101670 2024-08-19T01:20:45.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.903+0000 7f0e16c74640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e100ff5a0 con 0x7f0e10100d50 2024-08-19T01:20:45.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e10101670 0x7f0e100feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:45.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e0ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e10101670 0x7f0e100feef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33504/0 (socket says 172.21.15.17:33504) 2024-08-19T01:20:45.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e0ffff640 1 -- 172.21.15.17:0/1436380969 learned_addr learned my addr 172.21.15.17:0/1436380969 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:45.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e14a10640 1 --2- 172.21.15.17:0/1436380969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e10100d50 0x7f0e100fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:45.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e0ffff640 1 -- 172.21.15.17:0/1436380969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e10100d50 msgr2=0x7f0e100fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:45.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e0ffff640 1 --2- 172.21.15.17:0/1436380969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e10100d50 0x7f0e100fe9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:45.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e0ffff640 1 -- 172.21.15.17:0/1436380969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04009560 con 0x7f0e10101670 2024-08-19T01:20:45.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e0ffff640 1 --2- 172.21.15.17:0/1436380969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e10101670 0x7f0e100feef0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00d6f0 tx=0x7f0dfc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:45.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e0dffb640 1 -- 172.21.15.17:0/1436380969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dfc009a30 con 0x7f0e10101670 2024-08-19T01:20:45.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e0dffb640 1 -- 172.21.15.17:0/1436380969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0dfc0054e0 con 0x7f0e10101670 2024-08-19T01:20:45.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e16c74640 1 -- 172.21.15.17:0/1436380969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e101a1c50 con 0x7f0e10101670 2024-08-19T01:20:45.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.904+0000 7f0e0dffb640 1 -- 172.21.15.17:0/1436380969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dfc010460 con 0x7f0e10101670 2024-08-19T01:20:45.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.905+0000 7f0e16c74640 1 -- 172.21.15.17:0/1436380969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e101a1fb0 con 0x7f0e10101670 2024-08-19T01:20:45.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.906+0000 7f0e16c74640 1 -- 172.21.15.17:0/1436380969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e10068cd0 con 0x7f0e10101670 2024-08-19T01:20:45.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.906+0000 7f0e0dffb640 1 -- 172.21.15.17:0/1436380969 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0dfc009b90 con 0x7f0e10101670 2024-08-19T01:20:45.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.906+0000 7f0e0dffb640 1 --2- 172.21.15.17:0/1436380969 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0e0006e170 0x7f0e00070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:45.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.907+0000 7f0e0dffb640 1 -- 172.21.15.17:0/1436380969 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0dfc08dc50 con 0x7f0e10101670 2024-08-19T01:20:45.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.907+0000 7f0e14a10640 1 --2- 172.21.15.17:0/1436380969 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0e0006e170 0x7f0e00070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:45.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.907+0000 7f0e14a10640 1 --2- 172.21.15.17:0/1436380969 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0e0006e170 0x7f0e00070630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0e04000c00 tx=0x7f0e04005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:45.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:45.911+0000 7f0e0dffb640 1 -- 172.21.15.17:0/1436380969 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0dfc056fb0 con 0x7f0e10101670 2024-08-19T01:20:46.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.105+0000 7f0e16c74640 1 -- 172.21.15.17:0/1436380969 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e10104400 con 0x7f0e0006e170 2024-08-19T01:20:46.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.106+0000 7f0e0dffb640 1 -- 172.21.15.17:0/1436380969 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f0e10104400 con 0x7f0e0006e170 2024-08-19T01:20:46.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.108+0000 7f0e16c74640 1 -- 172.21.15.17:0/1436380969 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0e0006e170 msgr2=0x7f0e00070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.108+0000 7f0e16c74640 1 --2- 172.21.15.17:0/1436380969 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0e0006e170 0x7f0e00070630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0e04000c00 tx=0x7f0e04005a20 comp rx=0 tx=0).stop 2024-08-19T01:20:46.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.108+0000 7f0e16c74640 1 -- 172.21.15.17:0/1436380969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e10101670 msgr2=0x7f0e100feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.108+0000 7f0e16c74640 1 --2- 172.21.15.17:0/1436380969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e10101670 0x7f0e100feef0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00d6f0 tx=0x7f0dfc00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.108+0000 7f0e16c74640 1 -- 172.21.15.17:0/1436380969 shutdown_connections 2024-08-19T01:20:46.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.108+0000 7f0e16c74640 1 --2- 172.21.15.17:0/1436380969 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0e0006e170 0x7f0e00070630 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.108+0000 7f0e16c74640 1 --2- 172.21.15.17:0/1436380969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0e10101670 0x7f0e100feef0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.108+0000 7f0e16c74640 1 --2- 172.21.15.17:0/1436380969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0e10100d50 0x7f0e100fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.108+0000 7f0e16c74640 1 -- 172.21.15.17:0/1436380969 >> 172.21.15.17:0/1436380969 conn(0x7f0e100fa730 msgr2=0x7f0e10101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:46.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.108+0000 7f0e16c74640 1 -- 172.21.15.17:0/1436380969 shutdown_connections 2024-08-19T01:20:46.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.108+0000 7f0e16c74640 1 -- 172.21.15.17:0/1436380969 wait complete. 2024-08-19T01:20:46.119 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:20:46.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.191+0000 7f40cb61f640 1 -- 172.21.15.17:0/4222778389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c4105bf0 msgr2=0x7f40c4105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.191+0000 7f40cb61f640 1 --2- 172.21.15.17:0/4222778389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c4105bf0 0x7f40c4105fd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009c20 tx=0x7f40b402a970 comp rx=0 tx=0).stop 2024-08-19T01:20:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.191+0000 7f40cb61f640 1 -- 172.21.15.17:0/4222778389 shutdown_connections 2024-08-19T01:20:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.191+0000 7f40cb61f640 1 --2- 172.21.15.17:0/4222778389 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40c40ffb40 0x7f40c40fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.191+0000 7f40cb61f640 1 --2- 172.21.15.17:0/4222778389 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c4105bf0 0x7f40c4105fd0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.191+0000 7f40cb61f640 1 -- 172.21.15.17:0/4222778389 >> 172.21.15.17:0/4222778389 conn(0x7f40c40fb860 msgr2=0x7f40c40fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.191+0000 7f40cb61f640 1 -- 172.21.15.17:0/4222778389 shutdown_connections 2024-08-19T01:20:46.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.191+0000 7f40cb61f640 1 -- 172.21.15.17:0/4222778389 wait complete. 2024-08-19T01:20:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.192+0000 7f40cb61f640 1 Processor -- start 2024-08-19T01:20:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.192+0000 7f40cb61f640 1 -- start start 2024-08-19T01:20:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.192+0000 7f40cb61f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40c40ffb40 0x7f40c419da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.192+0000 7f40cb61f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c4105bf0 0x7f40c419df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:46.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.192+0000 7f40cb61f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4197aa0 con 0x7f40c4105bf0 2024-08-19T01:20:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.192+0000 7f40cb61f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4197be0 con 0x7f40c40ffb40 2024-08-19T01:20:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.192+0000 7f40c8bba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c4105bf0 0x7f40c419df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.192+0000 7f40c8bba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c4105bf0 0x7f40c419df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33522/0 (socket says 172.21.15.17:33522) 2024-08-19T01:20:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.192+0000 7f40c8bba640 1 -- 172.21.15.17:0/2482806934 learned_addr learned my addr 172.21.15.17:0/2482806934 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.193+0000 7f40c93bb640 1 --2- 172.21.15.17:0/2482806934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40c40ffb40 0x7f40c419da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:46.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.193+0000 7f40c8bba640 1 -- 172.21.15.17:0/2482806934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40c40ffb40 msgr2=0x7f40c419da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.193+0000 7f40c8bba640 1 --2- 172.21.15.17:0/2482806934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40c40ffb40 0x7f40c419da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.193+0000 7f40c8bba640 1 -- 172.21.15.17:0/2482806934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b4009900 con 0x7f40c4105bf0 2024-08-19T01:20:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.193+0000 7f40c8bba640 1 --2- 172.21.15.17:0/2482806934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c4105bf0 0x7f40c419df80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f40b800c8f0 tx=0x7f40b800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.193+0000 7f40c27fc640 1 -- 172.21.15.17:0/2482806934 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40b8007b80 con 0x7f40c4105bf0 2024-08-19T01:20:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.193+0000 7f40c27fc640 1 -- 172.21.15.17:0/2482806934 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40b80054e0 con 0x7f40c4105bf0 2024-08-19T01:20:46.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.193+0000 7f40cb61f640 1 -- 172.21.15.17:0/2482806934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c4197ec0 con 0x7f40c4105bf0 2024-08-19T01:20:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.193+0000 7f40c27fc640 1 -- 172.21.15.17:0/2482806934 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40b800f450 con 0x7f40c4105bf0 2024-08-19T01:20:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.193+0000 7f40cb61f640 1 -- 172.21.15.17:0/2482806934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c4198490 con 0x7f40c4105bf0 2024-08-19T01:20:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.194+0000 7f40cb61f640 1 -- 172.21.15.17:0/2482806934 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c41011f0 con 0x7f40c4105bf0 2024-08-19T01:20:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.195+0000 7f40c27fc640 1 -- 172.21.15.17:0/2482806934 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f40b8004f60 con 0x7f40c4105bf0 2024-08-19T01:20:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.195+0000 7f40c27fc640 1 --2- 172.21.15.17:0/2482806934 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f40ac06e170 0x7f40ac070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.195+0000 7f40c93bb640 1 --2- 172.21.15.17:0/2482806934 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f40ac06e170 0x7f40ac070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:46.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.195+0000 7f40c27fc640 1 -- 172.21.15.17:0/2482806934 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f40b808dff0 con 0x7f40c4105bf0 2024-08-19T01:20:46.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.196+0000 7f40c93bb640 1 --2- 172.21.15.17:0/2482806934 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f40ac06e170 0x7f40ac070630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f40b40098d0 tx=0x7f40b4009820 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:46.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.200+0000 7f40c27fc640 1 -- 172.21.15.17:0/2482806934 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f40b80572d0 con 0x7f40c4105bf0 2024-08-19T01:20:46.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.392+0000 7f40cb61f640 1 -- 172.21.15.17:0/2482806934 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f40c4198710 con 0x7f40ac06e170 2024-08-19T01:20:46.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.393+0000 7f40c27fc640 1 -- 172.21.15.17:0/2482806934 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f40c4198710 con 0x7f40ac06e170 2024-08-19T01:20:46.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.395+0000 7f40cb61f640 1 -- 172.21.15.17:0/2482806934 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f40ac06e170 msgr2=0x7f40ac070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.395+0000 7f40cb61f640 1 --2- 172.21.15.17:0/2482806934 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f40ac06e170 0x7f40ac070630 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f40b40098d0 tx=0x7f40b4009820 comp rx=0 tx=0).stop 2024-08-19T01:20:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.395+0000 7f40cb61f640 1 -- 172.21.15.17:0/2482806934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c4105bf0 msgr2=0x7f40c419df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.395+0000 7f40cb61f640 1 --2- 172.21.15.17:0/2482806934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c4105bf0 0x7f40c419df80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f40b800c8f0 tx=0x7f40b800cdb0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.395+0000 7f40cb61f640 1 -- 172.21.15.17:0/2482806934 shutdown_connections 2024-08-19T01:20:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.395+0000 7f40cb61f640 1 --2- 172.21.15.17:0/2482806934 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f40ac06e170 0x7f40ac070630 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.395+0000 7f40cb61f640 1 --2- 172.21.15.17:0/2482806934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f40c4105bf0 0x7f40c419df80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.395+0000 7f40cb61f640 1 --2- 172.21.15.17:0/2482806934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f40c40ffb40 0x7f40c419da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.395+0000 7f40cb61f640 1 -- 172.21.15.17:0/2482806934 >> 172.21.15.17:0/2482806934 conn(0x7f40c40fb860 msgr2=0x7f40c4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.395+0000 7f40cb61f640 1 -- 172.21.15.17:0/2482806934 shutdown_connections 2024-08-19T01:20:46.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.395+0000 7f40cb61f640 1 -- 172.21.15.17:0/2482806934 wait complete. 2024-08-19T01:20:46.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.477+0000 7f18d3d80640 1 -- 172.21.15.17:0/4279990570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18cc100750 msgr2=0x7f18cc1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.477+0000 7f18d3d80640 1 --2- 172.21.15.17:0/4279990570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18cc100750 0x7f18cc1047a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009880 tx=0x7f18c002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.477+0000 7f18d3d80640 1 -- 172.21.15.17:0/4279990570 shutdown_connections 2024-08-19T01:20:46.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.477+0000 7f18d3d80640 1 --2- 172.21.15.17:0/4279990570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18cc100750 0x7f18cc1047a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.477+0000 7f18d3d80640 1 --2- 172.21.15.17:0/4279990570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18cc0ffda0 0x7f18cc100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.477+0000 7f18d3d80640 1 -- 172.21.15.17:0/4279990570 >> 172.21.15.17:0/4279990570 conn(0x7f18cc0fb840 msgr2=0x7f18cc0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:46.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.477+0000 7f18d3d80640 1 -- 172.21.15.17:0/4279990570 shutdown_connections 2024-08-19T01:20:46.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.477+0000 7f18d3d80640 1 -- 172.21.15.17:0/4279990570 wait complete. 2024-08-19T01:20:46.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d3d80640 1 Processor -- start 2024-08-19T01:20:46.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d3d80640 1 -- start start 2024-08-19T01:20:46.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d3d80640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18cc0ffda0 0x7f18cc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:46.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d3d80640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18cc100750 0x7f18cc072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:46.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d3d80640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc073230 con 0x7f18cc0ffda0 2024-08-19T01:20:46.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d3d80640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0733a0 con 0x7f18cc100750 2024-08-19T01:20:46.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d1b1c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18cc0ffda0 0x7f18cc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:46.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d1b1c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18cc0ffda0 0x7f18cc0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33538/0 (socket says 172.21.15.17:33538) 2024-08-19T01:20:46.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d1b1c640 1 -- 172.21.15.17:0/4009132013 learned_addr learned my addr 172.21.15.17:0/4009132013 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d131b640 1 --2- 172.21.15.17:0/4009132013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18cc100750 0x7f18cc072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d1b1c640 1 -- 172.21.15.17:0/4009132013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18cc100750 msgr2=0x7f18cc072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d1b1c640 1 --2- 172.21.15.17:0/4009132013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18cc100750 0x7f18cc072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.478+0000 7f18d1b1c640 1 -- 172.21.15.17:0/4009132013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c0009560 con 0x7f18cc0ffda0 2024-08-19T01:20:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.479+0000 7f18d1b1c640 1 --2- 172.21.15.17:0/4009132013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18cc0ffda0 0x7f18cc0727b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f18c800d8d0 tx=0x7f18c800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.479+0000 7f18beffd640 1 -- 172.21.15.17:0/4009132013 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18c8009c00 con 0x7f18cc0ffda0 2024-08-19T01:20:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.479+0000 7f18d3d80640 1 -- 172.21.15.17:0/4009132013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc1a1c90 con 0x7f18cc0ffda0 2024-08-19T01:20:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.479+0000 7f18beffd640 1 -- 172.21.15.17:0/4009132013 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f18c8009d60 con 0x7f18cc0ffda0 2024-08-19T01:20:46.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.479+0000 7f18d3d80640 1 -- 172.21.15.17:0/4009132013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc1a1ff0 con 0x7f18cc0ffda0 2024-08-19T01:20:46.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.479+0000 7f18beffd640 1 -- 172.21.15.17:0/4009132013 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18c80049d0 con 0x7f18cc0ffda0 2024-08-19T01:20:46.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.480+0000 7f18d3d80640 1 -- 172.21.15.17:0/4009132013 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc101280 con 0x7f18cc0ffda0 2024-08-19T01:20:46.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.480+0000 7f18beffd640 1 -- 172.21.15.17:0/4009132013 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f18c8004c40 con 0x7f18cc0ffda0 2024-08-19T01:20:46.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.481+0000 7f18beffd640 1 --2- 172.21.15.17:0/4009132013 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f18b806e170 0x7f18b8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:46.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.481+0000 7f18beffd640 1 -- 172.21.15.17:0/4009132013 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f18c808de50 con 0x7f18cc0ffda0 2024-08-19T01:20:46.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.481+0000 7f18d131b640 1 --2- 172.21.15.17:0/4009132013 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f18b806e170 0x7f18b8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:46.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.482+0000 7f18d131b640 1 --2- 172.21.15.17:0/4009132013 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f18b806e170 0x7f18b8070630 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f18c0000c00 tx=0x7f18c0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:46.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.486+0000 7f18beffd640 1 -- 172.21.15.17:0/4009132013 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f18c80571b0 con 0x7f18cc0ffda0 2024-08-19T01:20:46.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.670+0000 7f18d3d80640 1 -- 172.21.15.17:0/4009132013 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f18cc073d50 con 0x7f18b806e170 2024-08-19T01:20:46.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.679+0000 7f18beffd640 1 -- 172.21.15.17:0/4009132013 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f18cc073d50 con 0x7f18b806e170 2024-08-19T01:20:46.681 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:20:46.681 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (22m) 33s ago 32m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:20:46.681 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (32m) 33s ago 32m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:20:46.681 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (31m) 35s ago 31m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:20:46.681 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (19m) 33s ago 32m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:20:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (19m) 35s ago 31m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:20:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (21m) 33s ago 32m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:20:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (16m) 33s ago 27m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:20:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (16m) 33s ago 27m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:20:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (39s) 35s ago 27m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:20:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (15m) 35s ago 27m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:20:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (24m) 33s ago 34m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:20:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (22m) 35s ago 31m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:20:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (20m) 33s ago 34m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:20:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (20m) 35s ago 31m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:20:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (22m) 33s ago 32m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:20:46.683 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (22m) 35s ago 31m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:20:46.683 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (19m) 33s ago 30m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:20:46.683 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (18m) 33s ago 30m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:20:46.683 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (18m) 33s ago 30m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:20:46.683 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (17m) 35s ago 29m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:20:46.683 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (17m) 35s ago 29m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:20:46.683 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (16m) 35s ago 28m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:20:46.683 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (22m) 33s ago 32m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:20:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.681+0000 7f18d3d80640 1 -- 172.21.15.17:0/4009132013 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f18b806e170 msgr2=0x7f18b8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.681+0000 7f18d3d80640 1 --2- 172.21.15.17:0/4009132013 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f18b806e170 0x7f18b8070630 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f18c0000c00 tx=0x7f18c0005a20 comp rx=0 tx=0).stop 2024-08-19T01:20:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.681+0000 7f18d3d80640 1 -- 172.21.15.17:0/4009132013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18cc0ffda0 msgr2=0x7f18cc0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.681+0000 7f18d3d80640 1 --2- 172.21.15.17:0/4009132013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18cc0ffda0 0x7f18cc0727b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f18c800d8d0 tx=0x7f18c800dd90 comp rx=0 tx=0).stop 2024-08-19T01:20:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.681+0000 7f18d3d80640 1 -- 172.21.15.17:0/4009132013 shutdown_connections 2024-08-19T01:20:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.681+0000 7f18d3d80640 1 --2- 172.21.15.17:0/4009132013 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f18b806e170 0x7f18b8070630 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.681+0000 7f18d3d80640 1 --2- 172.21.15.17:0/4009132013 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f18cc100750 0x7f18cc072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.681+0000 7f18d3d80640 1 --2- 172.21.15.17:0/4009132013 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18cc0ffda0 0x7f18cc0727b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.681+0000 7f18d3d80640 1 -- 172.21.15.17:0/4009132013 >> 172.21.15.17:0/4009132013 conn(0x7f18cc0fb840 msgr2=0x7f18cc0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.682+0000 7f18d3d80640 1 -- 172.21.15.17:0/4009132013 shutdown_connections 2024-08-19T01:20:46.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.682+0000 7f18d3d80640 1 -- 172.21.15.17:0/4009132013 wait complete. 2024-08-19T01:20:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.763+0000 7f329f6fc640 1 -- 172.21.15.17:0/426878029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298104a30 msgr2=0x7f3298104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.763+0000 7f329f6fc640 1 --2- 172.21.15.17:0/426878029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298104a30 0x7f3298104e10 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3288009880 tx=0x7f328802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.763+0000 7f329f6fc640 1 -- 172.21.15.17:0/426878029 shutdown_connections 2024-08-19T01:20:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.763+0000 7f329f6fc640 1 --2- 172.21.15.17:0/426878029 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32980fea30 0x7f32980fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.763+0000 7f329f6fc640 1 --2- 172.21.15.17:0/426878029 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298104a30 0x7f3298104e10 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.763+0000 7f329f6fc640 1 -- 172.21.15.17:0/426878029 >> 172.21.15.17:0/426878029 conn(0x7f32980fa730 msgr2=0x7f32980fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.763+0000 7f329f6fc640 1 -- 172.21.15.17:0/426878029 shutdown_connections 2024-08-19T01:20:46.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.763+0000 7f329f6fc640 1 -- 172.21.15.17:0/426878029 wait complete. 2024-08-19T01:20:46.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329f6fc640 1 Processor -- start 2024-08-19T01:20:46.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329f6fc640 1 -- start start 2024-08-19T01:20:46.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329f6fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32980fea30 0x7f329819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:46.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329f6fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298104a30 0x7f329819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:46.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329f6fc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329819c3c0 con 0x7f3298104a30 2024-08-19T01:20:46.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329f6fc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3298195890 con 0x7f32980fea30 2024-08-19T01:20:46.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329cc97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298104a30 0x7f329819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329cc97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298104a30 0x7f329819bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54520/0 (socket says 172.21.15.17:54520) 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329cc97640 1 -- 172.21.15.17:0/706236926 learned_addr learned my addr 172.21.15.17:0/706236926 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329d498640 1 --2- 172.21.15.17:0/706236926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32980fea30 0x7f329819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329cc97640 1 -- 172.21.15.17:0/706236926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32980fea30 msgr2=0x7f329819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329cc97640 1 --2- 172.21.15.17:0/706236926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32980fea30 0x7f329819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.764+0000 7f329cc97640 1 -- 172.21.15.17:0/706236926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288009560 con 0x7f3298104a30 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.765+0000 7f329cc97640 1 --2- 172.21.15.17:0/706236926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298104a30 0x7f329819bd70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f328c00c8a0 tx=0x7f328c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.765+0000 7f32967fc640 1 -- 172.21.15.17:0/706236926 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f328c007b80 con 0x7f3298104a30 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.765+0000 7f32967fc640 1 -- 172.21.15.17:0/706236926 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f328c007ce0 con 0x7f3298104a30 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.765+0000 7f32967fc640 1 -- 172.21.15.17:0/706236926 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f328c018810 con 0x7f3298104a30 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.765+0000 7f329f6fc640 1 -- 172.21.15.17:0/706236926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3298195b70 con 0x7f3298104a30 2024-08-19T01:20:46.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.765+0000 7f329f6fc640 1 -- 172.21.15.17:0/706236926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3298196070 con 0x7f3298104a30 2024-08-19T01:20:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.766+0000 7f329f6fc640 1 -- 172.21.15.17:0/706236926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3298100170 con 0x7f3298104a30 2024-08-19T01:20:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.767+0000 7f32967fc640 1 -- 172.21.15.17:0/706236926 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f328c018a80 con 0x7f3298104a30 2024-08-19T01:20:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.767+0000 7f32967fc640 1 --2- 172.21.15.17:0/706236926 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f328006e170 0x7f3280070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.767+0000 7f32967fc640 1 -- 172.21.15.17:0/706236926 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f328c08e390 con 0x7f3298104a30 2024-08-19T01:20:46.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.767+0000 7f329d498640 1 --2- 172.21.15.17:0/706236926 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f328006e170 0x7f3280070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:46.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.768+0000 7f329d498640 1 --2- 172.21.15.17:0/706236926 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f328006e170 0x7f3280070630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3288009230 tx=0x7f32880058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:46.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:46.772+0000 7f32967fc640 1 -- 172.21.15.17:0/706236926 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f328c0575d0 con 0x7f3298104a30 2024-08-19T01:20:47.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.016+0000 7f329f6fc640 1 -- 172.21.15.17:0/706236926 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f329810bd30 con 0x7f3298104a30 2024-08-19T01:20:47.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.016+0000 7f32967fc640 1 -- 172.21.15.17:0/706236926 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f328c05ac90 con 0x7f3298104a30 2024-08-19T01:20:47.018 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:20:47.019 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:20:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:20:47.020 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:20:47.020 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:20:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.019+0000 7f329f6fc640 1 -- 172.21.15.17:0/706236926 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f328006e170 msgr2=0x7f3280070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.019+0000 7f329f6fc640 1 --2- 172.21.15.17:0/706236926 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f328006e170 0x7f3280070630 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3288009230 tx=0x7f32880058d0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.019+0000 7f329f6fc640 1 -- 172.21.15.17:0/706236926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298104a30 msgr2=0x7f329819bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.019+0000 7f329f6fc640 1 --2- 172.21.15.17:0/706236926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298104a30 0x7f329819bd70 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f328c00c8a0 tx=0x7f328c00cd60 comp rx=0 tx=0).stop 2024-08-19T01:20:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.019+0000 7f329f6fc640 1 -- 172.21.15.17:0/706236926 shutdown_connections 2024-08-19T01:20:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.019+0000 7f329f6fc640 1 --2- 172.21.15.17:0/706236926 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f328006e170 0x7f3280070630 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.019+0000 7f329f6fc640 1 --2- 172.21.15.17:0/706236926 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298104a30 0x7f329819bd70 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.019+0000 7f329f6fc640 1 --2- 172.21.15.17:0/706236926 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32980fea30 0x7f329819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.019+0000 7f329f6fc640 1 -- 172.21.15.17:0/706236926 >> 172.21.15.17:0/706236926 conn(0x7f32980fa730 msgr2=0x7f3298068770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.019+0000 7f329f6fc640 1 -- 172.21.15.17:0/706236926 shutdown_connections 2024-08-19T01:20:47.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.019+0000 7f329f6fc640 1 -- 172.21.15.17:0/706236926 wait complete. 2024-08-19T01:20:47.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.101+0000 7fb93bbd9640 1 -- 172.21.15.17:0/3104998349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb934100a60 msgr2=0x7fb9340fdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.101+0000 7fb93bbd9640 1 --2- 172.21.15.17:0/3104998349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb934100a60 0x7fb9340fdf70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb930009880 tx=0x7fb93002a540 comp rx=0 tx=0).stop 2024-08-19T01:20:47.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.101+0000 7fb93bbd9640 1 -- 172.21.15.17:0/3104998349 shutdown_connections 2024-08-19T01:20:47.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.101+0000 7fb93bbd9640 1 --2- 172.21.15.17:0/3104998349 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb934100e40 0x7fb9340fe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.101+0000 7fb93bbd9640 1 --2- 172.21.15.17:0/3104998349 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb934100a60 0x7fb9340fdf70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.101+0000 7fb93bbd9640 1 -- 172.21.15.17:0/3104998349 >> 172.21.15.17:0/3104998349 conn(0x7fb9340f9ec0 msgr2=0x7fb9340fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.101+0000 7fb93bbd9640 1 -- 172.21.15.17:0/3104998349 shutdown_connections 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.101+0000 7fb93bbd9640 1 -- 172.21.15.17:0/3104998349 wait complete. 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.102+0000 7fb93bbd9640 1 Processor -- start 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.102+0000 7fb93bbd9640 1 -- start start 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.102+0000 7fb93bbd9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb934100a60 0x7fb93419d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.102+0000 7fb93bbd9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb934100e40 0x7fb93419de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.102+0000 7fb93bbd9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93419e420 con 0x7fb934100e40 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.102+0000 7fb93bbd9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb934197a40 con 0x7fb934100a60 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.102+0000 7fb939174640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb934100e40 0x7fb93419de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.102+0000 7fb939174640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb934100e40 0x7fb93419de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54536/0 (socket says 172.21.15.17:54536) 2024-08-19T01:20:47.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.102+0000 7fb939975640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb934100a60 0x7fb93419d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:47.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.102+0000 7fb939174640 1 -- 172.21.15.17:0/1239337294 learned_addr learned my addr 172.21.15.17:0/1239337294 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:47.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.103+0000 7fb939174640 1 -- 172.21.15.17:0/1239337294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb934100a60 msgr2=0x7fb93419d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.103+0000 7fb939174640 1 --2- 172.21.15.17:0/1239337294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb934100a60 0x7fb93419d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.103+0000 7fb939174640 1 -- 172.21.15.17:0/1239337294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb930009560 con 0x7fb934100e40 2024-08-19T01:20:47.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.103+0000 7fb939975640 1 --2- 172.21.15.17:0/1239337294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb934100a60 0x7fb93419d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T01:20:47.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.103+0000 7fb939174640 1 --2- 172.21.15.17:0/1239337294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb934100e40 0x7fb93419de90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb92400c8f0 tx=0x7fb92400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:47.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.104+0000 7fb92affd640 1 -- 172.21.15.17:0/1239337294 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb924004410 con 0x7fb934100e40 2024-08-19T01:20:47.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.105+0000 7fb92affd640 1 -- 172.21.15.17:0/1239337294 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb924007c60 con 0x7fb934100e40 2024-08-19T01:20:47.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.105+0000 7fb92affd640 1 -- 172.21.15.17:0/1239337294 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb92400f450 con 0x7fb934100e40 2024-08-19T01:20:47.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.105+0000 7fb93bbd9640 1 -- 172.21.15.17:0/1239337294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb934197d20 con 0x7fb934100e40 2024-08-19T01:20:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.105+0000 7fb93bbd9640 1 -- 172.21.15.17:0/1239337294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9341982f0 con 0x7fb934100e40 2024-08-19T01:20:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.106+0000 7fb93bbd9640 1 -- 172.21.15.17:0/1239337294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9340ff190 con 0x7fb934100e40 2024-08-19T01:20:47.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.106+0000 7fb92affd640 1 -- 172.21.15.17:0/1239337294 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb9240077a0 con 0x7fb934100e40 2024-08-19T01:20:47.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.107+0000 7fb92affd640 1 --2- 172.21.15.17:0/1239337294 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb92006e170 0x7fb920070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:47.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.107+0000 7fb92affd640 1 -- 172.21.15.17:0/1239337294 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb92408dfc0 con 0x7fb934100e40 2024-08-19T01:20:47.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.107+0000 7fb939975640 1 --2- 172.21.15.17:0/1239337294 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb92006e170 0x7fb920070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:47.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.107+0000 7fb939975640 1 --2- 172.21.15.17:0/1239337294 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb92006e170 0x7fb920070630 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb930009230 tx=0x7fb9300058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:47.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.111+0000 7fb92affd640 1 -- 172.21.15.17:0/1239337294 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb9240573d0 con 0x7fb934100e40 2024-08-19T01:20:47.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.324+0000 7fb93bbd9640 1 -- 172.21.15.17:0/1239337294 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb9340fdf70 con 0x7fb934100e40 2024-08-19T01:20:47.326 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:47 smithi017 ceph-mon[99370]: pgmap v661: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:47.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:47 smithi017 ceph-mon[99370]: from='client.35242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:47.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:47 smithi017 ceph-mon[99370]: from='client.35246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:47.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:47 smithi017 ceph-mon[99370]: from='client.35250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:47.327 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:47 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/706236926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:47.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.325+0000 7fb92affd640 1 -- 172.21.15.17:0/1239337294 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7fb924014790 con 0x7fb934100e40 2024-08-19T01:20:47.327 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:20:47.327 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:20:47.327 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:20:47.328 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:20:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:20:47.330 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:20:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:20:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.327+0000 7fb93bbd9640 1 -- 172.21.15.17:0/1239337294 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb92006e170 msgr2=0x7fb920070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.327+0000 7fb93bbd9640 1 --2- 172.21.15.17:0/1239337294 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb92006e170 0x7fb920070630 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb930009230 tx=0x7fb9300058d0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.327+0000 7fb93bbd9640 1 -- 172.21.15.17:0/1239337294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb934100e40 msgr2=0x7fb93419de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.327+0000 7fb93bbd9640 1 --2- 172.21.15.17:0/1239337294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb934100e40 0x7fb93419de90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb92400c8f0 tx=0x7fb92400cdb0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.327+0000 7fb93bbd9640 1 -- 172.21.15.17:0/1239337294 shutdown_connections 2024-08-19T01:20:47.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.327+0000 7fb93bbd9640 1 --2- 172.21.15.17:0/1239337294 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb92006e170 0x7fb920070630 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.327+0000 7fb93bbd9640 1 --2- 172.21.15.17:0/1239337294 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb934100e40 0x7fb93419de90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.327+0000 7fb93bbd9640 1 --2- 172.21.15.17:0/1239337294 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb934100a60 0x7fb93419d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.327+0000 7fb93bbd9640 1 -- 172.21.15.17:0/1239337294 >> 172.21.15.17:0/1239337294 conn(0x7fb9340f9ec0 msgr2=0x7fb9340faab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:47.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.327+0000 7fb93bbd9640 1 -- 172.21.15.17:0/1239337294 shutdown_connections 2024-08-19T01:20:47.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.327+0000 7fb93bbd9640 1 -- 172.21.15.17:0/1239337294 wait complete. 2024-08-19T01:20:47.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.410+0000 7f37a2def640 1 -- 172.21.15.17:0/2682660079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c0fea30 msgr2=0x7f379c0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.410+0000 7f37a2def640 1 --2- 172.21.15.17:0/2682660079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c0fea30 0x7f379c0fee90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3788009880 tx=0x7f378802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.410+0000 7f37a2def640 1 -- 172.21.15.17:0/2682660079 shutdown_connections 2024-08-19T01:20:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.410+0000 7f37a2def640 1 --2- 172.21.15.17:0/2682660079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c0fea30 0x7f379c0fee90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.410+0000 7f37a2def640 1 --2- 172.21.15.17:0/2682660079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f379c104a30 0x7f379c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.410+0000 7f37a2def640 1 -- 172.21.15.17:0/2682660079 >> 172.21.15.17:0/2682660079 conn(0x7f379c0fa730 msgr2=0x7f379c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.410+0000 7f37a2def640 1 -- 172.21.15.17:0/2682660079 shutdown_connections 2024-08-19T01:20:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.410+0000 7f37a2def640 1 -- 172.21.15.17:0/2682660079 wait complete. 2024-08-19T01:20:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.411+0000 7f37a2def640 1 Processor -- start 2024-08-19T01:20:47.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.411+0000 7f37a2def640 1 -- start start 2024-08-19T01:20:47.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.411+0000 7f37a2def640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f379c0fea30 0x7f379c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:47.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.411+0000 7f37a2def640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c104a30 0x7f379c19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:47.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.411+0000 7f37a2def640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c19c470 con 0x7f379c104a30 2024-08-19T01:20:47.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.411+0000 7f37a2def640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c195a00 con 0x7f379c0fea30 2024-08-19T01:20:47.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.411+0000 7f379bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c104a30 0x7f379c19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:47.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.411+0000 7f379bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c104a30 0x7f379c19be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54544/0 (socket says 172.21.15.17:54544) 2024-08-19T01:20:47.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.411+0000 7f379bfff640 1 -- 172.21.15.17:0/2765326971 learned_addr learned my addr 172.21.15.17:0/2765326971 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:47.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.411+0000 7f37a0b8b640 1 --2- 172.21.15.17:0/2765326971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f379c0fea30 0x7f379c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:47.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.412+0000 7f379bfff640 1 -- 172.21.15.17:0/2765326971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f379c0fea30 msgr2=0x7f379c19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.412+0000 7f379bfff640 1 --2- 172.21.15.17:0/2765326971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f379c0fea30 0x7f379c19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.412+0000 7f379bfff640 1 -- 172.21.15.17:0/2765326971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788009560 con 0x7f379c104a30 2024-08-19T01:20:47.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.412+0000 7f379bfff640 1 --2- 172.21.15.17:0/2765326971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c104a30 0x7f379c19be50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f378802a9c0 tx=0x7f37880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:47.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.412+0000 7f3799ffb640 1 -- 172.21.15.17:0/2765326971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3788004aa0 con 0x7f379c104a30 2024-08-19T01:20:47.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.412+0000 7f3799ffb640 1 -- 172.21.15.17:0/2765326971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3788004c00 con 0x7f379c104a30 2024-08-19T01:20:47.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.412+0000 7f37a2def640 1 -- 172.21.15.17:0/2765326971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c195c80 con 0x7f379c104a30 2024-08-19T01:20:47.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.412+0000 7f3799ffb640 1 -- 172.21.15.17:0/2765326971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3788003a20 con 0x7f379c104a30 2024-08-19T01:20:47.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.412+0000 7f37a2def640 1 -- 172.21.15.17:0/2765326971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c196170 con 0x7f379c104a30 2024-08-19T01:20:47.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.413+0000 7f37a2def640 1 -- 172.21.15.17:0/2765326971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379c100170 con 0x7f379c104a30 2024-08-19T01:20:47.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.414+0000 7f3799ffb640 1 -- 172.21.15.17:0/2765326971 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3788031c90 con 0x7f379c104a30 2024-08-19T01:20:47.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.414+0000 7f3799ffb640 1 --2- 172.21.15.17:0/2765326971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f378c06e170 0x7f378c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:47.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.414+0000 7f3799ffb640 1 -- 172.21.15.17:0/2765326971 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f37880af220 con 0x7f379c104a30 2024-08-19T01:20:47.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.414+0000 7f37a0b8b640 1 --2- 172.21.15.17:0/2765326971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f378c06e170 0x7f378c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:47.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.415+0000 7f37a0b8b640 1 --2- 172.21.15.17:0/2765326971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f378c06e170 0x7f378c070630 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3790009990 tx=0x7f3790009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:47.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.419+0000 7f3799ffb640 1 -- 172.21.15.17:0/2765326971 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3788078500 con 0x7f379c104a30 2024-08-19T01:20:47.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:47 smithi086 ceph-mon[71303]: pgmap v661: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:47.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:47 smithi086 ceph-mon[71303]: from='client.35242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:47.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:47 smithi086 ceph-mon[71303]: from='client.35246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:47.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:47 smithi086 ceph-mon[71303]: from='client.35250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:47.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:47 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/706236926' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:20:47.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.609+0000 7f37a2def640 1 -- 172.21.15.17:0/2765326971 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f379c10bd20 con 0x7f378c06e170 2024-08-19T01:20:47.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.610+0000 7f3799ffb640 1 -- 172.21.15.17:0/2765326971 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f379c10bd20 con 0x7f378c06e170 2024-08-19T01:20:47.612 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:20:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:20:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:20:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:20:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:20:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:20:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:20:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:20:47.612 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:20:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:20:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:20:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:20:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:20:47.613 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:20:47.613 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:20:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.613+0000 7f37a2def640 1 -- 172.21.15.17:0/2765326971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f378c06e170 msgr2=0x7f378c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.613+0000 7f37a2def640 1 --2- 172.21.15.17:0/2765326971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f378c06e170 0x7f378c070630 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3790009990 tx=0x7f3790009110 comp rx=0 tx=0).stop 2024-08-19T01:20:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.613+0000 7f37a2def640 1 -- 172.21.15.17:0/2765326971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c104a30 msgr2=0x7f379c19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.613+0000 7f37a2def640 1 --2- 172.21.15.17:0/2765326971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c104a30 0x7f379c19be50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f378802a9c0 tx=0x7f37880055a0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.613+0000 7f37a2def640 1 -- 172.21.15.17:0/2765326971 shutdown_connections 2024-08-19T01:20:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.613+0000 7f37a2def640 1 --2- 172.21.15.17:0/2765326971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f378c06e170 0x7f378c070630 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.613+0000 7f37a2def640 1 --2- 172.21.15.17:0/2765326971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f379c104a30 0x7f379c19be50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.613+0000 7f37a2def640 1 --2- 172.21.15.17:0/2765326971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f379c0fea30 0x7f379c19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.613+0000 7f37a2def640 1 -- 172.21.15.17:0/2765326971 >> 172.21.15.17:0/2765326971 conn(0x7f379c0fa730 msgr2=0x7f379c068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:47.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.613+0000 7f37a2def640 1 -- 172.21.15.17:0/2765326971 shutdown_connections 2024-08-19T01:20:47.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.613+0000 7f37a2def640 1 -- 172.21.15.17:0/2765326971 wait complete. 2024-08-19T01:20:47.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.695+0000 7f13c75cd640 1 -- 172.21.15.17:0/4204701193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c00fea30 msgr2=0x7f13c00fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.695+0000 7f13c75cd640 1 --2- 172.21.15.17:0/4204701193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c00fea30 0x7f13c00fee90 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009880 tx=0x7f13b002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.695+0000 7f13c75cd640 1 -- 172.21.15.17:0/4204701193 shutdown_connections 2024-08-19T01:20:47.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.695+0000 7f13c75cd640 1 --2- 172.21.15.17:0/4204701193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c00fea30 0x7f13c00fee90 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.695+0000 7f13c75cd640 1 --2- 172.21.15.17:0/4204701193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13c0104a30 0x7f13c0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.695+0000 7f13c75cd640 1 -- 172.21.15.17:0/4204701193 >> 172.21.15.17:0/4204701193 conn(0x7f13c00fa730 msgr2=0x7f13c00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:47.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.695+0000 7f13c75cd640 1 -- 172.21.15.17:0/4204701193 shutdown_connections 2024-08-19T01:20:47.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.695+0000 7f13c75cd640 1 -- 172.21.15.17:0/4204701193 wait complete. 2024-08-19T01:20:47.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c75cd640 1 Processor -- start 2024-08-19T01:20:47.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c75cd640 1 -- start start 2024-08-19T01:20:47.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c75cd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13c00fea30 0x7f13c01949f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c75cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0104a30 0x7f13c0194f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c75cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c0195610 con 0x7f13c0104a30 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c75cd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c0199360 con 0x7f13c00fea30 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c4b68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0104a30 0x7f13c0194f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c4b68640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0104a30 0x7f13c0194f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:54562/0 (socket says 172.21.15.17:54562) 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c4b68640 1 -- 172.21.15.17:0/19094345 learned_addr learned my addr 172.21.15.17:0/19094345 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c5369640 1 --2- 172.21.15.17:0/19094345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13c00fea30 0x7f13c01949f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c4b68640 1 -- 172.21.15.17:0/19094345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13c00fea30 msgr2=0x7f13c01949f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c4b68640 1 --2- 172.21.15.17:0/19094345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13c00fea30 0x7f13c01949f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.696+0000 7f13c4b68640 1 -- 172.21.15.17:0/19094345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0009560 con 0x7f13c0104a30 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.697+0000 7f13c4b68640 1 --2- 172.21.15.17:0/19094345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0104a30 0x7f13c0194f30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f13b002a9c0 tx=0x7f13b00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.697+0000 7f13b67fc640 1 -- 172.21.15.17:0/19094345 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13b0004aa0 con 0x7f13c0104a30 2024-08-19T01:20:47.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.697+0000 7f13b67fc640 1 -- 172.21.15.17:0/19094345 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13b0004c00 con 0x7f13c0104a30 2024-08-19T01:20:47.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.697+0000 7f13c75cd640 1 -- 172.21.15.17:0/19094345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c01995e0 con 0x7f13c0104a30 2024-08-19T01:20:47.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.697+0000 7f13b67fc640 1 -- 172.21.15.17:0/19094345 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13b0003980 con 0x7f13c0104a30 2024-08-19T01:20:47.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.697+0000 7f13c75cd640 1 -- 172.21.15.17:0/19094345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c0199ad0 con 0x7f13c0104a30 2024-08-19T01:20:47.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.698+0000 7f13c75cd640 1 -- 172.21.15.17:0/19094345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c0100170 con 0x7f13c0104a30 2024-08-19T01:20:47.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.698+0000 7f13b67fc640 1 -- 172.21.15.17:0/19094345 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f13b0003bf0 con 0x7f13c0104a30 2024-08-19T01:20:47.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.699+0000 7f13b67fc640 1 --2- 172.21.15.17:0/19094345 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13ac06e170 0x7f13ac070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:20:47.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.699+0000 7f13b67fc640 1 -- 172.21.15.17:0/19094345 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f13b00af160 con 0x7f13c0104a30 2024-08-19T01:20:47.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.699+0000 7f13c5369640 1 --2- 172.21.15.17:0/19094345 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13ac06e170 0x7f13ac070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:20:47.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.700+0000 7f13c5369640 1 --2- 172.21.15.17:0/19094345 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13ac06e170 0x7f13ac070630 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f13bc005fd0 tx=0x7f13bc00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:20:47.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.703+0000 7f13b67fc640 1 -- 172.21.15.17:0/19094345 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f13b00784f0 con 0x7f13c0104a30 2024-08-19T01:20:47.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.946+0000 7f13c75cd640 1 -- 172.21.15.17:0/19094345 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f13c00fee90 con 0x7f13c0104a30 2024-08-19T01:20:47.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.946+0000 7f13b67fc640 1 -- 172.21.15.17:0/19094345 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f13b007bbb0 con 0x7f13c0104a30 2024-08-19T01:20:47.948 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:20:47.949 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:20:47.950 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:20:47.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.948+0000 7f13c75cd640 1 -- 172.21.15.17:0/19094345 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13ac06e170 msgr2=0x7f13ac070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.948+0000 7f13c75cd640 1 --2- 172.21.15.17:0/19094345 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13ac06e170 0x7f13ac070630 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f13bc005fd0 tx=0x7f13bc00b390 comp rx=0 tx=0).stop 2024-08-19T01:20:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.948+0000 7f13c75cd640 1 -- 172.21.15.17:0/19094345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0104a30 msgr2=0x7f13c0194f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:20:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.948+0000 7f13c75cd640 1 --2- 172.21.15.17:0/19094345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0104a30 0x7f13c0194f30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f13b002a9c0 tx=0x7f13b00055a0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.948+0000 7f13c75cd640 1 -- 172.21.15.17:0/19094345 shutdown_connections 2024-08-19T01:20:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.948+0000 7f13c75cd640 1 --2- 172.21.15.17:0/19094345 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f13ac06e170 0x7f13ac070630 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.948+0000 7f13c75cd640 1 --2- 172.21.15.17:0/19094345 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c0104a30 0x7f13c0194f30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.948+0000 7f13c75cd640 1 --2- 172.21.15.17:0/19094345 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f13c00fea30 0x7f13c01949f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:20:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.948+0000 7f13c75cd640 1 -- 172.21.15.17:0/19094345 >> 172.21.15.17:0/19094345 conn(0x7f13c00fa730 msgr2=0x7f13c00fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:20:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.949+0000 7f13c75cd640 1 -- 172.21.15.17:0/19094345 shutdown_connections 2024-08-19T01:20:47.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:20:47.949+0000 7f13c75cd640 1 -- 172.21.15.17:0/19094345 wait complete. 2024-08-19T01:20:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:48 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1239337294' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:20:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:48 smithi017 ceph-mon[99370]: from='client.35262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:20:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:48 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/19094345' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:20:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:48 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1239337294' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:20:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:48 smithi086 ceph-mon[71303]: from='client.35262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:20:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:20:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:48 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/19094345' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:20:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:49 smithi017 ceph-mon[99370]: pgmap v662: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:49.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:49 smithi086 ceph-mon[71303]: pgmap v662: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:51.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:51 smithi017 ceph-mon[99370]: pgmap v663: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:51.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:51 smithi086 ceph-mon[71303]: pgmap v663: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:53.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:53 smithi017 ceph-mon[99370]: pgmap v664: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:53.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:53 smithi086 ceph-mon[71303]: pgmap v664: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:55.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:55 smithi017 ceph-mon[99370]: pgmap v665: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:55.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:55 smithi086 ceph-mon[71303]: pgmap v665: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:57.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:57 smithi017 ceph-mon[99370]: pgmap v666: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:57.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:57 smithi086 ceph-mon[71303]: pgmap v666: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:59.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:20:59 smithi017 ceph-mon[99370]: pgmap v667: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:20:59.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:20:59 smithi086 ceph-mon[71303]: pgmap v667: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:01 smithi017 ceph-mon[99370]: pgmap v668: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:01.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:01 smithi086 ceph-mon[71303]: pgmap v668: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:03.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:03 smithi017 ceph-mon[99370]: pgmap v669: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:03.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:21:03.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:03 smithi086 ceph-mon[71303]: pgmap v669: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:03.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:21:05.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:05 smithi017 ceph-mon[99370]: pgmap v670: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:05.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:05 smithi086 ceph-mon[71303]: pgmap v670: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:07.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:07 smithi017 ceph-mon[99370]: pgmap v671: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:07.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:07 smithi086 ceph-mon[71303]: pgmap v671: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:09.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:09 smithi017 ceph-mon[99370]: pgmap v672: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:09.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:09 smithi086 ceph-mon[71303]: pgmap v672: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:11.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:11 smithi017 ceph-mon[99370]: pgmap v673: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:11.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:11 smithi086 ceph-mon[71303]: pgmap v673: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:13.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:13 smithi017 ceph-mon[99370]: pgmap v674: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:13.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:13 smithi086 ceph-mon[71303]: pgmap v674: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:15.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:15 smithi017 ceph-mon[99370]: pgmap v675: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:15.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:15 smithi086 ceph-mon[71303]: pgmap v675: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:17.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:17 smithi017 ceph-mon[99370]: pgmap v676: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:17.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:17 smithi086 ceph-mon[71303]: pgmap v676: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:18.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.042+0000 7f2b75cd0640 1 -- 172.21.15.17:0/3468571829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b700ffda0 msgr2=0x7f2b70100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.042+0000 7f2b75cd0640 1 --2- 172.21.15.17:0/3468571829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b700ffda0 0x7f2b70100180 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009880 tx=0x7f2b6002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.042+0000 7f2b75cd0640 1 -- 172.21.15.17:0/3468571829 shutdown_connections 2024-08-19T01:21:18.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.042+0000 7f2b75cd0640 1 --2- 172.21.15.17:0/3468571829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b70100750 0x7f2b701047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.042+0000 7f2b75cd0640 1 --2- 172.21.15.17:0/3468571829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b700ffda0 0x7f2b70100180 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.042+0000 7f2b75cd0640 1 -- 172.21.15.17:0/3468571829 >> 172.21.15.17:0/3468571829 conn(0x7f2b700fb840 msgr2=0x7f2b700fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:18.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.042+0000 7f2b75cd0640 1 -- 172.21.15.17:0/3468571829 shutdown_connections 2024-08-19T01:21:18.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.042+0000 7f2b75cd0640 1 -- 172.21.15.17:0/3468571829 wait complete. 2024-08-19T01:21:18.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.043+0000 7f2b75cd0640 1 Processor -- start 2024-08-19T01:21:18.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.043+0000 7f2b75cd0640 1 -- start start 2024-08-19T01:21:18.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.043+0000 7f2b75cd0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b700ffda0 0x7f2b700727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.043+0000 7f2b75cd0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b70100750 0x7f2b70072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.043+0000 7f2b75cd0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70073230 con 0x7f2b700ffda0 2024-08-19T01:21:18.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.043+0000 7f2b75cd0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b70073370 con 0x7f2b70100750 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b6f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b700ffda0 0x7f2b700727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b6f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b700ffda0 0x7f2b700727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37720/0 (socket says 172.21.15.17:37720) 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b6f7fe640 1 -- 172.21.15.17:0/303535500 learned_addr learned my addr 172.21.15.17:0/303535500 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b67fff640 1 --2- 172.21.15.17:0/303535500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b70100750 0x7f2b70072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b6f7fe640 1 -- 172.21.15.17:0/303535500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b70100750 msgr2=0x7f2b70072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b6f7fe640 1 --2- 172.21.15.17:0/303535500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b70100750 0x7f2b70072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b6f7fe640 1 -- 172.21.15.17:0/303535500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b60009560 con 0x7f2b700ffda0 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b6f7fe640 1 --2- 172.21.15.17:0/303535500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b700ffda0 0x7f2b700727b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2b60006010 tx=0x7f2b600055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b6d7fa640 1 -- 172.21.15.17:0/303535500 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b600048d0 con 0x7f2b700ffda0 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b6d7fa640 1 -- 172.21.15.17:0/303535500 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b60031640 con 0x7f2b700ffda0 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b75cd0640 1 -- 172.21.15.17:0/303535500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b700735f0 con 0x7f2b700ffda0 2024-08-19T01:21:18.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.044+0000 7f2b6d7fa640 1 -- 172.21.15.17:0/303535500 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b60003820 con 0x7f2b700ffda0 2024-08-19T01:21:18.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.045+0000 7f2b75cd0640 1 -- 172.21.15.17:0/303535500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b701a20e0 con 0x7f2b700ffda0 2024-08-19T01:21:18.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.046+0000 7f2b75cd0640 1 -- 172.21.15.17:0/303535500 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b70101280 con 0x7f2b700ffda0 2024-08-19T01:21:18.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.046+0000 7f2b6d7fa640 1 -- 172.21.15.17:0/303535500 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2b600317b0 con 0x7f2b700ffda0 2024-08-19T01:21:18.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.046+0000 7f2b6d7fa640 1 --2- 172.21.15.17:0/303535500 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2b5c06e180 0x7f2b5c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.047+0000 7f2b6d7fa640 1 -- 172.21.15.17:0/303535500 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2b600af000 con 0x7f2b700ffda0 2024-08-19T01:21:18.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.047+0000 7f2b67fff640 1 --2- 172.21.15.17:0/303535500 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2b5c06e180 0x7f2b5c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.047+0000 7f2b67fff640 1 --2- 172.21.15.17:0/303535500 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2b5c06e180 0x7f2b5c070640 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2b700742b0 tx=0x7f2b58005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:18.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.051+0000 7f2b6d7fa640 1 -- 172.21.15.17:0/303535500 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2b60078410 con 0x7f2b700ffda0 2024-08-19T01:21:18.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.250+0000 7f2b75cd0640 1 -- 172.21.15.17:0/303535500 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b70073ce0 con 0x7f2b5c06e180 2024-08-19T01:21:18.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.251+0000 7f2b6d7fa640 1 -- 172.21.15.17:0/303535500 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2b70073ce0 con 0x7f2b5c06e180 2024-08-19T01:21:18.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.253+0000 7f2b75cd0640 1 -- 172.21.15.17:0/303535500 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2b5c06e180 msgr2=0x7f2b5c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.253+0000 7f2b75cd0640 1 --2- 172.21.15.17:0/303535500 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2b5c06e180 0x7f2b5c070640 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2b700742b0 tx=0x7f2b58005f90 comp rx=0 tx=0).stop 2024-08-19T01:21:18.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.253+0000 7f2b75cd0640 1 -- 172.21.15.17:0/303535500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b700ffda0 msgr2=0x7f2b700727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.253+0000 7f2b75cd0640 1 --2- 172.21.15.17:0/303535500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b700ffda0 0x7f2b700727b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2b60006010 tx=0x7f2b600055a0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.253+0000 7f2b75cd0640 1 -- 172.21.15.17:0/303535500 shutdown_connections 2024-08-19T01:21:18.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.253+0000 7f2b75cd0640 1 --2- 172.21.15.17:0/303535500 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2b5c06e180 0x7f2b5c070640 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.253+0000 7f2b75cd0640 1 --2- 172.21.15.17:0/303535500 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b70100750 0x7f2b70072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.253+0000 7f2b75cd0640 1 --2- 172.21.15.17:0/303535500 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b700ffda0 0x7f2b700727b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.253+0000 7f2b75cd0640 1 -- 172.21.15.17:0/303535500 >> 172.21.15.17:0/303535500 conn(0x7f2b700fb840 msgr2=0x7f2b700fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:18.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.254+0000 7f2b75cd0640 1 -- 172.21.15.17:0/303535500 shutdown_connections 2024-08-19T01:21:18.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.254+0000 7f2b75cd0640 1 -- 172.21.15.17:0/303535500 wait complete. 2024-08-19T01:21:18.264 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:21:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.339+0000 7fd37f247640 1 -- 172.21.15.17:0/1825043019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd378100d50 msgr2=0x7fd378101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.339+0000 7fd37f247640 1 --2- 172.21.15.17:0/1825043019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd378100d50 0x7fd378101130 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009880 tx=0x7fd36c02a530 comp rx=0 tx=0).stop 2024-08-19T01:21:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.339+0000 7fd37f247640 1 -- 172.21.15.17:0/1825043019 shutdown_connections 2024-08-19T01:21:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.339+0000 7fd37f247640 1 --2- 172.21.15.17:0/1825043019 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd378101670 0x7fd378109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.339+0000 7fd37f247640 1 --2- 172.21.15.17:0/1825043019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd378100d50 0x7fd378101130 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.339+0000 7fd37f247640 1 -- 172.21.15.17:0/1825043019 >> 172.21.15.17:0/1825043019 conn(0x7fd3780758a0 msgr2=0x7fd3780fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:18.342 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:21:18.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.339+0000 7fd37f247640 1 -- 172.21.15.17:0/1825043019 shutdown_connections 2024-08-19T01:21:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.339+0000 7fd37f247640 1 -- 172.21.15.17:0/1825043019 wait complete. 2024-08-19T01:21:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd37f247640 1 Processor -- start 2024-08-19T01:21:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd37f247640 1 -- start start 2024-08-19T01:21:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd37f247640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd378100d50 0x7fd3780fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd37f247640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd378101670 0x7fd3780feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd37f247640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3780ff430 con 0x7fd378101670 2024-08-19T01:21:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd37f247640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3780ff5a0 con 0x7fd378100d50 2024-08-19T01:21:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd377fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd378101670 0x7fd3780feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd377fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd378101670 0x7fd3780feef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37736/0 (socket says 172.21.15.17:37736) 2024-08-19T01:21:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd377fff640 1 -- 172.21.15.17:0/3941143446 learned_addr learned my addr 172.21.15.17:0/3941143446 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:18.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd37cfe3640 1 --2- 172.21.15.17:0/3941143446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd378100d50 0x7fd3780fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd377fff640 1 -- 172.21.15.17:0/3941143446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd378100d50 msgr2=0x7fd3780fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd377fff640 1 --2- 172.21.15.17:0/3941143446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd378100d50 0x7fd3780fe9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.340+0000 7fd377fff640 1 -- 172.21.15.17:0/3941143446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c009560 con 0x7fd378101670 2024-08-19T01:21:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.341+0000 7fd377fff640 1 --2- 172.21.15.17:0/3941143446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd378101670 0x7fd3780feef0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd36400b420 tx=0x7fd36400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.341+0000 7fd375ffb640 1 -- 172.21.15.17:0/3941143446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd364011800 con 0x7fd378101670 2024-08-19T01:21:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.341+0000 7fd37f247640 1 -- 172.21.15.17:0/3941143446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3781a1e20 con 0x7fd378101670 2024-08-19T01:21:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.341+0000 7fd375ffb640 1 -- 172.21.15.17:0/3941143446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd364011e20 con 0x7fd378101670 2024-08-19T01:21:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.341+0000 7fd375ffb640 1 -- 172.21.15.17:0/3941143446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36400f2e0 con 0x7fd378101670 2024-08-19T01:21:18.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.341+0000 7fd37f247640 1 -- 172.21.15.17:0/3941143446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3781a2180 con 0x7fd378101670 2024-08-19T01:21:18.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.342+0000 7fd37f247640 1 -- 172.21.15.17:0/3941143446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd378068470 con 0x7fd378101670 2024-08-19T01:21:18.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.342+0000 7fd375ffb640 1 -- 172.21.15.17:0/3941143446 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd364010380 con 0x7fd378101670 2024-08-19T01:21:18.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.343+0000 7fd375ffb640 1 --2- 172.21.15.17:0/3941143446 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd36806e170 0x7fd368070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.343+0000 7fd375ffb640 1 -- 172.21.15.17:0/3941143446 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd36408daf0 con 0x7fd378101670 2024-08-19T01:21:18.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.343+0000 7fd37cfe3640 1 --2- 172.21.15.17:0/3941143446 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd36806e170 0x7fd368070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.343+0000 7fd37cfe3640 1 --2- 172.21.15.17:0/3941143446 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd36806e170 0x7fd368070630 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd36c000c00 tx=0x7fd36c031400 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:18.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.347+0000 7fd375ffb640 1 -- 172.21.15.17:0/3941143446 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd364056dd0 con 0x7fd378101670 2024-08-19T01:21:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:21:18.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.541+0000 7fd37f247640 1 -- 172.21.15.17:0/3941143446 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3780ff760 con 0x7fd36806e170 2024-08-19T01:21:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.543+0000 7fd375ffb640 1 -- 172.21.15.17:0/3941143446 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd3780ff760 con 0x7fd36806e170 2024-08-19T01:21:18.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.544+0000 7fd37f247640 1 -- 172.21.15.17:0/3941143446 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd36806e170 msgr2=0x7fd368070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.544+0000 7fd37f247640 1 --2- 172.21.15.17:0/3941143446 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd36806e170 0x7fd368070630 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd36c000c00 tx=0x7fd36c031400 comp rx=0 tx=0).stop 2024-08-19T01:21:18.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.544+0000 7fd37f247640 1 -- 172.21.15.17:0/3941143446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd378101670 msgr2=0x7fd3780feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.545+0000 7fd37f247640 1 --2- 172.21.15.17:0/3941143446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd378101670 0x7fd3780feef0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd36400b420 tx=0x7fd36400b8e0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.545+0000 7fd37f247640 1 -- 172.21.15.17:0/3941143446 shutdown_connections 2024-08-19T01:21:18.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.545+0000 7fd37f247640 1 --2- 172.21.15.17:0/3941143446 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd36806e170 0x7fd368070630 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.545+0000 7fd37f247640 1 --2- 172.21.15.17:0/3941143446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd378101670 0x7fd3780feef0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.545+0000 7fd37f247640 1 --2- 172.21.15.17:0/3941143446 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd378100d50 0x7fd3780fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.545+0000 7fd37f247640 1 -- 172.21.15.17:0/3941143446 >> 172.21.15.17:0/3941143446 conn(0x7fd3780758a0 msgr2=0x7fd378101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:18.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.545+0000 7fd37f247640 1 -- 172.21.15.17:0/3941143446 shutdown_connections 2024-08-19T01:21:18.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.545+0000 7fd37f247640 1 -- 172.21.15.17:0/3941143446 wait complete. 2024-08-19T01:21:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.626+0000 7f42ce481640 1 -- 172.21.15.17:0/2459157427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c8104a30 msgr2=0x7f42c8104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.626+0000 7f42ce481640 1 --2- 172.21.15.17:0/2459157427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c8104a30 0x7f42c8104e10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f42b8009880 tx=0x7f42b802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.626+0000 7f42ce481640 1 -- 172.21.15.17:0/2459157427 shutdown_connections 2024-08-19T01:21:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.626+0000 7f42ce481640 1 --2- 172.21.15.17:0/2459157427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c80fea30 0x7f42c80fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.626+0000 7f42ce481640 1 --2- 172.21.15.17:0/2459157427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c8104a30 0x7f42c8104e10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.626+0000 7f42ce481640 1 -- 172.21.15.17:0/2459157427 >> 172.21.15.17:0/2459157427 conn(0x7f42c80fa730 msgr2=0x7f42c80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.627+0000 7f42ce481640 1 -- 172.21.15.17:0/2459157427 shutdown_connections 2024-08-19T01:21:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.627+0000 7f42ce481640 1 -- 172.21.15.17:0/2459157427 wait complete. 2024-08-19T01:21:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.627+0000 7f42ce481640 1 Processor -- start 2024-08-19T01:21:18.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.627+0000 7f42ce481640 1 -- start start 2024-08-19T01:21:18.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42ce481640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c80fea30 0x7f42c8197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42ce481640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c8104a30 0x7f42c81981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42ce481640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c81988d0 con 0x7f42c8104a30 2024-08-19T01:21:18.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42ce481640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c819b540 con 0x7f42c80fea30 2024-08-19T01:21:18.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c8104a30 0x7f42c81981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42c77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c8104a30 0x7f42c81981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37766/0 (socket says 172.21.15.17:37766) 2024-08-19T01:21:18.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42c77fe640 1 -- 172.21.15.17:0/3484429821 learned_addr learned my addr 172.21.15.17:0/3484429821 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:18.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42c7fff640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c80fea30 0x7f42c8197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42c77fe640 1 -- 172.21.15.17:0/3484429821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c80fea30 msgr2=0x7f42c8197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42c77fe640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c80fea30 0x7f42c8197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42c77fe640 1 -- 172.21.15.17:0/3484429821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8009560 con 0x7f42c8104a30 2024-08-19T01:21:18.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42c7fff640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c80fea30 0x7f42c8197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:21:18.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.628+0000 7f42c77fe640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c8104a30 0x7f42c81981f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00e970 tx=0x7f42bc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:18.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.629+0000 7f42c57fa640 1 -- 172.21.15.17:0/3484429821 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42bc00cc90 con 0x7f42c8104a30 2024-08-19T01:21:18.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.629+0000 7f42ce481640 1 -- 172.21.15.17:0/3484429821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c819b820 con 0x7f42c8104a30 2024-08-19T01:21:18.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.629+0000 7f42c57fa640 1 -- 172.21.15.17:0/3484429821 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42bc00cdf0 con 0x7f42c8104a30 2024-08-19T01:21:18.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.629+0000 7f42c57fa640 1 -- 172.21.15.17:0/3484429821 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42bc018810 con 0x7f42c8104a30 2024-08-19T01:21:18.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.629+0000 7f42ce481640 1 -- 172.21.15.17:0/3484429821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c819bd70 con 0x7f42c8104a30 2024-08-19T01:21:18.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.630+0000 7f42ce481640 1 -- 172.21.15.17:0/3484429821 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c8100170 con 0x7f42c8104a30 2024-08-19T01:21:18.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.630+0000 7f42c57fa640 1 -- 172.21.15.17:0/3484429821 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f42bc010c10 con 0x7f42c8104a30 2024-08-19T01:21:18.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.631+0000 7f42c57fa640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f42b006e170 0x7f42b0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.631+0000 7f42c57fa640 1 -- 172.21.15.17:0/3484429821 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f42bc014070 con 0x7f42c8104a30 2024-08-19T01:21:18.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.631+0000 7f42c7fff640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f42b006e170 0x7f42b0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.631+0000 7f42c7fff640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f42b006e170 0x7f42b0070630 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f42b8000c00 tx=0x7f42b8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:18.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.635+0000 7f42c57fa640 1 -- 172.21.15.17:0/3484429821 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f42bc053df0 con 0x7f42c8104a30 2024-08-19T01:21:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.817+0000 7f42ce481640 1 -- 172.21.15.17:0/3484429821 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f42c810bca0 con 0x7f42b006e170 2024-08-19T01:21:18.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.827+0000 7f42c57fa640 1 -- 172.21.15.17:0/3484429821 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f42c810bca0 con 0x7f42b006e170 2024-08-19T01:21:18.829 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:21:18.829 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (22m) 65s ago 33m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:21:18.829 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (33m) 65s ago 33m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:21:18.829 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (32m) 67s ago 32m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:21:18.829 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (20m) 65s ago 33m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:21:18.829 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (20m) 67s ago 32m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:21:18.829 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (22m) 65s ago 33m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:21:18.829 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (16m) 65s ago 27m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:21:18.829 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (16m) 65s ago 27m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:21:18.829 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (71s) 67s ago 27m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:21:18.829 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (16m) 67s ago 27m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (24m) 65s ago 34m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (23m) 67s ago 32m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (21m) 65s ago 34m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (21m) 67s ago 32m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (23m) 65s ago 33m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (23m) 67s ago 32m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (19m) 65s ago 31m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (19m) 65s ago 31m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (18m) 65s ago 30m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (18m) 67s ago 30m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (17m) 67s ago 29m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:21:18.830 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (17m) 67s ago 29m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:21:18.831 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (22m) 65s ago 32m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:21:18.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.829+0000 7f42ce481640 1 -- 172.21.15.17:0/3484429821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f42b006e170 msgr2=0x7f42b0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.829+0000 7f42ce481640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f42b006e170 0x7f42b0070630 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f42b8000c00 tx=0x7f42b8005a20 comp rx=0 tx=0).stop 2024-08-19T01:21:18.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.829+0000 7f42ce481640 1 -- 172.21.15.17:0/3484429821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c8104a30 msgr2=0x7f42c81981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.829+0000 7f42ce481640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c8104a30 0x7f42c81981f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00e970 tx=0x7f42bc00ee30 comp rx=0 tx=0).stop 2024-08-19T01:21:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.829+0000 7f42ce481640 1 -- 172.21.15.17:0/3484429821 shutdown_connections 2024-08-19T01:21:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.829+0000 7f42ce481640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f42b006e170 0x7f42b0070630 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.829+0000 7f42ce481640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42c8104a30 0x7f42c81981f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.829+0000 7f42ce481640 1 --2- 172.21.15.17:0/3484429821 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f42c80fea30 0x7f42c8197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.829+0000 7f42ce481640 1 -- 172.21.15.17:0/3484429821 >> 172.21.15.17:0/3484429821 conn(0x7f42c80fa730 msgr2=0x7f42c80fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.829+0000 7f42ce481640 1 -- 172.21.15.17:0/3484429821 shutdown_connections 2024-08-19T01:21:18.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.829+0000 7f42ce481640 1 -- 172.21.15.17:0/3484429821 wait complete. 2024-08-19T01:21:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.910+0000 7fba4a6fd640 1 -- 172.21.15.17:0/781063474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44105c00 msgr2=0x7fba44105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.910+0000 7fba4a6fd640 1 --2- 172.21.15.17:0/781063474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44105c00 0x7fba44105fe0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fba34009880 tx=0x7fba3402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.910+0000 7fba4a6fd640 1 -- 172.21.15.17:0/781063474 shutdown_connections 2024-08-19T01:21:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.910+0000 7fba4a6fd640 1 --2- 172.21.15.17:0/781063474 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba440ffb50 0x7fba440fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.910+0000 7fba4a6fd640 1 --2- 172.21.15.17:0/781063474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44105c00 0x7fba44105fe0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.910+0000 7fba4a6fd640 1 -- 172.21.15.17:0/781063474 >> 172.21.15.17:0/781063474 conn(0x7fba440fb830 msgr2=0x7fba440fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.911+0000 7fba4a6fd640 1 -- 172.21.15.17:0/781063474 shutdown_connections 2024-08-19T01:21:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.911+0000 7fba4a6fd640 1 -- 172.21.15.17:0/781063474 wait complete. 2024-08-19T01:21:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.911+0000 7fba4a6fd640 1 Processor -- start 2024-08-19T01:21:18.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.911+0000 7fba4a6fd640 1 -- start start 2024-08-19T01:21:18.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba4a6fd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba440ffb50 0x7fba440727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba4a6fd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44105c00 0x7fba44072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba4a6fd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44073230 con 0x7fba44105c00 2024-08-19T01:21:18.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba4a6fd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440733a0 con 0x7fba440ffb50 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44105c00 0x7fba44072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44105c00 0x7fba44072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37780/0 (socket says 172.21.15.17:37780) 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba437fe640 1 -- 172.21.15.17:0/2514567281 learned_addr learned my addr 172.21.15.17:0/2514567281 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba43fff640 1 --2- 172.21.15.17:0/2514567281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba440ffb50 0x7fba440727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba437fe640 1 -- 172.21.15.17:0/2514567281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba440ffb50 msgr2=0x7fba440727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba437fe640 1 --2- 172.21.15.17:0/2514567281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba440ffb50 0x7fba440727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba437fe640 1 -- 172.21.15.17:0/2514567281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba34009560 con 0x7fba44105c00 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.912+0000 7fba437fe640 1 --2- 172.21.15.17:0/2514567281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44105c00 0x7fba44072cf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fba3800d6f0 tx=0x7fba3800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.913+0000 7fba417fa640 1 -- 172.21.15.17:0/2514567281 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba38009a30 con 0x7fba44105c00 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.913+0000 7fba417fa640 1 -- 172.21.15.17:0/2514567281 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba380054e0 con 0x7fba44105c00 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.913+0000 7fba4a6fd640 1 -- 172.21.15.17:0/2514567281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba441a1cc0 con 0x7fba44105c00 2024-08-19T01:21:18.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.913+0000 7fba417fa640 1 -- 172.21.15.17:0/2514567281 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba38010460 con 0x7fba44105c00 2024-08-19T01:21:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.913+0000 7fba4a6fd640 1 -- 172.21.15.17:0/2514567281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba441a2020 con 0x7fba44105c00 2024-08-19T01:21:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.914+0000 7fba4a6fd640 1 -- 172.21.15.17:0/2514567281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba44101200 con 0x7fba44105c00 2024-08-19T01:21:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.914+0000 7fba417fa640 1 -- 172.21.15.17:0/2514567281 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fba38009b90 con 0x7fba44105c00 2024-08-19T01:21:18.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.915+0000 7fba417fa640 1 --2- 172.21.15.17:0/2514567281 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fba2c06e180 0x7fba2c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.915+0000 7fba417fa640 1 -- 172.21.15.17:0/2514567281 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fba3808dd20 con 0x7fba44105c00 2024-08-19T01:21:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.915+0000 7fba43fff640 1 --2- 172.21.15.17:0/2514567281 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fba2c06e180 0x7fba2c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:18.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.915+0000 7fba43fff640 1 --2- 172.21.15.17:0/2514567281 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fba2c06e180 0x7fba2c070640 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fba34006010 tx=0x7fba34000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:18.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:18.919+0000 7fba417fa640 1 -- 172.21.15.17:0/2514567281 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fba38057000 con 0x7fba44105c00 2024-08-19T01:21:19.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.171+0000 7fba4a6fd640 1 -- 172.21.15.17:0/2514567281 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fba44108050 con 0x7fba44105c00 2024-08-19T01:21:19.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:19 smithi017 ceph-mon[99370]: pgmap v677: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:19.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:19 smithi017 ceph-mon[99370]: from='client.35270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:19.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:19 smithi017 ceph-mon[99370]: from='client.35274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:19.174 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:19 smithi017 ceph-mon[99370]: from='client.35278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:19.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.171+0000 7fba417fa640 1 -- 172.21.15.17:0/2514567281 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fba3805a6c0 con 0x7fba44105c00 2024-08-19T01:21:19.174 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:21:19.174 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:21:19.174 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:21:19.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:21:19.175 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:21:19.175 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:21:19.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:21:19.175 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:21:19.175 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:21:19.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:21:19.175 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:21:19.175 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:21:19.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:21:19.175 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:21:19.175 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:21:19.176 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:21:19.176 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:21:19.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.174+0000 7fba4a6fd640 1 -- 172.21.15.17:0/2514567281 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fba2c06e180 msgr2=0x7fba2c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.174+0000 7fba4a6fd640 1 --2- 172.21.15.17:0/2514567281 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fba2c06e180 0x7fba2c070640 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fba34006010 tx=0x7fba34000bc0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.174+0000 7fba4a6fd640 1 -- 172.21.15.17:0/2514567281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44105c00 msgr2=0x7fba44072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.174+0000 7fba4a6fd640 1 --2- 172.21.15.17:0/2514567281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44105c00 0x7fba44072cf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fba3800d6f0 tx=0x7fba3800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.174+0000 7fba4a6fd640 1 -- 172.21.15.17:0/2514567281 shutdown_connections 2024-08-19T01:21:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.174+0000 7fba4a6fd640 1 --2- 172.21.15.17:0/2514567281 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fba2c06e180 0x7fba2c070640 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.174+0000 7fba4a6fd640 1 --2- 172.21.15.17:0/2514567281 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba44105c00 0x7fba44072cf0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.174+0000 7fba4a6fd640 1 --2- 172.21.15.17:0/2514567281 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fba440ffb50 0x7fba440727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.174+0000 7fba4a6fd640 1 -- 172.21.15.17:0/2514567281 >> 172.21.15.17:0/2514567281 conn(0x7fba440fb830 msgr2=0x7fba440fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.174+0000 7fba4a6fd640 1 -- 172.21.15.17:0/2514567281 shutdown_connections 2024-08-19T01:21:19.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.174+0000 7fba4a6fd640 1 -- 172.21.15.17:0/2514567281 wait complete. 2024-08-19T01:21:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.255+0000 7fa1ec6df640 1 -- 172.21.15.17:0/910331452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e41049c0 msgr2=0x7fa1e4104da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.255+0000 7fa1ec6df640 1 --2- 172.21.15.17:0/910331452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e41049c0 0x7fa1e4104da0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009880 tx=0x7fa1e002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.255+0000 7fa1ec6df640 1 -- 172.21.15.17:0/910331452 shutdown_connections 2024-08-19T01:21:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.255+0000 7fa1ec6df640 1 --2- 172.21.15.17:0/910331452 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1e40fe9c0 0x7fa1e40fee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.255+0000 7fa1ec6df640 1 --2- 172.21.15.17:0/910331452 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e41049c0 0x7fa1e4104da0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.255+0000 7fa1ec6df640 1 -- 172.21.15.17:0/910331452 >> 172.21.15.17:0/910331452 conn(0x7fa1e40fa6a0 msgr2=0x7fa1e40fcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.255+0000 7fa1ec6df640 1 -- 172.21.15.17:0/910331452 shutdown_connections 2024-08-19T01:21:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.255+0000 7fa1ec6df640 1 -- 172.21.15.17:0/910331452 wait complete. 2024-08-19T01:21:19.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1ec6df640 1 Processor -- start 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1ec6df640 1 -- start start 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1ec6df640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1e40fe9c0 0x7fa1e419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1ec6df640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e41049c0 0x7fa1e419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1ec6df640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e41947d0 con 0x7fa1e41049c0 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1ec6df640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1e4194940 con 0x7fa1e40fe9c0 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1e9c7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e41049c0 0x7fa1e419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1e9c7a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e41049c0 0x7fa1e419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37798/0 (socket says 172.21.15.17:37798) 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1e9c7a640 1 -- 172.21.15.17:0/1248808517 learned_addr learned my addr 172.21.15.17:0/1248808517 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1ea47b640 1 --2- 172.21.15.17:0/1248808517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1e40fe9c0 0x7fa1e419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1e9c7a640 1 -- 172.21.15.17:0/1248808517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1e40fe9c0 msgr2=0x7fa1e419a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1e9c7a640 1 --2- 172.21.15.17:0/1248808517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1e40fe9c0 0x7fa1e419a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.256+0000 7fa1e9c7a640 1 -- 172.21.15.17:0/1248808517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e0009560 con 0x7fa1e41049c0 2024-08-19T01:21:19.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.257+0000 7fa1e9c7a640 1 --2- 172.21.15.17:0/1248808517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e41049c0 0x7fa1e419abd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400c810 tx=0x7fa1d400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:19.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.257+0000 7fa1db7fe640 1 -- 172.21.15.17:0/1248808517 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d40041f0 con 0x7fa1e41049c0 2024-08-19T01:21:19.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.257+0000 7fa1db7fe640 1 -- 172.21.15.17:0/1248808517 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1d4007e70 con 0x7fa1e41049c0 2024-08-19T01:21:19.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.257+0000 7fa1ec6df640 1 -- 172.21.15.17:0/1248808517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e4194c20 con 0x7fa1e41049c0 2024-08-19T01:21:19.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.257+0000 7fa1db7fe640 1 -- 172.21.15.17:0/1248808517 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1d40049d0 con 0x7fa1e41049c0 2024-08-19T01:21:19.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.257+0000 7fa1ec6df640 1 -- 172.21.15.17:0/1248808517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1e4195170 con 0x7fa1e41049c0 2024-08-19T01:21:19.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.258+0000 7fa1ec6df640 1 -- 172.21.15.17:0/1248808517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1e4100100 con 0x7fa1e41049c0 2024-08-19T01:21:19.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.258+0000 7fa1db7fe640 1 -- 172.21.15.17:0/1248808517 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa1d40079b0 con 0x7fa1e41049c0 2024-08-19T01:21:19.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.259+0000 7fa1db7fe640 1 --2- 172.21.15.17:0/1248808517 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1d006e170 0x7fa1d0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:19.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.259+0000 7fa1db7fe640 1 -- 172.21.15.17:0/1248808517 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa1d408dfe0 con 0x7fa1e41049c0 2024-08-19T01:21:19.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.259+0000 7fa1ea47b640 1 --2- 172.21.15.17:0/1248808517 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1d006e170 0x7fa1d0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:19.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.259+0000 7fa1ea47b640 1 --2- 172.21.15.17:0/1248808517 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1d006e170 0x7fa1d0070630 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0000c00 tx=0x7fa1e0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:19.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.263+0000 7fa1db7fe640 1 -- 172.21.15.17:0/1248808517 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa1d40572c0 con 0x7fa1e41049c0 2024-08-19T01:21:19.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:19 smithi086 ceph-mon[71303]: pgmap v677: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:19.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:19 smithi086 ceph-mon[71303]: from='client.35270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:19.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:19 smithi086 ceph-mon[71303]: from='client.35274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:19.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:19 smithi086 ceph-mon[71303]: from='client.35278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.478+0000 7fa1ec6df640 1 -- 172.21.15.17:0/1248808517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa1e4101c70 con 0x7fa1e41049c0 2024-08-19T01:21:19.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.478+0000 7fa1db7fe640 1 -- 172.21.15.17:0/1248808517 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7fa1d405a980 con 0x7fa1e41049c0 2024-08-19T01:21:19.480 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:21:19.480 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:21:19.480 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:21:19.481 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:21:19.482 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:21:19.483 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:21:19.483 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:21:19.483 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:21:19.483 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:21:19.483 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:21:19.483 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:21:19.483 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:21:19.483 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:21:19.483 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:21:19.483 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:21:19.483 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:21:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:21:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.480+0000 7fa1ec6df640 1 -- 172.21.15.17:0/1248808517 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1d006e170 msgr2=0x7fa1d0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.480+0000 7fa1ec6df640 1 --2- 172.21.15.17:0/1248808517 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1d006e170 0x7fa1d0070630 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0000c00 tx=0x7fa1e0005a20 comp rx=0 tx=0).stop 2024-08-19T01:21:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.480+0000 7fa1ec6df640 1 -- 172.21.15.17:0/1248808517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e41049c0 msgr2=0x7fa1e419abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.480+0000 7fa1ec6df640 1 --2- 172.21.15.17:0/1248808517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e41049c0 0x7fa1e419abd0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa1d400c810 tx=0x7fa1d400ccd0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.480+0000 7fa1ec6df640 1 -- 172.21.15.17:0/1248808517 shutdown_connections 2024-08-19T01:21:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.480+0000 7fa1ec6df640 1 --2- 172.21.15.17:0/1248808517 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1d006e170 0x7fa1d0070630 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.480+0000 7fa1ec6df640 1 --2- 172.21.15.17:0/1248808517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa1e41049c0 0x7fa1e419abd0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.480+0000 7fa1ec6df640 1 --2- 172.21.15.17:0/1248808517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa1e40fe9c0 0x7fa1e419a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.480+0000 7fa1ec6df640 1 -- 172.21.15.17:0/1248808517 >> 172.21.15.17:0/1248808517 conn(0x7fa1e40fa6a0 msgr2=0x7fa1e40fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:19.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.481+0000 7fa1ec6df640 1 -- 172.21.15.17:0/1248808517 shutdown_connections 2024-08-19T01:21:19.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.481+0000 7fa1ec6df640 1 -- 172.21.15.17:0/1248808517 wait complete. 2024-08-19T01:21:19.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.564+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/157984427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101670 msgr2=0x7fb9b0109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.564+0000 7fb9b5b4d640 1 --2- 172.21.15.17:0/157984427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101670 0x7fb9b0109b60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb998009880 tx=0x7fb99802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.564+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/157984427 shutdown_connections 2024-08-19T01:21:19.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.564+0000 7fb9b5b4d640 1 --2- 172.21.15.17:0/157984427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0101670 0x7fb9b0109b60 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.564+0000 7fb9b5b4d640 1 --2- 172.21.15.17:0/157984427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9b0100d50 0x7fb9b0101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.564+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/157984427 >> 172.21.15.17:0/157984427 conn(0x7fb9b00fa730 msgr2=0x7fb9b00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:19.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.564+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/157984427 shutdown_connections 2024-08-19T01:21:19.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.564+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/157984427 wait complete. 2024-08-19T01:21:19.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.564+0000 7fb9b5b4d640 1 Processor -- start 2024-08-19T01:21:19.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9b5b4d640 1 -- start start 2024-08-19T01:21:19.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9b5b4d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0100d50 0x7fb9b019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:19.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9b5b4d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9b0101670 0x7fb9b019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:19.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9b5b4d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b019c380 con 0x7fb9b0100d50 2024-08-19T01:21:19.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9b5b4d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0195910 con 0x7fb9b0101670 2024-08-19T01:21:19.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9af7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0100d50 0x7fb9b019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:19.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9af7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0100d50 0x7fb9b019b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37812/0 (socket says 172.21.15.17:37812) 2024-08-19T01:21:19.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9af7fe640 1 -- 172.21.15.17:0/760041855 learned_addr learned my addr 172.21.15.17:0/760041855 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9a6ffd640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9b0101670 0x7fb9b019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9af7fe640 1 -- 172.21.15.17:0/760041855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9b0101670 msgr2=0x7fb9b019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9af7fe640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9b0101670 0x7fb9b019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9af7fe640 1 -- 172.21.15.17:0/760041855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb998009560 con 0x7fb9b0100d50 2024-08-19T01:21:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9a6ffd640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9b0101670 0x7fb9b019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:21:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.565+0000 7fb9af7fe640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0100d50 0x7fb9b019b820 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000d6f0 tx=0x7fb9a000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.566+0000 7fb9ad7fa640 1 -- 172.21.15.17:0/760041855 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a0009a30 con 0x7fb9b0100d50 2024-08-19T01:21:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.566+0000 7fb9ad7fa640 1 -- 172.21.15.17:0/760041855 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9a00054e0 con 0x7fb9b0100d50 2024-08-19T01:21:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.566+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/760041855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b0195bf0 con 0x7fb9b0100d50 2024-08-19T01:21:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.566+0000 7fb9ad7fa640 1 -- 172.21.15.17:0/760041855 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9a0010460 con 0x7fb9b0100d50 2024-08-19T01:21:19.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.566+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/760041855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b0196140 con 0x7fb9b0100d50 2024-08-19T01:21:19.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.567+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/760041855 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b0068cd0 con 0x7fb9b0100d50 2024-08-19T01:21:19.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.567+0000 7fb9ad7fa640 1 -- 172.21.15.17:0/760041855 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb9a00105c0 con 0x7fb9b0100d50 2024-08-19T01:21:19.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.568+0000 7fb9ad7fa640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb99c06e180 0x7fb99c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:19.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.568+0000 7fb9ad7fa640 1 -- 172.21.15.17:0/760041855 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb9a008dc70 con 0x7fb9b0100d50 2024-08-19T01:21:19.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.568+0000 7fb9a6ffd640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb99c06e180 0x7fb99c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:19.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.568+0000 7fb9a6ffd640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb99c06e180 0x7fb99c070640 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb998000c00 tx=0x7fb9980041a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:19.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.572+0000 7fb9ad7fa640 1 -- 172.21.15.17:0/760041855 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb9a0056fd0 con 0x7fb9b0100d50 2024-08-19T01:21:19.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.765+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/760041855 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b0104460 con 0x7fb99c06e180 2024-08-19T01:21:19.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.766+0000 7fb9ad7fa640 1 -- 172.21.15.17:0/760041855 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fb9b0104460 con 0x7fb99c06e180 2024-08-19T01:21:19.768 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:21:19.768 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:21:19.769 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:21:19.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.769+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/760041855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb99c06e180 msgr2=0x7fb99c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.769+0000 7fb9b5b4d640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb99c06e180 0x7fb99c070640 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb998000c00 tx=0x7fb9980041a0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.769+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/760041855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0100d50 msgr2=0x7fb9b019b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.769+0000 7fb9b5b4d640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0100d50 0x7fb9b019b820 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000d6f0 tx=0x7fb9a000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.769+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/760041855 shutdown_connections 2024-08-19T01:21:19.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.769+0000 7fb9b5b4d640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb99c06e180 0x7fb99c070640 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.769+0000 7fb9b5b4d640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9b0101670 0x7fb9b019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.769+0000 7fb9b5b4d640 1 --2- 172.21.15.17:0/760041855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9b0100d50 0x7fb9b019b820 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.769+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/760041855 >> 172.21.15.17:0/760041855 conn(0x7fb9b00fa730 msgr2=0x7fb9b0101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:19.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.769+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/760041855 shutdown_connections 2024-08-19T01:21:19.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.769+0000 7fb9b5b4d640 1 -- 172.21.15.17:0/760041855 wait complete. 2024-08-19T01:21:19.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.851+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3987661152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bf0101400 msgr2=0x7f5bf01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.851+0000 7f5bf5ba0640 1 --2- 172.21.15.17:0/3987661152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bf0101400 0x7f5bf01098f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009880 tx=0x7f5bdc02a530 comp rx=0 tx=0).stop 2024-08-19T01:21:19.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.851+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3987661152 shutdown_connections 2024-08-19T01:21:19.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.851+0000 7f5bf5ba0640 1 --2- 172.21.15.17:0/3987661152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bf0101400 0x7f5bf01098f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.851+0000 7f5bf5ba0640 1 --2- 172.21.15.17:0/3987661152 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5bf0100ae0 0x7f5bf0100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.851+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3987661152 >> 172.21.15.17:0/3987661152 conn(0x7f5bf00fa4e0 msgr2=0x7f5bf00fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.851+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3987661152 shutdown_connections 2024-08-19T01:21:19.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.851+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3987661152 wait complete. 2024-08-19T01:21:19.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf5ba0640 1 Processor -- start 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf5ba0640 1 -- start start 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf5ba0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bf0100ae0 0x7f5bf019b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf5ba0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5bf0101400 0x7f5bf019bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf5ba0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0195790 con 0x7f5bf0100ae0 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf5ba0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0195900 con 0x7f5bf0101400 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf4b9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bf0100ae0 0x7f5bf019b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf4b9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bf0100ae0 0x7f5bf019b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37824/0 (socket says 172.21.15.17:37824) 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf4b9e640 1 -- 172.21.15.17:0/3640757135 learned_addr learned my addr 172.21.15.17:0/3640757135 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5beffff640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5bf0101400 0x7f5bf019bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf4b9e640 1 -- 172.21.15.17:0/3640757135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5bf0101400 msgr2=0x7f5bf019bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf4b9e640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5bf0101400 0x7f5bf019bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5bf4b9e640 1 -- 172.21.15.17:0/3640757135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bdc009560 con 0x7f5bf0100ae0 2024-08-19T01:21:19.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.852+0000 7f5beffff640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5bf0101400 0x7f5bf019bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:21:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.853+0000 7f5bf4b9e640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bf0100ae0 0x7f5bf019b6a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5be400c8f0 tx=0x7f5be400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.853+0000 7f5bedffb640 1 -- 172.21.15.17:0/3640757135 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be4007b80 con 0x7f5bf0100ae0 2024-08-19T01:21:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.853+0000 7f5bedffb640 1 -- 172.21.15.17:0/3640757135 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5be40054e0 con 0x7f5bf0100ae0 2024-08-19T01:21:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.853+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3640757135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf0195be0 con 0x7f5bf0100ae0 2024-08-19T01:21:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.853+0000 7f5bedffb640 1 -- 172.21.15.17:0/3640757135 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be400f450 con 0x7f5bf0100ae0 2024-08-19T01:21:19.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.853+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3640757135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf0196130 con 0x7f5bf0100ae0 2024-08-19T01:21:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.854+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3640757135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf0068d30 con 0x7f5bf0100ae0 2024-08-19T01:21:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.854+0000 7f5bedffb640 1 -- 172.21.15.17:0/3640757135 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5be4004f60 con 0x7f5bf0100ae0 2024-08-19T01:21:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.855+0000 7f5bedffb640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5be006e180 0x7f5be0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.855+0000 7f5bedffb640 1 -- 172.21.15.17:0/3640757135 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5be408dff0 con 0x7f5bf0100ae0 2024-08-19T01:21:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.855+0000 7f5beffff640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5be006e180 0x7f5be0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:19.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.855+0000 7f5beffff640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5be006e180 0x7f5be0070640 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc000c00 tx=0x7f5bdc004280 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:19.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:19.859+0000 7f5bedffb640 1 -- 172.21.15.17:0/3640757135 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5be40572d0 con 0x7f5bf0100ae0 2024-08-19T01:21:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.101+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3640757135 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5bf0196ca0 con 0x7f5bf0100ae0 2024-08-19T01:21:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.102+0000 7f5bedffb640 1 -- 172.21.15.17:0/3640757135 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f5be405a990 con 0x7f5bf0100ae0 2024-08-19T01:21:20.104 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:21:20.104 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:21:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:21:20.104 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:21:20.104 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:21:20.104 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:21:20.104 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:21:20.105 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:21:20.106 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:21:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:21:20.106 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:21:20.106 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:21:20.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.104+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3640757135 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5be006e180 msgr2=0x7f5be0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:20.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.104+0000 7f5bf5ba0640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5be006e180 0x7f5be0070640 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc000c00 tx=0x7f5bdc004280 comp rx=0 tx=0).stop 2024-08-19T01:21:20.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.104+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3640757135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bf0100ae0 msgr2=0x7f5bf019b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.104+0000 7f5bf5ba0640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bf0100ae0 0x7f5bf019b6a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5be400c8f0 tx=0x7f5be400cdb0 comp rx=0 tx=0).stop 2024-08-19T01:21:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.105+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3640757135 shutdown_connections 2024-08-19T01:21:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.105+0000 7f5bf5ba0640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5be006e180 0x7f5be0070640 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.105+0000 7f5bf5ba0640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5bf0101400 0x7f5bf019bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.105+0000 7f5bf5ba0640 1 --2- 172.21.15.17:0/3640757135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5bf0100ae0 0x7f5bf019b6a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.105+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3640757135 >> 172.21.15.17:0/3640757135 conn(0x7f5bf00fa4e0 msgr2=0x7f5bf0101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.105+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3640757135 shutdown_connections 2024-08-19T01:21:20.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:20.105+0000 7f5bf5ba0640 1 -- 172.21.15.17:0/3640757135 wait complete. 2024-08-19T01:21:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:20 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2514567281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:21:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:20 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1248808517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:21:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:20 smithi017 ceph-mon[99370]: from='client.35290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:20 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3640757135' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:21:20.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:20 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2514567281' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:21:20.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:20 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1248808517' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:21:20.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:20 smithi086 ceph-mon[71303]: from='client.35290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:20.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:20 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3640757135' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:21:21.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:21 smithi017 ceph-mon[99370]: pgmap v678: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:21.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:21 smithi086 ceph-mon[71303]: pgmap v678: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:23.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:23 smithi017 ceph-mon[99370]: pgmap v679: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:23.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:23 smithi086 ceph-mon[71303]: pgmap v679: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:25.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:25 smithi017 ceph-mon[99370]: pgmap v680: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:25.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:25 smithi086 ceph-mon[71303]: pgmap v680: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:27.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:27 smithi017 ceph-mon[99370]: pgmap v681: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:27.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:27 smithi086 ceph-mon[71303]: pgmap v681: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:29.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:29 smithi017 ceph-mon[99370]: pgmap v682: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:29.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:29 smithi086 ceph-mon[71303]: pgmap v682: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:31.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:31 smithi017 ceph-mon[99370]: pgmap v683: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:31.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:31 smithi086 ceph-mon[71303]: pgmap v683: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:33 smithi086 ceph-mon[71303]: pgmap v684: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:21:33.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:33 smithi017 ceph-mon[99370]: pgmap v684: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:33.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:21:35.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:35 smithi017 ceph-mon[99370]: pgmap v685: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:35 smithi086 ceph-mon[71303]: pgmap v685: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:37 smithi086 ceph-mon[71303]: pgmap v686: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:37.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:37 smithi017 ceph-mon[99370]: pgmap v686: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:39 smithi086 ceph-mon[71303]: pgmap v687: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:39.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:39 smithi017 ceph-mon[99370]: pgmap v687: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:41.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:41 smithi086 ceph-mon[71303]: pgmap v688: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:41.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:41 smithi017 ceph-mon[99370]: pgmap v688: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:43.619 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:43 smithi086 ceph-mon[71303]: pgmap v689: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:43.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:43 smithi017 ceph-mon[99370]: pgmap v689: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:45.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:45 smithi017 ceph-mon[99370]: pgmap v690: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:45.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:45 smithi086 ceph-mon[71303]: pgmap v690: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:47.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:47 smithi017 ceph-mon[99370]: pgmap v691: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:47.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:47 smithi086 ceph-mon[71303]: pgmap v691: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:48.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:21:48.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:21:49.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:49 smithi017 ceph-mon[99370]: pgmap v692: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:49.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:49 smithi086 ceph-mon[71303]: pgmap v692: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:50.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.195+0000 7f496b214640 1 -- 172.21.15.17:0/1557381831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49640ffb40 msgr2=0x7f49640fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.195+0000 7f496b214640 1 --2- 172.21.15.17:0/1557381831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49640ffb40 0x7f49640fffa0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4950009880 tx=0x7f495002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.195+0000 7f496b214640 1 -- 172.21.15.17:0/1557381831 shutdown_connections 2024-08-19T01:21:50.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.195+0000 7f496b214640 1 --2- 172.21.15.17:0/1557381831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49640ffb40 0x7f49640fffa0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.195+0000 7f496b214640 1 --2- 172.21.15.17:0/1557381831 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4964105bf0 0x7f4964105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.195+0000 7f496b214640 1 -- 172.21.15.17:0/1557381831 >> 172.21.15.17:0/1557381831 conn(0x7f49640fb860 msgr2=0x7f49640fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:50.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.195+0000 7f496b214640 1 -- 172.21.15.17:0/1557381831 shutdown_connections 2024-08-19T01:21:50.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.195+0000 7f496b214640 1 -- 172.21.15.17:0/1557381831 wait complete. 2024-08-19T01:21:50.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f496b214640 1 Processor -- start 2024-08-19T01:21:50.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f496b214640 1 -- start start 2024-08-19T01:21:50.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f496b214640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49640ffb40 0x7f496419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:50.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f496b214640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4964105bf0 0x7f496419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:50.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f496b214640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496419c340 con 0x7f4964105bf0 2024-08-19T01:21:50.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f496b214640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49641958d0 con 0x7f49640ffb40 2024-08-19T01:21:50.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f4963fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4964105bf0 0x7f496419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:50.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f4963fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4964105bf0 0x7f496419bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38308/0 (socket says 172.21.15.17:38308) 2024-08-19T01:21:50.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f4963fff640 1 -- 172.21.15.17:0/1941773049 learned_addr learned my addr 172.21.15.17:0/1941773049 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:50.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f4968fb0640 1 --2- 172.21.15.17:0/1941773049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49640ffb40 0x7f496419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:50.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f4963fff640 1 -- 172.21.15.17:0/1941773049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49640ffb40 msgr2=0x7f496419b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f4963fff640 1 --2- 172.21.15.17:0/1941773049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49640ffb40 0x7f496419b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.196+0000 7f4963fff640 1 -- 172.21.15.17:0/1941773049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4950009560 con 0x7f4964105bf0 2024-08-19T01:21:50.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.197+0000 7f4963fff640 1 --2- 172.21.15.17:0/1941773049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4964105bf0 0x7f496419bd20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f495002a9c0 tx=0x7f49500055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.197+0000 7f4961ffb640 1 -- 172.21.15.17:0/1941773049 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4950004aa0 con 0x7f4964105bf0 2024-08-19T01:21:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.197+0000 7f496b214640 1 -- 172.21.15.17:0/1941773049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4964195b50 con 0x7f4964105bf0 2024-08-19T01:21:50.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.197+0000 7f4961ffb640 1 -- 172.21.15.17:0/1941773049 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4950004c00 con 0x7f4964105bf0 2024-08-19T01:21:50.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.197+0000 7f4961ffb640 1 -- 172.21.15.17:0/1941773049 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4950003980 con 0x7f4964105bf0 2024-08-19T01:21:50.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.197+0000 7f496b214640 1 -- 172.21.15.17:0/1941773049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4964196040 con 0x7f4964105bf0 2024-08-19T01:21:50.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.198+0000 7f496b214640 1 -- 172.21.15.17:0/1941773049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49641011f0 con 0x7f4964105bf0 2024-08-19T01:21:50.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.199+0000 7f4961ffb640 1 -- 172.21.15.17:0/1941773049 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4950003bf0 con 0x7f4964105bf0 2024-08-19T01:21:50.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.199+0000 7f4961ffb640 1 --2- 172.21.15.17:0/1941773049 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f495406e170 0x7f4954070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:50.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.199+0000 7f4961ffb640 1 -- 172.21.15.17:0/1941773049 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f49500af210 con 0x7f4964105bf0 2024-08-19T01:21:50.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.199+0000 7f4968fb0640 1 --2- 172.21.15.17:0/1941773049 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f495406e170 0x7f4954070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:50.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.200+0000 7f4968fb0640 1 --2- 172.21.15.17:0/1941773049 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f495406e170 0x7f4954070630 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4958005d00 tx=0x7f4958005c50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:50.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.204+0000 7f4961ffb640 1 -- 172.21.15.17:0/1941773049 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f49500784f0 con 0x7f4964105bf0 2024-08-19T01:21:50.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.399+0000 7f496b214640 1 -- 172.21.15.17:0/1941773049 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f496410cd90 con 0x7f495406e170 2024-08-19T01:21:50.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.400+0000 7f4961ffb640 1 -- 172.21.15.17:0/1941773049 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f496410cd90 con 0x7f495406e170 2024-08-19T01:21:50.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.402+0000 7f496b214640 1 -- 172.21.15.17:0/1941773049 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f495406e170 msgr2=0x7f4954070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.402+0000 7f496b214640 1 --2- 172.21.15.17:0/1941773049 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f495406e170 0x7f4954070630 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4958005d00 tx=0x7f4958005c50 comp rx=0 tx=0).stop 2024-08-19T01:21:50.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.402+0000 7f496b214640 1 -- 172.21.15.17:0/1941773049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4964105bf0 msgr2=0x7f496419bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.402+0000 7f496b214640 1 --2- 172.21.15.17:0/1941773049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4964105bf0 0x7f496419bd20 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f495002a9c0 tx=0x7f49500055a0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.402+0000 7f496b214640 1 -- 172.21.15.17:0/1941773049 shutdown_connections 2024-08-19T01:21:50.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.402+0000 7f496b214640 1 --2- 172.21.15.17:0/1941773049 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f495406e170 0x7f4954070630 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.402+0000 7f496b214640 1 --2- 172.21.15.17:0/1941773049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4964105bf0 0x7f496419bd20 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.402+0000 7f496b214640 1 --2- 172.21.15.17:0/1941773049 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49640ffb40 0x7f496419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.402+0000 7f496b214640 1 -- 172.21.15.17:0/1941773049 >> 172.21.15.17:0/1941773049 conn(0x7f49640fb860 msgr2=0x7f49640fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:50.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.402+0000 7f496b214640 1 -- 172.21.15.17:0/1941773049 shutdown_connections 2024-08-19T01:21:50.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.402+0000 7f496b214640 1 -- 172.21.15.17:0/1941773049 wait complete. 2024-08-19T01:21:50.413 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:21:50.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.485+0000 7fa77f625640 1 -- 172.21.15.17:0/1075905521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778100750 msgr2=0x7fa7781047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.485+0000 7fa77f625640 1 --2- 172.21.15.17:0/1075905521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778100750 0x7fa7781047a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009880 tx=0x7fa76c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.485+0000 7fa77f625640 1 -- 172.21.15.17:0/1075905521 shutdown_connections 2024-08-19T01:21:50.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.485+0000 7fa77f625640 1 --2- 172.21.15.17:0/1075905521 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778100750 0x7fa7781047a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.485+0000 7fa77f625640 1 --2- 172.21.15.17:0/1075905521 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7780ffda0 0x7fa778100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.485+0000 7fa77f625640 1 -- 172.21.15.17:0/1075905521 >> 172.21.15.17:0/1075905521 conn(0x7fa7780fb840 msgr2=0x7fa7780fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:50.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.486+0000 7fa77f625640 1 -- 172.21.15.17:0/1075905521 shutdown_connections 2024-08-19T01:21:50.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.486+0000 7fa77f625640 1 -- 172.21.15.17:0/1075905521 wait complete. 2024-08-19T01:21:50.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.486+0000 7fa77f625640 1 Processor -- start 2024-08-19T01:21:50.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.486+0000 7fa77f625640 1 -- start start 2024-08-19T01:21:50.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77f625640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7780ffda0 0x7fa77819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:50.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77f625640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778100750 0x7fa77819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:50.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77f625640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa778195930 con 0x7fa778100750 2024-08-19T01:21:50.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77f625640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa778195a70 con 0x7fa7780ffda0 2024-08-19T01:21:50.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77cbc0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778100750 0x7fa77819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77cbc0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778100750 0x7fa77819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38318/0 (socket says 172.21.15.17:38318) 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77cbc0640 1 -- 172.21.15.17:0/2867769952 learned_addr learned my addr 172.21.15.17:0/2867769952 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77d3c1640 1 --2- 172.21.15.17:0/2867769952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7780ffda0 0x7fa77819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77cbc0640 1 -- 172.21.15.17:0/2867769952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7780ffda0 msgr2=0x7fa77819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77cbc0640 1 --2- 172.21.15.17:0/2867769952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7780ffda0 0x7fa77819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77cbc0640 1 -- 172.21.15.17:0/2867769952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c009560 con 0x7fa778100750 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.487+0000 7fa77cbc0640 1 --2- 172.21.15.17:0/2867769952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778100750 0x7fa77819be10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa76c02a9c0 tx=0x7fa76c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.488+0000 7fa7767fc640 1 -- 172.21.15.17:0/2867769952 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76c004aa0 con 0x7fa778100750 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.488+0000 7fa7767fc640 1 -- 172.21.15.17:0/2867769952 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa76c004c00 con 0x7fa778100750 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.488+0000 7fa77f625640 1 -- 172.21.15.17:0/2867769952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa778195cf0 con 0x7fa778100750 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.488+0000 7fa7767fc640 1 -- 172.21.15.17:0/2867769952 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76c003980 con 0x7fa778100750 2024-08-19T01:21:50.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.488+0000 7fa77f625640 1 -- 172.21.15.17:0/2867769952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7781961e0 con 0x7fa778100750 2024-08-19T01:21:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.489+0000 7fa77f625640 1 -- 172.21.15.17:0/2867769952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa778101280 con 0x7fa778100750 2024-08-19T01:21:50.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.489+0000 7fa7767fc640 1 -- 172.21.15.17:0/2867769952 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa76c003b00 con 0x7fa778100750 2024-08-19T01:21:50.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.490+0000 7fa7767fc640 1 --2- 172.21.15.17:0/2867769952 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa76006e170 0x7fa760070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:50.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.490+0000 7fa7767fc640 1 -- 172.21.15.17:0/2867769952 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa76c0af0b0 con 0x7fa778100750 2024-08-19T01:21:50.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.490+0000 7fa77d3c1640 1 --2- 172.21.15.17:0/2867769952 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa76006e170 0x7fa760070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:50.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.490+0000 7fa77d3c1640 1 --2- 172.21.15.17:0/2867769952 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa76006e170 0x7fa760070630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa768005fd0 tx=0x7fa768009680 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:50.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.494+0000 7fa7767fc640 1 -- 172.21.15.17:0/2867769952 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa76c0784c0 con 0x7fa778100750 2024-08-19T01:21:50.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.686+0000 7fa77f625640 1 -- 172.21.15.17:0/2867769952 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa77810cdd0 con 0x7fa76006e170 2024-08-19T01:21:50.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.687+0000 7fa7767fc640 1 -- 172.21.15.17:0/2867769952 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa77810cdd0 con 0x7fa76006e170 2024-08-19T01:21:50.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.689+0000 7fa77f625640 1 -- 172.21.15.17:0/2867769952 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa76006e170 msgr2=0x7fa760070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.689+0000 7fa77f625640 1 --2- 172.21.15.17:0/2867769952 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa76006e170 0x7fa760070630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa768005fd0 tx=0x7fa768009680 comp rx=0 tx=0).stop 2024-08-19T01:21:50.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.689+0000 7fa77f625640 1 -- 172.21.15.17:0/2867769952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778100750 msgr2=0x7fa77819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.689+0000 7fa77f625640 1 --2- 172.21.15.17:0/2867769952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778100750 0x7fa77819be10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa76c02a9c0 tx=0x7fa76c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.689+0000 7fa77f625640 1 -- 172.21.15.17:0/2867769952 shutdown_connections 2024-08-19T01:21:50.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.689+0000 7fa77f625640 1 --2- 172.21.15.17:0/2867769952 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa76006e170 0x7fa760070630 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.689+0000 7fa77f625640 1 --2- 172.21.15.17:0/2867769952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa778100750 0x7fa77819be10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.689+0000 7fa77f625640 1 --2- 172.21.15.17:0/2867769952 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa7780ffda0 0x7fa77819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.689+0000 7fa77f625640 1 -- 172.21.15.17:0/2867769952 >> 172.21.15.17:0/2867769952 conn(0x7fa7780fb840 msgr2=0x7fa7780fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:50.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.689+0000 7fa77f625640 1 -- 172.21.15.17:0/2867769952 shutdown_connections 2024-08-19T01:21:50.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.689+0000 7fa77f625640 1 -- 172.21.15.17:0/2867769952 wait complete. 2024-08-19T01:21:50.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.771+0000 7f5158b81640 1 -- 172.21.15.17:0/4046374656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154100750 msgr2=0x7f51541047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.771+0000 7f5158b81640 1 --2- 172.21.15.17:0/4046374656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154100750 0x7f51541047a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5144009880 tx=0x7f514402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.771+0000 7f5158b81640 1 -- 172.21.15.17:0/4046374656 shutdown_connections 2024-08-19T01:21:50.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.771+0000 7f5158b81640 1 --2- 172.21.15.17:0/4046374656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154100750 0x7f51541047a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.771+0000 7f5158b81640 1 --2- 172.21.15.17:0/4046374656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51540ffda0 0x7f5154100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.771+0000 7f5158b81640 1 -- 172.21.15.17:0/4046374656 >> 172.21.15.17:0/4046374656 conn(0x7f51540fb840 msgr2=0x7f51540fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:50.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.771+0000 7f5158b81640 1 -- 172.21.15.17:0/4046374656 shutdown_connections 2024-08-19T01:21:50.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.771+0000 7f5158b81640 1 -- 172.21.15.17:0/4046374656 wait complete. 2024-08-19T01:21:50.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5158b81640 1 Processor -- start 2024-08-19T01:21:50.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5158b81640 1 -- start start 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5158b81640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51540ffda0 0x7f51540727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5158b81640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154100750 0x7f5154072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5158b81640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5154074780 con 0x7f5154100750 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5158b81640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5154073230 con 0x7f51540ffda0 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5151d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154100750 0x7f5154072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5151d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154100750 0x7f5154072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38342/0 (socket says 172.21.15.17:38342) 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5151d9b640 1 -- 172.21.15.17:0/766733692 learned_addr learned my addr 172.21.15.17:0/766733692 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f515259c640 1 --2- 172.21.15.17:0/766733692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51540ffda0 0x7f51540727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5151d9b640 1 -- 172.21.15.17:0/766733692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51540ffda0 msgr2=0x7f51540727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5151d9b640 1 --2- 172.21.15.17:0/766733692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51540ffda0 0x7f51540727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.772+0000 7f5151d9b640 1 -- 172.21.15.17:0/766733692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144009560 con 0x7f5154100750 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.773+0000 7f5151d9b640 1 --2- 172.21.15.17:0/766733692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154100750 0x7f5154072cf0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f514402a9c0 tx=0x7f51440055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:50.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.773+0000 7f514b7fe640 1 -- 172.21.15.17:0/766733692 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5144004aa0 con 0x7f5154100750 2024-08-19T01:21:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.773+0000 7f5158b81640 1 -- 172.21.15.17:0/766733692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51540734b0 con 0x7f5154100750 2024-08-19T01:21:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.773+0000 7f514b7fe640 1 -- 172.21.15.17:0/766733692 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5144004c00 con 0x7f5154100750 2024-08-19T01:21:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.773+0000 7f514b7fe640 1 -- 172.21.15.17:0/766733692 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5144003a20 con 0x7f5154100750 2024-08-19T01:21:50.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.773+0000 7f5158b81640 1 -- 172.21.15.17:0/766733692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51541a1eb0 con 0x7f5154100750 2024-08-19T01:21:50.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.775+0000 7f5158b81640 1 -- 172.21.15.17:0/766733692 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5154101280 con 0x7f5154100750 2024-08-19T01:21:50.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.775+0000 7f514b7fe640 1 -- 172.21.15.17:0/766733692 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5144031c90 con 0x7f5154100750 2024-08-19T01:21:50.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.775+0000 7f514b7fe640 1 --2- 172.21.15.17:0/766733692 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f514006e170 0x7f5140070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:50.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.775+0000 7f514b7fe640 1 -- 172.21.15.17:0/766733692 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f51440af240 con 0x7f5154100750 2024-08-19T01:21:50.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.775+0000 7f515259c640 1 --2- 172.21.15.17:0/766733692 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f514006e170 0x7f5140070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:50.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.776+0000 7f515259c640 1 --2- 172.21.15.17:0/766733692 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f514006e170 0x7f5140070630 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f513c00abe0 tx=0x7f513c00a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:50.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.780+0000 7f514b7fe640 1 -- 172.21.15.17:0/766733692 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5144078520 con 0x7f5154100750 2024-08-19T01:21:50.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.962+0000 7f5158b81640 1 -- 172.21.15.17:0/766733692 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f515410cdb0 con 0x7f514006e170 2024-08-19T01:21:50.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.972+0000 7f514b7fe640 1 -- 172.21.15.17:0/766733692 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f515410cdb0 con 0x7f514006e170 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (23m) 97s ago 33m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (34m) 97s ago 34m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (33m) 99s ago 33m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (20m) 97s ago 33m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (20m) 99s ago 32m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (22m) 97s ago 33m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (17m) 97s ago 28m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (17m) 97s ago 28m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (103s) 99s ago 28m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (16m) 99s ago 28m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (25m) 97s ago 35m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:21:50.974 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (23m) 99s ago 32m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:21:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (21m) 97s ago 35m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:21:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (21m) 99s ago 32m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:21:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (23m) 97s ago 33m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:21:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (23m) 99s ago 32m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:21:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (20m) 97s ago 31m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:21:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (19m) 97s ago 31m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:21:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (19m) 97s ago 31m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:21:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (18m) 99s ago 30m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:21:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (18m) 99s ago 30m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:21:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (17m) 99s ago 29m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:21:50.975 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (23m) 97s ago 33m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:21:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.973+0000 7f5158b81640 1 -- 172.21.15.17:0/766733692 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f514006e170 msgr2=0x7f5140070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.973+0000 7f5158b81640 1 --2- 172.21.15.17:0/766733692 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f514006e170 0x7f5140070630 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f513c00abe0 tx=0x7f513c00a2d0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.973+0000 7f5158b81640 1 -- 172.21.15.17:0/766733692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154100750 msgr2=0x7f5154072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.973+0000 7f5158b81640 1 --2- 172.21.15.17:0/766733692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154100750 0x7f5154072cf0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f514402a9c0 tx=0x7f51440055a0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.974+0000 7f5158b81640 1 -- 172.21.15.17:0/766733692 shutdown_connections 2024-08-19T01:21:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.974+0000 7f5158b81640 1 --2- 172.21.15.17:0/766733692 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f514006e170 0x7f5140070630 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.974+0000 7f5158b81640 1 --2- 172.21.15.17:0/766733692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5154100750 0x7f5154072cf0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.974+0000 7f5158b81640 1 --2- 172.21.15.17:0/766733692 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51540ffda0 0x7f51540727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.974+0000 7f5158b81640 1 -- 172.21.15.17:0/766733692 >> 172.21.15.17:0/766733692 conn(0x7f51540fb840 msgr2=0x7f51540fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.974+0000 7f5158b81640 1 -- 172.21.15.17:0/766733692 shutdown_connections 2024-08-19T01:21:50.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:50.974+0000 7f5158b81640 1 -- 172.21.15.17:0/766733692 wait complete. 2024-08-19T01:21:51.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.055+0000 7f9fbf572640 1 -- 172.21.15.17:0/268885395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8104a30 msgr2=0x7f9fb8104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.055+0000 7f9fbf572640 1 --2- 172.21.15.17:0/268885395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8104a30 0x7f9fb8104e10 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009880 tx=0x7f9fb402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.055+0000 7f9fbf572640 1 -- 172.21.15.17:0/268885395 shutdown_connections 2024-08-19T01:21:51.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.055+0000 7f9fbf572640 1 --2- 172.21.15.17:0/268885395 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fb80fea30 0x7f9fb80fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.055+0000 7f9fbf572640 1 --2- 172.21.15.17:0/268885395 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8104a30 0x7f9fb8104e10 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.055+0000 7f9fbf572640 1 -- 172.21.15.17:0/268885395 >> 172.21.15.17:0/268885395 conn(0x7f9fb80fa730 msgr2=0x7f9fb80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.055+0000 7f9fbf572640 1 -- 172.21.15.17:0/268885395 shutdown_connections 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.055+0000 7f9fbf572640 1 -- 172.21.15.17:0/268885395 wait complete. 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.056+0000 7f9fbf572640 1 Processor -- start 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.056+0000 7f9fbf572640 1 -- start start 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.056+0000 7f9fbf572640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fb80fea30 0x7f9fb819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.056+0000 7f9fbf572640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8104a30 0x7f9fb819bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.056+0000 7f9fbf572640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb819c520 con 0x7f9fb8104a30 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.056+0000 7f9fbf572640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8195ab0 con 0x7f9fb80fea30 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.056+0000 7f9fbcb0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8104a30 0x7f9fb819bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.056+0000 7f9fbcb0d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8104a30 0x7f9fb819bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38360/0 (socket says 172.21.15.17:38360) 2024-08-19T01:21:51.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.056+0000 7f9fbcb0d640 1 -- 172.21.15.17:0/1502475313 learned_addr learned my addr 172.21.15.17:0/1502475313 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:51.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.056+0000 7f9fbd30e640 1 --2- 172.21.15.17:0/1502475313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fb80fea30 0x7f9fb819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.057+0000 7f9fbcb0d640 1 -- 172.21.15.17:0/1502475313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fb80fea30 msgr2=0x7f9fb819b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.057+0000 7f9fbcb0d640 1 --2- 172.21.15.17:0/1502475313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fb80fea30 0x7f9fb819b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.057+0000 7f9fbcb0d640 1 -- 172.21.15.17:0/1502475313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb4009560 con 0x7f9fb8104a30 2024-08-19T01:21:51.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.057+0000 7f9fbcb0d640 1 --2- 172.21.15.17:0/1502475313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8104a30 0x7f9fb819bf00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800b420 tx=0x7f9fa800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:51.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.057+0000 7f9fae7fc640 1 -- 172.21.15.17:0/1502475313 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fa8011800 con 0x7f9fb8104a30 2024-08-19T01:21:51.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.057+0000 7f9fae7fc640 1 -- 172.21.15.17:0/1502475313 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fa8011e20 con 0x7f9fb8104a30 2024-08-19T01:21:51.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.057+0000 7f9fae7fc640 1 -- 172.21.15.17:0/1502475313 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fa800f2e0 con 0x7f9fb8104a30 2024-08-19T01:21:51.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.057+0000 7f9fbf572640 1 -- 172.21.15.17:0/1502475313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb8195d90 con 0x7f9fb8104a30 2024-08-19T01:21:51.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.057+0000 7f9fbf572640 1 -- 172.21.15.17:0/1502475313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb81962e0 con 0x7f9fb8104a30 2024-08-19T01:21:51.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.058+0000 7f9fbf572640 1 -- 172.21.15.17:0/1502475313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb8100170 con 0x7f9fb8104a30 2024-08-19T01:21:51.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.059+0000 7f9fae7fc640 1 -- 172.21.15.17:0/1502475313 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9fa8010380 con 0x7f9fb8104a30 2024-08-19T01:21:51.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.060+0000 7f9fae7fc640 1 --2- 172.21.15.17:0/1502475313 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fa406e170 0x7f9fa4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.060+0000 7f9fbd30e640 1 --2- 172.21.15.17:0/1502475313 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fa406e170 0x7f9fa4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.060+0000 7f9fae7fc640 1 -- 172.21.15.17:0/1502475313 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9fa808d990 con 0x7f9fb8104a30 2024-08-19T01:21:51.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.060+0000 7f9fbd30e640 1 --2- 172.21.15.17:0/1502475313 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fa406e170 0x7f9fa4070630 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009230 tx=0x7f9fb40058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:51.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.064+0000 7f9fae7fc640 1 -- 172.21.15.17:0/1502475313 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9fa8056cf0 con 0x7f9fb8104a30 2024-08-19T01:21:51.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.308+0000 7f9fbf572640 1 -- 172.21.15.17:0/1502475313 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9fb80fef10 con 0x7f9fb8104a30 2024-08-19T01:21:51.311 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:51 smithi017 ceph-mon[99370]: pgmap v693: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:51.311 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:51 smithi017 ceph-mon[99370]: from='client.35298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:51.311 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:51 smithi017 ceph-mon[99370]: from='client.35302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:51.311 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:51 smithi017 ceph-mon[99370]: from='client.35306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:51.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.309+0000 7f9fae7fc640 1 -- 172.21.15.17:0/1502475313 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f9fa805a3b0 con 0x7f9fb8104a30 2024-08-19T01:21:51.312 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:21:51.312 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:21:51.312 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:21:51.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:21:51.312 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:21:51.312 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:21:51.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:21:51.312 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:21:51.312 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:21:51.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:21:51.313 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:21:51.313 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:21:51.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:21:51.313 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:21:51.313 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:21:51.313 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:21:51.313 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:21:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.311+0000 7f9fbf572640 1 -- 172.21.15.17:0/1502475313 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fa406e170 msgr2=0x7f9fa4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.311+0000 7f9fbf572640 1 --2- 172.21.15.17:0/1502475313 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fa406e170 0x7f9fa4070630 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009230 tx=0x7f9fb40058d0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.311+0000 7f9fbf572640 1 -- 172.21.15.17:0/1502475313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8104a30 msgr2=0x7f9fb819bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.311+0000 7f9fbf572640 1 --2- 172.21.15.17:0/1502475313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8104a30 0x7f9fb819bf00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9fa800b420 tx=0x7f9fa800b8e0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.311+0000 7f9fbf572640 1 -- 172.21.15.17:0/1502475313 shutdown_connections 2024-08-19T01:21:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.311+0000 7f9fbf572640 1 --2- 172.21.15.17:0/1502475313 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9fa406e170 0x7f9fa4070630 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.311+0000 7f9fbf572640 1 --2- 172.21.15.17:0/1502475313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fb8104a30 0x7f9fb819bf00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.311+0000 7f9fbf572640 1 --2- 172.21.15.17:0/1502475313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9fb80fea30 0x7f9fb819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.311+0000 7f9fbf572640 1 -- 172.21.15.17:0/1502475313 >> 172.21.15.17:0/1502475313 conn(0x7f9fb80fa730 msgr2=0x7f9fb80fb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:51.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.311+0000 7f9fbf572640 1 -- 172.21.15.17:0/1502475313 shutdown_connections 2024-08-19T01:21:51.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.311+0000 7f9fbf572640 1 -- 172.21.15.17:0/1502475313 wait complete. 2024-08-19T01:21:51.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.393+0000 7fd6e0303640 1 -- 172.21.15.17:0/2330419550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6d8104a30 msgr2=0x7fd6d8104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.393+0000 7fd6e0303640 1 --2- 172.21.15.17:0/2330419550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6d8104a30 0x7fd6d8104e10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4009880 tx=0x7fd6d402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.393+0000 7fd6e0303640 1 -- 172.21.15.17:0/2330419550 shutdown_connections 2024-08-19T01:21:51.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.393+0000 7fd6e0303640 1 --2- 172.21.15.17:0/2330419550 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6d80fea30 0x7fd6d80fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.393+0000 7fd6e0303640 1 --2- 172.21.15.17:0/2330419550 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6d8104a30 0x7fd6d8104e10 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.393+0000 7fd6e0303640 1 -- 172.21.15.17:0/2330419550 >> 172.21.15.17:0/2330419550 conn(0x7fd6d80fa730 msgr2=0x7fd6d80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.393+0000 7fd6e0303640 1 -- 172.21.15.17:0/2330419550 shutdown_connections 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.393+0000 7fd6e0303640 1 -- 172.21.15.17:0/2330419550 wait complete. 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6e0303640 1 Processor -- start 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6e0303640 1 -- start start 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6e0303640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6d80fea30 0x7fd6d81099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6e0303640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6d8104a30 0x7fd6d8109f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6e0303640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d810a440 con 0x7fd6d80fea30 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6e0303640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d810a5b0 con 0x7fd6d8104a30 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6de09f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6d80fea30 0x7fd6d81099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6de09f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6d80fea30 0x7fd6d81099c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38378/0 (socket says 172.21.15.17:38378) 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6de09f640 1 -- 172.21.15.17:0/1727373468 learned_addr learned my addr 172.21.15.17:0/1727373468 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6dd89e640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6d8104a30 0x7fd6d8109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6de09f640 1 -- 172.21.15.17:0/1727373468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6d8104a30 msgr2=0x7fd6d8109f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6de09f640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6d8104a30 0x7fd6d8109f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6de09f640 1 -- 172.21.15.17:0/1727373468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d4009560 con 0x7fd6d80fea30 2024-08-19T01:21:51.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6dd89e640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6d8104a30 0x7fd6d8109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:21:51.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.394+0000 7fd6de09f640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6d80fea30 0x7fd6d81099c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd6d402a9c0 tx=0x7fd6d40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:51.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.395+0000 7fd6cb7fe640 1 -- 172.21.15.17:0/1727373468 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6d4004aa0 con 0x7fd6d80fea30 2024-08-19T01:21:51.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.395+0000 7fd6cb7fe640 1 -- 172.21.15.17:0/1727373468 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6d4004c00 con 0x7fd6d80fea30 2024-08-19T01:21:51.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.395+0000 7fd6e0303640 1 -- 172.21.15.17:0/1727373468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d810a830 con 0x7fd6d80fea30 2024-08-19T01:21:51.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.395+0000 7fd6cb7fe640 1 -- 172.21.15.17:0/1727373468 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6d4003980 con 0x7fd6d80fea30 2024-08-19T01:21:51.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.395+0000 7fd6e0303640 1 -- 172.21.15.17:0/1727373468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d81a1f70 con 0x7fd6d80fea30 2024-08-19T01:21:51.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.396+0000 7fd6e0303640 1 -- 172.21.15.17:0/1727373468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d8100170 con 0x7fd6d80fea30 2024-08-19T01:21:51.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.396+0000 7fd6cb7fe640 1 -- 172.21.15.17:0/1727373468 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd6d4003b20 con 0x7fd6d80fea30 2024-08-19T01:21:51.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.396+0000 7fd6cb7fe640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6c406e170 0x7fd6c4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.397+0000 7fd6cb7fe640 1 -- 172.21.15.17:0/1727373468 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd6d40aefd0 con 0x7fd6d80fea30 2024-08-19T01:21:51.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.397+0000 7fd6dd89e640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6c406e170 0x7fd6c4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.397+0000 7fd6dd89e640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6c406e170 0x7fd6c4070630 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0058c0 tx=0x7fd6cc005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:51.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.401+0000 7fd6cb7fe640 1 -- 172.21.15.17:0/1727373468 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd6d4078330 con 0x7fd6d80fea30 2024-08-19T01:21:51.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.614+0000 7fd6e0303640 1 -- 172.21.15.17:0/1727373468 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd6d810a830 con 0x7fd6d80fea30 2024-08-19T01:21:51.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.615+0000 7fd6cb7fe640 1 -- 172.21.15.17:0/1727373468 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7fd6d810a830 con 0x7fd6d80fea30 2024-08-19T01:21:51.617 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:21:51.617 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:21:51.617 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:21:51.617 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:21:51.617 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:21:51.617 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:21:51.617 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:21:51.617 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:21:51.617 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:21:51.618 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:21:51.619 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:21:51.620 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:21:51.620 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:21:51.620 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:21:51.620 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:21:51.620 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:21:51.620 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:21:51.620 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:21:51.620 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:21:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:21:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.617+0000 7fd6e0303640 1 -- 172.21.15.17:0/1727373468 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6c406e170 msgr2=0x7fd6c4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.617+0000 7fd6e0303640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6c406e170 0x7fd6c4070630 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0058c0 tx=0x7fd6cc005850 comp rx=0 tx=0).stop 2024-08-19T01:21:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.617+0000 7fd6e0303640 1 -- 172.21.15.17:0/1727373468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6d80fea30 msgr2=0x7fd6d81099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.617+0000 7fd6e0303640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6d80fea30 0x7fd6d81099c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd6d402a9c0 tx=0x7fd6d40055a0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.617+0000 7fd6e0303640 1 -- 172.21.15.17:0/1727373468 shutdown_connections 2024-08-19T01:21:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.617+0000 7fd6e0303640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6c406e170 0x7fd6c4070630 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.617+0000 7fd6e0303640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6d8104a30 0x7fd6d8109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.617+0000 7fd6e0303640 1 --2- 172.21.15.17:0/1727373468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6d80fea30 0x7fd6d81099c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.617+0000 7fd6e0303640 1 -- 172.21.15.17:0/1727373468 >> 172.21.15.17:0/1727373468 conn(0x7fd6d80fa730 msgr2=0x7fd6d80fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.617+0000 7fd6e0303640 1 -- 172.21.15.17:0/1727373468 shutdown_connections 2024-08-19T01:21:51.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.617+0000 7fd6e0303640 1 -- 172.21.15.17:0/1727373468 wait complete. 2024-08-19T01:21:51.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:51 smithi086 ceph-mon[71303]: pgmap v693: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:51.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:51 smithi086 ceph-mon[71303]: from='client.35298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:51.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:51 smithi086 ceph-mon[71303]: from='client.35302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:51.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:51 smithi086 ceph-mon[71303]: from='client.35306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:51.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.700+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3993988245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df40fea30 msgr2=0x7f0df40fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.700+0000 7f0df8fa6640 1 --2- 172.21.15.17:0/3993988245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df40fea30 0x7f0df40fee90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0de8009880 tx=0x7f0de802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.700+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3993988245 shutdown_connections 2024-08-19T01:21:51.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.700+0000 7f0df8fa6640 1 --2- 172.21.15.17:0/3993988245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df40fea30 0x7f0df40fee90 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.700+0000 7f0df8fa6640 1 --2- 172.21.15.17:0/3993988245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df4104a30 0x7f0df4104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.700+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3993988245 >> 172.21.15.17:0/3993988245 conn(0x7f0df40fa730 msgr2=0x7f0df40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:51.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.700+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3993988245 shutdown_connections 2024-08-19T01:21:51.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.700+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3993988245 wait complete. 2024-08-19T01:21:51.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.701+0000 7f0df8fa6640 1 Processor -- start 2024-08-19T01:21:51.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.701+0000 7f0df8fa6640 1 -- start start 2024-08-19T01:21:51.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.701+0000 7f0df8fa6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df40fea30 0x7f0df40fb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.701+0000 7f0df8fa6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df4104a30 0x7f0df40fb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.701+0000 7f0df8fa6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40fbb10 con 0x7f0df40fea30 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.701+0000 7f0df8fa6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40fbc80 con 0x7f0df4104a30 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.701+0000 7f0df259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df40fea30 0x7f0df40fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.701+0000 7f0df259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df40fea30 0x7f0df40fb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38388/0 (socket says 172.21.15.17:38388) 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.701+0000 7f0df259c640 1 -- 172.21.15.17:0/3568168068 learned_addr learned my addr 172.21.15.17:0/3568168068 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.702+0000 7f0df1d9b640 1 --2- 172.21.15.17:0/3568168068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df4104a30 0x7f0df40fb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.702+0000 7f0df259c640 1 -- 172.21.15.17:0/3568168068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df4104a30 msgr2=0x7f0df40fb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.702+0000 7f0df259c640 1 --2- 172.21.15.17:0/3568168068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df4104a30 0x7f0df40fb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.702+0000 7f0df259c640 1 -- 172.21.15.17:0/3568168068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de8009560 con 0x7f0df40fea30 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.702+0000 7f0df259c640 1 --2- 172.21.15.17:0/3568168068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df40fea30 0x7f0df40fb090 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0de400c8f0 tx=0x7f0de400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.702+0000 7f0de37fe640 1 -- 172.21.15.17:0/3568168068 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de4007b80 con 0x7f0df40fea30 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.702+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3568168068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df41a1cc0 con 0x7f0df40fea30 2024-08-19T01:21:51.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.702+0000 7f0de37fe640 1 -- 172.21.15.17:0/3568168068 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0de40054e0 con 0x7f0df40fea30 2024-08-19T01:21:51.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.702+0000 7f0de37fe640 1 -- 172.21.15.17:0/3568168068 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0de400f450 con 0x7f0df40fea30 2024-08-19T01:21:51.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.702+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3568168068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df41a2020 con 0x7f0df40fea30 2024-08-19T01:21:51.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.703+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3568168068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df4100170 con 0x7f0df40fea30 2024-08-19T01:21:51.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.704+0000 7f0de37fe640 1 -- 172.21.15.17:0/3568168068 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0de4004f60 con 0x7f0df40fea30 2024-08-19T01:21:51.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.704+0000 7f0de37fe640 1 --2- 172.21.15.17:0/3568168068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ddc06e170 0x7f0ddc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.704+0000 7f0de37fe640 1 -- 172.21.15.17:0/3568168068 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0de408dff0 con 0x7f0df40fea30 2024-08-19T01:21:51.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.704+0000 7f0df1d9b640 1 --2- 172.21.15.17:0/3568168068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ddc06e170 0x7f0ddc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.705+0000 7f0df1d9b640 1 --2- 172.21.15.17:0/3568168068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ddc06e170 0x7f0ddc070630 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0de8000c00 tx=0x7f0de8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:51.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.709+0000 7f0de37fe640 1 -- 172.21.15.17:0/3568168068 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0de40572d0 con 0x7f0df40fea30 2024-08-19T01:21:51.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.900+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3568168068 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0df40fc630 con 0x7f0ddc06e170 2024-08-19T01:21:51.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.902+0000 7f0de37fe640 1 -- 172.21.15.17:0/3568168068 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f0df40fc630 con 0x7f0ddc06e170 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:21:51.904 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:21:51.905 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:21:51.905 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:21:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.904+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3568168068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ddc06e170 msgr2=0x7f0ddc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.904+0000 7f0df8fa6640 1 --2- 172.21.15.17:0/3568168068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ddc06e170 0x7f0ddc070630 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0de8000c00 tx=0x7f0de8005a20 comp rx=0 tx=0).stop 2024-08-19T01:21:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.904+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3568168068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df40fea30 msgr2=0x7f0df40fb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.904+0000 7f0df8fa6640 1 --2- 172.21.15.17:0/3568168068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df40fea30 0x7f0df40fb090 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0de400c8f0 tx=0x7f0de400cdb0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.904+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3568168068 shutdown_connections 2024-08-19T01:21:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.904+0000 7f0df8fa6640 1 --2- 172.21.15.17:0/3568168068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0ddc06e170 0x7f0ddc070630 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.904+0000 7f0df8fa6640 1 --2- 172.21.15.17:0/3568168068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0df4104a30 0x7f0df40fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.904+0000 7f0df8fa6640 1 --2- 172.21.15.17:0/3568168068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0df40fea30 0x7f0df40fb090 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.904+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3568168068 >> 172.21.15.17:0/3568168068 conn(0x7f0df40fa730 msgr2=0x7f0df4068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.904+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3568168068 shutdown_connections 2024-08-19T01:21:51.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.904+0000 7f0df8fa6640 1 -- 172.21.15.17:0/3568168068 wait complete. 2024-08-19T01:21:51.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.986+0000 7fdf80913640 1 -- 172.21.15.17:0/1070219371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf7c104a30 msgr2=0x7fdf7c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.986+0000 7fdf80913640 1 --2- 172.21.15.17:0/1070219371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf7c104a30 0x7fdf7c104e10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009880 tx=0x7fdf6402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.986+0000 7fdf80913640 1 -- 172.21.15.17:0/1070219371 shutdown_connections 2024-08-19T01:21:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.986+0000 7fdf80913640 1 --2- 172.21.15.17:0/1070219371 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7c0fea30 0x7fdf7c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.986+0000 7fdf80913640 1 --2- 172.21.15.17:0/1070219371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf7c104a30 0x7fdf7c104e10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.986+0000 7fdf80913640 1 -- 172.21.15.17:0/1070219371 >> 172.21.15.17:0/1070219371 conn(0x7fdf7c0fa730 msgr2=0x7fdf7c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.986+0000 7fdf80913640 1 -- 172.21.15.17:0/1070219371 shutdown_connections 2024-08-19T01:21:51.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.986+0000 7fdf80913640 1 -- 172.21.15.17:0/1070219371 wait complete. 2024-08-19T01:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.987+0000 7fdf80913640 1 Processor -- start 2024-08-19T01:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.987+0000 7fdf80913640 1 -- start start 2024-08-19T01:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.987+0000 7fdf80913640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf7c0fea30 0x7fdf7c105960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.987+0000 7fdf80913640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7c104a30 0x7fdf7c105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.987+0000 7fdf80913640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c1063e0 con 0x7fdf7c0fea30 2024-08-19T01:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.987+0000 7fdf80913640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7c106520 con 0x7fdf7c104a30 2024-08-19T01:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf7c0fea30 0x7fdf7c105960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf7a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf7c0fea30 0x7fdf7c105960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38402/0 (socket says 172.21.15.17:38402) 2024-08-19T01:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf7a59c640 1 -- 172.21.15.17:0/188479443 learned_addr learned my addr 172.21.15.17:0/188479443 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf79d9b640 1 --2- 172.21.15.17:0/188479443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7c104a30 0x7fdf7c105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf7a59c640 1 -- 172.21.15.17:0/188479443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7c104a30 msgr2=0x7fdf7c105ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf7a59c640 1 --2- 172.21.15.17:0/188479443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7c104a30 0x7fdf7c105ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf7a59c640 1 -- 172.21.15.17:0/188479443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf64009560 con 0x7fdf7c0fea30 2024-08-19T01:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf7a59c640 1 --2- 172.21.15.17:0/188479443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf7c0fea30 0x7fdf7c105960 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdf64006010 tx=0x7fdf640055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf737fe640 1 -- 172.21.15.17:0/188479443 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf64004aa0 con 0x7fdf7c0fea30 2024-08-19T01:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf80913640 1 -- 172.21.15.17:0/188479443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7c1067a0 con 0x7fdf7c0fea30 2024-08-19T01:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf737fe640 1 -- 172.21.15.17:0/188479443 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf64004c00 con 0x7fdf7c0fea30 2024-08-19T01:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf737fe640 1 -- 172.21.15.17:0/188479443 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf64003a20 con 0x7fdf7c0fea30 2024-08-19T01:21:51.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.988+0000 7fdf80913640 1 -- 172.21.15.17:0/188479443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7c1a1f50 con 0x7fdf7c0fea30 2024-08-19T01:21:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.989+0000 7fdf80913640 1 -- 172.21.15.17:0/188479443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7c100170 con 0x7fdf7c0fea30 2024-08-19T01:21:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.990+0000 7fdf737fe640 1 -- 172.21.15.17:0/188479443 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdf64031c90 con 0x7fdf7c0fea30 2024-08-19T01:21:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.990+0000 7fdf737fe640 1 --2- 172.21.15.17:0/188479443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdf6806e180 0x7fdf68070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:21:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.990+0000 7fdf737fe640 1 -- 172.21.15.17:0/188479443 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdf640af420 con 0x7fdf7c0fea30 2024-08-19T01:21:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.990+0000 7fdf79d9b640 1 --2- 172.21.15.17:0/188479443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdf6806e180 0x7fdf68070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:21:51.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.991+0000 7fdf79d9b640 1 --2- 172.21.15.17:0/188479443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdf6806e180 0x7fdf68070640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c005e10 tx=0x7fdf6c005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:21:51.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:51.995+0000 7fdf737fe640 1 -- 172.21.15.17:0/188479443 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdf64078660 con 0x7fdf7c0fea30 2024-08-19T01:21:52.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.240+0000 7fdf80913640 1 -- 172.21.15.17:0/188479443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdf7c10bca0 con 0x7fdf7c0fea30 2024-08-19T01:21:52.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.241+0000 7fdf737fe640 1 -- 172.21.15.17:0/188479443 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7fdf6407bd20 con 0x7fdf7c0fea30 2024-08-19T01:21:52.243 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:21:52.243 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:21:52.243 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:21:52.243 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:21:52.243 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:21:52.243 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:21:52.243 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:21:52.243 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:21:52.244 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:21:52.245 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:21:52.245 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:21:52.245 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:21:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.243+0000 7fdf80913640 1 -- 172.21.15.17:0/188479443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdf6806e180 msgr2=0x7fdf68070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.243+0000 7fdf80913640 1 --2- 172.21.15.17:0/188479443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdf6806e180 0x7fdf68070640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c005e10 tx=0x7fdf6c005da0 comp rx=0 tx=0).stop 2024-08-19T01:21:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.243+0000 7fdf80913640 1 -- 172.21.15.17:0/188479443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf7c0fea30 msgr2=0x7fdf7c105960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:21:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.243+0000 7fdf80913640 1 --2- 172.21.15.17:0/188479443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf7c0fea30 0x7fdf7c105960 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdf64006010 tx=0x7fdf640055a0 comp rx=0 tx=0).stop 2024-08-19T01:21:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.243+0000 7fdf80913640 1 -- 172.21.15.17:0/188479443 shutdown_connections 2024-08-19T01:21:52.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.243+0000 7fdf80913640 1 --2- 172.21.15.17:0/188479443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdf6806e180 0x7fdf68070640 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.243+0000 7fdf80913640 1 --2- 172.21.15.17:0/188479443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdf7c104a30 0x7fdf7c105ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.243+0000 7fdf80913640 1 --2- 172.21.15.17:0/188479443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdf7c0fea30 0x7fdf7c105960 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:21:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.243+0000 7fdf80913640 1 -- 172.21.15.17:0/188479443 >> 172.21.15.17:0/188479443 conn(0x7fdf7c0fa730 msgr2=0x7fdf7c0686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:21:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.243+0000 7fdf80913640 1 -- 172.21.15.17:0/188479443 shutdown_connections 2024-08-19T01:21:52.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:21:52.243+0000 7fdf80913640 1 -- 172.21.15.17:0/188479443 wait complete. 2024-08-19T01:21:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:52 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1502475313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:21:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:52 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1727373468' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:21:52.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:52 smithi017 ceph-mon[99370]: from='client.35318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:52.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:52 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1502475313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:21:52.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:52 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1727373468' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:21:52.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:52 smithi086 ceph-mon[71303]: from='client.35318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:21:53.597 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:53 smithi086 ceph-mon[71303]: pgmap v694: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:53.597 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:53 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/188479443' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:21:53.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:53 smithi017 ceph-mon[99370]: pgmap v694: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:53.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:53 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/188479443' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:21:55.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:55 smithi017 ceph-mon[99370]: pgmap v695: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:55.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:55 smithi086 ceph-mon[71303]: pgmap v695: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:57.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:57 smithi017 ceph-mon[99370]: pgmap v696: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:57.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:57 smithi086 ceph-mon[71303]: pgmap v696: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:59.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:21:59 smithi017 ceph-mon[99370]: pgmap v697: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:21:59.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:21:59 smithi086 ceph-mon[71303]: pgmap v697: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:01.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:01 smithi017 ceph-mon[99370]: pgmap v698: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:01.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:01 smithi086 ceph-mon[71303]: pgmap v698: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:03.485 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:03 smithi017 ceph-mon[99370]: pgmap v699: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:03.485 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:22:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:03 smithi086 ceph-mon[71303]: pgmap v699: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:22:05.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:05 smithi017 ceph-mon[99370]: pgmap v700: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:05.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:05 smithi086 ceph-mon[71303]: pgmap v700: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:07.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:07 smithi017 ceph-mon[99370]: pgmap v701: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:07.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:07 smithi086 ceph-mon[71303]: pgmap v701: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:09.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:09 smithi017 ceph-mon[99370]: pgmap v702: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:09.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:09 smithi086 ceph-mon[71303]: pgmap v702: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:11.583 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:11 smithi086 ceph-mon[71303]: pgmap v703: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:11.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:11 smithi017 ceph-mon[99370]: pgmap v703: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:13.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:13 smithi017 ceph-mon[99370]: pgmap v704: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:13 smithi086 ceph-mon[71303]: pgmap v704: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:15.363 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:15 smithi017 ceph-mon[99370]: pgmap v705: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:15.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:15 smithi086 ceph-mon[71303]: pgmap v705: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:17.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:17 smithi017 ceph-mon[99370]: pgmap v706: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:17 smithi086 ceph-mon[71303]: pgmap v706: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:22:18.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:22:19.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:19 smithi017 ceph-mon[99370]: pgmap v707: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:19.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:19 smithi086 ceph-mon[71303]: pgmap v707: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:21 smithi017 ceph-mon[99370]: pgmap v708: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:21.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:21 smithi086 ceph-mon[71303]: pgmap v708: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:22.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.338+0000 7f7d0f225640 1 -- 172.21.15.17:0/3345397300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d08100d50 msgr2=0x7f7d08101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.338+0000 7f7d0f225640 1 --2- 172.21.15.17:0/3345397300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d08100d50 0x7f7d08101130 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009880 tx=0x7f7cfc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.338+0000 7f7d0f225640 1 -- 172.21.15.17:0/3345397300 shutdown_connections 2024-08-19T01:22:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.338+0000 7f7d0f225640 1 --2- 172.21.15.17:0/3345397300 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08101670 0x7f7d08109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.338+0000 7f7d0f225640 1 --2- 172.21.15.17:0/3345397300 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d08100d50 0x7f7d08101130 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.338+0000 7f7d0f225640 1 -- 172.21.15.17:0/3345397300 >> 172.21.15.17:0/3345397300 conn(0x7f7d080fa730 msgr2=0x7f7d080fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.338+0000 7f7d0f225640 1 -- 172.21.15.17:0/3345397300 shutdown_connections 2024-08-19T01:22:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.338+0000 7f7d0f225640 1 -- 172.21.15.17:0/3345397300 wait complete. 2024-08-19T01:22:22.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.339+0000 7f7d0f225640 1 Processor -- start 2024-08-19T01:22:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.339+0000 7f7d0f225640 1 -- start start 2024-08-19T01:22:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.339+0000 7f7d0f225640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08100d50 0x7f7d0819b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.339+0000 7f7d0f225640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d08101670 0x7f7d0819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.339+0000 7f7d0f225640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0819c340 con 0x7f7d08101670 2024-08-19T01:22:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.339+0000 7f7d0f225640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d081958d0 con 0x7f7d08100d50 2024-08-19T01:22:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d08101670 0x7f7d0819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d08101670 0x7f7d0819bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46114/0 (socket says 172.21.15.17:46114) 2024-08-19T01:22:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d07fff640 1 -- 172.21.15.17:0/1534318972 learned_addr learned my addr 172.21.15.17:0/1534318972 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:22.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d0cfc1640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08100d50 0x7f7d0819b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d07fff640 1 -- 172.21.15.17:0/1534318972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08100d50 msgr2=0x7f7d0819b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d07fff640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08100d50 0x7f7d0819b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d07fff640 1 -- 172.21.15.17:0/1534318972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc009560 con 0x7f7d08101670 2024-08-19T01:22:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d0cfc1640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08100d50 0x7f7d0819b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:22:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d07fff640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d08101670 0x7f7d0819bd20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400d6f0 tx=0x7f7cf400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d05ffb640 1 -- 172.21.15.17:0/1534318972 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cf4009a30 con 0x7f7d08101670 2024-08-19T01:22:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d05ffb640 1 -- 172.21.15.17:0/1534318972 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7cf40054e0 con 0x7f7d08101670 2024-08-19T01:22:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d0f225640 1 -- 172.21.15.17:0/1534318972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d08195bb0 con 0x7f7d08101670 2024-08-19T01:22:22.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.340+0000 7f7d05ffb640 1 -- 172.21.15.17:0/1534318972 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cf4010460 con 0x7f7d08101670 2024-08-19T01:22:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.341+0000 7f7d0f225640 1 -- 172.21.15.17:0/1534318972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d08196100 con 0x7f7d08101670 2024-08-19T01:22:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.342+0000 7f7d0f225640 1 -- 172.21.15.17:0/1534318972 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d08068cd0 con 0x7f7d08101670 2024-08-19T01:22:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.342+0000 7f7d05ffb640 1 -- 172.21.15.17:0/1534318972 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7cf4009b90 con 0x7f7d08101670 2024-08-19T01:22:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.342+0000 7f7d05ffb640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf806e180 0x7f7cf8070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.343+0000 7f7d05ffb640 1 -- 172.21.15.17:0/1534318972 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7cf408dc80 con 0x7f7d08101670 2024-08-19T01:22:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.343+0000 7f7d0cfc1640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf806e180 0x7f7cf8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:22.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.343+0000 7f7d0cfc1640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf806e180 0x7f7cf8070640 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc000c00 tx=0x7f7cfc005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:22.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.347+0000 7f7d05ffb640 1 -- 172.21.15.17:0/1534318972 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7cf4056fe0 con 0x7f7d08101670 2024-08-19T01:22:22.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.540+0000 7f7d0f225640 1 -- 172.21.15.17:0/1534318972 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d0810cd70 con 0x7f7cf806e180 2024-08-19T01:22:22.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.541+0000 7f7d05ffb640 1 -- 172.21.15.17:0/1534318972 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f7d0810cd70 con 0x7f7cf806e180 2024-08-19T01:22:22.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.543+0000 7f7d0f225640 1 -- 172.21.15.17:0/1534318972 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf806e180 msgr2=0x7f7cf8070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:22.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.543+0000 7f7d0f225640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf806e180 0x7f7cf8070640 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc000c00 tx=0x7f7cfc005a20 comp rx=0 tx=0).stop 2024-08-19T01:22:22.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.543+0000 7f7d0f225640 1 -- 172.21.15.17:0/1534318972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d08101670 msgr2=0x7f7d0819bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:22.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.543+0000 7f7d0f225640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d08101670 0x7f7d0819bd20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400d6f0 tx=0x7f7cf400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.543+0000 7f7d0f225640 1 -- 172.21.15.17:0/1534318972 shutdown_connections 2024-08-19T01:22:22.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.543+0000 7f7d0f225640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7cf806e180 0x7f7cf8070640 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.543+0000 7f7d0f225640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7d08101670 0x7f7d0819bd20 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.543+0000 7f7d0f225640 1 --2- 172.21.15.17:0/1534318972 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7d08100d50 0x7f7d0819b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.543+0000 7f7d0f225640 1 -- 172.21.15.17:0/1534318972 >> 172.21.15.17:0/1534318972 conn(0x7f7d080fa730 msgr2=0x7f7d08101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.543+0000 7f7d0f225640 1 -- 172.21.15.17:0/1534318972 shutdown_connections 2024-08-19T01:22:22.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.543+0000 7f7d0f225640 1 -- 172.21.15.17:0/1534318972 wait complete. 2024-08-19T01:22:22.554 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:22:22.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.626+0000 7f1d09594640 1 -- 172.21.15.17:0/1151165492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d040fea30 msgr2=0x7f1d040fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:22.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.626+0000 7f1d09594640 1 --2- 172.21.15.17:0/1151165492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d040fea30 0x7f1d040fee90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1cec009880 tx=0x7f1cec02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.626+0000 7f1d09594640 1 -- 172.21.15.17:0/1151165492 shutdown_connections 2024-08-19T01:22:22.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.626+0000 7f1d09594640 1 --2- 172.21.15.17:0/1151165492 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d040fea30 0x7f1d040fee90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.626+0000 7f1d09594640 1 --2- 172.21.15.17:0/1151165492 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d04104a30 0x7f1d04104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.626+0000 7f1d09594640 1 -- 172.21.15.17:0/1151165492 >> 172.21.15.17:0/1151165492 conn(0x7f1d040fa730 msgr2=0x7f1d040fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:22.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.626+0000 7f1d09594640 1 -- 172.21.15.17:0/1151165492 shutdown_connections 2024-08-19T01:22:22.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.626+0000 7f1d09594640 1 -- 172.21.15.17:0/1151165492 wait complete. 2024-08-19T01:22:22.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.627+0000 7f1d09594640 1 Processor -- start 2024-08-19T01:22:22.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.627+0000 7f1d09594640 1 -- start start 2024-08-19T01:22:22.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.627+0000 7f1d09594640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d040fea30 0x7f1d04196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:22.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.627+0000 7f1d09594640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d04104a30 0x7f1d04196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:22.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.627+0000 7f1d09594640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04197430 con 0x7f1d04104a30 2024-08-19T01:22:22.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.627+0000 7f1d09594640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d041975a0 con 0x7f1d040fea30 2024-08-19T01:22:22.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.627+0000 7f1d027fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d04104a30 0x7f1d04196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:22.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.627+0000 7f1d027fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d04104a30 0x7f1d04196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46138/0 (socket says 172.21.15.17:46138) 2024-08-19T01:22:22.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.627+0000 7f1d027fc640 1 -- 172.21.15.17:0/3708400656 learned_addr learned my addr 172.21.15.17:0/3708400656 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:22.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.627+0000 7f1d02ffd640 1 --2- 172.21.15.17:0/3708400656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d040fea30 0x7f1d04196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:22.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.628+0000 7f1d027fc640 1 -- 172.21.15.17:0/3708400656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d040fea30 msgr2=0x7f1d04196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:22.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.628+0000 7f1d027fc640 1 --2- 172.21.15.17:0/3708400656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d040fea30 0x7f1d04196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.628+0000 7f1d027fc640 1 -- 172.21.15.17:0/3708400656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec009560 con 0x7f1d04104a30 2024-08-19T01:22:22.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.628+0000 7f1d027fc640 1 --2- 172.21.15.17:0/3708400656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d04104a30 0x7f1d04196e60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1cec02a9c0 tx=0x7f1cec0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:22.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.628+0000 7f1cfbfff640 1 -- 172.21.15.17:0/3708400656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cec004aa0 con 0x7f1d04104a30 2024-08-19T01:22:22.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.628+0000 7f1cfbfff640 1 -- 172.21.15.17:0/3708400656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cec004c00 con 0x7f1d04104a30 2024-08-19T01:22:22.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.628+0000 7f1d09594640 1 -- 172.21.15.17:0/3708400656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0419f990 con 0x7f1d04104a30 2024-08-19T01:22:22.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.628+0000 7f1cfbfff640 1 -- 172.21.15.17:0/3708400656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cec003980 con 0x7f1d04104a30 2024-08-19T01:22:22.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.628+0000 7f1d09594640 1 -- 172.21.15.17:0/3708400656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0419fcf0 con 0x7f1d04104a30 2024-08-19T01:22:22.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.629+0000 7f1d09594640 1 -- 172.21.15.17:0/3708400656 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d04100170 con 0x7f1d04104a30 2024-08-19T01:22:22.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.630+0000 7f1cfbfff640 1 -- 172.21.15.17:0/3708400656 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1cec003b00 con 0x7f1d04104a30 2024-08-19T01:22:22.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.630+0000 7f1cfbfff640 1 --2- 172.21.15.17:0/3708400656 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1cf006e170 0x7f1cf0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:22.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.630+0000 7f1cfbfff640 1 -- 172.21.15.17:0/3708400656 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1cec0af0b0 con 0x7f1d04104a30 2024-08-19T01:22:22.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.630+0000 7f1d02ffd640 1 --2- 172.21.15.17:0/3708400656 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1cf006e170 0x7f1cf0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:22.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.631+0000 7f1d02ffd640 1 --2- 172.21.15.17:0/3708400656 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1cf006e170 0x7f1cf0070630 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400bbe0 tx=0x7f1cf400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:22.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.635+0000 7f1cfbfff640 1 -- 172.21.15.17:0/3708400656 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1cec0784c0 con 0x7f1d04104a30 2024-08-19T01:22:22.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.826+0000 7f1d09594640 1 -- 172.21.15.17:0/3708400656 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d0410bca0 con 0x7f1cf006e170 2024-08-19T01:22:22.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.827+0000 7f1cfbfff640 1 -- 172.21.15.17:0/3708400656 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f1d0410bca0 con 0x7f1cf006e170 2024-08-19T01:22:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.829+0000 7f1d09594640 1 -- 172.21.15.17:0/3708400656 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1cf006e170 msgr2=0x7f1cf0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.829+0000 7f1d09594640 1 --2- 172.21.15.17:0/3708400656 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1cf006e170 0x7f1cf0070630 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400bbe0 tx=0x7f1cf400b390 comp rx=0 tx=0).stop 2024-08-19T01:22:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.829+0000 7f1d09594640 1 -- 172.21.15.17:0/3708400656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d04104a30 msgr2=0x7f1d04196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.829+0000 7f1d09594640 1 --2- 172.21.15.17:0/3708400656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d04104a30 0x7f1d04196e60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1cec02a9c0 tx=0x7f1cec0055a0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.829+0000 7f1d09594640 1 -- 172.21.15.17:0/3708400656 shutdown_connections 2024-08-19T01:22:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.829+0000 7f1d09594640 1 --2- 172.21.15.17:0/3708400656 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1cf006e170 0x7f1cf0070630 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.829+0000 7f1d09594640 1 --2- 172.21.15.17:0/3708400656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d04104a30 0x7f1d04196e60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.829+0000 7f1d09594640 1 --2- 172.21.15.17:0/3708400656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1d040fea30 0x7f1d04196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.829+0000 7f1d09594640 1 -- 172.21.15.17:0/3708400656 >> 172.21.15.17:0/3708400656 conn(0x7f1d040fa730 msgr2=0x7f1d040fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.829+0000 7f1d09594640 1 -- 172.21.15.17:0/3708400656 shutdown_connections 2024-08-19T01:22:22.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.829+0000 7f1d09594640 1 -- 172.21.15.17:0/3708400656 wait complete. 2024-08-19T01:22:22.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.910+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1083542261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe24100d70 msgr2=0x7efe24101150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:22.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.910+0000 7efe2c0e7640 1 --2- 172.21.15.17:0/1083542261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe24100d70 0x7efe24101150 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7efe18009880 tx=0x7efe1802a530 comp rx=0 tx=0).stop 2024-08-19T01:22:22.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.910+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1083542261 shutdown_connections 2024-08-19T01:22:22.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.910+0000 7efe2c0e7640 1 --2- 172.21.15.17:0/1083542261 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe24101690 0x7efe24109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.910+0000 7efe2c0e7640 1 --2- 172.21.15.17:0/1083542261 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe24100d70 0x7efe24101150 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.911+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1083542261 >> 172.21.15.17:0/1083542261 conn(0x7efe240758a0 msgr2=0x7efe240fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:22.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.911+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1083542261 shutdown_connections 2024-08-19T01:22:22.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.911+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1083542261 wait complete. 2024-08-19T01:22:22.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.911+0000 7efe2c0e7640 1 Processor -- start 2024-08-19T01:22:22.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.911+0000 7efe2c0e7640 1 -- start start 2024-08-19T01:22:22.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe2c0e7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe24100d70 0x7efe24197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:22.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe2c0e7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe24101690 0x7efe24198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:22.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe2c0e7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe24198900 con 0x7efe24101690 2024-08-19T01:22:22.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe2c0e7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2419c670 con 0x7efe24100d70 2024-08-19T01:22:22.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe29682640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe24101690 0x7efe24198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:22.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe29682640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe24101690 0x7efe24198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46164/0 (socket says 172.21.15.17:46164) 2024-08-19T01:22:22.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe29682640 1 -- 172.21.15.17:0/1029148183 learned_addr learned my addr 172.21.15.17:0/1029148183 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:22.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe29e83640 1 --2- 172.21.15.17:0/1029148183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe24100d70 0x7efe24197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:22.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe29682640 1 -- 172.21.15.17:0/1029148183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe24100d70 msgr2=0x7efe24197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:22.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe29682640 1 --2- 172.21.15.17:0/1029148183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe24100d70 0x7efe24197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:22.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe29682640 1 -- 172.21.15.17:0/1029148183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe18009560 con 0x7efe24101690 2024-08-19T01:22:22.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe29682640 1 --2- 172.21.15.17:0/1029148183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe24101690 0x7efe24198270 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7efe2000c8f0 tx=0x7efe2000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:22.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.912+0000 7efe16ffd640 1 -- 172.21.15.17:0/1029148183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe20007b80 con 0x7efe24101690 2024-08-19T01:22:22.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.913+0000 7efe16ffd640 1 -- 172.21.15.17:0/1029148183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe200054e0 con 0x7efe24101690 2024-08-19T01:22:22.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.913+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1029148183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2419c950 con 0x7efe24101690 2024-08-19T01:22:22.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.913+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1029148183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2419cea0 con 0x7efe24101690 2024-08-19T01:22:22.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.913+0000 7efe16ffd640 1 -- 172.21.15.17:0/1029148183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe2000f450 con 0x7efe24101690 2024-08-19T01:22:22.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.914+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1029148183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe08005250 con 0x7efe24101690 2024-08-19T01:22:22.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.914+0000 7efe16ffd640 1 -- 172.21.15.17:0/1029148183 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efe20007ce0 con 0x7efe24101690 2024-08-19T01:22:22.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.915+0000 7efe16ffd640 1 --2- 172.21.15.17:0/1029148183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe1006e170 0x7efe10070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:22.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.915+0000 7efe16ffd640 1 -- 172.21.15.17:0/1029148183 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efe2008ddf0 con 0x7efe24101690 2024-08-19T01:22:22.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.915+0000 7efe29e83640 1 --2- 172.21.15.17:0/1029148183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe1006e170 0x7efe10070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:22.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.915+0000 7efe29e83640 1 --2- 172.21.15.17:0/1029148183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe1006e170 0x7efe10070630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efe18000c00 tx=0x7efe18005750 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:22.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:22.919+0000 7efe16ffd640 1 -- 172.21.15.17:0/1029148183 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efe20057180 con 0x7efe24101690 2024-08-19T01:22:23.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.103+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1029148183 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efe08000bc0 con 0x7efe1006e170 2024-08-19T01:22:23.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.112+0000 7efe16ffd640 1 -- 172.21.15.17:0/1029148183 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7efe08000bc0 con 0x7efe1006e170 2024-08-19T01:22:23.114 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:22:23.114 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (23m) 2m ago 34m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (34m) 2m ago 34m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (33m) 2m ago 33m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (21m) 2m ago 34m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (21m) 2m ago 33m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (23m) 2m ago 34m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (17m) 2m ago 28m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (17m) 2m ago 28m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (2m) 2m ago 28m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (17m) 2m ago 28m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (25m) 2m ago 35m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (24m) 2m ago 33m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (22m) 2m ago 35m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (22m) 2m ago 33m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:22:23.115 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (24m) 2m ago 34m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:22:23.116 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (24m) 2m ago 33m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:22:23.116 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (21m) 2m ago 32m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:22:23.116 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (20m) 2m ago 32m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:22:23.116 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (19m) 2m ago 31m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:22:23.116 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (19m) 2m ago 31m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:22:23.116 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (18m) 2m ago 30m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:22:23.116 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (18m) 2m ago 30m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:22:23.116 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (23m) 2m ago 33m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:22:23.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.114+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1029148183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe1006e170 msgr2=0x7efe10070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.114+0000 7efe2c0e7640 1 --2- 172.21.15.17:0/1029148183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe1006e170 0x7efe10070630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7efe18000c00 tx=0x7efe18005750 comp rx=0 tx=0).stop 2024-08-19T01:22:23.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.114+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1029148183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe24101690 msgr2=0x7efe24198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.114+0000 7efe2c0e7640 1 --2- 172.21.15.17:0/1029148183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe24101690 0x7efe24198270 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7efe2000c8f0 tx=0x7efe2000cdb0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.114+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1029148183 shutdown_connections 2024-08-19T01:22:23.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.114+0000 7efe2c0e7640 1 --2- 172.21.15.17:0/1029148183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe1006e170 0x7efe10070630 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.114+0000 7efe2c0e7640 1 --2- 172.21.15.17:0/1029148183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe24101690 0x7efe24198270 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.114+0000 7efe2c0e7640 1 --2- 172.21.15.17:0/1029148183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe24100d70 0x7efe24197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.114+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1029148183 >> 172.21.15.17:0/1029148183 conn(0x7efe240758a0 msgr2=0x7efe240fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:23.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.115+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1029148183 shutdown_connections 2024-08-19T01:22:23.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.115+0000 7efe2c0e7640 1 -- 172.21.15.17:0/1029148183 wait complete. 2024-08-19T01:22:23.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.196+0000 7f678cac2640 1 -- 172.21.15.17:0/2135776275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67880fe9f0 msgr2=0x7f67880fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.196+0000 7f678cac2640 1 --2- 172.21.15.17:0/2135776275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67880fe9f0 0x7f67880fee50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f677c009880 tx=0x7f677c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.196+0000 7f678cac2640 1 -- 172.21.15.17:0/2135776275 shutdown_connections 2024-08-19T01:22:23.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.196+0000 7f678cac2640 1 --2- 172.21.15.17:0/2135776275 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67880fe9f0 0x7f67880fee50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.196+0000 7f678cac2640 1 --2- 172.21.15.17:0/2135776275 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67881049f0 0x7f6788104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.196+0000 7f678cac2640 1 -- 172.21.15.17:0/2135776275 >> 172.21.15.17:0/2135776275 conn(0x7f67880758a0 msgr2=0x7f67880fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:23.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.196+0000 7f678cac2640 1 -- 172.21.15.17:0/2135776275 shutdown_connections 2024-08-19T01:22:23.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.196+0000 7f678cac2640 1 -- 172.21.15.17:0/2135776275 wait complete. 2024-08-19T01:22:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.196+0000 7f678cac2640 1 Processor -- start 2024-08-19T01:22:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f678cac2640 1 -- start start 2024-08-19T01:22:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f678cac2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67880fe9f0 0x7f678819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f678cac2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67881049f0 0x7f678819bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f678cac2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6788195900 con 0x7f67881049f0 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f678cac2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6788195a40 con 0x7f67880fe9f0 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f6785d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67881049f0 0x7f678819bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f6785d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67881049f0 0x7f678819bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46176/0 (socket says 172.21.15.17:46176) 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f6785d9b640 1 -- 172.21.15.17:0/1829290282 learned_addr learned my addr 172.21.15.17:0/1829290282 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f678659c640 1 --2- 172.21.15.17:0/1829290282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67880fe9f0 0x7f678819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f6785d9b640 1 -- 172.21.15.17:0/1829290282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67880fe9f0 msgr2=0x7f678819b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f6785d9b640 1 --2- 172.21.15.17:0/1829290282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67880fe9f0 0x7f678819b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f6785d9b640 1 -- 172.21.15.17:0/1829290282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c009560 con 0x7f67881049f0 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.197+0000 7f6785d9b640 1 --2- 172.21.15.17:0/1829290282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67881049f0 0x7f678819bde0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f677c02a9c0 tx=0x7f677c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.198+0000 7f67777fe640 1 -- 172.21.15.17:0/1829290282 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f677c0048d0 con 0x7f67881049f0 2024-08-19T01:22:23.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.198+0000 7f67777fe640 1 -- 172.21.15.17:0/1829290282 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f677c031640 con 0x7f67881049f0 2024-08-19T01:22:23.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.198+0000 7f678cac2640 1 -- 172.21.15.17:0/1829290282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6788195cc0 con 0x7f67881049f0 2024-08-19T01:22:23.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.198+0000 7f67777fe640 1 -- 172.21.15.17:0/1829290282 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f677c0038d0 con 0x7f67881049f0 2024-08-19T01:22:23.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.198+0000 7f678cac2640 1 -- 172.21.15.17:0/1829290282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67881961b0 con 0x7f67881049f0 2024-08-19T01:22:23.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.199+0000 7f678cac2640 1 -- 172.21.15.17:0/1829290282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6788100130 con 0x7f67881049f0 2024-08-19T01:22:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.199+0000 7f67777fe640 1 -- 172.21.15.17:0/1829290282 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f677c004a30 con 0x7f67881049f0 2024-08-19T01:22:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.199+0000 7f67777fe640 1 --2- 172.21.15.17:0/1829290282 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f677006e170 0x7f6770070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.200+0000 7f67777fe640 1 -- 172.21.15.17:0/1829290282 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f677c0af030 con 0x7f67881049f0 2024-08-19T01:22:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.200+0000 7f678659c640 1 --2- 172.21.15.17:0/1829290282 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f677006e170 0x7f6770070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.200+0000 7f678659c640 1 --2- 172.21.15.17:0/1829290282 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f677006e170 0x7f6770070630 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6778009bd0 tx=0x7f6778005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:23.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.204+0000 7f67777fe640 1 -- 172.21.15.17:0/1829290282 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f677c078440 con 0x7f67881049f0 2024-08-19T01:22:23.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.447+0000 7f678cac2640 1 -- 172.21.15.17:0/1829290282 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f678810bc80 con 0x7f67881049f0 2024-08-19T01:22:23.450 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:23 smithi017 ceph-mon[99370]: pgmap v709: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:23.450 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:23 smithi017 ceph-mon[99370]: from='client.35326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:23.450 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:23 smithi017 ceph-mon[99370]: from='client.35330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:23.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.448+0000 7f67777fe640 1 -- 172.21.15.17:0/1829290282 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f677c07bb00 con 0x7f67881049f0 2024-08-19T01:22:23.450 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:22:23.450 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:22:23.450 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:22:23.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:22:23.452 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:22:23.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.450+0000 7f678cac2640 1 -- 172.21.15.17:0/1829290282 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f677006e170 msgr2=0x7f6770070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.450+0000 7f678cac2640 1 --2- 172.21.15.17:0/1829290282 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f677006e170 0x7f6770070630 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6778009bd0 tx=0x7f6778005f90 comp rx=0 tx=0).stop 2024-08-19T01:22:23.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.450+0000 7f678cac2640 1 -- 172.21.15.17:0/1829290282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67881049f0 msgr2=0x7f678819bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.450+0000 7f678cac2640 1 --2- 172.21.15.17:0/1829290282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67881049f0 0x7f678819bde0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f677c02a9c0 tx=0x7f677c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.450+0000 7f678cac2640 1 -- 172.21.15.17:0/1829290282 shutdown_connections 2024-08-19T01:22:23.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.450+0000 7f678cac2640 1 --2- 172.21.15.17:0/1829290282 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f677006e170 0x7f6770070630 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.450+0000 7f678cac2640 1 --2- 172.21.15.17:0/1829290282 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67881049f0 0x7f678819bde0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.450+0000 7f678cac2640 1 --2- 172.21.15.17:0/1829290282 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f67880fe9f0 0x7f678819b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.450+0000 7f678cac2640 1 -- 172.21.15.17:0/1829290282 >> 172.21.15.17:0/1829290282 conn(0x7f67880758a0 msgr2=0x7f67880fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:23.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.450+0000 7f678cac2640 1 -- 172.21.15.17:0/1829290282 shutdown_connections 2024-08-19T01:22:23.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.450+0000 7f678cac2640 1 -- 172.21.15.17:0/1829290282 wait complete. 2024-08-19T01:22:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.533+0000 7f375b4c0640 1 -- 172.21.15.17:0/2573535943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3754105bf0 msgr2=0x7f3754105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.533+0000 7f375b4c0640 1 --2- 172.21.15.17:0/2573535943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3754105bf0 0x7f3754105fd0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3750009880 tx=0x7f375002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.533+0000 7f375b4c0640 1 -- 172.21.15.17:0/2573535943 shutdown_connections 2024-08-19T01:22:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.533+0000 7f375b4c0640 1 --2- 172.21.15.17:0/2573535943 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f37540ffb40 0x7f37540fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.533+0000 7f375b4c0640 1 --2- 172.21.15.17:0/2573535943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3754105bf0 0x7f3754105fd0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.533+0000 7f375b4c0640 1 -- 172.21.15.17:0/2573535943 >> 172.21.15.17:0/2573535943 conn(0x7f37540fb860 msgr2=0x7f37540fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:23.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.533+0000 7f375b4c0640 1 -- 172.21.15.17:0/2573535943 shutdown_connections 2024-08-19T01:22:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.533+0000 7f375b4c0640 1 -- 172.21.15.17:0/2573535943 wait complete. 2024-08-19T01:22:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.533+0000 7f375b4c0640 1 Processor -- start 2024-08-19T01:22:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.533+0000 7f375b4c0640 1 -- start start 2024-08-19T01:22:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375b4c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37540ffb40 0x7f375419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375b4c0640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3754105bf0 0x7f375419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375b4c0640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375419c3a0 con 0x7f37540ffb40 2024-08-19T01:22:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375b4c0640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754195930 con 0x7f3754105bf0 2024-08-19T01:22:23.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375925c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37540ffb40 0x7f375419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375925c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37540ffb40 0x7f375419b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46200/0 (socket says 172.21.15.17:46200) 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375925c640 1 -- 172.21.15.17:0/2366046839 learned_addr learned my addr 172.21.15.17:0/2366046839 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f3758a5b640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3754105bf0 0x7f375419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375925c640 1 -- 172.21.15.17:0/2366046839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3754105bf0 msgr2=0x7f375419bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375925c640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3754105bf0 0x7f375419bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375925c640 1 -- 172.21.15.17:0/2366046839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750009560 con 0x7f37540ffb40 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f3758a5b640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3754105bf0 0x7f375419bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375925c640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37540ffb40 0x7f375419b840 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f375002a9c0 tx=0x7f37500055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f374a7fc640 1 -- 172.21.15.17:0/2366046839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3750004aa0 con 0x7f37540ffb40 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f374a7fc640 1 -- 172.21.15.17:0/2366046839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3750004c00 con 0x7f37540ffb40 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375b4c0640 1 -- 172.21.15.17:0/2366046839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3754195bb0 con 0x7f37540ffb40 2024-08-19T01:22:23.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f374a7fc640 1 -- 172.21.15.17:0/2366046839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3750003ab0 con 0x7f37540ffb40 2024-08-19T01:22:23.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.534+0000 7f375b4c0640 1 -- 172.21.15.17:0/2366046839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37541960a0 con 0x7f37540ffb40 2024-08-19T01:22:23.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.535+0000 7f375b4c0640 1 -- 172.21.15.17:0/2366046839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37541011f0 con 0x7f37540ffb40 2024-08-19T01:22:23.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.536+0000 7f374a7fc640 1 -- 172.21.15.17:0/2366046839 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3750003ce0 con 0x7f37540ffb40 2024-08-19T01:22:23.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.536+0000 7f374a7fc640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f374006e170 0x7f3740070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:23.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.536+0000 7f374a7fc640 1 -- 172.21.15.17:0/2366046839 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f37500af260 con 0x7f37540ffb40 2024-08-19T01:22:23.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.536+0000 7f3758a5b640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f374006e170 0x7f3740070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:23.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.537+0000 7f3758a5b640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f374006e170 0x7f3740070630 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3754196da0 tx=0x7f3744005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:23.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.541+0000 7f374a7fc640 1 -- 172.21.15.17:0/2366046839 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3750078540 con 0x7f37540ffb40 2024-08-19T01:22:23.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:23 smithi086 ceph-mon[71303]: pgmap v709: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:23.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:23 smithi086 ceph-mon[71303]: from='client.35326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:23.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:23 smithi086 ceph-mon[71303]: from='client.35330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:23.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.753+0000 7f375b4c0640 1 -- 172.21.15.17:0/2366046839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3754108010 con 0x7f37540ffb40 2024-08-19T01:22:23.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.753+0000 7f374a7fc640 1 -- 172.21.15.17:0/2366046839 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f375007bc00 con 0x7f37540ffb40 2024-08-19T01:22:23.755 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:22:23.755 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:22:23.756 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:22:23.757 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:22:23.757 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:22:23.757 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:22:23.757 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:22:23.757 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:22:23.757 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:22:23.757 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:22:23.757 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:22:23.757 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:22:23.757 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:22:23.758 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:22:23.759 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:22:23.759 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:22:23.759 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:22:23.759 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:22:23.759 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.755+0000 7f375b4c0640 1 -- 172.21.15.17:0/2366046839 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f374006e170 msgr2=0x7f3740070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.755+0000 7f375b4c0640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f374006e170 0x7f3740070630 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3754196da0 tx=0x7f3744005d30 comp rx=0 tx=0).stop 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.755+0000 7f375b4c0640 1 -- 172.21.15.17:0/2366046839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37540ffb40 msgr2=0x7f375419b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.755+0000 7f375b4c0640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37540ffb40 0x7f375419b840 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f375002a9c0 tx=0x7f37500055a0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.755+0000 7f375b4c0640 1 -- 172.21.15.17:0/2366046839 shutdown_connections 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.755+0000 7f375b4c0640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f374006e170 0x7f3740070630 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.755+0000 7f375b4c0640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3754105bf0 0x7f375419bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.755+0000 7f375b4c0640 1 --2- 172.21.15.17:0/2366046839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37540ffb40 0x7f375419b840 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.755+0000 7f375b4c0640 1 -- 172.21.15.17:0/2366046839 >> 172.21.15.17:0/2366046839 conn(0x7f37540fb860 msgr2=0x7f37540fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.755+0000 7f375b4c0640 1 -- 172.21.15.17:0/2366046839 shutdown_connections 2024-08-19T01:22:23.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.755+0000 7f375b4c0640 1 -- 172.21.15.17:0/2366046839 wait complete. 2024-08-19T01:22:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.838+0000 7f2e03f67640 1 -- 172.21.15.17:0/1783095625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dfc104b30 msgr2=0x7f2dfc104f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.838+0000 7f2e03f67640 1 --2- 172.21.15.17:0/1783095625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dfc104b30 0x7f2dfc104f10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009c20 tx=0x7f2df802a970 comp rx=0 tx=0).stop 2024-08-19T01:22:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.838+0000 7f2e03f67640 1 -- 172.21.15.17:0/1783095625 shutdown_connections 2024-08-19T01:22:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.838+0000 7f2e03f67640 1 --2- 172.21.15.17:0/1783095625 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc0fdf50 0x7f2dfc0fe3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.838+0000 7f2e03f67640 1 --2- 172.21.15.17:0/1783095625 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dfc104b30 0x7f2dfc104f10 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.838+0000 7f2e03f67640 1 -- 172.21.15.17:0/1783095625 >> 172.21.15.17:0/1783095625 conn(0x7f2dfc0f9e40 msgr2=0x7f2dfc0fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:23.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.839+0000 7f2e03f67640 1 -- 172.21.15.17:0/1783095625 shutdown_connections 2024-08-19T01:22:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.839+0000 7f2e03f67640 1 -- 172.21.15.17:0/1783095625 wait complete. 2024-08-19T01:22:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.839+0000 7f2e03f67640 1 Processor -- start 2024-08-19T01:22:23.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.839+0000 7f2e03f67640 1 -- start start 2024-08-19T01:22:23.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.839+0000 7f2e03f67640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc0fdf50 0x7f2dfc19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:23.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.839+0000 7f2e03f67640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dfc104b30 0x7f2dfc19be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.839+0000 7f2e03f67640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc19c4a0 con 0x7f2dfc104b30 2024-08-19T01:22:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.839+0000 7f2e03f67640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dfc195a30 con 0x7f2dfc0fdf50 2024-08-19T01:22:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2e01502640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dfc104b30 0x7f2dfc19be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2e01502640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dfc104b30 0x7f2dfc19be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46216/0 (socket says 172.21.15.17:46216) 2024-08-19T01:22:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2e01502640 1 -- 172.21.15.17:0/4077210984 learned_addr learned my addr 172.21.15.17:0/4077210984 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:23.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2e01d03640 1 --2- 172.21.15.17:0/4077210984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc0fdf50 0x7f2dfc19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2e01502640 1 -- 172.21.15.17:0/4077210984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc0fdf50 msgr2=0x7f2dfc19b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2e01502640 1 --2- 172.21.15.17:0/4077210984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc0fdf50 0x7f2dfc19b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2e01502640 1 -- 172.21.15.17:0/4077210984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df8009900 con 0x7f2dfc104b30 2024-08-19T01:22:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2e01502640 1 --2- 172.21.15.17:0/4077210984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dfc104b30 0x7f2dfc19be80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00d6f0 tx=0x7f2dec00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2df2ffd640 1 -- 172.21.15.17:0/4077210984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dec009a30 con 0x7f2dfc104b30 2024-08-19T01:22:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2df2ffd640 1 -- 172.21.15.17:0/4077210984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2dec0054e0 con 0x7f2dfc104b30 2024-08-19T01:22:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2e03f67640 1 -- 172.21.15.17:0/4077210984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dfc195d10 con 0x7f2dfc104b30 2024-08-19T01:22:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2df2ffd640 1 -- 172.21.15.17:0/4077210984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dec010460 con 0x7f2dfc104b30 2024-08-19T01:22:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.840+0000 7f2e03f67640 1 -- 172.21.15.17:0/4077210984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dfc196260 con 0x7f2dfc104b30 2024-08-19T01:22:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.841+0000 7f2e03f67640 1 -- 172.21.15.17:0/4077210984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dfc101270 con 0x7f2dfc104b30 2024-08-19T01:22:23.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.842+0000 7f2df2ffd640 1 -- 172.21.15.17:0/4077210984 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2dec009b90 con 0x7f2dfc104b30 2024-08-19T01:22:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.842+0000 7f2df2ffd640 1 --2- 172.21.15.17:0/4077210984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2de806e170 0x7f2de8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.842+0000 7f2df2ffd640 1 -- 172.21.15.17:0/4077210984 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2dec08dd30 con 0x7f2dfc104b30 2024-08-19T01:22:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.842+0000 7f2e01d03640 1 --2- 172.21.15.17:0/4077210984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2de806e170 0x7f2de8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:23.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.843+0000 7f2e01d03640 1 --2- 172.21.15.17:0/4077210984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2de806e170 0x7f2de8070630 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2df80098d0 tx=0x7f2df8009800 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:23.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:23.847+0000 7f2df2ffd640 1 -- 172.21.15.17:0/4077210984 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2dec057010 con 0x7f2dfc104b30 2024-08-19T01:22:24.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.038+0000 7f2e03f67640 1 -- 172.21.15.17:0/4077210984 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dfc10ce90 con 0x7f2de806e170 2024-08-19T01:22:24.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.039+0000 7f2df2ffd640 1 -- 172.21.15.17:0/4077210984 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2dfc10ce90 con 0x7f2de806e170 2024-08-19T01:22:24.041 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:22:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:22:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:22:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:22:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:22:24.041 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:22:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:22:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:22:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:22:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:22:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:22:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:22:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:22:24.042 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:22:24.042 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:22:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.041+0000 7f2e03f67640 1 -- 172.21.15.17:0/4077210984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2de806e170 msgr2=0x7f2de8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.041+0000 7f2e03f67640 1 --2- 172.21.15.17:0/4077210984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2de806e170 0x7f2de8070630 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2df80098d0 tx=0x7f2df8009800 comp rx=0 tx=0).stop 2024-08-19T01:22:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.041+0000 7f2e03f67640 1 -- 172.21.15.17:0/4077210984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dfc104b30 msgr2=0x7f2dfc19be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.041+0000 7f2e03f67640 1 --2- 172.21.15.17:0/4077210984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dfc104b30 0x7f2dfc19be80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00d6f0 tx=0x7f2dec00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.041+0000 7f2e03f67640 1 -- 172.21.15.17:0/4077210984 shutdown_connections 2024-08-19T01:22:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.041+0000 7f2e03f67640 1 --2- 172.21.15.17:0/4077210984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2de806e170 0x7f2de8070630 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.041+0000 7f2e03f67640 1 --2- 172.21.15.17:0/4077210984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2dfc104b30 0x7f2dfc19be80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.041+0000 7f2e03f67640 1 --2- 172.21.15.17:0/4077210984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2dfc0fdf50 0x7f2dfc19b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.041+0000 7f2e03f67640 1 -- 172.21.15.17:0/4077210984 >> 172.21.15.17:0/4077210984 conn(0x7f2dfc0f9e40 msgr2=0x7f2dfc0faff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.041+0000 7f2e03f67640 1 -- 172.21.15.17:0/4077210984 shutdown_connections 2024-08-19T01:22:24.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.041+0000 7f2e03f67640 1 -- 172.21.15.17:0/4077210984 wait complete. 2024-08-19T01:22:24.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.123+0000 7f030e383640 1 -- 172.21.15.17:0/3947168429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080fea30 msgr2=0x7f03080fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.123+0000 7f030e383640 1 --2- 172.21.15.17:0/3947168429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080fea30 0x7f03080fee90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f02fc009880 tx=0x7f02fc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.123+0000 7f030e383640 1 -- 172.21.15.17:0/3947168429 shutdown_connections 2024-08-19T01:22:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.123+0000 7f030e383640 1 --2- 172.21.15.17:0/3947168429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03080fea30 0x7f03080fee90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.123+0000 7f030e383640 1 --2- 172.21.15.17:0/3947168429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0308104a30 0x7f0308104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.123+0000 7f030e383640 1 -- 172.21.15.17:0/3947168429 >> 172.21.15.17:0/3947168429 conn(0x7f03080fa730 msgr2=0x7f03080fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.123+0000 7f030e383640 1 -- 172.21.15.17:0/3947168429 shutdown_connections 2024-08-19T01:22:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.123+0000 7f030e383640 1 -- 172.21.15.17:0/3947168429 wait complete. 2024-08-19T01:22:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.124+0000 7f030e383640 1 Processor -- start 2024-08-19T01:22:24.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.124+0000 7f030e383640 1 -- start start 2024-08-19T01:22:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.124+0000 7f030e383640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03080fea30 0x7f0308196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.124+0000 7f030e383640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0308104a30 0x7f0308196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.124+0000 7f030e383640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0308197430 con 0x7f0308104a30 2024-08-19T01:22:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.124+0000 7f030e383640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03081975a0 con 0x7f03080fea30 2024-08-19T01:22:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.124+0000 7f03077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0308104a30 0x7f0308196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.124+0000 7f03077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0308104a30 0x7f0308196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46230/0 (socket says 172.21.15.17:46230) 2024-08-19T01:22:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.124+0000 7f03077fe640 1 -- 172.21.15.17:0/994119539 learned_addr learned my addr 172.21.15.17:0/994119539 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.124+0000 7f0307fff640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03080fea30 0x7f0308196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.125+0000 7f03077fe640 1 -- 172.21.15.17:0/994119539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03080fea30 msgr2=0x7f0308196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:24.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.125+0000 7f03077fe640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03080fea30 0x7f0308196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.125+0000 7f03077fe640 1 -- 172.21.15.17:0/994119539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc009560 con 0x7f0308104a30 2024-08-19T01:22:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.125+0000 7f0307fff640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03080fea30 0x7f0308196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:22:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.125+0000 7f03077fe640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0308104a30 0x7f0308196e60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f02fc02a9c0 tx=0x7f02fc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.125+0000 7f03057fa640 1 -- 172.21.15.17:0/994119539 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02fc004aa0 con 0x7f0308104a30 2024-08-19T01:22:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.125+0000 7f030e383640 1 -- 172.21.15.17:0/994119539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030819f990 con 0x7f0308104a30 2024-08-19T01:22:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.125+0000 7f03057fa640 1 -- 172.21.15.17:0/994119539 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02fc004c00 con 0x7f0308104a30 2024-08-19T01:22:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.125+0000 7f03057fa640 1 -- 172.21.15.17:0/994119539 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02fc003ab0 con 0x7f0308104a30 2024-08-19T01:22:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.125+0000 7f030e383640 1 -- 172.21.15.17:0/994119539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030819fcf0 con 0x7f0308104a30 2024-08-19T01:22:24.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.126+0000 7f030e383640 1 -- 172.21.15.17:0/994119539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0308100170 con 0x7f0308104a30 2024-08-19T01:22:24.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.127+0000 7f03057fa640 1 -- 172.21.15.17:0/994119539 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f02fc031d20 con 0x7f0308104a30 2024-08-19T01:22:24.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.127+0000 7f03057fa640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f02f006e170 0x7f02f0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:24.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.127+0000 7f03057fa640 1 -- 172.21.15.17:0/994119539 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f02fc0af270 con 0x7f0308104a30 2024-08-19T01:22:24.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.127+0000 7f0307fff640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f02f006e170 0x7f02f0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:24.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.128+0000 7f0307fff640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f02f006e170 0x7f02f0070630 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f02f80058c0 tx=0x7f02f8005ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:24.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.132+0000 7f03057fa640 1 -- 172.21.15.17:0/994119539 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f02fc078550 con 0x7f0308104a30 2024-08-19T01:22:24.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.373+0000 7f030e383640 1 -- 172.21.15.17:0/994119539 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f03080fee90 con 0x7f0308104a30 2024-08-19T01:22:24.375 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:24 smithi017 ceph-mon[99370]: from='client.35334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:24.376 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:24 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1829290282' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:22:24.376 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:24 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2366046839' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:22:24.376 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:24 smithi017 ceph-mon[99370]: from='client.35346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:24.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.373+0000 7f03057fa640 1 -- 172.21.15.17:0/994119539 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f02fc09ae60 con 0x7f0308104a30 2024-08-19T01:22:24.376 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:22:24.376 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:22:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:22:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:22:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:22:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:22:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:22:24.378 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:22:24.378 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:22:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:22:24.378 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:22:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:22:24.378 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:22:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:22:24.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.376+0000 7f030e383640 1 -- 172.21.15.17:0/994119539 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f02f006e170 msgr2=0x7f02f0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:24.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.376+0000 7f030e383640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f02f006e170 0x7f02f0070630 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f02f80058c0 tx=0x7f02f8005ec0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.376+0000 7f030e383640 1 -- 172.21.15.17:0/994119539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0308104a30 msgr2=0x7f0308196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:24.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.376+0000 7f030e383640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0308104a30 0x7f0308196e60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f02fc02a9c0 tx=0x7f02fc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.376+0000 7f030e383640 1 -- 172.21.15.17:0/994119539 shutdown_connections 2024-08-19T01:22:24.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.376+0000 7f030e383640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f02f006e170 0x7f02f0070630 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.376+0000 7f030e383640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0308104a30 0x7f0308196e60 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.376+0000 7f030e383640 1 --2- 172.21.15.17:0/994119539 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f03080fea30 0x7f0308196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:24.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.376+0000 7f030e383640 1 -- 172.21.15.17:0/994119539 >> 172.21.15.17:0/994119539 conn(0x7f03080fa730 msgr2=0x7f03080fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:24.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.376+0000 7f030e383640 1 -- 172.21.15.17:0/994119539 shutdown_connections 2024-08-19T01:22:24.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:24.376+0000 7f030e383640 1 -- 172.21.15.17:0/994119539 wait complete. 2024-08-19T01:22:24.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:24 smithi086 ceph-mon[71303]: from='client.35334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:24.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:24 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1829290282' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:22:24.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:24 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2366046839' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:22:24.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:24 smithi086 ceph-mon[71303]: from='client.35346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:25.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:25 smithi017 ceph-mon[99370]: pgmap v710: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:25.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:25 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/994119539' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:22:25.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:25 smithi086 ceph-mon[71303]: pgmap v710: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:25.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:25 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/994119539' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:22:27.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:27 smithi017 ceph-mon[99370]: pgmap v711: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:27.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:27 smithi086 ceph-mon[71303]: pgmap v711: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:29.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:29 smithi017 ceph-mon[99370]: pgmap v712: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:29.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:29 smithi086 ceph-mon[71303]: pgmap v712: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:31.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:31 smithi017 ceph-mon[99370]: pgmap v713: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:31.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:31 smithi086 ceph-mon[71303]: pgmap v713: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:33.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:33 smithi017 ceph-mon[99370]: pgmap v714: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:33.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:22:33.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:33 smithi086 ceph-mon[71303]: pgmap v714: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:33.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:22:35.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:35 smithi017 ceph-mon[99370]: pgmap v715: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:35.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:35 smithi086 ceph-mon[71303]: pgmap v715: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:37.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:37 smithi017 ceph-mon[99370]: pgmap v716: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:37.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:37 smithi086 ceph-mon[71303]: pgmap v716: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:39.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:39 smithi017 ceph-mon[99370]: pgmap v717: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:39.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:39 smithi086 ceph-mon[71303]: pgmap v717: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:41.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:41 smithi017 ceph-mon[99370]: pgmap v718: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:41.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:41 smithi086 ceph-mon[71303]: pgmap v718: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:43.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:43 smithi017 ceph-mon[99370]: pgmap v719: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:43.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:43 smithi086 ceph-mon[71303]: pgmap v719: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:45.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:45 smithi017 ceph-mon[99370]: pgmap v720: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:45.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:45 smithi086 ceph-mon[71303]: pgmap v720: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:47.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:47 smithi017 ceph-mon[99370]: pgmap v721: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:47.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:47 smithi086 ceph-mon[71303]: pgmap v721: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:48.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:22:48.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:22:49.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:49 smithi017 ceph-mon[99370]: pgmap v722: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:49.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:49 smithi086 ceph-mon[71303]: pgmap v722: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:51.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:51 smithi017 ceph-mon[99370]: pgmap v723: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:51.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:51 smithi086 ceph-mon[71303]: pgmap v723: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:53.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:53 smithi017 ceph-mon[99370]: pgmap v724: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:53 smithi086 ceph-mon[71303]: pgmap v724: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:54.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.471+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/1121467559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4e01015d0 msgr2=0x7fc4e0109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.471+0000 7fc4e6fc6640 1 --2- 172.21.15.17:0/1121467559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4e01015d0 0x7fc4e0109ac0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009880 tx=0x7fc4d002a530 comp rx=0 tx=0).stop 2024-08-19T01:22:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.471+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/1121467559 shutdown_connections 2024-08-19T01:22:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.471+0000 7fc4e6fc6640 1 --2- 172.21.15.17:0/1121467559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4e01015d0 0x7fc4e0109ac0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.471+0000 7fc4e6fc6640 1 --2- 172.21.15.17:0/1121467559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e0100cb0 0x7fc4e0101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.471+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/1121467559 >> 172.21.15.17:0/1121467559 conn(0x7fc4e00758a0 msgr2=0x7fc4e00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.472+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/1121467559 shutdown_connections 2024-08-19T01:22:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.472+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/1121467559 wait complete. 2024-08-19T01:22:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.472+0000 7fc4e6fc6640 1 Processor -- start 2024-08-19T01:22:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.472+0000 7fc4e6fc6640 1 -- start start 2024-08-19T01:22:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.472+0000 7fc4e6fc6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4e0100cb0 0x7fc4e019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:54.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.472+0000 7fc4e6fc6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e01015d0 0x7fc4e019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.472+0000 7fc4e6fc6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e019c390 con 0x7fc4e0100cb0 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.472+0000 7fc4e6fc6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e0195920 con 0x7fc4e01015d0 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4e4d62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4e0100cb0 0x7fc4e019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4e4d62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4e0100cb0 0x7fc4e019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44708/0 (socket says 172.21.15.17:44708) 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4e4d62640 1 -- 172.21.15.17:0/3588440723 learned_addr learned my addr 172.21.15.17:0/3588440723 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4dffff640 1 --2- 172.21.15.17:0/3588440723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e01015d0 0x7fc4e019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4e4d62640 1 -- 172.21.15.17:0/3588440723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e01015d0 msgr2=0x7fc4e019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4e4d62640 1 --2- 172.21.15.17:0/3588440723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e01015d0 0x7fc4e019bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4e4d62640 1 -- 172.21.15.17:0/3588440723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d0009560 con 0x7fc4e0100cb0 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4e4d62640 1 --2- 172.21.15.17:0/3588440723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4e0100cb0 0x7fc4e019b830 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800d8d0 tx=0x7fc4c800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4ddffb640 1 -- 172.21.15.17:0/3588440723 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4c800bea0 con 0x7fc4e0100cb0 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4ddffb640 1 -- 172.21.15.17:0/3588440723 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc4c8009c00 con 0x7fc4e0100cb0 2024-08-19T01:22:54.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/3588440723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e0195c00 con 0x7fc4e0100cb0 2024-08-19T01:22:54.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.473+0000 7fc4ddffb640 1 -- 172.21.15.17:0/3588440723 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4c800f710 con 0x7fc4e0100cb0 2024-08-19T01:22:54.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.474+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/3588440723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e0196120 con 0x7fc4e0100cb0 2024-08-19T01:22:54.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.475+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/3588440723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e0068510 con 0x7fc4e0100cb0 2024-08-19T01:22:54.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.475+0000 7fc4ddffb640 1 -- 172.21.15.17:0/3588440723 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc4c800f990 con 0x7fc4e0100cb0 2024-08-19T01:22:54.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.476+0000 7fc4ddffb640 1 --2- 172.21.15.17:0/3588440723 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc4cc06e170 0x7fc4cc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:54.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.476+0000 7fc4ddffb640 1 -- 172.21.15.17:0/3588440723 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc4c808df20 con 0x7fc4e0100cb0 2024-08-19T01:22:54.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.476+0000 7fc4dffff640 1 --2- 172.21.15.17:0/3588440723 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc4cc06e170 0x7fc4cc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:54.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.476+0000 7fc4dffff640 1 --2- 172.21.15.17:0/3588440723 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc4cc06e170 0x7fc4cc070630 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0000c00 tx=0x7fc4d0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:54.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.480+0000 7fc4ddffb640 1 -- 172.21.15.17:0/3588440723 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc4c80c2df0 con 0x7fc4e0100cb0 2024-08-19T01:22:54.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.674+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/3588440723 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4e01043f0 con 0x7fc4cc06e170 2024-08-19T01:22:54.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.675+0000 7fc4ddffb640 1 -- 172.21.15.17:0/3588440723 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc4e01043f0 con 0x7fc4cc06e170 2024-08-19T01:22:54.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.677+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/3588440723 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc4cc06e170 msgr2=0x7fc4cc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:54.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.677+0000 7fc4e6fc6640 1 --2- 172.21.15.17:0/3588440723 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc4cc06e170 0x7fc4cc070630 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0000c00 tx=0x7fc4d0005a20 comp rx=0 tx=0).stop 2024-08-19T01:22:54.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.677+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/3588440723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4e0100cb0 msgr2=0x7fc4e019b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:54.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.677+0000 7fc4e6fc6640 1 --2- 172.21.15.17:0/3588440723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4e0100cb0 0x7fc4e019b830 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800d8d0 tx=0x7fc4c800dd90 comp rx=0 tx=0).stop 2024-08-19T01:22:54.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.677+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/3588440723 shutdown_connections 2024-08-19T01:22:54.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.677+0000 7fc4e6fc6640 1 --2- 172.21.15.17:0/3588440723 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc4cc06e170 0x7fc4cc070630 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.677+0000 7fc4e6fc6640 1 --2- 172.21.15.17:0/3588440723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc4e01015d0 0x7fc4e019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.677+0000 7fc4e6fc6640 1 --2- 172.21.15.17:0/3588440723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4e0100cb0 0x7fc4e019b830 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.677+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/3588440723 >> 172.21.15.17:0/3588440723 conn(0x7fc4e00758a0 msgr2=0x7fc4e0101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:54.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.678+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/3588440723 shutdown_connections 2024-08-19T01:22:54.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.678+0000 7fc4e6fc6640 1 -- 172.21.15.17:0/3588440723 wait complete. 2024-08-19T01:22:54.688 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:22:54.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.761+0000 7fcf88e79640 1 -- 172.21.15.17:0/3690047418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84104a30 msgr2=0x7fcf84104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:54.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.761+0000 7fcf88e79640 1 --2- 172.21.15.17:0/3690047418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84104a30 0x7fcf84104e10 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009c20 tx=0x7fcf7402a970 comp rx=0 tx=0).stop 2024-08-19T01:22:54.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.761+0000 7fcf88e79640 1 -- 172.21.15.17:0/3690047418 shutdown_connections 2024-08-19T01:22:54.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.761+0000 7fcf88e79640 1 --2- 172.21.15.17:0/3690047418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf840fea30 0x7fcf840fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.761+0000 7fcf88e79640 1 --2- 172.21.15.17:0/3690047418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84104a30 0x7fcf84104e10 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.761+0000 7fcf88e79640 1 -- 172.21.15.17:0/3690047418 >> 172.21.15.17:0/3690047418 conn(0x7fcf840fa730 msgr2=0x7fcf840fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:54.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.761+0000 7fcf88e79640 1 -- 172.21.15.17:0/3690047418 shutdown_connections 2024-08-19T01:22:54.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.761+0000 7fcf88e79640 1 -- 172.21.15.17:0/3690047418 wait complete. 2024-08-19T01:22:54.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.762+0000 7fcf88e79640 1 Processor -- start 2024-08-19T01:22:54.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.762+0000 7fcf88e79640 1 -- start start 2024-08-19T01:22:54.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.762+0000 7fcf88e79640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf840fea30 0x7fcf8419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:54.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.762+0000 7fcf88e79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84104a30 0x7fcf8419bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:54.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.762+0000 7fcf88e79640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8419c410 con 0x7fcf84104a30 2024-08-19T01:22:54.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.762+0000 7fcf88e79640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf841959a0 con 0x7fcf840fea30 2024-08-19T01:22:54.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.762+0000 7fcf81d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84104a30 0x7fcf8419bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.762+0000 7fcf81d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84104a30 0x7fcf8419bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44718/0 (socket says 172.21.15.17:44718) 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.762+0000 7fcf81d9b640 1 -- 172.21.15.17:0/1940473092 learned_addr learned my addr 172.21.15.17:0/1940473092 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.763+0000 7fcf8259c640 1 --2- 172.21.15.17:0/1940473092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf840fea30 0x7fcf8419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.763+0000 7fcf81d9b640 1 -- 172.21.15.17:0/1940473092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf840fea30 msgr2=0x7fcf8419b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.763+0000 7fcf81d9b640 1 --2- 172.21.15.17:0/1940473092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf840fea30 0x7fcf8419b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.763+0000 7fcf81d9b640 1 -- 172.21.15.17:0/1940473092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf74009900 con 0x7fcf84104a30 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.763+0000 7fcf81d9b640 1 --2- 172.21.15.17:0/1940473092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84104a30 0x7fcf8419bdf0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00d6f0 tx=0x7fcf6c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.763+0000 7fcf7b7fe640 1 -- 172.21.15.17:0/1940473092 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6c009a30 con 0x7fcf84104a30 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.763+0000 7fcf88e79640 1 -- 172.21.15.17:0/1940473092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf84195c80 con 0x7fcf84104a30 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.763+0000 7fcf7b7fe640 1 -- 172.21.15.17:0/1940473092 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf6c0054e0 con 0x7fcf84104a30 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.763+0000 7fcf7b7fe640 1 -- 172.21.15.17:0/1940473092 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf6c010460 con 0x7fcf84104a30 2024-08-19T01:22:54.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.763+0000 7fcf88e79640 1 -- 172.21.15.17:0/1940473092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf841961d0 con 0x7fcf84104a30 2024-08-19T01:22:54.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.764+0000 7fcf88e79640 1 -- 172.21.15.17:0/1940473092 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf84100170 con 0x7fcf84104a30 2024-08-19T01:22:54.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.765+0000 7fcf7b7fe640 1 -- 172.21.15.17:0/1940473092 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcf6c009b90 con 0x7fcf84104a30 2024-08-19T01:22:54.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.766+0000 7fcf7b7fe640 1 --2- 172.21.15.17:0/1940473092 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcf7006e170 0x7fcf70070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:54.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.766+0000 7fcf7b7fe640 1 -- 172.21.15.17:0/1940473092 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcf6c08dd30 con 0x7fcf84104a30 2024-08-19T01:22:54.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.766+0000 7fcf8259c640 1 --2- 172.21.15.17:0/1940473092 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcf7006e170 0x7fcf70070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:54.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.766+0000 7fcf8259c640 1 --2- 172.21.15.17:0/1940473092 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcf7006e170 0x7fcf70070630 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcf74005fa0 tx=0x7fcf74005f10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:54.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.770+0000 7fcf7b7fe640 1 -- 172.21.15.17:0/1940473092 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcf6c057010 con 0x7fcf84104a30 2024-08-19T01:22:54.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.961+0000 7fcf88e79640 1 -- 172.21.15.17:0/1940473092 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf8410bcc0 con 0x7fcf7006e170 2024-08-19T01:22:54.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.962+0000 7fcf7b7fe640 1 -- 172.21.15.17:0/1940473092 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fcf8410bcc0 con 0x7fcf7006e170 2024-08-19T01:22:54.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.964+0000 7fcf88e79640 1 -- 172.21.15.17:0/1940473092 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcf7006e170 msgr2=0x7fcf70070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:54.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.964+0000 7fcf88e79640 1 --2- 172.21.15.17:0/1940473092 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcf7006e170 0x7fcf70070630 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcf74005fa0 tx=0x7fcf74005f10 comp rx=0 tx=0).stop 2024-08-19T01:22:54.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.964+0000 7fcf88e79640 1 -- 172.21.15.17:0/1940473092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84104a30 msgr2=0x7fcf8419bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:54.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.964+0000 7fcf88e79640 1 --2- 172.21.15.17:0/1940473092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84104a30 0x7fcf8419bdf0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00d6f0 tx=0x7fcf6c00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.964+0000 7fcf88e79640 1 -- 172.21.15.17:0/1940473092 shutdown_connections 2024-08-19T01:22:54.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.964+0000 7fcf88e79640 1 --2- 172.21.15.17:0/1940473092 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcf7006e170 0x7fcf70070630 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.964+0000 7fcf88e79640 1 --2- 172.21.15.17:0/1940473092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcf84104a30 0x7fcf8419bdf0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.964+0000 7fcf88e79640 1 --2- 172.21.15.17:0/1940473092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcf840fea30 0x7fcf8419b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.964+0000 7fcf88e79640 1 -- 172.21.15.17:0/1940473092 >> 172.21.15.17:0/1940473092 conn(0x7fcf840fa730 msgr2=0x7fcf840fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.964+0000 7fcf88e79640 1 -- 172.21.15.17:0/1940473092 shutdown_connections 2024-08-19T01:22:54.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:54.964+0000 7fcf88e79640 1 -- 172.21.15.17:0/1940473092 wait complete. 2024-08-19T01:22:55.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.046+0000 7f62162bd640 1 -- 172.21.15.17:0/2290699457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210100750 msgr2=0x7f62101047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.046+0000 7f62162bd640 1 --2- 172.21.15.17:0/2290699457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210100750 0x7f62101047a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6204009880 tx=0x7f620402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.046+0000 7f62162bd640 1 -- 172.21.15.17:0/2290699457 shutdown_connections 2024-08-19T01:22:55.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.046+0000 7f62162bd640 1 --2- 172.21.15.17:0/2290699457 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210100750 0x7f62101047a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.046+0000 7f62162bd640 1 --2- 172.21.15.17:0/2290699457 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62100ffda0 0x7f6210100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.046+0000 7f62162bd640 1 -- 172.21.15.17:0/2290699457 >> 172.21.15.17:0/2290699457 conn(0x7f62100fb840 msgr2=0x7f62100fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:55.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.046+0000 7f62162bd640 1 -- 172.21.15.17:0/2290699457 shutdown_connections 2024-08-19T01:22:55.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.046+0000 7f62162bd640 1 -- 172.21.15.17:0/2290699457 wait complete. 2024-08-19T01:22:55.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.047+0000 7f62162bd640 1 Processor -- start 2024-08-19T01:22:55.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.047+0000 7f62162bd640 1 -- start start 2024-08-19T01:22:55.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.047+0000 7f62162bd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62100ffda0 0x7f62100727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.047+0000 7f62162bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210100750 0x7f6210072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.047+0000 7f62162bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6210073230 con 0x7f6210100750 2024-08-19T01:22:55.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.047+0000 7f62162bd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6210073370 con 0x7f62100ffda0 2024-08-19T01:22:55.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f620f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210100750 0x7f6210072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f620f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210100750 0x7f6210072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44730/0 (socket says 172.21.15.17:44730) 2024-08-19T01:22:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f620f7fe640 1 -- 172.21.15.17:0/3752216616 learned_addr learned my addr 172.21.15.17:0/3752216616 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f620ffff640 1 --2- 172.21.15.17:0/3752216616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62100ffda0 0x7f62100727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f620f7fe640 1 -- 172.21.15.17:0/3752216616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62100ffda0 msgr2=0x7f62100727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f620f7fe640 1 --2- 172.21.15.17:0/3752216616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62100ffda0 0x7f62100727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f620f7fe640 1 -- 172.21.15.17:0/3752216616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204009560 con 0x7f6210100750 2024-08-19T01:22:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f620f7fe640 1 --2- 172.21.15.17:0/3752216616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210100750 0x7f6210072cf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f620402a9c0 tx=0x7f62040055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f620d7fa640 1 -- 172.21.15.17:0/3752216616 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62040048d0 con 0x7f6210100750 2024-08-19T01:22:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f620d7fa640 1 -- 172.21.15.17:0/3752216616 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6204031640 con 0x7f6210100750 2024-08-19T01:22:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f62162bd640 1 -- 172.21.15.17:0/3752216616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62100735f0 con 0x7f6210100750 2024-08-19T01:22:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.048+0000 7f620d7fa640 1 -- 172.21.15.17:0/3752216616 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62040038d0 con 0x7f6210100750 2024-08-19T01:22:55.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.049+0000 7f62162bd640 1 -- 172.21.15.17:0/3752216616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62101a2000 con 0x7f6210100750 2024-08-19T01:22:55.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.050+0000 7f62162bd640 1 -- 172.21.15.17:0/3752216616 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6210101280 con 0x7f6210100750 2024-08-19T01:22:55.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.050+0000 7f620d7fa640 1 -- 172.21.15.17:0/3752216616 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6204003b90 con 0x7f6210100750 2024-08-19T01:22:55.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.051+0000 7f620d7fa640 1 --2- 172.21.15.17:0/3752216616 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61f806e170 0x7f61f8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.051+0000 7f620d7fa640 1 -- 172.21.15.17:0/3752216616 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f62040af0a0 con 0x7f6210100750 2024-08-19T01:22:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.051+0000 7f620ffff640 1 --2- 172.21.15.17:0/3752216616 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61f806e170 0x7f61f8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.051+0000 7f620ffff640 1 --2- 172.21.15.17:0/3752216616 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61f806e170 0x7f61f8070630 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6200009bd0 tx=0x7f6200005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:55.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.055+0000 7f620d7fa640 1 -- 172.21.15.17:0/3752216616 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6204078430 con 0x7f6210100750 2024-08-19T01:22:55.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.239+0000 7f62162bd640 1 -- 172.21.15.17:0/3752216616 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f621010cdd0 con 0x7f61f806e170 2024-08-19T01:22:55.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.249+0000 7f620d7fa640 1 -- 172.21.15.17:0/3752216616 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f621010cdd0 con 0x7f61f806e170 2024-08-19T01:22:55.251 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:22:55.251 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (24m) 2m ago 34m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:22:55.251 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (35m) 2m ago 35m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:22:55.251 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (34m) 2m ago 34m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:22:55.251 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (21m) 2m ago 35m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:22:55.251 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (21m) 2m ago 34m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:22:55.251 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (23m) 2m ago 34m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:22:55.251 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (18m) 2m ago 29m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (18m) 2m ago 29m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (2m) 2m ago 29m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (17m) 2m ago 29m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (26m) 2m ago 36m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (25m) 2m ago 33m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (22m) 2m ago 36m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (22m) 2m ago 33m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (24m) 2m ago 34m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (24m) 2m ago 33m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (21m) 2m ago 33m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (21m) 2m ago 32m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (20m) 2m ago 32m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (19m) 2m ago 31m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:22:55.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (19m) 2m ago 31m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:22:55.253 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (18m) 2m ago 30m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:22:55.253 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (24m) 2m ago 34m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:22:55.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.251+0000 7f62162bd640 1 -- 172.21.15.17:0/3752216616 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61f806e170 msgr2=0x7f61f8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.251+0000 7f62162bd640 1 --2- 172.21.15.17:0/3752216616 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61f806e170 0x7f61f8070630 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6200009bd0 tx=0x7f6200005f90 comp rx=0 tx=0).stop 2024-08-19T01:22:55.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.251+0000 7f62162bd640 1 -- 172.21.15.17:0/3752216616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210100750 msgr2=0x7f6210072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.251+0000 7f62162bd640 1 --2- 172.21.15.17:0/3752216616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210100750 0x7f6210072cf0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f620402a9c0 tx=0x7f62040055a0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.251+0000 7f62162bd640 1 -- 172.21.15.17:0/3752216616 shutdown_connections 2024-08-19T01:22:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.251+0000 7f62162bd640 1 --2- 172.21.15.17:0/3752216616 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f61f806e170 0x7f61f8070630 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.251+0000 7f62162bd640 1 --2- 172.21.15.17:0/3752216616 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6210100750 0x7f6210072cf0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.251+0000 7f62162bd640 1 --2- 172.21.15.17:0/3752216616 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62100ffda0 0x7f62100727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.251+0000 7f62162bd640 1 -- 172.21.15.17:0/3752216616 >> 172.21.15.17:0/3752216616 conn(0x7f62100fb840 msgr2=0x7f62100fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.251+0000 7f62162bd640 1 -- 172.21.15.17:0/3752216616 shutdown_connections 2024-08-19T01:22:55.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.251+0000 7f62162bd640 1 -- 172.21.15.17:0/3752216616 wait complete. 2024-08-19T01:22:55.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.332+0000 7f715b557640 1 -- 172.21.15.17:0/3844143642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71540ffda0 msgr2=0x7f7154100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.332+0000 7f715b557640 1 --2- 172.21.15.17:0/3844143642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71540ffda0 0x7f7154100180 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f714c009880 tx=0x7f714c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.332+0000 7f715b557640 1 -- 172.21.15.17:0/3844143642 shutdown_connections 2024-08-19T01:22:55.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.332+0000 7f715b557640 1 --2- 172.21.15.17:0/3844143642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7154100750 0x7f71541047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.332+0000 7f715b557640 1 --2- 172.21.15.17:0/3844143642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71540ffda0 0x7f7154100180 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.332+0000 7f715b557640 1 -- 172.21.15.17:0/3844143642 >> 172.21.15.17:0/3844143642 conn(0x7f71540fb840 msgr2=0x7f71540fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:55.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.332+0000 7f715b557640 1 -- 172.21.15.17:0/3844143642 shutdown_connections 2024-08-19T01:22:55.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.332+0000 7f715b557640 1 -- 172.21.15.17:0/3844143642 wait complete. 2024-08-19T01:22:55.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.333+0000 7f715b557640 1 Processor -- start 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.333+0000 7f715b557640 1 -- start start 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.333+0000 7f715b557640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71540ffda0 0x7f715419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.333+0000 7f715b557640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7154100750 0x7f715419bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.333+0000 7f715b557640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7154195a10 con 0x7f7154100750 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.333+0000 7f715b557640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7154195b50 con 0x7f71540ffda0 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.333+0000 7f7158af2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7154100750 0x7f715419bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.333+0000 7f7158af2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7154100750 0x7f715419bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44756/0 (socket says 172.21.15.17:44756) 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.333+0000 7f7158af2640 1 -- 172.21.15.17:0/4006645974 learned_addr learned my addr 172.21.15.17:0/4006645974 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.333+0000 7f71592f3640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71540ffda0 0x7f715419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.334+0000 7f7158af2640 1 -- 172.21.15.17:0/4006645974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71540ffda0 msgr2=0x7f715419b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.334+0000 7f7158af2640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71540ffda0 0x7f715419b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.334+0000 7f7158af2640 1 -- 172.21.15.17:0/4006645974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c009560 con 0x7f7154100750 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.334+0000 7f71592f3640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71540ffda0 0x7f715419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T01:22:55.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.334+0000 7f7158af2640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7154100750 0x7f715419bef0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f714800d6f0 tx=0x7f714800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:55.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.334+0000 7f71527fc640 1 -- 172.21.15.17:0/4006645974 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7148009a30 con 0x7f7154100750 2024-08-19T01:22:55.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.334+0000 7f71527fc640 1 -- 172.21.15.17:0/4006645974 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71480054e0 con 0x7f7154100750 2024-08-19T01:22:55.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.334+0000 7f715b557640 1 -- 172.21.15.17:0/4006645974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7154195e30 con 0x7f7154100750 2024-08-19T01:22:55.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.334+0000 7f71527fc640 1 -- 172.21.15.17:0/4006645974 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7148010460 con 0x7f7154100750 2024-08-19T01:22:55.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.334+0000 7f715b557640 1 -- 172.21.15.17:0/4006645974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7154196380 con 0x7f7154100750 2024-08-19T01:22:55.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.335+0000 7f715b557640 1 -- 172.21.15.17:0/4006645974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7154101280 con 0x7f7154100750 2024-08-19T01:22:55.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.336+0000 7f71527fc640 1 -- 172.21.15.17:0/4006645974 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7148009b90 con 0x7f7154100750 2024-08-19T01:22:55.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.336+0000 7f71527fc640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f713c06e170 0x7f713c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.336+0000 7f71527fc640 1 -- 172.21.15.17:0/4006645974 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f714808dbd0 con 0x7f7154100750 2024-08-19T01:22:55.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.336+0000 7f71592f3640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f713c06e170 0x7f713c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.337+0000 7f71592f3640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f713c06e170 0x7f713c070630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f714c009230 tx=0x7f714c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:55.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.341+0000 7f71527fc640 1 -- 172.21.15.17:0/4006645974 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7148056fe0 con 0x7f7154100750 2024-08-19T01:22:55.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.583+0000 7f715b557640 1 -- 172.21.15.17:0/4006645974 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7154196f70 con 0x7f7154100750 2024-08-19T01:22:55.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.584+0000 7f71527fc640 1 -- 172.21.15.17:0/4006645974 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f7148020280 con 0x7f7154100750 2024-08-19T01:22:55.586 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:22:55.586 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:22:55.586 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:22:55.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:22:55.586 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:22:55.586 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:22:55.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:22:55.587 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:22:55.587 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:22:55.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:22:55.587 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:22:55.587 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:22:55.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:22:55.587 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:22:55.587 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:22:55.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:22:55.587 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:22:55.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.586+0000 7f715b557640 1 -- 172.21.15.17:0/4006645974 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f713c06e170 msgr2=0x7f713c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.586+0000 7f715b557640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f713c06e170 0x7f713c070630 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f714c009230 tx=0x7f714c0058d0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.586+0000 7f715b557640 1 -- 172.21.15.17:0/4006645974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7154100750 msgr2=0x7f715419bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.586+0000 7f715b557640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7154100750 0x7f715419bef0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f714800d6f0 tx=0x7f714800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.586+0000 7f715b557640 1 -- 172.21.15.17:0/4006645974 shutdown_connections 2024-08-19T01:22:55.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.586+0000 7f715b557640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f713c06e170 0x7f713c070630 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.586+0000 7f715b557640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7154100750 0x7f715419bef0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.586+0000 7f715b557640 1 --2- 172.21.15.17:0/4006645974 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f71540ffda0 0x7f715419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.586+0000 7f715b557640 1 -- 172.21.15.17:0/4006645974 >> 172.21.15.17:0/4006645974 conn(0x7f71540fb840 msgr2=0x7f71540fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:55.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.586+0000 7f715b557640 1 -- 172.21.15.17:0/4006645974 shutdown_connections 2024-08-19T01:22:55.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.586+0000 7f715b557640 1 -- 172.21.15.17:0/4006645974 wait complete. 2024-08-19T01:22:55.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.668+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/2187100161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc80fea30 msgr2=0x7f7fc80fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.668+0000 7f7fcd8f3640 1 --2- 172.21.15.17:0/2187100161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc80fea30 0x7f7fc80fee90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009880 tx=0x7f7fbc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.668+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/2187100161 shutdown_connections 2024-08-19T01:22:55.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.668+0000 7f7fcd8f3640 1 --2- 172.21.15.17:0/2187100161 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc80fea30 0x7f7fc80fee90 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.668+0000 7f7fcd8f3640 1 --2- 172.21.15.17:0/2187100161 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc8104a30 0x7f7fc8104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.668+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/2187100161 >> 172.21.15.17:0/2187100161 conn(0x7f7fc80fa730 msgr2=0x7f7fc80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:55.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.668+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/2187100161 shutdown_connections 2024-08-19T01:22:55.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.668+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/2187100161 wait complete. 2024-08-19T01:22:55.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fcd8f3640 1 Processor -- start 2024-08-19T01:22:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fcd8f3640 1 -- start start 2024-08-19T01:22:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fcd8f3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc80fea30 0x7f7fc8196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fcd8f3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc8104a30 0x7f7fc8196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fcd8f3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8197430 con 0x7f7fc80fea30 2024-08-19T01:22:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fcd8f3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc81975a0 con 0x7f7fc8104a30 2024-08-19T01:22:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fc6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc80fea30 0x7f7fc8196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fc6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc80fea30 0x7f7fc8196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44776/0 (socket says 172.21.15.17:44776) 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fc6ffd640 1 -- 172.21.15.17:0/529869115 learned_addr learned my addr 172.21.15.17:0/529869115 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fc67fc640 1 --2- 172.21.15.17:0/529869115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc8104a30 0x7f7fc8196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fc6ffd640 1 -- 172.21.15.17:0/529869115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc8104a30 msgr2=0x7f7fc8196e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fc6ffd640 1 --2- 172.21.15.17:0/529869115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc8104a30 0x7f7fc8196e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.669+0000 7f7fc6ffd640 1 -- 172.21.15.17:0/529869115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc009560 con 0x7f7fc80fea30 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.670+0000 7f7fc6ffd640 1 --2- 172.21.15.17:0/529869115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc80fea30 0x7f7fc8196920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800ea00 tx=0x7f7fb800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.670+0000 7f7fcc8f1640 1 -- 172.21.15.17:0/529869115 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fb800cd50 con 0x7f7fc80fea30 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.670+0000 7f7fcc8f1640 1 -- 172.21.15.17:0/529869115 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fb8005020 con 0x7f7fc80fea30 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.670+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/529869115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc819f990 con 0x7f7fc80fea30 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.670+0000 7f7fcc8f1640 1 -- 172.21.15.17:0/529869115 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fb80116a0 con 0x7f7fc80fea30 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.670+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/529869115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc819fda0 con 0x7f7fc80fea30 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.671+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/529869115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc8100170 con 0x7f7fc80fea30 2024-08-19T01:22:55.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.671+0000 7f7fcc8f1640 1 -- 172.21.15.17:0/529869115 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7fb8005190 con 0x7f7fc80fea30 2024-08-19T01:22:55.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.672+0000 7f7fcc8f1640 1 --2- 172.21.15.17:0/529869115 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 0x7f7fb0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.672+0000 7f7fcc8f1640 1 -- 172.21.15.17:0/529869115 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7fb808e3e0 con 0x7f7fc80fea30 2024-08-19T01:22:55.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.672+0000 7f7fc67fc640 1 --2- 172.21.15.17:0/529869115 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 0x7f7fb0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.672+0000 7f7fc67fc640 1 --2- 172.21.15.17:0/529869115 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 0x7f7fb0070630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009230 tx=0x7f7fbc0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:55.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.676+0000 7f7fcc8f1640 1 -- 172.21.15.17:0/529869115 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7fb80577f0 con 0x7f7fc80fea30 2024-08-19T01:22:55.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.889+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/529869115 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7fc80fee90 con 0x7f7fc80fea30 2024-08-19T01:22:55.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:55 smithi017 ceph-mon[99370]: pgmap v725: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:55.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:55 smithi017 ceph-mon[99370]: from='client.35354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:55.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:55 smithi017 ceph-mon[99370]: from='client.35358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:55.892 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:55 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4006645974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:22:55.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.890+0000 7f7fcc8f1640 1 -- 172.21.15.17:0/529869115 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f7fb801f790 con 0x7f7fc80fea30 2024-08-19T01:22:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:22:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:22:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:22:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:22:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:22:55.893 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:22:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:22:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:22:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:22:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:22:55.894 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:22:55.895 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:22:55.896 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:22:55.896 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:22:55.896 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:22:55.896 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:22:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:22:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.892+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/529869115 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 msgr2=0x7f7fb0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.892+0000 7f7fcd8f3640 1 --2- 172.21.15.17:0/529869115 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 0x7f7fb0070630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009230 tx=0x7f7fbc0058d0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.892+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/529869115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc80fea30 msgr2=0x7f7fc8196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.892+0000 7f7fcd8f3640 1 --2- 172.21.15.17:0/529869115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc80fea30 0x7f7fc8196920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800ea00 tx=0x7f7fb800eec0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.892+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/529869115 shutdown_connections 2024-08-19T01:22:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.892+0000 7f7fcd8f3640 1 --2- 172.21.15.17:0/529869115 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7fb006e170 0x7f7fb0070630 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.892+0000 7f7fcd8f3640 1 --2- 172.21.15.17:0/529869115 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7fc8104a30 0x7f7fc8196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.892+0000 7f7fcd8f3640 1 --2- 172.21.15.17:0/529869115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7fc80fea30 0x7f7fc8196920 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.892+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/529869115 >> 172.21.15.17:0/529869115 conn(0x7f7fc80fa730 msgr2=0x7f7fc80fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.892+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/529869115 shutdown_connections 2024-08-19T01:22:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.892+0000 7f7fcd8f3640 1 -- 172.21.15.17:0/529869115 wait complete. 2024-08-19T01:22:55.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:55 smithi086 ceph-mon[71303]: pgmap v725: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:55.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:55 smithi086 ceph-mon[71303]: from='client.35354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:55.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:55 smithi086 ceph-mon[71303]: from='client.35358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:55.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:55 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4006645974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:22:55.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.975+0000 7f0555aca640 1 -- 172.21.15.17:0/3906318191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05500ffda0 msgr2=0x7f0550100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.975+0000 7f0555aca640 1 --2- 172.21.15.17:0/3906318191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05500ffda0 0x7f0550100180 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0540009880 tx=0x7f054002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.975+0000 7f0555aca640 1 -- 172.21.15.17:0/3906318191 shutdown_connections 2024-08-19T01:22:55.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.975+0000 7f0555aca640 1 --2- 172.21.15.17:0/3906318191 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0550100750 0x7f05501047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.975+0000 7f0555aca640 1 --2- 172.21.15.17:0/3906318191 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05500ffda0 0x7f0550100180 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.975+0000 7f0555aca640 1 -- 172.21.15.17:0/3906318191 >> 172.21.15.17:0/3906318191 conn(0x7f05500fb840 msgr2=0x7f05500fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:55.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.975+0000 7f0555aca640 1 -- 172.21.15.17:0/3906318191 shutdown_connections 2024-08-19T01:22:55.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.975+0000 7f0555aca640 1 -- 172.21.15.17:0/3906318191 wait complete. 2024-08-19T01:22:55.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.976+0000 7f0555aca640 1 Processor -- start 2024-08-19T01:22:55.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.976+0000 7f0555aca640 1 -- start start 2024-08-19T01:22:55.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.976+0000 7f0555aca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05500ffda0 0x7f05500727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.976+0000 7f0555aca640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0550100750 0x7f0550072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.976+0000 7f0555aca640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05500747b0 con 0x7f05500ffda0 2024-08-19T01:22:55.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.976+0000 7f0555aca640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0550073230 con 0x7f0550100750 2024-08-19T01:22:55.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.976+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05500ffda0 0x7f05500727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.976+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05500ffda0 0x7f05500727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44802/0 (socket says 172.21.15.17:44802) 2024-08-19T01:22:55.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.976+0000 7f054f7fe640 1 -- 172.21.15.17:0/86024718 learned_addr learned my addr 172.21.15.17:0/86024718 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.977+0000 7f0546ffd640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0550100750 0x7f0550072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.977+0000 7f054f7fe640 1 -- 172.21.15.17:0/86024718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0550100750 msgr2=0x7f0550072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.977+0000 7f054f7fe640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0550100750 0x7f0550072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.977+0000 7f054f7fe640 1 -- 172.21.15.17:0/86024718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0540009560 con 0x7f05500ffda0 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.977+0000 7f0546ffd640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0550100750 0x7f0550072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.977+0000 7f054f7fe640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05500ffda0 0x7f05500727b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0540006010 tx=0x7f05400055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.977+0000 7f054d7fa640 1 -- 172.21.15.17:0/86024718 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0540004aa0 con 0x7f05500ffda0 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.977+0000 7f0555aca640 1 -- 172.21.15.17:0/86024718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05500734b0 con 0x7f05500ffda0 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.977+0000 7f054d7fa640 1 -- 172.21.15.17:0/86024718 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0540004c00 con 0x7f05500ffda0 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.977+0000 7f054d7fa640 1 -- 172.21.15.17:0/86024718 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0540003a20 con 0x7f05500ffda0 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.977+0000 7f0555aca640 1 -- 172.21.15.17:0/86024718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05501a1e90 con 0x7f05500ffda0 2024-08-19T01:22:55.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.978+0000 7f0555aca640 1 -- 172.21.15.17:0/86024718 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0550101280 con 0x7f05500ffda0 2024-08-19T01:22:55.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.979+0000 7f054d7fa640 1 -- 172.21.15.17:0/86024718 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0540031c90 con 0x7f05500ffda0 2024-08-19T01:22:55.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.979+0000 7f054d7fa640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f053c06e180 0x7f053c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:55.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.979+0000 7f054d7fa640 1 -- 172.21.15.17:0/86024718 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f05400af360 con 0x7f05500ffda0 2024-08-19T01:22:55.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.979+0000 7f0546ffd640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f053c06e180 0x7f053c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:55.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.980+0000 7f0546ffd640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f053c06e180 0x7f053c070640 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0550074240 tx=0x7f0538005d90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:55.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:55.984+0000 7f054d7fa640 1 -- 172.21.15.17:0/86024718 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0540078640 con 0x7f05500ffda0 2024-08-19T01:22:56.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.186+0000 7f0555aca640 1 -- 172.21.15.17:0/86024718 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f055010cdb0 con 0x7f053c06e180 2024-08-19T01:22:56.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.187+0000 7f054d7fa640 1 -- 172.21.15.17:0/86024718 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f055010cdb0 con 0x7f053c06e180 2024-08-19T01:22:56.189 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:22:56.190 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:22:56.191 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:22:56.191 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:22:56.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.189+0000 7f0555aca640 1 -- 172.21.15.17:0/86024718 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f053c06e180 msgr2=0x7f053c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:56.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.189+0000 7f0555aca640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f053c06e180 0x7f053c070640 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0550074240 tx=0x7f0538005d90 comp rx=0 tx=0).stop 2024-08-19T01:22:56.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.189+0000 7f0555aca640 1 -- 172.21.15.17:0/86024718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05500ffda0 msgr2=0x7f05500727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:56.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.189+0000 7f0555aca640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05500ffda0 0x7f05500727b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0540006010 tx=0x7f05400055a0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.190+0000 7f0555aca640 1 -- 172.21.15.17:0/86024718 shutdown_connections 2024-08-19T01:22:56.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.190+0000 7f0555aca640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f053c06e180 0x7f053c070640 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.190+0000 7f0555aca640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0550100750 0x7f0550072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.190+0000 7f0555aca640 1 --2- 172.21.15.17:0/86024718 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05500ffda0 0x7f05500727b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.190+0000 7f0555aca640 1 -- 172.21.15.17:0/86024718 >> 172.21.15.17:0/86024718 conn(0x7f05500fb840 msgr2=0x7f05500fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:56.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.190+0000 7f0555aca640 1 -- 172.21.15.17:0/86024718 shutdown_connections 2024-08-19T01:22:56.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.190+0000 7f0555aca640 1 -- 172.21.15.17:0/86024718 wait complete. 2024-08-19T01:22:56.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.271+0000 7f95cb43b640 1 -- 172.21.15.17:0/3205914517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c40fea30 msgr2=0x7f95c40fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:56.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.271+0000 7f95cb43b640 1 --2- 172.21.15.17:0/3205914517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c40fea30 0x7f95c40fee90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009880 tx=0x7f95b802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.271+0000 7f95cb43b640 1 -- 172.21.15.17:0/3205914517 shutdown_connections 2024-08-19T01:22:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.271+0000 7f95cb43b640 1 --2- 172.21.15.17:0/3205914517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c40fea30 0x7f95c40fee90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.271+0000 7f95cb43b640 1 --2- 172.21.15.17:0/3205914517 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95c4104a30 0x7f95c4104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.271+0000 7f95cb43b640 1 -- 172.21.15.17:0/3205914517 >> 172.21.15.17:0/3205914517 conn(0x7f95c40fa730 msgr2=0x7f95c40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.271+0000 7f95cb43b640 1 -- 172.21.15.17:0/3205914517 shutdown_connections 2024-08-19T01:22:56.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.271+0000 7f95cb43b640 1 -- 172.21.15.17:0/3205914517 wait complete. 2024-08-19T01:22:56.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.272+0000 7f95cb43b640 1 Processor -- start 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.272+0000 7f95cb43b640 1 -- start start 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.272+0000 7f95cb43b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c40fea30 0x7f95c4196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.272+0000 7f95cb43b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95c4104a30 0x7f95c4196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.272+0000 7f95cb43b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4197470 con 0x7f95c40fea30 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.272+0000 7f95cb43b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c41975e0 con 0x7f95c4104a30 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.272+0000 7f95c91d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c40fea30 0x7f95c4196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.272+0000 7f95c91d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c40fea30 0x7f95c4196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:44812/0 (socket says 172.21.15.17:44812) 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.272+0000 7f95c91d7640 1 -- 172.21.15.17:0/554656531 learned_addr learned my addr 172.21.15.17:0/554656531 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.273+0000 7f95c89d6640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95c4104a30 0x7f95c4196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.273+0000 7f95c91d7640 1 -- 172.21.15.17:0/554656531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95c4104a30 msgr2=0x7f95c4196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.273+0000 7f95c91d7640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95c4104a30 0x7f95c4196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.273+0000 7f95c91d7640 1 -- 172.21.15.17:0/554656531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b8009560 con 0x7f95c40fea30 2024-08-19T01:22:56.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.273+0000 7f95c89d6640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95c4104a30 0x7f95c4196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:22:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.273+0000 7f95c91d7640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c40fea30 0x7f95c4196960 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00c8f0 tx=0x7f95bc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.273+0000 7f95c27fc640 1 -- 172.21.15.17:0/554656531 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95bc007b80 con 0x7f95c40fea30 2024-08-19T01:22:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.273+0000 7f95c27fc640 1 -- 172.21.15.17:0/554656531 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f95bc0054e0 con 0x7f95c40fea30 2024-08-19T01:22:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.273+0000 7f95cb43b640 1 -- 172.21.15.17:0/554656531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c419f9d0 con 0x7f95c40fea30 2024-08-19T01:22:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.273+0000 7f95c27fc640 1 -- 172.21.15.17:0/554656531 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95bc00f450 con 0x7f95c40fea30 2024-08-19T01:22:56.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.273+0000 7f95cb43b640 1 -- 172.21.15.17:0/554656531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c419fde0 con 0x7f95c40fea30 2024-08-19T01:22:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.274+0000 7f95cb43b640 1 -- 172.21.15.17:0/554656531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c4100170 con 0x7f95c40fea30 2024-08-19T01:22:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.275+0000 7f95c27fc640 1 -- 172.21.15.17:0/554656531 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f95bc004f60 con 0x7f95c40fea30 2024-08-19T01:22:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.275+0000 7f95c27fc640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f95ac06e170 0x7f95ac070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:22:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.275+0000 7f95c27fc640 1 -- 172.21.15.17:0/554656531 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f95bc08df30 con 0x7f95c40fea30 2024-08-19T01:22:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.275+0000 7f95c89d6640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f95ac06e170 0x7f95ac070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:22:56.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.276+0000 7f95c89d6640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f95ac06e170 0x7f95ac070630 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f95b8000c00 tx=0x7f95b8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:22:56.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.279+0000 7f95c27fc640 1 -- 172.21.15.17:0/554656531 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f95bc0c2df0 con 0x7f95c40fea30 2024-08-19T01:22:56.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.523+0000 7f95cb43b640 1 -- 172.21.15.17:0/554656531 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f95c41977a0 con 0x7f95c40fea30 2024-08-19T01:22:56.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.523+0000 7f95c27fc640 1 -- 172.21.15.17:0/554656531 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f95c41977a0 con 0x7f95c40fea30 2024-08-19T01:22:56.525 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:22:56.525 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:22:56.526 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:22:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:22:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:22:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:22:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:22:56.527 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:22:56.527 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:22:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:22:56.527 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:22:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:22:56.527 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:22:56.527 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:22:56.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.525+0000 7f95cb43b640 1 -- 172.21.15.17:0/554656531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f95ac06e170 msgr2=0x7f95ac070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:56.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.525+0000 7f95cb43b640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f95ac06e170 0x7f95ac070630 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f95b8000c00 tx=0x7f95b8005a20 comp rx=0 tx=0).stop 2024-08-19T01:22:56.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.525+0000 7f95cb43b640 1 -- 172.21.15.17:0/554656531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c40fea30 msgr2=0x7f95c4196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:22:56.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.525+0000 7f95cb43b640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c40fea30 0x7f95c4196960 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f95bc00c8f0 tx=0x7f95bc00cdb0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.525+0000 7f95cb43b640 1 -- 172.21.15.17:0/554656531 shutdown_connections 2024-08-19T01:22:56.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.525+0000 7f95cb43b640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f95ac06e170 0x7f95ac070630 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.525+0000 7f95cb43b640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f95c4104a30 0x7f95c4196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.525+0000 7f95cb43b640 1 --2- 172.21.15.17:0/554656531 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c40fea30 0x7f95c4196960 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:22:56.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.525+0000 7f95cb43b640 1 -- 172.21.15.17:0/554656531 >> 172.21.15.17:0/554656531 conn(0x7f95c40fa730 msgr2=0x7f95c40fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:22:56.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.526+0000 7f95cb43b640 1 -- 172.21.15.17:0/554656531 shutdown_connections 2024-08-19T01:22:56.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:22:56.526+0000 7f95cb43b640 1 -- 172.21.15.17:0/554656531 wait complete. 2024-08-19T01:22:56.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:56 smithi017 ceph-mon[99370]: from='client.35362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:56.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:56 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/529869115' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:22:56.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:56 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/554656531' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:22:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:56 smithi086 ceph-mon[71303]: from='client.35362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:56 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/529869115' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:22:56.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:56 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/554656531' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:22:57.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:57 smithi017 ceph-mon[99370]: pgmap v726: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:57.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:57 smithi017 ceph-mon[99370]: from='client.35374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:57 smithi086 ceph-mon[71303]: pgmap v726: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:57.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:57 smithi086 ceph-mon[71303]: from='client.35374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:22:59.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:22:59 smithi017 ceph-mon[99370]: pgmap v727: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:22:59.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:22:59 smithi086 ceph-mon[71303]: pgmap v727: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:01.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:01 smithi017 ceph-mon[99370]: pgmap v728: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:01.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:01 smithi086 ceph-mon[71303]: pgmap v728: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:03.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:03 smithi017 ceph-mon[99370]: pgmap v729: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:03.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:23:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:03 smithi086 ceph-mon[71303]: pgmap v729: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:03.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:23:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:05 smithi017 ceph-mon[99370]: pgmap v730: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:05.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:05 smithi086 ceph-mon[71303]: pgmap v730: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:07.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:07 smithi017 ceph-mon[99370]: pgmap v731: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:07.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:07 smithi086 ceph-mon[71303]: pgmap v731: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:09.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:09 smithi017 ceph-mon[99370]: pgmap v732: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:09.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:09 smithi086 ceph-mon[71303]: pgmap v732: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:11.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:11 smithi017 ceph-mon[99370]: pgmap v733: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:11.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:11 smithi086 ceph-mon[71303]: pgmap v733: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:13.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:13 smithi086 ceph-mon[71303]: pgmap v734: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:14.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:13 smithi017 ceph-mon[99370]: pgmap v734: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:15.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:15 smithi086 ceph-mon[71303]: pgmap v735: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:16.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:15 smithi017 ceph-mon[99370]: pgmap v735: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:17.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:17 smithi086 ceph-mon[71303]: pgmap v736: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:17 smithi017 ceph-mon[99370]: pgmap v736: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:23:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:23:20.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:19 smithi017 ceph-mon[99370]: pgmap v737: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:19 smithi086 ceph-mon[71303]: pgmap v737: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:21.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:21 smithi017 ceph-mon[99370]: pgmap v738: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:22.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:21 smithi086 ceph-mon[71303]: pgmap v738: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:23 smithi017 ceph-mon[99370]: pgmap v739: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:24.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:23 smithi086 ceph-mon[71303]: pgmap v739: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:26.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:25 smithi017 ceph-mon[99370]: pgmap v740: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:25 smithi086 ceph-mon[71303]: pgmap v740: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:26.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.622+0000 7f6f65d18640 1 -- 172.21.15.17:0/3120538283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f600fe9f0 msgr2=0x7f6f600fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:26.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.622+0000 7f6f65d18640 1 --2- 172.21.15.17:0/3120538283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f600fe9f0 0x7f6f600fee50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009880 tx=0x7f6f4802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.622+0000 7f6f65d18640 1 -- 172.21.15.17:0/3120538283 shutdown_connections 2024-08-19T01:23:26.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.622+0000 7f6f65d18640 1 --2- 172.21.15.17:0/3120538283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f600fe9f0 0x7f6f600fee50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.622+0000 7f6f65d18640 1 --2- 172.21.15.17:0/3120538283 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f601049f0 0x7f6f60104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.622+0000 7f6f65d18640 1 -- 172.21.15.17:0/3120538283 >> 172.21.15.17:0/3120538283 conn(0x7f6f600758a0 msgr2=0x7f6f600fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:26.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.622+0000 7f6f65d18640 1 -- 172.21.15.17:0/3120538283 shutdown_connections 2024-08-19T01:23:26.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.622+0000 7f6f65d18640 1 -- 172.21.15.17:0/3120538283 wait complete. 2024-08-19T01:23:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.623+0000 7f6f65d18640 1 Processor -- start 2024-08-19T01:23:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.623+0000 7f6f65d18640 1 -- start start 2024-08-19T01:23:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f65d18640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f600fe9f0 0x7f6f6019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f65d18640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f601049f0 0x7f6f6019bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f65d18640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60195900 con 0x7f6f601049f0 2024-08-19T01:23:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f65d18640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f60195a40 con 0x7f6f600fe9f0 2024-08-19T01:23:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f56ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f601049f0 0x7f6f6019bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f56ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f601049f0 0x7f6f6019bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55140/0 (socket says 172.21.15.17:55140) 2024-08-19T01:23:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f56ffd640 1 -- 172.21.15.17:0/412526374 learned_addr learned my addr 172.21.15.17:0/412526374 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f5f7fe640 1 --2- 172.21.15.17:0/412526374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f600fe9f0 0x7f6f6019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:26.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f56ffd640 1 -- 172.21.15.17:0/412526374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f600fe9f0 msgr2=0x7f6f6019b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f56ffd640 1 --2- 172.21.15.17:0/412526374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f600fe9f0 0x7f6f6019b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f56ffd640 1 -- 172.21.15.17:0/412526374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f48009560 con 0x7f6f601049f0 2024-08-19T01:23:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.624+0000 7f6f56ffd640 1 --2- 172.21.15.17:0/412526374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f601049f0 0x7f6f6019bde0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6f4802a9c0 tx=0x7f6f480055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.625+0000 7f6f5d7fa640 1 -- 172.21.15.17:0/412526374 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f48004aa0 con 0x7f6f601049f0 2024-08-19T01:23:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.625+0000 7f6f5d7fa640 1 -- 172.21.15.17:0/412526374 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f48004c00 con 0x7f6f601049f0 2024-08-19T01:23:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.625+0000 7f6f5d7fa640 1 -- 172.21.15.17:0/412526374 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f48003980 con 0x7f6f601049f0 2024-08-19T01:23:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.625+0000 7f6f65d18640 1 -- 172.21.15.17:0/412526374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f60195cc0 con 0x7f6f601049f0 2024-08-19T01:23:26.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.625+0000 7f6f65d18640 1 -- 172.21.15.17:0/412526374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f601961b0 con 0x7f6f601049f0 2024-08-19T01:23:26.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.626+0000 7f6f65d18640 1 -- 172.21.15.17:0/412526374 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f60100130 con 0x7f6f601049f0 2024-08-19T01:23:26.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.627+0000 7f6f5d7fa640 1 -- 172.21.15.17:0/412526374 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6f48003b00 con 0x7f6f601049f0 2024-08-19T01:23:26.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.627+0000 7f6f5d7fa640 1 --2- 172.21.15.17:0/412526374 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f4c06e170 0x7f6f4c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:26.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.627+0000 7f6f5d7fa640 1 -- 172.21.15.17:0/412526374 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6f480af0b0 con 0x7f6f601049f0 2024-08-19T01:23:26.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.627+0000 7f6f5f7fe640 1 --2- 172.21.15.17:0/412526374 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f4c06e170 0x7f6f4c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:26.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.628+0000 7f6f5f7fe640 1 --2- 172.21.15.17:0/412526374 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f4c06e170 0x7f6f4c070630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6f50005fd0 tx=0x7f6f5000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:26.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.632+0000 7f6f5d7fa640 1 -- 172.21.15.17:0/412526374 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6f480784c0 con 0x7f6f601049f0 2024-08-19T01:23:26.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.827+0000 7f6f65d18640 1 -- 172.21.15.17:0/412526374 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f6010bc80 con 0x7f6f4c06e170 2024-08-19T01:23:26.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.828+0000 7f6f5d7fa640 1 -- 172.21.15.17:0/412526374 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f6f6010bc80 con 0x7f6f4c06e170 2024-08-19T01:23:26.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.830+0000 7f6f65d18640 1 -- 172.21.15.17:0/412526374 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f4c06e170 msgr2=0x7f6f4c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:26.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.830+0000 7f6f65d18640 1 --2- 172.21.15.17:0/412526374 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f4c06e170 0x7f6f4c070630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6f50005fd0 tx=0x7f6f5000b390 comp rx=0 tx=0).stop 2024-08-19T01:23:26.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.830+0000 7f6f65d18640 1 -- 172.21.15.17:0/412526374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f601049f0 msgr2=0x7f6f6019bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:26.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.830+0000 7f6f65d18640 1 --2- 172.21.15.17:0/412526374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f601049f0 0x7f6f6019bde0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6f4802a9c0 tx=0x7f6f480055a0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.830+0000 7f6f65d18640 1 -- 172.21.15.17:0/412526374 shutdown_connections 2024-08-19T01:23:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.830+0000 7f6f65d18640 1 --2- 172.21.15.17:0/412526374 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6f4c06e170 0x7f6f4c070630 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.830+0000 7f6f65d18640 1 --2- 172.21.15.17:0/412526374 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6f601049f0 0x7f6f6019bde0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.830+0000 7f6f65d18640 1 --2- 172.21.15.17:0/412526374 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6f600fe9f0 0x7f6f6019b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.830+0000 7f6f65d18640 1 -- 172.21.15.17:0/412526374 >> 172.21.15.17:0/412526374 conn(0x7f6f600758a0 msgr2=0x7f6f600fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.831+0000 7f6f65d18640 1 -- 172.21.15.17:0/412526374 shutdown_connections 2024-08-19T01:23:26.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.831+0000 7f6f65d18640 1 -- 172.21.15.17:0/412526374 wait complete. 2024-08-19T01:23:26.841 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:23:26.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.914+0000 7f3276ab4640 1 -- 172.21.15.17:0/2273152174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32700fea30 msgr2=0x7f32700fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:26.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.914+0000 7f3276ab4640 1 --2- 172.21.15.17:0/2273152174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32700fea30 0x7f32700fee90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3258009880 tx=0x7f325802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.914+0000 7f3276ab4640 1 -- 172.21.15.17:0/2273152174 shutdown_connections 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.914+0000 7f3276ab4640 1 --2- 172.21.15.17:0/2273152174 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32700fea30 0x7f32700fee90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.914+0000 7f3276ab4640 1 --2- 172.21.15.17:0/2273152174 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3270104a30 0x7f3270104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.914+0000 7f3276ab4640 1 -- 172.21.15.17:0/2273152174 >> 172.21.15.17:0/2273152174 conn(0x7f32700fa730 msgr2=0x7f32700fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.914+0000 7f3276ab4640 1 -- 172.21.15.17:0/2273152174 shutdown_connections 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.914+0000 7f3276ab4640 1 -- 172.21.15.17:0/2273152174 wait complete. 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.915+0000 7f3276ab4640 1 Processor -- start 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.915+0000 7f3276ab4640 1 -- start start 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.915+0000 7f3276ab4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32700fea30 0x7f32700fafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.915+0000 7f3276ab4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270104a30 0x7f32700fb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.915+0000 7f3276ab4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32700fba20 con 0x7f3270104a30 2024-08-19T01:23:26.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.915+0000 7f3276ab4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32700fbb90 con 0x7f32700fea30 2024-08-19T01:23:26.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.915+0000 7f326ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270104a30 0x7f32700fb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:26.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.915+0000 7f326ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270104a30 0x7f32700fb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36394/0 (socket says 172.21.15.17:36394) 2024-08-19T01:23:26.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.915+0000 7f326ffff640 1 -- 172.21.15.17:0/3364665080 learned_addr learned my addr 172.21.15.17:0/3364665080 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:26.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.916+0000 7f3274850640 1 --2- 172.21.15.17:0/3364665080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32700fea30 0x7f32700fafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:26.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.916+0000 7f326ffff640 1 -- 172.21.15.17:0/3364665080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32700fea30 msgr2=0x7f32700fafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:26.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.916+0000 7f326ffff640 1 --2- 172.21.15.17:0/3364665080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32700fea30 0x7f32700fafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:26.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.916+0000 7f326ffff640 1 -- 172.21.15.17:0/3364665080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3258009560 con 0x7f3270104a30 2024-08-19T01:23:26.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.916+0000 7f326ffff640 1 --2- 172.21.15.17:0/3364665080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270104a30 0x7f32700fb4e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f325802a9c0 tx=0x7f32580055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:26.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.916+0000 7f326dffb640 1 -- 172.21.15.17:0/3364665080 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3258004aa0 con 0x7f3270104a30 2024-08-19T01:23:26.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.916+0000 7f326dffb640 1 -- 172.21.15.17:0/3364665080 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3258004c00 con 0x7f3270104a30 2024-08-19T01:23:26.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.916+0000 7f3276ab4640 1 -- 172.21.15.17:0/3364665080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32700fbe10 con 0x7f3270104a30 2024-08-19T01:23:26.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.916+0000 7f326dffb640 1 -- 172.21.15.17:0/3364665080 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3258003980 con 0x7f3270104a30 2024-08-19T01:23:26.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.916+0000 7f3276ab4640 1 -- 172.21.15.17:0/3364665080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32701a1ef0 con 0x7f3270104a30 2024-08-19T01:23:26.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.917+0000 7f3276ab4640 1 -- 172.21.15.17:0/3364665080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3270100170 con 0x7f3270104a30 2024-08-19T01:23:26.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.918+0000 7f326dffb640 1 -- 172.21.15.17:0/3364665080 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3258003b20 con 0x7f3270104a30 2024-08-19T01:23:26.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.918+0000 7f326dffb640 1 --2- 172.21.15.17:0/3364665080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f325c06e170 0x7f325c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:26.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.918+0000 7f326dffb640 1 -- 172.21.15.17:0/3364665080 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f32580aefc0 con 0x7f3270104a30 2024-08-19T01:23:26.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.918+0000 7f3274850640 1 --2- 172.21.15.17:0/3364665080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f325c06e170 0x7f325c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:26.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.919+0000 7f3274850640 1 --2- 172.21.15.17:0/3364665080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f325c06e170 0x7f325c070630 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3260005fd0 tx=0x7f3260009680 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:26.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:26.923+0000 7f326dffb640 1 -- 172.21.15.17:0/3364665080 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f32580e3df0 con 0x7f3270104a30 2024-08-19T01:23:27.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.113+0000 7f3276ab4640 1 -- 172.21.15.17:0/3364665080 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32700fbe10 con 0x7f325c06e170 2024-08-19T01:23:27.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.114+0000 7f326dffb640 1 -- 172.21.15.17:0/3364665080 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f32700fbe10 con 0x7f325c06e170 2024-08-19T01:23:27.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.117+0000 7f3276ab4640 1 -- 172.21.15.17:0/3364665080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f325c06e170 msgr2=0x7f325c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.117+0000 7f3276ab4640 1 --2- 172.21.15.17:0/3364665080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f325c06e170 0x7f325c070630 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3260005fd0 tx=0x7f3260009680 comp rx=0 tx=0).stop 2024-08-19T01:23:27.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.117+0000 7f3276ab4640 1 -- 172.21.15.17:0/3364665080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270104a30 msgr2=0x7f32700fb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.117+0000 7f3276ab4640 1 --2- 172.21.15.17:0/3364665080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270104a30 0x7f32700fb4e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f325802a9c0 tx=0x7f32580055a0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.117+0000 7f3276ab4640 1 -- 172.21.15.17:0/3364665080 shutdown_connections 2024-08-19T01:23:27.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.117+0000 7f3276ab4640 1 --2- 172.21.15.17:0/3364665080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f325c06e170 0x7f325c070630 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.117+0000 7f3276ab4640 1 --2- 172.21.15.17:0/3364665080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3270104a30 0x7f32700fb4e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.117+0000 7f3276ab4640 1 --2- 172.21.15.17:0/3364665080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f32700fea30 0x7f32700fafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.117+0000 7f3276ab4640 1 -- 172.21.15.17:0/3364665080 >> 172.21.15.17:0/3364665080 conn(0x7f32700fa730 msgr2=0x7f3270068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:27.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.117+0000 7f3276ab4640 1 -- 172.21.15.17:0/3364665080 shutdown_connections 2024-08-19T01:23:27.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.117+0000 7f3276ab4640 1 -- 172.21.15.17:0/3364665080 wait complete. 2024-08-19T01:23:27.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.199+0000 7fbf9abd8640 1 -- 172.21.15.17:0/2237169677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf940ffda0 msgr2=0x7fbf94100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.199+0000 7fbf9abd8640 1 --2- 172.21.15.17:0/2237169677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf940ffda0 0x7fbf94100180 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009880 tx=0x7fbf7c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.199+0000 7fbf9abd8640 1 -- 172.21.15.17:0/2237169677 shutdown_connections 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.199+0000 7fbf9abd8640 1 --2- 172.21.15.17:0/2237169677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf94100750 0x7fbf941047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.199+0000 7fbf9abd8640 1 --2- 172.21.15.17:0/2237169677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf940ffda0 0x7fbf94100180 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.199+0000 7fbf9abd8640 1 -- 172.21.15.17:0/2237169677 >> 172.21.15.17:0/2237169677 conn(0x7fbf940fb840 msgr2=0x7fbf940fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.199+0000 7fbf9abd8640 1 -- 172.21.15.17:0/2237169677 shutdown_connections 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.199+0000 7fbf9abd8640 1 -- 172.21.15.17:0/2237169677 wait complete. 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.200+0000 7fbf9abd8640 1 Processor -- start 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.200+0000 7fbf9abd8640 1 -- start start 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.200+0000 7fbf9abd8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf940ffda0 0x7fbf9419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.200+0000 7fbf9abd8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf94100750 0x7fbf9419bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.200+0000 7fbf9abd8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94195a10 con 0x7fbf940ffda0 2024-08-19T01:23:27.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.200+0000 7fbf9abd8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94195b50 con 0x7fbf94100750 2024-08-19T01:23:27.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.200+0000 7fbf98974640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf940ffda0 0x7fbf9419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:27.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.200+0000 7fbf98974640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf940ffda0 0x7fbf9419b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36406/0 (socket says 172.21.15.17:36406) 2024-08-19T01:23:27.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.200+0000 7fbf98974640 1 -- 172.21.15.17:0/607490646 learned_addr learned my addr 172.21.15.17:0/607490646 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:27.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.201+0000 7fbf93fff640 1 --2- 172.21.15.17:0/607490646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf94100750 0x7fbf9419bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:27.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.201+0000 7fbf98974640 1 -- 172.21.15.17:0/607490646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf94100750 msgr2=0x7fbf9419bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.201+0000 7fbf98974640 1 --2- 172.21.15.17:0/607490646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf94100750 0x7fbf9419bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.201+0000 7fbf98974640 1 -- 172.21.15.17:0/607490646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c009560 con 0x7fbf940ffda0 2024-08-19T01:23:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.201+0000 7fbf98974640 1 --2- 172.21.15.17:0/607490646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf940ffda0 0x7fbf9419b9b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c02a9c0 tx=0x7fbf7c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.201+0000 7fbf91ffb640 1 -- 172.21.15.17:0/607490646 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf7c0048d0 con 0x7fbf940ffda0 2024-08-19T01:23:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.201+0000 7fbf91ffb640 1 -- 172.21.15.17:0/607490646 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf7c031640 con 0x7fbf940ffda0 2024-08-19T01:23:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.201+0000 7fbf9abd8640 1 -- 172.21.15.17:0/607490646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf94195dd0 con 0x7fbf940ffda0 2024-08-19T01:23:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.201+0000 7fbf91ffb640 1 -- 172.21.15.17:0/607490646 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf7c0038d0 con 0x7fbf940ffda0 2024-08-19T01:23:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.201+0000 7fbf9abd8640 1 -- 172.21.15.17:0/607490646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf941962c0 con 0x7fbf940ffda0 2024-08-19T01:23:27.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.202+0000 7fbf9abd8640 1 -- 172.21.15.17:0/607490646 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf94101280 con 0x7fbf940ffda0 2024-08-19T01:23:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.203+0000 7fbf91ffb640 1 -- 172.21.15.17:0/607490646 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbf7c003b90 con 0x7fbf940ffda0 2024-08-19T01:23:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.203+0000 7fbf91ffb640 1 --2- 172.21.15.17:0/607490646 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf8006e170 0x7fbf80070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.204+0000 7fbf93fff640 1 --2- 172.21.15.17:0/607490646 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf8006e170 0x7fbf80070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.204+0000 7fbf91ffb640 1 -- 172.21.15.17:0/607490646 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fbf7c0af1f0 con 0x7fbf940ffda0 2024-08-19T01:23:27.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.204+0000 7fbf93fff640 1 --2- 172.21.15.17:0/607490646 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf8006e170 0x7fbf80070630 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbf94197260 tx=0x7fbf84005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:27.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.208+0000 7fbf91ffb640 1 -- 172.21.15.17:0/607490646 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbf7c078430 con 0x7fbf940ffda0 2024-08-19T01:23:27.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.391+0000 7fbf9abd8640 1 -- 172.21.15.17:0/607490646 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf94196fa0 con 0x7fbf8006e170 2024-08-19T01:23:27.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.400+0000 7fbf91ffb640 1 -- 172.21.15.17:0/607490646 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fbf94196fa0 con 0x7fbf8006e170 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (24m) 3m ago 35m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (35m) 3m ago 35m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (34m) 3m ago 34m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (22m) 3m ago 35m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (22m) 3m ago 34m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (24m) 3m ago 35m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (18m) 3m ago 29m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (19m) 3m ago 30m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (3m) 3m ago 29m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (18m) 3m ago 29m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:23:27.403 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (26m) 3m ago 36m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (25m) 3m ago 34m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (23m) 3m ago 36m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (23m) 3m ago 34m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (25m) 3m ago 35m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (25m) 3m ago 34m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (22m) 3m ago 33m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (21m) 3m ago 33m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (20m) 3m ago 32m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (20m) 3m ago 32m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (19m) 3m ago 31m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (19m) 3m ago 31m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:23:27.404 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (25m) 3m ago 34m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:23:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.402+0000 7fbf9abd8640 1 -- 172.21.15.17:0/607490646 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf8006e170 msgr2=0x7fbf80070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.402+0000 7fbf9abd8640 1 --2- 172.21.15.17:0/607490646 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf8006e170 0x7fbf80070630 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbf94197260 tx=0x7fbf84005f90 comp rx=0 tx=0).stop 2024-08-19T01:23:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.402+0000 7fbf9abd8640 1 -- 172.21.15.17:0/607490646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf940ffda0 msgr2=0x7fbf9419b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.402+0000 7fbf9abd8640 1 --2- 172.21.15.17:0/607490646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf940ffda0 0x7fbf9419b9b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c02a9c0 tx=0x7fbf7c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.402+0000 7fbf9abd8640 1 -- 172.21.15.17:0/607490646 shutdown_connections 2024-08-19T01:23:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.402+0000 7fbf9abd8640 1 --2- 172.21.15.17:0/607490646 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf8006e170 0x7fbf80070630 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.402+0000 7fbf9abd8640 1 --2- 172.21.15.17:0/607490646 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf94100750 0x7fbf9419bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.402+0000 7fbf9abd8640 1 --2- 172.21.15.17:0/607490646 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf940ffda0 0x7fbf9419b9b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.402+0000 7fbf9abd8640 1 -- 172.21.15.17:0/607490646 >> 172.21.15.17:0/607490646 conn(0x7fbf940fb840 msgr2=0x7fbf940fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:27.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.403+0000 7fbf9abd8640 1 -- 172.21.15.17:0/607490646 shutdown_connections 2024-08-19T01:23:27.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.403+0000 7fbf9abd8640 1 -- 172.21.15.17:0/607490646 wait complete. 2024-08-19T01:23:27.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.483+0000 7f29137b5640 1 -- 172.21.15.17:0/3661087193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f290c0ffda0 msgr2=0x7f290c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.483+0000 7f29137b5640 1 --2- 172.21.15.17:0/3661087193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f290c0ffda0 0x7f290c100180 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009c20 tx=0x7f28fc02a970 comp rx=0 tx=0).stop 2024-08-19T01:23:27.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.483+0000 7f29137b5640 1 -- 172.21.15.17:0/3661087193 shutdown_connections 2024-08-19T01:23:27.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.483+0000 7f29137b5640 1 --2- 172.21.15.17:0/3661087193 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f290c100750 0x7f290c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.483+0000 7f29137b5640 1 --2- 172.21.15.17:0/3661087193 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f290c0ffda0 0x7f290c100180 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.483+0000 7f29137b5640 1 -- 172.21.15.17:0/3661087193 >> 172.21.15.17:0/3661087193 conn(0x7f290c0fb840 msgr2=0x7f290c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:27.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.484+0000 7f29137b5640 1 -- 172.21.15.17:0/3661087193 shutdown_connections 2024-08-19T01:23:27.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.484+0000 7f29137b5640 1 -- 172.21.15.17:0/3661087193 wait complete. 2024-08-19T01:23:27.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.484+0000 7f29137b5640 1 Processor -- start 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.484+0000 7f29137b5640 1 -- start start 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.484+0000 7f29137b5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f290c0ffda0 0x7f290c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.484+0000 7f29137b5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f290c100750 0x7f290c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.484+0000 7f29137b5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c074780 con 0x7f290c100750 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.484+0000 7f29137b5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c073230 con 0x7f290c0ffda0 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.484+0000 7f2910d50640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f290c100750 0x7f290c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.484+0000 7f2910d50640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f290c100750 0x7f290c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36416/0 (socket says 172.21.15.17:36416) 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.484+0000 7f2910d50640 1 -- 172.21.15.17:0/2064139051 learned_addr learned my addr 172.21.15.17:0/2064139051 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.485+0000 7f2911551640 1 --2- 172.21.15.17:0/2064139051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f290c0ffda0 0x7f290c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.485+0000 7f2910d50640 1 -- 172.21.15.17:0/2064139051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f290c0ffda0 msgr2=0x7f290c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.485+0000 7f2910d50640 1 --2- 172.21.15.17:0/2064139051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f290c0ffda0 0x7f290c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.485+0000 7f2910d50640 1 -- 172.21.15.17:0/2064139051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc009900 con 0x7f290c100750 2024-08-19T01:23:27.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.485+0000 7f2910d50640 1 --2- 172.21.15.17:0/2064139051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f290c100750 0x7f290c072cf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f290000c8a0 tx=0x7f290000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:27.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.485+0000 7f290a7fc640 1 -- 172.21.15.17:0/2064139051 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2900007b80 con 0x7f290c100750 2024-08-19T01:23:27.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.485+0000 7f290a7fc640 1 -- 172.21.15.17:0/2064139051 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2900007ce0 con 0x7f290c100750 2024-08-19T01:23:27.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.485+0000 7f29137b5640 1 -- 172.21.15.17:0/2064139051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290c073510 con 0x7f290c100750 2024-08-19T01:23:27.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.485+0000 7f290a7fc640 1 -- 172.21.15.17:0/2064139051 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2900018810 con 0x7f290c100750 2024-08-19T01:23:27.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.485+0000 7f29137b5640 1 -- 172.21.15.17:0/2064139051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290c1a1f50 con 0x7f290c100750 2024-08-19T01:23:27.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.486+0000 7f29137b5640 1 -- 172.21.15.17:0/2064139051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290c101280 con 0x7f290c100750 2024-08-19T01:23:27.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.487+0000 7f290a7fc640 1 -- 172.21.15.17:0/2064139051 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2900018970 con 0x7f290c100750 2024-08-19T01:23:27.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.487+0000 7f290a7fc640 1 --2- 172.21.15.17:0/2064139051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28f406e170 0x7f28f4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:27.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.487+0000 7f290a7fc640 1 -- 172.21.15.17:0/2064139051 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f290008e190 con 0x7f290c100750 2024-08-19T01:23:27.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.487+0000 7f2911551640 1 --2- 172.21.15.17:0/2064139051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28f406e170 0x7f28f4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:27.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.488+0000 7f2911551640 1 --2- 172.21.15.17:0/2064139051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28f406e170 0x7f28f4070630 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f28fc000f80 tx=0x7f28fc03d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:27.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.491+0000 7f290a7fc640 1 -- 172.21.15.17:0/2064139051 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f29000574f0 con 0x7f290c100750 2024-08-19T01:23:27.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.735+0000 7f29137b5640 1 -- 172.21.15.17:0/2064139051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f290c100180 con 0x7f290c100750 2024-08-19T01:23:27.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.736+0000 7f290a7fc640 1 -- 172.21.15.17:0/2064139051 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f290005abb0 con 0x7f290c100750 2024-08-19T01:23:27.738 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:23:27.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:23:27.738 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:23:27.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:23:27.738 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:23:27.738 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:23:27.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:23:27.738 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:23:27.738 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:23:27.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:23:27.739 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:23:27.739 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:23:27.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:23:27.739 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:23:27.739 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:23:27.739 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:23:27.739 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:23:27.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.738+0000 7f29137b5640 1 -- 172.21.15.17:0/2064139051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28f406e170 msgr2=0x7f28f4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.738+0000 7f29137b5640 1 --2- 172.21.15.17:0/2064139051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28f406e170 0x7f28f4070630 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f28fc000f80 tx=0x7f28fc03d040 comp rx=0 tx=0).stop 2024-08-19T01:23:27.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.738+0000 7f29137b5640 1 -- 172.21.15.17:0/2064139051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f290c100750 msgr2=0x7f290c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.738+0000 7f29137b5640 1 --2- 172.21.15.17:0/2064139051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f290c100750 0x7f290c072cf0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f290000c8a0 tx=0x7f290000cd60 comp rx=0 tx=0).stop 2024-08-19T01:23:27.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.738+0000 7f29137b5640 1 -- 172.21.15.17:0/2064139051 shutdown_connections 2024-08-19T01:23:27.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.738+0000 7f29137b5640 1 --2- 172.21.15.17:0/2064139051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28f406e170 0x7f28f4070630 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.738+0000 7f29137b5640 1 --2- 172.21.15.17:0/2064139051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f290c100750 0x7f290c072cf0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.738+0000 7f29137b5640 1 --2- 172.21.15.17:0/2064139051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f290c0ffda0 0x7f290c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.738+0000 7f29137b5640 1 -- 172.21.15.17:0/2064139051 >> 172.21.15.17:0/2064139051 conn(0x7f290c0fb840 msgr2=0x7f290c0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:27.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.738+0000 7f29137b5640 1 -- 172.21.15.17:0/2064139051 shutdown_connections 2024-08-19T01:23:27.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.738+0000 7f29137b5640 1 -- 172.21.15.17:0/2064139051 wait complete. 2024-08-19T01:23:27.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.820+0000 7f429ba6e640 1 -- 172.21.15.17:0/2267789092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4294100d50 msgr2=0x7f4294101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.820+0000 7f429ba6e640 1 --2- 172.21.15.17:0/2267789092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4294100d50 0x7f4294101130 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4290009880 tx=0x7f429002a530 comp rx=0 tx=0).stop 2024-08-19T01:23:27.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.820+0000 7f429ba6e640 1 -- 172.21.15.17:0/2267789092 shutdown_connections 2024-08-19T01:23:27.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.820+0000 7f429ba6e640 1 --2- 172.21.15.17:0/2267789092 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4294101670 0x7f4294109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.820+0000 7f429ba6e640 1 --2- 172.21.15.17:0/2267789092 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4294100d50 0x7f4294101130 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.820+0000 7f429ba6e640 1 -- 172.21.15.17:0/2267789092 >> 172.21.15.17:0/2267789092 conn(0x7f42940758a0 msgr2=0x7f42940fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:27.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.820+0000 7f429ba6e640 1 -- 172.21.15.17:0/2267789092 shutdown_connections 2024-08-19T01:23:27.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.820+0000 7f429ba6e640 1 -- 172.21.15.17:0/2267789092 wait complete. 2024-08-19T01:23:27.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f429ba6e640 1 Processor -- start 2024-08-19T01:23:27.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f429ba6e640 1 -- start start 2024-08-19T01:23:27.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f429ba6e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4294100d50 0x7f429419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:27.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f429ba6e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4294101670 0x7f429419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:27.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f429ba6e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429419c3d0 con 0x7f4294101670 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f429ba6e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4294195960 con 0x7f4294100d50 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f4299009640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4294101670 0x7f429419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f4299009640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4294101670 0x7f429419bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36446/0 (socket says 172.21.15.17:36446) 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f4299009640 1 -- 172.21.15.17:0/4251996058 learned_addr learned my addr 172.21.15.17:0/4251996058 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f429980a640 1 --2- 172.21.15.17:0/4251996058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4294100d50 0x7f429419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f4299009640 1 -- 172.21.15.17:0/4251996058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4294100d50 msgr2=0x7f429419b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f4299009640 1 --2- 172.21.15.17:0/4251996058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4294100d50 0x7f429419b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.821+0000 7f4299009640 1 -- 172.21.15.17:0/4251996058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4290009560 con 0x7f4294101670 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.822+0000 7f4299009640 1 --2- 172.21.15.17:0/4251996058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4294101670 0x7f429419bdb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f428400d8d0 tx=0x7f428400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.822+0000 7f428affd640 1 -- 172.21.15.17:0/4251996058 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4284009c00 con 0x7f4294101670 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.822+0000 7f428affd640 1 -- 172.21.15.17:0/4251996058 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4284009d60 con 0x7f4294101670 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.822+0000 7f429ba6e640 1 -- 172.21.15.17:0/4251996058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4294195c40 con 0x7f4294101670 2024-08-19T01:23:27.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.822+0000 7f428affd640 1 -- 172.21.15.17:0/4251996058 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42840049d0 con 0x7f4294101670 2024-08-19T01:23:27.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.822+0000 7f429ba6e640 1 -- 172.21.15.17:0/4251996058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4294196190 con 0x7f4294101670 2024-08-19T01:23:27.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.823+0000 7f429ba6e640 1 -- 172.21.15.17:0/4251996058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4294068470 con 0x7f4294101670 2024-08-19T01:23:27.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.823+0000 7f428affd640 1 -- 172.21.15.17:0/4251996058 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4284004c90 con 0x7f4294101670 2024-08-19T01:23:27.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.824+0000 7f428affd640 1 --2- 172.21.15.17:0/4251996058 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f428006e170 0x7f4280070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:27.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.824+0000 7f428affd640 1 -- 172.21.15.17:0/4251996058 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f428408dec0 con 0x7f4294101670 2024-08-19T01:23:27.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.824+0000 7f429980a640 1 --2- 172.21.15.17:0/4251996058 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f428006e170 0x7f4280070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:27.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.825+0000 7f429980a640 1 --2- 172.21.15.17:0/4251996058 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f428006e170 0x7f4280070630 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4290000c00 tx=0x7f42900058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:27.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:27.828+0000 7f428affd640 1 -- 172.21.15.17:0/4251996058 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4284057100 con 0x7f4294101670 2024-08-19T01:23:28.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.039+0000 7f429ba6e640 1 -- 172.21.15.17:0/4251996058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4294101130 con 0x7f4294101670 2024-08-19T01:23:28.042 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:27 smithi017 ceph-mon[99370]: pgmap v741: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:28.042 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:27 smithi017 ceph-mon[99370]: from='client.35382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:23:28.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.040+0000 7f428affd640 1 -- 172.21.15.17:0/4251996058 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f4284017790 con 0x7f4294101670 2024-08-19T01:23:28.043 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:23:28.043 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:23:28.043 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:23:28.043 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:23:28.043 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:23:28.043 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:23:28.043 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:23:28.043 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:23:28.043 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:23:28.043 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:23:28.044 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:23:28.045 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:23:28.046 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:23:28.046 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:23:28.046 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:23:28.046 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:23:28.046 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:23:28.046 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:23:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:23:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.042+0000 7f429ba6e640 1 -- 172.21.15.17:0/4251996058 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f428006e170 msgr2=0x7f4280070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.042+0000 7f429ba6e640 1 --2- 172.21.15.17:0/4251996058 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f428006e170 0x7f4280070630 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4290000c00 tx=0x7f42900058d0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.042+0000 7f429ba6e640 1 -- 172.21.15.17:0/4251996058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4294101670 msgr2=0x7f429419bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.042+0000 7f429ba6e640 1 --2- 172.21.15.17:0/4251996058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4294101670 0x7f429419bdb0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f428400d8d0 tx=0x7f428400dd90 comp rx=0 tx=0).stop 2024-08-19T01:23:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.042+0000 7f429ba6e640 1 -- 172.21.15.17:0/4251996058 shutdown_connections 2024-08-19T01:23:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.042+0000 7f429ba6e640 1 --2- 172.21.15.17:0/4251996058 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f428006e170 0x7f4280070630 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.042+0000 7f429ba6e640 1 --2- 172.21.15.17:0/4251996058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4294101670 0x7f429419bdb0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.042+0000 7f429ba6e640 1 --2- 172.21.15.17:0/4251996058 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4294100d50 0x7f429419b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.042+0000 7f429ba6e640 1 -- 172.21.15.17:0/4251996058 >> 172.21.15.17:0/4251996058 conn(0x7f42940758a0 msgr2=0x7f4294101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:28.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.042+0000 7f429ba6e640 1 -- 172.21.15.17:0/4251996058 shutdown_connections 2024-08-19T01:23:28.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.042+0000 7f429ba6e640 1 -- 172.21.15.17:0/4251996058 wait complete. 2024-08-19T01:23:28.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.125+0000 7f50473fc640 1 -- 172.21.15.17:0/1132426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040100c60 msgr2=0x7f5040101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:28.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.125+0000 7f50473fc640 1 --2- 172.21.15.17:0/1132426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040100c60 0x7f5040101040 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f503c0098b0 tx=0x7f503c02a4d0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.125+0000 7f50473fc640 1 -- 172.21.15.17:0/1132426 shutdown_connections 2024-08-19T01:23:28.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.125+0000 7f50473fc640 1 --2- 172.21.15.17:0/1132426 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5040101610 0x7f5040109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.125+0000 7f50473fc640 1 --2- 172.21.15.17:0/1132426 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040100c60 0x7f5040101040 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.125+0000 7f50473fc640 1 -- 172.21.15.17:0/1132426 >> 172.21.15.17:0/1132426 conn(0x7f50400fa730 msgr2=0x7f50400fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:28.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.125+0000 7f50473fc640 1 -- 172.21.15.17:0/1132426 shutdown_connections 2024-08-19T01:23:28.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.125+0000 7f50473fc640 1 -- 172.21.15.17:0/1132426 wait complete. 2024-08-19T01:23:28.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.125+0000 7f50473fc640 1 Processor -- start 2024-08-19T01:23:28.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f50473fc640 1 -- start start 2024-08-19T01:23:28.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f50473fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5040100c60 0x7f50400fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:28.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f50473fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040101610 0x7f50400fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:28.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f50473fc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50400ff3d0 con 0x7f5040101610 2024-08-19T01:23:28.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f50473fc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50400ff540 con 0x7f5040100c60 2024-08-19T01:23:28.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f5044997640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040101610 0x7f50400fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:28.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f5044997640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040101610 0x7f50400fee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36464/0 (socket says 172.21.15.17:36464) 2024-08-19T01:23:28.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f5044997640 1 -- 172.21.15.17:0/2817808079 learned_addr learned my addr 172.21.15.17:0/2817808079 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:28.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f5045198640 1 --2- 172.21.15.17:0/2817808079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5040100c60 0x7f50400fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:28.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f5044997640 1 -- 172.21.15.17:0/2817808079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5040100c60 msgr2=0x7f50400fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:28.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f5044997640 1 --2- 172.21.15.17:0/2817808079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5040100c60 0x7f50400fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f5044997640 1 -- 172.21.15.17:0/2817808079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c009560 con 0x7f5040101610 2024-08-19T01:23:28.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.126+0000 7f5044997640 1 --2- 172.21.15.17:0/2817808079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040101610 0x7f50400fee90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f503000d6f0 tx=0x7f503000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:28.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.127+0000 7f50367fc640 1 -- 172.21.15.17:0/2817808079 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5030009a30 con 0x7f5040101610 2024-08-19T01:23:28.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.127+0000 7f50367fc640 1 -- 172.21.15.17:0/2817808079 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50300054e0 con 0x7f5040101610 2024-08-19T01:23:28.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.127+0000 7f50473fc640 1 -- 172.21.15.17:0/2817808079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50401a1cb0 con 0x7f5040101610 2024-08-19T01:23:28.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.127+0000 7f50367fc640 1 -- 172.21.15.17:0/2817808079 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5030010460 con 0x7f5040101610 2024-08-19T01:23:28.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.127+0000 7f50473fc640 1 -- 172.21.15.17:0/2817808079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50401a2010 con 0x7f5040101610 2024-08-19T01:23:28.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.128+0000 7f50473fc640 1 -- 172.21.15.17:0/2817808079 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5040068d30 con 0x7f5040101610 2024-08-19T01:23:28.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.128+0000 7f50367fc640 1 -- 172.21.15.17:0/2817808079 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5030009b90 con 0x7f5040101610 2024-08-19T01:23:28.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.129+0000 7f50367fc640 1 --2- 172.21.15.17:0/2817808079 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502c06e170 0x7f502c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:28.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.129+0000 7f50367fc640 1 -- 172.21.15.17:0/2817808079 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f503008dd30 con 0x7f5040101610 2024-08-19T01:23:28.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.129+0000 7f5045198640 1 --2- 172.21.15.17:0/2817808079 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502c06e170 0x7f502c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:28.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.129+0000 7f5045198640 1 --2- 172.21.15.17:0/2817808079 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502c06e170 0x7f502c070630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f503c009230 tx=0x7f503c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:28.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.133+0000 7f50367fc640 1 -- 172.21.15.17:0/2817808079 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5030057010 con 0x7f5040101610 2024-08-19T01:23:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:27 smithi086 ceph-mon[71303]: pgmap v741: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:27 smithi086 ceph-mon[71303]: from='client.35382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:23:28.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.325+0000 7f50473fc640 1 -- 172.21.15.17:0/2817808079 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50401043a0 con 0x7f502c06e170 2024-08-19T01:23:28.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.326+0000 7f50367fc640 1 -- 172.21.15.17:0/2817808079 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f50401043a0 con 0x7f502c06e170 2024-08-19T01:23:28.328 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:23:28.328 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:23:28.328 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:23:28.329 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:23:28.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.328+0000 7f50473fc640 1 -- 172.21.15.17:0/2817808079 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502c06e170 msgr2=0x7f502c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:28.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.328+0000 7f50473fc640 1 --2- 172.21.15.17:0/2817808079 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502c06e170 0x7f502c070630 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f503c009230 tx=0x7f503c005a20 comp rx=0 tx=0).stop 2024-08-19T01:23:28.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.328+0000 7f50473fc640 1 -- 172.21.15.17:0/2817808079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040101610 msgr2=0x7f50400fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:28.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.328+0000 7f50473fc640 1 --2- 172.21.15.17:0/2817808079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040101610 0x7f50400fee90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f503000d6f0 tx=0x7f503000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.328+0000 7f50473fc640 1 -- 172.21.15.17:0/2817808079 shutdown_connections 2024-08-19T01:23:28.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.328+0000 7f50473fc640 1 --2- 172.21.15.17:0/2817808079 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f502c06e170 0x7f502c070630 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.328+0000 7f50473fc640 1 --2- 172.21.15.17:0/2817808079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5040101610 0x7f50400fee90 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.328+0000 7f50473fc640 1 --2- 172.21.15.17:0/2817808079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5040100c60 0x7f50400fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.328+0000 7f50473fc640 1 -- 172.21.15.17:0/2817808079 >> 172.21.15.17:0/2817808079 conn(0x7f50400fa730 msgr2=0x7f5040101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:28.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.328+0000 7f50473fc640 1 -- 172.21.15.17:0/2817808079 shutdown_connections 2024-08-19T01:23:28.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.328+0000 7f50473fc640 1 -- 172.21.15.17:0/2817808079 wait complete. 2024-08-19T01:23:28.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.410+0000 7f8345523640 1 -- 172.21.15.17:0/3175186486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83400ffda0 msgr2=0x7f8340100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:28.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.410+0000 7f8345523640 1 --2- 172.21.15.17:0/3175186486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83400ffda0 0x7f8340100180 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8330009880 tx=0x7f833002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.410+0000 7f8345523640 1 -- 172.21.15.17:0/3175186486 shutdown_connections 2024-08-19T01:23:28.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.410+0000 7f8345523640 1 --2- 172.21.15.17:0/3175186486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8340100750 0x7f83401047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.410+0000 7f8345523640 1 --2- 172.21.15.17:0/3175186486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f83400ffda0 0x7f8340100180 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.410+0000 7f8345523640 1 -- 172.21.15.17:0/3175186486 >> 172.21.15.17:0/3175186486 conn(0x7f83400fb840 msgr2=0x7f83400fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.410+0000 7f8345523640 1 -- 172.21.15.17:0/3175186486 shutdown_connections 2024-08-19T01:23:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.410+0000 7f8345523640 1 -- 172.21.15.17:0/3175186486 wait complete. 2024-08-19T01:23:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f8345523640 1 Processor -- start 2024-08-19T01:23:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f8345523640 1 -- start start 2024-08-19T01:23:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f8345523640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83400ffda0 0x7f834019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f8345523640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8340100750 0x7f834019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f8345523640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8340195a10 con 0x7f8340100750 2024-08-19T01:23:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f8345523640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8340195b50 con 0x7f83400ffda0 2024-08-19T01:23:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f833e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8340100750 0x7f834019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f833e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8340100750 0x7f834019bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36486/0 (socket says 172.21.15.17:36486) 2024-08-19T01:23:28.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f833e7fc640 1 -- 172.21.15.17:0/964790373 learned_addr learned my addr 172.21.15.17:0/964790373 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:28.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f833effd640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83400ffda0 0x7f834019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:28.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f833e7fc640 1 -- 172.21.15.17:0/964790373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83400ffda0 msgr2=0x7f834019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:28.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f833e7fc640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83400ffda0 0x7f834019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f833e7fc640 1 -- 172.21.15.17:0/964790373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330009560 con 0x7f8340100750 2024-08-19T01:23:28.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.411+0000 7f833effd640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83400ffda0 0x7f834019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:23:28.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.412+0000 7f833e7fc640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8340100750 0x7f834019bef0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f833400d6f0 tx=0x7f833400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:28.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.412+0000 7f8327fff640 1 -- 172.21.15.17:0/964790373 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8334009a30 con 0x7f8340100750 2024-08-19T01:23:28.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.412+0000 7f8327fff640 1 -- 172.21.15.17:0/964790373 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83340054e0 con 0x7f8340100750 2024-08-19T01:23:28.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.412+0000 7f8345523640 1 -- 172.21.15.17:0/964790373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8340195e30 con 0x7f8340100750 2024-08-19T01:23:28.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.412+0000 7f8327fff640 1 -- 172.21.15.17:0/964790373 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8334010460 con 0x7f8340100750 2024-08-19T01:23:28.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.412+0000 7f8345523640 1 -- 172.21.15.17:0/964790373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8340196380 con 0x7f8340100750 2024-08-19T01:23:28.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.413+0000 7f8345523640 1 -- 172.21.15.17:0/964790373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8340101280 con 0x7f8340100750 2024-08-19T01:23:28.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.414+0000 7f8327fff640 1 -- 172.21.15.17:0/964790373 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8334009b90 con 0x7f8340100750 2024-08-19T01:23:28.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.414+0000 7f8327fff640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f832806e170 0x7f8328070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:28.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.414+0000 7f8327fff640 1 -- 172.21.15.17:0/964790373 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f833408d8f0 con 0x7f8340100750 2024-08-19T01:23:28.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.414+0000 7f833effd640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f832806e170 0x7f8328070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:28.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.414+0000 7f833effd640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f832806e170 0x7f8328070630 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8330000c00 tx=0x7f8330005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:28.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.418+0000 7f8327fff640 1 -- 172.21.15.17:0/964790373 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8334056cf0 con 0x7f8340100750 2024-08-19T01:23:28.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.664+0000 7f8345523640 1 -- 172.21.15.17:0/964790373 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8340196f70 con 0x7f8340100750 2024-08-19T01:23:28.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.665+0000 7f8327fff640 1 -- 172.21.15.17:0/964790373 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f833405a3b0 con 0x7f8340100750 2024-08-19T01:23:28.667 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:23:28.667 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:23:28.667 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:23:28.667 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:23:28.667 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:23:28.667 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:23:28.667 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:23:28.667 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:23:28.667 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:23:28.667 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:23:28.668 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:23:28.669 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:23:28.669 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:23:28.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.667+0000 7f8345523640 1 -- 172.21.15.17:0/964790373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f832806e170 msgr2=0x7f8328070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:28.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.667+0000 7f8345523640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f832806e170 0x7f8328070630 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8330000c00 tx=0x7f8330005a20 comp rx=0 tx=0).stop 2024-08-19T01:23:28.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.667+0000 7f8345523640 1 -- 172.21.15.17:0/964790373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8340100750 msgr2=0x7f834019bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:28.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.667+0000 7f8345523640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8340100750 0x7f834019bef0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f833400d6f0 tx=0x7f833400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.667+0000 7f8345523640 1 -- 172.21.15.17:0/964790373 shutdown_connections 2024-08-19T01:23:28.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.667+0000 7f8345523640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f832806e170 0x7f8328070630 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.667+0000 7f8345523640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8340100750 0x7f834019bef0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.667+0000 7f8345523640 1 --2- 172.21.15.17:0/964790373 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f83400ffda0 0x7f834019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:28.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.667+0000 7f8345523640 1 -- 172.21.15.17:0/964790373 >> 172.21.15.17:0/964790373 conn(0x7f83400fb840 msgr2=0x7f83400fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:28.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.667+0000 7f8345523640 1 -- 172.21.15.17:0/964790373 shutdown_connections 2024-08-19T01:23:28.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:28.667+0000 7f8345523640 1 -- 172.21.15.17:0/964790373 wait complete. 2024-08-19T01:23:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:28 smithi017 ceph-mon[99370]: from='client.35386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:23:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:28 smithi017 ceph-mon[99370]: from='client.35390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:23:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:28 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2064139051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:23:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:28 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4251996058' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:23:28.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:28 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/964790373' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:23:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:28 smithi086 ceph-mon[71303]: from='client.35386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:23:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:28 smithi086 ceph-mon[71303]: from='client.35390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:23:29.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:28 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2064139051' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:23:29.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:28 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4251996058' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:23:29.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:28 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/964790373' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:23:30.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:29 smithi017 ceph-mon[99370]: pgmap v742: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:30.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:29 smithi017 ceph-mon[99370]: from='client.35402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:23:30.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:29 smithi086 ceph-mon[71303]: pgmap v742: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:30.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:29 smithi086 ceph-mon[71303]: from='client.35402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:23:31.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:31 smithi017 ceph-mon[99370]: pgmap v743: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:31 smithi086 ceph-mon[71303]: pgmap v743: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:33 smithi017 ceph-mon[99370]: pgmap v744: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:23:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:33 smithi086 ceph-mon[71303]: pgmap v744: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:23:36.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:35 smithi017 ceph-mon[99370]: pgmap v745: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:36.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:35 smithi086 ceph-mon[71303]: pgmap v745: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:38.010 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:37 smithi086 ceph-mon[71303]: pgmap v746: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:38.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:37 smithi017 ceph-mon[99370]: pgmap v746: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:40.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:39 smithi017 ceph-mon[99370]: pgmap v747: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:40.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:39 smithi086 ceph-mon[71303]: pgmap v747: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:42.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:41 smithi017 ceph-mon[99370]: pgmap v748: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:42.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:41 smithi086 ceph-mon[71303]: pgmap v748: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:44.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:43 smithi017 ceph-mon[99370]: pgmap v749: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:44.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:43 smithi086 ceph-mon[71303]: pgmap v749: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:45 smithi017 ceph-mon[99370]: pgmap v750: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:45 smithi086 ceph-mon[71303]: pgmap v750: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:48.177 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:47 smithi086 ceph-mon[71303]: pgmap v751: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:47 smithi017 ceph-mon[99370]: pgmap v751: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:49.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:23:49.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:23:50.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:49 smithi017 ceph-mon[99370]: pgmap v752: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:50.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:49 smithi086 ceph-mon[71303]: pgmap v752: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:51 smithi017 ceph-mon[99370]: pgmap v753: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:52.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:51 smithi086 ceph-mon[71303]: pgmap v753: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:54.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:53 smithi017 ceph-mon[99370]: pgmap v754: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:53 smithi086 ceph-mon[71303]: pgmap v754: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:56.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:55 smithi017 ceph-mon[99370]: pgmap v755: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:56.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:55 smithi086 ceph-mon[71303]: pgmap v755: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:58.186 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:57 smithi017 ceph-mon[99370]: pgmap v756: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:58.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:57 smithi086 ceph-mon[71303]: pgmap v756: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:58.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.762+0000 7f62bf01e640 1 -- 172.21.15.17:0/2625881403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62b8101610 msgr2=0x7f62b8109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:58.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.762+0000 7f62bf01e640 1 --2- 172.21.15.17:0/2625881403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62b8101610 0x7f62b8109b00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f62a40098b0 tx=0x7f62a402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:23:58.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.763+0000 7f62bf01e640 1 -- 172.21.15.17:0/2625881403 shutdown_connections 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.763+0000 7f62bf01e640 1 --2- 172.21.15.17:0/2625881403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62b8101610 0x7f62b8109b00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.763+0000 7f62bf01e640 1 --2- 172.21.15.17:0/2625881403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8100c60 0x7f62b8101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.763+0000 7f62bf01e640 1 -- 172.21.15.17:0/2625881403 >> 172.21.15.17:0/2625881403 conn(0x7f62b80fa730 msgr2=0x7f62b80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.763+0000 7f62bf01e640 1 -- 172.21.15.17:0/2625881403 shutdown_connections 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.763+0000 7f62bf01e640 1 -- 172.21.15.17:0/2625881403 wait complete. 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.763+0000 7f62bf01e640 1 Processor -- start 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.763+0000 7f62bf01e640 1 -- start start 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62bf01e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8100c60 0x7f62b8197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62bf01e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62b8101610 0x7f62b81982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62bf01e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81988a0 con 0x7f62b8101610 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62bf01e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b8198a10 con 0x7f62b8100c60 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62b7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62b8101610 0x7f62b81982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:58.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62b7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62b8101610 0x7f62b81982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45342/0 (socket says 172.21.15.17:45342) 2024-08-19T01:23:58.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62b7fff640 1 -- 172.21.15.17:0/264617527 learned_addr learned my addr 172.21.15.17:0/264617527 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:58.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62bcdba640 1 --2- 172.21.15.17:0/264617527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8100c60 0x7f62b8197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:58.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62b7fff640 1 -- 172.21.15.17:0/264617527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8100c60 msgr2=0x7f62b8197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:58.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62b7fff640 1 --2- 172.21.15.17:0/264617527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8100c60 0x7f62b8197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:58.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62b7fff640 1 -- 172.21.15.17:0/264617527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a4009560 con 0x7f62b8101610 2024-08-19T01:23:58.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.764+0000 7f62b7fff640 1 --2- 172.21.15.17:0/264617527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62b8101610 0x7f62b81982a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f62a4006010 tx=0x7f62a40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:58.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.765+0000 7f62b5ffb640 1 -- 172.21.15.17:0/264617527 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62a4004aa0 con 0x7f62b8101610 2024-08-19T01:23:58.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.765+0000 7f62b5ffb640 1 -- 172.21.15.17:0/264617527 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f62a4004c00 con 0x7f62b8101610 2024-08-19T01:23:58.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.765+0000 7f62bf01e640 1 -- 172.21.15.17:0/264617527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b819c790 con 0x7f62b8101610 2024-08-19T01:23:58.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.765+0000 7f62b5ffb640 1 -- 172.21.15.17:0/264617527 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62a4003940 con 0x7f62b8101610 2024-08-19T01:23:58.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.765+0000 7f62bf01e640 1 -- 172.21.15.17:0/264617527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b819cc80 con 0x7f62b8101610 2024-08-19T01:23:58.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.766+0000 7f62bf01e640 1 -- 172.21.15.17:0/264617527 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b8068d30 con 0x7f62b8101610 2024-08-19T01:23:58.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.767+0000 7f62b5ffb640 1 -- 172.21.15.17:0/264617527 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f62a4031b90 con 0x7f62b8101610 2024-08-19T01:23:58.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.767+0000 7f62b5ffb640 1 --2- 172.21.15.17:0/264617527 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62a806e170 0x7f62a8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:58.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.767+0000 7f62b5ffb640 1 -- 172.21.15.17:0/264617527 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f62a40af270 con 0x7f62b8101610 2024-08-19T01:23:58.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.767+0000 7f62bcdba640 1 --2- 172.21.15.17:0/264617527 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62a806e170 0x7f62a8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:58.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.768+0000 7f62bcdba640 1 --2- 172.21.15.17:0/264617527 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62a806e170 0x7f62a8070630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00abe0 tx=0x7f62ac00a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:58.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.772+0000 7f62b5ffb640 1 -- 172.21.15.17:0/264617527 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f62a4078550 con 0x7f62b8101610 2024-08-19T01:23:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.964+0000 7f62bf01e640 1 -- 172.21.15.17:0/264617527 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62b810cdb0 con 0x7f62a806e170 2024-08-19T01:23:58.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.965+0000 7f62b5ffb640 1 -- 172.21.15.17:0/264617527 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f62b810cdb0 con 0x7f62a806e170 2024-08-19T01:23:58.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.968+0000 7f62bf01e640 1 -- 172.21.15.17:0/264617527 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62a806e170 msgr2=0x7f62a8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:58.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.968+0000 7f62bf01e640 1 --2- 172.21.15.17:0/264617527 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62a806e170 0x7f62a8070630 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f62ac00abe0 tx=0x7f62ac00a2d0 comp rx=0 tx=0).stop 2024-08-19T01:23:58.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.968+0000 7f62bf01e640 1 -- 172.21.15.17:0/264617527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62b8101610 msgr2=0x7f62b81982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:58.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.968+0000 7f62bf01e640 1 --2- 172.21.15.17:0/264617527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62b8101610 0x7f62b81982a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f62a4006010 tx=0x7f62a40055a0 comp rx=0 tx=0).stop 2024-08-19T01:23:58.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.968+0000 7f62bf01e640 1 -- 172.21.15.17:0/264617527 shutdown_connections 2024-08-19T01:23:58.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.968+0000 7f62bf01e640 1 --2- 172.21.15.17:0/264617527 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f62a806e170 0x7f62a8070630 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:58.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.968+0000 7f62bf01e640 1 --2- 172.21.15.17:0/264617527 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62b8101610 0x7f62b81982a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:58.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.968+0000 7f62bf01e640 1 --2- 172.21.15.17:0/264617527 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f62b8100c60 0x7f62b8197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:58.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.968+0000 7f62bf01e640 1 -- 172.21.15.17:0/264617527 >> 172.21.15.17:0/264617527 conn(0x7f62b80fa730 msgr2=0x7f62b80ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:58.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.968+0000 7f62bf01e640 1 -- 172.21.15.17:0/264617527 shutdown_connections 2024-08-19T01:23:58.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:58.968+0000 7f62bf01e640 1 -- 172.21.15.17:0/264617527 wait complete. 2024-08-19T01:23:58.978 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:23:59.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.050+0000 7feb4521f640 1 -- 172.21.15.17:0/3272061240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb400ffda0 msgr2=0x7feb40100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.050+0000 7feb4521f640 1 --2- 172.21.15.17:0/3272061240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb400ffda0 0x7feb40100180 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7feb30009c20 tx=0x7feb3002a970 comp rx=0 tx=0).stop 2024-08-19T01:23:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.050+0000 7feb4521f640 1 -- 172.21.15.17:0/3272061240 shutdown_connections 2024-08-19T01:23:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.050+0000 7feb4521f640 1 --2- 172.21.15.17:0/3272061240 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb40100750 0x7feb401047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.050+0000 7feb4521f640 1 --2- 172.21.15.17:0/3272061240 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb400ffda0 0x7feb40100180 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.050+0000 7feb4521f640 1 -- 172.21.15.17:0/3272061240 >> 172.21.15.17:0/3272061240 conn(0x7feb400fb840 msgr2=0x7feb400fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.050+0000 7feb4521f640 1 -- 172.21.15.17:0/3272061240 shutdown_connections 2024-08-19T01:23:59.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.050+0000 7feb4521f640 1 -- 172.21.15.17:0/3272061240 wait complete. 2024-08-19T01:23:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.051+0000 7feb4521f640 1 Processor -- start 2024-08-19T01:23:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.051+0000 7feb4521f640 1 -- start start 2024-08-19T01:23:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.052+0000 7feb4521f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb400ffda0 0x7feb4019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.052+0000 7feb4521f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb40100750 0x7feb4019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.052+0000 7feb4521f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb40195a10 con 0x7feb40100750 2024-08-19T01:23:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.052+0000 7feb4521f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb40195b50 con 0x7feb400ffda0 2024-08-19T01:23:59.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.052+0000 7feb3e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb40100750 0x7feb4019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.052+0000 7feb3e59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb40100750 0x7feb4019bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45370/0 (socket says 172.21.15.17:45370) 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.052+0000 7feb3e59c640 1 -- 172.21.15.17:0/912285593 learned_addr learned my addr 172.21.15.17:0/912285593 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.052+0000 7feb3ed9d640 1 --2- 172.21.15.17:0/912285593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb400ffda0 0x7feb4019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.052+0000 7feb3e59c640 1 -- 172.21.15.17:0/912285593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb400ffda0 msgr2=0x7feb4019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.052+0000 7feb3e59c640 1 --2- 172.21.15.17:0/912285593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb400ffda0 0x7feb4019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.052+0000 7feb3e59c640 1 -- 172.21.15.17:0/912285593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb30009900 con 0x7feb40100750 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.053+0000 7feb3e59c640 1 --2- 172.21.15.17:0/912285593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb40100750 0x7feb4019bef0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feb2800c8f0 tx=0x7feb2800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.053+0000 7feb37fff640 1 -- 172.21.15.17:0/912285593 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb28007b80 con 0x7feb40100750 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.053+0000 7feb37fff640 1 -- 172.21.15.17:0/912285593 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb280054e0 con 0x7feb40100750 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.053+0000 7feb37fff640 1 -- 172.21.15.17:0/912285593 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb2800f450 con 0x7feb40100750 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.053+0000 7feb4521f640 1 -- 172.21.15.17:0/912285593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb40195e30 con 0x7feb40100750 2024-08-19T01:23:59.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.053+0000 7feb4521f640 1 -- 172.21.15.17:0/912285593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb40196330 con 0x7feb40100750 2024-08-19T01:23:59.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.054+0000 7feb4521f640 1 -- 172.21.15.17:0/912285593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb40101280 con 0x7feb40100750 2024-08-19T01:23:59.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.054+0000 7feb37fff640 1 -- 172.21.15.17:0/912285593 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7feb28004f60 con 0x7feb40100750 2024-08-19T01:23:59.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.055+0000 7feb37fff640 1 --2- 172.21.15.17:0/912285593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb2c06e170 0x7feb2c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.055+0000 7feb37fff640 1 -- 172.21.15.17:0/912285593 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7feb2808dff0 con 0x7feb40100750 2024-08-19T01:23:59.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.055+0000 7feb3ed9d640 1 --2- 172.21.15.17:0/912285593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb2c06e170 0x7feb2c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.055+0000 7feb3ed9d640 1 --2- 172.21.15.17:0/912285593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb2c06e170 0x7feb2c070630 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feb300098d0 tx=0x7feb30009820 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:59.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.059+0000 7feb37fff640 1 -- 172.21.15.17:0/912285593 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7feb280572d0 con 0x7feb40100750 2024-08-19T01:23:59.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.250+0000 7feb4521f640 1 -- 172.21.15.17:0/912285593 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb40196f40 con 0x7feb2c06e170 2024-08-19T01:23:59.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.251+0000 7feb37fff640 1 -- 172.21.15.17:0/912285593 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7feb40196f40 con 0x7feb2c06e170 2024-08-19T01:23:59.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.253+0000 7feb4521f640 1 -- 172.21.15.17:0/912285593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb2c06e170 msgr2=0x7feb2c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.253+0000 7feb4521f640 1 --2- 172.21.15.17:0/912285593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb2c06e170 0x7feb2c070630 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7feb300098d0 tx=0x7feb30009820 comp rx=0 tx=0).stop 2024-08-19T01:23:59.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.253+0000 7feb4521f640 1 -- 172.21.15.17:0/912285593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb40100750 msgr2=0x7feb4019bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.253+0000 7feb4521f640 1 --2- 172.21.15.17:0/912285593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb40100750 0x7feb4019bef0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feb2800c8f0 tx=0x7feb2800cdb0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.253+0000 7feb4521f640 1 -- 172.21.15.17:0/912285593 shutdown_connections 2024-08-19T01:23:59.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.253+0000 7feb4521f640 1 --2- 172.21.15.17:0/912285593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7feb2c06e170 0x7feb2c070630 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.253+0000 7feb4521f640 1 --2- 172.21.15.17:0/912285593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb40100750 0x7feb4019bef0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.253+0000 7feb4521f640 1 --2- 172.21.15.17:0/912285593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7feb400ffda0 0x7feb4019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.253+0000 7feb4521f640 1 -- 172.21.15.17:0/912285593 >> 172.21.15.17:0/912285593 conn(0x7feb400fb840 msgr2=0x7feb400fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:59.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.253+0000 7feb4521f640 1 -- 172.21.15.17:0/912285593 shutdown_connections 2024-08-19T01:23:59.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.253+0000 7feb4521f640 1 -- 172.21.15.17:0/912285593 wait complete. 2024-08-19T01:23:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.336+0000 7f66c61ae640 1 -- 172.21.15.17:0/864089337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c0101610 msgr2=0x7f66c0109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.336+0000 7f66c61ae640 1 --2- 172.21.15.17:0/864089337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c0101610 0x7f66c0109b00 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f66b40098b0 tx=0x7f66b402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.336+0000 7f66c61ae640 1 -- 172.21.15.17:0/864089337 shutdown_connections 2024-08-19T01:23:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.336+0000 7f66c61ae640 1 --2- 172.21.15.17:0/864089337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c0101610 0x7f66c0109b00 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.336+0000 7f66c61ae640 1 --2- 172.21.15.17:0/864089337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c0100c60 0x7f66c0101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.336+0000 7f66c61ae640 1 -- 172.21.15.17:0/864089337 >> 172.21.15.17:0/864089337 conn(0x7f66c00fa730 msgr2=0x7f66c00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.336+0000 7f66c61ae640 1 -- 172.21.15.17:0/864089337 shutdown_connections 2024-08-19T01:23:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.336+0000 7f66c61ae640 1 -- 172.21.15.17:0/864089337 wait complete. 2024-08-19T01:23:59.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.337+0000 7f66c61ae640 1 Processor -- start 2024-08-19T01:23:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.337+0000 7f66c61ae640 1 -- start start 2024-08-19T01:23:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.337+0000 7f66c61ae640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c0100c60 0x7f66c019da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.337+0000 7f66c61ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c0101610 0x7f66c019dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.337+0000 7f66c61ae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c0197b50 con 0x7f66c0101610 2024-08-19T01:23:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.337+0000 7f66c61ae640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c0197cc0 con 0x7f66c0100c60 2024-08-19T01:23:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.337+0000 7f66beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c0101610 0x7f66c019dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.337+0000 7f66bf7fe640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c0100c60 0x7f66c019da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.337+0000 7f66beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c0101610 0x7f66c019dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45384/0 (socket says 172.21.15.17:45384) 2024-08-19T01:23:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.337+0000 7f66beffd640 1 -- 172.21.15.17:0/238695040 learned_addr learned my addr 172.21.15.17:0/238695040 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.338+0000 7f66beffd640 1 -- 172.21.15.17:0/238695040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c0100c60 msgr2=0x7f66c019da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.338+0000 7f66beffd640 1 --2- 172.21.15.17:0/238695040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c0100c60 0x7f66c019da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.338+0000 7f66beffd640 1 -- 172.21.15.17:0/238695040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b4009560 con 0x7f66c0101610 2024-08-19T01:23:59.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.338+0000 7f66beffd640 1 --2- 172.21.15.17:0/238695040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c0101610 0x7f66c019dfa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f66b4006010 tx=0x7f66b40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:59.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.338+0000 7f66bcff9640 1 -- 172.21.15.17:0/238695040 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66b4004aa0 con 0x7f66c0101610 2024-08-19T01:23:59.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.338+0000 7f66bcff9640 1 -- 172.21.15.17:0/238695040 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f66b4004c00 con 0x7f66c0101610 2024-08-19T01:23:59.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.338+0000 7f66c61ae640 1 -- 172.21.15.17:0/238695040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c0197f40 con 0x7f66c0101610 2024-08-19T01:23:59.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.338+0000 7f66bcff9640 1 -- 172.21.15.17:0/238695040 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66b4003a20 con 0x7f66c0101610 2024-08-19T01:23:59.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.338+0000 7f66c61ae640 1 -- 172.21.15.17:0/238695040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c0198430 con 0x7f66c0101610 2024-08-19T01:23:59.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.339+0000 7f66c61ae640 1 -- 172.21.15.17:0/238695040 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c0068d30 con 0x7f66c0101610 2024-08-19T01:23:59.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.340+0000 7f66bcff9640 1 -- 172.21.15.17:0/238695040 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f66b4003ba0 con 0x7f66c0101610 2024-08-19T01:23:59.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.340+0000 7f66bcff9640 1 --2- 172.21.15.17:0/238695040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f66a806e170 0x7f66a8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.340+0000 7f66bcff9640 1 -- 172.21.15.17:0/238695040 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f66b40af1c0 con 0x7f66c0101610 2024-08-19T01:23:59.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.340+0000 7f66bf7fe640 1 --2- 172.21.15.17:0/238695040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f66a806e170 0x7f66a8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.341+0000 7f66bf7fe640 1 --2- 172.21.15.17:0/238695040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f66a806e170 0x7f66a8070630 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f66b00058c0 tx=0x7f66b000a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:59.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.345+0000 7f66bcff9640 1 -- 172.21.15.17:0/238695040 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f66b40785d0 con 0x7f66c0101610 2024-08-19T01:23:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.526+0000 7f66c61ae640 1 -- 172.21.15.17:0/238695040 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f66c0109550 con 0x7f66a806e170 2024-08-19T01:23:59.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.536+0000 7f66bcff9640 1 -- 172.21.15.17:0/238695040 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f66c0109550 con 0x7f66a806e170 2024-08-19T01:23:59.539 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:23:59.539 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (25m) 3m ago 35m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:23:59.539 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (36m) 3m ago 36m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:23:59.539 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (35m) 3m ago 35m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:23:59.539 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (23m) 3m ago 36m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:23:59.539 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (22m) 3m ago 35m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:23:59.539 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (24m) 3m ago 35m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:23:59.539 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (19m) 3m ago 30m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:23:59.539 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (19m) 3m ago 30m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:23:59.540 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (3m) 3m ago 30m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:23:59.540 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (18m) 3m ago 30m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:23:59.540 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (27m) 3m ago 37m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:23:59.540 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (26m) 3m ago 34m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:23:59.540 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (24m) 3m ago 37m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:23:59.540 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (23m) 3m ago 34m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:23:59.540 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (25m) 3m ago 36m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:23:59.541 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (25m) 3m ago 35m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:23:59.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (22m) 3m ago 34m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:23:59.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (22m) 3m ago 33m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:23:59.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (21m) 3m ago 33m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:23:59.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (20m) 3m ago 32m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:23:59.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (20m) 3m ago 32m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:23:59.541 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (19m) 3m ago 32m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:23:59.542 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (25m) 3m ago 35m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:23:59.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.538+0000 7f66c61ae640 1 -- 172.21.15.17:0/238695040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f66a806e170 msgr2=0x7f66a8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.538+0000 7f66c61ae640 1 --2- 172.21.15.17:0/238695040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f66a806e170 0x7f66a8070630 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f66b00058c0 tx=0x7f66b000a2d0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.538+0000 7f66c61ae640 1 -- 172.21.15.17:0/238695040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c0101610 msgr2=0x7f66c019dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.538+0000 7f66c61ae640 1 --2- 172.21.15.17:0/238695040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c0101610 0x7f66c019dfa0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f66b4006010 tx=0x7f66b40055a0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.538+0000 7f66c61ae640 1 -- 172.21.15.17:0/238695040 shutdown_connections 2024-08-19T01:23:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.538+0000 7f66c61ae640 1 --2- 172.21.15.17:0/238695040 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f66a806e170 0x7f66a8070630 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.538+0000 7f66c61ae640 1 --2- 172.21.15.17:0/238695040 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f66c0101610 0x7f66c019dfa0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.538+0000 7f66c61ae640 1 --2- 172.21.15.17:0/238695040 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f66c0100c60 0x7f66c019da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.538+0000 7f66c61ae640 1 -- 172.21.15.17:0/238695040 >> 172.21.15.17:0/238695040 conn(0x7f66c00fa730 msgr2=0x7f66c00ffed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.538+0000 7f66c61ae640 1 -- 172.21.15.17:0/238695040 shutdown_connections 2024-08-19T01:23:59.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.538+0000 7f66c61ae640 1 -- 172.21.15.17:0/238695040 wait complete. 2024-08-19T01:23:59.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.620+0000 7f58b9d65640 1 -- 172.21.15.17:0/996929876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b40ffb30 msgr2=0x7f58b40fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.620+0000 7f58b9d65640 1 --2- 172.21.15.17:0/996929876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b40ffb30 0x7f58b40fff90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f589c009880 tx=0x7f589c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.620+0000 7f58b9d65640 1 -- 172.21.15.17:0/996929876 shutdown_connections 2024-08-19T01:23:59.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.620+0000 7f58b9d65640 1 --2- 172.21.15.17:0/996929876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b40ffb30 0x7f58b40fff90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.620+0000 7f58b9d65640 1 --2- 172.21.15.17:0/996929876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b4105be0 0x7f58b4105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.620+0000 7f58b9d65640 1 -- 172.21.15.17:0/996929876 >> 172.21.15.17:0/996929876 conn(0x7f58b40fb810 msgr2=0x7f58b40fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:59.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.620+0000 7f58b9d65640 1 -- 172.21.15.17:0/996929876 shutdown_connections 2024-08-19T01:23:59.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.620+0000 7f58b9d65640 1 -- 172.21.15.17:0/996929876 wait complete. 2024-08-19T01:23:59.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.621+0000 7f58b9d65640 1 Processor -- start 2024-08-19T01:23:59.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.621+0000 7f58b9d65640 1 -- start start 2024-08-19T01:23:59.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.621+0000 7f58b9d65640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b40ffb30 0x7f58b419b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.621+0000 7f58b9d65640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b4105be0 0x7f58b419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.621+0000 7f58b9d65640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b419c330 con 0x7f58b40ffb30 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.621+0000 7f58b9d65640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b41958c0 con 0x7f58b4105be0 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b40ffb30 0x7f58b419b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b40ffb30 0x7f58b419b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45394/0 (socket says 172.21.15.17:45394) 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b37fe640 1 -- 172.21.15.17:0/1575336021 learned_addr learned my addr 172.21.15.17:0/1575336021 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58aaffd640 1 --2- 172.21.15.17:0/1575336021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b4105be0 0x7f58b419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b37fe640 1 -- 172.21.15.17:0/1575336021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b4105be0 msgr2=0x7f58b419bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b37fe640 1 --2- 172.21.15.17:0/1575336021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b4105be0 0x7f58b419bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b37fe640 1 -- 172.21.15.17:0/1575336021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c009560 con 0x7f58b40ffb30 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b37fe640 1 --2- 172.21.15.17:0/1575336021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b40ffb30 0x7f58b419b7d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f58a400d6f0 tx=0x7f58a400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b17fa640 1 -- 172.21.15.17:0/1575336021 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a4009a30 con 0x7f58b40ffb30 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b17fa640 1 -- 172.21.15.17:0/1575336021 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58a40054e0 con 0x7f58b40ffb30 2024-08-19T01:23:59.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b9d65640 1 -- 172.21.15.17:0/1575336021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b4195ba0 con 0x7f58b40ffb30 2024-08-19T01:23:59.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b17fa640 1 -- 172.21.15.17:0/1575336021 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a4010460 con 0x7f58b40ffb30 2024-08-19T01:23:59.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.622+0000 7f58b9d65640 1 -- 172.21.15.17:0/1575336021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b4196140 con 0x7f58b40ffb30 2024-08-19T01:23:59.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.623+0000 7f58b9d65640 1 -- 172.21.15.17:0/1575336021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b41011e0 con 0x7f58b40ffb30 2024-08-19T01:23:59.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.624+0000 7f58b17fa640 1 -- 172.21.15.17:0/1575336021 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f58a4009b90 con 0x7f58b40ffb30 2024-08-19T01:23:59.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.625+0000 7f58b17fa640 1 --2- 172.21.15.17:0/1575336021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f58a006e180 0x7f58a0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.625+0000 7f58b17fa640 1 -- 172.21.15.17:0/1575336021 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f58a408dc80 con 0x7f58b40ffb30 2024-08-19T01:23:59.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.625+0000 7f58aaffd640 1 --2- 172.21.15.17:0/1575336021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f58a006e180 0x7f58a0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.626+0000 7f58aaffd640 1 --2- 172.21.15.17:0/1575336021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f58a006e180 0x7f58a0070640 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f589c009230 tx=0x7f589c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:59.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.630+0000 7f58b17fa640 1 -- 172.21.15.17:0/1575336021 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f58a4057010 con 0x7f58b40ffb30 2024-08-19T01:23:59.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.875+0000 7f58b9d65640 1 -- 172.21.15.17:0/1575336021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f58b4108000 con 0x7f58b40ffb30 2024-08-19T01:23:59.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:59 smithi017 ceph-mon[99370]: pgmap v757: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:23:59.877 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:23:59 smithi017 ceph-mon[99370]: from='client.35410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:23:59.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.875+0000 7f58b17fa640 1 -- 172.21.15.17:0/1575336021 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f58a4017280 con 0x7f58b40ffb30 2024-08-19T01:23:59.878 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:23:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:23:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:23:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:23:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:23:59.878 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:23:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:23:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:23:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:23:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:23:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:23:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:23:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:23:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:23:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:23:59.879 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:23:59.879 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:23:59.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.877+0000 7f58b9d65640 1 -- 172.21.15.17:0/1575336021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f58a006e180 msgr2=0x7f58a0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.877+0000 7f58b9d65640 1 --2- 172.21.15.17:0/1575336021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f58a006e180 0x7f58a0070640 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f589c009230 tx=0x7f589c005a20 comp rx=0 tx=0).stop 2024-08-19T01:23:59.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.877+0000 7f58b9d65640 1 -- 172.21.15.17:0/1575336021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b40ffb30 msgr2=0x7f58b419b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.877+0000 7f58b9d65640 1 --2- 172.21.15.17:0/1575336021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b40ffb30 0x7f58b419b7d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f58a400d6f0 tx=0x7f58a400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.877+0000 7f58b9d65640 1 -- 172.21.15.17:0/1575336021 shutdown_connections 2024-08-19T01:23:59.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.877+0000 7f58b9d65640 1 --2- 172.21.15.17:0/1575336021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f58a006e180 0x7f58a0070640 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.877+0000 7f58b9d65640 1 --2- 172.21.15.17:0/1575336021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f58b4105be0 0x7f58b419bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.877+0000 7f58b9d65640 1 --2- 172.21.15.17:0/1575336021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58b40ffb30 0x7f58b419b7d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.878+0000 7f58b9d65640 1 -- 172.21.15.17:0/1575336021 >> 172.21.15.17:0/1575336021 conn(0x7f58b40fb810 msgr2=0x7f58b40fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:59.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.878+0000 7f58b9d65640 1 -- 172.21.15.17:0/1575336021 shutdown_connections 2024-08-19T01:23:59.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.878+0000 7f58b9d65640 1 -- 172.21.15.17:0/1575336021 wait complete. 2024-08-19T01:23:59.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.959+0000 7f966c2cd640 1 -- 172.21.15.17:0/845897014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96641049f0 msgr2=0x7f9664104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.959+0000 7f966c2cd640 1 --2- 172.21.15.17:0/845897014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96641049f0 0x7f9664104dd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9660009880 tx=0x7f966002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.960+0000 7f966c2cd640 1 -- 172.21.15.17:0/845897014 shutdown_connections 2024-08-19T01:23:59.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.960+0000 7f966c2cd640 1 --2- 172.21.15.17:0/845897014 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96640fe9f0 0x7f96640fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.960+0000 7f966c2cd640 1 --2- 172.21.15.17:0/845897014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96641049f0 0x7f9664104dd0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.960+0000 7f966c2cd640 1 -- 172.21.15.17:0/845897014 >> 172.21.15.17:0/845897014 conn(0x7f96640758a0 msgr2=0x7f96640fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:23:59.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.960+0000 7f966c2cd640 1 -- 172.21.15.17:0/845897014 shutdown_connections 2024-08-19T01:23:59.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.960+0000 7f966c2cd640 1 -- 172.21.15.17:0/845897014 wait complete. 2024-08-19T01:23:59.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.960+0000 7f966c2cd640 1 Processor -- start 2024-08-19T01:23:59.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.960+0000 7f966c2cd640 1 -- start start 2024-08-19T01:23:59.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966c2cd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96640fe9f0 0x7f966419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966c2cd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96641049f0 0x7f966419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966c2cd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9664195890 con 0x7f96640fe9f0 2024-08-19T01:23:59.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966c2cd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96641959d0 con 0x7f96641049f0 2024-08-19T01:23:59.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966a069640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96640fe9f0 0x7f966419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966a069640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96640fe9f0 0x7f966419b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45416/0 (socket says 172.21.15.17:45416) 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966a069640 1 -- 172.21.15.17:0/1160651713 learned_addr learned my addr 172.21.15.17:0/1160651713 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f9669868640 1 --2- 172.21.15.17:0/1160651713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96641049f0 0x7f966419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966a069640 1 -- 172.21.15.17:0/1160651713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96641049f0 msgr2=0x7f966419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966a069640 1 --2- 172.21.15.17:0/1160651713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96641049f0 0x7f966419bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966a069640 1 -- 172.21.15.17:0/1160651713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9660009560 con 0x7f96640fe9f0 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966a069640 1 --2- 172.21.15.17:0/1160651713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96640fe9f0 0x7f966419b830 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f966002a9c0 tx=0x7f9660004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f96577fe640 1 -- 172.21.15.17:0/1160651713 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96600051d0 con 0x7f96640fe9f0 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f96577fe640 1 -- 172.21.15.17:0/1160651713 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9660031990 con 0x7f96640fe9f0 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966c2cd640 1 -- 172.21.15.17:0/1160651713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9664195c50 con 0x7f96640fe9f0 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f96577fe640 1 -- 172.21.15.17:0/1160651713 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9660003980 con 0x7f96640fe9f0 2024-08-19T01:23:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.961+0000 7f966c2cd640 1 -- 172.21.15.17:0/1160651713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9664196140 con 0x7f96640fe9f0 2024-08-19T01:23:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.962+0000 7f966c2cd640 1 -- 172.21.15.17:0/1160651713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9664100130 con 0x7f96640fe9f0 2024-08-19T01:23:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.963+0000 7f96577fe640 1 -- 172.21.15.17:0/1160651713 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9660005330 con 0x7f96640fe9f0 2024-08-19T01:23:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.963+0000 7f96577fe640 1 --2- 172.21.15.17:0/1160651713 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f965006e170 0x7f9650070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:23:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.963+0000 7f96577fe640 1 -- 172.21.15.17:0/1160651713 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f96600af2b0 con 0x7f96640fe9f0 2024-08-19T01:23:59.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.964+0000 7f9669868640 1 --2- 172.21.15.17:0/1160651713 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f965006e170 0x7f9650070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:23:59.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.964+0000 7f9669868640 1 --2- 172.21.15.17:0/1160651713 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f965006e170 0x7f9650070630 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f96641970e0 tx=0x7f965800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:23:59.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:23:59.968+0000 7f96577fe640 1 -- 172.21.15.17:0/1160651713 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9660078640 con 0x7f96640fe9f0 2024-08-19T01:24:00.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.177+0000 7f966c2cd640 1 -- 172.21.15.17:0/1160651713 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f966410bc60 con 0x7f96640fe9f0 2024-08-19T01:24:00.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.177+0000 7f96577fe640 1 -- 172.21.15.17:0/1160651713 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f966007bd00 con 0x7f96640fe9f0 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:24:00.180 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:24:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:24:00.182 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:24:00.183 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:24:00.183 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:24:00.183 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:24:00.183 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:24:00.183 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:24:00.184 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:24:00.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.179+0000 7f966c2cd640 1 -- 172.21.15.17:0/1160651713 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f965006e170 msgr2=0x7f9650070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:00.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.179+0000 7f966c2cd640 1 --2- 172.21.15.17:0/1160651713 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f965006e170 0x7f9650070630 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f96641970e0 tx=0x7f965800b410 comp rx=0 tx=0).stop 2024-08-19T01:24:00.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.179+0000 7f966c2cd640 1 -- 172.21.15.17:0/1160651713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96640fe9f0 msgr2=0x7f966419b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:00.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.179+0000 7f966c2cd640 1 --2- 172.21.15.17:0/1160651713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96640fe9f0 0x7f966419b830 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f966002a9c0 tx=0x7f9660004270 comp rx=0 tx=0).stop 2024-08-19T01:24:00.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.179+0000 7f966c2cd640 1 -- 172.21.15.17:0/1160651713 shutdown_connections 2024-08-19T01:24:00.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.179+0000 7f966c2cd640 1 --2- 172.21.15.17:0/1160651713 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f965006e170 0x7f9650070630 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.179+0000 7f966c2cd640 1 --2- 172.21.15.17:0/1160651713 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f96641049f0 0x7f966419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.179+0000 7f966c2cd640 1 --2- 172.21.15.17:0/1160651713 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96640fe9f0 0x7f966419b830 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.179+0000 7f966c2cd640 1 -- 172.21.15.17:0/1160651713 >> 172.21.15.17:0/1160651713 conn(0x7f96640758a0 msgr2=0x7f9664067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:00.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.180+0000 7f966c2cd640 1 -- 172.21.15.17:0/1160651713 shutdown_connections 2024-08-19T01:24:00.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.180+0000 7f966c2cd640 1 -- 172.21.15.17:0/1160651713 wait complete. 2024-08-19T01:24:00.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:59 smithi086 ceph-mon[71303]: pgmap v757: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:00.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:23:59 smithi086 ceph-mon[71303]: from='client.35410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:00.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.263+0000 7f5be60c2640 1 -- 172.21.15.17:0/3571176741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5be0101610 msgr2=0x7f5be0109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:00.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.263+0000 7f5be60c2640 1 --2- 172.21.15.17:0/3571176741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5be0101610 0x7f5be0109b00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40098b0 tx=0x7f5bd402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.263+0000 7f5be60c2640 1 -- 172.21.15.17:0/3571176741 shutdown_connections 2024-08-19T01:24:00.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.263+0000 7f5be60c2640 1 --2- 172.21.15.17:0/3571176741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5be0101610 0x7f5be0109b00 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.263+0000 7f5be60c2640 1 --2- 172.21.15.17:0/3571176741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5be0100c60 0x7f5be0101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.263+0000 7f5be60c2640 1 -- 172.21.15.17:0/3571176741 >> 172.21.15.17:0/3571176741 conn(0x7f5be00fa730 msgr2=0x7f5be00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:00.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.263+0000 7f5be60c2640 1 -- 172.21.15.17:0/3571176741 shutdown_connections 2024-08-19T01:24:00.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.263+0000 7f5be60c2640 1 -- 172.21.15.17:0/3571176741 wait complete. 2024-08-19T01:24:00.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.264+0000 7f5be60c2640 1 Processor -- start 2024-08-19T01:24:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.264+0000 7f5be60c2640 1 -- start start 2024-08-19T01:24:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.264+0000 7f5be60c2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5be0100c60 0x7f5be019b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.264+0000 7f5be60c2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5be0101610 0x7f5be019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.264+0000 7f5be60c2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be019c3e0 con 0x7f5be0100c60 2024-08-19T01:24:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.264+0000 7f5be60c2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0195970 con 0x7f5be0101610 2024-08-19T01:24:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.264+0000 7f5bdf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5be0100c60 0x7f5be019b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.264+0000 7f5bdf7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5be0100c60 0x7f5be019b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45438/0 (socket says 172.21.15.17:45438) 2024-08-19T01:24:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.264+0000 7f5bdf7fe640 1 -- 172.21.15.17:0/1571738478 learned_addr learned my addr 172.21.15.17:0/1571738478 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:24:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.264+0000 7f5bdeffd640 1 --2- 172.21.15.17:0/1571738478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5be0101610 0x7f5be019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:00.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.265+0000 7f5bdf7fe640 1 -- 172.21.15.17:0/1571738478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5be0101610 msgr2=0x7f5be019bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.265+0000 7f5bdf7fe640 1 --2- 172.21.15.17:0/1571738478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5be0101610 0x7f5be019bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.265+0000 7f5bdf7fe640 1 -- 172.21.15.17:0/1571738478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4009560 con 0x7f5be0100c60 2024-08-19T01:24:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.265+0000 7f5bdf7fe640 1 --2- 172.21.15.17:0/1571738478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5be0100c60 0x7f5be019b880 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000d6f0 tx=0x7f5bd000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.265+0000 7f5bdcff9640 1 -- 172.21.15.17:0/1571738478 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bd0009a30 con 0x7f5be0100c60 2024-08-19T01:24:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.265+0000 7f5be60c2640 1 -- 172.21.15.17:0/1571738478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be0195c50 con 0x7f5be0100c60 2024-08-19T01:24:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.265+0000 7f5bdcff9640 1 -- 172.21.15.17:0/1571738478 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5bd00054e0 con 0x7f5be0100c60 2024-08-19T01:24:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.265+0000 7f5bdcff9640 1 -- 172.21.15.17:0/1571738478 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bd0010460 con 0x7f5be0100c60 2024-08-19T01:24:00.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.265+0000 7f5be60c2640 1 -- 172.21.15.17:0/1571738478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be0196170 con 0x7f5be0100c60 2024-08-19T01:24:00.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.266+0000 7f5be60c2640 1 -- 172.21.15.17:0/1571738478 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be0068d30 con 0x7f5be0100c60 2024-08-19T01:24:00.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.266+0000 7f5bdcff9640 1 -- 172.21.15.17:0/1571738478 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5bd0009b90 con 0x7f5be0100c60 2024-08-19T01:24:00.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.267+0000 7f5bdcff9640 1 --2- 172.21.15.17:0/1571738478 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5bc806e180 0x7f5bc8070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:00.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.267+0000 7f5bdcff9640 1 -- 172.21.15.17:0/1571738478 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5bd008dc80 con 0x7f5be0100c60 2024-08-19T01:24:00.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.267+0000 7f5bdeffd640 1 --2- 172.21.15.17:0/1571738478 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5bc806e180 0x7f5bc8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:00.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.268+0000 7f5bdeffd640 1 --2- 172.21.15.17:0/1571738478 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5bc806e180 0x7f5bc8070640 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009880 tx=0x7f5bd4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:00.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.271+0000 7f5bdcff9640 1 -- 172.21.15.17:0/1571738478 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5bd0057010 con 0x7f5be0100c60 2024-08-19T01:24:00.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.462+0000 7f5be60c2640 1 -- 172.21.15.17:0/1571738478 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5be010cdd0 con 0x7f5bc806e180 2024-08-19T01:24:00.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.463+0000 7f5bdcff9640 1 -- 172.21.15.17:0/1571738478 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f5be010cdd0 con 0x7f5bc806e180 2024-08-19T01:24:00.465 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:24:00.466 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:24:00.467 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:24:00.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.466+0000 7f5be60c2640 1 -- 172.21.15.17:0/1571738478 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5bc806e180 msgr2=0x7f5bc8070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:00.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.466+0000 7f5be60c2640 1 --2- 172.21.15.17:0/1571738478 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5bc806e180 0x7f5bc8070640 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009880 tx=0x7f5bd4005a20 comp rx=0 tx=0).stop 2024-08-19T01:24:00.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.466+0000 7f5be60c2640 1 -- 172.21.15.17:0/1571738478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5be0100c60 msgr2=0x7f5be019b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:00.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.466+0000 7f5be60c2640 1 --2- 172.21.15.17:0/1571738478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5be0100c60 0x7f5be019b880 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000d6f0 tx=0x7f5bd000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.466+0000 7f5be60c2640 1 -- 172.21.15.17:0/1571738478 shutdown_connections 2024-08-19T01:24:00.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.466+0000 7f5be60c2640 1 --2- 172.21.15.17:0/1571738478 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5bc806e180 0x7f5bc8070640 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.466+0000 7f5be60c2640 1 --2- 172.21.15.17:0/1571738478 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5be0101610 0x7f5be019bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.466+0000 7f5be60c2640 1 --2- 172.21.15.17:0/1571738478 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5be0100c60 0x7f5be019b880 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.466+0000 7f5be60c2640 1 -- 172.21.15.17:0/1571738478 >> 172.21.15.17:0/1571738478 conn(0x7f5be00fa730 msgr2=0x7f5be0101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:00.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.466+0000 7f5be60c2640 1 -- 172.21.15.17:0/1571738478 shutdown_connections 2024-08-19T01:24:00.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.466+0000 7f5be60c2640 1 -- 172.21.15.17:0/1571738478 wait complete. 2024-08-19T01:24:00.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.548+0000 7ff99c39d640 1 -- 172.21.15.17:0/1135777414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9940fe9f0 msgr2=0x7ff9940fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:00.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.548+0000 7ff99c39d640 1 --2- 172.21.15.17:0/1135777414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9940fe9f0 0x7ff9940fee50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff988009880 tx=0x7ff98802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 -- 172.21.15.17:0/1135777414 shutdown_connections 2024-08-19T01:24:00.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 --2- 172.21.15.17:0/1135777414 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9940fe9f0 0x7ff9940fee50 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 --2- 172.21.15.17:0/1135777414 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9941049f0 0x7ff994104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 -- 172.21.15.17:0/1135777414 >> 172.21.15.17:0/1135777414 conn(0x7ff9940758a0 msgr2=0x7ff9940fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:00.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 -- 172.21.15.17:0/1135777414 shutdown_connections 2024-08-19T01:24:00.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 -- 172.21.15.17:0/1135777414 wait complete. 2024-08-19T01:24:00.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 Processor -- start 2024-08-19T01:24:00.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 -- start start 2024-08-19T01:24:00.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9940fe9f0 0x7ff9940fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:00.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9941049f0 0x7ff9940fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:00.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940fb800 con 0x7ff9941049f0 2024-08-19T01:24:00.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.549+0000 7ff99c39d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940fb940 con 0x7ff9940fe9f0 2024-08-19T01:24:00.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff999938640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9941049f0 0x7ff9940fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:00.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff999938640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9941049f0 0x7ff9940fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:45470/0 (socket says 172.21.15.17:45470) 2024-08-19T01:24:00.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff999938640 1 -- 172.21.15.17:0/1150306271 learned_addr learned my addr 172.21.15.17:0/1150306271 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:24:00.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff99a139640 1 --2- 172.21.15.17:0/1150306271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9940fe9f0 0x7ff9940fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:00.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff999938640 1 -- 172.21.15.17:0/1150306271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9940fe9f0 msgr2=0x7ff9940fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:00.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff999938640 1 --2- 172.21.15.17:0/1150306271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9940fe9f0 0x7ff9940fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff999938640 1 -- 172.21.15.17:0/1150306271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff988009560 con 0x7ff9941049f0 2024-08-19T01:24:00.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff999938640 1 --2- 172.21.15.17:0/1150306271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9941049f0 0x7ff9940fb2c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff98802a9c0 tx=0x7ff9880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:00.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff9877fe640 1 -- 172.21.15.17:0/1150306271 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff988004aa0 con 0x7ff9941049f0 2024-08-19T01:24:00.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff99c39d640 1 -- 172.21.15.17:0/1150306271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9940fbbc0 con 0x7ff9941049f0 2024-08-19T01:24:00.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff9877fe640 1 -- 172.21.15.17:0/1150306271 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff988004c00 con 0x7ff9941049f0 2024-08-19T01:24:00.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff9877fe640 1 -- 172.21.15.17:0/1150306271 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff988003980 con 0x7ff9941049f0 2024-08-19T01:24:00.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.550+0000 7ff99c39d640 1 -- 172.21.15.17:0/1150306271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9941a1fa0 con 0x7ff9941049f0 2024-08-19T01:24:00.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.551+0000 7ff99c39d640 1 -- 172.21.15.17:0/1150306271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff994100130 con 0x7ff9941049f0 2024-08-19T01:24:00.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.552+0000 7ff9877fe640 1 -- 172.21.15.17:0/1150306271 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff988003bf0 con 0x7ff9941049f0 2024-08-19T01:24:00.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.552+0000 7ff9877fe640 1 --2- 172.21.15.17:0/1150306271 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98006e170 0x7ff980070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:00.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.552+0000 7ff9877fe640 1 -- 172.21.15.17:0/1150306271 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff9880af140 con 0x7ff9941049f0 2024-08-19T01:24:00.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.553+0000 7ff99a139640 1 --2- 172.21.15.17:0/1150306271 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98006e170 0x7ff980070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:00.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.553+0000 7ff99a139640 1 --2- 172.21.15.17:0/1150306271 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98006e170 0x7ff980070630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff990005d00 tx=0x7ff99000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:00.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.557+0000 7ff9877fe640 1 -- 172.21.15.17:0/1150306271 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff9880784d0 con 0x7ff9941049f0 2024-08-19T01:24:00.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.800+0000 7ff99c39d640 1 -- 172.21.15.17:0/1150306271 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff99410bc60 con 0x7ff9941049f0 2024-08-19T01:24:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.801+0000 7ff9877fe640 1 -- 172.21.15.17:0/1150306271 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7ff98807bb90 con 0x7ff9941049f0 2024-08-19T01:24:00.803 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:24:00.803 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:24:00.803 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:24:00.803 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:24:00.803 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:24:00.803 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:24:00.803 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:24:00.803 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:24:00.803 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:24:00.804 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:24:00.805 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:24:00.805 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:24:00.805 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:24:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.803+0000 7ff99c39d640 1 -- 172.21.15.17:0/1150306271 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98006e170 msgr2=0x7ff980070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.803+0000 7ff99c39d640 1 --2- 172.21.15.17:0/1150306271 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98006e170 0x7ff980070630 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff990005d00 tx=0x7ff99000b410 comp rx=0 tx=0).stop 2024-08-19T01:24:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.803+0000 7ff99c39d640 1 -- 172.21.15.17:0/1150306271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9941049f0 msgr2=0x7ff9940fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.803+0000 7ff99c39d640 1 --2- 172.21.15.17:0/1150306271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9941049f0 0x7ff9940fb2c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff98802a9c0 tx=0x7ff9880055a0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.803+0000 7ff99c39d640 1 -- 172.21.15.17:0/1150306271 shutdown_connections 2024-08-19T01:24:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.803+0000 7ff99c39d640 1 --2- 172.21.15.17:0/1150306271 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff98006e170 0x7ff980070630 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.803+0000 7ff99c39d640 1 --2- 172.21.15.17:0/1150306271 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff9941049f0 0x7ff9940fb2c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.803+0000 7ff99c39d640 1 --2- 172.21.15.17:0/1150306271 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff9940fe9f0 0x7ff9940fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.803+0000 7ff99c39d640 1 -- 172.21.15.17:0/1150306271 >> 172.21.15.17:0/1150306271 conn(0x7ff9940758a0 msgr2=0x7ff9940fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.803+0000 7ff99c39d640 1 -- 172.21.15.17:0/1150306271 shutdown_connections 2024-08-19T01:24:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:00.803+0000 7ff99c39d640 1 -- 172.21.15.17:0/1150306271 wait complete. 2024-08-19T01:24:01.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:00 smithi017 ceph-mon[99370]: from='client.35414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:01.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:00 smithi017 ceph-mon[99370]: from='client.35418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:01.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:00 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1575336021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:24:01.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:00 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1160651713' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:24:01.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:00 smithi086 ceph-mon[71303]: from='client.35414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:01.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:00 smithi086 ceph-mon[71303]: from='client.35418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:01.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:00 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1575336021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:24:01.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:00 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1160651713' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:24:02.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:01 smithi017 ceph-mon[99370]: pgmap v758: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:02.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:01 smithi017 ceph-mon[99370]: from='client.35430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:02.158 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:01 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1150306271' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:24:02.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:01 smithi086 ceph-mon[71303]: pgmap v758: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:02.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:01 smithi086 ceph-mon[71303]: from='client.35430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:02.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:01 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1150306271' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:24:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:03 smithi017 ceph-mon[99370]: pgmap v759: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:24:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:03 smithi086 ceph-mon[71303]: pgmap v759: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:24:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:05 smithi017 ceph-mon[99370]: pgmap v760: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:05 smithi086 ceph-mon[71303]: pgmap v760: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:07 smithi017 ceph-mon[99370]: pgmap v761: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:08.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:07 smithi086 ceph-mon[71303]: pgmap v761: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:10.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:09 smithi017 ceph-mon[99370]: pgmap v762: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:10.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:09 smithi086 ceph-mon[71303]: pgmap v762: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:11 smithi017 ceph-mon[99370]: pgmap v763: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:12.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:11 smithi086 ceph-mon[71303]: pgmap v763: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:13.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:13 smithi086 ceph-mon[71303]: pgmap v764: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:14.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:13 smithi017 ceph-mon[99370]: pgmap v764: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:16.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:15 smithi017 ceph-mon[99370]: pgmap v765: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:16.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:15 smithi086 ceph-mon[71303]: pgmap v765: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:17 smithi017 ceph-mon[99370]: pgmap v766: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:17 smithi086 ceph-mon[71303]: pgmap v766: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:18.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:24:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:24:20.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:19 smithi017 ceph-mon[99370]: pgmap v767: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:20.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:19 smithi086 ceph-mon[71303]: pgmap v767: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:22.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:21 smithi017 ceph-mon[99370]: pgmap v768: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:22.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:21 smithi086 ceph-mon[71303]: pgmap v768: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:23 smithi017 ceph-mon[99370]: pgmap v769: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:24.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:23 smithi086 ceph-mon[71303]: pgmap v769: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:26.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:25 smithi017 ceph-mon[99370]: pgmap v770: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:25 smithi086 ceph-mon[71303]: pgmap v770: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:27.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:27 smithi017 ceph-mon[99370]: pgmap v771: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:27 smithi086 ceph-mon[71303]: pgmap v771: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:30.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:29 smithi017 ceph-mon[99370]: pgmap v772: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:30.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:29 smithi086 ceph-mon[71303]: pgmap v772: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.899+0000 7fa049937640 1 -- 172.21.15.17:0/3881711150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa044100750 msgr2=0x7fa0441047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.899+0000 7fa049937640 1 --2- 172.21.15.17:0/3881711150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa044100750 0x7fa0441047a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa02c009880 tx=0x7fa02c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:24:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.899+0000 7fa049937640 1 -- 172.21.15.17:0/3881711150 shutdown_connections 2024-08-19T01:24:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.899+0000 7fa049937640 1 --2- 172.21.15.17:0/3881711150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa044100750 0x7fa0441047a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.899+0000 7fa049937640 1 --2- 172.21.15.17:0/3881711150 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa0440ffda0 0x7fa044100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.899+0000 7fa049937640 1 -- 172.21.15.17:0/3881711150 >> 172.21.15.17:0/3881711150 conn(0x7fa0440fb840 msgr2=0x7fa0440fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.899+0000 7fa049937640 1 -- 172.21.15.17:0/3881711150 shutdown_connections 2024-08-19T01:24:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.900+0000 7fa049937640 1 -- 172.21.15.17:0/3881711150 wait complete. 2024-08-19T01:24:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.900+0000 7fa049937640 1 Processor -- start 2024-08-19T01:24:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.900+0000 7fa049937640 1 -- start start 2024-08-19T01:24:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.901+0000 7fa049937640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0440ffda0 0x7fa04419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.901+0000 7fa049937640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044100750 0x7fa04419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.901+0000 7fa049937640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04419c380 con 0x7fa0440ffda0 2024-08-19T01:24:30.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.901+0000 7fa049937640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa044195910 con 0x7fa044100750 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.901+0000 7fa042ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0440ffda0 0x7fa04419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.901+0000 7fa042ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0440ffda0 0x7fa04419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46984/0 (socket says 172.21.15.17:46984) 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.901+0000 7fa042ffd640 1 -- 172.21.15.17:0/1926264890 learned_addr learned my addr 172.21.15.17:0/1926264890 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.901+0000 7fa03a7fc640 1 --2- 172.21.15.17:0/1926264890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044100750 0x7fa04419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.901+0000 7fa042ffd640 1 -- 172.21.15.17:0/1926264890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044100750 msgr2=0x7fa04419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.901+0000 7fa042ffd640 1 --2- 172.21.15.17:0/1926264890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044100750 0x7fa04419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.901+0000 7fa042ffd640 1 -- 172.21.15.17:0/1926264890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa02c009560 con 0x7fa0440ffda0 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.902+0000 7fa042ffd640 1 --2- 172.21.15.17:0/1926264890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0440ffda0 0x7fa04419b820 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa03400d8d0 tx=0x7fa03400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.902+0000 7fa048935640 1 -- 172.21.15.17:0/1926264890 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa03400bea0 con 0x7fa0440ffda0 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.902+0000 7fa048935640 1 -- 172.21.15.17:0/1926264890 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa034009c00 con 0x7fa0440ffda0 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.902+0000 7fa049937640 1 -- 172.21.15.17:0/1926264890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa044195bf0 con 0x7fa0440ffda0 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.902+0000 7fa048935640 1 -- 172.21.15.17:0/1926264890 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa03400f710 con 0x7fa0440ffda0 2024-08-19T01:24:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.902+0000 7fa049937640 1 -- 172.21.15.17:0/1926264890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa044196110 con 0x7fa0440ffda0 2024-08-19T01:24:30.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.903+0000 7fa049937640 1 -- 172.21.15.17:0/1926264890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa044101280 con 0x7fa0440ffda0 2024-08-19T01:24:30.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.903+0000 7fa048935640 1 -- 172.21.15.17:0/1926264890 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa034010460 con 0x7fa0440ffda0 2024-08-19T01:24:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.904+0000 7fa048935640 1 --2- 172.21.15.17:0/1926264890 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa03006e170 0x7fa030070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.904+0000 7fa048935640 1 -- 172.21.15.17:0/1926264890 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa03408df80 con 0x7fa0440ffda0 2024-08-19T01:24:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.904+0000 7fa03a7fc640 1 --2- 172.21.15.17:0/1926264890 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa03006e170 0x7fa030070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:30.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.905+0000 7fa03a7fc640 1 --2- 172.21.15.17:0/1926264890 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa03006e170 0x7fa030070630 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa02c000c00 tx=0x7fa02c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:30.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:30.908+0000 7fa048935640 1 -- 172.21.15.17:0/1926264890 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa034057260 con 0x7fa0440ffda0 2024-08-19T01:24:31.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.101+0000 7fa049937640 1 -- 172.21.15.17:0/1926264890 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa04410cdb0 con 0x7fa03006e170 2024-08-19T01:24:31.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.102+0000 7fa048935640 1 -- 172.21.15.17:0/1926264890 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa04410cdb0 con 0x7fa03006e170 2024-08-19T01:24:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.104+0000 7fa049937640 1 -- 172.21.15.17:0/1926264890 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa03006e170 msgr2=0x7fa030070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.104+0000 7fa049937640 1 --2- 172.21.15.17:0/1926264890 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa03006e170 0x7fa030070630 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa02c000c00 tx=0x7fa02c005a20 comp rx=0 tx=0).stop 2024-08-19T01:24:31.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.104+0000 7fa049937640 1 -- 172.21.15.17:0/1926264890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0440ffda0 msgr2=0x7fa04419b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.104+0000 7fa049937640 1 --2- 172.21.15.17:0/1926264890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0440ffda0 0x7fa04419b820 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa03400d8d0 tx=0x7fa03400dd90 comp rx=0 tx=0).stop 2024-08-19T01:24:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.104+0000 7fa049937640 1 -- 172.21.15.17:0/1926264890 shutdown_connections 2024-08-19T01:24:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.104+0000 7fa049937640 1 --2- 172.21.15.17:0/1926264890 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa03006e170 0x7fa030070630 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.104+0000 7fa049937640 1 --2- 172.21.15.17:0/1926264890 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa044100750 0x7fa04419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.104+0000 7fa049937640 1 --2- 172.21.15.17:0/1926264890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0440ffda0 0x7fa04419b820 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.104+0000 7fa049937640 1 -- 172.21.15.17:0/1926264890 >> 172.21.15.17:0/1926264890 conn(0x7fa0440fb840 msgr2=0x7fa0440fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.104+0000 7fa049937640 1 -- 172.21.15.17:0/1926264890 shutdown_connections 2024-08-19T01:24:31.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.104+0000 7fa049937640 1 -- 172.21.15.17:0/1926264890 wait complete. 2024-08-19T01:24:31.115 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:24:31.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.188+0000 7f9aae5de640 1 -- 172.21.15.17:0/2550761358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa81049f0 msgr2=0x7f9aa8104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.188+0000 7f9aae5de640 1 --2- 172.21.15.17:0/2550761358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa81049f0 0x7f9aa8104dd0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009880 tx=0x7f9a9802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.188+0000 7f9aae5de640 1 -- 172.21.15.17:0/2550761358 shutdown_connections 2024-08-19T01:24:31.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.188+0000 7f9aae5de640 1 --2- 172.21.15.17:0/2550761358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa80fe9f0 0x7f9aa80fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.188+0000 7f9aae5de640 1 --2- 172.21.15.17:0/2550761358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa81049f0 0x7f9aa8104dd0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.188+0000 7f9aae5de640 1 -- 172.21.15.17:0/2550761358 >> 172.21.15.17:0/2550761358 conn(0x7f9aa80758a0 msgr2=0x7f9aa80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.189+0000 7f9aae5de640 1 -- 172.21.15.17:0/2550761358 shutdown_connections 2024-08-19T01:24:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.189+0000 7f9aae5de640 1 -- 172.21.15.17:0/2550761358 wait complete. 2024-08-19T01:24:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.189+0000 7f9aae5de640 1 Processor -- start 2024-08-19T01:24:31.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.189+0000 7f9aae5de640 1 -- start start 2024-08-19T01:24:31.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aae5de640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa80fe9f0 0x7f9aa8196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:31.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aae5de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa81049f0 0x7f9aa8196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:31.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aae5de640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8197490 con 0x7f9aa81049f0 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aae5de640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8197600 con 0x7f9aa80fe9f0 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aa77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa81049f0 0x7f9aa8196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aa77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa81049f0 0x7f9aa8196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47002/0 (socket says 172.21.15.17:47002) 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aa77fe640 1 -- 172.21.15.17:0/3146049036 learned_addr learned my addr 172.21.15.17:0/3146049036 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aa7fff640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa80fe9f0 0x7f9aa8196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aa77fe640 1 -- 172.21.15.17:0/3146049036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa80fe9f0 msgr2=0x7f9aa8196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aa77fe640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa80fe9f0 0x7f9aa8196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aa77fe640 1 -- 172.21.15.17:0/3146049036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98009560 con 0x7f9aa81049f0 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aa7fff640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa80fe9f0 0x7f9aa8196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aa77fe640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa81049f0 0x7f9aa8196ec0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00e970 tx=0x7f9a9c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aa57fa640 1 -- 172.21.15.17:0/3146049036 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a9c00cc90 con 0x7f9aa81049f0 2024-08-19T01:24:31.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aae5de640 1 -- 172.21.15.17:0/3146049036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa819f9f0 con 0x7f9aa81049f0 2024-08-19T01:24:31.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.190+0000 7f9aa57fa640 1 -- 172.21.15.17:0/3146049036 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a9c00cdf0 con 0x7f9aa81049f0 2024-08-19T01:24:31.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.191+0000 7f9aa57fa640 1 -- 172.21.15.17:0/3146049036 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a9c010430 con 0x7f9aa81049f0 2024-08-19T01:24:31.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.191+0000 7f9aae5de640 1 -- 172.21.15.17:0/3146049036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa819fe60 con 0x7f9aa81049f0 2024-08-19T01:24:31.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.192+0000 7f9aae5de640 1 -- 172.21.15.17:0/3146049036 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa8100130 con 0x7f9aa81049f0 2024-08-19T01:24:31.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.192+0000 7f9aa57fa640 1 -- 172.21.15.17:0/3146049036 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9a9c0046c0 con 0x7f9aa81049f0 2024-08-19T01:24:31.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.193+0000 7f9aa57fa640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a9006e170 0x7f9a90070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:31.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.193+0000 7f9aa7fff640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a9006e170 0x7f9a90070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:31.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.193+0000 7f9aa57fa640 1 -- 172.21.15.17:0/3146049036 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9a9c014070 con 0x7f9aa81049f0 2024-08-19T01:24:31.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.193+0000 7f9aa7fff640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a9006e170 0x7f9a90070630 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9a98006010 tx=0x7f9a98005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:31.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.197+0000 7f9aa57fa640 1 -- 172.21.15.17:0/3146049036 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9a9c057a50 con 0x7f9aa81049f0 2024-08-19T01:24:31.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.390+0000 7f9aae5de640 1 -- 172.21.15.17:0/3146049036 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9aa810bc80 con 0x7f9a9006e170 2024-08-19T01:24:31.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.392+0000 7f9aa57fa640 1 -- 172.21.15.17:0/3146049036 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f9aa810bc80 con 0x7f9a9006e170 2024-08-19T01:24:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.394+0000 7f9aae5de640 1 -- 172.21.15.17:0/3146049036 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a9006e170 msgr2=0x7f9a90070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.394+0000 7f9aae5de640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a9006e170 0x7f9a90070630 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9a98006010 tx=0x7f9a98005e60 comp rx=0 tx=0).stop 2024-08-19T01:24:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.394+0000 7f9aae5de640 1 -- 172.21.15.17:0/3146049036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa81049f0 msgr2=0x7f9aa8196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.394+0000 7f9aae5de640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa81049f0 0x7f9aa8196ec0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00e970 tx=0x7f9a9c00ed70 comp rx=0 tx=0).stop 2024-08-19T01:24:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.394+0000 7f9aae5de640 1 -- 172.21.15.17:0/3146049036 shutdown_connections 2024-08-19T01:24:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.394+0000 7f9aae5de640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9a9006e170 0x7f9a90070630 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.394+0000 7f9aae5de640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9aa81049f0 0x7f9aa8196ec0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.394+0000 7f9aae5de640 1 --2- 172.21.15.17:0/3146049036 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9aa80fe9f0 0x7f9aa8196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.394+0000 7f9aae5de640 1 -- 172.21.15.17:0/3146049036 >> 172.21.15.17:0/3146049036 conn(0x7f9aa80758a0 msgr2=0x7f9aa80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.394+0000 7f9aae5de640 1 -- 172.21.15.17:0/3146049036 shutdown_connections 2024-08-19T01:24:31.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.394+0000 7f9aae5de640 1 -- 172.21.15.17:0/3146049036 wait complete. 2024-08-19T01:24:31.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.476+0000 7f386ae0f640 1 -- 172.21.15.17:0/3102419327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38640ffda0 msgr2=0x7f3864100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.476+0000 7f386ae0f640 1 --2- 172.21.15.17:0/3102419327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38640ffda0 0x7f3864100180 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3858009880 tx=0x7f385802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.476+0000 7f386ae0f640 1 -- 172.21.15.17:0/3102419327 shutdown_connections 2024-08-19T01:24:31.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.476+0000 7f386ae0f640 1 --2- 172.21.15.17:0/3102419327 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3864100750 0x7f38641047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.476+0000 7f386ae0f640 1 --2- 172.21.15.17:0/3102419327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38640ffda0 0x7f3864100180 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.476+0000 7f386ae0f640 1 -- 172.21.15.17:0/3102419327 >> 172.21.15.17:0/3102419327 conn(0x7f38640fb840 msgr2=0x7f38640fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:31.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.476+0000 7f386ae0f640 1 -- 172.21.15.17:0/3102419327 shutdown_connections 2024-08-19T01:24:31.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.476+0000 7f386ae0f640 1 -- 172.21.15.17:0/3102419327 wait complete. 2024-08-19T01:24:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f386ae0f640 1 Processor -- start 2024-08-19T01:24:31.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f386ae0f640 1 -- start start 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f386ae0f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38640ffda0 0x7f38640727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f386ae0f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3864100750 0x7f3864072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f386ae0f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3864073230 con 0x7f3864100750 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f386ae0f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3864073370 con 0x7f38640ffda0 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f3863fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3864100750 0x7f3864072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f3863fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3864100750 0x7f3864072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47018/0 (socket says 172.21.15.17:47018) 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f3863fff640 1 -- 172.21.15.17:0/2350784386 learned_addr learned my addr 172.21.15.17:0/2350784386 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f3868bab640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38640ffda0 0x7f38640727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f3863fff640 1 -- 172.21.15.17:0/2350784386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38640ffda0 msgr2=0x7f38640727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f3863fff640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38640ffda0 0x7f38640727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f3863fff640 1 -- 172.21.15.17:0/2350784386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858009560 con 0x7f3864100750 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.477+0000 7f3868bab640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38640ffda0 0x7f38640727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.478+0000 7f3863fff640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3864100750 0x7f3864072cf0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f385000d6f0 tx=0x7f385000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:31.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.478+0000 7f3861ffb640 1 -- 172.21.15.17:0/2350784386 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3850009a30 con 0x7f3864100750 2024-08-19T01:24:31.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.478+0000 7f3861ffb640 1 -- 172.21.15.17:0/2350784386 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38500054e0 con 0x7f3864100750 2024-08-19T01:24:31.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.478+0000 7f386ae0f640 1 -- 172.21.15.17:0/2350784386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38641a1db0 con 0x7f3864100750 2024-08-19T01:24:31.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.478+0000 7f3861ffb640 1 -- 172.21.15.17:0/2350784386 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3850010460 con 0x7f3864100750 2024-08-19T01:24:31.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.478+0000 7f386ae0f640 1 -- 172.21.15.17:0/2350784386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38641a21c0 con 0x7f3864100750 2024-08-19T01:24:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.479+0000 7f386ae0f640 1 -- 172.21.15.17:0/2350784386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3864101280 con 0x7f3864100750 2024-08-19T01:24:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.479+0000 7f3861ffb640 1 -- 172.21.15.17:0/2350784386 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3850009b90 con 0x7f3864100750 2024-08-19T01:24:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.480+0000 7f3861ffb640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f385406e170 0x7f3854070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.480+0000 7f3861ffb640 1 -- 172.21.15.17:0/2350784386 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f385008dc50 con 0x7f3864100750 2024-08-19T01:24:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.480+0000 7f3868bab640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f385406e170 0x7f3854070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:31.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.481+0000 7f3868bab640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f385406e170 0x7f3854070630 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3858000c00 tx=0x7f3858005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:31.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.486+0000 7f3861ffb640 1 -- 172.21.15.17:0/2350784386 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3850056fb0 con 0x7f3864100750 2024-08-19T01:24:31.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.668+0000 7f386ae0f640 1 -- 172.21.15.17:0/2350784386 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f386410cdd0 con 0x7f385406e170 2024-08-19T01:24:31.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.677+0000 7f3861ffb640 1 -- 172.21.15.17:0/2350784386 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f386410cdd0 con 0x7f385406e170 2024-08-19T01:24:31.679 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (25m) 4m ago 36m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (36m) 4m ago 36m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (35m) 4m ago 35m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (23m) 4m ago 36m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (23m) 4m ago 35m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (25m) 4m ago 36m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (19m) 4m ago 30m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (20m) 4m ago 31m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (4m) 4m ago 30m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (19m) 4m ago 31m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (27m) 4m ago 37m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (26m) 4m ago 35m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (24m) 4m ago 38m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (24m) 4m ago 35m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:24:31.680 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (26m) 4m ago 36m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:24:31.681 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (26m) 4m ago 35m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:24:31.681 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (23m) 4m ago 34m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:24:31.681 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (22m) 4m ago 34m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:24:31.681 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (22m) 4m ago 33m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:24:31.681 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (21m) 4m ago 33m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:24:31.681 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (20m) 4m ago 32m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:24:31.681 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (20m) 4m ago 32m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:24:31.681 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (26m) 4m ago 36m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:24:31.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.679+0000 7f386ae0f640 1 -- 172.21.15.17:0/2350784386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f385406e170 msgr2=0x7f3854070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.679+0000 7f386ae0f640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f385406e170 0x7f3854070630 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3858000c00 tx=0x7f3858005a20 comp rx=0 tx=0).stop 2024-08-19T01:24:31.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.679+0000 7f386ae0f640 1 -- 172.21.15.17:0/2350784386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3864100750 msgr2=0x7f3864072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.679+0000 7f386ae0f640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3864100750 0x7f3864072cf0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f385000d6f0 tx=0x7f385000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.679+0000 7f386ae0f640 1 -- 172.21.15.17:0/2350784386 shutdown_connections 2024-08-19T01:24:31.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.679+0000 7f386ae0f640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f385406e170 0x7f3854070630 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.679+0000 7f386ae0f640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3864100750 0x7f3864072cf0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.679+0000 7f386ae0f640 1 --2- 172.21.15.17:0/2350784386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f38640ffda0 0x7f38640727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.679+0000 7f386ae0f640 1 -- 172.21.15.17:0/2350784386 >> 172.21.15.17:0/2350784386 conn(0x7f38640fb840 msgr2=0x7f38640fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:31.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.680+0000 7f386ae0f640 1 -- 172.21.15.17:0/2350784386 shutdown_connections 2024-08-19T01:24:31.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.680+0000 7f386ae0f640 1 -- 172.21.15.17:0/2350784386 wait complete. 2024-08-19T01:24:31.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.760+0000 7fa3a6bad640 1 -- 172.21.15.17:0/2764434746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a01015d0 msgr2=0x7fa3a0109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.760+0000 7fa3a6bad640 1 --2- 172.21.15.17:0/2764434746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a01015d0 0x7fa3a0109ac0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa388009c20 tx=0x7fa38802aa00 comp rx=0 tx=0).stop 2024-08-19T01:24:31.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.760+0000 7fa3a6bad640 1 -- 172.21.15.17:0/2764434746 shutdown_connections 2024-08-19T01:24:31.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.760+0000 7fa3a6bad640 1 --2- 172.21.15.17:0/2764434746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a01015d0 0x7fa3a0109ac0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.760+0000 7fa3a6bad640 1 --2- 172.21.15.17:0/2764434746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3a0100cb0 0x7fa3a0101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.760+0000 7fa3a6bad640 1 -- 172.21.15.17:0/2764434746 >> 172.21.15.17:0/2764434746 conn(0x7fa3a00758a0 msgr2=0x7fa3a00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:31.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.761+0000 7fa3a6bad640 1 -- 172.21.15.17:0/2764434746 shutdown_connections 2024-08-19T01:24:31.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.761+0000 7fa3a6bad640 1 -- 172.21.15.17:0/2764434746 wait complete. 2024-08-19T01:24:31.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.761+0000 7fa3a6bad640 1 Processor -- start 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.761+0000 7fa3a6bad640 1 -- start start 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.761+0000 7fa3a6bad640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3a0100cb0 0x7fa3a00fe910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.761+0000 7fa3a6bad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a01015d0 0x7fa3a00fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.761+0000 7fa3a6bad640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00ff390 con 0x7fa3a01015d0 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.761+0000 7fa3a6bad640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00ff500 con 0x7fa3a0100cb0 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa39ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a01015d0 0x7fa3a00fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa39ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a01015d0 0x7fa3a00fee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47026/0 (socket says 172.21.15.17:47026) 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa39ffff640 1 -- 172.21.15.17:0/3493561412 learned_addr learned my addr 172.21.15.17:0/3493561412 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa3a4949640 1 --2- 172.21.15.17:0/3493561412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3a0100cb0 0x7fa3a00fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa39ffff640 1 -- 172.21.15.17:0/3493561412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3a0100cb0 msgr2=0x7fa3a00fe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa39ffff640 1 --2- 172.21.15.17:0/3493561412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3a0100cb0 0x7fa3a00fe910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa39ffff640 1 -- 172.21.15.17:0/3493561412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa388009900 con 0x7fa3a01015d0 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa39ffff640 1 --2- 172.21.15.17:0/3493561412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a01015d0 0x7fa3a00fee50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa388006010 tx=0x7fa38802f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:31.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa39dffb640 1 -- 172.21.15.17:0/3493561412 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa38803e070 con 0x7fa3a01015d0 2024-08-19T01:24:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa39dffb640 1 -- 172.21.15.17:0/3493561412 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa38802e870 con 0x7fa3a01015d0 2024-08-19T01:24:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa3a6bad640 1 -- 172.21.15.17:0/3493561412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a00ff780 con 0x7fa3a01015d0 2024-08-19T01:24:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.762+0000 7fa39dffb640 1 -- 172.21.15.17:0/3493561412 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3880046c0 con 0x7fa3a01015d0 2024-08-19T01:24:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.763+0000 7fa3a6bad640 1 -- 172.21.15.17:0/3493561412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a01a1f40 con 0x7fa3a01015d0 2024-08-19T01:24:31.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.764+0000 7fa3a6bad640 1 -- 172.21.15.17:0/3493561412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a0068510 con 0x7fa3a01015d0 2024-08-19T01:24:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.764+0000 7fa39dffb640 1 -- 172.21.15.17:0/3493561412 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa38800a040 con 0x7fa3a01015d0 2024-08-19T01:24:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.764+0000 7fa39dffb640 1 --2- 172.21.15.17:0/3493561412 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa38c06e180 0x7fa38c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.765+0000 7fa39dffb640 1 -- 172.21.15.17:0/3493561412 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa3880af1a0 con 0x7fa3a01015d0 2024-08-19T01:24:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.765+0000 7fa3a4949640 1 --2- 172.21.15.17:0/3493561412 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa38c06e180 0x7fa38c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:31.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.765+0000 7fa3a4949640 1 --2- 172.21.15.17:0/3493561412 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa38c06e180 0x7fa38c070640 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa398005fd0 tx=0x7fa39800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:31.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:31.769+0000 7fa39dffb640 1 -- 172.21.15.17:0/3493561412 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa388078530 con 0x7fa3a01015d0 2024-08-19T01:24:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.014+0000 7fa3a6bad640 1 -- 172.21.15.17:0/3493561412 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa3a00ff780 con 0x7fa3a01015d0 2024-08-19T01:24:32.017 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:31 smithi017 ceph-mon[99370]: pgmap v773: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:32.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.015+0000 7fa39dffb640 1 -- 172.21.15.17:0/3493561412 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fa3a00ff780 con 0x7fa3a01015d0 2024-08-19T01:24:32.017 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:24:32.017 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:24:32.017 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:24:32.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:24:32.017 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:24:32.018 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:24:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.017+0000 7fa3a6bad640 1 -- 172.21.15.17:0/3493561412 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa38c06e180 msgr2=0x7fa38c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.017+0000 7fa3a6bad640 1 --2- 172.21.15.17:0/3493561412 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa38c06e180 0x7fa38c070640 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa398005fd0 tx=0x7fa39800b390 comp rx=0 tx=0).stop 2024-08-19T01:24:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.017+0000 7fa3a6bad640 1 -- 172.21.15.17:0/3493561412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a01015d0 msgr2=0x7fa3a00fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.017+0000 7fa3a6bad640 1 --2- 172.21.15.17:0/3493561412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a01015d0 0x7fa3a00fee50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa388006010 tx=0x7fa38802f890 comp rx=0 tx=0).stop 2024-08-19T01:24:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.017+0000 7fa3a6bad640 1 -- 172.21.15.17:0/3493561412 shutdown_connections 2024-08-19T01:24:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.017+0000 7fa3a6bad640 1 --2- 172.21.15.17:0/3493561412 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa38c06e180 0x7fa38c070640 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.017+0000 7fa3a6bad640 1 --2- 172.21.15.17:0/3493561412 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3a01015d0 0x7fa3a00fee50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.017+0000 7fa3a6bad640 1 --2- 172.21.15.17:0/3493561412 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3a0100cb0 0x7fa3a00fe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.017+0000 7fa3a6bad640 1 -- 172.21.15.17:0/3493561412 >> 172.21.15.17:0/3493561412 conn(0x7fa3a00758a0 msgr2=0x7fa3a0101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.017+0000 7fa3a6bad640 1 -- 172.21.15.17:0/3493561412 shutdown_connections 2024-08-19T01:24:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.017+0000 7fa3a6bad640 1 -- 172.21.15.17:0/3493561412 wait complete. 2024-08-19T01:24:32.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.098+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/4272787991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc58100750 msgr2=0x7fdc581047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.098+0000 7fdc5ebb9640 1 --2- 172.21.15.17:0/4272787991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc58100750 0x7fdc581047a0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fdc40009880 tx=0x7fdc4002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.098+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/4272787991 shutdown_connections 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.098+0000 7fdc5ebb9640 1 --2- 172.21.15.17:0/4272787991 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc58100750 0x7fdc581047a0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.098+0000 7fdc5ebb9640 1 --2- 172.21.15.17:0/4272787991 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc580ffda0 0x7fdc58100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.098+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/4272787991 >> 172.21.15.17:0/4272787991 conn(0x7fdc580fb840 msgr2=0x7fdc580fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.098+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/4272787991 shutdown_connections 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.098+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/4272787991 wait complete. 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.099+0000 7fdc5ebb9640 1 Processor -- start 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.099+0000 7fdc5ebb9640 1 -- start start 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.099+0000 7fdc5ebb9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc580ffda0 0x7fdc58197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.099+0000 7fdc5ebb9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc58100750 0x7fdc581982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.099+0000 7fdc5ebb9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc58198940 con 0x7fdc580ffda0 2024-08-19T01:24:32.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.099+0000 7fdc5ebb9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5819c6b0 con 0x7fdc58100750 2024-08-19T01:24:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.099+0000 7fdc5c955640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc580ffda0 0x7fdc58197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.099+0000 7fdc5c955640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc580ffda0 0x7fdc58197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47034/0 (socket says 172.21.15.17:47034) 2024-08-19T01:24:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.099+0000 7fdc5c955640 1 -- 172.21.15.17:0/3266190735 learned_addr learned my addr 172.21.15.17:0/3266190735 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:24:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.099+0000 7fdc57fff640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc58100750 0x7fdc581982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.100+0000 7fdc5c955640 1 -- 172.21.15.17:0/3266190735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc58100750 msgr2=0x7fdc581982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.100+0000 7fdc5c955640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc58100750 0x7fdc581982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.100+0000 7fdc5c955640 1 -- 172.21.15.17:0/3266190735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc40009560 con 0x7fdc580ffda0 2024-08-19T01:24:32.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.100+0000 7fdc57fff640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc58100750 0x7fdc581982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:24:32.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.100+0000 7fdc5c955640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc580ffda0 0x7fdc58197d70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800ea00 tx=0x7fdc4800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:32.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.100+0000 7fdc55ffb640 1 -- 172.21.15.17:0/3266190735 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc4800cd50 con 0x7fdc580ffda0 2024-08-19T01:24:32.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.100+0000 7fdc55ffb640 1 -- 172.21.15.17:0/3266190735 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc48005020 con 0x7fdc580ffda0 2024-08-19T01:24:32.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.100+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/3266190735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5819c990 con 0x7fdc580ffda0 2024-08-19T01:24:32.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.100+0000 7fdc55ffb640 1 -- 172.21.15.17:0/3266190735 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc480116a0 con 0x7fdc580ffda0 2024-08-19T01:24:32.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.100+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/3266190735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5819ceb0 con 0x7fdc580ffda0 2024-08-19T01:24:32.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.101+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/3266190735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc58101280 con 0x7fdc580ffda0 2024-08-19T01:24:32.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.102+0000 7fdc55ffb640 1 -- 172.21.15.17:0/3266190735 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdc48005190 con 0x7fdc580ffda0 2024-08-19T01:24:32.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.102+0000 7fdc55ffb640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc4406e170 0x7fdc44070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:32.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.102+0000 7fdc55ffb640 1 -- 172.21.15.17:0/3266190735 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdc4808e550 con 0x7fdc580ffda0 2024-08-19T01:24:32.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.102+0000 7fdc57fff640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc4406e170 0x7fdc44070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:32.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.103+0000 7fdc57fff640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc4406e170 0x7fdc44070630 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdc40000c00 tx=0x7fdc40005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:32.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.107+0000 7fdc55ffb640 1 -- 172.21.15.17:0/3266190735 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdc48057830 con 0x7fdc580ffda0 2024-08-19T01:24:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:31 smithi086 ceph-mon[71303]: pgmap v773: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:32.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.325+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/3266190735 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdc58100180 con 0x7fdc580ffda0 2024-08-19T01:24:32.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.325+0000 7fdc55ffb640 1 -- 172.21.15.17:0/3266190735 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7fdc4801f790 con 0x7fdc580ffda0 2024-08-19T01:24:32.327 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:24:32.328 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:24:32.329 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:24:32.330 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:24:32.331 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:24:32.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.328+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/3266190735 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc4406e170 msgr2=0x7fdc44070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.328+0000 7fdc5ebb9640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc4406e170 0x7fdc44070630 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdc40000c00 tx=0x7fdc40005a20 comp rx=0 tx=0).stop 2024-08-19T01:24:32.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.328+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/3266190735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc580ffda0 msgr2=0x7fdc58197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.328+0000 7fdc5ebb9640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc580ffda0 0x7fdc58197d70 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800ea00 tx=0x7fdc4800eec0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.328+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/3266190735 shutdown_connections 2024-08-19T01:24:32.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.328+0000 7fdc5ebb9640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc4406e170 0x7fdc44070630 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.328+0000 7fdc5ebb9640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc58100750 0x7fdc581982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.328+0000 7fdc5ebb9640 1 --2- 172.21.15.17:0/3266190735 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc580ffda0 0x7fdc58197d70 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.328+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/3266190735 >> 172.21.15.17:0/3266190735 conn(0x7fdc580fb840 msgr2=0x7fdc580fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:32.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.328+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/3266190735 shutdown_connections 2024-08-19T01:24:32.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.329+0000 7fdc5ebb9640 1 -- 172.21.15.17:0/3266190735 wait complete. 2024-08-19T01:24:32.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.411+0000 7fa6d2aae640 1 -- 172.21.15.17:0/1758181084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6cc0fe9f0 msgr2=0x7fa6cc0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.411+0000 7fa6d2aae640 1 --2- 172.21.15.17:0/1758181084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6cc0fe9f0 0x7fa6cc0fee50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009880 tx=0x7fa6b802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 -- 172.21.15.17:0/1758181084 shutdown_connections 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 --2- 172.21.15.17:0/1758181084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6cc0fe9f0 0x7fa6cc0fee50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 --2- 172.21.15.17:0/1758181084 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6cc1049f0 0x7fa6cc104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 -- 172.21.15.17:0/1758181084 >> 172.21.15.17:0/1758181084 conn(0x7fa6cc0758a0 msgr2=0x7fa6cc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 -- 172.21.15.17:0/1758181084 shutdown_connections 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 -- 172.21.15.17:0/1758181084 wait complete. 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 Processor -- start 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 -- start start 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6cc0fe9f0 0x7fa6cc197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6cc1049f0 0x7fa6cc198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc1988e0 con 0x7fa6cc1049f0 2024-08-19T01:24:32.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.412+0000 7fa6d2aae640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc19c650 con 0x7fa6cc0fe9f0 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6cc1049f0 0x7fa6cc198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6cbfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6cc1049f0 0x7fa6cc198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47054/0 (socket says 172.21.15.17:47054) 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6cbfff640 1 -- 172.21.15.17:0/2547381209 learned_addr learned my addr 172.21.15.17:0/2547381209 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6d084a640 1 --2- 172.21.15.17:0/2547381209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6cc0fe9f0 0x7fa6cc197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6cbfff640 1 -- 172.21.15.17:0/2547381209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6cc0fe9f0 msgr2=0x7fa6cc197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6cbfff640 1 --2- 172.21.15.17:0/2547381209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6cc0fe9f0 0x7fa6cc197d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6cbfff640 1 -- 172.21.15.17:0/2547381209 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b8009560 con 0x7fa6cc1049f0 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6cbfff640 1 --2- 172.21.15.17:0/2547381209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6cc1049f0 0x7fa6cc198250 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa6b802a9c0 tx=0x7fa6b80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6c9ffb640 1 -- 172.21.15.17:0/2547381209 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6b8004aa0 con 0x7fa6cc1049f0 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6d2aae640 1 -- 172.21.15.17:0/2547381209 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc19c8d0 con 0x7fa6cc1049f0 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6c9ffb640 1 -- 172.21.15.17:0/2547381209 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6b8004c00 con 0x7fa6cc1049f0 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.413+0000 7fa6c9ffb640 1 -- 172.21.15.17:0/2547381209 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6b8003980 con 0x7fa6cc1049f0 2024-08-19T01:24:32.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.414+0000 7fa6d2aae640 1 -- 172.21.15.17:0/2547381209 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc19cdc0 con 0x7fa6cc1049f0 2024-08-19T01:24:32.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.414+0000 7fa6d2aae640 1 -- 172.21.15.17:0/2547381209 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc100130 con 0x7fa6cc1049f0 2024-08-19T01:24:32.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.415+0000 7fa6c9ffb640 1 -- 172.21.15.17:0/2547381209 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa6b8003bf0 con 0x7fa6cc1049f0 2024-08-19T01:24:32.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.416+0000 7fa6c9ffb640 1 --2- 172.21.15.17:0/2547381209 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6bc06e170 0x7fa6bc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:32.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.416+0000 7fa6d084a640 1 --2- 172.21.15.17:0/2547381209 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6bc06e170 0x7fa6bc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:32.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.416+0000 7fa6c9ffb640 1 -- 172.21.15.17:0/2547381209 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa6b80af200 con 0x7fa6cc1049f0 2024-08-19T01:24:32.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.416+0000 7fa6d084a640 1 --2- 172.21.15.17:0/2547381209 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6bc06e170 0x7fa6bc070630 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0005fd0 tx=0x7fa6c000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:32.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.420+0000 7fa6c9ffb640 1 -- 172.21.15.17:0/2547381209 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa6b80784f0 con 0x7fa6cc1049f0 2024-08-19T01:24:32.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.612+0000 7fa6d2aae640 1 -- 172.21.15.17:0/2547381209 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6cc10bc80 con 0x7fa6bc06e170 2024-08-19T01:24:32.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.614+0000 7fa6c9ffb640 1 -- 172.21.15.17:0/2547381209 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa6cc10bc80 con 0x7fa6bc06e170 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:24:32.616 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:24:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:24:32.617 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:24:32.617 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:24:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.616+0000 7fa6d2aae640 1 -- 172.21.15.17:0/2547381209 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6bc06e170 msgr2=0x7fa6bc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.616+0000 7fa6d2aae640 1 --2- 172.21.15.17:0/2547381209 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6bc06e170 0x7fa6bc070630 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0005fd0 tx=0x7fa6c000b390 comp rx=0 tx=0).stop 2024-08-19T01:24:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.616+0000 7fa6d2aae640 1 -- 172.21.15.17:0/2547381209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6cc1049f0 msgr2=0x7fa6cc198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.616+0000 7fa6d2aae640 1 --2- 172.21.15.17:0/2547381209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6cc1049f0 0x7fa6cc198250 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa6b802a9c0 tx=0x7fa6b80055a0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.616+0000 7fa6d2aae640 1 -- 172.21.15.17:0/2547381209 shutdown_connections 2024-08-19T01:24:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.616+0000 7fa6d2aae640 1 --2- 172.21.15.17:0/2547381209 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6bc06e170 0x7fa6bc070630 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.616+0000 7fa6d2aae640 1 --2- 172.21.15.17:0/2547381209 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6cc1049f0 0x7fa6cc198250 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.616+0000 7fa6d2aae640 1 --2- 172.21.15.17:0/2547381209 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa6cc0fe9f0 0x7fa6cc197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.616+0000 7fa6d2aae640 1 -- 172.21.15.17:0/2547381209 >> 172.21.15.17:0/2547381209 conn(0x7fa6cc0758a0 msgr2=0x7fa6cc101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.616+0000 7fa6d2aae640 1 -- 172.21.15.17:0/2547381209 shutdown_connections 2024-08-19T01:24:32.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.616+0000 7fa6d2aae640 1 -- 172.21.15.17:0/2547381209 wait complete. 2024-08-19T01:24:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.699+0000 7fa95453e640 1 -- 172.21.15.17:0/1031452556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1049f0 msgr2=0x7fa94c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.699+0000 7fa95453e640 1 --2- 172.21.15.17:0/1031452556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1049f0 0x7fa94c104dd0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa948009880 tx=0x7fa94802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.699+0000 7fa95453e640 1 -- 172.21.15.17:0/1031452556 shutdown_connections 2024-08-19T01:24:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.699+0000 7fa95453e640 1 --2- 172.21.15.17:0/1031452556 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c0fe9f0 0x7fa94c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.699+0000 7fa95453e640 1 --2- 172.21.15.17:0/1031452556 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1049f0 0x7fa94c104dd0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.699+0000 7fa95453e640 1 -- 172.21.15.17:0/1031452556 >> 172.21.15.17:0/1031452556 conn(0x7fa94c0758a0 msgr2=0x7fa94c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.699+0000 7fa95453e640 1 -- 172.21.15.17:0/1031452556 shutdown_connections 2024-08-19T01:24:32.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.699+0000 7fa95453e640 1 -- 172.21.15.17:0/1031452556 wait complete. 2024-08-19T01:24:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.699+0000 7fa95453e640 1 Processor -- start 2024-08-19T01:24:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa95453e640 1 -- start start 2024-08-19T01:24:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa95453e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c0fe9f0 0x7fa94c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa95453e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1049f0 0x7fa94c19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa95453e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c195970 con 0x7fa94c1049f0 2024-08-19T01:24:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa95453e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c195ab0 con 0x7fa94c0fe9f0 2024-08-19T01:24:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa951ad9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1049f0 0x7fa94c19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:32.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa951ad9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1049f0 0x7fa94c19be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47062/0 (socket says 172.21.15.17:47062) 2024-08-19T01:24:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa951ad9640 1 -- 172.21.15.17:0/3374106388 learned_addr learned my addr 172.21.15.17:0/3374106388 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:24:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa9522da640 1 --2- 172.21.15.17:0/3374106388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c0fe9f0 0x7fa94c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa951ad9640 1 -- 172.21.15.17:0/3374106388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c0fe9f0 msgr2=0x7fa94c19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa951ad9640 1 --2- 172.21.15.17:0/3374106388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c0fe9f0 0x7fa94c19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa951ad9640 1 -- 172.21.15.17:0/3374106388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948009560 con 0x7fa94c1049f0 2024-08-19T01:24:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.700+0000 7fa951ad9640 1 --2- 172.21.15.17:0/3374106388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1049f0 0x7fa94c19be50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00d6f0 tx=0x7fa93c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.701+0000 7fa9437fe640 1 -- 172.21.15.17:0/3374106388 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa93c009a30 con 0x7fa94c1049f0 2024-08-19T01:24:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.701+0000 7fa9437fe640 1 -- 172.21.15.17:0/3374106388 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa93c0054e0 con 0x7fa94c1049f0 2024-08-19T01:24:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.701+0000 7fa95453e640 1 -- 172.21.15.17:0/3374106388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c195d90 con 0x7fa94c1049f0 2024-08-19T01:24:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.701+0000 7fa9437fe640 1 -- 172.21.15.17:0/3374106388 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa93c010460 con 0x7fa94c1049f0 2024-08-19T01:24:32.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.701+0000 7fa95453e640 1 -- 172.21.15.17:0/3374106388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c1962e0 con 0x7fa94c1049f0 2024-08-19T01:24:32.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.702+0000 7fa95453e640 1 -- 172.21.15.17:0/3374106388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c100130 con 0x7fa94c1049f0 2024-08-19T01:24:32.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.703+0000 7fa9437fe640 1 -- 172.21.15.17:0/3374106388 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa93c009b90 con 0x7fa94c1049f0 2024-08-19T01:24:32.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.703+0000 7fa9437fe640 1 --2- 172.21.15.17:0/3374106388 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93806e180 0x7fa938070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:24:32.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.703+0000 7fa9437fe640 1 -- 172.21.15.17:0/3374106388 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa93c08d8d0 con 0x7fa94c1049f0 2024-08-19T01:24:32.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.703+0000 7fa9522da640 1 --2- 172.21.15.17:0/3374106388 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93806e180 0x7fa938070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:24:32.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.704+0000 7fa9522da640 1 --2- 172.21.15.17:0/3374106388 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93806e180 0x7fa938070640 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa948000c00 tx=0x7fa948005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:24:32.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.709+0000 7fa9437fe640 1 -- 172.21.15.17:0/3374106388 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa93c056cd0 con 0x7fa94c1049f0 2024-08-19T01:24:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:32 smithi017 ceph-mon[99370]: from='client.35438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:32 smithi017 ceph-mon[99370]: from='client.35442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:32 smithi017 ceph-mon[99370]: from='client.35446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:32 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3493561412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:24:32.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:32 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3266190735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:24:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.955+0000 7fa95453e640 1 -- 172.21.15.17:0/3374106388 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa94c196610 con 0x7fa94c1049f0 2024-08-19T01:24:32.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.955+0000 7fa9437fe640 1 -- 172.21.15.17:0/3374106388 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7fa93c05a390 con 0x7fa94c1049f0 2024-08-19T01:24:32.957 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:24:32.957 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:24:32.957 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:24:32.957 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:24:32.958 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:24:32.959 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:24:32.959 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:24:32.959 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:24:32.959 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:24:32.959 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:24:32.959 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:24:32.959 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:24:32.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.958+0000 7fa95453e640 1 -- 172.21.15.17:0/3374106388 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93806e180 msgr2=0x7fa938070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.958+0000 7fa95453e640 1 --2- 172.21.15.17:0/3374106388 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93806e180 0x7fa938070640 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa948000c00 tx=0x7fa948005e30 comp rx=0 tx=0).stop 2024-08-19T01:24:32.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.958+0000 7fa95453e640 1 -- 172.21.15.17:0/3374106388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1049f0 msgr2=0x7fa94c19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:24:32.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.958+0000 7fa95453e640 1 --2- 172.21.15.17:0/3374106388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1049f0 0x7fa94c19be50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fa93c00d6f0 tx=0x7fa93c00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.958+0000 7fa95453e640 1 -- 172.21.15.17:0/3374106388 shutdown_connections 2024-08-19T01:24:32.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.958+0000 7fa95453e640 1 --2- 172.21.15.17:0/3374106388 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93806e180 0x7fa938070640 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.958+0000 7fa95453e640 1 --2- 172.21.15.17:0/3374106388 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c1049f0 0x7fa94c19be50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.958+0000 7fa95453e640 1 --2- 172.21.15.17:0/3374106388 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c0fe9f0 0x7fa94c19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:24:32.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.958+0000 7fa95453e640 1 -- 172.21.15.17:0/3374106388 >> 172.21.15.17:0/3374106388 conn(0x7fa94c0758a0 msgr2=0x7fa94c0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:24:32.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.958+0000 7fa95453e640 1 -- 172.21.15.17:0/3374106388 shutdown_connections 2024-08-19T01:24:32.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:24:32.958+0000 7fa95453e640 1 -- 172.21.15.17:0/3374106388 wait complete. 2024-08-19T01:24:33.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:32 smithi086 ceph-mon[71303]: from='client.35438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:33.199 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:32 smithi086 ceph-mon[71303]: from='client.35442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:33.199 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:32 smithi086 ceph-mon[71303]: from='client.35446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:33.199 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:32 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3493561412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:24:33.199 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:32 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3266190735' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:24:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:33 smithi017 ceph-mon[99370]: pgmap v774: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:33 smithi017 ceph-mon[99370]: from='client.35458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:24:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:33 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3374106388' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:24:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:33 smithi086 ceph-mon[71303]: pgmap v774: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:33 smithi086 ceph-mon[71303]: from='client.35458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:24:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:24:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:33 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3374106388' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:24:36.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:35 smithi017 ceph-mon[99370]: pgmap v775: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:36.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:35 smithi086 ceph-mon[71303]: pgmap v775: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:38.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:37 smithi017 ceph-mon[99370]: pgmap v776: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:38.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:37 smithi086 ceph-mon[71303]: pgmap v776: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:40.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:39 smithi017 ceph-mon[99370]: pgmap v777: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:40.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:39 smithi086 ceph-mon[71303]: pgmap v777: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:42.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:41 smithi017 ceph-mon[99370]: pgmap v778: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:42.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:41 smithi086 ceph-mon[71303]: pgmap v778: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:44.103 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:43 smithi086 ceph-mon[71303]: pgmap v779: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:44.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:43 smithi017 ceph-mon[99370]: pgmap v779: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:45 smithi017 ceph-mon[99370]: pgmap v780: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:45 smithi086 ceph-mon[71303]: pgmap v780: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:48.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:47 smithi017 ceph-mon[99370]: pgmap v781: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:48.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:47 smithi086 ceph-mon[71303]: pgmap v781: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:24:49.186 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:24:50.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:49 smithi017 ceph-mon[99370]: pgmap v782: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:50.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:49 smithi086 ceph-mon[71303]: pgmap v782: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:51 smithi017 ceph-mon[99370]: pgmap v783: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:52.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:51 smithi086 ceph-mon[71303]: pgmap v783: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:54.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:53 smithi017 ceph-mon[99370]: pgmap v784: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:53 smithi086 ceph-mon[71303]: pgmap v784: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:56.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:55 smithi017 ceph-mon[99370]: pgmap v785: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:56.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:55 smithi086 ceph-mon[71303]: pgmap v785: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:58.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:57 smithi017 ceph-mon[99370]: pgmap v786: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:24:58.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:57 smithi086 ceph-mon[71303]: pgmap v786: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:00.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:24:59 smithi017 ceph-mon[99370]: pgmap v787: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:00.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:24:59 smithi086 ceph-mon[71303]: pgmap v787: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:02.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:01 smithi017 ceph-mon[99370]: pgmap v788: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:02.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:01 smithi086 ceph-mon[71303]: pgmap v788: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.052+0000 7fddf6f1b640 1 -- 172.21.15.17:0/2898572263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0101690 msgr2=0x7fddf0109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.052+0000 7fddf6f1b640 1 --2- 172.21.15.17:0/2898572263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0101690 0x7fddf0109b80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009880 tx=0x7fdddc02a530 comp rx=0 tx=0).stop 2024-08-19T01:25:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.052+0000 7fddf6f1b640 1 -- 172.21.15.17:0/2898572263 shutdown_connections 2024-08-19T01:25:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.052+0000 7fddf6f1b640 1 --2- 172.21.15.17:0/2898572263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0101690 0x7fddf0109b80 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.052+0000 7fddf6f1b640 1 --2- 172.21.15.17:0/2898572263 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddf0100d70 0x7fddf0101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.052+0000 7fddf6f1b640 1 -- 172.21.15.17:0/2898572263 >> 172.21.15.17:0/2898572263 conn(0x7fddf00758a0 msgr2=0x7fddf00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.052+0000 7fddf6f1b640 1 -- 172.21.15.17:0/2898572263 shutdown_connections 2024-08-19T01:25:03.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.052+0000 7fddf6f1b640 1 -- 172.21.15.17:0/2898572263 wait complete. 2024-08-19T01:25:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.052+0000 7fddf6f1b640 1 Processor -- start 2024-08-19T01:25:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.052+0000 7fddf6f1b640 1 -- start start 2024-08-19T01:25:03.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddf6f1b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddf0100d70 0x7fddf00fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddf6f1b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0101690 0x7fddf00fef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddf6f1b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf00ff450 con 0x7fddf0101690 2024-08-19T01:25:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddf6f1b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf00ff5c0 con 0x7fddf0100d70 2024-08-19T01:25:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddeffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0101690 0x7fddf00fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddeffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0101690 0x7fddf00fef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41936/0 (socket says 172.21.15.17:41936) 2024-08-19T01:25:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddeffff640 1 -- 172.21.15.17:0/908139964 learned_addr learned my addr 172.21.15.17:0/908139964 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddf4cb7640 1 --2- 172.21.15.17:0/908139964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddf0100d70 0x7fddf00fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddeffff640 1 -- 172.21.15.17:0/908139964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddf0100d70 msgr2=0x7fddf00fe9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddeffff640 1 --2- 172.21.15.17:0/908139964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddf0100d70 0x7fddf00fe9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddeffff640 1 -- 172.21.15.17:0/908139964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc009560 con 0x7fddf0101690 2024-08-19T01:25:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.053+0000 7fddeffff640 1 --2- 172.21.15.17:0/908139964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0101690 0x7fddf00fef10 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdddc006010 tx=0x7fdddc032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.054+0000 7fddedffb640 1 -- 172.21.15.17:0/908139964 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdddc005220 con 0x7fddf0101690 2024-08-19T01:25:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.054+0000 7fddf6f1b640 1 -- 172.21.15.17:0/908139964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf00ff840 con 0x7fddf0101690 2024-08-19T01:25:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.054+0000 7fddedffb640 1 -- 172.21.15.17:0/908139964 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdddc005d50 con 0x7fddf0101690 2024-08-19T01:25:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.054+0000 7fddedffb640 1 -- 172.21.15.17:0/908139964 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdddc0038f0 con 0x7fddf0101690 2024-08-19T01:25:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.054+0000 7fddf6f1b640 1 -- 172.21.15.17:0/908139964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf01a1f20 con 0x7fddf0101690 2024-08-19T01:25:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.055+0000 7fddf6f1b640 1 -- 172.21.15.17:0/908139964 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf0068450 con 0x7fddf0101690 2024-08-19T01:25:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.055+0000 7fddedffb640 1 -- 172.21.15.17:0/908139964 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdddc02ad50 con 0x7fddf0101690 2024-08-19T01:25:03.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.056+0000 7fddedffb640 1 --2- 172.21.15.17:0/908139964 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdde006e180 0x7fdde0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.056+0000 7fddedffb640 1 -- 172.21.15.17:0/908139964 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdddc0ae870 con 0x7fddf0101690 2024-08-19T01:25:03.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.056+0000 7fddf4cb7640 1 --2- 172.21.15.17:0/908139964 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdde006e180 0x7fdde0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.057+0000 7fddf4cb7640 1 --2- 172.21.15.17:0/908139964 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdde006e180 0x7fdde0070640 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009bd0 tx=0x7fdde4005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.061+0000 7fddedffb640 1 -- 172.21.15.17:0/908139964 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdddc077c00 con 0x7fddf0101690 2024-08-19T01:25:03.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.262+0000 7fddf6f1b640 1 -- 172.21.15.17:0/908139964 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddf01044b0 con 0x7fdde006e180 2024-08-19T01:25:03.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.263+0000 7fddedffb640 1 -- 172.21.15.17:0/908139964 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fddf01044b0 con 0x7fdde006e180 2024-08-19T01:25:03.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.265+0000 7fddf6f1b640 1 -- 172.21.15.17:0/908139964 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdde006e180 msgr2=0x7fdde0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.265+0000 7fddf6f1b640 1 --2- 172.21.15.17:0/908139964 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdde006e180 0x7fdde0070640 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009bd0 tx=0x7fdde4005f90 comp rx=0 tx=0).stop 2024-08-19T01:25:03.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.265+0000 7fddf6f1b640 1 -- 172.21.15.17:0/908139964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0101690 msgr2=0x7fddf00fef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.265+0000 7fddf6f1b640 1 --2- 172.21.15.17:0/908139964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0101690 0x7fddf00fef10 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fdddc006010 tx=0x7fdddc032bb0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.265+0000 7fddf6f1b640 1 -- 172.21.15.17:0/908139964 shutdown_connections 2024-08-19T01:25:03.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.265+0000 7fddf6f1b640 1 --2- 172.21.15.17:0/908139964 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdde006e180 0x7fdde0070640 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.265+0000 7fddf6f1b640 1 --2- 172.21.15.17:0/908139964 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fddf0101690 0x7fddf00fef10 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.265+0000 7fddf6f1b640 1 --2- 172.21.15.17:0/908139964 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fddf0100d70 0x7fddf00fe9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.265+0000 7fddf6f1b640 1 -- 172.21.15.17:0/908139964 >> 172.21.15.17:0/908139964 conn(0x7fddf00758a0 msgr2=0x7fddf0101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.266+0000 7fddf6f1b640 1 -- 172.21.15.17:0/908139964 shutdown_connections 2024-08-19T01:25:03.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.266+0000 7fddf6f1b640 1 -- 172.21.15.17:0/908139964 wait complete. 2024-08-19T01:25:03.276 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:25:03.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.349+0000 7fd4dfc24640 1 -- 172.21.15.17:0/2159605037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d8100cb0 msgr2=0x7fd4d8101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.349+0000 7fd4dfc24640 1 --2- 172.21.15.17:0/2159605037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d8100cb0 0x7fd4d8101090 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8009c20 tx=0x7fd4c802aa00 comp rx=0 tx=0).stop 2024-08-19T01:25:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.349+0000 7fd4dfc24640 1 -- 172.21.15.17:0/2159605037 shutdown_connections 2024-08-19T01:25:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.349+0000 7fd4dfc24640 1 --2- 172.21.15.17:0/2159605037 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d81015d0 0x7fd4d8109ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.349+0000 7fd4dfc24640 1 --2- 172.21.15.17:0/2159605037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d8100cb0 0x7fd4d8101090 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.349+0000 7fd4dfc24640 1 -- 172.21.15.17:0/2159605037 >> 172.21.15.17:0/2159605037 conn(0x7fd4d80758a0 msgr2=0x7fd4d80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.350+0000 7fd4dfc24640 1 -- 172.21.15.17:0/2159605037 shutdown_connections 2024-08-19T01:25:03.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.350+0000 7fd4dfc24640 1 -- 172.21.15.17:0/2159605037 wait complete. 2024-08-19T01:25:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.350+0000 7fd4dfc24640 1 Processor -- start 2024-08-19T01:25:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.350+0000 7fd4dfc24640 1 -- start start 2024-08-19T01:25:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.350+0000 7fd4dfc24640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d8100cb0 0x7fd4d80fe910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.350+0000 7fd4dfc24640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d81015d0 0x7fd4d80fee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.350+0000 7fd4dfc24640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80ff390 con 0x7fd4d8100cb0 2024-08-19T01:25:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.350+0000 7fd4dfc24640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80ff500 con 0x7fd4d81015d0 2024-08-19T01:25:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4dd9c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d8100cb0 0x7fd4d80fe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4dd9c0640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d8100cb0 0x7fd4d80fe910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41946/0 (socket says 172.21.15.17:41946) 2024-08-19T01:25:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4dd9c0640 1 -- 172.21.15.17:0/612443031 learned_addr learned my addr 172.21.15.17:0/612443031 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4dd1bf640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d81015d0 0x7fd4d80fee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4dd9c0640 1 -- 172.21.15.17:0/612443031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d81015d0 msgr2=0x7fd4d80fee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4dd9c0640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d81015d0 0x7fd4d80fee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4dd9c0640 1 -- 172.21.15.17:0/612443031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c8009900 con 0x7fd4d8100cb0 2024-08-19T01:25:03.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4dd1bf640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d81015d0 0x7fd4d80fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:25:03.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4dd9c0640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d8100cb0 0x7fd4d80fe910 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd4c802af20 tx=0x7fd4c802f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:03.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4d6ffd640 1 -- 172.21.15.17:0/612443031 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4c803e070 con 0x7fd4d8100cb0 2024-08-19T01:25:03.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4dfc24640 1 -- 172.21.15.17:0/612443031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d80ff780 con 0x7fd4d8100cb0 2024-08-19T01:25:03.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4d6ffd640 1 -- 172.21.15.17:0/612443031 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4c802e870 con 0x7fd4d8100cb0 2024-08-19T01:25:03.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4d6ffd640 1 -- 172.21.15.17:0/612443031 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4c8004830 con 0x7fd4d8100cb0 2024-08-19T01:25:03.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.351+0000 7fd4dfc24640 1 -- 172.21.15.17:0/612443031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d81a1fa0 con 0x7fd4d8100cb0 2024-08-19T01:25:03.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.352+0000 7fd4dfc24640 1 -- 172.21.15.17:0/612443031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d8068510 con 0x7fd4d8100cb0 2024-08-19T01:25:03.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.353+0000 7fd4d6ffd640 1 -- 172.21.15.17:0/612443031 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd4c800a040 con 0x7fd4d8100cb0 2024-08-19T01:25:03.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.353+0000 7fd4d6ffd640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4c006e170 0x7fd4c0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.354+0000 7fd4d6ffd640 1 -- 172.21.15.17:0/612443031 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd4c80af1c0 con 0x7fd4d8100cb0 2024-08-19T01:25:03.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.354+0000 7fd4dd1bf640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4c006e170 0x7fd4c0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.354+0000 7fd4dd1bf640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4c006e170 0x7fd4c0070630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8100090 tx=0x7fd4cc00b690 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:03.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.358+0000 7fd4d6ffd640 1 -- 172.21.15.17:0/612443031 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd4c80784a0 con 0x7fd4d8100cb0 2024-08-19T01:25:03.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.552+0000 7fd4dfc24640 1 -- 172.21.15.17:0/612443031 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4d80ff780 con 0x7fd4c006e170 2024-08-19T01:25:03.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.553+0000 7fd4d6ffd640 1 -- 172.21.15.17:0/612443031 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd4d80ff780 con 0x7fd4c006e170 2024-08-19T01:25:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.555+0000 7fd4dfc24640 1 -- 172.21.15.17:0/612443031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4c006e170 msgr2=0x7fd4c0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.555+0000 7fd4dfc24640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4c006e170 0x7fd4c0070630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8100090 tx=0x7fd4cc00b690 comp rx=0 tx=0).stop 2024-08-19T01:25:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.555+0000 7fd4dfc24640 1 -- 172.21.15.17:0/612443031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d8100cb0 msgr2=0x7fd4d80fe910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.555+0000 7fd4dfc24640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d8100cb0 0x7fd4d80fe910 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd4c802af20 tx=0x7fd4c802f870 comp rx=0 tx=0).stop 2024-08-19T01:25:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.555+0000 7fd4dfc24640 1 -- 172.21.15.17:0/612443031 shutdown_connections 2024-08-19T01:25:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.555+0000 7fd4dfc24640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4c006e170 0x7fd4c0070630 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.555+0000 7fd4dfc24640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4d81015d0 0x7fd4d80fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.555+0000 7fd4dfc24640 1 --2- 172.21.15.17:0/612443031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4d8100cb0 0x7fd4d80fe910 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.555+0000 7fd4dfc24640 1 -- 172.21.15.17:0/612443031 >> 172.21.15.17:0/612443031 conn(0x7fd4d80758a0 msgr2=0x7fd4d8101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.555+0000 7fd4dfc24640 1 -- 172.21.15.17:0/612443031 shutdown_connections 2024-08-19T01:25:03.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.555+0000 7fd4dfc24640 1 -- 172.21.15.17:0/612443031 wait complete. 2024-08-19T01:25:03.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.638+0000 7f8194e38640 1 -- 172.21.15.17:0/4045048781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8190100750 msgr2=0x7f81901047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.638+0000 7f8194e38640 1 --2- 172.21.15.17:0/4045048781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8190100750 0x7f81901047a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f8180009880 tx=0x7f818002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.638+0000 7f8194e38640 1 -- 172.21.15.17:0/4045048781 shutdown_connections 2024-08-19T01:25:03.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.638+0000 7f8194e38640 1 --2- 172.21.15.17:0/4045048781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8190100750 0x7f81901047a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.638+0000 7f8194e38640 1 --2- 172.21.15.17:0/4045048781 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81900ffda0 0x7f8190100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.638+0000 7f8194e38640 1 -- 172.21.15.17:0/4045048781 >> 172.21.15.17:0/4045048781 conn(0x7f81900fb840 msgr2=0x7f81900fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.638+0000 7f8194e38640 1 -- 172.21.15.17:0/4045048781 shutdown_connections 2024-08-19T01:25:03.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.638+0000 7f8194e38640 1 -- 172.21.15.17:0/4045048781 wait complete. 2024-08-19T01:25:03.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f8194e38640 1 Processor -- start 2024-08-19T01:25:03.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f8194e38640 1 -- start start 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f8194e38640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81900ffda0 0x7f81900727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f8194e38640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8190100750 0x7f8190072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f8194e38640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190073230 con 0x7f8190100750 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f8194e38640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190073370 con 0x7f81900ffda0 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f818dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8190100750 0x7f8190072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f818dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8190100750 0x7f8190072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41958/0 (socket says 172.21.15.17:41958) 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f818dd9b640 1 -- 172.21.15.17:0/2995455221 learned_addr learned my addr 172.21.15.17:0/2995455221 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f818e59c640 1 --2- 172.21.15.17:0/2995455221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81900ffda0 0x7f81900727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f818dd9b640 1 -- 172.21.15.17:0/2995455221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81900ffda0 msgr2=0x7f81900727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f818dd9b640 1 --2- 172.21.15.17:0/2995455221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81900ffda0 0x7f81900727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.639+0000 7f818dd9b640 1 -- 172.21.15.17:0/2995455221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180009560 con 0x7f8190100750 2024-08-19T01:25:03.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.640+0000 7f818dd9b640 1 --2- 172.21.15.17:0/2995455221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8190100750 0x7f8190072cf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f818002a9c0 tx=0x7f81800055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.640+0000 7f81877fe640 1 -- 172.21.15.17:0/2995455221 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81800048d0 con 0x7f8190100750 2024-08-19T01:25:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.640+0000 7f8194e38640 1 -- 172.21.15.17:0/2995455221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81900735f0 con 0x7f8190100750 2024-08-19T01:25:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.640+0000 7f81877fe640 1 -- 172.21.15.17:0/2995455221 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8180031640 con 0x7f8190100750 2024-08-19T01:25:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.640+0000 7f81877fe640 1 -- 172.21.15.17:0/2995455221 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81800038d0 con 0x7f8190100750 2024-08-19T01:25:03.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.640+0000 7f8194e38640 1 -- 172.21.15.17:0/2995455221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81901a2000 con 0x7f8190100750 2024-08-19T01:25:03.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.641+0000 7f8194e38640 1 -- 172.21.15.17:0/2995455221 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8190101280 con 0x7f8190100750 2024-08-19T01:25:03.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.642+0000 7f81877fe640 1 -- 172.21.15.17:0/2995455221 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8180003b90 con 0x7f8190100750 2024-08-19T01:25:03.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.642+0000 7f81877fe640 1 --2- 172.21.15.17:0/2995455221 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f817c06e170 0x7f817c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.642+0000 7f818e59c640 1 --2- 172.21.15.17:0/2995455221 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f817c06e170 0x7f817c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.642+0000 7f81877fe640 1 -- 172.21.15.17:0/2995455221 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f81800af0a0 con 0x7f8190100750 2024-08-19T01:25:03.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.643+0000 7f818e59c640 1 --2- 172.21.15.17:0/2995455221 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f817c06e170 0x7f817c070630 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8178009bd0 tx=0x7f8178005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:03.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.647+0000 7f81877fe640 1 -- 172.21.15.17:0/2995455221 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8180078430 con 0x7f8190100750 2024-08-19T01:25:03.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.831+0000 7f8194e38640 1 -- 172.21.15.17:0/2995455221 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8190108170 con 0x7f817c06e170 2024-08-19T01:25:03.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.840+0000 7f81877fe640 1 -- 172.21.15.17:0/2995455221 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f8190108170 con 0x7f817c06e170 2024-08-19T01:25:03.843 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:25:03.843 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (26m) 4m ago 36m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:25:03.843 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (37m) 4m ago 37m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:25:03.843 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (36m) 4m ago 36m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:25:03.843 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (24m) 4m ago 37m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:25:03.843 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (24m) 4m ago 36m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:25:03.843 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (25m) 4m ago 36m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:25:03.843 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (20m) 4m ago 31m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:25:03.843 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (20m) 4m ago 31m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:25:03.843 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (4m) 4m ago 31m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:25:03.843 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (20m) 4m ago 31m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (28m) 4m ago 38m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (27m) 4m ago 36m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (25m) 4m ago 38m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (24m) 4m ago 35m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (27m) 4m ago 37m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (26m) 4m ago 36m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (23m) 4m ago 35m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (23m) 4m ago 34m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (22m) 4m ago 34m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (21m) 4m ago 33m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (21m) 4m ago 33m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (20m) 4m ago 33m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:25:03.844 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (26m) 4m ago 36m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:25:03.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.843+0000 7f8194e38640 1 -- 172.21.15.17:0/2995455221 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f817c06e170 msgr2=0x7f817c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.843+0000 7f8194e38640 1 --2- 172.21.15.17:0/2995455221 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f817c06e170 0x7f817c070630 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8178009bd0 tx=0x7f8178005f90 comp rx=0 tx=0).stop 2024-08-19T01:25:03.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.843+0000 7f8194e38640 1 -- 172.21.15.17:0/2995455221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8190100750 msgr2=0x7f8190072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.843+0000 7f8194e38640 1 --2- 172.21.15.17:0/2995455221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8190100750 0x7f8190072cf0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f818002a9c0 tx=0x7f81800055a0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.843+0000 7f8194e38640 1 -- 172.21.15.17:0/2995455221 shutdown_connections 2024-08-19T01:25:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.843+0000 7f8194e38640 1 --2- 172.21.15.17:0/2995455221 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f817c06e170 0x7f817c070630 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.843+0000 7f8194e38640 1 --2- 172.21.15.17:0/2995455221 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8190100750 0x7f8190072cf0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.843+0000 7f8194e38640 1 --2- 172.21.15.17:0/2995455221 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f81900ffda0 0x7f81900727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.843+0000 7f8194e38640 1 -- 172.21.15.17:0/2995455221 >> 172.21.15.17:0/2995455221 conn(0x7f81900fb840 msgr2=0x7f81900fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.843+0000 7f8194e38640 1 -- 172.21.15.17:0/2995455221 shutdown_connections 2024-08-19T01:25:03.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.843+0000 7f8194e38640 1 -- 172.21.15.17:0/2995455221 wait complete. 2024-08-19T01:25:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.924+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/1447157210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc40fe9f0 msgr2=0x7f6bc40fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.924+0000 7f6bc9bf4640 1 --2- 172.21.15.17:0/1447157210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc40fe9f0 0x7f6bc40fee50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009880 tx=0x7f6bb402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.924+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/1447157210 shutdown_connections 2024-08-19T01:25:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.924+0000 7f6bc9bf4640 1 --2- 172.21.15.17:0/1447157210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc40fe9f0 0x7f6bc40fee50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.924+0000 7f6bc9bf4640 1 --2- 172.21.15.17:0/1447157210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bc41049f0 0x7f6bc4104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.924+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/1447157210 >> 172.21.15.17:0/1447157210 conn(0x7f6bc40758a0 msgr2=0x7f6bc40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:03.927 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:03 smithi017 ceph-mon[99370]: pgmap v789: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:03.927 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:25:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.925+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/1447157210 shutdown_connections 2024-08-19T01:25:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.925+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/1447157210 wait complete. 2024-08-19T01:25:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.925+0000 7f6bc9bf4640 1 Processor -- start 2024-08-19T01:25:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc9bf4640 1 -- start start 2024-08-19T01:25:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc9bf4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bc40fe9f0 0x7f6bc4197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc9bf4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc41049f0 0x7f6bc4198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc9bf4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc41988f0 con 0x7f6bc41049f0 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc9bf4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc419b560 con 0x7f6bc40fe9f0 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc41049f0 0x7f6bc4198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc41049f0 0x7f6bc4198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41972/0 (socket says 172.21.15.17:41972) 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc2ffd640 1 -- 172.21.15.17:0/3044497706 learned_addr learned my addr 172.21.15.17:0/3044497706 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc37fe640 1 --2- 172.21.15.17:0/3044497706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bc40fe9f0 0x7f6bc4197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc2ffd640 1 -- 172.21.15.17:0/3044497706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bc40fe9f0 msgr2=0x7f6bc4197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc2ffd640 1 --2- 172.21.15.17:0/3044497706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bc40fe9f0 0x7f6bc4197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.926+0000 7f6bc2ffd640 1 -- 172.21.15.17:0/3044497706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4009560 con 0x7f6bc41049f0 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.927+0000 7f6bc2ffd640 1 --2- 172.21.15.17:0/3044497706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc41049f0 0x7f6bc4198210 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6bb402a9c0 tx=0x7f6bb40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.927+0000 7f6bc0ff9640 1 -- 172.21.15.17:0/3044497706 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb4004aa0 con 0x7f6bc41049f0 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.927+0000 7f6bc0ff9640 1 -- 172.21.15.17:0/3044497706 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6bb4004c00 con 0x7f6bc41049f0 2024-08-19T01:25:03.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.927+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/3044497706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc419b7e0 con 0x7f6bc41049f0 2024-08-19T01:25:03.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.927+0000 7f6bc0ff9640 1 -- 172.21.15.17:0/3044497706 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb4003ab0 con 0x7f6bc41049f0 2024-08-19T01:25:03.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.927+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/3044497706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc419bcd0 con 0x7f6bc41049f0 2024-08-19T01:25:03.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.928+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/3044497706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc4100130 con 0x7f6bc41049f0 2024-08-19T01:25:03.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.929+0000 7f6bc0ff9640 1 -- 172.21.15.17:0/3044497706 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6bb4003ce0 con 0x7f6bc41049f0 2024-08-19T01:25:03.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.929+0000 7f6bc0ff9640 1 --2- 172.21.15.17:0/3044497706 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6bb006e170 0x7f6bb0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:03.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.929+0000 7f6bc0ff9640 1 -- 172.21.15.17:0/3044497706 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6bb40af1b0 con 0x7f6bc41049f0 2024-08-19T01:25:03.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.929+0000 7f6bc37fe640 1 --2- 172.21.15.17:0/3044497706 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6bb006e170 0x7f6bb0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:03.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.930+0000 7f6bc37fe640 1 --2- 172.21.15.17:0/3044497706 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6bb006e170 0x7f6bb0070630 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0058c0 tx=0x7f6bac00a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:03.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:03.933+0000 7f6bc0ff9640 1 -- 172.21.15.17:0/3044497706 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6bb4078540 con 0x7f6bc41049f0 2024-08-19T01:25:04.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.180+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/3044497706 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6bc4199050 con 0x7f6bc41049f0 2024-08-19T01:25:04.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.180+0000 7f6bc0ff9640 1 -- 172.21.15.17:0/3044497706 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f6bb407bc00 con 0x7f6bc41049f0 2024-08-19T01:25:04.183 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:25:04.183 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:25:04.183 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:25:04.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:25:04.183 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:25:04.183 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:25:04.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:25:04.183 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:25:04.183 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:25:04.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:25:04.184 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:25:04.184 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:25:04.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:25:04.184 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:25:04.184 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:25:04.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:25:04.184 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:25:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.183+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/3044497706 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6bb006e170 msgr2=0x7f6bb0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.183+0000 7f6bc9bf4640 1 --2- 172.21.15.17:0/3044497706 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6bb006e170 0x7f6bb0070630 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0058c0 tx=0x7f6bac00a250 comp rx=0 tx=0).stop 2024-08-19T01:25:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.183+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/3044497706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc41049f0 msgr2=0x7f6bc4198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.183+0000 7f6bc9bf4640 1 --2- 172.21.15.17:0/3044497706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc41049f0 0x7f6bc4198210 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6bb402a9c0 tx=0x7f6bb40055a0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.183+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/3044497706 shutdown_connections 2024-08-19T01:25:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.183+0000 7f6bc9bf4640 1 --2- 172.21.15.17:0/3044497706 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6bb006e170 0x7f6bb0070630 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.183+0000 7f6bc9bf4640 1 --2- 172.21.15.17:0/3044497706 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc41049f0 0x7f6bc4198210 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.183+0000 7f6bc9bf4640 1 --2- 172.21.15.17:0/3044497706 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6bc40fe9f0 0x7f6bc4197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.183+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/3044497706 >> 172.21.15.17:0/3044497706 conn(0x7f6bc40758a0 msgr2=0x7f6bc4067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:04.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.183+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/3044497706 shutdown_connections 2024-08-19T01:25:04.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.183+0000 7f6bc9bf4640 1 -- 172.21.15.17:0/3044497706 wait complete. 2024-08-19T01:25:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:03 smithi086 ceph-mon[71303]: pgmap v789: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:25:04.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.264+0000 7fa711dd4640 1 -- 172.21.15.17:0/3009044465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa70c073200 msgr2=0x7fa70c10be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.264+0000 7fa711dd4640 1 --2- 172.21.15.17:0/3009044465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa70c073200 0x7fa70c10be30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009880 tx=0x7fa6f402a530 comp rx=0 tx=0).stop 2024-08-19T01:25:04.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.264+0000 7fa711dd4640 1 -- 172.21.15.17:0/3009044465 shutdown_connections 2024-08-19T01:25:04.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.264+0000 7fa711dd4640 1 --2- 172.21.15.17:0/3009044465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa70c073200 0x7fa70c10be30 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.264+0000 7fa711dd4640 1 --2- 172.21.15.17:0/3009044465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa70c0728e0 0x7fa70c072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.264+0000 7fa711dd4640 1 -- 172.21.15.17:0/3009044465 >> 172.21.15.17:0/3009044465 conn(0x7fa70c0fb830 msgr2=0x7fa70c0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:04.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.265+0000 7fa711dd4640 1 -- 172.21.15.17:0/3009044465 shutdown_connections 2024-08-19T01:25:04.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.265+0000 7fa711dd4640 1 -- 172.21.15.17:0/3009044465 wait complete. 2024-08-19T01:25:04.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.265+0000 7fa711dd4640 1 Processor -- start 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.265+0000 7fa711dd4640 1 -- start start 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.265+0000 7fa711dd4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa70c0728e0 0x7fa70c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.265+0000 7fa711dd4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa70c073200 0x7fa70c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.265+0000 7fa711dd4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c1989e0 con 0x7fa70c073200 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.265+0000 7fa711dd4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70c19c750 con 0x7fa70c0728e0 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa702ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa70c073200 0x7fa70c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa702ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa70c073200 0x7fa70c198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41996/0 (socket says 172.21.15.17:41996) 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa702ffd640 1 -- 172.21.15.17:0/3024177786 learned_addr learned my addr 172.21.15.17:0/3024177786 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa70b7fe640 1 --2- 172.21.15.17:0/3024177786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa70c0728e0 0x7fa70c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa702ffd640 1 -- 172.21.15.17:0/3024177786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa70c0728e0 msgr2=0x7fa70c197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa702ffd640 1 --2- 172.21.15.17:0/3024177786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa70c0728e0 0x7fa70c197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa702ffd640 1 -- 172.21.15.17:0/3024177786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4009560 con 0x7fa70c073200 2024-08-19T01:25:04.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa702ffd640 1 --2- 172.21.15.17:0/3024177786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa70c073200 0x7fa70c198350 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa6f402aa50 tx=0x7fa6f40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:04.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa7097fa640 1 -- 172.21.15.17:0/3024177786 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f4004aa0 con 0x7fa70c073200 2024-08-19T01:25:04.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa7097fa640 1 -- 172.21.15.17:0/3024177786 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6f4004c00 con 0x7fa70c073200 2024-08-19T01:25:04.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa711dd4640 1 -- 172.21.15.17:0/3024177786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70c19c9d0 con 0x7fa70c073200 2024-08-19T01:25:04.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa7097fa640 1 -- 172.21.15.17:0/3024177786 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f4003ab0 con 0x7fa70c073200 2024-08-19T01:25:04.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.266+0000 7fa711dd4640 1 -- 172.21.15.17:0/3024177786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70c19cec0 con 0x7fa70c073200 2024-08-19T01:25:04.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.267+0000 7fa711dd4640 1 -- 172.21.15.17:0/3024177786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa70c073f90 con 0x7fa70c073200 2024-08-19T01:25:04.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.268+0000 7fa7097fa640 1 -- 172.21.15.17:0/3024177786 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa6f402ad50 con 0x7fa70c073200 2024-08-19T01:25:04.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.268+0000 7fa7097fa640 1 --2- 172.21.15.17:0/3024177786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6f806e170 0x7fa6f8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:04.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.268+0000 7fa7097fa640 1 -- 172.21.15.17:0/3024177786 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa6f40af030 con 0x7fa70c073200 2024-08-19T01:25:04.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.269+0000 7fa70b7fe640 1 --2- 172.21.15.17:0/3024177786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6f806e170 0x7fa6f8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:04.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.269+0000 7fa70b7fe640 1 --2- 172.21.15.17:0/3024177786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6f806e170 0x7fa6f8070630 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0058c0 tx=0x7fa6fc005c60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:04.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.273+0000 7fa7097fa640 1 -- 172.21.15.17:0/3024177786 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa6f4078310 con 0x7fa70c073200 2024-08-19T01:25:04.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.485+0000 7fa711dd4640 1 -- 172.21.15.17:0/3024177786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa70c199170 con 0x7fa70c073200 2024-08-19T01:25:04.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.485+0000 7fa7097fa640 1 -- 172.21.15.17:0/3024177786 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7fa6f407b9d0 con 0x7fa70c073200 2024-08-19T01:25:04.488 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:25:04.488 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:25:04.488 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:25:04.488 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:25:04.488 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:25:04.488 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:25:04.488 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:25:04.488 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:25:04.488 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:25:04.488 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:25:04.488 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:25:04.489 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:25:04.490 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:25:04.491 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:25:04.491 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:25:04.491 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:25:04.491 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:25:04.491 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:25:04.491 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:25:04.491 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:25:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:25:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.487+0000 7fa711dd4640 1 -- 172.21.15.17:0/3024177786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6f806e170 msgr2=0x7fa6f8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.487+0000 7fa711dd4640 1 --2- 172.21.15.17:0/3024177786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6f806e170 0x7fa6f8070630 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc0058c0 tx=0x7fa6fc005c60 comp rx=0 tx=0).stop 2024-08-19T01:25:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.487+0000 7fa711dd4640 1 -- 172.21.15.17:0/3024177786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa70c073200 msgr2=0x7fa70c198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.487+0000 7fa711dd4640 1 --2- 172.21.15.17:0/3024177786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa70c073200 0x7fa70c198350 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa6f402aa50 tx=0x7fa6f40055a0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.487+0000 7fa711dd4640 1 -- 172.21.15.17:0/3024177786 shutdown_connections 2024-08-19T01:25:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.487+0000 7fa711dd4640 1 --2- 172.21.15.17:0/3024177786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa6f806e170 0x7fa6f8070630 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.487+0000 7fa711dd4640 1 --2- 172.21.15.17:0/3024177786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa70c073200 0x7fa70c198350 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.487+0000 7fa711dd4640 1 --2- 172.21.15.17:0/3024177786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa70c0728e0 0x7fa70c197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.487+0000 7fa711dd4640 1 -- 172.21.15.17:0/3024177786 >> 172.21.15.17:0/3024177786 conn(0x7fa70c0fb830 msgr2=0x7fa70c104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:04.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.488+0000 7fa711dd4640 1 -- 172.21.15.17:0/3024177786 shutdown_connections 2024-08-19T01:25:04.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.488+0000 7fa711dd4640 1 -- 172.21.15.17:0/3024177786 wait complete. 2024-08-19T01:25:04.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.570+0000 7f594b556640 1 -- 172.21.15.17:0/4011446079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59441049f0 msgr2=0x7f5944104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.570+0000 7f594b556640 1 --2- 172.21.15.17:0/4011446079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59441049f0 0x7f5944104dd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5940009880 tx=0x7f594002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.570+0000 7f594b556640 1 -- 172.21.15.17:0/4011446079 shutdown_connections 2024-08-19T01:25:04.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.570+0000 7f594b556640 1 --2- 172.21.15.17:0/4011446079 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59440fe9f0 0x7f59440fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.570+0000 7f594b556640 1 --2- 172.21.15.17:0/4011446079 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59441049f0 0x7f5944104dd0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.570+0000 7f594b556640 1 -- 172.21.15.17:0/4011446079 >> 172.21.15.17:0/4011446079 conn(0x7f59440758a0 msgr2=0x7f59440fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:04.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.571+0000 7f594b556640 1 -- 172.21.15.17:0/4011446079 shutdown_connections 2024-08-19T01:25:04.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.571+0000 7f594b556640 1 -- 172.21.15.17:0/4011446079 wait complete. 2024-08-19T01:25:04.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.571+0000 7f594b556640 1 Processor -- start 2024-08-19T01:25:04.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.571+0000 7f594b556640 1 -- start start 2024-08-19T01:25:04.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.571+0000 7f594b556640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59440fe9f0 0x7f59440fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:04.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.571+0000 7f594b556640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59441049f0 0x7f59440fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:04.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.571+0000 7f594b556640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440fb800 con 0x7f59441049f0 2024-08-19T01:25:04.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.571+0000 7f594b556640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59440fb940 con 0x7f59440fe9f0 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f5948af1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59441049f0 0x7f59440fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f5948af1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59441049f0 0x7f59440fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42012/0 (socket says 172.21.15.17:42012) 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f5948af1640 1 -- 172.21.15.17:0/3557774558 learned_addr learned my addr 172.21.15.17:0/3557774558 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f59492f2640 1 --2- 172.21.15.17:0/3557774558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59440fe9f0 0x7f59440fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f5948af1640 1 -- 172.21.15.17:0/3557774558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59440fe9f0 msgr2=0x7f59440fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f5948af1640 1 --2- 172.21.15.17:0/3557774558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59440fe9f0 0x7f59440fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f5948af1640 1 -- 172.21.15.17:0/3557774558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5940009560 con 0x7f59441049f0 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f5948af1640 1 --2- 172.21.15.17:0/3557774558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59441049f0 0x7f59440fb2c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f593400c8f0 tx=0x7f593400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f593a7fc640 1 -- 172.21.15.17:0/3557774558 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5934007b80 con 0x7f59441049f0 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f593a7fc640 1 -- 172.21.15.17:0/3557774558 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59340054e0 con 0x7f59441049f0 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f594b556640 1 -- 172.21.15.17:0/3557774558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59441a1ca0 con 0x7f59441049f0 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f593a7fc640 1 -- 172.21.15.17:0/3557774558 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f593400f450 con 0x7f59441049f0 2024-08-19T01:25:04.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.572+0000 7f594b556640 1 -- 172.21.15.17:0/3557774558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59441a20b0 con 0x7f59441049f0 2024-08-19T01:25:04.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.573+0000 7f594b556640 1 -- 172.21.15.17:0/3557774558 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5944100130 con 0x7f59441049f0 2024-08-19T01:25:04.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.574+0000 7f593a7fc640 1 -- 172.21.15.17:0/3557774558 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5934004f60 con 0x7f59441049f0 2024-08-19T01:25:04.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.574+0000 7f593a7fc640 1 --2- 172.21.15.17:0/3557774558 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f593006e170 0x7f5930070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:04.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.574+0000 7f593a7fc640 1 -- 172.21.15.17:0/3557774558 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f593408dfe0 con 0x7f59441049f0 2024-08-19T01:25:04.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.575+0000 7f59492f2640 1 --2- 172.21.15.17:0/3557774558 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f593006e170 0x7f5930070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:04.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.575+0000 7f59492f2640 1 --2- 172.21.15.17:0/3557774558 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f593006e170 0x7f5930070630 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5940009230 tx=0x7f59400058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:04.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.579+0000 7f593a7fc640 1 -- 172.21.15.17:0/3557774558 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f59340c2df0 con 0x7f59441049f0 2024-08-19T01:25:04.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.772+0000 7f594b556640 1 -- 172.21.15.17:0/3557774558 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f594410bd90 con 0x7f593006e170 2024-08-19T01:25:04.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.774+0000 7f593a7fc640 1 -- 172.21.15.17:0/3557774558 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f594410bd90 con 0x7f593006e170 2024-08-19T01:25:04.776 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:25:04.776 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:25:04.776 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:25:04.776 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:25:04.776 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:25:04.776 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:25:04.776 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:25:04.776 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:25:04.776 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:25:04.776 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:25:04.777 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:25:04.777 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:25:04.777 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:25:04.777 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:25:04.777 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:25:04.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.776+0000 7f594b556640 1 -- 172.21.15.17:0/3557774558 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f593006e170 msgr2=0x7f5930070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.776+0000 7f594b556640 1 --2- 172.21.15.17:0/3557774558 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f593006e170 0x7f5930070630 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5940009230 tx=0x7f59400058d0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.776+0000 7f594b556640 1 -- 172.21.15.17:0/3557774558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59441049f0 msgr2=0x7f59440fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.776+0000 7f594b556640 1 --2- 172.21.15.17:0/3557774558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59441049f0 0x7f59440fb2c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f593400c8f0 tx=0x7f593400cdb0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.776+0000 7f594b556640 1 -- 172.21.15.17:0/3557774558 shutdown_connections 2024-08-19T01:25:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.776+0000 7f594b556640 1 --2- 172.21.15.17:0/3557774558 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f593006e170 0x7f5930070630 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.776+0000 7f594b556640 1 --2- 172.21.15.17:0/3557774558 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f59441049f0 0x7f59440fb2c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.776+0000 7f594b556640 1 --2- 172.21.15.17:0/3557774558 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f59440fe9f0 0x7f59440fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.776+0000 7f594b556640 1 -- 172.21.15.17:0/3557774558 >> 172.21.15.17:0/3557774558 conn(0x7f59440758a0 msgr2=0x7f59440fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.776+0000 7f594b556640 1 -- 172.21.15.17:0/3557774558 shutdown_connections 2024-08-19T01:25:04.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.776+0000 7f594b556640 1 -- 172.21.15.17:0/3557774558 wait complete. 2024-08-19T01:25:04.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.858+0000 7faad1c55640 1 -- 172.21.15.17:0/580889648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faacc100750 msgr2=0x7faacc1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.858+0000 7faad1c55640 1 --2- 172.21.15.17:0/580889648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faacc100750 0x7faacc1047a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7faab4009880 tx=0x7faab402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.859+0000 7faad1c55640 1 -- 172.21.15.17:0/580889648 shutdown_connections 2024-08-19T01:25:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.859+0000 7faad1c55640 1 --2- 172.21.15.17:0/580889648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faacc100750 0x7faacc1047a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.859+0000 7faad1c55640 1 --2- 172.21.15.17:0/580889648 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faacc0ffda0 0x7faacc100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.859+0000 7faad1c55640 1 -- 172.21.15.17:0/580889648 >> 172.21.15.17:0/580889648 conn(0x7faacc0fb840 msgr2=0x7faacc0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.859+0000 7faad1c55640 1 -- 172.21.15.17:0/580889648 shutdown_connections 2024-08-19T01:25:04.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.859+0000 7faad1c55640 1 -- 172.21.15.17:0/580889648 wait complete. 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.859+0000 7faad1c55640 1 Processor -- start 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.859+0000 7faad1c55640 1 -- start start 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faad1c55640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faacc0ffda0 0x7faacc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faad1c55640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faacc100750 0x7faacc072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faad1c55640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc073230 con 0x7faacc100750 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faad1c55640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faacc073370 con 0x7faacc0ffda0 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faacc100750 0x7faacc072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faac2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faacc100750 0x7faacc072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42030/0 (socket says 172.21.15.17:42030) 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faac2ffd640 1 -- 172.21.15.17:0/2369034189 learned_addr learned my addr 172.21.15.17:0/2369034189 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faacb7fe640 1 --2- 172.21.15.17:0/2369034189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faacc0ffda0 0x7faacc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faac2ffd640 1 -- 172.21.15.17:0/2369034189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faacc0ffda0 msgr2=0x7faacc0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faac2ffd640 1 --2- 172.21.15.17:0/2369034189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faacc0ffda0 0x7faacc0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:04.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faac2ffd640 1 -- 172.21.15.17:0/2369034189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab4009560 con 0x7faacc100750 2024-08-19T01:25:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faac2ffd640 1 --2- 172.21.15.17:0/2369034189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faacc100750 0x7faacc072cf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7faab402a9c0 tx=0x7faab40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faac97fa640 1 -- 172.21.15.17:0/2369034189 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faab4004aa0 con 0x7faacc100750 2024-08-19T01:25:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faad1c55640 1 -- 172.21.15.17:0/2369034189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faacc0735f0 con 0x7faacc100750 2024-08-19T01:25:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.860+0000 7faac97fa640 1 -- 172.21.15.17:0/2369034189 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faab4004c00 con 0x7faacc100750 2024-08-19T01:25:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.861+0000 7faac97fa640 1 -- 172.21.15.17:0/2369034189 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faab4003980 con 0x7faacc100750 2024-08-19T01:25:04.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.861+0000 7faad1c55640 1 -- 172.21.15.17:0/2369034189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faacc1a2000 con 0x7faacc100750 2024-08-19T01:25:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.862+0000 7faad1c55640 1 -- 172.21.15.17:0/2369034189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faacc101280 con 0x7faacc100750 2024-08-19T01:25:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.862+0000 7faac97fa640 1 -- 172.21.15.17:0/2369034189 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7faab4003bf0 con 0x7faacc100750 2024-08-19T01:25:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.863+0000 7faac97fa640 1 --2- 172.21.15.17:0/2369034189 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faab806e170 0x7faab8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.863+0000 7faac97fa640 1 -- 172.21.15.17:0/2369034189 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7faab40af140 con 0x7faacc100750 2024-08-19T01:25:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.863+0000 7faacb7fe640 1 --2- 172.21.15.17:0/2369034189 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faab806e170 0x7faab8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:04.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.863+0000 7faacb7fe640 1 --2- 172.21.15.17:0/2369034189 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faab806e170 0x7faab8070630 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faabc005fd0 tx=0x7faabc00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:04.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:04.867+0000 7faac97fa640 1 -- 172.21.15.17:0/2369034189 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7faab40784d0 con 0x7faacc100750 2024-08-19T01:25:05.060 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:04 smithi017 ceph-mon[99370]: from='client.35466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:05.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:04 smithi017 ceph-mon[99370]: from='client.35470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:05.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:04 smithi017 ceph-mon[99370]: from='client.35474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:05.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:04 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3044497706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:25:05.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:04 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3024177786' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:25:05.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.110+0000 7faad1c55640 1 -- 172.21.15.17:0/2369034189 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7faacc1080b0 con 0x7faacc100750 2024-08-19T01:25:05.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.110+0000 7faac97fa640 1 -- 172.21.15.17:0/2369034189 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7faab407bb90 con 0x7faacc100750 2024-08-19T01:25:05.112 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:25:05.112 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:25:05.112 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:25:05.113 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:25:05.114 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:25:05.114 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:25:05.114 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:25:05.114 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:25:05.114 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:25:05.114 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:25:05.114 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:25:05.114 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:25:05.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.113+0000 7faad1c55640 1 -- 172.21.15.17:0/2369034189 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faab806e170 msgr2=0x7faab8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:05.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.113+0000 7faad1c55640 1 --2- 172.21.15.17:0/2369034189 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faab806e170 0x7faab8070630 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faabc005fd0 tx=0x7faabc00b390 comp rx=0 tx=0).stop 2024-08-19T01:25:05.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.113+0000 7faad1c55640 1 -- 172.21.15.17:0/2369034189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faacc100750 msgr2=0x7faacc072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:05.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.113+0000 7faad1c55640 1 --2- 172.21.15.17:0/2369034189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faacc100750 0x7faacc072cf0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7faab402a9c0 tx=0x7faab40055a0 comp rx=0 tx=0).stop 2024-08-19T01:25:05.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.113+0000 7faad1c55640 1 -- 172.21.15.17:0/2369034189 shutdown_connections 2024-08-19T01:25:05.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.113+0000 7faad1c55640 1 --2- 172.21.15.17:0/2369034189 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faab806e170 0x7faab8070630 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:05.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.113+0000 7faad1c55640 1 --2- 172.21.15.17:0/2369034189 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faacc100750 0x7faacc072cf0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:05.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.113+0000 7faad1c55640 1 --2- 172.21.15.17:0/2369034189 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faacc0ffda0 0x7faacc0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:05.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.113+0000 7faad1c55640 1 -- 172.21.15.17:0/2369034189 >> 172.21.15.17:0/2369034189 conn(0x7faacc0fb840 msgr2=0x7faacc0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:05.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.113+0000 7faad1c55640 1 -- 172.21.15.17:0/2369034189 shutdown_connections 2024-08-19T01:25:05.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:05.113+0000 7faad1c55640 1 -- 172.21.15.17:0/2369034189 wait complete. 2024-08-19T01:25:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:04 smithi086 ceph-mon[71303]: from='client.35466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:04 smithi086 ceph-mon[71303]: from='client.35470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:04 smithi086 ceph-mon[71303]: from='client.35474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:04 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3044497706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:25:05.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:04 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3024177786' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:25:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:05 smithi017 ceph-mon[99370]: pgmap v790: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:05 smithi017 ceph-mon[99370]: from='client.35486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:06.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:05 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2369034189' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:25:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:05 smithi086 ceph-mon[71303]: pgmap v790: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:05 smithi086 ceph-mon[71303]: from='client.35486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:06.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:05 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2369034189' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:25:08.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:07 smithi017 ceph-mon[99370]: pgmap v791: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:08.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:07 smithi086 ceph-mon[71303]: pgmap v791: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:10.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:09 smithi017 ceph-mon[99370]: pgmap v792: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:10.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:09 smithi086 ceph-mon[71303]: pgmap v792: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:12.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:11 smithi017 ceph-mon[99370]: pgmap v793: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:12.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:11 smithi086 ceph-mon[71303]: pgmap v793: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:14.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:13 smithi017 ceph-mon[99370]: pgmap v794: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:14.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:13 smithi086 ceph-mon[71303]: pgmap v794: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:16.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:15 smithi017 ceph-mon[99370]: pgmap v795: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:16.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:15 smithi086 ceph-mon[71303]: pgmap v795: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:18.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:17 smithi017 ceph-mon[99370]: pgmap v796: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:18.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:17 smithi086 ceph-mon[71303]: pgmap v796: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:19.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:25:19.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:25:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:19 smithi086 ceph-mon[71303]: pgmap v797: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:20.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:19 smithi017 ceph-mon[99370]: pgmap v797: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:22.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:21 smithi017 ceph-mon[99370]: pgmap v798: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:22.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:21 smithi086 ceph-mon[71303]: pgmap v798: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:24.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:23 smithi017 ceph-mon[99370]: pgmap v799: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:24.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:23 smithi086 ceph-mon[71303]: pgmap v799: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:26.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:25 smithi017 ceph-mon[99370]: pgmap v800: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:25 smithi086 ceph-mon[71303]: pgmap v800: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:28.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:27 smithi017 ceph-mon[99370]: pgmap v801: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:28.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:27 smithi086 ceph-mon[71303]: pgmap v801: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:30.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:29 smithi086 ceph-mon[71303]: pgmap v802: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:30.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:29 smithi017 ceph-mon[99370]: pgmap v802: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:32.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:31 smithi086 ceph-mon[71303]: pgmap v803: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:32.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:31 smithi017 ceph-mon[99370]: pgmap v803: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:33 smithi086 ceph-mon[71303]: pgmap v804: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:34.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:25:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:33 smithi017 ceph-mon[99370]: pgmap v804: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:25:35.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.208+0000 7f1e63286640 1 -- 172.21.15.17:0/3332933653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5c101670 msgr2=0x7f1e5c109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.208+0000 7f1e63286640 1 --2- 172.21.15.17:0/3332933653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5c101670 0x7f1e5c109b60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1e50009880 tx=0x7f1e5002a530 comp rx=0 tx=0).stop 2024-08-19T01:25:35.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.208+0000 7f1e63286640 1 -- 172.21.15.17:0/3332933653 shutdown_connections 2024-08-19T01:25:35.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.208+0000 7f1e63286640 1 --2- 172.21.15.17:0/3332933653 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5c101670 0x7f1e5c109b60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.208+0000 7f1e63286640 1 --2- 172.21.15.17:0/3332933653 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5c100d50 0x7f1e5c101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.208+0000 7f1e63286640 1 -- 172.21.15.17:0/3332933653 >> 172.21.15.17:0/3332933653 conn(0x7f1e5c0758a0 msgr2=0x7f1e5c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:35.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.208+0000 7f1e63286640 1 -- 172.21.15.17:0/3332933653 shutdown_connections 2024-08-19T01:25:35.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.208+0000 7f1e63286640 1 -- 172.21.15.17:0/3332933653 wait complete. 2024-08-19T01:25:35.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.209+0000 7f1e63286640 1 Processor -- start 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.209+0000 7f1e63286640 1 -- start start 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.209+0000 7f1e63286640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5c100d50 0x7f1e5c0fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.209+0000 7f1e63286640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5c101670 0x7f1e5c0feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.209+0000 7f1e63286640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c0ff430 con 0x7f1e5c101670 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.209+0000 7f1e63286640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c0ff5a0 con 0x7f1e5c100d50 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.209+0000 7f1e60821640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5c101670 0x7f1e5c0feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.209+0000 7f1e60821640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5c101670 0x7f1e5c0feef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36274/0 (socket says 172.21.15.17:36274) 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.209+0000 7f1e60821640 1 -- 172.21.15.17:0/3910602984 learned_addr learned my addr 172.21.15.17:0/3910602984 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.210+0000 7f1e61022640 1 --2- 172.21.15.17:0/3910602984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5c100d50 0x7f1e5c0fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.210+0000 7f1e60821640 1 -- 172.21.15.17:0/3910602984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5c100d50 msgr2=0x7f1e5c0fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.210+0000 7f1e60821640 1 --2- 172.21.15.17:0/3910602984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5c100d50 0x7f1e5c0fe9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.210+0000 7f1e60821640 1 -- 172.21.15.17:0/3910602984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50009560 con 0x7f1e5c101670 2024-08-19T01:25:35.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.210+0000 7f1e60821640 1 --2- 172.21.15.17:0/3910602984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5c101670 0x7f1e5c0feef0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1e5002aa50 tx=0x7f1e50032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:35.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.210+0000 7f1e4e7fc640 1 -- 172.21.15.17:0/3910602984 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e500037c0 con 0x7f1e5c101670 2024-08-19T01:25:35.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.210+0000 7f1e4e7fc640 1 -- 172.21.15.17:0/3910602984 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e50005d50 con 0x7f1e5c101670 2024-08-19T01:25:35.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.210+0000 7f1e63286640 1 -- 172.21.15.17:0/3910602984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5c0ff820 con 0x7f1e5c101670 2024-08-19T01:25:35.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.210+0000 7f1e4e7fc640 1 -- 172.21.15.17:0/3910602984 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e5003be30 con 0x7f1e5c101670 2024-08-19T01:25:35.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.210+0000 7f1e63286640 1 -- 172.21.15.17:0/3910602984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5c1a1f40 con 0x7f1e5c101670 2024-08-19T01:25:35.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.212+0000 7f1e63286640 1 -- 172.21.15.17:0/3910602984 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5c068470 con 0x7f1e5c101670 2024-08-19T01:25:35.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.212+0000 7f1e4e7fc640 1 -- 172.21.15.17:0/3910602984 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1e5002ad50 con 0x7f1e5c101670 2024-08-19T01:25:35.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.212+0000 7f1e4e7fc640 1 --2- 172.21.15.17:0/3910602984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e4806e110 0x7f1e480705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:35.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.213+0000 7f1e4e7fc640 1 -- 172.21.15.17:0/3910602984 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1e500aeac0 con 0x7f1e5c101670 2024-08-19T01:25:35.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.213+0000 7f1e61022640 1 --2- 172.21.15.17:0/3910602984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e4806e110 0x7f1e480705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:35.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.213+0000 7f1e61022640 1 --2- 172.21.15.17:0/3910602984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e4806e110 0x7f1e480705d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1e58005d00 tx=0x7f1e5800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:35.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.217+0000 7f1e4e7fc640 1 -- 172.21.15.17:0/3910602984 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1e50077e50 con 0x7f1e5c101670 2024-08-19T01:25:35.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.409+0000 7f1e63286640 1 -- 172.21.15.17:0/3910602984 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e5c0ff800 con 0x7f1e4806e110 2024-08-19T01:25:35.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.410+0000 7f1e4e7fc640 1 -- 172.21.15.17:0/3910602984 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f1e5c0ff800 con 0x7f1e4806e110 2024-08-19T01:25:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.413+0000 7f1e63286640 1 -- 172.21.15.17:0/3910602984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e4806e110 msgr2=0x7f1e480705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.413+0000 7f1e63286640 1 --2- 172.21.15.17:0/3910602984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e4806e110 0x7f1e480705d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1e58005d00 tx=0x7f1e5800b410 comp rx=0 tx=0).stop 2024-08-19T01:25:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.413+0000 7f1e63286640 1 -- 172.21.15.17:0/3910602984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5c101670 msgr2=0x7f1e5c0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.413+0000 7f1e63286640 1 --2- 172.21.15.17:0/3910602984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5c101670 0x7f1e5c0feef0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1e5002aa50 tx=0x7f1e50032bb0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.413+0000 7f1e63286640 1 -- 172.21.15.17:0/3910602984 shutdown_connections 2024-08-19T01:25:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.413+0000 7f1e63286640 1 --2- 172.21.15.17:0/3910602984 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1e4806e110 0x7f1e480705d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.413+0000 7f1e63286640 1 --2- 172.21.15.17:0/3910602984 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1e5c101670 0x7f1e5c0feef0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.413+0000 7f1e63286640 1 --2- 172.21.15.17:0/3910602984 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1e5c100d50 0x7f1e5c0fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.413+0000 7f1e63286640 1 -- 172.21.15.17:0/3910602984 >> 172.21.15.17:0/3910602984 conn(0x7f1e5c0758a0 msgr2=0x7f1e5c101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.413+0000 7f1e63286640 1 -- 172.21.15.17:0/3910602984 shutdown_connections 2024-08-19T01:25:35.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.413+0000 7f1e63286640 1 -- 172.21.15.17:0/3910602984 wait complete. 2024-08-19T01:25:35.424 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:25:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.497+0000 7f8ee9803640 1 -- 172.21.15.17:0/940289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee40fe860 msgr2=0x7f8ee40fecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.497+0000 7f8ee9803640 1 --2- 172.21.15.17:0/940289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee40fe860 0x7f8ee40fecc0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009880 tx=0x7f8ed802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.497+0000 7f8ee9803640 1 -- 172.21.15.17:0/940289 shutdown_connections 2024-08-19T01:25:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.497+0000 7f8ee9803640 1 --2- 172.21.15.17:0/940289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee40fe860 0x7f8ee40fecc0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.497+0000 7f8ee9803640 1 --2- 172.21.15.17:0/940289 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee4104860 0x7f8ee4104c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.497+0000 7f8ee9803640 1 -- 172.21.15.17:0/940289 >> 172.21.15.17:0/940289 conn(0x7f8ee40fa540 msgr2=0x7f8ee40fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.497+0000 7f8ee9803640 1 -- 172.21.15.17:0/940289 shutdown_connections 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.497+0000 7f8ee9803640 1 -- 172.21.15.17:0/940289 wait complete. 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.497+0000 7f8ee9803640 1 Processor -- start 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee9803640 1 -- start start 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee9803640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee40fe860 0x7f8ee40faeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee9803640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee4104860 0x7f8ee40fb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee9803640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40fb930 con 0x7f8ee40fe860 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee9803640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40fbaa0 con 0x7f8ee4104860 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee40fe860 0x7f8ee40faeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee40fe860 0x7f8ee40faeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36292/0 (socket says 172.21.15.17:36292) 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee2ffd640 1 -- 172.21.15.17:0/1802102808 learned_addr learned my addr 172.21.15.17:0/1802102808 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee27fc640 1 --2- 172.21.15.17:0/1802102808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee4104860 0x7f8ee40fb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee2ffd640 1 -- 172.21.15.17:0/1802102808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee4104860 msgr2=0x7f8ee40fb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee2ffd640 1 --2- 172.21.15.17:0/1802102808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee4104860 0x7f8ee40fb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee2ffd640 1 -- 172.21.15.17:0/1802102808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8009560 con 0x7f8ee40fe860 2024-08-19T01:25:35.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.498+0000 7f8ee2ffd640 1 --2- 172.21.15.17:0/1802102808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee40fe860 0x7f8ee40faeb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400d6f0 tx=0x7f8ed400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.499+0000 7f8ee8801640 1 -- 172.21.15.17:0/1802102808 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed4009a30 con 0x7f8ee40fe860 2024-08-19T01:25:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.499+0000 7f8ee8801640 1 -- 172.21.15.17:0/1802102808 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ed40054e0 con 0x7f8ee40fe860 2024-08-19T01:25:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.499+0000 7f8ee8801640 1 -- 172.21.15.17:0/1802102808 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed4010460 con 0x7f8ee40fe860 2024-08-19T01:25:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.499+0000 7f8ee9803640 1 -- 172.21.15.17:0/1802102808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee41a1b10 con 0x7f8ee40fe860 2024-08-19T01:25:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.499+0000 7f8ee9803640 1 -- 172.21.15.17:0/1802102808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee41a1e70 con 0x7f8ee40fe860 2024-08-19T01:25:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.500+0000 7f8ee9803640 1 -- 172.21.15.17:0/1802102808 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee40fffa0 con 0x7f8ee40fe860 2024-08-19T01:25:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.500+0000 7f8ee8801640 1 -- 172.21.15.17:0/1802102808 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8ed4009b90 con 0x7f8ee40fe860 2024-08-19T01:25:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.501+0000 7f8ee8801640 1 --2- 172.21.15.17:0/1802102808 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8ecc06e170 0x7f8ecc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.501+0000 7f8ee8801640 1 -- 172.21.15.17:0/1802102808 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8ed408dc80 con 0x7f8ee40fe860 2024-08-19T01:25:35.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.501+0000 7f8ee27fc640 1 --2- 172.21.15.17:0/1802102808 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8ecc06e170 0x7f8ecc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:35.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.501+0000 7f8ee27fc640 1 --2- 172.21.15.17:0/1802102808 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8ecc06e170 0x7f8ecc070630 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8000c00 tx=0x7f8ed8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:35.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.505+0000 7f8ee8801640 1 -- 172.21.15.17:0/1802102808 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8ed4056fe0 con 0x7f8ee40fe860 2024-08-19T01:25:35.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.700+0000 7f8ee9803640 1 -- 172.21.15.17:0/1802102808 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ee40fc450 con 0x7f8ecc06e170 2024-08-19T01:25:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.701+0000 7f8ee8801640 1 -- 172.21.15.17:0/1802102808 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f8ee40fc450 con 0x7f8ecc06e170 2024-08-19T01:25:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.703+0000 7f8ee9803640 1 -- 172.21.15.17:0/1802102808 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8ecc06e170 msgr2=0x7f8ecc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.703+0000 7f8ee9803640 1 --2- 172.21.15.17:0/1802102808 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8ecc06e170 0x7f8ecc070630 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8000c00 tx=0x7f8ed8005a20 comp rx=0 tx=0).stop 2024-08-19T01:25:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.703+0000 7f8ee9803640 1 -- 172.21.15.17:0/1802102808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee40fe860 msgr2=0x7f8ee40faeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.703+0000 7f8ee9803640 1 --2- 172.21.15.17:0/1802102808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee40fe860 0x7f8ee40faeb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400d6f0 tx=0x7f8ed400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.703+0000 7f8ee9803640 1 -- 172.21.15.17:0/1802102808 shutdown_connections 2024-08-19T01:25:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.703+0000 7f8ee9803640 1 --2- 172.21.15.17:0/1802102808 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8ecc06e170 0x7f8ecc070630 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.703+0000 7f8ee9803640 1 --2- 172.21.15.17:0/1802102808 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8ee4104860 0x7f8ee40fb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.703+0000 7f8ee9803640 1 --2- 172.21.15.17:0/1802102808 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8ee40fe860 0x7f8ee40faeb0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.703+0000 7f8ee9803640 1 -- 172.21.15.17:0/1802102808 >> 172.21.15.17:0/1802102808 conn(0x7f8ee40fa540 msgr2=0x7f8ee4068990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.703+0000 7f8ee9803640 1 -- 172.21.15.17:0/1802102808 shutdown_connections 2024-08-19T01:25:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.703+0000 7f8ee9803640 1 -- 172.21.15.17:0/1802102808 wait complete. 2024-08-19T01:25:35.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.785+0000 7f55d771c640 1 -- 172.21.15.17:0/2193663647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fe880 msgr2=0x7f55d00fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.785+0000 7f55d771c640 1 --2- 172.21.15.17:0/2193663647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fe880 0x7f55d00fec60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009c20 tx=0x7f55c002a970 comp rx=0 tx=0).stop 2024-08-19T01:25:35.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.785+0000 7f55d771c640 1 -- 172.21.15.17:0/2193663647 shutdown_connections 2024-08-19T01:25:35.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.785+0000 7f55d771c640 1 --2- 172.21.15.17:0/2193663647 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d00ff230 0x7f55d010bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.785+0000 7f55d771c640 1 --2- 172.21.15.17:0/2193663647 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fe880 0x7f55d00fec60 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.785+0000 7f55d771c640 1 -- 172.21.15.17:0/2193663647 >> 172.21.15.17:0/2193663647 conn(0x7f55d00fa730 msgr2=0x7f55d00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:35.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.786+0000 7f55d771c640 1 -- 172.21.15.17:0/2193663647 shutdown_connections 2024-08-19T01:25:35.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.786+0000 7f55d771c640 1 -- 172.21.15.17:0/2193663647 wait complete. 2024-08-19T01:25:35.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.786+0000 7f55d771c640 1 Processor -- start 2024-08-19T01:25:35.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.786+0000 7f55d771c640 1 -- start start 2024-08-19T01:25:35.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.786+0000 7f55d771c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fe880 0x7f55d0197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:35.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.786+0000 7f55d771c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d00ff230 0x7f55d01981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:35.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.786+0000 7f55d771c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d01988c0 con 0x7f55d00fe880 2024-08-19T01:25:35.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.786+0000 7f55d771c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d019b530 con 0x7f55d00ff230 2024-08-19T01:25:35.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55d54b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fe880 0x7f55d0197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:35.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55d54b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fe880 0x7f55d0197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36302/0 (socket says 172.21.15.17:36302) 2024-08-19T01:25:35.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55d54b8640 1 -- 172.21.15.17:0/3923647086 learned_addr learned my addr 172.21.15.17:0/3923647086 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:35.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55d54b8640 1 -- 172.21.15.17:0/3923647086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d00ff230 msgr2=0x7f55d01981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55d54b8640 1 --2- 172.21.15.17:0/3923647086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d00ff230 0x7f55d01981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55d54b8640 1 -- 172.21.15.17:0/3923647086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c0009900 con 0x7f55d00fe880 2024-08-19T01:25:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55d54b8640 1 --2- 172.21.15.17:0/3923647086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fe880 0x7f55d0197ca0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f55c002ae90 tx=0x7f55c0030880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55ce7fc640 1 -- 172.21.15.17:0/3923647086 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c002f3c0 con 0x7f55d00fe880 2024-08-19T01:25:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55ce7fc640 1 -- 172.21.15.17:0/3923647086 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55c002f9e0 con 0x7f55d00fe880 2024-08-19T01:25:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55d771c640 1 -- 172.21.15.17:0/3923647086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d019b810 con 0x7f55d00fe880 2024-08-19T01:25:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55ce7fc640 1 -- 172.21.15.17:0/3923647086 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c0039450 con 0x7f55d00fe880 2024-08-19T01:25:35.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.787+0000 7f55d771c640 1 -- 172.21.15.17:0/3923647086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d019bd60 con 0x7f55d00fe880 2024-08-19T01:25:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.788+0000 7f55d771c640 1 -- 172.21.15.17:0/3923647086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d0068d30 con 0x7f55d00fe880 2024-08-19T01:25:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.789+0000 7f55ce7fc640 1 -- 172.21.15.17:0/3923647086 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f55c000a040 con 0x7f55d00fe880 2024-08-19T01:25:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.789+0000 7f55ce7fc640 1 --2- 172.21.15.17:0/3923647086 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e170 0x7f55b8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.790+0000 7f55d4cb7640 1 --2- 172.21.15.17:0/3923647086 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e170 0x7f55b8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.790+0000 7f55ce7fc640 1 -- 172.21.15.17:0/3923647086 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f55c002c040 con 0x7f55d00fe880 2024-08-19T01:25:35.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.790+0000 7f55d4cb7640 1 --2- 172.21.15.17:0/3923647086 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e170 0x7f55b8070630 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f55c4005fd0 tx=0x7f55c4005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:35.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.794+0000 7f55ce7fc640 1 -- 172.21.15.17:0/3923647086 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f55c00788b0 con 0x7f55d00fe880 2024-08-19T01:25:35.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.980+0000 7f55d771c640 1 -- 172.21.15.17:0/3923647086 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f55d010ef70 con 0x7f55b806e170 2024-08-19T01:25:35.982 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:35 smithi017 ceph-mon[99370]: pgmap v805: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:35.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.989+0000 7f55ce7fc640 1 -- 172.21.15.17:0/3923647086 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f55d010ef70 con 0x7f55b806e170 2024-08-19T01:25:35.991 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:25:35.991 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (26m) 5m ago 37m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:25:35.991 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (37m) 5m ago 37m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:25:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (36m) 5m ago 36m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:25:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (24m) 5m ago 37m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:25:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (24m) 5m ago 36m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:25:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (26m) 5m ago 37m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:25:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (20m) 5m ago 32m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:25:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (21m) 5m ago 32m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:25:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (5m) 5m ago 32m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:25:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (20m) 5m ago 32m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:25:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (28m) 5m ago 38m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:25:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (27m) 5m ago 36m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:25:35.992 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (25m) 5m ago 39m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:25:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (25m) 5m ago 36m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:25:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (27m) 5m ago 37m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:25:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (27m) 5m ago 36m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:25:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (24m) 5m ago 35m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:25:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (23m) 5m ago 35m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:25:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (23m) 5m ago 34m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:25:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (22m) 5m ago 34m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:25:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (21m) 5m ago 34m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:25:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (21m) 5m ago 33m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:25:35.993 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (27m) 5m ago 37m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:25:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.991+0000 7f55d771c640 1 -- 172.21.15.17:0/3923647086 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e170 msgr2=0x7f55b8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.991+0000 7f55d771c640 1 --2- 172.21.15.17:0/3923647086 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e170 0x7f55b8070630 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f55c4005fd0 tx=0x7f55c4005850 comp rx=0 tx=0).stop 2024-08-19T01:25:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.991+0000 7f55d771c640 1 -- 172.21.15.17:0/3923647086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fe880 msgr2=0x7f55d0197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.991+0000 7f55d771c640 1 --2- 172.21.15.17:0/3923647086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fe880 0x7f55d0197ca0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f55c002ae90 tx=0x7f55c0030880 comp rx=0 tx=0).stop 2024-08-19T01:25:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.991+0000 7f55d771c640 1 -- 172.21.15.17:0/3923647086 shutdown_connections 2024-08-19T01:25:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.991+0000 7f55d771c640 1 --2- 172.21.15.17:0/3923647086 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e170 0x7f55b8070630 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.991+0000 7f55d771c640 1 --2- 172.21.15.17:0/3923647086 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d00ff230 0x7f55d01981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.991+0000 7f55d771c640 1 --2- 172.21.15.17:0/3923647086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fe880 0x7f55d0197ca0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.991+0000 7f55d771c640 1 -- 172.21.15.17:0/3923647086 >> 172.21.15.17:0/3923647086 conn(0x7f55d00fa730 msgr2=0x7f55d00fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.991+0000 7f55d771c640 1 -- 172.21.15.17:0/3923647086 shutdown_connections 2024-08-19T01:25:35.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:35.991+0000 7f55d771c640 1 -- 172.21.15.17:0/3923647086 wait complete. 2024-08-19T01:25:36.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.073+0000 7f5c6af1e640 1 -- 172.21.15.17:0/360651358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c64104a30 msgr2=0x7f5c64104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.073+0000 7f5c6af1e640 1 --2- 172.21.15.17:0/360651358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c64104a30 0x7f5c64104e10 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009c20 tx=0x7f5c5402a970 comp rx=0 tx=0).stop 2024-08-19T01:25:36.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.073+0000 7f5c6af1e640 1 -- 172.21.15.17:0/360651358 shutdown_connections 2024-08-19T01:25:36.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.073+0000 7f5c6af1e640 1 --2- 172.21.15.17:0/360651358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c640fea30 0x7f5c640fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.073+0000 7f5c6af1e640 1 --2- 172.21.15.17:0/360651358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c64104a30 0x7f5c64104e10 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.073+0000 7f5c6af1e640 1 -- 172.21.15.17:0/360651358 >> 172.21.15.17:0/360651358 conn(0x7f5c640fa730 msgr2=0x7f5c640fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:36.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.073+0000 7f5c6af1e640 1 -- 172.21.15.17:0/360651358 shutdown_connections 2024-08-19T01:25:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.073+0000 7f5c6af1e640 1 -- 172.21.15.17:0/360651358 wait complete. 2024-08-19T01:25:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.074+0000 7f5c6af1e640 1 Processor -- start 2024-08-19T01:25:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.074+0000 7f5c6af1e640 1 -- start start 2024-08-19T01:25:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.074+0000 7f5c6af1e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c640fea30 0x7f5c64194770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.074+0000 7f5c6af1e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c64104a30 0x7f5c64194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:36.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.074+0000 7f5c6af1e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c641951f0 con 0x7f5c640fea30 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.074+0000 7f5c6af1e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64195360 con 0x7f5c64104a30 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.074+0000 7f5c68cba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c640fea30 0x7f5c64194770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.074+0000 7f5c68cba640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c640fea30 0x7f5c64194770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36326/0 (socket says 172.21.15.17:36326) 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.074+0000 7f5c68cba640 1 -- 172.21.15.17:0/3830337020 learned_addr learned my addr 172.21.15.17:0/3830337020 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.074+0000 7f5c63fff640 1 --2- 172.21.15.17:0/3830337020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c64104a30 0x7f5c64194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.075+0000 7f5c68cba640 1 -- 172.21.15.17:0/3830337020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c64104a30 msgr2=0x7f5c64194cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.075+0000 7f5c68cba640 1 --2- 172.21.15.17:0/3830337020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c64104a30 0x7f5c64194cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.075+0000 7f5c68cba640 1 -- 172.21.15.17:0/3830337020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54009900 con 0x7f5c640fea30 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.075+0000 7f5c68cba640 1 --2- 172.21.15.17:0/3830337020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c640fea30 0x7f5c64194770 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5c5402ae90 tx=0x7f5c54030880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.075+0000 7f5c61ffb640 1 -- 172.21.15.17:0/3830337020 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c5402f3c0 con 0x7f5c640fea30 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.075+0000 7f5c61ffb640 1 -- 172.21.15.17:0/3830337020 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c5402f9e0 con 0x7f5c640fea30 2024-08-19T01:25:36.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.075+0000 7f5c6af1e640 1 -- 172.21.15.17:0/3830337020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c641955e0 con 0x7f5c640fea30 2024-08-19T01:25:36.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.075+0000 7f5c61ffb640 1 -- 172.21.15.17:0/3830337020 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c54039450 con 0x7f5c640fea30 2024-08-19T01:25:36.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.075+0000 7f5c6af1e640 1 -- 172.21.15.17:0/3830337020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c641a2000 con 0x7f5c640fea30 2024-08-19T01:25:36.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.076+0000 7f5c6af1e640 1 -- 172.21.15.17:0/3830337020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c64100170 con 0x7f5c640fea30 2024-08-19T01:25:36.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.077+0000 7f5c61ffb640 1 -- 172.21.15.17:0/3830337020 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5c5400a040 con 0x7f5c640fea30 2024-08-19T01:25:36.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.077+0000 7f5c61ffb640 1 --2- 172.21.15.17:0/3830337020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c5006e170 0x7f5c50070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:36.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.077+0000 7f5c61ffb640 1 -- 172.21.15.17:0/3830337020 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5c5402c040 con 0x7f5c640fea30 2024-08-19T01:25:36.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.077+0000 7f5c63fff640 1 --2- 172.21.15.17:0/3830337020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c5006e170 0x7f5c50070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:36.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.078+0000 7f5c63fff640 1 --2- 172.21.15.17:0/3830337020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c5006e170 0x7f5c50070630 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5c64068d40 tx=0x7f5c4c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:36.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.081+0000 7f5c61ffb640 1 -- 172.21.15.17:0/3830337020 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5c540786a0 con 0x7f5c640fea30 2024-08-19T01:25:36.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:35 smithi086 ceph-mon[71303]: pgmap v805: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:36.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.323+0000 7f5c6af1e640 1 -- 172.21.15.17:0/3830337020 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c641955e0 con 0x7f5c640fea30 2024-08-19T01:25:36.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.324+0000 7f5c61ffb640 1 -- 172.21.15.17:0/3830337020 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f5c641955e0 con 0x7f5c640fea30 2024-08-19T01:25:36.326 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:25:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:25:36.326 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:25:36.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:25:36.328 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:25:36.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.326+0000 7f5c6af1e640 1 -- 172.21.15.17:0/3830337020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c5006e170 msgr2=0x7f5c50070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.326+0000 7f5c6af1e640 1 --2- 172.21.15.17:0/3830337020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c5006e170 0x7f5c50070630 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5c64068d40 tx=0x7f5c4c00b390 comp rx=0 tx=0).stop 2024-08-19T01:25:36.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.326+0000 7f5c6af1e640 1 -- 172.21.15.17:0/3830337020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c640fea30 msgr2=0x7f5c64194770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.326+0000 7f5c6af1e640 1 --2- 172.21.15.17:0/3830337020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c640fea30 0x7f5c64194770 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f5c5402ae90 tx=0x7f5c54030880 comp rx=0 tx=0).stop 2024-08-19T01:25:36.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.326+0000 7f5c6af1e640 1 -- 172.21.15.17:0/3830337020 shutdown_connections 2024-08-19T01:25:36.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.326+0000 7f5c6af1e640 1 --2- 172.21.15.17:0/3830337020 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c5006e170 0x7f5c50070630 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.326+0000 7f5c6af1e640 1 --2- 172.21.15.17:0/3830337020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c64104a30 0x7f5c64194cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.326+0000 7f5c6af1e640 1 --2- 172.21.15.17:0/3830337020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c640fea30 0x7f5c64194770 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.326+0000 7f5c6af1e640 1 -- 172.21.15.17:0/3830337020 >> 172.21.15.17:0/3830337020 conn(0x7f5c640fa730 msgr2=0x7f5c640fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:36.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.326+0000 7f5c6af1e640 1 -- 172.21.15.17:0/3830337020 shutdown_connections 2024-08-19T01:25:36.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.326+0000 7f5c6af1e640 1 -- 172.21.15.17:0/3830337020 wait complete. 2024-08-19T01:25:36.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.408+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1625415270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec1049f0 msgr2=0x7fd6ec104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.408+0000 7fd6f1d4c640 1 --2- 172.21.15.17:0/1625415270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec1049f0 0x7fd6ec104dd0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009880 tx=0x7fd6dc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.409+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1625415270 shutdown_connections 2024-08-19T01:25:36.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.409+0000 7fd6f1d4c640 1 --2- 172.21.15.17:0/1625415270 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec0fe9f0 0x7fd6ec0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.409+0000 7fd6f1d4c640 1 --2- 172.21.15.17:0/1625415270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec1049f0 0x7fd6ec104dd0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.409+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1625415270 >> 172.21.15.17:0/1625415270 conn(0x7fd6ec0758a0 msgr2=0x7fd6ec0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:36.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.409+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1625415270 shutdown_connections 2024-08-19T01:25:36.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.409+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1625415270 wait complete. 2024-08-19T01:25:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.409+0000 7fd6f1d4c640 1 Processor -- start 2024-08-19T01:25:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.409+0000 7fd6f1d4c640 1 -- start start 2024-08-19T01:25:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6f1d4c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec0fe9f0 0x7fd6ec19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6f1d4c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec1049f0 0x7fd6ec19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6f1d4c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec195970 con 0x7fd6ec1049f0 2024-08-19T01:25:36.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6f1d4c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec195ab0 con 0x7fd6ec0fe9f0 2024-08-19T01:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6e2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec1049f0 0x7fd6ec19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6e2ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec1049f0 0x7fd6ec19be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36350/0 (socket says 172.21.15.17:36350) 2024-08-19T01:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6e2ffd640 1 -- 172.21.15.17:0/1121546875 learned_addr learned my addr 172.21.15.17:0/1121546875 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6eb7fe640 1 --2- 172.21.15.17:0/1121546875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec0fe9f0 0x7fd6ec19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6e2ffd640 1 -- 172.21.15.17:0/1121546875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec0fe9f0 msgr2=0x7fd6ec19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6e2ffd640 1 --2- 172.21.15.17:0/1121546875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec0fe9f0 0x7fd6ec19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6e2ffd640 1 -- 172.21.15.17:0/1121546875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc009560 con 0x7fd6ec1049f0 2024-08-19T01:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6e2ffd640 1 --2- 172.21.15.17:0/1121546875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec1049f0 0x7fd6ec19be50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c8f0 tx=0x7fd6d400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:36.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6e97fa640 1 -- 172.21.15.17:0/1121546875 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6d4007b80 con 0x7fd6ec1049f0 2024-08-19T01:25:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6e97fa640 1 -- 172.21.15.17:0/1121546875 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6d40054e0 con 0x7fd6ec1049f0 2024-08-19T01:25:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.410+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1121546875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec195d90 con 0x7fd6ec1049f0 2024-08-19T01:25:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.411+0000 7fd6e97fa640 1 -- 172.21.15.17:0/1121546875 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6d400f450 con 0x7fd6ec1049f0 2024-08-19T01:25:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.411+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1121546875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec1962e0 con 0x7fd6ec1049f0 2024-08-19T01:25:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.411+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1121546875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec100130 con 0x7fd6ec1049f0 2024-08-19T01:25:36.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.412+0000 7fd6e97fa640 1 -- 172.21.15.17:0/1121546875 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd6d4004f60 con 0x7fd6ec1049f0 2024-08-19T01:25:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.413+0000 7fd6e97fa640 1 --2- 172.21.15.17:0/1121546875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6d806e170 0x7fd6d8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.413+0000 7fd6eb7fe640 1 --2- 172.21.15.17:0/1121546875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6d806e170 0x7fd6d8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.413+0000 7fd6e97fa640 1 -- 172.21.15.17:0/1121546875 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd6d408de80 con 0x7fd6ec1049f0 2024-08-19T01:25:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.413+0000 7fd6eb7fe640 1 --2- 172.21.15.17:0/1121546875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6d806e170 0x7fd6d8070630 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009230 tx=0x7fd6dc0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:36.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.417+0000 7fd6e97fa640 1 -- 172.21.15.17:0/1121546875 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd6d4057290 con 0x7fd6ec1049f0 2024-08-19T01:25:36.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.632+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1121546875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd6ec1965b0 con 0x7fd6ec1049f0 2024-08-19T01:25:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.633+0000 7fd6e97fa640 1 -- 172.21.15.17:0/1121546875 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7fd6d401d020 con 0x7fd6ec1049f0 2024-08-19T01:25:36.635 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:25:36.635 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:25:36.635 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:25:36.635 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:25:36.635 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:25:36.635 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:25:36.635 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:25:36.636 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:25:36.637 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:25:36.638 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:25:36.638 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:25:36.638 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:25:36.638 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:25:36.638 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:25:36.638 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:25:36.638 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:25:36.638 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:25:36.638 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:25:36.638 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:25:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:25:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.635+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1121546875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6d806e170 msgr2=0x7fd6d8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.635+0000 7fd6f1d4c640 1 --2- 172.21.15.17:0/1121546875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6d806e170 0x7fd6d8070630 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009230 tx=0x7fd6dc0058d0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.635+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1121546875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec1049f0 msgr2=0x7fd6ec19be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.635+0000 7fd6f1d4c640 1 --2- 172.21.15.17:0/1121546875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec1049f0 0x7fd6ec19be50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c8f0 tx=0x7fd6d400cdb0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.635+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1121546875 shutdown_connections 2024-08-19T01:25:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.635+0000 7fd6f1d4c640 1 --2- 172.21.15.17:0/1121546875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd6d806e170 0x7fd6d8070630 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.635+0000 7fd6f1d4c640 1 --2- 172.21.15.17:0/1121546875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd6ec1049f0 0x7fd6ec19be50 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.635+0000 7fd6f1d4c640 1 --2- 172.21.15.17:0/1121546875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd6ec0fe9f0 0x7fd6ec19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.635+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1121546875 >> 172.21.15.17:0/1121546875 conn(0x7fd6ec0758a0 msgr2=0x7fd6ec0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.635+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1121546875 shutdown_connections 2024-08-19T01:25:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.635+0000 7fd6f1d4c640 1 -- 172.21.15.17:0/1121546875 wait complete. 2024-08-19T01:25:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.718+0000 7f45746c8640 1 -- 172.21.15.17:0/3846654922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f456c104a30 msgr2=0x7f456c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.718+0000 7f45746c8640 1 --2- 172.21.15.17:0/3846654922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f456c104a30 0x7f456c104e10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4568009880 tx=0x7f456802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.718+0000 7f45746c8640 1 -- 172.21.15.17:0/3846654922 shutdown_connections 2024-08-19T01:25:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.718+0000 7f45746c8640 1 --2- 172.21.15.17:0/3846654922 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f456c0fea30 0x7f456c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.718+0000 7f45746c8640 1 --2- 172.21.15.17:0/3846654922 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f456c104a30 0x7f456c104e10 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.718+0000 7f45746c8640 1 -- 172.21.15.17:0/3846654922 >> 172.21.15.17:0/3846654922 conn(0x7f456c0fa730 msgr2=0x7f456c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.718+0000 7f45746c8640 1 -- 172.21.15.17:0/3846654922 shutdown_connections 2024-08-19T01:25:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.718+0000 7f45746c8640 1 -- 172.21.15.17:0/3846654922 wait complete. 2024-08-19T01:25:36.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.718+0000 7f45746c8640 1 Processor -- start 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.718+0000 7f45746c8640 1 -- start start 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f45746c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f456c0fea30 0x7f456c0fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f45746c8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f456c104a30 0x7f456c0fb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f45746c8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c0fbad0 con 0x7f456c0fea30 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f45746c8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c0fbc10 con 0x7f456c104a30 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f4572464640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f456c0fea30 0x7f456c0fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f4572464640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f456c0fea30 0x7f456c0fb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60430/0 (socket says 172.21.15.17:60430) 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f4572464640 1 -- 172.21.15.17:0/1478540604 learned_addr learned my addr 172.21.15.17:0/1478540604 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f4571c63640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f456c104a30 0x7f456c0fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f4572464640 1 -- 172.21.15.17:0/1478540604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f456c104a30 msgr2=0x7f456c0fb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f4572464640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f456c104a30 0x7f456c0fb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f4572464640 1 -- 172.21.15.17:0/1478540604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4568009560 con 0x7f456c0fea30 2024-08-19T01:25:36.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f4571c63640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f456c104a30 0x7f456c0fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:25:36.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f4572464640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f456c0fea30 0x7f456c0fb050 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f456802a9c0 tx=0x7f45680055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:36.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f45637fe640 1 -- 172.21.15.17:0/1478540604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4568004aa0 con 0x7f456c0fea30 2024-08-19T01:25:36.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f45637fe640 1 -- 172.21.15.17:0/1478540604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4568004c00 con 0x7f456c0fea30 2024-08-19T01:25:36.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f45746c8640 1 -- 172.21.15.17:0/1478540604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c0fbe90 con 0x7f456c0fea30 2024-08-19T01:25:36.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.719+0000 7f45637fe640 1 -- 172.21.15.17:0/1478540604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4568003980 con 0x7f456c0fea30 2024-08-19T01:25:36.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.720+0000 7f45746c8640 1 -- 172.21.15.17:0/1478540604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c1a1fa0 con 0x7f456c0fea30 2024-08-19T01:25:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.721+0000 7f45746c8640 1 -- 172.21.15.17:0/1478540604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c100170 con 0x7f456c0fea30 2024-08-19T01:25:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.721+0000 7f45637fe640 1 -- 172.21.15.17:0/1478540604 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4568003bf0 con 0x7f456c0fea30 2024-08-19T01:25:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.722+0000 7f45637fe640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f455806e170 0x7f4558070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.722+0000 7f45637fe640 1 -- 172.21.15.17:0/1478540604 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f45680af210 con 0x7f456c0fea30 2024-08-19T01:25:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.722+0000 7f4571c63640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f455806e170 0x7f4558070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:36.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.722+0000 7f4571c63640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f455806e170 0x7f4558070630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f455c0058c0 tx=0x7f455c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:36.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.726+0000 7f45637fe640 1 -- 172.21.15.17:0/1478540604 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f45680784f0 con 0x7f456c0fea30 2024-08-19T01:25:36.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.918+0000 7f45746c8640 1 -- 172.21.15.17:0/1478540604 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f456c108000 con 0x7f455806e170 2024-08-19T01:25:36.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.920+0000 7f45637fe640 1 -- 172.21.15.17:0/1478540604 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f456c108000 con 0x7f455806e170 2024-08-19T01:25:36.922 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:25:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:25:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:25:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:25:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:25:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:25:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:25:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:25:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:25:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:25:36.922 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:25:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:25:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:25:36.923 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:25:36.923 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:25:36.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.922+0000 7f45746c8640 1 -- 172.21.15.17:0/1478540604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f455806e170 msgr2=0x7f4558070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.922+0000 7f45746c8640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f455806e170 0x7f4558070630 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f455c0058c0 tx=0x7f455c005850 comp rx=0 tx=0).stop 2024-08-19T01:25:36.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.922+0000 7f45746c8640 1 -- 172.21.15.17:0/1478540604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f456c0fea30 msgr2=0x7f456c0fb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:36.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.922+0000 7f45746c8640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f456c0fea30 0x7f456c0fb050 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f456802a9c0 tx=0x7f45680055a0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.922+0000 7f45746c8640 1 -- 172.21.15.17:0/1478540604 shutdown_connections 2024-08-19T01:25:36.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.922+0000 7f45746c8640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f455806e170 0x7f4558070630 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.922+0000 7f45746c8640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f456c104a30 0x7f456c0fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.922+0000 7f45746c8640 1 --2- 172.21.15.17:0/1478540604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f456c0fea30 0x7f456c0fb050 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:36.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.922+0000 7f45746c8640 1 -- 172.21.15.17:0/1478540604 >> 172.21.15.17:0/1478540604 conn(0x7f456c0fa730 msgr2=0x7f456c068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:36.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.922+0000 7f45746c8640 1 -- 172.21.15.17:0/1478540604 shutdown_connections 2024-08-19T01:25:36.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:36.922+0000 7f45746c8640 1 -- 172.21.15.17:0/1478540604 wait complete. 2024-08-19T01:25:37.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.004+0000 7fee9dbea640 1 -- 172.21.15.17:0/501389484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee981049f0 msgr2=0x7fee98104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:37.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.004+0000 7fee9dbea640 1 --2- 172.21.15.17:0/501389484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee981049f0 0x7fee98104dd0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fee88009880 tx=0x7fee8802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:25:37.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.005+0000 7fee9dbea640 1 -- 172.21.15.17:0/501389484 shutdown_connections 2024-08-19T01:25:37.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.005+0000 7fee9dbea640 1 --2- 172.21.15.17:0/501389484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee980fe9f0 0x7fee980fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:37.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.005+0000 7fee9dbea640 1 --2- 172.21.15.17:0/501389484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee981049f0 0x7fee98104dd0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:37.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.005+0000 7fee9dbea640 1 -- 172.21.15.17:0/501389484 >> 172.21.15.17:0/501389484 conn(0x7fee980758a0 msgr2=0x7fee980fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:37.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.005+0000 7fee9dbea640 1 -- 172.21.15.17:0/501389484 shutdown_connections 2024-08-19T01:25:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.005+0000 7fee9dbea640 1 -- 172.21.15.17:0/501389484 wait complete. 2024-08-19T01:25:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.005+0000 7fee9dbea640 1 Processor -- start 2024-08-19T01:25:37.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.005+0000 7fee9dbea640 1 -- start start 2024-08-19T01:25:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.005+0000 7fee9dbea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee980fe9f0 0x7fee9819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee9dbea640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee981049f0 0x7fee9819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee9dbea640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee98195890 con 0x7fee980fe9f0 2024-08-19T01:25:37.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee9dbea640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee981959d0 con 0x7fee981049f0 2024-08-19T01:25:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee977fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee980fe9f0 0x7fee9819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee977fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee980fe9f0 0x7fee9819b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60440/0 (socket says 172.21.15.17:60440) 2024-08-19T01:25:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee977fe640 1 -- 172.21.15.17:0/3423855242 learned_addr learned my addr 172.21.15.17:0/3423855242 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:25:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee8effd640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee981049f0 0x7fee9819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee977fe640 1 -- 172.21.15.17:0/3423855242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee981049f0 msgr2=0x7fee9819bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee977fe640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee981049f0 0x7fee9819bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee977fe640 1 -- 172.21.15.17:0/3423855242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88009560 con 0x7fee980fe9f0 2024-08-19T01:25:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee8effd640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee981049f0 0x7fee9819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:25:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee977fe640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee980fe9f0 0x7fee9819b830 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fee88006010 tx=0x7fee880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee957fa640 1 -- 172.21.15.17:0/3423855242 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee88004aa0 con 0x7fee980fe9f0 2024-08-19T01:25:37.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee9dbea640 1 -- 172.21.15.17:0/3423855242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee98195c50 con 0x7fee980fe9f0 2024-08-19T01:25:37.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee957fa640 1 -- 172.21.15.17:0/3423855242 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fee88031470 con 0x7fee980fe9f0 2024-08-19T01:25:37.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee957fa640 1 -- 172.21.15.17:0/3423855242 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee88003940 con 0x7fee980fe9f0 2024-08-19T01:25:37.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.006+0000 7fee9dbea640 1 -- 172.21.15.17:0/3423855242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee98196140 con 0x7fee980fe9f0 2024-08-19T01:25:37.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.007+0000 7fee9dbea640 1 -- 172.21.15.17:0/3423855242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee98100130 con 0x7fee980fe9f0 2024-08-19T01:25:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.008+0000 7fee957fa640 1 -- 172.21.15.17:0/3423855242 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fee88031b90 con 0x7fee980fe9f0 2024-08-19T01:25:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.008+0000 7fee957fa640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fee8406e180 0x7fee84070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:25:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.009+0000 7fee957fa640 1 -- 172.21.15.17:0/3423855242 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fee880af1e0 con 0x7fee980fe9f0 2024-08-19T01:25:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.009+0000 7fee8effd640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fee8406e180 0x7fee84070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:25:37.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.009+0000 7fee8effd640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fee8406e180 0x7fee84070640 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fee981970e0 tx=0x7fee80005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:25:37.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.013+0000 7fee957fa640 1 -- 172.21.15.17:0/3423855242 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fee88078540 con 0x7fee980fe9f0 2024-08-19T01:25:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:36 smithi017 ceph-mon[99370]: from='client.35494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:36 smithi017 ceph-mon[99370]: from='client.35498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:36 smithi017 ceph-mon[99370]: from='client.35502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:36 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3830337020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:25:37.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:36 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1121546875' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:25:37.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.260+0000 7fee9dbea640 1 -- 172.21.15.17:0/3423855242 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fee980fee50 con 0x7fee980fe9f0 2024-08-19T01:25:37.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.261+0000 7fee957fa640 1 -- 172.21.15.17:0/3423855242 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7fee88004c00 con 0x7fee980fe9f0 2024-08-19T01:25:37.263 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:25:37.263 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:25:37.263 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:25:37.263 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:25:37.264 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:25:37.264 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:25:37.264 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:25:37.264 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:25:37.264 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:25:37.264 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:25:37.264 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:25:37.264 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:25:37.264 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:25:37.265 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:25:37.265 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:25:37.265 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:25:37.265 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:25:37.265 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:25:37.265 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:25:37.265 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:25:37.265 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:25:37.265 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:25:37.265 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:25:37.266 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:25:37.266 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:25:37.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.263+0000 7fee9dbea640 1 -- 172.21.15.17:0/3423855242 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fee8406e180 msgr2=0x7fee84070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.263+0000 7fee9dbea640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fee8406e180 0x7fee84070640 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fee981970e0 tx=0x7fee80005e50 comp rx=0 tx=0).stop 2024-08-19T01:25:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.263+0000 7fee9dbea640 1 -- 172.21.15.17:0/3423855242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee980fe9f0 msgr2=0x7fee9819b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:25:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.263+0000 7fee9dbea640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee980fe9f0 0x7fee9819b830 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fee88006010 tx=0x7fee880055a0 comp rx=0 tx=0).stop 2024-08-19T01:25:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.263+0000 7fee9dbea640 1 -- 172.21.15.17:0/3423855242 shutdown_connections 2024-08-19T01:25:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.263+0000 7fee9dbea640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fee8406e180 0x7fee84070640 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.263+0000 7fee9dbea640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fee981049f0 0x7fee9819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.263+0000 7fee9dbea640 1 --2- 172.21.15.17:0/3423855242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fee980fe9f0 0x7fee9819b830 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:25:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.263+0000 7fee9dbea640 1 -- 172.21.15.17:0/3423855242 >> 172.21.15.17:0/3423855242 conn(0x7fee980758a0 msgr2=0x7fee98067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:25:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.263+0000 7fee9dbea640 1 -- 172.21.15.17:0/3423855242 shutdown_connections 2024-08-19T01:25:37.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:25:37.263+0000 7fee9dbea640 1 -- 172.21.15.17:0/3423855242 wait complete. 2024-08-19T01:25:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:36 smithi086 ceph-mon[71303]: from='client.35494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:36 smithi086 ceph-mon[71303]: from='client.35498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:36 smithi086 ceph-mon[71303]: from='client.35502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:36 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3830337020' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:25:37.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:36 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1121546875' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:25:38.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:37 smithi017 ceph-mon[99370]: pgmap v806: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:38.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:37 smithi017 ceph-mon[99370]: from='client.35514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:38.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:37 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3423855242' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:25:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:37 smithi086 ceph-mon[71303]: pgmap v806: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:37 smithi086 ceph-mon[71303]: from='client.35514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:25:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:37 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3423855242' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:25:40.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:39 smithi017 ceph-mon[99370]: pgmap v807: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:40.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:39 smithi086 ceph-mon[71303]: pgmap v807: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:41 smithi017 ceph-mon[99370]: pgmap v808: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:41 smithi086 ceph-mon[71303]: pgmap v808: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:44.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:43 smithi017 ceph-mon[99370]: pgmap v809: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:44.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:43 smithi086 ceph-mon[71303]: pgmap v809: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:45 smithi017 ceph-mon[99370]: pgmap v810: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:46.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:45 smithi086 ceph-mon[71303]: pgmap v810: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:47 smithi017 ceph-mon[99370]: pgmap v811: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:47 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:25:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:47 smithi086 ceph-mon[71303]: pgmap v811: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:47 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:25:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:49 smithi017 ceph-mon[99370]: pgmap v812: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:49 smithi086 ceph-mon[71303]: pgmap v812: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:52.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:51 smithi017 ceph-mon[99370]: pgmap v813: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:52.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:51 smithi086 ceph-mon[71303]: pgmap v813: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:54.247 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:53 smithi086 ceph-mon[71303]: pgmap v814: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:53 smithi017 ceph-mon[99370]: pgmap v814: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:56.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:55 smithi017 ceph-mon[99370]: pgmap v815: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:56.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:55 smithi086 ceph-mon[71303]: pgmap v815: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:57 smithi017 ceph-mon[99370]: pgmap v816: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:25:58.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:57 smithi086 ceph-mon[71303]: pgmap v816: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:00.364 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:25:59 smithi086 ceph-mon[71303]: pgmap v817: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:25:59 smithi017 ceph-mon[99370]: pgmap v817: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:01 smithi017 ceph-mon[99370]: pgmap v818: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:02.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:01 smithi086 ceph-mon[71303]: pgmap v818: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:03.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:02 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:26:03.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:02 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:26:04.334 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:03 smithi017 ceph-mon[99370]: pgmap v819: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:04.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:03 smithi086 ceph-mon[71303]: pgmap v819: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:06.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:05 smithi017 ceph-mon[99370]: pgmap v820: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:06.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:05 smithi086 ceph-mon[71303]: pgmap v820: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.359+0000 7fd01d121640 1 -- 172.21.15.17:0/861547552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0180ffda0 msgr2=0x7fd018100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.359+0000 7fd01d121640 1 --2- 172.21.15.17:0/861547552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0180ffda0 0x7fd018100180 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd008009880 tx=0x7fd00802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.359+0000 7fd01d121640 1 -- 172.21.15.17:0/861547552 shutdown_connections 2024-08-19T01:26:07.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.359+0000 7fd01d121640 1 --2- 172.21.15.17:0/861547552 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd018100750 0x7fd0181047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.359+0000 7fd01d121640 1 --2- 172.21.15.17:0/861547552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd0180ffda0 0x7fd018100180 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.359+0000 7fd01d121640 1 -- 172.21.15.17:0/861547552 >> 172.21.15.17:0/861547552 conn(0x7fd0180fb840 msgr2=0x7fd0180fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:07.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.359+0000 7fd01d121640 1 -- 172.21.15.17:0/861547552 shutdown_connections 2024-08-19T01:26:07.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.359+0000 7fd01d121640 1 -- 172.21.15.17:0/861547552 wait complete. 2024-08-19T01:26:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.360+0000 7fd01d121640 1 Processor -- start 2024-08-19T01:26:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.360+0000 7fd01d121640 1 -- start start 2024-08-19T01:26:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.360+0000 7fd01d121640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0180ffda0 0x7fd0180727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.360+0000 7fd01d121640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd018100750 0x7fd018072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.360+0000 7fd01d121640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd018073230 con 0x7fd018100750 2024-08-19T01:26:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.360+0000 7fd01d121640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd018073370 con 0x7fd0180ffda0 2024-08-19T01:26:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.361+0000 7fd01659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd018100750 0x7fd018072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.361+0000 7fd01659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd018100750 0x7fd018072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39434/0 (socket says 172.21.15.17:39434) 2024-08-19T01:26:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.361+0000 7fd01659c640 1 -- 172.21.15.17:0/3974100681 learned_addr learned my addr 172.21.15.17:0/3974100681 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.361+0000 7fd016d9d640 1 --2- 172.21.15.17:0/3974100681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0180ffda0 0x7fd0180727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.361+0000 7fd01659c640 1 -- 172.21.15.17:0/3974100681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0180ffda0 msgr2=0x7fd0180727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.361+0000 7fd01659c640 1 --2- 172.21.15.17:0/3974100681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0180ffda0 0x7fd0180727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.361+0000 7fd01659c640 1 -- 172.21.15.17:0/3974100681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd008009560 con 0x7fd018100750 2024-08-19T01:26:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.361+0000 7fd01659c640 1 --2- 172.21.15.17:0/3974100681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd018100750 0x7fd018072cf0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd00000d6f0 tx=0x7fd00000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.362+0000 7fd00ffff640 1 -- 172.21.15.17:0/3974100681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd000009a30 con 0x7fd018100750 2024-08-19T01:26:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.362+0000 7fd01d121640 1 -- 172.21.15.17:0/3974100681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0181a1db0 con 0x7fd018100750 2024-08-19T01:26:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.362+0000 7fd00ffff640 1 -- 172.21.15.17:0/3974100681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0000054e0 con 0x7fd018100750 2024-08-19T01:26:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.362+0000 7fd00ffff640 1 -- 172.21.15.17:0/3974100681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd000010460 con 0x7fd018100750 2024-08-19T01:26:07.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.362+0000 7fd01d121640 1 -- 172.21.15.17:0/3974100681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0181a21c0 con 0x7fd018100750 2024-08-19T01:26:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.363+0000 7fd01d121640 1 -- 172.21.15.17:0/3974100681 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd018101280 con 0x7fd018100750 2024-08-19T01:26:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.363+0000 7fd00ffff640 1 -- 172.21.15.17:0/3974100681 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd000009b90 con 0x7fd018100750 2024-08-19T01:26:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.364+0000 7fd00ffff640 1 --2- 172.21.15.17:0/3974100681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd00406e170 0x7fd004070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.364+0000 7fd00ffff640 1 -- 172.21.15.17:0/3974100681 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd00008dc80 con 0x7fd018100750 2024-08-19T01:26:07.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.364+0000 7fd016d9d640 1 --2- 172.21.15.17:0/3974100681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd00406e170 0x7fd004070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.364+0000 7fd016d9d640 1 --2- 172.21.15.17:0/3974100681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd00406e170 0x7fd004070630 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd008009230 tx=0x7fd0080058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:07.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.368+0000 7fd00ffff640 1 -- 172.21.15.17:0/3974100681 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd000057010 con 0x7fd018100750 2024-08-19T01:26:07.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.560+0000 7fd01d121640 1 -- 172.21.15.17:0/3974100681 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd018073530 con 0x7fd00406e170 2024-08-19T01:26:07.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.561+0000 7fd00ffff640 1 -- 172.21.15.17:0/3974100681 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd018073530 con 0x7fd00406e170 2024-08-19T01:26:07.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.563+0000 7fd01d121640 1 -- 172.21.15.17:0/3974100681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd00406e170 msgr2=0x7fd004070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:07.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.563+0000 7fd01d121640 1 --2- 172.21.15.17:0/3974100681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd00406e170 0x7fd004070630 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd008009230 tx=0x7fd0080058d0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.563+0000 7fd01d121640 1 -- 172.21.15.17:0/3974100681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd018100750 msgr2=0x7fd018072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:07.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.563+0000 7fd01d121640 1 --2- 172.21.15.17:0/3974100681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd018100750 0x7fd018072cf0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd00000d6f0 tx=0x7fd00000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.563+0000 7fd01d121640 1 -- 172.21.15.17:0/3974100681 shutdown_connections 2024-08-19T01:26:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.563+0000 7fd01d121640 1 --2- 172.21.15.17:0/3974100681 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd00406e170 0x7fd004070630 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.563+0000 7fd01d121640 1 --2- 172.21.15.17:0/3974100681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd018100750 0x7fd018072cf0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.563+0000 7fd01d121640 1 --2- 172.21.15.17:0/3974100681 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd0180ffda0 0x7fd0180727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.563+0000 7fd01d121640 1 -- 172.21.15.17:0/3974100681 >> 172.21.15.17:0/3974100681 conn(0x7fd0180fb840 msgr2=0x7fd0180fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.563+0000 7fd01d121640 1 -- 172.21.15.17:0/3974100681 shutdown_connections 2024-08-19T01:26:07.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.563+0000 7fd01d121640 1 -- 172.21.15.17:0/3974100681 wait complete. 2024-08-19T01:26:07.574 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:26:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.647+0000 7f2b05cf6640 1 -- 172.21.15.17:0/4276340960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b00101670 msgr2=0x7f2b00109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.647+0000 7f2b05cf6640 1 --2- 172.21.15.17:0/4276340960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b00101670 0x7f2b00109b60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8009880 tx=0x7f2ae802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.647+0000 7f2b05cf6640 1 -- 172.21.15.17:0/4276340960 shutdown_connections 2024-08-19T01:26:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.647+0000 7f2b05cf6640 1 --2- 172.21.15.17:0/4276340960 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b00101670 0x7f2b00109b60 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.647+0000 7f2b05cf6640 1 --2- 172.21.15.17:0/4276340960 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b00100d50 0x7f2b00101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.647+0000 7f2b05cf6640 1 -- 172.21.15.17:0/4276340960 >> 172.21.15.17:0/4276340960 conn(0x7f2b000fa730 msgr2=0x7f2b000fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.647+0000 7f2b05cf6640 1 -- 172.21.15.17:0/4276340960 shutdown_connections 2024-08-19T01:26:07.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.647+0000 7f2b05cf6640 1 -- 172.21.15.17:0/4276340960 wait complete. 2024-08-19T01:26:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.647+0000 7f2b05cf6640 1 Processor -- start 2024-08-19T01:26:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.647+0000 7f2b05cf6640 1 -- start start 2024-08-19T01:26:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2b05cf6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b00100d50 0x7f2b0019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2b05cf6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b00101670 0x7f2b0019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2b05cf6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0019c380 con 0x7f2b00100d50 2024-08-19T01:26:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2b05cf6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00195910 con 0x7f2b00101670 2024-08-19T01:26:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2aff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b00100d50 0x7f2b0019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:07.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2aff7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b00100d50 0x7f2b0019b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39442/0 (socket says 172.21.15.17:39442) 2024-08-19T01:26:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2aff7fe640 1 -- 172.21.15.17:0/3403673871 learned_addr learned my addr 172.21.15.17:0/3403673871 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2af6ffd640 1 --2- 172.21.15.17:0/3403673871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b00101670 0x7f2b0019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2aff7fe640 1 -- 172.21.15.17:0/3403673871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b00101670 msgr2=0x7f2b0019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2aff7fe640 1 --2- 172.21.15.17:0/3403673871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b00101670 0x7f2b0019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2aff7fe640 1 -- 172.21.15.17:0/3403673871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae8009560 con 0x7f2b00100d50 2024-08-19T01:26:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.648+0000 7f2aff7fe640 1 --2- 172.21.15.17:0/3403673871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b00100d50 0x7f2b0019b820 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e970 tx=0x7f2af000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.649+0000 7f2afd7fa640 1 -- 172.21.15.17:0/3403673871 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af000cc90 con 0x7f2b00100d50 2024-08-19T01:26:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.649+0000 7f2afd7fa640 1 -- 172.21.15.17:0/3403673871 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2af000cdf0 con 0x7f2b00100d50 2024-08-19T01:26:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.649+0000 7f2afd7fa640 1 -- 172.21.15.17:0/3403673871 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af0010430 con 0x7f2b00100d50 2024-08-19T01:26:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.649+0000 7f2b05cf6640 1 -- 172.21.15.17:0/3403673871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b00195bf0 con 0x7f2b00100d50 2024-08-19T01:26:07.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.649+0000 7f2b05cf6640 1 -- 172.21.15.17:0/3403673871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b00196110 con 0x7f2b00100d50 2024-08-19T01:26:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.650+0000 7f2b05cf6640 1 -- 172.21.15.17:0/3403673871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b00068cd0 con 0x7f2b00100d50 2024-08-19T01:26:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.651+0000 7f2afd7fa640 1 -- 172.21.15.17:0/3403673871 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2af0004f50 con 0x7f2b00100d50 2024-08-19T01:26:07.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.651+0000 7f2afd7fa640 1 --2- 172.21.15.17:0/3403673871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aec06df70 0x7f2aec070430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.652+0000 7f2afd7fa640 1 -- 172.21.15.17:0/3403673871 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2af0014070 con 0x7f2b00100d50 2024-08-19T01:26:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.652+0000 7f2af6ffd640 1 --2- 172.21.15.17:0/3403673871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aec06df70 0x7f2aec070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:07.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.652+0000 7f2af6ffd640 1 --2- 172.21.15.17:0/3403673871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aec06df70 0x7f2aec070430 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000c00 tx=0x7f2ae8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:07.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.656+0000 7f2afd7fa640 1 -- 172.21.15.17:0/3403673871 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2af0057a90 con 0x7f2b00100d50 2024-08-19T01:26:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.847+0000 7f2b05cf6640 1 -- 172.21.15.17:0/3403673871 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b0010cd70 con 0x7f2aec06df70 2024-08-19T01:26:07.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.848+0000 7f2afd7fa640 1 -- 172.21.15.17:0/3403673871 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2b0010cd70 con 0x7f2aec06df70 2024-08-19T01:26:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.850+0000 7f2b05cf6640 1 -- 172.21.15.17:0/3403673871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aec06df70 msgr2=0x7f2aec070430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.850+0000 7f2b05cf6640 1 --2- 172.21.15.17:0/3403673871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aec06df70 0x7f2aec070430 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000c00 tx=0x7f2ae8005a20 comp rx=0 tx=0).stop 2024-08-19T01:26:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.850+0000 7f2b05cf6640 1 -- 172.21.15.17:0/3403673871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b00100d50 msgr2=0x7f2b0019b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.850+0000 7f2b05cf6640 1 --2- 172.21.15.17:0/3403673871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b00100d50 0x7f2b0019b820 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e970 tx=0x7f2af000ed70 comp rx=0 tx=0).stop 2024-08-19T01:26:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.850+0000 7f2b05cf6640 1 -- 172.21.15.17:0/3403673871 shutdown_connections 2024-08-19T01:26:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.850+0000 7f2b05cf6640 1 --2- 172.21.15.17:0/3403673871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2aec06df70 0x7f2aec070430 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.850+0000 7f2b05cf6640 1 --2- 172.21.15.17:0/3403673871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2b00101670 0x7f2b0019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.850+0000 7f2b05cf6640 1 --2- 172.21.15.17:0/3403673871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2b00100d50 0x7f2b0019b820 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.850+0000 7f2b05cf6640 1 -- 172.21.15.17:0/3403673871 >> 172.21.15.17:0/3403673871 conn(0x7f2b000fa730 msgr2=0x7f2b00101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:07.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.850+0000 7f2b05cf6640 1 -- 172.21.15.17:0/3403673871 shutdown_connections 2024-08-19T01:26:07.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.850+0000 7f2b05cf6640 1 -- 172.21.15.17:0/3403673871 wait complete. 2024-08-19T01:26:07.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.932+0000 7fda64d99640 1 -- 172.21.15.17:0/3793673559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda601049f0 msgr2=0x7fda60104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:07.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.932+0000 7fda64d99640 1 --2- 172.21.15.17:0/3793673559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda601049f0 0x7fda60104dd0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fda50009c20 tx=0x7fda5002a970 comp rx=0 tx=0).stop 2024-08-19T01:26:07.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.933+0000 7fda64d99640 1 -- 172.21.15.17:0/3793673559 shutdown_connections 2024-08-19T01:26:07.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.933+0000 7fda64d99640 1 --2- 172.21.15.17:0/3793673559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fe9f0 0x7fda600fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.933+0000 7fda64d99640 1 --2- 172.21.15.17:0/3793673559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda601049f0 0x7fda60104dd0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.933+0000 7fda64d99640 1 -- 172.21.15.17:0/3793673559 >> 172.21.15.17:0/3793673559 conn(0x7fda600758a0 msgr2=0x7fda600fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:07.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.933+0000 7fda64d99640 1 -- 172.21.15.17:0/3793673559 shutdown_connections 2024-08-19T01:26:07.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.933+0000 7fda64d99640 1 -- 172.21.15.17:0/3793673559 wait complete. 2024-08-19T01:26:07.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.933+0000 7fda64d99640 1 Processor -- start 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.933+0000 7fda64d99640 1 -- start start 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda64d99640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fe9f0 0x7fda60105920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda64d99640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda601049f0 0x7fda60105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda64d99640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda601063a0 con 0x7fda601049f0 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda64d99640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda601064e0 con 0x7fda600fe9f0 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda5dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda601049f0 0x7fda60105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda5dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda601049f0 0x7fda60105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39466/0 (socket says 172.21.15.17:39466) 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda5dd9b640 1 -- 172.21.15.17:0/4124305589 learned_addr learned my addr 172.21.15.17:0/4124305589 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda5e59c640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fe9f0 0x7fda60105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda5dd9b640 1 -- 172.21.15.17:0/4124305589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fe9f0 msgr2=0x7fda60105920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda5dd9b640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fe9f0 0x7fda60105920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda5dd9b640 1 -- 172.21.15.17:0/4124305589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50009900 con 0x7fda601049f0 2024-08-19T01:26:07.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda5e59c640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fe9f0 0x7fda60105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:26:07.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda5dd9b640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda601049f0 0x7fda60105e60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fda5400d8d0 tx=0x7fda5400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:07.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda4f7fe640 1 -- 172.21.15.17:0/4124305589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda5400bea0 con 0x7fda601049f0 2024-08-19T01:26:07.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda4f7fe640 1 -- 172.21.15.17:0/4124305589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda54009c00 con 0x7fda601049f0 2024-08-19T01:26:07.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda64d99640 1 -- 172.21.15.17:0/4124305589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda601a1c90 con 0x7fda601049f0 2024-08-19T01:26:07.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda4f7fe640 1 -- 172.21.15.17:0/4124305589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda5400f710 con 0x7fda601049f0 2024-08-19T01:26:07.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.934+0000 7fda64d99640 1 -- 172.21.15.17:0/4124305589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda601a20a0 con 0x7fda601049f0 2024-08-19T01:26:07.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.935+0000 7fda64d99640 1 -- 172.21.15.17:0/4124305589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda60100130 con 0x7fda601049f0 2024-08-19T01:26:07.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.936+0000 7fda4f7fe640 1 -- 172.21.15.17:0/4124305589 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fda5400f990 con 0x7fda601049f0 2024-08-19T01:26:07.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.936+0000 7fda4f7fe640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4806e170 0x7fda48070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:07.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.936+0000 7fda4f7fe640 1 -- 172.21.15.17:0/4124305589 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fda5408df20 con 0x7fda601049f0 2024-08-19T01:26:07.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.936+0000 7fda5e59c640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4806e170 0x7fda48070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:07.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.937+0000 7fda5e59c640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4806e170 0x7fda48070630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fda500098d0 tx=0x7fda50009360 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:07.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:07.941+0000 7fda4f7fe640 1 -- 172.21.15.17:0/4124305589 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fda540c2df0 con 0x7fda601049f0 2024-08-19T01:26:08.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.123+0000 7fda64d99640 1 -- 172.21.15.17:0/4124305589 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda6010bd20 con 0x7fda4806e170 2024-08-19T01:26:08.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.133+0000 7fda4f7fe640 1 -- 172.21.15.17:0/4124305589 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fda6010bd20 con 0x7fda4806e170 2024-08-19T01:26:08.136 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (27m) 5m ago 38m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (38m) 5m ago 38m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (37m) 5m ago 37m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (25m) 5m ago 38m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (25m) 5m ago 37m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (27m) 5m ago 37m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (21m) 5m ago 32m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (21m) 5m ago 32m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (6m) 5m ago 32m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (21m) 5m ago 32m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (29m) 5m ago 39m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:26:08.137 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (28m) 5m ago 37m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:26:08.138 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (26m) 5m ago 39m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:26:08.138 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (25m) 5m ago 37m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:26:08.138 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (28m) 5m ago 38m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:26:08.138 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (28m) 5m ago 37m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:26:08.138 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (24m) 5m ago 36m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:26:08.138 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (24m) 5m ago 35m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:26:08.138 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (23m) 5m ago 35m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:26:08.138 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (23m) 5m ago 35m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:26:08.138 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (22m) 5m ago 34m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:26:08.138 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (21m) 5m ago 34m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:26:08.138 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (27m) 5m ago 37m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:26:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.135+0000 7fda64d99640 1 -- 172.21.15.17:0/4124305589 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4806e170 msgr2=0x7fda48070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.135+0000 7fda64d99640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4806e170 0x7fda48070630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fda500098d0 tx=0x7fda50009360 comp rx=0 tx=0).stop 2024-08-19T01:26:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.135+0000 7fda64d99640 1 -- 172.21.15.17:0/4124305589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda601049f0 msgr2=0x7fda60105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.135+0000 7fda64d99640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda601049f0 0x7fda60105e60 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fda5400d8d0 tx=0x7fda5400dd90 comp rx=0 tx=0).stop 2024-08-19T01:26:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.135+0000 7fda64d99640 1 -- 172.21.15.17:0/4124305589 shutdown_connections 2024-08-19T01:26:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.135+0000 7fda64d99640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fda4806e170 0x7fda48070630 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.135+0000 7fda64d99640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda601049f0 0x7fda60105e60 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.135+0000 7fda64d99640 1 --2- 172.21.15.17:0/4124305589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fda600fe9f0 0x7fda60105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.135+0000 7fda64d99640 1 -- 172.21.15.17:0/4124305589 >> 172.21.15.17:0/4124305589 conn(0x7fda600758a0 msgr2=0x7fda60067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.136+0000 7fda64d99640 1 -- 172.21.15.17:0/4124305589 shutdown_connections 2024-08-19T01:26:08.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.136+0000 7fda64d99640 1 -- 172.21.15.17:0/4124305589 wait complete. 2024-08-19T01:26:08.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.216+0000 7f8a4b895640 1 -- 172.21.15.17:0/1850443509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a441015d0 msgr2=0x7f8a44109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.216+0000 7f8a4b895640 1 --2- 172.21.15.17:0/1850443509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a441015d0 0x7f8a44109ac0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009880 tx=0x7f8a3402a530 comp rx=0 tx=0).stop 2024-08-19T01:26:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.216+0000 7f8a4b895640 1 -- 172.21.15.17:0/1850443509 shutdown_connections 2024-08-19T01:26:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.216+0000 7f8a4b895640 1 --2- 172.21.15.17:0/1850443509 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a441015d0 0x7f8a44109ac0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.216+0000 7f8a4b895640 1 --2- 172.21.15.17:0/1850443509 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a44100cb0 0x7f8a44101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.216+0000 7f8a4b895640 1 -- 172.21.15.17:0/1850443509 >> 172.21.15.17:0/1850443509 conn(0x7f8a440758a0 msgr2=0x7f8a440fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:08.221 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:07 smithi017 ceph-mon[99370]: pgmap v821: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:08.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.217+0000 7f8a4b895640 1 -- 172.21.15.17:0/1850443509 shutdown_connections 2024-08-19T01:26:08.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.217+0000 7f8a4b895640 1 -- 172.21.15.17:0/1850443509 wait complete. 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.217+0000 7f8a4b895640 1 Processor -- start 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.217+0000 7f8a4b895640 1 -- start start 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.217+0000 7f8a4b895640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a44100cb0 0x7f8a4419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a4b895640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a441015d0 0x7f8a4419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a4b895640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4419c390 con 0x7f8a44100cb0 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a4b895640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a44195920 con 0x7f8a441015d0 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a49631640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a44100cb0 0x7f8a4419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a49631640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a44100cb0 0x7f8a4419b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39488/0 (socket says 172.21.15.17:39488) 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a49631640 1 -- 172.21.15.17:0/2761023882 learned_addr learned my addr 172.21.15.17:0/2761023882 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a48e30640 1 --2- 172.21.15.17:0/2761023882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a441015d0 0x7f8a4419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a49631640 1 -- 172.21.15.17:0/2761023882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a441015d0 msgr2=0x7f8a4419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a49631640 1 --2- 172.21.15.17:0/2761023882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a441015d0 0x7f8a4419bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a49631640 1 -- 172.21.15.17:0/2761023882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a34009560 con 0x7f8a44100cb0 2024-08-19T01:26:08.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a49631640 1 --2- 172.21.15.17:0/2761023882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a44100cb0 0x7f8a4419b830 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000db80 tx=0x7f8a4000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:08.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a3a7fc640 1 -- 172.21.15.17:0/2761023882 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a4000de40 con 0x7f8a44100cb0 2024-08-19T01:26:08.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a4b895640 1 -- 172.21.15.17:0/2761023882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a44195c00 con 0x7f8a44100cb0 2024-08-19T01:26:08.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a3a7fc640 1 -- 172.21.15.17:0/2761023882 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a40003e30 con 0x7f8a44100cb0 2024-08-19T01:26:08.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.218+0000 7f8a3a7fc640 1 -- 172.21.15.17:0/2761023882 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a40010830 con 0x7f8a44100cb0 2024-08-19T01:26:08.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.219+0000 7f8a4b895640 1 -- 172.21.15.17:0/2761023882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a44196120 con 0x7f8a44100cb0 2024-08-19T01:26:08.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.219+0000 7f8a4b895640 1 -- 172.21.15.17:0/2761023882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a44068510 con 0x7f8a44100cb0 2024-08-19T01:26:08.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.220+0000 7f8a3a7fc640 1 -- 172.21.15.17:0/2761023882 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8a40004020 con 0x7f8a44100cb0 2024-08-19T01:26:08.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.221+0000 7f8a3a7fc640 1 --2- 172.21.15.17:0/2761023882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8a3006e170 0x7f8a30070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:08.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.221+0000 7f8a3a7fc640 1 -- 172.21.15.17:0/2761023882 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8a4008e480 con 0x7f8a44100cb0 2024-08-19T01:26:08.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.221+0000 7f8a48e30640 1 --2- 172.21.15.17:0/2761023882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8a3006e170 0x7f8a30070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:08.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.221+0000 7f8a48e30640 1 --2- 172.21.15.17:0/2761023882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8a3006e170 0x7f8a30070630 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009230 tx=0x7f8a340058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:08.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.225+0000 7f8a3a7fc640 1 -- 172.21.15.17:0/2761023882 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8a40057760 con 0x7f8a44100cb0 2024-08-19T01:26:08.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:07 smithi086 ceph-mon[71303]: pgmap v821: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:08.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.470+0000 7f8a4b895640 1 -- 172.21.15.17:0/2761023882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a441043e0 con 0x7f8a44100cb0 2024-08-19T01:26:08.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.470+0000 7f8a3a7fc640 1 -- 172.21.15.17:0/2761023882 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f8a400042d0 con 0x7f8a44100cb0 2024-08-19T01:26:08.473 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:26:08.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:26:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:26:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:26:08.475 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:26:08.475 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:26:08.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.472+0000 7f8a4b895640 1 -- 172.21.15.17:0/2761023882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8a3006e170 msgr2=0x7f8a30070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.472+0000 7f8a4b895640 1 --2- 172.21.15.17:0/2761023882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8a3006e170 0x7f8a30070630 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009230 tx=0x7f8a340058d0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.472+0000 7f8a4b895640 1 -- 172.21.15.17:0/2761023882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a44100cb0 msgr2=0x7f8a4419b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.472+0000 7f8a4b895640 1 --2- 172.21.15.17:0/2761023882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a44100cb0 0x7f8a4419b830 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000db80 tx=0x7f8a4000b630 comp rx=0 tx=0).stop 2024-08-19T01:26:08.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.473+0000 7f8a4b895640 1 -- 172.21.15.17:0/2761023882 shutdown_connections 2024-08-19T01:26:08.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.473+0000 7f8a4b895640 1 --2- 172.21.15.17:0/2761023882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8a3006e170 0x7f8a30070630 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.473+0000 7f8a4b895640 1 --2- 172.21.15.17:0/2761023882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8a441015d0 0x7f8a4419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.473+0000 7f8a4b895640 1 --2- 172.21.15.17:0/2761023882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a44100cb0 0x7f8a4419b830 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.473+0000 7f8a4b895640 1 -- 172.21.15.17:0/2761023882 >> 172.21.15.17:0/2761023882 conn(0x7f8a440758a0 msgr2=0x7f8a44101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:08.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.473+0000 7f8a4b895640 1 -- 172.21.15.17:0/2761023882 shutdown_connections 2024-08-19T01:26:08.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.473+0000 7f8a4b895640 1 -- 172.21.15.17:0/2761023882 wait complete. 2024-08-19T01:26:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.554+0000 7fc75574d640 1 -- 172.21.15.17:0/1548041624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7500fea30 msgr2=0x7fc7500fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.554+0000 7fc75574d640 1 --2- 172.21.15.17:0/1548041624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7500fea30 0x7fc7500fee90 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fc744009880 tx=0x7fc74402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.554+0000 7fc75574d640 1 -- 172.21.15.17:0/1548041624 shutdown_connections 2024-08-19T01:26:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.554+0000 7fc75574d640 1 --2- 172.21.15.17:0/1548041624 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc7500fea30 0x7fc7500fee90 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.554+0000 7fc75574d640 1 --2- 172.21.15.17:0/1548041624 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc750104a30 0x7fc750104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.554+0000 7fc75574d640 1 -- 172.21.15.17:0/1548041624 >> 172.21.15.17:0/1548041624 conn(0x7fc7500fa730 msgr2=0x7fc7500fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.554+0000 7fc75574d640 1 -- 172.21.15.17:0/1548041624 shutdown_connections 2024-08-19T01:26:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.554+0000 7fc75574d640 1 -- 172.21.15.17:0/1548041624 wait complete. 2024-08-19T01:26:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.555+0000 7fc75574d640 1 Processor -- start 2024-08-19T01:26:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.555+0000 7fc75574d640 1 -- start start 2024-08-19T01:26:08.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.555+0000 7fc75574d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7500fea30 0x7fc75019d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:08.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.555+0000 7fc75574d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc750104a30 0x7fc75019def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.555+0000 7fc75574d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75019e580 con 0x7fc750104a30 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.555+0000 7fc75574d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc750197b00 con 0x7fc7500fea30 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.555+0000 7fc74e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc750104a30 0x7fc75019def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.555+0000 7fc74e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc750104a30 0x7fc75019def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39506/0 (socket says 172.21.15.17:39506) 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.555+0000 7fc74e7fc640 1 -- 172.21.15.17:0/3355726324 learned_addr learned my addr 172.21.15.17:0/3355726324 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.555+0000 7fc74effd640 1 --2- 172.21.15.17:0/3355726324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7500fea30 0x7fc75019d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.556+0000 7fc74e7fc640 1 -- 172.21.15.17:0/3355726324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7500fea30 msgr2=0x7fc75019d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.556+0000 7fc74e7fc640 1 --2- 172.21.15.17:0/3355726324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7500fea30 0x7fc75019d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.556+0000 7fc74e7fc640 1 -- 172.21.15.17:0/3355726324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744009560 con 0x7fc750104a30 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.556+0000 7fc74e7fc640 1 --2- 172.21.15.17:0/3355726324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc750104a30 0x7fc75019def0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc74402a9c0 tx=0x7fc7440055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.556+0000 7fc737fff640 1 -- 172.21.15.17:0/3355726324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc744004aa0 con 0x7fc750104a30 2024-08-19T01:26:08.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.556+0000 7fc737fff640 1 -- 172.21.15.17:0/3355726324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc744004c00 con 0x7fc750104a30 2024-08-19T01:26:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.556+0000 7fc75574d640 1 -- 172.21.15.17:0/3355726324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc750197d80 con 0x7fc750104a30 2024-08-19T01:26:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.556+0000 7fc737fff640 1 -- 172.21.15.17:0/3355726324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc744003ab0 con 0x7fc750104a30 2024-08-19T01:26:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.556+0000 7fc75574d640 1 -- 172.21.15.17:0/3355726324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc750198270 con 0x7fc750104a30 2024-08-19T01:26:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.557+0000 7fc75574d640 1 -- 172.21.15.17:0/3355726324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc750100170 con 0x7fc750104a30 2024-08-19T01:26:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.558+0000 7fc737fff640 1 -- 172.21.15.17:0/3355726324 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc744003ce0 con 0x7fc750104a30 2024-08-19T01:26:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.558+0000 7fc737fff640 1 --2- 172.21.15.17:0/3355726324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 0x7fc738070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.558+0000 7fc737fff640 1 -- 172.21.15.17:0/3355726324 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc7440af1b0 con 0x7fc750104a30 2024-08-19T01:26:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.558+0000 7fc74effd640 1 --2- 172.21.15.17:0/3355726324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 0x7fc738070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.559+0000 7fc74effd640 1 --2- 172.21.15.17:0/3355726324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 0x7fc738070630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc7400058c0 tx=0x7fc74000a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:08.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.563+0000 7fc737fff640 1 -- 172.21.15.17:0/3355726324 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc744078540 con 0x7fc750104a30 2024-08-19T01:26:08.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.775+0000 7fc75574d640 1 -- 172.21.15.17:0/3355726324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc7500fee90 con 0x7fc750104a30 2024-08-19T01:26:08.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.776+0000 7fc737fff640 1 -- 172.21.15.17:0/3355726324 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7fc74407bc00 con 0x7fc750104a30 2024-08-19T01:26:08.779 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:26:08.779 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:26:08.779 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:26:08.779 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:26:08.779 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:26:08.779 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:26:08.779 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:26:08.779 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:26:08.779 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:26:08.780 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:26:08.781 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:26:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:26:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:26:08.782 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:26:08.782 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:26:08.782 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:26:08.782 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:26:08.782 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:26:08.782 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:26:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:26:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.777+0000 7fc75574d640 1 -- 172.21.15.17:0/3355726324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 msgr2=0x7fc738070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.778+0000 7fc75574d640 1 --2- 172.21.15.17:0/3355726324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 0x7fc738070630 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc7400058c0 tx=0x7fc74000a250 comp rx=0 tx=0).stop 2024-08-19T01:26:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.778+0000 7fc75574d640 1 -- 172.21.15.17:0/3355726324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc750104a30 msgr2=0x7fc75019def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.778+0000 7fc75574d640 1 --2- 172.21.15.17:0/3355726324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc750104a30 0x7fc75019def0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fc74402a9c0 tx=0x7fc7440055a0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.778+0000 7fc75574d640 1 -- 172.21.15.17:0/3355726324 shutdown_connections 2024-08-19T01:26:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.778+0000 7fc75574d640 1 --2- 172.21.15.17:0/3355726324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 0x7fc738070630 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.778+0000 7fc75574d640 1 --2- 172.21.15.17:0/3355726324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc750104a30 0x7fc75019def0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.778+0000 7fc75574d640 1 --2- 172.21.15.17:0/3355726324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc7500fea30 0x7fc75019d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.778+0000 7fc75574d640 1 -- 172.21.15.17:0/3355726324 >> 172.21.15.17:0/3355726324 conn(0x7fc7500fa730 msgr2=0x7fc7500fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:08.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.778+0000 7fc75574d640 1 -- 172.21.15.17:0/3355726324 shutdown_connections 2024-08-19T01:26:08.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.778+0000 7fc75574d640 1 -- 172.21.15.17:0/3355726324 wait complete. 2024-08-19T01:26:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.861+0000 7f101f19d640 1 -- 172.21.15.17:0/909847279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104a30 msgr2=0x7f1018104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.861+0000 7f101f19d640 1 --2- 172.21.15.17:0/909847279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104a30 0x7f1018104e10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1008009c20 tx=0x7f100802a970 comp rx=0 tx=0).stop 2024-08-19T01:26:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.861+0000 7f101f19d640 1 -- 172.21.15.17:0/909847279 shutdown_connections 2024-08-19T01:26:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.861+0000 7f101f19d640 1 --2- 172.21.15.17:0/909847279 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10180fea30 0x7f10180fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.861+0000 7f101f19d640 1 --2- 172.21.15.17:0/909847279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104a30 0x7f1018104e10 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.861+0000 7f101f19d640 1 -- 172.21.15.17:0/909847279 >> 172.21.15.17:0/909847279 conn(0x7f10180fa730 msgr2=0x7f10180fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.861+0000 7f101f19d640 1 -- 172.21.15.17:0/909847279 shutdown_connections 2024-08-19T01:26:08.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.861+0000 7f101f19d640 1 -- 172.21.15.17:0/909847279 wait complete. 2024-08-19T01:26:08.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f101f19d640 1 Processor -- start 2024-08-19T01:26:08.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f101f19d640 1 -- start start 2024-08-19T01:26:08.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f101f19d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10180fea30 0x7f1018197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:08.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f101f19d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104a30 0x7f10181982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f101f19d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1018198940 con 0x7f1018104a30 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f101f19d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101819c6b0 con 0x7f10180fea30 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f1017fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104a30 0x7f10181982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f1017fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104a30 0x7f10181982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39528/0 (socket says 172.21.15.17:39528) 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f1017fff640 1 -- 172.21.15.17:0/2087647871 learned_addr learned my addr 172.21.15.17:0/2087647871 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f101cf39640 1 --2- 172.21.15.17:0/2087647871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10180fea30 0x7f1018197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f1017fff640 1 -- 172.21.15.17:0/2087647871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10180fea30 msgr2=0x7f1018197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f1017fff640 1 --2- 172.21.15.17:0/2087647871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10180fea30 0x7f1018197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.862+0000 7f1017fff640 1 -- 172.21.15.17:0/2087647871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1008009900 con 0x7f1018104a30 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.863+0000 7f1017fff640 1 --2- 172.21.15.17:0/2087647871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104a30 0x7f10181982b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f100000d6f0 tx=0x7f100000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.863+0000 7f1015ffb640 1 -- 172.21.15.17:0/2087647871 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1000009a30 con 0x7f1018104a30 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.863+0000 7f1015ffb640 1 -- 172.21.15.17:0/2087647871 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f10000054e0 con 0x7f1018104a30 2024-08-19T01:26:08.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.863+0000 7f101f19d640 1 -- 172.21.15.17:0/2087647871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101819c990 con 0x7f1018104a30 2024-08-19T01:26:08.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.863+0000 7f1015ffb640 1 -- 172.21.15.17:0/2087647871 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1000010460 con 0x7f1018104a30 2024-08-19T01:26:08.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.863+0000 7f101f19d640 1 -- 172.21.15.17:0/2087647871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101819cee0 con 0x7f1018104a30 2024-08-19T01:26:08.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.864+0000 7f101f19d640 1 -- 172.21.15.17:0/2087647871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1018100170 con 0x7f1018104a30 2024-08-19T01:26:08.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.864+0000 7f1015ffb640 1 -- 172.21.15.17:0/2087647871 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1000009b90 con 0x7f1018104a30 2024-08-19T01:26:08.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.865+0000 7f1015ffb640 1 --2- 172.21.15.17:0/2087647871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f100406e180 0x7f1004070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:08.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.865+0000 7f1015ffb640 1 -- 172.21.15.17:0/2087647871 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f100008dc80 con 0x7f1018104a30 2024-08-19T01:26:08.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.865+0000 7f101cf39640 1 --2- 172.21.15.17:0/2087647871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f100406e180 0x7f1004070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:08.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.865+0000 7f101cf39640 1 --2- 172.21.15.17:0/2087647871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f100406e180 0x7f1004070640 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1008000f80 tx=0x7f100803d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:08.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:08.869+0000 7f1015ffb640 1 -- 172.21.15.17:0/2087647871 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1000057010 con 0x7f1018104a30 2024-08-19T01:26:09.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.061+0000 7f101f19d640 1 -- 172.21.15.17:0/2087647871 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f101810bcc0 con 0x7f100406e180 2024-08-19T01:26:09.065 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:09 smithi017 ceph-mon[99370]: from='client.35522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:09.065 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:09 smithi017 ceph-mon[99370]: from='client.35526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:09.065 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:09 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2761023882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:26:09.065 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:09 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3355726324' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:26:09.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.063+0000 7f1015ffb640 1 -- 172.21.15.17:0/2087647871 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f101810bcc0 con 0x7f100406e180 2024-08-19T01:26:09.066 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:26:09.066 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:26:09.066 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:26:09.066 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:26:09.066 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:26:09.066 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:26:09.066 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:26:09.066 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:26:09.066 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:26:09.066 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:26:09.067 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:26:09.067 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:26:09.067 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:26:09.067 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:26:09.067 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:26:09.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.065+0000 7f101f19d640 1 -- 172.21.15.17:0/2087647871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f100406e180 msgr2=0x7f1004070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.065+0000 7f101f19d640 1 --2- 172.21.15.17:0/2087647871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f100406e180 0x7f1004070640 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1008000f80 tx=0x7f100803d040 comp rx=0 tx=0).stop 2024-08-19T01:26:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.065+0000 7f101f19d640 1 -- 172.21.15.17:0/2087647871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104a30 msgr2=0x7f10181982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.065+0000 7f101f19d640 1 --2- 172.21.15.17:0/2087647871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104a30 0x7f10181982b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f100000d6f0 tx=0x7f100000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.065+0000 7f101f19d640 1 -- 172.21.15.17:0/2087647871 shutdown_connections 2024-08-19T01:26:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.065+0000 7f101f19d640 1 --2- 172.21.15.17:0/2087647871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f100406e180 0x7f1004070640 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.065+0000 7f101f19d640 1 --2- 172.21.15.17:0/2087647871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1018104a30 0x7f10181982b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.065+0000 7f101f19d640 1 --2- 172.21.15.17:0/2087647871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f10180fea30 0x7f1018197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.065+0000 7f101f19d640 1 -- 172.21.15.17:0/2087647871 >> 172.21.15.17:0/2087647871 conn(0x7f10180fa730 msgr2=0x7f10180fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.065+0000 7f101f19d640 1 -- 172.21.15.17:0/2087647871 shutdown_connections 2024-08-19T01:26:09.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.065+0000 7f101f19d640 1 -- 172.21.15.17:0/2087647871 wait complete. 2024-08-19T01:26:09.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.148+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4117319750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f681049f0 msgr2=0x7f7f68104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:09.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.148+0000 7f7f6f49c640 1 --2- 172.21.15.17:0/4117319750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f681049f0 0x7f7f68104dd0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009880 tx=0x7f7f6402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.148+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4117319750 shutdown_connections 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.148+0000 7f7f6f49c640 1 --2- 172.21.15.17:0/4117319750 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f680fe9f0 0x7f7f680fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.148+0000 7f7f6f49c640 1 --2- 172.21.15.17:0/4117319750 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f681049f0 0x7f7f68104dd0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.148+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4117319750 >> 172.21.15.17:0/4117319750 conn(0x7f7f680758a0 msgr2=0x7f7f680fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.148+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4117319750 shutdown_connections 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.148+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4117319750 wait complete. 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.148+0000 7f7f6f49c640 1 Processor -- start 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.148+0000 7f7f6f49c640 1 -- start start 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6f49c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f680fe9f0 0x7f7f6819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6f49c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f681049f0 0x7f7f6819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6f49c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f68195890 con 0x7f7f681049f0 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6f49c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f681959d0 con 0x7f7f680fe9f0 2024-08-19T01:26:09.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6ca37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f681049f0 0x7f7f6819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6ca37640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f681049f0 0x7f7f6819bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39544/0 (socket says 172.21.15.17:39544) 2024-08-19T01:26:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6ca37640 1 -- 172.21.15.17:0/4272389519 learned_addr learned my addr 172.21.15.17:0/4272389519 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6d238640 1 --2- 172.21.15.17:0/4272389519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f680fe9f0 0x7f7f6819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6ca37640 1 -- 172.21.15.17:0/4272389519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f680fe9f0 msgr2=0x7f7f6819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6ca37640 1 --2- 172.21.15.17:0/4272389519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f680fe9f0 0x7f7f6819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6ca37640 1 -- 172.21.15.17:0/4272389519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64009560 con 0x7f7f681049f0 2024-08-19T01:26:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6ca37640 1 --2- 172.21.15.17:0/4272389519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f681049f0 0x7f7f6819bd70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800d8d0 tx=0x7f7f5800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f5e7fc640 1 -- 172.21.15.17:0/4272389519 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f5800bea0 con 0x7f7f681049f0 2024-08-19T01:26:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4272389519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f68195cb0 con 0x7f7f681049f0 2024-08-19T01:26:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f5e7fc640 1 -- 172.21.15.17:0/4272389519 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f58009c00 con 0x7f7f681049f0 2024-08-19T01:26:09.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f5e7fc640 1 -- 172.21.15.17:0/4272389519 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f5800f710 con 0x7f7f681049f0 2024-08-19T01:26:09.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.149+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4272389519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f68196200 con 0x7f7f681049f0 2024-08-19T01:26:09.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.150+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4272389519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f68100130 con 0x7f7f681049f0 2024-08-19T01:26:09.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.151+0000 7f7f5e7fc640 1 -- 172.21.15.17:0/4272389519 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7f5800f990 con 0x7f7f681049f0 2024-08-19T01:26:09.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.151+0000 7f7f5e7fc640 1 --2- 172.21.15.17:0/4272389519 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7f5406e170 0x7f7f54070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:09.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.152+0000 7f7f5e7fc640 1 -- 172.21.15.17:0/4272389519 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7f5808de70 con 0x7f7f681049f0 2024-08-19T01:26:09.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.152+0000 7f7f6d238640 1 --2- 172.21.15.17:0/4272389519 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7f5406e170 0x7f7f54070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:09.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.152+0000 7f7f6d238640 1 --2- 172.21.15.17:0/4272389519 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7f5406e170 0x7f7f54070630 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009230 tx=0x7f7f640058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:09.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.156+0000 7f7f5e7fc640 1 -- 172.21.15.17:0/4272389519 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7f58057200 con 0x7f7f681049f0 2024-08-19T01:26:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.410+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4272389519 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7f6810bc60 con 0x7f7f681049f0 2024-08-19T01:26:09.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.410+0000 7f7f5e7fc640 1 -- 172.21.15.17:0/4272389519 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f7f5805a8c0 con 0x7f7f681049f0 2024-08-19T01:26:09.413 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:26:09.413 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:26:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:26:09.414 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:26:09.414 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:26:09.414 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:26:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:26:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:26:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:26:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:26:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:26:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:26:09.414 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:26:09.415 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:26:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.412+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4272389519 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7f5406e170 msgr2=0x7f7f54070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.412+0000 7f7f6f49c640 1 --2- 172.21.15.17:0/4272389519 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7f5406e170 0x7f7f54070630 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7f64009230 tx=0x7f7f640058d0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.412+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4272389519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f681049f0 msgr2=0x7f7f6819bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.413+0000 7f7f6f49c640 1 --2- 172.21.15.17:0/4272389519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f681049f0 0x7f7f6819bd70 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800d8d0 tx=0x7f7f5800dd90 comp rx=0 tx=0).stop 2024-08-19T01:26:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.413+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4272389519 shutdown_connections 2024-08-19T01:26:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.413+0000 7f7f6f49c640 1 --2- 172.21.15.17:0/4272389519 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7f5406e170 0x7f7f54070630 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.413+0000 7f7f6f49c640 1 --2- 172.21.15.17:0/4272389519 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7f681049f0 0x7f7f6819bd70 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.413+0000 7f7f6f49c640 1 --2- 172.21.15.17:0/4272389519 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7f680fe9f0 0x7f7f6819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.413+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4272389519 >> 172.21.15.17:0/4272389519 conn(0x7f7f680758a0 msgr2=0x7f7f68067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.413+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4272389519 shutdown_connections 2024-08-19T01:26:09.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:09.413+0000 7f7f6f49c640 1 -- 172.21.15.17:0/4272389519 wait complete. 2024-08-19T01:26:09.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:09 smithi086 ceph-mon[71303]: from='client.35522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:09.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:09 smithi086 ceph-mon[71303]: from='client.35526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:09.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:09 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2761023882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:26:09.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:09 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3355726324' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:26:10.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:10 smithi017 ceph-mon[99370]: from='client.35530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:10.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:10 smithi017 ceph-mon[99370]: pgmap v822: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:10.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:10 smithi017 ceph-mon[99370]: from='client.35542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:10.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:10 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4272389519' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:26:10.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:10 smithi086 ceph-mon[71303]: from='client.35530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:10.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:10 smithi086 ceph-mon[71303]: pgmap v822: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:10.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:10 smithi086 ceph-mon[71303]: from='client.35542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:10.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:10 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4272389519' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:26:12.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:12 smithi017 ceph-mon[99370]: pgmap v823: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:12.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:12 smithi086 ceph-mon[71303]: pgmap v823: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:14.367 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:14 smithi017 ceph-mon[99370]: pgmap v824: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:14.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:14 smithi086 ceph-mon[71303]: pgmap v824: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:16.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:16 smithi017 ceph-mon[99370]: pgmap v825: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:16.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:16 smithi086 ceph-mon[71303]: pgmap v825: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:18 smithi017 ceph-mon[99370]: pgmap v826: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:26:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:18 smithi086 ceph-mon[71303]: pgmap v826: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:26:20.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:20 smithi017 ceph-mon[99370]: pgmap v827: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:20.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:20 smithi086 ceph-mon[71303]: pgmap v827: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:22.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:22 smithi017 ceph-mon[99370]: pgmap v828: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:22.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:22 smithi086 ceph-mon[71303]: pgmap v828: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:24.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:24 smithi017 ceph-mon[99370]: pgmap v829: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:24.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:24 smithi086 ceph-mon[71303]: pgmap v829: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:26 smithi086 ceph-mon[71303]: pgmap v830: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:26.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:26 smithi017 ceph-mon[99370]: pgmap v830: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:28.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:28 smithi017 ceph-mon[99370]: pgmap v831: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:28.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:28 smithi086 ceph-mon[71303]: pgmap v831: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:30.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:30 smithi017 ceph-mon[99370]: pgmap v832: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:30.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:30 smithi086 ceph-mon[71303]: pgmap v832: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:32.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:32 smithi017 ceph-mon[99370]: pgmap v833: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:32.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:32 smithi086 ceph-mon[71303]: pgmap v833: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:26:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:26:34.334 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:34 smithi017 ceph-mon[99370]: pgmap v834: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:34 smithi086 ceph-mon[71303]: pgmap v834: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:36.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:36 smithi017 ceph-mon[99370]: pgmap v835: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:36.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:36 smithi086 ceph-mon[71303]: pgmap v835: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:38.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:38 smithi017 ceph-mon[99370]: pgmap v836: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:38.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:38 smithi086 ceph-mon[71303]: pgmap v836: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:39.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.509+0000 7f4e95d39640 1 -- 172.21.15.17:0/2122788453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e90101610 msgr2=0x7f4e90109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:39.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.509+0000 7f4e95d39640 1 --2- 172.21.15.17:0/2122788453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e90101610 0x7f4e90109b00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4e840098b0 tx=0x7f4e8402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:26:39.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.509+0000 7f4e95d39640 1 -- 172.21.15.17:0/2122788453 shutdown_connections 2024-08-19T01:26:39.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.509+0000 7f4e95d39640 1 --2- 172.21.15.17:0/2122788453 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e90101610 0x7f4e90109b00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:39.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.509+0000 7f4e95d39640 1 --2- 172.21.15.17:0/2122788453 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e90100c60 0x7f4e90101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:39.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.509+0000 7f4e95d39640 1 -- 172.21.15.17:0/2122788453 >> 172.21.15.17:0/2122788453 conn(0x7f4e900fa730 msgr2=0x7f4e900fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:39.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.509+0000 7f4e95d39640 1 -- 172.21.15.17:0/2122788453 shutdown_connections 2024-08-19T01:26:39.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.509+0000 7f4e95d39640 1 -- 172.21.15.17:0/2122788453 wait complete. 2024-08-19T01:26:39.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.510+0000 7f4e95d39640 1 Processor -- start 2024-08-19T01:26:39.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.510+0000 7f4e95d39640 1 -- start start 2024-08-19T01:26:39.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.510+0000 7f4e95d39640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e90100c60 0x7f4e900fe950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.510+0000 7f4e95d39640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e90101610 0x7f4e900fee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.510+0000 7f4e95d39640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900ff3d0 con 0x7f4e90101610 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.510+0000 7f4e95d39640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e900ff540 con 0x7f4e90100c60 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.510+0000 7f4e8effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e90101610 0x7f4e900fee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.510+0000 7f4e8effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e90101610 0x7f4e900fee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42402/0 (socket says 172.21.15.17:42402) 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.510+0000 7f4e8effd640 1 -- 172.21.15.17:0/2007454557 learned_addr learned my addr 172.21.15.17:0/2007454557 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.511+0000 7f4e8f7fe640 1 --2- 172.21.15.17:0/2007454557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e90100c60 0x7f4e900fe950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.511+0000 7f4e8effd640 1 -- 172.21.15.17:0/2007454557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e90100c60 msgr2=0x7f4e900fe950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.511+0000 7f4e8effd640 1 --2- 172.21.15.17:0/2007454557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e90100c60 0x7f4e900fe950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.511+0000 7f4e8effd640 1 -- 172.21.15.17:0/2007454557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e84009560 con 0x7f4e90101610 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.511+0000 7f4e8effd640 1 --2- 172.21.15.17:0/2007454557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e90101610 0x7f4e900fee90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4e84006010 tx=0x7f4e840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:39.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.511+0000 7f4e8cff9640 1 -- 172.21.15.17:0/2007454557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e84004aa0 con 0x7f4e90101610 2024-08-19T01:26:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.511+0000 7f4e8cff9640 1 -- 172.21.15.17:0/2007454557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e84031470 con 0x7f4e90101610 2024-08-19T01:26:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.511+0000 7f4e95d39640 1 -- 172.21.15.17:0/2007454557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e900ff7c0 con 0x7f4e90101610 2024-08-19T01:26:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.511+0000 7f4e8cff9640 1 -- 172.21.15.17:0/2007454557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e84003940 con 0x7f4e90101610 2024-08-19T01:26:39.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.511+0000 7f4e95d39640 1 -- 172.21.15.17:0/2007454557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e901a1f70 con 0x7f4e90101610 2024-08-19T01:26:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.513+0000 7f4e95d39640 1 -- 172.21.15.17:0/2007454557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e90068d30 con 0x7f4e90101610 2024-08-19T01:26:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.513+0000 7f4e8cff9640 1 -- 172.21.15.17:0/2007454557 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4e84031b90 con 0x7f4e90101610 2024-08-19T01:26:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.514+0000 7f4e8cff9640 1 --2- 172.21.15.17:0/2007454557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e7806e170 0x7f4e78070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.514+0000 7f4e8cff9640 1 -- 172.21.15.17:0/2007454557 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4e840af040 con 0x7f4e90101610 2024-08-19T01:26:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.514+0000 7f4e8f7fe640 1 --2- 172.21.15.17:0/2007454557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e7806e170 0x7f4e78070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.514+0000 7f4e8f7fe640 1 --2- 172.21.15.17:0/2007454557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e7806e170 0x7f4e78070630 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4e80005fd0 tx=0x7f4e8000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:39.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.518+0000 7f4e8cff9640 1 -- 172.21.15.17:0/2007454557 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4e840783d0 con 0x7f4e90101610 2024-08-19T01:26:39.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.712+0000 7f4e95d39640 1 -- 172.21.15.17:0/2007454557 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e900ff7c0 con 0x7f4e7806e170 2024-08-19T01:26:39.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.713+0000 7f4e8cff9640 1 -- 172.21.15.17:0/2007454557 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4e900ff7c0 con 0x7f4e7806e170 2024-08-19T01:26:39.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.715+0000 7f4e95d39640 1 -- 172.21.15.17:0/2007454557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e7806e170 msgr2=0x7f4e78070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:39.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.715+0000 7f4e95d39640 1 --2- 172.21.15.17:0/2007454557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e7806e170 0x7f4e78070630 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4e80005fd0 tx=0x7f4e8000b390 comp rx=0 tx=0).stop 2024-08-19T01:26:39.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.715+0000 7f4e95d39640 1 -- 172.21.15.17:0/2007454557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e90101610 msgr2=0x7f4e900fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:39.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.715+0000 7f4e95d39640 1 --2- 172.21.15.17:0/2007454557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e90101610 0x7f4e900fee90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4e84006010 tx=0x7f4e840055a0 comp rx=0 tx=0).stop 2024-08-19T01:26:39.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.715+0000 7f4e95d39640 1 -- 172.21.15.17:0/2007454557 shutdown_connections 2024-08-19T01:26:39.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.715+0000 7f4e95d39640 1 --2- 172.21.15.17:0/2007454557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4e7806e170 0x7f4e78070630 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:39.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.715+0000 7f4e95d39640 1 --2- 172.21.15.17:0/2007454557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4e90101610 0x7f4e900fee90 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:39.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.715+0000 7f4e95d39640 1 --2- 172.21.15.17:0/2007454557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4e90100c60 0x7f4e900fe950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:39.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.715+0000 7f4e95d39640 1 -- 172.21.15.17:0/2007454557 >> 172.21.15.17:0/2007454557 conn(0x7f4e900fa730 msgr2=0x7f4e90101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:39.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.715+0000 7f4e95d39640 1 -- 172.21.15.17:0/2007454557 shutdown_connections 2024-08-19T01:26:39.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.715+0000 7f4e95d39640 1 -- 172.21.15.17:0/2007454557 wait complete. 2024-08-19T01:26:39.726 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:26:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.799+0000 7f4edcad1640 1 -- 172.21.15.17:0/3792989614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed80fe8a0 msgr2=0x7f4ed80fec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:39.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.799+0000 7f4edcad1640 1 --2- 172.21.15.17:0/3792989614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed80fe8a0 0x7f4ed80fec80 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009880 tx=0x7f4ec802a490 comp rx=0 tx=0).stop 2024-08-19T01:26:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.799+0000 7f4edcad1640 1 -- 172.21.15.17:0/3792989614 shutdown_connections 2024-08-19T01:26:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.799+0000 7f4edcad1640 1 --2- 172.21.15.17:0/3792989614 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed80ff250 0x7f4ed810bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.799+0000 7f4edcad1640 1 --2- 172.21.15.17:0/3792989614 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed80fe8a0 0x7f4ed80fec80 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.799+0000 7f4edcad1640 1 -- 172.21.15.17:0/3792989614 >> 172.21.15.17:0/3792989614 conn(0x7f4ed80758a0 msgr2=0x7f4ed80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.799+0000 7f4edcad1640 1 -- 172.21.15.17:0/3792989614 shutdown_connections 2024-08-19T01:26:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.799+0000 7f4edcad1640 1 -- 172.21.15.17:0/3792989614 wait complete. 2024-08-19T01:26:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4edcad1640 1 Processor -- start 2024-08-19T01:26:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4edcad1640 1 -- start start 2024-08-19T01:26:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4edcad1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed80fe8a0 0x7f4ed819da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4edcad1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed80ff250 0x7f4ed819df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4edcad1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed819e5a0 con 0x7f4ed80ff250 2024-08-19T01:26:39.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4edcad1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8197b30 con 0x7f4ed80fe8a0 2024-08-19T01:26:39.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4ed5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed80ff250 0x7f4ed819df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:39.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4ed5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed80ff250 0x7f4ed819df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42416/0 (socket says 172.21.15.17:42416) 2024-08-19T01:26:39.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4ed5d9b640 1 -- 172.21.15.17:0/2843358837 learned_addr learned my addr 172.21.15.17:0/2843358837 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:39.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4ed659c640 1 --2- 172.21.15.17:0/2843358837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed80fe8a0 0x7f4ed819da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:39.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4ed5d9b640 1 -- 172.21.15.17:0/2843358837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed80fe8a0 msgr2=0x7f4ed819da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:39.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4ed5d9b640 1 --2- 172.21.15.17:0/2843358837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed80fe8a0 0x7f4ed819da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:39.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.800+0000 7f4ed5d9b640 1 -- 172.21.15.17:0/2843358837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec8009560 con 0x7f4ed80ff250 2024-08-19T01:26:39.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.801+0000 7f4ed5d9b640 1 --2- 172.21.15.17:0/2843358837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed80ff250 0x7f4ed819df80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c8f0 tx=0x7f4ec000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:39.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.801+0000 7f4ecf7fe640 1 -- 172.21.15.17:0/2843358837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec0007b80 con 0x7f4ed80ff250 2024-08-19T01:26:39.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.801+0000 7f4edcad1640 1 -- 172.21.15.17:0/2843358837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed8197e10 con 0x7f4ed80ff250 2024-08-19T01:26:39.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.801+0000 7f4ecf7fe640 1 -- 172.21.15.17:0/2843358837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ec00054e0 con 0x7f4ed80ff250 2024-08-19T01:26:39.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.801+0000 7f4ecf7fe640 1 -- 172.21.15.17:0/2843358837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec000f450 con 0x7f4ed80ff250 2024-08-19T01:26:39.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.801+0000 7f4edcad1640 1 -- 172.21.15.17:0/2843358837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed8198360 con 0x7f4ed80ff250 2024-08-19T01:26:39.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.802+0000 7f4edcad1640 1 -- 172.21.15.17:0/2843358837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed80684b0 con 0x7f4ed80ff250 2024-08-19T01:26:39.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.802+0000 7f4ecf7fe640 1 -- 172.21.15.17:0/2843358837 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4ec0004f60 con 0x7f4ed80ff250 2024-08-19T01:26:39.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.803+0000 7f4ecf7fe640 1 --2- 172.21.15.17:0/2843358837 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ec406e170 0x7f4ec4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:39.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.803+0000 7f4ecf7fe640 1 -- 172.21.15.17:0/2843358837 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4ec008df40 con 0x7f4ed80ff250 2024-08-19T01:26:39.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.803+0000 7f4ed659c640 1 --2- 172.21.15.17:0/2843358837 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ec406e170 0x7f4ec4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:39.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.803+0000 7f4ed659c640 1 --2- 172.21.15.17:0/2843358837 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ec406e170 0x7f4ec4070630 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009230 tx=0x7f4ec80058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:39.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:39.807+0000 7f4ecf7fe640 1 -- 172.21.15.17:0/2843358837 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4ec00c2df0 con 0x7f4ed80ff250 2024-08-19T01:26:40.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.024+0000 7f4edcad1640 1 -- 172.21.15.17:0/2843358837 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ed810eef0 con 0x7f4ec406e170 2024-08-19T01:26:40.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.025+0000 7f4ecf7fe640 1 -- 172.21.15.17:0/2843358837 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4ed810eef0 con 0x7f4ec406e170 2024-08-19T01:26:40.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.027+0000 7f4edcad1640 1 -- 172.21.15.17:0/2843358837 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ec406e170 msgr2=0x7f4ec4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.027+0000 7f4edcad1640 1 --2- 172.21.15.17:0/2843358837 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ec406e170 0x7f4ec4070630 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009230 tx=0x7f4ec80058d0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.027+0000 7f4edcad1640 1 -- 172.21.15.17:0/2843358837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed80ff250 msgr2=0x7f4ed819df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.027+0000 7f4edcad1640 1 --2- 172.21.15.17:0/2843358837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed80ff250 0x7f4ed819df80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c8f0 tx=0x7f4ec000cdb0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.027+0000 7f4edcad1640 1 -- 172.21.15.17:0/2843358837 shutdown_connections 2024-08-19T01:26:40.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.027+0000 7f4edcad1640 1 --2- 172.21.15.17:0/2843358837 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4ec406e170 0x7f4ec4070630 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.027+0000 7f4edcad1640 1 --2- 172.21.15.17:0/2843358837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ed80ff250 0x7f4ed819df80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.027+0000 7f4edcad1640 1 --2- 172.21.15.17:0/2843358837 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4ed80fe8a0 0x7f4ed819da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.027+0000 7f4edcad1640 1 -- 172.21.15.17:0/2843358837 >> 172.21.15.17:0/2843358837 conn(0x7f4ed80758a0 msgr2=0x7f4ed80fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:40.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.027+0000 7f4edcad1640 1 -- 172.21.15.17:0/2843358837 shutdown_connections 2024-08-19T01:26:40.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.027+0000 7f4edcad1640 1 -- 172.21.15.17:0/2843358837 wait complete. 2024-08-19T01:26:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.112+0000 7f55970b6640 1 -- 172.21.15.17:0/405186937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5590100750 msgr2=0x7f55901047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.112+0000 7f55970b6640 1 --2- 172.21.15.17:0/405186937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5590100750 0x7f55901047a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f557c009880 tx=0x7f557c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.112+0000 7f55970b6640 1 -- 172.21.15.17:0/405186937 shutdown_connections 2024-08-19T01:26:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.112+0000 7f55970b6640 1 --2- 172.21.15.17:0/405186937 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5590100750 0x7f55901047a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.112+0000 7f55970b6640 1 --2- 172.21.15.17:0/405186937 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55900ffda0 0x7f5590100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.112+0000 7f55970b6640 1 -- 172.21.15.17:0/405186937 >> 172.21.15.17:0/405186937 conn(0x7f55900fb840 msgr2=0x7f55900fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:40.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.112+0000 7f55970b6640 1 -- 172.21.15.17:0/405186937 shutdown_connections 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.112+0000 7f55970b6640 1 -- 172.21.15.17:0/405186937 wait complete. 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.112+0000 7f55970b6640 1 Processor -- start 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.112+0000 7f55970b6640 1 -- start start 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f55970b6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900ffda0 0x7f559019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f55970b6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5590100750 0x7f559019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f55970b6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5590195930 con 0x7f55900ffda0 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f55970b6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5590195a70 con 0x7f5590100750 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f5594e52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900ffda0 0x7f559019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f5594e52640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900ffda0 0x7f559019b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42426/0 (socket says 172.21.15.17:42426) 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f5594e52640 1 -- 172.21.15.17:0/602703593 learned_addr learned my addr 172.21.15.17:0/602703593 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f558ffff640 1 --2- 172.21.15.17:0/602703593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5590100750 0x7f559019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:40.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f5594e52640 1 -- 172.21.15.17:0/602703593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5590100750 msgr2=0x7f559019be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f5594e52640 1 --2- 172.21.15.17:0/602703593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5590100750 0x7f559019be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f5594e52640 1 -- 172.21.15.17:0/602703593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c009560 con 0x7f55900ffda0 2024-08-19T01:26:40.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f5594e52640 1 --2- 172.21.15.17:0/602703593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900ffda0 0x7f559019b8d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f558400d6f0 tx=0x7f558400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:40.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f558dffb640 1 -- 172.21.15.17:0/602703593 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5584009a30 con 0x7f55900ffda0 2024-08-19T01:26:40.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f558dffb640 1 -- 172.21.15.17:0/602703593 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55840054e0 con 0x7f55900ffda0 2024-08-19T01:26:40.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f55970b6640 1 -- 172.21.15.17:0/602703593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5590195d50 con 0x7f55900ffda0 2024-08-19T01:26:40.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.113+0000 7f558dffb640 1 -- 172.21.15.17:0/602703593 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5584010460 con 0x7f55900ffda0 2024-08-19T01:26:40.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.114+0000 7f55970b6640 1 -- 172.21.15.17:0/602703593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5590196270 con 0x7f55900ffda0 2024-08-19T01:26:40.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.115+0000 7f55970b6640 1 -- 172.21.15.17:0/602703593 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5590101280 con 0x7f55900ffda0 2024-08-19T01:26:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.115+0000 7f558dffb640 1 -- 172.21.15.17:0/602703593 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5584009b90 con 0x7f55900ffda0 2024-08-19T01:26:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.115+0000 7f558dffb640 1 --2- 172.21.15.17:0/602703593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f558006e170 0x7f5580070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.115+0000 7f558dffb640 1 -- 172.21.15.17:0/602703593 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f558408dbd0 con 0x7f55900ffda0 2024-08-19T01:26:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.115+0000 7f558ffff640 1 --2- 172.21.15.17:0/602703593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f558006e170 0x7f5580070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:40.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.116+0000 7f558ffff640 1 --2- 172.21.15.17:0/602703593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f558006e170 0x7f5580070630 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f557c009230 tx=0x7f557c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:40.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.120+0000 7f558dffb640 1 -- 172.21.15.17:0/602703593 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5584056fe0 con 0x7f55900ffda0 2024-08-19T01:26:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.305+0000 7f55970b6640 1 -- 172.21.15.17:0/602703593 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f559010cdd0 con 0x7f558006e170 2024-08-19T01:26:40.307 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:40 smithi017 ceph-mon[99370]: pgmap v837: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:40.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.315+0000 7f558dffb640 1 -- 172.21.15.17:0/602703593 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f559010cdd0 con 0x7f558006e170 2024-08-19T01:26:40.317 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (27m) 6m ago 38m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (38m) 6m ago 38m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (37m) 6m ago 37m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (25m) 6m ago 38m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (25m) 6m ago 37m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (27m) 6m ago 38m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (21m) 6m ago 33m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (22m) 6m ago 33m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (6m) 6m ago 33m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (21m) 6m ago 33m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (29m) 6m ago 40m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (28m) 6m ago 37m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:26:40.318 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (26m) 6m ago 40m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:26:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (26m) 6m ago 37m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:26:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (28m) 6m ago 38m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:26:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (28m) 6m ago 37m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:26:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (25m) 6m ago 36m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:26:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (24m) 6m ago 36m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:26:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (24m) 6m ago 35m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:26:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (23m) 6m ago 35m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:26:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (23m) 6m ago 35m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:26:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (22m) 6m ago 34m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:26:40.319 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (28m) 6m ago 38m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:26:40.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.317+0000 7f55970b6640 1 -- 172.21.15.17:0/602703593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f558006e170 msgr2=0x7f5580070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.317+0000 7f55970b6640 1 --2- 172.21.15.17:0/602703593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f558006e170 0x7f5580070630 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f557c009230 tx=0x7f557c0058d0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.317+0000 7f55970b6640 1 -- 172.21.15.17:0/602703593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900ffda0 msgr2=0x7f559019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.317+0000 7f55970b6640 1 --2- 172.21.15.17:0/602703593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900ffda0 0x7f559019b8d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f558400d6f0 tx=0x7f558400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.317+0000 7f55970b6640 1 -- 172.21.15.17:0/602703593 shutdown_connections 2024-08-19T01:26:40.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.317+0000 7f55970b6640 1 --2- 172.21.15.17:0/602703593 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f558006e170 0x7f5580070630 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.317+0000 7f55970b6640 1 --2- 172.21.15.17:0/602703593 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5590100750 0x7f559019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.317+0000 7f55970b6640 1 --2- 172.21.15.17:0/602703593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55900ffda0 0x7f559019b8d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.317+0000 7f55970b6640 1 -- 172.21.15.17:0/602703593 >> 172.21.15.17:0/602703593 conn(0x7f55900fb840 msgr2=0x7f55900fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:40.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.318+0000 7f55970b6640 1 -- 172.21.15.17:0/602703593 shutdown_connections 2024-08-19T01:26:40.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.318+0000 7f55970b6640 1 -- 172.21.15.17:0/602703593 wait complete. 2024-08-19T01:26:40.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.399+0000 7fa9f674b640 1 -- 172.21.15.17:0/2963563857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9f0100c60 msgr2=0x7fa9f0101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.399+0000 7fa9f674b640 1 --2- 172.21.15.17:0/2963563857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9f0100c60 0x7fa9f0101040 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa9e00098b0 tx=0x7fa9e002a4d0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.399+0000 7fa9f674b640 1 -- 172.21.15.17:0/2963563857 shutdown_connections 2024-08-19T01:26:40.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.399+0000 7fa9f674b640 1 --2- 172.21.15.17:0/2963563857 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f0101610 0x7fa9f0109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.399+0000 7fa9f674b640 1 --2- 172.21.15.17:0/2963563857 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9f0100c60 0x7fa9f0101040 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.399+0000 7fa9f674b640 1 -- 172.21.15.17:0/2963563857 >> 172.21.15.17:0/2963563857 conn(0x7fa9f00fa730 msgr2=0x7fa9f00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:40.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.399+0000 7fa9f674b640 1 -- 172.21.15.17:0/2963563857 shutdown_connections 2024-08-19T01:26:40.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.399+0000 7fa9f674b640 1 -- 172.21.15.17:0/2963563857 wait complete. 2024-08-19T01:26:40.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.399+0000 7fa9f674b640 1 Processor -- start 2024-08-19T01:26:40.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.399+0000 7fa9f674b640 1 -- start start 2024-08-19T01:26:40.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9f674b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9f0100c60 0x7fa9f019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9f674b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f0101610 0x7fa9f019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9f674b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f019c380 con 0x7fa9f0100c60 2024-08-19T01:26:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9f674b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f0195910 con 0x7fa9f0101610 2024-08-19T01:26:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9f0100c60 0x7fa9f019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9effff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9f0100c60 0x7fa9f019b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42448/0 (socket says 172.21.15.17:42448) 2024-08-19T01:26:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9effff640 1 -- 172.21.15.17:0/4132521386 learned_addr learned my addr 172.21.15.17:0/4132521386 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9ef7fe640 1 --2- 172.21.15.17:0/4132521386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f0101610 0x7fa9f019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9effff640 1 -- 172.21.15.17:0/4132521386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f0101610 msgr2=0x7fa9f019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9effff640 1 --2- 172.21.15.17:0/4132521386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f0101610 0x7fa9f019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9effff640 1 -- 172.21.15.17:0/4132521386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0009560 con 0x7fa9f0100c60 2024-08-19T01:26:40.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9effff640 1 --2- 172.21.15.17:0/4132521386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9f0100c60 0x7fa9f019b820 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009230 tx=0x7fa9e00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:40.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9ed7fa640 1 -- 172.21.15.17:0/4132521386 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e0004aa0 con 0x7fa9f0100c60 2024-08-19T01:26:40.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9ed7fa640 1 -- 172.21.15.17:0/4132521386 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9e0031470 con 0x7fa9f0100c60 2024-08-19T01:26:40.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9f674b640 1 -- 172.21.15.17:0/4132521386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f0195b90 con 0x7fa9f0100c60 2024-08-19T01:26:40.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.400+0000 7fa9ed7fa640 1 -- 172.21.15.17:0/4132521386 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e00039e0 con 0x7fa9f0100c60 2024-08-19T01:26:40.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.401+0000 7fa9f674b640 1 -- 172.21.15.17:0/4132521386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f0196080 con 0x7fa9f0100c60 2024-08-19T01:26:40.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.402+0000 7fa9f674b640 1 -- 172.21.15.17:0/4132521386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f0068d30 con 0x7fa9f0100c60 2024-08-19T01:26:40.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.402+0000 7fa9ed7fa640 1 -- 172.21.15.17:0/4132521386 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa9e0031c00 con 0x7fa9f0100c60 2024-08-19T01:26:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.402+0000 7fa9ed7fa640 1 --2- 172.21.15.17:0/4132521386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa9d806e180 0x7fa9d8070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.403+0000 7fa9ed7fa640 1 -- 172.21.15.17:0/4132521386 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa9e00af160 con 0x7fa9f0100c60 2024-08-19T01:26:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.403+0000 7fa9ef7fe640 1 --2- 172.21.15.17:0/4132521386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa9d806e180 0x7fa9d8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:40.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.403+0000 7fa9ef7fe640 1 --2- 172.21.15.17:0/4132521386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa9d806e180 0x7fa9d8070640 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0196d80 tx=0x7fa9e400b590 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:40.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.407+0000 7fa9ed7fa640 1 -- 172.21.15.17:0/4132521386 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa9e00784c0 con 0x7fa9f0100c60 2024-08-19T01:26:40.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:40 smithi086 ceph-mon[71303]: pgmap v837: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:40.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.649+0000 7fa9f674b640 1 -- 172.21.15.17:0/4132521386 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa9f0104380 con 0x7fa9f0100c60 2024-08-19T01:26:40.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.649+0000 7fa9ed7fa640 1 -- 172.21.15.17:0/4132521386 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fa9e007bb80 con 0x7fa9f0100c60 2024-08-19T01:26:40.651 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:26:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:26:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:26:40.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:26:40.652 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:26:40.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.651+0000 7fa9f674b640 1 -- 172.21.15.17:0/4132521386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa9d806e180 msgr2=0x7fa9d8070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.651+0000 7fa9f674b640 1 --2- 172.21.15.17:0/4132521386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa9d806e180 0x7fa9d8070640 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0196d80 tx=0x7fa9e400b590 comp rx=0 tx=0).stop 2024-08-19T01:26:40.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.651+0000 7fa9f674b640 1 -- 172.21.15.17:0/4132521386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9f0100c60 msgr2=0x7fa9f019b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.651+0000 7fa9f674b640 1 --2- 172.21.15.17:0/4132521386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9f0100c60 0x7fa9f019b820 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009230 tx=0x7fa9e00055a0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.652+0000 7fa9f674b640 1 -- 172.21.15.17:0/4132521386 shutdown_connections 2024-08-19T01:26:40.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.652+0000 7fa9f674b640 1 --2- 172.21.15.17:0/4132521386 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa9d806e180 0x7fa9d8070640 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.652+0000 7fa9f674b640 1 --2- 172.21.15.17:0/4132521386 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa9f0101610 0x7fa9f019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.652+0000 7fa9f674b640 1 --2- 172.21.15.17:0/4132521386 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa9f0100c60 0x7fa9f019b820 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.652+0000 7fa9f674b640 1 -- 172.21.15.17:0/4132521386 >> 172.21.15.17:0/4132521386 conn(0x7fa9f00fa730 msgr2=0x7fa9f0101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:40.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.652+0000 7fa9f674b640 1 -- 172.21.15.17:0/4132521386 shutdown_connections 2024-08-19T01:26:40.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.652+0000 7fa9f674b640 1 -- 172.21.15.17:0/4132521386 wait complete. 2024-08-19T01:26:40.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.735+0000 7f5c52b9e640 1 -- 172.21.15.17:0/763637012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c0fe820 msgr2=0x7f5c4c0fec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.735+0000 7f5c52b9e640 1 --2- 172.21.15.17:0/763637012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c0fe820 0x7f5c4c0fec80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009880 tx=0x7f5c3c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.735+0000 7f5c52b9e640 1 -- 172.21.15.17:0/763637012 shutdown_connections 2024-08-19T01:26:40.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.735+0000 7f5c52b9e640 1 --2- 172.21.15.17:0/763637012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c0fe820 0x7f5c4c0fec80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.735+0000 7f5c52b9e640 1 --2- 172.21.15.17:0/763637012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c4c104820 0x7f5c4c104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.735+0000 7f5c52b9e640 1 -- 172.21.15.17:0/763637012 >> 172.21.15.17:0/763637012 conn(0x7f5c4c0fa4e0 msgr2=0x7f5c4c0fc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.735+0000 7f5c52b9e640 1 -- 172.21.15.17:0/763637012 shutdown_connections 2024-08-19T01:26:40.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.735+0000 7f5c52b9e640 1 -- 172.21.15.17:0/763637012 wait complete. 2024-08-19T01:26:40.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.736+0000 7f5c52b9e640 1 Processor -- start 2024-08-19T01:26:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.736+0000 7f5c52b9e640 1 -- start start 2024-08-19T01:26:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.736+0000 7f5c52b9e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c0fe820 0x7f5c4c0fae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.736+0000 7f5c52b9e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c4c104820 0x7f5c4c0fb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.736+0000 7f5c52b9e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0fb8b0 con 0x7f5c4c0fe820 2024-08-19T01:26:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.736+0000 7f5c52b9e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4c0fba20 con 0x7f5c4c104820 2024-08-19T01:26:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.736+0000 7f5c51b9c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c0fe820 0x7f5c4c0fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.736+0000 7f5c51b9c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c0fe820 0x7f5c4c0fae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42464/0 (socket says 172.21.15.17:42464) 2024-08-19T01:26:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.736+0000 7f5c51b9c640 1 -- 172.21.15.17:0/3681400828 learned_addr learned my addr 172.21.15.17:0/3681400828 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.736+0000 7f5c5139b640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c4c104820 0x7f5c4c0fb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:40.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.737+0000 7f5c51b9c640 1 -- 172.21.15.17:0/3681400828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c4c104820 msgr2=0x7f5c4c0fb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.737+0000 7f5c51b9c640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c4c104820 0x7f5c4c0fb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.737+0000 7f5c51b9c640 1 -- 172.21.15.17:0/3681400828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c009560 con 0x7f5c4c0fe820 2024-08-19T01:26:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.737+0000 7f5c5139b640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c4c104820 0x7f5c4c0fb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:26:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.737+0000 7f5c51b9c640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c0fe820 0x7f5c4c0fae30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800e970 tx=0x7f5c4800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.737+0000 7f5c42ffd640 1 -- 172.21.15.17:0/3681400828 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c4800cc90 con 0x7f5c4c0fe820 2024-08-19T01:26:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.737+0000 7f5c42ffd640 1 -- 172.21.15.17:0/3681400828 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c4800cdf0 con 0x7f5c4c0fe820 2024-08-19T01:26:40.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.737+0000 7f5c52b9e640 1 -- 172.21.15.17:0/3681400828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4c1a1af0 con 0x7f5c4c0fe820 2024-08-19T01:26:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.737+0000 7f5c42ffd640 1 -- 172.21.15.17:0/3681400828 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c48010430 con 0x7f5c4c0fe820 2024-08-19T01:26:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.737+0000 7f5c52b9e640 1 -- 172.21.15.17:0/3681400828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4c1a1e50 con 0x7f5c4c0fe820 2024-08-19T01:26:40.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.738+0000 7f5c52b9e640 1 -- 172.21.15.17:0/3681400828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4c0fff60 con 0x7f5c4c0fe820 2024-08-19T01:26:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.739+0000 7f5c42ffd640 1 -- 172.21.15.17:0/3681400828 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5c480046c0 con 0x7f5c4c0fe820 2024-08-19T01:26:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.739+0000 7f5c42ffd640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c3806e170 0x7f5c38070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.739+0000 7f5c5139b640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c3806e170 0x7f5c38070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.739+0000 7f5c42ffd640 1 -- 172.21.15.17:0/3681400828 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5c48014070 con 0x7f5c4c0fe820 2024-08-19T01:26:40.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.740+0000 7f5c5139b640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c3806e170 0x7f5c38070630 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c000c00 tx=0x7f5c3c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:40.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.743+0000 7f5c42ffd640 1 -- 172.21.15.17:0/3681400828 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5c48057a60 con 0x7f5c4c0fe820 2024-08-19T01:26:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.954+0000 7f5c52b9e640 1 -- 172.21.15.17:0/3681400828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5c4c0fc390 con 0x7f5c4c0fe820 2024-08-19T01:26:40.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.954+0000 7f5c42ffd640 1 -- 172.21.15.17:0/3681400828 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f5c4805b120 con 0x7f5c4c0fe820 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:26:40.957 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:26:40.958 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:26:40.959 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:26:40.960 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:26:40.960 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:26:40.960 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.957+0000 7f5c52b9e640 1 -- 172.21.15.17:0/3681400828 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c3806e170 msgr2=0x7f5c38070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.957+0000 7f5c52b9e640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c3806e170 0x7f5c38070630 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c000c00 tx=0x7f5c3c005a20 comp rx=0 tx=0).stop 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.957+0000 7f5c52b9e640 1 -- 172.21.15.17:0/3681400828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c0fe820 msgr2=0x7f5c4c0fae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.957+0000 7f5c52b9e640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c0fe820 0x7f5c4c0fae30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800e970 tx=0x7f5c4800ed70 comp rx=0 tx=0).stop 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.957+0000 7f5c52b9e640 1 -- 172.21.15.17:0/3681400828 shutdown_connections 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.957+0000 7f5c52b9e640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c3806e170 0x7f5c38070630 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.957+0000 7f5c52b9e640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c4c104820 0x7f5c4c0fb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.957+0000 7f5c52b9e640 1 --2- 172.21.15.17:0/3681400828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c4c0fe820 0x7f5c4c0fae30 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.957+0000 7f5c52b9e640 1 -- 172.21.15.17:0/3681400828 >> 172.21.15.17:0/3681400828 conn(0x7f5c4c0fa4e0 msgr2=0x7f5c4c068930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.957+0000 7f5c52b9e640 1 -- 172.21.15.17:0/3681400828 shutdown_connections 2024-08-19T01:26:40.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:40.957+0000 7f5c52b9e640 1 -- 172.21.15.17:0/3681400828 wait complete. 2024-08-19T01:26:41.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.040+0000 7f890ff1d640 1 -- 172.21.15.17:0/2683068344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8908100750 msgr2=0x7f89081047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:41.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.040+0000 7f890ff1d640 1 --2- 172.21.15.17:0/2683068344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8908100750 0x7f89081047a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f88f8009880 tx=0x7f88f802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.040+0000 7f890ff1d640 1 -- 172.21.15.17:0/2683068344 shutdown_connections 2024-08-19T01:26:41.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.040+0000 7f890ff1d640 1 --2- 172.21.15.17:0/2683068344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8908100750 0x7f89081047a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.040+0000 7f890ff1d640 1 --2- 172.21.15.17:0/2683068344 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f89080ffda0 0x7f8908100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.040+0000 7f890ff1d640 1 -- 172.21.15.17:0/2683068344 >> 172.21.15.17:0/2683068344 conn(0x7f89080fb840 msgr2=0x7f89080fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:41.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.040+0000 7f890ff1d640 1 -- 172.21.15.17:0/2683068344 shutdown_connections 2024-08-19T01:26:41.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.040+0000 7f890ff1d640 1 -- 172.21.15.17:0/2683068344 wait complete. 2024-08-19T01:26:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890ff1d640 1 Processor -- start 2024-08-19T01:26:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890ff1d640 1 -- start start 2024-08-19T01:26:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890ff1d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89080ffda0 0x7f890819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890ff1d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8908100750 0x7f890819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890ff1d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8908195930 con 0x7f89080ffda0 2024-08-19T01:26:41.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890ff1d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8908195a70 con 0x7f8908100750 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890dcb9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89080ffda0 0x7f890819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890dcb9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89080ffda0 0x7f890819b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42486/0 (socket says 172.21.15.17:42486) 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890dcb9640 1 -- 172.21.15.17:0/2732884009 learned_addr learned my addr 172.21.15.17:0/2732884009 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890d4b8640 1 --2- 172.21.15.17:0/2732884009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8908100750 0x7f890819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890dcb9640 1 -- 172.21.15.17:0/2732884009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8908100750 msgr2=0x7f890819be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890dcb9640 1 --2- 172.21.15.17:0/2732884009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8908100750 0x7f890819be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890dcb9640 1 -- 172.21.15.17:0/2732884009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f8009560 con 0x7f89080ffda0 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.041+0000 7f890dcb9640 1 --2- 172.21.15.17:0/2732884009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89080ffda0 0x7f890819b8d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f890400e970 tx=0x7f890400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.042+0000 7f88feffd640 1 -- 172.21.15.17:0/2732884009 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f890400cc90 con 0x7f89080ffda0 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.042+0000 7f88feffd640 1 -- 172.21.15.17:0/2732884009 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f890400cdf0 con 0x7f89080ffda0 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.042+0000 7f890ff1d640 1 -- 172.21.15.17:0/2732884009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8908195d50 con 0x7f89080ffda0 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.042+0000 7f88feffd640 1 -- 172.21.15.17:0/2732884009 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8904010430 con 0x7f89080ffda0 2024-08-19T01:26:41.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.042+0000 7f890ff1d640 1 -- 172.21.15.17:0/2732884009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8908196270 con 0x7f89080ffda0 2024-08-19T01:26:41.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.043+0000 7f890ff1d640 1 -- 172.21.15.17:0/2732884009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8908101280 con 0x7f89080ffda0 2024-08-19T01:26:41.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.043+0000 7f88feffd640 1 -- 172.21.15.17:0/2732884009 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f89040046c0 con 0x7f89080ffda0 2024-08-19T01:26:41.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.044+0000 7f88feffd640 1 --2- 172.21.15.17:0/2732884009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f88f406e170 0x7f88f4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:41.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.044+0000 7f88feffd640 1 -- 172.21.15.17:0/2732884009 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8904014070 con 0x7f89080ffda0 2024-08-19T01:26:41.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.044+0000 7f890d4b8640 1 --2- 172.21.15.17:0/2732884009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f88f406e170 0x7f88f4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:41.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.044+0000 7f890d4b8640 1 --2- 172.21.15.17:0/2732884009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f88f406e170 0x7f88f4070630 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f88f8000c00 tx=0x7f88f8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:41.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.048+0000 7f88feffd640 1 -- 172.21.15.17:0/2732884009 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8904057a00 con 0x7f89080ffda0 2024-08-19T01:26:41.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.241+0000 7f890ff1d640 1 -- 172.21.15.17:0/2732884009 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f890810cdd0 con 0x7f88f406e170 2024-08-19T01:26:41.243 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:41 smithi017 ceph-mon[99370]: from='client.35550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:41.244 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:41 smithi017 ceph-mon[99370]: from='client.35554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:41.244 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:41 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4132521386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:26:41.244 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:41 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3681400828' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:26:41.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.242+0000 7f88feffd640 1 -- 172.21.15.17:0/2732884009 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f890810cdd0 con 0x7f88f406e170 2024-08-19T01:26:41.244 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:26:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:26:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:26:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:26:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:26:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:26:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:26:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:26:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:26:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:26:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:26:41.245 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:26:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:26:41.246 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:26:41.246 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:26:41.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.244+0000 7f890ff1d640 1 -- 172.21.15.17:0/2732884009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f88f406e170 msgr2=0x7f88f4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:41.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.244+0000 7f890ff1d640 1 --2- 172.21.15.17:0/2732884009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f88f406e170 0x7f88f4070630 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f88f8000c00 tx=0x7f88f8005a20 comp rx=0 tx=0).stop 2024-08-19T01:26:41.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.244+0000 7f890ff1d640 1 -- 172.21.15.17:0/2732884009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89080ffda0 msgr2=0x7f890819b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:41.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.244+0000 7f890ff1d640 1 --2- 172.21.15.17:0/2732884009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89080ffda0 0x7f890819b8d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f890400e970 tx=0x7f890400ed70 comp rx=0 tx=0).stop 2024-08-19T01:26:41.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.244+0000 7f890ff1d640 1 -- 172.21.15.17:0/2732884009 shutdown_connections 2024-08-19T01:26:41.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.244+0000 7f890ff1d640 1 --2- 172.21.15.17:0/2732884009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f88f406e170 0x7f88f4070630 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.244+0000 7f890ff1d640 1 --2- 172.21.15.17:0/2732884009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8908100750 0x7f890819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.244+0000 7f890ff1d640 1 --2- 172.21.15.17:0/2732884009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89080ffda0 0x7f890819b8d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.244+0000 7f890ff1d640 1 -- 172.21.15.17:0/2732884009 >> 172.21.15.17:0/2732884009 conn(0x7f89080fb840 msgr2=0x7f89080fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:41.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.244+0000 7f890ff1d640 1 -- 172.21.15.17:0/2732884009 shutdown_connections 2024-08-19T01:26:41.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.244+0000 7f890ff1d640 1 -- 172.21.15.17:0/2732884009 wait complete. 2024-08-19T01:26:41.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.327+0000 7fb98ef1b640 1 -- 172.21.15.17:0/2257430403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9880ffda0 msgr2=0x7fb988100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:41.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.327+0000 7fb98ef1b640 1 --2- 172.21.15.17:0/2257430403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9880ffda0 0x7fb988100180 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb978009c20 tx=0x7fb97802a970 comp rx=0 tx=0).stop 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.327+0000 7fb98ef1b640 1 -- 172.21.15.17:0/2257430403 shutdown_connections 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.327+0000 7fb98ef1b640 1 --2- 172.21.15.17:0/2257430403 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb988100750 0x7fb9881047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.327+0000 7fb98ef1b640 1 --2- 172.21.15.17:0/2257430403 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9880ffda0 0x7fb988100180 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.327+0000 7fb98ef1b640 1 -- 172.21.15.17:0/2257430403 >> 172.21.15.17:0/2257430403 conn(0x7fb9880fb840 msgr2=0x7fb9880fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.327+0000 7fb98ef1b640 1 -- 172.21.15.17:0/2257430403 shutdown_connections 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.327+0000 7fb98ef1b640 1 -- 172.21.15.17:0/2257430403 wait complete. 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.327+0000 7fb98ef1b640 1 Processor -- start 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.327+0000 7fb98ef1b640 1 -- start start 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ef1b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9880ffda0 0x7fb9880727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ef1b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb988100750 0x7fb988072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ef1b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb988074780 con 0x7fb9880ffda0 2024-08-19T01:26:41.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ef1b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb988073230 con 0x7fb988100750 2024-08-19T01:26:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ccb7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9880ffda0 0x7fb9880727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ccb7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9880ffda0 0x7fb9880727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42504/0 (socket says 172.21.15.17:42504) 2024-08-19T01:26:41.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ccb7640 1 -- 172.21.15.17:0/3082982258 learned_addr learned my addr 172.21.15.17:0/3082982258 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:26:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ccb7640 1 -- 172.21.15.17:0/3082982258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb988100750 msgr2=0x7fb988072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb987fff640 1 --2- 172.21.15.17:0/3082982258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb988100750 0x7fb988072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ccb7640 1 --2- 172.21.15.17:0/3082982258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb988100750 0x7fb988072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ccb7640 1 -- 172.21.15.17:0/3082982258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb978009900 con 0x7fb9880ffda0 2024-08-19T01:26:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ccb7640 1 --2- 172.21.15.17:0/3082982258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9880ffda0 0x7fb9880727b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb97802ae90 tx=0x7fb9780308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb985ffb640 1 -- 172.21.15.17:0/3082982258 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb97802f590 con 0x7fb9880ffda0 2024-08-19T01:26:41.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb985ffb640 1 -- 172.21.15.17:0/3082982258 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb978030ca0 con 0x7fb9880ffda0 2024-08-19T01:26:41.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb98ef1b640 1 -- 172.21.15.17:0/3082982258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9880734b0 con 0x7fb9880ffda0 2024-08-19T01:26:41.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.328+0000 7fb985ffb640 1 -- 172.21.15.17:0/3082982258 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb978039680 con 0x7fb9880ffda0 2024-08-19T01:26:41.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.329+0000 7fb98ef1b640 1 -- 172.21.15.17:0/3082982258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9881a1e90 con 0x7fb9880ffda0 2024-08-19T01:26:41.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.330+0000 7fb98ef1b640 1 -- 172.21.15.17:0/3082982258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb988101280 con 0x7fb9880ffda0 2024-08-19T01:26:41.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.330+0000 7fb985ffb640 1 -- 172.21.15.17:0/3082982258 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb97800a040 con 0x7fb9880ffda0 2024-08-19T01:26:41.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.331+0000 7fb985ffb640 1 --2- 172.21.15.17:0/3082982258 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb97406e170 0x7fb974070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:26:41.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.331+0000 7fb985ffb640 1 -- 172.21.15.17:0/3082982258 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb97802c040 con 0x7fb9880ffda0 2024-08-19T01:26:41.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.331+0000 7fb987fff640 1 --2- 172.21.15.17:0/3082982258 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb97406e170 0x7fb974070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:26:41.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.331+0000 7fb987fff640 1 --2- 172.21.15.17:0/3082982258 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb97406e170 0x7fb974070630 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb988073f30 tx=0x7fb970005cc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:26:41.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.335+0000 7fb985ffb640 1 -- 172.21.15.17:0/3082982258 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb978078860 con 0x7fb9880ffda0 2024-08-19T01:26:41.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:41 smithi086 ceph-mon[71303]: from='client.35550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:41.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:41 smithi086 ceph-mon[71303]: from='client.35554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:41.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:41 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4132521386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:26:41.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:41 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3681400828' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:26:41.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.580+0000 7fb98ef1b640 1 -- 172.21.15.17:0/3082982258 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb988073d40 con 0x7fb9880ffda0 2024-08-19T01:26:41.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.580+0000 7fb985ffb640 1 -- 172.21.15.17:0/3082982258 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7fb97809c020 con 0x7fb9880ffda0 2024-08-19T01:26:41.583 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:26:41.583 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:26:41.583 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:26:41.583 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:26:41.583 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:26:41.583 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:26:41.583 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:26:41.584 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:26:41.585 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:26:41.585 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:26:41.585 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:26:41.585 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:26:41.585 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:26:41.585 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:26:41.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.583+0000 7fb98ef1b640 1 -- 172.21.15.17:0/3082982258 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb97406e170 msgr2=0x7fb974070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:41.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.583+0000 7fb98ef1b640 1 --2- 172.21.15.17:0/3082982258 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb97406e170 0x7fb974070630 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb988073f30 tx=0x7fb970005cc0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.583+0000 7fb98ef1b640 1 -- 172.21.15.17:0/3082982258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9880ffda0 msgr2=0x7fb9880727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:26:41.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.583+0000 7fb98ef1b640 1 --2- 172.21.15.17:0/3082982258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9880ffda0 0x7fb9880727b0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb97802ae90 tx=0x7fb9780308a0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.583+0000 7fb98ef1b640 1 -- 172.21.15.17:0/3082982258 shutdown_connections 2024-08-19T01:26:41.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.583+0000 7fb98ef1b640 1 --2- 172.21.15.17:0/3082982258 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb97406e170 0x7fb974070630 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.583+0000 7fb98ef1b640 1 --2- 172.21.15.17:0/3082982258 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb988100750 0x7fb988072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.583+0000 7fb98ef1b640 1 --2- 172.21.15.17:0/3082982258 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9880ffda0 0x7fb9880727b0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:26:41.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.583+0000 7fb98ef1b640 1 -- 172.21.15.17:0/3082982258 >> 172.21.15.17:0/3082982258 conn(0x7fb9880fb840 msgr2=0x7fb9880fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:26:41.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.583+0000 7fb98ef1b640 1 -- 172.21.15.17:0/3082982258 shutdown_connections 2024-08-19T01:26:41.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:26:41.583+0000 7fb98ef1b640 1 -- 172.21.15.17:0/3082982258 wait complete. 2024-08-19T01:26:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:42 smithi017 ceph-mon[99370]: pgmap v838: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:42 smithi017 ceph-mon[99370]: from='client.35558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:42.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:42 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3082982258' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:26:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:42 smithi086 ceph-mon[71303]: pgmap v838: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:42 smithi086 ceph-mon[71303]: from='client.35558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:42.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:42 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3082982258' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:26:43.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:43 smithi017 ceph-mon[99370]: from='client.35570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:43.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:43 smithi086 ceph-mon[71303]: from='client.35570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:26:44.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:44 smithi017 ceph-mon[99370]: pgmap v839: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:44.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:44 smithi086 ceph-mon[71303]: pgmap v839: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:46.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:46 smithi017 ceph-mon[99370]: pgmap v840: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:46.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:46 smithi086 ceph-mon[71303]: pgmap v840: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:48 smithi017 ceph-mon[99370]: pgmap v841: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:48.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:26:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:48 smithi086 ceph-mon[71303]: pgmap v841: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:48.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:26:50.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:50 smithi017 ceph-mon[99370]: pgmap v842: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:50.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:50 smithi086 ceph-mon[71303]: pgmap v842: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:52.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:52 smithi017 ceph-mon[99370]: pgmap v843: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:52.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:52 smithi086 ceph-mon[71303]: pgmap v843: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:54.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:54 smithi017 ceph-mon[99370]: pgmap v844: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:54.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:54 smithi086 ceph-mon[71303]: pgmap v844: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:56.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:56 smithi017 ceph-mon[99370]: pgmap v845: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:56.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:56 smithi086 ceph-mon[71303]: pgmap v845: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:58.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:26:58 smithi017 ceph-mon[99370]: pgmap v846: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:26:58.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:26:58 smithi086 ceph-mon[71303]: pgmap v846: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:00 smithi017 ceph-mon[99370]: pgmap v847: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:00.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:00 smithi086 ceph-mon[71303]: pgmap v847: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:02.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:02 smithi017 ceph-mon[99370]: pgmap v848: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:02.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:02 smithi086 ceph-mon[71303]: pgmap v848: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:03.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:27:03.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:27:04.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:04 smithi017 ceph-mon[99370]: pgmap v849: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:04.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:04 smithi086 ceph-mon[71303]: pgmap v849: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:06.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:06 smithi017 ceph-mon[99370]: pgmap v850: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:06.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:06 smithi086 ceph-mon[71303]: pgmap v850: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:08 smithi017 ceph-mon[99370]: pgmap v851: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:08.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:08 smithi086 ceph-mon[71303]: pgmap v851: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:09.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:09 smithi017 ceph-mon[99370]: pgmap v852: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:09.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:09 smithi086 ceph-mon[71303]: pgmap v852: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:11.539 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:11 smithi086 ceph-mon[71303]: pgmap v853: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.677+0000 7fc6d0366640 1 -- 172.21.15.17:0/3246938780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8100d10 msgr2=0x7fc6c81010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:11.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.677+0000 7fc6d0366640 1 --2- 172.21.15.17:0/3246938780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8100d10 0x7fc6c81010f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40098b0 tx=0x7fc6c402a560 comp rx=0 tx=0).stop 2024-08-19T01:27:11.679 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:11 smithi017 ceph-mon[99370]: pgmap v853: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.677+0000 7fc6d0366640 1 -- 172.21.15.17:0/3246938780 shutdown_connections 2024-08-19T01:27:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.677+0000 7fc6d0366640 1 --2- 172.21.15.17:0/3246938780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c8101630 0x7fc6c8109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.677+0000 7fc6d0366640 1 --2- 172.21.15.17:0/3246938780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8100d10 0x7fc6c81010f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.677+0000 7fc6d0366640 1 -- 172.21.15.17:0/3246938780 >> 172.21.15.17:0/3246938780 conn(0x7fc6c80758a0 msgr2=0x7fc6c80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:11.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.677+0000 7fc6d0366640 1 -- 172.21.15.17:0/3246938780 shutdown_connections 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.677+0000 7fc6d0366640 1 -- 172.21.15.17:0/3246938780 wait complete. 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.678+0000 7fc6d0366640 1 Processor -- start 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.678+0000 7fc6d0366640 1 -- start start 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.678+0000 7fc6d0366640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c8100d10 0x7fc6c80fe970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.678+0000 7fc6d0366640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8101630 0x7fc6c80feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.678+0000 7fc6d0366640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8100940 con 0x7fc6c8101630 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.678+0000 7fc6d0366640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c80ff3f0 con 0x7fc6c8100d10 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.678+0000 7fc6cd901640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8101630 0x7fc6c80feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.678+0000 7fc6cd901640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8101630 0x7fc6c80feeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51754/0 (socket says 172.21.15.17:51754) 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.678+0000 7fc6cd901640 1 -- 172.21.15.17:0/1975175912 learned_addr learned my addr 172.21.15.17:0/1975175912 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.679+0000 7fc6ce102640 1 --2- 172.21.15.17:0/1975175912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c8100d10 0x7fc6c80fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.679+0000 7fc6cd901640 1 -- 172.21.15.17:0/1975175912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c8100d10 msgr2=0x7fc6c80fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:11.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.679+0000 7fc6cd901640 1 --2- 172.21.15.17:0/1975175912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c8100d10 0x7fc6c80fe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:11.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.679+0000 7fc6cd901640 1 -- 172.21.15.17:0/1975175912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4009560 con 0x7fc6c8101630 2024-08-19T01:27:11.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.679+0000 7fc6cd901640 1 --2- 172.21.15.17:0/1975175912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8101630 0x7fc6c80feeb0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800c8a0 tx=0x7fc6b800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:11.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.679+0000 7fc6bf7fe640 1 -- 172.21.15.17:0/1975175912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b8007b80 con 0x7fc6c8101630 2024-08-19T01:27:11.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.679+0000 7fc6bf7fe640 1 -- 172.21.15.17:0/1975175912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6b8007ce0 con 0x7fc6c8101630 2024-08-19T01:27:11.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.679+0000 7fc6d0366640 1 -- 172.21.15.17:0/1975175912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c80ff6d0 con 0x7fc6c8101630 2024-08-19T01:27:11.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.679+0000 7fc6bf7fe640 1 -- 172.21.15.17:0/1975175912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b8018810 con 0x7fc6c8101630 2024-08-19T01:27:11.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.679+0000 7fc6d0366640 1 -- 172.21.15.17:0/1975175912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c81a1fa0 con 0x7fc6c8101630 2024-08-19T01:27:11.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.680+0000 7fc6d0366640 1 -- 172.21.15.17:0/1975175912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c80684b0 con 0x7fc6c8101630 2024-08-19T01:27:11.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.681+0000 7fc6bf7fe640 1 -- 172.21.15.17:0/1975175912 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc6b8018970 con 0x7fc6c8101630 2024-08-19T01:27:11.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.681+0000 7fc6bf7fe640 1 --2- 172.21.15.17:0/1975175912 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc6b406e180 0x7fc6b4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:11.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.682+0000 7fc6bf7fe640 1 -- 172.21.15.17:0/1975175912 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc6b808e270 con 0x7fc6c8101630 2024-08-19T01:27:11.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.682+0000 7fc6ce102640 1 --2- 172.21.15.17:0/1975175912 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc6b406e180 0x7fc6b4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:11.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.682+0000 7fc6ce102640 1 --2- 172.21.15.17:0/1975175912 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc6b406e180 0x7fc6b4070640 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009880 tx=0x7fc6c4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:11.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.686+0000 7fc6bf7fe640 1 -- 172.21.15.17:0/1975175912 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc6b8057530 con 0x7fc6c8101630 2024-08-19T01:27:11.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.878+0000 7fc6d0366640 1 -- 172.21.15.17:0/1975175912 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6c810cd80 con 0x7fc6b406e180 2024-08-19T01:27:11.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.879+0000 7fc6bf7fe640 1 -- 172.21.15.17:0/1975175912 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc6c810cd80 con 0x7fc6b406e180 2024-08-19T01:27:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.881+0000 7fc6d0366640 1 -- 172.21.15.17:0/1975175912 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc6b406e180 msgr2=0x7fc6b4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.881+0000 7fc6d0366640 1 --2- 172.21.15.17:0/1975175912 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc6b406e180 0x7fc6b4070640 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4009880 tx=0x7fc6c4005a20 comp rx=0 tx=0).stop 2024-08-19T01:27:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.881+0000 7fc6d0366640 1 -- 172.21.15.17:0/1975175912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8101630 msgr2=0x7fc6c80feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.881+0000 7fc6d0366640 1 --2- 172.21.15.17:0/1975175912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8101630 0x7fc6c80feeb0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800c8a0 tx=0x7fc6b800cd60 comp rx=0 tx=0).stop 2024-08-19T01:27:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.881+0000 7fc6d0366640 1 -- 172.21.15.17:0/1975175912 shutdown_connections 2024-08-19T01:27:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.881+0000 7fc6d0366640 1 --2- 172.21.15.17:0/1975175912 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc6b406e180 0x7fc6b4070640 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.881+0000 7fc6d0366640 1 --2- 172.21.15.17:0/1975175912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6c8101630 0x7fc6c80feeb0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:11.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.881+0000 7fc6d0366640 1 --2- 172.21.15.17:0/1975175912 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc6c8100d10 0x7fc6c80fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:11.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.881+0000 7fc6d0366640 1 -- 172.21.15.17:0/1975175912 >> 172.21.15.17:0/1975175912 conn(0x7fc6c80758a0 msgr2=0x7fc6c8101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:11.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.881+0000 7fc6d0366640 1 -- 172.21.15.17:0/1975175912 shutdown_connections 2024-08-19T01:27:11.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.881+0000 7fc6d0366640 1 -- 172.21.15.17:0/1975175912 wait complete. 2024-08-19T01:27:11.892 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:27:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.965+0000 7f6570805640 1 -- 172.21.15.17:0/974259563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c100750 msgr2=0x7f656c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.965+0000 7f6570805640 1 --2- 172.21.15.17:0/974259563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c100750 0x7f656c1047a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6560009880 tx=0x7f656002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:27:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.965+0000 7f6570805640 1 -- 172.21.15.17:0/974259563 shutdown_connections 2024-08-19T01:27:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.965+0000 7f6570805640 1 --2- 172.21.15.17:0/974259563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c100750 0x7f656c1047a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.965+0000 7f6570805640 1 --2- 172.21.15.17:0/974259563 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656c0ffda0 0x7f656c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:11.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.965+0000 7f6570805640 1 -- 172.21.15.17:0/974259563 >> 172.21.15.17:0/974259563 conn(0x7f656c0fb840 msgr2=0x7f656c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.965+0000 7f6570805640 1 -- 172.21.15.17:0/974259563 shutdown_connections 2024-08-19T01:27:11.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.965+0000 7f6570805640 1 -- 172.21.15.17:0/974259563 wait complete. 2024-08-19T01:27:11.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.966+0000 7f6570805640 1 Processor -- start 2024-08-19T01:27:11.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.966+0000 7f6570805640 1 -- start start 2024-08-19T01:27:11.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.966+0000 7f6570805640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c0ffda0 0x7f656c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:11.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.966+0000 7f6570805640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656c100750 0x7f656c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:11.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.966+0000 7f6570805640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c19c380 con 0x7f656c0ffda0 2024-08-19T01:27:11.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.966+0000 7f6570805640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c195910 con 0x7f656c100750 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.966+0000 7f656a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c0ffda0 0x7f656c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.966+0000 7f656a59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c0ffda0 0x7f656c19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51770/0 (socket says 172.21.15.17:51770) 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.966+0000 7f656a59c640 1 -- 172.21.15.17:0/2532609252 learned_addr learned my addr 172.21.15.17:0/2532609252 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.966+0000 7f6569d9b640 1 --2- 172.21.15.17:0/2532609252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656c100750 0x7f656c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.966+0000 7f656a59c640 1 -- 172.21.15.17:0/2532609252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656c100750 msgr2=0x7f656c19bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.967+0000 7f656a59c640 1 --2- 172.21.15.17:0/2532609252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656c100750 0x7f656c19bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.967+0000 7f656a59c640 1 -- 172.21.15.17:0/2532609252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6560009560 con 0x7f656c0ffda0 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.967+0000 7f656a59c640 1 --2- 172.21.15.17:0/2532609252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c0ffda0 0x7f656c19b820 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f655c00d8d0 tx=0x7f655c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.967+0000 7f655b7fe640 1 -- 172.21.15.17:0/2532609252 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f655c00bea0 con 0x7f656c0ffda0 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.967+0000 7f6570805640 1 -- 172.21.15.17:0/2532609252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656c195bf0 con 0x7f656c0ffda0 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.967+0000 7f655b7fe640 1 -- 172.21.15.17:0/2532609252 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f655c009c00 con 0x7f656c0ffda0 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.967+0000 7f655b7fe640 1 -- 172.21.15.17:0/2532609252 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f655c00f710 con 0x7f656c0ffda0 2024-08-19T01:27:11.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.967+0000 7f6570805640 1 -- 172.21.15.17:0/2532609252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656c196110 con 0x7f656c0ffda0 2024-08-19T01:27:11.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.968+0000 7f6570805640 1 -- 172.21.15.17:0/2532609252 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f656c101280 con 0x7f656c0ffda0 2024-08-19T01:27:11.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.968+0000 7f655b7fe640 1 -- 172.21.15.17:0/2532609252 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f655c00f990 con 0x7f656c0ffda0 2024-08-19T01:27:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.969+0000 7f655b7fe640 1 --2- 172.21.15.17:0/2532609252 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f655406e170 0x7f6554070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.969+0000 7f655b7fe640 1 -- 172.21.15.17:0/2532609252 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f655c08de70 con 0x7f656c0ffda0 2024-08-19T01:27:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.969+0000 7f6569d9b640 1 --2- 172.21.15.17:0/2532609252 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f655406e170 0x7f6554070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:11.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.969+0000 7f6569d9b640 1 --2- 172.21.15.17:0/2532609252 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f655406e170 0x7f6554070630 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6560009230 tx=0x7f65600058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:11.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:11.973+0000 7f655b7fe640 1 -- 172.21.15.17:0/2532609252 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f655c057200 con 0x7f656c0ffda0 2024-08-19T01:27:12.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.164+0000 7f6570805640 1 -- 172.21.15.17:0/2532609252 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f656c108120 con 0x7f655406e170 2024-08-19T01:27:12.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.165+0000 7f655b7fe640 1 -- 172.21.15.17:0/2532609252 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f656c108120 con 0x7f655406e170 2024-08-19T01:27:12.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.167+0000 7f6570805640 1 -- 172.21.15.17:0/2532609252 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f655406e170 msgr2=0x7f6554070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.167+0000 7f6570805640 1 --2- 172.21.15.17:0/2532609252 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f655406e170 0x7f6554070630 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6560009230 tx=0x7f65600058d0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.167+0000 7f6570805640 1 -- 172.21.15.17:0/2532609252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c0ffda0 msgr2=0x7f656c19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.167+0000 7f6570805640 1 --2- 172.21.15.17:0/2532609252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c0ffda0 0x7f656c19b820 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f655c00d8d0 tx=0x7f655c00dd90 comp rx=0 tx=0).stop 2024-08-19T01:27:12.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.167+0000 7f6570805640 1 -- 172.21.15.17:0/2532609252 shutdown_connections 2024-08-19T01:27:12.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.167+0000 7f6570805640 1 --2- 172.21.15.17:0/2532609252 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f655406e170 0x7f6554070630 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.167+0000 7f6570805640 1 --2- 172.21.15.17:0/2532609252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f656c100750 0x7f656c19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.167+0000 7f6570805640 1 --2- 172.21.15.17:0/2532609252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f656c0ffda0 0x7f656c19b820 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.167+0000 7f6570805640 1 -- 172.21.15.17:0/2532609252 >> 172.21.15.17:0/2532609252 conn(0x7f656c0fb840 msgr2=0x7f656c0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:12.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.167+0000 7f6570805640 1 -- 172.21.15.17:0/2532609252 shutdown_connections 2024-08-19T01:27:12.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.167+0000 7f6570805640 1 -- 172.21.15.17:0/2532609252 wait complete. 2024-08-19T01:27:12.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.249+0000 7fea8f818640 1 -- 172.21.15.17:0/84297242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea881015d0 msgr2=0x7fea88109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.249+0000 7fea8f818640 1 --2- 172.21.15.17:0/84297242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea881015d0 0x7fea88109ac0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fea78009880 tx=0x7fea7802a530 comp rx=0 tx=0).stop 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.249+0000 7fea8f818640 1 -- 172.21.15.17:0/84297242 shutdown_connections 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.249+0000 7fea8f818640 1 --2- 172.21.15.17:0/84297242 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea881015d0 0x7fea88109ac0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.249+0000 7fea8f818640 1 --2- 172.21.15.17:0/84297242 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea88100cb0 0x7fea88101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.249+0000 7fea8f818640 1 -- 172.21.15.17:0/84297242 >> 172.21.15.17:0/84297242 conn(0x7fea880758a0 msgr2=0x7fea880fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.250+0000 7fea8f818640 1 -- 172.21.15.17:0/84297242 shutdown_connections 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.250+0000 7fea8f818640 1 -- 172.21.15.17:0/84297242 wait complete. 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.250+0000 7fea8f818640 1 Processor -- start 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.250+0000 7fea8f818640 1 -- start start 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.250+0000 7fea8f818640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea88100cb0 0x7fea8819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.250+0000 7fea8f818640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea881015d0 0x7fea8819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.250+0000 7fea8f818640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8819c3b0 con 0x7fea881015d0 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.250+0000 7fea8f818640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea88195940 con 0x7fea88100cb0 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.250+0000 7fea8cdb3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea881015d0 0x7fea8819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:12.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea8cdb3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea881015d0 0x7fea8819bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51788/0 (socket says 172.21.15.17:51788) 2024-08-19T01:27:12.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea8cdb3640 1 -- 172.21.15.17:0/2031427982 learned_addr learned my addr 172.21.15.17:0/2031427982 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:12.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea8d5b4640 1 --2- 172.21.15.17:0/2031427982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea88100cb0 0x7fea8819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:12.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea8cdb3640 1 -- 172.21.15.17:0/2031427982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea88100cb0 msgr2=0x7fea8819b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea8cdb3640 1 --2- 172.21.15.17:0/2031427982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea88100cb0 0x7fea8819b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea8cdb3640 1 -- 172.21.15.17:0/2031427982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78009560 con 0x7fea881015d0 2024-08-19T01:27:12.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea8cdb3640 1 --2- 172.21.15.17:0/2031427982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea881015d0 0x7fea8819bd90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fea7802aa50 tx=0x7fea780055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:12.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea7e7fc640 1 -- 172.21.15.17:0/2031427982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea780048d0 con 0x7fea881015d0 2024-08-19T01:27:12.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea7e7fc640 1 -- 172.21.15.17:0/2031427982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea78031640 con 0x7fea881015d0 2024-08-19T01:27:12.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea7e7fc640 1 -- 172.21.15.17:0/2031427982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea780038d0 con 0x7fea881015d0 2024-08-19T01:27:12.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea8f818640 1 -- 172.21.15.17:0/2031427982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea88195bc0 con 0x7fea881015d0 2024-08-19T01:27:12.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.251+0000 7fea8f818640 1 -- 172.21.15.17:0/2031427982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea881960b0 con 0x7fea881015d0 2024-08-19T01:27:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.252+0000 7fea8f818640 1 -- 172.21.15.17:0/2031427982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea88068510 con 0x7fea881015d0 2024-08-19T01:27:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.253+0000 7fea7e7fc640 1 -- 172.21.15.17:0/2031427982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fea7802ad50 con 0x7fea881015d0 2024-08-19T01:27:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.253+0000 7fea7e7fc640 1 --2- 172.21.15.17:0/2031427982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fea7406e170 0x7fea74070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.254+0000 7fea7e7fc640 1 -- 172.21.15.17:0/2031427982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fea780aee60 con 0x7fea881015d0 2024-08-19T01:27:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.254+0000 7fea8d5b4640 1 --2- 172.21.15.17:0/2031427982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fea7406e170 0x7fea74070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:12.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.254+0000 7fea8d5b4640 1 --2- 172.21.15.17:0/2031427982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fea7406e170 0x7fea74070630 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fea84005fd0 tx=0x7fea8400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:12.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.258+0000 7fea7e7fc640 1 -- 172.21.15.17:0/2031427982 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fea780781f0 con 0x7fea881015d0 2024-08-19T01:27:12.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.440+0000 7fea8f818640 1 -- 172.21.15.17:0/2031427982 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea8810cda0 con 0x7fea7406e170 2024-08-19T01:27:12.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.450+0000 7fea7e7fc640 1 -- 172.21.15.17:0/2031427982 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fea8810cda0 con 0x7fea7406e170 2024-08-19T01:27:12.452 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:27:12.452 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (28m) 6m ago 39m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:27:12.452 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (39m) 6m ago 39m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:27:12.452 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (38m) 7m ago 38m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:27:12.452 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (26m) 6m ago 39m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:27:12.452 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (26m) 7m ago 38m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:27:12.452 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (28m) 6m ago 38m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:27:12.452 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (22m) 6m ago 33m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (22m) 6m ago 33m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (7m) 7m ago 33m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (22m) 7m ago 33m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (30m) 6m ago 40m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (29m) 7m ago 38m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (27m) 6m ago 40m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (26m) 7m ago 38m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (29m) 6m ago 39m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (29m) 7m ago 38m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (25m) 6m ago 37m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (25m) 6m ago 36m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (24m) 6m ago 36m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:27:12.453 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (24m) 7m ago 36m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:27:12.454 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (23m) 7m ago 35m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:27:12.454 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (23m) 7m ago 35m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:27:12.454 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (28m) 6m ago 38m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:27:12.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.452+0000 7fea8f818640 1 -- 172.21.15.17:0/2031427982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fea7406e170 msgr2=0x7fea74070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.452+0000 7fea8f818640 1 --2- 172.21.15.17:0/2031427982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fea7406e170 0x7fea74070630 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fea84005fd0 tx=0x7fea8400b390 comp rx=0 tx=0).stop 2024-08-19T01:27:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.452+0000 7fea8f818640 1 -- 172.21.15.17:0/2031427982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea881015d0 msgr2=0x7fea8819bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.452+0000 7fea8f818640 1 --2- 172.21.15.17:0/2031427982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea881015d0 0x7fea8819bd90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fea7802aa50 tx=0x7fea780055a0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.452+0000 7fea8f818640 1 -- 172.21.15.17:0/2031427982 shutdown_connections 2024-08-19T01:27:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.452+0000 7fea8f818640 1 --2- 172.21.15.17:0/2031427982 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fea7406e170 0x7fea74070630 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.452+0000 7fea8f818640 1 --2- 172.21.15.17:0/2031427982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fea881015d0 0x7fea8819bd90 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.452+0000 7fea8f818640 1 --2- 172.21.15.17:0/2031427982 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fea88100cb0 0x7fea8819b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.452+0000 7fea8f818640 1 -- 172.21.15.17:0/2031427982 >> 172.21.15.17:0/2031427982 conn(0x7fea880758a0 msgr2=0x7fea88101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.452+0000 7fea8f818640 1 -- 172.21.15.17:0/2031427982 shutdown_connections 2024-08-19T01:27:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.452+0000 7fea8f818640 1 -- 172.21.15.17:0/2031427982 wait complete. 2024-08-19T01:27:12.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.533+0000 7f6585353640 1 -- 172.21.15.17:0/3564474729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6580100750 msgr2=0x7f65801047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.533+0000 7f6585353640 1 --2- 172.21.15.17:0/3564474729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6580100750 0x7f65801047a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6568009880 tx=0x7f656802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.533+0000 7f6585353640 1 -- 172.21.15.17:0/3564474729 shutdown_connections 2024-08-19T01:27:12.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.533+0000 7f6585353640 1 --2- 172.21.15.17:0/3564474729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6580100750 0x7f65801047a0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.533+0000 7f6585353640 1 --2- 172.21.15.17:0/3564474729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65800ffda0 0x7f6580100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.533+0000 7f6585353640 1 -- 172.21.15.17:0/3564474729 >> 172.21.15.17:0/3564474729 conn(0x7f65800fb840 msgr2=0x7f65800fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:12.537 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:12 smithi017 ceph-mon[99370]: from='client.35578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.533+0000 7f6585353640 1 -- 172.21.15.17:0/3564474729 shutdown_connections 2024-08-19T01:27:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.533+0000 7f6585353640 1 -- 172.21.15.17:0/3564474729 wait complete. 2024-08-19T01:27:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.533+0000 7f6585353640 1 Processor -- start 2024-08-19T01:27:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f6585353640 1 -- start start 2024-08-19T01:27:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f6585353640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65800ffda0 0x7f658019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f6585353640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6580100750 0x7f658019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f6585353640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6580195930 con 0x7f65800ffda0 2024-08-19T01:27:12.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f6585353640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6580195a70 con 0x7f6580100750 2024-08-19T01:27:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f657effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65800ffda0 0x7f658019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f657effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65800ffda0 0x7f658019b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51798/0 (socket says 172.21.15.17:51798) 2024-08-19T01:27:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f657effd640 1 -- 172.21.15.17:0/1563408717 learned_addr learned my addr 172.21.15.17:0/1563408717 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f657e7fc640 1 --2- 172.21.15.17:0/1563408717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6580100750 0x7f658019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f657effd640 1 -- 172.21.15.17:0/1563408717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6580100750 msgr2=0x7f658019be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f657effd640 1 --2- 172.21.15.17:0/1563408717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6580100750 0x7f658019be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.534+0000 7f657effd640 1 -- 172.21.15.17:0/1563408717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6568009560 con 0x7f65800ffda0 2024-08-19T01:27:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.535+0000 7f657effd640 1 --2- 172.21.15.17:0/1563408717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65800ffda0 0x7f658019b8d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f657000cc60 tx=0x7f657000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.535+0000 7f6577fff640 1 -- 172.21.15.17:0/1563408717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6570004b20 con 0x7f65800ffda0 2024-08-19T01:27:12.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.535+0000 7f6585353640 1 -- 172.21.15.17:0/1563408717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6580195d50 con 0x7f65800ffda0 2024-08-19T01:27:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.535+0000 7f6577fff640 1 -- 172.21.15.17:0/1563408717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6570004c80 con 0x7f65800ffda0 2024-08-19T01:27:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.535+0000 7f6577fff640 1 -- 172.21.15.17:0/1563408717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f657000f640 con 0x7f65800ffda0 2024-08-19T01:27:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.535+0000 7f6585353640 1 -- 172.21.15.17:0/1563408717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6580196270 con 0x7f65800ffda0 2024-08-19T01:27:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.536+0000 7f6585353640 1 -- 172.21.15.17:0/1563408717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6560005250 con 0x7f65800ffda0 2024-08-19T01:27:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.537+0000 7f6577fff640 1 -- 172.21.15.17:0/1563408717 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f657000f940 con 0x7f65800ffda0 2024-08-19T01:27:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.537+0000 7f6577fff640 1 --2- 172.21.15.17:0/1563408717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f656c06e170 0x7f656c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.537+0000 7f6577fff640 1 -- 172.21.15.17:0/1563408717 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f657008e200 con 0x7f65800ffda0 2024-08-19T01:27:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.537+0000 7f657e7fc640 1 --2- 172.21.15.17:0/1563408717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f656c06e170 0x7f656c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:12.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.538+0000 7f657e7fc640 1 --2- 172.21.15.17:0/1563408717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f656c06e170 0x7f656c070630 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6568000c00 tx=0x7f6568005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:12.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.542+0000 7f6577fff640 1 -- 172.21.15.17:0/1563408717 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f65700574e0 con 0x7f65800ffda0 2024-08-19T01:27:12.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:12 smithi086 ceph-mon[71303]: from='client.35578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:12.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.790+0000 7f6585353640 1 -- 172.21.15.17:0/1563408717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6560005d10 con 0x7f65800ffda0 2024-08-19T01:27:12.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.790+0000 7f6577fff640 1 -- 172.21.15.17:0/1563408717 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f657005aba0 con 0x7f65800ffda0 2024-08-19T01:27:12.792 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:27:12.793 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:27:12.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:27:12.794 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:27:12.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.793+0000 7f6585353640 1 -- 172.21.15.17:0/1563408717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f656c06e170 msgr2=0x7f656c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.793+0000 7f6585353640 1 --2- 172.21.15.17:0/1563408717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f656c06e170 0x7f656c070630 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6568000c00 tx=0x7f6568005a20 comp rx=0 tx=0).stop 2024-08-19T01:27:12.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.793+0000 7f6585353640 1 -- 172.21.15.17:0/1563408717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65800ffda0 msgr2=0x7f658019b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.793+0000 7f6585353640 1 --2- 172.21.15.17:0/1563408717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65800ffda0 0x7f658019b8d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f657000cc60 tx=0x7f657000a620 comp rx=0 tx=0).stop 2024-08-19T01:27:12.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.793+0000 7f6585353640 1 -- 172.21.15.17:0/1563408717 shutdown_connections 2024-08-19T01:27:12.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.793+0000 7f6585353640 1 --2- 172.21.15.17:0/1563408717 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f656c06e170 0x7f656c070630 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.793+0000 7f6585353640 1 --2- 172.21.15.17:0/1563408717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6580100750 0x7f658019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.793+0000 7f6585353640 1 --2- 172.21.15.17:0/1563408717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65800ffda0 0x7f658019b8d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.793+0000 7f6585353640 1 -- 172.21.15.17:0/1563408717 >> 172.21.15.17:0/1563408717 conn(0x7f65800fb840 msgr2=0x7f65800fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:12.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.793+0000 7f6585353640 1 -- 172.21.15.17:0/1563408717 shutdown_connections 2024-08-19T01:27:12.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.793+0000 7f6585353640 1 -- 172.21.15.17:0/1563408717 wait complete. 2024-08-19T01:27:12.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.874+0000 7f6e2af5f640 1 -- 172.21.15.17:0/114220589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e240fe880 msgr2=0x7f6e240fec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.874+0000 7f6e2af5f640 1 --2- 172.21.15.17:0/114220589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e240fe880 0x7f6e240fec60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009880 tx=0x7f6e2002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.874+0000 7f6e2af5f640 1 -- 172.21.15.17:0/114220589 shutdown_connections 2024-08-19T01:27:12.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.874+0000 7f6e2af5f640 1 --2- 172.21.15.17:0/114220589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e240ff230 0x7f6e2410bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.874+0000 7f6e2af5f640 1 --2- 172.21.15.17:0/114220589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e240fe880 0x7f6e240fec60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.874+0000 7f6e2af5f640 1 -- 172.21.15.17:0/114220589 >> 172.21.15.17:0/114220589 conn(0x7f6e240fa730 msgr2=0x7f6e240fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:12.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.874+0000 7f6e2af5f640 1 -- 172.21.15.17:0/114220589 shutdown_connections 2024-08-19T01:27:12.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.874+0000 7f6e2af5f640 1 -- 172.21.15.17:0/114220589 wait complete. 2024-08-19T01:27:12.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.875+0000 7f6e2af5f640 1 Processor -- start 2024-08-19T01:27:12.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.875+0000 7f6e2af5f640 1 -- start start 2024-08-19T01:27:12.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.875+0000 7f6e2af5f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e240fe880 0x7f6e24197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:12.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.875+0000 7f6e2af5f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e240ff230 0x7f6e241981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.875+0000 7f6e2af5f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e241988c0 con 0x7f6e240fe880 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.875+0000 7f6e2af5f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2419b530 con 0x7f6e240ff230 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.875+0000 7f6e28cfb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e240fe880 0x7f6e24197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.875+0000 7f6e28cfb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e240fe880 0x7f6e24197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51820/0 (socket says 172.21.15.17:51820) 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.875+0000 7f6e28cfb640 1 -- 172.21.15.17:0/2474338329 learned_addr learned my addr 172.21.15.17:0/2474338329 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.875+0000 7f6e1bfff640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e240ff230 0x7f6e241981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.876+0000 7f6e28cfb640 1 -- 172.21.15.17:0/2474338329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e240ff230 msgr2=0x7f6e241981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.876+0000 7f6e28cfb640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e240ff230 0x7f6e241981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.876+0000 7f6e28cfb640 1 -- 172.21.15.17:0/2474338329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20009560 con 0x7f6e240fe880 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.876+0000 7f6e1bfff640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e240ff230 0x7f6e241981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.876+0000 7f6e28cfb640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e240fe880 0x7f6e24197ca0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6e2002a9c0 tx=0x7f6e200055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:12.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.876+0000 7f6e19ffb640 1 -- 172.21.15.17:0/2474338329 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e20004aa0 con 0x7f6e240fe880 2024-08-19T01:27:12.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.876+0000 7f6e19ffb640 1 -- 172.21.15.17:0/2474338329 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e20004c00 con 0x7f6e240fe880 2024-08-19T01:27:12.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.876+0000 7f6e2af5f640 1 -- 172.21.15.17:0/2474338329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2419b810 con 0x7f6e240fe880 2024-08-19T01:27:12.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.876+0000 7f6e19ffb640 1 -- 172.21.15.17:0/2474338329 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e20003980 con 0x7f6e240fe880 2024-08-19T01:27:12.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.876+0000 7f6e2af5f640 1 -- 172.21.15.17:0/2474338329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2419bd60 con 0x7f6e240fe880 2024-08-19T01:27:12.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.877+0000 7f6e2af5f640 1 -- 172.21.15.17:0/2474338329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e24068d30 con 0x7f6e240fe880 2024-08-19T01:27:12.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.878+0000 7f6e19ffb640 1 -- 172.21.15.17:0/2474338329 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6e20003bf0 con 0x7f6e240fe880 2024-08-19T01:27:12.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.878+0000 7f6e19ffb640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6e0c06e170 0x7f6e0c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:12.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.878+0000 7f6e19ffb640 1 -- 172.21.15.17:0/2474338329 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6e200af180 con 0x7f6e240fe880 2024-08-19T01:27:12.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.878+0000 7f6e1bfff640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6e0c06e170 0x7f6e0c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:12.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.879+0000 7f6e1bfff640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6e0c06e170 0x7f6e0c070630 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6e140058c0 tx=0x7f6e14005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:12.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:12.883+0000 7f6e19ffb640 1 -- 172.21.15.17:0/2474338329 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6e20078460 con 0x7f6e240fe880 2024-08-19T01:27:13.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.093+0000 7f6e2af5f640 1 -- 172.21.15.17:0/2474338329 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6e24106770 con 0x7f6e240fe880 2024-08-19T01:27:13.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.094+0000 7f6e19ffb640 1 -- 172.21.15.17:0/2474338329 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f6e2007bb20 con 0x7f6e240fe880 2024-08-19T01:27:13.096 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:27:13.096 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:27:13.096 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:27:13.096 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:27:13.096 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:27:13.096 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:27:13.096 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:27:13.096 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:27:13.097 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:27:13.098 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:27:13.099 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:27:13.099 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:27:13.099 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:27:13.099 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:27:13.099 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:27:13.099 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:27:13.099 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:27:13.099 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:27:13.099 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:27:13.100 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:27:13.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.096+0000 7f6e2af5f640 1 -- 172.21.15.17:0/2474338329 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6e0c06e170 msgr2=0x7f6e0c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:13.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.096+0000 7f6e2af5f640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6e0c06e170 0x7f6e0c070630 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6e140058c0 tx=0x7f6e14005850 comp rx=0 tx=0).stop 2024-08-19T01:27:13.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.096+0000 7f6e2af5f640 1 -- 172.21.15.17:0/2474338329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e240fe880 msgr2=0x7f6e24197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:13.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.096+0000 7f6e2af5f640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e240fe880 0x7f6e24197ca0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6e2002a9c0 tx=0x7f6e200055a0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.096+0000 7f6e2af5f640 1 -- 172.21.15.17:0/2474338329 shutdown_connections 2024-08-19T01:27:13.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.096+0000 7f6e2af5f640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6e0c06e170 0x7f6e0c070630 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.096+0000 7f6e2af5f640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6e240ff230 0x7f6e241981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.096+0000 7f6e2af5f640 1 --2- 172.21.15.17:0/2474338329 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6e240fe880 0x7f6e24197ca0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.096+0000 7f6e2af5f640 1 -- 172.21.15.17:0/2474338329 >> 172.21.15.17:0/2474338329 conn(0x7f6e240fa730 msgr2=0x7f6e240fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:13.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.096+0000 7f6e2af5f640 1 -- 172.21.15.17:0/2474338329 shutdown_connections 2024-08-19T01:27:13.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.096+0000 7f6e2af5f640 1 -- 172.21.15.17:0/2474338329 wait complete. 2024-08-19T01:27:13.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.180+0000 7fd325ff4640 1 -- 172.21.15.17:0/622589608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3201049f0 msgr2=0x7fd320104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:13.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.180+0000 7fd325ff4640 1 --2- 172.21.15.17:0/622589608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3201049f0 0x7fd320104dd0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd310009880 tx=0x7fd31002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.180+0000 7fd325ff4640 1 -- 172.21.15.17:0/622589608 shutdown_connections 2024-08-19T01:27:13.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.180+0000 7fd325ff4640 1 --2- 172.21.15.17:0/622589608 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3200fe9f0 0x7fd3200fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.180+0000 7fd325ff4640 1 --2- 172.21.15.17:0/622589608 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3201049f0 0x7fd320104dd0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.180+0000 7fd325ff4640 1 -- 172.21.15.17:0/622589608 >> 172.21.15.17:0/622589608 conn(0x7fd3200758a0 msgr2=0x7fd3200fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:13.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.180+0000 7fd325ff4640 1 -- 172.21.15.17:0/622589608 shutdown_connections 2024-08-19T01:27:13.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.180+0000 7fd325ff4640 1 -- 172.21.15.17:0/622589608 wait complete. 2024-08-19T01:27:13.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.180+0000 7fd325ff4640 1 Processor -- start 2024-08-19T01:27:13.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.180+0000 7fd325ff4640 1 -- start start 2024-08-19T01:27:13.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd325ff4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200fe9f0 0x7fd3200fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:13.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd325ff4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3201049f0 0x7fd3200fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:13.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd325ff4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200fb800 con 0x7fd3200fe9f0 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd325ff4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3200fb940 con 0x7fd3201049f0 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd31f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200fe9f0 0x7fd3200fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd31f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200fe9f0 0x7fd3200fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51830/0 (socket says 172.21.15.17:51830) 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd31f7fe640 1 -- 172.21.15.17:0/3511663528 learned_addr learned my addr 172.21.15.17:0/3511663528 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd31effd640 1 --2- 172.21.15.17:0/3511663528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3201049f0 0x7fd3200fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd31f7fe640 1 -- 172.21.15.17:0/3511663528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3201049f0 msgr2=0x7fd3200fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd31f7fe640 1 --2- 172.21.15.17:0/3511663528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3201049f0 0x7fd3200fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd31f7fe640 1 -- 172.21.15.17:0/3511663528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd310009560 con 0x7fd3200fe9f0 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.181+0000 7fd31f7fe640 1 --2- 172.21.15.17:0/3511663528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200fe9f0 0x7fd3200fad80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd31002a9c0 tx=0x7fd3100055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.182+0000 7fd31cff9640 1 -- 172.21.15.17:0/3511663528 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd310004aa0 con 0x7fd3200fe9f0 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.182+0000 7fd31cff9640 1 -- 172.21.15.17:0/3511663528 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd310004c00 con 0x7fd3200fe9f0 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.182+0000 7fd325ff4640 1 -- 172.21.15.17:0/3511663528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3200fbbc0 con 0x7fd3200fe9f0 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.182+0000 7fd31cff9640 1 -- 172.21.15.17:0/3511663528 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd310003ab0 con 0x7fd3200fe9f0 2024-08-19T01:27:13.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.182+0000 7fd325ff4640 1 -- 172.21.15.17:0/3511663528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3201a1fd0 con 0x7fd3200fe9f0 2024-08-19T01:27:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.183+0000 7fd325ff4640 1 -- 172.21.15.17:0/3511663528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd320100130 con 0x7fd3200fe9f0 2024-08-19T01:27:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.183+0000 7fd31cff9640 1 -- 172.21.15.17:0/3511663528 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd310003ce0 con 0x7fd3200fe9f0 2024-08-19T01:27:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.184+0000 7fd31cff9640 1 --2- 172.21.15.17:0/3511663528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd30806e170 0x7fd308070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:13.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.184+0000 7fd31cff9640 1 -- 172.21.15.17:0/3511663528 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd3100af1c0 con 0x7fd3200fe9f0 2024-08-19T01:27:13.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.184+0000 7fd31effd640 1 --2- 172.21.15.17:0/3511663528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd30806e170 0x7fd308070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:13.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.184+0000 7fd31effd640 1 --2- 172.21.15.17:0/3511663528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd30806e170 0x7fd308070630 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd3200fc880 tx=0x7fd31400a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:13.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.189+0000 7fd31cff9640 1 -- 172.21.15.17:0/3511663528 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd310078550 con 0x7fd3200fe9f0 2024-08-19T01:27:13.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.381+0000 7fd325ff4640 1 -- 172.21.15.17:0/3511663528 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd32010bc80 con 0x7fd30806e170 2024-08-19T01:27:13.383 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:13 smithi017 ceph-mon[99370]: from='client.35582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:13.383 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:13 smithi017 ceph-mon[99370]: pgmap v854: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:13.383 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:13 smithi017 ceph-mon[99370]: from='client.35586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:13.383 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:13 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1563408717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:27:13.383 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:13 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2474338329' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:27:13.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.382+0000 7fd31cff9640 1 -- 172.21.15.17:0/3511663528 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd32010bc80 con 0x7fd30806e170 2024-08-19T01:27:13.384 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:27:13.384 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:27:13.384 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:27:13.384 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:27:13.384 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:27:13.384 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:27:13.384 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:27:13.384 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:27:13.385 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:27:13.385 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:27:13.385 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:27:13.385 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:27:13.385 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:27:13.385 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:27:13.385 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:27:13.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.384+0000 7fd325ff4640 1 -- 172.21.15.17:0/3511663528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd30806e170 msgr2=0x7fd308070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:13.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.384+0000 7fd325ff4640 1 --2- 172.21.15.17:0/3511663528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd30806e170 0x7fd308070630 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd3200fc880 tx=0x7fd31400a250 comp rx=0 tx=0).stop 2024-08-19T01:27:13.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.384+0000 7fd325ff4640 1 -- 172.21.15.17:0/3511663528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200fe9f0 msgr2=0x7fd3200fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:13.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.384+0000 7fd325ff4640 1 --2- 172.21.15.17:0/3511663528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200fe9f0 0x7fd3200fad80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd31002a9c0 tx=0x7fd3100055a0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.384+0000 7fd325ff4640 1 -- 172.21.15.17:0/3511663528 shutdown_connections 2024-08-19T01:27:13.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.384+0000 7fd325ff4640 1 --2- 172.21.15.17:0/3511663528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd30806e170 0x7fd308070630 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.384+0000 7fd325ff4640 1 --2- 172.21.15.17:0/3511663528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3201049f0 0x7fd3200fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.384+0000 7fd325ff4640 1 --2- 172.21.15.17:0/3511663528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3200fe9f0 0x7fd3200fad80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.384+0000 7fd325ff4640 1 -- 172.21.15.17:0/3511663528 >> 172.21.15.17:0/3511663528 conn(0x7fd3200758a0 msgr2=0x7fd3200fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:13.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.384+0000 7fd325ff4640 1 -- 172.21.15.17:0/3511663528 shutdown_connections 2024-08-19T01:27:13.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.384+0000 7fd325ff4640 1 -- 172.21.15.17:0/3511663528 wait complete. 2024-08-19T01:27:13.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.466+0000 7ff08a85a640 1 -- 172.21.15.17:0/3571326078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0840ffe20 msgr2=0x7ff084100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:13.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.466+0000 7ff08a85a640 1 --2- 172.21.15.17:0/3571326078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0840ffe20 0x7ff084100200 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff074009880 tx=0x7ff07402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.466+0000 7ff08a85a640 1 -- 172.21.15.17:0/3571326078 shutdown_connections 2024-08-19T01:27:13.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.466+0000 7ff08a85a640 1 --2- 172.21.15.17:0/3571326078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0841007d0 0x7ff084104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.466+0000 7ff08a85a640 1 --2- 172.21.15.17:0/3571326078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0840ffe20 0x7ff084100200 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.466+0000 7ff08a85a640 1 -- 172.21.15.17:0/3571326078 >> 172.21.15.17:0/3571326078 conn(0x7ff0840fb900 msgr2=0x7ff0840fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:13.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.466+0000 7ff08a85a640 1 -- 172.21.15.17:0/3571326078 shutdown_connections 2024-08-19T01:27:13.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.467+0000 7ff08a85a640 1 -- 172.21.15.17:0/3571326078 wait complete. 2024-08-19T01:27:13.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.467+0000 7ff08a85a640 1 Processor -- start 2024-08-19T01:27:13.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.467+0000 7ff08a85a640 1 -- start start 2024-08-19T01:27:13.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff08a85a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0840ffe20 0x7ff08419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:13.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff08a85a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841007d0 0x7ff08419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:13.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff08a85a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08419c400 con 0x7ff0841007d0 2024-08-19T01:27:13.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff08a85a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0841959e0 con 0x7ff0840ffe20 2024-08-19T01:27:13.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff0837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841007d0 0x7ff08419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:13.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff0837fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841007d0 0x7ff08419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:51848/0 (socket says 172.21.15.17:51848) 2024-08-19T01:27:13.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff0837fe640 1 -- 172.21.15.17:0/1114663895 learned_addr learned my addr 172.21.15.17:0/1114663895 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:13.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff083fff640 1 --2- 172.21.15.17:0/1114663895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0840ffe20 0x7ff08419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:13.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff0837fe640 1 -- 172.21.15.17:0/1114663895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0840ffe20 msgr2=0x7ff08419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:13.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff0837fe640 1 --2- 172.21.15.17:0/1114663895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0840ffe20 0x7ff08419b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff0837fe640 1 -- 172.21.15.17:0/1114663895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff074009560 con 0x7ff0841007d0 2024-08-19T01:27:13.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff0837fe640 1 --2- 172.21.15.17:0/1114663895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841007d0 0x7ff08419bde0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff07800d6f0 tx=0x7ff07800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:13.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.468+0000 7ff0817fa640 1 -- 172.21.15.17:0/1114663895 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff078009a30 con 0x7ff0841007d0 2024-08-19T01:27:13.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.469+0000 7ff08a85a640 1 -- 172.21.15.17:0/1114663895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff084195cc0 con 0x7ff0841007d0 2024-08-19T01:27:13.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.469+0000 7ff0817fa640 1 -- 172.21.15.17:0/1114663895 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff0780054e0 con 0x7ff0841007d0 2024-08-19T01:27:13.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.469+0000 7ff0817fa640 1 -- 172.21.15.17:0/1114663895 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff078010460 con 0x7ff0841007d0 2024-08-19T01:27:13.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.469+0000 7ff08a85a640 1 -- 172.21.15.17:0/1114663895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff084196210 con 0x7ff0841007d0 2024-08-19T01:27:13.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.470+0000 7ff08a85a640 1 -- 172.21.15.17:0/1114663895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff084101300 con 0x7ff0841007d0 2024-08-19T01:27:13.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.470+0000 7ff0817fa640 1 -- 172.21.15.17:0/1114663895 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff078009b90 con 0x7ff0841007d0 2024-08-19T01:27:13.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.471+0000 7ff0817fa640 1 --2- 172.21.15.17:0/1114663895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff06c06e170 0x7ff06c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:13.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.471+0000 7ff0817fa640 1 -- 172.21.15.17:0/1114663895 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff07808dc70 con 0x7ff0841007d0 2024-08-19T01:27:13.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.471+0000 7ff083fff640 1 --2- 172.21.15.17:0/1114663895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff06c06e170 0x7ff06c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:13.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.471+0000 7ff083fff640 1 --2- 172.21.15.17:0/1114663895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff06c06e170 0x7ff06c070630 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff074009230 tx=0x7ff0740058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:13.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.475+0000 7ff0817fa640 1 -- 172.21.15.17:0/1114663895 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff078094080 con 0x7ff0841007d0 2024-08-19T01:27:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:13 smithi086 ceph-mon[71303]: from='client.35582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:13 smithi086 ceph-mon[71303]: pgmap v854: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:13 smithi086 ceph-mon[71303]: from='client.35586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:13 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1563408717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:27:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:13 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2474338329' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:27:13.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.720+0000 7ff08a85a640 1 -- 172.21.15.17:0/1114663895 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff084108130 con 0x7ff0841007d0 2024-08-19T01:27:13.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.720+0000 7ff0817fa640 1 -- 172.21.15.17:0/1114663895 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7ff078020090 con 0x7ff0841007d0 2024-08-19T01:27:13.722 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:27:13.722 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:27:13.722 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:27:13.722 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:27:13.722 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:27:13.722 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:27:13.723 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:27:13.724 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:27:13.724 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:27:13.724 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:27:13.724 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:27:13.724 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:27:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.723+0000 7ff08a85a640 1 -- 172.21.15.17:0/1114663895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff06c06e170 msgr2=0x7ff06c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.723+0000 7ff08a85a640 1 --2- 172.21.15.17:0/1114663895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff06c06e170 0x7ff06c070630 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff074009230 tx=0x7ff0740058d0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.723+0000 7ff08a85a640 1 -- 172.21.15.17:0/1114663895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841007d0 msgr2=0x7ff08419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.723+0000 7ff08a85a640 1 --2- 172.21.15.17:0/1114663895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841007d0 0x7ff08419bde0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff07800d6f0 tx=0x7ff07800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.723+0000 7ff08a85a640 1 -- 172.21.15.17:0/1114663895 shutdown_connections 2024-08-19T01:27:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.723+0000 7ff08a85a640 1 --2- 172.21.15.17:0/1114663895 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff06c06e170 0x7ff06c070630 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.723+0000 7ff08a85a640 1 --2- 172.21.15.17:0/1114663895 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0841007d0 0x7ff08419bde0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.723+0000 7ff08a85a640 1 --2- 172.21.15.17:0/1114663895 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff0840ffe20 0x7ff08419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.723+0000 7ff08a85a640 1 -- 172.21.15.17:0/1114663895 >> 172.21.15.17:0/1114663895 conn(0x7ff0840fb900 msgr2=0x7ff0840fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.723+0000 7ff08a85a640 1 -- 172.21.15.17:0/1114663895 shutdown_connections 2024-08-19T01:27:13.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:13.723+0000 7ff08a85a640 1 -- 172.21.15.17:0/1114663895 wait complete. 2024-08-19T01:27:14.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:14 smithi017 ceph-mon[99370]: from='client.35598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:14.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:14 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1114663895' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:27:14.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:14 smithi086 ceph-mon[71303]: from='client.35598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:14.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:14 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1114663895' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:27:15.409 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:15 smithi017 ceph-mon[99370]: pgmap v855: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:15.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:15 smithi086 ceph-mon[71303]: pgmap v855: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:17.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:17 smithi017 ceph-mon[99370]: pgmap v856: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:17.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:17 smithi086 ceph-mon[71303]: pgmap v856: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:27:18.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:27:19.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:19 smithi017 ceph-mon[99370]: pgmap v857: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:19.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:19 smithi086 ceph-mon[71303]: pgmap v857: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:21.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:21 smithi017 ceph-mon[99370]: pgmap v858: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:21.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:21 smithi086 ceph-mon[71303]: pgmap v858: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:23.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:23 smithi017 ceph-mon[99370]: pgmap v859: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:23.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:23 smithi086 ceph-mon[71303]: pgmap v859: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:25.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:25 smithi017 ceph-mon[99370]: pgmap v860: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:25.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:25 smithi086 ceph-mon[71303]: pgmap v860: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:27.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:27 smithi017 ceph-mon[99370]: pgmap v861: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:27.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:27 smithi086 ceph-mon[71303]: pgmap v861: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:29.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:29 smithi017 ceph-mon[99370]: pgmap v862: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:29.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:29 smithi086 ceph-mon[71303]: pgmap v862: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:31.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:31 smithi017 ceph-mon[99370]: pgmap v863: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:31.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:31 smithi086 ceph-mon[71303]: pgmap v863: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:33.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:33 smithi017 ceph-mon[99370]: pgmap v864: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:33.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:27:33.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:33 smithi086 ceph-mon[71303]: pgmap v864: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:33.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:27:35.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:35 smithi017 ceph-mon[99370]: pgmap v865: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:35.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:35 smithi086 ceph-mon[71303]: pgmap v865: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:37.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:37 smithi017 ceph-mon[99370]: pgmap v866: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:37.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:37 smithi086 ceph-mon[71303]: pgmap v866: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:39.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:39 smithi017 ceph-mon[99370]: pgmap v867: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:39.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:39 smithi086 ceph-mon[71303]: pgmap v867: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:41.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:41 smithi017 ceph-mon[99370]: pgmap v868: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:41.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:41 smithi086 ceph-mon[71303]: pgmap v868: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:43.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:43 smithi017 ceph-mon[99370]: pgmap v869: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:43.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:43 smithi086 ceph-mon[71303]: pgmap v869: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.818+0000 7f8795b02640 1 -- 172.21.15.17:0/887343864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8790101650 msgr2=0x7f8790109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.818+0000 7f8795b02640 1 --2- 172.21.15.17:0/887343864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8790101650 0x7f8790109b40 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8778009880 tx=0x7f877802a530 comp rx=0 tx=0).stop 2024-08-19T01:27:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.818+0000 7f8795b02640 1 -- 172.21.15.17:0/887343864 shutdown_connections 2024-08-19T01:27:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.818+0000 7f8795b02640 1 --2- 172.21.15.17:0/887343864 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8790101650 0x7f8790109b40 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.818+0000 7f8795b02640 1 --2- 172.21.15.17:0/887343864 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8790100d30 0x7f8790101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:43.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.818+0000 7f8795b02640 1 -- 172.21.15.17:0/887343864 >> 172.21.15.17:0/887343864 conn(0x7f87900758a0 msgr2=0x7f87900fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.818+0000 7f8795b02640 1 -- 172.21.15.17:0/887343864 shutdown_connections 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.818+0000 7f8795b02640 1 -- 172.21.15.17:0/887343864 wait complete. 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.818+0000 7f8795b02640 1 Processor -- start 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.818+0000 7f8795b02640 1 -- start start 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.819+0000 7f8795b02640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8790100d30 0x7f879019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.819+0000 7f8795b02640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8790101650 0x7f879019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.819+0000 7f8795b02640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879019c390 con 0x7f8790100d30 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.819+0000 7f8795b02640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8790195920 con 0x7f8790101650 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.819+0000 7f878f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8790100d30 0x7f879019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.819+0000 7f878f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8790100d30 0x7f879019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38838/0 (socket says 172.21.15.17:38838) 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.819+0000 7f878f7fe640 1 -- 172.21.15.17:0/1453913508 learned_addr learned my addr 172.21.15.17:0/1453913508 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:43.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.819+0000 7f8786ffd640 1 --2- 172.21.15.17:0/1453913508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8790101650 0x7f879019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.819+0000 7f878f7fe640 1 -- 172.21.15.17:0/1453913508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8790101650 msgr2=0x7f879019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.819+0000 7f878f7fe640 1 --2- 172.21.15.17:0/1453913508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8790101650 0x7f879019bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.819+0000 7f878f7fe640 1 -- 172.21.15.17:0/1453913508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778009560 con 0x7f8790100d30 2024-08-19T01:27:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.820+0000 7f878f7fe640 1 --2- 172.21.15.17:0/1453913508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8790100d30 0x7f879019b830 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f878000d6f0 tx=0x7f878000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.820+0000 7f878d7fa640 1 -- 172.21.15.17:0/1453913508 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8780009a30 con 0x7f8790100d30 2024-08-19T01:27:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.820+0000 7f878d7fa640 1 -- 172.21.15.17:0/1453913508 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87800054e0 con 0x7f8790100d30 2024-08-19T01:27:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.820+0000 7f8795b02640 1 -- 172.21.15.17:0/1453913508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8790195c00 con 0x7f8790100d30 2024-08-19T01:27:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.820+0000 7f878d7fa640 1 -- 172.21.15.17:0/1453913508 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8780010460 con 0x7f8790100d30 2024-08-19T01:27:43.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.820+0000 7f8795b02640 1 -- 172.21.15.17:0/1453913508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8790196120 con 0x7f8790100d30 2024-08-19T01:27:43.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.821+0000 7f8795b02640 1 -- 172.21.15.17:0/1453913508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8790068490 con 0x7f8790100d30 2024-08-19T01:27:43.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.821+0000 7f878d7fa640 1 -- 172.21.15.17:0/1453913508 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8780009b90 con 0x7f8790100d30 2024-08-19T01:27:43.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.822+0000 7f878d7fa640 1 --2- 172.21.15.17:0/1453913508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f877c06e170 0x7f877c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:43.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.822+0000 7f878d7fa640 1 -- 172.21.15.17:0/1453913508 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f878008dc80 con 0x7f8790100d30 2024-08-19T01:27:43.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.822+0000 7f8786ffd640 1 --2- 172.21.15.17:0/1453913508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f877c06e170 0x7f877c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:43.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.823+0000 7f8786ffd640 1 --2- 172.21.15.17:0/1453913508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f877c06e170 0x7f877c070630 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8778031440 tx=0x7f8778005b70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:43.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:43.827+0000 7f878d7fa640 1 -- 172.21.15.17:0/1453913508 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8780056fe0 con 0x7f8790100d30 2024-08-19T01:27:44.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.020+0000 7f8795b02640 1 -- 172.21.15.17:0/1453913508 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8790104450 con 0x7f877c06e170 2024-08-19T01:27:44.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.022+0000 7f878d7fa640 1 -- 172.21.15.17:0/1453913508 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f8790104450 con 0x7f877c06e170 2024-08-19T01:27:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.024+0000 7f8795b02640 1 -- 172.21.15.17:0/1453913508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f877c06e170 msgr2=0x7f877c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.024+0000 7f8795b02640 1 --2- 172.21.15.17:0/1453913508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f877c06e170 0x7f877c070630 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8778031440 tx=0x7f8778005b70 comp rx=0 tx=0).stop 2024-08-19T01:27:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.024+0000 7f8795b02640 1 -- 172.21.15.17:0/1453913508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8790100d30 msgr2=0x7f879019b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.024+0000 7f8795b02640 1 --2- 172.21.15.17:0/1453913508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8790100d30 0x7f879019b830 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f878000d6f0 tx=0x7f878000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.024+0000 7f8795b02640 1 -- 172.21.15.17:0/1453913508 shutdown_connections 2024-08-19T01:27:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.024+0000 7f8795b02640 1 --2- 172.21.15.17:0/1453913508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f877c06e170 0x7f877c070630 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.024+0000 7f8795b02640 1 --2- 172.21.15.17:0/1453913508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8790101650 0x7f879019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.024+0000 7f8795b02640 1 --2- 172.21.15.17:0/1453913508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8790100d30 0x7f879019b830 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.024+0000 7f8795b02640 1 -- 172.21.15.17:0/1453913508 >> 172.21.15.17:0/1453913508 conn(0x7f87900758a0 msgr2=0x7f8790101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:44.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.024+0000 7f8795b02640 1 -- 172.21.15.17:0/1453913508 shutdown_connections 2024-08-19T01:27:44.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.024+0000 7f8795b02640 1 -- 172.21.15.17:0/1453913508 wait complete. 2024-08-19T01:27:44.036 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:27:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.107+0000 7f3f8c96d640 1 -- 172.21.15.17:0/3259296313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f88104a30 msgr2=0x7f3f88104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.107+0000 7f3f8c96d640 1 --2- 172.21.15.17:0/3259296313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f88104a30 0x7f3f88104e10 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009c20 tx=0x7f3f7802a970 comp rx=0 tx=0).stop 2024-08-19T01:27:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.107+0000 7f3f8c96d640 1 -- 172.21.15.17:0/3259296313 shutdown_connections 2024-08-19T01:27:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.107+0000 7f3f8c96d640 1 --2- 172.21.15.17:0/3259296313 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f880fea30 0x7f3f880fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.107+0000 7f3f8c96d640 1 --2- 172.21.15.17:0/3259296313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f88104a30 0x7f3f88104e10 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.107+0000 7f3f8c96d640 1 -- 172.21.15.17:0/3259296313 >> 172.21.15.17:0/3259296313 conn(0x7f3f880fa730 msgr2=0x7f3f880fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:44.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.107+0000 7f3f8c96d640 1 -- 172.21.15.17:0/3259296313 shutdown_connections 2024-08-19T01:27:44.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.107+0000 7f3f8c96d640 1 -- 172.21.15.17:0/3259296313 wait complete. 2024-08-19T01:27:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8c96d640 1 Processor -- start 2024-08-19T01:27:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8c96d640 1 -- start start 2024-08-19T01:27:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8c96d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f880fea30 0x7f3f88197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8c96d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f88104a30 0x7f3f88198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8c96d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f881988e0 con 0x7f3f880fea30 2024-08-19T01:27:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8c96d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8819c650 con 0x7f3f88104a30 2024-08-19T01:27:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f880fea30 0x7f3f88197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:44.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f880fea30 0x7f3f88197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38848/0 (socket says 172.21.15.17:38848) 2024-08-19T01:27:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8659c640 1 -- 172.21.15.17:0/4265712324 learned_addr learned my addr 172.21.15.17:0/4265712324 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f85d9b640 1 --2- 172.21.15.17:0/4265712324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f88104a30 0x7f3f88198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8659c640 1 -- 172.21.15.17:0/4265712324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f88104a30 msgr2=0x7f3f88198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8659c640 1 --2- 172.21.15.17:0/4265712324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f88104a30 0x7f3f88198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.108+0000 7f3f8659c640 1 -- 172.21.15.17:0/4265712324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f78009900 con 0x7f3f880fea30 2024-08-19T01:27:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.109+0000 7f3f8659c640 1 --2- 172.21.15.17:0/4265712324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f880fea30 0x7f3f88197d10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3f78032000 tx=0x7f3f780308a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.109+0000 7f3f777fe640 1 -- 172.21.15.17:0/4265712324 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f7802f590 con 0x7f3f880fea30 2024-08-19T01:27:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.109+0000 7f3f8c96d640 1 -- 172.21.15.17:0/4265712324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8819c8d0 con 0x7f3f880fea30 2024-08-19T01:27:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.109+0000 7f3f777fe640 1 -- 172.21.15.17:0/4265712324 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3f78030ca0 con 0x7f3f880fea30 2024-08-19T01:27:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.109+0000 7f3f777fe640 1 -- 172.21.15.17:0/4265712324 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f78039680 con 0x7f3f880fea30 2024-08-19T01:27:44.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.109+0000 7f3f8c96d640 1 -- 172.21.15.17:0/4265712324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8819cdc0 con 0x7f3f880fea30 2024-08-19T01:27:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.110+0000 7f3f8c96d640 1 -- 172.21.15.17:0/4265712324 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f88100170 con 0x7f3f880fea30 2024-08-19T01:27:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.111+0000 7f3f777fe640 1 -- 172.21.15.17:0/4265712324 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3f7800a040 con 0x7f3f880fea30 2024-08-19T01:27:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.111+0000 7f3f777fe640 1 --2- 172.21.15.17:0/4265712324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f7006e180 0x7f3f70070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:44.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.111+0000 7f3f777fe640 1 -- 172.21.15.17:0/4265712324 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3f7802c040 con 0x7f3f880fea30 2024-08-19T01:27:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.111+0000 7f3f85d9b640 1 --2- 172.21.15.17:0/4265712324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f7006e180 0x7f3f70070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:44.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.112+0000 7f3f85d9b640 1 --2- 172.21.15.17:0/4265712324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f7006e180 0x7f3f70070640 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3f881992c0 tx=0x7f3f7c00b590 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:44.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.115+0000 7f3f777fe640 1 -- 172.21.15.17:0/4265712324 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3f78078750 con 0x7f3f880fea30 2024-08-19T01:27:44.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.309+0000 7f3f8c96d640 1 -- 172.21.15.17:0/4265712324 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f88199140 con 0x7f3f7006e180 2024-08-19T01:27:44.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.311+0000 7f3f777fe640 1 -- 172.21.15.17:0/4265712324 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f3f7c00b340 con 0x7f3f7006e180 2024-08-19T01:27:44.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.312+0000 7f3f8c96d640 1 -- 172.21.15.17:0/4265712324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f7006e180 msgr2=0x7f3f70070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.312+0000 7f3f8c96d640 1 --2- 172.21.15.17:0/4265712324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f7006e180 0x7f3f70070640 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3f881992c0 tx=0x7f3f7c00b590 comp rx=0 tx=0).stop 2024-08-19T01:27:44.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.312+0000 7f3f8c96d640 1 -- 172.21.15.17:0/4265712324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f880fea30 msgr2=0x7f3f88197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.312+0000 7f3f8c96d640 1 --2- 172.21.15.17:0/4265712324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f880fea30 0x7f3f88197d10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3f78032000 tx=0x7f3f780308a0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.313+0000 7f3f8c96d640 1 -- 172.21.15.17:0/4265712324 shutdown_connections 2024-08-19T01:27:44.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.313+0000 7f3f8c96d640 1 --2- 172.21.15.17:0/4265712324 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3f7006e180 0x7f3f70070640 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.313+0000 7f3f8c96d640 1 --2- 172.21.15.17:0/4265712324 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3f88104a30 0x7f3f88198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.313+0000 7f3f8c96d640 1 --2- 172.21.15.17:0/4265712324 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f880fea30 0x7f3f88197d10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.313+0000 7f3f8c96d640 1 -- 172.21.15.17:0/4265712324 >> 172.21.15.17:0/4265712324 conn(0x7f3f880fa730 msgr2=0x7f3f88068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:44.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.313+0000 7f3f8c96d640 1 -- 172.21.15.17:0/4265712324 shutdown_connections 2024-08-19T01:27:44.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.313+0000 7f3f8c96d640 1 -- 172.21.15.17:0/4265712324 wait complete. 2024-08-19T01:27:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.394+0000 7f2017d21640 1 -- 172.21.15.17:0/2351379712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20101049f0 msgr2=0x7f2010104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.394+0000 7f2017d21640 1 --2- 172.21.15.17:0/2351379712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20101049f0 0x7f2010104dd0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2000009c20 tx=0x7f200002a970 comp rx=0 tx=0).stop 2024-08-19T01:27:44.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.394+0000 7f2017d21640 1 -- 172.21.15.17:0/2351379712 shutdown_connections 2024-08-19T01:27:44.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.394+0000 7f2017d21640 1 --2- 172.21.15.17:0/2351379712 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20100fe9f0 0x7f20100fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.394+0000 7f2017d21640 1 --2- 172.21.15.17:0/2351379712 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20101049f0 0x7f2010104dd0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.394+0000 7f2017d21640 1 -- 172.21.15.17:0/2351379712 >> 172.21.15.17:0/2351379712 conn(0x7f20100758a0 msgr2=0x7f20100fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:44.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:44 smithi017 ceph-mon[99370]: from='client.35606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:44.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.395+0000 7f2017d21640 1 -- 172.21.15.17:0/2351379712 shutdown_connections 2024-08-19T01:27:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.395+0000 7f2017d21640 1 -- 172.21.15.17:0/2351379712 wait complete. 2024-08-19T01:27:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.395+0000 7f2017d21640 1 Processor -- start 2024-08-19T01:27:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.395+0000 7f2017d21640 1 -- start start 2024-08-19T01:27:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.395+0000 7f2017d21640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20100fe9f0 0x7f20100fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.395+0000 7f2017d21640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20101049f0 0x7f20100fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.395+0000 7f2017d21640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20100fb800 con 0x7f20101049f0 2024-08-19T01:27:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.395+0000 7f2017d21640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20100fb940 con 0x7f20100fe9f0 2024-08-19T01:27:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f20152bc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20101049f0 0x7f20100fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f20152bc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20101049f0 0x7f20100fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38870/0 (socket says 172.21.15.17:38870) 2024-08-19T01:27:44.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f20152bc640 1 -- 172.21.15.17:0/1599845875 learned_addr learned my addr 172.21.15.17:0/1599845875 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f2015abd640 1 --2- 172.21.15.17:0/1599845875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20100fe9f0 0x7f20100fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f20152bc640 1 -- 172.21.15.17:0/1599845875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20100fe9f0 msgr2=0x7f20100fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f20152bc640 1 --2- 172.21.15.17:0/1599845875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20100fe9f0 0x7f20100fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f20152bc640 1 -- 172.21.15.17:0/1599845875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000009900 con 0x7f20101049f0 2024-08-19T01:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f20152bc640 1 --2- 172.21.15.17:0/1599845875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20101049f0 0x7f20100fb2c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f200400b420 tx=0x7f200400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f200effd640 1 -- 172.21.15.17:0/1599845875 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2004011800 con 0x7f20101049f0 2024-08-19T01:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f200effd640 1 -- 172.21.15.17:0/1599845875 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2004011e20 con 0x7f20101049f0 2024-08-19T01:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f2017d21640 1 -- 172.21.15.17:0/1599845875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20101a1d90 con 0x7f20101049f0 2024-08-19T01:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.396+0000 7f200effd640 1 -- 172.21.15.17:0/1599845875 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f200400f2e0 con 0x7f20101049f0 2024-08-19T01:27:44.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.397+0000 7f2017d21640 1 -- 172.21.15.17:0/1599845875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20101a21a0 con 0x7f20101049f0 2024-08-19T01:27:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.398+0000 7f2017d21640 1 -- 172.21.15.17:0/1599845875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2010100130 con 0x7f20101049f0 2024-08-19T01:27:44.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.398+0000 7f200effd640 1 -- 172.21.15.17:0/1599845875 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2004010380 con 0x7f20101049f0 2024-08-19T01:27:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.399+0000 7f200effd640 1 --2- 172.21.15.17:0/1599845875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ff806e170 0x7f1ff8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.399+0000 7f200effd640 1 -- 172.21.15.17:0/1599845875 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f200408d990 con 0x7f20101049f0 2024-08-19T01:27:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.399+0000 7f2015abd640 1 --2- 172.21.15.17:0/1599845875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ff806e170 0x7f1ff8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:44.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.399+0000 7f2015abd640 1 --2- 172.21.15.17:0/1599845875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ff806e170 0x7f1ff8070630 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2000000f80 tx=0x7f200003d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:44.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.403+0000 7f200effd640 1 -- 172.21.15.17:0/1599845875 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2004056cf0 con 0x7f20101049f0 2024-08-19T01:27:44.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.586+0000 7f2017d21640 1 -- 172.21.15.17:0/1599845875 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f201010bd50 con 0x7f1ff806e170 2024-08-19T01:27:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.595+0000 7f200effd640 1 -- 172.21.15.17:0/1599845875 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f201010bd50 con 0x7f1ff806e170 2024-08-19T01:27:44.599 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:27:44.599 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (29m) 7m ago 39m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:27:44.599 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (39m) 7m ago 39m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:27:44.599 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (38m) 7m ago 38m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:27:44.599 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (26m) 7m ago 39m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:27:44.600 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (26m) 7m ago 38m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:27:44.600 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (28m) 7m ago 39m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:27:44.600 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (23m) 7m ago 34m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:27:44.600 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (23m) 7m ago 34m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:27:44.600 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (7m) 7m ago 34m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:27:44.600 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (22m) 7m ago 34m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:27:44.601 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (30m) 7m ago 41m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:27:44.601 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (29m) 7m ago 38m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:27:44.601 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (27m) 7m ago 41m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:27:44.601 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (27m) 7m ago 38m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:27:44.601 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (29m) 7m ago 39m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:27:44.602 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (29m) 7m ago 38m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:27:44.602 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (26m) 7m ago 37m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:27:44.602 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (25m) 7m ago 37m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:27:44.602 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (25m) 7m ago 36m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:27:44.602 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (24m) 7m ago 36m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:27:44.602 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (24m) 7m ago 36m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:27:44.603 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (23m) 7m ago 35m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:27:44.603 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (29m) 7m ago 39m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:27:44.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.597+0000 7f2017d21640 1 -- 172.21.15.17:0/1599845875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ff806e170 msgr2=0x7f1ff8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.597+0000 7f2017d21640 1 --2- 172.21.15.17:0/1599845875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ff806e170 0x7f1ff8070630 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2000000f80 tx=0x7f200003d040 comp rx=0 tx=0).stop 2024-08-19T01:27:44.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.597+0000 7f2017d21640 1 -- 172.21.15.17:0/1599845875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20101049f0 msgr2=0x7f20100fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.597+0000 7f2017d21640 1 --2- 172.21.15.17:0/1599845875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20101049f0 0x7f20100fb2c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f200400b420 tx=0x7f200400b8e0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.597+0000 7f2017d21640 1 -- 172.21.15.17:0/1599845875 shutdown_connections 2024-08-19T01:27:44.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.597+0000 7f2017d21640 1 --2- 172.21.15.17:0/1599845875 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ff806e170 0x7f1ff8070630 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.597+0000 7f2017d21640 1 --2- 172.21.15.17:0/1599845875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20101049f0 0x7f20100fb2c0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.597+0000 7f2017d21640 1 --2- 172.21.15.17:0/1599845875 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20100fe9f0 0x7f20100fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.597+0000 7f2017d21640 1 -- 172.21.15.17:0/1599845875 >> 172.21.15.17:0/1599845875 conn(0x7f20100758a0 msgr2=0x7f20100fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.598+0000 7f2017d21640 1 -- 172.21.15.17:0/1599845875 shutdown_connections 2024-08-19T01:27:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.598+0000 7f2017d21640 1 -- 172.21.15.17:0/1599845875 wait complete. 2024-08-19T01:27:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.678+0000 7f27689dd640 1 -- 172.21.15.17:0/1796144059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2764100750 msgr2=0x7f27641047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.678+0000 7f27689dd640 1 --2- 172.21.15.17:0/1796144059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2764100750 0x7f27641047a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f274c009880 tx=0x7f274c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.678+0000 7f27689dd640 1 -- 172.21.15.17:0/1796144059 shutdown_connections 2024-08-19T01:27:44.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.678+0000 7f27689dd640 1 --2- 172.21.15.17:0/1796144059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2764100750 0x7f27641047a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.678+0000 7f27689dd640 1 --2- 172.21.15.17:0/1796144059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27640ffda0 0x7f2764100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.678+0000 7f27689dd640 1 -- 172.21.15.17:0/1796144059 >> 172.21.15.17:0/1796144059 conn(0x7f27640fb840 msgr2=0x7f27640fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:44.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.678+0000 7f27689dd640 1 -- 172.21.15.17:0/1796144059 shutdown_connections 2024-08-19T01:27:44.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.678+0000 7f27689dd640 1 -- 172.21.15.17:0/1796144059 wait complete. 2024-08-19T01:27:44.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.679+0000 7f27689dd640 1 Processor -- start 2024-08-19T01:27:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.679+0000 7f27689dd640 1 -- start start 2024-08-19T01:27:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.679+0000 7f27689dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27640ffda0 0x7f276419d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.679+0000 7f27689dd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2764100750 0x7f276419dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.679+0000 7f27689dd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276419e4e0 con 0x7f27640ffda0 2024-08-19T01:27:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.679+0000 7f27689dd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276419e650 con 0x7f2764100750 2024-08-19T01:27:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f276259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27640ffda0 0x7f276419d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f276259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27640ffda0 0x7f276419d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38888/0 (socket says 172.21.15.17:38888) 2024-08-19T01:27:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f276259c640 1 -- 172.21.15.17:0/2357359863 learned_addr learned my addr 172.21.15.17:0/2357359863 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f275bfff640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2764100750 0x7f276419dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f276259c640 1 -- 172.21.15.17:0/2357359863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2764100750 msgr2=0x7f276419dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f276259c640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2764100750 0x7f276419dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f276259c640 1 -- 172.21.15.17:0/2357359863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c009560 con 0x7f27640ffda0 2024-08-19T01:27:44.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f275bfff640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2764100750 0x7f276419dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:27:44.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f276259c640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27640ffda0 0x7f276419d9a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f275400c8a0 tx=0x7f275400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:44.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f275b7fe640 1 -- 172.21.15.17:0/2357359863 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2754007b80 con 0x7f27640ffda0 2024-08-19T01:27:44.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f27689dd640 1 -- 172.21.15.17:0/2357359863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2764197ce0 con 0x7f27640ffda0 2024-08-19T01:27:44.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f275b7fe640 1 -- 172.21.15.17:0/2357359863 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2754007ce0 con 0x7f27640ffda0 2024-08-19T01:27:44.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f275b7fe640 1 -- 172.21.15.17:0/2357359863 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2754018810 con 0x7f27640ffda0 2024-08-19T01:27:44.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.680+0000 7f27689dd640 1 -- 172.21.15.17:0/2357359863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2764198200 con 0x7f27640ffda0 2024-08-19T01:27:44.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.681+0000 7f27689dd640 1 -- 172.21.15.17:0/2357359863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2764101280 con 0x7f27640ffda0 2024-08-19T01:27:44.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.682+0000 7f275b7fe640 1 -- 172.21.15.17:0/2357359863 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f275400f450 con 0x7f27640ffda0 2024-08-19T01:27:44.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.682+0000 7f275b7fe640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f275006e170 0x7f2750070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:44.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.683+0000 7f275b7fe640 1 -- 172.21.15.17:0/2357359863 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f275408e350 con 0x7f27640ffda0 2024-08-19T01:27:44.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.683+0000 7f275bfff640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f275006e170 0x7f2750070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:44.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.683+0000 7f275bfff640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f275006e170 0x7f2750070630 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f274c000c00 tx=0x7f274c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:44.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.687+0000 7f275b7fe640 1 -- 172.21.15.17:0/2357359863 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2754057630 con 0x7f27640ffda0 2024-08-19T01:27:44.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:44 smithi086 ceph-mon[71303]: from='client.35606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:44.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.930+0000 7f27689dd640 1 -- 172.21.15.17:0/2357359863 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2764100180 con 0x7f27640ffda0 2024-08-19T01:27:44.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.930+0000 7f275b7fe640 1 -- 172.21.15.17:0/2357359863 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f275405acf0 con 0x7f27640ffda0 2024-08-19T01:27:44.933 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:27:44.933 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:27:44.933 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:27:44.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:27:44.934 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:27:44.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.932+0000 7f27689dd640 1 -- 172.21.15.17:0/2357359863 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f275006e170 msgr2=0x7f2750070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.932+0000 7f27689dd640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f275006e170 0x7f2750070630 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f274c000c00 tx=0x7f274c005a20 comp rx=0 tx=0).stop 2024-08-19T01:27:44.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.932+0000 7f27689dd640 1 -- 172.21.15.17:0/2357359863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27640ffda0 msgr2=0x7f276419d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:44.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.932+0000 7f27689dd640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27640ffda0 0x7f276419d9a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f275400c8a0 tx=0x7f275400cd60 comp rx=0 tx=0).stop 2024-08-19T01:27:44.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.932+0000 7f27689dd640 1 -- 172.21.15.17:0/2357359863 shutdown_connections 2024-08-19T01:27:44.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.932+0000 7f27689dd640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f275006e170 0x7f2750070630 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.932+0000 7f27689dd640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2764100750 0x7f276419dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.932+0000 7f27689dd640 1 --2- 172.21.15.17:0/2357359863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27640ffda0 0x7f276419d9a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:44.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.932+0000 7f27689dd640 1 -- 172.21.15.17:0/2357359863 >> 172.21.15.17:0/2357359863 conn(0x7f27640fb840 msgr2=0x7f27640fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:44.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.932+0000 7f27689dd640 1 -- 172.21.15.17:0/2357359863 shutdown_connections 2024-08-19T01:27:44.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:44.932+0000 7f27689dd640 1 -- 172.21.15.17:0/2357359863 wait complete. 2024-08-19T01:27:45.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.014+0000 7fa20d9d7640 1 -- 172.21.15.17:0/1739844456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2080ffda0 msgr2=0x7fa208100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.014+0000 7fa20d9d7640 1 --2- 172.21.15.17:0/1739844456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2080ffda0 0x7fa208100180 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009880 tx=0x7fa1f802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.014+0000 7fa20d9d7640 1 -- 172.21.15.17:0/1739844456 shutdown_connections 2024-08-19T01:27:45.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.014+0000 7fa20d9d7640 1 --2- 172.21.15.17:0/1739844456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa208100750 0x7fa2081047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.014+0000 7fa20d9d7640 1 --2- 172.21.15.17:0/1739844456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2080ffda0 0x7fa208100180 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.014+0000 7fa20d9d7640 1 -- 172.21.15.17:0/1739844456 >> 172.21.15.17:0/1739844456 conn(0x7fa2080fb840 msgr2=0x7fa2080fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:45.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.014+0000 7fa20d9d7640 1 -- 172.21.15.17:0/1739844456 shutdown_connections 2024-08-19T01:27:45.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.014+0000 7fa20d9d7640 1 -- 172.21.15.17:0/1739844456 wait complete. 2024-08-19T01:27:45.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.015+0000 7fa20d9d7640 1 Processor -- start 2024-08-19T01:27:45.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.015+0000 7fa20d9d7640 1 -- start start 2024-08-19T01:27:45.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.015+0000 7fa20d9d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2080ffda0 0x7fa2080727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.015+0000 7fa20d9d7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa208100750 0x7fa208072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.015+0000 7fa20d9d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa208073230 con 0x7fa2080ffda0 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.015+0000 7fa20d9d7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa208073370 con 0x7fa208100750 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.015+0000 7fa206ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2080ffda0 0x7fa2080727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.015+0000 7fa206ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2080ffda0 0x7fa2080727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38910/0 (socket says 172.21.15.17:38910) 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.015+0000 7fa206ffd640 1 -- 172.21.15.17:0/2649805129 learned_addr learned my addr 172.21.15.17:0/2649805129 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.015+0000 7fa2067fc640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa208100750 0x7fa208072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.016+0000 7fa206ffd640 1 -- 172.21.15.17:0/2649805129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa208100750 msgr2=0x7fa208072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.016+0000 7fa206ffd640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa208100750 0x7fa208072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.016+0000 7fa206ffd640 1 -- 172.21.15.17:0/2649805129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8009560 con 0x7fa2080ffda0 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.016+0000 7fa2067fc640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa208100750 0x7fa208072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:27:45.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.016+0000 7fa206ffd640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2080ffda0 0x7fa2080727b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa1f802a9c0 tx=0x7fa1f80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:45.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.016+0000 7fa20c9d5640 1 -- 172.21.15.17:0/2649805129 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f8004aa0 con 0x7fa2080ffda0 2024-08-19T01:27:45.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.016+0000 7fa20c9d5640 1 -- 172.21.15.17:0/2649805129 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1f8004c00 con 0x7fa2080ffda0 2024-08-19T01:27:45.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.016+0000 7fa20d9d7640 1 -- 172.21.15.17:0/2649805129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2080735f0 con 0x7fa2080ffda0 2024-08-19T01:27:45.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.016+0000 7fa20c9d5640 1 -- 172.21.15.17:0/2649805129 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1f8003ab0 con 0x7fa2080ffda0 2024-08-19T01:27:45.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.016+0000 7fa20d9d7640 1 -- 172.21.15.17:0/2649805129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2081a20e0 con 0x7fa2080ffda0 2024-08-19T01:27:45.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.017+0000 7fa20d9d7640 1 -- 172.21.15.17:0/2649805129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa208101280 con 0x7fa2080ffda0 2024-08-19T01:27:45.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.018+0000 7fa20c9d5640 1 -- 172.21.15.17:0/2649805129 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa1f8003c10 con 0x7fa2080ffda0 2024-08-19T01:27:45.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.018+0000 7fa20c9d5640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1f006e170 0x7fa1f0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:45.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.018+0000 7fa20c9d5640 1 -- 172.21.15.17:0/2649805129 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa1f80af190 con 0x7fa2080ffda0 2024-08-19T01:27:45.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.018+0000 7fa2067fc640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1f006e170 0x7fa1f0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:45.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.019+0000 7fa2067fc640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1f006e170 0x7fa1f0070630 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc005fd0 tx=0x7fa1fc005ea0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:45.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.023+0000 7fa20c9d5640 1 -- 172.21.15.17:0/2649805129 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa1f80784f0 con 0x7fa2080ffda0 2024-08-19T01:27:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.240+0000 7fa20d9d7640 1 -- 172.21.15.17:0/2649805129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa2081080e0 con 0x7fa2080ffda0 2024-08-19T01:27:45.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.241+0000 7fa20c9d5640 1 -- 172.21.15.17:0/2649805129 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7fa1f807bbb0 con 0x7fa2080ffda0 2024-08-19T01:27:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:27:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:27:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:27:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:27:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:27:45.244 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:27:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:27:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:27:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:27:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:27:45.244 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:27:45.245 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:27:45.246 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:27:45.247 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:27:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:27:45.247 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:27:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:27:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:27:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:27:45.247 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.243+0000 7fa20d9d7640 1 -- 172.21.15.17:0/2649805129 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1f006e170 msgr2=0x7fa1f0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.243+0000 7fa20d9d7640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1f006e170 0x7fa1f0070630 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc005fd0 tx=0x7fa1fc005ea0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.243+0000 7fa20d9d7640 1 -- 172.21.15.17:0/2649805129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2080ffda0 msgr2=0x7fa2080727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.243+0000 7fa20d9d7640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2080ffda0 0x7fa2080727b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa1f802a9c0 tx=0x7fa1f80055a0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.243+0000 7fa20d9d7640 1 -- 172.21.15.17:0/2649805129 shutdown_connections 2024-08-19T01:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.243+0000 7fa20d9d7640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa1f006e170 0x7fa1f0070630 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.243+0000 7fa20d9d7640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa208100750 0x7fa208072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.243+0000 7fa20d9d7640 1 --2- 172.21.15.17:0/2649805129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa2080ffda0 0x7fa2080727b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.243+0000 7fa20d9d7640 1 -- 172.21.15.17:0/2649805129 >> 172.21.15.17:0/2649805129 conn(0x7fa2080fb840 msgr2=0x7fa2080fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:45.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.243+0000 7fa20d9d7640 1 -- 172.21.15.17:0/2649805129 shutdown_connections 2024-08-19T01:27:45.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.243+0000 7fa20d9d7640 1 -- 172.21.15.17:0/2649805129 wait complete. 2024-08-19T01:27:45.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.329+0000 7fa541a33640 1 -- 172.21.15.17:0/1717890377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100750 msgr2=0x7fa53c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.329+0000 7fa541a33640 1 --2- 172.21.15.17:0/1717890377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100750 0x7fa53c1047a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa530009880 tx=0x7fa53002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.329+0000 7fa541a33640 1 -- 172.21.15.17:0/1717890377 shutdown_connections 2024-08-19T01:27:45.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.329+0000 7fa541a33640 1 --2- 172.21.15.17:0/1717890377 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100750 0x7fa53c1047a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.329+0000 7fa541a33640 1 --2- 172.21.15.17:0/1717890377 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa53c0ffda0 0x7fa53c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.329+0000 7fa541a33640 1 -- 172.21.15.17:0/1717890377 >> 172.21.15.17:0/1717890377 conn(0x7fa53c0fb840 msgr2=0x7fa53c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:45.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.329+0000 7fa541a33640 1 -- 172.21.15.17:0/1717890377 shutdown_connections 2024-08-19T01:27:45.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.329+0000 7fa541a33640 1 -- 172.21.15.17:0/1717890377 wait complete. 2024-08-19T01:27:45.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.330+0000 7fa541a33640 1 Processor -- start 2024-08-19T01:27:45.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.330+0000 7fa541a33640 1 -- start start 2024-08-19T01:27:45.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.330+0000 7fa541a33640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa53c0ffda0 0x7fa53c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:45.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.330+0000 7fa541a33640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100750 0x7fa53c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:45.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.330+0000 7fa541a33640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c073230 con 0x7fa53c100750 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.330+0000 7fa541a33640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0733a0 con 0x7fa53c0ffda0 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.330+0000 7fa53a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100750 0x7fa53c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.330+0000 7fa53a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100750 0x7fa53c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38928/0 (socket says 172.21.15.17:38928) 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.330+0000 7fa53a7fc640 1 -- 172.21.15.17:0/2786620862 learned_addr learned my addr 172.21.15.17:0/2786620862 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.330+0000 7fa53affd640 1 --2- 172.21.15.17:0/2786620862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa53c0ffda0 0x7fa53c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.331+0000 7fa53a7fc640 1 -- 172.21.15.17:0/2786620862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa53c0ffda0 msgr2=0x7fa53c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.331+0000 7fa53a7fc640 1 --2- 172.21.15.17:0/2786620862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa53c0ffda0 0x7fa53c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.331+0000 7fa53a7fc640 1 -- 172.21.15.17:0/2786620862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa530009560 con 0x7fa53c100750 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.331+0000 7fa53a7fc640 1 --2- 172.21.15.17:0/2786620862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100750 0x7fa53c072cf0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa53002a9c0 tx=0x7fa5300055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.331+0000 7fa540a31640 1 -- 172.21.15.17:0/2786620862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa530004aa0 con 0x7fa53c100750 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.331+0000 7fa541a33640 1 -- 172.21.15.17:0/2786620862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c073620 con 0x7fa53c100750 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.331+0000 7fa540a31640 1 -- 172.21.15.17:0/2786620862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa530004c00 con 0x7fa53c100750 2024-08-19T01:27:45.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.331+0000 7fa540a31640 1 -- 172.21.15.17:0/2786620862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa530003980 con 0x7fa53c100750 2024-08-19T01:27:45.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.331+0000 7fa541a33640 1 -- 172.21.15.17:0/2786620862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c1a1f10 con 0x7fa53c100750 2024-08-19T01:27:45.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.332+0000 7fa541a33640 1 -- 172.21.15.17:0/2786620862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53c101280 con 0x7fa53c100750 2024-08-19T01:27:45.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.333+0000 7fa540a31640 1 -- 172.21.15.17:0/2786620862 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa530003bf0 con 0x7fa53c100750 2024-08-19T01:27:45.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.333+0000 7fa540a31640 1 --2- 172.21.15.17:0/2786620862 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa52406e170 0x7fa524070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:45.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.333+0000 7fa540a31640 1 -- 172.21.15.17:0/2786620862 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa5300aefb0 con 0x7fa53c100750 2024-08-19T01:27:45.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.333+0000 7fa53affd640 1 --2- 172.21.15.17:0/2786620862 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa52406e170 0x7fa524070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:45.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.334+0000 7fa53affd640 1 --2- 172.21.15.17:0/2786620862 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa52406e170 0x7fa524070630 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00bbe0 tx=0x7fa52c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:45.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.338+0000 7fa540a31640 1 -- 172.21.15.17:0/2786620862 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa530078340 con 0x7fa53c100750 2024-08-19T01:27:45.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.529+0000 7fa541a33640 1 -- 172.21.15.17:0/2786620862 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa53c073620 con 0x7fa52406e170 2024-08-19T01:27:45.532 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:45 smithi017 ceph-mon[99370]: pgmap v870: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:45.532 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:45 smithi017 ceph-mon[99370]: from='client.35610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:45.532 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:45 smithi017 ceph-mon[99370]: from='client.35614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:45.533 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:45 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2357359863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:27:45.533 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:45 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2649805129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:27:45.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.530+0000 7fa540a31640 1 -- 172.21.15.17:0/2786620862 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa53c073620 con 0x7fa52406e170 2024-08-19T01:27:45.534 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:27:45.534 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:27:45.534 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:27:45.534 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:27:45.535 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:27:45.535 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:27:45.535 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:27:45.535 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:27:45.535 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:27:45.535 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:27:45.536 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:27:45.536 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:27:45.536 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:27:45.536 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:27:45.536 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:27:45.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.532+0000 7fa541a33640 1 -- 172.21.15.17:0/2786620862 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa52406e170 msgr2=0x7fa524070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.532+0000 7fa541a33640 1 --2- 172.21.15.17:0/2786620862 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa52406e170 0x7fa524070630 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00bbe0 tx=0x7fa52c00b390 comp rx=0 tx=0).stop 2024-08-19T01:27:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.532+0000 7fa541a33640 1 -- 172.21.15.17:0/2786620862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100750 msgr2=0x7fa53c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.532+0000 7fa541a33640 1 --2- 172.21.15.17:0/2786620862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100750 0x7fa53c072cf0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa53002a9c0 tx=0x7fa5300055a0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.532+0000 7fa541a33640 1 -- 172.21.15.17:0/2786620862 shutdown_connections 2024-08-19T01:27:45.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.532+0000 7fa541a33640 1 --2- 172.21.15.17:0/2786620862 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa52406e170 0x7fa524070630 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.532+0000 7fa541a33640 1 --2- 172.21.15.17:0/2786620862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa53c100750 0x7fa53c072cf0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.532+0000 7fa541a33640 1 --2- 172.21.15.17:0/2786620862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa53c0ffda0 0x7fa53c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.532+0000 7fa541a33640 1 -- 172.21.15.17:0/2786620862 >> 172.21.15.17:0/2786620862 conn(0x7fa53c0fb840 msgr2=0x7fa53c0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.532+0000 7fa541a33640 1 -- 172.21.15.17:0/2786620862 shutdown_connections 2024-08-19T01:27:45.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.532+0000 7fa541a33640 1 -- 172.21.15.17:0/2786620862 wait complete. 2024-08-19T01:27:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.614+0000 7f91ce1b2640 1 -- 172.21.15.17:0/340277363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c8101670 msgr2=0x7f91c8109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.614+0000 7f91ce1b2640 1 --2- 172.21.15.17:0/340277363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c8101670 0x7f91c8109b60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009880 tx=0x7f91b002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.614+0000 7f91ce1b2640 1 -- 172.21.15.17:0/340277363 shutdown_connections 2024-08-19T01:27:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.614+0000 7f91ce1b2640 1 --2- 172.21.15.17:0/340277363 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c8101670 0x7f91c8109b60 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.614+0000 7f91ce1b2640 1 --2- 172.21.15.17:0/340277363 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8100d50 0x7f91c8101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.614+0000 7f91ce1b2640 1 -- 172.21.15.17:0/340277363 >> 172.21.15.17:0/340277363 conn(0x7f91c80fa730 msgr2=0x7f91c80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:45.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.614+0000 7f91ce1b2640 1 -- 172.21.15.17:0/340277363 shutdown_connections 2024-08-19T01:27:45.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.614+0000 7f91ce1b2640 1 -- 172.21.15.17:0/340277363 wait complete. 2024-08-19T01:27:45.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91ce1b2640 1 Processor -- start 2024-08-19T01:27:45.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91ce1b2640 1 -- start start 2024-08-19T01:27:45.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91ce1b2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8100d50 0x7f91c819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:45.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91ce1b2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c8101670 0x7f91c819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:45.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91ce1b2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c819c2d0 con 0x7f91c8101670 2024-08-19T01:27:45.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91ce1b2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c81958f0 con 0x7f91c8100d50 2024-08-19T01:27:45.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c8101670 0x7f91c819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:45.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91beffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c8101670 0x7f91c819bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38948/0 (socket says 172.21.15.17:38948) 2024-08-19T01:27:45.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91beffd640 1 -- 172.21.15.17:0/2086622557 learned_addr learned my addr 172.21.15.17:0/2086622557 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:27:45.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91c77fe640 1 --2- 172.21.15.17:0/2086622557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8100d50 0x7f91c819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:45.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91beffd640 1 -- 172.21.15.17:0/2086622557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8100d50 msgr2=0x7f91c819b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91beffd640 1 --2- 172.21.15.17:0/2086622557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8100d50 0x7f91c819b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.615+0000 7f91beffd640 1 -- 172.21.15.17:0/2086622557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0009560 con 0x7f91c8101670 2024-08-19T01:27:45.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.616+0000 7f91beffd640 1 --2- 172.21.15.17:0/2086622557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c8101670 0x7f91c819bd40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f91b002a9c0 tx=0x7f91b00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:45.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.616+0000 7f91c57fa640 1 -- 172.21.15.17:0/2086622557 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b0004aa0 con 0x7f91c8101670 2024-08-19T01:27:45.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.616+0000 7f91ce1b2640 1 -- 172.21.15.17:0/2086622557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c8195bd0 con 0x7f91c8101670 2024-08-19T01:27:45.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.616+0000 7f91c57fa640 1 -- 172.21.15.17:0/2086622557 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91b0004c00 con 0x7f91c8101670 2024-08-19T01:27:45.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.616+0000 7f91c57fa640 1 -- 172.21.15.17:0/2086622557 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b0003ab0 con 0x7f91c8101670 2024-08-19T01:27:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.616+0000 7f91ce1b2640 1 -- 172.21.15.17:0/2086622557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c8196120 con 0x7f91c8101670 2024-08-19T01:27:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.617+0000 7f91ce1b2640 1 -- 172.21.15.17:0/2086622557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c8068cd0 con 0x7f91c8101670 2024-08-19T01:27:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.617+0000 7f91c57fa640 1 -- 172.21.15.17:0/2086622557 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f91b0003ce0 con 0x7f91c8101670 2024-08-19T01:27:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.618+0000 7f91c57fa640 1 --2- 172.21.15.17:0/2086622557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91b406e170 0x7f91b4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:27:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.618+0000 7f91c57fa640 1 -- 172.21.15.17:0/2086622557 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f91b00af290 con 0x7f91c8101670 2024-08-19T01:27:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.618+0000 7f91c77fe640 1 --2- 172.21.15.17:0/2086622557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91b406e170 0x7f91b4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:27:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.618+0000 7f91c77fe640 1 --2- 172.21.15.17:0/2086622557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91b406e170 0x7f91b4070630 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f91b8005e10 tx=0x7f91b8005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:27:45.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.622+0000 7f91c57fa640 1 -- 172.21.15.17:0/2086622557 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f91b0078510 con 0x7f91c8101670 2024-08-19T01:27:45.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:45 smithi086 ceph-mon[71303]: pgmap v870: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:45.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:45 smithi086 ceph-mon[71303]: from='client.35610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:45.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:45 smithi086 ceph-mon[71303]: from='client.35614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:45.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:45 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2357359863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:27:45.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:45 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2649805129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:27:45.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.863+0000 7f91ce1b2640 1 -- 172.21.15.17:0/2086622557 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f91c8196e30 con 0x7f91c8101670 2024-08-19T01:27:45.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.863+0000 7f91c57fa640 1 -- 172.21.15.17:0/2086622557 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f91b007bbd0 con 0x7f91c8101670 2024-08-19T01:27:45.866 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:27:45.867 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:27:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:27:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:27:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:27:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:27:45.868 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:27:45.868 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:27:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:27:45.868 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:27:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:27:45.868 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:27:45.868 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:27:45.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.865+0000 7f91ce1b2640 1 -- 172.21.15.17:0/2086622557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91b406e170 msgr2=0x7f91b4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.865+0000 7f91ce1b2640 1 --2- 172.21.15.17:0/2086622557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91b406e170 0x7f91b4070630 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f91b8005e10 tx=0x7f91b8005da0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.865+0000 7f91ce1b2640 1 -- 172.21.15.17:0/2086622557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c8101670 msgr2=0x7f91c819bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:27:45.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.865+0000 7f91ce1b2640 1 --2- 172.21.15.17:0/2086622557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c8101670 0x7f91c819bd40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f91b002a9c0 tx=0x7f91b00055a0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.866+0000 7f91ce1b2640 1 -- 172.21.15.17:0/2086622557 shutdown_connections 2024-08-19T01:27:45.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.866+0000 7f91ce1b2640 1 --2- 172.21.15.17:0/2086622557 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91b406e170 0x7f91b4070630 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.866+0000 7f91ce1b2640 1 --2- 172.21.15.17:0/2086622557 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91c8101670 0x7f91c819bd40 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.866+0000 7f91ce1b2640 1 --2- 172.21.15.17:0/2086622557 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91c8100d50 0x7f91c819b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:27:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.866+0000 7f91ce1b2640 1 -- 172.21.15.17:0/2086622557 >> 172.21.15.17:0/2086622557 conn(0x7f91c80fa730 msgr2=0x7f91c8101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:27:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.866+0000 7f91ce1b2640 1 -- 172.21.15.17:0/2086622557 shutdown_connections 2024-08-19T01:27:45.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:27:45.866+0000 7f91ce1b2640 1 -- 172.21.15.17:0/2086622557 wait complete. 2024-08-19T01:27:46.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:46 smithi017 ceph-mon[99370]: from='client.35626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:46.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:46 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2086622557' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:27:46.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:46 smithi086 ceph-mon[71303]: from='client.35626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:27:46.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:46 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2086622557' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:27:47.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:47 smithi086 ceph-mon[71303]: pgmap v871: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:47.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:47 smithi017 ceph-mon[99370]: pgmap v871: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:48.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:27:48.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:27:49.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:49 smithi017 ceph-mon[99370]: pgmap v872: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:49.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:49 smithi086 ceph-mon[71303]: pgmap v872: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:51.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:51 smithi017 ceph-mon[99370]: pgmap v873: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:51.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:51 smithi086 ceph-mon[71303]: pgmap v873: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:53.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:53 smithi017 ceph-mon[99370]: pgmap v874: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:53.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:53 smithi086 ceph-mon[71303]: pgmap v874: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:55.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:55 smithi017 ceph-mon[99370]: pgmap v875: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:55.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:55 smithi086 ceph-mon[71303]: pgmap v875: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:57.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:57 smithi017 ceph-mon[99370]: pgmap v876: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:57.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:57 smithi086 ceph-mon[71303]: pgmap v876: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:59.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:27:59 smithi017 ceph-mon[99370]: pgmap v877: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:27:59.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:27:59 smithi086 ceph-mon[71303]: pgmap v877: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:01.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:01 smithi017 ceph-mon[99370]: pgmap v878: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:01.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:01 smithi086 ceph-mon[71303]: pgmap v878: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:03.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:03 smithi017 ceph-mon[99370]: pgmap v879: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:03.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:28:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:03 smithi086 ceph-mon[71303]: pgmap v879: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:28:05.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:05 smithi017 ceph-mon[99370]: pgmap v880: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:05.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:05 smithi086 ceph-mon[71303]: pgmap v880: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:07.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:07 smithi017 ceph-mon[99370]: pgmap v881: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:07.699 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:07 smithi086 ceph-mon[71303]: pgmap v881: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:09.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:09 smithi017 ceph-mon[99370]: pgmap v882: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:09.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:09 smithi086 ceph-mon[71303]: pgmap v882: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:11.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:11 smithi017 ceph-mon[99370]: pgmap v883: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:11.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:11 smithi086 ceph-mon[71303]: pgmap v883: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:13.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:13 smithi017 ceph-mon[99370]: pgmap v884: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:13.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:13 smithi086 ceph-mon[71303]: pgmap v884: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:15.686 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:15 smithi017 ceph-mon[99370]: pgmap v885: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:15.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:15 smithi086 ceph-mon[71303]: pgmap v885: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:15.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.962+0000 7f633d022640 1 -- 172.21.15.17:0/912836491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63381015d0 msgr2=0x7f6338109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:15.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.962+0000 7f633d022640 1 --2- 172.21.15.17:0/912836491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63381015d0 0x7f6338109ac0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f632c009880 tx=0x7f632c02a530 comp rx=0 tx=0).stop 2024-08-19T01:28:15.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.962+0000 7f633d022640 1 -- 172.21.15.17:0/912836491 shutdown_connections 2024-08-19T01:28:15.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.962+0000 7f633d022640 1 --2- 172.21.15.17:0/912836491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63381015d0 0x7f6338109ac0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:15.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.962+0000 7f633d022640 1 --2- 172.21.15.17:0/912836491 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6338100cb0 0x7f6338101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:15.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.962+0000 7f633d022640 1 -- 172.21.15.17:0/912836491 >> 172.21.15.17:0/912836491 conn(0x7f63380fa730 msgr2=0x7f63380fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:15.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.962+0000 7f633d022640 1 -- 172.21.15.17:0/912836491 shutdown_connections 2024-08-19T01:28:15.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.962+0000 7f633d022640 1 -- 172.21.15.17:0/912836491 wait complete. 2024-08-19T01:28:15.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.963+0000 7f633d022640 1 Processor -- start 2024-08-19T01:28:15.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.963+0000 7f633d022640 1 -- start start 2024-08-19T01:28:15.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.963+0000 7f633d022640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100cb0 0x7f633819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:15.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.963+0000 7f633d022640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63381015d0 0x7f633819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:15.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.963+0000 7f633d022640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633819c320 con 0x7f6338100cb0 2024-08-19T01:28:15.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.963+0000 7f633d022640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6338195940 con 0x7f63381015d0 2024-08-19T01:28:15.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.963+0000 7f6336d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100cb0 0x7f633819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:15.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.963+0000 7f6336d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100cb0 0x7f633819b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34844/0 (socket says 172.21.15.17:34844) 2024-08-19T01:28:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.963+0000 7f6336d9d640 1 -- 172.21.15.17:0/1201213702 learned_addr learned my addr 172.21.15.17:0/1201213702 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.963+0000 7f633659c640 1 --2- 172.21.15.17:0/1201213702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63381015d0 0x7f633819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.963+0000 7f6336d9d640 1 -- 172.21.15.17:0/1201213702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63381015d0 msgr2=0x7f633819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.964+0000 7f6336d9d640 1 --2- 172.21.15.17:0/1201213702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63381015d0 0x7f633819bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.964+0000 7f6336d9d640 1 -- 172.21.15.17:0/1201213702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632c009560 con 0x7f6338100cb0 2024-08-19T01:28:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.964+0000 7f6336d9d640 1 --2- 172.21.15.17:0/1201213702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100cb0 0x7f633819b850 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f632800c8a0 tx=0x7f632800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.964+0000 7f631ffff640 1 -- 172.21.15.17:0/1201213702 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6328007b80 con 0x7f6338100cb0 2024-08-19T01:28:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.964+0000 7f633d022640 1 -- 172.21.15.17:0/1201213702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6338195c20 con 0x7f6338100cb0 2024-08-19T01:28:15.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.964+0000 7f631ffff640 1 -- 172.21.15.17:0/1201213702 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6328007ce0 con 0x7f6338100cb0 2024-08-19T01:28:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.964+0000 7f631ffff640 1 -- 172.21.15.17:0/1201213702 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6328018810 con 0x7f6338100cb0 2024-08-19T01:28:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.964+0000 7f633d022640 1 -- 172.21.15.17:0/1201213702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6338196140 con 0x7f6338100cb0 2024-08-19T01:28:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.965+0000 7f633d022640 1 -- 172.21.15.17:0/1201213702 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6338068d30 con 0x7f6338100cb0 2024-08-19T01:28:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.966+0000 7f631ffff640 1 -- 172.21.15.17:0/1201213702 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6328018a80 con 0x7f6338100cb0 2024-08-19T01:28:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.966+0000 7f631ffff640 1 --2- 172.21.15.17:0/1201213702 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f632006e180 0x7f6320070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.966+0000 7f631ffff640 1 -- 172.21.15.17:0/1201213702 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f632808e3a0 con 0x7f6338100cb0 2024-08-19T01:28:15.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.966+0000 7f633659c640 1 --2- 172.21.15.17:0/1201213702 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f632006e180 0x7f6320070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:15.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.967+0000 7f633659c640 1 --2- 172.21.15.17:0/1201213702 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f632006e180 0x7f6320070640 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f632c000c00 tx=0x7f632c031420 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:15.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:15.971+0000 7f631ffff640 1 -- 172.21.15.17:0/1201213702 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6328057680 con 0x7f6338100cb0 2024-08-19T01:28:16.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.162+0000 7f633d022640 1 -- 172.21.15.17:0/1201213702 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f633810cd80 con 0x7f632006e180 2024-08-19T01:28:16.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.163+0000 7f631ffff640 1 -- 172.21.15.17:0/1201213702 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f633810cd80 con 0x7f632006e180 2024-08-19T01:28:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.165+0000 7f633d022640 1 -- 172.21.15.17:0/1201213702 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f632006e180 msgr2=0x7f6320070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.165+0000 7f633d022640 1 --2- 172.21.15.17:0/1201213702 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f632006e180 0x7f6320070640 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f632c000c00 tx=0x7f632c031420 comp rx=0 tx=0).stop 2024-08-19T01:28:16.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.165+0000 7f633d022640 1 -- 172.21.15.17:0/1201213702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100cb0 msgr2=0x7f633819b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.165+0000 7f633d022640 1 --2- 172.21.15.17:0/1201213702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100cb0 0x7f633819b850 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f632800c8a0 tx=0x7f632800cd60 comp rx=0 tx=0).stop 2024-08-19T01:28:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.165+0000 7f633d022640 1 -- 172.21.15.17:0/1201213702 shutdown_connections 2024-08-19T01:28:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.165+0000 7f633d022640 1 --2- 172.21.15.17:0/1201213702 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f632006e180 0x7f6320070640 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.165+0000 7f633d022640 1 --2- 172.21.15.17:0/1201213702 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f63381015d0 0x7f633819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.165+0000 7f633d022640 1 --2- 172.21.15.17:0/1201213702 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6338100cb0 0x7f633819b850 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.165+0000 7f633d022640 1 -- 172.21.15.17:0/1201213702 >> 172.21.15.17:0/1201213702 conn(0x7f63380fa730 msgr2=0x7f6338101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.166+0000 7f633d022640 1 -- 172.21.15.17:0/1201213702 shutdown_connections 2024-08-19T01:28:16.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.166+0000 7f633d022640 1 -- 172.21.15.17:0/1201213702 wait complete. 2024-08-19T01:28:16.176 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:28:16.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.248+0000 7f30285aa640 1 -- 172.21.15.17:0/2041617020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30200fea30 msgr2=0x7f30200fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.248+0000 7f30285aa640 1 --2- 172.21.15.17:0/2041617020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30200fea30 0x7f30200fee90 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f3010009880 tx=0x7f301002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.249+0000 7f30285aa640 1 -- 172.21.15.17:0/2041617020 shutdown_connections 2024-08-19T01:28:16.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.249+0000 7f30285aa640 1 --2- 172.21.15.17:0/2041617020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30200fea30 0x7f30200fee90 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.249+0000 7f30285aa640 1 --2- 172.21.15.17:0/2041617020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3020104a30 0x7f3020104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.249+0000 7f30285aa640 1 -- 172.21.15.17:0/2041617020 >> 172.21.15.17:0/2041617020 conn(0x7f30200fa730 msgr2=0x7f30200fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:16.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.249+0000 7f30285aa640 1 -- 172.21.15.17:0/2041617020 shutdown_connections 2024-08-19T01:28:16.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.249+0000 7f30285aa640 1 -- 172.21.15.17:0/2041617020 wait complete. 2024-08-19T01:28:16.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.249+0000 7f30285aa640 1 Processor -- start 2024-08-19T01:28:16.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.249+0000 7f30285aa640 1 -- start start 2024-08-19T01:28:16.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f30285aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30200fea30 0x7f302019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f30285aa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3020104a30 0x7f302019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f30285aa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302019c3b0 con 0x7f30200fea30 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f30285aa640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3020195940 con 0x7f3020104a30 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f3026346640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30200fea30 0x7f302019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f3026346640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30200fea30 0x7f302019b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34850/0 (socket says 172.21.15.17:34850) 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f3026346640 1 -- 172.21.15.17:0/3937519795 learned_addr learned my addr 172.21.15.17:0/3937519795 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f3025b45640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3020104a30 0x7f302019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f3026346640 1 -- 172.21.15.17:0/3937519795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3020104a30 msgr2=0x7f302019bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f3026346640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3020104a30 0x7f302019bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f3026346640 1 -- 172.21.15.17:0/3937519795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010009560 con 0x7f30200fea30 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f3025b45640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3020104a30 0x7f302019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:28:16.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f3026346640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30200fea30 0x7f302019b850 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c8f0 tx=0x7f301c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:16.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.250+0000 7f30177fe640 1 -- 172.21.15.17:0/3937519795 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f301c007b80 con 0x7f30200fea30 2024-08-19T01:28:16.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.251+0000 7f30177fe640 1 -- 172.21.15.17:0/3937519795 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f301c0054e0 con 0x7f30200fea30 2024-08-19T01:28:16.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.251+0000 7f30285aa640 1 -- 172.21.15.17:0/3937519795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3020195c20 con 0x7f30200fea30 2024-08-19T01:28:16.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.251+0000 7f30177fe640 1 -- 172.21.15.17:0/3937519795 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f301c00f450 con 0x7f30200fea30 2024-08-19T01:28:16.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.251+0000 7f30285aa640 1 -- 172.21.15.17:0/3937519795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3020196140 con 0x7f30200fea30 2024-08-19T01:28:16.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.252+0000 7f30285aa640 1 -- 172.21.15.17:0/3937519795 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3020100170 con 0x7f30200fea30 2024-08-19T01:28:16.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.252+0000 7f30177fe640 1 -- 172.21.15.17:0/3937519795 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f301c004f60 con 0x7f30200fea30 2024-08-19T01:28:16.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.253+0000 7f30177fe640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f300c06e170 0x7f300c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:16.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.253+0000 7f30177fe640 1 -- 172.21.15.17:0/3937519795 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f301c08dff0 con 0x7f30200fea30 2024-08-19T01:28:16.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.253+0000 7f3025b45640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f300c06e170 0x7f300c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:16.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.253+0000 7f3025b45640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f300c06e170 0x7f300c070630 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3010000c00 tx=0x7f3010005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:16.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.257+0000 7f30177fe640 1 -- 172.21.15.17:0/3937519795 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f301c0572d0 con 0x7f30200fea30 2024-08-19T01:28:16.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.450+0000 7f30285aa640 1 -- 172.21.15.17:0/3937519795 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f302010bcc0 con 0x7f300c06e170 2024-08-19T01:28:16.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.451+0000 7f30177fe640 1 -- 172.21.15.17:0/3937519795 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f302010bcc0 con 0x7f300c06e170 2024-08-19T01:28:16.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.453+0000 7f30285aa640 1 -- 172.21.15.17:0/3937519795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f300c06e170 msgr2=0x7f300c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.453+0000 7f30285aa640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f300c06e170 0x7f300c070630 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3010000c00 tx=0x7f3010005a20 comp rx=0 tx=0).stop 2024-08-19T01:28:16.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.453+0000 7f30285aa640 1 -- 172.21.15.17:0/3937519795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30200fea30 msgr2=0x7f302019b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.453+0000 7f30285aa640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30200fea30 0x7f302019b850 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c8f0 tx=0x7f301c00cdb0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.453+0000 7f30285aa640 1 -- 172.21.15.17:0/3937519795 shutdown_connections 2024-08-19T01:28:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.453+0000 7f30285aa640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f300c06e170 0x7f300c070630 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.453+0000 7f30285aa640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3020104a30 0x7f302019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.453+0000 7f30285aa640 1 --2- 172.21.15.17:0/3937519795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f30200fea30 0x7f302019b850 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.453+0000 7f30285aa640 1 -- 172.21.15.17:0/3937519795 >> 172.21.15.17:0/3937519795 conn(0x7f30200fa730 msgr2=0x7f3020068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.453+0000 7f30285aa640 1 -- 172.21.15.17:0/3937519795 shutdown_connections 2024-08-19T01:28:16.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.453+0000 7f30285aa640 1 -- 172.21.15.17:0/3937519795 wait complete. 2024-08-19T01:28:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.536+0000 7fe172cae640 1 -- 172.21.15.17:0/300457880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe16c0fdf40 msgr2=0x7fe16c0fe3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.536+0000 7fe172cae640 1 --2- 172.21.15.17:0/300457880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe16c0fdf40 0x7fe16c0fe3a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe154009880 tx=0x7fe15402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.536+0000 7fe172cae640 1 -- 172.21.15.17:0/300457880 shutdown_connections 2024-08-19T01:28:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.536+0000 7fe172cae640 1 --2- 172.21.15.17:0/300457880 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe16c0fdf40 0x7fe16c0fe3a0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.536+0000 7fe172cae640 1 --2- 172.21.15.17:0/300457880 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe16c104b20 0x7fe16c104f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.536+0000 7fe172cae640 1 -- 172.21.15.17:0/300457880 >> 172.21.15.17:0/300457880 conn(0x7fe16c0f9e50 msgr2=0x7fe16c0fc270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.536+0000 7fe172cae640 1 -- 172.21.15.17:0/300457880 shutdown_connections 2024-08-19T01:28:16.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.536+0000 7fe172cae640 1 -- 172.21.15.17:0/300457880 wait complete. 2024-08-19T01:28:16.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.537+0000 7fe172cae640 1 Processor -- start 2024-08-19T01:28:16.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.537+0000 7fe172cae640 1 -- start start 2024-08-19T01:28:16.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.537+0000 7fe172cae640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe16c0fdf40 0x7fe16c19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:16.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.537+0000 7fe172cae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe16c104b20 0x7fe16c19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:16.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.537+0000 7fe172cae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c19c430 con 0x7fe16c104b20 2024-08-19T01:28:16.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.537+0000 7fe16bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe16c104b20 0x7fe16c19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:16.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.537+0000 7fe16bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe16c104b20 0x7fe16c19be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34872/0 (socket says 172.21.15.17:34872) 2024-08-19T01:28:16.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.537+0000 7fe16bfff640 1 -- 172.21.15.17:0/3628827968 learned_addr learned my addr 172.21.15.17:0/3628827968 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:16.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.537+0000 7fe172cae640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c1959c0 con 0x7fe16c0fdf40 2024-08-19T01:28:16.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.537+0000 7fe170a4a640 1 --2- 172.21.15.17:0/3628827968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe16c0fdf40 0x7fe16c19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:16.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.538+0000 7fe16bfff640 1 -- 172.21.15.17:0/3628827968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe16c0fdf40 msgr2=0x7fe16c19b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.538+0000 7fe16bfff640 1 --2- 172.21.15.17:0/3628827968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe16c0fdf40 0x7fe16c19b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.538+0000 7fe16bfff640 1 -- 172.21.15.17:0/3628827968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe154009560 con 0x7fe16c104b20 2024-08-19T01:28:16.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.538+0000 7fe16bfff640 1 --2- 172.21.15.17:0/3628827968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe16c104b20 0x7fe16c19be10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe154006010 tx=0x7fe1540055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:16.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.538+0000 7fe169ffb640 1 -- 172.21.15.17:0/3628827968 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1540048d0 con 0x7fe16c104b20 2024-08-19T01:28:16.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.538+0000 7fe169ffb640 1 -- 172.21.15.17:0/3628827968 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe154031640 con 0x7fe16c104b20 2024-08-19T01:28:16.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.538+0000 7fe172cae640 1 -- 172.21.15.17:0/3628827968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16c195c40 con 0x7fe16c104b20 2024-08-19T01:28:16.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.538+0000 7fe169ffb640 1 -- 172.21.15.17:0/3628827968 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe154003820 con 0x7fe16c104b20 2024-08-19T01:28:16.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.538+0000 7fe172cae640 1 -- 172.21.15.17:0/3628827968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16c196130 con 0x7fe16c104b20 2024-08-19T01:28:16.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.540+0000 7fe172cae640 1 -- 172.21.15.17:0/3628827968 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16c101260 con 0x7fe16c104b20 2024-08-19T01:28:16.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.540+0000 7fe169ffb640 1 -- 172.21.15.17:0/3628827968 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe1540317b0 con 0x7fe16c104b20 2024-08-19T01:28:16.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.540+0000 7fe169ffb640 1 --2- 172.21.15.17:0/3628827968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe15806e180 0x7fe158070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:16.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.540+0000 7fe169ffb640 1 -- 172.21.15.17:0/3628827968 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe1540af0a0 con 0x7fe16c104b20 2024-08-19T01:28:16.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.540+0000 7fe170a4a640 1 --2- 172.21.15.17:0/3628827968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe15806e180 0x7fe158070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:16.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.541+0000 7fe170a4a640 1 --2- 172.21.15.17:0/3628827968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe15806e180 0x7fe158070640 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009bd0 tx=0x7fe15c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:16.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.545+0000 7fe169ffb640 1 -- 172.21.15.17:0/3628827968 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe154078430 con 0x7fe16c104b20 2024-08-19T01:28:16.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.728+0000 7fe172cae640 1 -- 172.21.15.17:0/3628827968 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe16c10ce80 con 0x7fe15806e180 2024-08-19T01:28:16.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.738+0000 7fe169ffb640 1 -- 172.21.15.17:0/3628827968 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fe16c10ce80 con 0x7fe15806e180 2024-08-19T01:28:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:28:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (29m) 8m ago 40m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:28:16.740 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (40m) 8m ago 40m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (39m) 8m ago 39m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (27m) 8m ago 40m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (27m) 8m ago 39m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (29m) 8m ago 39m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (23m) 8m ago 34m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (23m) 8m ago 34m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (8m) 8m ago 34m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (23m) 8m ago 34m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (31m) 8m ago 41m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (30m) 8m ago 39m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (28m) 8m ago 41m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (27m) 8m ago 39m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (30m) 8m ago 40m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:28:16.741 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (30m) 8m ago 39m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:28:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (26m) 8m ago 38m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:28:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (26m) 8m ago 37m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:28:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (25m) 8m ago 37m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:28:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (25m) 8m ago 37m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:28:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (24m) 8m ago 36m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:28:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (24m) 8m ago 36m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:28:16.742 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (29m) 8m ago 39m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:28:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.741+0000 7fe172cae640 1 -- 172.21.15.17:0/3628827968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe15806e180 msgr2=0x7fe158070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.741+0000 7fe172cae640 1 --2- 172.21.15.17:0/3628827968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe15806e180 0x7fe158070640 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009bd0 tx=0x7fe15c005f90 comp rx=0 tx=0).stop 2024-08-19T01:28:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.741+0000 7fe172cae640 1 -- 172.21.15.17:0/3628827968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe16c104b20 msgr2=0x7fe16c19be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.741+0000 7fe172cae640 1 --2- 172.21.15.17:0/3628827968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe16c104b20 0x7fe16c19be10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe154006010 tx=0x7fe1540055a0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.741+0000 7fe172cae640 1 -- 172.21.15.17:0/3628827968 shutdown_connections 2024-08-19T01:28:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.741+0000 7fe172cae640 1 --2- 172.21.15.17:0/3628827968 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe15806e180 0x7fe158070640 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.741+0000 7fe172cae640 1 --2- 172.21.15.17:0/3628827968 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe16c104b20 0x7fe16c19be10 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.741+0000 7fe172cae640 1 --2- 172.21.15.17:0/3628827968 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe16c0fdf40 0x7fe16c19b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.741+0000 7fe172cae640 1 -- 172.21.15.17:0/3628827968 >> 172.21.15.17:0/3628827968 conn(0x7fe16c0f9e50 msgr2=0x7fe16c0fafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.741+0000 7fe172cae640 1 -- 172.21.15.17:0/3628827968 shutdown_connections 2024-08-19T01:28:16.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.741+0000 7fe172cae640 1 -- 172.21.15.17:0/3628827968 wait complete. 2024-08-19T01:28:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.822+0000 7f204611c640 1 -- 172.21.15.17:0/3136424265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040100d50 msgr2=0x7f2040101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.822+0000 7f204611c640 1 --2- 172.21.15.17:0/3136424265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040100d50 0x7f2040101130 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2030009c20 tx=0x7f203002a970 comp rx=0 tx=0).stop 2024-08-19T01:28:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.822+0000 7f204611c640 1 -- 172.21.15.17:0/3136424265 shutdown_connections 2024-08-19T01:28:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.822+0000 7f204611c640 1 --2- 172.21.15.17:0/3136424265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2040101670 0x7f2040109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.822+0000 7f204611c640 1 --2- 172.21.15.17:0/3136424265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040100d50 0x7f2040101130 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.822+0000 7f204611c640 1 -- 172.21.15.17:0/3136424265 >> 172.21.15.17:0/3136424265 conn(0x7f20400fa730 msgr2=0x7f20400fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.822+0000 7f204611c640 1 -- 172.21.15.17:0/3136424265 shutdown_connections 2024-08-19T01:28:16.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.822+0000 7f204611c640 1 -- 172.21.15.17:0/3136424265 wait complete. 2024-08-19T01:28:16.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f204611c640 1 Processor -- start 2024-08-19T01:28:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f204611c640 1 -- start start 2024-08-19T01:28:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f204611c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2040100d50 0x7f204019b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f204611c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040101670 0x7f204019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f204611c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204019c340 con 0x7f2040101670 2024-08-19T01:28:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f204611c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20401958d0 con 0x7f2040100d50 2024-08-19T01:28:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f203effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040101670 0x7f204019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f203effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040101670 0x7f204019bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49178/0 (socket says 172.21.15.17:49178) 2024-08-19T01:28:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f203effd640 1 -- 172.21.15.17:0/13761134 learned_addr learned my addr 172.21.15.17:0/13761134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f203f7fe640 1 --2- 172.21.15.17:0/13761134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2040100d50 0x7f204019b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:16.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f203effd640 1 -- 172.21.15.17:0/13761134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2040100d50 msgr2=0x7f204019b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.823+0000 7f203effd640 1 --2- 172.21.15.17:0/13761134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2040100d50 0x7f204019b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.824+0000 7f203effd640 1 -- 172.21.15.17:0/13761134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2030009900 con 0x7f2040101670 2024-08-19T01:28:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.824+0000 7f203effd640 1 --2- 172.21.15.17:0/13761134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040101670 0x7f204019bd20 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f203400d6f0 tx=0x7f203400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.824+0000 7f203cff9640 1 -- 172.21.15.17:0/13761134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2034009a30 con 0x7f2040101670 2024-08-19T01:28:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.824+0000 7f203cff9640 1 -- 172.21.15.17:0/13761134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20340054e0 con 0x7f2040101670 2024-08-19T01:28:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.824+0000 7f203cff9640 1 -- 172.21.15.17:0/13761134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2034010460 con 0x7f2040101670 2024-08-19T01:28:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.824+0000 7f204611c640 1 -- 172.21.15.17:0/13761134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2040195bb0 con 0x7f2040101670 2024-08-19T01:28:16.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.824+0000 7f204611c640 1 -- 172.21.15.17:0/13761134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2040196100 con 0x7f2040101670 2024-08-19T01:28:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.825+0000 7f204611c640 1 -- 172.21.15.17:0/13761134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2040068cd0 con 0x7f2040101670 2024-08-19T01:28:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.826+0000 7f203cff9640 1 -- 172.21.15.17:0/13761134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2034009b90 con 0x7f2040101670 2024-08-19T01:28:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.826+0000 7f203cff9640 1 --2- 172.21.15.17:0/13761134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f202806e170 0x7f2028070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.826+0000 7f203cff9640 1 -- 172.21.15.17:0/13761134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f203408dc80 con 0x7f2040101670 2024-08-19T01:28:16.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.826+0000 7f203f7fe640 1 --2- 172.21.15.17:0/13761134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f202806e170 0x7f2028070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:16.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.827+0000 7f203f7fe640 1 --2- 172.21.15.17:0/13761134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f202806e170 0x7f2028070630 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2030005fa0 tx=0x7f2030005f10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:16.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:16.831+0000 7f203cff9640 1 -- 172.21.15.17:0/13761134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2034056fe0 con 0x7f2040101670 2024-08-19T01:28:17.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.076+0000 7f204611c640 1 -- 172.21.15.17:0/13761134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f20401043a0 con 0x7f2040101670 2024-08-19T01:28:17.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.077+0000 7f203cff9640 1 -- 172.21.15.17:0/13761134 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f2034020280 con 0x7f2040101670 2024-08-19T01:28:17.079 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:28:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:28:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:28:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:28:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:28:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:28:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:28:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:28:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:28:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:28:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:28:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:28:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:28:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:28:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:28:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:28:17.080 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:28:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.079+0000 7f204611c640 1 -- 172.21.15.17:0/13761134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f202806e170 msgr2=0x7f2028070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.079+0000 7f204611c640 1 --2- 172.21.15.17:0/13761134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f202806e170 0x7f2028070630 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2030005fa0 tx=0x7f2030005f10 comp rx=0 tx=0).stop 2024-08-19T01:28:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.079+0000 7f204611c640 1 -- 172.21.15.17:0/13761134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040101670 msgr2=0x7f204019bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.079+0000 7f204611c640 1 --2- 172.21.15.17:0/13761134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040101670 0x7f204019bd20 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f203400d6f0 tx=0x7f203400dbb0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.079+0000 7f204611c640 1 -- 172.21.15.17:0/13761134 shutdown_connections 2024-08-19T01:28:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.079+0000 7f204611c640 1 --2- 172.21.15.17:0/13761134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f202806e170 0x7f2028070630 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.079+0000 7f204611c640 1 --2- 172.21.15.17:0/13761134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2040101670 0x7f204019bd20 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.079+0000 7f204611c640 1 --2- 172.21.15.17:0/13761134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2040100d50 0x7f204019b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.079+0000 7f204611c640 1 -- 172.21.15.17:0/13761134 >> 172.21.15.17:0/13761134 conn(0x7f20400fa730 msgr2=0x7f2040101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:17.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.079+0000 7f204611c640 1 -- 172.21.15.17:0/13761134 shutdown_connections 2024-08-19T01:28:17.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.079+0000 7f204611c640 1 -- 172.21.15.17:0/13761134 wait complete. 2024-08-19T01:28:17.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.160+0000 7f0223fa7640 1 -- 172.21.15.17:0/3893321903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0fe9f0 msgr2=0x7f021c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.160+0000 7f0223fa7640 1 --2- 172.21.15.17:0/3893321903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0fe9f0 0x7f021c0fee50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f020c009880 tx=0x7f020c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.160+0000 7f0223fa7640 1 -- 172.21.15.17:0/3893321903 shutdown_connections 2024-08-19T01:28:17.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.160+0000 7f0223fa7640 1 --2- 172.21.15.17:0/3893321903 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c0fe9f0 0x7f021c0fee50 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.160+0000 7f0223fa7640 1 --2- 172.21.15.17:0/3893321903 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f021c1049f0 0x7f021c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.160+0000 7f0223fa7640 1 -- 172.21.15.17:0/3893321903 >> 172.21.15.17:0/3893321903 conn(0x7f021c0758a0 msgr2=0x7f021c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.161+0000 7f0223fa7640 1 -- 172.21.15.17:0/3893321903 shutdown_connections 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.161+0000 7f0223fa7640 1 -- 172.21.15.17:0/3893321903 wait complete. 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.161+0000 7f0223fa7640 1 Processor -- start 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.161+0000 7f0223fa7640 1 -- start start 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.161+0000 7f0223fa7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f021c0fe9f0 0x7f021c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.161+0000 7f0223fa7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c1049f0 0x7f021c19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.161+0000 7f0223fa7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c195960 con 0x7f021c1049f0 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.161+0000 7f0223fa7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c195aa0 con 0x7f021c0fe9f0 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0221542640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c1049f0 0x7f021c19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0221542640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c1049f0 0x7f021c19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49198/0 (socket says 172.21.15.17:49198) 2024-08-19T01:28:17.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0221542640 1 -- 172.21.15.17:0/1842607630 learned_addr learned my addr 172.21.15.17:0/1842607630 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:17.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0221d43640 1 --2- 172.21.15.17:0/1842607630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f021c0fe9f0 0x7f021c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:17.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0221542640 1 -- 172.21.15.17:0/1842607630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f021c0fe9f0 msgr2=0x7f021c19b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0221542640 1 --2- 172.21.15.17:0/1842607630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f021c0fe9f0 0x7f021c19b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0221542640 1 -- 172.21.15.17:0/1842607630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c009560 con 0x7f021c1049f0 2024-08-19T01:28:17.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0221542640 1 --2- 172.21.15.17:0/1842607630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c1049f0 0x7f021c19be40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f020c02a9c0 tx=0x7f020c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:17.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0212ffd640 1 -- 172.21.15.17:0/1842607630 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020c004aa0 con 0x7f021c1049f0 2024-08-19T01:28:17.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0212ffd640 1 -- 172.21.15.17:0/1842607630 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f020c004c00 con 0x7f021c1049f0 2024-08-19T01:28:17.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0223fa7640 1 -- 172.21.15.17:0/1842607630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c195d20 con 0x7f021c1049f0 2024-08-19T01:28:17.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0212ffd640 1 -- 172.21.15.17:0/1842607630 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020c003ab0 con 0x7f021c1049f0 2024-08-19T01:28:17.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.162+0000 7f0223fa7640 1 -- 172.21.15.17:0/1842607630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c196210 con 0x7f021c1049f0 2024-08-19T01:28:17.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.163+0000 7f0223fa7640 1 -- 172.21.15.17:0/1842607630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c100130 con 0x7f021c1049f0 2024-08-19T01:28:17.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.164+0000 7f0212ffd640 1 -- 172.21.15.17:0/1842607630 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f020c003ce0 con 0x7f021c1049f0 2024-08-19T01:28:17.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.164+0000 7f0212ffd640 1 --2- 172.21.15.17:0/1842607630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f020806e170 0x7f0208070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:17.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.165+0000 7f0212ffd640 1 -- 172.21.15.17:0/1842607630 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f020c0af1b0 con 0x7f021c1049f0 2024-08-19T01:28:17.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.165+0000 7f0221d43640 1 --2- 172.21.15.17:0/1842607630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f020806e170 0x7f0208070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:17.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.165+0000 7f0221d43640 1 --2- 172.21.15.17:0/1842607630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f020806e170 0x7f0208070630 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f02180058c0 tx=0x7f021800a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:17.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.169+0000 7f0212ffd640 1 -- 172.21.15.17:0/1842607630 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f020c078540 con 0x7f021c1049f0 2024-08-19T01:28:17.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.386+0000 7f0223fa7640 1 -- 172.21.15.17:0/1842607630 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f021c10bc80 con 0x7f021c1049f0 2024-08-19T01:28:17.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.386+0000 7f0212ffd640 1 -- 172.21.15.17:0/1842607630 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f020c07bc00 con 0x7f021c1049f0 2024-08-19T01:28:17.388 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:28:17.388 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:28:17.389 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:28:17.390 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:28:17.391 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:28:17.392 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:28:17.392 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:28:17.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.388+0000 7f0223fa7640 1 -- 172.21.15.17:0/1842607630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f020806e170 msgr2=0x7f0208070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.388+0000 7f0223fa7640 1 --2- 172.21.15.17:0/1842607630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f020806e170 0x7f0208070630 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f02180058c0 tx=0x7f021800a250 comp rx=0 tx=0).stop 2024-08-19T01:28:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.388+0000 7f0223fa7640 1 -- 172.21.15.17:0/1842607630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c1049f0 msgr2=0x7f021c19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.388+0000 7f0223fa7640 1 --2- 172.21.15.17:0/1842607630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c1049f0 0x7f021c19be40 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f020c02a9c0 tx=0x7f020c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.388+0000 7f0223fa7640 1 -- 172.21.15.17:0/1842607630 shutdown_connections 2024-08-19T01:28:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.388+0000 7f0223fa7640 1 --2- 172.21.15.17:0/1842607630 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f020806e170 0x7f0208070630 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.388+0000 7f0223fa7640 1 --2- 172.21.15.17:0/1842607630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f021c1049f0 0x7f021c19be40 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.388+0000 7f0223fa7640 1 --2- 172.21.15.17:0/1842607630 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f021c0fe9f0 0x7f021c19b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.388+0000 7f0223fa7640 1 -- 172.21.15.17:0/1842607630 >> 172.21.15.17:0/1842607630 conn(0x7f021c0758a0 msgr2=0x7f021c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.388+0000 7f0223fa7640 1 -- 172.21.15.17:0/1842607630 shutdown_connections 2024-08-19T01:28:17.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.388+0000 7f0223fa7640 1 -- 172.21.15.17:0/1842607630 wait complete. 2024-08-19T01:28:17.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.472+0000 7fa262065640 1 -- 172.21.15.17:0/108941012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa25c100750 msgr2=0x7fa25c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.472+0000 7fa262065640 1 --2- 172.21.15.17:0/108941012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa25c100750 0x7fa25c1047a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa250009880 tx=0x7fa25002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.472+0000 7fa262065640 1 -- 172.21.15.17:0/108941012 shutdown_connections 2024-08-19T01:28:17.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.472+0000 7fa262065640 1 --2- 172.21.15.17:0/108941012 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa25c100750 0x7fa25c1047a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.472+0000 7fa262065640 1 --2- 172.21.15.17:0/108941012 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa25c0ffda0 0x7fa25c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.472+0000 7fa262065640 1 -- 172.21.15.17:0/108941012 >> 172.21.15.17:0/108941012 conn(0x7fa25c0fb840 msgr2=0x7fa25c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:17.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.472+0000 7fa262065640 1 -- 172.21.15.17:0/108941012 shutdown_connections 2024-08-19T01:28:17.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.472+0000 7fa262065640 1 -- 172.21.15.17:0/108941012 wait complete. 2024-08-19T01:28:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.472+0000 7fa262065640 1 Processor -- start 2024-08-19T01:28:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa262065640 1 -- start start 2024-08-19T01:28:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa262065640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa25c0ffda0 0x7fa25c19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa262065640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa25c100750 0x7fa25c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa262065640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c19c380 con 0x7fa25c0ffda0 2024-08-19T01:28:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa262065640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c195910 con 0x7fa25c100750 2024-08-19T01:28:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa25b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa25c0ffda0 0x7fa25c19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa25b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa25c0ffda0 0x7fa25c19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49202/0 (socket says 172.21.15.17:49202) 2024-08-19T01:28:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa25b7fe640 1 -- 172.21.15.17:0/2064381051 learned_addr learned my addr 172.21.15.17:0/2064381051 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:17.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa25affd640 1 --2- 172.21.15.17:0/2064381051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa25c100750 0x7fa25c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa25b7fe640 1 -- 172.21.15.17:0/2064381051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa25c100750 msgr2=0x7fa25c19bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa25b7fe640 1 --2- 172.21.15.17:0/2064381051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa25c100750 0x7fa25c19bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa25b7fe640 1 -- 172.21.15.17:0/2064381051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa250009560 con 0x7fa25c0ffda0 2024-08-19T01:28:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.473+0000 7fa25b7fe640 1 --2- 172.21.15.17:0/2064381051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa25c0ffda0 0x7fa25c19b820 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00c810 tx=0x7fa24c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.474+0000 7fa258ff9640 1 -- 172.21.15.17:0/2064381051 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa24c0041f0 con 0x7fa25c0ffda0 2024-08-19T01:28:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.474+0000 7fa262065640 1 -- 172.21.15.17:0/2064381051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c195bf0 con 0x7fa25c0ffda0 2024-08-19T01:28:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.474+0000 7fa258ff9640 1 -- 172.21.15.17:0/2064381051 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa24c007e70 con 0x7fa25c0ffda0 2024-08-19T01:28:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.474+0000 7fa258ff9640 1 -- 172.21.15.17:0/2064381051 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa24c0049d0 con 0x7fa25c0ffda0 2024-08-19T01:28:17.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.474+0000 7fa262065640 1 -- 172.21.15.17:0/2064381051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c196110 con 0x7fa25c0ffda0 2024-08-19T01:28:17.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.475+0000 7fa262065640 1 -- 172.21.15.17:0/2064381051 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa25c101280 con 0x7fa25c0ffda0 2024-08-19T01:28:17.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.475+0000 7fa258ff9640 1 -- 172.21.15.17:0/2064381051 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa24c0079b0 con 0x7fa25c0ffda0 2024-08-19T01:28:17.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.476+0000 7fa258ff9640 1 --2- 172.21.15.17:0/2064381051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa24406e170 0x7fa244070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.476+0000 7fa25affd640 1 --2- 172.21.15.17:0/2064381051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa24406e170 0x7fa244070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.476+0000 7fa258ff9640 1 -- 172.21.15.17:0/2064381051 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa24c08e060 con 0x7fa25c0ffda0 2024-08-19T01:28:17.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.477+0000 7fa25affd640 1 --2- 172.21.15.17:0/2064381051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa24406e170 0x7fa244070630 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa250005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:17.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.480+0000 7fa258ff9640 1 -- 172.21.15.17:0/2064381051 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa24c0572a0 con 0x7fa25c0ffda0 2024-08-19T01:28:17.632 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:17 smithi086 ceph-mon[71303]: from='client.35634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:17.632 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:17 smithi086 ceph-mon[71303]: pgmap v886: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:17.632 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:17 smithi086 ceph-mon[71303]: from='client.35638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:17.633 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:17 smithi086 ceph-mon[71303]: from='client.35642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:17.633 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:17 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/13761134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:28:17.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.676+0000 7fa262065640 1 -- 172.21.15.17:0/2064381051 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa25c10cdb0 con 0x7fa24406e170 2024-08-19T01:28:17.678 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:17 smithi017 ceph-mon[99370]: from='client.35634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:17.678 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:17 smithi017 ceph-mon[99370]: pgmap v886: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:17.678 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:17 smithi017 ceph-mon[99370]: from='client.35638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:17.678 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:17 smithi017 ceph-mon[99370]: from='client.35642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:17.678 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:17 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/13761134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:28:17.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.677+0000 7fa258ff9640 1 -- 172.21.15.17:0/2064381051 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa25c10cdb0 con 0x7fa24406e170 2024-08-19T01:28:17.679 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:28:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:28:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:28:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:28:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:28:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:28:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:28:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:28:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:28:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:28:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:28:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:28:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:28:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:28:17.681 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:28:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.679+0000 7fa262065640 1 -- 172.21.15.17:0/2064381051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa24406e170 msgr2=0x7fa244070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.679+0000 7fa262065640 1 --2- 172.21.15.17:0/2064381051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa24406e170 0x7fa244070630 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa250005a20 comp rx=0 tx=0).stop 2024-08-19T01:28:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.679+0000 7fa262065640 1 -- 172.21.15.17:0/2064381051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa25c0ffda0 msgr2=0x7fa25c19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.679+0000 7fa262065640 1 --2- 172.21.15.17:0/2064381051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa25c0ffda0 0x7fa25c19b820 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00c810 tx=0x7fa24c00ccd0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.679+0000 7fa262065640 1 -- 172.21.15.17:0/2064381051 shutdown_connections 2024-08-19T01:28:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.679+0000 7fa262065640 1 --2- 172.21.15.17:0/2064381051 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa24406e170 0x7fa244070630 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.679+0000 7fa262065640 1 --2- 172.21.15.17:0/2064381051 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa25c100750 0x7fa25c19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.679+0000 7fa262065640 1 --2- 172.21.15.17:0/2064381051 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa25c0ffda0 0x7fa25c19b820 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.679+0000 7fa262065640 1 -- 172.21.15.17:0/2064381051 >> 172.21.15.17:0/2064381051 conn(0x7fa25c0fb840 msgr2=0x7fa25c0fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.680+0000 7fa262065640 1 -- 172.21.15.17:0/2064381051 shutdown_connections 2024-08-19T01:28:17.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.680+0000 7fa262065640 1 -- 172.21.15.17:0/2064381051 wait complete. 2024-08-19T01:28:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.762+0000 7f1fb3476640 1 -- 172.21.15.17:0/2226357132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fac0ff1f0 msgr2=0x7f1fac10beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.762+0000 7f1fb3476640 1 --2- 172.21.15.17:0/2226357132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fac0ff1f0 0x7f1fac10beb0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c009880 tx=0x7f1f9c02a490 comp rx=0 tx=0).stop 2024-08-19T01:28:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.762+0000 7f1fb3476640 1 -- 172.21.15.17:0/2226357132 shutdown_connections 2024-08-19T01:28:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.762+0000 7f1fb3476640 1 --2- 172.21.15.17:0/2226357132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fac0ff1f0 0x7f1fac10beb0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.762+0000 7f1fb3476640 1 --2- 172.21.15.17:0/2226357132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fac0fe840 0x7f1fac0fec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.762+0000 7f1fb3476640 1 -- 172.21.15.17:0/2226357132 >> 172.21.15.17:0/2226357132 conn(0x7f1fac0758a0 msgr2=0x7f1fac0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.762+0000 7f1fb3476640 1 -- 172.21.15.17:0/2226357132 shutdown_connections 2024-08-19T01:28:17.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.762+0000 7f1fb3476640 1 -- 172.21.15.17:0/2226357132 wait complete. 2024-08-19T01:28:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.762+0000 7f1fb3476640 1 Processor -- start 2024-08-19T01:28:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb3476640 1 -- start start 2024-08-19T01:28:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb3476640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fac0fe840 0x7f1fac197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb3476640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fac0ff1f0 0x7f1fac1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb3476640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac1988d0 con 0x7f1fac0ff1f0 2024-08-19T01:28:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb3476640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac19b540 con 0x7f1fac0fe840 2024-08-19T01:28:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb0a11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fac0ff1f0 0x7f1fac1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb0a11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fac0ff1f0 0x7f1fac1981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49230/0 (socket says 172.21.15.17:49230) 2024-08-19T01:28:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb0a11640 1 -- 172.21.15.17:0/3247936276 learned_addr learned my addr 172.21.15.17:0/3247936276 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb1212640 1 --2- 172.21.15.17:0/3247936276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fac0fe840 0x7f1fac197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:17.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb0a11640 1 -- 172.21.15.17:0/3247936276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fac0fe840 msgr2=0x7f1fac197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb0a11640 1 --2- 172.21.15.17:0/3247936276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fac0fe840 0x7f1fac197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb0a11640 1 -- 172.21.15.17:0/3247936276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c009560 con 0x7f1fac0ff1f0 2024-08-19T01:28:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.763+0000 7f1fb0a11640 1 --2- 172.21.15.17:0/3247936276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fac0ff1f0 0x7f1fac1981f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c02a9b0 tx=0x7f1f9c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.764+0000 7f1fa27fc640 1 -- 172.21.15.17:0/3247936276 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f9c004aa0 con 0x7f1fac0ff1f0 2024-08-19T01:28:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.764+0000 7f1fa27fc640 1 -- 172.21.15.17:0/3247936276 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f9c004c00 con 0x7f1fac0ff1f0 2024-08-19T01:28:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.764+0000 7f1fb3476640 1 -- 172.21.15.17:0/3247936276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fac19b7c0 con 0x7f1fac0ff1f0 2024-08-19T01:28:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.764+0000 7f1fa27fc640 1 -- 172.21.15.17:0/3247936276 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f9c003980 con 0x7f1fac0ff1f0 2024-08-19T01:28:17.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.764+0000 7f1fb3476640 1 -- 172.21.15.17:0/3247936276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac19bd10 con 0x7f1fac0ff1f0 2024-08-19T01:28:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.765+0000 7f1fb3476640 1 -- 172.21.15.17:0/3247936276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fac068510 con 0x7f1fac0ff1f0 2024-08-19T01:28:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.765+0000 7f1fa27fc640 1 -- 172.21.15.17:0/3247936276 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1f9c003bf0 con 0x7f1fac0ff1f0 2024-08-19T01:28:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.766+0000 7f1fa27fc640 1 --2- 172.21.15.17:0/3247936276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f9806e170 0x7f1f98070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.766+0000 7f1fa27fc640 1 -- 172.21.15.17:0/3247936276 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1f9c0af160 con 0x7f1fac0ff1f0 2024-08-19T01:28:17.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.766+0000 7f1fb1212640 1 --2- 172.21.15.17:0/3247936276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f9806e170 0x7f1f98070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:17.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.766+0000 7f1fb1212640 1 --2- 172.21.15.17:0/3247936276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f9806e170 0x7f1f98070630 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8005fd0 tx=0x7f1fa8009680 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:17.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:17.770+0000 7f1fa27fc640 1 -- 172.21.15.17:0/3247936276 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1f9c0784f0 con 0x7f1fac0ff1f0 2024-08-19T01:28:18.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.013+0000 7f1fb3476640 1 -- 172.21.15.17:0/3247936276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1fac0fec20 con 0x7f1fac0ff1f0 2024-08-19T01:28:18.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.013+0000 7f1fa27fc640 1 -- 172.21.15.17:0/3247936276 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f1f9c07bbb0 con 0x7f1fac0ff1f0 2024-08-19T01:28:18.015 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:28:18.015 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:28:18.015 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:28:18.015 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:28:18.015 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:28:18.015 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:28:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:28:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:28:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:28:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:28:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:28:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:28:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:28:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:28:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:28:18.016 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:28:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:28:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:28:18.017 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:28:18.017 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:28:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:28:18.017 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:28:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:28:18.017 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:28:18.017 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:28:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.015+0000 7f1fb3476640 1 -- 172.21.15.17:0/3247936276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f9806e170 msgr2=0x7f1f98070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.015+0000 7f1fb3476640 1 --2- 172.21.15.17:0/3247936276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f9806e170 0x7f1f98070630 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8005fd0 tx=0x7f1fa8009680 comp rx=0 tx=0).stop 2024-08-19T01:28:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.015+0000 7f1fb3476640 1 -- 172.21.15.17:0/3247936276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fac0ff1f0 msgr2=0x7f1fac1981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.015+0000 7f1fb3476640 1 --2- 172.21.15.17:0/3247936276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fac0ff1f0 0x7f1fac1981f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c02a9b0 tx=0x7f1f9c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:28:18.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.015+0000 7f1fb3476640 1 -- 172.21.15.17:0/3247936276 shutdown_connections 2024-08-19T01:28:18.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.015+0000 7f1fb3476640 1 --2- 172.21.15.17:0/3247936276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1f9806e170 0x7f1f98070630 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:18.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.015+0000 7f1fb3476640 1 --2- 172.21.15.17:0/3247936276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fac0ff1f0 0x7f1fac1981f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:18.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.015+0000 7f1fb3476640 1 --2- 172.21.15.17:0/3247936276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1fac0fe840 0x7f1fac197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:18.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.015+0000 7f1fb3476640 1 -- 172.21.15.17:0/3247936276 >> 172.21.15.17:0/3247936276 conn(0x7f1fac0758a0 msgr2=0x7f1fac0fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:18.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.015+0000 7f1fb3476640 1 -- 172.21.15.17:0/3247936276 shutdown_connections 2024-08-19T01:28:18.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:18.015+0000 7f1fb3476640 1 -- 172.21.15.17:0/3247936276 wait complete. 2024-08-19T01:28:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:18 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1842607630' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:28:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:18 smithi017 ceph-mon[99370]: from='client.35654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:28:18.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:18 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3247936276' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:28:18.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:18 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1842607630' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:28:18.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:18 smithi086 ceph-mon[71303]: from='client.35654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:18.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:28:18.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:18 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3247936276' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:28:19.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:19 smithi017 ceph-mon[99370]: pgmap v887: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:19.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:19 smithi086 ceph-mon[71303]: pgmap v887: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:21.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:21 smithi017 ceph-mon[99370]: pgmap v888: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:21.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:21 smithi086 ceph-mon[71303]: pgmap v888: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:23.687 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:23 smithi017 ceph-mon[99370]: pgmap v889: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:23.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:23 smithi086 ceph-mon[71303]: pgmap v889: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:25.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:25 smithi017 ceph-mon[99370]: pgmap v890: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:25.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:25 smithi086 ceph-mon[71303]: pgmap v890: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:27.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:27 smithi017 ceph-mon[99370]: pgmap v891: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:27.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:27 smithi086 ceph-mon[71303]: pgmap v891: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:29.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:29 smithi017 ceph-mon[99370]: pgmap v892: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:29.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:29 smithi086 ceph-mon[71303]: pgmap v892: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:31.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:31 smithi017 ceph-mon[99370]: pgmap v893: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:31.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:31 smithi086 ceph-mon[71303]: pgmap v893: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:33.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:33 smithi017 ceph-mon[99370]: pgmap v894: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:33.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:28:33.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:33 smithi086 ceph-mon[71303]: pgmap v894: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:33.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:28:35.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:35 smithi017 ceph-mon[99370]: pgmap v895: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:35.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:35 smithi086 ceph-mon[71303]: pgmap v895: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:37.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:37 smithi017 ceph-mon[99370]: pgmap v896: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:37.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:37 smithi086 ceph-mon[71303]: pgmap v896: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:39.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:39 smithi017 ceph-mon[99370]: pgmap v897: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:39.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:39 smithi086 ceph-mon[71303]: pgmap v897: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:41.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:41 smithi017 ceph-mon[99370]: pgmap v898: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:41.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:41 smithi086 ceph-mon[71303]: pgmap v898: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:43.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:43 smithi017 ceph-mon[99370]: pgmap v899: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:43.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:43 smithi086 ceph-mon[71303]: pgmap v899: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:45.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:45 smithi017 ceph-mon[99370]: pgmap v900: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:45.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:45 smithi086 ceph-mon[71303]: pgmap v900: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:47.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:47 smithi017 ceph-mon[99370]: pgmap v901: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:47.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:47 smithi086 ceph-mon[71303]: pgmap v901: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.111+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3895756576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44101610 msgr2=0x7fbf44109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.111+0000 7fbf49c3c640 1 --2- 172.21.15.17:0/3895756576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44101610 0x7fbf44109b00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c0098b0 tx=0x7fbf2c02a4d0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.111+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3895756576 shutdown_connections 2024-08-19T01:28:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.111+0000 7fbf49c3c640 1 --2- 172.21.15.17:0/3895756576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44101610 0x7fbf44109b00 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.111+0000 7fbf49c3c640 1 --2- 172.21.15.17:0/3895756576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf44100c60 0x7fbf44101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.111+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3895756576 >> 172.21.15.17:0/3895756576 conn(0x7fbf440fa730 msgr2=0x7fbf440fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.111+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3895756576 shutdown_connections 2024-08-19T01:28:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.111+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3895756576 wait complete. 2024-08-19T01:28:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.111+0000 7fbf49c3c640 1 Processor -- start 2024-08-19T01:28:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.111+0000 7fbf49c3c640 1 -- start start 2024-08-19T01:28:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf49c3c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44100c60 0x7fbf4419b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf49c3c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf44101610 0x7fbf4419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf49c3c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4419c3c0 con 0x7fbf44100c60 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf49c3c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf44195950 con 0x7fbf44101610 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44100c60 0x7fbf4419b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf437fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44100c60 0x7fbf4419b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39126/0 (socket says 172.21.15.17:39126) 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf437fe640 1 -- 172.21.15.17:0/3296566688 learned_addr learned my addr 172.21.15.17:0/3296566688 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf3affd640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf44101610 0x7fbf4419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf437fe640 1 -- 172.21.15.17:0/3296566688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf44101610 msgr2=0x7fbf4419bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf437fe640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf44101610 0x7fbf4419bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf437fe640 1 -- 172.21.15.17:0/3296566688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c009560 con 0x7fbf44100c60 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.112+0000 7fbf3affd640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf44101610 0x7fbf4419bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.113+0000 7fbf437fe640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44100c60 0x7fbf4419b860 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400c810 tx=0x7fbf3400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.113+0000 7fbf417fa640 1 -- 172.21.15.17:0/3296566688 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf340041f0 con 0x7fbf44100c60 2024-08-19T01:28:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.113+0000 7fbf417fa640 1 -- 172.21.15.17:0/3296566688 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf34007e70 con 0x7fbf44100c60 2024-08-19T01:28:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.113+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3296566688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf44195c30 con 0x7fbf44100c60 2024-08-19T01:28:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.113+0000 7fbf417fa640 1 -- 172.21.15.17:0/3296566688 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf340049d0 con 0x7fbf44100c60 2024-08-19T01:28:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.113+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3296566688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf44196150 con 0x7fbf44100c60 2024-08-19T01:28:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.114+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3296566688 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf44068d30 con 0x7fbf44100c60 2024-08-19T01:28:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.115+0000 7fbf417fa640 1 -- 172.21.15.17:0/3296566688 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbf340079b0 con 0x7fbf44100c60 2024-08-19T01:28:48.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.115+0000 7fbf417fa640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf3006e170 0x7fbf30070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.115+0000 7fbf417fa640 1 -- 172.21.15.17:0/3296566688 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fbf3408dfe0 con 0x7fbf44100c60 2024-08-19T01:28:48.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.115+0000 7fbf3affd640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf3006e170 0x7fbf30070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.116+0000 7fbf3affd640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf3006e170 0x7fbf30070630 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009230 tx=0x7fbf2c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:48.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.120+0000 7fbf417fa640 1 -- 172.21.15.17:0/3296566688 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbf340572c0 con 0x7fbf44100c60 2024-08-19T01:28:48.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.316+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3296566688 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf441043b0 con 0x7fbf3006e170 2024-08-19T01:28:48.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.317+0000 7fbf417fa640 1 -- 172.21.15.17:0/3296566688 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fbf441043b0 con 0x7fbf3006e170 2024-08-19T01:28:48.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.319+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3296566688 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf3006e170 msgr2=0x7fbf30070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.319+0000 7fbf49c3c640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf3006e170 0x7fbf30070630 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009230 tx=0x7fbf2c005a20 comp rx=0 tx=0).stop 2024-08-19T01:28:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.319+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3296566688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44100c60 msgr2=0x7fbf4419b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.319+0000 7fbf49c3c640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44100c60 0x7fbf4419b860 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbf3400c810 tx=0x7fbf3400ccd0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.319+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3296566688 shutdown_connections 2024-08-19T01:28:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.319+0000 7fbf49c3c640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbf3006e170 0x7fbf30070630 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.319+0000 7fbf49c3c640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbf44101610 0x7fbf4419bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.319+0000 7fbf49c3c640 1 --2- 172.21.15.17:0/3296566688 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbf44100c60 0x7fbf4419b860 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.319+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3296566688 >> 172.21.15.17:0/3296566688 conn(0x7fbf440fa730 msgr2=0x7fbf44101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.319+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3296566688 shutdown_connections 2024-08-19T01:28:48.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.319+0000 7fbf49c3c640 1 -- 172.21.15.17:0/3296566688 wait complete. 2024-08-19T01:28:48.329 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:28:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.402+0000 7f393a11f640 1 -- 172.21.15.17:0/1437868202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340fea30 msgr2=0x7f39340fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.402+0000 7f393a11f640 1 --2- 172.21.15.17:0/1437868202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340fea30 0x7f39340fee90 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3924009880 tx=0x7f392402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.402+0000 7f393a11f640 1 -- 172.21.15.17:0/1437868202 shutdown_connections 2024-08-19T01:28:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.402+0000 7f393a11f640 1 --2- 172.21.15.17:0/1437868202 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340fea30 0x7f39340fee90 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.402+0000 7f393a11f640 1 --2- 172.21.15.17:0/1437868202 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3934104a30 0x7f3934104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.402+0000 7f393a11f640 1 -- 172.21.15.17:0/1437868202 >> 172.21.15.17:0/1437868202 conn(0x7f39340fa730 msgr2=0x7f39340fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.402+0000 7f393a11f640 1 -- 172.21.15.17:0/1437868202 shutdown_connections 2024-08-19T01:28:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.402+0000 7f393a11f640 1 -- 172.21.15.17:0/1437868202 wait complete. 2024-08-19T01:28:48.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.402+0000 7f393a11f640 1 Processor -- start 2024-08-19T01:28:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f393a11f640 1 -- start start 2024-08-19T01:28:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f393a11f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340fea30 0x7f39340fb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f393a11f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3934104a30 0x7f39340fb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f393a11f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39340fbad0 con 0x7f39340fea30 2024-08-19T01:28:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f393a11f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39340fbc40 con 0x7f3934104a30 2024-08-19T01:28:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f39337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340fea30 0x7f39340fb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f39337fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340fea30 0x7f39340fb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39138/0 (socket says 172.21.15.17:39138) 2024-08-19T01:28:48.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f39337fe640 1 -- 172.21.15.17:0/3676756768 learned_addr learned my addr 172.21.15.17:0/3676756768 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f3932ffd640 1 --2- 172.21.15.17:0/3676756768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3934104a30 0x7f39340fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f39337fe640 1 -- 172.21.15.17:0/3676756768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3934104a30 msgr2=0x7f39340fb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f39337fe640 1 --2- 172.21.15.17:0/3676756768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3934104a30 0x7f39340fb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.403+0000 7f39337fe640 1 -- 172.21.15.17:0/3676756768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3924009560 con 0x7f39340fea30 2024-08-19T01:28:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.404+0000 7f39337fe640 1 --2- 172.21.15.17:0/3676756768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340fea30 0x7f39340fb050 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f391c00b420 tx=0x7f391c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.404+0000 7f3930ff9640 1 -- 172.21.15.17:0/3676756768 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f391c011800 con 0x7f39340fea30 2024-08-19T01:28:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.404+0000 7f3930ff9640 1 -- 172.21.15.17:0/3676756768 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f391c011e20 con 0x7f39340fea30 2024-08-19T01:28:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.404+0000 7f393a11f640 1 -- 172.21.15.17:0/3676756768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39341a1da0 con 0x7f39340fea30 2024-08-19T01:28:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.404+0000 7f3930ff9640 1 -- 172.21.15.17:0/3676756768 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f391c00f2e0 con 0x7f39340fea30 2024-08-19T01:28:48.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.404+0000 7f393a11f640 1 -- 172.21.15.17:0/3676756768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39341a2100 con 0x7f39340fea30 2024-08-19T01:28:48.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.405+0000 7f393a11f640 1 -- 172.21.15.17:0/3676756768 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3934100170 con 0x7f39340fea30 2024-08-19T01:28:48.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.406+0000 7f3930ff9640 1 -- 172.21.15.17:0/3676756768 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f391c010380 con 0x7f39340fea30 2024-08-19T01:28:48.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.406+0000 7f3930ff9640 1 --2- 172.21.15.17:0/3676756768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f392006e170 0x7f3920070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.406+0000 7f3930ff9640 1 -- 172.21.15.17:0/3676756768 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f391c08da60 con 0x7f39340fea30 2024-08-19T01:28:48.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.406+0000 7f3932ffd640 1 --2- 172.21.15.17:0/3676756768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f392006e170 0x7f3920070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.407+0000 7f3932ffd640 1 --2- 172.21.15.17:0/3676756768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f392006e170 0x7f3920070630 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3924009230 tx=0x7f39240058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.411+0000 7f3930ff9640 1 -- 172.21.15.17:0/3676756768 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f391c056d40 con 0x7f39340fea30 2024-08-19T01:28:48.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.602+0000 7f393a11f640 1 -- 172.21.15.17:0/3676756768 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39340fc5f0 con 0x7f392006e170 2024-08-19T01:28:48.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.604+0000 7f3930ff9640 1 -- 172.21.15.17:0/3676756768 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f39340fc5f0 con 0x7f392006e170 2024-08-19T01:28:48.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.606+0000 7f393a11f640 1 -- 172.21.15.17:0/3676756768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f392006e170 msgr2=0x7f3920070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.606+0000 7f393a11f640 1 --2- 172.21.15.17:0/3676756768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f392006e170 0x7f3920070630 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3924009230 tx=0x7f39240058d0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.606+0000 7f393a11f640 1 -- 172.21.15.17:0/3676756768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340fea30 msgr2=0x7f39340fb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.606+0000 7f393a11f640 1 --2- 172.21.15.17:0/3676756768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340fea30 0x7f39340fb050 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f391c00b420 tx=0x7f391c00b8e0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.606+0000 7f393a11f640 1 -- 172.21.15.17:0/3676756768 shutdown_connections 2024-08-19T01:28:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.606+0000 7f393a11f640 1 --2- 172.21.15.17:0/3676756768 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f392006e170 0x7f3920070630 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.606+0000 7f393a11f640 1 --2- 172.21.15.17:0/3676756768 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3934104a30 0x7f39340fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.606+0000 7f393a11f640 1 --2- 172.21.15.17:0/3676756768 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f39340fea30 0x7f39340fb050 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.606+0000 7f393a11f640 1 -- 172.21.15.17:0/3676756768 >> 172.21.15.17:0/3676756768 conn(0x7f39340fa730 msgr2=0x7f3934068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.606+0000 7f393a11f640 1 -- 172.21.15.17:0/3676756768 shutdown_connections 2024-08-19T01:28:48.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.606+0000 7f393a11f640 1 -- 172.21.15.17:0/3676756768 wait complete. 2024-08-19T01:28:48.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:28:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.688+0000 7f915eb9f640 1 -- 172.21.15.17:0/3417006791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9158100750 msgr2=0x7f91581047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.688+0000 7f915eb9f640 1 --2- 172.21.15.17:0/3417006791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9158100750 0x7f91581047a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9144009880 tx=0x7f914402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.688+0000 7f915eb9f640 1 -- 172.21.15.17:0/3417006791 shutdown_connections 2024-08-19T01:28:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.688+0000 7f915eb9f640 1 --2- 172.21.15.17:0/3417006791 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9158100750 0x7f91581047a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.688+0000 7f915eb9f640 1 --2- 172.21.15.17:0/3417006791 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f91580ffda0 0x7f9158100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.688+0000 7f915eb9f640 1 -- 172.21.15.17:0/3417006791 >> 172.21.15.17:0/3417006791 conn(0x7f91580fb840 msgr2=0x7f91580fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.688+0000 7f915eb9f640 1 -- 172.21.15.17:0/3417006791 shutdown_connections 2024-08-19T01:28:48.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.688+0000 7f915eb9f640 1 -- 172.21.15.17:0/3417006791 wait complete. 2024-08-19T01:28:48.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f915eb9f640 1 Processor -- start 2024-08-19T01:28:48.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f915eb9f640 1 -- start start 2024-08-19T01:28:48.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f915eb9f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91580ffda0 0x7f9158197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f915eb9f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9158100750 0x7f91581982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f915eb9f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158198940 con 0x7f91580ffda0 2024-08-19T01:28:48.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f915eb9f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915819c6b0 con 0x7f9158100750 2024-08-19T01:28:48.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f915c93b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91580ffda0 0x7f9158197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f915c93b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91580ffda0 0x7f9158197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39152/0 (socket says 172.21.15.17:39152) 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f915c93b640 1 -- 172.21.15.17:0/3699125694 learned_addr learned my addr 172.21.15.17:0/3699125694 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f9157fff640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9158100750 0x7f91581982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f915c93b640 1 -- 172.21.15.17:0/3699125694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9158100750 msgr2=0x7f91581982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.689+0000 7f915c93b640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9158100750 0x7f91581982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.690+0000 7f915c93b640 1 -- 172.21.15.17:0/3699125694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144009560 con 0x7f91580ffda0 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.690+0000 7f9157fff640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9158100750 0x7f91581982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.690+0000 7f915c93b640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91580ffda0 0x7f9158197d70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f914c00d6f0 tx=0x7f914c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.690+0000 7f9155ffb640 1 -- 172.21.15.17:0/3699125694 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f914c009a30 con 0x7f91580ffda0 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.690+0000 7f915eb9f640 1 -- 172.21.15.17:0/3699125694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f915819c990 con 0x7f91580ffda0 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.690+0000 7f9155ffb640 1 -- 172.21.15.17:0/3699125694 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f914c0054e0 con 0x7f91580ffda0 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.690+0000 7f9155ffb640 1 -- 172.21.15.17:0/3699125694 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f914c010460 con 0x7f91580ffda0 2024-08-19T01:28:48.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.690+0000 7f915eb9f640 1 -- 172.21.15.17:0/3699125694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915819ceb0 con 0x7f91580ffda0 2024-08-19T01:28:48.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.691+0000 7f915eb9f640 1 -- 172.21.15.17:0/3699125694 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9158101280 con 0x7f91580ffda0 2024-08-19T01:28:48.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.692+0000 7f9155ffb640 1 -- 172.21.15.17:0/3699125694 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f914c009b90 con 0x7f91580ffda0 2024-08-19T01:28:48.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.692+0000 7f9155ffb640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f914806e170 0x7f9148070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.692+0000 7f9155ffb640 1 -- 172.21.15.17:0/3699125694 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f914c08dd30 con 0x7f91580ffda0 2024-08-19T01:28:48.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.692+0000 7f9157fff640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f914806e170 0x7f9148070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.693+0000 7f9157fff640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f914806e170 0x7f9148070630 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9144000c00 tx=0x7f9144005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:48.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:28:48.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.696+0000 7f9155ffb640 1 -- 172.21.15.17:0/3699125694 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f914c057010 con 0x7f91580ffda0 2024-08-19T01:28:48.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.884+0000 7f915eb9f640 1 -- 172.21.15.17:0/3699125694 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f91581990d0 con 0x7f914806e170 2024-08-19T01:28:48.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.893+0000 7f9155ffb640 1 -- 172.21.15.17:0/3699125694 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f91581990d0 con 0x7f914806e170 2024-08-19T01:28:48.895 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:28:48.895 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (30m) 8m ago 40m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:28:48.895 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (40m) 8m ago 40m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:28:48.895 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (39m) 8m ago 39m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (27m) 8m ago 40m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (27m) 8m ago 39m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (29m) 8m ago 40m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (24m) 8m ago 35m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (24m) 8m ago 35m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (8m) 8m ago 35m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (23m) 8m ago 35m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (32m) 8m ago 42m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (30m) 8m ago 39m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (28m) 8m ago 42m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (28m) 8m ago 39m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:28:48.896 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (30m) 8m ago 40m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:28:48.897 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (30m) 8m ago 39m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:28:48.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (27m) 8m ago 38m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:28:48.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (26m) 8m ago 38m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:28:48.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (26m) 8m ago 38m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:28:48.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (25m) 8m ago 37m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:28:48.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (25m) 8m ago 37m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:28:48.897 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (24m) 8m ago 36m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:28:48.897 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (30m) 8m ago 40m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:28:48.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.895+0000 7f915eb9f640 1 -- 172.21.15.17:0/3699125694 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f914806e170 msgr2=0x7f9148070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.895+0000 7f915eb9f640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f914806e170 0x7f9148070630 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9144000c00 tx=0x7f9144005a20 comp rx=0 tx=0).stop 2024-08-19T01:28:48.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.895+0000 7f915eb9f640 1 -- 172.21.15.17:0/3699125694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91580ffda0 msgr2=0x7f9158197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.895+0000 7f915eb9f640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91580ffda0 0x7f9158197d70 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f914c00d6f0 tx=0x7f914c00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.895+0000 7f915eb9f640 1 -- 172.21.15.17:0/3699125694 shutdown_connections 2024-08-19T01:28:48.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.895+0000 7f915eb9f640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f914806e170 0x7f9148070630 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.895+0000 7f915eb9f640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9158100750 0x7f91581982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.895+0000 7f915eb9f640 1 --2- 172.21.15.17:0/3699125694 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f91580ffda0 0x7f9158197d70 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.895+0000 7f915eb9f640 1 -- 172.21.15.17:0/3699125694 >> 172.21.15.17:0/3699125694 conn(0x7f91580fb840 msgr2=0x7f91580fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:48.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.896+0000 7f915eb9f640 1 -- 172.21.15.17:0/3699125694 shutdown_connections 2024-08-19T01:28:48.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.896+0000 7f915eb9f640 1 -- 172.21.15.17:0/3699125694 wait complete. 2024-08-19T01:28:48.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.977+0000 7f212862a640 1 -- 172.21.15.17:0/439392408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21200ff1d0 msgr2=0x7f21200ff610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.977+0000 7f212862a640 1 --2- 172.21.15.17:0/439392408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21200ff1d0 0x7f21200ff610 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f2114009880 tx=0x7f211402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.977+0000 7f212862a640 1 -- 172.21.15.17:0/439392408 shutdown_connections 2024-08-19T01:28:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.977+0000 7f212862a640 1 --2- 172.21.15.17:0/439392408 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21200ff1d0 0x7f21200ff610 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.977+0000 7f212862a640 1 --2- 172.21.15.17:0/439392408 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2120103a20 0x7f2120103e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.977+0000 7f212862a640 1 -- 172.21.15.17:0/439392408 >> 172.21.15.17:0/439392408 conn(0x7f21200f9e70 msgr2=0x7f21200fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.977+0000 7f212862a640 1 -- 172.21.15.17:0/439392408 shutdown_connections 2024-08-19T01:28:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.977+0000 7f212862a640 1 -- 172.21.15.17:0/439392408 wait complete. 2024-08-19T01:28:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f212862a640 1 Processor -- start 2024-08-19T01:28:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f212862a640 1 -- start start 2024-08-19T01:28:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f212862a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21200ff1d0 0x7f212019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f212862a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120103a20 0x7f212019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f212862a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212019c440 con 0x7f2120103a20 2024-08-19T01:28:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f212862a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21201959d0 con 0x7f21200ff1d0 2024-08-19T01:28:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f2125bc5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120103a20 0x7f212019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f2125bc5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120103a20 0x7f212019be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39176/0 (socket says 172.21.15.17:39176) 2024-08-19T01:28:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f2125bc5640 1 -- 172.21.15.17:0/3137126318 learned_addr learned my addr 172.21.15.17:0/3137126318 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f21263c6640 1 --2- 172.21.15.17:0/3137126318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21200ff1d0 0x7f212019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f2125bc5640 1 -- 172.21.15.17:0/3137126318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21200ff1d0 msgr2=0x7f212019b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:48.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f2125bc5640 1 --2- 172.21.15.17:0/3137126318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21200ff1d0 0x7f212019b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:48.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.978+0000 7f2125bc5640 1 -- 172.21.15.17:0/3137126318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114009560 con 0x7f2120103a20 2024-08-19T01:28:48.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.979+0000 7f2125bc5640 1 --2- 172.21.15.17:0/3137126318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120103a20 0x7f212019be20 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f211402a9c0 tx=0x7f21140055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:48.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.979+0000 7f211f7fe640 1 -- 172.21.15.17:0/3137126318 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2114004aa0 con 0x7f2120103a20 2024-08-19T01:28:48.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.979+0000 7f211f7fe640 1 -- 172.21.15.17:0/3137126318 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2114004c00 con 0x7f2120103a20 2024-08-19T01:28:48.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.979+0000 7f212862a640 1 -- 172.21.15.17:0/3137126318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2120195c50 con 0x7f2120103a20 2024-08-19T01:28:48.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.979+0000 7f211f7fe640 1 -- 172.21.15.17:0/3137126318 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2114003980 con 0x7f2120103a20 2024-08-19T01:28:48.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.979+0000 7f212862a640 1 -- 172.21.15.17:0/3137126318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2120196140 con 0x7f2120103a20 2024-08-19T01:28:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.980+0000 7f212862a640 1 -- 172.21.15.17:0/3137126318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21201001e0 con 0x7f2120103a20 2024-08-19T01:28:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.981+0000 7f211f7fe640 1 -- 172.21.15.17:0/3137126318 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2114003bf0 con 0x7f2120103a20 2024-08-19T01:28:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.981+0000 7f211f7fe640 1 --2- 172.21.15.17:0/3137126318 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f210806e170 0x7f2108070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.981+0000 7f211f7fe640 1 -- 172.21.15.17:0/3137126318 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f21140af160 con 0x7f2120103a20 2024-08-19T01:28:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.981+0000 7f21263c6640 1 --2- 172.21.15.17:0/3137126318 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f210806e170 0x7f2108070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.982+0000 7f21263c6640 1 --2- 172.21.15.17:0/3137126318 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f210806e170 0x7f2108070630 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2110005fd0 tx=0x7f2110009680 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:48.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:48.986+0000 7f211f7fe640 1 -- 172.21.15.17:0/3137126318 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f21140784f0 con 0x7f2120103a20 2024-08-19T01:28:49.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.233+0000 7f212862a640 1 -- 172.21.15.17:0/3137126318 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2120196f40 con 0x7f2120103a20 2024-08-19T01:28:49.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.234+0000 7f211f7fe640 1 -- 172.21.15.17:0/3137126318 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f211407bbb0 con 0x7f2120103a20 2024-08-19T01:28:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:28:49.236 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:28:49.236 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:28:49.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:28:49.236 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:28:49.236 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:28:49.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:28:49.236 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:28:49.236 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:28:49.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:28:49.237 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:28:49.237 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:28:49.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:28:49.237 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:28:49.237 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:28:49.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:28:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:28:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.236+0000 7f212862a640 1 -- 172.21.15.17:0/3137126318 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f210806e170 msgr2=0x7f2108070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.236+0000 7f212862a640 1 --2- 172.21.15.17:0/3137126318 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f210806e170 0x7f2108070630 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2110005fd0 tx=0x7f2110009680 comp rx=0 tx=0).stop 2024-08-19T01:28:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.236+0000 7f212862a640 1 -- 172.21.15.17:0/3137126318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120103a20 msgr2=0x7f212019be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.236+0000 7f212862a640 1 --2- 172.21.15.17:0/3137126318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120103a20 0x7f212019be20 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f211402a9c0 tx=0x7f21140055a0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.236+0000 7f212862a640 1 -- 172.21.15.17:0/3137126318 shutdown_connections 2024-08-19T01:28:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.236+0000 7f212862a640 1 --2- 172.21.15.17:0/3137126318 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f210806e170 0x7f2108070630 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.236+0000 7f212862a640 1 --2- 172.21.15.17:0/3137126318 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2120103a20 0x7f212019be20 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.236+0000 7f212862a640 1 --2- 172.21.15.17:0/3137126318 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f21200ff1d0 0x7f212019b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.236+0000 7f212862a640 1 -- 172.21.15.17:0/3137126318 >> 172.21.15.17:0/3137126318 conn(0x7f21200f9e70 msgr2=0x7f21200fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:49.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.236+0000 7f212862a640 1 -- 172.21.15.17:0/3137126318 shutdown_connections 2024-08-19T01:28:49.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.236+0000 7f212862a640 1 -- 172.21.15.17:0/3137126318 wait complete. 2024-08-19T01:28:49.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.318+0000 7fc690033640 1 -- 172.21.15.17:0/1887302216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6880ffb00 msgr2=0x7fc6880fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.318+0000 7fc690033640 1 --2- 172.21.15.17:0/1887302216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6880ffb00 0x7fc6880fff60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009880 tx=0x7fc67c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.318+0000 7fc690033640 1 -- 172.21.15.17:0/1887302216 shutdown_connections 2024-08-19T01:28:49.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.318+0000 7fc690033640 1 --2- 172.21.15.17:0/1887302216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6880ffb00 0x7fc6880fff60 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.318+0000 7fc690033640 1 --2- 172.21.15.17:0/1887302216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc688105b90 0x7fc688105f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.318+0000 7fc690033640 1 -- 172.21.15.17:0/1887302216 >> 172.21.15.17:0/1887302216 conn(0x7fc6880fb840 msgr2=0x7fc6880fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:49.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.319+0000 7fc690033640 1 -- 172.21.15.17:0/1887302216 shutdown_connections 2024-08-19T01:28:49.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.319+0000 7fc690033640 1 -- 172.21.15.17:0/1887302216 wait complete. 2024-08-19T01:28:49.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.319+0000 7fc690033640 1 Processor -- start 2024-08-19T01:28:49.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.319+0000 7fc690033640 1 -- start start 2024-08-19T01:28:49.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.319+0000 7fc690033640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6880ffb00 0x7fc68819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:49.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.319+0000 7fc690033640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc688105b90 0x7fc68819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:49.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.319+0000 7fc690033640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68819c2f0 con 0x7fc6880ffb00 2024-08-19T01:28:49.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.319+0000 7fc690033640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc688195910 con 0x7fc688105b90 2024-08-19T01:28:49.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc68ddcf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6880ffb00 0x7fc68819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc68ddcf640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6880ffb00 0x7fc68819b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39206/0 (socket says 172.21.15.17:39206) 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc68ddcf640 1 -- 172.21.15.17:0/3577708533 learned_addr learned my addr 172.21.15.17:0/3577708533 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc68d5ce640 1 --2- 172.21.15.17:0/3577708533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc688105b90 0x7fc68819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc68ddcf640 1 -- 172.21.15.17:0/3577708533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc688105b90 msgr2=0x7fc68819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc68ddcf640 1 --2- 172.21.15.17:0/3577708533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc688105b90 0x7fc68819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc68ddcf640 1 -- 172.21.15.17:0/3577708533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c009560 con 0x7fc6880ffb00 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc68ddcf640 1 --2- 172.21.15.17:0/3577708533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6880ffb00 0x7fc68819b820 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc68000c8a0 tx=0x7fc68000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc686ffd640 1 -- 172.21.15.17:0/3577708533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc680007b80 con 0x7fc6880ffb00 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc690033640 1 -- 172.21.15.17:0/3577708533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc688195bf0 con 0x7fc6880ffb00 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc686ffd640 1 -- 172.21.15.17:0/3577708533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc680007ce0 con 0x7fc6880ffb00 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc686ffd640 1 -- 172.21.15.17:0/3577708533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc680018810 con 0x7fc6880ffb00 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.320+0000 7fc690033640 1 -- 172.21.15.17:0/3577708533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc688196110 con 0x7fc6880ffb00 2024-08-19T01:28:49.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.321+0000 7fc690033640 1 -- 172.21.15.17:0/3577708533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc688101200 con 0x7fc6880ffb00 2024-08-19T01:28:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.322+0000 7fc686ffd640 1 -- 172.21.15.17:0/3577708533 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc680018970 con 0x7fc6880ffb00 2024-08-19T01:28:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.322+0000 7fc686ffd640 1 --2- 172.21.15.17:0/3577708533 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc67006e170 0x7fc670070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.322+0000 7fc686ffd640 1 -- 172.21.15.17:0/3577708533 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc68008e200 con 0x7fc6880ffb00 2024-08-19T01:28:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.322+0000 7fc68d5ce640 1 --2- 172.21.15.17:0/3577708533 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc67006e170 0x7fc670070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:49.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.323+0000 7fc68d5ce640 1 --2- 172.21.15.17:0/3577708533 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc67006e170 0x7fc670070630 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009230 tx=0x7fc67c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:49.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.327+0000 7fc686ffd640 1 -- 172.21.15.17:0/3577708533 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc680057560 con 0x7fc6880ffb00 2024-08-19T01:28:49.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.540+0000 7fc690033640 1 -- 172.21.15.17:0/3577708533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc688108090 con 0x7fc6880ffb00 2024-08-19T01:28:49.542 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:49 smithi017 ceph-mon[99370]: pgmap v902: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:49.543 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:49 smithi017 ceph-mon[99370]: from='client.35662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:49.543 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:49 smithi017 ceph-mon[99370]: from='client.35666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:49.543 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:49 smithi017 ceph-mon[99370]: from='client.35670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:49.543 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:49 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3137126318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:28:49.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.541+0000 7fc686ffd640 1 -- 172.21.15.17:0/3577708533 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7fc68005ac20 con 0x7fc6880ffb00 2024-08-19T01:28:49.543 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:28:49.544 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:28:49.544 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:28:49.544 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:28:49.544 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:28:49.544 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:28:49.544 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:28:49.544 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:28:49.544 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:28:49.544 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:28:49.544 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:28:49.545 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:28:49.546 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:28:49.547 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:28:49.547 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:28:49.547 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:28:49.547 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:28:49.547 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:28:49.547 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:28:49.547 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:28:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:28:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.543+0000 7fc690033640 1 -- 172.21.15.17:0/3577708533 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc67006e170 msgr2=0x7fc670070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.543+0000 7fc690033640 1 --2- 172.21.15.17:0/3577708533 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc67006e170 0x7fc670070630 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009230 tx=0x7fc67c0058d0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.543+0000 7fc690033640 1 -- 172.21.15.17:0/3577708533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6880ffb00 msgr2=0x7fc68819b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.543+0000 7fc690033640 1 --2- 172.21.15.17:0/3577708533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6880ffb00 0x7fc68819b820 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fc68000c8a0 tx=0x7fc68000cd60 comp rx=0 tx=0).stop 2024-08-19T01:28:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.543+0000 7fc690033640 1 -- 172.21.15.17:0/3577708533 shutdown_connections 2024-08-19T01:28:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.543+0000 7fc690033640 1 --2- 172.21.15.17:0/3577708533 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc67006e170 0x7fc670070630 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.543+0000 7fc690033640 1 --2- 172.21.15.17:0/3577708533 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc688105b90 0x7fc68819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.543+0000 7fc690033640 1 --2- 172.21.15.17:0/3577708533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6880ffb00 0x7fc68819b820 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.543+0000 7fc690033640 1 -- 172.21.15.17:0/3577708533 >> 172.21.15.17:0/3577708533 conn(0x7fc6880fb840 msgr2=0x7fc6880fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.543+0000 7fc690033640 1 -- 172.21.15.17:0/3577708533 shutdown_connections 2024-08-19T01:28:49.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.543+0000 7fc690033640 1 -- 172.21.15.17:0/3577708533 wait complete. 2024-08-19T01:28:49.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.625+0000 7fccdd1e9640 1 -- 172.21.15.17:0/107799842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd8104a30 msgr2=0x7fccd8104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.625+0000 7fccdd1e9640 1 --2- 172.21.15.17:0/107799842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd8104a30 0x7fccd8104e10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009880 tx=0x7fccc802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.626+0000 7fccdd1e9640 1 -- 172.21.15.17:0/107799842 shutdown_connections 2024-08-19T01:28:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.626+0000 7fccdd1e9640 1 --2- 172.21.15.17:0/107799842 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccd80fea30 0x7fccd80fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.626+0000 7fccdd1e9640 1 --2- 172.21.15.17:0/107799842 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd8104a30 0x7fccd8104e10 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.626+0000 7fccdd1e9640 1 -- 172.21.15.17:0/107799842 >> 172.21.15.17:0/107799842 conn(0x7fccd80fa730 msgr2=0x7fccd80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.626+0000 7fccdd1e9640 1 -- 172.21.15.17:0/107799842 shutdown_connections 2024-08-19T01:28:49.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.626+0000 7fccdd1e9640 1 -- 172.21.15.17:0/107799842 wait complete. 2024-08-19T01:28:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.626+0000 7fccdd1e9640 1 Processor -- start 2024-08-19T01:28:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccdd1e9640 1 -- start start 2024-08-19T01:28:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccdd1e9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd80fea30 0x7fccd8196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:49.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccdd1e9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccd8104a30 0x7fccd8196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccdd1e9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd8197490 con 0x7fccd80fea30 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccdd1e9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd8197600 con 0x7fccd8104a30 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccd6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd80fea30 0x7fccd8196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccd6d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd80fea30 0x7fccd8196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39228/0 (socket says 172.21.15.17:39228) 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccd6d9d640 1 -- 172.21.15.17:0/1698510217 learned_addr learned my addr 172.21.15.17:0/1698510217 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccd659c640 1 --2- 172.21.15.17:0/1698510217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccd8104a30 0x7fccd8196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccd6d9d640 1 -- 172.21.15.17:0/1698510217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccd8104a30 msgr2=0x7fccd8196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccd6d9d640 1 --2- 172.21.15.17:0/1698510217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccd8104a30 0x7fccd8196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccd6d9d640 1 -- 172.21.15.17:0/1698510217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc8009560 con 0x7fccd80fea30 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.627+0000 7fccd6d9d640 1 --2- 172.21.15.17:0/1698510217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd80fea30 0x7fccd8196980 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fccc802a9c0 tx=0x7fccc80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.628+0000 7fccbffff640 1 -- 172.21.15.17:0/1698510217 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc80048d0 con 0x7fccd80fea30 2024-08-19T01:28:49.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.628+0000 7fccbffff640 1 -- 172.21.15.17:0/1698510217 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccc8031640 con 0x7fccd80fea30 2024-08-19T01:28:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.628+0000 7fccdd1e9640 1 -- 172.21.15.17:0/1698510217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd819f9f0 con 0x7fccd80fea30 2024-08-19T01:28:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.628+0000 7fccbffff640 1 -- 172.21.15.17:0/1698510217 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccc80038d0 con 0x7fccd80fea30 2024-08-19T01:28:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.628+0000 7fccdd1e9640 1 -- 172.21.15.17:0/1698510217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd819fd50 con 0x7fccd80fea30 2024-08-19T01:28:49.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.629+0000 7fccdd1e9640 1 -- 172.21.15.17:0/1698510217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd8100170 con 0x7fccd80fea30 2024-08-19T01:28:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.629+0000 7fccbffff640 1 -- 172.21.15.17:0/1698510217 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fccc8003b90 con 0x7fccd80fea30 2024-08-19T01:28:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.630+0000 7fccbffff640 1 --2- 172.21.15.17:0/1698510217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fccc006e170 0x7fccc0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.630+0000 7fccbffff640 1 -- 172.21.15.17:0/1698510217 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fccc80af150 con 0x7fccd80fea30 2024-08-19T01:28:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.630+0000 7fccd659c640 1 --2- 172.21.15.17:0/1698510217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fccc006e170 0x7fccc0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:49.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.630+0000 7fccd659c640 1 --2- 172.21.15.17:0/1698510217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fccc006e170 0x7fccc0070630 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fccd8068c90 tx=0x7fcccc005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:49.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.634+0000 7fccbffff640 1 -- 172.21.15.17:0/1698510217 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fccc8078430 con 0x7fccd80fea30 2024-08-19T01:28:49.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:49 smithi086 ceph-mon[71303]: pgmap v902: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:49.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:49 smithi086 ceph-mon[71303]: from='client.35662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:49.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:49 smithi086 ceph-mon[71303]: from='client.35666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:49.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:49 smithi086 ceph-mon[71303]: from='client.35670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:49.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:49 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3137126318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:28:49.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.825+0000 7fccdd1e9640 1 -- 172.21.15.17:0/1698510217 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fccd8068b00 con 0x7fccc006e170 2024-08-19T01:28:49.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.826+0000 7fccbffff640 1 -- 172.21.15.17:0/1698510217 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fccd8068b00 con 0x7fccc006e170 2024-08-19T01:28:49.828 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:28:49.828 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:28:49.828 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:28:49.828 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:28:49.828 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:28:49.828 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:28:49.828 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:28:49.828 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:28:49.828 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:28:49.828 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:28:49.829 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:28:49.829 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:28:49.829 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:28:49.829 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:28:49.829 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:28:49.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.828+0000 7fccdd1e9640 1 -- 172.21.15.17:0/1698510217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fccc006e170 msgr2=0x7fccc0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.828+0000 7fccdd1e9640 1 --2- 172.21.15.17:0/1698510217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fccc006e170 0x7fccc0070630 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fccd8068c90 tx=0x7fcccc005f90 comp rx=0 tx=0).stop 2024-08-19T01:28:49.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.828+0000 7fccdd1e9640 1 -- 172.21.15.17:0/1698510217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd80fea30 msgr2=0x7fccd8196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.828+0000 7fccdd1e9640 1 --2- 172.21.15.17:0/1698510217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd80fea30 0x7fccd8196980 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fccc802a9c0 tx=0x7fccc80055a0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.828+0000 7fccdd1e9640 1 -- 172.21.15.17:0/1698510217 shutdown_connections 2024-08-19T01:28:49.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.828+0000 7fccdd1e9640 1 --2- 172.21.15.17:0/1698510217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fccc006e170 0x7fccc0070630 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.829+0000 7fccdd1e9640 1 --2- 172.21.15.17:0/1698510217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fccd8104a30 0x7fccd8196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.829+0000 7fccdd1e9640 1 --2- 172.21.15.17:0/1698510217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccd80fea30 0x7fccd8196980 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.829+0000 7fccdd1e9640 1 -- 172.21.15.17:0/1698510217 >> 172.21.15.17:0/1698510217 conn(0x7fccd80fa730 msgr2=0x7fccd80fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:49.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.829+0000 7fccdd1e9640 1 -- 172.21.15.17:0/1698510217 shutdown_connections 2024-08-19T01:28:49.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.829+0000 7fccdd1e9640 1 -- 172.21.15.17:0/1698510217 wait complete. 2024-08-19T01:28:49.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.910+0000 7fb45d721640 1 -- 172.21.15.17:0/3363936217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580fea30 msgr2=0x7fb4580fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.910+0000 7fb45d721640 1 --2- 172.21.15.17:0/3363936217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580fea30 0x7fb4580fee90 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009880 tx=0x7fb44c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.910+0000 7fb45d721640 1 -- 172.21.15.17:0/3363936217 shutdown_connections 2024-08-19T01:28:49.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.910+0000 7fb45d721640 1 --2- 172.21.15.17:0/3363936217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580fea30 0x7fb4580fee90 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.910+0000 7fb45d721640 1 --2- 172.21.15.17:0/3363936217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb458104a30 0x7fb458104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.910+0000 7fb45d721640 1 -- 172.21.15.17:0/3363936217 >> 172.21.15.17:0/3363936217 conn(0x7fb4580fa730 msgr2=0x7fb4580fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:49.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.910+0000 7fb45d721640 1 -- 172.21.15.17:0/3363936217 shutdown_connections 2024-08-19T01:28:49.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.910+0000 7fb45d721640 1 -- 172.21.15.17:0/3363936217 wait complete. 2024-08-19T01:28:49.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.910+0000 7fb45d721640 1 Processor -- start 2024-08-19T01:28:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb45d721640 1 -- start start 2024-08-19T01:28:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb45d721640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4580fea30 0x7fb458194750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb45d721640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb458104a30 0x7fb458194c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb45d721640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4581951d0 con 0x7fb458104a30 2024-08-19T01:28:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb45d721640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458195340 con 0x7fb4580fea30 2024-08-19T01:28:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb4567fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb458104a30 0x7fb458194c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb4567fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb458104a30 0x7fb458194c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39244/0 (socket says 172.21.15.17:39244) 2024-08-19T01:28:49.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb4567fc640 1 -- 172.21.15.17:0/1098119418 learned_addr learned my addr 172.21.15.17:0/1098119418 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb456ffd640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4580fea30 0x7fb458194750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb4567fc640 1 -- 172.21.15.17:0/1098119418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4580fea30 msgr2=0x7fb458194750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb4567fc640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4580fea30 0x7fb458194750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb4567fc640 1 -- 172.21.15.17:0/1098119418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009560 con 0x7fb458104a30 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb456ffd640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4580fea30 0x7fb458194750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.911+0000 7fb4567fc640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb458104a30 0x7fb458194c90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb44c02a9c0 tx=0x7fb44c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.912+0000 7fb43ffff640 1 -- 172.21.15.17:0/1098119418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb44c004aa0 con 0x7fb458104a30 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.912+0000 7fb43ffff640 1 -- 172.21.15.17:0/1098119418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb44c004c00 con 0x7fb458104a30 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.912+0000 7fb45d721640 1 -- 172.21.15.17:0/1098119418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4581955c0 con 0x7fb458104a30 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.912+0000 7fb43ffff640 1 -- 172.21.15.17:0/1098119418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb44c003980 con 0x7fb458104a30 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.912+0000 7fb45d721640 1 -- 172.21.15.17:0/1098119418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4581a1fe0 con 0x7fb458104a30 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.913+0000 7fb45d721640 1 -- 172.21.15.17:0/1098119418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb458100170 con 0x7fb458104a30 2024-08-19T01:28:49.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.913+0000 7fb43ffff640 1 -- 172.21.15.17:0/1098119418 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb44c003b00 con 0x7fb458104a30 2024-08-19T01:28:49.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.914+0000 7fb43ffff640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44006e170 0x7fb440070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:28:49.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.914+0000 7fb43ffff640 1 -- 172.21.15.17:0/1098119418 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb44c0aefb0 con 0x7fb458104a30 2024-08-19T01:28:49.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.914+0000 7fb456ffd640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44006e170 0x7fb440070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:28:49.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.914+0000 7fb456ffd640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44006e170 0x7fb440070630 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb448009b40 tx=0x7fb448005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:28:49.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:49.918+0000 7fb43ffff640 1 -- 172.21.15.17:0/1098119418 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb44c078310 con 0x7fb458104a30 2024-08-19T01:28:50.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.162+0000 7fb45d721640 1 -- 172.21.15.17:0/1098119418 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb4581955c0 con 0x7fb458104a30 2024-08-19T01:28:50.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.162+0000 7fb43ffff640 1 -- 172.21.15.17:0/1098119418 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7fb4581955c0 con 0x7fb458104a30 2024-08-19T01:28:50.164 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:28:50.164 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:28:50.164 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:28:50.165 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:28:50.166 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:28:50.166 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:28:50.166 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:28:50.166 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:28:50.166 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:28:50.166 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:28:50.166 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:28:50.166 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:28:50.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.164+0000 7fb45d721640 1 -- 172.21.15.17:0/1098119418 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44006e170 msgr2=0x7fb440070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:50.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.164+0000 7fb45d721640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44006e170 0x7fb440070630 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb448009b40 tx=0x7fb448005e50 comp rx=0 tx=0).stop 2024-08-19T01:28:50.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.164+0000 7fb45d721640 1 -- 172.21.15.17:0/1098119418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb458104a30 msgr2=0x7fb458194c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:28:50.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.164+0000 7fb45d721640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb458104a30 0x7fb458194c90 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb44c02a9c0 tx=0x7fb44c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:28:50.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.164+0000 7fb45d721640 1 -- 172.21.15.17:0/1098119418 shutdown_connections 2024-08-19T01:28:50.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.164+0000 7fb45d721640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb44006e170 0x7fb440070630 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:50.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.164+0000 7fb45d721640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb458104a30 0x7fb458194c90 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:50.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.164+0000 7fb45d721640 1 --2- 172.21.15.17:0/1098119418 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb4580fea30 0x7fb458194750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:28:50.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.164+0000 7fb45d721640 1 -- 172.21.15.17:0/1098119418 >> 172.21.15.17:0/1098119418 conn(0x7fb4580fa730 msgr2=0x7fb4580fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:28:50.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.165+0000 7fb45d721640 1 -- 172.21.15.17:0/1098119418 shutdown_connections 2024-08-19T01:28:50.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:28:50.165+0000 7fb45d721640 1 -- 172.21.15.17:0/1098119418 wait complete. 2024-08-19T01:28:50.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:50 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3577708533' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:28:50.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:50 smithi017 ceph-mon[99370]: from='client.35682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:50.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:50 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1098119418' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:28:50.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:50 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3577708533' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:28:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:50 smithi086 ceph-mon[71303]: from='client.35682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:28:50.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:50 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1098119418' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:28:51.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:51 smithi017 ceph-mon[99370]: pgmap v903: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:51.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:51 smithi086 ceph-mon[71303]: pgmap v903: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:53.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:53 smithi017 ceph-mon[99370]: pgmap v904: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:53.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:53 smithi086 ceph-mon[71303]: pgmap v904: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:55.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:55 smithi017 ceph-mon[99370]: pgmap v905: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:55.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:55 smithi086 ceph-mon[71303]: pgmap v905: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:57.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:57 smithi017 ceph-mon[99370]: pgmap v906: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:57.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:57 smithi086 ceph-mon[71303]: pgmap v906: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:59.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:28:59 smithi086 ceph-mon[71303]: pgmap v907: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:28:59.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:28:59 smithi017 ceph-mon[99370]: pgmap v907: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:01.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:01 smithi086 ceph-mon[71303]: pgmap v908: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:01.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:01 smithi017 ceph-mon[99370]: pgmap v908: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:03.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:03 smithi086 ceph-mon[71303]: pgmap v909: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:03.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:29:03.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:03 smithi017 ceph-mon[99370]: pgmap v909: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:03.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:29:05.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:05 smithi086 ceph-mon[71303]: pgmap v910: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:05.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:05 smithi017 ceph-mon[99370]: pgmap v910: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:07.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:07 smithi017 ceph-mon[99370]: pgmap v911: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:07.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:07 smithi086 ceph-mon[71303]: pgmap v911: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:09.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:09 smithi017 ceph-mon[99370]: pgmap v912: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:09.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:09 smithi086 ceph-mon[71303]: pgmap v912: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:11.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:11 smithi017 ceph-mon[99370]: pgmap v913: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:11.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:11 smithi086 ceph-mon[71303]: pgmap v913: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:13.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:13 smithi017 ceph-mon[99370]: pgmap v914: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:13.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:13 smithi086 ceph-mon[71303]: pgmap v914: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:15.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:15 smithi017 ceph-mon[99370]: pgmap v915: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:15.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:15 smithi086 ceph-mon[71303]: pgmap v915: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:17.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:17 smithi017 ceph-mon[99370]: pgmap v916: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:17.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:17 smithi086 ceph-mon[71303]: pgmap v916: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:18.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:29:18.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:29:19.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:19 smithi017 ceph-mon[99370]: pgmap v917: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:19.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:19 smithi086 ceph-mon[71303]: pgmap v917: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:20.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.260+0000 7f9f72c8b640 1 -- 172.21.15.17:0/55681730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f6c0fe9f0 msgr2=0x7f9f6c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:20.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.260+0000 7f9f72c8b640 1 --2- 172.21.15.17:0/55681730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f6c0fe9f0 0x7f9f6c0fee50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9f60009880 tx=0x7f9f6002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.260+0000 7f9f72c8b640 1 -- 172.21.15.17:0/55681730 shutdown_connections 2024-08-19T01:29:20.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.260+0000 7f9f72c8b640 1 --2- 172.21.15.17:0/55681730 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f6c0fe9f0 0x7f9f6c0fee50 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.260+0000 7f9f72c8b640 1 --2- 172.21.15.17:0/55681730 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f6c1049f0 0x7f9f6c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.260+0000 7f9f72c8b640 1 -- 172.21.15.17:0/55681730 >> 172.21.15.17:0/55681730 conn(0x7f9f6c0758a0 msgr2=0x7f9f6c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:20.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.260+0000 7f9f72c8b640 1 -- 172.21.15.17:0/55681730 shutdown_connections 2024-08-19T01:29:20.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.260+0000 7f9f72c8b640 1 -- 172.21.15.17:0/55681730 wait complete. 2024-08-19T01:29:20.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.261+0000 7f9f72c8b640 1 Processor -- start 2024-08-19T01:29:20.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.261+0000 7f9f72c8b640 1 -- start start 2024-08-19T01:29:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.261+0000 7f9f72c8b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f6c0fe9f0 0x7f9f6c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.261+0000 7f9f72c8b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f6c1049f0 0x7f9f6c19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.261+0000 7f9f72c8b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c195900 con 0x7f9f6c1049f0 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.261+0000 7f9f72c8b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6c195a40 con 0x7f9f6c0fe9f0 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.261+0000 7f9f6bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f6c1049f0 0x7f9f6c19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.261+0000 7f9f6bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f6c1049f0 0x7f9f6c19bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50328/0 (socket says 172.21.15.17:50328) 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.261+0000 7f9f6bfff640 1 -- 172.21.15.17:0/2767454295 learned_addr learned my addr 172.21.15.17:0/2767454295 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.261+0000 7f9f70a27640 1 --2- 172.21.15.17:0/2767454295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f6c0fe9f0 0x7f9f6c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.262+0000 7f9f6bfff640 1 -- 172.21.15.17:0/2767454295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f6c0fe9f0 msgr2=0x7f9f6c19b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.262+0000 7f9f6bfff640 1 --2- 172.21.15.17:0/2767454295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f6c0fe9f0 0x7f9f6c19b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.262+0000 7f9f6bfff640 1 -- 172.21.15.17:0/2767454295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60009560 con 0x7f9f6c1049f0 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.262+0000 7f9f6bfff640 1 --2- 172.21.15.17:0/2767454295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f6c1049f0 0x7f9f6c19bde0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9f6002a9c0 tx=0x7f9f600055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.262+0000 7f9f69ffb640 1 -- 172.21.15.17:0/2767454295 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f60004aa0 con 0x7f9f6c1049f0 2024-08-19T01:29:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.262+0000 7f9f69ffb640 1 -- 172.21.15.17:0/2767454295 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f60004c00 con 0x7f9f6c1049f0 2024-08-19T01:29:20.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.262+0000 7f9f72c8b640 1 -- 172.21.15.17:0/2767454295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6c195cc0 con 0x7f9f6c1049f0 2024-08-19T01:29:20.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.262+0000 7f9f69ffb640 1 -- 172.21.15.17:0/2767454295 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f60003980 con 0x7f9f6c1049f0 2024-08-19T01:29:20.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.262+0000 7f9f72c8b640 1 -- 172.21.15.17:0/2767454295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6c1961b0 con 0x7f9f6c1049f0 2024-08-19T01:29:20.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.263+0000 7f9f72c8b640 1 -- 172.21.15.17:0/2767454295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6c100130 con 0x7f9f6c1049f0 2024-08-19T01:29:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.264+0000 7f9f69ffb640 1 -- 172.21.15.17:0/2767454295 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9f60003bf0 con 0x7f9f6c1049f0 2024-08-19T01:29:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.264+0000 7f9f69ffb640 1 --2- 172.21.15.17:0/2767454295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f5406e170 0x7f9f54070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.265+0000 7f9f69ffb640 1 -- 172.21.15.17:0/2767454295 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9f600af160 con 0x7f9f6c1049f0 2024-08-19T01:29:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.265+0000 7f9f70a27640 1 --2- 172.21.15.17:0/2767454295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f5406e170 0x7f9f54070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.265+0000 7f9f70a27640 1 --2- 172.21.15.17:0/2767454295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f5406e170 0x7f9f54070630 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c005fd0 tx=0x7f9f5c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:20.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.269+0000 7f9f69ffb640 1 -- 172.21.15.17:0/2767454295 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9f600784f0 con 0x7f9f6c1049f0 2024-08-19T01:29:20.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.465+0000 7f9f72c8b640 1 -- 172.21.15.17:0/2767454295 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f6c10bc80 con 0x7f9f5406e170 2024-08-19T01:29:20.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.466+0000 7f9f69ffb640 1 -- 172.21.15.17:0/2767454295 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f9f6c10bc80 con 0x7f9f5406e170 2024-08-19T01:29:20.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.468+0000 7f9f72c8b640 1 -- 172.21.15.17:0/2767454295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f5406e170 msgr2=0x7f9f54070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:20.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.468+0000 7f9f72c8b640 1 --2- 172.21.15.17:0/2767454295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f5406e170 0x7f9f54070630 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c005fd0 tx=0x7f9f5c00b390 comp rx=0 tx=0).stop 2024-08-19T01:29:20.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.468+0000 7f9f72c8b640 1 -- 172.21.15.17:0/2767454295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f6c1049f0 msgr2=0x7f9f6c19bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:20.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.468+0000 7f9f72c8b640 1 --2- 172.21.15.17:0/2767454295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f6c1049f0 0x7f9f6c19bde0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9f6002a9c0 tx=0x7f9f600055a0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.468+0000 7f9f72c8b640 1 -- 172.21.15.17:0/2767454295 shutdown_connections 2024-08-19T01:29:20.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.468+0000 7f9f72c8b640 1 --2- 172.21.15.17:0/2767454295 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f5406e170 0x7f9f54070630 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.468+0000 7f9f72c8b640 1 --2- 172.21.15.17:0/2767454295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f6c1049f0 0x7f9f6c19bde0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.468+0000 7f9f72c8b640 1 --2- 172.21.15.17:0/2767454295 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f6c0fe9f0 0x7f9f6c19b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.468+0000 7f9f72c8b640 1 -- 172.21.15.17:0/2767454295 >> 172.21.15.17:0/2767454295 conn(0x7f9f6c0758a0 msgr2=0x7f9f6c0fd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:20.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.468+0000 7f9f72c8b640 1 -- 172.21.15.17:0/2767454295 shutdown_connections 2024-08-19T01:29:20.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.468+0000 7f9f72c8b640 1 -- 172.21.15.17:0/2767454295 wait complete. 2024-08-19T01:29:20.479 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:29:20.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.552+0000 7f45bc240640 1 -- 172.21.15.17:0/3606303466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45b4104a30 msgr2=0x7f45b4104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:20.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.552+0000 7f45bc240640 1 --2- 172.21.15.17:0/3606303466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45b4104a30 0x7f45b4104e10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009880 tx=0x7f45b002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.552+0000 7f45bc240640 1 -- 172.21.15.17:0/3606303466 shutdown_connections 2024-08-19T01:29:20.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.552+0000 7f45bc240640 1 --2- 172.21.15.17:0/3606303466 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45b40fea30 0x7f45b40fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.552+0000 7f45bc240640 1 --2- 172.21.15.17:0/3606303466 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45b4104a30 0x7f45b4104e10 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.552+0000 7f45bc240640 1 -- 172.21.15.17:0/3606303466 >> 172.21.15.17:0/3606303466 conn(0x7f45b40fa730 msgr2=0x7f45b40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.552+0000 7f45bc240640 1 -- 172.21.15.17:0/3606303466 shutdown_connections 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.552+0000 7f45bc240640 1 -- 172.21.15.17:0/3606303466 wait complete. 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45bc240640 1 Processor -- start 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45bc240640 1 -- start start 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45bc240640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45b40fea30 0x7f45b419b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45bc240640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45b4104a30 0x7f45b419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45bc240640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b419c3b0 con 0x7f45b4104a30 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45bc240640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b4195940 con 0x7f45b40fea30 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45b97db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45b4104a30 0x7f45b419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45b97db640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45b4104a30 0x7f45b419bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50342/0 (socket says 172.21.15.17:50342) 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45b97db640 1 -- 172.21.15.17:0/676784801 learned_addr learned my addr 172.21.15.17:0/676784801 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:20.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45b9fdc640 1 --2- 172.21.15.17:0/676784801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45b40fea30 0x7f45b419b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45b97db640 1 -- 172.21.15.17:0/676784801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45b40fea30 msgr2=0x7f45b419b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.553+0000 7f45b97db640 1 --2- 172.21.15.17:0/676784801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45b40fea30 0x7f45b419b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.554+0000 7f45b97db640 1 -- 172.21.15.17:0/676784801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b0009560 con 0x7f45b4104a30 2024-08-19T01:29:20.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.554+0000 7f45b97db640 1 --2- 172.21.15.17:0/676784801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45b4104a30 0x7f45b419bd90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f45a400e970 tx=0x7f45a400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.554+0000 7f45aaffd640 1 -- 172.21.15.17:0/676784801 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45a400cc90 con 0x7f45b4104a30 2024-08-19T01:29:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.554+0000 7f45aaffd640 1 -- 172.21.15.17:0/676784801 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45a400cdf0 con 0x7f45b4104a30 2024-08-19T01:29:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.554+0000 7f45bc240640 1 -- 172.21.15.17:0/676784801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b4195c20 con 0x7f45b4104a30 2024-08-19T01:29:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.554+0000 7f45aaffd640 1 -- 172.21.15.17:0/676784801 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45a4010430 con 0x7f45b4104a30 2024-08-19T01:29:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.554+0000 7f45bc240640 1 -- 172.21.15.17:0/676784801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b4196170 con 0x7f45b4104a30 2024-08-19T01:29:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.555+0000 7f45bc240640 1 -- 172.21.15.17:0/676784801 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b4100170 con 0x7f45b4104a30 2024-08-19T01:29:20.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.555+0000 7f45aaffd640 1 -- 172.21.15.17:0/676784801 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f45a40046c0 con 0x7f45b4104a30 2024-08-19T01:29:20.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.556+0000 7f45aaffd640 1 --2- 172.21.15.17:0/676784801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f45a006e170 0x7f45a0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:20.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.556+0000 7f45aaffd640 1 -- 172.21.15.17:0/676784801 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f45a4014070 con 0x7f45b4104a30 2024-08-19T01:29:20.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.556+0000 7f45b9fdc640 1 --2- 172.21.15.17:0/676784801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f45a006e170 0x7f45a0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:20.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.557+0000 7f45b9fdc640 1 --2- 172.21.15.17:0/676784801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f45a006e170 0x7f45a0070630 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009230 tx=0x7f45b00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:20.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.564+0000 7f45aaffd640 1 -- 172.21.15.17:0/676784801 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f45a40579d0 con 0x7f45b4104a30 2024-08-19T01:29:20.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.759+0000 7f45bc240640 1 -- 172.21.15.17:0/676784801 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45b410bcc0 con 0x7f45a006e170 2024-08-19T01:29:20.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.760+0000 7f45aaffd640 1 -- 172.21.15.17:0/676784801 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f45b410bcc0 con 0x7f45a006e170 2024-08-19T01:29:20.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.762+0000 7f45bc240640 1 -- 172.21.15.17:0/676784801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f45a006e170 msgr2=0x7f45a0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:20.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.762+0000 7f45bc240640 1 --2- 172.21.15.17:0/676784801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f45a006e170 0x7f45a0070630 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009230 tx=0x7f45b00058d0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.762+0000 7f45bc240640 1 -- 172.21.15.17:0/676784801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45b4104a30 msgr2=0x7f45b419bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:20.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.762+0000 7f45bc240640 1 --2- 172.21.15.17:0/676784801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45b4104a30 0x7f45b419bd90 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f45a400e970 tx=0x7f45a400ed70 comp rx=0 tx=0).stop 2024-08-19T01:29:20.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.762+0000 7f45bc240640 1 -- 172.21.15.17:0/676784801 shutdown_connections 2024-08-19T01:29:20.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.762+0000 7f45bc240640 1 --2- 172.21.15.17:0/676784801 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f45a006e170 0x7f45a0070630 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.762+0000 7f45bc240640 1 --2- 172.21.15.17:0/676784801 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f45b4104a30 0x7f45b419bd90 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.762+0000 7f45bc240640 1 --2- 172.21.15.17:0/676784801 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f45b40fea30 0x7f45b419b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.762+0000 7f45bc240640 1 -- 172.21.15.17:0/676784801 >> 172.21.15.17:0/676784801 conn(0x7f45b40fa730 msgr2=0x7f45b4068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:20.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.762+0000 7f45bc240640 1 -- 172.21.15.17:0/676784801 shutdown_connections 2024-08-19T01:29:20.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.762+0000 7f45bc240640 1 -- 172.21.15.17:0/676784801 wait complete. 2024-08-19T01:29:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.845+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/3377957486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb28073200 msgr2=0x7fcb2810be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.845+0000 7fcb2d7c8640 1 --2- 172.21.15.17:0/3377957486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb28073200 0x7fcb2810be40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009880 tx=0x7fcb1002a530 comp rx=0 tx=0).stop 2024-08-19T01:29:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.845+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/3377957486 shutdown_connections 2024-08-19T01:29:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.845+0000 7fcb2d7c8640 1 --2- 172.21.15.17:0/3377957486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb28073200 0x7fcb2810be40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.845+0000 7fcb2d7c8640 1 --2- 172.21.15.17:0/3377957486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb280728e0 0x7fcb28072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.845+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/3377957486 >> 172.21.15.17:0/3377957486 conn(0x7fcb280fb840 msgr2=0x7fcb280fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.845+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/3377957486 shutdown_connections 2024-08-19T01:29:20.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.845+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/3377957486 wait complete. 2024-08-19T01:29:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.846+0000 7fcb2d7c8640 1 Processor -- start 2024-08-19T01:29:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.846+0000 7fcb2d7c8640 1 -- start start 2024-08-19T01:29:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.846+0000 7fcb2d7c8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb280728e0 0x7fcb2819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.846+0000 7fcb2d7c8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb28073200 0x7fcb2819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.846+0000 7fcb2d7c8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2819e5c0 con 0x7fcb280728e0 2024-08-19T01:29:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.846+0000 7fcb2d7c8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb28197b50 con 0x7fcb28073200 2024-08-19T01:29:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.846+0000 7fcb26ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb280728e0 0x7fcb2819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.846+0000 7fcb26ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb280728e0 0x7fcb2819da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50372/0 (socket says 172.21.15.17:50372) 2024-08-19T01:29:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.846+0000 7fcb26ffd640 1 -- 172.21.15.17:0/1676985746 learned_addr learned my addr 172.21.15.17:0/1676985746 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.846+0000 7fcb267fc640 1 --2- 172.21.15.17:0/1676985746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb28073200 0x7fcb2819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:20.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.847+0000 7fcb26ffd640 1 -- 172.21.15.17:0/1676985746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb28073200 msgr2=0x7fcb2819dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.847+0000 7fcb26ffd640 1 --2- 172.21.15.17:0/1676985746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb28073200 0x7fcb2819dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.847+0000 7fcb26ffd640 1 -- 172.21.15.17:0/1676985746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10009560 con 0x7fcb280728e0 2024-08-19T01:29:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.847+0000 7fcb26ffd640 1 --2- 172.21.15.17:0/1676985746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb280728e0 0x7fcb2819da60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800e970 tx=0x7fcb1800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:20.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.847+0000 7fcb1ffff640 1 -- 172.21.15.17:0/1676985746 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb1800cc90 con 0x7fcb280728e0 2024-08-19T01:29:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.847+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/1676985746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb28197e30 con 0x7fcb280728e0 2024-08-19T01:29:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.847+0000 7fcb1ffff640 1 -- 172.21.15.17:0/1676985746 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb1800cdf0 con 0x7fcb280728e0 2024-08-19T01:29:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.847+0000 7fcb1ffff640 1 -- 172.21.15.17:0/1676985746 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb18018810 con 0x7fcb280728e0 2024-08-19T01:29:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.847+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/1676985746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb28198350 con 0x7fcb280728e0 2024-08-19T01:29:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.848+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/1676985746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb28073f90 con 0x7fcb280728e0 2024-08-19T01:29:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.849+0000 7fcb1ffff640 1 -- 172.21.15.17:0/1676985746 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcb18018a50 con 0x7fcb280728e0 2024-08-19T01:29:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.849+0000 7fcb1ffff640 1 --2- 172.21.15.17:0/1676985746 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb1406e170 0x7fcb14070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.849+0000 7fcb1ffff640 1 -- 172.21.15.17:0/1676985746 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fcb18014070 con 0x7fcb280728e0 2024-08-19T01:29:20.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.849+0000 7fcb267fc640 1 --2- 172.21.15.17:0/1676985746 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb1406e170 0x7fcb14070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:20.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.850+0000 7fcb267fc640 1 --2- 172.21.15.17:0/1676985746 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb1406e170 0x7fcb14070630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009230 tx=0x7fcb100058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:20.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:20.854+0000 7fcb1ffff640 1 -- 172.21.15.17:0/1676985746 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fcb18053df0 con 0x7fcb280728e0 2024-08-19T01:29:21.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.038+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/1676985746 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb28199060 con 0x7fcb1406e170 2024-08-19T01:29:21.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.048+0000 7fcb1ffff640 1 -- 172.21.15.17:0/1676985746 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fcb28199060 con 0x7fcb1406e170 2024-08-19T01:29:21.050 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:29:21.050 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (30m) 9m ago 41m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:29:21.050 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (41m) 9m ago 41m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:29:21.050 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (40m) 9m ago 40m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:29:21.050 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (28m) 9m ago 41m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:29:21.050 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (28m) 9m ago 40m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:29:21.050 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (30m) 9m ago 41m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:29:21.050 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (24m) 9m ago 35m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:29:21.050 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (24m) 9m ago 35m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (9m) 9m ago 35m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (24m) 9m ago 35m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (32m) 9m ago 42m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (31m) 9m ago 40m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (29m) 9m ago 42m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (29m) 9m ago 40m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (31m) 9m ago 41m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (31m) 9m ago 40m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (28m) 9m ago 39m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (27m) 9m ago 39m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (26m) 9m ago 38m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (26m) 9m ago 38m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:29:21.051 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (25m) 9m ago 37m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:29:21.052 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (25m) 9m ago 37m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:29:21.052 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (30m) 9m ago 40m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:29:21.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.050+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/1676985746 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb1406e170 msgr2=0x7fcb14070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.050+0000 7fcb2d7c8640 1 --2- 172.21.15.17:0/1676985746 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb1406e170 0x7fcb14070630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009230 tx=0x7fcb100058d0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.050+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/1676985746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb280728e0 msgr2=0x7fcb2819da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.050+0000 7fcb2d7c8640 1 --2- 172.21.15.17:0/1676985746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb280728e0 0x7fcb2819da60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800e970 tx=0x7fcb1800ee30 comp rx=0 tx=0).stop 2024-08-19T01:29:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.050+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/1676985746 shutdown_connections 2024-08-19T01:29:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.050+0000 7fcb2d7c8640 1 --2- 172.21.15.17:0/1676985746 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcb1406e170 0x7fcb14070630 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.050+0000 7fcb2d7c8640 1 --2- 172.21.15.17:0/1676985746 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcb28073200 0x7fcb2819dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.050+0000 7fcb2d7c8640 1 --2- 172.21.15.17:0/1676985746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb280728e0 0x7fcb2819da60 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.050+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/1676985746 >> 172.21.15.17:0/1676985746 conn(0x7fcb280fb840 msgr2=0x7fcb281042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.050+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/1676985746 shutdown_connections 2024-08-19T01:29:21.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.050+0000 7fcb2d7c8640 1 -- 172.21.15.17:0/1676985746 wait complete. 2024-08-19T01:29:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.131+0000 7f0544a20640 1 -- 172.21.15.17:0/2383758741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0540101670 msgr2=0x7f0540109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.131+0000 7f0544a20640 1 --2- 172.21.15.17:0/2383758741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0540101670 0x7f0540109b60 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0528009880 tx=0x7f052802a530 comp rx=0 tx=0).stop 2024-08-19T01:29:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.132+0000 7f0544a20640 1 -- 172.21.15.17:0/2383758741 shutdown_connections 2024-08-19T01:29:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.132+0000 7f0544a20640 1 --2- 172.21.15.17:0/2383758741 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0540101670 0x7f0540109b60 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.132+0000 7f0544a20640 1 --2- 172.21.15.17:0/2383758741 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0540100d50 0x7f0540101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.132+0000 7f0544a20640 1 -- 172.21.15.17:0/2383758741 >> 172.21.15.17:0/2383758741 conn(0x7f05400758a0 msgr2=0x7f05400fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.132+0000 7f0544a20640 1 -- 172.21.15.17:0/2383758741 shutdown_connections 2024-08-19T01:29:21.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.132+0000 7f0544a20640 1 -- 172.21.15.17:0/2383758741 wait complete. 2024-08-19T01:29:21.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f0544a20640 1 Processor -- start 2024-08-19T01:29:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f0544a20640 1 -- start start 2024-08-19T01:29:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f0544a20640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0540100d50 0x7f054019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f0544a20640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0540101670 0x7f054019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f0544a20640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054019c3b0 con 0x7f0540101670 2024-08-19T01:29:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f0544a20640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540195940 con 0x7f0540100d50 2024-08-19T01:29:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f053dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0540101670 0x7f054019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f053dd9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0540101670 0x7f054019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50388/0 (socket says 172.21.15.17:50388) 2024-08-19T01:29:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f053dd9b640 1 -- 172.21.15.17:0/1076702971 learned_addr learned my addr 172.21.15.17:0/1076702971 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f053e59c640 1 --2- 172.21.15.17:0/1076702971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0540100d50 0x7f054019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:21.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f053dd9b640 1 -- 172.21.15.17:0/1076702971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0540100d50 msgr2=0x7f054019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.133+0000 7f053dd9b640 1 --2- 172.21.15.17:0/1076702971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0540100d50 0x7f054019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.134+0000 7f053dd9b640 1 -- 172.21.15.17:0/1076702971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0528009560 con 0x7f0540101670 2024-08-19T01:29:21.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.134+0000 7f053dd9b640 1 --2- 172.21.15.17:0/1076702971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0540101670 0x7f054019bd90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0528005940 tx=0x7f0528032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:21.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.134+0000 7f05377fe640 1 -- 172.21.15.17:0/1076702971 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0528005220 con 0x7f0540101670 2024-08-19T01:29:21.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.134+0000 7f05377fe640 1 -- 172.21.15.17:0/1076702971 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0528005380 con 0x7f0540101670 2024-08-19T01:29:21.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.134+0000 7f05377fe640 1 -- 172.21.15.17:0/1076702971 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0528003a50 con 0x7f0540101670 2024-08-19T01:29:21.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.134+0000 7f0544a20640 1 -- 172.21.15.17:0/1076702971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0540195bc0 con 0x7f0540101670 2024-08-19T01:29:21.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.134+0000 7f0544a20640 1 -- 172.21.15.17:0/1076702971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0540196060 con 0x7f0540101670 2024-08-19T01:29:21.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.135+0000 7f0544a20640 1 -- 172.21.15.17:0/1076702971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0540068470 con 0x7f0540101670 2024-08-19T01:29:21.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.136+0000 7f05377fe640 1 -- 172.21.15.17:0/1076702971 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f052802ad50 con 0x7f0540101670 2024-08-19T01:29:21.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.136+0000 7f05377fe640 1 --2- 172.21.15.17:0/1076702971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 0x7f052c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:21.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.137+0000 7f05377fe640 1 -- 172.21.15.17:0/1076702971 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f05280aeb90 con 0x7f0540101670 2024-08-19T01:29:21.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.137+0000 7f053e59c640 1 --2- 172.21.15.17:0/1076702971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 0x7f052c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:21.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.137+0000 7f053e59c640 1 --2- 172.21.15.17:0/1076702971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 0x7f052c070630 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0530005c40 tx=0x7f053000a590 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:21.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.141+0000 7f05377fe640 1 -- 172.21.15.17:0/1076702971 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0528077f20 con 0x7f0540101670 2024-08-19T01:29:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.389+0000 7f0544a20640 1 -- 172.21.15.17:0/1076702971 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0540104430 con 0x7f0540101670 2024-08-19T01:29:21.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.390+0000 7f05377fe640 1 -- 172.21.15.17:0/1076702971 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f05280ae280 con 0x7f0540101670 2024-08-19T01:29:21.392 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:29:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:29:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:29:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:29:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:29:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:29:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:29:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:29:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:29:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:29:21.392 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:29:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:29:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:29:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:29:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:29:21.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:29:21.393 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:29:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.392+0000 7f0544a20640 1 -- 172.21.15.17:0/1076702971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 msgr2=0x7f052c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.392+0000 7f0544a20640 1 --2- 172.21.15.17:0/1076702971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 0x7f052c070630 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0530005c40 tx=0x7f053000a590 comp rx=0 tx=0).stop 2024-08-19T01:29:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.392+0000 7f0544a20640 1 -- 172.21.15.17:0/1076702971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0540101670 msgr2=0x7f054019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.392+0000 7f0544a20640 1 --2- 172.21.15.17:0/1076702971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0540101670 0x7f054019bd90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0528005940 tx=0x7f0528032bd0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.392+0000 7f0544a20640 1 -- 172.21.15.17:0/1076702971 shutdown_connections 2024-08-19T01:29:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.392+0000 7f0544a20640 1 --2- 172.21.15.17:0/1076702971 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f052c06e170 0x7f052c070630 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.392+0000 7f0544a20640 1 --2- 172.21.15.17:0/1076702971 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0540101670 0x7f054019bd90 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.392+0000 7f0544a20640 1 --2- 172.21.15.17:0/1076702971 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0540100d50 0x7f054019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.392+0000 7f0544a20640 1 -- 172.21.15.17:0/1076702971 >> 172.21.15.17:0/1076702971 conn(0x7f05400758a0 msgr2=0x7f0540101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.392+0000 7f0544a20640 1 -- 172.21.15.17:0/1076702971 shutdown_connections 2024-08-19T01:29:21.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.392+0000 7f0544a20640 1 -- 172.21.15.17:0/1076702971 wait complete. 2024-08-19T01:29:21.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.474+0000 7f5622686640 1 -- 172.21.15.17:0/1380957872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f561c105bf0 msgr2=0x7f561c105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.474+0000 7f5622686640 1 --2- 172.21.15.17:0/1380957872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f561c105bf0 0x7f561c105fd0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f560c009880 tx=0x7f560c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.474+0000 7f5622686640 1 -- 172.21.15.17:0/1380957872 shutdown_connections 2024-08-19T01:29:21.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.474+0000 7f5622686640 1 --2- 172.21.15.17:0/1380957872 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561c0ffb40 0x7f561c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.474+0000 7f5622686640 1 --2- 172.21.15.17:0/1380957872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f561c105bf0 0x7f561c105fd0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.474+0000 7f5622686640 1 -- 172.21.15.17:0/1380957872 >> 172.21.15.17:0/1380957872 conn(0x7f561c0fb7e0 msgr2=0x7f561c0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:21.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.474+0000 7f5622686640 1 -- 172.21.15.17:0/1380957872 shutdown_connections 2024-08-19T01:29:21.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.474+0000 7f5622686640 1 -- 172.21.15.17:0/1380957872 wait complete. 2024-08-19T01:29:21.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.475+0000 7f5622686640 1 Processor -- start 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.475+0000 7f5622686640 1 -- start start 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.475+0000 7f5622686640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561c0ffb40 0x7f561c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.475+0000 7f5622686640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f561c105bf0 0x7f561c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.475+0000 7f5622686640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c073230 con 0x7f561c105bf0 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.475+0000 7f5622686640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c0733a0 con 0x7f561c0ffb40 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.475+0000 7f561b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f561c105bf0 0x7f561c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.475+0000 7f561b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f561c105bf0 0x7f561c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50418/0 (socket says 172.21.15.17:50418) 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.475+0000 7f561b7fe640 1 -- 172.21.15.17:0/1070883343 learned_addr learned my addr 172.21.15.17:0/1070883343 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.475+0000 7f561bfff640 1 --2- 172.21.15.17:0/1070883343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561c0ffb40 0x7f561c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.476+0000 7f561b7fe640 1 -- 172.21.15.17:0/1070883343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561c0ffb40 msgr2=0x7f561c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.476+0000 7f561b7fe640 1 --2- 172.21.15.17:0/1070883343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561c0ffb40 0x7f561c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.476+0000 7f561b7fe640 1 -- 172.21.15.17:0/1070883343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c009560 con 0x7f561c105bf0 2024-08-19T01:29:21.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.476+0000 7f561b7fe640 1 --2- 172.21.15.17:0/1070883343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f561c105bf0 0x7f561c072cf0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f561000d8d0 tx=0x7f561000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:21.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.476+0000 7f56197fa640 1 -- 172.21.15.17:0/1070883343 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5610009c00 con 0x7f561c105bf0 2024-08-19T01:29:21.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.476+0000 7f56197fa640 1 -- 172.21.15.17:0/1070883343 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5610009d60 con 0x7f561c105bf0 2024-08-19T01:29:21.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.476+0000 7f5622686640 1 -- 172.21.15.17:0/1070883343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561c1a1c50 con 0x7f561c105bf0 2024-08-19T01:29:21.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.476+0000 7f56197fa640 1 -- 172.21.15.17:0/1070883343 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56100049d0 con 0x7f561c105bf0 2024-08-19T01:29:21.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.476+0000 7f5622686640 1 -- 172.21.15.17:0/1070883343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561c1a1fb0 con 0x7f561c105bf0 2024-08-19T01:29:21.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.477+0000 7f5622686640 1 -- 172.21.15.17:0/1070883343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561c1011f0 con 0x7f561c105bf0 2024-08-19T01:29:21.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.477+0000 7f56197fa640 1 -- 172.21.15.17:0/1070883343 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5610004c90 con 0x7f561c105bf0 2024-08-19T01:29:21.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.478+0000 7f56197fa640 1 --2- 172.21.15.17:0/1070883343 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560406e170 0x7f5604070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:21.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.478+0000 7f56197fa640 1 -- 172.21.15.17:0/1070883343 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f561008de90 con 0x7f561c105bf0 2024-08-19T01:29:21.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.478+0000 7f561bfff640 1 --2- 172.21.15.17:0/1070883343 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560406e170 0x7f5604070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:21.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.478+0000 7f561bfff640 1 --2- 172.21.15.17:0/1070883343 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560406e170 0x7f5604070630 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f560c009230 tx=0x7f560c0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:21.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.482+0000 7f56197fa640 1 -- 172.21.15.17:0/1070883343 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5610057170 con 0x7f561c105bf0 2024-08-19T01:29:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:21 smithi017 ceph-mon[99370]: pgmap v918: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:21 smithi017 ceph-mon[99370]: from='client.35690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:21 smithi017 ceph-mon[99370]: from='client.35694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:21 smithi017 ceph-mon[99370]: from='client.35698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:21 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1076702971' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:29:21.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.694+0000 7f5622686640 1 -- 172.21.15.17:0/1070883343 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f561c1080b0 con 0x7f561c105bf0 2024-08-19T01:29:21.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.694+0000 7f56197fa640 1 -- 172.21.15.17:0/1070883343 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f561005a830 con 0x7f561c105bf0 2024-08-19T01:29:21.696 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:29:21.696 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:29:21.696 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:29:21.696 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:29:21.696 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:29:21.697 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:29:21.698 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:29:21.698 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:29:21.698 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:29:21.698 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:29:21.698 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:29:21.698 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:29:21.699 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:29:21.700 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:29:21.700 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:29:21.700 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:29:21.700 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:29:21.700 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:29:21.700 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:29:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:29:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.696+0000 7f5622686640 1 -- 172.21.15.17:0/1070883343 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560406e170 msgr2=0x7f5604070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.696+0000 7f5622686640 1 --2- 172.21.15.17:0/1070883343 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560406e170 0x7f5604070630 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f560c009230 tx=0x7f560c0058d0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.696+0000 7f5622686640 1 -- 172.21.15.17:0/1070883343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f561c105bf0 msgr2=0x7f561c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.696+0000 7f5622686640 1 --2- 172.21.15.17:0/1070883343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f561c105bf0 0x7f561c072cf0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f561000d8d0 tx=0x7f561000dd90 comp rx=0 tx=0).stop 2024-08-19T01:29:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.696+0000 7f5622686640 1 -- 172.21.15.17:0/1070883343 shutdown_connections 2024-08-19T01:29:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.696+0000 7f5622686640 1 --2- 172.21.15.17:0/1070883343 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560406e170 0x7f5604070630 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.696+0000 7f5622686640 1 --2- 172.21.15.17:0/1070883343 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f561c105bf0 0x7f561c072cf0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.696+0000 7f5622686640 1 --2- 172.21.15.17:0/1070883343 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f561c0ffb40 0x7f561c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.696+0000 7f5622686640 1 -- 172.21.15.17:0/1070883343 >> 172.21.15.17:0/1070883343 conn(0x7f561c0fb7e0 msgr2=0x7f561c0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:21.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.697+0000 7f5622686640 1 -- 172.21.15.17:0/1070883343 shutdown_connections 2024-08-19T01:29:21.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.697+0000 7f5622686640 1 -- 172.21.15.17:0/1070883343 wait complete. 2024-08-19T01:29:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.779+0000 7f36584de640 1 -- 172.21.15.17:0/3770351166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36500fea30 msgr2=0x7f36500fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.779+0000 7f36584de640 1 --2- 172.21.15.17:0/3770351166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36500fea30 0x7f36500fee90 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3640009880 tx=0x7f364002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.779+0000 7f36584de640 1 -- 172.21.15.17:0/3770351166 shutdown_connections 2024-08-19T01:29:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.779+0000 7f36584de640 1 --2- 172.21.15.17:0/3770351166 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f36500fea30 0x7f36500fee90 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.779+0000 7f36584de640 1 --2- 172.21.15.17:0/3770351166 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3650104a30 0x7f3650104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.779+0000 7f36584de640 1 -- 172.21.15.17:0/3770351166 >> 172.21.15.17:0/3770351166 conn(0x7f36500fa730 msgr2=0x7f36500fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.779+0000 7f36584de640 1 -- 172.21.15.17:0/3770351166 shutdown_connections 2024-08-19T01:29:21.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.779+0000 7f36584de640 1 -- 172.21.15.17:0/3770351166 wait complete. 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f36584de640 1 Processor -- start 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f36584de640 1 -- start start 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f36584de640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36500fea30 0x7f3650197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f36584de640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3650104a30 0x7f36501982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f36584de640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3650198940 con 0x7f3650104a30 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f36584de640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f365019c6b0 con 0x7f36500fea30 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f3655a79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3650104a30 0x7f36501982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f3655a79640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3650104a30 0x7f36501982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50432/0 (socket says 172.21.15.17:50432) 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f3655a79640 1 -- 172.21.15.17:0/2545346508 learned_addr learned my addr 172.21.15.17:0/2545346508 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f365627a640 1 --2- 172.21.15.17:0/2545346508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36500fea30 0x7f3650197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f3655a79640 1 -- 172.21.15.17:0/2545346508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36500fea30 msgr2=0x7f3650197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f3655a79640 1 --2- 172.21.15.17:0/2545346508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36500fea30 0x7f3650197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.780+0000 7f3655a79640 1 -- 172.21.15.17:0/2545346508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009560 con 0x7f3650104a30 2024-08-19T01:29:21.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.781+0000 7f3655a79640 1 --2- 172.21.15.17:0/2545346508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3650104a30 0x7f36501982b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f364002a9c0 tx=0x7f36400055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:21.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.781+0000 7f36477fe640 1 -- 172.21.15.17:0/2545346508 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3640004aa0 con 0x7f3650104a30 2024-08-19T01:29:21.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.781+0000 7f36477fe640 1 -- 172.21.15.17:0/2545346508 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3640004c00 con 0x7f3650104a30 2024-08-19T01:29:21.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.781+0000 7f36584de640 1 -- 172.21.15.17:0/2545346508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365019c930 con 0x7f3650104a30 2024-08-19T01:29:21.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.781+0000 7f36477fe640 1 -- 172.21.15.17:0/2545346508 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3640003980 con 0x7f3650104a30 2024-08-19T01:29:21.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.781+0000 7f36584de640 1 -- 172.21.15.17:0/2545346508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365019ce20 con 0x7f3650104a30 2024-08-19T01:29:21.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.782+0000 7f36584de640 1 -- 172.21.15.17:0/2545346508 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3650100170 con 0x7f3650104a30 2024-08-19T01:29:21.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.782+0000 7f36477fe640 1 -- 172.21.15.17:0/2545346508 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3640003b00 con 0x7f3650104a30 2024-08-19T01:29:21.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.783+0000 7f36477fe640 1 --2- 172.21.15.17:0/2545346508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f363c06e170 0x7f363c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:21.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.783+0000 7f36477fe640 1 -- 172.21.15.17:0/2545346508 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f36400af0b0 con 0x7f3650104a30 2024-08-19T01:29:21.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.783+0000 7f365627a640 1 --2- 172.21.15.17:0/2545346508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f363c06e170 0x7f363c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:21.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.783+0000 7f365627a640 1 --2- 172.21.15.17:0/2545346508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f363c06e170 0x7f363c070630 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f364c005fd0 tx=0x7f364c00b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:21.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.787+0000 7f36477fe640 1 -- 172.21.15.17:0/2545346508 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f36400784c0 con 0x7f3650104a30 2024-08-19T01:29:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:21 smithi086 ceph-mon[71303]: pgmap v918: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:21 smithi086 ceph-mon[71303]: from='client.35690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:21 smithi086 ceph-mon[71303]: from='client.35694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:21 smithi086 ceph-mon[71303]: from='client.35698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:21.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:21 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1076702971' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:29:21.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.978+0000 7f36584de640 1 -- 172.21.15.17:0/2545346508 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3650199170 con 0x7f363c06e170 2024-08-19T01:29:21.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.979+0000 7f36477fe640 1 -- 172.21.15.17:0/2545346508 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f3650199170 con 0x7f363c06e170 2024-08-19T01:29:21.981 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:29:21.981 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:29:21.981 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:29:21.981 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:29:21.981 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:29:21.981 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:29:21.981 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:29:21.982 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:29:21.982 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:29:21.982 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:29:21.982 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:29:21.982 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:29:21.982 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:29:21.982 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:29:21.982 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:29:21.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.981+0000 7f36584de640 1 -- 172.21.15.17:0/2545346508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f363c06e170 msgr2=0x7f363c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.981+0000 7f36584de640 1 --2- 172.21.15.17:0/2545346508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f363c06e170 0x7f363c070630 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f364c005fd0 tx=0x7f364c00b390 comp rx=0 tx=0).stop 2024-08-19T01:29:21.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.981+0000 7f36584de640 1 -- 172.21.15.17:0/2545346508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3650104a30 msgr2=0x7f36501982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:21.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.981+0000 7f36584de640 1 --2- 172.21.15.17:0/2545346508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3650104a30 0x7f36501982b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f364002a9c0 tx=0x7f36400055a0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.981+0000 7f36584de640 1 -- 172.21.15.17:0/2545346508 shutdown_connections 2024-08-19T01:29:21.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.981+0000 7f36584de640 1 --2- 172.21.15.17:0/2545346508 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f363c06e170 0x7f363c070630 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.981+0000 7f36584de640 1 --2- 172.21.15.17:0/2545346508 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3650104a30 0x7f36501982b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.982+0000 7f36584de640 1 --2- 172.21.15.17:0/2545346508 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f36500fea30 0x7f3650197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:21.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.982+0000 7f36584de640 1 -- 172.21.15.17:0/2545346508 >> 172.21.15.17:0/2545346508 conn(0x7f36500fa730 msgr2=0x7f36500fb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:21.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.982+0000 7f36584de640 1 -- 172.21.15.17:0/2545346508 shutdown_connections 2024-08-19T01:29:21.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:21.982+0000 7f36584de640 1 -- 172.21.15.17:0/2545346508 wait complete. 2024-08-19T01:29:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 -- 172.21.15.17:0/1332815884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fceac100750 msgr2=0x7fceac1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 --2- 172.21.15.17:0/1332815884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fceac100750 0x7fceac1047a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009880 tx=0x7fcea002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:29:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 -- 172.21.15.17:0/1332815884 shutdown_connections 2024-08-19T01:29:22.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 --2- 172.21.15.17:0/1332815884 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fceac100750 0x7fceac1047a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 --2- 172.21.15.17:0/1332815884 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceac0ffda0 0x7fceac100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 -- 172.21.15.17:0/1332815884 >> 172.21.15.17:0/1332815884 conn(0x7fceac0fb840 msgr2=0x7fceac0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 -- 172.21.15.17:0/1332815884 shutdown_connections 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 -- 172.21.15.17:0/1332815884 wait complete. 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 Processor -- start 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 -- start start 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fceac0ffda0 0x7fceac19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.064+0000 7fceb2ec6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceac100750 0x7fceac19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fceb2ec6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac195930 con 0x7fceac0ffda0 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fceb2ec6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac195a70 con 0x7fceac100750 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fceb0c62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fceac0ffda0 0x7fceac19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fceb0c62640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fceac0ffda0 0x7fceac19b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50444/0 (socket says 172.21.15.17:50444) 2024-08-19T01:29:22.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fceb0c62640 1 -- 172.21.15.17:0/2458481137 learned_addr learned my addr 172.21.15.17:0/2458481137 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:22.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fceabfff640 1 --2- 172.21.15.17:0/2458481137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceac100750 0x7fceac19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fceb0c62640 1 -- 172.21.15.17:0/2458481137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceac100750 msgr2=0x7fceac19be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fceb0c62640 1 --2- 172.21.15.17:0/2458481137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceac100750 0x7fceac19be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fceb0c62640 1 -- 172.21.15.17:0/2458481137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea0009560 con 0x7fceac0ffda0 2024-08-19T01:29:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fceb0c62640 1 --2- 172.21.15.17:0/2458481137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fceac0ffda0 0x7fceac19b8d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00d6f0 tx=0x7fce9c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fcea9ffb640 1 -- 172.21.15.17:0/2458481137 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce9c009a30 con 0x7fceac0ffda0 2024-08-19T01:29:22.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fcea9ffb640 1 -- 172.21.15.17:0/2458481137 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fce9c0054e0 con 0x7fceac0ffda0 2024-08-19T01:29:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fceb2ec6640 1 -- 172.21.15.17:0/2458481137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac195d50 con 0x7fceac0ffda0 2024-08-19T01:29:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.065+0000 7fcea9ffb640 1 -- 172.21.15.17:0/2458481137 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce9c010460 con 0x7fceac0ffda0 2024-08-19T01:29:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.066+0000 7fceb2ec6640 1 -- 172.21.15.17:0/2458481137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac196270 con 0x7fceac0ffda0 2024-08-19T01:29:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.067+0000 7fceb2ec6640 1 -- 172.21.15.17:0/2458481137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac101280 con 0x7fceac0ffda0 2024-08-19T01:29:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.067+0000 7fcea9ffb640 1 -- 172.21.15.17:0/2458481137 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fce9c009b90 con 0x7fceac0ffda0 2024-08-19T01:29:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.068+0000 7fcea9ffb640 1 --2- 172.21.15.17:0/2458481137 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fce9406e170 0x7fce94070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.068+0000 7fcea9ffb640 1 -- 172.21.15.17:0/2458481137 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fce9c08dbd0 con 0x7fceac0ffda0 2024-08-19T01:29:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.068+0000 7fceabfff640 1 --2- 172.21.15.17:0/2458481137 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fce9406e170 0x7fce94070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:22.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.068+0000 7fceabfff640 1 --2- 172.21.15.17:0/2458481137 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fce9406e170 0x7fce94070630 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009230 tx=0x7fcea00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:22.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.072+0000 7fcea9ffb640 1 -- 172.21.15.17:0/2458481137 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fce9c056fe0 con 0x7fceac0ffda0 2024-08-19T01:29:22.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.316+0000 7fceb2ec6640 1 -- 172.21.15.17:0/2458481137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fceac1080b0 con 0x7fceac0ffda0 2024-08-19T01:29:22.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.316+0000 7fcea9ffb640 1 -- 172.21.15.17:0/2458481137 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7fce9c020090 con 0x7fceac0ffda0 2024-08-19T01:29:22.318 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:29:22.318 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:29:22.318 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:29:22.318 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:29:22.318 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:29:22.319 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:29:22.320 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:29:22.320 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:29:22.320 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:29:22.320 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:29:22.320 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:29:22.320 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:29:22.320 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:29:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.319+0000 7fceb2ec6640 1 -- 172.21.15.17:0/2458481137 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fce9406e170 msgr2=0x7fce94070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.319+0000 7fceb2ec6640 1 --2- 172.21.15.17:0/2458481137 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fce9406e170 0x7fce94070630 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009230 tx=0x7fcea00058d0 comp rx=0 tx=0).stop 2024-08-19T01:29:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.319+0000 7fceb2ec6640 1 -- 172.21.15.17:0/2458481137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fceac0ffda0 msgr2=0x7fceac19b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.319+0000 7fceb2ec6640 1 --2- 172.21.15.17:0/2458481137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fceac0ffda0 0x7fceac19b8d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00d6f0 tx=0x7fce9c00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:29:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.319+0000 7fceb2ec6640 1 -- 172.21.15.17:0/2458481137 shutdown_connections 2024-08-19T01:29:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.319+0000 7fceb2ec6640 1 --2- 172.21.15.17:0/2458481137 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fce9406e170 0x7fce94070630 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.319+0000 7fceb2ec6640 1 --2- 172.21.15.17:0/2458481137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fceac100750 0x7fceac19be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.319+0000 7fceb2ec6640 1 --2- 172.21.15.17:0/2458481137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fceac0ffda0 0x7fceac19b8d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.319+0000 7fceb2ec6640 1 -- 172.21.15.17:0/2458481137 >> 172.21.15.17:0/2458481137 conn(0x7fceac0fb840 msgr2=0x7fceac0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:22.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.319+0000 7fceb2ec6640 1 -- 172.21.15.17:0/2458481137 shutdown_connections 2024-08-19T01:29:22.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:22.319+0000 7fceb2ec6640 1 -- 172.21.15.17:0/2458481137 wait complete. 2024-08-19T01:29:22.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:22 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1070883343' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:29:22.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:22 smithi017 ceph-mon[99370]: from='client.35710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:22.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:22 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2458481137' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:29:22.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:22 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1070883343' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:29:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:22 smithi086 ceph-mon[71303]: from='client.35710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:22.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:22 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2458481137' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:29:23.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:23 smithi017 ceph-mon[99370]: pgmap v919: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:23.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:23 smithi086 ceph-mon[71303]: pgmap v919: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:25.748 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:25 smithi086 ceph-mon[71303]: pgmap v920: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:25.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:25 smithi017 ceph-mon[99370]: pgmap v920: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:27.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:27 smithi017 ceph-mon[99370]: pgmap v921: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:27.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:27 smithi086 ceph-mon[71303]: pgmap v921: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:29.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:29 smithi017 ceph-mon[99370]: pgmap v922: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:29.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:29 smithi086 ceph-mon[71303]: pgmap v922: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:31.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:31 smithi017 ceph-mon[99370]: pgmap v923: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:31.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:31 smithi086 ceph-mon[71303]: pgmap v923: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:33.895 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:33 smithi086 ceph-mon[71303]: pgmap v924: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:33.895 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:29:33.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:33 smithi017 ceph-mon[99370]: pgmap v924: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:33.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:29:35.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:35 smithi017 ceph-mon[99370]: pgmap v925: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:35.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:35 smithi086 ceph-mon[71303]: pgmap v925: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:37.781 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:37 smithi017 ceph-mon[99370]: pgmap v926: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:37.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:37 smithi086 ceph-mon[71303]: pgmap v926: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:39.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:39 smithi017 ceph-mon[99370]: pgmap v927: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:39.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:39 smithi086 ceph-mon[71303]: pgmap v927: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:41.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:41 smithi017 ceph-mon[99370]: pgmap v928: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:41.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:41 smithi086 ceph-mon[71303]: pgmap v928: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:43.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:43 smithi017 ceph-mon[99370]: pgmap v929: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:43.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:43 smithi086 ceph-mon[71303]: pgmap v929: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:45.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:45 smithi017 ceph-mon[99370]: pgmap v930: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:45.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:45 smithi086 ceph-mon[71303]: pgmap v930: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:47.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:47 smithi017 ceph-mon[99370]: pgmap v931: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:47.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:47 smithi086 ceph-mon[71303]: pgmap v931: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:48.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:29:48.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:29:49.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:49 smithi017 ceph-mon[99370]: pgmap v932: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:49.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:49 smithi086 ceph-mon[71303]: pgmap v932: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:51.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:51 smithi017 ceph-mon[99370]: pgmap v933: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:51.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:51 smithi086 ceph-mon[71303]: pgmap v933: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.414+0000 7f14bc83a640 1 -- 172.21.15.17:0/400779947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14b80ffda0 msgr2=0x7f14b8100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.414+0000 7f14bc83a640 1 --2- 172.21.15.17:0/400779947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14b80ffda0 0x7f14b8100180 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009880 tx=0x7f14a802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.414+0000 7f14bc83a640 1 -- 172.21.15.17:0/400779947 shutdown_connections 2024-08-19T01:29:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.414+0000 7f14bc83a640 1 --2- 172.21.15.17:0/400779947 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14b8100750 0x7f14b81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.414+0000 7f14bc83a640 1 --2- 172.21.15.17:0/400779947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14b80ffda0 0x7f14b8100180 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.414+0000 7f14bc83a640 1 -- 172.21.15.17:0/400779947 >> 172.21.15.17:0/400779947 conn(0x7f14b80fb840 msgr2=0x7f14b80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:52.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.414+0000 7f14bc83a640 1 -- 172.21.15.17:0/400779947 shutdown_connections 2024-08-19T01:29:52.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.414+0000 7f14bc83a640 1 -- 172.21.15.17:0/400779947 wait complete. 2024-08-19T01:29:52.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.415+0000 7f14bc83a640 1 Processor -- start 2024-08-19T01:29:52.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.415+0000 7f14bc83a640 1 -- start start 2024-08-19T01:29:52.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.415+0000 7f14bc83a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14b80ffda0 0x7f14b819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.415+0000 7f14bc83a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14b8100750 0x7f14b819df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.415+0000 7f14bc83a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8197b40 con 0x7f14b8100750 2024-08-19T01:29:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.415+0000 7f14bc83a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8197cb0 con 0x7f14b80ffda0 2024-08-19T01:29:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.415+0000 7f14b5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14b8100750 0x7f14b819df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14b5d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14b8100750 0x7f14b819df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35978/0 (socket says 172.21.15.17:35978) 2024-08-19T01:29:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14b5d9b640 1 -- 172.21.15.17:0/2634185101 learned_addr learned my addr 172.21.15.17:0/2634185101 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14b659c640 1 --2- 172.21.15.17:0/2634185101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14b80ffda0 0x7f14b819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14b5d9b640 1 -- 172.21.15.17:0/2634185101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14b80ffda0 msgr2=0x7f14b819da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14b5d9b640 1 --2- 172.21.15.17:0/2634185101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14b80ffda0 0x7f14b819da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14b5d9b640 1 -- 172.21.15.17:0/2634185101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8009560 con 0x7f14b8100750 2024-08-19T01:29:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14b5d9b640 1 --2- 172.21.15.17:0/2634185101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14b8100750 0x7f14b819df90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00d6f0 tx=0x7f14ac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14a77fe640 1 -- 172.21.15.17:0/2634185101 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14ac009a30 con 0x7f14b8100750 2024-08-19T01:29:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14a77fe640 1 -- 172.21.15.17:0/2634185101 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f14ac0054e0 con 0x7f14b8100750 2024-08-19T01:29:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14bc83a640 1 -- 172.21.15.17:0/2634185101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b8197f90 con 0x7f14b8100750 2024-08-19T01:29:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14a77fe640 1 -- 172.21.15.17:0/2634185101 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14ac010460 con 0x7f14b8100750 2024-08-19T01:29:52.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.416+0000 7f14bc83a640 1 -- 172.21.15.17:0/2634185101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b81984e0 con 0x7f14b8100750 2024-08-19T01:29:52.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.418+0000 7f14bc83a640 1 -- 172.21.15.17:0/2634185101 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b8101280 con 0x7f14b8100750 2024-08-19T01:29:52.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.418+0000 7f14a77fe640 1 -- 172.21.15.17:0/2634185101 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f14ac009b90 con 0x7f14b8100750 2024-08-19T01:29:52.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.419+0000 7f14a77fe640 1 --2- 172.21.15.17:0/2634185101 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f14a006e170 0x7f14a0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:52.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.419+0000 7f14a77fe640 1 -- 172.21.15.17:0/2634185101 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f14ac08dc70 con 0x7f14b8100750 2024-08-19T01:29:52.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.419+0000 7f14b659c640 1 --2- 172.21.15.17:0/2634185101 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f14a006e170 0x7f14a0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:52.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.419+0000 7f14b659c640 1 --2- 172.21.15.17:0/2634185101 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f14a006e170 0x7f14a0070630 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009230 tx=0x7f14a80058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:52.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.423+0000 7f14a77fe640 1 -- 172.21.15.17:0/2634185101 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f14ac094080 con 0x7f14b8100750 2024-08-19T01:29:52.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.618+0000 7f14bc83a640 1 -- 172.21.15.17:0/2634185101 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14b8198fe0 con 0x7f14a006e170 2024-08-19T01:29:52.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.619+0000 7f14a77fe640 1 -- 172.21.15.17:0/2634185101 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f14b8198fe0 con 0x7f14a006e170 2024-08-19T01:29:52.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.621+0000 7f14bc83a640 1 -- 172.21.15.17:0/2634185101 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f14a006e170 msgr2=0x7f14a0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.621+0000 7f14bc83a640 1 --2- 172.21.15.17:0/2634185101 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f14a006e170 0x7f14a0070630 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009230 tx=0x7f14a80058d0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.621+0000 7f14bc83a640 1 -- 172.21.15.17:0/2634185101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14b8100750 msgr2=0x7f14b819df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.621+0000 7f14bc83a640 1 --2- 172.21.15.17:0/2634185101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14b8100750 0x7f14b819df90 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00d6f0 tx=0x7f14ac00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.621+0000 7f14bc83a640 1 -- 172.21.15.17:0/2634185101 shutdown_connections 2024-08-19T01:29:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.621+0000 7f14bc83a640 1 --2- 172.21.15.17:0/2634185101 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f14a006e170 0x7f14a0070630 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.621+0000 7f14bc83a640 1 --2- 172.21.15.17:0/2634185101 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f14b8100750 0x7f14b819df90 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.621+0000 7f14bc83a640 1 --2- 172.21.15.17:0/2634185101 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f14b80ffda0 0x7f14b819da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.621+0000 7f14bc83a640 1 -- 172.21.15.17:0/2634185101 >> 172.21.15.17:0/2634185101 conn(0x7f14b80fb840 msgr2=0x7f14b80fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.621+0000 7f14bc83a640 1 -- 172.21.15.17:0/2634185101 shutdown_connections 2024-08-19T01:29:52.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.621+0000 7f14bc83a640 1 -- 172.21.15.17:0/2634185101 wait complete. 2024-08-19T01:29:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:29:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.704+0000 7fa5f74be640 1 -- 172.21.15.17:0/2729625172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f00fea30 msgr2=0x7fa5f00fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.704+0000 7fa5f74be640 1 --2- 172.21.15.17:0/2729625172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f00fea30 0x7fa5f00fee90 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009880 tx=0x7fa5e002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.704+0000 7fa5f74be640 1 -- 172.21.15.17:0/2729625172 shutdown_connections 2024-08-19T01:29:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.704+0000 7fa5f74be640 1 --2- 172.21.15.17:0/2729625172 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f00fea30 0x7fa5f00fee90 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.704+0000 7fa5f74be640 1 --2- 172.21.15.17:0/2729625172 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f0104a30 0x7fa5f0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.704+0000 7fa5f74be640 1 -- 172.21.15.17:0/2729625172 >> 172.21.15.17:0/2729625172 conn(0x7fa5f00fa730 msgr2=0x7fa5f00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.704+0000 7fa5f74be640 1 -- 172.21.15.17:0/2729625172 shutdown_connections 2024-08-19T01:29:52.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.704+0000 7fa5f74be640 1 -- 172.21.15.17:0/2729625172 wait complete. 2024-08-19T01:29:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f74be640 1 Processor -- start 2024-08-19T01:29:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f74be640 1 -- start start 2024-08-19T01:29:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f74be640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f00fea30 0x7fa5f0196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f74be640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f0104a30 0x7fa5f0196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f74be640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0197470 con 0x7fa5f00fea30 2024-08-19T01:29:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f74be640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f01975e0 con 0x7fa5f0104a30 2024-08-19T01:29:52.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f525a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f00fea30 0x7fa5f0196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f525a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f00fea30 0x7fa5f0196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35992/0 (socket says 172.21.15.17:35992) 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f525a640 1 -- 172.21.15.17:0/233323897 learned_addr learned my addr 172.21.15.17:0/233323897 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f4a59640 1 --2- 172.21.15.17:0/233323897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f0104a30 0x7fa5f0196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f525a640 1 -- 172.21.15.17:0/233323897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f0104a30 msgr2=0x7fa5f0196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f525a640 1 --2- 172.21.15.17:0/233323897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f0104a30 0x7fa5f0196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f525a640 1 -- 172.21.15.17:0/233323897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e0009560 con 0x7fa5f00fea30 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.705+0000 7fa5f525a640 1 --2- 172.21.15.17:0/233323897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f00fea30 0x7fa5f0196960 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00cc60 tx=0x7fa5ec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.706+0000 7fa5e67fc640 1 -- 172.21.15.17:0/233323897 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5ec004b20 con 0x7fa5f00fea30 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.706+0000 7fa5e67fc640 1 -- 172.21.15.17:0/233323897 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa5ec004c80 con 0x7fa5f00fea30 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.706+0000 7fa5f74be640 1 -- 172.21.15.17:0/233323897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f019f9d0 con 0x7fa5f00fea30 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.706+0000 7fa5e67fc640 1 -- 172.21.15.17:0/233323897 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5ec00f640 con 0x7fa5f00fea30 2024-08-19T01:29:52.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.706+0000 7fa5f74be640 1 -- 172.21.15.17:0/233323897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f019fde0 con 0x7fa5f00fea30 2024-08-19T01:29:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.707+0000 7fa5f74be640 1 -- 172.21.15.17:0/233323897 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f0100170 con 0x7fa5f00fea30 2024-08-19T01:29:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.707+0000 7fa5e67fc640 1 -- 172.21.15.17:0/233323897 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa5ec0055e0 con 0x7fa5f00fea30 2024-08-19T01:29:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.708+0000 7fa5e67fc640 1 --2- 172.21.15.17:0/233323897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa5dc06e170 0x7fa5dc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.708+0000 7fa5e67fc640 1 -- 172.21.15.17:0/233323897 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa5ec08e3c0 con 0x7fa5f00fea30 2024-08-19T01:29:52.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.708+0000 7fa5f4a59640 1 --2- 172.21.15.17:0/233323897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa5dc06e170 0x7fa5dc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:52.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.708+0000 7fa5f4a59640 1 --2- 172.21.15.17:0/233323897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa5dc06e170 0x7fa5dc070630 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0000c00 tx=0x7fa5e0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:52.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.712+0000 7fa5e67fc640 1 -- 172.21.15.17:0/233323897 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa5ec0576a0 con 0x7fa5f00fea30 2024-08-19T01:29:52.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.903+0000 7fa5f74be640 1 -- 172.21.15.17:0/233323897 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5f01977a0 con 0x7fa5dc06e170 2024-08-19T01:29:52.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.904+0000 7fa5e67fc640 1 -- 172.21.15.17:0/233323897 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa5f01977a0 con 0x7fa5dc06e170 2024-08-19T01:29:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.906+0000 7fa5f74be640 1 -- 172.21.15.17:0/233323897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa5dc06e170 msgr2=0x7fa5dc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.906+0000 7fa5f74be640 1 --2- 172.21.15.17:0/233323897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa5dc06e170 0x7fa5dc070630 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0000c00 tx=0x7fa5e0005a20 comp rx=0 tx=0).stop 2024-08-19T01:29:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.906+0000 7fa5f74be640 1 -- 172.21.15.17:0/233323897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f00fea30 msgr2=0x7fa5f0196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.906+0000 7fa5f74be640 1 --2- 172.21.15.17:0/233323897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f00fea30 0x7fa5f0196960 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00cc60 tx=0x7fa5ec00a620 comp rx=0 tx=0).stop 2024-08-19T01:29:52.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.906+0000 7fa5f74be640 1 -- 172.21.15.17:0/233323897 shutdown_connections 2024-08-19T01:29:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.906+0000 7fa5f74be640 1 --2- 172.21.15.17:0/233323897 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa5dc06e170 0x7fa5dc070630 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.906+0000 7fa5f74be640 1 --2- 172.21.15.17:0/233323897 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa5f0104a30 0x7fa5f0196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.906+0000 7fa5f74be640 1 --2- 172.21.15.17:0/233323897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa5f00fea30 0x7fa5f0196960 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.906+0000 7fa5f74be640 1 -- 172.21.15.17:0/233323897 >> 172.21.15.17:0/233323897 conn(0x7fa5f00fa730 msgr2=0x7fa5f00fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.906+0000 7fa5f74be640 1 -- 172.21.15.17:0/233323897 shutdown_connections 2024-08-19T01:29:52.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.906+0000 7fa5f74be640 1 -- 172.21.15.17:0/233323897 wait complete. 2024-08-19T01:29:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.988+0000 7f1f034ae640 1 -- 172.21.15.17:0/2263566033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc0fe9f0 msgr2=0x7f1efc0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.988+0000 7f1f034ae640 1 --2- 172.21.15.17:0/2263566033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc0fe9f0 0x7f1efc0fee50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009880 tx=0x7f1ef802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.989+0000 7f1f034ae640 1 -- 172.21.15.17:0/2263566033 shutdown_connections 2024-08-19T01:29:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.989+0000 7f1f034ae640 1 --2- 172.21.15.17:0/2263566033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc0fe9f0 0x7f1efc0fee50 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.989+0000 7f1f034ae640 1 --2- 172.21.15.17:0/2263566033 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc1049f0 0x7f1efc104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.989+0000 7f1f034ae640 1 -- 172.21.15.17:0/2263566033 >> 172.21.15.17:0/2263566033 conn(0x7f1efc0758a0 msgr2=0x7f1efc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.989+0000 7f1f034ae640 1 -- 172.21.15.17:0/2263566033 shutdown_connections 2024-08-19T01:29:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.989+0000 7f1f034ae640 1 -- 172.21.15.17:0/2263566033 wait complete. 2024-08-19T01:29:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.989+0000 7f1f034ae640 1 Processor -- start 2024-08-19T01:29:52.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.989+0000 7f1f034ae640 1 -- start start 2024-08-19T01:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.989+0000 7f1f034ae640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc0fe9f0 0x7f1efc196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f034ae640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc1049f0 0x7f1efc196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f034ae640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc1974e0 con 0x7f1efc0fe9f0 2024-08-19T01:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f034ae640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc197650 con 0x7f1efc1049f0 2024-08-19T01:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f0124a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc0fe9f0 0x7f1efc196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f0124a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc0fe9f0 0x7f1efc196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35998/0 (socket says 172.21.15.17:35998) 2024-08-19T01:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f0124a640 1 -- 172.21.15.17:0/4058673904 learned_addr learned my addr 172.21.15.17:0/4058673904 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f00a49640 1 --2- 172.21.15.17:0/4058673904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc1049f0 0x7f1efc196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f0124a640 1 -- 172.21.15.17:0/4058673904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc1049f0 msgr2=0x7f1efc196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:52.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f0124a640 1 --2- 172.21.15.17:0/4058673904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc1049f0 0x7f1efc196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:52.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f0124a640 1 -- 172.21.15.17:0/4058673904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef8009560 con 0x7f1efc0fe9f0 2024-08-19T01:29:52.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f0124a640 1 --2- 172.21.15.17:0/4058673904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc0fe9f0 0x7f1efc196a60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000b420 tx=0x7f1ef000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:52.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1eee7fc640 1 -- 172.21.15.17:0/4058673904 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef0011800 con 0x7f1efc0fe9f0 2024-08-19T01:29:52.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1eee7fc640 1 -- 172.21.15.17:0/4058673904 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1ef0011e20 con 0x7f1efc0fe9f0 2024-08-19T01:29:52.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f034ae640 1 -- 172.21.15.17:0/4058673904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1efc19fad0 con 0x7f1efc0fe9f0 2024-08-19T01:29:52.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1eee7fc640 1 -- 172.21.15.17:0/4058673904 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ef000f2e0 con 0x7f1efc0fe9f0 2024-08-19T01:29:52.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.990+0000 7f1f034ae640 1 -- 172.21.15.17:0/4058673904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1efc19fee0 con 0x7f1efc0fe9f0 2024-08-19T01:29:52.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.992+0000 7f1f034ae640 1 -- 172.21.15.17:0/4058673904 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1efc100130 con 0x7f1efc0fe9f0 2024-08-19T01:29:52.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.992+0000 7f1eee7fc640 1 -- 172.21.15.17:0/4058673904 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1ef0010380 con 0x7f1efc0fe9f0 2024-08-19T01:29:52.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.992+0000 7f1eee7fc640 1 --2- 172.21.15.17:0/4058673904 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ee806e170 0x7f1ee8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:52.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.992+0000 7f1eee7fc640 1 -- 172.21.15.17:0/4058673904 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1ef008daa0 con 0x7f1efc0fe9f0 2024-08-19T01:29:52.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.992+0000 7f1f00a49640 1 --2- 172.21.15.17:0/4058673904 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ee806e170 0x7f1ee8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:52.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.993+0000 7f1f00a49640 1 --2- 172.21.15.17:0/4058673904 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ee806e170 0x7f1ee8070630 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009230 tx=0x7f1ef80058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:52.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:52.997+0000 7f1eee7fc640 1 -- 172.21.15.17:0/4058673904 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1ef0056d80 con 0x7f1efc0fe9f0 2024-08-19T01:29:53.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.186+0000 7f1f034ae640 1 -- 172.21.15.17:0/4058673904 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1efc197810 con 0x7f1ee806e170 2024-08-19T01:29:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.196+0000 7f1eee7fc640 1 -- 172.21.15.17:0/4058673904 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f1efc197810 con 0x7f1ee806e170 2024-08-19T01:29:53.199 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:29:53.199 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (31m) 9m ago 41m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:29:53.199 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (42m) 9m ago 42m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:29:53.199 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (41m) 9m ago 41m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:29:53.199 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (28m) 9m ago 42m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:29:53.200 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (28m) 9m ago 40m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:29:53.200 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (30m) 9m ago 41m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:29:53.200 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (25m) 9m ago 36m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:29:53.200 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (25m) 9m ago 36m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:29:53.200 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (9m) 9m ago 36m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:29:53.200 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (24m) 9m ago 36m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:29:53.201 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (33m) 9m ago 43m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:29:53.201 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (32m) 9m ago 40m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:29:53.201 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (29m) 9m ago 43m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:29:53.201 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (29m) 9m ago 40m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:29:53.201 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (31m) 9m ago 41m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:29:53.201 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (31m) 9m ago 40m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:29:53.202 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (28m) 9m ago 40m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:29:53.202 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (27m) 9m ago 39m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:29:53.202 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (27m) 9m ago 39m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:29:53.202 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (26m) 9m ago 38m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:29:53.202 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (26m) 9m ago 38m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:29:53.202 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (25m) 9m ago 37m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:29:53.203 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (31m) 9m ago 41m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:29:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.199+0000 7f1f034ae640 1 -- 172.21.15.17:0/4058673904 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ee806e170 msgr2=0x7f1ee8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.199+0000 7f1f034ae640 1 --2- 172.21.15.17:0/4058673904 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ee806e170 0x7f1ee8070630 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009230 tx=0x7f1ef80058d0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.199+0000 7f1f034ae640 1 -- 172.21.15.17:0/4058673904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc0fe9f0 msgr2=0x7f1efc196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.199+0000 7f1f034ae640 1 --2- 172.21.15.17:0/4058673904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc0fe9f0 0x7f1efc196a60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000b420 tx=0x7f1ef000b8e0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.199+0000 7f1f034ae640 1 -- 172.21.15.17:0/4058673904 shutdown_connections 2024-08-19T01:29:53.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.199+0000 7f1f034ae640 1 --2- 172.21.15.17:0/4058673904 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1ee806e170 0x7f1ee8070630 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.199+0000 7f1f034ae640 1 --2- 172.21.15.17:0/4058673904 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1efc1049f0 0x7f1efc196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.199+0000 7f1f034ae640 1 --2- 172.21.15.17:0/4058673904 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1efc0fe9f0 0x7f1efc196a60 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.199+0000 7f1f034ae640 1 -- 172.21.15.17:0/4058673904 >> 172.21.15.17:0/4058673904 conn(0x7f1efc0758a0 msgr2=0x7f1efc0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:53.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.199+0000 7f1f034ae640 1 -- 172.21.15.17:0/4058673904 shutdown_connections 2024-08-19T01:29:53.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.199+0000 7f1f034ae640 1 -- 172.21.15.17:0/4058673904 wait complete. 2024-08-19T01:29:53.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.280+0000 7f20bca08640 1 -- 172.21.15.17:0/3148136988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20b80ffb50 msgr2=0x7f20b80fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.280+0000 7f20bca08640 1 --2- 172.21.15.17:0/3148136988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20b80ffb50 0x7f20b80fffb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009880 tx=0x7f20a002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.280+0000 7f20bca08640 1 -- 172.21.15.17:0/3148136988 shutdown_connections 2024-08-19T01:29:53.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.280+0000 7f20bca08640 1 --2- 172.21.15.17:0/3148136988 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20b80ffb50 0x7f20b80fffb0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.280+0000 7f20bca08640 1 --2- 172.21.15.17:0/3148136988 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b8105c00 0x7f20b8105fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.280+0000 7f20bca08640 1 -- 172.21.15.17:0/3148136988 >> 172.21.15.17:0/3148136988 conn(0x7f20b80fb830 msgr2=0x7f20b80fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:53.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.281+0000 7f20bca08640 1 -- 172.21.15.17:0/3148136988 shutdown_connections 2024-08-19T01:29:53.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.281+0000 7f20bca08640 1 -- 172.21.15.17:0/3148136988 wait complete. 2024-08-19T01:29:53.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.282+0000 7f20bca08640 1 Processor -- start 2024-08-19T01:29:53.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.282+0000 7f20bca08640 1 -- start start 2024-08-19T01:29:53.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.282+0000 7f20bca08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20b80ffb50 0x7f20b80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:53.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.282+0000 7f20bca08640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b8105c00 0x7f20b8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:53.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.282+0000 7f20bca08640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b8073230 con 0x7f20b80ffb50 2024-08-19T01:29:53.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.282+0000 7f20bca08640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b8073370 con 0x7f20b8105c00 2024-08-19T01:29:53.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.282+0000 7f20b659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20b80ffb50 0x7f20b80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:53.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.282+0000 7f20b659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20b80ffb50 0x7f20b80727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36012/0 (socket says 172.21.15.17:36012) 2024-08-19T01:29:53.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.282+0000 7f20b659c640 1 -- 172.21.15.17:0/3432128813 learned_addr learned my addr 172.21.15.17:0/3432128813 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:53.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.282+0000 7f20affff640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b8105c00 0x7f20b8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:53.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.283+0000 7f20b659c640 1 -- 172.21.15.17:0/3432128813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b8105c00 msgr2=0x7f20b8072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.283+0000 7f20b659c640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b8105c00 0x7f20b8072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.283+0000 7f20b659c640 1 -- 172.21.15.17:0/3432128813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0009560 con 0x7f20b80ffb50 2024-08-19T01:29:53.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.283+0000 7f20affff640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b8105c00 0x7f20b8072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-19T01:29:53.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.283+0000 7f20b659c640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20b80ffb50 0x7f20b80727b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f20a800e970 tx=0x7f20a800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:53.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.283+0000 7f20af7fe640 1 -- 172.21.15.17:0/3432128813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a800cc90 con 0x7f20b80ffb50 2024-08-19T01:29:53.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.283+0000 7f20af7fe640 1 -- 172.21.15.17:0/3432128813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20a800cdf0 con 0x7f20b80ffb50 2024-08-19T01:29:53.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.283+0000 7f20bca08640 1 -- 172.21.15.17:0/3432128813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b81a1c20 con 0x7f20b80ffb50 2024-08-19T01:29:53.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.283+0000 7f20af7fe640 1 -- 172.21.15.17:0/3432128813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a8010430 con 0x7f20b80ffb50 2024-08-19T01:29:53.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.283+0000 7f20bca08640 1 -- 172.21.15.17:0/3432128813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b81a1fd0 con 0x7f20b80ffb50 2024-08-19T01:29:53.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.284+0000 7f20bca08640 1 -- 172.21.15.17:0/3432128813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b8101200 con 0x7f20b80ffb50 2024-08-19T01:29:53.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.285+0000 7f20af7fe640 1 -- 172.21.15.17:0/3432128813 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f20a80046c0 con 0x7f20b80ffb50 2024-08-19T01:29:53.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.285+0000 7f20af7fe640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20a406e170 0x7f20a4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:53.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.286+0000 7f20af7fe640 1 -- 172.21.15.17:0/3432128813 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f20a8014070 con 0x7f20b80ffb50 2024-08-19T01:29:53.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.286+0000 7f20affff640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20a406e170 0x7f20a4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:53.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.286+0000 7f20affff640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20a406e170 0x7f20a4070630 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009230 tx=0x7f20a00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:53.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.290+0000 7f20af7fe640 1 -- 172.21.15.17:0/3432128813 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f20a80579d0 con 0x7f20b80ffb50 2024-08-19T01:29:53.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.537+0000 7f20bca08640 1 -- 172.21.15.17:0/3432128813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f20b80fffb0 con 0x7f20b80ffb50 2024-08-19T01:29:53.539 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:53 smithi017 ceph-mon[99370]: pgmap v934: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:53.539 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:53 smithi017 ceph-mon[99370]: from='client.35718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:53.539 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:53 smithi017 ceph-mon[99370]: from='client.35722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:53.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.537+0000 7f20af7fe640 1 -- 172.21.15.17:0/3432128813 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f20a805b090 con 0x7f20b80ffb50 2024-08-19T01:29:53.539 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:29:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:29:53.539 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:29:53.540 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:29:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.539+0000 7f20bca08640 1 -- 172.21.15.17:0/3432128813 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20a406e170 msgr2=0x7f20a4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.539+0000 7f20bca08640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20a406e170 0x7f20a4070630 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f20a0009230 tx=0x7f20a00058d0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.539+0000 7f20bca08640 1 -- 172.21.15.17:0/3432128813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20b80ffb50 msgr2=0x7f20b80727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.539+0000 7f20bca08640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20b80ffb50 0x7f20b80727b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f20a800e970 tx=0x7f20a800ed70 comp rx=0 tx=0).stop 2024-08-19T01:29:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.539+0000 7f20bca08640 1 -- 172.21.15.17:0/3432128813 shutdown_connections 2024-08-19T01:29:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.539+0000 7f20bca08640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f20a406e170 0x7f20a4070630 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.539+0000 7f20bca08640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f20b8105c00 0x7f20b8072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.539+0000 7f20bca08640 1 --2- 172.21.15.17:0/3432128813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f20b80ffb50 0x7f20b80727b0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.539+0000 7f20bca08640 1 -- 172.21.15.17:0/3432128813 >> 172.21.15.17:0/3432128813 conn(0x7f20b80fb830 msgr2=0x7f20b80fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.539+0000 7f20bca08640 1 -- 172.21.15.17:0/3432128813 shutdown_connections 2024-08-19T01:29:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.539+0000 7f20bca08640 1 -- 172.21.15.17:0/3432128813 wait complete. 2024-08-19T01:29:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.623+0000 7fa02d387640 1 -- 172.21.15.17:0/3919182236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0280fea30 msgr2=0x7fa0280fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.623+0000 7fa02d387640 1 --2- 172.21.15.17:0/3919182236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0280fea30 0x7fa0280fee90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa01c009880 tx=0x7fa01c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.623+0000 7fa02d387640 1 -- 172.21.15.17:0/3919182236 shutdown_connections 2024-08-19T01:29:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.623+0000 7fa02d387640 1 --2- 172.21.15.17:0/3919182236 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0280fea30 0x7fa0280fee90 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.623+0000 7fa02d387640 1 --2- 172.21.15.17:0/3919182236 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa028104a30 0x7fa028104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.623+0000 7fa02d387640 1 -- 172.21.15.17:0/3919182236 >> 172.21.15.17:0/3919182236 conn(0x7fa0280fa730 msgr2=0x7fa0280fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.623+0000 7fa02d387640 1 -- 172.21.15.17:0/3919182236 shutdown_connections 2024-08-19T01:29:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.623+0000 7fa02d387640 1 -- 172.21.15.17:0/3919182236 wait complete. 2024-08-19T01:29:53.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.624+0000 7fa02d387640 1 Processor -- start 2024-08-19T01:29:53.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.624+0000 7fa02d387640 1 -- start start 2024-08-19T01:29:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.624+0000 7fa02d387640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0280fea30 0x7fa028196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.624+0000 7fa02d387640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa028104a30 0x7fa028196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.624+0000 7fa02d387640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa028197470 con 0x7fa0280fea30 2024-08-19T01:29:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.624+0000 7fa02d387640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0281975e0 con 0x7fa028104a30 2024-08-19T01:29:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa026ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0280fea30 0x7fa028196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa026ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0280fea30 0x7fa028196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36028/0 (socket says 172.21.15.17:36028) 2024-08-19T01:29:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa026ffd640 1 -- 172.21.15.17:0/1899650078 learned_addr learned my addr 172.21.15.17:0/1899650078 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa0267fc640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa028104a30 0x7fa028196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa026ffd640 1 -- 172.21.15.17:0/1899650078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa028104a30 msgr2=0x7fa028196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa026ffd640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa028104a30 0x7fa028196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa026ffd640 1 -- 172.21.15.17:0/1899650078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c009560 con 0x7fa0280fea30 2024-08-19T01:29:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa0267fc640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa028104a30 0x7fa028196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:29:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa026ffd640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0280fea30 0x7fa028196960 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa01800ea00 tx=0x7fa01800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa00ffff640 1 -- 172.21.15.17:0/1899650078 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa01800cd50 con 0x7fa0280fea30 2024-08-19T01:29:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa00ffff640 1 -- 172.21.15.17:0/1899650078 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa018005020 con 0x7fa0280fea30 2024-08-19T01:29:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa00ffff640 1 -- 172.21.15.17:0/1899650078 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0180116a0 con 0x7fa0280fea30 2024-08-19T01:29:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa02d387640 1 -- 172.21.15.17:0/1899650078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02819f9d0 con 0x7fa0280fea30 2024-08-19T01:29:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.625+0000 7fa02d387640 1 -- 172.21.15.17:0/1899650078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02819fde0 con 0x7fa0280fea30 2024-08-19T01:29:53.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.626+0000 7fa02d387640 1 -- 172.21.15.17:0/1899650078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa028100170 con 0x7fa0280fea30 2024-08-19T01:29:53.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.627+0000 7fa00ffff640 1 -- 172.21.15.17:0/1899650078 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa018005190 con 0x7fa0280fea30 2024-08-19T01:29:53.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.627+0000 7fa00ffff640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa01006e170 0x7fa010070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:53.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.627+0000 7fa00ffff640 1 -- 172.21.15.17:0/1899650078 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa01808e5f0 con 0x7fa0280fea30 2024-08-19T01:29:53.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.627+0000 7fa0267fc640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa01006e170 0x7fa010070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:53.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.628+0000 7fa0267fc640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa01006e170 0x7fa010070630 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa01c000c00 tx=0x7fa01c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:53.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.632+0000 7fa00ffff640 1 -- 172.21.15.17:0/1899650078 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa018057830 con 0x7fa0280fea30 2024-08-19T01:29:53.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.844+0000 7fa02d387640 1 -- 172.21.15.17:0/1899650078 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa0280fee90 con 0x7fa0280fea30 2024-08-19T01:29:53.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.844+0000 7fa00ffff640 1 -- 172.21.15.17:0/1899650078 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7fa01801f790 con 0x7fa0280fea30 2024-08-19T01:29:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:29:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:29:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:29:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:29:53.846 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:29:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:29:53.847 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:29:53.848 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:29:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:29:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:29:53.849 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:29:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:29:53.849 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:29:53.849 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:29:53.849 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:29:53.849 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:29:53.850 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:29:53.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.846+0000 7fa02d387640 1 -- 172.21.15.17:0/1899650078 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa01006e170 msgr2=0x7fa010070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.846+0000 7fa02d387640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa01006e170 0x7fa010070630 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa01c000c00 tx=0x7fa01c005a20 comp rx=0 tx=0).stop 2024-08-19T01:29:53.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.846+0000 7fa02d387640 1 -- 172.21.15.17:0/1899650078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0280fea30 msgr2=0x7fa028196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.846+0000 7fa02d387640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0280fea30 0x7fa028196960 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa01800ea00 tx=0x7fa01800eec0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.846+0000 7fa02d387640 1 -- 172.21.15.17:0/1899650078 shutdown_connections 2024-08-19T01:29:53.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.846+0000 7fa02d387640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa01006e170 0x7fa010070630 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.846+0000 7fa02d387640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa028104a30 0x7fa028196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.846+0000 7fa02d387640 1 --2- 172.21.15.17:0/1899650078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa0280fea30 0x7fa028196960 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.846+0000 7fa02d387640 1 -- 172.21.15.17:0/1899650078 >> 172.21.15.17:0/1899650078 conn(0x7fa0280fa730 msgr2=0x7fa0280fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:53.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.846+0000 7fa02d387640 1 -- 172.21.15.17:0/1899650078 shutdown_connections 2024-08-19T01:29:53.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.846+0000 7fa02d387640 1 -- 172.21.15.17:0/1899650078 wait complete. 2024-08-19T01:29:53.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.929+0000 7f92114bb640 1 -- 172.21.15.17:0/1850491468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f920c104a30 msgr2=0x7f920c104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.929+0000 7f92114bb640 1 --2- 172.21.15.17:0/1850491468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f920c104a30 0x7f920c104e10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f91fc009c20 tx=0x7f91fc02a970 comp rx=0 tx=0).stop 2024-08-19T01:29:53.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.929+0000 7f92114bb640 1 -- 172.21.15.17:0/1850491468 shutdown_connections 2024-08-19T01:29:53.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.929+0000 7f92114bb640 1 --2- 172.21.15.17:0/1850491468 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f920c0fea30 0x7f920c0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.929+0000 7f92114bb640 1 --2- 172.21.15.17:0/1850491468 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f920c104a30 0x7f920c104e10 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.929+0000 7f92114bb640 1 -- 172.21.15.17:0/1850491468 >> 172.21.15.17:0/1850491468 conn(0x7f920c0fa730 msgr2=0x7f920c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:53.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.929+0000 7f92114bb640 1 -- 172.21.15.17:0/1850491468 shutdown_connections 2024-08-19T01:29:53.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.929+0000 7f92114bb640 1 -- 172.21.15.17:0/1850491468 wait complete. 2024-08-19T01:29:53.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.930+0000 7f92114bb640 1 Processor -- start 2024-08-19T01:29:53.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.930+0000 7f92114bb640 1 -- start start 2024-08-19T01:29:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.930+0000 7f92114bb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f920c0fea30 0x7f920c196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.930+0000 7f92114bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f920c104a30 0x7f920c196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.930+0000 7f92114bb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c197490 con 0x7f920c104a30 2024-08-19T01:29:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.930+0000 7f92114bb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f920c197600 con 0x7f920c0fea30 2024-08-19T01:29:53.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.930+0000 7f920a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f920c104a30 0x7f920c196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.930+0000 7f920a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f920c104a30 0x7f920c196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36056/0 (socket says 172.21.15.17:36056) 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.930+0000 7f920a7fc640 1 -- 172.21.15.17:0/2976604276 learned_addr learned my addr 172.21.15.17:0/2976604276 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.930+0000 7f920affd640 1 --2- 172.21.15.17:0/2976604276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f920c0fea30 0x7f920c196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.931+0000 7f920a7fc640 1 -- 172.21.15.17:0/2976604276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f920c0fea30 msgr2=0x7f920c196980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.931+0000 7f920a7fc640 1 --2- 172.21.15.17:0/2976604276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f920c0fea30 0x7f920c196980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.931+0000 7f920a7fc640 1 -- 172.21.15.17:0/2976604276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc009900 con 0x7f920c104a30 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.931+0000 7f920a7fc640 1 --2- 172.21.15.17:0/2976604276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f920c104a30 0x7f920c196ec0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f920000d6f0 tx=0x7f920000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.931+0000 7f91f3fff640 1 -- 172.21.15.17:0/2976604276 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9200009a30 con 0x7f920c104a30 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.931+0000 7f92114bb640 1 -- 172.21.15.17:0/2976604276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920c19f9f0 con 0x7f920c104a30 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.931+0000 7f91f3fff640 1 -- 172.21.15.17:0/2976604276 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92000054e0 con 0x7f920c104a30 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.931+0000 7f91f3fff640 1 -- 172.21.15.17:0/2976604276 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9200010460 con 0x7f920c104a30 2024-08-19T01:29:53.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.931+0000 7f92114bb640 1 -- 172.21.15.17:0/2976604276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920c19fe60 con 0x7f920c104a30 2024-08-19T01:29:53.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.932+0000 7f92114bb640 1 -- 172.21.15.17:0/2976604276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920c100170 con 0x7f920c104a30 2024-08-19T01:29:53.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.933+0000 7f91f3fff640 1 -- 172.21.15.17:0/2976604276 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9200009b90 con 0x7f920c104a30 2024-08-19T01:29:53.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.933+0000 7f91f3fff640 1 --2- 172.21.15.17:0/2976604276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91f406e170 0x7f91f4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:53.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.933+0000 7f91f3fff640 1 -- 172.21.15.17:0/2976604276 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f920008dc80 con 0x7f920c104a30 2024-08-19T01:29:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.933+0000 7f920affd640 1 --2- 172.21.15.17:0/2976604276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91f406e170 0x7f91f4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:53.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.934+0000 7f920affd640 1 --2- 172.21.15.17:0/2976604276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91f406e170 0x7f91f4070630 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f91fc000f80 tx=0x7f91fc03d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:53.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:53.938+0000 7f91f3fff640 1 -- 172.21.15.17:0/2976604276 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9200057010 con 0x7f920c104a30 2024-08-19T01:29:53.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:53 smithi086 ceph-mon[71303]: pgmap v934: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:53 smithi086 ceph-mon[71303]: from='client.35718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:53.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:53 smithi086 ceph-mon[71303]: from='client.35722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:54.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.129+0000 7f92114bb640 1 -- 172.21.15.17:0/2976604276 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f920c10bcc0 con 0x7f91f406e170 2024-08-19T01:29:54.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.130+0000 7f91f3fff640 1 -- 172.21.15.17:0/2976604276 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f920c10bcc0 con 0x7f91f406e170 2024-08-19T01:29:54.132 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:29:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:29:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:29:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:29:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:29:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:29:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:29:54.132 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:29:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:29:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:29:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:29:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:29:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:29:54.133 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:29:54.133 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:29:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.132+0000 7f92114bb640 1 -- 172.21.15.17:0/2976604276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91f406e170 msgr2=0x7f91f4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.133+0000 7f92114bb640 1 --2- 172.21.15.17:0/2976604276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91f406e170 0x7f91f4070630 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f91fc000f80 tx=0x7f91fc03d040 comp rx=0 tx=0).stop 2024-08-19T01:29:54.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.133+0000 7f92114bb640 1 -- 172.21.15.17:0/2976604276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f920c104a30 msgr2=0x7f920c196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.133+0000 7f92114bb640 1 --2- 172.21.15.17:0/2976604276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f920c104a30 0x7f920c196ec0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f920000d6f0 tx=0x7f920000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.133+0000 7f92114bb640 1 -- 172.21.15.17:0/2976604276 shutdown_connections 2024-08-19T01:29:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.133+0000 7f92114bb640 1 --2- 172.21.15.17:0/2976604276 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f91f406e170 0x7f91f4070630 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.133+0000 7f92114bb640 1 --2- 172.21.15.17:0/2976604276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f920c104a30 0x7f920c196ec0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.133+0000 7f92114bb640 1 --2- 172.21.15.17:0/2976604276 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f920c0fea30 0x7f920c196980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.133+0000 7f92114bb640 1 -- 172.21.15.17:0/2976604276 >> 172.21.15.17:0/2976604276 conn(0x7f920c0fa730 msgr2=0x7f920c0fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.133+0000 7f92114bb640 1 -- 172.21.15.17:0/2976604276 shutdown_connections 2024-08-19T01:29:54.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.133+0000 7f92114bb640 1 -- 172.21.15.17:0/2976604276 wait complete. 2024-08-19T01:29:54.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.215+0000 7f906cff6640 1 -- 172.21.15.17:0/2133381437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90680fea30 msgr2=0x7f90680fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:54.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.215+0000 7f906cff6640 1 --2- 172.21.15.17:0/2133381437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90680fea30 0x7f90680fee90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f9050009880 tx=0x7f905002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.215+0000 7f906cff6640 1 -- 172.21.15.17:0/2133381437 shutdown_connections 2024-08-19T01:29:54.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.215+0000 7f906cff6640 1 --2- 172.21.15.17:0/2133381437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90680fea30 0x7f90680fee90 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.215+0000 7f906cff6640 1 --2- 172.21.15.17:0/2133381437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9068104a30 0x7f9068104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.215+0000 7f906cff6640 1 -- 172.21.15.17:0/2133381437 >> 172.21.15.17:0/2133381437 conn(0x7f90680fa730 msgr2=0x7f90680fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:54.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.215+0000 7f906cff6640 1 -- 172.21.15.17:0/2133381437 shutdown_connections 2024-08-19T01:29:54.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.215+0000 7f906cff6640 1 -- 172.21.15.17:0/2133381437 wait complete. 2024-08-19T01:29:54.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f906cff6640 1 Processor -- start 2024-08-19T01:29:54.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f906cff6640 1 -- start start 2024-08-19T01:29:54.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f906cff6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90680fea30 0x7f906819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:54.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f906cff6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068104a30 0x7f906819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:54.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f906cff6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906819c380 con 0x7f9068104a30 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f906cff6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90681959a0 con 0x7f90680fea30 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f9065d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068104a30 0x7f906819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f9065d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068104a30 0x7f906819bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36074/0 (socket says 172.21.15.17:36074) 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f9065d9b640 1 -- 172.21.15.17:0/1102163265 learned_addr learned my addr 172.21.15.17:0/1102163265 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f906659c640 1 --2- 172.21.15.17:0/1102163265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90680fea30 0x7f906819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f9065d9b640 1 -- 172.21.15.17:0/1102163265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90680fea30 msgr2=0x7f906819b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f9065d9b640 1 --2- 172.21.15.17:0/1102163265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90680fea30 0x7f906819b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.216+0000 7f9065d9b640 1 -- 172.21.15.17:0/1102163265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9050009560 con 0x7f9068104a30 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.217+0000 7f9065d9b640 1 --2- 172.21.15.17:0/1102163265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068104a30 0x7f906819bdf0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f905002a9c0 tx=0x7f90500055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.217+0000 7f905f7fe640 1 -- 172.21.15.17:0/1102163265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9050004aa0 con 0x7f9068104a30 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.217+0000 7f905f7fe640 1 -- 172.21.15.17:0/1102163265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9050004c00 con 0x7f9068104a30 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.217+0000 7f906cff6640 1 -- 172.21.15.17:0/1102163265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9068195c20 con 0x7f9068104a30 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.217+0000 7f905f7fe640 1 -- 172.21.15.17:0/1102163265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9050003ab0 con 0x7f9068104a30 2024-08-19T01:29:54.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.217+0000 7f906cff6640 1 -- 172.21.15.17:0/1102163265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9068196110 con 0x7f9068104a30 2024-08-19T01:29:54.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.218+0000 7f906cff6640 1 -- 172.21.15.17:0/1102163265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9068100170 con 0x7f9068104a30 2024-08-19T01:29:54.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.219+0000 7f905f7fe640 1 -- 172.21.15.17:0/1102163265 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9050031d20 con 0x7f9068104a30 2024-08-19T01:29:54.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.219+0000 7f905f7fe640 1 --2- 172.21.15.17:0/1102163265 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f905406e170 0x7f9054070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:29:54.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.219+0000 7f905f7fe640 1 -- 172.21.15.17:0/1102163265 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f90500af1b0 con 0x7f9068104a30 2024-08-19T01:29:54.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.219+0000 7f906659c640 1 --2- 172.21.15.17:0/1102163265 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f905406e170 0x7f9054070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:29:54.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.219+0000 7f906659c640 1 --2- 172.21.15.17:0/1102163265 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f905406e170 0x7f9054070630 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9058005e10 tx=0x7f9058005da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:29:54.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.223+0000 7f905f7fe640 1 -- 172.21.15.17:0/1102163265 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9050078510 con 0x7f9068104a30 2024-08-19T01:29:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.466+0000 7f906cff6640 1 -- 172.21.15.17:0/1102163265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9068196f20 con 0x7f9068104a30 2024-08-19T01:29:54.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.466+0000 7f905f7fe640 1 -- 172.21.15.17:0/1102163265 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f9068196f20 con 0x7f9068104a30 2024-08-19T01:29:54.468 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:29:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:29:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:29:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:29:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:29:54.469 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:29:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:29:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:29:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:29:54.469 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:29:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:29:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:29:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:29:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:29:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:29:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:29:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:29:54.470 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:29:54.470 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:29:54.471 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:29:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:29:54.471 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:29:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:29:54.471 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:29:54.471 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:29:54.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.468+0000 7f906cff6640 1 -- 172.21.15.17:0/1102163265 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f905406e170 msgr2=0x7f9054070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:54.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.468+0000 7f906cff6640 1 --2- 172.21.15.17:0/1102163265 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f905406e170 0x7f9054070630 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9058005e10 tx=0x7f9058005da0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.468+0000 7f906cff6640 1 -- 172.21.15.17:0/1102163265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068104a30 msgr2=0x7f906819bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:29:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.468+0000 7f906cff6640 1 --2- 172.21.15.17:0/1102163265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068104a30 0x7f906819bdf0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f905002a9c0 tx=0x7f90500055a0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.469+0000 7f906cff6640 1 -- 172.21.15.17:0/1102163265 shutdown_connections 2024-08-19T01:29:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.469+0000 7f906cff6640 1 --2- 172.21.15.17:0/1102163265 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f905406e170 0x7f9054070630 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.469+0000 7f906cff6640 1 --2- 172.21.15.17:0/1102163265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9068104a30 0x7f906819bdf0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.469+0000 7f906cff6640 1 --2- 172.21.15.17:0/1102163265 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f90680fea30 0x7f906819b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:29:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.469+0000 7f906cff6640 1 -- 172.21.15.17:0/1102163265 >> 172.21.15.17:0/1102163265 conn(0x7f90680fa730 msgr2=0x7f90680fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:29:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.469+0000 7f906cff6640 1 -- 172.21.15.17:0/1102163265 shutdown_connections 2024-08-19T01:29:54.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:29:54.469+0000 7f906cff6640 1 -- 172.21.15.17:0/1102163265 wait complete. 2024-08-19T01:29:54.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:54 smithi017 ceph-mon[99370]: from='client.35726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:54.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:54 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3432128813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:29:54.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:54 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1899650078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:29:54.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:54 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1102163265' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:29:54.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:54 smithi086 ceph-mon[71303]: from='client.35726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:54.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:54 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3432128813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:29:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:54 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1899650078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:29:54.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:54 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1102163265' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:29:55.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:55 smithi086 ceph-mon[71303]: from='client.35738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:55.847 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:55 smithi086 ceph-mon[71303]: pgmap v935: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:55.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:55 smithi017 ceph-mon[99370]: from='client.35738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:29:55.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:55 smithi017 ceph-mon[99370]: pgmap v935: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:57.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:57 smithi017 ceph-mon[99370]: pgmap v936: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:57.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:57 smithi086 ceph-mon[71303]: pgmap v936: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:59.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:29:59 smithi086 ceph-mon[71303]: pgmap v937: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:29:59.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:29:59 smithi017 ceph-mon[99370]: pgmap v937: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:30:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:30:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:30:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : /usr/bin/podman: timeout after 895 seconds 2024-08-19T01:30:00.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:30:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : Traceback (most recent call last): 2024-08-19T01:30:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:30:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : return _run_code(code, main_globals, None, 2024-08-19T01:30:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:30:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : exec(code, run_globals) 2024-08-19T01:30:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:30:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:30:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:30:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:30:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:30:00.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:30:00.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:30:00.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:30:00.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:30:00.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:30:00.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-08-19T01:30:00.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:30:00.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:30:00.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:30:00.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:29:59.999+0000 7f7b3ccd7640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-08-19T01:30:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: Health detail: HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:30:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:30:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:30:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: /usr/bin/podman: timeout after 895 seconds 2024-08-19T01:30:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:30:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: Traceback (most recent call last): 2024-08-19T01:30:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:30:00.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: return _run_code(code, main_globals, None, 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: exec(code, run_globals) 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:30:00.934 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:30:00.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: fs cephfs is degraded 2024-08-19T01:30:00.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:30:00.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:30:00.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:30:00.935 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:00 smithi017 ceph-mon[99370]: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:30:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: Health detail: HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:30:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: [WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:30:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:30:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: /usr/bin/podman: timeout after 895 seconds 2024-08-19T01:30:00.946 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: Traceback (most recent call last): 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: return _run_code(code, main_globals, None, 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: exec(code, run_globals) 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:30:00.947 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:30:00.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:30:00.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:30:00.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: fs cephfs is degraded 2024-08-19T01:30:00.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:30:00.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:30:00.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:30:00.948 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:00 smithi086 ceph-mon[71303]: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:30:01.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:01 smithi017 ceph-mon[99370]: pgmap v938: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:01.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:01 smithi086 ceph-mon[71303]: pgmap v938: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:03.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:03 smithi017 ceph-mon[99370]: pgmap v939: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:03.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:30:03.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:03 smithi086 ceph-mon[71303]: pgmap v939: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:03.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:30:05.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:05 smithi017 ceph-mon[99370]: pgmap v940: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:05.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:05 smithi086 ceph-mon[71303]: pgmap v940: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:07.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:07 smithi017 ceph-mon[99370]: pgmap v941: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:07.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:07 smithi086 ceph-mon[71303]: pgmap v941: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:09.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:09 smithi017 ceph-mon[99370]: pgmap v942: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:09.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:09 smithi086 ceph-mon[71303]: pgmap v942: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:11.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:11 smithi017 ceph-mon[99370]: pgmap v943: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:11.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:11 smithi086 ceph-mon[71303]: pgmap v943: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:14.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:13 smithi017 ceph-mon[99370]: pgmap v944: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:14.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:13 smithi086 ceph-mon[71303]: pgmap v944: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:16.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:15 smithi017 ceph-mon[99370]: pgmap v945: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:16.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:15 smithi086 ceph-mon[71303]: pgmap v945: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:18.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:17 smithi017 ceph-mon[99370]: pgmap v946: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:18.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:17 smithi086 ceph-mon[71303]: pgmap v946: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:19.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:30:19.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:30:19.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:19 smithi086 ceph-mon[71303]: pgmap v947: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:20.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:19 smithi017 ceph-mon[99370]: pgmap v947: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:22.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:21 smithi017 ceph-mon[99370]: pgmap v948: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:22.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:21 smithi086 ceph-mon[71303]: pgmap v948: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:23.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:23 smithi017 ceph-mon[99370]: pgmap v949: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:24.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:23 smithi086 ceph-mon[71303]: pgmap v949: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:24.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.565+0000 7fc67ee15640 1 -- 172.21.15.17:0/2141184632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6780fea30 msgr2=0x7fc6780fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:24.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.565+0000 7fc67ee15640 1 --2- 172.21.15.17:0/2141184632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6780fea30 0x7fc6780fee90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc660009880 tx=0x7fc66002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 -- 172.21.15.17:0/2141184632 shutdown_connections 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 --2- 172.21.15.17:0/2141184632 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6780fea30 0x7fc6780fee90 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 --2- 172.21.15.17:0/2141184632 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc678104a30 0x7fc678104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 -- 172.21.15.17:0/2141184632 >> 172.21.15.17:0/2141184632 conn(0x7fc6780fa730 msgr2=0x7fc6780fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 -- 172.21.15.17:0/2141184632 shutdown_connections 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 -- 172.21.15.17:0/2141184632 wait complete. 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 Processor -- start 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 -- start start 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6780fea30 0x7fc6780faff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc678104a30 0x7fc6780fb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780fba70 con 0x7fc6780fea30 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.566+0000 7fc67ee15640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780fbbe0 con 0x7fc678104a30 2024-08-19T01:30:24.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.567+0000 7fc67cbb1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6780fea30 0x7fc6780faff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:24.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.567+0000 7fc67cbb1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6780fea30 0x7fc6780faff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48148/0 (socket says 172.21.15.17:48148) 2024-08-19T01:30:24.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.567+0000 7fc67cbb1640 1 -- 172.21.15.17:0/2641840858 learned_addr learned my addr 172.21.15.17:0/2641840858 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:24.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.567+0000 7fc677fff640 1 --2- 172.21.15.17:0/2641840858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc678104a30 0x7fc6780fb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:24.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.567+0000 7fc67cbb1640 1 -- 172.21.15.17:0/2641840858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc678104a30 msgr2=0x7fc6780fb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:24.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.567+0000 7fc67cbb1640 1 --2- 172.21.15.17:0/2641840858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc678104a30 0x7fc6780fb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:24.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.567+0000 7fc67cbb1640 1 -- 172.21.15.17:0/2641840858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009560 con 0x7fc6780fea30 2024-08-19T01:30:24.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.567+0000 7fc67cbb1640 1 --2- 172.21.15.17:0/2641840858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6780fea30 0x7fc6780faff0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc66800d6f0 tx=0x7fc66800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:24.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.567+0000 7fc675ffb640 1 -- 172.21.15.17:0/2641840858 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc668009a30 con 0x7fc6780fea30 2024-08-19T01:30:24.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.567+0000 7fc675ffb640 1 -- 172.21.15.17:0/2641840858 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6680054e0 con 0x7fc6780fea30 2024-08-19T01:30:24.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.567+0000 7fc67ee15640 1 -- 172.21.15.17:0/2641840858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6781a1cc0 con 0x7fc6780fea30 2024-08-19T01:30:24.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.568+0000 7fc675ffb640 1 -- 172.21.15.17:0/2641840858 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc668010460 con 0x7fc6780fea30 2024-08-19T01:30:24.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.568+0000 7fc67ee15640 1 -- 172.21.15.17:0/2641840858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6781a2020 con 0x7fc6780fea30 2024-08-19T01:30:24.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.569+0000 7fc67ee15640 1 -- 172.21.15.17:0/2641840858 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc678100170 con 0x7fc6780fea30 2024-08-19T01:30:24.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.569+0000 7fc675ffb640 1 -- 172.21.15.17:0/2641840858 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc668009b90 con 0x7fc6780fea30 2024-08-19T01:30:24.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.569+0000 7fc675ffb640 1 --2- 172.21.15.17:0/2641840858 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc66406e170 0x7fc664070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:24.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.570+0000 7fc675ffb640 1 -- 172.21.15.17:0/2641840858 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc66808dc50 con 0x7fc6780fea30 2024-08-19T01:30:24.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.570+0000 7fc677fff640 1 --2- 172.21.15.17:0/2641840858 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc66406e170 0x7fc664070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:24.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.570+0000 7fc677fff640 1 --2- 172.21.15.17:0/2641840858 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc66406e170 0x7fc664070630 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc660000c00 tx=0x7fc660005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:24.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.574+0000 7fc675ffb640 1 -- 172.21.15.17:0/2641840858 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc668056fb0 con 0x7fc6780fea30 2024-08-19T01:30:24.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.769+0000 7fc67ee15640 1 -- 172.21.15.17:0/2641840858 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6780fbda0 con 0x7fc66406e170 2024-08-19T01:30:24.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.770+0000 7fc675ffb640 1 -- 172.21.15.17:0/2641840858 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc6780fbda0 con 0x7fc66406e170 2024-08-19T01:30:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.772+0000 7fc67ee15640 1 -- 172.21.15.17:0/2641840858 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc66406e170 msgr2=0x7fc664070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:24.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.772+0000 7fc67ee15640 1 --2- 172.21.15.17:0/2641840858 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc66406e170 0x7fc664070630 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc660000c00 tx=0x7fc660005a20 comp rx=0 tx=0).stop 2024-08-19T01:30:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.772+0000 7fc67ee15640 1 -- 172.21.15.17:0/2641840858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6780fea30 msgr2=0x7fc6780faff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.772+0000 7fc67ee15640 1 --2- 172.21.15.17:0/2641840858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6780fea30 0x7fc6780faff0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc66800d6f0 tx=0x7fc66800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:30:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.772+0000 7fc67ee15640 1 -- 172.21.15.17:0/2641840858 shutdown_connections 2024-08-19T01:30:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.772+0000 7fc67ee15640 1 --2- 172.21.15.17:0/2641840858 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc66406e170 0x7fc664070630 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.772+0000 7fc67ee15640 1 --2- 172.21.15.17:0/2641840858 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc678104a30 0x7fc6780fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.772+0000 7fc67ee15640 1 --2- 172.21.15.17:0/2641840858 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6780fea30 0x7fc6780faff0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.772+0000 7fc67ee15640 1 -- 172.21.15.17:0/2641840858 >> 172.21.15.17:0/2641840858 conn(0x7fc6780fa730 msgr2=0x7fc678068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.772+0000 7fc67ee15640 1 -- 172.21.15.17:0/2641840858 shutdown_connections 2024-08-19T01:30:24.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.772+0000 7fc67ee15640 1 -- 172.21.15.17:0/2641840858 wait complete. 2024-08-19T01:30:24.782 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:30:24.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.856+0000 7f4fe34af640 1 -- 172.21.15.17:0/4051642391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc0ffda0 msgr2=0x7f4fdc100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:24.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.856+0000 7f4fe34af640 1 --2- 172.21.15.17:0/4051642391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc0ffda0 0x7f4fdc100180 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc009c20 tx=0x7f4fcc02a970 comp rx=0 tx=0).stop 2024-08-19T01:30:24.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.856+0000 7f4fe34af640 1 -- 172.21.15.17:0/4051642391 shutdown_connections 2024-08-19T01:30:24.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.856+0000 7f4fe34af640 1 --2- 172.21.15.17:0/4051642391 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fdc100750 0x7f4fdc1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:24.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.856+0000 7f4fe34af640 1 --2- 172.21.15.17:0/4051642391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc0ffda0 0x7f4fdc100180 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:24.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.856+0000 7f4fe34af640 1 -- 172.21.15.17:0/4051642391 >> 172.21.15.17:0/4051642391 conn(0x7f4fdc0fb840 msgr2=0x7f4fdc0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:24.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.856+0000 7f4fe34af640 1 -- 172.21.15.17:0/4051642391 shutdown_connections 2024-08-19T01:30:24.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.856+0000 7f4fe34af640 1 -- 172.21.15.17:0/4051642391 wait complete. 2024-08-19T01:30:24.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe34af640 1 Processor -- start 2024-08-19T01:30:24.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe34af640 1 -- start start 2024-08-19T01:30:24.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe34af640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fdc0ffda0 0x7f4fdc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:24.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe34af640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc100750 0x7f4fdc072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:24.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe34af640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc073230 con 0x7f4fdc100750 2024-08-19T01:30:24.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe34af640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc073370 con 0x7f4fdc0ffda0 2024-08-19T01:30:24.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe0a4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc100750 0x7f4fdc072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:24.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe0a4a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc100750 0x7f4fdc072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48178/0 (socket says 172.21.15.17:48178) 2024-08-19T01:30:24.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe0a4a640 1 -- 172.21.15.17:0/2059332132 learned_addr learned my addr 172.21.15.17:0/2059332132 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:24.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe124b640 1 --2- 172.21.15.17:0/2059332132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fdc0ffda0 0x7f4fdc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:24.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe0a4a640 1 -- 172.21.15.17:0/2059332132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fdc0ffda0 msgr2=0x7f4fdc0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:24.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe0a4a640 1 --2- 172.21.15.17:0/2059332132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fdc0ffda0 0x7f4fdc0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:24.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.857+0000 7f4fe0a4a640 1 -- 172.21.15.17:0/2059332132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc009900 con 0x7f4fdc100750 2024-08-19T01:30:24.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.858+0000 7f4fe0a4a640 1 --2- 172.21.15.17:0/2059332132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc100750 0x7f4fdc072cf0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000d6f0 tx=0x7f4fd000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:24.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.858+0000 7f4fda7fc640 1 -- 172.21.15.17:0/2059332132 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd0009a30 con 0x7f4fdc100750 2024-08-19T01:30:24.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.858+0000 7f4fda7fc640 1 -- 172.21.15.17:0/2059332132 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4fd00054e0 con 0x7f4fdc100750 2024-08-19T01:30:24.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.858+0000 7f4fe34af640 1 -- 172.21.15.17:0/2059332132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fdc1a1db0 con 0x7f4fdc100750 2024-08-19T01:30:24.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.858+0000 7f4fda7fc640 1 -- 172.21.15.17:0/2059332132 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd0010460 con 0x7f4fdc100750 2024-08-19T01:30:24.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.858+0000 7f4fe34af640 1 -- 172.21.15.17:0/2059332132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc1a21c0 con 0x7f4fdc100750 2024-08-19T01:30:24.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.859+0000 7f4fe34af640 1 -- 172.21.15.17:0/2059332132 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fdc101280 con 0x7f4fdc100750 2024-08-19T01:30:24.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.859+0000 7f4fda7fc640 1 -- 172.21.15.17:0/2059332132 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4fd0009b90 con 0x7f4fdc100750 2024-08-19T01:30:24.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.860+0000 7f4fda7fc640 1 --2- 172.21.15.17:0/2059332132 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fc406e180 0x7f4fc4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:24.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.860+0000 7f4fda7fc640 1 -- 172.21.15.17:0/2059332132 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4fd008dc80 con 0x7f4fdc100750 2024-08-19T01:30:24.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.860+0000 7f4fe124b640 1 --2- 172.21.15.17:0/2059332132 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fc406e180 0x7f4fc4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:24.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.860+0000 7f4fe124b640 1 --2- 172.21.15.17:0/2059332132 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fc406e180 0x7f4fc4070640 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc000f80 tx=0x7f4fcc03d040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:24.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:24.864+0000 7f4fda7fc640 1 -- 172.21.15.17:0/2059332132 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4fd0057010 con 0x7f4fdc100750 2024-08-19T01:30:25.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.054+0000 7f4fe34af640 1 -- 172.21.15.17:0/2059332132 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fdc10cdd0 con 0x7f4fc406e180 2024-08-19T01:30:25.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.055+0000 7f4fda7fc640 1 -- 172.21.15.17:0/2059332132 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4fdc10cdd0 con 0x7f4fc406e180 2024-08-19T01:30:25.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.057+0000 7f4fe34af640 1 -- 172.21.15.17:0/2059332132 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fc406e180 msgr2=0x7f4fc4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.057+0000 7f4fe34af640 1 --2- 172.21.15.17:0/2059332132 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fc406e180 0x7f4fc4070640 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc000f80 tx=0x7f4fcc03d040 comp rx=0 tx=0).stop 2024-08-19T01:30:25.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.057+0000 7f4fe34af640 1 -- 172.21.15.17:0/2059332132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc100750 msgr2=0x7f4fdc072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.057+0000 7f4fe34af640 1 --2- 172.21.15.17:0/2059332132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc100750 0x7f4fdc072cf0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000d6f0 tx=0x7f4fd000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.057+0000 7f4fe34af640 1 -- 172.21.15.17:0/2059332132 shutdown_connections 2024-08-19T01:30:25.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.057+0000 7f4fe34af640 1 --2- 172.21.15.17:0/2059332132 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4fc406e180 0x7f4fc4070640 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.057+0000 7f4fe34af640 1 --2- 172.21.15.17:0/2059332132 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4fdc100750 0x7f4fdc072cf0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.057+0000 7f4fe34af640 1 --2- 172.21.15.17:0/2059332132 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4fdc0ffda0 0x7f4fdc0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.057+0000 7f4fe34af640 1 -- 172.21.15.17:0/2059332132 >> 172.21.15.17:0/2059332132 conn(0x7f4fdc0fb840 msgr2=0x7f4fdc0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:25.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.057+0000 7f4fe34af640 1 -- 172.21.15.17:0/2059332132 shutdown_connections 2024-08-19T01:30:25.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.057+0000 7f4fe34af640 1 -- 172.21.15.17:0/2059332132 wait complete. 2024-08-19T01:30:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.139+0000 7f3b5b993640 1 -- 172.21.15.17:0/1439230723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b54101670 msgr2=0x7f3b54109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.139+0000 7f3b5b993640 1 --2- 172.21.15.17:0/1439230723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b54101670 0x7f3b54109b60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009880 tx=0x7f3b4402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.139+0000 7f3b5b993640 1 -- 172.21.15.17:0/1439230723 shutdown_connections 2024-08-19T01:30:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.139+0000 7f3b5b993640 1 --2- 172.21.15.17:0/1439230723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b54101670 0x7f3b54109b60 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.139+0000 7f3b5b993640 1 --2- 172.21.15.17:0/1439230723 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b54100d50 0x7f3b54101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.139+0000 7f3b5b993640 1 -- 172.21.15.17:0/1439230723 >> 172.21.15.17:0/1439230723 conn(0x7f3b540fa730 msgr2=0x7f3b540fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.139+0000 7f3b5b993640 1 -- 172.21.15.17:0/1439230723 shutdown_connections 2024-08-19T01:30:25.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.139+0000 7f3b5b993640 1 -- 172.21.15.17:0/1439230723 wait complete. 2024-08-19T01:30:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.140+0000 7f3b5b993640 1 Processor -- start 2024-08-19T01:30:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.140+0000 7f3b5b993640 1 -- start start 2024-08-19T01:30:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.140+0000 7f3b5b993640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b54100d50 0x7f3b54197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.140+0000 7f3b5b993640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b54101670 0x7f3b541981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.140+0000 7f3b5b993640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b541988d0 con 0x7f3b54101670 2024-08-19T01:30:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.140+0000 7f3b5b993640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5419b540 con 0x7f3b54100d50 2024-08-19T01:30:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.140+0000 7f3b58f2e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b54101670 0x7f3b541981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.140+0000 7f3b58f2e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b54101670 0x7f3b541981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48200/0 (socket says 172.21.15.17:48200) 2024-08-19T01:30:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.140+0000 7f3b58f2e640 1 -- 172.21.15.17:0/3552356660 learned_addr learned my addr 172.21.15.17:0/3552356660 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.141+0000 7f3b5972f640 1 --2- 172.21.15.17:0/3552356660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b54100d50 0x7f3b54197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.141+0000 7f3b58f2e640 1 -- 172.21.15.17:0/3552356660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b54100d50 msgr2=0x7f3b54197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.141+0000 7f3b58f2e640 1 --2- 172.21.15.17:0/3552356660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b54100d50 0x7f3b54197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.141+0000 7f3b58f2e640 1 -- 172.21.15.17:0/3552356660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44009560 con 0x7f3b54101670 2024-08-19T01:30:25.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.141+0000 7f3b58f2e640 1 --2- 172.21.15.17:0/3552356660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b54101670 0x7f3b541981f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3b4402a9c0 tx=0x7f3b440055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:25.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.141+0000 7f3b4a7fc640 1 -- 172.21.15.17:0/3552356660 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b44004aa0 con 0x7f3b54101670 2024-08-19T01:30:25.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.141+0000 7f3b5b993640 1 -- 172.21.15.17:0/3552356660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b5419b820 con 0x7f3b54101670 2024-08-19T01:30:25.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.141+0000 7f3b4a7fc640 1 -- 172.21.15.17:0/3552356660 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b44004c00 con 0x7f3b54101670 2024-08-19T01:30:25.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.141+0000 7f3b4a7fc640 1 -- 172.21.15.17:0/3552356660 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b44003980 con 0x7f3b54101670 2024-08-19T01:30:25.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.141+0000 7f3b5b993640 1 -- 172.21.15.17:0/3552356660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b5419bd70 con 0x7f3b54101670 2024-08-19T01:30:25.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.142+0000 7f3b5b993640 1 -- 172.21.15.17:0/3552356660 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b54106410 con 0x7f3b54101670 2024-08-19T01:30:25.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.143+0000 7f3b4a7fc640 1 -- 172.21.15.17:0/3552356660 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3b44003bf0 con 0x7f3b54101670 2024-08-19T01:30:25.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.143+0000 7f3b4a7fc640 1 --2- 172.21.15.17:0/3552356660 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b4006e170 0x7f3b40070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:25.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.143+0000 7f3b4a7fc640 1 -- 172.21.15.17:0/3552356660 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3b440af130 con 0x7f3b54101670 2024-08-19T01:30:25.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.143+0000 7f3b5972f640 1 --2- 172.21.15.17:0/3552356660 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b4006e170 0x7f3b40070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:25.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.144+0000 7f3b5972f640 1 --2- 172.21.15.17:0/3552356660 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b4006e170 0x7f3b40070630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3b50005fd0 tx=0x7f3b5000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.148+0000 7f3b4a7fc640 1 -- 172.21.15.17:0/3552356660 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3b440784c0 con 0x7f3b54101670 2024-08-19T01:30:25.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.334+0000 7f3b5b993640 1 -- 172.21.15.17:0/3552356660 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b540ffa40 con 0x7f3b4006e170 2024-08-19T01:30:25.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.344+0000 7f3b4a7fc640 1 -- 172.21.15.17:0/3552356660 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3b540ffa40 con 0x7f3b4006e170 2024-08-19T01:30:25.345 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:30:25.345 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (31m) 10m ago 42m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (42m) 10m ago 42m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (41m) 10m ago 41m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (29m) 10m ago 42m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (29m) 10m ago 41m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (31m) 10m ago 42m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (25m) 10m ago 36m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (25m) 10m ago 36m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (10m) 10m ago 36m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (25m) 10m ago 36m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (33m) 10m ago 43m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (32m) 10m ago 41m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (30m) 10m ago 43m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:30:25.346 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (30m) 10m ago 41m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:30:25.347 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (32m) 10m ago 42m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:30:25.347 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (32m) 10m ago 41m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:30:25.347 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (29m) 10m ago 40m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:30:25.347 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (28m) 10m ago 40m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:30:25.347 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (27m) 10m ago 39m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:30:25.347 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (27m) 10m ago 39m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:30:25.347 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (26m) 10m ago 38m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:30:25.347 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (26m) 10m ago 38m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:30:25.347 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (32m) 10m ago 41m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:30:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.346+0000 7f3b5b993640 1 -- 172.21.15.17:0/3552356660 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b4006e170 msgr2=0x7f3b40070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.346+0000 7f3b5b993640 1 --2- 172.21.15.17:0/3552356660 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b4006e170 0x7f3b40070630 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3b50005fd0 tx=0x7f3b5000b390 comp rx=0 tx=0).stop 2024-08-19T01:30:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.346+0000 7f3b5b993640 1 -- 172.21.15.17:0/3552356660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b54101670 msgr2=0x7f3b541981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.346+0000 7f3b5b993640 1 --2- 172.21.15.17:0/3552356660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b54101670 0x7f3b541981f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f3b4402a9c0 tx=0x7f3b440055a0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.346+0000 7f3b5b993640 1 -- 172.21.15.17:0/3552356660 shutdown_connections 2024-08-19T01:30:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.346+0000 7f3b5b993640 1 --2- 172.21.15.17:0/3552356660 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b4006e170 0x7f3b40070630 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.346+0000 7f3b5b993640 1 --2- 172.21.15.17:0/3552356660 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b54101670 0x7f3b541981f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.346+0000 7f3b5b993640 1 --2- 172.21.15.17:0/3552356660 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3b54100d50 0x7f3b54197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.346+0000 7f3b5b993640 1 -- 172.21.15.17:0/3552356660 >> 172.21.15.17:0/3552356660 conn(0x7f3b540fa730 msgr2=0x7f3b54109170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.346+0000 7f3b5b993640 1 -- 172.21.15.17:0/3552356660 shutdown_connections 2024-08-19T01:30:25.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.347+0000 7f3b5b993640 1 -- 172.21.15.17:0/3552356660 wait complete. 2024-08-19T01:30:25.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.428+0000 7f027638e640 1 -- 172.21.15.17:0/3575972339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02701049f0 msgr2=0x7f0270104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.428+0000 7f027638e640 1 --2- 172.21.15.17:0/3575972339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02701049f0 0x7f0270104dd0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0260009880 tx=0x7f026002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.429+0000 7f027638e640 1 -- 172.21.15.17:0/3575972339 shutdown_connections 2024-08-19T01:30:25.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.429+0000 7f027638e640 1 --2- 172.21.15.17:0/3575972339 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02700fe9f0 0x7f02700fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.429+0000 7f027638e640 1 --2- 172.21.15.17:0/3575972339 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02701049f0 0x7f0270104dd0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.429+0000 7f027638e640 1 -- 172.21.15.17:0/3575972339 >> 172.21.15.17:0/3575972339 conn(0x7f02700758a0 msgr2=0x7f02700fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:25.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.429+0000 7f027638e640 1 -- 172.21.15.17:0/3575972339 shutdown_connections 2024-08-19T01:30:25.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.429+0000 7f027638e640 1 -- 172.21.15.17:0/3575972339 wait complete. 2024-08-19T01:30:25.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.429+0000 7f027638e640 1 Processor -- start 2024-08-19T01:30:25.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.429+0000 7f027638e640 1 -- start start 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f027638e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02700fe9f0 0x7f027019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f027638e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701049f0 0x7f027019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f027638e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027019c3c0 con 0x7f02700fe9f0 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f027638e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0270195890 con 0x7f02701049f0 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f026ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02700fe9f0 0x7f027019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f026ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02700fe9f0 0x7f027019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48220/0 (socket says 172.21.15.17:48220) 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f026ffff640 1 -- 172.21.15.17:0/2348691739 learned_addr learned my addr 172.21.15.17:0/2348691739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f0267fff640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701049f0 0x7f027019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f026ffff640 1 -- 172.21.15.17:0/2348691739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701049f0 msgr2=0x7f027019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f026ffff640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701049f0 0x7f027019bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f026ffff640 1 -- 172.21.15.17:0/2348691739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0260009560 con 0x7f02700fe9f0 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f0267fff640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701049f0 0x7f027019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:30:25.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.430+0000 7f026ffff640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02700fe9f0 0x7f027019b830 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f026002a9c0 tx=0x7f02600055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:25.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.431+0000 7f026dffb640 1 -- 172.21.15.17:0/2348691739 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0260004aa0 con 0x7f02700fe9f0 2024-08-19T01:30:25.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.431+0000 7f027638e640 1 -- 172.21.15.17:0/2348691739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0270195b10 con 0x7f02700fe9f0 2024-08-19T01:30:25.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.431+0000 7f026dffb640 1 -- 172.21.15.17:0/2348691739 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0260004c00 con 0x7f02700fe9f0 2024-08-19T01:30:25.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.431+0000 7f026dffb640 1 -- 172.21.15.17:0/2348691739 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0260003ab0 con 0x7f02700fe9f0 2024-08-19T01:30:25.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.431+0000 7f027638e640 1 -- 172.21.15.17:0/2348691739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0270196000 con 0x7f02700fe9f0 2024-08-19T01:30:25.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.432+0000 7f027638e640 1 -- 172.21.15.17:0/2348691739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0270100130 con 0x7f02700fe9f0 2024-08-19T01:30:25.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.432+0000 7f026dffb640 1 -- 172.21.15.17:0/2348691739 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0260003ce0 con 0x7f02700fe9f0 2024-08-19T01:30:25.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.433+0000 7f026dffb640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f025c06e170 0x7f025c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:25.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.433+0000 7f026dffb640 1 -- 172.21.15.17:0/2348691739 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f02600af260 con 0x7f02700fe9f0 2024-08-19T01:30:25.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.433+0000 7f0267fff640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f025c06e170 0x7f025c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:25.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.433+0000 7f0267fff640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f025c06e170 0x7f025c070630 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f02701970e0 tx=0x7f025800a5c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:25.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.437+0000 7f026dffb640 1 -- 172.21.15.17:0/2348691739 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0260078540 con 0x7f02700fe9f0 2024-08-19T01:30:25.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.682+0000 7f027638e640 1 -- 172.21.15.17:0/2348691739 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f027010bc60 con 0x7f02700fe9f0 2024-08-19T01:30:25.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.683+0000 7f026dffb640 1 -- 172.21.15.17:0/2348691739 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f026007bc00 con 0x7f02700fe9f0 2024-08-19T01:30:25.684 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:30:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:30:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:30:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:30:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:30:25.686 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:30:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.685+0000 7f027638e640 1 -- 172.21.15.17:0/2348691739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f025c06e170 msgr2=0x7f025c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.685+0000 7f027638e640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f025c06e170 0x7f025c070630 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f02701970e0 tx=0x7f025800a5c0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.685+0000 7f027638e640 1 -- 172.21.15.17:0/2348691739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02700fe9f0 msgr2=0x7f027019b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.685+0000 7f027638e640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02700fe9f0 0x7f027019b830 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f026002a9c0 tx=0x7f02600055a0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.685+0000 7f027638e640 1 -- 172.21.15.17:0/2348691739 shutdown_connections 2024-08-19T01:30:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.685+0000 7f027638e640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f025c06e170 0x7f025c070630 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.685+0000 7f027638e640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f02701049f0 0x7f027019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.685+0000 7f027638e640 1 --2- 172.21.15.17:0/2348691739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f02700fe9f0 0x7f027019b830 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.685+0000 7f027638e640 1 -- 172.21.15.17:0/2348691739 >> 172.21.15.17:0/2348691739 conn(0x7f02700758a0 msgr2=0x7f0270067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.685+0000 7f027638e640 1 -- 172.21.15.17:0/2348691739 shutdown_connections 2024-08-19T01:30:25.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.685+0000 7f027638e640 1 -- 172.21.15.17:0/2348691739 wait complete. 2024-08-19T01:30:25.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.767+0000 7f1a2b681640 1 -- 172.21.15.17:0/2475211869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a24100750 msgr2=0x7f1a241047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.767+0000 7f1a2b681640 1 --2- 172.21.15.17:0/2475211869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a24100750 0x7f1a241047a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009880 tx=0x7f1a1402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.767+0000 7f1a2b681640 1 -- 172.21.15.17:0/2475211869 shutdown_connections 2024-08-19T01:30:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.767+0000 7f1a2b681640 1 --2- 172.21.15.17:0/2475211869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a24100750 0x7f1a241047a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.767+0000 7f1a2b681640 1 --2- 172.21.15.17:0/2475211869 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a240ffda0 0x7f1a24100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.767+0000 7f1a2b681640 1 -- 172.21.15.17:0/2475211869 >> 172.21.15.17:0/2475211869 conn(0x7f1a240fb840 msgr2=0x7f1a240fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.767+0000 7f1a2b681640 1 -- 172.21.15.17:0/2475211869 shutdown_connections 2024-08-19T01:30:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.767+0000 7f1a2b681640 1 -- 172.21.15.17:0/2475211869 wait complete. 2024-08-19T01:30:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.768+0000 7f1a2b681640 1 Processor -- start 2024-08-19T01:30:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.768+0000 7f1a2b681640 1 -- start start 2024-08-19T01:30:25.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.768+0000 7f1a2b681640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a240ffda0 0x7f1a240727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.768+0000 7f1a2b681640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a24100750 0x7f1a24072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.768+0000 7f1a2b681640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24073230 con 0x7f1a240ffda0 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.768+0000 7f1a2b681640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24073370 con 0x7f1a24100750 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.768+0000 7f1a2941d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a240ffda0 0x7f1a240727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.768+0000 7f1a2941d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a240ffda0 0x7f1a240727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48240/0 (socket says 172.21.15.17:48240) 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.768+0000 7f1a2941d640 1 -- 172.21.15.17:0/473868378 learned_addr learned my addr 172.21.15.17:0/473868378 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.768+0000 7f1a28c1c640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a24100750 0x7f1a24072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.769+0000 7f1a2941d640 1 -- 172.21.15.17:0/473868378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a24100750 msgr2=0x7f1a24072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.769+0000 7f1a2941d640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a24100750 0x7f1a24072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.769+0000 7f1a2941d640 1 -- 172.21.15.17:0/473868378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14009560 con 0x7f1a240ffda0 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.769+0000 7f1a28c1c640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a24100750 0x7f1a24072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:30:25.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.769+0000 7f1a2941d640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a240ffda0 0x7f1a240727b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000c8f0 tx=0x7f1a2000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.769+0000 7f1a1a7fc640 1 -- 172.21.15.17:0/473868378 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a20007b80 con 0x7f1a240ffda0 2024-08-19T01:30:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.769+0000 7f1a1a7fc640 1 -- 172.21.15.17:0/473868378 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a200054e0 con 0x7f1a240ffda0 2024-08-19T01:30:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.769+0000 7f1a2b681640 1 -- 172.21.15.17:0/473868378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a241a1cd0 con 0x7f1a240ffda0 2024-08-19T01:30:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.769+0000 7f1a1a7fc640 1 -- 172.21.15.17:0/473868378 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a2000f450 con 0x7f1a240ffda0 2024-08-19T01:30:25.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.769+0000 7f1a2b681640 1 -- 172.21.15.17:0/473868378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a241a20e0 con 0x7f1a240ffda0 2024-08-19T01:30:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.770+0000 7f1a2b681640 1 -- 172.21.15.17:0/473868378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a24101280 con 0x7f1a240ffda0 2024-08-19T01:30:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.770+0000 7f1a1a7fc640 1 -- 172.21.15.17:0/473868378 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1a20004f60 con 0x7f1a240ffda0 2024-08-19T01:30:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.771+0000 7f1a1a7fc640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a1006e170 0x7f1a10070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.771+0000 7f1a1a7fc640 1 -- 172.21.15.17:0/473868378 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1a2008dff0 con 0x7f1a240ffda0 2024-08-19T01:30:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.771+0000 7f1a28c1c640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a1006e170 0x7f1a10070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:25.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.771+0000 7f1a28c1c640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a1006e170 0x7f1a10070630 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1a14006010 tx=0x7f1a14005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:25.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.775+0000 7f1a1a7fc640 1 -- 172.21.15.17:0/473868378 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1a200572d0 con 0x7f1a240ffda0 2024-08-19T01:30:25.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.986+0000 7f1a2b681640 1 -- 172.21.15.17:0/473868378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1a24073da0 con 0x7f1a240ffda0 2024-08-19T01:30:25.988 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:25 smithi017 ceph-mon[99370]: pgmap v950: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:25.988 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:25 smithi017 ceph-mon[99370]: from='client.35746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:25.989 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:25 smithi017 ceph-mon[99370]: from='client.35750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:25.989 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:25 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2348691739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:30:25.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.987+0000 7f1a1a7fc640 1 -- 172.21.15.17:0/473868378 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f1a2005a990 con 0x7f1a240ffda0 2024-08-19T01:30:25.989 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:30:25.989 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:30:25.989 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:30:25.989 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:30:25.990 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:30:25.991 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:30:25.992 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:30:25.993 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:30:25.993 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:30:25.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.989+0000 7f1a2b681640 1 -- 172.21.15.17:0/473868378 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a1006e170 msgr2=0x7f1a10070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.989+0000 7f1a2b681640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a1006e170 0x7f1a10070630 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1a14006010 tx=0x7f1a14005e60 comp rx=0 tx=0).stop 2024-08-19T01:30:25.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.989+0000 7f1a2b681640 1 -- 172.21.15.17:0/473868378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a240ffda0 msgr2=0x7f1a240727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:25.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.989+0000 7f1a2b681640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a240ffda0 0x7f1a240727b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000c8f0 tx=0x7f1a2000cdb0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.989+0000 7f1a2b681640 1 -- 172.21.15.17:0/473868378 shutdown_connections 2024-08-19T01:30:25.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.989+0000 7f1a2b681640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1a1006e170 0x7f1a10070630 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.989+0000 7f1a2b681640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1a24100750 0x7f1a24072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.989+0000 7f1a2b681640 1 --2- 172.21.15.17:0/473868378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a240ffda0 0x7f1a240727b0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:25.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.989+0000 7f1a2b681640 1 -- 172.21.15.17:0/473868378 >> 172.21.15.17:0/473868378 conn(0x7f1a240fb840 msgr2=0x7f1a240fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:25.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.989+0000 7f1a2b681640 1 -- 172.21.15.17:0/473868378 shutdown_connections 2024-08-19T01:30:25.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:25.989+0000 7f1a2b681640 1 -- 172.21.15.17:0/473868378 wait complete. 2024-08-19T01:30:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.072+0000 7ff3343bd640 1 -- 172.21.15.17:0/3759743178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff32c0fea30 msgr2=0x7ff32c0fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.072+0000 7ff3343bd640 1 --2- 172.21.15.17:0/3759743178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff32c0fea30 0x7ff32c0fee90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7ff320009880 tx=0x7ff32002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.072+0000 7ff3343bd640 1 -- 172.21.15.17:0/3759743178 shutdown_connections 2024-08-19T01:30:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.072+0000 7ff3343bd640 1 --2- 172.21.15.17:0/3759743178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff32c0fea30 0x7ff32c0fee90 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.072+0000 7ff3343bd640 1 --2- 172.21.15.17:0/3759743178 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff32c104a30 0x7ff32c104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.072+0000 7ff3343bd640 1 -- 172.21.15.17:0/3759743178 >> 172.21.15.17:0/3759743178 conn(0x7ff32c0fa730 msgr2=0x7ff32c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.072+0000 7ff3343bd640 1 -- 172.21.15.17:0/3759743178 shutdown_connections 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.072+0000 7ff3343bd640 1 -- 172.21.15.17:0/3759743178 wait complete. 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff3343bd640 1 Processor -- start 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff3343bd640 1 -- start start 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff3343bd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff32c0fea30 0x7ff32c1099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff3343bd640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff32c104a30 0x7ff32c109f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff3343bd640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c10a440 con 0x7ff32c0fea30 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff3343bd640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c10a5b0 con 0x7ff32c104a30 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff332159640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff32c0fea30 0x7ff32c1099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff332159640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff32c0fea30 0x7ff32c1099c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48262/0 (socket says 172.21.15.17:48262) 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff332159640 1 -- 172.21.15.17:0/1776430570 learned_addr learned my addr 172.21.15.17:0/1776430570 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff331958640 1 --2- 172.21.15.17:0/1776430570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff32c104a30 0x7ff32c109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff332159640 1 -- 172.21.15.17:0/1776430570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff32c104a30 msgr2=0x7ff32c109f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff332159640 1 --2- 172.21.15.17:0/1776430570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff32c104a30 0x7ff32c109f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff332159640 1 -- 172.21.15.17:0/1776430570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff320009560 con 0x7ff32c0fea30 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.073+0000 7ff332159640 1 --2- 172.21.15.17:0/1776430570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff32c0fea30 0x7ff32c1099c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00db80 tx=0x7ff31c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.074+0000 7ff32b7fe640 1 -- 172.21.15.17:0/1776430570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff31c00de40 con 0x7ff32c0fea30 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.074+0000 7ff32b7fe640 1 -- 172.21.15.17:0/1776430570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff31c003e30 con 0x7ff32c0fea30 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.074+0000 7ff3343bd640 1 -- 172.21.15.17:0/1776430570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c1a1c80 con 0x7ff32c0fea30 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.074+0000 7ff32b7fe640 1 -- 172.21.15.17:0/1776430570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff31c010830 con 0x7ff32c0fea30 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.074+0000 7ff3343bd640 1 -- 172.21.15.17:0/1776430570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c1a1fe0 con 0x7ff32c0fea30 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.075+0000 7ff3343bd640 1 -- 172.21.15.17:0/1776430570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c100170 con 0x7ff32c0fea30 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.075+0000 7ff32b7fe640 1 -- 172.21.15.17:0/1776430570 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff31c004020 con 0x7ff32c0fea30 2024-08-19T01:30:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.076+0000 7ff32b7fe640 1 --2- 172.21.15.17:0/1776430570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff31406e170 0x7ff314070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.076+0000 7ff32b7fe640 1 -- 172.21.15.17:0/1776430570 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff31c08e000 con 0x7ff32c0fea30 2024-08-19T01:30:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.076+0000 7ff331958640 1 --2- 172.21.15.17:0/1776430570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff31406e170 0x7ff314070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.076+0000 7ff331958640 1 --2- 172.21.15.17:0/1776430570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff31406e170 0x7ff314070630 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff320000c00 tx=0x7ff320005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.080+0000 7ff32b7fe640 1 -- 172.21.15.17:0/1776430570 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff31c0572e0 con 0x7ff32c0fea30 2024-08-19T01:30:26.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:25 smithi086 ceph-mon[71303]: pgmap v950: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:25 smithi086 ceph-mon[71303]: from='client.35746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:25 smithi086 ceph-mon[71303]: from='client.35750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:26.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:25 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2348691739' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:30:26.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.272+0000 7ff3343bd640 1 -- 172.21.15.17:0/1776430570 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff32c10a770 con 0x7ff31406e170 2024-08-19T01:30:26.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.273+0000 7ff32b7fe640 1 -- 172.21.15.17:0/1776430570 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ff32c10a770 con 0x7ff31406e170 2024-08-19T01:30:26.275 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:30:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:30:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:30:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:30:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:30:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:30:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:30:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:30:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:30:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:30:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:30:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:30:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:30:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:30:26.276 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:30:26.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.276+0000 7ff3343bd640 1 -- 172.21.15.17:0/1776430570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff31406e170 msgr2=0x7ff314070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:26.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.276+0000 7ff3343bd640 1 --2- 172.21.15.17:0/1776430570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff31406e170 0x7ff314070630 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff320000c00 tx=0x7ff320005a20 comp rx=0 tx=0).stop 2024-08-19T01:30:26.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.276+0000 7ff3343bd640 1 -- 172.21.15.17:0/1776430570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff32c0fea30 msgr2=0x7ff32c1099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:26.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.276+0000 7ff3343bd640 1 --2- 172.21.15.17:0/1776430570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff32c0fea30 0x7ff32c1099c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00db80 tx=0x7ff31c00b630 comp rx=0 tx=0).stop 2024-08-19T01:30:26.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.276+0000 7ff3343bd640 1 -- 172.21.15.17:0/1776430570 shutdown_connections 2024-08-19T01:30:26.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.276+0000 7ff3343bd640 1 --2- 172.21.15.17:0/1776430570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff31406e170 0x7ff314070630 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.276+0000 7ff3343bd640 1 --2- 172.21.15.17:0/1776430570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff32c104a30 0x7ff32c109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.276+0000 7ff3343bd640 1 --2- 172.21.15.17:0/1776430570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff32c0fea30 0x7ff32c1099c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.276+0000 7ff3343bd640 1 -- 172.21.15.17:0/1776430570 >> 172.21.15.17:0/1776430570 conn(0x7ff32c0fa730 msgr2=0x7ff32c0fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:26.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.276+0000 7ff3343bd640 1 -- 172.21.15.17:0/1776430570 shutdown_connections 2024-08-19T01:30:26.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.276+0000 7ff3343bd640 1 -- 172.21.15.17:0/1776430570 wait complete. 2024-08-19T01:30:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.358+0000 7f160c78e640 1 -- 172.21.15.17:0/1848360846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16040fea30 msgr2=0x7f16040fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.358+0000 7f160c78e640 1 --2- 172.21.15.17:0/1848360846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16040fea30 0x7f16040fee90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1600009880 tx=0x7f160002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.358+0000 7f160c78e640 1 -- 172.21.15.17:0/1848360846 shutdown_connections 2024-08-19T01:30:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.358+0000 7f160c78e640 1 --2- 172.21.15.17:0/1848360846 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16040fea30 0x7f16040fee90 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.358+0000 7f160c78e640 1 --2- 172.21.15.17:0/1848360846 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1604104a30 0x7f1604104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.358+0000 7f160c78e640 1 -- 172.21.15.17:0/1848360846 >> 172.21.15.17:0/1848360846 conn(0x7f16040fa730 msgr2=0x7f16040fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:26.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.358+0000 7f160c78e640 1 -- 172.21.15.17:0/1848360846 shutdown_connections 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.358+0000 7f160c78e640 1 -- 172.21.15.17:0/1848360846 wait complete. 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.358+0000 7f160c78e640 1 Processor -- start 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.358+0000 7f160c78e640 1 -- start start 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f160c78e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16040fea30 0x7f16040fb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f160c78e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1604104a30 0x7f16040fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f160c78e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040fbaa0 con 0x7f1604104a30 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f160c78e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16040fbc10 con 0x7f16040fea30 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f1609d29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1604104a30 0x7f16040fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f1609d29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1604104a30 0x7f16040fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48272/0 (socket says 172.21.15.17:48272) 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f1609d29640 1 -- 172.21.15.17:0/1285710234 learned_addr learned my addr 172.21.15.17:0/1285710234 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f160a52a640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16040fea30 0x7f16040fb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:26.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f1609d29640 1 -- 172.21.15.17:0/1285710234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16040fea30 msgr2=0x7f16040fb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f1609d29640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16040fea30 0x7f16040fb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f1609d29640 1 -- 172.21.15.17:0/1285710234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1600009560 con 0x7f1604104a30 2024-08-19T01:30:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f160a52a640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16040fea30 0x7f16040fb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:30:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f1609d29640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1604104a30 0x7f16040fb560 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1600006010 tx=0x7f16000055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f15f77fe640 1 -- 172.21.15.17:0/1285710234 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1600004aa0 con 0x7f1604104a30 2024-08-19T01:30:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f15f77fe640 1 -- 172.21.15.17:0/1285710234 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1600031470 con 0x7f1604104a30 2024-08-19T01:30:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f160c78e640 1 -- 172.21.15.17:0/1285710234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16040fbe90 con 0x7f1604104a30 2024-08-19T01:30:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.359+0000 7f15f77fe640 1 -- 172.21.15.17:0/1285710234 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1600003940 con 0x7f1604104a30 2024-08-19T01:30:26.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.360+0000 7f160c78e640 1 -- 172.21.15.17:0/1285710234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16041a1ef0 con 0x7f1604104a30 2024-08-19T01:30:26.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.361+0000 7f160c78e640 1 -- 172.21.15.17:0/1285710234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1604100170 con 0x7f1604104a30 2024-08-19T01:30:26.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.361+0000 7f15f77fe640 1 -- 172.21.15.17:0/1285710234 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1600031b90 con 0x7f1604104a30 2024-08-19T01:30:26.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.362+0000 7f15f77fe640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15f006e180 0x7f15f0070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:26.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.362+0000 7f15f77fe640 1 -- 172.21.15.17:0/1285710234 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f16000af120 con 0x7f1604104a30 2024-08-19T01:30:26.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.362+0000 7f160a52a640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15f006e180 0x7f15f0070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:26.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.362+0000 7f160a52a640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15f006e180 0x7f15f0070640 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009b40 tx=0x7f15f8005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:26.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.366+0000 7f15f77fe640 1 -- 172.21.15.17:0/1285710234 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1600078400 con 0x7f1604104a30 2024-08-19T01:30:26.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.612+0000 7f160c78e640 1 -- 172.21.15.17:0/1285710234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f16040fbe90 con 0x7f1604104a30 2024-08-19T01:30:26.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.613+0000 7f15f77fe640 1 -- 172.21.15.17:0/1285710234 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f16040fbe90 con 0x7f1604104a30 2024-08-19T01:30:26.615 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:30:26.615 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:30:26.615 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:30:26.615 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:30:26.615 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:30:26.615 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:30:26.615 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:30:26.615 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:30:26.615 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:30:26.616 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:30:26.617 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:30:26.617 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:30:26.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.615+0000 7f160c78e640 1 -- 172.21.15.17:0/1285710234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15f006e180 msgr2=0x7f15f0070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:26.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.615+0000 7f160c78e640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15f006e180 0x7f15f0070640 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f15f8009b40 tx=0x7f15f8005e50 comp rx=0 tx=0).stop 2024-08-19T01:30:26.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.615+0000 7f160c78e640 1 -- 172.21.15.17:0/1285710234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1604104a30 msgr2=0x7f16040fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:26.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.615+0000 7f160c78e640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1604104a30 0x7f16040fb560 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f1600006010 tx=0x7f16000055a0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.615+0000 7f160c78e640 1 -- 172.21.15.17:0/1285710234 shutdown_connections 2024-08-19T01:30:26.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.615+0000 7f160c78e640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15f006e180 0x7f15f0070640 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.615+0000 7f160c78e640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1604104a30 0x7f16040fb560 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.615+0000 7f160c78e640 1 --2- 172.21.15.17:0/1285710234 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f16040fea30 0x7f16040fb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:26.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.615+0000 7f160c78e640 1 -- 172.21.15.17:0/1285710234 >> 172.21.15.17:0/1285710234 conn(0x7f16040fa730 msgr2=0x7f1604068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:26.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.615+0000 7f160c78e640 1 -- 172.21.15.17:0/1285710234 shutdown_connections 2024-08-19T01:30:26.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:26.615+0000 7f160c78e640 1 -- 172.21.15.17:0/1285710234 wait complete. 2024-08-19T01:30:26.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:26 smithi017 ceph-mon[99370]: from='client.35754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:26 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/473868378' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:30:26.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:26 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1285710234' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:30:27.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:26 smithi086 ceph-mon[71303]: from='client.35754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:27.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:26 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/473868378' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:30:27.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:26 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1285710234' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:30:28.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:27 smithi017 ceph-mon[99370]: pgmap v951: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:28.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:27 smithi017 ceph-mon[99370]: from='client.35766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:28.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:27 smithi086 ceph-mon[71303]: pgmap v951: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:28.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:27 smithi086 ceph-mon[71303]: from='client.35766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:30.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:29 smithi017 ceph-mon[99370]: pgmap v952: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:30.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:29 smithi086 ceph-mon[71303]: pgmap v952: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:32.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:31 smithi017 ceph-mon[99370]: pgmap v953: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:32.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:31 smithi086 ceph-mon[71303]: pgmap v953: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:33 smithi017 ceph-mon[99370]: pgmap v954: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:30:34.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:33 smithi086 ceph-mon[71303]: pgmap v954: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:34.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:30:36.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:35 smithi017 ceph-mon[99370]: pgmap v955: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:35 smithi086 ceph-mon[71303]: pgmap v955: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:38.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:37 smithi017 ceph-mon[99370]: pgmap v956: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:38.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:37 smithi086 ceph-mon[71303]: pgmap v956: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:40.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:39 smithi017 ceph-mon[99370]: pgmap v957: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:40.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:39 smithi086 ceph-mon[71303]: pgmap v957: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:42.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:41 smithi017 ceph-mon[99370]: pgmap v958: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:42.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:41 smithi086 ceph-mon[71303]: pgmap v958: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:44.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:43 smithi017 ceph-mon[99370]: pgmap v959: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:44.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:43 smithi086 ceph-mon[71303]: pgmap v959: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:46.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:45 smithi017 ceph-mon[99370]: pgmap v960: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:46.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:45 smithi086 ceph-mon[71303]: pgmap v960: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:48.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:47 smithi017 ceph-mon[99370]: pgmap v961: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:48.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:47 smithi086 ceph-mon[71303]: pgmap v961: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:49.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:30:49.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:30:50.162 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:49 smithi086 ceph-mon[71303]: pgmap v962: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:50.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:49 smithi017 ceph-mon[99370]: pgmap v962: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:52.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:51 smithi017 ceph-mon[99370]: pgmap v963: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:52.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:51 smithi086 ceph-mon[71303]: pgmap v963: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:54.062 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:53 smithi017 ceph-mon[99370]: pgmap v964: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:54.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:53 smithi086 ceph-mon[71303]: pgmap v964: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:56.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:55 smithi017 ceph-mon[99370]: pgmap v965: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:56.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:55 smithi086 ceph-mon[71303]: pgmap v965: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.710+0000 7f51cc697640 1 -- 172.21.15.17:0/4087541871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c4100750 msgr2=0x7f51c41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:56.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.710+0000 7f51cc697640 1 --2- 172.21.15.17:0/4087541871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c4100750 0x7f51c41047a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f51c0009880 tx=0x7f51c002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:30:56.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.710+0000 7f51cc697640 1 -- 172.21.15.17:0/4087541871 shutdown_connections 2024-08-19T01:30:56.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.710+0000 7f51cc697640 1 --2- 172.21.15.17:0/4087541871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c4100750 0x7f51c41047a0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:56.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.710+0000 7f51cc697640 1 --2- 172.21.15.17:0/4087541871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51c40ffda0 0x7f51c4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:56.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.710+0000 7f51cc697640 1 -- 172.21.15.17:0/4087541871 >> 172.21.15.17:0/4087541871 conn(0x7f51c40fb840 msgr2=0x7f51c40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:56.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.710+0000 7f51cc697640 1 -- 172.21.15.17:0/4087541871 shutdown_connections 2024-08-19T01:30:56.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.710+0000 7f51cc697640 1 -- 172.21.15.17:0/4087541871 wait complete. 2024-08-19T01:30:56.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.711+0000 7f51cc697640 1 Processor -- start 2024-08-19T01:30:56.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.711+0000 7f51cc697640 1 -- start start 2024-08-19T01:30:56.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.711+0000 7f51cc697640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51c40ffda0 0x7f51c419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:56.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.711+0000 7f51cc697640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c4100750 0x7f51c419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:56.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.711+0000 7f51cc697640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4195930 con 0x7f51c4100750 2024-08-19T01:30:56.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.711+0000 7f51cc697640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4195a70 con 0x7f51c40ffda0 2024-08-19T01:30:56.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.711+0000 7f51c9c32640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c4100750 0x7f51c419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:56.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.711+0000 7f51c9c32640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c4100750 0x7f51c419be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60298/0 (socket says 172.21.15.17:60298) 2024-08-19T01:30:56.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.711+0000 7f51c9c32640 1 -- 172.21.15.17:0/2958805915 learned_addr learned my addr 172.21.15.17:0/2958805915 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:56.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.711+0000 7f51ca433640 1 --2- 172.21.15.17:0/2958805915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51c40ffda0 0x7f51c419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:56.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.712+0000 7f51c9c32640 1 -- 172.21.15.17:0/2958805915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51c40ffda0 msgr2=0x7f51c419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:56.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.712+0000 7f51c9c32640 1 --2- 172.21.15.17:0/2958805915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51c40ffda0 0x7f51c419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.712+0000 7f51c9c32640 1 -- 172.21.15.17:0/2958805915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c0009560 con 0x7f51c4100750 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.712+0000 7f51c9c32640 1 --2- 172.21.15.17:0/2958805915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c4100750 0x7f51c419be10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f51c002a9c0 tx=0x7f51c00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.712+0000 7f51b77fe640 1 -- 172.21.15.17:0/2958805915 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51c0004aa0 con 0x7f51c4100750 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.712+0000 7f51b77fe640 1 -- 172.21.15.17:0/2958805915 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51c0004c00 con 0x7f51c4100750 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.712+0000 7f51cc697640 1 -- 172.21.15.17:0/2958805915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c4195cf0 con 0x7f51c4100750 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.712+0000 7f51b77fe640 1 -- 172.21.15.17:0/2958805915 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51c0003ab0 con 0x7f51c4100750 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.712+0000 7f51cc697640 1 -- 172.21.15.17:0/2958805915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c41961e0 con 0x7f51c4100750 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.713+0000 7f51cc697640 1 -- 172.21.15.17:0/2958805915 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c4101280 con 0x7f51c4100750 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.714+0000 7f51b77fe640 1 -- 172.21.15.17:0/2958805915 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f51c0031d20 con 0x7f51c4100750 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.714+0000 7f51b77fe640 1 --2- 172.21.15.17:0/2958805915 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f51b006e170 0x7f51b0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.715+0000 7f51b77fe640 1 -- 172.21.15.17:0/2958805915 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f51c00af100 con 0x7f51c4100750 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.715+0000 7f51ca433640 1 --2- 172.21.15.17:0/2958805915 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f51b006e170 0x7f51b0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:56.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.715+0000 7f51ca433640 1 --2- 172.21.15.17:0/2958805915 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f51b006e170 0x7f51b0070630 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f51b80058c0 tx=0x7f51b800a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:56.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.719+0000 7f51b77fe640 1 -- 172.21.15.17:0/2958805915 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f51c0078510 con 0x7f51c4100750 2024-08-19T01:30:56.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.913+0000 7f51cc697640 1 -- 172.21.15.17:0/2958805915 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51c410cdd0 con 0x7f51b006e170 2024-08-19T01:30:56.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.914+0000 7f51b77fe640 1 -- 172.21.15.17:0/2958805915 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f51c410cdd0 con 0x7f51b006e170 2024-08-19T01:30:56.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.916+0000 7f51cc697640 1 -- 172.21.15.17:0/2958805915 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f51b006e170 msgr2=0x7f51b0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:56.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.916+0000 7f51cc697640 1 --2- 172.21.15.17:0/2958805915 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f51b006e170 0x7f51b0070630 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f51b80058c0 tx=0x7f51b800a250 comp rx=0 tx=0).stop 2024-08-19T01:30:56.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.916+0000 7f51cc697640 1 -- 172.21.15.17:0/2958805915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c4100750 msgr2=0x7f51c419be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:56.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.916+0000 7f51cc697640 1 --2- 172.21.15.17:0/2958805915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c4100750 0x7f51c419be10 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f51c002a9c0 tx=0x7f51c00055a0 comp rx=0 tx=0).stop 2024-08-19T01:30:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.916+0000 7f51cc697640 1 -- 172.21.15.17:0/2958805915 shutdown_connections 2024-08-19T01:30:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.916+0000 7f51cc697640 1 --2- 172.21.15.17:0/2958805915 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f51b006e170 0x7f51b0070630 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.916+0000 7f51cc697640 1 --2- 172.21.15.17:0/2958805915 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51c4100750 0x7f51c419be10 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.916+0000 7f51cc697640 1 --2- 172.21.15.17:0/2958805915 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51c40ffda0 0x7f51c419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.916+0000 7f51cc697640 1 -- 172.21.15.17:0/2958805915 >> 172.21.15.17:0/2958805915 conn(0x7f51c40fb840 msgr2=0x7f51c40fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.916+0000 7f51cc697640 1 -- 172.21.15.17:0/2958805915 shutdown_connections 2024-08-19T01:30:56.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.916+0000 7f51cc697640 1 -- 172.21.15.17:0/2958805915 wait complete. 2024-08-19T01:30:56.926 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:30:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.999+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/3311514853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f34104a30 msgr2=0x7f2f34104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.999+0000 7f2f3bbe7640 1 --2- 172.21.15.17:0/3311514853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f34104a30 0x7f2f34104e10 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2f30009880 tx=0x7f2f3002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.999+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/3311514853 shutdown_connections 2024-08-19T01:30:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.999+0000 7f2f3bbe7640 1 --2- 172.21.15.17:0/3311514853 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f340fea30 0x7f2f340fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.999+0000 7f2f3bbe7640 1 --2- 172.21.15.17:0/3311514853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f34104a30 0x7f2f34104e10 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.999+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/3311514853 >> 172.21.15.17:0/3311514853 conn(0x7f2f340fa730 msgr2=0x7f2f340fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.999+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/3311514853 shutdown_connections 2024-08-19T01:30:57.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:56.999+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/3311514853 wait complete. 2024-08-19T01:30:57.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.000+0000 7f2f3bbe7640 1 Processor -- start 2024-08-19T01:30:57.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.000+0000 7f2f3bbe7640 1 -- start start 2024-08-19T01:30:57.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.000+0000 7f2f3bbe7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340fea30 0x7f2f34105960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.000+0000 7f2f3bbe7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f34104a30 0x7f2f34105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.000+0000 7f2f3bbe7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341063e0 con 0x7f2f340fea30 2024-08-19T01:30:57.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.000+0000 7f2f3bbe7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f34106520 con 0x7f2f34104a30 2024-08-19T01:30:57.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.000+0000 7f2f39983640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340fea30 0x7f2f34105960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.000+0000 7f2f39983640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340fea30 0x7f2f34105960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60312/0 (socket says 172.21.15.17:60312) 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.000+0000 7f2f39983640 1 -- 172.21.15.17:0/259036496 learned_addr learned my addr 172.21.15.17:0/259036496 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.000+0000 7f2f39182640 1 --2- 172.21.15.17:0/259036496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f34104a30 0x7f2f34105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.001+0000 7f2f39983640 1 -- 172.21.15.17:0/259036496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f34104a30 msgr2=0x7f2f34105ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.001+0000 7f2f39983640 1 --2- 172.21.15.17:0/259036496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f34104a30 0x7f2f34105ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.001+0000 7f2f39983640 1 -- 172.21.15.17:0/259036496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f30009560 con 0x7f2f340fea30 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.001+0000 7f2f39983640 1 --2- 172.21.15.17:0/259036496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340fea30 0x7f2f34105960 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2f3002a9c0 tx=0x7f2f300055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.001+0000 7f2f2affd640 1 -- 172.21.15.17:0/259036496 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f30004aa0 con 0x7f2f340fea30 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.001+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/259036496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f341067a0 con 0x7f2f340fea30 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.001+0000 7f2f2affd640 1 -- 172.21.15.17:0/259036496 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2f30004c00 con 0x7f2f340fea30 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.001+0000 7f2f2affd640 1 -- 172.21.15.17:0/259036496 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f30003a20 con 0x7f2f340fea30 2024-08-19T01:30:57.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.001+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/259036496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f341a1ec0 con 0x7f2f340fea30 2024-08-19T01:30:57.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.002+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/259036496 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f34100170 con 0x7f2f340fea30 2024-08-19T01:30:57.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.003+0000 7f2f2affd640 1 -- 172.21.15.17:0/259036496 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2f30031c90 con 0x7f2f340fea30 2024-08-19T01:30:57.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.003+0000 7f2f2affd640 1 --2- 172.21.15.17:0/259036496 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f2006e170 0x7f2f20070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.004+0000 7f2f2affd640 1 -- 172.21.15.17:0/259036496 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f2f300af240 con 0x7f2f340fea30 2024-08-19T01:30:57.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.004+0000 7f2f39182640 1 --2- 172.21.15.17:0/259036496 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f2006e170 0x7f2f20070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.004+0000 7f2f39182640 1 --2- 172.21.15.17:0/259036496 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f2006e170 0x7f2f20070630 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2f34107460 tx=0x7f2f2400a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:57.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.009+0000 7f2f2affd640 1 -- 172.21.15.17:0/259036496 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f2f30078520 con 0x7f2f340fea30 2024-08-19T01:30:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.201+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/259036496 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f3410bd10 con 0x7f2f2006e170 2024-08-19T01:30:57.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.202+0000 7f2f2affd640 1 -- 172.21.15.17:0/259036496 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2f3410bd10 con 0x7f2f2006e170 2024-08-19T01:30:57.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.204+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/259036496 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f2006e170 msgr2=0x7f2f20070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.204+0000 7f2f3bbe7640 1 --2- 172.21.15.17:0/259036496 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f2006e170 0x7f2f20070630 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2f34107460 tx=0x7f2f2400a2d0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.204+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/259036496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340fea30 msgr2=0x7f2f34105960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.204+0000 7f2f3bbe7640 1 --2- 172.21.15.17:0/259036496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340fea30 0x7f2f34105960 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2f3002a9c0 tx=0x7f2f300055a0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.204+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/259036496 shutdown_connections 2024-08-19T01:30:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.204+0000 7f2f3bbe7640 1 --2- 172.21.15.17:0/259036496 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f2f2006e170 0x7f2f20070630 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.204+0000 7f2f3bbe7640 1 --2- 172.21.15.17:0/259036496 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2f34104a30 0x7f2f34105ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.204+0000 7f2f3bbe7640 1 --2- 172.21.15.17:0/259036496 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f340fea30 0x7f2f34105960 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.204+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/259036496 >> 172.21.15.17:0/259036496 conn(0x7f2f340fa730 msgr2=0x7f2f34068770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.205+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/259036496 shutdown_connections 2024-08-19T01:30:57.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.205+0000 7f2f3bbe7640 1 -- 172.21.15.17:0/259036496 wait complete. 2024-08-19T01:30:57.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.287+0000 7fecffdbb640 1 -- 172.21.15.17:0/1775584252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecf81015d0 msgr2=0x7fecf8109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.287+0000 7fecffdbb640 1 --2- 172.21.15.17:0/1775584252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecf81015d0 0x7fecf8109ac0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fecec009880 tx=0x7fecec02a530 comp rx=0 tx=0).stop 2024-08-19T01:30:57.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.287+0000 7fecffdbb640 1 -- 172.21.15.17:0/1775584252 shutdown_connections 2024-08-19T01:30:57.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.287+0000 7fecffdbb640 1 --2- 172.21.15.17:0/1775584252 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecf81015d0 0x7fecf8109ac0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.287+0000 7fecffdbb640 1 --2- 172.21.15.17:0/1775584252 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecf8100cb0 0x7fecf8101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.287+0000 7fecffdbb640 1 -- 172.21.15.17:0/1775584252 >> 172.21.15.17:0/1775584252 conn(0x7fecf80758a0 msgr2=0x7fecf80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:57.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.288+0000 7fecffdbb640 1 -- 172.21.15.17:0/1775584252 shutdown_connections 2024-08-19T01:30:57.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.288+0000 7fecffdbb640 1 -- 172.21.15.17:0/1775584252 wait complete. 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.288+0000 7fecffdbb640 1 Processor -- start 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecffdbb640 1 -- start start 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecffdbb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecf8100cb0 0x7fecf819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecffdbb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecf81015d0 0x7fecf819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecffdbb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf819c3b0 con 0x7fecf8100cb0 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecffdbb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf8195940 con 0x7fecf81015d0 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecfdb57640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecf8100cb0 0x7fecf819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecfdb57640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecf8100cb0 0x7fecf819b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60344/0 (socket says 172.21.15.17:60344) 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecfdb57640 1 -- 172.21.15.17:0/1036820654 learned_addr learned my addr 172.21.15.17:0/1036820654 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecfd356640 1 --2- 172.21.15.17:0/1036820654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecf81015d0 0x7fecf819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecfdb57640 1 -- 172.21.15.17:0/1036820654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecf81015d0 msgr2=0x7fecf819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecfdb57640 1 --2- 172.21.15.17:0/1036820654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecf81015d0 0x7fecf819bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.289+0000 7fecfdb57640 1 -- 172.21.15.17:0/1036820654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec009560 con 0x7fecf8100cb0 2024-08-19T01:30:57.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.290+0000 7fecfdb57640 1 --2- 172.21.15.17:0/1036820654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecf8100cb0 0x7fecf819b850 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fecf000e970 tx=0x7fecf000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:57.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.290+0000 7fecf6ffd640 1 -- 172.21.15.17:0/1036820654 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf000cc90 con 0x7fecf8100cb0 2024-08-19T01:30:57.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.290+0000 7fecf6ffd640 1 -- 172.21.15.17:0/1036820654 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fecf000cdf0 con 0x7fecf8100cb0 2024-08-19T01:30:57.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.290+0000 7fecffdbb640 1 -- 172.21.15.17:0/1036820654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf8195c20 con 0x7fecf8100cb0 2024-08-19T01:30:57.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.290+0000 7fecf6ffd640 1 -- 172.21.15.17:0/1036820654 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf0010430 con 0x7fecf8100cb0 2024-08-19T01:30:57.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.290+0000 7fecffdbb640 1 -- 172.21.15.17:0/1036820654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf8196140 con 0x7fecf8100cb0 2024-08-19T01:30:57.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.291+0000 7fecffdbb640 1 -- 172.21.15.17:0/1036820654 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf8068510 con 0x7fecf8100cb0 2024-08-19T01:30:57.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.292+0000 7fecf6ffd640 1 -- 172.21.15.17:0/1036820654 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fecf00046c0 con 0x7fecf8100cb0 2024-08-19T01:30:57.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.292+0000 7fecf6ffd640 1 --2- 172.21.15.17:0/1036820654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fece006e170 0x7fece0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.292+0000 7fecf6ffd640 1 -- 172.21.15.17:0/1036820654 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fecf0014070 con 0x7fecf8100cb0 2024-08-19T01:30:57.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.292+0000 7fecfd356640 1 --2- 172.21.15.17:0/1036820654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fece006e170 0x7fece0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.293+0000 7fecfd356640 1 --2- 172.21.15.17:0/1036820654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fece006e170 0x7fece0070630 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fecec009230 tx=0x7fecec0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:57.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.296+0000 7fecf6ffd640 1 -- 172.21.15.17:0/1036820654 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fecf0057c50 con 0x7fecf8100cb0 2024-08-19T01:30:57.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.481+0000 7fecffdbb640 1 -- 172.21.15.17:0/1036820654 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fecf8104380 con 0x7fece006e170 2024-08-19T01:30:57.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.490+0000 7fecf6ffd640 1 -- 172.21.15.17:0/1036820654 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fecf8104380 con 0x7fece006e170 2024-08-19T01:30:57.492 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:30:57.492 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (32m) 10m ago 42m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:30:57.492 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (43m) 10m ago 43m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:30:57.492 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (42m) 10m ago 42m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:30:57.493 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (30m) 10m ago 43m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:30:57.493 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (29m) 10m ago 42m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:30:57.493 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (31m) 10m ago 42m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:30:57.493 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (26m) 10m ago 37m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:30:57.493 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (26m) 10m ago 37m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:30:57.493 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (10m) 10m ago 37m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:30:57.493 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (25m) 10m ago 37m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:30:57.493 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (34m) 10m ago 44m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (33m) 10m ago 41m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (31m) 10m ago 44m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (30m) 10m ago 41m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (32m) 10m ago 43m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (32m) 10m ago 41m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (29m) 10m ago 41m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (29m) 10m ago 40m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (28m) 10m ago 40m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (27m) 10m ago 39m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (27m) 10m ago 39m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (26m) 10m ago 39m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:30:57.494 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (32m) 10m ago 42m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:30:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.493+0000 7fecffdbb640 1 -- 172.21.15.17:0/1036820654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fece006e170 msgr2=0x7fece0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.493+0000 7fecffdbb640 1 --2- 172.21.15.17:0/1036820654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fece006e170 0x7fece0070630 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fecec009230 tx=0x7fecec0058d0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.493+0000 7fecffdbb640 1 -- 172.21.15.17:0/1036820654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecf8100cb0 msgr2=0x7fecf819b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.493+0000 7fecffdbb640 1 --2- 172.21.15.17:0/1036820654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecf8100cb0 0x7fecf819b850 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fecf000e970 tx=0x7fecf000ed70 comp rx=0 tx=0).stop 2024-08-19T01:30:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.493+0000 7fecffdbb640 1 -- 172.21.15.17:0/1036820654 shutdown_connections 2024-08-19T01:30:57.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.493+0000 7fecffdbb640 1 --2- 172.21.15.17:0/1036820654 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fece006e170 0x7fece0070630 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.493+0000 7fecffdbb640 1 --2- 172.21.15.17:0/1036820654 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fecf81015d0 0x7fecf819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.493+0000 7fecffdbb640 1 --2- 172.21.15.17:0/1036820654 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fecf8100cb0 0x7fecf819b850 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.493+0000 7fecffdbb640 1 -- 172.21.15.17:0/1036820654 >> 172.21.15.17:0/1036820654 conn(0x7fecf80758a0 msgr2=0x7fecf8101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.493+0000 7fecffdbb640 1 -- 172.21.15.17:0/1036820654 shutdown_connections 2024-08-19T01:30:57.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.493+0000 7fecffdbb640 1 -- 172.21.15.17:0/1036820654 wait complete. 2024-08-19T01:30:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.574+0000 7f6ff8350640 1 -- 172.21.15.17:0/4215382231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0073170 msgr2=0x7f6ff0110610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.574+0000 7f6ff8350640 1 --2- 172.21.15.17:0/4215382231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0073170 0x7f6ff0110610 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009880 tx=0x7f6fe002a530 comp rx=0 tx=0).stop 2024-08-19T01:30:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.574+0000 7f6ff8350640 1 -- 172.21.15.17:0/4215382231 shutdown_connections 2024-08-19T01:30:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.574+0000 7f6ff8350640 1 --2- 172.21.15.17:0/4215382231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0073170 0x7f6ff0110610 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.574+0000 7f6ff8350640 1 --2- 172.21.15.17:0/4215382231 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff0072850 0x7f6ff0072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.574+0000 7f6ff8350640 1 -- 172.21.15.17:0/4215382231 >> 172.21.15.17:0/4215382231 conn(0x7f6ff00fb840 msgr2=0x7f6ff00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.574+0000 7f6ff8350640 1 -- 172.21.15.17:0/4215382231 shutdown_connections 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.574+0000 7f6ff8350640 1 -- 172.21.15.17:0/4215382231 wait complete. 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.575+0000 7f6ff8350640 1 Processor -- start 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.575+0000 7f6ff8350640 1 -- start start 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.575+0000 7f6ff8350640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0072850 0x7f6ff019c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.575+0000 7f6ff8350640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff0073170 0x7f6ff019c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.575+0000 7f6ff8350640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff019cca0 con 0x7f6ff0072850 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.575+0000 7f6ff8350640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff01a0a10 con 0x7f6ff0073170 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.575+0000 7f6ff60ec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0072850 0x7f6ff019c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.575+0000 7f6ff60ec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0072850 0x7f6ff019c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60372/0 (socket says 172.21.15.17:60372) 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.575+0000 7f6ff60ec640 1 -- 172.21.15.17:0/3356854140 learned_addr learned my addr 172.21.15.17:0/3356854140 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:57.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.576+0000 7f6ff58eb640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff0073170 0x7f6ff019c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.576+0000 7f6ff60ec640 1 -- 172.21.15.17:0/3356854140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff0073170 msgr2=0x7f6ff019c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.576+0000 7f6ff60ec640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff0073170 0x7f6ff019c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.576+0000 7f6ff60ec640 1 -- 172.21.15.17:0/3356854140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0009560 con 0x7f6ff0072850 2024-08-19T01:30:57.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.576+0000 7f6ff58eb640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff0073170 0x7f6ff019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:30:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.576+0000 7f6ff60ec640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0072850 0x7f6ff019c0d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00d8d0 tx=0x7f6fec00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.576+0000 7f6fe77fe640 1 -- 172.21.15.17:0/3356854140 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fec009c00 con 0x7f6ff0072850 2024-08-19T01:30:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.576+0000 7f6fe77fe640 1 -- 172.21.15.17:0/3356854140 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6fec009d60 con 0x7f6ff0072850 2024-08-19T01:30:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.576+0000 7f6ff8350640 1 -- 172.21.15.17:0/3356854140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff01a0cf0 con 0x7f6ff0072850 2024-08-19T01:30:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.576+0000 7f6fe77fe640 1 -- 172.21.15.17:0/3356854140 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fec0049d0 con 0x7f6ff0072850 2024-08-19T01:30:57.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.576+0000 7f6ff8350640 1 -- 172.21.15.17:0/3356854140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff01a1210 con 0x7f6ff0072850 2024-08-19T01:30:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.577+0000 7f6ff8350640 1 -- 172.21.15.17:0/3356854140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff0073f90 con 0x7f6ff0072850 2024-08-19T01:30:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.578+0000 7f6fe77fe640 1 -- 172.21.15.17:0/3356854140 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6fec004c90 con 0x7f6ff0072850 2024-08-19T01:30:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.578+0000 7f6fe77fe640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6fdc06e170 0x7f6fdc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.578+0000 7f6fe77fe640 1 -- 172.21.15.17:0/3356854140 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6fec08ded0 con 0x7f6ff0072850 2024-08-19T01:30:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.578+0000 7f6ff58eb640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6fdc06e170 0x7f6fdc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.579+0000 7f6ff58eb640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6fdc06e170 0x7f6fdc070630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0031440 tx=0x7f6fe0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:57.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.583+0000 7f6fe77fe640 1 -- 172.21.15.17:0/3356854140 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6fec0571b0 con 0x7f6ff0072850 2024-08-19T01:30:57.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.827+0000 7f6ff8350640 1 -- 172.21.15.17:0/3356854140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6ff019d430 con 0x7f6ff0072850 2024-08-19T01:30:57.829 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:57 smithi017 ceph-mon[99370]: pgmap v966: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:57.830 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:57 smithi017 ceph-mon[99370]: from='client.35774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:57.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.828+0000 7f6fe77fe640 1 -- 172.21.15.17:0/3356854140 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f6fec05a870 con 0x7f6ff0072850 2024-08-19T01:30:57.830 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:30:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:30:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:30:57.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:30:57.831 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:30:57.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.830+0000 7f6ff8350640 1 -- 172.21.15.17:0/3356854140 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6fdc06e170 msgr2=0x7f6fdc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.830+0000 7f6ff8350640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6fdc06e170 0x7f6fdc070630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0031440 tx=0x7f6fe0005a20 comp rx=0 tx=0).stop 2024-08-19T01:30:57.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.830+0000 7f6ff8350640 1 -- 172.21.15.17:0/3356854140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0072850 msgr2=0x7f6ff019c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.830+0000 7f6ff8350640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0072850 0x7f6ff019c0d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00d8d0 tx=0x7f6fec00dd90 comp rx=0 tx=0).stop 2024-08-19T01:30:57.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.830+0000 7f6ff8350640 1 -- 172.21.15.17:0/3356854140 shutdown_connections 2024-08-19T01:30:57.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.830+0000 7f6ff8350640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6fdc06e170 0x7f6fdc070630 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.830+0000 7f6ff8350640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ff0073170 0x7f6ff019c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.830+0000 7f6ff8350640 1 --2- 172.21.15.17:0/3356854140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ff0072850 0x7f6ff019c0d0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.830+0000 7f6ff8350640 1 -- 172.21.15.17:0/3356854140 >> 172.21.15.17:0/3356854140 conn(0x7f6ff00fb840 msgr2=0x7f6ff0103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:57.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.830+0000 7f6ff8350640 1 -- 172.21.15.17:0/3356854140 shutdown_connections 2024-08-19T01:30:57.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.830+0000 7f6ff8350640 1 -- 172.21.15.17:0/3356854140 wait complete. 2024-08-19T01:30:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.912+0000 7efe41496640 1 -- 172.21.15.17:0/2692195216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c0ff150 msgr2=0x7efe3c0ff5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.912+0000 7efe41496640 1 --2- 172.21.15.17:0/2692195216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c0ff150 0x7efe3c0ff5b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efe30009880 tx=0x7efe3002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.912+0000 7efe41496640 1 -- 172.21.15.17:0/2692195216 shutdown_connections 2024-08-19T01:30:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.912+0000 7efe41496640 1 --2- 172.21.15.17:0/2692195216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c0ff150 0x7efe3c0ff5b0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.912+0000 7efe41496640 1 --2- 172.21.15.17:0/2692195216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe3c103a60 0x7efe3c103e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.912+0000 7efe41496640 1 -- 172.21.15.17:0/2692195216 >> 172.21.15.17:0/2692195216 conn(0x7efe3c0f9e90 msgr2=0x7efe3c0fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.912+0000 7efe41496640 1 -- 172.21.15.17:0/2692195216 shutdown_connections 2024-08-19T01:30:57.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.912+0000 7efe41496640 1 -- 172.21.15.17:0/2692195216 wait complete. 2024-08-19T01:30:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.912+0000 7efe41496640 1 Processor -- start 2024-08-19T01:30:57.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe41496640 1 -- start start 2024-08-19T01:30:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe41496640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe3c0ff150 0x7efe3c19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe41496640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c103a60 0x7efe3c19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe41496640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c19c480 con 0x7efe3c103a60 2024-08-19T01:30:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe41496640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c195a10 con 0x7efe3c0ff150 2024-08-19T01:30:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe3a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c103a60 0x7efe3c19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe3a7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c103a60 0x7efe3c19be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60382/0 (socket says 172.21.15.17:60382) 2024-08-19T01:30:57.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe3a7fc640 1 -- 172.21.15.17:0/3238237672 learned_addr learned my addr 172.21.15.17:0/3238237672 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe3affd640 1 --2- 172.21.15.17:0/3238237672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe3c0ff150 0x7efe3c19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe3a7fc640 1 -- 172.21.15.17:0/3238237672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe3c0ff150 msgr2=0x7efe3c19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe3a7fc640 1 --2- 172.21.15.17:0/3238237672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe3c0ff150 0x7efe3c19b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.913+0000 7efe3a7fc640 1 -- 172.21.15.17:0/3238237672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe30009560 con 0x7efe3c103a60 2024-08-19T01:30:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.914+0000 7efe3a7fc640 1 --2- 172.21.15.17:0/3238237672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c103a60 0x7efe3c19be60 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efe3002a9c0 tx=0x7efe300055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.914+0000 7efe23fff640 1 -- 172.21.15.17:0/3238237672 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe30004aa0 con 0x7efe3c103a60 2024-08-19T01:30:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.914+0000 7efe23fff640 1 -- 172.21.15.17:0/3238237672 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe30004c00 con 0x7efe3c103a60 2024-08-19T01:30:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.914+0000 7efe41496640 1 -- 172.21.15.17:0/3238237672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c195c90 con 0x7efe3c103a60 2024-08-19T01:30:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.914+0000 7efe23fff640 1 -- 172.21.15.17:0/3238237672 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe30003a20 con 0x7efe3c103a60 2024-08-19T01:30:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.914+0000 7efe41496640 1 -- 172.21.15.17:0/3238237672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c196180 con 0x7efe3c103a60 2024-08-19T01:30:57.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.915+0000 7efe41496640 1 -- 172.21.15.17:0/3238237672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c100370 con 0x7efe3c103a60 2024-08-19T01:30:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.915+0000 7efe23fff640 1 -- 172.21.15.17:0/3238237672 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efe30031c90 con 0x7efe3c103a60 2024-08-19T01:30:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.916+0000 7efe23fff640 1 --2- 172.21.15.17:0/3238237672 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe2406e170 0x7efe24070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.916+0000 7efe23fff640 1 -- 172.21.15.17:0/3238237672 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efe300af1a0 con 0x7efe3c103a60 2024-08-19T01:30:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.916+0000 7efe3affd640 1 --2- 172.21.15.17:0/3238237672 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe2406e170 0x7efe24070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:57.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.916+0000 7efe3affd640 1 --2- 172.21.15.17:0/3238237672 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe2406e170 0x7efe24070630 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009990 tx=0x7efe2c009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:57.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:57.920+0000 7efe23fff640 1 -- 172.21.15.17:0/3238237672 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efe300784a0 con 0x7efe3c103a60 2024-08-19T01:30:58.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.132+0000 7efe41496640 1 -- 172.21.15.17:0/3238237672 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efe3c0ff630 con 0x7efe3c103a60 2024-08-19T01:30:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.132+0000 7efe23fff640 1 -- 172.21.15.17:0/3238237672 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7efe3007bb60 con 0x7efe3c103a60 2024-08-19T01:30:58.134 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:30:58.134 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:30:58.134 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:30:58.134 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:30:58.135 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:30:58.136 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:30:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:30:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:30:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:30:58.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:30:58.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:30:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:30:58.137 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:30:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:30:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:30:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:30:58.137 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:30:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:30:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.135+0000 7efe41496640 1 -- 172.21.15.17:0/3238237672 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe2406e170 msgr2=0x7efe24070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.135+0000 7efe41496640 1 --2- 172.21.15.17:0/3238237672 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe2406e170 0x7efe24070630 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009990 tx=0x7efe2c009110 comp rx=0 tx=0).stop 2024-08-19T01:30:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.135+0000 7efe41496640 1 -- 172.21.15.17:0/3238237672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c103a60 msgr2=0x7efe3c19be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.135+0000 7efe41496640 1 --2- 172.21.15.17:0/3238237672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c103a60 0x7efe3c19be60 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7efe3002a9c0 tx=0x7efe300055a0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.135+0000 7efe41496640 1 -- 172.21.15.17:0/3238237672 shutdown_connections 2024-08-19T01:30:58.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.135+0000 7efe41496640 1 --2- 172.21.15.17:0/3238237672 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efe2406e170 0x7efe24070630 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.135+0000 7efe41496640 1 --2- 172.21.15.17:0/3238237672 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efe3c103a60 0x7efe3c19be60 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.135+0000 7efe41496640 1 --2- 172.21.15.17:0/3238237672 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efe3c0ff150 0x7efe3c19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.135+0000 7efe41496640 1 -- 172.21.15.17:0/3238237672 >> 172.21.15.17:0/3238237672 conn(0x7efe3c0f9e90 msgr2=0x7efe3c0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.135+0000 7efe41496640 1 -- 172.21.15.17:0/3238237672 shutdown_connections 2024-08-19T01:30:58.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.135+0000 7efe41496640 1 -- 172.21.15.17:0/3238237672 wait complete. 2024-08-19T01:30:58.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:57 smithi086 ceph-mon[71303]: pgmap v966: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:30:58.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:57 smithi086 ceph-mon[71303]: from='client.35774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:58.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.218+0000 7ff4a8494640 1 -- 172.21.15.17:0/1847526547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4a0100750 msgr2=0x7ff4a01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:58.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.218+0000 7ff4a8494640 1 --2- 172.21.15.17:0/1847526547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4a0100750 0x7ff4a01047a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff490009880 tx=0x7ff49002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.218+0000 7ff4a8494640 1 -- 172.21.15.17:0/1847526547 shutdown_connections 2024-08-19T01:30:58.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.218+0000 7ff4a8494640 1 --2- 172.21.15.17:0/1847526547 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4a0100750 0x7ff4a01047a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.218+0000 7ff4a8494640 1 --2- 172.21.15.17:0/1847526547 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4a00ffda0 0x7ff4a0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.218+0000 7ff4a8494640 1 -- 172.21.15.17:0/1847526547 >> 172.21.15.17:0/1847526547 conn(0x7ff4a00fb840 msgr2=0x7ff4a00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:58.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.218+0000 7ff4a8494640 1 -- 172.21.15.17:0/1847526547 shutdown_connections 2024-08-19T01:30:58.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.218+0000 7ff4a8494640 1 -- 172.21.15.17:0/1847526547 wait complete. 2024-08-19T01:30:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a8494640 1 Processor -- start 2024-08-19T01:30:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a8494640 1 -- start start 2024-08-19T01:30:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a8494640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4a00ffda0 0x7ff4a00727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a8494640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4a0100750 0x7ff4a0072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a8494640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a0073230 con 0x7ff4a00ffda0 2024-08-19T01:30:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a8494640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00733a0 con 0x7ff4a0100750 2024-08-19T01:30:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a6230640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4a00ffda0 0x7ff4a00727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a6230640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4a00ffda0 0x7ff4a00727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60402/0 (socket says 172.21.15.17:60402) 2024-08-19T01:30:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a6230640 1 -- 172.21.15.17:0/1117926183 learned_addr learned my addr 172.21.15.17:0/1117926183 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a6230640 1 -- 172.21.15.17:0/1117926183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4a0100750 msgr2=0x7ff4a0072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:58.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a6230640 1 --2- 172.21.15.17:0/1117926183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4a0100750 0x7ff4a0072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.219+0000 7ff4a6230640 1 -- 172.21.15.17:0/1117926183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490009560 con 0x7ff4a00ffda0 2024-08-19T01:30:58.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.220+0000 7ff4a6230640 1 --2- 172.21.15.17:0/1117926183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4a00ffda0 0x7ff4a00727b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00e970 tx=0x7ff49c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:58.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.220+0000 7ff4977fe640 1 -- 172.21.15.17:0/1117926183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff49c00cc90 con 0x7ff4a00ffda0 2024-08-19T01:30:58.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.220+0000 7ff4977fe640 1 -- 172.21.15.17:0/1117926183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff49c00cdf0 con 0x7ff4a00ffda0 2024-08-19T01:30:58.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.220+0000 7ff4977fe640 1 -- 172.21.15.17:0/1117926183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff49c018810 con 0x7ff4a00ffda0 2024-08-19T01:30:58.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.220+0000 7ff4a8494640 1 -- 172.21.15.17:0/1117926183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a01a1c90 con 0x7ff4a00ffda0 2024-08-19T01:30:58.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.220+0000 7ff4a8494640 1 -- 172.21.15.17:0/1117926183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a01a1ff0 con 0x7ff4a00ffda0 2024-08-19T01:30:58.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.221+0000 7ff4a8494640 1 -- 172.21.15.17:0/1117926183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a0101280 con 0x7ff4a00ffda0 2024-08-19T01:30:58.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.221+0000 7ff4977fe640 1 -- 172.21.15.17:0/1117926183 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff49c010c10 con 0x7ff4a00ffda0 2024-08-19T01:30:58.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.222+0000 7ff4977fe640 1 --2- 172.21.15.17:0/1117926183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff48c06e170 0x7ff48c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:58.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.222+0000 7ff4977fe640 1 -- 172.21.15.17:0/1117926183 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff49c014070 con 0x7ff4a00ffda0 2024-08-19T01:30:58.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.222+0000 7ff4a5a2f640 1 --2- 172.21.15.17:0/1117926183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff48c06e170 0x7ff48c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:58.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.222+0000 7ff4a5a2f640 1 --2- 172.21.15.17:0/1117926183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff48c06e170 0x7ff48c070630 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0073f30 tx=0x7ff490000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:58.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.226+0000 7ff4977fe640 1 -- 172.21.15.17:0/1117926183 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff49c053df0 con 0x7ff4a00ffda0 2024-08-19T01:30:58.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.419+0000 7ff4a8494640 1 -- 172.21.15.17:0/1117926183 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4a010cdb0 con 0x7ff48c06e170 2024-08-19T01:30:58.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.421+0000 7ff4977fe640 1 -- 172.21.15.17:0/1117926183 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ff4a010cdb0 con 0x7ff48c06e170 2024-08-19T01:30:58.422 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:30:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:30:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:30:58.422 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:30:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:30:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:30:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:30:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:30:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:30:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:30:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:30:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:30:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:30:58.423 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:30:58.423 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:30:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.423+0000 7ff4a8494640 1 -- 172.21.15.17:0/1117926183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff48c06e170 msgr2=0x7ff48c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.423+0000 7ff4a8494640 1 --2- 172.21.15.17:0/1117926183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff48c06e170 0x7ff48c070630 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0073f30 tx=0x7ff490000bc0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.423+0000 7ff4a8494640 1 -- 172.21.15.17:0/1117926183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4a00ffda0 msgr2=0x7ff4a00727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.423+0000 7ff4a8494640 1 --2- 172.21.15.17:0/1117926183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4a00ffda0 0x7ff4a00727b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00e970 tx=0x7ff49c00ee30 comp rx=0 tx=0).stop 2024-08-19T01:30:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.423+0000 7ff4a8494640 1 -- 172.21.15.17:0/1117926183 shutdown_connections 2024-08-19T01:30:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.423+0000 7ff4a8494640 1 --2- 172.21.15.17:0/1117926183 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff48c06e170 0x7ff48c070630 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.423+0000 7ff4a8494640 1 --2- 172.21.15.17:0/1117926183 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4a0100750 0x7ff4a0072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.423+0000 7ff4a8494640 1 --2- 172.21.15.17:0/1117926183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4a00ffda0 0x7ff4a00727b0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.423+0000 7ff4a8494640 1 -- 172.21.15.17:0/1117926183 >> 172.21.15.17:0/1117926183 conn(0x7ff4a00fb840 msgr2=0x7ff4a00fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.423+0000 7ff4a8494640 1 -- 172.21.15.17:0/1117926183 shutdown_connections 2024-08-19T01:30:58.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.423+0000 7ff4a8494640 1 -- 172.21.15.17:0/1117926183 wait complete. 2024-08-19T01:30:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.505+0000 7f05ed66e640 1 -- 172.21.15.17:0/2377058187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e80fea30 msgr2=0x7f05e80fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.505+0000 7f05ed66e640 1 --2- 172.21.15.17:0/2377058187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e80fea30 0x7f05e80fee90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009880 tx=0x7f05dc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.505+0000 7f05ed66e640 1 -- 172.21.15.17:0/2377058187 shutdown_connections 2024-08-19T01:30:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.505+0000 7f05ed66e640 1 --2- 172.21.15.17:0/2377058187 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e80fea30 0x7f05e80fee90 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.505+0000 7f05ed66e640 1 --2- 172.21.15.17:0/2377058187 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8104a30 0x7f05e8104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.505+0000 7f05ed66e640 1 -- 172.21.15.17:0/2377058187 >> 172.21.15.17:0/2377058187 conn(0x7f05e80fa730 msgr2=0x7f05e80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.505+0000 7f05ed66e640 1 -- 172.21.15.17:0/2377058187 shutdown_connections 2024-08-19T01:30:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.505+0000 7f05ed66e640 1 -- 172.21.15.17:0/2377058187 wait complete. 2024-08-19T01:30:58.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.505+0000 7f05ed66e640 1 Processor -- start 2024-08-19T01:30:58.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05ed66e640 1 -- start start 2024-08-19T01:30:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05ed66e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e80fea30 0x7f05e8196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05ed66e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8104a30 0x7f05e8196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05ed66e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8197470 con 0x7f05e80fea30 2024-08-19T01:30:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05ed66e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e81975e0 con 0x7f05e8104a30 2024-08-19T01:30:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05e6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e80fea30 0x7f05e8196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05e6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e80fea30 0x7f05e8196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:60416/0 (socket says 172.21.15.17:60416) 2024-08-19T01:30:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05e6ffd640 1 -- 172.21.15.17:0/3668811157 learned_addr learned my addr 172.21.15.17:0/3668811157 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:30:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05e67fc640 1 --2- 172.21.15.17:0/3668811157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8104a30 0x7f05e8196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:58.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05e6ffd640 1 -- 172.21.15.17:0/3668811157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8104a30 msgr2=0x7f05e8196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05e6ffd640 1 --2- 172.21.15.17:0/3668811157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8104a30 0x7f05e8196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05e6ffd640 1 -- 172.21.15.17:0/3668811157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc009560 con 0x7f05e80fea30 2024-08-19T01:30:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.506+0000 7f05e6ffd640 1 --2- 172.21.15.17:0/3668811157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e80fea30 0x7f05e8196960 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c8f0 tx=0x7f05d800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.507+0000 7f05cffff640 1 -- 172.21.15.17:0/3668811157 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05d8007b80 con 0x7f05e80fea30 2024-08-19T01:30:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.507+0000 7f05ed66e640 1 -- 172.21.15.17:0/3668811157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e819f9d0 con 0x7f05e80fea30 2024-08-19T01:30:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.507+0000 7f05cffff640 1 -- 172.21.15.17:0/3668811157 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f05d80054e0 con 0x7f05e80fea30 2024-08-19T01:30:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.507+0000 7f05cffff640 1 -- 172.21.15.17:0/3668811157 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05d800f450 con 0x7f05e80fea30 2024-08-19T01:30:58.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.507+0000 7f05ed66e640 1 -- 172.21.15.17:0/3668811157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e819fde0 con 0x7f05e80fea30 2024-08-19T01:30:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.508+0000 7f05ed66e640 1 -- 172.21.15.17:0/3668811157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e8100170 con 0x7f05e80fea30 2024-08-19T01:30:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.508+0000 7f05cffff640 1 -- 172.21.15.17:0/3668811157 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f05d8004f60 con 0x7f05e80fea30 2024-08-19T01:30:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.509+0000 7f05cffff640 1 --2- 172.21.15.17:0/3668811157 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05d006e170 0x7f05d0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:30:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.509+0000 7f05cffff640 1 -- 172.21.15.17:0/3668811157 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f05d808dff0 con 0x7f05e80fea30 2024-08-19T01:30:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.509+0000 7f05e67fc640 1 --2- 172.21.15.17:0/3668811157 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05d006e170 0x7f05d0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:30:58.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.509+0000 7f05e67fc640 1 --2- 172.21.15.17:0/3668811157 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05d006e170 0x7f05d0070630 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f05dc000c00 tx=0x7f05dc005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:30:58.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.513+0000 7f05cffff640 1 -- 172.21.15.17:0/3668811157 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f05d80572d0 con 0x7f05e80fea30 2024-08-19T01:30:58.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.759+0000 7f05ed66e640 1 -- 172.21.15.17:0/3668811157 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f05e81977a0 con 0x7f05e80fea30 2024-08-19T01:30:58.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.759+0000 7f05cffff640 1 -- 172.21.15.17:0/3668811157 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f05e81977a0 con 0x7f05e80fea30 2024-08-19T01:30:58.761 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:30:58.761 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:30:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:30:58.761 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:30:58.761 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:30:58.761 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:30:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:30:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:30:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:30:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:30:58.762 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:30:58.763 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:30:58.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.761+0000 7f05ed66e640 1 -- 172.21.15.17:0/3668811157 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05d006e170 msgr2=0x7f05d0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:58.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.761+0000 7f05ed66e640 1 --2- 172.21.15.17:0/3668811157 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05d006e170 0x7f05d0070630 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f05dc000c00 tx=0x7f05dc005a20 comp rx=0 tx=0).stop 2024-08-19T01:30:58.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.761+0000 7f05ed66e640 1 -- 172.21.15.17:0/3668811157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e80fea30 msgr2=0x7f05e8196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:30:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.761+0000 7f05ed66e640 1 --2- 172.21.15.17:0/3668811157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e80fea30 0x7f05e8196960 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c8f0 tx=0x7f05d800cdb0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.761+0000 7f05ed66e640 1 -- 172.21.15.17:0/3668811157 shutdown_connections 2024-08-19T01:30:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.761+0000 7f05ed66e640 1 --2- 172.21.15.17:0/3668811157 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f05d006e170 0x7f05d0070630 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.761+0000 7f05ed66e640 1 --2- 172.21.15.17:0/3668811157 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f05e8104a30 0x7f05e8196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.761+0000 7f05ed66e640 1 --2- 172.21.15.17:0/3668811157 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e80fea30 0x7f05e8196960 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:30:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.761+0000 7f05ed66e640 1 -- 172.21.15.17:0/3668811157 >> 172.21.15.17:0/3668811157 conn(0x7f05e80fa730 msgr2=0x7f05e80fb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:30:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.762+0000 7f05ed66e640 1 -- 172.21.15.17:0/3668811157 shutdown_connections 2024-08-19T01:30:58.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:30:58.762+0000 7f05ed66e640 1 -- 172.21.15.17:0/3668811157 wait complete. 2024-08-19T01:30:59.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:58 smithi017 ceph-mon[99370]: from='client.35778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:59.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:58 smithi017 ceph-mon[99370]: from='client.35782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:59.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:58 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3356854140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:30:59.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:58 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3238237672' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:30:59.147 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:58 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3668811157' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:30:59.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:58 smithi086 ceph-mon[71303]: from='client.35778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:59.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:58 smithi086 ceph-mon[71303]: from='client.35782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:30:59.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:58 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3356854140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:30:59.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:58 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3238237672' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:30:59.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:58 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3668811157' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:31:00.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:59 smithi017 ceph-mon[99370]: pgmap v967: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:00.185 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:30:59 smithi017 ceph-mon[99370]: from='client.35794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:31:00.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:59 smithi086 ceph-mon[71303]: pgmap v967: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:00.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:30:59 smithi086 ceph-mon[71303]: from='client.35794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:31:02.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:01 smithi017 ceph-mon[99370]: pgmap v968: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:02.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:01 smithi086 ceph-mon[71303]: pgmap v968: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:04.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:03 smithi017 ceph-mon[99370]: pgmap v969: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:31:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:03 smithi086 ceph-mon[71303]: pgmap v969: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:31:06.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:05 smithi017 ceph-mon[99370]: pgmap v970: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:06.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:05 smithi086 ceph-mon[71303]: pgmap v970: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:08.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:07 smithi017 ceph-mon[99370]: pgmap v971: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:08.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:07 smithi086 ceph-mon[71303]: pgmap v971: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:10.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:09 smithi017 ceph-mon[99370]: pgmap v972: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:10.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:09 smithi086 ceph-mon[71303]: pgmap v972: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:12.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:11 smithi017 ceph-mon[99370]: pgmap v973: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:12.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:11 smithi086 ceph-mon[71303]: pgmap v973: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:14.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:13 smithi017 ceph-mon[99370]: pgmap v974: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:14.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:13 smithi086 ceph-mon[71303]: pgmap v974: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:15.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:15 smithi086 ceph-mon[71303]: pgmap v975: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:16.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:15 smithi017 ceph-mon[99370]: pgmap v975: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:18.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:17 smithi017 ceph-mon[99370]: pgmap v976: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:18.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:17 smithi086 ceph-mon[71303]: pgmap v976: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:19.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:31:19.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:31:20.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:19 smithi017 ceph-mon[99370]: pgmap v977: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:20.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:19 smithi086 ceph-mon[71303]: pgmap v977: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:22.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:21 smithi017 ceph-mon[99370]: pgmap v978: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:22.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:21 smithi086 ceph-mon[71303]: pgmap v978: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:24.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:23 smithi017 ceph-mon[99370]: pgmap v979: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:24.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:23 smithi086 ceph-mon[71303]: pgmap v979: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:26.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:25 smithi017 ceph-mon[99370]: pgmap v980: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:26.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:25 smithi086 ceph-mon[71303]: pgmap v980: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:28.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:27 smithi017 ceph-mon[99370]: pgmap v981: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:28.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:27 smithi086 ceph-mon[71303]: pgmap v981: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.857+0000 7f5c32d08640 1 -- 172.21.15.17:0/2189601586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c100750 msgr2=0x7f5c2c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.857+0000 7f5c32d08640 1 --2- 172.21.15.17:0/2189601586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c100750 0x7f5c2c1047a0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009880 tx=0x7f5c2002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:31:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.857+0000 7f5c32d08640 1 -- 172.21.15.17:0/2189601586 shutdown_connections 2024-08-19T01:31:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.857+0000 7f5c32d08640 1 --2- 172.21.15.17:0/2189601586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c100750 0x7f5c2c1047a0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.857+0000 7f5c32d08640 1 --2- 172.21.15.17:0/2189601586 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c2c0ffda0 0x7f5c2c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:28.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.857+0000 7f5c32d08640 1 -- 172.21.15.17:0/2189601586 >> 172.21.15.17:0/2189601586 conn(0x7f5c2c0fb840 msgr2=0x7f5c2c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.857+0000 7f5c32d08640 1 -- 172.21.15.17:0/2189601586 shutdown_connections 2024-08-19T01:31:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.857+0000 7f5c32d08640 1 -- 172.21.15.17:0/2189601586 wait complete. 2024-08-19T01:31:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c32d08640 1 Processor -- start 2024-08-19T01:31:28.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c32d08640 1 -- start start 2024-08-19T01:31:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c32d08640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c2c0ffda0 0x7f5c2c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c32d08640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c100750 0x7f5c2c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:28.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c32d08640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c073230 con 0x7f5c2c100750 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c32d08640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c073370 con 0x7f5c2c0ffda0 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c2bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c100750 0x7f5c2c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c2bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c100750 0x7f5c2c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53826/0 (socket says 172.21.15.17:53826) 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c2bfff640 1 -- 172.21.15.17:0/1768330774 learned_addr learned my addr 172.21.15.17:0/1768330774 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c30aa4640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c2c0ffda0 0x7f5c2c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c2bfff640 1 -- 172.21.15.17:0/1768330774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c2c0ffda0 msgr2=0x7f5c2c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c2bfff640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c2c0ffda0 0x7f5c2c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c2bfff640 1 -- 172.21.15.17:0/1768330774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c20009560 con 0x7f5c2c100750 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.858+0000 7f5c30aa4640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c2c0ffda0 0x7f5c2c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.859+0000 7f5c2bfff640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c100750 0x7f5c2c072cf0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5c2002a9c0 tx=0x7f5c200055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.859+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1768330774 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c20004aa0 con 0x7f5c2c100750 2024-08-19T01:31:28.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.859+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1768330774 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c20004c00 con 0x7f5c2c100750 2024-08-19T01:31:28.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.859+0000 7f5c32d08640 1 -- 172.21.15.17:0/1768330774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2c0735f0 con 0x7f5c2c100750 2024-08-19T01:31:28.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.859+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1768330774 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c20003ab0 con 0x7f5c2c100750 2024-08-19T01:31:28.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.859+0000 7f5c32d08640 1 -- 172.21.15.17:0/1768330774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2c1a2000 con 0x7f5c2c100750 2024-08-19T01:31:28.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.860+0000 7f5c32d08640 1 -- 172.21.15.17:0/1768330774 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2c101280 con 0x7f5c2c100750 2024-08-19T01:31:28.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.861+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1768330774 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5c20003c10 con 0x7f5c2c100750 2024-08-19T01:31:28.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.861+0000 7f5c29ffb640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c1406e170 0x7f5c14070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:28.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.861+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1768330774 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5c200af190 con 0x7f5c2c100750 2024-08-19T01:31:28.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.862+0000 7f5c30aa4640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c1406e170 0x7f5c14070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:28.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.862+0000 7f5c30aa4640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c1406e170 0x7f5c14070630 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c0058c0 tx=0x7f5c1c005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:28.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:28.866+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1768330774 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5c200784f0 con 0x7f5c2c100750 2024-08-19T01:31:29.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.058+0000 7f5c32d08640 1 -- 172.21.15.17:0/1768330774 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c2c10cdd0 con 0x7f5c1406e170 2024-08-19T01:31:29.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.060+0000 7f5c29ffb640 1 -- 172.21.15.17:0/1768330774 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f5c2c10cdd0 con 0x7f5c1406e170 2024-08-19T01:31:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.062+0000 7f5c32d08640 1 -- 172.21.15.17:0/1768330774 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c1406e170 msgr2=0x7f5c14070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.062+0000 7f5c32d08640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c1406e170 0x7f5c14070630 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c0058c0 tx=0x7f5c1c005d30 comp rx=0 tx=0).stop 2024-08-19T01:31:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.062+0000 7f5c32d08640 1 -- 172.21.15.17:0/1768330774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c100750 msgr2=0x7f5c2c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.062+0000 7f5c32d08640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c100750 0x7f5c2c072cf0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f5c2002a9c0 tx=0x7f5c200055a0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.062+0000 7f5c32d08640 1 -- 172.21.15.17:0/1768330774 shutdown_connections 2024-08-19T01:31:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.062+0000 7f5c32d08640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c1406e170 0x7f5c14070630 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.062+0000 7f5c32d08640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c2c100750 0x7f5c2c072cf0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.062+0000 7f5c32d08640 1 --2- 172.21.15.17:0/1768330774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c2c0ffda0 0x7f5c2c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.062+0000 7f5c32d08640 1 -- 172.21.15.17:0/1768330774 >> 172.21.15.17:0/1768330774 conn(0x7f5c2c0fb840 msgr2=0x7f5c2c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.062+0000 7f5c32d08640 1 -- 172.21.15.17:0/1768330774 shutdown_connections 2024-08-19T01:31:29.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.062+0000 7f5c32d08640 1 -- 172.21.15.17:0/1768330774 wait complete. 2024-08-19T01:31:29.072 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:31:29.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.147+0000 7f29f82f4640 1 -- 172.21.15.17:0/3992722342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f0104a30 msgr2=0x7f29f0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.147+0000 7f29f82f4640 1 --2- 172.21.15.17:0/3992722342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f0104a30 0x7f29f0104e10 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f29ec009c20 tx=0x7f29ec02a970 comp rx=0 tx=0).stop 2024-08-19T01:31:29.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.147+0000 7f29f82f4640 1 -- 172.21.15.17:0/3992722342 shutdown_connections 2024-08-19T01:31:29.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.147+0000 7f29f82f4640 1 --2- 172.21.15.17:0/3992722342 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f00fea30 0x7f29f00fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.147+0000 7f29f82f4640 1 --2- 172.21.15.17:0/3992722342 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f0104a30 0x7f29f0104e10 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.147+0000 7f29f82f4640 1 -- 172.21.15.17:0/3992722342 >> 172.21.15.17:0/3992722342 conn(0x7f29f00fa730 msgr2=0x7f29f00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:29.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.147+0000 7f29f82f4640 1 -- 172.21.15.17:0/3992722342 shutdown_connections 2024-08-19T01:31:29.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.147+0000 7f29f82f4640 1 -- 172.21.15.17:0/3992722342 wait complete. 2024-08-19T01:31:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f82f4640 1 Processor -- start 2024-08-19T01:31:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f82f4640 1 -- start start 2024-08-19T01:31:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f82f4640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f00fea30 0x7f29f019a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f82f4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f0104a30 0x7f29f019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f82f4640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f019b390 con 0x7f29f0104a30 2024-08-19T01:31:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f82f4640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0194920 con 0x7f29f00fea30 2024-08-19T01:31:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f588f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f0104a30 0x7f29f019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:29.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f588f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f0104a30 0x7f29f019ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53846/0 (socket says 172.21.15.17:53846) 2024-08-19T01:31:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f588f640 1 -- 172.21.15.17:0/1325802882 learned_addr learned my addr 172.21.15.17:0/1325802882 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:31:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f6090640 1 --2- 172.21.15.17:0/1325802882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f00fea30 0x7f29f019a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f588f640 1 -- 172.21.15.17:0/1325802882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f00fea30 msgr2=0x7f29f019a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f588f640 1 --2- 172.21.15.17:0/1325802882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f00fea30 0x7f29f019a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f588f640 1 -- 172.21.15.17:0/1325802882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec009900 con 0x7f29f0104a30 2024-08-19T01:31:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.148+0000 7f29f588f640 1 --2- 172.21.15.17:0/1325802882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f0104a30 0x7f29f019ad70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f29e000b420 tx=0x7f29e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.149+0000 7f29e77fe640 1 -- 172.21.15.17:0/1325802882 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e0011800 con 0x7f29f0104a30 2024-08-19T01:31:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.149+0000 7f29e77fe640 1 -- 172.21.15.17:0/1325802882 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f29e0011e20 con 0x7f29f0104a30 2024-08-19T01:31:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.149+0000 7f29f82f4640 1 -- 172.21.15.17:0/1325802882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f0194c00 con 0x7f29f0104a30 2024-08-19T01:31:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.149+0000 7f29e77fe640 1 -- 172.21.15.17:0/1325802882 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29e000f2e0 con 0x7f29f0104a30 2024-08-19T01:31:29.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.149+0000 7f29f82f4640 1 -- 172.21.15.17:0/1325802882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f0195150 con 0x7f29f0104a30 2024-08-19T01:31:29.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.150+0000 7f29f82f4640 1 -- 172.21.15.17:0/1325802882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f0100170 con 0x7f29f0104a30 2024-08-19T01:31:29.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.150+0000 7f29e77fe640 1 -- 172.21.15.17:0/1325802882 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f29e0010380 con 0x7f29f0104a30 2024-08-19T01:31:29.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.151+0000 7f29e77fe640 1 --2- 172.21.15.17:0/1325802882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29dc06e170 0x7f29dc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:29.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.151+0000 7f29e77fe640 1 -- 172.21.15.17:0/1325802882 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f29e008daf0 con 0x7f29f0104a30 2024-08-19T01:31:29.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.151+0000 7f29f6090640 1 --2- 172.21.15.17:0/1325802882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29dc06e170 0x7f29dc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:29.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.151+0000 7f29f6090640 1 --2- 172.21.15.17:0/1325802882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29dc06e170 0x7f29dc070630 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0098d0 tx=0x7f29ec009800 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:29.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.155+0000 7f29e77fe640 1 -- 172.21.15.17:0/1325802882 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f29e0056dd0 con 0x7f29f0104a30 2024-08-19T01:31:29.352 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.350+0000 7f29f82f4640 1 -- 172.21.15.17:0/1325802882 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29f010bd20 con 0x7f29dc06e170 2024-08-19T01:31:29.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.352+0000 7f29e77fe640 1 -- 172.21.15.17:0/1325802882 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f29f010bd20 con 0x7f29dc06e170 2024-08-19T01:31:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.353+0000 7f29f82f4640 1 -- 172.21.15.17:0/1325802882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29dc06e170 msgr2=0x7f29dc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.354+0000 7f29f82f4640 1 --2- 172.21.15.17:0/1325802882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29dc06e170 0x7f29dc070630 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0098d0 tx=0x7f29ec009800 comp rx=0 tx=0).stop 2024-08-19T01:31:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.354+0000 7f29f82f4640 1 -- 172.21.15.17:0/1325802882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f0104a30 msgr2=0x7f29f019ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.354+0000 7f29f82f4640 1 --2- 172.21.15.17:0/1325802882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f0104a30 0x7f29f019ad70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f29e000b420 tx=0x7f29e000b8e0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.354+0000 7f29f82f4640 1 -- 172.21.15.17:0/1325802882 shutdown_connections 2024-08-19T01:31:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.354+0000 7f29f82f4640 1 --2- 172.21.15.17:0/1325802882 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f29dc06e170 0x7f29dc070630 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.354+0000 7f29f82f4640 1 --2- 172.21.15.17:0/1325802882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29f0104a30 0x7f29f019ad70 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.354+0000 7f29f82f4640 1 --2- 172.21.15.17:0/1325802882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29f00fea30 0x7f29f019a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.354+0000 7f29f82f4640 1 -- 172.21.15.17:0/1325802882 >> 172.21.15.17:0/1325802882 conn(0x7f29f00fa730 msgr2=0x7f29f00fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.354+0000 7f29f82f4640 1 -- 172.21.15.17:0/1325802882 shutdown_connections 2024-08-19T01:31:29.356 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.354+0000 7f29f82f4640 1 -- 172.21.15.17:0/1325802882 wait complete. 2024-08-19T01:31:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.436+0000 7f5c7b75d640 1 -- 172.21.15.17:0/2413561434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c741049f0 msgr2=0x7f5c74104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.436+0000 7f5c7b75d640 1 --2- 172.21.15.17:0/2413561434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c741049f0 0x7f5c74104dd0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009880 tx=0x7f5c7002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.436+0000 7f5c7b75d640 1 -- 172.21.15.17:0/2413561434 shutdown_connections 2024-08-19T01:31:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.436+0000 7f5c7b75d640 1 --2- 172.21.15.17:0/2413561434 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c740fe9f0 0x7f5c740fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.436+0000 7f5c7b75d640 1 --2- 172.21.15.17:0/2413561434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c741049f0 0x7f5c74104dd0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.436+0000 7f5c7b75d640 1 -- 172.21.15.17:0/2413561434 >> 172.21.15.17:0/2413561434 conn(0x7f5c740758a0 msgr2=0x7f5c740fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.436+0000 7f5c7b75d640 1 -- 172.21.15.17:0/2413561434 shutdown_connections 2024-08-19T01:31:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.436+0000 7f5c7b75d640 1 -- 172.21.15.17:0/2413561434 wait complete. 2024-08-19T01:31:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c7b75d640 1 Processor -- start 2024-08-19T01:31:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c7b75d640 1 -- start start 2024-08-19T01:31:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c7b75d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c740fe9f0 0x7f5c74196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c7b75d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c741049f0 0x7f5c74196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:29.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c7b75d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74197460 con 0x7f5c741049f0 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c7b75d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c741975d0 con 0x7f5c740fe9f0 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c78cf8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c741049f0 0x7f5c74196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c78cf8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c741049f0 0x7f5c74196e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53860/0 (socket says 172.21.15.17:53860) 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c78cf8640 1 -- 172.21.15.17:0/3095478486 learned_addr learned my addr 172.21.15.17:0/3095478486 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c794f9640 1 --2- 172.21.15.17:0/3095478486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c740fe9f0 0x7f5c74196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c78cf8640 1 -- 172.21.15.17:0/3095478486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c740fe9f0 msgr2=0x7f5c74196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c78cf8640 1 --2- 172.21.15.17:0/3095478486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c740fe9f0 0x7f5c74196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.437+0000 7f5c78cf8640 1 -- 172.21.15.17:0/3095478486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c70009560 con 0x7f5c741049f0 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.438+0000 7f5c78cf8640 1 --2- 172.21.15.17:0/3095478486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c741049f0 0x7f5c74196e40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400c810 tx=0x7f5c6400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.438+0000 7f5c6a7fc640 1 -- 172.21.15.17:0/3095478486 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c640041f0 con 0x7f5c741049f0 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.438+0000 7f5c6a7fc640 1 -- 172.21.15.17:0/3095478486 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c64007e70 con 0x7f5c741049f0 2024-08-19T01:31:29.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.438+0000 7f5c7b75d640 1 -- 172.21.15.17:0/3095478486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7419f970 con 0x7f5c741049f0 2024-08-19T01:31:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.438+0000 7f5c6a7fc640 1 -- 172.21.15.17:0/3095478486 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c640049d0 con 0x7f5c741049f0 2024-08-19T01:31:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.438+0000 7f5c7b75d640 1 -- 172.21.15.17:0/3095478486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7419fe60 con 0x7f5c741049f0 2024-08-19T01:31:29.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.439+0000 7f5c7b75d640 1 -- 172.21.15.17:0/3095478486 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c74100130 con 0x7f5c741049f0 2024-08-19T01:31:29.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.439+0000 7f5c6a7fc640 1 -- 172.21.15.17:0/3095478486 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5c640079b0 con 0x7f5c741049f0 2024-08-19T01:31:29.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.440+0000 7f5c6a7fc640 1 --2- 172.21.15.17:0/3095478486 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c6006e170 0x7f5c60070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:29.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.440+0000 7f5c6a7fc640 1 -- 172.21.15.17:0/3095478486 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5c6408dfe0 con 0x7f5c741049f0 2024-08-19T01:31:29.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.440+0000 7f5c794f9640 1 --2- 172.21.15.17:0/3095478486 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c6006e170 0x7f5c60070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:29.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.440+0000 7f5c794f9640 1 --2- 172.21.15.17:0/3095478486 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c6006e170 0x7f5c60070630 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5c70000c00 tx=0x7f5c70005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:29.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.444+0000 7f5c6a7fc640 1 -- 172.21.15.17:0/3095478486 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5c640572c0 con 0x7f5c741049f0 2024-08-19T01:31:29.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.627+0000 7f5c7b75d640 1 -- 172.21.15.17:0/3095478486 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c7410bc60 con 0x7f5c6006e170 2024-08-19T01:31:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.636+0000 7f5c6a7fc640 1 -- 172.21.15.17:0/3095478486 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f5c7410bc60 con 0x7f5c6006e170 2024-08-19T01:31:29.638 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:31:29.638 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (32m) 11m ago 43m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (43m) 11m ago 43m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (42m) 11m ago 42m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (30m) 11m ago 43m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (30m) 11m ago 42m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (32m) 11m ago 43m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (26m) 11m ago 37m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (27m) 11m ago 38m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (11m) 11m ago 37m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (26m) 11m ago 38m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (34m) 11m ago 44m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (33m) 11m ago 42m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (31m) 11m ago 44m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (31m) 11m ago 42m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:31:29.639 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (33m) 11m ago 43m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:31:29.640 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (33m) 11m ago 42m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:31:29.640 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (30m) 11m ago 41m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:31:29.640 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (29m) 11m ago 41m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:31:29.640 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (29m) 11m ago 40m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:31:29.640 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (28m) 11m ago 40m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:31:29.640 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (27m) 11m ago 39m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:31:29.640 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (27m) 11m ago 39m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:31:29.640 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (33m) 11m ago 43m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:31:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.639+0000 7f5c7b75d640 1 -- 172.21.15.17:0/3095478486 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c6006e170 msgr2=0x7f5c60070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.639+0000 7f5c7b75d640 1 --2- 172.21.15.17:0/3095478486 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c6006e170 0x7f5c60070630 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5c70000c00 tx=0x7f5c70005a20 comp rx=0 tx=0).stop 2024-08-19T01:31:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.639+0000 7f5c7b75d640 1 -- 172.21.15.17:0/3095478486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c741049f0 msgr2=0x7f5c74196e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.639+0000 7f5c7b75d640 1 --2- 172.21.15.17:0/3095478486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c741049f0 0x7f5c74196e40 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400c810 tx=0x7f5c6400ccd0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.639+0000 7f5c7b75d640 1 -- 172.21.15.17:0/3095478486 shutdown_connections 2024-08-19T01:31:29.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.639+0000 7f5c7b75d640 1 --2- 172.21.15.17:0/3095478486 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5c6006e170 0x7f5c60070630 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.639+0000 7f5c7b75d640 1 --2- 172.21.15.17:0/3095478486 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5c741049f0 0x7f5c74196e40 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.639+0000 7f5c7b75d640 1 --2- 172.21.15.17:0/3095478486 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5c740fe9f0 0x7f5c74196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.639+0000 7f5c7b75d640 1 -- 172.21.15.17:0/3095478486 >> 172.21.15.17:0/3095478486 conn(0x7f5c740758a0 msgr2=0x7f5c740fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:29.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.639+0000 7f5c7b75d640 1 -- 172.21.15.17:0/3095478486 shutdown_connections 2024-08-19T01:31:29.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.639+0000 7f5c7b75d640 1 -- 172.21.15.17:0/3095478486 wait complete. 2024-08-19T01:31:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.724+0000 7fd42d0ff640 1 -- 172.21.15.17:0/4260924384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4280fe9f0 msgr2=0x7fd4280fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.724+0000 7fd42d0ff640 1 --2- 172.21.15.17:0/4260924384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4280fe9f0 0x7fd4280fee50 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009880 tx=0x7fd41c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.724+0000 7fd42d0ff640 1 -- 172.21.15.17:0/4260924384 shutdown_connections 2024-08-19T01:31:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.724+0000 7fd42d0ff640 1 --2- 172.21.15.17:0/4260924384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4280fe9f0 0x7fd4280fee50 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.724+0000 7fd42d0ff640 1 --2- 172.21.15.17:0/4260924384 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4281049f0 0x7fd428104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.724+0000 7fd42d0ff640 1 -- 172.21.15.17:0/4260924384 >> 172.21.15.17:0/4260924384 conn(0x7fd4280758a0 msgr2=0x7fd4280fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.724+0000 7fd42d0ff640 1 -- 172.21.15.17:0/4260924384 shutdown_connections 2024-08-19T01:31:29.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.724+0000 7fd42d0ff640 1 -- 172.21.15.17:0/4260924384 wait complete. 2024-08-19T01:31:29.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.725+0000 7fd42d0ff640 1 Processor -- start 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.725+0000 7fd42d0ff640 1 -- start start 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.725+0000 7fd42d0ff640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4280fe9f0 0x7fd42819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.725+0000 7fd42d0ff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4281049f0 0x7fd42819df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.725+0000 7fd42d0ff640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42819e5b0 con 0x7fd4281049f0 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.725+0000 7fd42d0ff640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd428197b40 con 0x7fd4280fe9f0 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.725+0000 7fd42659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4281049f0 0x7fd42819df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.726+0000 7fd42659c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4281049f0 0x7fd42819df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53868/0 (socket says 172.21.15.17:53868) 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.726+0000 7fd42659c640 1 -- 172.21.15.17:0/1619583883 learned_addr learned my addr 172.21.15.17:0/1619583883 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.726+0000 7fd426d9d640 1 --2- 172.21.15.17:0/1619583883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4280fe9f0 0x7fd42819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.726+0000 7fd42659c640 1 -- 172.21.15.17:0/1619583883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4280fe9f0 msgr2=0x7fd42819da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.726+0000 7fd42659c640 1 --2- 172.21.15.17:0/1619583883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4280fe9f0 0x7fd42819da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.726+0000 7fd42659c640 1 -- 172.21.15.17:0/1619583883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c009560 con 0x7fd4281049f0 2024-08-19T01:31:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.726+0000 7fd42659c640 1 --2- 172.21.15.17:0/1619583883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4281049f0 0x7fd42819df90 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd41c006010 tx=0x7fd41c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.726+0000 7fd40ffff640 1 -- 172.21.15.17:0/1619583883 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd41c004aa0 con 0x7fd4281049f0 2024-08-19T01:31:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.726+0000 7fd40ffff640 1 -- 172.21.15.17:0/1619583883 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd41c031470 con 0x7fd4281049f0 2024-08-19T01:31:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.726+0000 7fd42d0ff640 1 -- 172.21.15.17:0/1619583883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd428197dc0 con 0x7fd4281049f0 2024-08-19T01:31:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.726+0000 7fd40ffff640 1 -- 172.21.15.17:0/1619583883 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd41c003940 con 0x7fd4281049f0 2024-08-19T01:31:29.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.727+0000 7fd42d0ff640 1 -- 172.21.15.17:0/1619583883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4281982b0 con 0x7fd4281049f0 2024-08-19T01:31:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.728+0000 7fd42d0ff640 1 -- 172.21.15.17:0/1619583883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd428100130 con 0x7fd4281049f0 2024-08-19T01:31:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.728+0000 7fd40ffff640 1 -- 172.21.15.17:0/1619583883 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd41c031b90 con 0x7fd4281049f0 2024-08-19T01:31:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.729+0000 7fd40ffff640 1 --2- 172.21.15.17:0/1619583883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd41006e180 0x7fd410070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.729+0000 7fd40ffff640 1 -- 172.21.15.17:0/1619583883 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd41c0af1a0 con 0x7fd4281049f0 2024-08-19T01:31:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.729+0000 7fd426d9d640 1 --2- 172.21.15.17:0/1619583883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd41006e180 0x7fd410070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:29.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.730+0000 7fd426d9d640 1 --2- 172.21.15.17:0/1619583883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd41006e180 0x7fd410070640 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd418005fd0 tx=0x7fd41800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:29.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.733+0000 7fd40ffff640 1 -- 172.21.15.17:0/1619583883 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd41c078550 con 0x7fd4281049f0 2024-08-19T01:31:29.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.979+0000 7fd42d0ff640 1 -- 172.21.15.17:0/1619583883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd4280fee50 con 0x7fd4281049f0 2024-08-19T01:31:29.981 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:29 smithi017 ceph-mon[99370]: pgmap v982: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:29.981 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:29 smithi017 ceph-mon[99370]: from='client.35802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:31:29.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.980+0000 7fd40ffff640 1 -- 172.21.15.17:0/1619583883 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fd41c004c00 con 0x7fd4281049f0 2024-08-19T01:31:29.982 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:31:29.982 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:31:29.982 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:31:29.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:31:29.982 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:31:29.982 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:31:29.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:31:29.983 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:31:29.983 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:31:29.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:31:29.983 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:31:29.983 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:31:29.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:31:29.983 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:31:29.983 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:31:29.983 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:31:29.983 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:31:29.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.982+0000 7fd42d0ff640 1 -- 172.21.15.17:0/1619583883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd41006e180 msgr2=0x7fd410070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.982+0000 7fd42d0ff640 1 --2- 172.21.15.17:0/1619583883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd41006e180 0x7fd410070640 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd418005fd0 tx=0x7fd41800b390 comp rx=0 tx=0).stop 2024-08-19T01:31:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.982+0000 7fd42d0ff640 1 -- 172.21.15.17:0/1619583883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4281049f0 msgr2=0x7fd42819df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.982+0000 7fd42d0ff640 1 --2- 172.21.15.17:0/1619583883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4281049f0 0x7fd42819df90 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd41c006010 tx=0x7fd41c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.982+0000 7fd42d0ff640 1 -- 172.21.15.17:0/1619583883 shutdown_connections 2024-08-19T01:31:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.982+0000 7fd42d0ff640 1 --2- 172.21.15.17:0/1619583883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd41006e180 0x7fd410070640 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.982+0000 7fd42d0ff640 1 --2- 172.21.15.17:0/1619583883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4281049f0 0x7fd42819df90 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.982+0000 7fd42d0ff640 1 --2- 172.21.15.17:0/1619583883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4280fe9f0 0x7fd42819da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:29.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.982+0000 7fd42d0ff640 1 -- 172.21.15.17:0/1619583883 >> 172.21.15.17:0/1619583883 conn(0x7fd4280758a0 msgr2=0x7fd4280fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:29.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.982+0000 7fd42d0ff640 1 -- 172.21.15.17:0/1619583883 shutdown_connections 2024-08-19T01:31:29.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:29.982+0000 7fd42d0ff640 1 -- 172.21.15.17:0/1619583883 wait complete. 2024-08-19T01:31:30.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.064+0000 7f291ac1f640 1 -- 172.21.15.17:0/487144560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2914100750 msgr2=0x7f29141047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.064+0000 7f291ac1f640 1 --2- 172.21.15.17:0/487144560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2914100750 0x7f29141047a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f2908009880 tx=0x7f290802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.064+0000 7f291ac1f640 1 -- 172.21.15.17:0/487144560 shutdown_connections 2024-08-19T01:31:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.064+0000 7f291ac1f640 1 --2- 172.21.15.17:0/487144560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2914100750 0x7f29141047a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.064+0000 7f291ac1f640 1 --2- 172.21.15.17:0/487144560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29140ffda0 0x7f2914100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.064+0000 7f291ac1f640 1 -- 172.21.15.17:0/487144560 >> 172.21.15.17:0/487144560 conn(0x7f29140fb840 msgr2=0x7f29140fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.064+0000 7f291ac1f640 1 -- 172.21.15.17:0/487144560 shutdown_connections 2024-08-19T01:31:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.064+0000 7f291ac1f640 1 -- 172.21.15.17:0/487144560 wait complete. 2024-08-19T01:31:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.065+0000 7f291ac1f640 1 Processor -- start 2024-08-19T01:31:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.065+0000 7f291ac1f640 1 -- start start 2024-08-19T01:31:30.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.065+0000 7f291ac1f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29140ffda0 0x7f291419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.065+0000 7f291ac1f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2914100750 0x7f291419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.065+0000 7f291ac1f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2914195930 con 0x7f2914100750 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.065+0000 7f291ac1f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2914195a70 con 0x7f29140ffda0 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.065+0000 7f2913fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2914100750 0x7f291419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.065+0000 7f2913fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2914100750 0x7f291419be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53890/0 (socket says 172.21.15.17:53890) 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.065+0000 7f2913fff640 1 -- 172.21.15.17:0/1365548743 learned_addr learned my addr 172.21.15.17:0/1365548743 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.065+0000 7f29189bb640 1 --2- 172.21.15.17:0/1365548743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29140ffda0 0x7f291419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.066+0000 7f2913fff640 1 -- 172.21.15.17:0/1365548743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29140ffda0 msgr2=0x7f291419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.066+0000 7f2913fff640 1 --2- 172.21.15.17:0/1365548743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29140ffda0 0x7f291419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.066+0000 7f2913fff640 1 -- 172.21.15.17:0/1365548743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2908009560 con 0x7f2914100750 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.066+0000 7f2913fff640 1 --2- 172.21.15.17:0/1365548743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2914100750 0x7f291419be10 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f290802a9c0 tx=0x7f29080055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.066+0000 7f2911ffb640 1 -- 172.21.15.17:0/1365548743 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2908004aa0 con 0x7f2914100750 2024-08-19T01:31:30.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.066+0000 7f291ac1f640 1 -- 172.21.15.17:0/1365548743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2914195cf0 con 0x7f2914100750 2024-08-19T01:31:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.066+0000 7f2911ffb640 1 -- 172.21.15.17:0/1365548743 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2908004c00 con 0x7f2914100750 2024-08-19T01:31:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.066+0000 7f2911ffb640 1 -- 172.21.15.17:0/1365548743 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2908003980 con 0x7f2914100750 2024-08-19T01:31:30.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.066+0000 7f291ac1f640 1 -- 172.21.15.17:0/1365548743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29141961e0 con 0x7f2914100750 2024-08-19T01:31:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.067+0000 7f291ac1f640 1 -- 172.21.15.17:0/1365548743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2914101280 con 0x7f2914100750 2024-08-19T01:31:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.068+0000 7f2911ffb640 1 -- 172.21.15.17:0/1365548743 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2908003bf0 con 0x7f2914100750 2024-08-19T01:31:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.068+0000 7f2911ffb640 1 --2- 172.21.15.17:0/1365548743 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28fc06e170 0x7f28fc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.068+0000 7f2911ffb640 1 -- 172.21.15.17:0/1365548743 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f29080af200 con 0x7f2914100750 2024-08-19T01:31:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.068+0000 7f29189bb640 1 --2- 172.21.15.17:0/1365548743 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28fc06e170 0x7f28fc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:30.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.069+0000 7f29189bb640 1 --2- 172.21.15.17:0/1365548743 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28fc06e170 0x7f28fc070630 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f290c005fd0 tx=0x7f290c009680 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:30.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.073+0000 7f2911ffb640 1 -- 172.21.15.17:0/1365548743 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f29080784f0 con 0x7f2914100750 2024-08-19T01:31:30.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:29 smithi086 ceph-mon[71303]: pgmap v982: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:30.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:29 smithi086 ceph-mon[71303]: from='client.35802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:31:30.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.285+0000 7f291ac1f640 1 -- 172.21.15.17:0/1365548743 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f29141080b0 con 0x7f2914100750 2024-08-19T01:31:30.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.285+0000 7f2911ffb640 1 -- 172.21.15.17:0/1365548743 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f290807bbb0 con 0x7f2914100750 2024-08-19T01:31:30.287 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:31:30.287 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:31:30.287 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:31:30.287 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:31:30.287 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:31:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:31:30.287 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:31:30.287 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:31:30.287 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:31:30.288 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:31:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:31:30.290 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:31:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:31:30.290 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:31:30.290 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:31:30.290 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:31:30.290 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:31:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:31:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.287+0000 7f291ac1f640 1 -- 172.21.15.17:0/1365548743 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28fc06e170 msgr2=0x7f28fc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.287+0000 7f291ac1f640 1 --2- 172.21.15.17:0/1365548743 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28fc06e170 0x7f28fc070630 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f290c005fd0 tx=0x7f290c009680 comp rx=0 tx=0).stop 2024-08-19T01:31:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.287+0000 7f291ac1f640 1 -- 172.21.15.17:0/1365548743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2914100750 msgr2=0x7f291419be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.287+0000 7f291ac1f640 1 --2- 172.21.15.17:0/1365548743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2914100750 0x7f291419be10 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f290802a9c0 tx=0x7f29080055a0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.287+0000 7f291ac1f640 1 -- 172.21.15.17:0/1365548743 shutdown_connections 2024-08-19T01:31:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.287+0000 7f291ac1f640 1 --2- 172.21.15.17:0/1365548743 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f28fc06e170 0x7f28fc070630 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.287+0000 7f291ac1f640 1 --2- 172.21.15.17:0/1365548743 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2914100750 0x7f291419be10 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.287+0000 7f291ac1f640 1 --2- 172.21.15.17:0/1365548743 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f29140ffda0 0x7f291419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.287+0000 7f291ac1f640 1 -- 172.21.15.17:0/1365548743 >> 172.21.15.17:0/1365548743 conn(0x7f29140fb840 msgr2=0x7f29140fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.287+0000 7f291ac1f640 1 -- 172.21.15.17:0/1365548743 shutdown_connections 2024-08-19T01:31:30.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.287+0000 7f291ac1f640 1 -- 172.21.15.17:0/1365548743 wait complete. 2024-08-19T01:31:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.370+0000 7f4b0e291640 1 -- 172.21.15.17:0/2422290490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b080fea30 msgr2=0x7f4b080fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.370+0000 7f4b0e291640 1 --2- 172.21.15.17:0/2422290490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b080fea30 0x7f4b080fee90 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009880 tx=0x7f4afc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.370+0000 7f4b0e291640 1 -- 172.21.15.17:0/2422290490 shutdown_connections 2024-08-19T01:31:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.370+0000 7f4b0e291640 1 --2- 172.21.15.17:0/2422290490 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b080fea30 0x7f4b080fee90 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.370+0000 7f4b0e291640 1 --2- 172.21.15.17:0/2422290490 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b08104a30 0x7f4b08104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.370+0000 7f4b0e291640 1 -- 172.21.15.17:0/2422290490 >> 172.21.15.17:0/2422290490 conn(0x7f4b080fa730 msgr2=0x7f4b080fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.370+0000 7f4b0e291640 1 -- 172.21.15.17:0/2422290490 shutdown_connections 2024-08-19T01:31:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.370+0000 7f4b0e291640 1 -- 172.21.15.17:0/2422290490 wait complete. 2024-08-19T01:31:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.370+0000 7f4b0e291640 1 Processor -- start 2024-08-19T01:31:30.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.370+0000 7f4b0e291640 1 -- start start 2024-08-19T01:31:30.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b0e291640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b080fea30 0x7f4b0819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:30.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b0e291640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b08104a30 0x7f4b0819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:30.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b0e291640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0819c490 con 0x7f4b080fea30 2024-08-19T01:31:30.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b0e291640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b08195a20 con 0x7f4b08104a30 2024-08-19T01:31:30.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b080fea30 0x7f4b0819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:30.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b07fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b080fea30 0x7f4b0819b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53912/0 (socket says 172.21.15.17:53912) 2024-08-19T01:31:30.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b07fff640 1 -- 172.21.15.17:0/1840775009 learned_addr learned my addr 172.21.15.17:0/1840775009 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:31:30.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b077fe640 1 --2- 172.21.15.17:0/1840775009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b08104a30 0x7f4b0819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:30.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b07fff640 1 -- 172.21.15.17:0/1840775009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b08104a30 msgr2=0x7f4b0819be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b07fff640 1 --2- 172.21.15.17:0/1840775009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b08104a30 0x7f4b0819be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b07fff640 1 -- 172.21.15.17:0/1840775009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc009560 con 0x7f4b080fea30 2024-08-19T01:31:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.371+0000 7f4b07fff640 1 --2- 172.21.15.17:0/1840775009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b080fea30 0x7f4b0819b930 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f4af800b420 tx=0x7f4af800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.372+0000 7f4b057fa640 1 -- 172.21.15.17:0/1840775009 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af8011800 con 0x7f4b080fea30 2024-08-19T01:31:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.372+0000 7f4b057fa640 1 -- 172.21.15.17:0/1840775009 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4af8011e20 con 0x7f4b080fea30 2024-08-19T01:31:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.372+0000 7f4b0e291640 1 -- 172.21.15.17:0/1840775009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b08195d00 con 0x7f4b080fea30 2024-08-19T01:31:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.372+0000 7f4b057fa640 1 -- 172.21.15.17:0/1840775009 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af800f2e0 con 0x7f4b080fea30 2024-08-19T01:31:30.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.372+0000 7f4b0e291640 1 -- 172.21.15.17:0/1840775009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b08196220 con 0x7f4b080fea30 2024-08-19T01:31:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.373+0000 7f4b0e291640 1 -- 172.21.15.17:0/1840775009 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b08100170 con 0x7f4b080fea30 2024-08-19T01:31:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.373+0000 7f4b057fa640 1 -- 172.21.15.17:0/1840775009 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4af8010380 con 0x7f4b080fea30 2024-08-19T01:31:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.374+0000 7f4b057fa640 1 --2- 172.21.15.17:0/1840775009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4af006e170 0x7f4af0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.374+0000 7f4b077fe640 1 --2- 172.21.15.17:0/1840775009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4af006e170 0x7f4af0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.374+0000 7f4b057fa640 1 -- 172.21.15.17:0/1840775009 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4af808da60 con 0x7f4b080fea30 2024-08-19T01:31:30.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.374+0000 7f4b077fe640 1 --2- 172.21.15.17:0/1840775009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4af006e170 0x7f4af0070630 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009230 tx=0x7f4afc0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:30.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.378+0000 7f4b057fa640 1 -- 172.21.15.17:0/1840775009 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4af8056d40 con 0x7f4b080fea30 2024-08-19T01:31:30.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.570+0000 7f4b0e291640 1 -- 172.21.15.17:0/1840775009 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b08108090 con 0x7f4af006e170 2024-08-19T01:31:30.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.571+0000 7f4b057fa640 1 -- 172.21.15.17:0/1840775009 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4b08108090 con 0x7f4af006e170 2024-08-19T01:31:30.573 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:31:30.573 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:31:30.573 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:31:30.573 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:31:30.573 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:31:30.573 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:31:30.574 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:31:30.574 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:31:30.574 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:31:30.574 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:31:30.574 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:31:30.574 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:31:30.574 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:31:30.574 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:31:30.574 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:31:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.574+0000 7f4b0e291640 1 -- 172.21.15.17:0/1840775009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4af006e170 msgr2=0x7f4af0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.574+0000 7f4b0e291640 1 --2- 172.21.15.17:0/1840775009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4af006e170 0x7f4af0070630 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009230 tx=0x7f4afc0058d0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.574+0000 7f4b0e291640 1 -- 172.21.15.17:0/1840775009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b080fea30 msgr2=0x7f4b0819b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.574+0000 7f4b0e291640 1 --2- 172.21.15.17:0/1840775009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b080fea30 0x7f4b0819b930 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f4af800b420 tx=0x7f4af800b8e0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.574+0000 7f4b0e291640 1 -- 172.21.15.17:0/1840775009 shutdown_connections 2024-08-19T01:31:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.574+0000 7f4b0e291640 1 --2- 172.21.15.17:0/1840775009 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4af006e170 0x7f4af0070630 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.574+0000 7f4b0e291640 1 --2- 172.21.15.17:0/1840775009 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4b08104a30 0x7f4b0819be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.574+0000 7f4b0e291640 1 --2- 172.21.15.17:0/1840775009 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4b080fea30 0x7f4b0819b930 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.574+0000 7f4b0e291640 1 -- 172.21.15.17:0/1840775009 >> 172.21.15.17:0/1840775009 conn(0x7f4b080fa730 msgr2=0x7f4b08068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.574+0000 7f4b0e291640 1 -- 172.21.15.17:0/1840775009 shutdown_connections 2024-08-19T01:31:30.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.574+0000 7f4b0e291640 1 -- 172.21.15.17:0/1840775009 wait complete. 2024-08-19T01:31:30.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.655+0000 7f7eee560640 1 -- 172.21.15.17:0/1630966047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ee81015d0 msgr2=0x7f7ee8109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.655+0000 7f7eee560640 1 --2- 172.21.15.17:0/1630966047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ee81015d0 0x7f7ee8109ac0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009880 tx=0x7f7edc02a530 comp rx=0 tx=0).stop 2024-08-19T01:31:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.656+0000 7f7eee560640 1 -- 172.21.15.17:0/1630966047 shutdown_connections 2024-08-19T01:31:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.656+0000 7f7eee560640 1 --2- 172.21.15.17:0/1630966047 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ee81015d0 0x7f7ee8109ac0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.656+0000 7f7eee560640 1 --2- 172.21.15.17:0/1630966047 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee8100cb0 0x7f7ee8101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.656+0000 7f7eee560640 1 -- 172.21.15.17:0/1630966047 >> 172.21.15.17:0/1630966047 conn(0x7f7ee80758a0 msgr2=0x7f7ee80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.656+0000 7f7eee560640 1 -- 172.21.15.17:0/1630966047 shutdown_connections 2024-08-19T01:31:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.656+0000 7f7eee560640 1 -- 172.21.15.17:0/1630966047 wait complete. 2024-08-19T01:31:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.656+0000 7f7eee560640 1 Processor -- start 2024-08-19T01:31:30.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.656+0000 7f7eee560640 1 -- start start 2024-08-19T01:31:30.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7eee560640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee8100cb0 0x7f7ee819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:30.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7eee560640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ee81015d0 0x7f7ee819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7eee560640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee819c390 con 0x7f7ee81015d0 2024-08-19T01:31:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7eee560640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8195920 con 0x7f7ee8100cb0 2024-08-19T01:31:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ee81015d0 0x7f7ee819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7ee77fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ee81015d0 0x7f7ee819bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:53942/0 (socket says 172.21.15.17:53942) 2024-08-19T01:31:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7ee77fe640 1 -- 172.21.15.17:0/3029369780 learned_addr learned my addr 172.21.15.17:0/3029369780 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:31:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7ee7fff640 1 --2- 172.21.15.17:0/3029369780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee8100cb0 0x7f7ee819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7ee77fe640 1 -- 172.21.15.17:0/3029369780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee8100cb0 msgr2=0x7f7ee819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7ee77fe640 1 --2- 172.21.15.17:0/3029369780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee8100cb0 0x7f7ee819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7ee77fe640 1 -- 172.21.15.17:0/3029369780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc009560 con 0x7f7ee81015d0 2024-08-19T01:31:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7ee77fe640 1 --2- 172.21.15.17:0/3029369780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ee81015d0 0x7f7ee819bd70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7edc02aa50 tx=0x7f7edc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:30.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7ee57fa640 1 -- 172.21.15.17:0/3029369780 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7edc004aa0 con 0x7f7ee81015d0 2024-08-19T01:31:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7ee57fa640 1 -- 172.21.15.17:0/3029369780 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7edc004c00 con 0x7f7ee81015d0 2024-08-19T01:31:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.657+0000 7f7eee560640 1 -- 172.21.15.17:0/3029369780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee8195ba0 con 0x7f7ee81015d0 2024-08-19T01:31:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.658+0000 7f7ee57fa640 1 -- 172.21.15.17:0/3029369780 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7edc0039b0 con 0x7f7ee81015d0 2024-08-19T01:31:30.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.658+0000 7f7eee560640 1 -- 172.21.15.17:0/3029369780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee8196090 con 0x7f7ee81015d0 2024-08-19T01:31:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.659+0000 7f7eee560640 1 -- 172.21.15.17:0/3029369780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee8068510 con 0x7f7ee81015d0 2024-08-19T01:31:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.659+0000 7f7ee57fa640 1 -- 172.21.15.17:0/3029369780 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7edc02ad50 con 0x7f7ee81015d0 2024-08-19T01:31:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.660+0000 7f7ee57fa640 1 --2- 172.21.15.17:0/3029369780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7ed006e170 0x7f7ed0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:31:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.660+0000 7f7ee57fa640 1 -- 172.21.15.17:0/3029369780 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7edc0aef60 con 0x7f7ee81015d0 2024-08-19T01:31:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.660+0000 7f7ee7fff640 1 --2- 172.21.15.17:0/3029369780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7ed006e170 0x7f7ed0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:31:30.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.660+0000 7f7ee7fff640 1 --2- 172.21.15.17:0/3029369780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7ed006e170 0x7f7ed0070630 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80058c0 tx=0x7f7ed800a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:31:30.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.664+0000 7f7ee57fa640 1 -- 172.21.15.17:0/3029369780 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7edc0e3df0 con 0x7f7ee81015d0 2024-08-19T01:31:30.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.910+0000 7f7eee560640 1 -- 172.21.15.17:0/3029369780 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7ee8104380 con 0x7f7ee81015d0 2024-08-19T01:31:30.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.910+0000 7f7ee57fa640 1 -- 172.21.15.17:0/3029369780 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f7edc0782f0 con 0x7f7ee81015d0 2024-08-19T01:31:30.912 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:31:30.912 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:31:30.912 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:31:30.912 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:31:30.912 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:31:30.912 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:31:30.912 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:31:30.912 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:31:30.913 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:31:30.914 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:31:30.914 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:31:30.914 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:31:30.914 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:31:30.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.912+0000 7f7eee560640 1 -- 172.21.15.17:0/3029369780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7ed006e170 msgr2=0x7f7ed0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.912+0000 7f7eee560640 1 --2- 172.21.15.17:0/3029369780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7ed006e170 0x7f7ed0070630 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80058c0 tx=0x7f7ed800a2d0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.912+0000 7f7eee560640 1 -- 172.21.15.17:0/3029369780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ee81015d0 msgr2=0x7f7ee819bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:31:30.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.912+0000 7f7eee560640 1 --2- 172.21.15.17:0/3029369780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ee81015d0 0x7f7ee819bd70 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7edc02aa50 tx=0x7f7edc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.912+0000 7f7eee560640 1 -- 172.21.15.17:0/3029369780 shutdown_connections 2024-08-19T01:31:30.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.912+0000 7f7eee560640 1 --2- 172.21.15.17:0/3029369780 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7ed006e170 0x7f7ed0070630 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.912+0000 7f7eee560640 1 --2- 172.21.15.17:0/3029369780 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7ee81015d0 0x7f7ee819bd70 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.912+0000 7f7eee560640 1 --2- 172.21.15.17:0/3029369780 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7ee8100cb0 0x7f7ee819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:31:30.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.912+0000 7f7eee560640 1 -- 172.21.15.17:0/3029369780 >> 172.21.15.17:0/3029369780 conn(0x7f7ee80758a0 msgr2=0x7f7ee8101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:31:30.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.912+0000 7f7eee560640 1 -- 172.21.15.17:0/3029369780 shutdown_connections 2024-08-19T01:31:30.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:31:30.912+0000 7f7eee560640 1 -- 172.21.15.17:0/3029369780 wait complete. 2024-08-19T01:31:31.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:30 smithi017 ceph-mon[99370]: from='client.35806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:31:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:30 smithi017 ceph-mon[99370]: from='client.35810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:31:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:30 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1619583883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:31:31.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:30 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1365548743' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:31:31.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:30 smithi086 ceph-mon[71303]: from='client.35806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:31:31.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:30 smithi086 ceph-mon[71303]: from='client.35810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:31:31.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:30 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1619583883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:31:31.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:30 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1365548743' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:31:32.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:31 smithi017 ceph-mon[99370]: pgmap v983: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:32.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:31 smithi017 ceph-mon[99370]: from='client.35822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:31:32.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:31 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3029369780' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:31:32.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:31 smithi086 ceph-mon[71303]: pgmap v983: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:32.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:31 smithi086 ceph-mon[71303]: from='client.35822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:31:32.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:31 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3029369780' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:31:34.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:33 smithi017 ceph-mon[99370]: pgmap v984: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:34.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:31:34.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:33 smithi086 ceph-mon[71303]: pgmap v984: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:34.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:31:36.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:35 smithi017 ceph-mon[99370]: pgmap v985: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:35 smithi086 ceph-mon[71303]: pgmap v985: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:38.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:37 smithi017 ceph-mon[99370]: pgmap v986: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:38.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:37 smithi086 ceph-mon[71303]: pgmap v986: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:40.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:39 smithi017 ceph-mon[99370]: pgmap v987: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:40.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:39 smithi086 ceph-mon[71303]: pgmap v987: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:42.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:41 smithi017 ceph-mon[99370]: pgmap v988: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:42.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:41 smithi086 ceph-mon[71303]: pgmap v988: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:44.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:43 smithi017 ceph-mon[99370]: pgmap v989: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:44.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:43 smithi086 ceph-mon[71303]: pgmap v989: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:46.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:45 smithi017 ceph-mon[99370]: pgmap v990: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:46.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:45 smithi086 ceph-mon[71303]: pgmap v990: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:48.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:47 smithi017 ceph-mon[99370]: pgmap v991: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:48.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:47 smithi086 ceph-mon[71303]: pgmap v991: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:49.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:31:49.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:31:50.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:49 smithi017 ceph-mon[99370]: pgmap v992: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:50.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:49 smithi086 ceph-mon[71303]: pgmap v992: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:52.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:51 smithi017 ceph-mon[99370]: pgmap v993: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:52.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:51 smithi086 ceph-mon[71303]: pgmap v993: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:54.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:53 smithi017 ceph-mon[99370]: pgmap v994: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:54.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:53 smithi086 ceph-mon[71303]: pgmap v994: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:56.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:55 smithi017 ceph-mon[99370]: pgmap v995: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:56.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:55 smithi086 ceph-mon[71303]: pgmap v995: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:58.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:57 smithi017 ceph-mon[99370]: pgmap v996: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:31:58.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:57 smithi086 ceph-mon[71303]: pgmap v996: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:00.163 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:31:59 smithi017 ceph-mon[99370]: pgmap v997: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:00.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:31:59 smithi086 ceph-mon[71303]: pgmap v997: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.008+0000 7f80ad6d7640 1 -- 172.21.15.17:0/1158560484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80a8101670 msgr2=0x7f80a8109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.008+0000 7f80ad6d7640 1 --2- 172.21.15.17:0/1158560484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80a8101670 0x7f80a8109b60 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f809c009880 tx=0x7f809c02a530 comp rx=0 tx=0).stop 2024-08-19T01:32:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.008+0000 7f80ad6d7640 1 -- 172.21.15.17:0/1158560484 shutdown_connections 2024-08-19T01:32:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.008+0000 7f80ad6d7640 1 --2- 172.21.15.17:0/1158560484 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80a8101670 0x7f80a8109b60 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.008+0000 7f80ad6d7640 1 --2- 172.21.15.17:0/1158560484 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a8100d50 0x7f80a8101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.008+0000 7f80ad6d7640 1 -- 172.21.15.17:0/1158560484 >> 172.21.15.17:0/1158560484 conn(0x7f80a80758a0 msgr2=0x7f80a80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.008+0000 7f80ad6d7640 1 -- 172.21.15.17:0/1158560484 shutdown_connections 2024-08-19T01:32:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.008+0000 7f80ad6d7640 1 -- 172.21.15.17:0/1158560484 wait complete. 2024-08-19T01:32:01.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.008+0000 7f80ad6d7640 1 Processor -- start 2024-08-19T01:32:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80ad6d7640 1 -- start start 2024-08-19T01:32:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80ad6d7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a8100d50 0x7f80a819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80ad6d7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80a8101670 0x7f80a819df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80ad6d7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a819e5b0 con 0x7f80a8101670 2024-08-19T01:32:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80ad6d7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8197b90 con 0x7f80a8100d50 2024-08-19T01:32:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80a67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80a8101670 0x7f80a819df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80a67fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80a8101670 0x7f80a819df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47842/0 (socket says 172.21.15.17:47842) 2024-08-19T01:32:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80a67fc640 1 -- 172.21.15.17:0/3185996213 learned_addr learned my addr 172.21.15.17:0/3185996213 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:01.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80a6ffd640 1 --2- 172.21.15.17:0/3185996213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a8100d50 0x7f80a819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80a67fc640 1 -- 172.21.15.17:0/3185996213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a8100d50 msgr2=0x7f80a819da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80a67fc640 1 --2- 172.21.15.17:0/3185996213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a8100d50 0x7f80a819da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.009+0000 7f80a67fc640 1 -- 172.21.15.17:0/3185996213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c009560 con 0x7f80a8101670 2024-08-19T01:32:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.010+0000 7f80a67fc640 1 --2- 172.21.15.17:0/3185996213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80a8101670 0x7f80a819df90 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f809c005940 tx=0x7f809c032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.010+0000 7f808ffff640 1 -- 172.21.15.17:0/3185996213 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809c005220 con 0x7f80a8101670 2024-08-19T01:32:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.010+0000 7f80ad6d7640 1 -- 172.21.15.17:0/3185996213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a8197e10 con 0x7f80a8101670 2024-08-19T01:32:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.010+0000 7f808ffff640 1 -- 172.21.15.17:0/3185996213 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f809c005380 con 0x7f80a8101670 2024-08-19T01:32:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.010+0000 7f808ffff640 1 -- 172.21.15.17:0/3185996213 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809c003a50 con 0x7f80a8101670 2024-08-19T01:32:01.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.010+0000 7f80ad6d7640 1 -- 172.21.15.17:0/3185996213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a8198300 con 0x7f80a8101670 2024-08-19T01:32:01.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.011+0000 7f80ad6d7640 1 -- 172.21.15.17:0/3185996213 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a8068470 con 0x7f80a8101670 2024-08-19T01:32:01.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.012+0000 7f808ffff640 1 -- 172.21.15.17:0/3185996213 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f809c02ad50 con 0x7f80a8101670 2024-08-19T01:32:01.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.012+0000 7f808ffff640 1 --2- 172.21.15.17:0/3185996213 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f809006e170 0x7f8090070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.012+0000 7f808ffff640 1 -- 172.21.15.17:0/3185996213 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f809c0aed20 con 0x7f80a8101670 2024-08-19T01:32:01.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.012+0000 7f80a6ffd640 1 --2- 172.21.15.17:0/3185996213 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f809006e170 0x7f8090070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.013+0000 7f80a6ffd640 1 --2- 172.21.15.17:0/3185996213 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f809006e170 0x7f8090070630 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8098005c40 tx=0x7f809800a390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:01.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.017+0000 7f808ffff640 1 -- 172.21.15.17:0/3185996213 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f809c077f60 con 0x7f80a8101670 2024-08-19T01:32:01.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.210+0000 7f80ad6d7640 1 -- 172.21.15.17:0/3185996213 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80a810cda0 con 0x7f809006e170 2024-08-19T01:32:01.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.211+0000 7f808ffff640 1 -- 172.21.15.17:0/3185996213 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f80a810cda0 con 0x7f809006e170 2024-08-19T01:32:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.213+0000 7f80ad6d7640 1 -- 172.21.15.17:0/3185996213 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f809006e170 msgr2=0x7f8090070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.213+0000 7f80ad6d7640 1 --2- 172.21.15.17:0/3185996213 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f809006e170 0x7f8090070630 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8098005c40 tx=0x7f809800a390 comp rx=0 tx=0).stop 2024-08-19T01:32:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.213+0000 7f80ad6d7640 1 -- 172.21.15.17:0/3185996213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80a8101670 msgr2=0x7f80a819df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.213+0000 7f80ad6d7640 1 --2- 172.21.15.17:0/3185996213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80a8101670 0x7f80a819df90 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f809c005940 tx=0x7f809c032bd0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.213+0000 7f80ad6d7640 1 -- 172.21.15.17:0/3185996213 shutdown_connections 2024-08-19T01:32:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.213+0000 7f80ad6d7640 1 --2- 172.21.15.17:0/3185996213 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f809006e170 0x7f8090070630 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.213+0000 7f80ad6d7640 1 --2- 172.21.15.17:0/3185996213 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80a8101670 0x7f80a819df90 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.213+0000 7f80ad6d7640 1 --2- 172.21.15.17:0/3185996213 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80a8100d50 0x7f80a819da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.213+0000 7f80ad6d7640 1 -- 172.21.15.17:0/3185996213 >> 172.21.15.17:0/3185996213 conn(0x7f80a80758a0 msgr2=0x7f80a80fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:01.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.214+0000 7f80ad6d7640 1 -- 172.21.15.17:0/3185996213 shutdown_connections 2024-08-19T01:32:01.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.214+0000 7f80ad6d7640 1 -- 172.21.15.17:0/3185996213 wait complete. 2024-08-19T01:32:01.224 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:32:01.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.298+0000 7fe97604f640 1 -- 172.21.15.17:0/873191687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9700ff3d0 msgr2=0x7fe9700ff7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.298+0000 7fe97604f640 1 --2- 172.21.15.17:0/873191687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9700ff3d0 0x7fe9700ff7b0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe960009880 tx=0x7fe96002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.298+0000 7fe97604f640 1 -- 172.21.15.17:0/873191687 shutdown_connections 2024-08-19T01:32:01.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.298+0000 7fe97604f640 1 --2- 172.21.15.17:0/873191687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9700ffd80 0x7fe9701038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.298+0000 7fe97604f640 1 --2- 172.21.15.17:0/873191687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9700ff3d0 0x7fe9700ff7b0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.298+0000 7fe97604f640 1 -- 172.21.15.17:0/873191687 >> 172.21.15.17:0/873191687 conn(0x7fe9700f9e90 msgr2=0x7fe9700fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:01.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.298+0000 7fe97604f640 1 -- 172.21.15.17:0/873191687 shutdown_connections 2024-08-19T01:32:01.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.298+0000 7fe97604f640 1 -- 172.21.15.17:0/873191687 wait complete. 2024-08-19T01:32:01.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe97604f640 1 Processor -- start 2024-08-19T01:32:01.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe97604f640 1 -- start start 2024-08-19T01:32:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe97604f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9700ff3d0 0x7fe970100950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe97604f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9700ffd80 0x7fe970100e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe97604f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701013d0 con 0x7fe9700ffd80 2024-08-19T01:32:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe97604f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970101540 con 0x7fe9700ff3d0 2024-08-19T01:32:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe967fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9700ffd80 0x7fe970100e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe967fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9700ffd80 0x7fe970100e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47868/0 (socket says 172.21.15.17:47868) 2024-08-19T01:32:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe967fff640 1 -- 172.21.15.17:0/2514253287 learned_addr learned my addr 172.21.15.17:0/2514253287 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe96f7fe640 1 --2- 172.21.15.17:0/2514253287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9700ff3d0 0x7fe970100950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe967fff640 1 -- 172.21.15.17:0/2514253287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9700ff3d0 msgr2=0x7fe970100950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe967fff640 1 --2- 172.21.15.17:0/2514253287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9700ff3d0 0x7fe970100950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.299+0000 7fe967fff640 1 -- 172.21.15.17:0/2514253287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe960009560 con 0x7fe9700ffd80 2024-08-19T01:32:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.300+0000 7fe967fff640 1 --2- 172.21.15.17:0/2514253287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9700ffd80 0x7fe970100e90 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe95800c8f0 tx=0x7fe95800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.300+0000 7fe96d7fa640 1 -- 172.21.15.17:0/2514253287 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe958007b80 con 0x7fe9700ffd80 2024-08-19T01:32:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.300+0000 7fe96d7fa640 1 -- 172.21.15.17:0/2514253287 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9580054e0 con 0x7fe9700ffd80 2024-08-19T01:32:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.300+0000 7fe97604f640 1 -- 172.21.15.17:0/2514253287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9701a1ed0 con 0x7fe9700ffd80 2024-08-19T01:32:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.300+0000 7fe96d7fa640 1 -- 172.21.15.17:0/2514253287 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe95800f450 con 0x7fe9700ffd80 2024-08-19T01:32:01.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.300+0000 7fe97604f640 1 -- 172.21.15.17:0/2514253287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9701a2230 con 0x7fe9700ffd80 2024-08-19T01:32:01.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.301+0000 7fe97604f640 1 -- 172.21.15.17:0/2514253287 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe970100420 con 0x7fe9700ffd80 2024-08-19T01:32:01.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.302+0000 7fe96d7fa640 1 -- 172.21.15.17:0/2514253287 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe958004f60 con 0x7fe9700ffd80 2024-08-19T01:32:01.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.302+0000 7fe96d7fa640 1 --2- 172.21.15.17:0/2514253287 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe95c06e180 0x7fe95c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.303+0000 7fe96d7fa640 1 -- 172.21.15.17:0/2514253287 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe95808dfe0 con 0x7fe9700ffd80 2024-08-19T01:32:01.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.303+0000 7fe96f7fe640 1 --2- 172.21.15.17:0/2514253287 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe95c06e180 0x7fe95c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.303+0000 7fe96f7fe640 1 --2- 172.21.15.17:0/2514253287 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe95c06e180 0x7fe95c070640 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe960009230 tx=0x7fe960005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:01.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.307+0000 7fe96d7fa640 1 -- 172.21.15.17:0/2514253287 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe9580c2df0 con 0x7fe9700ffd80 2024-08-19T01:32:01.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.501+0000 7fe97604f640 1 -- 172.21.15.17:0/2514253287 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe97010bef0 con 0x7fe95c06e180 2024-08-19T01:32:01.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.502+0000 7fe96d7fa640 1 -- 172.21.15.17:0/2514253287 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe97010bef0 con 0x7fe95c06e180 2024-08-19T01:32:01.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.504+0000 7fe97604f640 1 -- 172.21.15.17:0/2514253287 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe95c06e180 msgr2=0x7fe95c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.504+0000 7fe97604f640 1 --2- 172.21.15.17:0/2514253287 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe95c06e180 0x7fe95c070640 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe960009230 tx=0x7fe960005a20 comp rx=0 tx=0).stop 2024-08-19T01:32:01.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.504+0000 7fe97604f640 1 -- 172.21.15.17:0/2514253287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9700ffd80 msgr2=0x7fe970100e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.504+0000 7fe97604f640 1 --2- 172.21.15.17:0/2514253287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9700ffd80 0x7fe970100e90 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe95800c8f0 tx=0x7fe95800cdb0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.504+0000 7fe97604f640 1 -- 172.21.15.17:0/2514253287 shutdown_connections 2024-08-19T01:32:01.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.504+0000 7fe97604f640 1 --2- 172.21.15.17:0/2514253287 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe95c06e180 0x7fe95c070640 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.504+0000 7fe97604f640 1 --2- 172.21.15.17:0/2514253287 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9700ffd80 0x7fe970100e90 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.504+0000 7fe97604f640 1 --2- 172.21.15.17:0/2514253287 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9700ff3d0 0x7fe970100950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.504+0000 7fe97604f640 1 -- 172.21.15.17:0/2514253287 >> 172.21.15.17:0/2514253287 conn(0x7fe9700f9e90 msgr2=0x7fe9700fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:01.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.504+0000 7fe97604f640 1 -- 172.21.15.17:0/2514253287 shutdown_connections 2024-08-19T01:32:01.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.504+0000 7fe97604f640 1 -- 172.21.15.17:0/2514253287 wait complete. 2024-08-19T01:32:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.587+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/3245039855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24104a30 msgr2=0x7f0a24104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.587+0000 7f0a2b6ec640 1 --2- 172.21.15.17:0/3245039855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24104a30 0x7f0a24104e10 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009880 tx=0x7f0a2002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.587+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/3245039855 shutdown_connections 2024-08-19T01:32:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.587+0000 7f0a2b6ec640 1 --2- 172.21.15.17:0/3245039855 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a240fea30 0x7f0a240fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.587+0000 7f0a2b6ec640 1 --2- 172.21.15.17:0/3245039855 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a24104a30 0x7f0a24104e10 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.587+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/3245039855 >> 172.21.15.17:0/3245039855 conn(0x7f0a240fa730 msgr2=0x7f0a240fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.587+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/3245039855 shutdown_connections 2024-08-19T01:32:01.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.587+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/3245039855 wait complete. 2024-08-19T01:32:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a2b6ec640 1 Processor -- start 2024-08-19T01:32:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a2b6ec640 1 -- start start 2024-08-19T01:32:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a2b6ec640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a240fea30 0x7f0a241946f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a2b6ec640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a24104a30 0x7f0a24194c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a2b6ec640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a24195170 con 0x7f0a240fea30 2024-08-19T01:32:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a2b6ec640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a241952e0 con 0x7f0a24104a30 2024-08-19T01:32:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a29488640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a240fea30 0x7f0a241946f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a29488640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a240fea30 0x7f0a241946f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47890/0 (socket says 172.21.15.17:47890) 2024-08-19T01:32:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a29488640 1 -- 172.21.15.17:0/4045347353 learned_addr learned my addr 172.21.15.17:0/4045347353 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a28c87640 1 --2- 172.21.15.17:0/4045347353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a24104a30 0x7f0a24194c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a29488640 1 -- 172.21.15.17:0/4045347353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a24104a30 msgr2=0x7f0a24194c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a29488640 1 --2- 172.21.15.17:0/4045347353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a24104a30 0x7f0a24194c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.588+0000 7f0a29488640 1 -- 172.21.15.17:0/4045347353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20009560 con 0x7f0a240fea30 2024-08-19T01:32:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.589+0000 7f0a29488640 1 --2- 172.21.15.17:0/4045347353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a240fea30 0x7f0a241946f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0a2002a9c0 tx=0x7f0a200055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.589+0000 7f0a167fc640 1 -- 172.21.15.17:0/4045347353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a20004aa0 con 0x7f0a240fea30 2024-08-19T01:32:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.589+0000 7f0a167fc640 1 -- 172.21.15.17:0/4045347353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a20004c00 con 0x7f0a240fea30 2024-08-19T01:32:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.589+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/4045347353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a24195560 con 0x7f0a240fea30 2024-08-19T01:32:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.589+0000 7f0a167fc640 1 -- 172.21.15.17:0/4045347353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a20003980 con 0x7f0a240fea30 2024-08-19T01:32:01.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.589+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/4045347353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a241a1f80 con 0x7f0a240fea30 2024-08-19T01:32:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.590+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/4045347353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a24100170 con 0x7f0a240fea30 2024-08-19T01:32:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.591+0000 7f0a167fc640 1 -- 172.21.15.17:0/4045347353 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0a20003bf0 con 0x7f0a240fea30 2024-08-19T01:32:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.591+0000 7f0a167fc640 1 --2- 172.21.15.17:0/4045347353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0a1006e170 0x7f0a10070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.591+0000 7f0a167fc640 1 -- 172.21.15.17:0/4045347353 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f0a200af010 con 0x7f0a240fea30 2024-08-19T01:32:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.591+0000 7f0a28c87640 1 --2- 172.21.15.17:0/4045347353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0a1006e170 0x7f0a10070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.592+0000 7f0a28c87640 1 --2- 172.21.15.17:0/4045347353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0a1006e170 0x7f0a10070630 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0a24068d40 tx=0x7f0a1800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:01.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.595+0000 7f0a167fc640 1 -- 172.21.15.17:0/4045347353 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f0a200783a0 con 0x7f0a240fea30 2024-08-19T01:32:01.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.778+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/4045347353 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a24068ab0 con 0x7f0a1006e170 2024-08-19T01:32:01.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.788+0000 7f0a167fc640 1 -- 172.21.15.17:0/4045347353 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0a24068ab0 con 0x7f0a1006e170 2024-08-19T01:32:01.790 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:32:01.790 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (33m) 11m ago 43m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:32:01.790 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (44m) 11m ago 44m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:32:01.790 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (43m) 11m ago 43m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:32:01.790 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (31m) 11m ago 44m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:32:01.790 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (30m) 11m ago 43m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:32:01.790 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (32m) 11m ago 43m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:32:01.790 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (27m) 11m ago 38m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:32:01.790 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (27m) 11m ago 38m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:32:01.790 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (11m) 11m ago 38m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:32:01.790 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (27m) 11m ago 38m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (35m) 11m ago 45m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (34m) 11m ago 42m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (32m) 11m ago 45m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (31m) 11m ago 42m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (33m) 11m ago 44m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (33m) 11m ago 43m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (30m) 11m ago 42m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (30m) 11m ago 41m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (29m) 11m ago 41m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (28m) 11m ago 40m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (28m) 11m ago 40m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (27m) 11m ago 40m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:32:01.791 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (33m) 11m ago 43m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:32:01.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.790+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/4045347353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0a1006e170 msgr2=0x7f0a10070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.790+0000 7f0a2b6ec640 1 --2- 172.21.15.17:0/4045347353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0a1006e170 0x7f0a10070630 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0a24068d40 tx=0x7f0a1800b390 comp rx=0 tx=0).stop 2024-08-19T01:32:01.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.790+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/4045347353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a240fea30 msgr2=0x7f0a241946f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.790+0000 7f0a2b6ec640 1 --2- 172.21.15.17:0/4045347353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a240fea30 0x7f0a241946f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0a2002a9c0 tx=0x7f0a200055a0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.790+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/4045347353 shutdown_connections 2024-08-19T01:32:01.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.790+0000 7f0a2b6ec640 1 --2- 172.21.15.17:0/4045347353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f0a1006e170 0x7f0a10070630 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.790+0000 7f0a2b6ec640 1 --2- 172.21.15.17:0/4045347353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f0a24104a30 0x7f0a24194c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.790+0000 7f0a2b6ec640 1 --2- 172.21.15.17:0/4045347353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a240fea30 0x7f0a241946f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.790+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/4045347353 >> 172.21.15.17:0/4045347353 conn(0x7f0a240fa730 msgr2=0x7f0a240fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:01.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.790+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/4045347353 shutdown_connections 2024-08-19T01:32:01.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.790+0000 7f0a2b6ec640 1 -- 172.21.15.17:0/4045347353 wait complete. 2024-08-19T01:32:01.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.871+0000 7f4222238640 1 -- 172.21.15.17:0/542039123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421c073170 msgr2=0x7f421c110610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.871+0000 7f4222238640 1 --2- 172.21.15.17:0/542039123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421c073170 0x7f421c110610 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4210009880 tx=0x7f421002a530 comp rx=0 tx=0).stop 2024-08-19T01:32:01.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.871+0000 7f4222238640 1 -- 172.21.15.17:0/542039123 shutdown_connections 2024-08-19T01:32:01.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.871+0000 7f4222238640 1 --2- 172.21.15.17:0/542039123 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421c073170 0x7f421c110610 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.871+0000 7f4222238640 1 --2- 172.21.15.17:0/542039123 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f421c072850 0x7f421c072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.871+0000 7f4222238640 1 -- 172.21.15.17:0/542039123 >> 172.21.15.17:0/542039123 conn(0x7f421c0fb840 msgr2=0x7f421c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:01.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.871+0000 7f4222238640 1 -- 172.21.15.17:0/542039123 shutdown_connections 2024-08-19T01:32:01.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.871+0000 7f4222238640 1 -- 172.21.15.17:0/542039123 wait complete. 2024-08-19T01:32:01.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.872+0000 7f4222238640 1 Processor -- start 2024-08-19T01:32:01.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.872+0000 7f4222238640 1 -- start start 2024-08-19T01:32:01.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.872+0000 7f4222238640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421c072850 0x7f421c19c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.872+0000 7f4222238640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f421c073170 0x7f421c19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.872+0000 7f4222238640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c19cca0 con 0x7f421c072850 2024-08-19T01:32:01.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.872+0000 7f4222238640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421c1a0a10 con 0x7f421c073170 2024-08-19T01:32:01.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f421b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421c072850 0x7f421c19c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f421b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421c072850 0x7f421c19c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47902/0 (socket says 172.21.15.17:47902) 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f421b7fe640 1 -- 172.21.15.17:0/856205245 learned_addr learned my addr 172.21.15.17:0/856205245 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f421affd640 1 --2- 172.21.15.17:0/856205245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f421c073170 0x7f421c19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f421b7fe640 1 -- 172.21.15.17:0/856205245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f421c073170 msgr2=0x7f421c19c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f421b7fe640 1 --2- 172.21.15.17:0/856205245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f421c073170 0x7f421c19c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f421b7fe640 1 -- 172.21.15.17:0/856205245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4210009560 con 0x7f421c072850 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f421b7fe640 1 --2- 172.21.15.17:0/856205245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421c072850 0x7f421c19c0d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f420c00d8d0 tx=0x7f420c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f4218ff9640 1 -- 172.21.15.17:0/856205245 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f420c009c00 con 0x7f421c072850 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f4218ff9640 1 -- 172.21.15.17:0/856205245 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f420c009d60 con 0x7f421c072850 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f4222238640 1 -- 172.21.15.17:0/856205245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421c1a0cf0 con 0x7f421c072850 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f4218ff9640 1 -- 172.21.15.17:0/856205245 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f420c0049d0 con 0x7f421c072850 2024-08-19T01:32:01.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.873+0000 7f4222238640 1 -- 172.21.15.17:0/856205245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421c1a1210 con 0x7f421c072850 2024-08-19T01:32:01.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.875+0000 7f4222238640 1 -- 172.21.15.17:0/856205245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421c073f90 con 0x7f421c072850 2024-08-19T01:32:01.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.875+0000 7f4218ff9640 1 -- 172.21.15.17:0/856205245 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f420c004c40 con 0x7f421c072850 2024-08-19T01:32:01.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.876+0000 7f4218ff9640 1 --2- 172.21.15.17:0/856205245 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f420406e170 0x7f4204070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:01.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.876+0000 7f4218ff9640 1 -- 172.21.15.17:0/856205245 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f420c08dda0 con 0x7f421c072850 2024-08-19T01:32:01.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.876+0000 7f421affd640 1 --2- 172.21.15.17:0/856205245 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f420406e170 0x7f4204070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:01.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.876+0000 7f421affd640 1 --2- 172.21.15.17:0/856205245 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f420406e170 0x7f4204070630 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4210000c00 tx=0x7f42100058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:01.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:01.880+0000 7f4218ff9640 1 -- 172.21.15.17:0/856205245 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f420c057100 con 0x7f421c072850 2024-08-19T01:32:02.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.128+0000 7f4222238640 1 -- 172.21.15.17:0/856205245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f421c19d430 con 0x7f421c072850 2024-08-19T01:32:02.130 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:01 smithi017 ceph-mon[99370]: pgmap v998: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:02.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.128+0000 7f4218ff9640 1 -- 172.21.15.17:0/856205245 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f420c017280 con 0x7f421c072850 2024-08-19T01:32:02.130 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:32:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:32:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:32:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:32:02.130 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:32:02.131 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:32:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.130+0000 7f4222238640 1 -- 172.21.15.17:0/856205245 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f420406e170 msgr2=0x7f4204070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.130+0000 7f4222238640 1 --2- 172.21.15.17:0/856205245 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f420406e170 0x7f4204070630 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4210000c00 tx=0x7f42100058d0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.130+0000 7f4222238640 1 -- 172.21.15.17:0/856205245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421c072850 msgr2=0x7f421c19c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.130+0000 7f4222238640 1 --2- 172.21.15.17:0/856205245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421c072850 0x7f421c19c0d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f420c00d8d0 tx=0x7f420c00dd90 comp rx=0 tx=0).stop 2024-08-19T01:32:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.130+0000 7f4222238640 1 -- 172.21.15.17:0/856205245 shutdown_connections 2024-08-19T01:32:02.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.130+0000 7f4222238640 1 --2- 172.21.15.17:0/856205245 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f420406e170 0x7f4204070630 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.130+0000 7f4222238640 1 --2- 172.21.15.17:0/856205245 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f421c073170 0x7f421c19c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.130+0000 7f4222238640 1 --2- 172.21.15.17:0/856205245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f421c072850 0x7f421c19c0d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.130+0000 7f4222238640 1 -- 172.21.15.17:0/856205245 >> 172.21.15.17:0/856205245 conn(0x7f421c0fb840 msgr2=0x7f421c103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:02.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.130+0000 7f4222238640 1 -- 172.21.15.17:0/856205245 shutdown_connections 2024-08-19T01:32:02.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.130+0000 7f4222238640 1 -- 172.21.15.17:0/856205245 wait complete. 2024-08-19T01:32:02.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:01 smithi086 ceph-mon[71303]: pgmap v998: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.212+0000 7febd8fd1640 1 -- 172.21.15.17:0/3408892228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd40ffda0 msgr2=0x7febd4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.212+0000 7febd8fd1640 1 --2- 172.21.15.17:0/3408892228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd40ffda0 0x7febd4100180 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7febc4009880 tx=0x7febc402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.212+0000 7febd8fd1640 1 -- 172.21.15.17:0/3408892228 shutdown_connections 2024-08-19T01:32:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.212+0000 7febd8fd1640 1 --2- 172.21.15.17:0/3408892228 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd4100750 0x7febd41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.212+0000 7febd8fd1640 1 --2- 172.21.15.17:0/3408892228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd40ffda0 0x7febd4100180 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.212+0000 7febd8fd1640 1 -- 172.21.15.17:0/3408892228 >> 172.21.15.17:0/3408892228 conn(0x7febd40fb840 msgr2=0x7febd40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.212+0000 7febd8fd1640 1 -- 172.21.15.17:0/3408892228 shutdown_connections 2024-08-19T01:32:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.212+0000 7febd8fd1640 1 -- 172.21.15.17:0/3408892228 wait complete. 2024-08-19T01:32:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.213+0000 7febd8fd1640 1 Processor -- start 2024-08-19T01:32:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.213+0000 7febd8fd1640 1 -- start start 2024-08-19T01:32:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.213+0000 7febd8fd1640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd40ffda0 0x7febd4197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.213+0000 7febd8fd1640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd4100750 0x7febd4198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.213+0000 7febd8fd1640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd41988f0 con 0x7febd40ffda0 2024-08-19T01:32:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.213+0000 7febd8fd1640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd419b560 con 0x7febd4100750 2024-08-19T01:32:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.213+0000 7febd259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd40ffda0 0x7febd4197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.213+0000 7febd259c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd40ffda0 0x7febd4197cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47922/0 (socket says 172.21.15.17:47922) 2024-08-19T01:32:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.213+0000 7febd259c640 1 -- 172.21.15.17:0/378815080 learned_addr learned my addr 172.21.15.17:0/378815080 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.213+0000 7febd1d9b640 1 --2- 172.21.15.17:0/378815080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd4100750 0x7febd4198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.214+0000 7febd259c640 1 -- 172.21.15.17:0/378815080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd4100750 msgr2=0x7febd4198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.214+0000 7febd259c640 1 --2- 172.21.15.17:0/378815080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd4100750 0x7febd4198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.214+0000 7febd259c640 1 -- 172.21.15.17:0/378815080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4009560 con 0x7febd40ffda0 2024-08-19T01:32:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.214+0000 7febd259c640 1 --2- 172.21.15.17:0/378815080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd40ffda0 0x7febd4197cd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7febc4006010 tx=0x7febc40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.214+0000 7febc37fe640 1 -- 172.21.15.17:0/378815080 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc4004aa0 con 0x7febd40ffda0 2024-08-19T01:32:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.214+0000 7febc37fe640 1 -- 172.21.15.17:0/378815080 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7febc4031470 con 0x7febd40ffda0 2024-08-19T01:32:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.214+0000 7febd8fd1640 1 -- 172.21.15.17:0/378815080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd419b7e0 con 0x7febd40ffda0 2024-08-19T01:32:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.214+0000 7febc37fe640 1 -- 172.21.15.17:0/378815080 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc4003940 con 0x7febd40ffda0 2024-08-19T01:32:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.214+0000 7febd8fd1640 1 -- 172.21.15.17:0/378815080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd419bcd0 con 0x7febd40ffda0 2024-08-19T01:32:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.215+0000 7febd8fd1640 1 -- 172.21.15.17:0/378815080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd4101280 con 0x7febd40ffda0 2024-08-19T01:32:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.216+0000 7febc37fe640 1 -- 172.21.15.17:0/378815080 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7febc4031b90 con 0x7febd40ffda0 2024-08-19T01:32:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.216+0000 7febc37fe640 1 --2- 172.21.15.17:0/378815080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7febbc06e180 0x7febbc070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.216+0000 7febc37fe640 1 -- 172.21.15.17:0/378815080 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7febc40af2c0 con 0x7febd40ffda0 2024-08-19T01:32:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.216+0000 7febd1d9b640 1 --2- 172.21.15.17:0/378815080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7febbc06e180 0x7febbc070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:02.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.217+0000 7febd1d9b640 1 --2- 172.21.15.17:0/378815080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7febbc06e180 0x7febbc070640 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7febd4199240 tx=0x7febc800b590 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:02.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.221+0000 7febc37fe640 1 -- 172.21.15.17:0/378815080 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7febc40785a0 con 0x7febd40ffda0 2024-08-19T01:32:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.433+0000 7febd8fd1640 1 -- 172.21.15.17:0/378815080 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7febd4073f10 con 0x7febd40ffda0 2024-08-19T01:32:02.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.434+0000 7febc37fe640 1 -- 172.21.15.17:0/378815080 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7febc4004c00 con 0x7febd40ffda0 2024-08-19T01:32:02.435 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:32:02.435 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:32:02.436 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:32:02.437 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:32:02.438 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:32:02.439 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:32:02.439 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:32:02.439 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:32:02.439 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:32:02.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.436+0000 7febd8fd1640 1 -- 172.21.15.17:0/378815080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7febbc06e180 msgr2=0x7febbc070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.436+0000 7febd8fd1640 1 --2- 172.21.15.17:0/378815080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7febbc06e180 0x7febbc070640 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7febd4199240 tx=0x7febc800b590 comp rx=0 tx=0).stop 2024-08-19T01:32:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.436+0000 7febd8fd1640 1 -- 172.21.15.17:0/378815080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd40ffda0 msgr2=0x7febd4197cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.436+0000 7febd8fd1640 1 --2- 172.21.15.17:0/378815080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd40ffda0 0x7febd4197cd0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7febc4006010 tx=0x7febc40055a0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.436+0000 7febd8fd1640 1 -- 172.21.15.17:0/378815080 shutdown_connections 2024-08-19T01:32:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.436+0000 7febd8fd1640 1 --2- 172.21.15.17:0/378815080 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7febbc06e180 0x7febbc070640 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.436+0000 7febd8fd1640 1 --2- 172.21.15.17:0/378815080 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7febd4100750 0x7febd4198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.436+0000 7febd8fd1640 1 --2- 172.21.15.17:0/378815080 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7febd40ffda0 0x7febd4197cd0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.436+0000 7febd8fd1640 1 -- 172.21.15.17:0/378815080 >> 172.21.15.17:0/378815080 conn(0x7febd40fb840 msgr2=0x7febd40fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.436+0000 7febd8fd1640 1 -- 172.21.15.17:0/378815080 shutdown_connections 2024-08-19T01:32:02.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.436+0000 7febd8fd1640 1 -- 172.21.15.17:0/378815080 wait complete. 2024-08-19T01:32:02.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.518+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2332352259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4105c00 msgr2=0x7efdc4105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.518+0000 7efdcbc3d640 1 --2- 172.21.15.17:0/2332352259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4105c00 0x7efdc4105fe0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009c20 tx=0x7efdb402a970 comp rx=0 tx=0).stop 2024-08-19T01:32:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.518+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2332352259 shutdown_connections 2024-08-19T01:32:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.518+0000 7efdcbc3d640 1 --2- 172.21.15.17:0/2332352259 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc40ffb50 0x7efdc40fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.519+0000 7efdcbc3d640 1 --2- 172.21.15.17:0/2332352259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4105c00 0x7efdc4105fe0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.519+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2332352259 >> 172.21.15.17:0/2332352259 conn(0x7efdc40fb830 msgr2=0x7efdc40fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.519+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2332352259 shutdown_connections 2024-08-19T01:32:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.519+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2332352259 wait complete. 2024-08-19T01:32:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.519+0000 7efdcbc3d640 1 Processor -- start 2024-08-19T01:32:02.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.519+0000 7efdcbc3d640 1 -- start start 2024-08-19T01:32:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.519+0000 7efdcbc3d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc40ffb50 0x7efdc419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.519+0000 7efdcbc3d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4105c00 0x7efdc419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.519+0000 7efdcbc3d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc419c310 con 0x7efdc4105c00 2024-08-19T01:32:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.519+0000 7efdcbc3d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc41958a0 con 0x7efdc40ffb50 2024-08-19T01:32:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdc91d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4105c00 0x7efdc419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdc91d8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4105c00 0x7efdc419bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47932/0 (socket says 172.21.15.17:47932) 2024-08-19T01:32:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdc91d8640 1 -- 172.21.15.17:0/2945896216 learned_addr learned my addr 172.21.15.17:0/2945896216 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdc99d9640 1 --2- 172.21.15.17:0/2945896216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc40ffb50 0x7efdc419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:02.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdc91d8640 1 -- 172.21.15.17:0/2945896216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc40ffb50 msgr2=0x7efdc419b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdc91d8640 1 --2- 172.21.15.17:0/2945896216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc40ffb50 0x7efdc419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdc91d8640 1 -- 172.21.15.17:0/2945896216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb4009900 con 0x7efdc4105c00 2024-08-19T01:32:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdc91d8640 1 --2- 172.21.15.17:0/2945896216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4105c00 0x7efdc419bcf0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7efdb800d8d0 tx=0x7efdb800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdc2ffd640 1 -- 172.21.15.17:0/2945896216 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb800bea0 con 0x7efdc4105c00 2024-08-19T01:32:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdc2ffd640 1 -- 172.21.15.17:0/2945896216 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdb8009c00 con 0x7efdc4105c00 2024-08-19T01:32:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2945896216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc4195b80 con 0x7efdc4105c00 2024-08-19T01:32:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdc2ffd640 1 -- 172.21.15.17:0/2945896216 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb800f710 con 0x7efdc4105c00 2024-08-19T01:32:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.520+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2945896216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc4196150 con 0x7efdc4105c00 2024-08-19T01:32:02.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.521+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2945896216 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc4101200 con 0x7efdc4105c00 2024-08-19T01:32:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.522+0000 7efdc2ffd640 1 -- 172.21.15.17:0/2945896216 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efdb8010460 con 0x7efdc4105c00 2024-08-19T01:32:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.522+0000 7efdc2ffd640 1 --2- 172.21.15.17:0/2945896216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efdac06e170 0x7efdac070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.522+0000 7efdc2ffd640 1 -- 172.21.15.17:0/2945896216 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efdb808de30 con 0x7efdc4105c00 2024-08-19T01:32:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.523+0000 7efdc99d9640 1 --2- 172.21.15.17:0/2945896216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efdac06e170 0x7efdac070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:02.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.523+0000 7efdc99d9640 1 --2- 172.21.15.17:0/2945896216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efdac06e170 0x7efdac070630 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7efdb40098d0 tx=0x7efdb4009800 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:02.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.527+0000 7efdc2ffd640 1 -- 172.21.15.17:0/2945896216 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efdb8057190 con 0x7efdc4105c00 2024-08-19T01:32:02.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.717+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2945896216 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdc4108090 con 0x7efdac06e170 2024-08-19T01:32:02.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.719+0000 7efdc2ffd640 1 -- 172.21.15.17:0/2945896216 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7efdc4108090 con 0x7efdac06e170 2024-08-19T01:32:02.720 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:32:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:32:02.720 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:32:02.721 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:32:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.721+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2945896216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efdac06e170 msgr2=0x7efdac070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.721+0000 7efdcbc3d640 1 --2- 172.21.15.17:0/2945896216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efdac06e170 0x7efdac070630 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7efdb40098d0 tx=0x7efdb4009800 comp rx=0 tx=0).stop 2024-08-19T01:32:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.721+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2945896216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4105c00 msgr2=0x7efdc419bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.721+0000 7efdcbc3d640 1 --2- 172.21.15.17:0/2945896216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4105c00 0x7efdc419bcf0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7efdb800d8d0 tx=0x7efdb800dd90 comp rx=0 tx=0).stop 2024-08-19T01:32:02.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.721+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2945896216 shutdown_connections 2024-08-19T01:32:02.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.721+0000 7efdcbc3d640 1 --2- 172.21.15.17:0/2945896216 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efdac06e170 0x7efdac070630 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.721+0000 7efdcbc3d640 1 --2- 172.21.15.17:0/2945896216 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc4105c00 0x7efdc419bcf0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.721+0000 7efdcbc3d640 1 --2- 172.21.15.17:0/2945896216 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc40ffb50 0x7efdc419b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.721+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2945896216 >> 172.21.15.17:0/2945896216 conn(0x7efdc40fb830 msgr2=0x7efdc40fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:02.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.721+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2945896216 shutdown_connections 2024-08-19T01:32:02.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.721+0000 7efdcbc3d640 1 -- 172.21.15.17:0/2945896216 wait complete. 2024-08-19T01:32:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.804+0000 7f53a225b640 1 -- 172.21.15.17:0/1599763028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f539c1007d0 msgr2=0x7f539c104820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.804+0000 7f53a225b640 1 --2- 172.21.15.17:0/1599763028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f539c1007d0 0x7f539c104820 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5384009880 tx=0x7f538402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.804+0000 7f53a225b640 1 -- 172.21.15.17:0/1599763028 shutdown_connections 2024-08-19T01:32:02.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.804+0000 7f53a225b640 1 --2- 172.21.15.17:0/1599763028 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f539c1007d0 0x7f539c104820 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.804+0000 7f53a225b640 1 --2- 172.21.15.17:0/1599763028 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f539c0ffe20 0x7f539c100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.804+0000 7f53a225b640 1 -- 172.21.15.17:0/1599763028 >> 172.21.15.17:0/1599763028 conn(0x7f539c0fb900 msgr2=0x7f539c0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:02.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.804+0000 7f53a225b640 1 -- 172.21.15.17:0/1599763028 shutdown_connections 2024-08-19T01:32:02.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.804+0000 7f53a225b640 1 -- 172.21.15.17:0/1599763028 wait complete. 2024-08-19T01:32:02.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.804+0000 7f53a225b640 1 Processor -- start 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.804+0000 7f53a225b640 1 -- start start 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f53a225b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f539c0ffe20 0x7f539c19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f53a225b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f539c1007d0 0x7f539c19be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f53a225b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c19c3f0 con 0x7f539c1007d0 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f53a225b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c195a10 con 0x7f539c0ffe20 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f5393fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f539c1007d0 0x7f539c19be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f5393fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f539c1007d0 0x7f539c19be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47954/0 (socket says 172.21.15.17:47954) 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f5393fff640 1 -- 172.21.15.17:0/3643058528 learned_addr learned my addr 172.21.15.17:0/3643058528 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f539b7fe640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f539c0ffe20 0x7f539c19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f5393fff640 1 -- 172.21.15.17:0/3643058528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f539c0ffe20 msgr2=0x7f539c19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f5393fff640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f539c0ffe20 0x7f539c19b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f5393fff640 1 -- 172.21.15.17:0/3643058528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5384009560 con 0x7f539c1007d0 2024-08-19T01:32:02.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f539b7fe640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f539c0ffe20 0x7f539c19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:32:02.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f5393fff640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f539c1007d0 0x7f539c19be60 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5384006010 tx=0x7f53840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:02.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f53997fa640 1 -- 172.21.15.17:0/3643058528 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5384004aa0 con 0x7f539c1007d0 2024-08-19T01:32:02.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f53997fa640 1 -- 172.21.15.17:0/3643058528 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5384004c00 con 0x7f539c1007d0 2024-08-19T01:32:02.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f53a225b640 1 -- 172.21.15.17:0/3643058528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c195c90 con 0x7f539c1007d0 2024-08-19T01:32:02.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f53997fa640 1 -- 172.21.15.17:0/3643058528 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5384003a20 con 0x7f539c1007d0 2024-08-19T01:32:02.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.805+0000 7f53a225b640 1 -- 172.21.15.17:0/3643058528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c196180 con 0x7f539c1007d0 2024-08-19T01:32:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.807+0000 7f53a225b640 1 -- 172.21.15.17:0/3643058528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c101300 con 0x7f539c1007d0 2024-08-19T01:32:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.807+0000 7f53997fa640 1 -- 172.21.15.17:0/3643058528 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5384031c90 con 0x7f539c1007d0 2024-08-19T01:32:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.807+0000 7f53997fa640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f538806e180 0x7f5388070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.808+0000 7f53997fa640 1 -- 172.21.15.17:0/3643058528 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f53840af2e0 con 0x7f539c1007d0 2024-08-19T01:32:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.808+0000 7f539b7fe640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f538806e180 0x7f5388070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:02.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.808+0000 7f539b7fe640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f538806e180 0x7f5388070640 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f538c00abe0 tx=0x7f538c00a5c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:02.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:02.812+0000 7f53997fa640 1 -- 172.21.15.17:0/3643058528 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5384078640 con 0x7f539c1007d0 2024-08-19T01:32:03.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.056+0000 7f53a225b640 1 -- 172.21.15.17:0/3643058528 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f539c108190 con 0x7f539c1007d0 2024-08-19T01:32:03.058 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:02 smithi017 ceph-mon[99370]: from='client.35830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:03.058 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:02 smithi017 ceph-mon[99370]: from='client.35834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:03.058 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:02 smithi017 ceph-mon[99370]: from='client.35838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:03.059 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:02 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/856205245' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:32:03.059 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:02 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/378815080' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:32:03.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.057+0000 7f53997fa640 1 -- 172.21.15.17:0/3643058528 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f538407bd00 con 0x7f539c1007d0 2024-08-19T01:32:03.059 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:32:03.059 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:32:03.059 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:32:03.059 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:32:03.059 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:32:03.060 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:32:03.061 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:32:03.061 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:32:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:32:03.061 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:32:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:32:03.061 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:32:03.061 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:32:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.059+0000 7f53a225b640 1 -- 172.21.15.17:0/3643058528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f538806e180 msgr2=0x7f5388070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.059+0000 7f53a225b640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f538806e180 0x7f5388070640 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f538c00abe0 tx=0x7f538c00a5c0 comp rx=0 tx=0).stop 2024-08-19T01:32:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.059+0000 7f53a225b640 1 -- 172.21.15.17:0/3643058528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f539c1007d0 msgr2=0x7f539c19be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.059+0000 7f53a225b640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f539c1007d0 0x7f539c19be60 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5384006010 tx=0x7f53840055a0 comp rx=0 tx=0).stop 2024-08-19T01:32:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.059+0000 7f53a225b640 1 -- 172.21.15.17:0/3643058528 shutdown_connections 2024-08-19T01:32:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.059+0000 7f53a225b640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f538806e180 0x7f5388070640 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.059+0000 7f53a225b640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f539c1007d0 0x7f539c19be60 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.059+0000 7f53a225b640 1 --2- 172.21.15.17:0/3643058528 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f539c0ffe20 0x7f539c19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.059+0000 7f53a225b640 1 -- 172.21.15.17:0/3643058528 >> 172.21.15.17:0/3643058528 conn(0x7f539c0fb900 msgr2=0x7f539c0fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.059+0000 7f53a225b640 1 -- 172.21.15.17:0/3643058528 shutdown_connections 2024-08-19T01:32:03.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:03.059+0000 7f53a225b640 1 -- 172.21.15.17:0/3643058528 wait complete. 2024-08-19T01:32:03.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:02 smithi086 ceph-mon[71303]: from='client.35830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:03.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:02 smithi086 ceph-mon[71303]: from='client.35834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:03.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:02 smithi086 ceph-mon[71303]: from='client.35838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:03.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:02 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/856205245' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:32:03.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:02 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/378815080' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:32:04.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:03 smithi017 ceph-mon[99370]: pgmap v999: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:03 smithi017 ceph-mon[99370]: from='client.35850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:32:04.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:03 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3643058528' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:32:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:03 smithi086 ceph-mon[71303]: pgmap v999: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:03 smithi086 ceph-mon[71303]: from='client.35850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:32:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:03 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3643058528' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:32:06.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:05 smithi017 ceph-mon[99370]: pgmap v1000: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:06.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:05 smithi086 ceph-mon[71303]: pgmap v1000: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:08.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:07 smithi017 ceph-mon[99370]: pgmap v1001: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:08.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:07 smithi086 ceph-mon[71303]: pgmap v1001: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:10.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:09 smithi017 ceph-mon[99370]: pgmap v1002: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:10.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:09 smithi086 ceph-mon[71303]: pgmap v1002: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:12.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:11 smithi017 ceph-mon[99370]: pgmap v1003: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:12.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:11 smithi086 ceph-mon[71303]: pgmap v1003: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:14.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:13 smithi017 ceph-mon[99370]: pgmap v1004: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:14.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:13 smithi086 ceph-mon[71303]: pgmap v1004: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:16.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:15 smithi017 ceph-mon[99370]: pgmap v1005: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:16.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:15 smithi086 ceph-mon[71303]: pgmap v1005: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:18.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:17 smithi017 ceph-mon[99370]: pgmap v1006: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:18.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:17 smithi086 ceph-mon[71303]: pgmap v1006: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:19.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:32:19.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:32:20.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:19 smithi086 ceph-mon[71303]: pgmap v1007: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:20.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:19 smithi017 ceph-mon[99370]: pgmap v1007: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:22.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:21 smithi086 ceph-mon[71303]: pgmap v1008: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:22.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:21 smithi017 ceph-mon[99370]: pgmap v1008: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:24.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:23 smithi086 ceph-mon[71303]: pgmap v1009: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:24.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:23 smithi017 ceph-mon[99370]: pgmap v1009: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:26.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:25 smithi086 ceph-mon[71303]: pgmap v1010: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:26.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:25 smithi017 ceph-mon[99370]: pgmap v1010: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:28.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:27 smithi017 ceph-mon[99370]: pgmap v1011: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:28.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:27 smithi086 ceph-mon[71303]: pgmap v1011: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:30.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:29 smithi017 ceph-mon[99370]: pgmap v1012: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:30.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:29 smithi086 ceph-mon[71303]: pgmap v1012: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:32.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:31 smithi086 ceph-mon[71303]: pgmap v1013: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:32.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:31 smithi017 ceph-mon[99370]: pgmap v1013: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.155+0000 7efedb236640 1 -- 172.21.15.17:0/1467558075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed40ffda0 msgr2=0x7efed4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.155+0000 7efedb236640 1 --2- 172.21.15.17:0/1467558075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed40ffda0 0x7efed4100180 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7efec8009880 tx=0x7efec802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.155+0000 7efedb236640 1 -- 172.21.15.17:0/1467558075 shutdown_connections 2024-08-19T01:32:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.155+0000 7efedb236640 1 --2- 172.21.15.17:0/1467558075 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efed4100750 0x7efed41047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.155+0000 7efedb236640 1 --2- 172.21.15.17:0/1467558075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed40ffda0 0x7efed4100180 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.155+0000 7efedb236640 1 -- 172.21.15.17:0/1467558075 >> 172.21.15.17:0/1467558075 conn(0x7efed40fb840 msgr2=0x7efed40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.155+0000 7efedb236640 1 -- 172.21.15.17:0/1467558075 shutdown_connections 2024-08-19T01:32:33.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.155+0000 7efedb236640 1 -- 172.21.15.17:0/1467558075 wait complete. 2024-08-19T01:32:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.156+0000 7efedb236640 1 Processor -- start 2024-08-19T01:32:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.156+0000 7efedb236640 1 -- start start 2024-08-19T01:32:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.156+0000 7efedb236640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efed40ffda0 0x7efed419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.156+0000 7efedb236640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed4100750 0x7efed419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.156+0000 7efedb236640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed419c360 con 0x7efed4100750 2024-08-19T01:32:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.156+0000 7efedb236640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed41958f0 con 0x7efed40ffda0 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.156+0000 7efed3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed4100750 0x7efed419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.157+0000 7efed3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed4100750 0x7efed419bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55642/0 (socket says 172.21.15.17:55642) 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.157+0000 7efed3fff640 1 -- 172.21.15.17:0/1645440427 learned_addr learned my addr 172.21.15.17:0/1645440427 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.157+0000 7efed8fd2640 1 --2- 172.21.15.17:0/1645440427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efed40ffda0 0x7efed419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.157+0000 7efed3fff640 1 -- 172.21.15.17:0/1645440427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efed40ffda0 msgr2=0x7efed419b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.157+0000 7efed3fff640 1 --2- 172.21.15.17:0/1645440427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efed40ffda0 0x7efed419b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.157+0000 7efed3fff640 1 -- 172.21.15.17:0/1645440427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec8009560 con 0x7efed4100750 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.157+0000 7efed3fff640 1 --2- 172.21.15.17:0/1645440427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed4100750 0x7efed419bd40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7efec000d8d0 tx=0x7efec000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.157+0000 7efed1ffb640 1 -- 172.21.15.17:0/1645440427 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efec000bea0 con 0x7efed4100750 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.157+0000 7efed1ffb640 1 -- 172.21.15.17:0/1645440427 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efec0009c00 con 0x7efed4100750 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.157+0000 7efedb236640 1 -- 172.21.15.17:0/1645440427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed4195bd0 con 0x7efed4100750 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.157+0000 7efed1ffb640 1 -- 172.21.15.17:0/1645440427 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efec000f710 con 0x7efed4100750 2024-08-19T01:32:33.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.158+0000 7efedb236640 1 -- 172.21.15.17:0/1645440427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed4196120 con 0x7efed4100750 2024-08-19T01:32:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.159+0000 7efedb236640 1 -- 172.21.15.17:0/1645440427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed4101280 con 0x7efed4100750 2024-08-19T01:32:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.159+0000 7efed1ffb640 1 -- 172.21.15.17:0/1645440427 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efec0010460 con 0x7efed4100750 2024-08-19T01:32:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.160+0000 7efed1ffb640 1 --2- 172.21.15.17:0/1645440427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efec406e170 0x7efec4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.160+0000 7efed1ffb640 1 -- 172.21.15.17:0/1645440427 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efec008dd80 con 0x7efed4100750 2024-08-19T01:32:33.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.160+0000 7efed8fd2640 1 --2- 172.21.15.17:0/1645440427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efec406e170 0x7efec4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:33.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.160+0000 7efed8fd2640 1 --2- 172.21.15.17:0/1645440427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efec406e170 0x7efec4070630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efec8009230 tx=0x7efec80058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:33.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.165+0000 7efed1ffb640 1 -- 172.21.15.17:0/1645440427 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efec0057190 con 0x7efed4100750 2024-08-19T01:32:33.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.361+0000 7efedb236640 1 -- 172.21.15.17:0/1645440427 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efed410cdb0 con 0x7efec406e170 2024-08-19T01:32:33.363 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:32:33.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.363+0000 7efed1ffb640 1 -- 172.21.15.17:0/1645440427 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7efed410cdb0 con 0x7efec406e170 2024-08-19T01:32:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.364+0000 7efedb236640 1 -- 172.21.15.17:0/1645440427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efec406e170 msgr2=0x7efec4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.364+0000 7efedb236640 1 --2- 172.21.15.17:0/1645440427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efec406e170 0x7efec4070630 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efec8009230 tx=0x7efec80058d0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.365+0000 7efedb236640 1 -- 172.21.15.17:0/1645440427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed4100750 msgr2=0x7efed419bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.365+0000 7efedb236640 1 --2- 172.21.15.17:0/1645440427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed4100750 0x7efed419bd40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7efec000d8d0 tx=0x7efec000dd90 comp rx=0 tx=0).stop 2024-08-19T01:32:33.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.365+0000 7efedb236640 1 -- 172.21.15.17:0/1645440427 shutdown_connections 2024-08-19T01:32:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.365+0000 7efedb236640 1 --2- 172.21.15.17:0/1645440427 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efec406e170 0x7efec4070630 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.365+0000 7efedb236640 1 --2- 172.21.15.17:0/1645440427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efed4100750 0x7efed419bd40 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.365+0000 7efedb236640 1 --2- 172.21.15.17:0/1645440427 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efed40ffda0 0x7efed419b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.365+0000 7efedb236640 1 -- 172.21.15.17:0/1645440427 >> 172.21.15.17:0/1645440427 conn(0x7efed40fb840 msgr2=0x7efed40fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.365+0000 7efedb236640 1 -- 172.21.15.17:0/1645440427 shutdown_connections 2024-08-19T01:32:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.365+0000 7efedb236640 1 -- 172.21.15.17:0/1645440427 wait complete. 2024-08-19T01:32:33.375 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:32:33.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:32:33.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.448+0000 7f56286d5640 1 -- 172.21.15.17:0/940154454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56200fea30 msgr2=0x7f56200fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.448+0000 7f56286d5640 1 --2- 172.21.15.17:0/940154454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56200fea30 0x7f56200fee90 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5614009880 tx=0x7f561402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.448+0000 7f56286d5640 1 -- 172.21.15.17:0/940154454 shutdown_connections 2024-08-19T01:32:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.448+0000 7f56286d5640 1 --2- 172.21.15.17:0/940154454 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56200fea30 0x7f56200fee90 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.448+0000 7f56286d5640 1 --2- 172.21.15.17:0/940154454 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5620104a30 0x7f5620104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.448+0000 7f56286d5640 1 -- 172.21.15.17:0/940154454 >> 172.21.15.17:0/940154454 conn(0x7f56200fa730 msgr2=0x7f56200fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.448+0000 7f56286d5640 1 -- 172.21.15.17:0/940154454 shutdown_connections 2024-08-19T01:32:33.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.448+0000 7f56286d5640 1 -- 172.21.15.17:0/940154454 wait complete. 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f56286d5640 1 Processor -- start 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f56286d5640 1 -- start start 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f56286d5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56200fea30 0x7f56201099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f56286d5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5620104a30 0x7f5620109f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f56286d5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562010b990 con 0x7f56200fea30 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f56286d5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562010a440 con 0x7f5620104a30 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f5626471640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56200fea30 0x7f56201099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f5626471640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56200fea30 0x7f56201099c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55658/0 (socket says 172.21.15.17:55658) 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f5626471640 1 -- 172.21.15.17:0/1227742874 learned_addr learned my addr 172.21.15.17:0/1227742874 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f5625c70640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5620104a30 0x7f5620109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f5626471640 1 -- 172.21.15.17:0/1227742874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5620104a30 msgr2=0x7f5620109f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f5626471640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5620104a30 0x7f5620109f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f5626471640 1 -- 172.21.15.17:0/1227742874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5614009560 con 0x7f56200fea30 2024-08-19T01:32:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.449+0000 7f5625c70640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5620104a30 0x7f5620109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:32:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.450+0000 7f5626471640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56200fea30 0x7f56201099c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f561800c8a0 tx=0x7f561800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.450+0000 7f561f7fe640 1 -- 172.21.15.17:0/1227742874 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5618007b80 con 0x7f56200fea30 2024-08-19T01:32:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.450+0000 7f561f7fe640 1 -- 172.21.15.17:0/1227742874 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5618007ce0 con 0x7f56200fea30 2024-08-19T01:32:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.450+0000 7f56286d5640 1 -- 172.21.15.17:0/1227742874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562010a720 con 0x7f56200fea30 2024-08-19T01:32:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.450+0000 7f561f7fe640 1 -- 172.21.15.17:0/1227742874 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5618018810 con 0x7f56200fea30 2024-08-19T01:32:33.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.450+0000 7f56286d5640 1 -- 172.21.15.17:0/1227742874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56201a1f10 con 0x7f56200fea30 2024-08-19T01:32:33.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.451+0000 7f56286d5640 1 -- 172.21.15.17:0/1227742874 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5620100170 con 0x7f56200fea30 2024-08-19T01:32:33.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.451+0000 7f561f7fe640 1 -- 172.21.15.17:0/1227742874 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5618018a80 con 0x7f56200fea30 2024-08-19T01:32:33.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.452+0000 7f561f7fe640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560806e170 0x7f5608070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:33.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.452+0000 7f561f7fe640 1 -- 172.21.15.17:0/1227742874 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f561808e380 con 0x7f56200fea30 2024-08-19T01:32:33.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.452+0000 7f5625c70640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560806e170 0x7f5608070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:33.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.452+0000 7f5625c70640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560806e170 0x7f5608070630 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5614000c00 tx=0x7f5614005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:33.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.456+0000 7f561f7fe640 1 -- 172.21.15.17:0/1227742874 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5618057660 con 0x7f56200fea30 2024-08-19T01:32:33.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.648+0000 7f56286d5640 1 -- 172.21.15.17:0/1227742874 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f562010af90 con 0x7f560806e170 2024-08-19T01:32:33.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.650+0000 7f561f7fe640 1 -- 172.21.15.17:0/1227742874 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f562010af90 con 0x7f560806e170 2024-08-19T01:32:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.652+0000 7f56286d5640 1 -- 172.21.15.17:0/1227742874 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560806e170 msgr2=0x7f5608070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.652+0000 7f56286d5640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560806e170 0x7f5608070630 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5614000c00 tx=0x7f5614005a20 comp rx=0 tx=0).stop 2024-08-19T01:32:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.652+0000 7f56286d5640 1 -- 172.21.15.17:0/1227742874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56200fea30 msgr2=0x7f56201099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.652+0000 7f56286d5640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56200fea30 0x7f56201099c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f561800c8a0 tx=0x7f561800cd60 comp rx=0 tx=0).stop 2024-08-19T01:32:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.653+0000 7f56286d5640 1 -- 172.21.15.17:0/1227742874 shutdown_connections 2024-08-19T01:32:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.653+0000 7f56286d5640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f560806e170 0x7f5608070630 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.653+0000 7f56286d5640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5620104a30 0x7f5620109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.653+0000 7f56286d5640 1 --2- 172.21.15.17:0/1227742874 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56200fea30 0x7f56201099c0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.653+0000 7f56286d5640 1 -- 172.21.15.17:0/1227742874 >> 172.21.15.17:0/1227742874 conn(0x7f56200fa730 msgr2=0x7f56200fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.653+0000 7f56286d5640 1 -- 172.21.15.17:0/1227742874 shutdown_connections 2024-08-19T01:32:33.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.653+0000 7f56286d5640 1 -- 172.21.15.17:0/1227742874 wait complete. 2024-08-19T01:32:33.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.735+0000 7f55d4862640 1 -- 172.21.15.17:0/709577829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d0104a30 msgr2=0x7f55d0104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.735+0000 7f55d4862640 1 --2- 172.21.15.17:0/709577829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d0104a30 0x7f55d0104e10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009880 tx=0x7f55c002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.735+0000 7f55d4862640 1 -- 172.21.15.17:0/709577829 shutdown_connections 2024-08-19T01:32:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.735+0000 7f55d4862640 1 --2- 172.21.15.17:0/709577829 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d00fea30 0x7f55d00fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.735+0000 7f55d4862640 1 --2- 172.21.15.17:0/709577829 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d0104a30 0x7f55d0104e10 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.735+0000 7f55d4862640 1 -- 172.21.15.17:0/709577829 >> 172.21.15.17:0/709577829 conn(0x7f55d00fa730 msgr2=0x7f55d00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.735+0000 7f55d4862640 1 -- 172.21.15.17:0/709577829 shutdown_connections 2024-08-19T01:32:33.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.735+0000 7f55d4862640 1 -- 172.21.15.17:0/709577829 wait complete. 2024-08-19T01:32:33.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.735+0000 7f55d4862640 1 Processor -- start 2024-08-19T01:32:33.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55d4862640 1 -- start start 2024-08-19T01:32:33.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55d4862640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fea30 0x7f55d01968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:33.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55d4862640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d0104a30 0x7f55d0196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:33.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55d4862640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d01973d0 con 0x7f55d00fea30 2024-08-19T01:32:33.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55d4862640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0197540 con 0x7f55d0104a30 2024-08-19T01:32:33.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fea30 0x7f55d01968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:33.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55ce59c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fea30 0x7f55d01968c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55672/0 (socket says 172.21.15.17:55672) 2024-08-19T01:32:33.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55ce59c640 1 -- 172.21.15.17:0/3276035017 learned_addr learned my addr 172.21.15.17:0/3276035017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:33.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55cdd9b640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d0104a30 0x7f55d0196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:33.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55ce59c640 1 -- 172.21.15.17:0/3276035017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d0104a30 msgr2=0x7f55d0196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55ce59c640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d0104a30 0x7f55d0196e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55ce59c640 1 -- 172.21.15.17:0/3276035017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c0009560 con 0x7f55d00fea30 2024-08-19T01:32:33.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55cdd9b640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d0104a30 0x7f55d0196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:32:33.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.736+0000 7f55ce59c640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fea30 0x7f55d01968c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f55c0006010 tx=0x7f55c00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:33.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.737+0000 7f55bf7fe640 1 -- 172.21.15.17:0/3276035017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c0004aa0 con 0x7f55d00fea30 2024-08-19T01:32:33.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.737+0000 7f55d4862640 1 -- 172.21.15.17:0/3276035017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d019f930 con 0x7f55d00fea30 2024-08-19T01:32:33.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.737+0000 7f55bf7fe640 1 -- 172.21.15.17:0/3276035017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55c0031470 con 0x7f55d00fea30 2024-08-19T01:32:33.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.737+0000 7f55bf7fe640 1 -- 172.21.15.17:0/3276035017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c0003940 con 0x7f55d00fea30 2024-08-19T01:32:33.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.737+0000 7f55d4862640 1 -- 172.21.15.17:0/3276035017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d019fd40 con 0x7f55d00fea30 2024-08-19T01:32:33.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.738+0000 7f55d4862640 1 -- 172.21.15.17:0/3276035017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d0100170 con 0x7f55d00fea30 2024-08-19T01:32:33.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.738+0000 7f55bf7fe640 1 -- 172.21.15.17:0/3276035017 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f55c0031b90 con 0x7f55d00fea30 2024-08-19T01:32:33.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.738+0000 7f55bf7fe640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e180 0x7f55b8070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:33.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.739+0000 7f55bf7fe640 1 -- 172.21.15.17:0/3276035017 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f55c00af2c0 con 0x7f55d00fea30 2024-08-19T01:32:33.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.739+0000 7f55cdd9b640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e180 0x7f55b8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:33.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.739+0000 7f55cdd9b640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e180 0x7f55b8070640 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f55d0068cd0 tx=0x7f55c4005e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:33.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.743+0000 7f55bf7fe640 1 -- 172.21.15.17:0/3276035017 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f55c00785a0 con 0x7f55d00fea30 2024-08-19T01:32:33.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.925+0000 7f55d4862640 1 -- 172.21.15.17:0/3276035017 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f55d010bca0 con 0x7f55b806e180 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.935+0000 7f55bf7fe640 1 -- 172.21.15.17:0/3276035017 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f55d010bca0 con 0x7f55b806e180 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (33m) 12m ago 44m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (44m) 12m ago 44m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (43m) 12m ago 43m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (31m) 12m ago 44m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (31m) 12m ago 43m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (33m) 12m ago 44m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (27m) 12m ago 39m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (28m) 12m ago 39m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (12m) 12m ago 38m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:32:33.937 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (27m) 12m ago 39m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (35m) 12m ago 45m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (34m) 12m ago 43m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (32m) 12m ago 46m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (32m) 12m ago 43m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (34m) 12m ago 44m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (34m) 12m ago 43m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (31m) 12m ago 42m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (30m) 12m ago 42m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (30m) 12m ago 41m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (29m) 12m ago 41m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (28m) 12m ago 41m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (28m) 12m ago 40m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:32:33.938 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (34m) 12m ago 44m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:32:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.937+0000 7f55d4862640 1 -- 172.21.15.17:0/3276035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e180 msgr2=0x7f55b8070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.937+0000 7f55d4862640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e180 0x7f55b8070640 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f55d0068cd0 tx=0x7f55c4005e50 comp rx=0 tx=0).stop 2024-08-19T01:32:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.937+0000 7f55d4862640 1 -- 172.21.15.17:0/3276035017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fea30 msgr2=0x7f55d01968c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:33.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.937+0000 7f55d4862640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fea30 0x7f55d01968c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f55c0006010 tx=0x7f55c00055a0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.937+0000 7f55d4862640 1 -- 172.21.15.17:0/3276035017 shutdown_connections 2024-08-19T01:32:33.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.937+0000 7f55d4862640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f55b806e180 0x7f55b8070640 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.937+0000 7f55d4862640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f55d0104a30 0x7f55d0196e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.937+0000 7f55d4862640 1 --2- 172.21.15.17:0/3276035017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f55d00fea30 0x7f55d01968c0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:33.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.937+0000 7f55d4862640 1 -- 172.21.15.17:0/3276035017 >> 172.21.15.17:0/3276035017 conn(0x7f55d00fa730 msgr2=0x7f55d00fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:33.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.938+0000 7f55d4862640 1 -- 172.21.15.17:0/3276035017 shutdown_connections 2024-08-19T01:32:33.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:33.938+0000 7f55d4862640 1 -- 172.21.15.17:0/3276035017 wait complete. 2024-08-19T01:32:34.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.018+0000 7fbc1297a640 1 -- 172.21.15.17:0/3567028169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc0c0fe9f0 msgr2=0x7fbc0c0fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.018+0000 7fbc1297a640 1 --2- 172.21.15.17:0/3567028169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc0c0fe9f0 0x7fbc0c0fee50 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009880 tx=0x7fbc0002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.019+0000 7fbc1297a640 1 -- 172.21.15.17:0/3567028169 shutdown_connections 2024-08-19T01:32:34.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.019+0000 7fbc1297a640 1 --2- 172.21.15.17:0/3567028169 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc0c0fe9f0 0x7fbc0c0fee50 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.019+0000 7fbc1297a640 1 --2- 172.21.15.17:0/3567028169 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc0c1049f0 0x7fbc0c104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.019+0000 7fbc1297a640 1 -- 172.21.15.17:0/3567028169 >> 172.21.15.17:0/3567028169 conn(0x7fbc0c0758a0 msgr2=0x7fbc0c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:34.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.019+0000 7fbc1297a640 1 -- 172.21.15.17:0/3567028169 shutdown_connections 2024-08-19T01:32:34.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.019+0000 7fbc1297a640 1 -- 172.21.15.17:0/3567028169 wait complete. 2024-08-19T01:32:34.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.019+0000 7fbc1297a640 1 Processor -- start 2024-08-19T01:32:34.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.019+0000 7fbc1297a640 1 -- start start 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc1297a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc0c0fe9f0 0x7fbc0c19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc1297a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc0c1049f0 0x7fbc0c19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc1297a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c19c510 con 0x7fbc0c1049f0 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc1297a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c1959e0 con 0x7fbc0c0fe9f0 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc0b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc0c1049f0 0x7fbc0c19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc0b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc0c1049f0 0x7fbc0c19bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55694/0 (socket says 172.21.15.17:55694) 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc0b7fe640 1 -- 172.21.15.17:0/3445306576 learned_addr learned my addr 172.21.15.17:0/3445306576 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc0bfff640 1 --2- 172.21.15.17:0/3445306576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc0c0fe9f0 0x7fbc0c19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc0b7fe640 1 -- 172.21.15.17:0/3445306576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc0c0fe9f0 msgr2=0x7fbc0c19b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc0b7fe640 1 --2- 172.21.15.17:0/3445306576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc0c0fe9f0 0x7fbc0c19b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc0b7fe640 1 -- 172.21.15.17:0/3445306576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc00009560 con 0x7fbc0c1049f0 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc0b7fe640 1 --2- 172.21.15.17:0/3445306576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc0c1049f0 0x7fbc0c19bec0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fbc0002a9c0 tx=0x7fbc000055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:34.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.020+0000 7fbc097fa640 1 -- 172.21.15.17:0/3445306576 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc00004aa0 con 0x7fbc0c1049f0 2024-08-19T01:32:34.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.021+0000 7fbc1297a640 1 -- 172.21.15.17:0/3445306576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0c195c60 con 0x7fbc0c1049f0 2024-08-19T01:32:34.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.021+0000 7fbc097fa640 1 -- 172.21.15.17:0/3445306576 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc00004c00 con 0x7fbc0c1049f0 2024-08-19T01:32:34.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.021+0000 7fbc097fa640 1 -- 172.21.15.17:0/3445306576 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc00003a20 con 0x7fbc0c1049f0 2024-08-19T01:32:34.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.021+0000 7fbc1297a640 1 -- 172.21.15.17:0/3445306576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0c196150 con 0x7fbc0c1049f0 2024-08-19T01:32:34.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.021+0000 7fbc1297a640 1 -- 172.21.15.17:0/3445306576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0c100130 con 0x7fbc0c1049f0 2024-08-19T01:32:34.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.022+0000 7fbc097fa640 1 -- 172.21.15.17:0/3445306576 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbc00031c90 con 0x7fbc0c1049f0 2024-08-19T01:32:34.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.022+0000 7fbc097fa640 1 --2- 172.21.15.17:0/3445306576 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbf406e170 0x7fbbf4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.023+0000 7fbc097fa640 1 -- 172.21.15.17:0/3445306576 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fbc000af220 con 0x7fbc0c1049f0 2024-08-19T01:32:34.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.023+0000 7fbc0bfff640 1 --2- 172.21.15.17:0/3445306576 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbf406e170 0x7fbbf4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.023+0000 7fbc0bfff640 1 --2- 172.21.15.17:0/3445306576 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbf406e170 0x7fbbf4070630 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00abe0 tx=0x7fbbfc00a2d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:34.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.027+0000 7fbc097fa640 1 -- 172.21.15.17:0/3445306576 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbc00078500 con 0x7fbc0c1049f0 2024-08-19T01:32:34.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:34 smithi017 ceph-mon[99370]: pgmap v1014: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:34.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.270+0000 7fbc1297a640 1 -- 172.21.15.17:0/3445306576 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbc0c10bc60 con 0x7fbc0c1049f0 2024-08-19T01:32:34.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.270+0000 7fbc097fa640 1 -- 172.21.15.17:0/3445306576 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fbc0007bbc0 con 0x7fbc0c1049f0 2024-08-19T01:32:34.272 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:32:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:32:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:32:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:32:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:32:34.272 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:32:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:32:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:32:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:32:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:32:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:32:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:32:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:32:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:32:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:32:34.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:32:34.273 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:32:34.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.273+0000 7fbc1297a640 1 -- 172.21.15.17:0/3445306576 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbf406e170 msgr2=0x7fbbf4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.273+0000 7fbc1297a640 1 --2- 172.21.15.17:0/3445306576 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbf406e170 0x7fbbf4070630 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00abe0 tx=0x7fbbfc00a2d0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.273+0000 7fbc1297a640 1 -- 172.21.15.17:0/3445306576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc0c1049f0 msgr2=0x7fbc0c19bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.273+0000 7fbc1297a640 1 --2- 172.21.15.17:0/3445306576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc0c1049f0 0x7fbc0c19bec0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fbc0002a9c0 tx=0x7fbc000055a0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.273+0000 7fbc1297a640 1 -- 172.21.15.17:0/3445306576 shutdown_connections 2024-08-19T01:32:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.273+0000 7fbc1297a640 1 --2- 172.21.15.17:0/3445306576 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbbf406e170 0x7fbbf4070630 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.273+0000 7fbc1297a640 1 --2- 172.21.15.17:0/3445306576 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbc0c1049f0 0x7fbc0c19bec0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.273+0000 7fbc1297a640 1 --2- 172.21.15.17:0/3445306576 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbc0c0fe9f0 0x7fbc0c19b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.273+0000 7fbc1297a640 1 -- 172.21.15.17:0/3445306576 >> 172.21.15.17:0/3445306576 conn(0x7fbc0c0758a0 msgr2=0x7fbc0c0fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.273+0000 7fbc1297a640 1 -- 172.21.15.17:0/3445306576 shutdown_connections 2024-08-19T01:32:34.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.273+0000 7fbc1297a640 1 -- 172.21.15.17:0/3445306576 wait complete. 2024-08-19T01:32:34.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.354+0000 7f0832c1d640 1 -- 172.21.15.17:0/1961477210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c1049f0 msgr2=0x7f082c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.354+0000 7f0832c1d640 1 --2- 172.21.15.17:0/1961477210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c1049f0 0x7f082c104dd0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0820009880 tx=0x7f082002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 -- 172.21.15.17:0/1961477210 shutdown_connections 2024-08-19T01:32:34.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 --2- 172.21.15.17:0/1961477210 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f082c0fe9f0 0x7f082c0fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 --2- 172.21.15.17:0/1961477210 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c1049f0 0x7f082c104dd0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 -- 172.21.15.17:0/1961477210 >> 172.21.15.17:0/1961477210 conn(0x7f082c0758a0 msgr2=0x7f082c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:34.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 -- 172.21.15.17:0/1961477210 shutdown_connections 2024-08-19T01:32:34.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 -- 172.21.15.17:0/1961477210 wait complete. 2024-08-19T01:32:34.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 Processor -- start 2024-08-19T01:32:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 -- start start 2024-08-19T01:32:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f082c0fe9f0 0x7f082c196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c1049f0 0x7f082c196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c197410 con 0x7f082c1049f0 2024-08-19T01:32:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.355+0000 7f0832c1d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c197550 con 0x7f082c0fe9f0 2024-08-19T01:32:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f082bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c1049f0 0x7f082c196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f082bfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c1049f0 0x7f082c196e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55704/0 (socket says 172.21.15.17:55704) 2024-08-19T01:32:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f082bfff640 1 -- 172.21.15.17:0/4237949217 learned_addr learned my addr 172.21.15.17:0/4237949217 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f08309b9640 1 --2- 172.21.15.17:0/4237949217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f082c0fe9f0 0x7f082c196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f082bfff640 1 -- 172.21.15.17:0/4237949217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f082c0fe9f0 msgr2=0x7f082c196900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f082bfff640 1 --2- 172.21.15.17:0/4237949217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f082c0fe9f0 0x7f082c196900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f082bfff640 1 -- 172.21.15.17:0/4237949217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820009560 con 0x7f082c1049f0 2024-08-19T01:32:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f082bfff640 1 --2- 172.21.15.17:0/4237949217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c1049f0 0x7f082c196e40 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f081800d8d0 tx=0x7f081800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f0829ffb640 1 -- 172.21.15.17:0/4237949217 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f081800bea0 con 0x7f082c1049f0 2024-08-19T01:32:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f0829ffb640 1 -- 172.21.15.17:0/4237949217 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0818009c00 con 0x7f082c1049f0 2024-08-19T01:32:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f0832c1d640 1 -- 172.21.15.17:0/4237949217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c19f970 con 0x7f082c1049f0 2024-08-19T01:32:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.356+0000 7f0829ffb640 1 -- 172.21.15.17:0/4237949217 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f081800f710 con 0x7f082c1049f0 2024-08-19T01:32:34.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.357+0000 7f0832c1d640 1 -- 172.21.15.17:0/4237949217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c19fde0 con 0x7f082c1049f0 2024-08-19T01:32:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.358+0000 7f0832c1d640 1 -- 172.21.15.17:0/4237949217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082c100130 con 0x7f082c1049f0 2024-08-19T01:32:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.358+0000 7f0829ffb640 1 -- 172.21.15.17:0/4237949217 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f081800f990 con 0x7f082c1049f0 2024-08-19T01:32:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.358+0000 7f0829ffb640 1 --2- 172.21.15.17:0/4237949217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f081c06e180 0x7f081c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.359+0000 7f0829ffb640 1 -- 172.21.15.17:0/4237949217 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f081808df20 con 0x7f082c1049f0 2024-08-19T01:32:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.359+0000 7f08309b9640 1 --2- 172.21.15.17:0/4237949217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f081c06e180 0x7f081c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.359+0000 7f08309b9640 1 --2- 172.21.15.17:0/4237949217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f081c06e180 0x7f081c070640 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0820000c00 tx=0x7f0820005e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:34.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.363+0000 7f0829ffb640 1 -- 172.21.15.17:0/4237949217 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f08180c2df0 con 0x7f082c1049f0 2024-08-19T01:32:34.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:34 smithi086 ceph-mon[71303]: pgmap v1014: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:34.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.576+0000 7f0832c1d640 1 -- 172.21.15.17:0/4237949217 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f082c0fee50 con 0x7f082c1049f0 2024-08-19T01:32:34.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.576+0000 7f0829ffb640 1 -- 172.21.15.17:0/4237949217 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f0818057200 con 0x7f082c1049f0 2024-08-19T01:32:34.578 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:32:34.578 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:32:34.578 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:32:34.578 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:32:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:32:34.580 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:32:34.581 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:32:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:32:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.579+0000 7f0832c1d640 1 -- 172.21.15.17:0/4237949217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f081c06e180 msgr2=0x7f081c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.579+0000 7f0832c1d640 1 --2- 172.21.15.17:0/4237949217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f081c06e180 0x7f081c070640 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0820000c00 tx=0x7f0820005e30 comp rx=0 tx=0).stop 2024-08-19T01:32:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.579+0000 7f0832c1d640 1 -- 172.21.15.17:0/4237949217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c1049f0 msgr2=0x7f082c196e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.579+0000 7f0832c1d640 1 --2- 172.21.15.17:0/4237949217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c1049f0 0x7f082c196e40 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f081800d8d0 tx=0x7f081800dd90 comp rx=0 tx=0).stop 2024-08-19T01:32:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.579+0000 7f0832c1d640 1 -- 172.21.15.17:0/4237949217 shutdown_connections 2024-08-19T01:32:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.579+0000 7f0832c1d640 1 --2- 172.21.15.17:0/4237949217 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f081c06e180 0x7f081c070640 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.579+0000 7f0832c1d640 1 --2- 172.21.15.17:0/4237949217 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f082c1049f0 0x7f082c196e40 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.579+0000 7f0832c1d640 1 --2- 172.21.15.17:0/4237949217 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f082c0fe9f0 0x7f082c196900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.579+0000 7f0832c1d640 1 -- 172.21.15.17:0/4237949217 >> 172.21.15.17:0/4237949217 conn(0x7f082c0758a0 msgr2=0x7f082c0fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.579+0000 7f0832c1d640 1 -- 172.21.15.17:0/4237949217 shutdown_connections 2024-08-19T01:32:34.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.579+0000 7f0832c1d640 1 -- 172.21.15.17:0/4237949217 wait complete. 2024-08-19T01:32:34.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.664+0000 7f80efd77640 1 -- 172.21.15.17:0/2969452280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80e80ffb30 msgr2=0x7f80e80fff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.664+0000 7f80efd77640 1 --2- 172.21.15.17:0/2969452280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80e80ffb30 0x7f80e80fff90 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009880 tx=0x7f80d802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.664+0000 7f80efd77640 1 -- 172.21.15.17:0/2969452280 shutdown_connections 2024-08-19T01:32:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.664+0000 7f80efd77640 1 --2- 172.21.15.17:0/2969452280 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80e80ffb30 0x7f80e80fff90 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.664+0000 7f80efd77640 1 --2- 172.21.15.17:0/2969452280 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80e8105be0 0x7f80e8105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.664+0000 7f80efd77640 1 -- 172.21.15.17:0/2969452280 >> 172.21.15.17:0/2969452280 conn(0x7f80e80fb810 msgr2=0x7f80e80fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.664+0000 7f80efd77640 1 -- 172.21.15.17:0/2969452280 shutdown_connections 2024-08-19T01:32:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.664+0000 7f80efd77640 1 -- 172.21.15.17:0/2969452280 wait complete. 2024-08-19T01:32:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80efd77640 1 Processor -- start 2024-08-19T01:32:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80efd77640 1 -- start start 2024-08-19T01:32:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80efd77640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80e80ffb30 0x7f80e8197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80efd77640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80e8105be0 0x7f80e81981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80efd77640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81988c0 con 0x7f80e8105be0 2024-08-19T01:32:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80efd77640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e819b530 con 0x7f80e80ffb30 2024-08-19T01:32:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80ed312640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80e8105be0 0x7f80e81981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80ed312640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80e8105be0 0x7f80e81981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55718/0 (socket says 172.21.15.17:55718) 2024-08-19T01:32:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80ed312640 1 -- 172.21.15.17:0/1085252456 learned_addr learned my addr 172.21.15.17:0/1085252456 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80edb13640 1 --2- 172.21.15.17:0/1085252456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80e80ffb30 0x7f80e8197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80ed312640 1 -- 172.21.15.17:0/1085252456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80e80ffb30 msgr2=0x7f80e8197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80ed312640 1 --2- 172.21.15.17:0/1085252456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80e80ffb30 0x7f80e8197ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.665+0000 7f80ed312640 1 -- 172.21.15.17:0/1085252456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8009560 con 0x7f80e8105be0 2024-08-19T01:32:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.666+0000 7f80ed312640 1 --2- 172.21.15.17:0/1085252456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80e8105be0 0x7f80e81981e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f80d802a9c0 tx=0x7f80d80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.666+0000 7f80deffd640 1 -- 172.21.15.17:0/1085252456 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d8004aa0 con 0x7f80e8105be0 2024-08-19T01:32:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.666+0000 7f80deffd640 1 -- 172.21.15.17:0/1085252456 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80d8004c00 con 0x7f80e8105be0 2024-08-19T01:32:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.666+0000 7f80efd77640 1 -- 172.21.15.17:0/1085252456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e819b7b0 con 0x7f80e8105be0 2024-08-19T01:32:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.666+0000 7f80deffd640 1 -- 172.21.15.17:0/1085252456 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d8003ab0 con 0x7f80e8105be0 2024-08-19T01:32:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.666+0000 7f80efd77640 1 -- 172.21.15.17:0/1085252456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e819bd20 con 0x7f80e8105be0 2024-08-19T01:32:34.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.667+0000 7f80efd77640 1 -- 172.21.15.17:0/1085252456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e81011e0 con 0x7f80e8105be0 2024-08-19T01:32:34.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.667+0000 7f80deffd640 1 -- 172.21.15.17:0/1085252456 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f80d8003c10 con 0x7f80e8105be0 2024-08-19T01:32:34.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.668+0000 7f80deffd640 1 --2- 172.21.15.17:0/1085252456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f80d406e170 0x7f80d4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.668+0000 7f80deffd640 1 -- 172.21.15.17:0/1085252456 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f80d80af1b0 con 0x7f80e8105be0 2024-08-19T01:32:34.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.668+0000 7f80edb13640 1 --2- 172.21.15.17:0/1085252456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f80d406e170 0x7f80d4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.668+0000 7f80edb13640 1 --2- 172.21.15.17:0/1085252456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f80d406e170 0x7f80d4070630 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f80e4005fd0 tx=0x7f80e4005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.672+0000 7f80deffd640 1 -- 172.21.15.17:0/1085252456 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f80d8078510 con 0x7f80e8105be0 2024-08-19T01:32:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.864+0000 7f80efd77640 1 -- 172.21.15.17:0/1085252456 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80e810cda0 con 0x7f80d406e170 2024-08-19T01:32:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.865+0000 7f80deffd640 1 -- 172.21.15.17:0/1085252456 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f80e810cda0 con 0x7f80d406e170 2024-08-19T01:32:34.866 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:32:34.866 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:32:34.867 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:32:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.867+0000 7f80efd77640 1 -- 172.21.15.17:0/1085252456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f80d406e170 msgr2=0x7f80d4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.867+0000 7f80efd77640 1 --2- 172.21.15.17:0/1085252456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f80d406e170 0x7f80d4070630 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f80e4005fd0 tx=0x7f80e4005e20 comp rx=0 tx=0).stop 2024-08-19T01:32:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.867+0000 7f80efd77640 1 -- 172.21.15.17:0/1085252456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80e8105be0 msgr2=0x7f80e81981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.867+0000 7f80efd77640 1 --2- 172.21.15.17:0/1085252456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80e8105be0 0x7f80e81981e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f80d802a9c0 tx=0x7f80d80055a0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.867+0000 7f80efd77640 1 -- 172.21.15.17:0/1085252456 shutdown_connections 2024-08-19T01:32:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.867+0000 7f80efd77640 1 --2- 172.21.15.17:0/1085252456 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f80d406e170 0x7f80d4070630 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.867+0000 7f80efd77640 1 --2- 172.21.15.17:0/1085252456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f80e8105be0 0x7f80e81981e0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.867+0000 7f80efd77640 1 --2- 172.21.15.17:0/1085252456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f80e80ffb30 0x7f80e8197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.867+0000 7f80efd77640 1 -- 172.21.15.17:0/1085252456 >> 172.21.15.17:0/1085252456 conn(0x7f80e80fb810 msgr2=0x7f80e8072f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.867+0000 7f80efd77640 1 -- 172.21.15.17:0/1085252456 shutdown_connections 2024-08-19T01:32:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.867+0000 7f80efd77640 1 -- 172.21.15.17:0/1085252456 wait complete. 2024-08-19T01:32:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.949+0000 7fd80e24b640 1 -- 172.21.15.17:0/3027905717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8081049f0 msgr2=0x7fd808104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.949+0000 7fd80e24b640 1 --2- 172.21.15.17:0/3027905717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8081049f0 0x7fd808104dd0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8009880 tx=0x7fd7f802c6b0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.949+0000 7fd80e24b640 1 -- 172.21.15.17:0/3027905717 shutdown_connections 2024-08-19T01:32:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.949+0000 7fd80e24b640 1 --2- 172.21.15.17:0/3027905717 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8080fe9f0 0x7fd8080fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.949+0000 7fd80e24b640 1 --2- 172.21.15.17:0/3027905717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8081049f0 0x7fd808104dd0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.949+0000 7fd80e24b640 1 -- 172.21.15.17:0/3027905717 >> 172.21.15.17:0/3027905717 conn(0x7fd8080758a0 msgr2=0x7fd8080fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.949+0000 7fd80e24b640 1 -- 172.21.15.17:0/3027905717 shutdown_connections 2024-08-19T01:32:34.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.949+0000 7fd80e24b640 1 -- 172.21.15.17:0/3027905717 wait complete. 2024-08-19T01:32:34.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd80e24b640 1 Processor -- start 2024-08-19T01:32:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd80e24b640 1 -- start start 2024-08-19T01:32:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd80e24b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8080fe9f0 0x7fd808199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd80e24b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8081049f0 0x7fd808199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd80e24b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd808193760 con 0x7fd8080fe9f0 2024-08-19T01:32:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd80e24b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8081938d0 con 0x7fd8081049f0 2024-08-19T01:32:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd8077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8080fe9f0 0x7fd808199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd8077fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8080fe9f0 0x7fd808199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55738/0 (socket says 172.21.15.17:55738) 2024-08-19T01:32:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd8077fe640 1 -- 172.21.15.17:0/1295259353 learned_addr learned my addr 172.21.15.17:0/1295259353 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:32:34.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd7fffff640 1 --2- 172.21.15.17:0/1295259353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8081049f0 0x7fd808199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd8077fe640 1 -- 172.21.15.17:0/1295259353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8081049f0 msgr2=0x7fd808199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.950+0000 7fd8077fe640 1 --2- 172.21.15.17:0/1295259353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8081049f0 0x7fd808199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.951+0000 7fd8077fe640 1 -- 172.21.15.17:0/1295259353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f8009560 con 0x7fd8080fe9f0 2024-08-19T01:32:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.951+0000 7fd8077fe640 1 --2- 172.21.15.17:0/1295259353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8080fe9f0 0x7fd808199670 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8006010 tx=0x7fd7f80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.951+0000 7fd8057fa640 1 -- 172.21.15.17:0/1295259353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f8004aa0 con 0x7fd8080fe9f0 2024-08-19T01:32:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.951+0000 7fd8057fa640 1 -- 172.21.15.17:0/1295259353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7f8033470 con 0x7fd8080fe9f0 2024-08-19T01:32:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.951+0000 7fd80e24b640 1 -- 172.21.15.17:0/1295259353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd808193b50 con 0x7fd8080fe9f0 2024-08-19T01:32:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.951+0000 7fd8057fa640 1 -- 172.21.15.17:0/1295259353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7f8003940 con 0x7fd8080fe9f0 2024-08-19T01:32:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.951+0000 7fd80e24b640 1 -- 172.21.15.17:0/1295259353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd808194040 con 0x7fd8080fe9f0 2024-08-19T01:32:34.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.952+0000 7fd80e24b640 1 -- 172.21.15.17:0/1295259353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd808100130 con 0x7fd8080fe9f0 2024-08-19T01:32:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.953+0000 7fd8057fa640 1 -- 172.21.15.17:0/1295259353 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd7f8033b90 con 0x7fd8080fe9f0 2024-08-19T01:32:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.953+0000 7fd8057fa640 1 --2- 172.21.15.17:0/1295259353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd7f406e180 0x7fd7f4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:32:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.953+0000 7fd8057fa640 1 -- 172.21.15.17:0/1295259353 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd7f80b1130 con 0x7fd8080fe9f0 2024-08-19T01:32:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.953+0000 7fd7fffff640 1 --2- 172.21.15.17:0/1295259353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd7f406e180 0x7fd7f4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:32:34.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.954+0000 7fd7fffff640 1 --2- 172.21.15.17:0/1295259353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd7f406e180 0x7fd7f4070640 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd808194bd0 tx=0x7fd7f000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:32:34.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:34.958+0000 7fd8057fa640 1 -- 172.21.15.17:0/1295259353 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd7f807a540 con 0x7fd8080fe9f0 2024-08-19T01:32:35.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:35 smithi017 ceph-mon[99370]: from='client.35858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:35.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:35 smithi017 ceph-mon[99370]: from='client.35862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:35.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:35 smithi017 ceph-mon[99370]: from='client.35866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:35.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:35 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3445306576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:32:35.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:35 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4237949217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:32:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.202+0000 7fd80e24b640 1 -- 172.21.15.17:0/1295259353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd808106f60 con 0x7fd8080fe9f0 2024-08-19T01:32:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.203+0000 7fd8057fa640 1 -- 172.21.15.17:0/1295259353 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7fd7f8004c00 con 0x7fd8080fe9f0 2024-08-19T01:32:35.204 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:32:35.204 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:32:35.204 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:32:35.204 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:32:35.205 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:32:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:32:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:32:35.206 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:32:35.206 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:32:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:32:35.206 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:32:35.206 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:32:35.206 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:32:35.207 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:32:35.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.205+0000 7fd80e24b640 1 -- 172.21.15.17:0/1295259353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd7f406e180 msgr2=0x7fd7f4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:35.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.205+0000 7fd80e24b640 1 --2- 172.21.15.17:0/1295259353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd7f406e180 0x7fd7f4070640 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd808194bd0 tx=0x7fd7f000b390 comp rx=0 tx=0).stop 2024-08-19T01:32:35.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.205+0000 7fd80e24b640 1 -- 172.21.15.17:0/1295259353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8080fe9f0 msgr2=0x7fd808199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:32:35.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.205+0000 7fd80e24b640 1 --2- 172.21.15.17:0/1295259353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8080fe9f0 0x7fd808199670 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8006010 tx=0x7fd7f80055a0 comp rx=0 tx=0).stop 2024-08-19T01:32:35.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.205+0000 7fd80e24b640 1 -- 172.21.15.17:0/1295259353 shutdown_connections 2024-08-19T01:32:35.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.205+0000 7fd80e24b640 1 --2- 172.21.15.17:0/1295259353 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd7f406e180 0x7fd7f4070640 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:35.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.205+0000 7fd80e24b640 1 --2- 172.21.15.17:0/1295259353 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8081049f0 0x7fd808199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:35.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.205+0000 7fd80e24b640 1 --2- 172.21.15.17:0/1295259353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8080fe9f0 0x7fd808199670 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:32:35.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.205+0000 7fd80e24b640 1 -- 172.21.15.17:0/1295259353 >> 172.21.15.17:0/1295259353 conn(0x7fd8080758a0 msgr2=0x7fd8080fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:32:35.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.205+0000 7fd80e24b640 1 -- 172.21.15.17:0/1295259353 shutdown_connections 2024-08-19T01:32:35.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:32:35.205+0000 7fd80e24b640 1 -- 172.21.15.17:0/1295259353 wait complete. 2024-08-19T01:32:35.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:35 smithi086 ceph-mon[71303]: from='client.35858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:35 smithi086 ceph-mon[71303]: from='client.35862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:35 smithi086 ceph-mon[71303]: from='client.35866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:35 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3445306576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:32:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:35 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4237949217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:32:36.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:36 smithi017 ceph-mon[99370]: pgmap v1015: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:36.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:36 smithi017 ceph-mon[99370]: from='client.35878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:36.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:36 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1295259353' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:32:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:36 smithi086 ceph-mon[71303]: pgmap v1015: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:36 smithi086 ceph-mon[71303]: from='client.35878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:32:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:36 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1295259353' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:32:38.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:38 smithi017 ceph-mon[99370]: pgmap v1016: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:38.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:38 smithi086 ceph-mon[71303]: pgmap v1016: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:40.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:40 smithi017 ceph-mon[99370]: pgmap v1017: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:40.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:40 smithi086 ceph-mon[71303]: pgmap v1017: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:42.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:42 smithi017 ceph-mon[99370]: pgmap v1018: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:42.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:42 smithi086 ceph-mon[71303]: pgmap v1018: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:44.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:44 smithi017 ceph-mon[99370]: pgmap v1019: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:44.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:44 smithi086 ceph-mon[71303]: pgmap v1019: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:46.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:46 smithi017 ceph-mon[99370]: pgmap v1020: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:46.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:46 smithi086 ceph-mon[71303]: pgmap v1020: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:48.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:48 smithi017 ceph-mon[99370]: pgmap v1021: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:48.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:32:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:48 smithi086 ceph-mon[71303]: pgmap v1021: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:32:50.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:50 smithi017 ceph-mon[99370]: pgmap v1022: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:50.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:50 smithi086 ceph-mon[71303]: pgmap v1022: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:52.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:52 smithi017 ceph-mon[99370]: pgmap v1023: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:52.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:52 smithi086 ceph-mon[71303]: pgmap v1023: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:54.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:54 smithi017 ceph-mon[99370]: pgmap v1024: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:54.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:54 smithi086 ceph-mon[71303]: pgmap v1024: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:56.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:56 smithi017 ceph-mon[99370]: pgmap v1025: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:56.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:56 smithi086 ceph-mon[71303]: pgmap v1025: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:58.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:32:58 smithi017 ceph-mon[99370]: pgmap v1026: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:32:58.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:32:58 smithi086 ceph-mon[71303]: pgmap v1026: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:00.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:00 smithi017 ceph-mon[99370]: pgmap v1027: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:00.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:00 smithi086 ceph-mon[71303]: pgmap v1027: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:02.354 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:02 smithi086 ceph-mon[71303]: pgmap v1028: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:02.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:02 smithi017 ceph-mon[99370]: pgmap v1028: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:03.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:33:03.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:33:04.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:04 smithi017 ceph-mon[99370]: pgmap v1029: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:04.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:04 smithi086 ceph-mon[71303]: pgmap v1029: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:05.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.301+0000 7f3bae943640 1 -- 172.21.15.17:0/2557224437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ba8100750 msgr2=0x7f3ba81047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:05.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.301+0000 7f3bae943640 1 --2- 172.21.15.17:0/2557224437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ba8100750 0x7f3ba81047a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009880 tx=0x7f3b9002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.301+0000 7f3bae943640 1 -- 172.21.15.17:0/2557224437 shutdown_connections 2024-08-19T01:33:05.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.301+0000 7f3bae943640 1 --2- 172.21.15.17:0/2557224437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ba8100750 0x7f3ba81047a0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.301+0000 7f3bae943640 1 --2- 172.21.15.17:0/2557224437 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba80ffda0 0x7f3ba8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.301+0000 7f3bae943640 1 -- 172.21.15.17:0/2557224437 >> 172.21.15.17:0/2557224437 conn(0x7f3ba80fb840 msgr2=0x7f3ba80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:05.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.301+0000 7f3bae943640 1 -- 172.21.15.17:0/2557224437 shutdown_connections 2024-08-19T01:33:05.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.301+0000 7f3bae943640 1 -- 172.21.15.17:0/2557224437 wait complete. 2024-08-19T01:33:05.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.302+0000 7f3bae943640 1 Processor -- start 2024-08-19T01:33:05.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.302+0000 7f3bae943640 1 -- start start 2024-08-19T01:33:05.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.302+0000 7f3bae943640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ba80ffda0 0x7f3ba80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:05.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.302+0000 7f3bae943640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba8100750 0x7f3ba8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:05.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.302+0000 7f3bae943640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba8073230 con 0x7f3ba80ffda0 2024-08-19T01:33:05.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.302+0000 7f3bae943640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba8073370 con 0x7f3ba8100750 2024-08-19T01:33:05.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.302+0000 7f3ba7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ba80ffda0 0x7f3ba80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:05.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.302+0000 7f3ba7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ba80ffda0 0x7f3ba80727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36758/0 (socket says 172.21.15.17:36758) 2024-08-19T01:33:05.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.302+0000 7f3ba7fff640 1 -- 172.21.15.17:0/2862035017 learned_addr learned my addr 172.21.15.17:0/2862035017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:05.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.303+0000 7f3b9ffff640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba8100750 0x7f3ba8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:05.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.303+0000 7f3ba7fff640 1 -- 172.21.15.17:0/2862035017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba8100750 msgr2=0x7f3ba8072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:05.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.303+0000 7f3ba7fff640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba8100750 0x7f3ba8072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.303+0000 7f3ba7fff640 1 -- 172.21.15.17:0/2862035017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009560 con 0x7f3ba80ffda0 2024-08-19T01:33:05.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.303+0000 7f3b9ffff640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba8100750 0x7f3ba8072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:33:05.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.303+0000 7f3ba7fff640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ba80ffda0 0x7f3ba80727b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800d6f0 tx=0x7f3b9800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:05.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.303+0000 7f3ba5ffb640 1 -- 172.21.15.17:0/2862035017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b98009a30 con 0x7f3ba80ffda0 2024-08-19T01:33:05.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.303+0000 7f3bae943640 1 -- 172.21.15.17:0/2862035017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba81a1cd0 con 0x7f3ba80ffda0 2024-08-19T01:33:05.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.303+0000 7f3ba5ffb640 1 -- 172.21.15.17:0/2862035017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b980054e0 con 0x7f3ba80ffda0 2024-08-19T01:33:05.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.303+0000 7f3ba5ffb640 1 -- 172.21.15.17:0/2862035017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b98010460 con 0x7f3ba80ffda0 2024-08-19T01:33:05.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.303+0000 7f3bae943640 1 -- 172.21.15.17:0/2862035017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba81a20e0 con 0x7f3ba80ffda0 2024-08-19T01:33:05.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.304+0000 7f3bae943640 1 -- 172.21.15.17:0/2862035017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba8101280 con 0x7f3ba80ffda0 2024-08-19T01:33:05.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.305+0000 7f3ba5ffb640 1 -- 172.21.15.17:0/2862035017 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3b98009b90 con 0x7f3ba80ffda0 2024-08-19T01:33:05.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.305+0000 7f3ba5ffb640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b9406e170 0x7f3b94070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:05.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.305+0000 7f3ba5ffb640 1 -- 172.21.15.17:0/2862035017 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3b9808dd30 con 0x7f3ba80ffda0 2024-08-19T01:33:05.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.306+0000 7f3b9ffff640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b9406e170 0x7f3b94070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:05.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.306+0000 7f3b9ffff640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b9406e170 0x7f3b94070630 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006010 tx=0x7f3b90005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:05.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.310+0000 7f3ba5ffb640 1 -- 172.21.15.17:0/2862035017 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3b98057010 con 0x7f3ba80ffda0 2024-08-19T01:33:05.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.516+0000 7f3bae943640 1 -- 172.21.15.17:0/2862035017 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ba8073da0 con 0x7f3b9406e170 2024-08-19T01:33:05.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.518+0000 7f3ba5ffb640 1 -- 172.21.15.17:0/2862035017 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f3ba8073da0 con 0x7f3b9406e170 2024-08-19T01:33:05.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.519+0000 7f3bae943640 1 -- 172.21.15.17:0/2862035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b9406e170 msgr2=0x7f3b94070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:05.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.519+0000 7f3bae943640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b9406e170 0x7f3b94070630 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006010 tx=0x7f3b90005e60 comp rx=0 tx=0).stop 2024-08-19T01:33:05.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.519+0000 7f3bae943640 1 -- 172.21.15.17:0/2862035017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ba80ffda0 msgr2=0x7f3ba80727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:05.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.519+0000 7f3bae943640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ba80ffda0 0x7f3ba80727b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800d6f0 tx=0x7f3b9800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.520+0000 7f3bae943640 1 -- 172.21.15.17:0/2862035017 shutdown_connections 2024-08-19T01:33:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.520+0000 7f3bae943640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3b9406e170 0x7f3b94070630 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.520+0000 7f3bae943640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3ba8100750 0x7f3ba8072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.520+0000 7f3bae943640 1 --2- 172.21.15.17:0/2862035017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3ba80ffda0 0x7f3ba80727b0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.520+0000 7f3bae943640 1 -- 172.21.15.17:0/2862035017 >> 172.21.15.17:0/2862035017 conn(0x7f3ba80fb840 msgr2=0x7f3ba80fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.520+0000 7f3bae943640 1 -- 172.21.15.17:0/2862035017 shutdown_connections 2024-08-19T01:33:05.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.520+0000 7f3bae943640 1 -- 172.21.15.17:0/2862035017 wait complete. 2024-08-19T01:33:05.530 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:33:05.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.603+0000 7fac9a546640 1 -- 172.21.15.17:0/2333171456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100750 msgr2=0x7fac941047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:05.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.603+0000 7fac9a546640 1 --2- 172.21.15.17:0/2333171456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100750 0x7fac941047a0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fac88009880 tx=0x7fac8802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.603+0000 7fac9a546640 1 -- 172.21.15.17:0/2333171456 shutdown_connections 2024-08-19T01:33:05.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.603+0000 7fac9a546640 1 --2- 172.21.15.17:0/2333171456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100750 0x7fac941047a0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.603+0000 7fac9a546640 1 --2- 172.21.15.17:0/2333171456 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac940ffda0 0x7fac94100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.603+0000 7fac9a546640 1 -- 172.21.15.17:0/2333171456 >> 172.21.15.17:0/2333171456 conn(0x7fac940fb840 msgr2=0x7fac940fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:05.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.603+0000 7fac9a546640 1 -- 172.21.15.17:0/2333171456 shutdown_connections 2024-08-19T01:33:05.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.603+0000 7fac9a546640 1 -- 172.21.15.17:0/2333171456 wait complete. 2024-08-19T01:33:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.604+0000 7fac9a546640 1 Processor -- start 2024-08-19T01:33:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.604+0000 7fac9a546640 1 -- start start 2024-08-19T01:33:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.604+0000 7fac9a546640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac940ffda0 0x7fac9419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.604+0000 7fac9a546640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100750 0x7fac9419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.604+0000 7fac9a546640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac94195930 con 0x7fac94100750 2024-08-19T01:33:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.604+0000 7fac9a546640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac94195a70 con 0x7fac940ffda0 2024-08-19T01:33:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac937fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100750 0x7fac9419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac937fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100750 0x7fac9419be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36784/0 (socket says 172.21.15.17:36784) 2024-08-19T01:33:05.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac937fe640 1 -- 172.21.15.17:0/2557828201 learned_addr learned my addr 172.21.15.17:0/2557828201 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac93fff640 1 --2- 172.21.15.17:0/2557828201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac940ffda0 0x7fac9419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac937fe640 1 -- 172.21.15.17:0/2557828201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac940ffda0 msgr2=0x7fac9419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac937fe640 1 --2- 172.21.15.17:0/2557828201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac940ffda0 0x7fac9419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac937fe640 1 -- 172.21.15.17:0/2557828201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac88009560 con 0x7fac94100750 2024-08-19T01:33:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac937fe640 1 --2- 172.21.15.17:0/2557828201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100750 0x7fac9419be10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fac8802a9c0 tx=0x7fac880055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac917fa640 1 -- 172.21.15.17:0/2557828201 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac880048d0 con 0x7fac94100750 2024-08-19T01:33:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac917fa640 1 -- 172.21.15.17:0/2557828201 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac88031640 con 0x7fac94100750 2024-08-19T01:33:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac9a546640 1 -- 172.21.15.17:0/2557828201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac94195cf0 con 0x7fac94100750 2024-08-19T01:33:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac917fa640 1 -- 172.21.15.17:0/2557828201 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac880038d0 con 0x7fac94100750 2024-08-19T01:33:05.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.605+0000 7fac9a546640 1 -- 172.21.15.17:0/2557828201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac941961e0 con 0x7fac94100750 2024-08-19T01:33:05.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.607+0000 7fac9a546640 1 -- 172.21.15.17:0/2557828201 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac94101280 con 0x7fac94100750 2024-08-19T01:33:05.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.607+0000 7fac917fa640 1 -- 172.21.15.17:0/2557828201 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fac88003b90 con 0x7fac94100750 2024-08-19T01:33:05.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.607+0000 7fac917fa640 1 --2- 172.21.15.17:0/2557828201 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac7c06e170 0x7fac7c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:05.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.607+0000 7fac917fa640 1 -- 172.21.15.17:0/2557828201 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fac880af0f0 con 0x7fac94100750 2024-08-19T01:33:05.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.607+0000 7fac93fff640 1 --2- 172.21.15.17:0/2557828201 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac7c06e170 0x7fac7c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:05.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.608+0000 7fac93fff640 1 --2- 172.21.15.17:0/2557828201 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac7c06e170 0x7fac7c070630 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fac84009bd0 tx=0x7fac84005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:05.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.612+0000 7fac917fa640 1 -- 172.21.15.17:0/2557828201 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fac88078480 con 0x7fac94100750 2024-08-19T01:33:05.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.804+0000 7fac9a546640 1 -- 172.21.15.17:0/2557828201 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac9410cdd0 con 0x7fac7c06e170 2024-08-19T01:33:05.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.805+0000 7fac917fa640 1 -- 172.21.15.17:0/2557828201 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fac9410cdd0 con 0x7fac7c06e170 2024-08-19T01:33:05.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.807+0000 7fac9a546640 1 -- 172.21.15.17:0/2557828201 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac7c06e170 msgr2=0x7fac7c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:05.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.807+0000 7fac9a546640 1 --2- 172.21.15.17:0/2557828201 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac7c06e170 0x7fac7c070630 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fac84009bd0 tx=0x7fac84005f90 comp rx=0 tx=0).stop 2024-08-19T01:33:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.807+0000 7fac9a546640 1 -- 172.21.15.17:0/2557828201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100750 msgr2=0x7fac9419be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.807+0000 7fac9a546640 1 --2- 172.21.15.17:0/2557828201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100750 0x7fac9419be10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fac8802a9c0 tx=0x7fac880055a0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.807+0000 7fac9a546640 1 -- 172.21.15.17:0/2557828201 shutdown_connections 2024-08-19T01:33:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.807+0000 7fac9a546640 1 --2- 172.21.15.17:0/2557828201 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fac7c06e170 0x7fac7c070630 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.807+0000 7fac9a546640 1 --2- 172.21.15.17:0/2557828201 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac94100750 0x7fac9419be10 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.807+0000 7fac9a546640 1 --2- 172.21.15.17:0/2557828201 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fac940ffda0 0x7fac9419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.807+0000 7fac9a546640 1 -- 172.21.15.17:0/2557828201 >> 172.21.15.17:0/2557828201 conn(0x7fac940fb840 msgr2=0x7fac940fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.807+0000 7fac9a546640 1 -- 172.21.15.17:0/2557828201 shutdown_connections 2024-08-19T01:33:05.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.807+0000 7fac9a546640 1 -- 172.21.15.17:0/2557828201 wait complete. 2024-08-19T01:33:05.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.890+0000 7f851feca640 1 -- 172.21.15.17:0/723065524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85180fe9f0 msgr2=0x7f85180fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.890+0000 7f851feca640 1 --2- 172.21.15.17:0/723065524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85180fe9f0 0x7f85180fee50 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f8508009880 tx=0x7f850802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.891+0000 7f851feca640 1 -- 172.21.15.17:0/723065524 shutdown_connections 2024-08-19T01:33:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.891+0000 7f851feca640 1 --2- 172.21.15.17:0/723065524 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85180fe9f0 0x7f85180fee50 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.891+0000 7f851feca640 1 --2- 172.21.15.17:0/723065524 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85181049f0 0x7f8518104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.891+0000 7f851feca640 1 -- 172.21.15.17:0/723065524 >> 172.21.15.17:0/723065524 conn(0x7f85180758a0 msgr2=0x7f85180fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.891+0000 7f851feca640 1 -- 172.21.15.17:0/723065524 shutdown_connections 2024-08-19T01:33:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.891+0000 7f851feca640 1 -- 172.21.15.17:0/723065524 wait complete. 2024-08-19T01:33:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.891+0000 7f851feca640 1 Processor -- start 2024-08-19T01:33:05.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.891+0000 7f851feca640 1 -- start start 2024-08-19T01:33:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851feca640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85180fe9f0 0x7f85180fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851feca640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85181049f0 0x7f85180fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851feca640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85180fb800 con 0x7f85180fe9f0 2024-08-19T01:33:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851feca640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85180fb940 con 0x7f85181049f0 2024-08-19T01:33:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851dc66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85180fe9f0 0x7f85180fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851dc66640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85180fe9f0 0x7f85180fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36802/0 (socket says 172.21.15.17:36802) 2024-08-19T01:33:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851dc66640 1 -- 172.21.15.17:0/3643224473 learned_addr learned my addr 172.21.15.17:0/3643224473 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:05.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851d465640 1 --2- 172.21.15.17:0/3643224473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85181049f0 0x7f85180fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851dc66640 1 -- 172.21.15.17:0/3643224473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85181049f0 msgr2=0x7f85180fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851dc66640 1 --2- 172.21.15.17:0/3643224473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85181049f0 0x7f85180fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851dc66640 1 -- 172.21.15.17:0/3643224473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8508009560 con 0x7f85180fe9f0 2024-08-19T01:33:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851dc66640 1 --2- 172.21.15.17:0/3643224473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85180fe9f0 0x7f85180fad80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f851400e970 tx=0x7f851400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f850effd640 1 -- 172.21.15.17:0/3643224473 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f851400cc90 con 0x7f85180fe9f0 2024-08-19T01:33:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f850effd640 1 -- 172.21.15.17:0/3643224473 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f851400cdf0 con 0x7f85180fe9f0 2024-08-19T01:33:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f851feca640 1 -- 172.21.15.17:0/3643224473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85181a1d00 con 0x7f85180fe9f0 2024-08-19T01:33:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.892+0000 7f850effd640 1 -- 172.21.15.17:0/3643224473 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8514010430 con 0x7f85180fe9f0 2024-08-19T01:33:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.893+0000 7f851feca640 1 -- 172.21.15.17:0/3643224473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85181a20b0 con 0x7f85180fe9f0 2024-08-19T01:33:05.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.894+0000 7f851feca640 1 -- 172.21.15.17:0/3643224473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8518100130 con 0x7f85180fe9f0 2024-08-19T01:33:05.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.894+0000 7f850effd640 1 -- 172.21.15.17:0/3643224473 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f85140046c0 con 0x7f85180fe9f0 2024-08-19T01:33:05.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.894+0000 7f850effd640 1 --2- 172.21.15.17:0/3643224473 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f850406e170 0x7f8504070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:05.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.895+0000 7f850effd640 1 -- 172.21.15.17:0/3643224473 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8514014070 con 0x7f85180fe9f0 2024-08-19T01:33:05.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.895+0000 7f851d465640 1 --2- 172.21.15.17:0/3643224473 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f850406e170 0x7f8504070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:05.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.895+0000 7f851d465640 1 --2- 172.21.15.17:0/3643224473 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f850406e170 0x7f8504070630 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8508000c00 tx=0x7f8508005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:05.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:05.899+0000 7f850effd640 1 -- 172.21.15.17:0/3643224473 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8514057a30 con 0x7f85180fe9f0 2024-08-19T01:33:06.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.081+0000 7f851feca640 1 -- 172.21.15.17:0/3643224473 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f851810bc80 con 0x7f850406e170 2024-08-19T01:33:06.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.091+0000 7f850effd640 1 -- 172.21.15.17:0/3643224473 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f851810bc80 con 0x7f850406e170 2024-08-19T01:33:06.092 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:33:06.092 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (34m) 12m ago 45m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:33:06.092 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (45m) 12m ago 45m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (44m) 12m ago 44m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (32m) 12m ago 45m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (32m) 12m ago 44m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (34m) 12m ago 44m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (28m) 12m ago 39m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (28m) 12m ago 39m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (12m) 12m ago 39m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (28m) 12m ago 39m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (36m) 12m ago 46m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (35m) 12m ago 44m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (33m) 12m ago 46m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (32m) 12m ago 43m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:33:06.093 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (35m) 12m ago 45m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:33:06.094 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (35m) 12m ago 44m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:33:06.094 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (31m) 12m ago 43m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:33:06.094 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (31m) 12m ago 42m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:33:06.094 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (30m) 12m ago 42m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:33:06.094 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (30m) 12m ago 41m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:33:06.094 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (29m) 12m ago 41m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:33:06.094 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (28m) 12m ago 41m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:33:06.094 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (34m) 12m ago 44m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:33:06.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.093+0000 7f851feca640 1 -- 172.21.15.17:0/3643224473 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f850406e170 msgr2=0x7f8504070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.093+0000 7f851feca640 1 --2- 172.21.15.17:0/3643224473 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f850406e170 0x7f8504070630 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8508000c00 tx=0x7f8508005a20 comp rx=0 tx=0).stop 2024-08-19T01:33:06.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.093+0000 7f851feca640 1 -- 172.21.15.17:0/3643224473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85180fe9f0 msgr2=0x7f85180fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.093+0000 7f851feca640 1 --2- 172.21.15.17:0/3643224473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85180fe9f0 0x7f85180fad80 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f851400e970 tx=0x7f851400ed70 comp rx=0 tx=0).stop 2024-08-19T01:33:06.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.093+0000 7f851feca640 1 -- 172.21.15.17:0/3643224473 shutdown_connections 2024-08-19T01:33:06.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.093+0000 7f851feca640 1 --2- 172.21.15.17:0/3643224473 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f850406e170 0x7f8504070630 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.093+0000 7f851feca640 1 --2- 172.21.15.17:0/3643224473 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f85181049f0 0x7f85180fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.093+0000 7f851feca640 1 --2- 172.21.15.17:0/3643224473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85180fe9f0 0x7f85180fad80 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.093+0000 7f851feca640 1 -- 172.21.15.17:0/3643224473 >> 172.21.15.17:0/3643224473 conn(0x7f85180758a0 msgr2=0x7f85180fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:06.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.093+0000 7f851feca640 1 -- 172.21.15.17:0/3643224473 shutdown_connections 2024-08-19T01:33:06.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.093+0000 7f851feca640 1 -- 172.21.15.17:0/3643224473 wait complete. 2024-08-19T01:33:06.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.174+0000 7f4f1588b640 1 -- 172.21.15.17:0/2356389256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f101049f0 msgr2=0x7f4f10104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.174+0000 7f4f1588b640 1 --2- 172.21.15.17:0/2356389256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f101049f0 0x7f4f10104dd0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009880 tx=0x7f4f0002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.174+0000 7f4f1588b640 1 -- 172.21.15.17:0/2356389256 shutdown_connections 2024-08-19T01:33:06.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.174+0000 7f4f1588b640 1 --2- 172.21.15.17:0/2356389256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f100fe9f0 0x7f4f100fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.174+0000 7f4f1588b640 1 --2- 172.21.15.17:0/2356389256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f101049f0 0x7f4f10104dd0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.174+0000 7f4f1588b640 1 -- 172.21.15.17:0/2356389256 >> 172.21.15.17:0/2356389256 conn(0x7f4f100758a0 msgr2=0x7f4f100fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:06.176 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:06 smithi017 ceph-mon[99370]: pgmap v1030: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:06.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.174+0000 7f4f1588b640 1 -- 172.21.15.17:0/2356389256 shutdown_connections 2024-08-19T01:33:06.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.174+0000 7f4f1588b640 1 -- 172.21.15.17:0/2356389256 wait complete. 2024-08-19T01:33:06.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.175+0000 7f4f1588b640 1 Processor -- start 2024-08-19T01:33:06.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.175+0000 7f4f1588b640 1 -- start start 2024-08-19T01:33:06.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.175+0000 7f4f1588b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f100fe9f0 0x7f4f10196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:06.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.175+0000 7f4f1588b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f101049f0 0x7f4f10196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.175+0000 7f4f1588b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f10197450 con 0x7f4f101049f0 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.175+0000 7f4f1588b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f101975c0 con 0x7f4f100fe9f0 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.175+0000 7f4f0e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f101049f0 0x7f4f10196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f0e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f101049f0 0x7f4f10196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36830/0 (socket says 172.21.15.17:36830) 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f0e7fc640 1 -- 172.21.15.17:0/1202257045 learned_addr learned my addr 172.21.15.17:0/1202257045 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f0effd640 1 --2- 172.21.15.17:0/1202257045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f100fe9f0 0x7f4f10196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f0e7fc640 1 -- 172.21.15.17:0/1202257045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f100fe9f0 msgr2=0x7f4f10196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f0e7fc640 1 --2- 172.21.15.17:0/1202257045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f100fe9f0 0x7f4f10196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f0e7fc640 1 -- 172.21.15.17:0/1202257045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f00009560 con 0x7f4f101049f0 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f0e7fc640 1 --2- 172.21.15.17:0/1202257045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f101049f0 0x7f4f10196e80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800c8f0 tx=0x7f4ef800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f14889640 1 -- 172.21.15.17:0/1202257045 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef8007b80 con 0x7f4f101049f0 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f14889640 1 -- 172.21.15.17:0/1202257045 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ef80054e0 con 0x7f4f101049f0 2024-08-19T01:33:06.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f1588b640 1 -- 172.21.15.17:0/1202257045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1019f9b0 con 0x7f4f101049f0 2024-08-19T01:33:06.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f14889640 1 -- 172.21.15.17:0/1202257045 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ef800f450 con 0x7f4f101049f0 2024-08-19T01:33:06.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.176+0000 7f4f1588b640 1 -- 172.21.15.17:0/1202257045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1019fe20 con 0x7f4f101049f0 2024-08-19T01:33:06.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.177+0000 7f4f1588b640 1 -- 172.21.15.17:0/1202257045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f10100130 con 0x7f4f101049f0 2024-08-19T01:33:06.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.178+0000 7f4f14889640 1 -- 172.21.15.17:0/1202257045 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4ef8004f60 con 0x7f4f101049f0 2024-08-19T01:33:06.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.179+0000 7f4f14889640 1 --2- 172.21.15.17:0/1202257045 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4efc06e170 0x7f4efc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:06.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.179+0000 7f4f14889640 1 -- 172.21.15.17:0/1202257045 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4ef808dff0 con 0x7f4f101049f0 2024-08-19T01:33:06.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.179+0000 7f4f0effd640 1 --2- 172.21.15.17:0/1202257045 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4efc06e170 0x7f4efc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:06.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.179+0000 7f4f0effd640 1 --2- 172.21.15.17:0/1202257045 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4efc06e170 0x7f4efc070630 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4f00000c00 tx=0x7f4f00005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:06.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.183+0000 7f4f14889640 1 -- 172.21.15.17:0/1202257045 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4ef80572d0 con 0x7f4f101049f0 2024-08-19T01:33:06.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.432+0000 7f4f1588b640 1 -- 172.21.15.17:0/1202257045 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4f10107000 con 0x7f4f101049f0 2024-08-19T01:33:06.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.432+0000 7f4f14889640 1 -- 172.21.15.17:0/1202257045 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f4ef805a990 con 0x7f4f101049f0 2024-08-19T01:33:06.434 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:33:06.434 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:33:06.434 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:33:06.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:33:06.434 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:33:06.434 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:33:06.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:33:06.434 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:33:06.434 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:33:06.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:33:06.435 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:33:06.435 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:33:06.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:33:06.435 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:33:06.435 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:33:06.435 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:33:06.435 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:33:06.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.434+0000 7f4f1588b640 1 -- 172.21.15.17:0/1202257045 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4efc06e170 msgr2=0x7f4efc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.434+0000 7f4f1588b640 1 --2- 172.21.15.17:0/1202257045 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4efc06e170 0x7f4efc070630 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4f00000c00 tx=0x7f4f00005a20 comp rx=0 tx=0).stop 2024-08-19T01:33:06.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.434+0000 7f4f1588b640 1 -- 172.21.15.17:0/1202257045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f101049f0 msgr2=0x7f4f10196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.434+0000 7f4f1588b640 1 --2- 172.21.15.17:0/1202257045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f101049f0 0x7f4f10196e80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800c8f0 tx=0x7f4ef800cdb0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.434+0000 7f4f1588b640 1 -- 172.21.15.17:0/1202257045 shutdown_connections 2024-08-19T01:33:06.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.434+0000 7f4f1588b640 1 --2- 172.21.15.17:0/1202257045 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4efc06e170 0x7f4efc070630 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.434+0000 7f4f1588b640 1 --2- 172.21.15.17:0/1202257045 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f101049f0 0x7f4f10196e80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.434+0000 7f4f1588b640 1 --2- 172.21.15.17:0/1202257045 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f100fe9f0 0x7f4f10196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.434+0000 7f4f1588b640 1 -- 172.21.15.17:0/1202257045 >> 172.21.15.17:0/1202257045 conn(0x7f4f100758a0 msgr2=0x7f4f100fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:06.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.434+0000 7f4f1588b640 1 -- 172.21.15.17:0/1202257045 shutdown_connections 2024-08-19T01:33:06.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.434+0000 7f4f1588b640 1 -- 172.21.15.17:0/1202257045 wait complete. 2024-08-19T01:33:06.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:06 smithi086 ceph-mon[71303]: pgmap v1030: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:06.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.516+0000 7f1c642aa640 1 -- 172.21.15.17:0/1300589559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c5c100750 msgr2=0x7f1c5c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.516+0000 7f1c642aa640 1 --2- 172.21.15.17:0/1300589559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c5c100750 0x7f1c5c1047a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009880 tx=0x7f1c5002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.516+0000 7f1c642aa640 1 -- 172.21.15.17:0/1300589559 shutdown_connections 2024-08-19T01:33:06.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.516+0000 7f1c642aa640 1 --2- 172.21.15.17:0/1300589559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c5c100750 0x7f1c5c1047a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.516+0000 7f1c642aa640 1 --2- 172.21.15.17:0/1300589559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c5c0ffda0 0x7f1c5c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.516+0000 7f1c642aa640 1 -- 172.21.15.17:0/1300589559 >> 172.21.15.17:0/1300589559 conn(0x7f1c5c0fb840 msgr2=0x7f1c5c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:06.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.516+0000 7f1c642aa640 1 -- 172.21.15.17:0/1300589559 shutdown_connections 2024-08-19T01:33:06.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.516+0000 7f1c642aa640 1 -- 172.21.15.17:0/1300589559 wait complete. 2024-08-19T01:33:06.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.517+0000 7f1c642aa640 1 Processor -- start 2024-08-19T01:33:06.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.517+0000 7f1c642aa640 1 -- start start 2024-08-19T01:33:06.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.517+0000 7f1c642aa640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c5c0ffda0 0x7f1c5c19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:06.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.517+0000 7f1c642aa640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c5c100750 0x7f1c5c19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.517+0000 7f1c642aa640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c195930 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.517+0000 7f1c642aa640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c195a70 con 0x7f1c5c100750 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.517+0000 7f1c62046640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c5c0ffda0 0x7f1c5c19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.517+0000 7f1c62046640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c5c0ffda0 0x7f1c5c19b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36860/0 (socket says 172.21.15.17:36860) 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.517+0000 7f1c62046640 1 -- 172.21.15.17:0/59848429 learned_addr learned my addr 172.21.15.17:0/59848429 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.518+0000 7f1c61845640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c5c100750 0x7f1c5c19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.518+0000 7f1c62046640 1 -- 172.21.15.17:0/59848429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c5c100750 msgr2=0x7f1c5c19be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.518+0000 7f1c62046640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c5c100750 0x7f1c5c19be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.518+0000 7f1c62046640 1 -- 172.21.15.17:0/59848429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50009560 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.518+0000 7f1c61845640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c5c100750 0x7f1c5c19be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.518+0000 7f1c62046640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c5c0ffda0 0x7f1c5c19b8d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00eb10 tx=0x7f1c4c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:06.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.518+0000 7f1c5b7fe640 1 -- 172.21.15.17:0/59848429 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4c004b20 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.518+0000 7f1c5b7fe640 1 -- 172.21.15.17:0/59848429 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c4c004c80 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.518+0000 7f1c642aa640 1 -- 172.21.15.17:0/59848429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c195d50 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.518+0000 7f1c5b7fe640 1 -- 172.21.15.17:0/59848429 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c4c010640 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.518+0000 7f1c642aa640 1 -- 172.21.15.17:0/59848429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c1962a0 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.519+0000 7f1c642aa640 1 -- 172.21.15.17:0/59848429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c101280 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.520+0000 7f1c5b7fe640 1 -- 172.21.15.17:0/59848429 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1c4c0055e0 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.520+0000 7f1c5b7fe640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c4406e170 0x7f1c44070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.520+0000 7f1c5b7fe640 1 -- 172.21.15.17:0/59848429 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f1c4c014070 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.520+0000 7f1c61845640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c4406e170 0x7f1c44070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:06.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.521+0000 7f1c61845640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c4406e170 0x7f1c44070630 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1c50006010 tx=0x7f1c50005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:06.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.524+0000 7f1c5b7fe640 1 -- 172.21.15.17:0/59848429 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f1c4c057c30 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.736+0000 7f1c642aa640 1 -- 172.21.15.17:0/59848429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1c5c100180 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.737+0000 7f1c5b7fe640 1 -- 172.21.15.17:0/59848429 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f1c4c05b2f0 con 0x7f1c5c0ffda0 2024-08-19T01:33:06.738 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:33:06.738 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:33:06.738 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:33:06.738 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:33:06.738 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:33:06.739 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:33:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:33:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:33:06.741 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:33:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:33:06.741 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:33:06.741 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:33:06.741 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:33:06.741 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:33:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:33:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.739+0000 7f1c642aa640 1 -- 172.21.15.17:0/59848429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c4406e170 msgr2=0x7f1c44070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.739+0000 7f1c642aa640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c4406e170 0x7f1c44070630 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1c50006010 tx=0x7f1c50005e60 comp rx=0 tx=0).stop 2024-08-19T01:33:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.739+0000 7f1c642aa640 1 -- 172.21.15.17:0/59848429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c5c0ffda0 msgr2=0x7f1c5c19b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.739+0000 7f1c642aa640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c5c0ffda0 0x7f1c5c19b8d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00eb10 tx=0x7f1c4c00c2d0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.739+0000 7f1c642aa640 1 -- 172.21.15.17:0/59848429 shutdown_connections 2024-08-19T01:33:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.739+0000 7f1c642aa640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f1c4406e170 0x7f1c44070630 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.739+0000 7f1c642aa640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f1c5c100750 0x7f1c5c19be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.739+0000 7f1c642aa640 1 --2- 172.21.15.17:0/59848429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1c5c0ffda0 0x7f1c5c19b8d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.739+0000 7f1c642aa640 1 -- 172.21.15.17:0/59848429 >> 172.21.15.17:0/59848429 conn(0x7f1c5c0fb840 msgr2=0x7f1c5c0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:06.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.739+0000 7f1c642aa640 1 -- 172.21.15.17:0/59848429 shutdown_connections 2024-08-19T01:33:06.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.739+0000 7f1c642aa640 1 -- 172.21.15.17:0/59848429 wait complete. 2024-08-19T01:33:06.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.822+0000 7f332f648640 1 -- 172.21.15.17:0/1594894332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104a30 msgr2=0x7f3328104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.822+0000 7f332f648640 1 --2- 172.21.15.17:0/1594894332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104a30 0x7f3328104e10 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f3324009880 tx=0x7f332402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.822+0000 7f332f648640 1 -- 172.21.15.17:0/1594894332 shutdown_connections 2024-08-19T01:33:06.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.822+0000 7f332f648640 1 --2- 172.21.15.17:0/1594894332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33280fea30 0x7f33280fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.822+0000 7f332f648640 1 --2- 172.21.15.17:0/1594894332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104a30 0x7f3328104e10 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.822+0000 7f332f648640 1 -- 172.21.15.17:0/1594894332 >> 172.21.15.17:0/1594894332 conn(0x7f33280fa730 msgr2=0x7f33280fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:06.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.822+0000 7f332f648640 1 -- 172.21.15.17:0/1594894332 shutdown_connections 2024-08-19T01:33:06.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.822+0000 7f332f648640 1 -- 172.21.15.17:0/1594894332 wait complete. 2024-08-19T01:33:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.823+0000 7f332f648640 1 Processor -- start 2024-08-19T01:33:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.823+0000 7f332f648640 1 -- start start 2024-08-19T01:33:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.823+0000 7f332f648640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33280fea30 0x7f33281099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.823+0000 7f332f648640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104a30 0x7f3328109f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.823+0000 7f332f648640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332810a440 con 0x7f3328104a30 2024-08-19T01:33:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.823+0000 7f332f648640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332810a5b0 con 0x7f33280fea30 2024-08-19T01:33:06.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.823+0000 7f332cbe3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104a30 0x7f3328109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.823+0000 7f332cbe3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104a30 0x7f3328109f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33096/0 (socket says 172.21.15.17:33096) 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.823+0000 7f332cbe3640 1 -- 172.21.15.17:0/1924778143 learned_addr learned my addr 172.21.15.17:0/1924778143 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.824+0000 7f332d3e4640 1 --2- 172.21.15.17:0/1924778143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33280fea30 0x7f33281099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.824+0000 7f332cbe3640 1 -- 172.21.15.17:0/1924778143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33280fea30 msgr2=0x7f33281099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.824+0000 7f332cbe3640 1 --2- 172.21.15.17:0/1924778143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33280fea30 0x7f33281099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.824+0000 7f332cbe3640 1 -- 172.21.15.17:0/1924778143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3324009560 con 0x7f3328104a30 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.824+0000 7f332cbe3640 1 --2- 172.21.15.17:0/1924778143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104a30 0x7f3328109f00 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f331800d6f0 tx=0x7f331800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.824+0000 7f331e7fc640 1 -- 172.21.15.17:0/1924778143 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3318009a30 con 0x7f3328104a30 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.824+0000 7f331e7fc640 1 -- 172.21.15.17:0/1924778143 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33180054e0 con 0x7f3328104a30 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.824+0000 7f332f648640 1 -- 172.21.15.17:0/1924778143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33281a1c90 con 0x7f3328104a30 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.824+0000 7f331e7fc640 1 -- 172.21.15.17:0/1924778143 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3318010460 con 0x7f3328104a30 2024-08-19T01:33:06.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.824+0000 7f332f648640 1 -- 172.21.15.17:0/1924778143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33281a1ff0 con 0x7f3328104a30 2024-08-19T01:33:06.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.825+0000 7f332f648640 1 -- 172.21.15.17:0/1924778143 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3328100170 con 0x7f3328104a30 2024-08-19T01:33:06.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.826+0000 7f331e7fc640 1 -- 172.21.15.17:0/1924778143 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3318009b90 con 0x7f3328104a30 2024-08-19T01:33:06.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.826+0000 7f331e7fc640 1 --2- 172.21.15.17:0/1924778143 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f331406e170 0x7f3314070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:06.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.826+0000 7f331e7fc640 1 -- 172.21.15.17:0/1924778143 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f331808dbd0 con 0x7f3328104a30 2024-08-19T01:33:06.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.826+0000 7f332d3e4640 1 --2- 172.21.15.17:0/1924778143 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f331406e170 0x7f3314070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:06.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.827+0000 7f332d3e4640 1 --2- 172.21.15.17:0/1924778143 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f331406e170 0x7f3314070630 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3324009230 tx=0x7f33240058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:06.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:06.831+0000 7f331e7fc640 1 -- 172.21.15.17:0/1924778143 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3318056fe0 con 0x7f3328104a30 2024-08-19T01:33:07.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.024+0000 7f332f648640 1 -- 172.21.15.17:0/1924778143 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f332810cdd0 con 0x7f331406e170 2024-08-19T01:33:07.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.025+0000 7f331e7fc640 1 -- 172.21.15.17:0/1924778143 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f332810cdd0 con 0x7f331406e170 2024-08-19T01:33:07.026 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:33:07.026 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:33:07.027 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:33:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.027+0000 7f332f648640 1 -- 172.21.15.17:0/1924778143 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f331406e170 msgr2=0x7f3314070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.027+0000 7f332f648640 1 --2- 172.21.15.17:0/1924778143 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f331406e170 0x7f3314070630 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3324009230 tx=0x7f33240058d0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.027+0000 7f332f648640 1 -- 172.21.15.17:0/1924778143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104a30 msgr2=0x7f3328109f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:07.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.027+0000 7f332f648640 1 --2- 172.21.15.17:0/1924778143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104a30 0x7f3328109f00 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f331800d6f0 tx=0x7f331800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.027+0000 7f332f648640 1 -- 172.21.15.17:0/1924778143 shutdown_connections 2024-08-19T01:33:07.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.027+0000 7f332f648640 1 --2- 172.21.15.17:0/1924778143 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f331406e170 0x7f3314070630 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.027+0000 7f332f648640 1 --2- 172.21.15.17:0/1924778143 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3328104a30 0x7f3328109f00 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.027+0000 7f332f648640 1 --2- 172.21.15.17:0/1924778143 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f33280fea30 0x7f33281099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.027+0000 7f332f648640 1 -- 172.21.15.17:0/1924778143 >> 172.21.15.17:0/1924778143 conn(0x7f33280fa730 msgr2=0x7f33280fb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:07.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.028+0000 7f332f648640 1 -- 172.21.15.17:0/1924778143 shutdown_connections 2024-08-19T01:33:07.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.028+0000 7f332f648640 1 -- 172.21.15.17:0/1924778143 wait complete. 2024-08-19T01:33:07.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.112+0000 7ff833d82640 1 -- 172.21.15.17:0/723221442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0fe410 msgr2=0x7ff82c0fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.112+0000 7ff833d82640 1 --2- 172.21.15.17:0/723221442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0fe410 0x7ff82c0fe7f0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00ad30 tx=0x7ff81c02b860 comp rx=0 tx=0).stop 2024-08-19T01:33:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.112+0000 7ff833d82640 1 -- 172.21.15.17:0/723221442 shutdown_connections 2024-08-19T01:33:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.112+0000 7ff833d82640 1 --2- 172.21.15.17:0/723221442 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff82c0fedc0 0x7ff82c102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.112+0000 7ff833d82640 1 --2- 172.21.15.17:0/723221442 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0fe410 0x7ff82c0fe7f0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.112+0000 7ff833d82640 1 -- 172.21.15.17:0/723221442 >> 172.21.15.17:0/723221442 conn(0x7ff82c0f9e70 msgr2=0x7ff82c0fc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.112+0000 7ff833d82640 1 -- 172.21.15.17:0/723221442 shutdown_connections 2024-08-19T01:33:07.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.112+0000 7ff833d82640 1 -- 172.21.15.17:0/723221442 wait complete. 2024-08-19T01:33:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff833d82640 1 Processor -- start 2024-08-19T01:33:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff833d82640 1 -- start start 2024-08-19T01:33:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff833d82640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0fe410 0x7ff82c19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff833d82640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff82c0fedc0 0x7ff82c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff833d82640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c19c370 con 0x7ff82c0fe410 2024-08-19T01:33:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff833d82640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c195900 con 0x7ff82c0fedc0 2024-08-19T01:33:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff831b1e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0fe410 0x7ff82c19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff831b1e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0fe410 0x7ff82c19b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33124/0 (socket says 172.21.15.17:33124) 2024-08-19T01:33:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff831b1e640 1 -- 172.21.15.17:0/4129052549 learned_addr learned my addr 172.21.15.17:0/4129052549 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff83131d640 1 --2- 172.21.15.17:0/4129052549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff82c0fedc0 0x7ff82c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:07.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff831b1e640 1 -- 172.21.15.17:0/4129052549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff82c0fedc0 msgr2=0x7ff82c19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:07.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff831b1e640 1 --2- 172.21.15.17:0/4129052549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff82c0fedc0 0x7ff82c19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.113+0000 7ff831b1e640 1 -- 172.21.15.17:0/4129052549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81c00aa10 con 0x7ff82c0fe410 2024-08-19T01:33:07.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.114+0000 7ff831b1e640 1 --2- 172.21.15.17:0/4129052549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0fe410 0x7ff82c19b810 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff81c006010 tx=0x7ff81c008460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:07.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.114+0000 7ff82affd640 1 -- 172.21.15.17:0/4129052549 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff81c003d50 con 0x7ff82c0fe410 2024-08-19T01:33:07.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.114+0000 7ff833d82640 1 -- 172.21.15.17:0/4129052549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c195b80 con 0x7ff82c0fe410 2024-08-19T01:33:07.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.114+0000 7ff82affd640 1 -- 172.21.15.17:0/4129052549 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff81c031be0 con 0x7ff82c0fe410 2024-08-19T01:33:07.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.114+0000 7ff82affd640 1 -- 172.21.15.17:0/4129052549 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff81c004620 con 0x7ff82c0fe410 2024-08-19T01:33:07.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.114+0000 7ff833d82640 1 -- 172.21.15.17:0/4129052549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c1960d0 con 0x7ff82c0fe410 2024-08-19T01:33:07.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.115+0000 7ff833d82640 1 -- 172.21.15.17:0/4129052549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c0ff8f0 con 0x7ff82c0fe410 2024-08-19T01:33:07.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.116+0000 7ff82affd640 1 -- 172.21.15.17:0/4129052549 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff81c0323f0 con 0x7ff82c0fe410 2024-08-19T01:33:07.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.116+0000 7ff82affd640 1 --2- 172.21.15.17:0/4129052549 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff81406e170 0x7ff814070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:07.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.116+0000 7ff82affd640 1 -- 172.21.15.17:0/4129052549 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff81c02f050 con 0x7ff82c0fe410 2024-08-19T01:33:07.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.116+0000 7ff83131d640 1 --2- 172.21.15.17:0/4129052549 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff81406e170 0x7ff814070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:07.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.117+0000 7ff83131d640 1 --2- 172.21.15.17:0/4129052549 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff81406e170 0x7ff814070630 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff82c196d70 tx=0x7ff82000a4c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:07.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.120+0000 7ff82affd640 1 -- 172.21.15.17:0/4129052549 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff81c078960 con 0x7ff82c0fe410 2024-08-19T01:33:07.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.362+0000 7ff833d82640 1 -- 172.21.15.17:0/4129052549 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff82c0fe7f0 con 0x7ff82c0fe410 2024-08-19T01:33:07.363 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:07 smithi017 ceph-mon[99370]: from='client.35886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:07.363 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:07 smithi017 ceph-mon[99370]: from='client.35890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:07.363 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:07 smithi017 ceph-mon[99370]: from='client.35894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:07.364 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:07 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1202257045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:33:07.364 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:07 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/59848429' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:33:07.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.362+0000 7ff82affd640 1 -- 172.21.15.17:0/4129052549 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7ff81c07c020 con 0x7ff82c0fe410 2024-08-19T01:33:07.364 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:33:07.364 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:33:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:33:07.364 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:33:07.364 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:33:07.364 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:33:07.365 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:33:07.366 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:33:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:33:07.366 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:33:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:33:07.366 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:33:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:33:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.364+0000 7ff833d82640 1 -- 172.21.15.17:0/4129052549 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff81406e170 msgr2=0x7ff814070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.364+0000 7ff833d82640 1 --2- 172.21.15.17:0/4129052549 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff81406e170 0x7ff814070630 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff82c196d70 tx=0x7ff82000a4c0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.364+0000 7ff833d82640 1 -- 172.21.15.17:0/4129052549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0fe410 msgr2=0x7ff82c19b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.364+0000 7ff833d82640 1 --2- 172.21.15.17:0/4129052549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0fe410 0x7ff82c19b810 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7ff81c006010 tx=0x7ff81c008460 comp rx=0 tx=0).stop 2024-08-19T01:33:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.364+0000 7ff833d82640 1 -- 172.21.15.17:0/4129052549 shutdown_connections 2024-08-19T01:33:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.364+0000 7ff833d82640 1 --2- 172.21.15.17:0/4129052549 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff81406e170 0x7ff814070630 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.364+0000 7ff833d82640 1 --2- 172.21.15.17:0/4129052549 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff82c0fedc0 0x7ff82c19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.364+0000 7ff833d82640 1 --2- 172.21.15.17:0/4129052549 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff82c0fe410 0x7ff82c19b810 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.364+0000 7ff833d82640 1 -- 172.21.15.17:0/4129052549 >> 172.21.15.17:0/4129052549 conn(0x7ff82c0f9e70 msgr2=0x7ff82c0fb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.364+0000 7ff833d82640 1 -- 172.21.15.17:0/4129052549 shutdown_connections 2024-08-19T01:33:07.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:07.364+0000 7ff833d82640 1 -- 172.21.15.17:0/4129052549 wait complete. 2024-08-19T01:33:07.438 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:07 smithi086 ceph-mon[71303]: from='client.35886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:07.438 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:07 smithi086 ceph-mon[71303]: from='client.35890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:07.438 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:07 smithi086 ceph-mon[71303]: from='client.35894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:07.438 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:07 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1202257045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:33:07.438 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:07 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/59848429' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:33:08.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:08 smithi017 ceph-mon[99370]: pgmap v1031: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:08 smithi017 ceph-mon[99370]: from='client.35906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:08.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:08 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4129052549' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:33:08.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:08 smithi086 ceph-mon[71303]: pgmap v1031: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:08.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:08 smithi086 ceph-mon[71303]: from='client.35906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:08.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:08 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4129052549' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:33:10.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:10 smithi017 ceph-mon[99370]: pgmap v1032: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:10.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:10 smithi086 ceph-mon[71303]: pgmap v1032: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:12.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:12 smithi017 ceph-mon[99370]: pgmap v1033: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:12.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:12 smithi086 ceph-mon[71303]: pgmap v1033: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:14.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:14 smithi017 ceph-mon[99370]: pgmap v1034: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:14.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:14 smithi086 ceph-mon[71303]: pgmap v1034: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:16.428 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:16 smithi017 ceph-mon[99370]: pgmap v1035: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:16.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:16 smithi086 ceph-mon[71303]: pgmap v1035: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:18.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:18 smithi017 ceph-mon[99370]: pgmap v1036: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:33:18.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:18 smithi086 ceph-mon[71303]: pgmap v1036: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:33:20.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:20 smithi017 ceph-mon[99370]: pgmap v1037: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:20.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:20 smithi086 ceph-mon[71303]: pgmap v1037: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:22.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:22 smithi017 ceph-mon[99370]: pgmap v1038: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:22.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:22 smithi086 ceph-mon[71303]: pgmap v1038: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:24.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:24 smithi017 ceph-mon[99370]: pgmap v1039: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:24.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:24 smithi086 ceph-mon[71303]: pgmap v1039: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:26.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:26 smithi017 ceph-mon[99370]: pgmap v1040: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:26.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:26 smithi086 ceph-mon[71303]: pgmap v1040: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:28.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:28 smithi017 ceph-mon[99370]: pgmap v1041: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:28.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:28 smithi086 ceph-mon[71303]: pgmap v1041: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:30.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:30 smithi017 ceph-mon[99370]: pgmap v1042: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:30.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:30 smithi086 ceph-mon[71303]: pgmap v1042: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:32.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:32 smithi017 ceph-mon[99370]: pgmap v1043: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:32.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:32 smithi086 ceph-mon[71303]: pgmap v1043: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:33.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:33:33.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:33:34.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:34 smithi017 ceph-mon[99370]: pgmap v1044: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:34.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:34 smithi086 ceph-mon[71303]: pgmap v1044: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:36.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:36 smithi017 ceph-mon[99370]: pgmap v1045: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:36 smithi086 ceph-mon[71303]: pgmap v1045: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:37.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.461+0000 7f729c1b8640 1 -- 172.21.15.17:0/1481277551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72940ffda0 msgr2=0x7f7294100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:37.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.461+0000 7f729c1b8640 1 --2- 172.21.15.17:0/1481277551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72940ffda0 0x7f7294100180 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f7290009880 tx=0x7f729002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.461+0000 7f729c1b8640 1 -- 172.21.15.17:0/1481277551 shutdown_connections 2024-08-19T01:33:37.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.461+0000 7f729c1b8640 1 --2- 172.21.15.17:0/1481277551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7294100750 0x7f72941047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.461+0000 7f729c1b8640 1 --2- 172.21.15.17:0/1481277551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72940ffda0 0x7f7294100180 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.461+0000 7f729c1b8640 1 -- 172.21.15.17:0/1481277551 >> 172.21.15.17:0/1481277551 conn(0x7f72940fb840 msgr2=0x7f72940fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:37.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.461+0000 7f729c1b8640 1 -- 172.21.15.17:0/1481277551 shutdown_connections 2024-08-19T01:33:37.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.461+0000 7f729c1b8640 1 -- 172.21.15.17:0/1481277551 wait complete. 2024-08-19T01:33:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.462+0000 7f729c1b8640 1 Processor -- start 2024-08-19T01:33:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.462+0000 7f729c1b8640 1 -- start start 2024-08-19T01:33:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.462+0000 7f729c1b8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72940ffda0 0x7f72940727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.462+0000 7f729c1b8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7294100750 0x7f7294072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.462+0000 7f729c1b8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294073230 con 0x7f72940ffda0 2024-08-19T01:33:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.462+0000 7f729c1b8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72940733a0 con 0x7f7294100750 2024-08-19T01:33:37.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.462+0000 7f7299f54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72940ffda0 0x7f72940727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.462+0000 7f7299f54640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72940ffda0 0x7f72940727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42898/0 (socket says 172.21.15.17:42898) 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.462+0000 7f7299f54640 1 -- 172.21.15.17:0/2922200358 learned_addr learned my addr 172.21.15.17:0/2922200358 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.462+0000 7f7299753640 1 --2- 172.21.15.17:0/2922200358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7294100750 0x7f7294072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.463+0000 7f7299f54640 1 -- 172.21.15.17:0/2922200358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7294100750 msgr2=0x7f7294072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.463+0000 7f7299f54640 1 --2- 172.21.15.17:0/2922200358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7294100750 0x7f7294072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.463+0000 7f7299f54640 1 -- 172.21.15.17:0/2922200358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7290009560 con 0x7f72940ffda0 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.463+0000 7f7299f54640 1 --2- 172.21.15.17:0/2922200358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72940ffda0 0x7f72940727b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f729002a9c0 tx=0x7f72900055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.463+0000 7f728affd640 1 -- 172.21.15.17:0/2922200358 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7290004aa0 con 0x7f72940ffda0 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.463+0000 7f728affd640 1 -- 172.21.15.17:0/2922200358 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7290004c00 con 0x7f72940ffda0 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.463+0000 7f729c1b8640 1 -- 172.21.15.17:0/2922200358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7294073620 con 0x7f72940ffda0 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.463+0000 7f728affd640 1 -- 172.21.15.17:0/2922200358 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7290003980 con 0x7f72940ffda0 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.463+0000 7f729c1b8640 1 -- 172.21.15.17:0/2922200358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72941a1ef0 con 0x7f72940ffda0 2024-08-19T01:33:37.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.464+0000 7f729c1b8640 1 -- 172.21.15.17:0/2922200358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7294101280 con 0x7f72940ffda0 2024-08-19T01:33:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.465+0000 7f728affd640 1 -- 172.21.15.17:0/2922200358 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7290003b20 con 0x7f72940ffda0 2024-08-19T01:33:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.465+0000 7f728affd640 1 --2- 172.21.15.17:0/2922200358 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f728006e170 0x7f7280070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.465+0000 7f728affd640 1 -- 172.21.15.17:0/2922200358 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f72900aef20 con 0x7f72940ffda0 2024-08-19T01:33:37.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.465+0000 7f7299753640 1 --2- 172.21.15.17:0/2922200358 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f728006e170 0x7f7280070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:37.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.466+0000 7f7299753640 1 --2- 172.21.15.17:0/2922200358 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f728006e170 0x7f7280070630 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7294073f30 tx=0x7f728400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:37.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.470+0000 7f728affd640 1 -- 172.21.15.17:0/2922200358 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f72900e3df0 con 0x7f72940ffda0 2024-08-19T01:33:37.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.661+0000 7f729c1b8640 1 -- 172.21.15.17:0/2922200358 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7294073620 con 0x7f728006e170 2024-08-19T01:33:37.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.663+0000 7f728affd640 1 -- 172.21.15.17:0/2922200358 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f7294073620 con 0x7f728006e170 2024-08-19T01:33:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.664+0000 7f729c1b8640 1 -- 172.21.15.17:0/2922200358 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f728006e170 msgr2=0x7f7280070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.664+0000 7f729c1b8640 1 --2- 172.21.15.17:0/2922200358 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f728006e170 0x7f7280070630 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7294073f30 tx=0x7f728400b410 comp rx=0 tx=0).stop 2024-08-19T01:33:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.664+0000 7f729c1b8640 1 -- 172.21.15.17:0/2922200358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72940ffda0 msgr2=0x7f72940727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.664+0000 7f729c1b8640 1 --2- 172.21.15.17:0/2922200358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72940ffda0 0x7f72940727b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f729002a9c0 tx=0x7f72900055a0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.664+0000 7f729c1b8640 1 -- 172.21.15.17:0/2922200358 shutdown_connections 2024-08-19T01:33:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.665+0000 7f729c1b8640 1 --2- 172.21.15.17:0/2922200358 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f728006e170 0x7f7280070630 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.665+0000 7f729c1b8640 1 --2- 172.21.15.17:0/2922200358 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7294100750 0x7f7294072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.665+0000 7f729c1b8640 1 --2- 172.21.15.17:0/2922200358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f72940ffda0 0x7f72940727b0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.665+0000 7f729c1b8640 1 -- 172.21.15.17:0/2922200358 >> 172.21.15.17:0/2922200358 conn(0x7f72940fb840 msgr2=0x7f72940fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.665+0000 7f729c1b8640 1 -- 172.21.15.17:0/2922200358 shutdown_connections 2024-08-19T01:33:37.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.665+0000 7f729c1b8640 1 -- 172.21.15.17:0/2922200358 wait complete. 2024-08-19T01:33:37.675 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:33:37.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.747+0000 7f65e193f640 1 -- 172.21.15.17:0/3809087538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65dc101610 msgr2=0x7f65dc109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:37.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.747+0000 7f65e193f640 1 --2- 172.21.15.17:0/3809087538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65dc101610 0x7f65dc109b00 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f65d00098b0 tx=0x7f65d002a4d0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.747+0000 7f65e193f640 1 -- 172.21.15.17:0/3809087538 shutdown_connections 2024-08-19T01:33:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.747+0000 7f65e193f640 1 --2- 172.21.15.17:0/3809087538 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65dc101610 0x7f65dc109b00 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.747+0000 7f65e193f640 1 --2- 172.21.15.17:0/3809087538 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65dc100c60 0x7f65dc101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.747+0000 7f65e193f640 1 -- 172.21.15.17:0/3809087538 >> 172.21.15.17:0/3809087538 conn(0x7f65dc0fa730 msgr2=0x7f65dc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.747+0000 7f65e193f640 1 -- 172.21.15.17:0/3809087538 shutdown_connections 2024-08-19T01:33:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.747+0000 7f65e193f640 1 -- 172.21.15.17:0/3809087538 wait complete. 2024-08-19T01:33:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.748+0000 7f65e193f640 1 Processor -- start 2024-08-19T01:33:37.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.748+0000 7f65e193f640 1 -- start start 2024-08-19T01:33:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.748+0000 7f65e193f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65dc100c60 0x7f65dc19b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.748+0000 7f65e193f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65dc101610 0x7f65dc19bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.748+0000 7f65e193f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc19c330 con 0x7f65dc100c60 2024-08-19T01:33:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.748+0000 7f65e193f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc195950 con 0x7f65dc101610 2024-08-19T01:33:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.748+0000 7f65daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65dc100c60 0x7f65dc19b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65daffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65dc100c60 0x7f65dc19b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42922/0 (socket says 172.21.15.17:42922) 2024-08-19T01:33:37.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65daffd640 1 -- 172.21.15.17:0/2952217278 learned_addr learned my addr 172.21.15.17:0/2952217278 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65da7fc640 1 --2- 172.21.15.17:0/2952217278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65dc101610 0x7f65dc19bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65daffd640 1 -- 172.21.15.17:0/2952217278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65dc101610 msgr2=0x7f65dc19bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65daffd640 1 --2- 172.21.15.17:0/2952217278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65dc101610 0x7f65dc19bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65daffd640 1 -- 172.21.15.17:0/2952217278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d0009560 con 0x7f65dc100c60 2024-08-19T01:33:37.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65daffd640 1 --2- 172.21.15.17:0/2952217278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65dc100c60 0x7f65dc19b860 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00cc60 tx=0x7f65cc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65e093d640 1 -- 172.21.15.17:0/2952217278 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65cc00f450 con 0x7f65dc100c60 2024-08-19T01:33:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65e193f640 1 -- 172.21.15.17:0/2952217278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65dc195c30 con 0x7f65dc100c60 2024-08-19T01:33:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65e093d640 1 -- 172.21.15.17:0/2952217278 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f65cc00fa70 con 0x7f65dc100c60 2024-08-19T01:33:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65e093d640 1 -- 172.21.15.17:0/2952217278 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65cc018b80 con 0x7f65dc100c60 2024-08-19T01:33:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.749+0000 7f65e193f640 1 -- 172.21.15.17:0/2952217278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65dc196180 con 0x7f65dc100c60 2024-08-19T01:33:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.750+0000 7f65e193f640 1 -- 172.21.15.17:0/2952217278 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65dc068d30 con 0x7f65dc100c60 2024-08-19T01:33:37.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.751+0000 7f65e093d640 1 -- 172.21.15.17:0/2952217278 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f65cc018d00 con 0x7f65dc100c60 2024-08-19T01:33:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.751+0000 7f65e093d640 1 --2- 172.21.15.17:0/2952217278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f65c406e170 0x7f65c4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.752+0000 7f65da7fc640 1 --2- 172.21.15.17:0/2952217278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f65c406e170 0x7f65c4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.752+0000 7f65e093d640 1 -- 172.21.15.17:0/2952217278 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f65cc08e720 con 0x7f65dc100c60 2024-08-19T01:33:37.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.752+0000 7f65da7fc640 1 --2- 172.21.15.17:0/2952217278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f65c406e170 0x7f65c4070630 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f65d0000c00 tx=0x7f65d0004120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:37.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.756+0000 7f65e093d640 1 -- 172.21.15.17:0/2952217278 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f65cc057a70 con 0x7f65dc100c60 2024-08-19T01:33:37.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.949+0000 7f65e193f640 1 -- 172.21.15.17:0/2952217278 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65dc1043b0 con 0x7f65c406e170 2024-08-19T01:33:37.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.950+0000 7f65e093d640 1 -- 172.21.15.17:0/2952217278 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f65dc1043b0 con 0x7f65c406e170 2024-08-19T01:33:37.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.952+0000 7f65e193f640 1 -- 172.21.15.17:0/2952217278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f65c406e170 msgr2=0x7f65c4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:37.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.952+0000 7f65e193f640 1 --2- 172.21.15.17:0/2952217278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f65c406e170 0x7f65c4070630 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f65d0000c00 tx=0x7f65d0004120 comp rx=0 tx=0).stop 2024-08-19T01:33:37.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.952+0000 7f65e193f640 1 -- 172.21.15.17:0/2952217278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65dc100c60 msgr2=0x7f65dc19b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:37.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.952+0000 7f65e193f640 1 --2- 172.21.15.17:0/2952217278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65dc100c60 0x7f65dc19b860 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f65cc00cc60 tx=0x7f65cc00a620 comp rx=0 tx=0).stop 2024-08-19T01:33:37.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.952+0000 7f65e193f640 1 -- 172.21.15.17:0/2952217278 shutdown_connections 2024-08-19T01:33:37.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.952+0000 7f65e193f640 1 --2- 172.21.15.17:0/2952217278 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f65c406e170 0x7f65c4070630 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.952+0000 7f65e193f640 1 --2- 172.21.15.17:0/2952217278 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f65dc101610 0x7f65dc19bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.952+0000 7f65e193f640 1 --2- 172.21.15.17:0/2952217278 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65dc100c60 0x7f65dc19b860 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:37.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.952+0000 7f65e193f640 1 -- 172.21.15.17:0/2952217278 >> 172.21.15.17:0/2952217278 conn(0x7f65dc0fa730 msgr2=0x7f65dc101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:37.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.952+0000 7f65e193f640 1 -- 172.21.15.17:0/2952217278 shutdown_connections 2024-08-19T01:33:37.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:37.952+0000 7f65e193f640 1 -- 172.21.15.17:0/2952217278 wait complete. 2024-08-19T01:33:38.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.034+0000 7fd636a82640 1 -- 172.21.15.17:0/602095066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd630101630 msgr2=0x7fd630109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.034+0000 7fd636a82640 1 --2- 172.21.15.17:0/602095066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd630101630 0x7fd630109b20 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fd6180098b0 tx=0x7fd61802a560 comp rx=0 tx=0).stop 2024-08-19T01:33:38.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.035+0000 7fd636a82640 1 -- 172.21.15.17:0/602095066 shutdown_connections 2024-08-19T01:33:38.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.035+0000 7fd636a82640 1 --2- 172.21.15.17:0/602095066 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd630101630 0x7fd630109b20 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.035+0000 7fd636a82640 1 --2- 172.21.15.17:0/602095066 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd630100d10 0x7fd6301010f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.035+0000 7fd636a82640 1 -- 172.21.15.17:0/602095066 >> 172.21.15.17:0/602095066 conn(0x7fd6300758a0 msgr2=0x7fd6300fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:38.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.035+0000 7fd636a82640 1 -- 172.21.15.17:0/602095066 shutdown_connections 2024-08-19T01:33:38.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.035+0000 7fd636a82640 1 -- 172.21.15.17:0/602095066 wait complete. 2024-08-19T01:33:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.035+0000 7fd636a82640 1 Processor -- start 2024-08-19T01:33:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.035+0000 7fd636a82640 1 -- start start 2024-08-19T01:33:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd636a82640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd630100d10 0x7fd63019b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd636a82640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd630101630 0x7fd63019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd636a82640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63019c410 con 0x7fd630101630 2024-08-19T01:33:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd636a82640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6301959a0 con 0x7fd630100d10 2024-08-19T01:33:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd62ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd630101630 0x7fd63019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd62ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd630101630 0x7fd63019bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42934/0 (socket says 172.21.15.17:42934) 2024-08-19T01:33:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd62ffff640 1 -- 172.21.15.17:0/4094785790 learned_addr learned my addr 172.21.15.17:0/4094785790 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd63481e640 1 --2- 172.21.15.17:0/4094785790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd630100d10 0x7fd63019b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd62ffff640 1 -- 172.21.15.17:0/4094785790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd630100d10 msgr2=0x7fd63019b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd62ffff640 1 --2- 172.21.15.17:0/4094785790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd630100d10 0x7fd63019b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd62ffff640 1 -- 172.21.15.17:0/4094785790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd618009560 con 0x7fd630101630 2024-08-19T01:33:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.036+0000 7fd62ffff640 1 --2- 172.21.15.17:0/4094785790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd630101630 0x7fd63019bdf0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fd618006010 tx=0x7fd6180055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.037+0000 7fd62dffb640 1 -- 172.21.15.17:0/4094785790 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6180048d0 con 0x7fd630101630 2024-08-19T01:33:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.037+0000 7fd636a82640 1 -- 172.21.15.17:0/4094785790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd630195c20 con 0x7fd630101630 2024-08-19T01:33:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.037+0000 7fd62dffb640 1 -- 172.21.15.17:0/4094785790 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd618031640 con 0x7fd630101630 2024-08-19T01:33:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.037+0000 7fd62dffb640 1 -- 172.21.15.17:0/4094785790 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd618003800 con 0x7fd630101630 2024-08-19T01:33:38.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.037+0000 7fd636a82640 1 -- 172.21.15.17:0/4094785790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd630196110 con 0x7fd630101630 2024-08-19T01:33:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.038+0000 7fd636a82640 1 -- 172.21.15.17:0/4094785790 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6300684b0 con 0x7fd630101630 2024-08-19T01:33:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.038+0000 7fd62dffb640 1 -- 172.21.15.17:0/4094785790 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd618004a30 con 0x7fd630101630 2024-08-19T01:33:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.039+0000 7fd62dffb640 1 --2- 172.21.15.17:0/4094785790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd61c06e170 0x7fd61c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.039+0000 7fd62dffb640 1 -- 172.21.15.17:0/4094785790 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd6180af120 con 0x7fd630101630 2024-08-19T01:33:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.039+0000 7fd63481e640 1 --2- 172.21.15.17:0/4094785790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd61c06e170 0x7fd61c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.039+0000 7fd63481e640 1 --2- 172.21.15.17:0/4094785790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd61c06e170 0x7fd61c070630 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd620005fd0 tx=0x7fd620009500 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:38.044 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.043+0000 7fd62dffb640 1 -- 172.21.15.17:0/4094785790 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd6180784b0 con 0x7fd630101630 2024-08-19T01:33:38.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:38 smithi086 ceph-mon[71303]: pgmap v1046: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:38.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.227+0000 7fd636a82640 1 -- 172.21.15.17:0/4094785790 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd63010cda0 con 0x7fd61c06e170 2024-08-19T01:33:38.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.236+0000 7fd62dffb640 1 -- 172.21.15.17:0/4094785790 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd63010cda0 con 0x7fd61c06e170 2024-08-19T01:33:38.238 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:33:38.238 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (34m) 13m ago 45m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:33:38.238 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (45m) 13m ago 45m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:33:38.238 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (44m) 13m ago 44m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:33:38.238 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (32m) 13m ago 45m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:33:38.238 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (32m) 13m ago 44m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:33:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (34m) 13m ago 45m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:33:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (28m) 13m ago 40m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:33:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (29m) 13m ago 40m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:33:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (13m) 13m ago 40m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:33:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (28m) 13m ago 40m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:33:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (36m) 13m ago 47m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:33:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (35m) 13m ago 44m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:33:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (33m) 13m ago 47m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:33:38.239 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (33m) 13m ago 44m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:33:38.240 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (35m) 13m ago 45m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:33:38.240 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (35m) 13m ago 44m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:33:38.240 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (32m) 13m ago 43m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:33:38.240 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (31m) 13m ago 43m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:33:38.240 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (31m) 13m ago 42m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:33:38.240 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (30m) 13m ago 42m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:33:38.240 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (30m) 13m ago 42m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:33:38.240 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (29m) 13m ago 41m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:33:38.240 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (35m) 13m ago 45m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:33:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.238+0000 7fd636a82640 1 -- 172.21.15.17:0/4094785790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd61c06e170 msgr2=0x7fd61c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.238+0000 7fd636a82640 1 --2- 172.21.15.17:0/4094785790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd61c06e170 0x7fd61c070630 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd620005fd0 tx=0x7fd620009500 comp rx=0 tx=0).stop 2024-08-19T01:33:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.238+0000 7fd636a82640 1 -- 172.21.15.17:0/4094785790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd630101630 msgr2=0x7fd63019bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.238+0000 7fd636a82640 1 --2- 172.21.15.17:0/4094785790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd630101630 0x7fd63019bdf0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fd618006010 tx=0x7fd6180055a0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.238+0000 7fd636a82640 1 -- 172.21.15.17:0/4094785790 shutdown_connections 2024-08-19T01:33:38.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.238+0000 7fd636a82640 1 --2- 172.21.15.17:0/4094785790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd61c06e170 0x7fd61c070630 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.238+0000 7fd636a82640 1 --2- 172.21.15.17:0/4094785790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd630101630 0x7fd63019bdf0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.238+0000 7fd636a82640 1 --2- 172.21.15.17:0/4094785790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd630100d10 0x7fd63019b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.238+0000 7fd636a82640 1 -- 172.21.15.17:0/4094785790 >> 172.21.15.17:0/4094785790 conn(0x7fd6300758a0 msgr2=0x7fd630101f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:38.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.238+0000 7fd636a82640 1 -- 172.21.15.17:0/4094785790 shutdown_connections 2024-08-19T01:33:38.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.238+0000 7fd636a82640 1 -- 172.21.15.17:0/4094785790 wait complete. 2024-08-19T01:33:38.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.319+0000 7f7c2f15a640 1 -- 172.21.15.17:0/1073999934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c281016d0 msgr2=0x7f7c28109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.319+0000 7f7c2f15a640 1 --2- 172.21.15.17:0/1073999934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c281016d0 0x7f7c28109bc0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009880 tx=0x7f7c1402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.321 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:38 smithi017 ceph-mon[99370]: pgmap v1046: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.319+0000 7f7c2f15a640 1 -- 172.21.15.17:0/1073999934 shutdown_connections 2024-08-19T01:33:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.319+0000 7f7c2f15a640 1 --2- 172.21.15.17:0/1073999934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c281016d0 0x7f7c28109bc0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.319+0000 7f7c2f15a640 1 --2- 172.21.15.17:0/1073999934 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c28100db0 0x7f7c28101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.319+0000 7f7c2f15a640 1 -- 172.21.15.17:0/1073999934 >> 172.21.15.17:0/1073999934 conn(0x7f7c280fa730 msgr2=0x7f7c280fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:38.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.319+0000 7f7c2f15a640 1 -- 172.21.15.17:0/1073999934 shutdown_connections 2024-08-19T01:33:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.319+0000 7f7c2f15a640 1 -- 172.21.15.17:0/1073999934 wait complete. 2024-08-19T01:33:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.320+0000 7f7c2f15a640 1 Processor -- start 2024-08-19T01:33:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.320+0000 7f7c2f15a640 1 -- start start 2024-08-19T01:33:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.320+0000 7f7c2f15a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c28100db0 0x7f7c28197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.320+0000 7f7c2f15a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c281016d0 0x7f7c28198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.320+0000 7f7c2f15a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c28198900 con 0x7f7c281016d0 2024-08-19T01:33:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.320+0000 7f7c2f15a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2819c670 con 0x7f7c28100db0 2024-08-19T01:33:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.320+0000 7f7c27fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c281016d0 0x7f7c28198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.320+0000 7f7c27fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c281016d0 0x7f7c28198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42946/0 (socket says 172.21.15.17:42946) 2024-08-19T01:33:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.320+0000 7f7c27fff640 1 -- 172.21.15.17:0/3481991513 learned_addr learned my addr 172.21.15.17:0/3481991513 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:38.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.321+0000 7f7c2cef6640 1 --2- 172.21.15.17:0/3481991513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c28100db0 0x7f7c28197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.321+0000 7f7c27fff640 1 -- 172.21.15.17:0/3481991513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c28100db0 msgr2=0x7f7c28197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.321+0000 7f7c27fff640 1 --2- 172.21.15.17:0/3481991513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c28100db0 0x7f7c28197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.321+0000 7f7c27fff640 1 -- 172.21.15.17:0/3481991513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c14009560 con 0x7f7c281016d0 2024-08-19T01:33:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.321+0000 7f7c27fff640 1 --2- 172.21.15.17:0/3481991513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c281016d0 0x7f7c28198270 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7c1402a9c0 tx=0x7f7c14032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.321+0000 7f7c25ffb640 1 -- 172.21.15.17:0/3481991513 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c140037c0 con 0x7f7c281016d0 2024-08-19T01:33:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.321+0000 7f7c25ffb640 1 -- 172.21.15.17:0/3481991513 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c14005d50 con 0x7f7c281016d0 2024-08-19T01:33:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.321+0000 7f7c25ffb640 1 -- 172.21.15.17:0/3481991513 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c1403be30 con 0x7f7c281016d0 2024-08-19T01:33:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.321+0000 7f7c2f15a640 1 -- 172.21.15.17:0/3481991513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2819c8f0 con 0x7f7c281016d0 2024-08-19T01:33:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.321+0000 7f7c2f15a640 1 -- 172.21.15.17:0/3481991513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2819cde0 con 0x7f7c281016d0 2024-08-19T01:33:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.323+0000 7f7c2f15a640 1 -- 172.21.15.17:0/3481991513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c28068c70 con 0x7f7c281016d0 2024-08-19T01:33:38.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.323+0000 7f7c25ffb640 1 -- 172.21.15.17:0/3481991513 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7c1403b6d0 con 0x7f7c281016d0 2024-08-19T01:33:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.323+0000 7f7c25ffb640 1 --2- 172.21.15.17:0/3481991513 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7c1806e170 0x7f7c18070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.324+0000 7f7c25ffb640 1 -- 172.21.15.17:0/3481991513 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f7c140aeee0 con 0x7f7c281016d0 2024-08-19T01:33:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.324+0000 7f7c2cef6640 1 --2- 172.21.15.17:0/3481991513 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7c1806e170 0x7f7c18070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.324+0000 7f7c2cef6640 1 --2- 172.21.15.17:0/3481991513 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7c1806e170 0x7f7c18070630 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c005fd0 tx=0x7f7c1c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:38.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.328+0000 7f7c25ffb640 1 -- 172.21.15.17:0/3481991513 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f7c14078240 con 0x7f7c281016d0 2024-08-19T01:33:38.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.580+0000 7f7c2f15a640 1 -- 172.21.15.17:0/3481991513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7c28101190 con 0x7f7c281016d0 2024-08-19T01:33:38.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.581+0000 7f7c25ffb640 1 -- 172.21.15.17:0/3481991513 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f7c14041280 con 0x7f7c281016d0 2024-08-19T01:33:38.582 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:33:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:33:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:33:38.584 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:33:38.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.583+0000 7f7c2f15a640 1 -- 172.21.15.17:0/3481991513 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7c1806e170 msgr2=0x7f7c18070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.583+0000 7f7c2f15a640 1 --2- 172.21.15.17:0/3481991513 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7c1806e170 0x7f7c18070630 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c005fd0 tx=0x7f7c1c005850 comp rx=0 tx=0).stop 2024-08-19T01:33:38.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.583+0000 7f7c2f15a640 1 -- 172.21.15.17:0/3481991513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c281016d0 msgr2=0x7f7c28198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.583+0000 7f7c2f15a640 1 --2- 172.21.15.17:0/3481991513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c281016d0 0x7f7c28198270 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7c1402a9c0 tx=0x7f7c14032bb0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.583+0000 7f7c2f15a640 1 -- 172.21.15.17:0/3481991513 shutdown_connections 2024-08-19T01:33:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.583+0000 7f7c2f15a640 1 --2- 172.21.15.17:0/3481991513 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f7c1806e170 0x7f7c18070630 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.583+0000 7f7c2f15a640 1 --2- 172.21.15.17:0/3481991513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c281016d0 0x7f7c28198270 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.583+0000 7f7c2f15a640 1 --2- 172.21.15.17:0/3481991513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f7c28100db0 0x7f7c28197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.583+0000 7f7c2f15a640 1 -- 172.21.15.17:0/3481991513 >> 172.21.15.17:0/3481991513 conn(0x7f7c280fa730 msgr2=0x7f7c280fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.583+0000 7f7c2f15a640 1 -- 172.21.15.17:0/3481991513 shutdown_connections 2024-08-19T01:33:38.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.583+0000 7f7c2f15a640 1 -- 172.21.15.17:0/3481991513 wait complete. 2024-08-19T01:33:38.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.665+0000 7f6a25c6a640 1 -- 172.21.15.17:0/1262258765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a20100c60 msgr2=0x7f6a20101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.665+0000 7f6a25c6a640 1 --2- 172.21.15.17:0/1262258765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a20100c60 0x7f6a20101040 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6a100098b0 tx=0x7f6a1002a4d0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.665+0000 7f6a25c6a640 1 -- 172.21.15.17:0/1262258765 shutdown_connections 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.665+0000 7f6a25c6a640 1 --2- 172.21.15.17:0/1262258765 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a20101610 0x7f6a20109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.665+0000 7f6a25c6a640 1 --2- 172.21.15.17:0/1262258765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a20100c60 0x7f6a20101040 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.665+0000 7f6a25c6a640 1 -- 172.21.15.17:0/1262258765 >> 172.21.15.17:0/1262258765 conn(0x7f6a200fa730 msgr2=0x7f6a200fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.665+0000 7f6a25c6a640 1 -- 172.21.15.17:0/1262258765 shutdown_connections 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.665+0000 7f6a25c6a640 1 -- 172.21.15.17:0/1262258765 wait complete. 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.665+0000 7f6a25c6a640 1 Processor -- start 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a25c6a640 1 -- start start 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a25c6a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a20100c60 0x7f6a2019b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a25c6a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a20101610 0x7f6a2019bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a25c6a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2019c3a0 con 0x7f6a20100c60 2024-08-19T01:33:38.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a25c6a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a20195930 con 0x7f6a20101610 2024-08-19T01:33:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a1f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a20100c60 0x7f6a2019b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a1f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a20100c60 0x7f6a2019b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42964/0 (socket says 172.21.15.17:42964) 2024-08-19T01:33:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a1f7fe640 1 -- 172.21.15.17:0/4291661341 learned_addr learned my addr 172.21.15.17:0/4291661341 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a1effd640 1 --2- 172.21.15.17:0/4291661341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a20101610 0x7f6a2019bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a1f7fe640 1 -- 172.21.15.17:0/4291661341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a20101610 msgr2=0x7f6a2019bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a1f7fe640 1 --2- 172.21.15.17:0/4291661341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a20101610 0x7f6a2019bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.666+0000 7f6a1f7fe640 1 -- 172.21.15.17:0/4291661341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a10009560 con 0x7f6a20100c60 2024-08-19T01:33:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.667+0000 7f6a1f7fe640 1 --2- 172.21.15.17:0/4291661341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a20100c60 0x7f6a2019b840 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6a10006010 tx=0x7f6a100055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.667+0000 7f6a1cff9640 1 -- 172.21.15.17:0/4291661341 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a10004aa0 con 0x7f6a20100c60 2024-08-19T01:33:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.667+0000 7f6a25c6a640 1 -- 172.21.15.17:0/4291661341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a20195bb0 con 0x7f6a20100c60 2024-08-19T01:33:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.667+0000 7f6a1cff9640 1 -- 172.21.15.17:0/4291661341 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a10031470 con 0x7f6a20100c60 2024-08-19T01:33:38.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.667+0000 7f6a1cff9640 1 -- 172.21.15.17:0/4291661341 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a10003940 con 0x7f6a20100c60 2024-08-19T01:33:38.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.667+0000 7f6a25c6a640 1 -- 172.21.15.17:0/4291661341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a201960a0 con 0x7f6a20100c60 2024-08-19T01:33:38.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.668+0000 7f6a25c6a640 1 -- 172.21.15.17:0/4291661341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a20068d30 con 0x7f6a20100c60 2024-08-19T01:33:38.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.668+0000 7f6a1cff9640 1 -- 172.21.15.17:0/4291661341 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6a10031b90 con 0x7f6a20100c60 2024-08-19T01:33:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.669+0000 7f6a1cff9640 1 --2- 172.21.15.17:0/4291661341 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a0806e170 0x7f6a08070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.669+0000 7f6a1cff9640 1 -- 172.21.15.17:0/4291661341 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6a100af260 con 0x7f6a20100c60 2024-08-19T01:33:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.669+0000 7f6a1effd640 1 --2- 172.21.15.17:0/4291661341 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a0806e170 0x7f6a08070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.670+0000 7f6a1effd640 1 --2- 172.21.15.17:0/4291661341 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a0806e170 0x7f6a08070630 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6a20196da0 tx=0x7f6a1400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.673+0000 7f6a1cff9640 1 -- 172.21.15.17:0/4291661341 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6a10078550 con 0x7f6a20100c60 2024-08-19T01:33:38.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.886+0000 7f6a25c6a640 1 -- 172.21.15.17:0/4291661341 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6a20104360 con 0x7f6a20100c60 2024-08-19T01:33:38.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.887+0000 7f6a1cff9640 1 -- 172.21.15.17:0/4291661341 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f6a10004c00 con 0x7f6a20100c60 2024-08-19T01:33:38.888 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:33:38.888 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:33:38.889 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:33:38.890 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:33:38.891 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:33:38.892 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:33:38.892 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:33:38.892 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:33:38.892 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:33:38.892 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:33:38.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.889+0000 7f6a25c6a640 1 -- 172.21.15.17:0/4291661341 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a0806e170 msgr2=0x7f6a08070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.889+0000 7f6a25c6a640 1 --2- 172.21.15.17:0/4291661341 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a0806e170 0x7f6a08070630 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6a20196da0 tx=0x7f6a1400b390 comp rx=0 tx=0).stop 2024-08-19T01:33:38.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.889+0000 7f6a25c6a640 1 -- 172.21.15.17:0/4291661341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a20100c60 msgr2=0x7f6a2019b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.889+0000 7f6a25c6a640 1 --2- 172.21.15.17:0/4291661341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a20100c60 0x7f6a2019b840 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6a10006010 tx=0x7f6a100055a0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.889+0000 7f6a25c6a640 1 -- 172.21.15.17:0/4291661341 shutdown_connections 2024-08-19T01:33:38.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.889+0000 7f6a25c6a640 1 --2- 172.21.15.17:0/4291661341 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6a0806e170 0x7f6a08070630 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.889+0000 7f6a25c6a640 1 --2- 172.21.15.17:0/4291661341 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6a20101610 0x7f6a2019bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.889+0000 7f6a25c6a640 1 --2- 172.21.15.17:0/4291661341 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6a20100c60 0x7f6a2019b840 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.889+0000 7f6a25c6a640 1 -- 172.21.15.17:0/4291661341 >> 172.21.15.17:0/4291661341 conn(0x7f6a200fa730 msgr2=0x7f6a20101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:38.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.889+0000 7f6a25c6a640 1 -- 172.21.15.17:0/4291661341 shutdown_connections 2024-08-19T01:33:38.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.889+0000 7f6a25c6a640 1 -- 172.21.15.17:0/4291661341 wait complete. 2024-08-19T01:33:38.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.972+0000 7f43df4c5640 1 -- 172.21.15.17:0/4084027069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d8100750 msgr2=0x7f43d81047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.972+0000 7f43df4c5640 1 --2- 172.21.15.17:0/4084027069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d8100750 0x7f43d81047a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009880 tx=0x7f43cc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.972+0000 7f43df4c5640 1 -- 172.21.15.17:0/4084027069 shutdown_connections 2024-08-19T01:33:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.972+0000 7f43df4c5640 1 --2- 172.21.15.17:0/4084027069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d8100750 0x7f43d81047a0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.972+0000 7f43df4c5640 1 --2- 172.21.15.17:0/4084027069 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43d80ffda0 0x7f43d8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.972+0000 7f43df4c5640 1 -- 172.21.15.17:0/4084027069 >> 172.21.15.17:0/4084027069 conn(0x7f43d80fb840 msgr2=0x7f43d80fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.972+0000 7f43df4c5640 1 -- 172.21.15.17:0/4084027069 shutdown_connections 2024-08-19T01:33:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.973+0000 7f43df4c5640 1 -- 172.21.15.17:0/4084027069 wait complete. 2024-08-19T01:33:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.973+0000 7f43df4c5640 1 Processor -- start 2024-08-19T01:33:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.973+0000 7f43df4c5640 1 -- start start 2024-08-19T01:33:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.973+0000 7f43df4c5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43d80ffda0 0x7f43d80727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.973+0000 7f43df4c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d8100750 0x7f43d8072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.973+0000 7f43df4c5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d8073230 con 0x7f43d8100750 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.973+0000 7f43df4c5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d8073370 con 0x7f43d80ffda0 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.973+0000 7f43dca60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d8100750 0x7f43d8072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.973+0000 7f43dca60640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d8100750 0x7f43d8072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42976/0 (socket says 172.21.15.17:42976) 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.973+0000 7f43dca60640 1 -- 172.21.15.17:0/505296559 learned_addr learned my addr 172.21.15.17:0/505296559 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.974+0000 7f43dd261640 1 --2- 172.21.15.17:0/505296559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43d80ffda0 0x7f43d80727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.974+0000 7f43dca60640 1 -- 172.21.15.17:0/505296559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43d80ffda0 msgr2=0x7f43d80727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.974+0000 7f43dca60640 1 --2- 172.21.15.17:0/505296559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43d80ffda0 0x7f43d80727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.974+0000 7f43dca60640 1 -- 172.21.15.17:0/505296559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009560 con 0x7f43d8100750 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.974+0000 7f43dca60640 1 --2- 172.21.15.17:0/505296559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d8100750 0x7f43d8072cf0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f43cc02a9c0 tx=0x7f43cc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.974+0000 7f43d67fc640 1 -- 172.21.15.17:0/505296559 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43cc004aa0 con 0x7f43d8100750 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.974+0000 7f43d67fc640 1 -- 172.21.15.17:0/505296559 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43cc004c00 con 0x7f43d8100750 2024-08-19T01:33:38.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.974+0000 7f43df4c5640 1 -- 172.21.15.17:0/505296559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d80735f0 con 0x7f43d8100750 2024-08-19T01:33:38.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.974+0000 7f43d67fc640 1 -- 172.21.15.17:0/505296559 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43cc003ab0 con 0x7f43d8100750 2024-08-19T01:33:38.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.974+0000 7f43df4c5640 1 -- 172.21.15.17:0/505296559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d81a2000 con 0x7f43d8100750 2024-08-19T01:33:38.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.975+0000 7f43df4c5640 1 -- 172.21.15.17:0/505296559 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d8101280 con 0x7f43d8100750 2024-08-19T01:33:38.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.976+0000 7f43d67fc640 1 -- 172.21.15.17:0/505296559 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f43cc031d20 con 0x7f43d8100750 2024-08-19T01:33:38.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.976+0000 7f43d67fc640 1 --2- 172.21.15.17:0/505296559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f43c006e170 0x7f43c0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:38.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.976+0000 7f43d67fc640 1 -- 172.21.15.17:0/505296559 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f43cc0af1e0 con 0x7f43d8100750 2024-08-19T01:33:38.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.976+0000 7f43dd261640 1 --2- 172.21.15.17:0/505296559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f43c006e170 0x7f43c0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:38.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.977+0000 7f43dd261640 1 --2- 172.21.15.17:0/505296559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f43c006e170 0x7f43c0070630 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f43c8005c40 tx=0x7f43c800a570 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:38.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:38.981+0000 7f43d67fc640 1 -- 172.21.15.17:0/505296559 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f43cc078570 con 0x7f43d8100750 2024-08-19T01:33:39.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.173+0000 7f43df4c5640 1 -- 172.21.15.17:0/505296559 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43d8108100 con 0x7f43c006e170 2024-08-19T01:33:39.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:39 smithi017 ceph-mon[99370]: from='client.35914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:39.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:39 smithi017 ceph-mon[99370]: from='client.35918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:39.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:39 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3481991513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:33:39.175 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:39 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4291661341' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:33:39.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.174+0000 7f43d67fc640 1 -- 172.21.15.17:0/505296559 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f43d8108100 con 0x7f43c006e170 2024-08-19T01:33:39.176 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:33:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:33:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:33:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:33:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:33:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:33:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:33:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:33:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:33:39.176 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:33:39.177 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:33:39.177 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:33:39.177 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:33:39.177 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:33:39.177 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:33:39.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.177+0000 7f43df4c5640 1 -- 172.21.15.17:0/505296559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f43c006e170 msgr2=0x7f43c0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:39.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.177+0000 7f43df4c5640 1 --2- 172.21.15.17:0/505296559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f43c006e170 0x7f43c0070630 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f43c8005c40 tx=0x7f43c800a570 comp rx=0 tx=0).stop 2024-08-19T01:33:39.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.177+0000 7f43df4c5640 1 -- 172.21.15.17:0/505296559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d8100750 msgr2=0x7f43d8072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:39.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.177+0000 7f43df4c5640 1 --2- 172.21.15.17:0/505296559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d8100750 0x7f43d8072cf0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f43cc02a9c0 tx=0x7f43cc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.177+0000 7f43df4c5640 1 -- 172.21.15.17:0/505296559 shutdown_connections 2024-08-19T01:33:39.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.177+0000 7f43df4c5640 1 --2- 172.21.15.17:0/505296559 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f43c006e170 0x7f43c0070630 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.177+0000 7f43df4c5640 1 --2- 172.21.15.17:0/505296559 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f43d8100750 0x7f43d8072cf0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.177+0000 7f43df4c5640 1 --2- 172.21.15.17:0/505296559 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f43d80ffda0 0x7f43d80727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.177+0000 7f43df4c5640 1 -- 172.21.15.17:0/505296559 >> 172.21.15.17:0/505296559 conn(0x7f43d80fb840 msgr2=0x7f43d80fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:39.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.177+0000 7f43df4c5640 1 -- 172.21.15.17:0/505296559 shutdown_connections 2024-08-19T01:33:39.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.177+0000 7f43df4c5640 1 -- 172.21.15.17:0/505296559 wait complete. 2024-08-19T01:33:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.258+0000 7f769d7c7640 1 -- 172.21.15.17:0/1869930737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7698100750 msgr2=0x7f76981047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.258+0000 7f769d7c7640 1 --2- 172.21.15.17:0/1869930737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7698100750 0x7f76981047a0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7680009880 tx=0x7f768002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.258+0000 7f769d7c7640 1 -- 172.21.15.17:0/1869930737 shutdown_connections 2024-08-19T01:33:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.258+0000 7f769d7c7640 1 --2- 172.21.15.17:0/1869930737 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7698100750 0x7f76981047a0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.258+0000 7f769d7c7640 1 --2- 172.21.15.17:0/1869930737 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76980ffda0 0x7f7698100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.258+0000 7f769d7c7640 1 -- 172.21.15.17:0/1869930737 >> 172.21.15.17:0/1869930737 conn(0x7f76980fb840 msgr2=0x7f76980fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.258+0000 7f769d7c7640 1 -- 172.21.15.17:0/1869930737 shutdown_connections 2024-08-19T01:33:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.258+0000 7f769d7c7640 1 -- 172.21.15.17:0/1869930737 wait complete. 2024-08-19T01:33:39.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.259+0000 7f769d7c7640 1 Processor -- start 2024-08-19T01:33:39.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.259+0000 7f769d7c7640 1 -- start start 2024-08-19T01:33:39.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.259+0000 7f769d7c7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76980ffda0 0x7f76980727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:39.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.259+0000 7f769d7c7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7698100750 0x7f7698072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:39.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.259+0000 7f769d7c7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7698073230 con 0x7f7698100750 2024-08-19T01:33:39.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.259+0000 7f769d7c7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7698073370 con 0x7f76980ffda0 2024-08-19T01:33:39.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.259+0000 7f768e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7698100750 0x7f7698072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:39.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.259+0000 7f768e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7698100750 0x7f7698072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43002/0 (socket says 172.21.15.17:43002) 2024-08-19T01:33:39.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.259+0000 7f768e7fc640 1 -- 172.21.15.17:0/857683572 learned_addr learned my addr 172.21.15.17:0/857683572 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:33:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.259+0000 7f7696ffd640 1 --2- 172.21.15.17:0/857683572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76980ffda0 0x7f76980727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.260+0000 7f768e7fc640 1 -- 172.21.15.17:0/857683572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76980ffda0 msgr2=0x7f76980727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.260+0000 7f768e7fc640 1 --2- 172.21.15.17:0/857683572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76980ffda0 0x7f76980727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.260+0000 7f768e7fc640 1 -- 172.21.15.17:0/857683572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7680009560 con 0x7f7698100750 2024-08-19T01:33:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.260+0000 7f768e7fc640 1 --2- 172.21.15.17:0/857683572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7698100750 0x7f7698072cf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f768002a9c0 tx=0x7f76800055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.260+0000 7f7694ff9640 1 -- 172.21.15.17:0/857683572 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7680004aa0 con 0x7f7698100750 2024-08-19T01:33:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.260+0000 7f7694ff9640 1 -- 172.21.15.17:0/857683572 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7680004c00 con 0x7f7698100750 2024-08-19T01:33:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.260+0000 7f769d7c7640 1 -- 172.21.15.17:0/857683572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76980735f0 con 0x7f7698100750 2024-08-19T01:33:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.260+0000 7f7694ff9640 1 -- 172.21.15.17:0/857683572 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7680003980 con 0x7f7698100750 2024-08-19T01:33:39.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.260+0000 7f769d7c7640 1 -- 172.21.15.17:0/857683572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76981a2000 con 0x7f7698100750 2024-08-19T01:33:39.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.261+0000 7f769d7c7640 1 -- 172.21.15.17:0/857683572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7698101280 con 0x7f7698100750 2024-08-19T01:33:39.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.262+0000 7f7694ff9640 1 -- 172.21.15.17:0/857683572 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7680003b00 con 0x7f7698100750 2024-08-19T01:33:39.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.262+0000 7f7694ff9640 1 --2- 172.21.15.17:0/857683572 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f768406e170 0x7f7684070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:33:39.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.262+0000 7f7694ff9640 1 -- 172.21.15.17:0/857683572 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f76800af0b0 con 0x7f7698100750 2024-08-19T01:33:39.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.262+0000 7f7696ffd640 1 --2- 172.21.15.17:0/857683572 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f768406e170 0x7f7684070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:33:39.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.263+0000 7f7696ffd640 1 --2- 172.21.15.17:0/857683572 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f768406e170 0x7f7684070630 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7688005fd0 tx=0x7f768800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:33:39.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.267+0000 7f7694ff9640 1 -- 172.21.15.17:0/857683572 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f76800784c0 con 0x7f7698100750 2024-08-19T01:33:39.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:39 smithi086 ceph-mon[71303]: from='client.35914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:39.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:39 smithi086 ceph-mon[71303]: from='client.35918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:39 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3481991513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:33:39.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:39 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4291661341' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:33:39.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.510+0000 7f769d7c7640 1 -- 172.21.15.17:0/857683572 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7698100180 con 0x7f7698100750 2024-08-19T01:33:39.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.511+0000 7f7694ff9640 1 -- 172.21.15.17:0/857683572 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f768007bb80 con 0x7f7698100750 2024-08-19T01:33:39.513 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:33:39.513 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:33:39.513 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:33:39.513 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:33:39.513 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:33:39.513 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:33:39.513 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:33:39.513 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:33:39.513 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:33:39.514 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:33:39.514 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:33:39.514 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:33:39.514 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:33:39.514 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:33:39.514 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:33:39.514 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:33:39.514 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:33:39.514 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:33:39.514 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:33:39.514 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:33:39.515 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:33:39.515 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:33:39.515 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:33:39.515 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:33:39.515 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:33:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.513+0000 7f769d7c7640 1 -- 172.21.15.17:0/857683572 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f768406e170 msgr2=0x7f7684070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.513+0000 7f769d7c7640 1 --2- 172.21.15.17:0/857683572 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f768406e170 0x7f7684070630 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7688005fd0 tx=0x7f768800b390 comp rx=0 tx=0).stop 2024-08-19T01:33:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.513+0000 7f769d7c7640 1 -- 172.21.15.17:0/857683572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7698100750 msgr2=0x7f7698072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:33:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.513+0000 7f769d7c7640 1 --2- 172.21.15.17:0/857683572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7698100750 0x7f7698072cf0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f768002a9c0 tx=0x7f76800055a0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.513+0000 7f769d7c7640 1 -- 172.21.15.17:0/857683572 shutdown_connections 2024-08-19T01:33:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.513+0000 7f769d7c7640 1 --2- 172.21.15.17:0/857683572 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f768406e170 0x7f7684070630 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.513+0000 7f769d7c7640 1 --2- 172.21.15.17:0/857683572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7698100750 0x7f7698072cf0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.513+0000 7f769d7c7640 1 --2- 172.21.15.17:0/857683572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f76980ffda0 0x7f76980727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:33:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.513+0000 7f769d7c7640 1 -- 172.21.15.17:0/857683572 >> 172.21.15.17:0/857683572 conn(0x7f76980fb840 msgr2=0x7f76980fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:33:39.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.513+0000 7f769d7c7640 1 -- 172.21.15.17:0/857683572 shutdown_connections 2024-08-19T01:33:39.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:33:39.513+0000 7f769d7c7640 1 -- 172.21.15.17:0/857683572 wait complete. 2024-08-19T01:33:40.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:40 smithi017 ceph-mon[99370]: from='client.35922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:40.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:40 smithi017 ceph-mon[99370]: pgmap v1047: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:40.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:40 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/857683572' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:33:40.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:40 smithi086 ceph-mon[71303]: from='client.35922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:40.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:40 smithi086 ceph-mon[71303]: pgmap v1047: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:40.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:40 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/857683572' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:33:41.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:41 smithi017 ceph-mon[99370]: from='client.35934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:41.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:41 smithi086 ceph-mon[71303]: from='client.35934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:33:42.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:42 smithi017 ceph-mon[99370]: pgmap v1048: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:42.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:42 smithi086 ceph-mon[71303]: pgmap v1048: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:44.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:44 smithi017 ceph-mon[99370]: pgmap v1049: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:44.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:44 smithi086 ceph-mon[71303]: pgmap v1049: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:46.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:46 smithi017 ceph-mon[99370]: pgmap v1050: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:46.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:46 smithi086 ceph-mon[71303]: pgmap v1050: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:48.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:48 smithi017 ceph-mon[99370]: pgmap v1051: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:48.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:33:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:48 smithi086 ceph-mon[71303]: pgmap v1051: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:33:50.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:50 smithi017 ceph-mon[99370]: pgmap v1052: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:50.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:50 smithi086 ceph-mon[71303]: pgmap v1052: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:52.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:52 smithi017 ceph-mon[99370]: pgmap v1053: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:52.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:52 smithi086 ceph-mon[71303]: pgmap v1053: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:54.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:54 smithi017 ceph-mon[99370]: pgmap v1054: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:54.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:54 smithi086 ceph-mon[71303]: pgmap v1054: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:56.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:56 smithi017 ceph-mon[99370]: pgmap v1055: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:56.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:56 smithi086 ceph-mon[71303]: pgmap v1055: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:58.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:33:58 smithi017 ceph-mon[99370]: pgmap v1056: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:33:58.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:33:58 smithi086 ceph-mon[71303]: pgmap v1056: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:00.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:00 smithi017 ceph-mon[99370]: pgmap v1057: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:00.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:00 smithi086 ceph-mon[71303]: pgmap v1057: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:02.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:02 smithi017 ceph-mon[99370]: pgmap v1058: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:02.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:02 smithi086 ceph-mon[71303]: pgmap v1058: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:03.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:34:03.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:34:04.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:04 smithi017 ceph-mon[99370]: pgmap v1059: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:04.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:04 smithi086 ceph-mon[71303]: pgmap v1059: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:06.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:06 smithi017 ceph-mon[99370]: pgmap v1060: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:06.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:06 smithi086 ceph-mon[71303]: pgmap v1060: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:07.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:07 smithi017 ceph-mon[99370]: pgmap v1061: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:07.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:07 smithi086 ceph-mon[71303]: pgmap v1061: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:09.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.608+0000 7f06e2559640 1 -- 172.21.15.17:0/2879933020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc0ffda0 msgr2=0x7f06dc100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:09.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.608+0000 7f06e2559640 1 --2- 172.21.15.17:0/2879933020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc0ffda0 0x7f06dc100180 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009880 tx=0x7f06cc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:09.610 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:09 smithi017 ceph-mon[99370]: pgmap v1062: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.608+0000 7f06e2559640 1 -- 172.21.15.17:0/2879933020 shutdown_connections 2024-08-19T01:34:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.608+0000 7f06e2559640 1 --2- 172.21.15.17:0/2879933020 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06dc100750 0x7f06dc1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.608+0000 7f06e2559640 1 --2- 172.21.15.17:0/2879933020 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc0ffda0 0x7f06dc100180 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.608+0000 7f06e2559640 1 -- 172.21.15.17:0/2879933020 >> 172.21.15.17:0/2879933020 conn(0x7f06dc0fb840 msgr2=0x7f06dc0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.609+0000 7f06e2559640 1 -- 172.21.15.17:0/2879933020 shutdown_connections 2024-08-19T01:34:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.609+0000 7f06e2559640 1 -- 172.21.15.17:0/2879933020 wait complete. 2024-08-19T01:34:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.609+0000 7f06e2559640 1 Processor -- start 2024-08-19T01:34:09.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.609+0000 7f06e2559640 1 -- start start 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06e2559640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06dc0ffda0 0x7f06dc19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06e2559640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc100750 0x7f06dc19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06e2559640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc195a10 con 0x7f06dc100750 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06e2559640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc195b50 con 0x7f06dc0ffda0 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc100750 0x7f06dc19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc100750 0x7f06dc19bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52560/0 (socket says 172.21.15.17:52560) 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06db7fe640 1 -- 172.21.15.17:0/451828638 learned_addr learned my addr 172.21.15.17:0/451828638 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06dbfff640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06dc0ffda0 0x7f06dc19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06db7fe640 1 -- 172.21.15.17:0/451828638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06dc0ffda0 msgr2=0x7f06dc19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06db7fe640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06dc0ffda0 0x7f06dc19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06db7fe640 1 -- 172.21.15.17:0/451828638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc009560 con 0x7f06dc100750 2024-08-19T01:34:09.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06dbfff640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06dc0ffda0 0x7f06dc19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:34:09.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.610+0000 7f06db7fe640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc100750 0x7f06dc19bef0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f06c400e970 tx=0x7f06c400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:09.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.611+0000 7f06d97fa640 1 -- 172.21.15.17:0/451828638 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c400cc90 con 0x7f06dc100750 2024-08-19T01:34:09.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.611+0000 7f06d97fa640 1 -- 172.21.15.17:0/451828638 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f06c400cdf0 con 0x7f06dc100750 2024-08-19T01:34:09.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.611+0000 7f06e2559640 1 -- 172.21.15.17:0/451828638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc195e30 con 0x7f06dc100750 2024-08-19T01:34:09.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.611+0000 7f06d97fa640 1 -- 172.21.15.17:0/451828638 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c4010430 con 0x7f06dc100750 2024-08-19T01:34:09.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.611+0000 7f06e2559640 1 -- 172.21.15.17:0/451828638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc196380 con 0x7f06dc100750 2024-08-19T01:34:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.612+0000 7f06e2559640 1 -- 172.21.15.17:0/451828638 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc101280 con 0x7f06dc100750 2024-08-19T01:34:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.612+0000 7f06d97fa640 1 -- 172.21.15.17:0/451828638 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f06c40046c0 con 0x7f06dc100750 2024-08-19T01:34:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.613+0000 7f06d97fa640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06c806e170 0x7f06c8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.613+0000 7f06d97fa640 1 -- 172.21.15.17:0/451828638 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f06c4014070 con 0x7f06dc100750 2024-08-19T01:34:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.613+0000 7f06dbfff640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06c806e170 0x7f06c8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:09.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.613+0000 7f06dbfff640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06c806e170 0x7f06c8070630 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c00 tx=0x7f06cc005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:09.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.617+0000 7f06d97fa640 1 -- 172.21.15.17:0/451828638 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f06c4057a60 con 0x7f06dc100750 2024-08-19T01:34:09.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:09 smithi086 ceph-mon[71303]: pgmap v1062: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:09.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.815+0000 7f06e2559640 1 -- 172.21.15.17:0/451828638 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f06dc196fe0 con 0x7f06c806e170 2024-08-19T01:34:09.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.816+0000 7f06d97fa640 1 -- 172.21.15.17:0/451828638 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f06dc196fe0 con 0x7f06c806e170 2024-08-19T01:34:09.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.818+0000 7f06e2559640 1 -- 172.21.15.17:0/451828638 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06c806e170 msgr2=0x7f06c8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:09.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.818+0000 7f06e2559640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06c806e170 0x7f06c8070630 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c00 tx=0x7f06cc005a20 comp rx=0 tx=0).stop 2024-08-19T01:34:09.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.818+0000 7f06e2559640 1 -- 172.21.15.17:0/451828638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc100750 msgr2=0x7f06dc19bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:09.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.818+0000 7f06e2559640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc100750 0x7f06dc19bef0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f06c400e970 tx=0x7f06c400ed70 comp rx=0 tx=0).stop 2024-08-19T01:34:09.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.819+0000 7f06e2559640 1 -- 172.21.15.17:0/451828638 shutdown_connections 2024-08-19T01:34:09.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.819+0000 7f06e2559640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f06c806e170 0x7f06c8070630 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:09.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.819+0000 7f06e2559640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f06dc100750 0x7f06dc19bef0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:09.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.819+0000 7f06e2559640 1 --2- 172.21.15.17:0/451828638 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f06dc0ffda0 0x7f06dc19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:09.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.819+0000 7f06e2559640 1 -- 172.21.15.17:0/451828638 >> 172.21.15.17:0/451828638 conn(0x7f06dc0fb840 msgr2=0x7f06dc0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:09.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.819+0000 7f06e2559640 1 -- 172.21.15.17:0/451828638 shutdown_connections 2024-08-19T01:34:09.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.819+0000 7f06e2559640 1 -- 172.21.15.17:0/451828638 wait complete. 2024-08-19T01:34:09.829 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:34:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.901+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2139060589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b8104a30 msgr2=0x7f57b8104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.901+0000 7f57bfcfb640 1 --2- 172.21.15.17:0/2139060589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b8104a30 0x7f57b8104e10 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009880 tx=0x7f57b402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.901+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2139060589 shutdown_connections 2024-08-19T01:34:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.901+0000 7f57bfcfb640 1 --2- 172.21.15.17:0/2139060589 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b80fea30 0x7f57b80fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:09.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.901+0000 7f57bfcfb640 1 --2- 172.21.15.17:0/2139060589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b8104a30 0x7f57b8104e10 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:09.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.901+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2139060589 >> 172.21.15.17:0/2139060589 conn(0x7f57b80fa730 msgr2=0x7f57b80fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:09.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.902+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2139060589 shutdown_connections 2024-08-19T01:34:09.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.902+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2139060589 wait complete. 2024-08-19T01:34:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.902+0000 7f57bfcfb640 1 Processor -- start 2024-08-19T01:34:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.902+0000 7f57bfcfb640 1 -- start start 2024-08-19T01:34:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bfcfb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b80fea30 0x7f57b8196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bfcfb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b8104a30 0x7f57b8196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bfcfb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8197450 con 0x7f57b80fea30 2024-08-19T01:34:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bfcfb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b81975c0 con 0x7f57b8104a30 2024-08-19T01:34:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bda97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b80fea30 0x7f57b8196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:09.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bda97640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b80fea30 0x7f57b8196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52586/0 (socket says 172.21.15.17:52586) 2024-08-19T01:34:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bda97640 1 -- 172.21.15.17:0/2650819465 learned_addr learned my addr 172.21.15.17:0/2650819465 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bd296640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b8104a30 0x7f57b8196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bda97640 1 -- 172.21.15.17:0/2650819465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b8104a30 msgr2=0x7f57b8196e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bda97640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b8104a30 0x7f57b8196e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bda97640 1 -- 172.21.15.17:0/2650819465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4009560 con 0x7f57b80fea30 2024-08-19T01:34:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bd296640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b8104a30 0x7f57b8196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:34:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bda97640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b80fea30 0x7f57b8196940 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f57b402a9c0 tx=0x7f57b40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57aeffd640 1 -- 172.21.15.17:0/2650819465 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57b4004aa0 con 0x7f57b80fea30 2024-08-19T01:34:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2650819465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b819f9b0 con 0x7f57b80fea30 2024-08-19T01:34:09.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.903+0000 7f57aeffd640 1 -- 172.21.15.17:0/2650819465 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f57b4004c00 con 0x7f57b80fea30 2024-08-19T01:34:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.904+0000 7f57aeffd640 1 -- 172.21.15.17:0/2650819465 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57b4003ab0 con 0x7f57b80fea30 2024-08-19T01:34:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.904+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2650819465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b819fdc0 con 0x7f57b80fea30 2024-08-19T01:34:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.905+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2650819465 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b8100170 con 0x7f57b80fea30 2024-08-19T01:34:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.905+0000 7f57aeffd640 1 -- 172.21.15.17:0/2650819465 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f57b4003ce0 con 0x7f57b80fea30 2024-08-19T01:34:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.906+0000 7f57aeffd640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f57a406e170 0x7f57a4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.906+0000 7f57aeffd640 1 -- 172.21.15.17:0/2650819465 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f57b40af260 con 0x7f57b80fea30 2024-08-19T01:34:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.906+0000 7f57bd296640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f57a406e170 0x7f57a4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:09.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.906+0000 7f57bd296640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f57a406e170 0x7f57a4070630 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f57b8068cd0 tx=0x7f57a8005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:09.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:09.910+0000 7f57aeffd640 1 -- 172.21.15.17:0/2650819465 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f57b4078540 con 0x7f57b80fea30 2024-08-19T01:34:10.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.102+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2650819465 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57b810bcc0 con 0x7f57a406e170 2024-08-19T01:34:10.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.103+0000 7f57aeffd640 1 -- 172.21.15.17:0/2650819465 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f57b810bcc0 con 0x7f57a406e170 2024-08-19T01:34:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.105+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2650819465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f57a406e170 msgr2=0x7f57a4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.105+0000 7f57bfcfb640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f57a406e170 0x7f57a4070630 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f57b8068cd0 tx=0x7f57a8005d30 comp rx=0 tx=0).stop 2024-08-19T01:34:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.105+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2650819465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b80fea30 msgr2=0x7f57b8196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.105+0000 7f57bfcfb640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b80fea30 0x7f57b8196940 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f57b402a9c0 tx=0x7f57b40055a0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.105+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2650819465 shutdown_connections 2024-08-19T01:34:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.105+0000 7f57bfcfb640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f57a406e170 0x7f57a4070630 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.105+0000 7f57bfcfb640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f57b8104a30 0x7f57b8196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.105+0000 7f57bfcfb640 1 --2- 172.21.15.17:0/2650819465 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57b80fea30 0x7f57b8196940 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.105+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2650819465 >> 172.21.15.17:0/2650819465 conn(0x7f57b80fa730 msgr2=0x7f57b80fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.105+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2650819465 shutdown_connections 2024-08-19T01:34:10.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.105+0000 7f57bfcfb640 1 -- 172.21.15.17:0/2650819465 wait complete. 2024-08-19T01:34:10.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.188+0000 7efd75a6c640 1 -- 172.21.15.17:0/684829656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd70100750 msgr2=0x7efd701047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.188+0000 7efd75a6c640 1 --2- 172.21.15.17:0/684829656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd70100750 0x7efd701047a0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7efd58009880 tx=0x7efd5802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.188+0000 7efd75a6c640 1 -- 172.21.15.17:0/684829656 shutdown_connections 2024-08-19T01:34:10.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.188+0000 7efd75a6c640 1 --2- 172.21.15.17:0/684829656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd70100750 0x7efd701047a0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.188+0000 7efd75a6c640 1 --2- 172.21.15.17:0/684829656 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd700ffda0 0x7efd70100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.188+0000 7efd75a6c640 1 -- 172.21.15.17:0/684829656 >> 172.21.15.17:0/684829656 conn(0x7efd700fb840 msgr2=0x7efd700fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:10.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.188+0000 7efd75a6c640 1 -- 172.21.15.17:0/684829656 shutdown_connections 2024-08-19T01:34:10.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.188+0000 7efd75a6c640 1 -- 172.21.15.17:0/684829656 wait complete. 2024-08-19T01:34:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.189+0000 7efd75a6c640 1 Processor -- start 2024-08-19T01:34:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.189+0000 7efd75a6c640 1 -- start start 2024-08-19T01:34:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.189+0000 7efd75a6c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd700ffda0 0x7efd7019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.189+0000 7efd75a6c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd70100750 0x7efd7019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.189+0000 7efd75a6c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7019c2f0 con 0x7efd700ffda0 2024-08-19T01:34:10.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.189+0000 7efd75a6c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd70195910 con 0x7efd70100750 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.189+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd700ffda0 0x7efd7019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd6f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd700ffda0 0x7efd7019b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52608/0 (socket says 172.21.15.17:52608) 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd6f7fe640 1 -- 172.21.15.17:0/2822954337 learned_addr learned my addr 172.21.15.17:0/2822954337 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd66ffd640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd70100750 0x7efd7019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd6f7fe640 1 -- 172.21.15.17:0/2822954337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd70100750 msgr2=0x7efd7019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd6f7fe640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd70100750 0x7efd7019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd6f7fe640 1 -- 172.21.15.17:0/2822954337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd58009560 con 0x7efd700ffda0 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd66ffd640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd70100750 0x7efd7019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd6f7fe640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd700ffda0 0x7efd7019b820 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c8a0 tx=0x7efd6000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd6d7fa640 1 -- 172.21.15.17:0/2822954337 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd60007b80 con 0x7efd700ffda0 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd75a6c640 1 -- 172.21.15.17:0/2822954337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd70195bf0 con 0x7efd700ffda0 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd6d7fa640 1 -- 172.21.15.17:0/2822954337 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efd60007ce0 con 0x7efd700ffda0 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd6d7fa640 1 -- 172.21.15.17:0/2822954337 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd60018810 con 0x7efd700ffda0 2024-08-19T01:34:10.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.190+0000 7efd75a6c640 1 -- 172.21.15.17:0/2822954337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd70196140 con 0x7efd700ffda0 2024-08-19T01:34:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.191+0000 7efd75a6c640 1 -- 172.21.15.17:0/2822954337 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd70101280 con 0x7efd700ffda0 2024-08-19T01:34:10.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.192+0000 7efd6d7fa640 1 -- 172.21.15.17:0/2822954337 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efd60018970 con 0x7efd700ffda0 2024-08-19T01:34:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.192+0000 7efd6d7fa640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd5c06e180 0x7efd5c070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.192+0000 7efd6d7fa640 1 -- 172.21.15.17:0/2822954337 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efd6008e2f0 con 0x7efd700ffda0 2024-08-19T01:34:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.192+0000 7efd66ffd640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd5c06e180 0x7efd5c070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:10.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.193+0000 7efd66ffd640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd5c06e180 0x7efd5c070640 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efd58000c00 tx=0x7efd58004280 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:10.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.197+0000 7efd6d7fa640 1 -- 172.21.15.17:0/2822954337 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efd60057650 con 0x7efd700ffda0 2024-08-19T01:34:10.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.383+0000 7efd75a6c640 1 -- 172.21.15.17:0/2822954337 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efd70108120 con 0x7efd5c06e180 2024-08-19T01:34:10.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.392+0000 7efd6d7fa640 1 -- 172.21.15.17:0/2822954337 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7efd70108120 con 0x7efd5c06e180 2024-08-19T01:34:10.394 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:34:10.394 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (35m) 13m ago 46m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:34:10.394 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (46m) 13m ago 46m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:34:10.394 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (45m) 13m ago 45m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:34:10.394 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (33m) 13m ago 46m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:34:10.394 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (33m) 13m ago 45m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:34:10.394 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (35m) 13m ago 45m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:34:10.394 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (29m) 13m ago 40m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (29m) 13m ago 40m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (14m) 13m ago 40m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (29m) 13m ago 40m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (37m) 13m ago 47m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (36m) 13m ago 45m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (34m) 13m ago 47m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (33m) 13m ago 45m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (36m) 13m ago 46m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (36m) 13m ago 45m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (32m) 13m ago 44m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (32m) 13m ago 43m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:34:10.395 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (31m) 13m ago 43m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:34:10.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (31m) 13m ago 43m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:34:10.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (30m) 13m ago 42m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:34:10.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (30m) 13m ago 42m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:34:10.396 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (35m) 13m ago 45m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:34:10.396 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.394+0000 7efd75a6c640 1 -- 172.21.15.17:0/2822954337 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd5c06e180 msgr2=0x7efd5c070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.394+0000 7efd75a6c640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd5c06e180 0x7efd5c070640 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efd58000c00 tx=0x7efd58004280 comp rx=0 tx=0).stop 2024-08-19T01:34:10.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.394+0000 7efd75a6c640 1 -- 172.21.15.17:0/2822954337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd700ffda0 msgr2=0x7efd7019b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.394+0000 7efd75a6c640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd700ffda0 0x7efd7019b820 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7efd6000c8a0 tx=0x7efd6000cd60 comp rx=0 tx=0).stop 2024-08-19T01:34:10.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.394+0000 7efd75a6c640 1 -- 172.21.15.17:0/2822954337 shutdown_connections 2024-08-19T01:34:10.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.394+0000 7efd75a6c640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efd5c06e180 0x7efd5c070640 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.394+0000 7efd75a6c640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efd70100750 0x7efd7019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.394+0000 7efd75a6c640 1 --2- 172.21.15.17:0/2822954337 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efd700ffda0 0x7efd7019b820 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.394+0000 7efd75a6c640 1 -- 172.21.15.17:0/2822954337 >> 172.21.15.17:0/2822954337 conn(0x7efd700fb840 msgr2=0x7efd700fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:10.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.395+0000 7efd75a6c640 1 -- 172.21.15.17:0/2822954337 shutdown_connections 2024-08-19T01:34:10.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.395+0000 7efd75a6c640 1 -- 172.21.15.17:0/2822954337 wait complete. 2024-08-19T01:34:10.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.476+0000 7ffb3d81a640 1 -- 172.21.15.17:0/1870577852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb38100750 msgr2=0x7ffb381047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.476+0000 7ffb3d81a640 1 --2- 172.21.15.17:0/1870577852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb38100750 0x7ffb381047a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009880 tx=0x7ffb2c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.476+0000 7ffb3d81a640 1 -- 172.21.15.17:0/1870577852 shutdown_connections 2024-08-19T01:34:10.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.476+0000 7ffb3d81a640 1 --2- 172.21.15.17:0/1870577852 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb38100750 0x7ffb381047a0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.476+0000 7ffb3d81a640 1 --2- 172.21.15.17:0/1870577852 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ffda0 0x7ffb38100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.476+0000 7ffb3d81a640 1 -- 172.21.15.17:0/1870577852 >> 172.21.15.17:0/1870577852 conn(0x7ffb380fb840 msgr2=0x7ffb380fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:10.478 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:10 smithi017 ceph-mon[99370]: from='client.35942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:10.478 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:10 smithi017 ceph-mon[99370]: from='client.35946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.476+0000 7ffb3d81a640 1 -- 172.21.15.17:0/1870577852 shutdown_connections 2024-08-19T01:34:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.476+0000 7ffb3d81a640 1 -- 172.21.15.17:0/1870577852 wait complete. 2024-08-19T01:34:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.477+0000 7ffb3d81a640 1 Processor -- start 2024-08-19T01:34:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.477+0000 7ffb3d81a640 1 -- start start 2024-08-19T01:34:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.477+0000 7ffb3d81a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ffda0 0x7ffb3819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.477+0000 7ffb3d81a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb38100750 0x7ffb3819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.477+0000 7ffb3d81a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3819c380 con 0x7ffb38100750 2024-08-19T01:34:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.477+0000 7ffb3d81a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb38195910 con 0x7ffb380ffda0 2024-08-19T01:34:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.477+0000 7ffb367fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb38100750 0x7ffb3819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.477+0000 7ffb367fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb38100750 0x7ffb3819bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52624/0 (socket says 172.21.15.17:52624) 2024-08-19T01:34:10.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.477+0000 7ffb367fc640 1 -- 172.21.15.17:0/248438560 learned_addr learned my addr 172.21.15.17:0/248438560 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.478+0000 7ffb36ffd640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ffda0 0x7ffb3819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.478+0000 7ffb367fc640 1 -- 172.21.15.17:0/248438560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ffda0 msgr2=0x7ffb3819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.478+0000 7ffb367fc640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ffda0 0x7ffb3819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.478+0000 7ffb367fc640 1 -- 172.21.15.17:0/248438560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c009560 con 0x7ffb38100750 2024-08-19T01:34:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.478+0000 7ffb36ffd640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ffda0 0x7ffb3819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:34:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.478+0000 7ffb367fc640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb38100750 0x7ffb3819bd60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c02a9c0 tx=0x7ffb2c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.478+0000 7ffb3c818640 1 -- 172.21.15.17:0/248438560 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb2c004aa0 con 0x7ffb38100750 2024-08-19T01:34:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.478+0000 7ffb3d81a640 1 -- 172.21.15.17:0/248438560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb38195b90 con 0x7ffb38100750 2024-08-19T01:34:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.478+0000 7ffb3c818640 1 -- 172.21.15.17:0/248438560 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb2c004c00 con 0x7ffb38100750 2024-08-19T01:34:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.478+0000 7ffb3c818640 1 -- 172.21.15.17:0/248438560 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb2c003ab0 con 0x7ffb38100750 2024-08-19T01:34:10.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.478+0000 7ffb3d81a640 1 -- 172.21.15.17:0/248438560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb38196080 con 0x7ffb38100750 2024-08-19T01:34:10.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.480+0000 7ffb3d81a640 1 -- 172.21.15.17:0/248438560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb38101280 con 0x7ffb38100750 2024-08-19T01:34:10.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.480+0000 7ffb3c818640 1 -- 172.21.15.17:0/248438560 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ffb2c031d20 con 0x7ffb38100750 2024-08-19T01:34:10.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.480+0000 7ffb3c818640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffb2006e170 0x7ffb20070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:10.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.480+0000 7ffb3c818640 1 -- 172.21.15.17:0/248438560 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ffb2c0af270 con 0x7ffb38100750 2024-08-19T01:34:10.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.480+0000 7ffb36ffd640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffb2006e170 0x7ffb20070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:10.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.481+0000 7ffb36ffd640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffb2006e170 0x7ffb20070630 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ffb28005c40 tx=0x7ffb2800a430 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:10.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.485+0000 7ffb3c818640 1 -- 172.21.15.17:0/248438560 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ffb2c078550 con 0x7ffb38100750 2024-08-19T01:34:10.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:10 smithi086 ceph-mon[71303]: from='client.35942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:10.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:10 smithi086 ceph-mon[71303]: from='client.35946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:10.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.732+0000 7ffb3d81a640 1 -- 172.21.15.17:0/248438560 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffb38100180 con 0x7ffb38100750 2024-08-19T01:34:10.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.733+0000 7ffb3c818640 1 -- 172.21.15.17:0/248438560 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7ffb2c09ae60 con 0x7ffb38100750 2024-08-19T01:34:10.734 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:34:10.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:34:10.734 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:34:10.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:34:10.734 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:34:10.734 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:34:10.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:34:10.735 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:34:10.735 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:34:10.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:34:10.735 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:34:10.735 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:34:10.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:34:10.735 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:34:10.735 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:34:10.735 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:34:10.735 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:34:10.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.734+0000 7ffb3d81a640 1 -- 172.21.15.17:0/248438560 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffb2006e170 msgr2=0x7ffb20070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.735+0000 7ffb3d81a640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffb2006e170 0x7ffb20070630 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ffb28005c40 tx=0x7ffb2800a430 comp rx=0 tx=0).stop 2024-08-19T01:34:10.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.735+0000 7ffb3d81a640 1 -- 172.21.15.17:0/248438560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb38100750 msgr2=0x7ffb3819bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.735+0000 7ffb3d81a640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb38100750 0x7ffb3819bd60 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c02a9c0 tx=0x7ffb2c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.735+0000 7ffb3d81a640 1 -- 172.21.15.17:0/248438560 shutdown_connections 2024-08-19T01:34:10.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.735+0000 7ffb3d81a640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ffb2006e170 0x7ffb20070630 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.735+0000 7ffb3d81a640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb38100750 0x7ffb3819bd60 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.735+0000 7ffb3d81a640 1 --2- 172.21.15.17:0/248438560 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ffb380ffda0 0x7ffb3819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.735+0000 7ffb3d81a640 1 -- 172.21.15.17:0/248438560 >> 172.21.15.17:0/248438560 conn(0x7ffb380fb840 msgr2=0x7ffb380fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:10.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.735+0000 7ffb3d81a640 1 -- 172.21.15.17:0/248438560 shutdown_connections 2024-08-19T01:34:10.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.735+0000 7ffb3d81a640 1 -- 172.21.15.17:0/248438560 wait complete. 2024-08-19T01:34:10.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.817+0000 7fcec475d640 1 -- 172.21.15.17:0/1919858996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc105c00 msgr2=0x7fcebc105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.817+0000 7fcec475d640 1 --2- 172.21.15.17:0/1919858996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc105c00 0x7fcebc105fe0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009880 tx=0x7fceb802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.817+0000 7fcec475d640 1 -- 172.21.15.17:0/1919858996 shutdown_connections 2024-08-19T01:34:10.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.817+0000 7fcec475d640 1 --2- 172.21.15.17:0/1919858996 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc0ffb50 0x7fcebc0fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.817+0000 7fcec475d640 1 --2- 172.21.15.17:0/1919858996 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc105c00 0x7fcebc105fe0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.817+0000 7fcec475d640 1 -- 172.21.15.17:0/1919858996 >> 172.21.15.17:0/1919858996 conn(0x7fcebc0fb830 msgr2=0x7fcebc0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.817+0000 7fcec475d640 1 -- 172.21.15.17:0/1919858996 shutdown_connections 2024-08-19T01:34:10.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.817+0000 7fcec475d640 1 -- 172.21.15.17:0/1919858996 wait complete. 2024-08-19T01:34:10.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.817+0000 7fcec475d640 1 Processor -- start 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.817+0000 7fcec475d640 1 -- start start 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec475d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc0ffb50 0x7fcebc19b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec475d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc105c00 0x7fcebc19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec475d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc19c310 con 0x7fcebc105c00 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec475d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcebc1958a0 con 0x7fcebc0ffb50 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec1cf8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc105c00 0x7fcebc19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec1cf8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc105c00 0x7fcebc19bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52634/0 (socket says 172.21.15.17:52634) 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec1cf8640 1 -- 172.21.15.17:0/1568527134 learned_addr learned my addr 172.21.15.17:0/1568527134 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec24f9640 1 --2- 172.21.15.17:0/1568527134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc0ffb50 0x7fcebc19b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec1cf8640 1 -- 172.21.15.17:0/1568527134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc0ffb50 msgr2=0x7fcebc19b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec1cf8640 1 --2- 172.21.15.17:0/1568527134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc0ffb50 0x7fcebc19b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:10.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec1cf8640 1 -- 172.21.15.17:0/1568527134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8009560 con 0x7fcebc105c00 2024-08-19T01:34:10.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec1cf8640 1 --2- 172.21.15.17:0/1568527134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc105c00 0x7fcebc19bcf0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fceb000d8d0 tx=0x7fceb000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:10.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fceaf7fe640 1 -- 172.21.15.17:0/1568527134 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceb000bea0 con 0x7fcebc105c00 2024-08-19T01:34:10.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec475d640 1 -- 172.21.15.17:0/1568527134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcebc195b80 con 0x7fcebc105c00 2024-08-19T01:34:10.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fceaf7fe640 1 -- 172.21.15.17:0/1568527134 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fceb0009c00 con 0x7fcebc105c00 2024-08-19T01:34:10.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fceaf7fe640 1 -- 172.21.15.17:0/1568527134 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fceb000f710 con 0x7fcebc105c00 2024-08-19T01:34:10.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.818+0000 7fcec475d640 1 -- 172.21.15.17:0/1568527134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcebc196150 con 0x7fcebc105c00 2024-08-19T01:34:10.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.819+0000 7fcec475d640 1 -- 172.21.15.17:0/1568527134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcebc101200 con 0x7fcebc105c00 2024-08-19T01:34:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.820+0000 7fceaf7fe640 1 -- 172.21.15.17:0/1568527134 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fceb000f990 con 0x7fcebc105c00 2024-08-19T01:34:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.820+0000 7fceaf7fe640 1 --2- 172.21.15.17:0/1568527134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcea806e180 0x7fcea8070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.820+0000 7fceaf7fe640 1 -- 172.21.15.17:0/1568527134 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fceb008de70 con 0x7fcebc105c00 2024-08-19T01:34:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.821+0000 7fcec24f9640 1 --2- 172.21.15.17:0/1568527134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcea806e180 0x7fcea8070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:10.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.821+0000 7fcec24f9640 1 --2- 172.21.15.17:0/1568527134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcea806e180 0x7fcea8070640 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009230 tx=0x7fceb8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:10.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:10.825+0000 7fceaf7fe640 1 -- 172.21.15.17:0/1568527134 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fceb0057200 con 0x7fcebc105c00 2024-08-19T01:34:11.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.035+0000 7fcec475d640 1 -- 172.21.15.17:0/1568527134 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcebc108020 con 0x7fcebc105c00 2024-08-19T01:34:11.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.036+0000 7fceaf7fe640 1 -- 172.21.15.17:0/1568527134 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7fceb005a8c0 con 0x7fcebc105c00 2024-08-19T01:34:11.037 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:34:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:34:11.039 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:34:11.040 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:34:11.041 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:34:11.041 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:34:11.041 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:34:11.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.038+0000 7fcec475d640 1 -- 172.21.15.17:0/1568527134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcea806e180 msgr2=0x7fcea8070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:11.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.038+0000 7fcec475d640 1 --2- 172.21.15.17:0/1568527134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcea806e180 0x7fcea8070640 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009230 tx=0x7fceb8005a20 comp rx=0 tx=0).stop 2024-08-19T01:34:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.038+0000 7fcec475d640 1 -- 172.21.15.17:0/1568527134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc105c00 msgr2=0x7fcebc19bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.038+0000 7fcec475d640 1 --2- 172.21.15.17:0/1568527134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc105c00 0x7fcebc19bcf0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fceb000d8d0 tx=0x7fceb000dd90 comp rx=0 tx=0).stop 2024-08-19T01:34:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.038+0000 7fcec475d640 1 -- 172.21.15.17:0/1568527134 shutdown_connections 2024-08-19T01:34:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.038+0000 7fcec475d640 1 --2- 172.21.15.17:0/1568527134 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fcea806e180 0x7fcea8070640 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.038+0000 7fcec475d640 1 --2- 172.21.15.17:0/1568527134 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcebc105c00 0x7fcebc19bcf0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.038+0000 7fcec475d640 1 --2- 172.21.15.17:0/1568527134 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fcebc0ffb50 0x7fcebc19b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.038+0000 7fcec475d640 1 -- 172.21.15.17:0/1568527134 >> 172.21.15.17:0/1568527134 conn(0x7fcebc0fb830 msgr2=0x7fcebc0fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.038+0000 7fcec475d640 1 -- 172.21.15.17:0/1568527134 shutdown_connections 2024-08-19T01:34:11.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.038+0000 7fcec475d640 1 -- 172.21.15.17:0/1568527134 wait complete. 2024-08-19T01:34:11.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.121+0000 7fbb627d9640 1 -- 172.21.15.17:0/1279212016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5c101610 msgr2=0x7fbb5c109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:11.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.121+0000 7fbb627d9640 1 --2- 172.21.15.17:0/1279212016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5c101610 0x7fbb5c109b00 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fbb440098b0 tx=0x7fbb4402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.121+0000 7fbb627d9640 1 -- 172.21.15.17:0/1279212016 shutdown_connections 2024-08-19T01:34:11.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.121+0000 7fbb627d9640 1 --2- 172.21.15.17:0/1279212016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5c101610 0x7fbb5c109b00 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.121+0000 7fbb627d9640 1 --2- 172.21.15.17:0/1279212016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb5c100c60 0x7fbb5c101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.121+0000 7fbb627d9640 1 -- 172.21.15.17:0/1279212016 >> 172.21.15.17:0/1279212016 conn(0x7fbb5c0fa730 msgr2=0x7fbb5c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:11.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.121+0000 7fbb627d9640 1 -- 172.21.15.17:0/1279212016 shutdown_connections 2024-08-19T01:34:11.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.121+0000 7fbb627d9640 1 -- 172.21.15.17:0/1279212016 wait complete. 2024-08-19T01:34:11.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.122+0000 7fbb627d9640 1 Processor -- start 2024-08-19T01:34:11.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.122+0000 7fbb627d9640 1 -- start start 2024-08-19T01:34:11.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.122+0000 7fbb627d9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb5c100c60 0x7fbb5c19b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:11.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.122+0000 7fbb627d9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5c101610 0x7fbb5c19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.122+0000 7fbb627d9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c19c3e0 con 0x7fbb5c101610 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.122+0000 7fbb627d9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c195970 con 0x7fbb5c100c60 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb5b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5c101610 0x7fbb5c19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb5b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5c101610 0x7fbb5c19bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52660/0 (socket says 172.21.15.17:52660) 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb5b7fe640 1 -- 172.21.15.17:0/464287570 learned_addr learned my addr 172.21.15.17:0/464287570 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb5bfff640 1 --2- 172.21.15.17:0/464287570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb5c100c60 0x7fbb5c19b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb5b7fe640 1 -- 172.21.15.17:0/464287570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb5c100c60 msgr2=0x7fbb5c19b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb5b7fe640 1 --2- 172.21.15.17:0/464287570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb5c100c60 0x7fbb5c19b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb5b7fe640 1 -- 172.21.15.17:0/464287570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44009560 con 0x7fbb5c101610 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb5b7fe640 1 --2- 172.21.15.17:0/464287570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5c101610 0x7fbb5c19bdc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fbb44006010 tx=0x7fbb440055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb597fa640 1 -- 172.21.15.17:0/464287570 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb440048d0 con 0x7fbb5c101610 2024-08-19T01:34:11.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb627d9640 1 -- 172.21.15.17:0/464287570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c195bf0 con 0x7fbb5c101610 2024-08-19T01:34:11.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb597fa640 1 -- 172.21.15.17:0/464287570 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb44031640 con 0x7fbb5c101610 2024-08-19T01:34:11.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb597fa640 1 -- 172.21.15.17:0/464287570 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb44003800 con 0x7fbb5c101610 2024-08-19T01:34:11.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.123+0000 7fbb627d9640 1 -- 172.21.15.17:0/464287570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5c1960e0 con 0x7fbb5c101610 2024-08-19T01:34:11.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.124+0000 7fbb627d9640 1 -- 172.21.15.17:0/464287570 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5c068d30 con 0x7fbb5c101610 2024-08-19T01:34:11.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.125+0000 7fbb597fa640 1 -- 172.21.15.17:0/464287570 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fbb44004a30 con 0x7fbb5c101610 2024-08-19T01:34:11.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.125+0000 7fbb597fa640 1 --2- 172.21.15.17:0/464287570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbb4806e170 0x7fbb48070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:11.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.125+0000 7fbb597fa640 1 -- 172.21.15.17:0/464287570 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fbb440af170 con 0x7fbb5c101610 2024-08-19T01:34:11.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.126+0000 7fbb5bfff640 1 --2- 172.21.15.17:0/464287570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbb4806e170 0x7fbb48070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:11.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.126+0000 7fbb5bfff640 1 --2- 172.21.15.17:0/464287570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbb4806e170 0x7fbb48070630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009bd0 tx=0x7fbb4c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:11.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.130+0000 7fbb597fa640 1 -- 172.21.15.17:0/464287570 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fbb44078460 con 0x7fbb5c101610 2024-08-19T01:34:11.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.322+0000 7fbb627d9640 1 -- 172.21.15.17:0/464287570 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb5c10cdd0 con 0x7fbb4806e170 2024-08-19T01:34:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.323+0000 7fbb597fa640 1 -- 172.21.15.17:0/464287570 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fbb5c10cdd0 con 0x7fbb4806e170 2024-08-19T01:34:11.327 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:34:11.327 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:34:11.327 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:34:11.327 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:34:11.327 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:34:11.327 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:34:11.327 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:34:11.327 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:34:11.328 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:34:11.328 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:34:11.328 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:34:11.328 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:34:11.328 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:34:11.328 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:34:11.328 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:34:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.325+0000 7fbb627d9640 1 -- 172.21.15.17:0/464287570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbb4806e170 msgr2=0x7fbb48070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.325+0000 7fbb627d9640 1 --2- 172.21.15.17:0/464287570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbb4806e170 0x7fbb48070630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009bd0 tx=0x7fbb4c005f90 comp rx=0 tx=0).stop 2024-08-19T01:34:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.325+0000 7fbb627d9640 1 -- 172.21.15.17:0/464287570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5c101610 msgr2=0x7fbb5c19bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.325+0000 7fbb627d9640 1 --2- 172.21.15.17:0/464287570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5c101610 0x7fbb5c19bdc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fbb44006010 tx=0x7fbb440055a0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.325+0000 7fbb627d9640 1 -- 172.21.15.17:0/464287570 shutdown_connections 2024-08-19T01:34:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.325+0000 7fbb627d9640 1 --2- 172.21.15.17:0/464287570 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fbb4806e170 0x7fbb48070630 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.325+0000 7fbb627d9640 1 --2- 172.21.15.17:0/464287570 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbb5c101610 0x7fbb5c19bdc0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.325+0000 7fbb627d9640 1 --2- 172.21.15.17:0/464287570 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fbb5c100c60 0x7fbb5c19b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.325+0000 7fbb627d9640 1 -- 172.21.15.17:0/464287570 >> 172.21.15.17:0/464287570 conn(0x7fbb5c0fa730 msgr2=0x7fbb5c101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.325+0000 7fbb627d9640 1 -- 172.21.15.17:0/464287570 shutdown_connections 2024-08-19T01:34:11.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.325+0000 7fbb627d9640 1 -- 172.21.15.17:0/464287570 wait complete. 2024-08-19T01:34:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.408+0000 7f413df84640 1 -- 172.21.15.17:0/3201651809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41381049f0 msgr2=0x7f4138104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:11.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.408+0000 7f413df84640 1 --2- 172.21.15.17:0/3201651809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41381049f0 0x7f4138104dd0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f4128009880 tx=0x7f412802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.408+0000 7f413df84640 1 -- 172.21.15.17:0/3201651809 shutdown_connections 2024-08-19T01:34:11.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.408+0000 7f413df84640 1 --2- 172.21.15.17:0/3201651809 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41380fe9f0 0x7f41380fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.408+0000 7f413df84640 1 --2- 172.21.15.17:0/3201651809 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41381049f0 0x7f4138104dd0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.409+0000 7f413df84640 1 -- 172.21.15.17:0/3201651809 >> 172.21.15.17:0/3201651809 conn(0x7f41380758a0 msgr2=0x7f41380fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:11.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.409+0000 7f413df84640 1 -- 172.21.15.17:0/3201651809 shutdown_connections 2024-08-19T01:34:11.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.409+0000 7f413df84640 1 -- 172.21.15.17:0/3201651809 wait complete. 2024-08-19T01:34:11.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.409+0000 7f413df84640 1 Processor -- start 2024-08-19T01:34:11.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.409+0000 7f413df84640 1 -- start start 2024-08-19T01:34:11.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.409+0000 7f413df84640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41380fe9f0 0x7f41380fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:11.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.409+0000 7f413df84640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41381049f0 0x7f41380fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f413df84640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41380fb800 con 0x7f41381049f0 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f413df84640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41380fb940 con 0x7f41380fe9f0 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f412effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41381049f0 0x7f41380fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f412effd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41381049f0 0x7f41380fb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:52678/0 (socket says 172.21.15.17:52678) 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f412effd640 1 -- 172.21.15.17:0/2001763729 learned_addr learned my addr 172.21.15.17:0/2001763729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f41377fe640 1 --2- 172.21.15.17:0/2001763729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41380fe9f0 0x7f41380fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f412effd640 1 -- 172.21.15.17:0/2001763729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41380fe9f0 msgr2=0x7f41380fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f412effd640 1 --2- 172.21.15.17:0/2001763729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41380fe9f0 0x7f41380fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f412effd640 1 -- 172.21.15.17:0/2001763729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4128009560 con 0x7f41381049f0 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f412effd640 1 --2- 172.21.15.17:0/2001763729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41381049f0 0x7f41380fb2c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f412000d6f0 tx=0x7f412000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f41357fa640 1 -- 172.21.15.17:0/2001763729 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4120009a30 con 0x7f41381049f0 2024-08-19T01:34:11.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f413df84640 1 -- 172.21.15.17:0/2001763729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41381a1d00 con 0x7f41381049f0 2024-08-19T01:34:11.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f41357fa640 1 -- 172.21.15.17:0/2001763729 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f41200054e0 con 0x7f41381049f0 2024-08-19T01:34:11.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f41357fa640 1 -- 172.21.15.17:0/2001763729 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4120010460 con 0x7f41381049f0 2024-08-19T01:34:11.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.410+0000 7f413df84640 1 -- 172.21.15.17:0/2001763729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41381a2110 con 0x7f41381049f0 2024-08-19T01:34:11.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.411+0000 7f413df84640 1 -- 172.21.15.17:0/2001763729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4138100130 con 0x7f41381049f0 2024-08-19T01:34:11.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.412+0000 7f41357fa640 1 -- 172.21.15.17:0/2001763729 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4120009b90 con 0x7f41381049f0 2024-08-19T01:34:11.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.412+0000 7f41357fa640 1 --2- 172.21.15.17:0/2001763729 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f412406e170 0x7f4124070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:11.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.412+0000 7f41357fa640 1 -- 172.21.15.17:0/2001763729 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f412008dd20 con 0x7f41381049f0 2024-08-19T01:34:11.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.412+0000 7f41377fe640 1 --2- 172.21.15.17:0/2001763729 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f412406e170 0x7f4124070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:11.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.413+0000 7f41377fe640 1 --2- 172.21.15.17:0/2001763729 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f412406e170 0x7f4124070630 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4128009230 tx=0x7f41280058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:11.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.417+0000 7f41357fa640 1 -- 172.21.15.17:0/2001763729 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4120057010 con 0x7f41381049f0 2024-08-19T01:34:11.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.663+0000 7f413df84640 1 -- 172.21.15.17:0/2001763729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f413810bd20 con 0x7f41381049f0 2024-08-19T01:34:11.665 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:11 smithi017 ceph-mon[99370]: pgmap v1063: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:11.665 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:11 smithi017 ceph-mon[99370]: from='client.35950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:11.665 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:11 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/248438560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:34:11.665 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:11 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1568527134' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:34:11.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.663+0000 7f41357fa640 1 -- 172.21.15.17:0/2001763729 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7f4120017090 con 0x7f41381049f0 2024-08-19T01:34:11.665 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:34:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:34:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:34:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.666+0000 7f413df84640 1 -- 172.21.15.17:0/2001763729 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f412406e170 msgr2=0x7f4124070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.666+0000 7f413df84640 1 --2- 172.21.15.17:0/2001763729 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f412406e170 0x7f4124070630 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4128009230 tx=0x7f41280058d0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.666+0000 7f413df84640 1 -- 172.21.15.17:0/2001763729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41381049f0 msgr2=0x7f41380fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.666+0000 7f413df84640 1 --2- 172.21.15.17:0/2001763729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41381049f0 0x7f41380fb2c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f412000d6f0 tx=0x7f412000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.666+0000 7f413df84640 1 -- 172.21.15.17:0/2001763729 shutdown_connections 2024-08-19T01:34:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.666+0000 7f413df84640 1 --2- 172.21.15.17:0/2001763729 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f412406e170 0x7f4124070630 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.666+0000 7f413df84640 1 --2- 172.21.15.17:0/2001763729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f41381049f0 0x7f41380fb2c0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.666+0000 7f413df84640 1 --2- 172.21.15.17:0/2001763729 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f41380fe9f0 0x7f41380fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.666+0000 7f413df84640 1 -- 172.21.15.17:0/2001763729 >> 172.21.15.17:0/2001763729 conn(0x7f41380758a0 msgr2=0x7f41380fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.666+0000 7f413df84640 1 -- 172.21.15.17:0/2001763729 shutdown_connections 2024-08-19T01:34:11.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:11.666+0000 7f413df84640 1 -- 172.21.15.17:0/2001763729 wait complete. 2024-08-19T01:34:11.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:11 smithi086 ceph-mon[71303]: pgmap v1063: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:11.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:11 smithi086 ceph-mon[71303]: from='client.35950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:11.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:11 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/248438560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:34:11.696 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:11 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1568527134' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:34:12.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:12 smithi017 ceph-mon[99370]: from='client.35962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:12.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:12 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2001763729' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:34:12.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:12 smithi086 ceph-mon[71303]: from='client.35962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:12.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:12 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2001763729' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:34:13.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:13 smithi017 ceph-mon[99370]: pgmap v1064: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:13.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:13 smithi086 ceph-mon[71303]: pgmap v1064: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:15.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:15 smithi017 ceph-mon[99370]: pgmap v1065: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:15.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:15 smithi086 ceph-mon[71303]: pgmap v1065: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:17.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:17 smithi017 ceph-mon[99370]: pgmap v1066: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:17.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:17 smithi086 ceph-mon[71303]: pgmap v1066: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:18.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:34:18.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:34:19.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:19 smithi017 ceph-mon[99370]: pgmap v1067: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:19.697 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:19 smithi086 ceph-mon[71303]: pgmap v1067: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:21.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:21 smithi017 ceph-mon[99370]: pgmap v1068: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:21.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:21 smithi086 ceph-mon[71303]: pgmap v1068: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:23.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:23 smithi017 ceph-mon[99370]: pgmap v1069: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:23.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:23 smithi086 ceph-mon[71303]: pgmap v1069: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:25.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:25 smithi017 ceph-mon[99370]: pgmap v1070: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:25.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:25 smithi086 ceph-mon[71303]: pgmap v1070: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:27.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:27 smithi017 ceph-mon[99370]: pgmap v1071: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:27.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:27 smithi086 ceph-mon[71303]: pgmap v1071: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:29.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:29 smithi017 ceph-mon[99370]: pgmap v1072: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:29.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:29 smithi086 ceph-mon[71303]: pgmap v1072: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:31.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:31 smithi017 ceph-mon[99370]: pgmap v1073: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:31.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:31 smithi086 ceph-mon[71303]: pgmap v1073: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:33.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:33 smithi017 ceph-mon[99370]: pgmap v1074: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:33.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:34:33.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:33 smithi086 ceph-mon[71303]: pgmap v1074: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:33.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:34:35.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:35 smithi017 ceph-mon[99370]: pgmap v1075: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:35.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:35 smithi086 ceph-mon[71303]: pgmap v1075: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:38.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:37 smithi017 ceph-mon[99370]: pgmap v1076: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:38.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:37 smithi086 ceph-mon[71303]: pgmap v1076: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:40.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:39 smithi017 ceph-mon[99370]: pgmap v1077: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:40.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:39 smithi086 ceph-mon[71303]: pgmap v1077: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.761+0000 7efdc6377640 1 -- 172.21.15.17:0/4275046393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc0100c60 msgr2=0x7efdc0101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.761+0000 7efdc6377640 1 --2- 172.21.15.17:0/4275046393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc0100c60 0x7efdc0101040 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7efdb00098b0 tx=0x7efdb002a4d0 comp rx=0 tx=0).stop 2024-08-19T01:34:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.761+0000 7efdc6377640 1 -- 172.21.15.17:0/4275046393 shutdown_connections 2024-08-19T01:34:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.761+0000 7efdc6377640 1 --2- 172.21.15.17:0/4275046393 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc0101610 0x7efdc0109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.761+0000 7efdc6377640 1 --2- 172.21.15.17:0/4275046393 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc0100c60 0x7efdc0101040 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:41.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.761+0000 7efdc6377640 1 -- 172.21.15.17:0/4275046393 >> 172.21.15.17:0/4275046393 conn(0x7efdc00fa730 msgr2=0x7efdc00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:41.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.761+0000 7efdc6377640 1 -- 172.21.15.17:0/4275046393 shutdown_connections 2024-08-19T01:34:41.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.761+0000 7efdc6377640 1 -- 172.21.15.17:0/4275046393 wait complete. 2024-08-19T01:34:41.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.762+0000 7efdc6377640 1 Processor -- start 2024-08-19T01:34:41.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.762+0000 7efdc6377640 1 -- start start 2024-08-19T01:34:41.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdc6377640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc0100c60 0x7efdc019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:41.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdc6377640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc0101610 0x7efdc019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdc6377640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc019c380 con 0x7efdc0100c60 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdc6377640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc0195910 con 0x7efdc0101610 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdbffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc0100c60 0x7efdc019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdbffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc0100c60 0x7efdc019b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43828/0 (socket says 172.21.15.17:43828) 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdbffff640 1 -- 172.21.15.17:0/3967260883 learned_addr learned my addr 172.21.15.17:0/3967260883 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdbf7fe640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc0101610 0x7efdc019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdbffff640 1 -- 172.21.15.17:0/3967260883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc0101610 msgr2=0x7efdc019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdbffff640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc0101610 0x7efdc019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdbffff640 1 -- 172.21.15.17:0/3967260883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0009560 con 0x7efdc0100c60 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdbf7fe640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc0101610 0x7efdc019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.763+0000 7efdbffff640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc0100c60 0x7efdc019b820 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7efdb0006010 tx=0x7efdb00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.764+0000 7efdbd7fa640 1 -- 172.21.15.17:0/3967260883 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb0004aa0 con 0x7efdc0100c60 2024-08-19T01:34:41.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.764+0000 7efdc6377640 1 -- 172.21.15.17:0/3967260883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc0195b90 con 0x7efdc0100c60 2024-08-19T01:34:41.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.764+0000 7efdbd7fa640 1 -- 172.21.15.17:0/3967260883 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efdb0004c00 con 0x7efdc0100c60 2024-08-19T01:34:41.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.764+0000 7efdbd7fa640 1 -- 172.21.15.17:0/3967260883 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdb0003a20 con 0x7efdc0100c60 2024-08-19T01:34:41.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.764+0000 7efdc6377640 1 -- 172.21.15.17:0/3967260883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc0196080 con 0x7efdc0100c60 2024-08-19T01:34:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.765+0000 7efdc6377640 1 -- 172.21.15.17:0/3967260883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc0068d30 con 0x7efdc0100c60 2024-08-19T01:34:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.765+0000 7efdbd7fa640 1 -- 172.21.15.17:0/3967260883 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efdb0003c90 con 0x7efdc0100c60 2024-08-19T01:34:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.766+0000 7efdbd7fa640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efda806e170 0x7efda8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.766+0000 7efdbd7fa640 1 -- 172.21.15.17:0/3967260883 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7efdb00af3b0 con 0x7efdc0100c60 2024-08-19T01:34:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.766+0000 7efdbf7fe640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efda806e170 0x7efda8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:41.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.767+0000 7efdbf7fe640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efda806e170 0x7efda8070630 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efdc0196d80 tx=0x7efdb4005ec0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:41.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.771+0000 7efdbd7fa640 1 -- 172.21.15.17:0/3967260883 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7efdb0078630 con 0x7efdc0100c60 2024-08-19T01:34:41.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.965+0000 7efdc6377640 1 -- 172.21.15.17:0/3967260883 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdc01043f0 con 0x7efda806e170 2024-08-19T01:34:41.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.966+0000 7efdbd7fa640 1 -- 172.21.15.17:0/3967260883 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7efdc01043f0 con 0x7efda806e170 2024-08-19T01:34:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.968+0000 7efdc6377640 1 -- 172.21.15.17:0/3967260883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efda806e170 msgr2=0x7efda8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.968+0000 7efdc6377640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efda806e170 0x7efda8070630 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efdc0196d80 tx=0x7efdb4005ec0 comp rx=0 tx=0).stop 2024-08-19T01:34:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.968+0000 7efdc6377640 1 -- 172.21.15.17:0/3967260883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc0100c60 msgr2=0x7efdc019b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.968+0000 7efdc6377640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc0100c60 0x7efdc019b820 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7efdb0006010 tx=0x7efdb00055a0 comp rx=0 tx=0).stop 2024-08-19T01:34:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.968+0000 7efdc6377640 1 -- 172.21.15.17:0/3967260883 shutdown_connections 2024-08-19T01:34:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.968+0000 7efdc6377640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7efda806e170 0x7efda8070630 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.968+0000 7efdc6377640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7efdc0101610 0x7efdc019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.968+0000 7efdc6377640 1 --2- 172.21.15.17:0/3967260883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efdc0100c60 0x7efdc019b820 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.968+0000 7efdc6377640 1 -- 172.21.15.17:0/3967260883 >> 172.21.15.17:0/3967260883 conn(0x7efdc00fa730 msgr2=0x7efdc0101f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.969+0000 7efdc6377640 1 -- 172.21.15.17:0/3967260883 shutdown_connections 2024-08-19T01:34:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:41.969+0000 7efdc6377640 1 -- 172.21.15.17:0/3967260883 wait complete. 2024-08-19T01:34:41.978 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:34:42.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.052+0000 7f6898a06640 1 -- 172.21.15.17:0/3643572108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 msgr2=0x7f6894104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.052+0000 7f6898a06640 1 --2- 172.21.15.17:0/3643572108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f6894104e10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6884009880 tx=0x7f688402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.054 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:41 smithi017 ceph-mon[99370]: pgmap v1078: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:42.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.052+0000 7f6898a06640 1 -- 172.21.15.17:0/3643572108 shutdown_connections 2024-08-19T01:34:42.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.052+0000 7f6898a06640 1 --2- 172.21.15.17:0/3643572108 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 0x7f68940fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.052+0000 7f6898a06640 1 --2- 172.21.15.17:0/3643572108 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f6894104e10 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.052+0000 7f6898a06640 1 -- 172.21.15.17:0/3643572108 >> 172.21.15.17:0/3643572108 conn(0x7f68940fa710 msgr2=0x7f68940fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.052+0000 7f6898a06640 1 -- 172.21.15.17:0/3643572108 shutdown_connections 2024-08-19T01:34:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.052+0000 7f6898a06640 1 -- 172.21.15.17:0/3643572108 wait complete. 2024-08-19T01:34:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.053+0000 7f6898a06640 1 Processor -- start 2024-08-19T01:34:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.053+0000 7f6898a06640 1 -- start start 2024-08-19T01:34:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.053+0000 7f6898a06640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 0x7f6894196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.053+0000 7f6898a06640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f6894196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.053+0000 7f6898a06640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6894197590 con 0x7f6894104a30 2024-08-19T01:34:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.053+0000 7f6898a06640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6894197700 con 0x7f68940fea30 2024-08-19T01:34:42.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.053+0000 7f6891d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f6894196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.053+0000 7f6891d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f6894196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43854/0 (socket says 172.21.15.17:43854) 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.053+0000 7f6891d9b640 1 -- 172.21.15.17:0/2779955938 learned_addr learned my addr 172.21.15.17:0/2779955938 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.053+0000 7f689259c640 1 --2- 172.21.15.17:0/2779955938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 0x7f6894196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.054+0000 7f6891d9b640 1 -- 172.21.15.17:0/2779955938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 msgr2=0x7f6894196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.054+0000 7f6891d9b640 1 --2- 172.21.15.17:0/2779955938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 0x7f6894196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.054+0000 7f6891d9b640 1 -- 172.21.15.17:0/2779955938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884009560 con 0x7f6894104a30 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.054+0000 7f6891d9b640 1 --2- 172.21.15.17:0/2779955938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f6894196fc0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f687c00b420 tx=0x7f687c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.054+0000 7f688b7fe640 1 -- 172.21.15.17:0/2779955938 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687c011800 con 0x7f6894104a30 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.054+0000 7f688b7fe640 1 -- 172.21.15.17:0/2779955938 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f687c011e20 con 0x7f6894104a30 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.054+0000 7f6898a06640 1 -- 172.21.15.17:0/2779955938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689419faf0 con 0x7f6894104a30 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.054+0000 7f688b7fe640 1 -- 172.21.15.17:0/2779955938 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687c00f2e0 con 0x7f6894104a30 2024-08-19T01:34:42.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.054+0000 7f6898a06640 1 -- 172.21.15.17:0/2779955938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689419ff60 con 0x7f6894104a30 2024-08-19T01:34:42.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.055+0000 7f688b7fe640 1 -- 172.21.15.17:0/2779955938 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f687c010380 con 0x7f6894104a30 2024-08-19T01:34:42.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.055+0000 7f6898a06640 1 -- 172.21.15.17:0/2779955938 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6894100170 con 0x7f6894104a30 2024-08-19T01:34:42.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.056+0000 7f688b7fe640 1 --2- 172.21.15.17:0/2779955938 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 0x7f6880070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.056+0000 7f688b7fe640 1 -- 172.21.15.17:0/2779955938 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f687c08db10 con 0x7f6894104a30 2024-08-19T01:34:42.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.056+0000 7f689259c640 1 --2- 172.21.15.17:0/2779955938 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 0x7f6880070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.057+0000 7f689259c640 1 --2- 172.21.15.17:0/2779955938 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 0x7f6880070630 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6884000c00 tx=0x7f6884005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:42.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.060+0000 7f688b7fe640 1 -- 172.21.15.17:0/2779955938 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f687c056df0 con 0x7f6894104a30 2024-08-19T01:34:42.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:41 smithi086 ceph-mon[71303]: pgmap v1078: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:42.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.252+0000 7f6898a06640 1 -- 172.21.15.17:0/2779955938 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f689410bd20 con 0x7f688006e170 2024-08-19T01:34:42.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.253+0000 7f688b7fe640 1 -- 172.21.15.17:0/2779955938 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f689410bd20 con 0x7f688006e170 2024-08-19T01:34:42.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.255+0000 7f6898a06640 1 -- 172.21.15.17:0/2779955938 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 msgr2=0x7f6880070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.255+0000 7f6898a06640 1 --2- 172.21.15.17:0/2779955938 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 0x7f6880070630 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6884000c00 tx=0x7f6884005a20 comp rx=0 tx=0).stop 2024-08-19T01:34:42.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.255+0000 7f6898a06640 1 -- 172.21.15.17:0/2779955938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 msgr2=0x7f6894196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.255+0000 7f6898a06640 1 --2- 172.21.15.17:0/2779955938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f6894196fc0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f687c00b420 tx=0x7f687c00b8e0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.255+0000 7f6898a06640 1 -- 172.21.15.17:0/2779955938 shutdown_connections 2024-08-19T01:34:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.255+0000 7f6898a06640 1 --2- 172.21.15.17:0/2779955938 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 0x7f6880070630 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.255+0000 7f6898a06640 1 --2- 172.21.15.17:0/2779955938 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f6894196fc0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.255+0000 7f6898a06640 1 --2- 172.21.15.17:0/2779955938 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 0x7f6894196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.255+0000 7f6898a06640 1 -- 172.21.15.17:0/2779955938 >> 172.21.15.17:0/2779955938 conn(0x7f68940fa710 msgr2=0x7f68940fb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.255+0000 7f6898a06640 1 -- 172.21.15.17:0/2779955938 shutdown_connections 2024-08-19T01:34:42.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.255+0000 7f6898a06640 1 -- 172.21.15.17:0/2779955938 wait complete. 2024-08-19T01:34:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.337+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/1913945124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4104a30 msgr2=0x7fd3b4104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.337+0000 7fd3b8ac3640 1 --2- 172.21.15.17:0/1913945124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4104a30 0x7fd3b4104e10 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009880 tx=0x7fd3a402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.337+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/1913945124 shutdown_connections 2024-08-19T01:34:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.337+0000 7fd3b8ac3640 1 --2- 172.21.15.17:0/1913945124 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b40fea30 0x7fd3b40fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.337+0000 7fd3b8ac3640 1 --2- 172.21.15.17:0/1913945124 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4104a30 0x7fd3b4104e10 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.337+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/1913945124 >> 172.21.15.17:0/1913945124 conn(0x7fd3b40fa730 msgr2=0x7fd3b40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.337+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/1913945124 shutdown_connections 2024-08-19T01:34:42.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.337+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/1913945124 wait complete. 2024-08-19T01:34:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.338+0000 7fd3b8ac3640 1 Processor -- start 2024-08-19T01:34:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.338+0000 7fd3b8ac3640 1 -- start start 2024-08-19T01:34:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.338+0000 7fd3b8ac3640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b40fea30 0x7fd3b419b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.338+0000 7fd3b8ac3640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4104a30 0x7fd3b419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.338+0000 7fd3b8ac3640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4195890 con 0x7fd3b4104a30 2024-08-19T01:34:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.338+0000 7fd3b8ac3640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b41959d0 con 0x7fd3b40fea30 2024-08-19T01:34:42.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3b1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4104a30 0x7fd3b419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3b1d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4104a30 0x7fd3b419bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43872/0 (socket says 172.21.15.17:43872) 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3b1d9b640 1 -- 172.21.15.17:0/3757136444 learned_addr learned my addr 172.21.15.17:0/3757136444 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3b259c640 1 --2- 172.21.15.17:0/3757136444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b40fea30 0x7fd3b419b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3b1d9b640 1 -- 172.21.15.17:0/3757136444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b40fea30 msgr2=0x7fd3b419b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3b1d9b640 1 --2- 172.21.15.17:0/3757136444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b40fea30 0x7fd3b419b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3b1d9b640 1 -- 172.21.15.17:0/3757136444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4009560 con 0x7fd3b4104a30 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3b1d9b640 1 --2- 172.21.15.17:0/3757136444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4104a30 0x7fd3b419bd70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00d8d0 tx=0x7fd39c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3ab7fe640 1 -- 172.21.15.17:0/3757136444 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd39c009c00 con 0x7fd3b4104a30 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3ab7fe640 1 -- 172.21.15.17:0/3757136444 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd39c009d60 con 0x7fd3b4104a30 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/3757136444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b4195cb0 con 0x7fd3b4104a30 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3ab7fe640 1 -- 172.21.15.17:0/3757136444 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd39c0049d0 con 0x7fd3b4104a30 2024-08-19T01:34:42.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.339+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/3757136444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b4196200 con 0x7fd3b4104a30 2024-08-19T01:34:42.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.340+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/3757136444 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b4100170 con 0x7fd3b4104a30 2024-08-19T01:34:42.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.341+0000 7fd3ab7fe640 1 -- 172.21.15.17:0/3757136444 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd39c004c40 con 0x7fd3b4104a30 2024-08-19T01:34:42.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.342+0000 7fd3ab7fe640 1 --2- 172.21.15.17:0/3757136444 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3a006e170 0x7fd3a0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.342+0000 7fd3ab7fe640 1 -- 172.21.15.17:0/3757136444 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd39c08deb0 con 0x7fd3b4104a30 2024-08-19T01:34:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.342+0000 7fd3b259c640 1 --2- 172.21.15.17:0/3757136444 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3a006e170 0x7fd3a0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.342+0000 7fd3b259c640 1 --2- 172.21.15.17:0/3757136444 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3a006e170 0x7fd3a0070630 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009230 tx=0x7fd3a40058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:42.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.346+0000 7fd3ab7fe640 1 -- 172.21.15.17:0/3757136444 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd39c0570f0 con 0x7fd3b4104a30 2024-08-19T01:34:42.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.530+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/3757136444 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3b410bd10 con 0x7fd3a006e170 2024-08-19T01:34:42.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.539+0000 7fd3ab7fe640 1 -- 172.21.15.17:0/3757136444 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd3b410bd10 con 0x7fd3a006e170 2024-08-19T01:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (36m) 14m ago 46m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (46m) 14m ago 46m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (45m) 14m ago 45m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (33m) 14m ago 46m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (33m) 14m ago 45m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (35m) 14m ago 46m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (29m) 14m ago 41m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (30m) 14m ago 41m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:34:42.541 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (14m) 14m ago 41m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (29m) 14m ago 41m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (37m) 14m ago 48m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (36m) 14m ago 45m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (34m) 14m ago 48m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (34m) 14m ago 45m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (36m) 14m ago 46m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (36m) 14m ago 45m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (33m) 14m ago 44m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (32m) 14m ago 44m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (32m) 14m ago 43m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (31m) 14m ago 43m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (31m) 14m ago 43m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:34:42.542 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (30m) 14m ago 42m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:34:42.543 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (36m) 14m ago 46m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:34:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.542+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/3757136444 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3a006e170 msgr2=0x7fd3a0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.542+0000 7fd3b8ac3640 1 --2- 172.21.15.17:0/3757136444 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3a006e170 0x7fd3a0070630 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009230 tx=0x7fd3a40058d0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.542+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/3757136444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4104a30 msgr2=0x7fd3b419bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.542+0000 7fd3b8ac3640 1 --2- 172.21.15.17:0/3757136444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4104a30 0x7fd3b419bd70 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00d8d0 tx=0x7fd39c00dd90 comp rx=0 tx=0).stop 2024-08-19T01:34:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.542+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/3757136444 shutdown_connections 2024-08-19T01:34:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.542+0000 7fd3b8ac3640 1 --2- 172.21.15.17:0/3757136444 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd3a006e170 0x7fd3a0070630 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.542+0000 7fd3b8ac3640 1 --2- 172.21.15.17:0/3757136444 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd3b4104a30 0x7fd3b419bd70 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.542+0000 7fd3b8ac3640 1 --2- 172.21.15.17:0/3757136444 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd3b40fea30 0x7fd3b419b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.542+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/3757136444 >> 172.21.15.17:0/3757136444 conn(0x7fd3b40fa730 msgr2=0x7fd3b4068730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.542+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/3757136444 shutdown_connections 2024-08-19T01:34:42.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.542+0000 7fd3b8ac3640 1 -- 172.21.15.17:0/3757136444 wait complete. 2024-08-19T01:34:42.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.622+0000 7f494a378640 1 -- 172.21.15.17:0/3606423774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4944100750 msgr2=0x7f49441047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.622+0000 7f494a378640 1 --2- 172.21.15.17:0/3606423774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4944100750 0x7f49441047a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f4938009880 tx=0x7f493802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.622+0000 7f494a378640 1 -- 172.21.15.17:0/3606423774 shutdown_connections 2024-08-19T01:34:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.622+0000 7f494a378640 1 --2- 172.21.15.17:0/3606423774 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4944100750 0x7f49441047a0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.622+0000 7f494a378640 1 --2- 172.21.15.17:0/3606423774 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f49440ffda0 0x7f4944100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.622+0000 7f494a378640 1 -- 172.21.15.17:0/3606423774 >> 172.21.15.17:0/3606423774 conn(0x7f49440fb840 msgr2=0x7f49440fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.623+0000 7f494a378640 1 -- 172.21.15.17:0/3606423774 shutdown_connections 2024-08-19T01:34:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.623+0000 7f494a378640 1 -- 172.21.15.17:0/3606423774 wait complete. 2024-08-19T01:34:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.623+0000 7f494a378640 1 Processor -- start 2024-08-19T01:34:42.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.623+0000 7f494a378640 1 -- start start 2024-08-19T01:34:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f494a378640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49440ffda0 0x7f494419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f494a378640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944100750 0x7f494419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f494a378640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494419c380 con 0x7f49440ffda0 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f494a378640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4944195910 con 0x7f4944100750 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f4943fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49440ffda0 0x7f494419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f4943fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49440ffda0 0x7f494419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43894/0 (socket says 172.21.15.17:43894) 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f4943fff640 1 -- 172.21.15.17:0/363020256 learned_addr learned my addr 172.21.15.17:0/363020256 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f49437fe640 1 --2- 172.21.15.17:0/363020256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944100750 0x7f494419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f4943fff640 1 -- 172.21.15.17:0/363020256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944100750 msgr2=0x7f494419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f4943fff640 1 --2- 172.21.15.17:0/363020256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944100750 0x7f494419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f4943fff640 1 -- 172.21.15.17:0/363020256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938009560 con 0x7f49440ffda0 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f4943fff640 1 --2- 172.21.15.17:0/363020256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49440ffda0 0x7f494419b820 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f493400e970 tx=0x7f493400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.624+0000 7f49417fa640 1 -- 172.21.15.17:0/363020256 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f493400cc90 con 0x7f49440ffda0 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.625+0000 7f49417fa640 1 -- 172.21.15.17:0/363020256 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f493400cdf0 con 0x7f49440ffda0 2024-08-19T01:34:42.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.625+0000 7f49417fa640 1 -- 172.21.15.17:0/363020256 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4934018810 con 0x7f49440ffda0 2024-08-19T01:34:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.625+0000 7f494a378640 1 -- 172.21.15.17:0/363020256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4944195bf0 con 0x7f49440ffda0 2024-08-19T01:34:42.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.625+0000 7f494a378640 1 -- 172.21.15.17:0/363020256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4944196110 con 0x7f49440ffda0 2024-08-19T01:34:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.626+0000 7f494a378640 1 -- 172.21.15.17:0/363020256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4944101280 con 0x7f49440ffda0 2024-08-19T01:34:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.626+0000 7f49417fa640 1 -- 172.21.15.17:0/363020256 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4934010c10 con 0x7f49440ffda0 2024-08-19T01:34:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.627+0000 7f49417fa640 1 --2- 172.21.15.17:0/363020256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f492c06e170 0x7f492c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.627+0000 7f49417fa640 1 -- 172.21.15.17:0/363020256 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4934014070 con 0x7f49440ffda0 2024-08-19T01:34:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.627+0000 7f49437fe640 1 --2- 172.21.15.17:0/363020256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f492c06e170 0x7f492c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.627+0000 7f49437fe640 1 --2- 172.21.15.17:0/363020256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f492c06e170 0x7f492c070630 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4938000c00 tx=0x7f4938005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:42.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.631+0000 7f49417fa640 1 -- 172.21.15.17:0/363020256 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4934053df0 con 0x7f49440ffda0 2024-08-19T01:34:42.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.881+0000 7f494a378640 1 -- 172.21.15.17:0/363020256 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4944108110 con 0x7f49440ffda0 2024-08-19T01:34:42.883 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:42 smithi017 ceph-mon[99370]: from='client.35970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:42.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.882+0000 7f49417fa640 1 -- 172.21.15.17:0/363020256 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f493405b4d0 con 0x7f49440ffda0 2024-08-19T01:34:42.883 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:34:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:34:42.883 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:34:42.884 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:34:42.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.884+0000 7f494a378640 1 -- 172.21.15.17:0/363020256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f492c06e170 msgr2=0x7f492c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.884+0000 7f494a378640 1 --2- 172.21.15.17:0/363020256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f492c06e170 0x7f492c070630 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4938000c00 tx=0x7f4938005a20 comp rx=0 tx=0).stop 2024-08-19T01:34:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.884+0000 7f494a378640 1 -- 172.21.15.17:0/363020256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49440ffda0 msgr2=0x7f494419b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.884+0000 7f494a378640 1 --2- 172.21.15.17:0/363020256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49440ffda0 0x7f494419b820 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f493400e970 tx=0x7f493400ee30 comp rx=0 tx=0).stop 2024-08-19T01:34:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.884+0000 7f494a378640 1 -- 172.21.15.17:0/363020256 shutdown_connections 2024-08-19T01:34:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.884+0000 7f494a378640 1 --2- 172.21.15.17:0/363020256 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f492c06e170 0x7f492c070630 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.884+0000 7f494a378640 1 --2- 172.21.15.17:0/363020256 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4944100750 0x7f494419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.884+0000 7f494a378640 1 --2- 172.21.15.17:0/363020256 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49440ffda0 0x7f494419b820 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.884+0000 7f494a378640 1 -- 172.21.15.17:0/363020256 >> 172.21.15.17:0/363020256 conn(0x7f49440fb840 msgr2=0x7f49440fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.884+0000 7f494a378640 1 -- 172.21.15.17:0/363020256 shutdown_connections 2024-08-19T01:34:42.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.884+0000 7f494a378640 1 -- 172.21.15.17:0/363020256 wait complete. 2024-08-19T01:34:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.966+0000 7f46810bb640 1 -- 172.21.15.17:0/3133685262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c0ffda0 msgr2=0x7f467c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.966+0000 7f46810bb640 1 --2- 172.21.15.17:0/3133685262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c0ffda0 0x7f467c100180 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f466c009880 tx=0x7f466c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.966+0000 7f46810bb640 1 -- 172.21.15.17:0/3133685262 shutdown_connections 2024-08-19T01:34:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.966+0000 7f46810bb640 1 --2- 172.21.15.17:0/3133685262 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c100750 0x7f467c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.966+0000 7f46810bb640 1 --2- 172.21.15.17:0/3133685262 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c0ffda0 0x7f467c100180 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.966+0000 7f46810bb640 1 -- 172.21.15.17:0/3133685262 >> 172.21.15.17:0/3133685262 conn(0x7f467c0fb840 msgr2=0x7f467c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.966+0000 7f46810bb640 1 -- 172.21.15.17:0/3133685262 shutdown_connections 2024-08-19T01:34:42.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.966+0000 7f46810bb640 1 -- 172.21.15.17:0/3133685262 wait complete. 2024-08-19T01:34:42.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.967+0000 7f46810bb640 1 Processor -- start 2024-08-19T01:34:42.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.967+0000 7f46810bb640 1 -- start start 2024-08-19T01:34:42.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.967+0000 7f46810bb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c0ffda0 0x7f467c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.967+0000 7f46810bb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c100750 0x7f467c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f46810bb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c073230 con 0x7f467c0ffda0 2024-08-19T01:34:42.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f46810bb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c073370 con 0x7f467c100750 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f467ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c0ffda0 0x7f467c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f467ad9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c0ffda0 0x7f467c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43908/0 (socket says 172.21.15.17:43908) 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f467ad9d640 1 -- 172.21.15.17:0/3259247059 learned_addr learned my addr 172.21.15.17:0/3259247059 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f467a59c640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c100750 0x7f467c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f467ad9d640 1 -- 172.21.15.17:0/3259247059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c100750 msgr2=0x7f467c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f467ad9d640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c100750 0x7f467c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f467ad9d640 1 -- 172.21.15.17:0/3259247059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c009560 con 0x7f467c0ffda0 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f467a59c640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c100750 0x7f467c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f467ad9d640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c0ffda0 0x7f467c0727b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f466c02a9c0 tx=0x7f466c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f4663fff640 1 -- 172.21.15.17:0/3259247059 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f466c004aa0 con 0x7f467c0ffda0 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f4663fff640 1 -- 172.21.15.17:0/3259247059 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f466c004c00 con 0x7f467c0ffda0 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f46810bb640 1 -- 172.21.15.17:0/3259247059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c0735f0 con 0x7f467c0ffda0 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f4663fff640 1 -- 172.21.15.17:0/3259247059 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f466c003ab0 con 0x7f467c0ffda0 2024-08-19T01:34:42.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.968+0000 7f46810bb640 1 -- 172.21.15.17:0/3259247059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c1a20e0 con 0x7f467c0ffda0 2024-08-19T01:34:42.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.970+0000 7f46810bb640 1 -- 172.21.15.17:0/3259247059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c101280 con 0x7f467c0ffda0 2024-08-19T01:34:42.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.970+0000 7f4663fff640 1 -- 172.21.15.17:0/3259247059 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f466c003c10 con 0x7f467c0ffda0 2024-08-19T01:34:42.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.971+0000 7f4663fff640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466406e170 0x7f4664070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:42.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.971+0000 7f467a59c640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466406e170 0x7f4664070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:42.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.971+0000 7f4663fff640 1 -- 172.21.15.17:0/3259247059 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f466c0af190 con 0x7f467c0ffda0 2024-08-19T01:34:42.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.971+0000 7f467a59c640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466406e170 0x7f4664070630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4670005fd0 tx=0x7f4670005ea0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:42.975+0000 7f4663fff640 1 -- 172.21.15.17:0/3259247059 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f466c0784f0 con 0x7f467c0ffda0 2024-08-19T01:34:43.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.190+0000 7f46810bb640 1 -- 172.21.15.17:0/3259247059 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f467c100180 con 0x7f467c0ffda0 2024-08-19T01:34:43.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.191+0000 7f4663fff640 1 -- 172.21.15.17:0/3259247059 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1908 (secure 0 0 0) 0x7f466c07bbb0 con 0x7f467c0ffda0 2024-08-19T01:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout:e32 2024-08-19T01:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:20:07:951551+0000 2024-08-19T01:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:34:43.192 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 23 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:04:18.358857+0000 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:34:43.193 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:up {} 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:failed 0,1 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:34:43.194 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{-1:34388} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{-1:34420} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:34:43.195 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:34:43.196 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:34:43.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.193+0000 7f46810bb640 1 -- 172.21.15.17:0/3259247059 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466406e170 msgr2=0x7f4664070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:43.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.193+0000 7f46810bb640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466406e170 0x7f4664070630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4670005fd0 tx=0x7f4670005ea0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.193+0000 7f46810bb640 1 -- 172.21.15.17:0/3259247059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c0ffda0 msgr2=0x7f467c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:43.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.193+0000 7f46810bb640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c0ffda0 0x7f467c0727b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f466c02a9c0 tx=0x7f466c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.193+0000 7f46810bb640 1 -- 172.21.15.17:0/3259247059 shutdown_connections 2024-08-19T01:34:43.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.193+0000 7f46810bb640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f466406e170 0x7f4664070630 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.193+0000 7f46810bb640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f467c100750 0x7f467c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.193+0000 7f46810bb640 1 --2- 172.21.15.17:0/3259247059 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f467c0ffda0 0x7f467c0727b0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.193+0000 7f46810bb640 1 -- 172.21.15.17:0/3259247059 >> 172.21.15.17:0/3259247059 conn(0x7f467c0fb840 msgr2=0x7f467c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.193+0000 7f46810bb640 1 -- 172.21.15.17:0/3259247059 shutdown_connections 2024-08-19T01:34:43.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.193+0000 7f46810bb640 1 -- 172.21.15.17:0/3259247059 wait complete. 2024-08-19T01:34:43.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:42 smithi086 ceph-mon[71303]: from='client.35970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:43.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.275+0000 7f689a11b640 1 -- 172.21.15.17:0/513114034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 msgr2=0x7f6894104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:43.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.275+0000 7f689a11b640 1 --2- 172.21.15.17:0/513114034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f6894104e10 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f6884009880 tx=0x7f688402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.276+0000 7f689a11b640 1 -- 172.21.15.17:0/513114034 shutdown_connections 2024-08-19T01:34:43.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.276+0000 7f689a11b640 1 --2- 172.21.15.17:0/513114034 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 0x7f68940fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.276+0000 7f689a11b640 1 --2- 172.21.15.17:0/513114034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f6894104e10 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.276+0000 7f689a11b640 1 -- 172.21.15.17:0/513114034 >> 172.21.15.17:0/513114034 conn(0x7f68940fa730 msgr2=0x7f68940fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:43.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.276+0000 7f689a11b640 1 -- 172.21.15.17:0/513114034 shutdown_connections 2024-08-19T01:34:43.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.276+0000 7f689a11b640 1 -- 172.21.15.17:0/513114034 wait complete. 2024-08-19T01:34:43.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.276+0000 7f689a11b640 1 Processor -- start 2024-08-19T01:34:43.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.276+0000 7f689a11b640 1 -- start start 2024-08-19T01:34:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f689a11b640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 0x7f689419dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f689a11b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f689419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f689a11b640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6894197b20 con 0x7f6894104a30 2024-08-19T01:34:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f689a11b640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6894197c60 con 0x7f68940fea30 2024-08-19T01:34:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f688affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f689419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f688affd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f689419e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43922/0 (socket says 172.21.15.17:43922) 2024-08-19T01:34:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f688affd640 1 -- 172.21.15.17:0/869491919 learned_addr learned my addr 172.21.15.17:0/869491919 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f68937fe640 1 --2- 172.21.15.17:0/869491919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 0x7f689419dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f688affd640 1 -- 172.21.15.17:0/869491919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 msgr2=0x7f689419dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f688affd640 1 --2- 172.21.15.17:0/869491919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 0x7f689419dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f688affd640 1 -- 172.21.15.17:0/869491919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884009560 con 0x7f6894104a30 2024-08-19T01:34:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f688affd640 1 --2- 172.21.15.17:0/869491919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f689419e000 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f687c00d6f0 tx=0x7f687c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f68917fa640 1 -- 172.21.15.17:0/869491919 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687c009a30 con 0x7f6894104a30 2024-08-19T01:34:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f689a11b640 1 -- 172.21.15.17:0/869491919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6894197f40 con 0x7f6894104a30 2024-08-19T01:34:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f68917fa640 1 -- 172.21.15.17:0/869491919 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f687c0054e0 con 0x7f6894104a30 2024-08-19T01:34:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.277+0000 7f68917fa640 1 -- 172.21.15.17:0/869491919 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687c010460 con 0x7f6894104a30 2024-08-19T01:34:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.278+0000 7f689a11b640 1 -- 172.21.15.17:0/869491919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6894198490 con 0x7f6894104a30 2024-08-19T01:34:43.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.278+0000 7f689a11b640 1 -- 172.21.15.17:0/869491919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6894100170 con 0x7f6894104a30 2024-08-19T01:34:43.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.279+0000 7f68917fa640 1 -- 172.21.15.17:0/869491919 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f687c009b90 con 0x7f6894104a30 2024-08-19T01:34:43.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.280+0000 7f68917fa640 1 --2- 172.21.15.17:0/869491919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 0x7f6880070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:43.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.280+0000 7f68937fe640 1 --2- 172.21.15.17:0/869491919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 0x7f6880070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:43.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.280+0000 7f68917fa640 1 -- 172.21.15.17:0/869491919 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f687c08dce0 con 0x7f6894104a30 2024-08-19T01:34:43.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.280+0000 7f68937fe640 1 --2- 172.21.15.17:0/869491919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 0x7f6880070630 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6884009230 tx=0x7f68840058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:43.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.284+0000 7f68917fa640 1 -- 172.21.15.17:0/869491919 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f687c057010 con 0x7f6894104a30 2024-08-19T01:34:43.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.474+0000 7f689a11b640 1 -- 172.21.15.17:0/869491919 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f689410bcc0 con 0x7f688006e170 2024-08-19T01:34:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.476+0000 7f68917fa640 1 -- 172.21.15.17:0/869491919 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f689410bcc0 con 0x7f688006e170 2024-08-19T01:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:34:43.477 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading mds daemons", 2024-08-19T01:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:34:43.478 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:34:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.478+0000 7f689a11b640 1 -- 172.21.15.17:0/869491919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 msgr2=0x7f6880070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.478+0000 7f689a11b640 1 --2- 172.21.15.17:0/869491919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 0x7f6880070630 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6884009230 tx=0x7f68840058d0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.478+0000 7f689a11b640 1 -- 172.21.15.17:0/869491919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 msgr2=0x7f689419e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.478+0000 7f689a11b640 1 --2- 172.21.15.17:0/869491919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f689419e000 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f687c00d6f0 tx=0x7f687c00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.478+0000 7f689a11b640 1 -- 172.21.15.17:0/869491919 shutdown_connections 2024-08-19T01:34:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.478+0000 7f689a11b640 1 --2- 172.21.15.17:0/869491919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f688006e170 0x7f6880070630 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.478+0000 7f689a11b640 1 --2- 172.21.15.17:0/869491919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6894104a30 0x7f689419e000 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.478+0000 7f689a11b640 1 --2- 172.21.15.17:0/869491919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f68940fea30 0x7f689419dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.478+0000 7f689a11b640 1 -- 172.21.15.17:0/869491919 >> 172.21.15.17:0/869491919 conn(0x7f68940fa730 msgr2=0x7f68940fbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.478+0000 7f689a11b640 1 -- 172.21.15.17:0/869491919 shutdown_connections 2024-08-19T01:34:43.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.478+0000 7f689a11b640 1 -- 172.21.15.17:0/869491919 wait complete. 2024-08-19T01:34:43.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.560+0000 7ff5e5ace640 1 -- 172.21.15.17:0/1276726862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e0105bf0 msgr2=0x7ff5e0105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:43.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.560+0000 7ff5e5ace640 1 --2- 172.21.15.17:0/1276726862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e0105bf0 0x7ff5e0105fd0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009880 tx=0x7ff5d002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.560+0000 7ff5e5ace640 1 -- 172.21.15.17:0/1276726862 shutdown_connections 2024-08-19T01:34:43.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.560+0000 7ff5e5ace640 1 --2- 172.21.15.17:0/1276726862 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e00ffb40 0x7ff5e00fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.560+0000 7ff5e5ace640 1 --2- 172.21.15.17:0/1276726862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e0105bf0 0x7ff5e0105fd0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.560+0000 7ff5e5ace640 1 -- 172.21.15.17:0/1276726862 >> 172.21.15.17:0/1276726862 conn(0x7ff5e00fb860 msgr2=0x7ff5e00fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.560+0000 7ff5e5ace640 1 -- 172.21.15.17:0/1276726862 shutdown_connections 2024-08-19T01:34:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.560+0000 7ff5e5ace640 1 -- 172.21.15.17:0/1276726862 wait complete. 2024-08-19T01:34:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.561+0000 7ff5e5ace640 1 Processor -- start 2024-08-19T01:34:43.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.561+0000 7ff5e5ace640 1 -- start start 2024-08-19T01:34:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.561+0000 7ff5e5ace640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffb40 0x7ff5e019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:43.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.561+0000 7ff5e5ace640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e0105bf0 0x7ff5e019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.561+0000 7ff5e5ace640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e019c320 con 0x7ff5e00ffb40 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.561+0000 7ff5e5ace640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e01958b0 con 0x7ff5e0105bf0 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5df7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffb40 0x7ff5e019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5df7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffb40 0x7ff5e019b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43942/0 (socket says 172.21.15.17:43942) 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5df7fe640 1 -- 172.21.15.17:0/297506198 learned_addr learned my addr 172.21.15.17:0/297506198 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5d6ffd640 1 --2- 172.21.15.17:0/297506198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e0105bf0 0x7ff5e019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5df7fe640 1 -- 172.21.15.17:0/297506198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e0105bf0 msgr2=0x7ff5e019bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5df7fe640 1 --2- 172.21.15.17:0/297506198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e0105bf0 0x7ff5e019bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5df7fe640 1 -- 172.21.15.17:0/297506198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0009560 con 0x7ff5e00ffb40 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5df7fe640 1 --2- 172.21.15.17:0/297506198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffb40 0x7ff5e019b7c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0006010 tx=0x7ff5d00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5dd7fa640 1 -- 172.21.15.17:0/297506198 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d0004aa0 con 0x7ff5e00ffb40 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5dd7fa640 1 -- 172.21.15.17:0/297506198 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff5d0031470 con 0x7ff5e00ffb40 2024-08-19T01:34:43.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5e5ace640 1 -- 172.21.15.17:0/297506198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e0195b30 con 0x7ff5e00ffb40 2024-08-19T01:34:43.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5dd7fa640 1 -- 172.21.15.17:0/297506198 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5d0003940 con 0x7ff5e00ffb40 2024-08-19T01:34:43.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.562+0000 7ff5e5ace640 1 -- 172.21.15.17:0/297506198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e01960a0 con 0x7ff5e00ffb40 2024-08-19T01:34:43.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.564+0000 7ff5e5ace640 1 -- 172.21.15.17:0/297506198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e01011f0 con 0x7ff5e00ffb40 2024-08-19T01:34:43.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.564+0000 7ff5dd7fa640 1 -- 172.21.15.17:0/297506198 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff5d0031b90 con 0x7ff5e00ffb40 2024-08-19T01:34:43.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.564+0000 7ff5dd7fa640 1 --2- 172.21.15.17:0/297506198 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5cc06e180 0x7ff5cc070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:34:43.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.564+0000 7ff5dd7fa640 1 -- 172.21.15.17:0/297506198 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff5d00af130 con 0x7ff5e00ffb40 2024-08-19T01:34:43.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.564+0000 7ff5d6ffd640 1 --2- 172.21.15.17:0/297506198 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5cc06e180 0x7ff5cc070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:34:43.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.565+0000 7ff5d6ffd640 1 --2- 172.21.15.17:0/297506198 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5cc06e180 0x7ff5cc070640 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0196d20 tx=0x7ff5c800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:34:43.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.569+0000 7ff5dd7fa640 1 -- 172.21.15.17:0/297506198 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff5d0078540 con 0x7ff5e00ffb40 2024-08-19T01:34:43.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.814+0000 7ff5e5ace640 1 -- 172.21.15.17:0/297506198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff5e0108010 con 0x7ff5e00ffb40 2024-08-19T01:34:43.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.814+0000 7ff5dd7fa640 1 -- 172.21.15.17:0/297506198 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3795 (secure 0 0 0) 0x7ff5d0004c00 con 0x7ff5e00ffb40 2024-08-19T01:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_ERR failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-08-19T01:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:34:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpqj_869z2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:34:43.817 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:34:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:34:43.818 INFO:teuthology.orchestra.run.smithi017.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-08-19T01:34:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is offline because no MDS is active for it. 2024-08-19T01:34:43.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.816+0000 7ff5e5ace640 1 -- 172.21.15.17:0/297506198 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5cc06e180 msgr2=0x7ff5cc070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:43.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.816+0000 7ff5e5ace640 1 --2- 172.21.15.17:0/297506198 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5cc06e180 0x7ff5cc070640 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0196d20 tx=0x7ff5c800b390 comp rx=0 tx=0).stop 2024-08-19T01:34:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.816+0000 7ff5e5ace640 1 -- 172.21.15.17:0/297506198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffb40 msgr2=0x7ff5e019b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:34:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.816+0000 7ff5e5ace640 1 --2- 172.21.15.17:0/297506198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffb40 0x7ff5e019b7c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0006010 tx=0x7ff5d00055a0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.816+0000 7ff5e5ace640 1 -- 172.21.15.17:0/297506198 shutdown_connections 2024-08-19T01:34:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.816+0000 7ff5e5ace640 1 --2- 172.21.15.17:0/297506198 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff5cc06e180 0x7ff5cc070640 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.816+0000 7ff5e5ace640 1 --2- 172.21.15.17:0/297506198 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff5e0105bf0 0x7ff5e019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.816+0000 7ff5e5ace640 1 --2- 172.21.15.17:0/297506198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff5e00ffb40 0x7ff5e019b7c0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:34:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.816+0000 7ff5e5ace640 1 -- 172.21.15.17:0/297506198 >> 172.21.15.17:0/297506198 conn(0x7ff5e00fb860 msgr2=0x7ff5e00fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:34:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.817+0000 7ff5e5ace640 1 -- 172.21.15.17:0/297506198 shutdown_connections 2024-08-19T01:34:43.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:34:43.817+0000 7ff5e5ace640 1 -- 172.21.15.17:0/297506198 wait complete. 2024-08-19T01:34:44.041 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:43 smithi086 ceph-mon[71303]: from='client.35974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:44.041 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:43 smithi086 ceph-mon[71303]: pgmap v1079: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:44.041 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:43 smithi086 ceph-mon[71303]: from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:44.041 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:43 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/363020256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:34:44.041 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:43 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3259247059' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:34:44.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:43 smithi017 ceph-mon[99370]: from='client.35974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:44.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:43 smithi017 ceph-mon[99370]: pgmap v1079: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:44.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:43 smithi017 ceph-mon[99370]: from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:44.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:43 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/363020256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:34:44.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:43 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3259247059' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:34:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:44 smithi017 ceph-mon[99370]: from='client.35990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:45.061 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:44 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/297506198' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:34:45.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:44 smithi086 ceph-mon[71303]: from='client.35990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:34:45.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:44 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/297506198' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:34:46.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:45 smithi017 ceph-mon[99370]: pgmap v1080: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:46.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:45 smithi086 ceph-mon[71303]: pgmap v1080: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:48.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:47 smithi017 ceph-mon[99370]: pgmap v1081: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:48.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:47 smithi086 ceph-mon[71303]: pgmap v1081: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:49.124 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:34:49.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:34:50.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:49 smithi017 ceph-mon[99370]: pgmap v1082: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:50.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:49 smithi086 ceph-mon[71303]: pgmap v1082: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:52.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:51 smithi017 ceph-mon[99370]: pgmap v1083: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:52.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:51 smithi086 ceph-mon[71303]: pgmap v1083: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:54.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:53 smithi017 ceph-mon[99370]: pgmap v1084: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:54.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:53 smithi086 ceph-mon[71303]: pgmap v1084: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:56.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:55 smithi017 ceph-mon[99370]: pgmap v1085: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:56.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:55 smithi086 ceph-mon[71303]: pgmap v1085: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:58.121 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:57 smithi017 ceph-mon[99370]: pgmap v1086: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:34:58.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:57 smithi086 ceph-mon[71303]: pgmap v1086: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:00.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:34:59 smithi017 ceph-mon[99370]: pgmap v1087: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:00.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:34:59 smithi086 ceph-mon[71303]: pgmap v1087: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:02.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:01 smithi017 ceph-mon[99370]: pgmap v1088: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:02.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:01 smithi086 ceph-mon[71303]: pgmap v1088: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:04.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:03 smithi017 ceph-mon[99370]: pgmap v1089: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:04.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:35:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:03 smithi086 ceph-mon[71303]: pgmap v1089: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:35:06.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:05 smithi017 ceph-mon[99370]: pgmap v1090: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:06.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:05 smithi086 ceph-mon[71303]: pgmap v1090: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:08.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:07 smithi017 ceph-mon[99370]: pgmap v1091: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:08.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:07 smithi086 ceph-mon[71303]: pgmap v1091: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:35:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: pgmap v1092: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: pgmap v1093: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:35:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:09.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:09.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:09.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:09.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T01:35:09.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.gvlpoy"}]': finished 2024-08-19T01:35:09.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T01:35:09.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.junbdp"}]': finished 2024-08-19T01:35:09.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T01:35:09.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi086.oncasl"}]': finished 2024-08-19T01:35:09.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T01:35:09.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi086.uxhjfl"}]': finished 2024-08-19T01:35:09.184 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:08 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-08-19T01:35:09.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: pgmap v1092: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: pgmap v1093: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.gvlpoy"}]: dispatch 2024-08-19T01:35:09.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.gvlpoy"}]': finished 2024-08-19T01:35:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.junbdp"}]: dispatch 2024-08-19T01:35:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi017.junbdp"}]': finished 2024-08-19T01:35:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi086.oncasl"}]: dispatch 2024-08-19T01:35:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi086.oncasl"}]': finished 2024-08-19T01:35:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi086.uxhjfl"}]: dispatch 2024-08-19T01:35:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi086.uxhjfl"}]': finished 2024-08-19T01:35:09.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:08 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-08-19T01:35:09.832 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:09 smithi086 ceph-mon[71303]: Upgrade: Setting container_image for all mds 2024-08-19T01:35:09.833 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:09 smithi086 ceph-mon[71303]: Upgrade: Setting filesystem cephfs Joinable 2024-08-19T01:35:09.833 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:09 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-08-19T01:35:10.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:09 smithi017 ceph-mon[99370]: Upgrade: Setting container_image for all mds 2024-08-19T01:35:10.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:09 smithi017 ceph-mon[99370]: Upgrade: Setting filesystem cephfs Joinable 2024-08-19T01:35:10.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:09 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-08-19T01:35:10.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:09 smithi017 ceph-mon[99370]: Standby daemon mds.cephfs.smithi017.junbdp assigned to filesystem cephfs as rank 0 2024-08-19T01:35:10.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:09 smithi017 ceph-mon[99370]: Standby daemon mds.cephfs.smithi017.gvlpoy assigned to filesystem cephfs as rank 1 2024-08-19T01:35:10.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:09 smithi017 ceph-mon[99370]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-19T01:35:10.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:09 smithi017 ceph-mon[99370]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:35:10.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:09 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-08-19T01:35:10.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:09 smithi017 ceph-mon[99370]: fsmap cephfs:2/2 {0=cephfs.smithi017.junbdp=up:replay,1=cephfs.smithi017.gvlpoy=up:replay} 2 up:standby 2024-08-19T01:35:10.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:09 smithi086 ceph-mon[71303]: Standby daemon mds.cephfs.smithi017.junbdp assigned to filesystem cephfs as rank 0 2024-08-19T01:35:10.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:09 smithi086 ceph-mon[71303]: Standby daemon mds.cephfs.smithi017.gvlpoy assigned to filesystem cephfs as rank 1 2024-08-19T01:35:10.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:09 smithi086 ceph-mon[71303]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-19T01:35:10.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:09 smithi086 ceph-mon[71303]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-08-19T01:35:10.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:09 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-08-19T01:35:10.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:09 smithi086 ceph-mon[71303]: fsmap cephfs:2/2 {0=cephfs.smithi017.junbdp=up:replay,1=cephfs.smithi017.gvlpoy=up:replay} 2 up:standby 2024-08-19T01:35:10.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:10 smithi017 ceph-mon[99370]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-08-19T01:35:10.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:10 smithi017 ceph-mon[99370]: pgmap v1094: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:10.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-08-19T01:35:10.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:10 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] up:resolve 2024-08-19T01:35:10.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:10 smithi017 ceph-mon[99370]: fsmap cephfs:2/2 {0=cephfs.smithi017.junbdp=up:replay,1=cephfs.smithi017.gvlpoy=up:resolve} 2 up:standby 2024-08-19T01:35:10.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:10.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:10.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:10.905 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:10.905 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:10.905 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:10 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:11.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:10 smithi086 ceph-mon[71303]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-08-19T01:35:11.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:10 smithi086 ceph-mon[71303]: pgmap v1094: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail 2024-08-19T01:35:11.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-08-19T01:35:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:10 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] up:resolve 2024-08-19T01:35:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:10 smithi086 ceph-mon[71303]: fsmap cephfs:2/2 {0=cephfs.smithi017.junbdp=up:replay,1=cephfs.smithi017.gvlpoy=up:resolve} 2 up:standby 2024-08-19T01:35:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:11.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:10 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:11.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:11 smithi017 ceph-mon[99370]: Upgrade: Setting container_image for all rgw 2024-08-19T01:35:11.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:11 smithi017 ceph-mon[99370]: Upgrade: Setting container_image for all rbd-mirror 2024-08-19T01:35:11.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:11.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:35:11.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:11 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:12.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:11 smithi086 ceph-mon[71303]: Upgrade: Setting container_image for all rgw 2024-08-19T01:35:12.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:11 smithi086 ceph-mon[71303]: Upgrade: Setting container_image for all rbd-mirror 2024-08-19T01:35:12.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:12.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi017", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:35:12.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:11 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:13.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:12 smithi017 ceph-mon[99370]: Upgrade: Updating ceph-exporter.smithi017 (1/2) 2024-08-19T01:35:13.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:12 smithi017 ceph-mon[99370]: Deploying daemon ceph-exporter.smithi017 on smithi017 2024-08-19T01:35:13.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:12 smithi017 ceph-mon[99370]: pgmap v1095: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 9.6 MiB/s rd, 4 op/s 2024-08-19T01:35:13.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:12 smithi086 ceph-mon[71303]: Upgrade: Updating ceph-exporter.smithi017 (1/2) 2024-08-19T01:35:13.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:12 smithi086 ceph-mon[71303]: Deploying daemon ceph-exporter.smithi017 on smithi017 2024-08-19T01:35:13.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:12 smithi086 ceph-mon[71303]: pgmap v1095: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 9.6 MiB/s rd, 4 op/s 2024-08-19T01:35:13.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.910+0000 7fc75364e640 1 -- 172.21.15.17:0/3352528140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc74c0fe2d0 msgr2=0x7fc74c0fe6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:13.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.911+0000 7fc75364e640 1 --2- 172.21.15.17:0/3352528140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc74c0fe2d0 0x7fc74c0fe6b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc748009880 tx=0x7fc74802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:35:13.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.911+0000 7fc75364e640 1 -- 172.21.15.17:0/3352528140 shutdown_connections 2024-08-19T01:35:13.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.911+0000 7fc75364e640 1 --2- 172.21.15.17:0/3352528140 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc74c0fec80 0x7fc74c1047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:13.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.911+0000 7fc75364e640 1 --2- 172.21.15.17:0/3352528140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc74c0fe2d0 0x7fc74c0fe6b0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:13.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.911+0000 7fc75364e640 1 -- 172.21.15.17:0/3352528140 >> 172.21.15.17:0/3352528140 conn(0x7fc74c0f9e40 msgr2=0x7fc74c0fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:13.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.911+0000 7fc75364e640 1 -- 172.21.15.17:0/3352528140 shutdown_connections 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.911+0000 7fc75364e640 1 -- 172.21.15.17:0/3352528140 wait complete. 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.912+0000 7fc75364e640 1 Processor -- start 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.912+0000 7fc75364e640 1 -- start start 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.912+0000 7fc75364e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc74c0fe2d0 0x7fc74c0ff250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.912+0000 7fc75364e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc74c0fec80 0x7fc74c0ff790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.912+0000 7fc75364e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0ffcd0 con 0x7fc74c0fe2d0 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.912+0000 7fc75364e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74c0ffe40 con 0x7fc74c0fec80 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.913+0000 7fc7513ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc74c0fe2d0 0x7fc74c0ff250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.913+0000 7fc7513ea640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc74c0fe2d0 0x7fc74c0ff250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37136/0 (socket says 172.21.15.17:37136) 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.913+0000 7fc7513ea640 1 -- 172.21.15.17:0/173853671 learned_addr learned my addr 172.21.15.17:0/173853671 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.913+0000 7fc750be9640 1 --2- 172.21.15.17:0/173853671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc74c0fec80 0x7fc74c0ff790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.913+0000 7fc7513ea640 1 -- 172.21.15.17:0/173853671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc74c0fec80 msgr2=0x7fc74c0ff790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:13.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.913+0000 7fc7513ea640 1 --2- 172.21.15.17:0/173853671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc74c0fec80 0x7fc74c0ff790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:13.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.913+0000 7fc7513ea640 1 -- 172.21.15.17:0/173853671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc748009560 con 0x7fc74c0fe2d0 2024-08-19T01:35:13.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.913+0000 7fc7513ea640 1 --2- 172.21.15.17:0/173853671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc74c0fe2d0 0x7fc74c0ff250 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc74802a9c0 tx=0x7fc7480055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:13.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.913+0000 7fc7427fc640 1 -- 172.21.15.17:0/173853671 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc748004aa0 con 0x7fc74c0fe2d0 2024-08-19T01:35:13.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.913+0000 7fc7427fc640 1 -- 172.21.15.17:0/173853671 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc748004c00 con 0x7fc74c0fe2d0 2024-08-19T01:35:13.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.913+0000 7fc75364e640 1 -- 172.21.15.17:0/173853671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74c1000c0 con 0x7fc74c0fe2d0 2024-08-19T01:35:13.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.914+0000 7fc75364e640 1 -- 172.21.15.17:0/173853671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74c1a1fb0 con 0x7fc74c0fe2d0 2024-08-19T01:35:13.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.914+0000 7fc7427fc640 1 -- 172.21.15.17:0/173853671 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc748003980 con 0x7fc74c0fe2d0 2024-08-19T01:35:13.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.915+0000 7fc75364e640 1 -- 172.21.15.17:0/173853671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74c0fe6b0 con 0x7fc74c0fe2d0 2024-08-19T01:35:13.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.915+0000 7fc7427fc640 1 -- 172.21.15.17:0/173853671 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc748003be0 con 0x7fc74c0fe2d0 2024-08-19T01:35:13.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.915+0000 7fc7427fc640 1 --2- 172.21.15.17:0/173853671 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 0x7fc738070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:13.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.916+0000 7fc7427fc640 1 -- 172.21.15.17:0/173853671 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fc7480af020 con 0x7fc74c0fe2d0 2024-08-19T01:35:13.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.916+0000 7fc750be9640 1 --2- 172.21.15.17:0/173853671 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 0x7fc738070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:13.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.916+0000 7fc750be9640 1 --2- 172.21.15.17:0/173853671 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 0x7fc738070630 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc73c005fd0 tx=0x7fc73c005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:13.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:13.920+0000 7fc7427fc640 1 -- 172.21.15.17:0/173853671 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fc748078380 con 0x7fc74c0fe2d0 2024-08-19T01:35:14.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.118+0000 7fc75364e640 1 -- 172.21.15.17:0/173853671 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc74c101430 con 0x7fc73806e170 2024-08-19T01:35:14.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.120+0000 7fc7427fc640 1 -- 172.21.15.17:0/173853671 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7fc74c101430 con 0x7fc73806e170 2024-08-19T01:35:14.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.123+0000 7fc75364e640 1 -- 172.21.15.17:0/173853671 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 msgr2=0x7fc738070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.123+0000 7fc75364e640 1 --2- 172.21.15.17:0/173853671 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 0x7fc738070630 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc73c005fd0 tx=0x7fc73c005850 comp rx=0 tx=0).stop 2024-08-19T01:35:14.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.123+0000 7fc75364e640 1 -- 172.21.15.17:0/173853671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc74c0fe2d0 msgr2=0x7fc74c0ff250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.123+0000 7fc75364e640 1 --2- 172.21.15.17:0/173853671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc74c0fe2d0 0x7fc74c0ff250 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fc74802a9c0 tx=0x7fc7480055a0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.123+0000 7fc75364e640 1 -- 172.21.15.17:0/173853671 shutdown_connections 2024-08-19T01:35:14.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.123+0000 7fc75364e640 1 --2- 172.21.15.17:0/173853671 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fc73806e170 0x7fc738070630 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.123+0000 7fc75364e640 1 --2- 172.21.15.17:0/173853671 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fc74c0fec80 0x7fc74c0ff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.123+0000 7fc75364e640 1 --2- 172.21.15.17:0/173853671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc74c0fe2d0 0x7fc74c0ff250 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.123+0000 7fc75364e640 1 -- 172.21.15.17:0/173853671 >> 172.21.15.17:0/173853671 conn(0x7fc74c0f9e40 msgr2=0x7fc74c101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:14.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.123+0000 7fc75364e640 1 -- 172.21.15.17:0/173853671 shutdown_connections 2024-08-19T01:35:14.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.123+0000 7fc75364e640 1 -- 172.21.15.17:0/173853671 wait complete. 2024-08-19T01:35:14.134 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:35:14.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.208+0000 7f5fc736e640 1 -- 172.21.15.17:0/3705289693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc0073200 msgr2=0x7f5fc010be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.208+0000 7f5fc736e640 1 --2- 172.21.15.17:0/3705289693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc0073200 0x7f5fc010be30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009880 tx=0x7f5fb002a530 comp rx=0 tx=0).stop 2024-08-19T01:35:14.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.208+0000 7f5fc736e640 1 -- 172.21.15.17:0/3705289693 shutdown_connections 2024-08-19T01:35:14.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.208+0000 7f5fc736e640 1 --2- 172.21.15.17:0/3705289693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc0073200 0x7f5fc010be30 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.208+0000 7f5fc736e640 1 --2- 172.21.15.17:0/3705289693 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc00728e0 0x7f5fc0072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.208+0000 7f5fc736e640 1 -- 172.21.15.17:0/3705289693 >> 172.21.15.17:0/3705289693 conn(0x7f5fc00fb830 msgr2=0x7f5fc00fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:14.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.208+0000 7f5fc736e640 1 -- 172.21.15.17:0/3705289693 shutdown_connections 2024-08-19T01:35:14.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.208+0000 7f5fc736e640 1 -- 172.21.15.17:0/3705289693 wait complete. 2024-08-19T01:35:14.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.208+0000 7f5fc736e640 1 Processor -- start 2024-08-19T01:35:14.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc736e640 1 -- start start 2024-08-19T01:35:14.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc736e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc00728e0 0x7f5fc0197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:14.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc736e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc0073200 0x7f5fc0198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:14.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc736e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc01988e0 con 0x7f5fc0073200 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc736e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc019c650 con 0x7f5fc00728e0 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc4909640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc0073200 0x7f5fc0198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc4909640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc0073200 0x7f5fc0198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37164/0 (socket says 172.21.15.17:37164) 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc4909640 1 -- 172.21.15.17:0/2754747924 learned_addr learned my addr 172.21.15.17:0/2754747924 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc510a640 1 --2- 172.21.15.17:0/2754747924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc00728e0 0x7f5fc0197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc4909640 1 -- 172.21.15.17:0/2754747924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc00728e0 msgr2=0x7f5fc0197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc4909640 1 --2- 172.21.15.17:0/2754747924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc00728e0 0x7f5fc0197d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.209+0000 7f5fc4909640 1 -- 172.21.15.17:0/2754747924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0009560 con 0x7f5fc0073200 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.210+0000 7f5fc4909640 1 --2- 172.21.15.17:0/2754747924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc0073200 0x7f5fc0198250 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f5fb002aa50 tx=0x7f5fb00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.210+0000 7f5fb67fc640 1 -- 172.21.15.17:0/2754747924 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fb0004aa0 con 0x7f5fc0073200 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.210+0000 7f5fb67fc640 1 -- 172.21.15.17:0/2754747924 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5fb0004c00 con 0x7f5fc0073200 2024-08-19T01:35:14.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.210+0000 7f5fc736e640 1 -- 172.21.15.17:0/2754747924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc019c8d0 con 0x7f5fc0073200 2024-08-19T01:35:14.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.210+0000 7f5fb67fc640 1 -- 172.21.15.17:0/2754747924 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fb0003980 con 0x7f5fc0073200 2024-08-19T01:35:14.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.210+0000 7f5fc736e640 1 -- 172.21.15.17:0/2754747924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc019cd00 con 0x7f5fc0073200 2024-08-19T01:35:14.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.211+0000 7f5fc736e640 1 -- 172.21.15.17:0/2754747924 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc0073f90 con 0x7f5fc0073200 2024-08-19T01:35:14.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.212+0000 7f5fb67fc640 1 -- 172.21.15.17:0/2754747924 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5fb002ad50 con 0x7f5fc0073200 2024-08-19T01:35:14.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.213+0000 7f5fb67fc640 1 --2- 172.21.15.17:0/2754747924 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fac06e170 0x7f5fac070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:14.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.213+0000 7f5fb67fc640 1 -- 172.21.15.17:0/2754747924 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5fb00aeed0 con 0x7f5fc0073200 2024-08-19T01:35:14.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.213+0000 7f5fc510a640 1 --2- 172.21.15.17:0/2754747924 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fac06e170 0x7f5fac070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:14.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.213+0000 7f5fc510a640 1 --2- 172.21.15.17:0/2754747924 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fac06e170 0x7f5fac070630 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc005d00 tx=0x7f5fbc00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:14.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.221+0000 7f5fb67fc640 1 -- 172.21.15.17:0/2754747924 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f5fb0078260 con 0x7f5fc0073200 2024-08-19T01:35:14.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.522+0000 7f5fc736e640 1 -- 172.21.15.17:0/2754747924 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fc0106630 con 0x7f5fac06e170 2024-08-19T01:35:14.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.523+0000 7f5fb67fc640 1 -- 172.21.15.17:0/2754747924 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f5fc0106630 con 0x7f5fac06e170 2024-08-19T01:35:14.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.525+0000 7f5fc736e640 1 -- 172.21.15.17:0/2754747924 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fac06e170 msgr2=0x7f5fac070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.525+0000 7f5fc736e640 1 --2- 172.21.15.17:0/2754747924 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fac06e170 0x7f5fac070630 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc005d00 tx=0x7f5fbc00b410 comp rx=0 tx=0).stop 2024-08-19T01:35:14.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.525+0000 7f5fc736e640 1 -- 172.21.15.17:0/2754747924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc0073200 msgr2=0x7f5fc0198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.525+0000 7f5fc736e640 1 --2- 172.21.15.17:0/2754747924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc0073200 0x7f5fc0198250 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f5fb002aa50 tx=0x7f5fb00055a0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.525+0000 7f5fc736e640 1 -- 172.21.15.17:0/2754747924 shutdown_connections 2024-08-19T01:35:14.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.525+0000 7f5fc736e640 1 --2- 172.21.15.17:0/2754747924 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f5fac06e170 0x7f5fac070630 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.525+0000 7f5fc736e640 1 --2- 172.21.15.17:0/2754747924 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fc0073200 0x7f5fc0198250 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.525+0000 7f5fc736e640 1 --2- 172.21.15.17:0/2754747924 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5fc00728e0 0x7f5fc0197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.525+0000 7f5fc736e640 1 -- 172.21.15.17:0/2754747924 >> 172.21.15.17:0/2754747924 conn(0x7f5fc00fb830 msgr2=0x7f5fc0104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:14.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.525+0000 7f5fc736e640 1 -- 172.21.15.17:0/2754747924 shutdown_connections 2024-08-19T01:35:14.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.525+0000 7f5fc736e640 1 -- 172.21.15.17:0/2754747924 wait complete. 2024-08-19T01:35:14.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.612+0000 7faf8e170640 1 -- 172.21.15.17:0/1700554182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf881049f0 msgr2=0x7faf88104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.612+0000 7faf8e170640 1 --2- 172.21.15.17:0/1700554182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf881049f0 0x7faf88104dd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7faf78009880 tx=0x7faf7802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.612+0000 7faf8e170640 1 -- 172.21.15.17:0/1700554182 shutdown_connections 2024-08-19T01:35:14.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.612+0000 7faf8e170640 1 --2- 172.21.15.17:0/1700554182 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf880fe9f0 0x7faf880fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.612+0000 7faf8e170640 1 --2- 172.21.15.17:0/1700554182 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf881049f0 0x7faf88104dd0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.612+0000 7faf8e170640 1 -- 172.21.15.17:0/1700554182 >> 172.21.15.17:0/1700554182 conn(0x7faf880758a0 msgr2=0x7faf880fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:14.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.612+0000 7faf8e170640 1 -- 172.21.15.17:0/1700554182 shutdown_connections 2024-08-19T01:35:14.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.612+0000 7faf8e170640 1 -- 172.21.15.17:0/1700554182 wait complete. 2024-08-19T01:35:14.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.613+0000 7faf8e170640 1 Processor -- start 2024-08-19T01:35:14.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.613+0000 7faf8e170640 1 -- start start 2024-08-19T01:35:14.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.613+0000 7faf8e170640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf880fe9f0 0x7faf880fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:14.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.613+0000 7faf8e170640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf881049f0 0x7faf880fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:14.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.613+0000 7faf8e170640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf880fb800 con 0x7faf880fe9f0 2024-08-19T01:35:14.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.613+0000 7faf8e170640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf880fb940 con 0x7faf881049f0 2024-08-19T01:35:14.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf880fe9f0 0x7faf880fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:14.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf877fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf880fe9f0 0x7faf880fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37182/0 (socket says 172.21.15.17:37182) 2024-08-19T01:35:14.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf877fe640 1 -- 172.21.15.17:0/1717500031 learned_addr learned my addr 172.21.15.17:0/1717500031 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf86ffd640 1 --2- 172.21.15.17:0/1717500031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf881049f0 0x7faf880fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf877fe640 1 -- 172.21.15.17:0/1717500031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf881049f0 msgr2=0x7faf880fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf877fe640 1 --2- 172.21.15.17:0/1717500031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf881049f0 0x7faf880fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf877fe640 1 -- 172.21.15.17:0/1717500031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf78009560 con 0x7faf880fe9f0 2024-08-19T01:35:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf877fe640 1 --2- 172.21.15.17:0/1717500031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf880fe9f0 0x7faf880fad80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7faf7802a9c0 tx=0x7faf780055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf84ff9640 1 -- 172.21.15.17:0/1717500031 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf780048d0 con 0x7faf880fe9f0 2024-08-19T01:35:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf84ff9640 1 -- 172.21.15.17:0/1717500031 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf78031640 con 0x7faf880fe9f0 2024-08-19T01:35:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf8e170640 1 -- 172.21.15.17:0/1717500031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf880fbbc0 con 0x7faf880fe9f0 2024-08-19T01:35:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.614+0000 7faf84ff9640 1 -- 172.21.15.17:0/1717500031 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf780038d0 con 0x7faf880fe9f0 2024-08-19T01:35:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.615+0000 7faf8e170640 1 -- 172.21.15.17:0/1717500031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf881a2040 con 0x7faf880fe9f0 2024-08-19T01:35:14.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.616+0000 7faf8e170640 1 -- 172.21.15.17:0/1717500031 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf88100130 con 0x7faf880fe9f0 2024-08-19T01:35:14.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.616+0000 7faf84ff9640 1 -- 172.21.15.17:0/1717500031 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7faf78004a30 con 0x7faf880fe9f0 2024-08-19T01:35:14.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.617+0000 7faf84ff9640 1 --2- 172.21.15.17:0/1717500031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faf7006e170 0x7faf70070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:14.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.617+0000 7faf84ff9640 1 -- 172.21.15.17:0/1717500031 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7faf780aef90 con 0x7faf880fe9f0 2024-08-19T01:35:14.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.617+0000 7faf86ffd640 1 --2- 172.21.15.17:0/1717500031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faf7006e170 0x7faf70070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:14.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.618+0000 7faf86ffd640 1 --2- 172.21.15.17:0/1717500031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faf7006e170 0x7faf70070630 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf880fc880 tx=0x7faf7c005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:14.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.622+0000 7faf84ff9640 1 -- 172.21.15.17:0/1717500031 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7faf780783a0 con 0x7faf880fe9f0 2024-08-19T01:35:14.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.811+0000 7faf8e170640 1 -- 172.21.15.17:0/1717500031 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf8810bc80 con 0x7faf7006e170 2024-08-19T01:35:14.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.823+0000 7faf84ff9640 1 -- 172.21.15.17:0/1717500031 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7faf8810bc80 con 0x7faf7006e170 2024-08-19T01:35:14.825 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:35:14.825 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (36m) 15m ago 47m 25.5M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:35:14.825 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (47m) 15m ago 47m 10.4M - 18.2.4-721-gbaa926de e6c292a6bc95 2935a1b41c5b 2024-08-19T01:35:14.825 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (46m) 15m ago 46m 10.0M - 18.2.4-721-gbaa926de e6c292a6bc95 302b94198925 2024-08-19T01:35:14.825 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (34m) 15m ago 47m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (34m) 15m ago 46m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (36m) 15m ago 46m 78.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (30m) 15m ago 41m 20.4M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (30m) 15m ago 41m 20.6M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (15m) 15m ago 41m 12.8M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (30m) 15m ago 41m 21.7M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (38m) 15m ago 48m 508M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (37m) 15m ago 46m 448M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (35m) 15m ago 48m 71.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (34m) 15m ago 46m 53.4M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (37m) 15m ago 47m 15.8M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:35:14.826 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (37m) 15m ago 46m 15.8M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:35:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (33m) 15m ago 45m 93.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:35:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (33m) 15m ago 44m 94.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:35:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (32m) 15m ago 44m 84.3M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:35:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (32m) 15m ago 44m 95.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:35:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (31m) 15m ago 43m 89.6M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:35:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (31m) 15m ago 43m 88.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:35:14.827 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (36m) 15m ago 46m 82.4M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:35:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.825+0000 7faf8e170640 1 -- 172.21.15.17:0/1717500031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faf7006e170 msgr2=0x7faf70070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.825+0000 7faf8e170640 1 --2- 172.21.15.17:0/1717500031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faf7006e170 0x7faf70070630 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf880fc880 tx=0x7faf7c005f90 comp rx=0 tx=0).stop 2024-08-19T01:35:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.825+0000 7faf8e170640 1 -- 172.21.15.17:0/1717500031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf880fe9f0 msgr2=0x7faf880fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.825+0000 7faf8e170640 1 --2- 172.21.15.17:0/1717500031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf880fe9f0 0x7faf880fad80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7faf7802a9c0 tx=0x7faf780055a0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.826+0000 7faf8e170640 1 -- 172.21.15.17:0/1717500031 shutdown_connections 2024-08-19T01:35:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.826+0000 7faf8e170640 1 --2- 172.21.15.17:0/1717500031 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faf7006e170 0x7faf70070630 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.826+0000 7faf8e170640 1 --2- 172.21.15.17:0/1717500031 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faf881049f0 0x7faf880fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.826+0000 7faf8e170640 1 --2- 172.21.15.17:0/1717500031 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf880fe9f0 0x7faf880fad80 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.826+0000 7faf8e170640 1 -- 172.21.15.17:0/1717500031 >> 172.21.15.17:0/1717500031 conn(0x7faf880758a0 msgr2=0x7faf880fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.826+0000 7faf8e170640 1 -- 172.21.15.17:0/1717500031 shutdown_connections 2024-08-19T01:35:14.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.826+0000 7faf8e170640 1 -- 172.21.15.17:0/1717500031 wait complete. 2024-08-19T01:35:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.913+0000 7fb9e2a28640 1 -- 172.21.15.17:0/2072326642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc1015d0 msgr2=0x7fb9dc109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.913+0000 7fb9e2a28640 1 --2- 172.21.15.17:0/2072326642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc1015d0 0x7fb9dc109ac0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009880 tx=0x7fb9d002a530 comp rx=0 tx=0).stop 2024-08-19T01:35:14.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.913+0000 7fb9e2a28640 1 -- 172.21.15.17:0/2072326642 shutdown_connections 2024-08-19T01:35:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.913+0000 7fb9e2a28640 1 --2- 172.21.15.17:0/2072326642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc1015d0 0x7fb9dc109ac0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.913+0000 7fb9e2a28640 1 --2- 172.21.15.17:0/2072326642 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9dc100cb0 0x7fb9dc101090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.913+0000 7fb9e2a28640 1 -- 172.21.15.17:0/2072326642 >> 172.21.15.17:0/2072326642 conn(0x7fb9dc0fa730 msgr2=0x7fb9dc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.913+0000 7fb9e2a28640 1 -- 172.21.15.17:0/2072326642 shutdown_connections 2024-08-19T01:35:14.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.913+0000 7fb9e2a28640 1 -- 172.21.15.17:0/2072326642 wait complete. 2024-08-19T01:35:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.914+0000 7fb9e2a28640 1 Processor -- start 2024-08-19T01:35:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.914+0000 7fb9e2a28640 1 -- start start 2024-08-19T01:35:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.914+0000 7fb9e2a28640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9dc100cb0 0x7fb9dc19b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.914+0000 7fb9e2a28640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc1015d0 0x7fb9dc19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.915+0000 7fb9e2a28640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc19c3b0 con 0x7fb9dc1015d0 2024-08-19T01:35:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.915+0000 7fb9e2a28640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc195940 con 0x7fb9dc100cb0 2024-08-19T01:35:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.915+0000 7fb9db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc1015d0 0x7fb9dc19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.915+0000 7fb9db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc1015d0 0x7fb9dc19bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37196/0 (socket says 172.21.15.17:37196) 2024-08-19T01:35:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.915+0000 7fb9db7fe640 1 -- 172.21.15.17:0/1524934021 learned_addr learned my addr 172.21.15.17:0/1524934021 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:14.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.915+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/1524934021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9dc100cb0 0x7fb9dc19b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:14.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.915+0000 7fb9dbfff640 1 -- 172.21.15.17:0/1524934021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc1015d0 msgr2=0x7fb9dc19bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:14.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.915+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/1524934021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc1015d0 0x7fb9dc19bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:14.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.915+0000 7fb9dbfff640 1 -- 172.21.15.17:0/1524934021 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d0009560 con 0x7fb9dc100cb0 2024-08-19T01:35:14.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.915+0000 7fb9dbfff640 1 --2- 172.21.15.17:0/1524934021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9dc100cb0 0x7fb9dc19b850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00e970 tx=0x7fb9cc00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:14.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.916+0000 7fb9d97fa640 1 -- 172.21.15.17:0/1524934021 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9cc009640 con 0x7fb9dc100cb0 2024-08-19T01:35:14.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.916+0000 7fb9e2a28640 1 -- 172.21.15.17:0/1524934021 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc195c20 con 0x7fb9dc100cb0 2024-08-19T01:35:14.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.916+0000 7fb9d97fa640 1 -- 172.21.15.17:0/1524934021 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9cc00cc90 con 0x7fb9dc100cb0 2024-08-19T01:35:14.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.916+0000 7fb9d97fa640 1 -- 172.21.15.17:0/1524934021 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9cc018810 con 0x7fb9dc100cb0 2024-08-19T01:35:14.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.916+0000 7fb9e2a28640 1 -- 172.21.15.17:0/1524934021 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc196170 con 0x7fb9dc100cb0 2024-08-19T01:35:14.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.917+0000 7fb9e2a28640 1 -- 172.21.15.17:0/1524934021 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c8005250 con 0x7fb9dc100cb0 2024-08-19T01:35:14.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.918+0000 7fb9d97fa640 1 -- 172.21.15.17:0/1524934021 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb9cc010430 con 0x7fb9dc100cb0 2024-08-19T01:35:14.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.919+0000 7fb9d97fa640 1 --2- 172.21.15.17:0/1524934021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb9c406e170 0x7fb9c4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:14.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.919+0000 7fb9d97fa640 1 -- 172.21.15.17:0/1524934021 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb9cc014070 con 0x7fb9dc100cb0 2024-08-19T01:35:14.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.919+0000 7fb9db7fe640 1 --2- 172.21.15.17:0/1524934021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb9c406e170 0x7fb9c4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:14.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.919+0000 7fb9db7fe640 1 --2- 172.21.15.17:0/1524934021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb9c406e170 0x7fb9c4070630 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc196db0 tx=0x7fb9d0005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:14.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:14.923+0000 7fb9d97fa640 1 -- 172.21.15.17:0/1524934021 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb9cc053df0 con 0x7fb9dc100cb0 2024-08-19T01:35:15.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.304+0000 7fb9e2a28640 1 -- 172.21.15.17:0/1524934021 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb9c8005d10 con 0x7fb9dc100cb0 2024-08-19T01:35:15.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.305+0000 7fb9d97fa640 1 -- 172.21.15.17:0/1524934021 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fb9cc05b2f0 con 0x7fb9dc100cb0 2024-08-19T01:35:15.308 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:35:15.308 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:35:15.309 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:35:15.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:35:15.310 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:35:15.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.308+0000 7fb9e2a28640 1 -- 172.21.15.17:0/1524934021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb9c406e170 msgr2=0x7fb9c4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.308+0000 7fb9e2a28640 1 --2- 172.21.15.17:0/1524934021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb9c406e170 0x7fb9c4070630 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc196db0 tx=0x7fb9d0005a20 comp rx=0 tx=0).stop 2024-08-19T01:35:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.308+0000 7fb9e2a28640 1 -- 172.21.15.17:0/1524934021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9dc100cb0 msgr2=0x7fb9dc19b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.308+0000 7fb9e2a28640 1 --2- 172.21.15.17:0/1524934021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9dc100cb0 0x7fb9dc19b850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00e970 tx=0x7fb9cc00ee30 comp rx=0 tx=0).stop 2024-08-19T01:35:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.308+0000 7fb9e2a28640 1 -- 172.21.15.17:0/1524934021 shutdown_connections 2024-08-19T01:35:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.308+0000 7fb9e2a28640 1 --2- 172.21.15.17:0/1524934021 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb9c406e170 0x7fb9c4070630 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.308+0000 7fb9e2a28640 1 --2- 172.21.15.17:0/1524934021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9dc1015d0 0x7fb9dc19bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.308+0000 7fb9e2a28640 1 --2- 172.21.15.17:0/1524934021 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb9dc100cb0 0x7fb9dc19b850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.308+0000 7fb9e2a28640 1 -- 172.21.15.17:0/1524934021 >> 172.21.15.17:0/1524934021 conn(0x7fb9dc0fa730 msgr2=0x7fb9dc101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.308+0000 7fb9e2a28640 1 -- 172.21.15.17:0/1524934021 shutdown_connections 2024-08-19T01:35:15.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.308+0000 7fb9e2a28640 1 -- 172.21.15.17:0/1524934021 wait complete. 2024-08-19T01:35:15.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.395+0000 7f69a7224640 1 -- 172.21.15.17:0/320532264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00728e0 msgr2=0x7f69a0072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:15.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.395+0000 7f69a7224640 1 --2- 172.21.15.17:0/320532264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00728e0 0x7f69a0072cc0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6994009880 tx=0x7f699402a530 comp rx=0 tx=0).stop 2024-08-19T01:35:15.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.395+0000 7f69a7224640 1 -- 172.21.15.17:0/320532264 shutdown_connections 2024-08-19T01:35:15.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.395+0000 7f69a7224640 1 --2- 172.21.15.17:0/320532264 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69a0073200 0x7f69a010be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.395+0000 7f69a7224640 1 --2- 172.21.15.17:0/320532264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a00728e0 0x7f69a0072cc0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.395+0000 7f69a7224640 1 -- 172.21.15.17:0/320532264 >> 172.21.15.17:0/320532264 conn(0x7f69a00fb7e0 msgr2=0x7f69a00fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:15.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:15 smithi017 ceph-mon[99370]: pgmap v1096: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 5 op/s 2024-08-19T01:35:15.398 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:15 smithi017 ceph-mon[99370]: from='client.35998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:15.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.395+0000 7f69a7224640 1 -- 172.21.15.17:0/320532264 shutdown_connections 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.395+0000 7f69a7224640 1 -- 172.21.15.17:0/320532264 wait complete. 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.396+0000 7f69a7224640 1 Processor -- start 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.396+0000 7f69a7224640 1 -- start start 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.396+0000 7f69a7224640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69a00728e0 0x7f69a0197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.396+0000 7f69a7224640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a0073200 0x7f69a01982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.396+0000 7f69a7224640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a0198960 con 0x7f69a0073200 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.396+0000 7f69a7224640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a019c6d0 con 0x7f69a00728e0 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.396+0000 7f699ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a0073200 0x7f69a01982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.396+0000 7f699ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a0073200 0x7f69a01982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37200/0 (socket says 172.21.15.17:37200) 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.396+0000 7f699ffff640 1 -- 172.21.15.17:0/1861383030 learned_addr learned my addr 172.21.15.17:0/1861383030 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.396+0000 7f69a4fc0640 1 --2- 172.21.15.17:0/1861383030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69a00728e0 0x7f69a0197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:15.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.397+0000 7f699ffff640 1 -- 172.21.15.17:0/1861383030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69a00728e0 msgr2=0x7f69a0197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:15.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.397+0000 7f699ffff640 1 --2- 172.21.15.17:0/1861383030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69a00728e0 0x7f69a0197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.397+0000 7f699ffff640 1 -- 172.21.15.17:0/1861383030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6994009560 con 0x7f69a0073200 2024-08-19T01:35:15.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.397+0000 7f699ffff640 1 --2- 172.21.15.17:0/1861383030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a0073200 0x7f69a01982d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f698c00d8d0 tx=0x7f698c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:15.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.397+0000 7f699dffb640 1 -- 172.21.15.17:0/1861383030 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f698c009c00 con 0x7f69a0073200 2024-08-19T01:35:15.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.397+0000 7f699dffb640 1 -- 172.21.15.17:0/1861383030 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f698c009d60 con 0x7f69a0073200 2024-08-19T01:35:15.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.397+0000 7f69a7224640 1 -- 172.21.15.17:0/1861383030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a019c9b0 con 0x7f69a0073200 2024-08-19T01:35:15.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.397+0000 7f69a7224640 1 -- 172.21.15.17:0/1861383030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a019cf00 con 0x7f69a0073200 2024-08-19T01:35:15.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.398+0000 7f699dffb640 1 -- 172.21.15.17:0/1861383030 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f698c0049d0 con 0x7f69a0073200 2024-08-19T01:35:15.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.399+0000 7f69a7224640 1 -- 172.21.15.17:0/1861383030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6984005250 con 0x7f69a0073200 2024-08-19T01:35:15.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.399+0000 7f699dffb640 1 -- 172.21.15.17:0/1861383030 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f698c004c90 con 0x7f69a0073200 2024-08-19T01:35:15.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.400+0000 7f699dffb640 1 --2- 172.21.15.17:0/1861383030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f699006e170 0x7f6990070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:15.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.400+0000 7f699dffb640 1 -- 172.21.15.17:0/1861383030 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f698c08dd00 con 0x7f69a0073200 2024-08-19T01:35:15.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.400+0000 7f69a4fc0640 1 --2- 172.21.15.17:0/1861383030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f699006e170 0x7f6990070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:15.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.400+0000 7f69a4fc0640 1 --2- 172.21.15.17:0/1861383030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f699006e170 0x7f6990070630 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6994009230 tx=0x7f69940058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:15.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.404+0000 7f699dffb640 1 -- 172.21.15.17:0/1861383030 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f698c091030 con 0x7f69a0073200 2024-08-19T01:35:15.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:15 smithi086 ceph-mon[71303]: pgmap v1096: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 5 op/s 2024-08-19T01:35:15.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:15 smithi086 ceph-mon[71303]: from='client.35998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:15.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.624+0000 7f69a7224640 1 -- 172.21.15.17:0/1861383030 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6984005d10 con 0x7f69a0073200 2024-08-19T01:35:15.627 INFO:teuthology.orchestra.run.smithi017.stdout:e35 2024-08-19T01:35:15.627 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:35:10:226101+0000 2024-08-19T01:35:15.627 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:35:15.627 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:35:15.627 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:35:15.627 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:35:15.627 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 35 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:35:09.236370+0000 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:35:15.628 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=34388,1=34420} 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:35:15.629 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:35:15.630 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:35:15.630 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:35:15.630 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 0 members: 2024-08-19T01:35:15.630 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:34388} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:35:15.630 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{1:34420} state up:resolve seq 458 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:35:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:35:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:35:15.630 INFO:teuthology.orchestra.run.smithi017.stdout:Standby daemons: 2024-08-19T01:35:15.630 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:35:15.630 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{-1:44345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:35:15.630 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{-1:44907} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:35:15.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.624+0000 7f699dffb640 1 -- 172.21.15.17:0/1861383030 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1993 (secure 0 0 0) 0x7f698c0177e0 con 0x7f69a0073200 2024-08-19T01:35:15.631 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2024-08-19T01:35:15.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.626+0000 7f69a7224640 1 -- 172.21.15.17:0/1861383030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f699006e170 msgr2=0x7f6990070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:15.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.626+0000 7f69a7224640 1 --2- 172.21.15.17:0/1861383030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f699006e170 0x7f6990070630 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6994009230 tx=0x7f69940058d0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.626+0000 7f69a7224640 1 -- 172.21.15.17:0/1861383030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a0073200 msgr2=0x7f69a01982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:15.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.626+0000 7f69a7224640 1 --2- 172.21.15.17:0/1861383030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a0073200 0x7f69a01982d0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f698c00d8d0 tx=0x7f698c00dd90 comp rx=0 tx=0).stop 2024-08-19T01:35:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.626+0000 7f69a7224640 1 -- 172.21.15.17:0/1861383030 shutdown_connections 2024-08-19T01:35:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.626+0000 7f69a7224640 1 --2- 172.21.15.17:0/1861383030 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f699006e170 0x7f6990070630 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.626+0000 7f69a7224640 1 --2- 172.21.15.17:0/1861383030 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69a0073200 0x7f69a01982d0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.626+0000 7f69a7224640 1 --2- 172.21.15.17:0/1861383030 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f69a00728e0 0x7f69a0197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.626+0000 7f69a7224640 1 -- 172.21.15.17:0/1861383030 >> 172.21.15.17:0/1861383030 conn(0x7f69a00fb7e0 msgr2=0x7f69a0104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.626+0000 7f69a7224640 1 -- 172.21.15.17:0/1861383030 shutdown_connections 2024-08-19T01:35:15.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.626+0000 7f69a7224640 1 -- 172.21.15.17:0/1861383030 wait complete. 2024-08-19T01:35:15.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.724+0000 7f95a38e2640 1 -- 172.21.15.17:0/2596732441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f959c0ffb40 msgr2=0x7f959c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:15.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.724+0000 7f95a38e2640 1 --2- 172.21.15.17:0/2596732441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f959c0ffb40 0x7f959c0fffa0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f958c009880 tx=0x7f958c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.724+0000 7f95a38e2640 1 -- 172.21.15.17:0/2596732441 shutdown_connections 2024-08-19T01:35:15.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.724+0000 7f95a38e2640 1 --2- 172.21.15.17:0/2596732441 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f959c0ffb40 0x7f959c0fffa0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.724+0000 7f95a38e2640 1 --2- 172.21.15.17:0/2596732441 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c105bf0 0x7f959c105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.724+0000 7f95a38e2640 1 -- 172.21.15.17:0/2596732441 >> 172.21.15.17:0/2596732441 conn(0x7f959c0fb7e0 msgr2=0x7f959c0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:15.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.724+0000 7f95a38e2640 1 -- 172.21.15.17:0/2596732441 shutdown_connections 2024-08-19T01:35:15.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.724+0000 7f95a38e2640 1 -- 172.21.15.17:0/2596732441 wait complete. 2024-08-19T01:35:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.725+0000 7f95a38e2640 1 Processor -- start 2024-08-19T01:35:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.725+0000 7f95a38e2640 1 -- start start 2024-08-19T01:35:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.725+0000 7f95a38e2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f959c0ffb40 0x7f959c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.725+0000 7f95a38e2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c105bf0 0x7f959c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.725+0000 7f95a38e2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c074780 con 0x7f959c0ffb40 2024-08-19T01:35:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.725+0000 7f95a38e2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c073230 con 0x7f959c105bf0 2024-08-19T01:35:15.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.725+0000 7f95a167e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f959c0ffb40 0x7f959c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.726+0000 7f95a167e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f959c0ffb40 0x7f959c0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37228/0 (socket says 172.21.15.17:37228) 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.726+0000 7f95a167e640 1 -- 172.21.15.17:0/386647762 learned_addr learned my addr 172.21.15.17:0/386647762 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.726+0000 7f95a0e7d640 1 --2- 172.21.15.17:0/386647762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c105bf0 0x7f959c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.726+0000 7f95a167e640 1 -- 172.21.15.17:0/386647762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c105bf0 msgr2=0x7f959c072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.726+0000 7f95a167e640 1 --2- 172.21.15.17:0/386647762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c105bf0 0x7f959c072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.726+0000 7f95a167e640 1 -- 172.21.15.17:0/386647762 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c009560 con 0x7f959c0ffb40 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.726+0000 7f95a167e640 1 --2- 172.21.15.17:0/386647762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f959c0ffb40 0x7f959c0727b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f959800c8a0 tx=0x7f959800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.726+0000 7f95927fc640 1 -- 172.21.15.17:0/386647762 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9598007b80 con 0x7f959c0ffb40 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.726+0000 7f95927fc640 1 -- 172.21.15.17:0/386647762 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9598007ce0 con 0x7f959c0ffb40 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.726+0000 7f95a38e2640 1 -- 172.21.15.17:0/386647762 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c073510 con 0x7f959c0ffb40 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.726+0000 7f95927fc640 1 -- 172.21.15.17:0/386647762 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95980187b0 con 0x7f959c0ffb40 2024-08-19T01:35:15.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.727+0000 7f95a38e2640 1 -- 172.21.15.17:0/386647762 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c1a1e60 con 0x7f959c0ffb40 2024-08-19T01:35:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.728+0000 7f95a38e2640 1 -- 172.21.15.17:0/386647762 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c1011f0 con 0x7f959c0ffb40 2024-08-19T01:35:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.728+0000 7f95927fc640 1 -- 172.21.15.17:0/386647762 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f959800f450 con 0x7f959c0ffb40 2024-08-19T01:35:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.729+0000 7f95927fc640 1 --2- 172.21.15.17:0/386647762 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f958806e1c0 0x7f9588070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.729+0000 7f95927fc640 1 -- 172.21.15.17:0/386647762 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f959808e350 con 0x7f959c0ffb40 2024-08-19T01:35:15.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.729+0000 7f95a0e7d640 1 --2- 172.21.15.17:0/386647762 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f958806e1c0 0x7f9588070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:15.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.730+0000 7f95a0e7d640 1 --2- 172.21.15.17:0/386647762 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f958806e1c0 0x7f9588070680 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f958c009230 tx=0x7f958c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:15.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.737+0000 7f95927fc640 1 -- 172.21.15.17:0/386647762 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9598057590 con 0x7f959c0ffb40 2024-08-19T01:35:15.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.946+0000 7f95a38e2640 1 -- 172.21.15.17:0/386647762 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f959c073dc0 con 0x7f958806e1c0 2024-08-19T01:35:15.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.948+0000 7f95927fc640 1 -- 172.21.15.17:0/386647762 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f959c073dc0 con 0x7f958806e1c0 2024-08-19T01:35:15.950 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:35:15.950 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9", 2024-08-19T01:35:15.950 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": true, 2024-08-19T01:35:15.950 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "Upgrading all daemon types on all hosts", 2024-08-19T01:35:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [ 2024-08-19T01:35:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "osd", 2024-08-19T01:35:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr", 2024-08-19T01:35:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "mon", 2024-08-19T01:35:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "mds", 2024-08-19T01:35:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "crash" 2024-08-19T01:35:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: ], 2024-08-19T01:35:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": "16/23 daemons upgraded", 2024-08-19T01:35:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-08-19T01:35:15.951 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:35:15.951 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:35:15.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.951+0000 7f95a38e2640 1 -- 172.21.15.17:0/386647762 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f958806e1c0 msgr2=0x7f9588070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:15.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.951+0000 7f95a38e2640 1 --2- 172.21.15.17:0/386647762 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f958806e1c0 0x7f9588070680 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f958c009230 tx=0x7f958c005a20 comp rx=0 tx=0).stop 2024-08-19T01:35:15.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.951+0000 7f95a38e2640 1 -- 172.21.15.17:0/386647762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f959c0ffb40 msgr2=0x7f959c0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:15.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.951+0000 7f95a38e2640 1 --2- 172.21.15.17:0/386647762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f959c0ffb40 0x7f959c0727b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f959800c8a0 tx=0x7f959800cd60 comp rx=0 tx=0).stop 2024-08-19T01:35:15.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.951+0000 7f95a38e2640 1 -- 172.21.15.17:0/386647762 shutdown_connections 2024-08-19T01:35:15.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.951+0000 7f95a38e2640 1 --2- 172.21.15.17:0/386647762 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f958806e1c0 0x7f9588070680 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.951+0000 7f95a38e2640 1 --2- 172.21.15.17:0/386647762 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f959c105bf0 0x7f959c072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.951+0000 7f95a38e2640 1 --2- 172.21.15.17:0/386647762 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f959c0ffb40 0x7f959c0727b0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:15.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.951+0000 7f95a38e2640 1 -- 172.21.15.17:0/386647762 >> 172.21.15.17:0/386647762 conn(0x7f959c0fb7e0 msgr2=0x7f959c0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:15.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.951+0000 7f95a38e2640 1 -- 172.21.15.17:0/386647762 shutdown_connections 2024-08-19T01:35:15.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:15.951+0000 7f95a38e2640 1 -- 172.21.15.17:0/386647762 wait complete. 2024-08-19T01:35:16.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.035+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/2569029886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f9c101690 msgr2=0x7f9f9c109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.035+0000 7f9fa0fa6640 1 --2- 172.21.15.17:0/2569029886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f9c101690 0x7f9f9c109b80 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009880 tx=0x7f9f9002a530 comp rx=0 tx=0).stop 2024-08-19T01:35:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.035+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/2569029886 shutdown_connections 2024-08-19T01:35:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.035+0000 7f9fa0fa6640 1 --2- 172.21.15.17:0/2569029886 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f9c101690 0x7f9f9c109b80 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.035+0000 7f9fa0fa6640 1 --2- 172.21.15.17:0/2569029886 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f9c100d70 0x7f9f9c101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.035+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/2569029886 >> 172.21.15.17:0/2569029886 conn(0x7f9f9c0fa710 msgr2=0x7f9f9c0fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.035+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/2569029886 shutdown_connections 2024-08-19T01:35:16.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.035+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/2569029886 wait complete. 2024-08-19T01:35:16.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.036+0000 7f9fa0fa6640 1 Processor -- start 2024-08-19T01:35:16.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.036+0000 7f9fa0fa6640 1 -- start start 2024-08-19T01:35:16.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9fa0fa6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f9c100d70 0x7f9f9c0fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:16.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9fa0fa6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f9c101690 0x7f9f9c0fef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9fa0fa6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0ff450 con 0x7f9f9c101690 2024-08-19T01:35:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9fa0fa6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c0ff5c0 con 0x7f9f9c100d70 2024-08-19T01:35:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9f99d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f9c101690 0x7f9f9c0fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9f9a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f9c100d70 0x7f9f9c0fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9f99d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f9c101690 0x7f9f9c0fef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:37246/0 (socket says 172.21.15.17:37246) 2024-08-19T01:35:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9f99d9b640 1 -- 172.21.15.17:0/3543378790 learned_addr learned my addr 172.21.15.17:0/3543378790 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9f9a59c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f9c100d70 0x7f9f9c0fe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.86:3300/0 says I am v2:172.21.15.17:39410/0 (socket says 172.21.15.17:39410) 2024-08-19T01:35:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9f9a59c640 1 -- 172.21.15.17:0/3543378790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f9c101690 msgr2=0x7f9f9c0fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9f9a59c640 1 --2- 172.21.15.17:0/3543378790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f9c101690 0x7f9f9c0fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9f9a59c640 1 -- 172.21.15.17:0/3543378790 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f90009560 con 0x7f9f9c100d70 2024-08-19T01:35:16.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.037+0000 7f9f9a59c640 1 --2- 172.21.15.17:0/3543378790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f9c100d70 0x7f9f9c0fe9d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00e970 tx=0x7f9f8c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.038+0000 7f9f8b7fe640 1 -- 172.21.15.17:0/3543378790 <== mon.1 v2:172.21.15.86:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f8c009620 con 0x7f9f9c100d70 2024-08-19T01:35:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.038+0000 7f9f8b7fe640 1 -- 172.21.15.17:0/3543378790 <== mon.1 v2:172.21.15.86:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9f8c0044f0 con 0x7f9f9c100d70 2024-08-19T01:35:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.038+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/3543378790 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c1a1c80 con 0x7f9f9c100d70 2024-08-19T01:35:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.038+0000 7f9f8b7fe640 1 -- 172.21.15.17:0/3543378790 <== mon.1 v2:172.21.15.86:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f8c0049d0 con 0x7f9f9c100d70 2024-08-19T01:35:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.038+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/3543378790 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c1a1fe0 con 0x7f9f9c100d70 2024-08-19T01:35:16.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.039+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/3543378790 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c068cb0 con 0x7f9f9c100d70 2024-08-19T01:35:16.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.039+0000 7f9f8b7fe640 1 -- 172.21.15.17:0/3543378790 <== mon.1 v2:172.21.15.86:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9f8c00cc90 con 0x7f9f9c100d70 2024-08-19T01:35:16.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.040+0000 7f9f8b7fe640 1 --2- 172.21.15.17:0/3543378790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f8406e170 0x7f9f84070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:16.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.040+0000 7f9f8b7fe640 1 -- 172.21.15.17:0/3543378790 <== mon.1 v2:172.21.15.86:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9f8c014070 con 0x7f9f9c100d70 2024-08-19T01:35:16.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.040+0000 7f9f99d9b640 1 --2- 172.21.15.17:0/3543378790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f8406e170 0x7f9f84070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:16.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.040+0000 7f9f99d9b640 1 --2- 172.21.15.17:0/3543378790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f8406e170 0x7f9f84070630 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c100150 tx=0x7f9f900058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:16.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.044+0000 7f9f8b7fe640 1 -- 172.21.15.17:0/3543378790 <== mon.1 v2:172.21.15.86:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9f8c0577b0 con 0x7f9f9c100d70 2024-08-19T01:35:16.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.303+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/3543378790 --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9f9c1043f0 con 0x7f9f9c100d70 2024-08-19T01:35:16.305 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:16 smithi017 ceph-mon[99370]: from='client.36002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:16.306 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:16 smithi017 ceph-mon[99370]: from='client.36006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:16.306 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:16 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1524934021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:16.306 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:16 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1861383030' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:35:16.306 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:16 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:16.306 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:16 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:16.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.303+0000 7f9f8b7fe640 1 -- 172.21.15.17:0/3543378790 <== mon.1 v2:172.21.15.86:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3669 (secure 0 0 0) 0x7f9f8c05ae70 con 0x7f9f9c100d70 2024-08-19T01:35:16.306 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN failed to probe daemons or devices; 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout: host smithi086 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi086/config 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout:/usr/bin/podman: timeout after 895 seconds 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp68oz1xt0:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout:Traceback (most recent call last): 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout: return _run_code(code, main_globals, None, 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout: exec(code, run_globals) 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5579, in 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 5567, in main 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 409, in _infer_config 2024-08-19T01:35:16.307 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 324, in _infer_fsid 2024-08-19T01:35:16.308 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 437, in _infer_image 2024-08-19T01:35:16.308 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 311, in _validate_fsid 2024-08-19T01:35:16.308 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/__main__.py", line 3312, in command_ceph_volume 2024-08-19T01:35:16.308 INFO:teuthology.orchestra.run.smithi017.stdout: File "/tmp/tmpj5a3x5qq.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-08-19T01:35:16.308 INFO:teuthology.orchestra.run.smithi017.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 -e NODE_NAME=smithi086 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/run/ceph:z -v /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968:/var/log/ceph:z -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmp68oz1xt0:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 inventory --format=json-pretty --filter-for-batch 2024-08-19T01:35:16.308 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-08-19T01:35:16.308 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs is degraded 2024-08-19T01:35:16.308 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:35:16.308 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:35:16.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.306+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/3543378790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f8406e170 msgr2=0x7f9f84070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:16.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.306+0000 7f9fa0fa6640 1 --2- 172.21.15.17:0/3543378790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f8406e170 0x7f9f84070630 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c100150 tx=0x7f9f900058d0 comp rx=0 tx=0).stop 2024-08-19T01:35:16.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.306+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/3543378790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f9c100d70 msgr2=0x7f9f9c0fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:16.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.306+0000 7f9fa0fa6640 1 --2- 172.21.15.17:0/3543378790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f9c100d70 0x7f9f9c0fe9d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00e970 tx=0x7f9f8c00ee30 comp rx=0 tx=0).stop 2024-08-19T01:35:16.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.306+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/3543378790 shutdown_connections 2024-08-19T01:35:16.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.306+0000 7f9fa0fa6640 1 --2- 172.21.15.17:0/3543378790 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9f8406e170 0x7f9f84070630 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:16.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.306+0000 7f9fa0fa6640 1 --2- 172.21.15.17:0/3543378790 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9f9c101690 0x7f9f9c0fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:16.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.306+0000 7f9fa0fa6640 1 --2- 172.21.15.17:0/3543378790 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9f9c100d70 0x7f9f9c0fe9d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:16.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.306+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/3543378790 >> 172.21.15.17:0/3543378790 conn(0x7f9f9c0fa710 msgr2=0x7f9f9c101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:16.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.306+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/3543378790 shutdown_connections 2024-08-19T01:35:16.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:16.306+0000 7f9fa0fa6640 1 -- 172.21.15.17:0/3543378790 wait complete. 2024-08-19T01:35:16.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:16 smithi086 ceph-mon[71303]: from='client.36002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:16.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:16 smithi086 ceph-mon[71303]: from='client.36006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:16.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:16 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1524934021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:16.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:16 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1861383030' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:35:16.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:16 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:16.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:16 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:17.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:17 smithi017 ceph-mon[99370]: from='client.36020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:17.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:17 smithi017 ceph-mon[99370]: pgmap v1097: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-08-19T01:35:17.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:17 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3543378790' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:35:17.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:17 smithi086 ceph-mon[71303]: from='client.36020 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:17.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:17 smithi086 ceph-mon[71303]: pgmap v1097: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-08-19T01:35:17.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:17 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3543378790' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:35:18.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:18 smithi017 ceph-mon[99370]: Upgrade: Updating ceph-exporter.smithi086 (2/2) 2024-08-19T01:35:18.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:18.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:35:18.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:18 smithi017 ceph-mon[99370]: Deploying daemon ceph-exporter.smithi086 on smithi086 2024-08-19T01:35:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:35:18.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:18 smithi017 ceph-mon[99370]: pgmap v1098: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 8 op/s 2024-08-19T01:35:18.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:18 smithi086 ceph-mon[71303]: Upgrade: Updating ceph-exporter.smithi086 (2/2) 2024-08-19T01:35:18.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:18.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi086", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-08-19T01:35:18.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:18 smithi086 ceph-mon[71303]: Deploying daemon ceph-exporter.smithi086 on smithi086 2024-08-19T01:35:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:35:18.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:18 smithi086 ceph-mon[71303]: pgmap v1098: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 8 op/s 2024-08-19T01:35:19.358 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:19 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] up:resolve 2024-08-19T01:35:19.358 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:19 smithi086 ceph-mon[71303]: fsmap cephfs:2/2 {0=cephfs.smithi017.junbdp=up:resolve,1=cephfs.smithi017.gvlpoy=up:resolve} 2 up:standby 2024-08-19T01:35:19.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:19 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] up:resolve 2024-08-19T01:35:19.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:19 smithi017 ceph-mon[99370]: fsmap cephfs:2/2 {0=cephfs.smithi017.junbdp=up:resolve,1=cephfs.smithi017.gvlpoy=up:resolve} 2 up:standby 2024-08-19T01:35:20.373 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:20 smithi086 ceph-mon[71303]: reconnect by client.14524 192.168.0.1:0/167351478 after 0.00199998 2024-08-19T01:35:20.373 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:20 smithi086 ceph-mon[71303]: reconnect by client.14524 192.168.0.1:0/167351478 after 0.00199998 2024-08-19T01:35:20.373 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:20 smithi086 ceph-mon[71303]: reconnect by client.24339 192.168.0.1:0/819526977 after 0.00199998 2024-08-19T01:35:20.373 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:20 smithi086 ceph-mon[71303]: reconnect by client.24339 192.168.0.1:0/819526977 after 0.00199998 2024-08-19T01:35:20.373 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:20 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] up:reconnect 2024-08-19T01:35:20.373 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:20 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] up:reconnect 2024-08-19T01:35:20.373 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:20 smithi086 ceph-mon[71303]: fsmap cephfs:2/2 {0=cephfs.smithi017.junbdp=up:reconnect,1=cephfs.smithi017.gvlpoy=up:reconnect} 2 up:standby 2024-08-19T01:35:20.373 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:20 smithi086 ceph-mon[71303]: pgmap v1099: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-08-19T01:35:20.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:20 smithi017 ceph-mon[99370]: reconnect by client.14524 192.168.0.1:0/167351478 after 0.00199998 2024-08-19T01:35:20.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:20 smithi017 ceph-mon[99370]: reconnect by client.14524 192.168.0.1:0/167351478 after 0.00199998 2024-08-19T01:35:20.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:20 smithi017 ceph-mon[99370]: reconnect by client.24339 192.168.0.1:0/819526977 after 0.00199998 2024-08-19T01:35:20.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:20 smithi017 ceph-mon[99370]: reconnect by client.24339 192.168.0.1:0/819526977 after 0.00199998 2024-08-19T01:35:20.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:20 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] up:reconnect 2024-08-19T01:35:20.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:20 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] up:reconnect 2024-08-19T01:35:20.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:20 smithi017 ceph-mon[99370]: fsmap cephfs:2/2 {0=cephfs.smithi017.junbdp=up:reconnect,1=cephfs.smithi017.gvlpoy=up:reconnect} 2 up:standby 2024-08-19T01:35:20.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:20 smithi017 ceph-mon[99370]: pgmap v1099: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-08-19T01:35:21.575 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] up:rejoin 2024-08-19T01:35:21.575 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] up:rejoin 2024-08-19T01:35:21.575 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: fsmap cephfs:2/2 {0=cephfs.smithi017.junbdp=up:rejoin,1=cephfs.smithi017.gvlpoy=up:rejoin} 2 up:standby 2024-08-19T01:35:21.575 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: daemon mds.cephfs.smithi017.gvlpoy is now active in filesystem cephfs as rank 1 2024-08-19T01:35:21.575 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: daemon mds.cephfs.smithi017.junbdp is now active in filesystem cephfs as rank 0 2024-08-19T01:35:21.575 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:21.575 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:21.575 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:35:21.576 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:21.576 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:21.576 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:21.576 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:21 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:21.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] up:rejoin 2024-08-19T01:35:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] up:rejoin 2024-08-19T01:35:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: fsmap cephfs:2/2 {0=cephfs.smithi017.junbdp=up:rejoin,1=cephfs.smithi017.gvlpoy=up:rejoin} 2 up:standby 2024-08-19T01:35:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: daemon mds.cephfs.smithi017.gvlpoy is now active in filesystem cephfs as rank 1 2024-08-19T01:35:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: daemon mds.cephfs.smithi017.junbdp is now active in filesystem cephfs as rank 0 2024-08-19T01:35:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:35:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:21.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:21 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:22.323 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:22 smithi017 ceph-mon[99370]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-19T01:35:22.323 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:22 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] up:active 2024-08-19T01:35:22.324 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:22 smithi017 ceph-mon[99370]: mds.? [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] up:active 2024-08-19T01:35:22.324 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:22 smithi017 ceph-mon[99370]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi017.gvlpoy=up:active} 2 up:standby 2024-08-19T01:35:22.324 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:22 smithi017 ceph-mon[99370]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi017.gvlpoy=up:active} 2 up:standby-replay 2024-08-19T01:35:22.324 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:22 smithi017 ceph-mon[99370]: pgmap v1100: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 255 B/s wr, 9 op/s 2024-08-19T01:35:22.494 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:22 smithi086 ceph-mon[71303]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-19T01:35:22.495 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:22 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] up:active 2024-08-19T01:35:22.495 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:22 smithi086 ceph-mon[71303]: mds.? [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] up:active 2024-08-19T01:35:22.495 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:22 smithi086 ceph-mon[71303]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi017.gvlpoy=up:active} 2 up:standby 2024-08-19T01:35:22.495 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:22 smithi086 ceph-mon[71303]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi017.gvlpoy=up:active} 2 up:standby-replay 2024-08-19T01:35:22.495 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:22 smithi086 ceph-mon[71303]: pgmap v1100: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 255 B/s wr, 9 op/s 2024-08-19T01:35:25.368 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:25 smithi017 ceph-mon[99370]: pgmap v1101: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 255 B/s wr, 5 op/s 2024-08-19T01:35:25.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:25 smithi086 ceph-mon[71303]: pgmap v1101: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 255 B/s wr, 5 op/s 2024-08-19T01:35:27.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:26 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:27.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:26 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:27.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:26 smithi017 ceph-mon[99370]: pgmap v1102: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 4.3 KiB/s wr, 18 op/s 2024-08-19T01:35:27.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:26 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:27.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:26 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:27.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:26 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:27.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:26 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:27.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:26 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:27.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:26 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:27.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:26 smithi086 ceph-mon[71303]: pgmap v1102: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 4.3 KiB/s wr, 18 op/s 2024-08-19T01:35:27.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:26 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:27.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:26 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:27.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:26 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:27.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:26 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:28.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:28.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:28 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:28.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:28.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:28 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:29.058 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:29 smithi086 ceph-mon[71303]: pgmap v1103: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.3 KiB/s wr, 17 op/s 2024-08-19T01:35:29.341 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:29 smithi017 ceph-mon[99370]: pgmap v1103: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.3 KiB/s wr, 17 op/s 2024-08-19T01:35:30.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:30.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:30 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:30.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:30 smithi017 ceph-mon[99370]: pgmap v1104: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 4.3 KiB/s wr, 17 op/s 2024-08-19T01:35:30.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:30.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:30 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:30.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:30 smithi086 ceph-mon[71303]: pgmap v1104: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 18 MiB/s rd, 4.3 KiB/s wr, 17 op/s 2024-08-19T01:35:33.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: pgmap v1105: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 4.3 KiB/s wr, 19 op/s 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-08-19T01:35:33.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:33.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:35:33.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: pgmap v1105: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 4.3 KiB/s wr, 19 op/s 2024-08-19T01:35:33.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:33.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:35:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: pgmap v1106: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-08-19T01:35:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: Upgrade: Setting filesystem cephfs Joinable 2024-08-19T01:35:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-08-19T01:35:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-08-19T01:35:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi017.gvlpoy=up:active} 2 up:standby-replay 2024-08-19T01:35:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi017"}]: dispatch 2024-08-19T01:35:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi017"}]': finished 2024-08-19T01:35:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi086"}]: dispatch 2024-08-19T01:35:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi086"}]': finished 2024-08-19T01:35:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-08-19T01:35:34.435 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-19T01:35:34.436 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:35:34.437 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:34.438 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:35:34.438 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:34.438 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:35:34.438 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:34.438 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:35:34.438 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:34.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: pgmap v1106: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-08-19T01:35:34.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: Upgrade: Setting filesystem cephfs Joinable 2024-08-19T01:35:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-08-19T01:35:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-08-19T01:35:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: fsmap cephfs:2 {0=cephfs.smithi017.junbdp=up:active,1=cephfs.smithi017.gvlpoy=up:active} 2 up:standby-replay 2024-08-19T01:35:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi017"}]: dispatch 2024-08-19T01:35:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi017"}]': finished 2024-08-19T01:35:34.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi086"}]: dispatch 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi086"}]': finished 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-08-19T01:35:34.448 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-08-19T01:35:34.449 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-08-19T01:35:34.449 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.449 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-08-19T01:35:34.449 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-08-19T01:35:34.449 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-08-19T01:35:34.449 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-08-19T01:35:34.449 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-08-19T01:35:34.449 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-08-19T01:35:34.449 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-08-19T01:35:34.449 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:35:34.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:34.451 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:35:34.451 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:35:34.451 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:35:34.451 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:35.334 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:35 smithi017 ceph-mon[99370]: Upgrade: Setting container_image for all ceph-exporter 2024-08-19T01:35:35.334 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:35 smithi017 ceph-mon[99370]: Upgrade: Setting container_image for all iscsi 2024-08-19T01:35:35.334 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:35 smithi017 ceph-mon[99370]: Upgrade: Setting container_image for all nfs 2024-08-19T01:35:35.334 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:35 smithi017 ceph-mon[99370]: Upgrade: Setting container_image for all nvmeof 2024-08-19T01:35:35.334 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:35 smithi017 ceph-mon[99370]: Upgrade: Finalizing container_image settings 2024-08-19T01:35:35.334 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:35 smithi017 ceph-mon[99370]: Upgrade: Complete! 2024-08-19T01:35:35.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:35 smithi086 ceph-mon[71303]: Upgrade: Setting container_image for all ceph-exporter 2024-08-19T01:35:35.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:35 smithi086 ceph-mon[71303]: Upgrade: Setting container_image for all iscsi 2024-08-19T01:35:35.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:35 smithi086 ceph-mon[71303]: Upgrade: Setting container_image for all nfs 2024-08-19T01:35:35.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:35 smithi086 ceph-mon[71303]: Upgrade: Setting container_image for all nvmeof 2024-08-19T01:35:35.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:35 smithi086 ceph-mon[71303]: Upgrade: Finalizing container_image settings 2024-08-19T01:35:35.446 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:35 smithi086 ceph-mon[71303]: Upgrade: Complete! 2024-08-19T01:35:36.350 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:36 smithi017 ceph-mon[99370]: pgmap v1107: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-08-19T01:35:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:36 smithi086 ceph-mon[71303]: pgmap v1107: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-08-19T01:35:38.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:38 smithi017 ceph-mon[99370]: pgmap v1108: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 9.5 MiB/s rd, 5 op/s 2024-08-19T01:35:38.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:38 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:38.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:38 smithi086 ceph-mon[71303]: pgmap v1108: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 9.5 MiB/s rd, 5 op/s 2024-08-19T01:35:38.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:38 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:40.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:40 smithi017 ceph-mon[99370]: pgmap v1109: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 4 op/s 2024-08-19T01:35:40.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:40 smithi086 ceph-mon[71303]: pgmap v1109: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 4 op/s 2024-08-19T01:35:42.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:42 smithi017 ceph-mon[99370]: pgmap v1110: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 5 op/s 2024-08-19T01:35:42.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:42 smithi086 ceph-mon[71303]: pgmap v1110: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 5 op/s 2024-08-19T01:35:44.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:44 smithi017 ceph-mon[99370]: pgmap v1111: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-08-19T01:35:44.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:44 smithi086 ceph-mon[71303]: pgmap v1111: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-08-19T01:35:46.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.399+0000 7fdc6d123640 1 -- 172.21.15.17:0/4092314687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc681049f0 msgr2=0x7fdc68104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:46.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.399+0000 7fdc6d123640 1 --2- 172.21.15.17:0/4092314687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc681049f0 0x7fdc68104dd0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009880 tx=0x7fdc5802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:35:46.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.399+0000 7fdc6d123640 1 -- 172.21.15.17:0/4092314687 shutdown_connections 2024-08-19T01:35:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.399+0000 7fdc6d123640 1 --2- 172.21.15.17:0/4092314687 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc680fe9f0 0x7fdc680fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.399+0000 7fdc6d123640 1 --2- 172.21.15.17:0/4092314687 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc681049f0 0x7fdc68104dd0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.399+0000 7fdc6d123640 1 -- 172.21.15.17:0/4092314687 >> 172.21.15.17:0/4092314687 conn(0x7fdc680758a0 msgr2=0x7fdc680fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.399+0000 7fdc6d123640 1 -- 172.21.15.17:0/4092314687 shutdown_connections 2024-08-19T01:35:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.399+0000 7fdc6d123640 1 -- 172.21.15.17:0/4092314687 wait complete. 2024-08-19T01:35:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.400+0000 7fdc6d123640 1 Processor -- start 2024-08-19T01:35:46.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.400+0000 7fdc6d123640 1 -- start start 2024-08-19T01:35:46.402 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:46 smithi017 ceph-mon[99370]: pgmap v1112: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:35:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.400+0000 7fdc6d123640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc680fe9f0 0x7fdc68196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.400+0000 7fdc6d123640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc681049f0 0x7fdc68196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.400+0000 7fdc6d123640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc68197490 con 0x7fdc680fe9f0 2024-08-19T01:35:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.400+0000 7fdc6d123640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc68197600 con 0x7fdc681049f0 2024-08-19T01:35:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.400+0000 7fdc66d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc680fe9f0 0x7fdc68196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.400+0000 7fdc66d9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc680fe9f0 0x7fdc68196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55230/0 (socket says 172.21.15.17:55230) 2024-08-19T01:35:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.400+0000 7fdc66d9d640 1 -- 172.21.15.17:0/3327008332 learned_addr learned my addr 172.21.15.17:0/3327008332 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:46.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.400+0000 7fdc5ffff640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc681049f0 0x7fdc68196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.401+0000 7fdc66d9d640 1 -- 172.21.15.17:0/3327008332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc681049f0 msgr2=0x7fdc68196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.401+0000 7fdc66d9d640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc681049f0 0x7fdc68196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.401+0000 7fdc66d9d640 1 -- 172.21.15.17:0/3327008332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc58009560 con 0x7fdc680fe9f0 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.401+0000 7fdc5ffff640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc681049f0 0x7fdc68196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.401+0000 7fdc66d9d640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc680fe9f0 0x7fdc68196980 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fdc5802a9c0 tx=0x7fdc580055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.401+0000 7fdc64d99640 1 -- 172.21.15.17:0/3327008332 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc580048d0 con 0x7fdc680fe9f0 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.401+0000 7fdc64d99640 1 -- 172.21.15.17:0/3327008332 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdc58031640 con 0x7fdc680fe9f0 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.401+0000 7fdc6d123640 1 -- 172.21.15.17:0/3327008332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6819f9f0 con 0x7fdc680fe9f0 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.401+0000 7fdc64d99640 1 -- 172.21.15.17:0/3327008332 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc580038d0 con 0x7fdc680fe9f0 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.401+0000 7fdc6d123640 1 -- 172.21.15.17:0/3327008332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6819fd50 con 0x7fdc680fe9f0 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.402+0000 7fdc6d123640 1 -- 172.21.15.17:0/3327008332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc68100130 con 0x7fdc680fe9f0 2024-08-19T01:35:46.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.403+0000 7fdc64d99640 1 -- 172.21.15.17:0/3327008332 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdc58004a30 con 0x7fdc680fe9f0 2024-08-19T01:35:46.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.403+0000 7fdc64d99640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc5406e170 0x7fdc54070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:46.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.404+0000 7fdc64d99640 1 -- 172.21.15.17:0/3327008332 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdc580af180 con 0x7fdc680fe9f0 2024-08-19T01:35:46.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.404+0000 7fdc5ffff640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc5406e170 0x7fdc54070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:46.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.404+0000 7fdc5ffff640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc5406e170 0x7fdc54070630 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdc68068470 tx=0x7fdc50005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:46.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.408+0000 7fdc64d99640 1 -- 172.21.15.17:0/3327008332 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdc58078440 con 0x7fdc680fe9f0 2024-08-19T01:35:46.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:46 smithi086 ceph-mon[71303]: pgmap v1112: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:35:46.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.603+0000 7fdc6d123640 1 -- 172.21.15.17:0/3327008332 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdc68068220 con 0x7fdc5406e170 2024-08-19T01:35:46.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.604+0000 7fdc64d99640 1 -- 172.21.15.17:0/3327008332 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fdc68068220 con 0x7fdc5406e170 2024-08-19T01:35:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.606+0000 7fdc6d123640 1 -- 172.21.15.17:0/3327008332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc5406e170 msgr2=0x7fdc54070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.606+0000 7fdc6d123640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc5406e170 0x7fdc54070630 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdc68068470 tx=0x7fdc50005f90 comp rx=0 tx=0).stop 2024-08-19T01:35:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.606+0000 7fdc6d123640 1 -- 172.21.15.17:0/3327008332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc680fe9f0 msgr2=0x7fdc68196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.606+0000 7fdc6d123640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc680fe9f0 0x7fdc68196980 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fdc5802a9c0 tx=0x7fdc580055a0 comp rx=0 tx=0).stop 2024-08-19T01:35:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.606+0000 7fdc6d123640 1 -- 172.21.15.17:0/3327008332 shutdown_connections 2024-08-19T01:35:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.606+0000 7fdc6d123640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdc5406e170 0x7fdc54070630 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.606+0000 7fdc6d123640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdc681049f0 0x7fdc68196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.606+0000 7fdc6d123640 1 --2- 172.21.15.17:0/3327008332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdc680fe9f0 0x7fdc68196980 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.606+0000 7fdc6d123640 1 -- 172.21.15.17:0/3327008332 >> 172.21.15.17:0/3327008332 conn(0x7fdc680758a0 msgr2=0x7fdc680fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.606+0000 7fdc6d123640 1 -- 172.21.15.17:0/3327008332 shutdown_connections 2024-08-19T01:35:46.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:46.606+0000 7fdc6d123640 1 -- 172.21.15.17:0/3327008332 wait complete. 2024-08-19T01:35:47.192 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph orch ps' 2024-08-19T01:35:47.402 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:35:48.411 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:48 smithi017 ceph-mon[99370]: pgmap v1113: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:35:48.411 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:48 smithi017 ceph-mon[99370]: from='client.36028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:48.411 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:48.411 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:35:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:48 smithi086 ceph-mon[71303]: pgmap v1113: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:35:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:48 smithi086 ceph-mon[71303]: from='client.36028 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:35:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:35:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.885+0000 7f2556777640 1 -- 172.21.15.17:0/3222922917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25500fea30 msgr2=0x7f25500fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.885+0000 7f2556777640 1 --2- 172.21.15.17:0/3222922917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25500fea30 0x7f25500fee90 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f2544009880 tx=0x7f254402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:35:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.885+0000 7f2556777640 1 -- 172.21.15.17:0/3222922917 shutdown_connections 2024-08-19T01:35:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.885+0000 7f2556777640 1 --2- 172.21.15.17:0/3222922917 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f25500fea30 0x7f25500fee90 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.885+0000 7f2556777640 1 --2- 172.21.15.17:0/3222922917 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f2550104a30 0x7f2550104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:48.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.885+0000 7f2556777640 1 -- 172.21.15.17:0/3222922917 >> 172.21.15.17:0/3222922917 conn(0x7f25500fa730 msgr2=0x7f25500fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.885+0000 7f2556777640 1 -- 172.21.15.17:0/3222922917 shutdown_connections 2024-08-19T01:35:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.885+0000 7f2556777640 1 -- 172.21.15.17:0/3222922917 wait complete. 2024-08-19T01:35:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.886+0000 7f2556777640 1 Processor -- start 2024-08-19T01:35:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.886+0000 7f2556777640 1 -- start start 2024-08-19T01:35:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.886+0000 7f2556777640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25500fea30 0x7f25500fb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.886+0000 7f2556777640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550104a30 0x7f25500fb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.886+0000 7f2556777640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25500fba80 con 0x7f2550104a30 2024-08-19T01:35:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.886+0000 7f2556777640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25500fbbf0 con 0x7f25500fea30 2024-08-19T01:35:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.886+0000 7f254f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550104a30 0x7f25500fb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:48.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.886+0000 7f254f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550104a30 0x7f25500fb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46062/0 (socket says 172.21.15.17:46062) 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.886+0000 7f254f7fe640 1 -- 172.21.15.17:0/138939522 learned_addr learned my addr 172.21.15.17:0/138939522 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.887+0000 7f254f7fe640 1 -- 172.21.15.17:0/138939522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25500fea30 msgr2=0x7f25500fb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.887+0000 7f254ffff640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25500fea30 0x7f25500fb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.887+0000 7f254f7fe640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25500fea30 0x7f25500fb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.887+0000 7f254f7fe640 1 -- 172.21.15.17:0/138939522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2544009560 con 0x7f2550104a30 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.887+0000 7f254ffff640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25500fea30 0x7f25500fb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.887+0000 7f254f7fe640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550104a30 0x7f25500fb540 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f254402a9c0 tx=0x7f25440055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.887+0000 7f254d7fa640 1 -- 172.21.15.17:0/138939522 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2544004aa0 con 0x7f2550104a30 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.887+0000 7f254d7fa640 1 -- 172.21.15.17:0/138939522 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2544004c00 con 0x7f2550104a30 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.887+0000 7f2556777640 1 -- 172.21.15.17:0/138939522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25500fbe70 con 0x7f2550104a30 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.887+0000 7f254d7fa640 1 -- 172.21.15.17:0/138939522 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2544003ab0 con 0x7f2550104a30 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.887+0000 7f2556777640 1 -- 172.21.15.17:0/138939522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25501a1ef0 con 0x7f2550104a30 2024-08-19T01:35:48.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.888+0000 7f2556777640 1 -- 172.21.15.17:0/138939522 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2550100170 con 0x7f2550104a30 2024-08-19T01:35:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.889+0000 7f254d7fa640 1 -- 172.21.15.17:0/138939522 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2544031d20 con 0x7f2550104a30 2024-08-19T01:35:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.889+0000 7f254d7fa640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f253806e170 0x7f2538070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.889+0000 7f254d7fa640 1 -- 172.21.15.17:0/138939522 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f25440af110 con 0x7f2550104a30 2024-08-19T01:35:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.889+0000 7f254ffff640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f253806e170 0x7f2538070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.889+0000 7f254ffff640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f253806e170 0x7f2538070630 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f25400058c0 tx=0x7f2540005d30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:48.893+0000 7f254d7fa640 1 -- 172.21.15.17:0/138939522 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f25440783f0 con 0x7f2550104a30 2024-08-19T01:35:49.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.076+0000 7f2556777640 1 -- 172.21.15.17:0/138939522 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f25500fbe70 con 0x7f253806e170 2024-08-19T01:35:49.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.088+0000 7f254d7fa640 1 -- 172.21.15.17:0/138939522 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f25500fbe70 con 0x7f253806e170 2024-08-19T01:35:49.089 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:35:49.089 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (37m) 23s ago 47m 25.3M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:35:49.089 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (33s) 23s ago 47m 8120k - 19.1.0-1382-gde09dd01 ea7a5189f30b 2c4608603f6b 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (28s) 22s ago 46m 7285k - 19.1.0-1382-gde09dd01 ea7a5189f30b f4befa275518 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (34m) 23s ago 47m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (34m) 22s ago 46m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (36m) 23s ago 47m 77.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (31m) 23s ago 42m 26.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (31m) 23s ago 42m 86.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (15m) 22s ago 42m 20.1M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (30m) 22s ago 42m 24.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (39m) 23s ago 49m 511M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (37m) 22s ago 46m 449M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (35m) 23s ago 49m 85.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (35m) 22s ago 46m 61.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:35:49.090 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (37m) 23s ago 47m 15.7M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:35:49.091 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (37m) 22s ago 46m 15.3M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:35:49.091 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (34m) 23s ago 45m 96.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:35:49.091 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (33m) 23s ago 45m 103M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:35:49.091 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (33m) 23s ago 45m 92.5M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:35:49.091 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (32m) 22s ago 44m 104M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:35:49.091 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (32m) 22s ago 44m 93.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:35:49.091 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (31m) 22s ago 43m 96.0M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:35:49.091 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (37m) 23s ago 47m 82.6M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:35:49.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.090+0000 7f2556777640 1 -- 172.21.15.17:0/138939522 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f253806e170 msgr2=0x7f2538070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:49.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.090+0000 7f2556777640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f253806e170 0x7f2538070630 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f25400058c0 tx=0x7f2540005d30 comp rx=0 tx=0).stop 2024-08-19T01:35:49.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.090+0000 7f2556777640 1 -- 172.21.15.17:0/138939522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550104a30 msgr2=0x7f25500fb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:49.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.090+0000 7f2556777640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550104a30 0x7f25500fb540 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f254402a9c0 tx=0x7f25440055a0 comp rx=0 tx=0).stop 2024-08-19T01:35:49.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.090+0000 7f2556777640 1 -- 172.21.15.17:0/138939522 shutdown_connections 2024-08-19T01:35:49.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.090+0000 7f2556777640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f253806e170 0x7f2538070630 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:49.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.090+0000 7f2556777640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2550104a30 0x7f25500fb540 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:49.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.090+0000 7f2556777640 1 --2- 172.21.15.17:0/138939522 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f25500fea30 0x7f25500fb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:49.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.090+0000 7f2556777640 1 -- 172.21.15.17:0/138939522 >> 172.21.15.17:0/138939522 conn(0x7f25500fa730 msgr2=0x7f2550068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:49.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.090+0000 7f2556777640 1 -- 172.21.15.17:0/138939522 shutdown_connections 2024-08-19T01:35:49.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:49.090+0000 7f2556777640 1 -- 172.21.15.17:0/138939522 wait complete. 2024-08-19T01:35:49.891 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph orch upgrade status' 2024-08-19T01:35:50.101 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:35:50.430 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:50 smithi017 ceph-mon[99370]: pgmap v1114: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:35:50.430 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:50 smithi017 ceph-mon[99370]: from='client.36032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:50.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:50 smithi086 ceph-mon[71303]: pgmap v1114: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:35:50.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:50 smithi086 ceph-mon[71303]: from='client.36032 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.745+0000 7f8febfd7640 1 -- 172.21.15.17:0/3632476137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe41049f0 msgr2=0x7f8fe4104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.745+0000 7f8febfd7640 1 --2- 172.21.15.17:0/3632476137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe41049f0 0x7f8fe4104dd0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009880 tx=0x7f8fe002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:35:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.745+0000 7f8febfd7640 1 -- 172.21.15.17:0/3632476137 shutdown_connections 2024-08-19T01:35:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.745+0000 7f8febfd7640 1 --2- 172.21.15.17:0/3632476137 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe40fe9f0 0x7f8fe40fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.745+0000 7f8febfd7640 1 --2- 172.21.15.17:0/3632476137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe41049f0 0x7f8fe4104dd0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.745+0000 7f8febfd7640 1 -- 172.21.15.17:0/3632476137 >> 172.21.15.17:0/3632476137 conn(0x7f8fe40758a0 msgr2=0x7f8fe40fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:51.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.745+0000 7f8febfd7640 1 -- 172.21.15.17:0/3632476137 shutdown_connections 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.745+0000 7f8febfd7640 1 -- 172.21.15.17:0/3632476137 wait complete. 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.745+0000 7f8febfd7640 1 Processor -- start 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8febfd7640 1 -- start start 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8febfd7640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe40fe9f0 0x7f8fe4197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8febfd7640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe41049f0 0x7f8fe4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8febfd7640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe41989c0 con 0x7f8fe40fe9f0 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8febfd7640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe419c730 con 0x7f8fe41049f0 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8fe9d73640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe40fe9f0 0x7f8fe4197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8fe9d73640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe40fe9f0 0x7f8fe4197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46084/0 (socket says 172.21.15.17:46084) 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8fe9d73640 1 -- 172.21.15.17:0/1185402634 learned_addr learned my addr 172.21.15.17:0/1185402634 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8fe9d73640 1 -- 172.21.15.17:0/1185402634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe41049f0 msgr2=0x7f8fe4198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:51.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8fe9d73640 1 --2- 172.21.15.17:0/1185402634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe41049f0 0x7f8fe4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8fe9d73640 1 -- 172.21.15.17:0/1185402634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe0009560 con 0x7f8fe40fe9f0 2024-08-19T01:35:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.746+0000 7f8fe9d73640 1 --2- 172.21.15.17:0/1185402634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe40fe9f0 0x7f8fe4197df0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8fe002a9c0 tx=0x7f8fe00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.747+0000 7f8fdaffd640 1 -- 172.21.15.17:0/1185402634 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe0004aa0 con 0x7f8fe40fe9f0 2024-08-19T01:35:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.747+0000 7f8fdaffd640 1 -- 172.21.15.17:0/1185402634 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8fe0004c00 con 0x7f8fe40fe9f0 2024-08-19T01:35:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.747+0000 7f8fdaffd640 1 -- 172.21.15.17:0/1185402634 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe0003ab0 con 0x7f8fe40fe9f0 2024-08-19T01:35:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.747+0000 7f8febfd7640 1 -- 172.21.15.17:0/1185402634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe419c9b0 con 0x7f8fe40fe9f0 2024-08-19T01:35:51.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.747+0000 7f8febfd7640 1 -- 172.21.15.17:0/1185402634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe419cea0 con 0x7f8fe40fe9f0 2024-08-19T01:35:51.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.748+0000 7f8febfd7640 1 -- 172.21.15.17:0/1185402634 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe4100130 con 0x7f8fe40fe9f0 2024-08-19T01:35:51.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.748+0000 7f8fdaffd640 1 -- 172.21.15.17:0/1185402634 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8fe0031d20 con 0x7f8fe40fe9f0 2024-08-19T01:35:51.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.749+0000 7f8fdaffd640 1 --2- 172.21.15.17:0/1185402634 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8fd006e170 0x7f8fd0070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:51.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.749+0000 7f8fdaffd640 1 -- 172.21.15.17:0/1185402634 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f8fe00af1b0 con 0x7f8fe40fe9f0 2024-08-19T01:35:51.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.749+0000 7f8fe9572640 1 --2- 172.21.15.17:0/1185402634 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8fd006e170 0x7f8fd0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:51.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.749+0000 7f8fe9572640 1 --2- 172.21.15.17:0/1185402634 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8fd006e170 0x7f8fd0070630 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8fe41993a0 tx=0x7f8fd4006c90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:51.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.753+0000 7f8fdaffd640 1 -- 172.21.15.17:0/1185402634 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f8fe0078510 con 0x7f8fe40fe9f0 2024-08-19T01:35:51.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.948+0000 7f8febfd7640 1 -- 172.21.15.17:0/1185402634 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fe410bd50 con 0x7f8fd006e170 2024-08-19T01:35:51.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.949+0000 7f8fdaffd640 1 -- 172.21.15.17:0/1185402634 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f8fe410bd50 con 0x7f8fd006e170 2024-08-19T01:35:51.950 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:35:51.951 INFO:teuthology.orchestra.run.smithi017.stdout: "target_image": null, 2024-08-19T01:35:51.951 INFO:teuthology.orchestra.run.smithi017.stdout: "in_progress": false, 2024-08-19T01:35:51.951 INFO:teuthology.orchestra.run.smithi017.stdout: "which": "", 2024-08-19T01:35:51.951 INFO:teuthology.orchestra.run.smithi017.stdout: "services_complete": [], 2024-08-19T01:35:51.951 INFO:teuthology.orchestra.run.smithi017.stdout: "progress": null, 2024-08-19T01:35:51.951 INFO:teuthology.orchestra.run.smithi017.stdout: "message": "", 2024-08-19T01:35:51.951 INFO:teuthology.orchestra.run.smithi017.stdout: "is_paused": false 2024-08-19T01:35:51.951 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:35:51.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.951+0000 7f8febfd7640 1 -- 172.21.15.17:0/1185402634 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8fd006e170 msgr2=0x7f8fd0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:51.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.952+0000 7f8febfd7640 1 --2- 172.21.15.17:0/1185402634 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8fd006e170 0x7f8fd0070630 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8fe41993a0 tx=0x7f8fd4006c90 comp rx=0 tx=0).stop 2024-08-19T01:35:51.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.952+0000 7f8febfd7640 1 -- 172.21.15.17:0/1185402634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe40fe9f0 msgr2=0x7f8fe4197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:51.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.952+0000 7f8febfd7640 1 --2- 172.21.15.17:0/1185402634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe40fe9f0 0x7f8fe4197df0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8fe002a9c0 tx=0x7f8fe00055a0 comp rx=0 tx=0).stop 2024-08-19T01:35:51.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.952+0000 7f8febfd7640 1 -- 172.21.15.17:0/1185402634 shutdown_connections 2024-08-19T01:35:51.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.952+0000 7f8febfd7640 1 --2- 172.21.15.17:0/1185402634 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f8fd006e170 0x7f8fd0070630 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:51.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.952+0000 7f8febfd7640 1 --2- 172.21.15.17:0/1185402634 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f8fe41049f0 0x7f8fe4198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:51.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.952+0000 7f8febfd7640 1 --2- 172.21.15.17:0/1185402634 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8fe40fe9f0 0x7f8fe4197df0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:51.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.952+0000 7f8febfd7640 1 -- 172.21.15.17:0/1185402634 >> 172.21.15.17:0/1185402634 conn(0x7f8fe40758a0 msgr2=0x7f8fe4101fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:51.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.952+0000 7f8febfd7640 1 -- 172.21.15.17:0/1185402634 shutdown_connections 2024-08-19T01:35:51.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:51.952+0000 7f8febfd7640 1 -- 172.21.15.17:0/1185402634 wait complete. 2024-08-19T01:35:52.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:52 smithi017 ceph-mon[99370]: pgmap v1115: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:35:52.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:52 smithi086 ceph-mon[71303]: pgmap v1115: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:35:52.570 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph health detail' 2024-08-19T01:35:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:35:53.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:53 smithi017 ceph-mon[99370]: from='client.36036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:53.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:53 smithi086 ceph-mon[71303]: from='client.36036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:35:54.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:54 smithi017 ceph-mon[99370]: pgmap v1116: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:35:54.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:54 smithi086 ceph-mon[71303]: pgmap v1116: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:35:54.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.432+0000 7f4f7e18a640 1 -- 172.21.15.17:0/1459909866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f78104b60 msgr2=0x7f4f78104f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:54.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.432+0000 7f4f7e18a640 1 --2- 172.21.15.17:0/1459909866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f78104b60 0x7f4f78104f40 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009880 tx=0x7f4f6802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.432+0000 7f4f7e18a640 1 -- 172.21.15.17:0/1459909866 shutdown_connections 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.432+0000 7f4f7e18a640 1 --2- 172.21.15.17:0/1459909866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f780fdf80 0x7f4f780fe3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.432+0000 7f4f7e18a640 1 --2- 172.21.15.17:0/1459909866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f78104b60 0x7f4f78104f40 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.432+0000 7f4f7e18a640 1 -- 172.21.15.17:0/1459909866 >> 172.21.15.17:0/1459909866 conn(0x7f4f780f9e90 msgr2=0x7f4f780fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.432+0000 7f4f7e18a640 1 -- 172.21.15.17:0/1459909866 shutdown_connections 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.432+0000 7f4f7e18a640 1 -- 172.21.15.17:0/1459909866 wait complete. 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.432+0000 7f4f7e18a640 1 Processor -- start 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.432+0000 7f4f7e18a640 1 -- start start 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f7e18a640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f780fdf80 0x7f4f780ff160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f7e18a640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f78104b60 0x7f4f780ff6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f7e18a640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780ffbe0 con 0x7f4f78104b60 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f7e18a640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780ffd50 con 0x7f4f780fdf80 2024-08-19T01:35:54.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f76ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f78104b60 0x7f4f780ff6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f76ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f78104b60 0x7f4f780ff6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46110/0 (socket says 172.21.15.17:46110) 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f76ffd640 1 -- 172.21.15.17:0/3976642786 learned_addr learned my addr 172.21.15.17:0/3976642786 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f777fe640 1 --2- 172.21.15.17:0/3976642786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f780fdf80 0x7f4f780ff160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f76ffd640 1 -- 172.21.15.17:0/3976642786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f780fdf80 msgr2=0x7f4f780ff160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f76ffd640 1 --2- 172.21.15.17:0/3976642786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f780fdf80 0x7f4f780ff160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f76ffd640 1 -- 172.21.15.17:0/3976642786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f68009560 con 0x7f4f78104b60 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f76ffd640 1 --2- 172.21.15.17:0/3976642786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f78104b60 0x7f4f780ff6a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00d6f0 tx=0x7f4f6c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f74ff9640 1 -- 172.21.15.17:0/3976642786 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f6c009a30 con 0x7f4f78104b60 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.433+0000 7f4f74ff9640 1 -- 172.21.15.17:0/3976642786 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f6c0054e0 con 0x7f4f78104b60 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.434+0000 7f4f7e18a640 1 -- 172.21.15.17:0/3976642786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f781a1d80 con 0x7f4f78104b60 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.434+0000 7f4f74ff9640 1 -- 172.21.15.17:0/3976642786 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f6c010460 con 0x7f4f78104b60 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.434+0000 7f4f7e18a640 1 -- 172.21.15.17:0/3976642786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f781a20e0 con 0x7f4f78104b60 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.435+0000 7f4f7e18a640 1 -- 172.21.15.17:0/3976642786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f781012a0 con 0x7f4f78104b60 2024-08-19T01:35:54.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.435+0000 7f4f74ff9640 1 -- 172.21.15.17:0/3976642786 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4f6c009b90 con 0x7f4f78104b60 2024-08-19T01:35:54.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.436+0000 7f4f74ff9640 1 --2- 172.21.15.17:0/3976642786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f6006e170 0x7f4f60070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:54.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.436+0000 7f4f777fe640 1 --2- 172.21.15.17:0/3976642786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f6006e170 0x7f4f60070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:54.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.436+0000 7f4f74ff9640 1 -- 172.21.15.17:0/3976642786 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f4f6c08dc80 con 0x7f4f78104b60 2024-08-19T01:35:54.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.436+0000 7f4f777fe640 1 --2- 172.21.15.17:0/3976642786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f6006e170 0x7f4f60070630 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009230 tx=0x7f4f680058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:54.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.440+0000 7f4f74ff9640 1 -- 172.21.15.17:0/3976642786 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4f6c057010 con 0x7f4f78104b60 2024-08-19T01:35:54.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.687+0000 7f4f7e18a640 1 -- 172.21.15.17:0/3976642786 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4f781080a0 con 0x7f4f78104b60 2024-08-19T01:35:54.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.688+0000 7f4f74ff9640 1 -- 172.21.15.17:0/3976642786 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f4f6c017090 con 0x7f4f78104b60 2024-08-19T01:35:54.689 INFO:teuthology.orchestra.run.smithi017.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T01:35:54.689 INFO:teuthology.orchestra.run.smithi017.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:35:54.689 INFO:teuthology.orchestra.run.smithi017.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:35:54.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.690+0000 7f4f7e18a640 1 -- 172.21.15.17:0/3976642786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f6006e170 msgr2=0x7f4f60070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:54.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.690+0000 7f4f7e18a640 1 --2- 172.21.15.17:0/3976642786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f6006e170 0x7f4f60070630 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009230 tx=0x7f4f680058d0 comp rx=0 tx=0).stop 2024-08-19T01:35:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.690+0000 7f4f7e18a640 1 -- 172.21.15.17:0/3976642786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f78104b60 msgr2=0x7f4f780ff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.690+0000 7f4f7e18a640 1 --2- 172.21.15.17:0/3976642786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f78104b60 0x7f4f780ff6a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00d6f0 tx=0x7f4f6c00dbb0 comp rx=0 tx=0).stop 2024-08-19T01:35:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.690+0000 7f4f7e18a640 1 -- 172.21.15.17:0/3976642786 shutdown_connections 2024-08-19T01:35:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.690+0000 7f4f7e18a640 1 --2- 172.21.15.17:0/3976642786 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f4f6006e170 0x7f4f60070630 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.690+0000 7f4f7e18a640 1 --2- 172.21.15.17:0/3976642786 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4f78104b60 0x7f4f780ff6a0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.690+0000 7f4f7e18a640 1 --2- 172.21.15.17:0/3976642786 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f4f780fdf80 0x7f4f780ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.690+0000 7f4f7e18a640 1 -- 172.21.15.17:0/3976642786 >> 172.21.15.17:0/3976642786 conn(0x7f4f780f9e90 msgr2=0x7f4f780fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:54.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.691+0000 7f4f7e18a640 1 -- 172.21.15.17:0/3976642786 shutdown_connections 2024-08-19T01:35:54.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:54.691+0000 7f4f7e18a640 1 -- 172.21.15.17:0/3976642786 wait complete. 2024-08-19T01:35:55.357 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:55 smithi017 ceph-mon[99370]: pgmap v1117: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:35:55.357 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:55 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3976642786' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:35:55.382 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph versions' 2024-08-19T01:35:55.595 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:35:55.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:55 smithi086 ceph-mon[71303]: pgmap v1117: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:35:55.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:55 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3976642786' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-08-19T01:35:57.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.185+0000 7fec96695640 1 -- 172.21.15.17:0/2361947969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec900fdf70 msgr2=0x7fec900fe3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.185+0000 7fec96695640 1 --2- 172.21.15.17:0/2361947969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec900fdf70 0x7fec900fe3d0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fec84009880 tx=0x7fec8402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:35:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.185+0000 7fec96695640 1 -- 172.21.15.17:0/2361947969 shutdown_connections 2024-08-19T01:35:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.185+0000 7fec96695640 1 --2- 172.21.15.17:0/2361947969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec900fdf70 0x7fec900fe3d0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.185+0000 7fec96695640 1 --2- 172.21.15.17:0/2361947969 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec90104b50 0x7fec90104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.185+0000 7fec96695640 1 -- 172.21.15.17:0/2361947969 >> 172.21.15.17:0/2361947969 conn(0x7fec900f9ec0 msgr2=0x7fec900fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.185+0000 7fec96695640 1 -- 172.21.15.17:0/2361947969 shutdown_connections 2024-08-19T01:35:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.185+0000 7fec96695640 1 -- 172.21.15.17:0/2361947969 wait complete. 2024-08-19T01:35:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.186+0000 7fec96695640 1 Processor -- start 2024-08-19T01:35:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.186+0000 7fec96695640 1 -- start start 2024-08-19T01:35:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.186+0000 7fec96695640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec900fdf70 0x7fec900ff150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:57.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.186+0000 7fec96695640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec90104b50 0x7fec900ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.186+0000 7fec96695640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec900ffbd0 con 0x7fec90104b50 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.186+0000 7fec96695640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec900ffd40 con 0x7fec900fdf70 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.186+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec90104b50 0x7fec900ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.186+0000 7fec8f7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec90104b50 0x7fec900ff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35738/0 (socket says 172.21.15.17:35738) 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.186+0000 7fec8f7fe640 1 -- 172.21.15.17:0/3892294387 learned_addr learned my addr 172.21.15.17:0/3892294387 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.187+0000 7fec8ffff640 1 --2- 172.21.15.17:0/3892294387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec900fdf70 0x7fec900ff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.187+0000 7fec8f7fe640 1 -- 172.21.15.17:0/3892294387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec900fdf70 msgr2=0x7fec900ff150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.187+0000 7fec8f7fe640 1 --2- 172.21.15.17:0/3892294387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec900fdf70 0x7fec900ff150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.187+0000 7fec8f7fe640 1 -- 172.21.15.17:0/3892294387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84009560 con 0x7fec90104b50 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.187+0000 7fec8f7fe640 1 --2- 172.21.15.17:0/3892294387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec90104b50 0x7fec900ff690 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fec8402a9c0 tx=0x7fec840055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.187+0000 7fec8d7fa640 1 -- 172.21.15.17:0/3892294387 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec84004aa0 con 0x7fec90104b50 2024-08-19T01:35:57.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.187+0000 7fec96695640 1 -- 172.21.15.17:0/3892294387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec900fffc0 con 0x7fec90104b50 2024-08-19T01:35:57.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.187+0000 7fec8d7fa640 1 -- 172.21.15.17:0/3892294387 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec84004c00 con 0x7fec90104b50 2024-08-19T01:35:57.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.187+0000 7fec8d7fa640 1 -- 172.21.15.17:0/3892294387 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec84003980 con 0x7fec90104b50 2024-08-19T01:35:57.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.187+0000 7fec96695640 1 -- 172.21.15.17:0/3892294387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec901a1ff0 con 0x7fec90104b50 2024-08-19T01:35:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.188+0000 7fec96695640 1 -- 172.21.15.17:0/3892294387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec900fe3d0 con 0x7fec90104b50 2024-08-19T01:35:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.189+0000 7fec8d7fa640 1 -- 172.21.15.17:0/3892294387 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fec84003bf0 con 0x7fec90104b50 2024-08-19T01:35:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.189+0000 7fec8d7fa640 1 --2- 172.21.15.17:0/3892294387 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fec7806e170 0x7fec78070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:35:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.189+0000 7fec8d7fa640 1 -- 172.21.15.17:0/3892294387 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fec840aefb0 con 0x7fec90104b50 2024-08-19T01:35:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.189+0000 7fec8ffff640 1 --2- 172.21.15.17:0/3892294387 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fec7806e170 0x7fec78070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:35:57.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.190+0000 7fec8ffff640 1 --2- 172.21.15.17:0/3892294387 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fec7806e170 0x7fec78070630 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fec80005fd0 tx=0x7fec8000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:35:57.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.194+0000 7fec8d7fa640 1 -- 172.21.15.17:0/3892294387 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fec84078340 con 0x7fec90104b50 2024-08-19T01:35:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.439+0000 7fec96695640 1 -- 172.21.15.17:0/3892294387 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fec900fffc0 con 0x7fec90104b50 2024-08-19T01:35:57.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.440+0000 7fec8d7fa640 1 -- 172.21.15.17:0/3892294387 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fec900fffc0 con 0x7fec90104b50 2024-08-19T01:35:57.441 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:35:57.442 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:35:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:35:57.443 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:35:57.443 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:35:57.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.442+0000 7fec96695640 1 -- 172.21.15.17:0/3892294387 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fec7806e170 msgr2=0x7fec78070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.442+0000 7fec96695640 1 --2- 172.21.15.17:0/3892294387 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fec7806e170 0x7fec78070630 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fec80005fd0 tx=0x7fec8000b390 comp rx=0 tx=0).stop 2024-08-19T01:35:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.442+0000 7fec96695640 1 -- 172.21.15.17:0/3892294387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec90104b50 msgr2=0x7fec900ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:35:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.442+0000 7fec96695640 1 --2- 172.21.15.17:0/3892294387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec90104b50 0x7fec900ff690 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fec8402a9c0 tx=0x7fec840055a0 comp rx=0 tx=0).stop 2024-08-19T01:35:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.442+0000 7fec96695640 1 -- 172.21.15.17:0/3892294387 shutdown_connections 2024-08-19T01:35:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.442+0000 7fec96695640 1 --2- 172.21.15.17:0/3892294387 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fec7806e170 0x7fec78070630 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.442+0000 7fec96695640 1 --2- 172.21.15.17:0/3892294387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec90104b50 0x7fec900ff690 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.442+0000 7fec96695640 1 --2- 172.21.15.17:0/3892294387 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fec900fdf70 0x7fec900ff150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:35:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.442+0000 7fec96695640 1 -- 172.21.15.17:0/3892294387 >> 172.21.15.17:0/3892294387 conn(0x7fec900f9ec0 msgr2=0x7fec900fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:35:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.442+0000 7fec96695640 1 -- 172.21.15.17:0/3892294387 shutdown_connections 2024-08-19T01:35:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:35:57.442+0000 7fec96695640 1 -- 172.21.15.17:0/3892294387 wait complete. 2024-08-19T01:35:57.744 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:57 smithi017 ceph-mon[99370]: pgmap v1118: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:35:57.744 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:57 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3892294387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:57.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:57 smithi086 ceph-mon[71303]: pgmap v1118: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:35:57.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:57 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3892294387' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:35:58.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-08-19T01:35:58.299 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:35:59.882 INFO:teuthology.orchestra.run.smithi017.stdout:wait for servicemap items w/ changing names to refresh 2024-08-19T01:35:59.882 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:35:59 smithi017 ceph-mon[99370]: pgmap v1119: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:35:59.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:35:59 smithi086 ceph-mon[71303]: pgmap v1119: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:00.550 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'sleep 60' 2024-08-19T01:36:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:36:01.825 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:01 smithi017 ceph-mon[99370]: pgmap v1120: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:01.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:01 smithi086 ceph-mon[71303]: pgmap v1120: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:03.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:03 smithi017 ceph-mon[99370]: pgmap v1121: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:03.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:36:03.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:03 smithi086 ceph-mon[71303]: pgmap v1121: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:03.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:36:05.719 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:05 smithi017 ceph-mon[99370]: pgmap v1122: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:05.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:05 smithi086 ceph-mon[71303]: pgmap v1122: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:07.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:07 smithi017 ceph-mon[99370]: pgmap v1123: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:36:07.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:07 smithi086 ceph-mon[71303]: pgmap v1123: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:36:09.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:09 smithi017 ceph-mon[99370]: pgmap v1124: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:09.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:09 smithi086 ceph-mon[71303]: pgmap v1124: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:11.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:11 smithi086 ceph-mon[71303]: pgmap v1125: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:11.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:11 smithi017 ceph-mon[99370]: pgmap v1125: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:13.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:13 smithi017 ceph-mon[99370]: pgmap v1126: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:13.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:13 smithi086 ceph-mon[71303]: pgmap v1126: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:15.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:15 smithi017 ceph-mon[99370]: pgmap v1127: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:15.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:15 smithi086 ceph-mon[71303]: pgmap v1127: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:17.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:17 smithi017 ceph-mon[99370]: pgmap v1128: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:36:17.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:17 smithi086 ceph-mon[71303]: pgmap v1128: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:36:18.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:36:18.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:36:19.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:19 smithi017 ceph-mon[99370]: pgmap v1129: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:19.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:19 smithi086 ceph-mon[71303]: pgmap v1129: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:21.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:21 smithi017 ceph-mon[99370]: pgmap v1130: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:21.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:21 smithi086 ceph-mon[71303]: pgmap v1130: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:23.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:23 smithi017 ceph-mon[99370]: pgmap v1131: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:23.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:23 smithi086 ceph-mon[71303]: pgmap v1131: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:25.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:25 smithi017 ceph-mon[99370]: pgmap v1132: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:25.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:25 smithi086 ceph-mon[71303]: pgmap v1132: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:27.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:27 smithi017 ceph-mon[99370]: pgmap v1133: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:36:27.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:27 smithi086 ceph-mon[71303]: pgmap v1133: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:36:29.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:29 smithi017 ceph-mon[99370]: pgmap v1134: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:29.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:29 smithi086 ceph-mon[71303]: pgmap v1134: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:31.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:31 smithi017 ceph-mon[99370]: pgmap v1135: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:31.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:31 smithi086 ceph-mon[71303]: pgmap v1135: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:33.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:33 smithi017 ceph-mon[99370]: pgmap v1136: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:33.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:36:33.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:33 smithi086 ceph-mon[71303]: pgmap v1136: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:33.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:36:34.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:36:34.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:36:34.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:36:34.933 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:36:34.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:36:34.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:36:34.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:36:34.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:36:35.712 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:35 smithi017 ceph-mon[99370]: pgmap v1137: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:35.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:35 smithi086 ceph-mon[71303]: pgmap v1137: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:37.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:37 smithi017 ceph-mon[99370]: pgmap v1138: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:36:37.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:37 smithi086 ceph-mon[71303]: pgmap v1138: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:36:39.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:39 smithi017 ceph-mon[99370]: pgmap v1139: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:39.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:39 smithi086 ceph-mon[71303]: pgmap v1139: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:41.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:41 smithi017 ceph-mon[99370]: pgmap v1140: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:41.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:41 smithi086 ceph-mon[71303]: pgmap v1140: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:43.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:43 smithi017 ceph-mon[99370]: pgmap v1141: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:43.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:43 smithi086 ceph-mon[71303]: pgmap v1141: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:45.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:45 smithi017 ceph-mon[99370]: pgmap v1142: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:45.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:45 smithi086 ceph-mon[71303]: pgmap v1142: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:47.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:47 smithi017 ceph-mon[99370]: pgmap v1143: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:36:47.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:47 smithi086 ceph-mon[71303]: pgmap v1143: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:36:48.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:36:48.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:36:49.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:49 smithi017 ceph-mon[99370]: pgmap v1144: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:49.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:49 smithi086 ceph-mon[71303]: pgmap v1144: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:51.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:51 smithi017 ceph-mon[99370]: pgmap v1145: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:51.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:51 smithi086 ceph-mon[71303]: pgmap v1145: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:36:53.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:53 smithi086 ceph-mon[71303]: pgmap v1146: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:54.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:53 smithi017 ceph-mon[99370]: pgmap v1146: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:36:55.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:55 smithi086 ceph-mon[71303]: pgmap v1147: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:56.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:55 smithi017 ceph-mon[99370]: pgmap v1147: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:36:57.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:57 smithi017 ceph-mon[99370]: pgmap v1148: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:36:57.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:57 smithi086 ceph-mon[71303]: pgmap v1148: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:00.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:36:59 smithi017 ceph-mon[99370]: pgmap v1149: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:00.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:36:59 smithi086 ceph-mon[71303]: pgmap v1149: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:02.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:01 smithi017 ceph-mon[99370]: pgmap v1150: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:02.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:01 smithi086 ceph-mon[71303]: pgmap v1150: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:02.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph orch ps' 2024-08-19T01:37:03.199 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:03.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:03 smithi017 ceph-mon[99370]: pgmap v1151: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:03.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:37:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:03 smithi086 ceph-mon[71303]: pgmap v1151: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:04.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:37:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.795+0000 7f08be9d6640 1 -- 172.21.15.17:0/24488863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b81049f0 msgr2=0x7f08b8104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.795+0000 7f08be9d6640 1 --2- 172.21.15.17:0/24488863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b81049f0 0x7f08b8104dd0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f08a8009880 tx=0x7f08a802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.795+0000 7f08be9d6640 1 -- 172.21.15.17:0/24488863 shutdown_connections 2024-08-19T01:37:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.795+0000 7f08be9d6640 1 --2- 172.21.15.17:0/24488863 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b80fe9f0 0x7f08b80fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.795+0000 7f08be9d6640 1 --2- 172.21.15.17:0/24488863 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b81049f0 0x7f08b8104dd0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.795+0000 7f08be9d6640 1 -- 172.21.15.17:0/24488863 >> 172.21.15.17:0/24488863 conn(0x7f08b80758a0 msgr2=0x7f08b80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.795+0000 7f08be9d6640 1 -- 172.21.15.17:0/24488863 shutdown_connections 2024-08-19T01:37:04.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.795+0000 7f08be9d6640 1 -- 172.21.15.17:0/24488863 wait complete. 2024-08-19T01:37:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.795+0000 7f08be9d6640 1 Processor -- start 2024-08-19T01:37:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08be9d6640 1 -- start start 2024-08-19T01:37:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08be9d6640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b80fe9f0 0x7f08b819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08be9d6640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b81049f0 0x7f08b819abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08be9d6640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b819b1f0 con 0x7f08b80fe9f0 2024-08-19T01:37:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08be9d6640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b819b360 con 0x7f08b81049f0 2024-08-19T01:37:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08b7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b80fe9f0 0x7f08b819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08b7fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b80fe9f0 0x7f08b819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38712/0 (socket says 172.21.15.17:38712) 2024-08-19T01:37:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08b7fff640 1 -- 172.21.15.17:0/895193876 learned_addr learned my addr 172.21.15.17:0/895193876 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08affff640 1 --2- 172.21.15.17:0/895193876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b81049f0 0x7f08b819abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:04.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08b7fff640 1 -- 172.21.15.17:0/895193876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b81049f0 msgr2=0x7f08b819abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08b7fff640 1 --2- 172.21.15.17:0/895193876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b81049f0 0x7f08b819abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08b7fff640 1 -- 172.21.15.17:0/895193876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a8009560 con 0x7f08b80fe9f0 2024-08-19T01:37:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.796+0000 7f08b7fff640 1 --2- 172.21.15.17:0/895193876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b80fe9f0 0x7f08b819a6b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f08a802a9c0 tx=0x7f08a80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.797+0000 7f08b5ffb640 1 -- 172.21.15.17:0/895193876 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a8004aa0 con 0x7f08b80fe9f0 2024-08-19T01:37:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.797+0000 7f08be9d6640 1 -- 172.21.15.17:0/895193876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b8194940 con 0x7f08b80fe9f0 2024-08-19T01:37:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.797+0000 7f08b5ffb640 1 -- 172.21.15.17:0/895193876 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f08a8004c00 con 0x7f08b80fe9f0 2024-08-19T01:37:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.797+0000 7f08b5ffb640 1 -- 172.21.15.17:0/895193876 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08a8003ab0 con 0x7f08b80fe9f0 2024-08-19T01:37:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.797+0000 7f08be9d6640 1 -- 172.21.15.17:0/895193876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b8194e30 con 0x7f08b80fe9f0 2024-08-19T01:37:04.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.798+0000 7f08be9d6640 1 -- 172.21.15.17:0/895193876 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b8100130 con 0x7f08b80fe9f0 2024-08-19T01:37:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.798+0000 7f08b5ffb640 1 -- 172.21.15.17:0/895193876 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f08a8031d20 con 0x7f08b80fe9f0 2024-08-19T01:37:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.799+0000 7f08b5ffb640 1 --2- 172.21.15.17:0/895193876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f08a406e170 0x7f08a4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.799+0000 7f08b5ffb640 1 -- 172.21.15.17:0/895193876 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f08a80af310 con 0x7f08b80fe9f0 2024-08-19T01:37:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.799+0000 7f08affff640 1 --2- 172.21.15.17:0/895193876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f08a406e170 0x7f08a4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:04.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.799+0000 7f08affff640 1 --2- 172.21.15.17:0/895193876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f08a406e170 0x7f08a4070630 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f08b8195f80 tx=0x7f08a0005cc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:04.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.803+0000 7f08b5ffb640 1 -- 172.21.15.17:0/895193876 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f08a8078550 con 0x7f08b80fe9f0 2024-08-19T01:37:04.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.985+0000 7f08be9d6640 1 -- 172.21.15.17:0/895193876 --> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f08b810bd70 con 0x7f08a406e170 2024-08-19T01:37:04.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.995+0000 7f08b5ffb640 1 -- 172.21.15.17:0/895193876 <== mgr.34104 v2:172.21.15.17:6800/578379619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f08b810bd70 con 0x7f08a406e170 2024-08-19T01:37:04.996 INFO:teuthology.orchestra.run.smithi017.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-19T01:37:04.996 INFO:teuthology.orchestra.run.smithi017.stdout:alertmanager.smithi017 smithi017 *:9093,9094 running (38m) 99s ago 48m 25.3M - 0.25.0 c8568f914cd2 ef94e81ef6bf 2024-08-19T01:37:04.996 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi017 smithi017 running (109s) 99s ago 49m 8120k - 19.1.0-1382-gde09dd01 ea7a5189f30b 2c4608603f6b 2024-08-19T01:37:04.996 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-exporter.smithi086 smithi086 running (104s) 98s ago 48m 7285k - 19.1.0-1382-gde09dd01 ea7a5189f30b f4befa275518 2024-08-19T01:37:04.996 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi017 smithi017 running (36m) 99s ago 49m 6891k - 19.1.0-1382-gde09dd01 ea7a5189f30b a8e7a9dcde81 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:crash.smithi086 smithi086 running (36m) 98s ago 48m 6895k - 19.1.0-1382-gde09dd01 ea7a5189f30b 751907fd26f0 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:grafana.smithi017 smithi017 *:3000 running (38m) 99s ago 48m 77.5M - 9.4.12 2bacad6d85d8 5542914bceef 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.gvlpoy smithi017 running (32m) 99s ago 43m 26.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b 5aa49804c26c 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi017.junbdp smithi017 running (32m) 99s ago 43m 86.9M - 19.1.0-1382-gde09dd01 ea7a5189f30b c915dcf817f2 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.oncasl smithi086 running (16m) 98s ago 43m 20.1M - 19.1.0-1382-gde09dd01 ea7a5189f30b 8a1227aa865a 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:mds.cephfs.smithi086.uxhjfl smithi086 running (32m) 98s ago 43m 24.2M - 19.1.0-1382-gde09dd01 ea7a5189f30b cf32c75f32a2 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi017.hfpawi smithi017 *:8443,9283,8765 running (40m) 99s ago 50m 511M - 19.1.0-1382-gde09dd01 ea7a5189f30b 9c8905bba5a5 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:mgr.smithi086.uthxct smithi086 *:8443,9283,8765 running (39m) 98s ago 48m 449M - 19.1.0-1382-gde09dd01 ea7a5189f30b c167bf8c313b 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi017 smithi017 running (37m) 99s ago 50m 85.1M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b d3c8cdedb454 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:mon.smithi086 smithi086 running (36m) 98s ago 47m 61.0M 2048M 19.1.0-1382-gde09dd01 ea7a5189f30b 1ffcf46dbba9 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi017 smithi017 *:9100 running (39m) 99s ago 49m 15.7M - 1.5.0 0da6a335fe13 4ccfc5a5f226 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:node-exporter.smithi086 smithi086 *:9100 running (38m) 98s ago 48m 15.3M - 1.5.0 0da6a335fe13 b32d9e32a747 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 smithi017 running (35m) 99s ago 47m 96.4M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 759a865efe38 2024-08-19T01:37:04.997 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 smithi017 running (35m) 99s ago 46m 103M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b 146db8dc74d1 2024-08-19T01:37:04.998 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 smithi017 running (34m) 99s ago 46m 92.5M 1217M 19.1.0-1382-gde09dd01 ea7a5189f30b d03c5f91e697 2024-08-19T01:37:04.998 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 smithi086 running (34m) 98s ago 45m 104M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b da32fbdb0453 2024-08-19T01:37:04.998 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 smithi086 running (33m) 98s ago 45m 93.4M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 9bce1ba418a6 2024-08-19T01:37:04.998 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 smithi086 running (32m) 98s ago 45m 96.0M 2240M 19.1.0-1382-gde09dd01 ea7a5189f30b 6816a54a030f 2024-08-19T01:37:04.998 INFO:teuthology.orchestra.run.smithi017.stdout:prometheus.smithi017 smithi017 *:9095 running (38m) 99s ago 48m 82.6M - 2.43.0 a07b618ecd1d afa66134d5ca 2024-08-19T01:37:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.997+0000 7f08be9d6640 1 -- 172.21.15.17:0/895193876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f08a406e170 msgr2=0x7f08a4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.997+0000 7f08be9d6640 1 --2- 172.21.15.17:0/895193876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f08a406e170 0x7f08a4070630 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f08b8195f80 tx=0x7f08a0005cc0 comp rx=0 tx=0).stop 2024-08-19T01:37:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.997+0000 7f08be9d6640 1 -- 172.21.15.17:0/895193876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b80fe9f0 msgr2=0x7f08b819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.997+0000 7f08be9d6640 1 --2- 172.21.15.17:0/895193876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b80fe9f0 0x7f08b819a6b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f08a802a9c0 tx=0x7f08a80055a0 comp rx=0 tx=0).stop 2024-08-19T01:37:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.997+0000 7f08be9d6640 1 -- 172.21.15.17:0/895193876 shutdown_connections 2024-08-19T01:37:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.997+0000 7f08be9d6640 1 --2- 172.21.15.17:0/895193876 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f08a406e170 0x7f08a4070630 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.997+0000 7f08be9d6640 1 --2- 172.21.15.17:0/895193876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f08b81049f0 0x7f08b819abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.997+0000 7f08be9d6640 1 --2- 172.21.15.17:0/895193876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f08b80fe9f0 0x7f08b819a6b0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.997+0000 7f08be9d6640 1 -- 172.21.15.17:0/895193876 >> 172.21.15.17:0/895193876 conn(0x7f08b80758a0 msgr2=0x7f08b80fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.998+0000 7f08be9d6640 1 -- 172.21.15.17:0/895193876 shutdown_connections 2024-08-19T01:37:04.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:04.998+0000 7f08be9d6640 1 -- 172.21.15.17:0/895193876 wait complete. 2024-08-19T01:37:05.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph versions' 2024-08-19T01:37:05.783 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:05.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:05 smithi017 ceph-mon[99370]: pgmap v1152: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:05.904 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:05 smithi017 ceph-mon[99370]: from='client.36048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:37:06.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:05 smithi086 ceph-mon[71303]: pgmap v1152: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:06.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:05 smithi086 ceph-mon[71303]: from='client.36048 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-19T01:37:07.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.317+0000 7fa307e11640 1 -- 172.21.15.17:0/893629255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300104a30 msgr2=0x7fa300104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:07.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.317+0000 7fa307e11640 1 --2- 172.21.15.17:0/893629255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300104a30 0x7fa300104e10 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009880 tx=0x7fa2fc02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:07.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.317+0000 7fa307e11640 1 -- 172.21.15.17:0/893629255 shutdown_connections 2024-08-19T01:37:07.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.317+0000 7fa307e11640 1 --2- 172.21.15.17:0/893629255 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa3000fea30 0x7fa3000fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.317+0000 7fa307e11640 1 --2- 172.21.15.17:0/893629255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa300104a30 0x7fa300104e10 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.317+0000 7fa307e11640 1 -- 172.21.15.17:0/893629255 >> 172.21.15.17:0/893629255 conn(0x7fa3000fa730 msgr2=0x7fa3000fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.317+0000 7fa307e11640 1 -- 172.21.15.17:0/893629255 shutdown_connections 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.317+0000 7fa307e11640 1 -- 172.21.15.17:0/893629255 wait complete. 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.318+0000 7fa307e11640 1 Processor -- start 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.318+0000 7fa307e11640 1 -- start start 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.318+0000 7fa307e11640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3000fea30 0x7fa3000faff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.318+0000 7fa307e11640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa300104a30 0x7fa3000fb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.318+0000 7fa307e11640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000fba70 con 0x7fa3000fea30 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.318+0000 7fa307e11640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000fbbe0 con 0x7fa300104a30 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.318+0000 7fa305bad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3000fea30 0x7fa3000faff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:07.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.318+0000 7fa305bad640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3000fea30 0x7fa3000faff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59180/0 (socket says 172.21.15.17:59180) 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.318+0000 7fa305bad640 1 -- 172.21.15.17:0/1140465919 learned_addr learned my addr 172.21.15.17:0/1140465919 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.318+0000 7fa3053ac640 1 --2- 172.21.15.17:0/1140465919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa300104a30 0x7fa3000fb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.319+0000 7fa305bad640 1 -- 172.21.15.17:0/1140465919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa300104a30 msgr2=0x7fa3000fb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.319+0000 7fa305bad640 1 --2- 172.21.15.17:0/1140465919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa300104a30 0x7fa3000fb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.319+0000 7fa305bad640 1 -- 172.21.15.17:0/1140465919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc009560 con 0x7fa3000fea30 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.319+0000 7fa305bad640 1 --2- 172.21.15.17:0/1140465919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3000fea30 0x7fa3000faff0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc02a9c0 tx=0x7fa2fc0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.319+0000 7fa2f2ffd640 1 -- 172.21.15.17:0/1140465919 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2fc004aa0 con 0x7fa3000fea30 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.319+0000 7fa2f2ffd640 1 -- 172.21.15.17:0/1140465919 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa2fc004c00 con 0x7fa3000fea30 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.319+0000 7fa307e11640 1 -- 172.21.15.17:0/1140465919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3000fbe60 con 0x7fa3000fea30 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.319+0000 7fa2f2ffd640 1 -- 172.21.15.17:0/1140465919 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2fc003ab0 con 0x7fa3000fea30 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.319+0000 7fa307e11640 1 -- 172.21.15.17:0/1140465919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3001a1f40 con 0x7fa3000fea30 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.320+0000 7fa307e11640 1 -- 172.21.15.17:0/1140465919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa300100170 con 0x7fa3000fea30 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.321+0000 7fa2f2ffd640 1 -- 172.21.15.17:0/1140465919 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa2fc031d20 con 0x7fa3000fea30 2024-08-19T01:37:07.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.321+0000 7fa2f2ffd640 1 --2- 172.21.15.17:0/1140465919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa2ec06e170 0x7fa2ec070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.321+0000 7fa3053ac640 1 --2- 172.21.15.17:0/1140465919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa2ec06e170 0x7fa2ec070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.321+0000 7fa2f2ffd640 1 -- 172.21.15.17:0/1140465919 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa2fc0aef70 con 0x7fa3000fea30 2024-08-19T01:37:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.322+0000 7fa3053ac640 1 --2- 172.21.15.17:0/1140465919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa2ec06e170 0x7fa2ec070630 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa3000fc770 tx=0x7fa2f400a250 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:07.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.326+0000 7fa2f2ffd640 1 -- 172.21.15.17:0/1140465919 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa2fc0e3df0 con 0x7fa3000fea30 2024-08-19T01:37:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.573+0000 7fa307e11640 1 -- 172.21.15.17:0/1140465919 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa3000fbe60 con 0x7fa3000fea30 2024-08-19T01:37:07.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.573+0000 7fa2f2ffd640 1 -- 172.21.15.17:0/1140465919 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7fa3000fbe60 con 0x7fa3000fea30 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": { 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": { 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 2 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": { 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 6 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": { 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 4 2024-08-19T01:37:07.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-08-19T01:37:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "overall": { 2024-08-19T01:37:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)": 14 2024-08-19T01:37:07.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-08-19T01:37:07.576 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-08-19T01:37:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.575+0000 7fa307e11640 1 -- 172.21.15.17:0/1140465919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa2ec06e170 msgr2=0x7fa2ec070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.575+0000 7fa307e11640 1 --2- 172.21.15.17:0/1140465919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa2ec06e170 0x7fa2ec070630 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa3000fc770 tx=0x7fa2f400a250 comp rx=0 tx=0).stop 2024-08-19T01:37:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.575+0000 7fa307e11640 1 -- 172.21.15.17:0/1140465919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3000fea30 msgr2=0x7fa3000faff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.575+0000 7fa307e11640 1 --2- 172.21.15.17:0/1140465919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3000fea30 0x7fa3000faff0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc02a9c0 tx=0x7fa2fc0055a0 comp rx=0 tx=0).stop 2024-08-19T01:37:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.575+0000 7fa307e11640 1 -- 172.21.15.17:0/1140465919 shutdown_connections 2024-08-19T01:37:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.575+0000 7fa307e11640 1 --2- 172.21.15.17:0/1140465919 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa2ec06e170 0x7fa2ec070630 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.575+0000 7fa307e11640 1 --2- 172.21.15.17:0/1140465919 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa300104a30 0x7fa3000fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.575+0000 7fa307e11640 1 --2- 172.21.15.17:0/1140465919 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3000fea30 0x7fa3000faff0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.575+0000 7fa307e11640 1 -- 172.21.15.17:0/1140465919 >> 172.21.15.17:0/1140465919 conn(0x7fa3000fa730 msgr2=0x7fa300068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.575+0000 7fa307e11640 1 -- 172.21.15.17:0/1140465919 shutdown_connections 2024-08-19T01:37:07.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:07.575+0000 7fa307e11640 1 -- 172.21.15.17:0/1140465919 wait complete. 2024-08-19T01:37:07.835 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:07 smithi017 ceph-mon[99370]: pgmap v1153: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:07.835 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:07 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1140465919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:37:07.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:07 smithi086 ceph-mon[71303]: pgmap v1153: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:07.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:07 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1140465919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:37:08.188 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-08-19T01:37:08.396 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:09.760 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:09 smithi017 ceph-mon[99370]: pgmap v1154: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:10.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.008+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1582298016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27ec1016d0 msgr2=0x7f27ec109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:10.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.008+0000 7f27f2d5c640 1 --2- 172.21.15.17:0/1582298016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27ec1016d0 0x7f27ec109bc0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009880 tx=0x7f27d802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.008+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1582298016 shutdown_connections 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.008+0000 7f27f2d5c640 1 --2- 172.21.15.17:0/1582298016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27ec1016d0 0x7f27ec109bc0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.008+0000 7f27f2d5c640 1 --2- 172.21.15.17:0/1582298016 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec100db0 0x7f27ec101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.008+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1582298016 >> 172.21.15.17:0/1582298016 conn(0x7f27ec0fa730 msgr2=0x7f27ec0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.008+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1582298016 shutdown_connections 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.008+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1582298016 wait complete. 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.009+0000 7f27f2d5c640 1 Processor -- start 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.009+0000 7f27f2d5c640 1 -- start start 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.009+0000 7f27f2d5c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec100db0 0x7f27ec19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.009+0000 7f27f2d5c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27ec1016d0 0x7f27ec193710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.009+0000 7f27f2d5c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec193da0 con 0x7f27ec1016d0 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.009+0000 7f27f2d5c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec193f10 con 0x7f27ec100db0 2024-08-19T01:37:10.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.010+0000 7f27ebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27ec1016d0 0x7f27ec193710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:10.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.010+0000 7f27ebfff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27ec1016d0 0x7f27ec193710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59188/0 (socket says 172.21.15.17:59188) 2024-08-19T01:37:10.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.010+0000 7f27ebfff640 1 -- 172.21.15.17:0/1309465372 learned_addr learned my addr 172.21.15.17:0/1309465372 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:10.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.010+0000 7f27f0af8640 1 --2- 172.21.15.17:0/1309465372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec100db0 0x7f27ec19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:10.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.010+0000 7f27ebfff640 1 -- 172.21.15.17:0/1309465372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec100db0 msgr2=0x7f27ec19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:10.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.010+0000 7f27ebfff640 1 --2- 172.21.15.17:0/1309465372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec100db0 0x7f27ec19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:10.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.010+0000 7f27ebfff640 1 -- 172.21.15.17:0/1309465372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d8009560 con 0x7f27ec1016d0 2024-08-19T01:37:10.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.010+0000 7f27ebfff640 1 --2- 172.21.15.17:0/1309465372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27ec1016d0 0x7f27ec193710 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f27d802a9c0 tx=0x7f27d8032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:10.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.011+0000 7f27e9ffb640 1 -- 172.21.15.17:0/1309465372 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27d80037c0 con 0x7f27ec1016d0 2024-08-19T01:37:10.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.011+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1309465372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec194190 con 0x7f27ec1016d0 2024-08-19T01:37:10.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.011+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1309465372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec198220 con 0x7f27ec1016d0 2024-08-19T01:37:10.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.011+0000 7f27e9ffb640 1 -- 172.21.15.17:0/1309465372 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27d8005d50 con 0x7f27ec1016d0 2024-08-19T01:37:10.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.011+0000 7f27e9ffb640 1 -- 172.21.15.17:0/1309465372 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27d803be10 con 0x7f27ec1016d0 2024-08-19T01:37:10.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.012+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1309465372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d0005250 con 0x7f27ec1016d0 2024-08-19T01:37:10.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.013+0000 7f27e9ffb640 1 -- 172.21.15.17:0/1309465372 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f27d803a3c0 con 0x7f27ec1016d0 2024-08-19T01:37:10.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.013+0000 7f27e9ffb640 1 --2- 172.21.15.17:0/1309465372 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f27dc06e170 0x7f27dc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:10.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.013+0000 7f27e9ffb640 1 -- 172.21.15.17:0/1309465372 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f27d80aed80 con 0x7f27ec1016d0 2024-08-19T01:37:10.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.013+0000 7f27f0af8640 1 --2- 172.21.15.17:0/1309465372 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f27dc06e170 0x7f27dc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:10.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.014+0000 7f27f0af8640 1 --2- 172.21.15.17:0/1309465372 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f27dc06e170 0x7f27dc070630 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f27e0005d00 tx=0x7f27e000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:10.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.017+0000 7f27e9ffb640 1 -- 172.21.15.17:0/1309465372 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f27d8078110 con 0x7f27ec1016d0 2024-08-19T01:37:10.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:09 smithi086 ceph-mon[71303]: pgmap v1154: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:10.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.264+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1309465372 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f27d0005d10 con 0x7f27ec1016d0 2024-08-19T01:37:10.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.265+0000 7f27e9ffb640 1 -- 172.21.15.17:0/1309465372 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f27d807b7d0 con 0x7f27ec1016d0 2024-08-19T01:37:10.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.267+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1309465372 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f27dc06e170 msgr2=0x7f27dc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:10.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.267+0000 7f27f2d5c640 1 --2- 172.21.15.17:0/1309465372 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f27dc06e170 0x7f27dc070630 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f27e0005d00 tx=0x7f27e000b410 comp rx=0 tx=0).stop 2024-08-19T01:37:10.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.267+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1309465372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27ec1016d0 msgr2=0x7f27ec193710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:10.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.267+0000 7f27f2d5c640 1 --2- 172.21.15.17:0/1309465372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27ec1016d0 0x7f27ec193710 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f27d802a9c0 tx=0x7f27d8032bb0 comp rx=0 tx=0).stop 2024-08-19T01:37:10.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.267+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1309465372 shutdown_connections 2024-08-19T01:37:10.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.267+0000 7f27f2d5c640 1 --2- 172.21.15.17:0/1309465372 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f27dc06e170 0x7f27dc070630 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:10.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.267+0000 7f27f2d5c640 1 --2- 172.21.15.17:0/1309465372 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27ec1016d0 0x7f27ec193710 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:10.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.267+0000 7f27f2d5c640 1 --2- 172.21.15.17:0/1309465372 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f27ec100db0 0x7f27ec19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:10.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.267+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1309465372 >> 172.21.15.17:0/1309465372 conn(0x7f27ec0fa730 msgr2=0x7f27ec0fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:10.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.267+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1309465372 shutdown_connections 2024-08-19T01:37:10.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:10.267+0000 7f27f2d5c640 1 -- 172.21.15.17:0/1309465372 wait complete. 2024-08-19T01:37:10.277 INFO:teuthology.orchestra.run.smithi017.stdout:true 2024-08-19T01:37:10.889 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:10 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1309465372' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:37:10.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -e sha1=de09dd018de4baddfa6ca4d43bc8fb784cf75833 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-08-19T01:37:11.125 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:11.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:10 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1309465372' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:37:11.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:11 smithi017 ceph-mon[99370]: pgmap v1155: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:12.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:11 smithi086 ceph-mon[71303]: pgmap v1155: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.759+0000 7f6d6c80f640 1 -- 172.21.15.17:0/79672795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d68100d30 msgr2=0x7f6d68101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.759+0000 7f6d6c80f640 1 --2- 172.21.15.17:0/79672795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d68100d30 0x7f6d68101110 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009880 tx=0x7f6d5802a530 comp rx=0 tx=0).stop 2024-08-19T01:37:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.759+0000 7f6d6c80f640 1 -- 172.21.15.17:0/79672795 shutdown_connections 2024-08-19T01:37:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.759+0000 7f6d6c80f640 1 --2- 172.21.15.17:0/79672795 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d68101650 0x7f6d68109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.759+0000 7f6d6c80f640 1 --2- 172.21.15.17:0/79672795 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d68100d30 0x7f6d68101110 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.759+0000 7f6d6c80f640 1 -- 172.21.15.17:0/79672795 >> 172.21.15.17:0/79672795 conn(0x7f6d680758a0 msgr2=0x7f6d680fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.759+0000 7f6d6c80f640 1 -- 172.21.15.17:0/79672795 shutdown_connections 2024-08-19T01:37:12.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.759+0000 7f6d6c80f640 1 -- 172.21.15.17:0/79672795 wait complete. 2024-08-19T01:37:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.760+0000 7f6d6c80f640 1 Processor -- start 2024-08-19T01:37:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.760+0000 7f6d6c80f640 1 -- start start 2024-08-19T01:37:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.760+0000 7f6d6c80f640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d68100d30 0x7f6d680fe990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.760+0000 7f6d6c80f640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d68101650 0x7f6d680feed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.760+0000 7f6d6c80f640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680ff410 con 0x7f6d68101650 2024-08-19T01:37:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.760+0000 7f6d6c80f640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680ff580 con 0x7f6d68100d30 2024-08-19T01:37:12.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d68101650 0x7f6d680feed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d5ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d68101650 0x7f6d680feed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59212/0 (socket says 172.21.15.17:59212) 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d5ffff640 1 -- 172.21.15.17:0/3584875782 learned_addr learned my addr 172.21.15.17:0/3584875782 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d6659c640 1 --2- 172.21.15.17:0/3584875782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d68100d30 0x7f6d680fe990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d5ffff640 1 -- 172.21.15.17:0/3584875782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d68100d30 msgr2=0x7f6d680fe990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d5ffff640 1 --2- 172.21.15.17:0/3584875782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d68100d30 0x7f6d680fe990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d5ffff640 1 -- 172.21.15.17:0/3584875782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58009560 con 0x7f6d68101650 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d5ffff640 1 --2- 172.21.15.17:0/3584875782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d68101650 0x7f6d680feed0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000e970 tx=0x7f6d5000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d5f7fe640 1 -- 172.21.15.17:0/3584875782 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d5000cc90 con 0x7f6d68101650 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d6c80f640 1 -- 172.21.15.17:0/3584875782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d681a1ce0 con 0x7f6d68101650 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d5f7fe640 1 -- 172.21.15.17:0/3584875782 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d5000cdf0 con 0x7f6d68101650 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d5f7fe640 1 -- 172.21.15.17:0/3584875782 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d50018810 con 0x7f6d68101650 2024-08-19T01:37:12.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.761+0000 7f6d6c80f640 1 -- 172.21.15.17:0/3584875782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d681a2040 con 0x7f6d68101650 2024-08-19T01:37:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.762+0000 7f6d6c80f640 1 -- 172.21.15.17:0/3584875782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d68068490 con 0x7f6d68101650 2024-08-19T01:37:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.763+0000 7f6d5f7fe640 1 -- 172.21.15.17:0/3584875782 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6d50010c10 con 0x7f6d68101650 2024-08-19T01:37:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.763+0000 7f6d5f7fe640 1 --2- 172.21.15.17:0/3584875782 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d5406e180 0x7f6d54070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:12.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.763+0000 7f6d5f7fe640 1 -- 172.21.15.17:0/3584875782 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6d50014070 con 0x7f6d68101650 2024-08-19T01:37:12.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.763+0000 7f6d6659c640 1 --2- 172.21.15.17:0/3584875782 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d5406e180 0x7f6d54070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:12.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.764+0000 7f6d6659c640 1 --2- 172.21.15.17:0/3584875782 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d5406e180 0x7f6d54070640 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6d58031440 tx=0x7f6d58005d50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:12.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:12.768+0000 7f6d5f7fe640 1 -- 172.21.15.17:0/3584875782 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6d50053df0 con 0x7f6d68101650 2024-08-19T01:37:13.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.018+0000 7f6d6c80f640 1 -- 172.21.15.17:0/3584875782 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6d68104420 con 0x7f6d68101650 2024-08-19T01:37:13.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.019+0000 7f6d5f7fe640 1 -- 172.21.15.17:0/3584875782 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+618 (secure 0 0 0) 0x7f6d5005b4d0 con 0x7f6d68101650 2024-08-19T01:37:13.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.021+0000 7f6d6c80f640 1 -- 172.21.15.17:0/3584875782 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d5406e180 msgr2=0x7f6d54070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:13.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.021+0000 7f6d6c80f640 1 --2- 172.21.15.17:0/3584875782 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d5406e180 0x7f6d54070640 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6d58031440 tx=0x7f6d58005d50 comp rx=0 tx=0).stop 2024-08-19T01:37:13.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.021+0000 7f6d6c80f640 1 -- 172.21.15.17:0/3584875782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d68101650 msgr2=0x7f6d680feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:13.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.021+0000 7f6d6c80f640 1 --2- 172.21.15.17:0/3584875782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d68101650 0x7f6d680feed0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f6d5000e970 tx=0x7f6d5000ee30 comp rx=0 tx=0).stop 2024-08-19T01:37:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.021+0000 7f6d6c80f640 1 -- 172.21.15.17:0/3584875782 shutdown_connections 2024-08-19T01:37:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.021+0000 7f6d6c80f640 1 --2- 172.21.15.17:0/3584875782 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6d5406e180 0x7f6d54070640 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.021+0000 7f6d6c80f640 1 --2- 172.21.15.17:0/3584875782 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6d68101650 0x7f6d680feed0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.021+0000 7f6d6c80f640 1 --2- 172.21.15.17:0/3584875782 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6d68100d30 0x7f6d680fe990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.021+0000 7f6d6c80f640 1 -- 172.21.15.17:0/3584875782 >> 172.21.15.17:0/3584875782 conn(0x7f6d680758a0 msgr2=0x7f6d68101fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.021+0000 7f6d6c80f640 1 -- 172.21.15.17:0/3584875782 shutdown_connections 2024-08-19T01:37:13.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:13.021+0000 7f6d6c80f640 1 -- 172.21.15.17:0/3584875782 wait complete. 2024-08-19T01:37:13.031 INFO:teuthology.orchestra.run.smithi017.stdout: "ceph version 19.1.0-1382-gde09dd01 (de09dd018de4baddfa6ca4d43bc8fb784cf75833) squid (rc)" 2024-08-19T01:37:13.609 DEBUG:teuthology.parallel:result is None 2024-08-19T01:37:13.610 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-19T01:37:13.626 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T01:37:13.626 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-19T01:37:13.838 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:13.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:13 smithi017 ceph-mon[99370]: pgmap v1156: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:13.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:13 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3584875782' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:37:14.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:13 smithi086 ceph-mon[71303]: pgmap v1156: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:14.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:13 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3584875782' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-08-19T01:37:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.554+0000 7fd67d7c5640 1 -- 172.21.15.17:0/4242301856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd678101600 msgr2=0x7fd678109af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.554+0000 7fd67d7c5640 1 --2- 172.21.15.17:0/4242301856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd678101600 0x7fd678109af0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fd66c0098b0 tx=0x7fd66c02a4d0 comp rx=0 tx=0).stop 2024-08-19T01:37:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.554+0000 7fd67d7c5640 1 -- 172.21.15.17:0/4242301856 shutdown_connections 2024-08-19T01:37:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.554+0000 7fd67d7c5640 1 --2- 172.21.15.17:0/4242301856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd678101600 0x7fd678109af0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.554+0000 7fd67d7c5640 1 --2- 172.21.15.17:0/4242301856 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd678100c50 0x7fd678101030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.554+0000 7fd67d7c5640 1 -- 172.21.15.17:0/4242301856 >> 172.21.15.17:0/4242301856 conn(0x7fd6780fa700 msgr2=0x7fd6780fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.554+0000 7fd67d7c5640 1 -- 172.21.15.17:0/4242301856 shutdown_connections 2024-08-19T01:37:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.554+0000 7fd67d7c5640 1 -- 172.21.15.17:0/4242301856 wait complete. 2024-08-19T01:37:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.555+0000 7fd67d7c5640 1 Processor -- start 2024-08-19T01:37:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.555+0000 7fd67d7c5640 1 -- start start 2024-08-19T01:37:15.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.555+0000 7fd67d7c5640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd678100c50 0x7fd678197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.555+0000 7fd67d7c5640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd678101600 0x7fd678198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.555+0000 7fd67d7c5640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd678198910 con 0x7fd678100c50 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.555+0000 7fd67d7c5640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67819c680 con 0x7fd678101600 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.555+0000 7fd676ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd678100c50 0x7fd678197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.555+0000 7fd676ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd678100c50 0x7fd678197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:59218/0 (socket says 172.21.15.17:59218) 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.555+0000 7fd676ffd640 1 -- 172.21.15.17:0/3616799665 learned_addr learned my addr 172.21.15.17:0/3616799665 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.556+0000 7fd676ffd640 1 -- 172.21.15.17:0/3616799665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd678101600 msgr2=0x7fd678198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.556+0000 7fd676ffd640 1 --2- 172.21.15.17:0/3616799665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd678101600 0x7fd678198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.556+0000 7fd676ffd640 1 -- 172.21.15.17:0/3616799665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c009560 con 0x7fd678100c50 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.556+0000 7fd676ffd640 1 --2- 172.21.15.17:0/3616799665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd678100c50 0x7fd678197d40 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd66800ea00 tx=0x7fd66800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.556+0000 7fd65ffff640 1 -- 172.21.15.17:0/3616799665 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd66800cd50 con 0x7fd678100c50 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.556+0000 7fd65ffff640 1 -- 172.21.15.17:0/3616799665 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd668005020 con 0x7fd678100c50 2024-08-19T01:37:15.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.556+0000 7fd67d7c5640 1 -- 172.21.15.17:0/3616799665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67819c960 con 0x7fd678100c50 2024-08-19T01:37:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.556+0000 7fd65ffff640 1 -- 172.21.15.17:0/3616799665 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6680116a0 con 0x7fd678100c50 2024-08-19T01:37:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.556+0000 7fd67d7c5640 1 -- 172.21.15.17:0/3616799665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67819ceb0 con 0x7fd678100c50 2024-08-19T01:37:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.557+0000 7fd67d7c5640 1 -- 172.21.15.17:0/3616799665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd678068d30 con 0x7fd678100c50 2024-08-19T01:37:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.558+0000 7fd65ffff640 1 -- 172.21.15.17:0/3616799665 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd668005190 con 0x7fd678100c50 2024-08-19T01:37:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.558+0000 7fd65ffff640 1 --2- 172.21.15.17:0/3616799665 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd66006e170 0x7fd660070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.558+0000 7fd65ffff640 1 -- 172.21.15.17:0/3616799665 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd66808e490 con 0x7fd678100c50 2024-08-19T01:37:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.559+0000 7fd6767fc640 1 --2- 172.21.15.17:0/3616799665 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd66006e170 0x7fd660070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.559+0000 7fd6767fc640 1 --2- 172.21.15.17:0/3616799665 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd66006e170 0x7fd660070630 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd66c02a9f0 tx=0x7fd66c000bc0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.563+0000 7fd65ffff640 1 -- 172.21.15.17:0/3616799665 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd6680577f0 con 0x7fd678100c50 2024-08-19T01:37:15.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.776+0000 7fd67d7c5640 1 -- 172.21.15.17:0/3616799665 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd678101030 con 0x7fd678100c50 2024-08-19T01:37:15.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.777+0000 7fd65ffff640 1 -- 172.21.15.17:0/3616799665 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 41 v41) v1 ==== 76+0+2002 (secure 0 0 0) 0x7fd66801f7f0 con 0x7fd678100c50 2024-08-19T01:37:15.778 INFO:teuthology.orchestra.run.smithi017.stdout:e41 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:btime 2024-08-19T01:35:33:536022+0000 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:legacy client fscid: 1 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:Filesystem 'cephfs' (1) 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:fs_name cephfs 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 41 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-08-19T00:53:21.603255+0000 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-08-19T01:35:32.667950+0000 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:tableserver 0 2024-08-19T01:37:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:root 0 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:session_timeout 60 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:session_autoclose 300 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:max_file_size 1099511627776 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:max_xattr_size 65536 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:required_client_features {} 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure 0 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:last_failure_osd_epoch 81 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:max_mds 2 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:in 0,1 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:up {0=34388,1=34420} 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:failed 2024-08-19T01:37:15.780 INFO:teuthology.orchestra.run.smithi017.stdout:damaged 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:stopped 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:data_pools [3] 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:metadata_pool 2 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:inline_data enabled 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:balancer 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:bal_rank_mask -1 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:standby_count_wanted 1 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:qdb_cluster leader: 34388 members: 34388,34420 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.junbdp{0:34388} state up:active seq 467 join_fscid=1 addr [v2:172.21.15.17:6826/2640473134,v1:172.21.15.17:6827/2640473134] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.uxhjfl{0:44345} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.86:6824/3534897978,v1:172.21.15.86:6825/3534897978] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi017.gvlpoy{1:34420} state up:active seq 463 join_fscid=1 addr [v2:172.21.15.17:6828/3785389116,v1:172.21.15.17:6829/3785389116] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.cephfs.smithi086.oncasl{1:44907} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.86:6826/540250441,v1:172.21.15.86:6827/540250441] compat {c=[1],r=[1],i=[1fff]}] 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:15.781 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:15.782 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 41 2024-08-19T01:37:15.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.779+0000 7fd67d7c5640 1 -- 172.21.15.17:0/3616799665 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd66006e170 msgr2=0x7fd660070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:15.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.779+0000 7fd67d7c5640 1 --2- 172.21.15.17:0/3616799665 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd66006e170 0x7fd660070630 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd66c02a9f0 tx=0x7fd66c000bc0 comp rx=0 tx=0).stop 2024-08-19T01:37:15.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.779+0000 7fd67d7c5640 1 -- 172.21.15.17:0/3616799665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd678100c50 msgr2=0x7fd678197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:15.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.779+0000 7fd67d7c5640 1 --2- 172.21.15.17:0/3616799665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd678100c50 0x7fd678197d40 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fd66800ea00 tx=0x7fd66800eec0 comp rx=0 tx=0).stop 2024-08-19T01:37:15.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.779+0000 7fd67d7c5640 1 -- 172.21.15.17:0/3616799665 shutdown_connections 2024-08-19T01:37:15.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.779+0000 7fd67d7c5640 1 --2- 172.21.15.17:0/3616799665 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd66006e170 0x7fd660070630 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.779+0000 7fd67d7c5640 1 --2- 172.21.15.17:0/3616799665 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd678101600 0x7fd678198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.779+0000 7fd67d7c5640 1 --2- 172.21.15.17:0/3616799665 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd678100c50 0x7fd678197d40 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.779+0000 7fd67d7c5640 1 -- 172.21.15.17:0/3616799665 >> 172.21.15.17:0/3616799665 conn(0x7fd6780fa700 msgr2=0x7fd6780ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.779+0000 7fd67d7c5640 1 -- 172.21.15.17:0/3616799665 shutdown_connections 2024-08-19T01:37:15.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:15.779+0000 7fd67d7c5640 1 -- 172.21.15.17:0/3616799665 wait complete. 2024-08-19T01:37:15.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:15 smithi017 ceph-mon[99370]: pgmap v1157: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:16.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:15 smithi086 ceph-mon[71303]: pgmap v1157: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:16.397 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-08-19T01:37:16.410 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-19T01:37:16.617 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:17.063 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:16 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3616799665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:37:17.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:16 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3616799665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-19T01:37:17.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:17 smithi086 ceph-mon[71303]: pgmap v1158: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:18.016 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:17 smithi017 ceph-mon[99370]: pgmap v1158: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:18.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.241+0000 7faaa92bc640 1 -- 172.21.15.17:0/437938118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4100750 msgr2=0x7faaa41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:18.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.241+0000 7faaa92bc640 1 --2- 172.21.15.17:0/437938118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4100750 0x7faaa41047a0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7faa8c009880 tx=0x7faa8c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:18.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.241+0000 7faaa92bc640 1 -- 172.21.15.17:0/437938118 shutdown_connections 2024-08-19T01:37:18.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.241+0000 7faaa92bc640 1 --2- 172.21.15.17:0/437938118 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4100750 0x7faaa41047a0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:18.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.241+0000 7faaa92bc640 1 --2- 172.21.15.17:0/437938118 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40ffda0 0x7faaa4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.241+0000 7faaa92bc640 1 -- 172.21.15.17:0/437938118 >> 172.21.15.17:0/437938118 conn(0x7faaa40fb840 msgr2=0x7faaa40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.241+0000 7faaa92bc640 1 -- 172.21.15.17:0/437938118 shutdown_connections 2024-08-19T01:37:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.241+0000 7faaa92bc640 1 -- 172.21.15.17:0/437938118 wait complete. 2024-08-19T01:37:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.241+0000 7faaa92bc640 1 Processor -- start 2024-08-19T01:37:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa92bc640 1 -- start start 2024-08-19T01:37:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa92bc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40ffda0 0x7faaa419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa92bc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4100750 0x7faaa419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa92bc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4195930 con 0x7faaa4100750 2024-08-19T01:37:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa92bc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa4195a70 con 0x7faaa40ffda0 2024-08-19T01:37:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4100750 0x7faaa419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:18.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa27fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4100750 0x7faaa419be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49252/0 (socket says 172.21.15.17:49252) 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa27fc640 1 -- 172.21.15.17:0/470824082 learned_addr learned my addr 172.21.15.17:0/470824082 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa2ffd640 1 --2- 172.21.15.17:0/470824082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40ffda0 0x7faaa419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa27fc640 1 -- 172.21.15.17:0/470824082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40ffda0 msgr2=0x7faaa419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa27fc640 1 --2- 172.21.15.17:0/470824082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40ffda0 0x7faaa419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.242+0000 7faaa27fc640 1 -- 172.21.15.17:0/470824082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c009560 con 0x7faaa4100750 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.243+0000 7faaa27fc640 1 --2- 172.21.15.17:0/470824082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4100750 0x7faaa419be10 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7faa8c02a9c0 tx=0x7faa8c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.243+0000 7faa9bfff640 1 -- 172.21.15.17:0/470824082 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa8c004aa0 con 0x7faaa4100750 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.243+0000 7faa9bfff640 1 -- 172.21.15.17:0/470824082 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa8c004c00 con 0x7faaa4100750 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.243+0000 7faaa92bc640 1 -- 172.21.15.17:0/470824082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa4195cf0 con 0x7faaa4100750 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.243+0000 7faa9bfff640 1 -- 172.21.15.17:0/470824082 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa8c003980 con 0x7faaa4100750 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.243+0000 7faaa92bc640 1 -- 172.21.15.17:0/470824082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa41961e0 con 0x7faaa4100750 2024-08-19T01:37:18.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.244+0000 7faaa92bc640 1 -- 172.21.15.17:0/470824082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa4101280 con 0x7faaa4100750 2024-08-19T01:37:18.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.245+0000 7faa9bfff640 1 -- 172.21.15.17:0/470824082 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7faa8c003bf0 con 0x7faaa4100750 2024-08-19T01:37:18.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.245+0000 7faa9bfff640 1 --2- 172.21.15.17:0/470824082 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faa9006e170 0x7faa90070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:18.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.245+0000 7faa9bfff640 1 -- 172.21.15.17:0/470824082 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7faa8c0af210 con 0x7faaa4100750 2024-08-19T01:37:18.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.245+0000 7faaa2ffd640 1 --2- 172.21.15.17:0/470824082 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faa9006e170 0x7faa90070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:18.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.246+0000 7faaa2ffd640 1 --2- 172.21.15.17:0/470824082 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faa9006e170 0x7faa90070630 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faa94005fd0 tx=0x7faa94009870 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:18.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.250+0000 7faa9bfff640 1 -- 172.21.15.17:0/470824082 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7faa8c0784f0 con 0x7faaa4100750 2024-08-19T01:37:18.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.462+0000 7faaa92bc640 1 -- 172.21.15.17:0/470824082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faaa4196ec0 con 0x7faaa4100750 2024-08-19T01:37:18.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.463+0000 7faa9bfff640 1 -- 172.21.15.17:0/470824082 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+5287 (secure 0 0 0) 0x7faa8c07bbb0 con 0x7faaa4100750 2024-08-19T01:37:18.464 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:18.465 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":41,"btime":"2024-08-19T01:35:33:536022+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:35:32.667950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":0,"incarnation":34,"state":"up:active","state_seq":467,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":1,"incarnation":34,"state":"up:active","state_seq":463,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44345":{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44907":{"gid":44907,"name":"cephfs.smithi086.oncasl","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6827/540250441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":540250441},{"type":"v1","addr":"172.21.15.86:6827","nonce":540250441}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34388,"qdb_cluster":[34388,34420]},"id":1}]} 2024-08-19T01:37:18.465 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 41 2024-08-19T01:37:18.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.465+0000 7faaa92bc640 1 -- 172.21.15.17:0/470824082 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faa9006e170 msgr2=0x7faa90070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.465+0000 7faaa92bc640 1 --2- 172.21.15.17:0/470824082 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faa9006e170 0x7faa90070630 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7faa94005fd0 tx=0x7faa94009870 comp rx=0 tx=0).stop 2024-08-19T01:37:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.465+0000 7faaa92bc640 1 -- 172.21.15.17:0/470824082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4100750 msgr2=0x7faaa419be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.465+0000 7faaa92bc640 1 --2- 172.21.15.17:0/470824082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4100750 0x7faaa419be10 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7faa8c02a9c0 tx=0x7faa8c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:37:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.465+0000 7faaa92bc640 1 -- 172.21.15.17:0/470824082 shutdown_connections 2024-08-19T01:37:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.465+0000 7faaa92bc640 1 --2- 172.21.15.17:0/470824082 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7faa9006e170 0x7faa90070630 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.465+0000 7faaa92bc640 1 --2- 172.21.15.17:0/470824082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa4100750 0x7faaa419be10 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.465+0000 7faaa92bc640 1 --2- 172.21.15.17:0/470824082 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7faaa40ffda0 0x7faaa419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.465+0000 7faaa92bc640 1 -- 172.21.15.17:0/470824082 >> 172.21.15.17:0/470824082 conn(0x7faaa40fb840 msgr2=0x7faaa40fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.465+0000 7faaa92bc640 1 -- 172.21.15.17:0/470824082 shutdown_connections 2024-08-19T01:37:18.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:18.465+0000 7faaa92bc640 1 -- 172.21.15.17:0/470824082 wait complete. 2024-08-19T01:37:19.048 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:37:19.049 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:18 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/470824082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T01:37:19.070 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 21, 'max_mds': 2, 'flags': 50} 2024-08-19T01:37:19.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 22 2024-08-19T01:37:19.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:37:19.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:18 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/470824082' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-19T01:37:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:19.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:19 smithi017 ceph-mon[99370]: pgmap v1159: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:20.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:19 smithi086 ceph-mon[71303]: pgmap v1159: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:20.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.941+0000 7fdcca421640 1 -- 172.21.15.17:0/1609631385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcc4100c60 msgr2=0x7fdcc4101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:20.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.941+0000 7fdcca421640 1 --2- 172.21.15.17:0/1609631385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcc4100c60 0x7fdcc4101040 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40098b0 tx=0x7fdcb402a4d0 comp rx=0 tx=0).stop 2024-08-19T01:37:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.942+0000 7fdcca421640 1 -- 172.21.15.17:0/1609631385 shutdown_connections 2024-08-19T01:37:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.942+0000 7fdcca421640 1 --2- 172.21.15.17:0/1609631385 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdcc4101610 0x7fdcc4109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.942+0000 7fdcca421640 1 --2- 172.21.15.17:0/1609631385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcc4100c60 0x7fdcc4101040 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.942+0000 7fdcca421640 1 -- 172.21.15.17:0/1609631385 >> 172.21.15.17:0/1609631385 conn(0x7fdcc40fa730 msgr2=0x7fdcc40fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.942+0000 7fdcca421640 1 -- 172.21.15.17:0/1609631385 shutdown_connections 2024-08-19T01:37:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.942+0000 7fdcca421640 1 -- 172.21.15.17:0/1609631385 wait complete. 2024-08-19T01:37:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.942+0000 7fdcca421640 1 Processor -- start 2024-08-19T01:37:20.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.942+0000 7fdcca421640 1 -- start start 2024-08-19T01:37:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcca421640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdcc4100c60 0x7fdcc4197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:20.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcca421640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcc4101610 0x7fdcc4198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcca421640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc41988e0 con 0x7fdcc4101610 2024-08-19T01:37:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcca421640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc419c650 con 0x7fdcc4100c60 2024-08-19T01:37:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcc37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcc4101610 0x7fdcc4198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcc37fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcc4101610 0x7fdcc4198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49268/0 (socket says 172.21.15.17:49268) 2024-08-19T01:37:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcc37fe640 1 -- 172.21.15.17:0/3650052323 learned_addr learned my addr 172.21.15.17:0/3650052323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcc3fff640 1 --2- 172.21.15.17:0/3650052323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdcc4100c60 0x7fdcc4197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcc37fe640 1 -- 172.21.15.17:0/3650052323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdcc4100c60 msgr2=0x7fdcc4197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcc37fe640 1 --2- 172.21.15.17:0/3650052323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdcc4100c60 0x7fdcc4197d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcc37fe640 1 -- 172.21.15.17:0/3650052323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4009560 con 0x7fdcc4101610 2024-08-19T01:37:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.943+0000 7fdcc37fe640 1 --2- 172.21.15.17:0/3650052323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcc4101610 0x7fdcc4198250 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800d6f0 tx=0x7fdcb800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:20.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.944+0000 7fdcc17fa640 1 -- 172.21.15.17:0/3650052323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcb8009a30 con 0x7fdcc4101610 2024-08-19T01:37:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.944+0000 7fdcca421640 1 -- 172.21.15.17:0/3650052323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc419c930 con 0x7fdcc4101610 2024-08-19T01:37:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.944+0000 7fdcc17fa640 1 -- 172.21.15.17:0/3650052323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdcb80054e0 con 0x7fdcc4101610 2024-08-19T01:37:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.944+0000 7fdcc17fa640 1 -- 172.21.15.17:0/3650052323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcb8010460 con 0x7fdcc4101610 2024-08-19T01:37:20.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.944+0000 7fdcca421640 1 -- 172.21.15.17:0/3650052323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc419ce80 con 0x7fdcc4101610 2024-08-19T01:37:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.945+0000 7fdcca421640 1 -- 172.21.15.17:0/3650052323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc4068d30 con 0x7fdcc4101610 2024-08-19T01:37:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.945+0000 7fdcc17fa640 1 -- 172.21.15.17:0/3650052323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fdcb8009b90 con 0x7fdcc4101610 2024-08-19T01:37:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.946+0000 7fdcc17fa640 1 --2- 172.21.15.17:0/3650052323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdcac06e180 0x7fdcac070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.946+0000 7fdcc17fa640 1 -- 172.21.15.17:0/3650052323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fdcb808dc80 con 0x7fdcc4101610 2024-08-19T01:37:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.946+0000 7fdcc3fff640 1 --2- 172.21.15.17:0/3650052323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdcac06e180 0x7fdcac070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:20.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.946+0000 7fdcc3fff640 1 --2- 172.21.15.17:0/3650052323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdcac06e180 0x7fdcac070640 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009880 tx=0x7fdcb4005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:20.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:20.950+0000 7fdcc17fa640 1 -- 172.21.15.17:0/3650052323 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fdcb8057010 con 0x7fdcc4101610 2024-08-19T01:37:21.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.164+0000 7fdcca421640 1 -- 172.21.15.17:0/3650052323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fdcc4101040 con 0x7fdcc4101610 2024-08-19T01:37:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.165+0000 7fdcc17fa640 1 -- 172.21.15.17:0/3650052323 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v41) v1 ==== 107+0+3373 (secure 0 0 0) 0x7fdcb8020d40 con 0x7fdcc4101610 2024-08-19T01:37:21.166 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:21.166 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"btime":"2024-08-19T01:04:18:216558+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:04:18.216555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14486,"mds_1":24299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14486":{"gid":14486,"name":"cephfs.smithi017.gvlpoy","rank":0,"incarnation":16,"state":"up:active","state_seq":6,"addr":"172.21.15.17:6829/1603673340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1603673340},{"type":"v1","addr":"172.21.15.17:6829","nonce":1603673340}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24299":{"gid":24299,"name":"cephfs.smithi086.uxhjfl","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.86:6825/3387019469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3387019469},{"type":"v1","addr":"172.21.15.86:6825","nonce":3387019469}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14486,"qdb_cluster":[14486,24299]},"id":1}]} 2024-08-19T01:37:21.166 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2024-08-19T01:37:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.167+0000 7fdcca421640 1 -- 172.21.15.17:0/3650052323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdcac06e180 msgr2=0x7fdcac070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.167+0000 7fdcca421640 1 --2- 172.21.15.17:0/3650052323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdcac06e180 0x7fdcac070640 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4009880 tx=0x7fdcb4005a20 comp rx=0 tx=0).stop 2024-08-19T01:37:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.167+0000 7fdcca421640 1 -- 172.21.15.17:0/3650052323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcc4101610 msgr2=0x7fdcc4198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.167+0000 7fdcca421640 1 --2- 172.21.15.17:0/3650052323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcc4101610 0x7fdcc4198250 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800d6f0 tx=0x7fdcb800dbb0 comp rx=0 tx=0).stop 2024-08-19T01:37:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.167+0000 7fdcca421640 1 -- 172.21.15.17:0/3650052323 shutdown_connections 2024-08-19T01:37:21.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.167+0000 7fdcca421640 1 --2- 172.21.15.17:0/3650052323 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fdcac06e180 0x7fdcac070640 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:21.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.167+0000 7fdcca421640 1 --2- 172.21.15.17:0/3650052323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdcc4101610 0x7fdcc4198250 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:21.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.167+0000 7fdcca421640 1 --2- 172.21.15.17:0/3650052323 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fdcc4100c60 0x7fdcc4197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:21.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.167+0000 7fdcca421640 1 -- 172.21.15.17:0/3650052323 >> 172.21.15.17:0/3650052323 conn(0x7fdcc40fa730 msgr2=0x7fdcc40fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:21.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.167+0000 7fdcca421640 1 -- 172.21.15.17:0/3650052323 shutdown_connections 2024-08-19T01:37:21.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:21.167+0000 7fdcca421640 1 -- 172.21.15.17:0/3650052323 wait complete. 2024-08-19T01:37:21.737 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:21 smithi017 ceph-mon[99370]: pgmap v1160: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:21.738 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:21 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3650052323' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-08-19T01:37:21.793 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-08-19T01:37:21.793 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 23 2024-08-19T01:37:22.001 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:22.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:21 smithi086 ceph-mon[71303]: pgmap v1160: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:22.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:21 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3650052323' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-08-19T01:37:23.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.645+0000 7fd6a437d640 1 -- 172.21.15.17:0/3925395652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd69c0ffb40 msgr2=0x7fd69c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.645+0000 7fd6a437d640 1 --2- 172.21.15.17:0/3925395652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd69c0ffb40 0x7fd69c0fffa0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fd690009880 tx=0x7fd69002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.645+0000 7fd6a437d640 1 -- 172.21.15.17:0/3925395652 shutdown_connections 2024-08-19T01:37:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.645+0000 7fd6a437d640 1 --2- 172.21.15.17:0/3925395652 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd69c0ffb40 0x7fd69c0fffa0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.645+0000 7fd6a437d640 1 --2- 172.21.15.17:0/3925395652 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd69c105bf0 0x7fd69c105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.645+0000 7fd6a437d640 1 -- 172.21.15.17:0/3925395652 >> 172.21.15.17:0/3925395652 conn(0x7fd69c0fb860 msgr2=0x7fd69c0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.645+0000 7fd6a437d640 1 -- 172.21.15.17:0/3925395652 shutdown_connections 2024-08-19T01:37:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.645+0000 7fd6a437d640 1 -- 172.21.15.17:0/3925395652 wait complete. 2024-08-19T01:37:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.646+0000 7fd6a437d640 1 Processor -- start 2024-08-19T01:37:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.646+0000 7fd6a437d640 1 -- start start 2024-08-19T01:37:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.646+0000 7fd6a437d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd69c0ffb40 0x7fd69c0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:23.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.646+0000 7fd6a437d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd69c105bf0 0x7fd69c072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.646+0000 7fd6a437d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c073230 con 0x7fd69c105bf0 2024-08-19T01:37:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.646+0000 7fd6a437d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c0733a0 con 0x7fd69c0ffb40 2024-08-19T01:37:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.646+0000 7fd6a1918640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd69c105bf0 0x7fd69c072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.646+0000 7fd6a1918640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd69c105bf0 0x7fd69c072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49286/0 (socket says 172.21.15.17:49286) 2024-08-19T01:37:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.646+0000 7fd6a1918640 1 -- 172.21.15.17:0/1705033335 learned_addr learned my addr 172.21.15.17:0/1705033335 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.646+0000 7fd6a2119640 1 --2- 172.21.15.17:0/1705033335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd69c0ffb40 0x7fd69c0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.647+0000 7fd6a1918640 1 -- 172.21.15.17:0/1705033335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd69c0ffb40 msgr2=0x7fd69c0727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.647+0000 7fd6a1918640 1 --2- 172.21.15.17:0/1705033335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd69c0ffb40 0x7fd69c0727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.647+0000 7fd6a1918640 1 -- 172.21.15.17:0/1705033335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd690009560 con 0x7fd69c105bf0 2024-08-19T01:37:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.647+0000 7fd6a1918640 1 --2- 172.21.15.17:0/1705033335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd69c105bf0 0x7fd69c072cf0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd69002a9c0 tx=0x7fd6900055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:23.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.647+0000 7fd69b7fe640 1 -- 172.21.15.17:0/1705033335 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd690004aa0 con 0x7fd69c105bf0 2024-08-19T01:37:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.647+0000 7fd69b7fe640 1 -- 172.21.15.17:0/1705033335 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd690004c00 con 0x7fd69c105bf0 2024-08-19T01:37:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.647+0000 7fd6a437d640 1 -- 172.21.15.17:0/1705033335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69c073620 con 0x7fd69c105bf0 2024-08-19T01:37:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.647+0000 7fd69b7fe640 1 -- 172.21.15.17:0/1705033335 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd690003980 con 0x7fd69c105bf0 2024-08-19T01:37:23.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.647+0000 7fd6a437d640 1 -- 172.21.15.17:0/1705033335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69c1a1f30 con 0x7fd69c105bf0 2024-08-19T01:37:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.648+0000 7fd6a437d640 1 -- 172.21.15.17:0/1705033335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69c1011f0 con 0x7fd69c105bf0 2024-08-19T01:37:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.649+0000 7fd69b7fe640 1 -- 172.21.15.17:0/1705033335 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd690003bf0 con 0x7fd69c105bf0 2024-08-19T01:37:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.649+0000 7fd69b7fe640 1 --2- 172.21.15.17:0/1705033335 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd68406e170 0x7fd684070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.649+0000 7fd69b7fe640 1 -- 172.21.15.17:0/1705033335 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd6900aefb0 con 0x7fd69c105bf0 2024-08-19T01:37:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.649+0000 7fd6a2119640 1 --2- 172.21.15.17:0/1705033335 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd68406e170 0x7fd684070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.650+0000 7fd6a2119640 1 --2- 172.21.15.17:0/1705033335 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd68406e170 0x7fd684070630 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd694005fd0 tx=0x7fd69400b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.654+0000 7fd69b7fe640 1 -- 172.21.15.17:0/1705033335 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd690078340 con 0x7fd69c105bf0 2024-08-19T01:37:23.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.868+0000 7fd6a437d640 1 -- 172.21.15.17:0/1705033335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7fd69c073620 con 0x7fd69c105bf0 2024-08-19T01:37:23.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.868+0000 7fd69b7fe640 1 -- 172.21.15.17:0/1705033335 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v41) v1 ==== 107+0+3337 (secure 0 0 0) 0x7fd690040d20 con 0x7fd69c105bf0 2024-08-19T01:37:23.870 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:23.870 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":23,"btime":"2024-08-19T01:04:18:358859+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44309,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/1724223979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1724223979},{"type":"v1","addr":"172.21.15.86:6827","nonce":1724223979}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44313,"name":"cephfs.smithi017.junbdp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/3225608690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3225608690},{"type":"v1","addr":"172.21.15.17:6827","nonce":3225608690}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:04:18.358857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:23.870 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 23 2024-08-19T01:37:23.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.871+0000 7fd6a437d640 1 -- 172.21.15.17:0/1705033335 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd68406e170 msgr2=0x7fd684070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:23.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.871+0000 7fd6a437d640 1 --2- 172.21.15.17:0/1705033335 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd68406e170 0x7fd684070630 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd694005fd0 tx=0x7fd69400b390 comp rx=0 tx=0).stop 2024-08-19T01:37:23.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.871+0000 7fd6a437d640 1 -- 172.21.15.17:0/1705033335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd69c105bf0 msgr2=0x7fd69c072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:23.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.871+0000 7fd6a437d640 1 --2- 172.21.15.17:0/1705033335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd69c105bf0 0x7fd69c072cf0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fd69002a9c0 tx=0x7fd6900055a0 comp rx=0 tx=0).stop 2024-08-19T01:37:23.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.871+0000 7fd6a437d640 1 -- 172.21.15.17:0/1705033335 shutdown_connections 2024-08-19T01:37:23.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.871+0000 7fd6a437d640 1 --2- 172.21.15.17:0/1705033335 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd68406e170 0x7fd684070630 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:23.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.871+0000 7fd6a437d640 1 --2- 172.21.15.17:0/1705033335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd69c105bf0 0x7fd69c072cf0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:23.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.871+0000 7fd6a437d640 1 --2- 172.21.15.17:0/1705033335 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd69c0ffb40 0x7fd69c0727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:23.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.871+0000 7fd6a437d640 1 -- 172.21.15.17:0/1705033335 >> 172.21.15.17:0/1705033335 conn(0x7fd69c0fb860 msgr2=0x7fd69c0fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:23.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.871+0000 7fd6a437d640 1 -- 172.21.15.17:0/1705033335 shutdown_connections 2024-08-19T01:37:23.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:23.871+0000 7fd6a437d640 1 -- 172.21.15.17:0/1705033335 wait complete. 2024-08-19T01:37:24.152 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:23 smithi017 ceph-mon[99370]: pgmap v1161: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:24.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:23 smithi086 ceph-mon[71303]: pgmap v1161: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:24.449 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-08-19T01:37:24.449 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-08-19T01:37:24.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 24 2024-08-19T01:37:24.658 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:25.004 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:24 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1705033335' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-08-19T01:37:25.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:24 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1705033335' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-08-19T01:37:25.993 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:25 smithi017 ceph-mon[99370]: pgmap v1162: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:26.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:25 smithi086 ceph-mon[71303]: pgmap v1162: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:26.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.235+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3575818876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9dc0ffb50 msgr2=0x7fe9dc0fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:26.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.235+0000 7fe9e1de9640 1 --2- 172.21.15.17:0/3575818876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9dc0ffb50 0x7fe9dc0fffb0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0009880 tx=0x7fe9d002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:26.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.235+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3575818876 shutdown_connections 2024-08-19T01:37:26.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.235+0000 7fe9e1de9640 1 --2- 172.21.15.17:0/3575818876 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9dc0ffb50 0x7fe9dc0fffb0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:26.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.235+0000 7fe9e1de9640 1 --2- 172.21.15.17:0/3575818876 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc105c00 0x7fe9dc105fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:26.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.235+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3575818876 >> 172.21.15.17:0/3575818876 conn(0x7fe9dc0fb830 msgr2=0x7fe9dc0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:26.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.235+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3575818876 shutdown_connections 2024-08-19T01:37:26.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.235+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3575818876 wait complete. 2024-08-19T01:37:26.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.235+0000 7fe9e1de9640 1 Processor -- start 2024-08-19T01:37:26.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9e1de9640 1 -- start start 2024-08-19T01:37:26.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9e1de9640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9dc0ffb50 0x7fe9dc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:26.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9e1de9640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc105c00 0x7fe9dc072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9e1de9640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc074780 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9e1de9640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc073230 con 0x7fe9dc105c00 2024-08-19T01:37:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9dc0ffb50 0x7fe9dc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9dc0ffb50 0x7fe9dc0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49294/0 (socket says 172.21.15.17:49294) 2024-08-19T01:37:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9db7fe640 1 -- 172.21.15.17:0/3563966543 learned_addr learned my addr 172.21.15.17:0/3563966543 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9daffd640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc105c00 0x7fe9dc072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9db7fe640 1 -- 172.21.15.17:0/3563966543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc105c00 msgr2=0x7fe9dc072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9db7fe640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc105c00 0x7fe9dc072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9db7fe640 1 -- 172.21.15.17:0/3563966543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0009560 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.236+0000 7fe9daffd640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc105c00 0x7fe9dc072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:37:26.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.237+0000 7fe9db7fe640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9dc0ffb50 0x7fe9dc0727b0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00c8a0 tx=0x7fe9cc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.237+0000 7fe9d8ff9640 1 -- 172.21.15.17:0/3563966543 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9cc007b80 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.237+0000 7fe9d8ff9640 1 -- 172.21.15.17:0/3563966543 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9cc007ce0 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.237+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3563966543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc073510 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.237+0000 7fe9d8ff9640 1 -- 172.21.15.17:0/3563966543 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9cc018810 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.237+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3563966543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc1a1f80 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.238+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3563966543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc101200 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.238+0000 7fe9d8ff9640 1 -- 172.21.15.17:0/3563966543 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe9cc018970 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.239+0000 7fe9d8ff9640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9c406e170 0x7fe9c4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.239+0000 7fe9d8ff9640 1 -- 172.21.15.17:0/3563966543 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe9cc08e310 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.239+0000 7fe9daffd640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9c406e170 0x7fe9c4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:26.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.239+0000 7fe9daffd640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9c406e170 0x7fe9c4070630 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0006010 tx=0x7fe9d0005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:26.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.243+0000 7fe9d8ff9640 1 -- 172.21.15.17:0/3563966543 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe9cc057670 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.453+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3563966543 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fe9dc0fffb0 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.454+0000 7fe9d8ff9640 1 -- 172.21.15.17:0/3563966543 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v41) v1 ==== 107+0+4892 (secure 0 0 0) 0x7fe9cc05ad30 con 0x7fe9dc0ffb50 2024-08-19T01:37:26.455 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:26.455 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"btime":"2024-08-19T01:04:19:360427+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi017.gvlpoy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/1504429560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1504429560},{"type":"v1","addr":"172.21.15.17:6829","nonce":1504429560}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44309,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/1724223979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1724223979},{"type":"v1","addr":"172.21.15.86:6827","nonce":1724223979}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44313,"name":"cephfs.smithi017.junbdp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/3225608690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3225608690},{"type":"v1","addr":"172.21.15.17:6827","nonce":3225608690}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44317,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/612667702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":612667702},{"type":"v1","addr":"172.21.15.86:6825","nonce":612667702}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:04:18.358857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:26.456 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-08-19T01:37:26.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.456+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3563966543 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9c406e170 msgr2=0x7fe9c4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:26.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.456+0000 7fe9e1de9640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9c406e170 0x7fe9c4070630 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0006010 tx=0x7fe9d0005e60 comp rx=0 tx=0).stop 2024-08-19T01:37:26.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.456+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3563966543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9dc0ffb50 msgr2=0x7fe9dc0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:26.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.456+0000 7fe9e1de9640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9dc0ffb50 0x7fe9dc0727b0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00c8a0 tx=0x7fe9cc00cd60 comp rx=0 tx=0).stop 2024-08-19T01:37:26.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.456+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3563966543 shutdown_connections 2024-08-19T01:37:26.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.456+0000 7fe9e1de9640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9c406e170 0x7fe9c4070630 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:26.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.456+0000 7fe9e1de9640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9dc105c00 0x7fe9dc072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:26.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.456+0000 7fe9e1de9640 1 --2- 172.21.15.17:0/3563966543 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9dc0ffb50 0x7fe9dc0727b0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:26.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.456+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3563966543 >> 172.21.15.17:0/3563966543 conn(0x7fe9dc0fb830 msgr2=0x7fe9dc0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:26.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.456+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3563966543 shutdown_connections 2024-08-19T01:37:26.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:26.456+0000 7fe9e1de9640 1 -- 172.21.15.17:0/3563966543 wait complete. 2024-08-19T01:37:27.057 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:26 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3563966543' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-08-19T01:37:27.080 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-08-19T01:37:27.080 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-08-19T01:37:27.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 25 2024-08-19T01:37:27.096 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:26 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3563966543' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-08-19T01:37:27.290 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:28.114 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:27 smithi017 ceph-mon[99370]: pgmap v1163: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:28.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:27 smithi086 ceph-mon[71303]: pgmap v1163: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:28.917 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.914+0000 7f15c1e8e640 1 -- 172.21.15.17:0/2411561513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15bc104a30 msgr2=0x7f15bc104e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.914+0000 7f15c1e8e640 1 --2- 172.21.15.17:0/2411561513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15bc104a30 0x7f15bc104e10 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009880 tx=0x7f15ac02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.914+0000 7f15c1e8e640 1 -- 172.21.15.17:0/2411561513 shutdown_connections 2024-08-19T01:37:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.914+0000 7f15c1e8e640 1 --2- 172.21.15.17:0/2411561513 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15bc0fea30 0x7f15bc0fee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.914+0000 7f15c1e8e640 1 --2- 172.21.15.17:0/2411561513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15bc104a30 0x7f15bc104e10 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.914+0000 7f15c1e8e640 1 -- 172.21.15.17:0/2411561513 >> 172.21.15.17:0/2411561513 conn(0x7f15bc0fa730 msgr2=0x7f15bc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.914+0000 7f15c1e8e640 1 -- 172.21.15.17:0/2411561513 shutdown_connections 2024-08-19T01:37:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.914+0000 7f15c1e8e640 1 -- 172.21.15.17:0/2411561513 wait complete. 2024-08-19T01:37:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.915+0000 7f15c1e8e640 1 Processor -- start 2024-08-19T01:37:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.915+0000 7f15c1e8e640 1 -- start start 2024-08-19T01:37:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.915+0000 7f15c1e8e640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15bc0fea30 0x7f15bc19b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:28.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.915+0000 7f15c1e8e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15bc104a30 0x7f15bc19be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.915+0000 7f15c1e8e640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc195920 con 0x7f15bc104a30 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.915+0000 7f15c1e8e640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc195a60 con 0x7f15bc0fea30 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.915+0000 7f15baffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15bc104a30 0x7f15bc19be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.915+0000 7f15baffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15bc104a30 0x7f15bc19be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43074/0 (socket says 172.21.15.17:43074) 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.915+0000 7f15baffd640 1 -- 172.21.15.17:0/3730853758 learned_addr learned my addr 172.21.15.17:0/3730853758 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.915+0000 7f15bb7fe640 1 --2- 172.21.15.17:0/3730853758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15bc0fea30 0x7f15bc19b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.915+0000 7f15baffd640 1 -- 172.21.15.17:0/3730853758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15bc0fea30 msgr2=0x7f15bc19b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.916+0000 7f15baffd640 1 --2- 172.21.15.17:0/3730853758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15bc0fea30 0x7f15bc19b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.916+0000 7f15baffd640 1 -- 172.21.15.17:0/3730853758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac009560 con 0x7f15bc104a30 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.916+0000 7f15baffd640 1 --2- 172.21.15.17:0/3730853758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15bc104a30 0x7f15bc19be00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f15b000c810 tx=0x7f15b000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.916+0000 7f15b8ff9640 1 -- 172.21.15.17:0/3730853758 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15b00041f0 con 0x7f15bc104a30 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.916+0000 7f15c1e8e640 1 -- 172.21.15.17:0/3730853758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15bc195d40 con 0x7f15bc104a30 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.916+0000 7f15b8ff9640 1 -- 172.21.15.17:0/3730853758 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15b0007e70 con 0x7f15bc104a30 2024-08-19T01:37:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.916+0000 7f15b8ff9640 1 -- 172.21.15.17:0/3730853758 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15b00049d0 con 0x7f15bc104a30 2024-08-19T01:37:28.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.916+0000 7f15c1e8e640 1 -- 172.21.15.17:0/3730853758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15bc196290 con 0x7f15bc104a30 2024-08-19T01:37:28.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.917+0000 7f15c1e8e640 1 -- 172.21.15.17:0/3730853758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15bc100170 con 0x7f15bc104a30 2024-08-19T01:37:28.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.918+0000 7f15b8ff9640 1 -- 172.21.15.17:0/3730853758 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f15b00079b0 con 0x7f15bc104a30 2024-08-19T01:37:28.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.918+0000 7f15b8ff9640 1 --2- 172.21.15.17:0/3730853758 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15a406e170 0x7f15a4070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.918+0000 7f15b8ff9640 1 -- 172.21.15.17:0/3730853758 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f15b008df70 con 0x7f15bc104a30 2024-08-19T01:37:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.918+0000 7f15bb7fe640 1 --2- 172.21.15.17:0/3730853758 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15a406e170 0x7f15a4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.919+0000 7f15bb7fe640 1 --2- 172.21.15.17:0/3730853758 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15a406e170 0x7f15a4070630 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009230 tx=0x7f15ac0058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:28.923+0000 7f15b8ff9640 1 -- 172.21.15.17:0/3730853758 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f15b00c2df0 con 0x7f15bc104a30 2024-08-19T01:37:29.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.133+0000 7f15c1e8e640 1 -- 172.21.15.17:0/3730853758 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f15bc10bca0 con 0x7f15bc104a30 2024-08-19T01:37:29.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.134+0000 7f15b8ff9640 1 -- 172.21.15.17:0/3730853758 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v41) v1 ==== 107+0+4113 (secure 0 0 0) 0x7f15b00572a0 con 0x7f15bc104a30 2024-08-19T01:37:29.136 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:29.136 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":25,"btime":"2024-08-19T01:04:22:422611+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi017.gvlpoy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/1504429560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1504429560},{"type":"v1","addr":"172.21.15.17:6829","nonce":1504429560}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44309,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/1724223979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1724223979},{"type":"v1","addr":"172.21.15.86:6827","nonce":1724223979}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44317,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/612667702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":612667702},{"type":"v1","addr":"172.21.15.86:6825","nonce":612667702}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:04:18.358857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:29.136 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 25 2024-08-19T01:37:29.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.137+0000 7f15c1e8e640 1 -- 172.21.15.17:0/3730853758 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15a406e170 msgr2=0x7f15a4070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:29.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.137+0000 7f15c1e8e640 1 --2- 172.21.15.17:0/3730853758 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15a406e170 0x7f15a4070630 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009230 tx=0x7f15ac0058d0 comp rx=0 tx=0).stop 2024-08-19T01:37:29.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.137+0000 7f15c1e8e640 1 -- 172.21.15.17:0/3730853758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15bc104a30 msgr2=0x7f15bc19be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:29.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.137+0000 7f15c1e8e640 1 --2- 172.21.15.17:0/3730853758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15bc104a30 0x7f15bc19be00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f15b000c810 tx=0x7f15b000ccd0 comp rx=0 tx=0).stop 2024-08-19T01:37:29.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.137+0000 7f15c1e8e640 1 -- 172.21.15.17:0/3730853758 shutdown_connections 2024-08-19T01:37:29.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.137+0000 7f15c1e8e640 1 --2- 172.21.15.17:0/3730853758 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f15a406e170 0x7f15a4070630 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:29.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.137+0000 7f15c1e8e640 1 --2- 172.21.15.17:0/3730853758 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f15bc104a30 0x7f15bc19be00 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:29.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.137+0000 7f15c1e8e640 1 --2- 172.21.15.17:0/3730853758 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f15bc0fea30 0x7f15bc19b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:29.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.137+0000 7f15c1e8e640 1 -- 172.21.15.17:0/3730853758 >> 172.21.15.17:0/3730853758 conn(0x7f15bc0fa730 msgr2=0x7f15bc0686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:29.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.137+0000 7f15c1e8e640 1 -- 172.21.15.17:0/3730853758 shutdown_connections 2024-08-19T01:37:29.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:29.137+0000 7f15c1e8e640 1 -- 172.21.15.17:0/3730853758 wait complete. 2024-08-19T01:37:29.744 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-08-19T01:37:29.744 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-08-19T01:37:29.744 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 26 2024-08-19T01:37:29.954 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:30.075 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:29 smithi017 ceph-mon[99370]: pgmap v1164: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:30.075 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:29 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3730853758' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-08-19T01:37:30.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:29 smithi086 ceph-mon[71303]: pgmap v1164: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:30.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:29 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3730853758' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-08-19T01:37:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.798+0000 7f6991c5d640 1 -- 172.21.15.17:0/1274160135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f698c0ffda0 msgr2=0x7f698c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.798+0000 7f6991c5d640 1 --2- 172.21.15.17:0/1274160135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f698c0ffda0 0x7f698c100180 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f697c009880 tx=0x7f697c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.798+0000 7f6991c5d640 1 -- 172.21.15.17:0/1274160135 shutdown_connections 2024-08-19T01:37:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.798+0000 7f6991c5d640 1 --2- 172.21.15.17:0/1274160135 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f698c100750 0x7f698c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:31.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.798+0000 7f6991c5d640 1 --2- 172.21.15.17:0/1274160135 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f698c0ffda0 0x7f698c100180 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:31.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.798+0000 7f6991c5d640 1 -- 172.21.15.17:0/1274160135 >> 172.21.15.17:0/1274160135 conn(0x7f698c0fb860 msgr2=0x7f698c0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:31.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.798+0000 7f6991c5d640 1 -- 172.21.15.17:0/1274160135 shutdown_connections 2024-08-19T01:37:31.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.798+0000 7f6991c5d640 1 -- 172.21.15.17:0/1274160135 wait complete. 2024-08-19T01:37:31.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.799+0000 7f6991c5d640 1 Processor -- start 2024-08-19T01:37:31.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.799+0000 7f6991c5d640 1 -- start start 2024-08-19T01:37:31.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.799+0000 7f6991c5d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f698c0ffda0 0x7f698c19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:31.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.799+0000 7f6991c5d640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f698c100750 0x7f698c19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:31.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.799+0000 7f6991c5d640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c19c3a0 con 0x7f698c0ffda0 2024-08-19T01:37:31.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.799+0000 7f6991c5d640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c195930 con 0x7f698c100750 2024-08-19T01:37:31.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.799+0000 7f698b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f698c0ffda0 0x7f698c19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:31.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.799+0000 7f698b7fe640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f698c0ffda0 0x7f698c19b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43090/0 (socket says 172.21.15.17:43090) 2024-08-19T01:37:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.799+0000 7f698b7fe640 1 -- 172.21.15.17:0/1624072151 learned_addr learned my addr 172.21.15.17:0/1624072151 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.799+0000 7f698affd640 1 --2- 172.21.15.17:0/1624072151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f698c100750 0x7f698c19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.800+0000 7f698b7fe640 1 -- 172.21.15.17:0/1624072151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f698c100750 msgr2=0x7f698c19bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.800+0000 7f698b7fe640 1 --2- 172.21.15.17:0/1624072151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f698c100750 0x7f698c19bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.800+0000 7f698b7fe640 1 -- 172.21.15.17:0/1624072151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c009560 con 0x7f698c0ffda0 2024-08-19T01:37:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.800+0000 7f698b7fe640 1 --2- 172.21.15.17:0/1624072151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f698c0ffda0 0x7f698c19b840 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f697c02a9c0 tx=0x7f697c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.800+0000 7f6988ff9640 1 -- 172.21.15.17:0/1624072151 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f697c004aa0 con 0x7f698c0ffda0 2024-08-19T01:37:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.800+0000 7f6988ff9640 1 -- 172.21.15.17:0/1624072151 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f697c004c00 con 0x7f698c0ffda0 2024-08-19T01:37:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.800+0000 7f6991c5d640 1 -- 172.21.15.17:0/1624072151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c195bb0 con 0x7f698c0ffda0 2024-08-19T01:37:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.800+0000 7f6988ff9640 1 -- 172.21.15.17:0/1624072151 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f697c003980 con 0x7f698c0ffda0 2024-08-19T01:37:31.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.800+0000 7f6991c5d640 1 -- 172.21.15.17:0/1624072151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c1960a0 con 0x7f698c0ffda0 2024-08-19T01:37:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.801+0000 7f6991c5d640 1 -- 172.21.15.17:0/1624072151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698c101280 con 0x7f698c0ffda0 2024-08-19T01:37:31.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.802+0000 7f6988ff9640 1 -- 172.21.15.17:0/1624072151 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f697c003bf0 con 0x7f698c0ffda0 2024-08-19T01:37:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.802+0000 7f6988ff9640 1 --2- 172.21.15.17:0/1624072151 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f697406e170 0x7f6974070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.802+0000 7f6988ff9640 1 -- 172.21.15.17:0/1624072151 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f697c0af160 con 0x7f698c0ffda0 2024-08-19T01:37:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.802+0000 7f698affd640 1 --2- 172.21.15.17:0/1624072151 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f697406e170 0x7f6974070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:31.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.803+0000 7f698affd640 1 --2- 172.21.15.17:0/1624072151 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f697406e170 0x7f6974070630 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f698c196da0 tx=0x7f698000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:31.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:31.807+0000 7f6988ff9640 1 -- 172.21.15.17:0/1624072151 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f697c0784f0 con 0x7f698c0ffda0 2024-08-19T01:37:31.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:31 smithi017 ceph-mon[99370]: pgmap v1165: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:32.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.017+0000 7f6991c5d640 1 -- 172.21.15.17:0/1624072151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f698c1080b0 con 0x7f698c0ffda0 2024-08-19T01:37:32.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.018+0000 7f6988ff9640 1 -- 172.21.15.17:0/1624072151 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v41) v1 ==== 107+0+4960 (secure 0 0 0) 0x7f697c07bbb0 con 0x7f698c0ffda0 2024-08-19T01:37:32.019 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:32.020 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":26,"btime":"2024-08-19T01:04:28:434916+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34384,"name":"cephfs.smithi017.gvlpoy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/1504429560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":1504429560},{"type":"v1","addr":"172.21.15.17:6829","nonce":1504429560}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44309,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/1724223979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1724223979},{"type":"v1","addr":"172.21.15.86:6827","nonce":1724223979}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44317,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/612667702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":612667702},{"type":"v1","addr":"172.21.15.86:6825","nonce":612667702}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:04:18.358857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 26 2024-08-19T01:37:32.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.020+0000 7f6991c5d640 1 -- 172.21.15.17:0/1624072151 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f697406e170 msgr2=0x7f6974070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:32.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.020+0000 7f6991c5d640 1 --2- 172.21.15.17:0/1624072151 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f697406e170 0x7f6974070630 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f698c196da0 tx=0x7f698000b390 comp rx=0 tx=0).stop 2024-08-19T01:37:32.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.020+0000 7f6991c5d640 1 -- 172.21.15.17:0/1624072151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f698c0ffda0 msgr2=0x7f698c19b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:32.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.020+0000 7f6991c5d640 1 --2- 172.21.15.17:0/1624072151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f698c0ffda0 0x7f698c19b840 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f697c02a9c0 tx=0x7f697c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:37:32.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.020+0000 7f6991c5d640 1 -- 172.21.15.17:0/1624072151 shutdown_connections 2024-08-19T01:37:32.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.020+0000 7f6991c5d640 1 --2- 172.21.15.17:0/1624072151 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f697406e170 0x7f6974070630 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:32.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.020+0000 7f6991c5d640 1 --2- 172.21.15.17:0/1624072151 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f698c100750 0x7f698c19bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:32.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.020+0000 7f6991c5d640 1 --2- 172.21.15.17:0/1624072151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f698c0ffda0 0x7f698c19b840 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:32.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.020+0000 7f6991c5d640 1 -- 172.21.15.17:0/1624072151 >> 172.21.15.17:0/1624072151 conn(0x7f698c0fb860 msgr2=0x7f698c0fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:32.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.020+0000 7f6991c5d640 1 -- 172.21.15.17:0/1624072151 shutdown_connections 2024-08-19T01:37:32.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:32.020+0000 7f6991c5d640 1 -- 172.21.15.17:0/1624072151 wait complete. 2024-08-19T01:37:32.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:31 smithi086 ceph-mon[71303]: pgmap v1165: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:32.685 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-08-19T01:37:32.685 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-08-19T01:37:32.685 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 27 2024-08-19T01:37:32.899 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:33.021 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:32 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1624072151' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-08-19T01:37:33.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:32 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1624072151' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-08-19T01:37:33.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:33 smithi017 ceph-mon[99370]: pgmap v1166: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:33.967 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:37:34.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:33 smithi086 ceph-mon[71303]: pgmap v1166: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:34.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:37:34.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.444+0000 7fe9d74f8640 1 -- 172.21.15.17:0/3179326591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d00fe9f0 msgr2=0x7fe9d00fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:34.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.444+0000 7fe9d74f8640 1 --2- 172.21.15.17:0/3179326591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d00fe9f0 0x7fe9d00fee50 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009880 tx=0x7fe9c002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:34.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.444+0000 7fe9d74f8640 1 -- 172.21.15.17:0/3179326591 shutdown_connections 2024-08-19T01:37:34.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.444+0000 7fe9d74f8640 1 --2- 172.21.15.17:0/3179326591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d00fe9f0 0x7fe9d00fee50 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.444+0000 7fe9d74f8640 1 --2- 172.21.15.17:0/3179326591 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d01049f0 0x7fe9d0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.444+0000 7fe9d74f8640 1 -- 172.21.15.17:0/3179326591 >> 172.21.15.17:0/3179326591 conn(0x7fe9d00758a0 msgr2=0x7fe9d00fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.444+0000 7fe9d74f8640 1 -- 172.21.15.17:0/3179326591 shutdown_connections 2024-08-19T01:37:34.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.444+0000 7fe9d74f8640 1 -- 172.21.15.17:0/3179326591 wait complete. 2024-08-19T01:37:34.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d74f8640 1 Processor -- start 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d74f8640 1 -- start start 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d74f8640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d00fe9f0 0x7fe9d019da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d74f8640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d01049f0 0x7fe9d019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d74f8640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d0197b40 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d74f8640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d0197cb0 con 0x7fe9d01049f0 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d5294640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d00fe9f0 0x7fe9d019da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d5294640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d00fe9f0 0x7fe9d019da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:43118/0 (socket says 172.21.15.17:43118) 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d5294640 1 -- 172.21.15.17:0/1239779068 learned_addr learned my addr 172.21.15.17:0/1239779068 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d4a93640 1 --2- 172.21.15.17:0/1239779068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d01049f0 0x7fe9d019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d5294640 1 -- 172.21.15.17:0/1239779068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d01049f0 msgr2=0x7fe9d019df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.445+0000 7fe9d5294640 1 --2- 172.21.15.17:0/1239779068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d01049f0 0x7fe9d019df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.446+0000 7fe9d5294640 1 -- 172.21.15.17:0/1239779068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0009560 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.446+0000 7fe9d5294640 1 --2- 172.21.15.17:0/1239779068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d00fe9f0 0x7fe9d019da50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00e970 tx=0x7fe9cc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.446+0000 7fe9c67fc640 1 -- 172.21.15.17:0/1239779068 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9cc00cc90 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.446+0000 7fe9d74f8640 1 -- 172.21.15.17:0/1239779068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d0197f90 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.446+0000 7fe9c67fc640 1 -- 172.21.15.17:0/1239779068 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9cc00cdf0 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.446+0000 7fe9d74f8640 1 -- 172.21.15.17:0/1239779068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d01984b0 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.447+0000 7fe9c67fc640 1 -- 172.21.15.17:0/1239779068 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9cc021440 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.447+0000 7fe9d74f8640 1 -- 172.21.15.17:0/1239779068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d0100130 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.448+0000 7fe9c67fc640 1 -- 172.21.15.17:0/1239779068 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe9cc005020 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.448+0000 7fe9c67fc640 1 --2- 172.21.15.17:0/1239779068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9bc06e170 0x7fe9bc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.448+0000 7fe9c67fc640 1 -- 172.21.15.17:0/1239779068 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fe9cc014070 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.448+0000 7fe9d4a93640 1 --2- 172.21.15.17:0/1239779068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9bc06e170 0x7fe9bc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:34.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.449+0000 7fe9d4a93640 1 --2- 172.21.15.17:0/1239779068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9bc06e170 0x7fe9bc070630 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009230 tx=0x7fe9c00058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:34.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.453+0000 7fe9c67fc640 1 -- 172.21.15.17:0/1239779068 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fe9cc0579d0 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.666+0000 7fe9d74f8640 1 -- 172.21.15.17:0/1239779068 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fe9d0198750 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.667+0000 7fe9c67fc640 1 -- 172.21.15.17:0/1239779068 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v41) v1 ==== 107+0+4181 (secure 0 0 0) 0x7fe9cc05b090 con 0x7fe9d00fe9f0 2024-08-19T01:37:34.668 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:34.669 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":27,"btime":"2024-08-19T01:04:39:872973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":44309,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/1724223979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1724223979},{"type":"v1","addr":"172.21.15.86:6827","nonce":1724223979}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44317,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/612667702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":612667702},{"type":"v1","addr":"172.21.15.86:6825","nonce":612667702}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:04:18.358857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:34.669 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 27 2024-08-19T01:37:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.670+0000 7fe9d74f8640 1 -- 172.21.15.17:0/1239779068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9bc06e170 msgr2=0x7fe9bc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.670+0000 7fe9d74f8640 1 --2- 172.21.15.17:0/1239779068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9bc06e170 0x7fe9bc070630 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009230 tx=0x7fe9c00058d0 comp rx=0 tx=0).stop 2024-08-19T01:37:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.670+0000 7fe9d74f8640 1 -- 172.21.15.17:0/1239779068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d00fe9f0 msgr2=0x7fe9d019da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.670+0000 7fe9d74f8640 1 --2- 172.21.15.17:0/1239779068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d00fe9f0 0x7fe9d019da50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00e970 tx=0x7fe9cc00ed70 comp rx=0 tx=0).stop 2024-08-19T01:37:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.670+0000 7fe9d74f8640 1 -- 172.21.15.17:0/1239779068 shutdown_connections 2024-08-19T01:37:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.670+0000 7fe9d74f8640 1 --2- 172.21.15.17:0/1239779068 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fe9bc06e170 0x7fe9bc070630 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.670+0000 7fe9d74f8640 1 --2- 172.21.15.17:0/1239779068 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fe9d01049f0 0x7fe9d019df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.670+0000 7fe9d74f8640 1 --2- 172.21.15.17:0/1239779068 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d00fe9f0 0x7fe9d019da50 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.670+0000 7fe9d74f8640 1 -- 172.21.15.17:0/1239779068 >> 172.21.15.17:0/1239779068 conn(0x7fe9d00758a0 msgr2=0x7fe9d0102180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.670+0000 7fe9d74f8640 1 -- 172.21.15.17:0/1239779068 shutdown_connections 2024-08-19T01:37:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:34.670+0000 7fe9d74f8640 1 -- 172.21.15.17:0/1239779068 wait complete. 2024-08-19T01:37:34.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:34 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:37:34.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:34 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1239779068' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-08-19T01:37:35.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:34 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:37:35.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:34 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1239779068' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-08-19T01:37:35.413 DEBUG:tasks.fs:max_mds not reduced in epoch 27 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-08-19T01:37:35.413 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-08-19T01:37:35.413 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 28 2024-08-19T01:37:35.626 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:35.969 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:35 smithi017 ceph-mon[99370]: pgmap v1167: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:35.969 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:37:35.969 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:37:35.970 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:37:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:35 smithi086 ceph-mon[71303]: pgmap v1167: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:37:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:37:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:37:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.233+0000 7ff4f7b29640 1 -- 172.21.15.17:0/3144029859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f00fea30 msgr2=0x7ff4f00fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.233+0000 7ff4f7b29640 1 --2- 172.21.15.17:0/3144029859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f00fea30 0x7ff4f00fee90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009880 tx=0x7ff4e002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.233+0000 7ff4f7b29640 1 -- 172.21.15.17:0/3144029859 shutdown_connections 2024-08-19T01:37:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.233+0000 7ff4f7b29640 1 --2- 172.21.15.17:0/3144029859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f00fea30 0x7ff4f00fee90 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.233+0000 7ff4f7b29640 1 --2- 172.21.15.17:0/3144029859 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4f0104a30 0x7ff4f0104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.233+0000 7ff4f7b29640 1 -- 172.21.15.17:0/3144029859 >> 172.21.15.17:0/3144029859 conn(0x7ff4f00fa730 msgr2=0x7ff4f00fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.233+0000 7ff4f7b29640 1 -- 172.21.15.17:0/3144029859 shutdown_connections 2024-08-19T01:37:37.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.233+0000 7ff4f7b29640 1 -- 172.21.15.17:0/3144029859 wait complete. 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.233+0000 7ff4f7b29640 1 Processor -- start 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f7b29640 1 -- start start 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f7b29640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4f00fea30 0x7ff4f0196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f7b29640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0104a30 0x7ff4f0196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f7b29640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f0197430 con 0x7ff4f0104a30 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f7b29640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f01975a0 con 0x7ff4f00fea30 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f50c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0104a30 0x7ff4f0196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f50c4640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0104a30 0x7ff4f0196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33406/0 (socket says 172.21.15.17:33406) 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f50c4640 1 -- 172.21.15.17:0/47299138 learned_addr learned my addr 172.21.15.17:0/47299138 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f58c5640 1 --2- 172.21.15.17:0/47299138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4f00fea30 0x7ff4f0196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f50c4640 1 -- 172.21.15.17:0/47299138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4f00fea30 msgr2=0x7ff4f0196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f50c4640 1 --2- 172.21.15.17:0/47299138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4f00fea30 0x7ff4f0196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:37.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f50c4640 1 -- 172.21.15.17:0/47299138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0009560 con 0x7ff4f0104a30 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4f50c4640 1 --2- 172.21.15.17:0/47299138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0104a30 0x7ff4f0196e60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff4e002a9c0 tx=0x7ff4e00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4e6ffd640 1 -- 172.21.15.17:0/47299138 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e0004aa0 con 0x7ff4f0104a30 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.234+0000 7ff4e6ffd640 1 -- 172.21.15.17:0/47299138 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4e0004c00 con 0x7ff4f0104a30 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.235+0000 7ff4f7b29640 1 -- 172.21.15.17:0/47299138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f019f990 con 0x7ff4f0104a30 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.235+0000 7ff4e6ffd640 1 -- 172.21.15.17:0/47299138 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4e0003980 con 0x7ff4f0104a30 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.235+0000 7ff4f7b29640 1 -- 172.21.15.17:0/47299138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f019fcf0 con 0x7ff4f0104a30 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.235+0000 7ff4f7b29640 1 -- 172.21.15.17:0/47299138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f0100170 con 0x7ff4f0104a30 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.236+0000 7ff4e6ffd640 1 -- 172.21.15.17:0/47299138 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff4e0003b20 con 0x7ff4f0104a30 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.237+0000 7ff4e6ffd640 1 --2- 172.21.15.17:0/47299138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4dc06e170 0x7ff4dc070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.237+0000 7ff4e6ffd640 1 -- 172.21.15.17:0/47299138 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff4e00af080 con 0x7ff4f0104a30 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.237+0000 7ff4f58c5640 1 --2- 172.21.15.17:0/47299138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4dc06e170 0x7ff4dc070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.237+0000 7ff4f58c5640 1 --2- 172.21.15.17:0/47299138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4dc06e170 0x7ff4dc070630 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec005fd0 tx=0x7ff4ec009680 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:37.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.241+0000 7ff4e6ffd640 1 -- 172.21.15.17:0/47299138 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff4e0078490 con 0x7ff4f0104a30 2024-08-19T01:37:37.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.452+0000 7ff4f7b29640 1 -- 172.21.15.17:0/47299138 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7ff4f00fee90 con 0x7ff4f0104a30 2024-08-19T01:37:37.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.453+0000 7ff4e6ffd640 1 -- 172.21.15.17:0/47299138 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v41) v1 ==== 107+0+5028 (secure 0 0 0) 0x7ff4e007bb50 con 0x7ff4f0104a30 2024-08-19T01:37:37.454 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:37.454 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":28,"btime":"2024-08-19T01:04:44:883383+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44309,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/1724223979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1724223979},{"type":"v1","addr":"172.21.15.86:6827","nonce":1724223979}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44317,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/612667702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":612667702},{"type":"v1","addr":"172.21.15.86:6825","nonce":612667702}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:04:18.358857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:37.455 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 28 2024-08-19T01:37:37.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.455+0000 7ff4f7b29640 1 -- 172.21.15.17:0/47299138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4dc06e170 msgr2=0x7ff4dc070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:37.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.455+0000 7ff4f7b29640 1 --2- 172.21.15.17:0/47299138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4dc06e170 0x7ff4dc070630 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec005fd0 tx=0x7ff4ec009680 comp rx=0 tx=0).stop 2024-08-19T01:37:37.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.455+0000 7ff4f7b29640 1 -- 172.21.15.17:0/47299138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0104a30 msgr2=0x7ff4f0196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:37.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.455+0000 7ff4f7b29640 1 --2- 172.21.15.17:0/47299138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0104a30 0x7ff4f0196e60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff4e002a9c0 tx=0x7ff4e00055a0 comp rx=0 tx=0).stop 2024-08-19T01:37:37.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.455+0000 7ff4f7b29640 1 -- 172.21.15.17:0/47299138 shutdown_connections 2024-08-19T01:37:37.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.455+0000 7ff4f7b29640 1 --2- 172.21.15.17:0/47299138 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff4dc06e170 0x7ff4dc070630 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:37.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.455+0000 7ff4f7b29640 1 --2- 172.21.15.17:0/47299138 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff4f0104a30 0x7ff4f0196e60 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:37.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.455+0000 7ff4f7b29640 1 --2- 172.21.15.17:0/47299138 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff4f00fea30 0x7ff4f0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:37.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.455+0000 7ff4f7b29640 1 -- 172.21.15.17:0/47299138 >> 172.21.15.17:0/47299138 conn(0x7ff4f00fa730 msgr2=0x7ff4f00fb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:37.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.455+0000 7ff4f7b29640 1 -- 172.21.15.17:0/47299138 shutdown_connections 2024-08-19T01:37:37.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:37.455+0000 7ff4f7b29640 1 -- 172.21.15.17:0/47299138 wait complete. 2024-08-19T01:37:38.035 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:37 smithi086 ceph-mon[71303]: pgmap v1168: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:38.035 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:37 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/47299138' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-08-19T01:37:38.064 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:37 smithi017 ceph-mon[99370]: pgmap v1168: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:38.064 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:37 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/47299138' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-08-19T01:37:38.086 DEBUG:tasks.fs:max_mds not reduced in epoch 28 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-08-19T01:37:38.086 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-08-19T01:37:38.086 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 29 2024-08-19T01:37:38.295 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.947+0000 7f471f691640 1 -- 172.21.15.17:0/140400839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47180fe9f0 msgr2=0x7f47180fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.947+0000 7f471f691640 1 --2- 172.21.15.17:0/140400839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47180fe9f0 0x7f47180fee50 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4708009880 tx=0x7f470802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.947+0000 7f471f691640 1 -- 172.21.15.17:0/140400839 shutdown_connections 2024-08-19T01:37:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.947+0000 7f471f691640 1 --2- 172.21.15.17:0/140400839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47180fe9f0 0x7f47180fee50 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.947+0000 7f471f691640 1 --2- 172.21.15.17:0/140400839 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47181049f0 0x7f4718104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:39.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.947+0000 7f471f691640 1 -- 172.21.15.17:0/140400839 >> 172.21.15.17:0/140400839 conn(0x7f47180758a0 msgr2=0x7f47180fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:39.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.947+0000 7f471f691640 1 -- 172.21.15.17:0/140400839 shutdown_connections 2024-08-19T01:37:39.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.947+0000 7f471f691640 1 -- 172.21.15.17:0/140400839 wait complete. 2024-08-19T01:37:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.947+0000 7f471f691640 1 Processor -- start 2024-08-19T01:37:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.947+0000 7f471f691640 1 -- start start 2024-08-19T01:37:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471f691640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47180fe9f0 0x7f47180fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471f691640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47181049f0 0x7f47180fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471f691640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47180fb800 con 0x7f47180fe9f0 2024-08-19T01:37:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471f691640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47180fb970 con 0x7f47181049f0 2024-08-19T01:37:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471d42d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47180fe9f0 0x7f47180fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471d42d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47180fe9f0 0x7f47180fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33424/0 (socket says 172.21.15.17:33424) 2024-08-19T01:37:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471d42d640 1 -- 172.21.15.17:0/3858401854 learned_addr learned my addr 172.21.15.17:0/3858401854 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:39.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471cc2c640 1 --2- 172.21.15.17:0/3858401854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47181049f0 0x7f47180fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471d42d640 1 -- 172.21.15.17:0/3858401854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47181049f0 msgr2=0x7f47180fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471d42d640 1 --2- 172.21.15.17:0/3858401854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47181049f0 0x7f47180fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471d42d640 1 -- 172.21.15.17:0/3858401854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4708009560 con 0x7f47180fe9f0 2024-08-19T01:37:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f471d42d640 1 --2- 172.21.15.17:0/3858401854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47180fe9f0 0x7f47180fad80 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f471400b420 tx=0x7f471400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.948+0000 7f470e7fc640 1 -- 172.21.15.17:0/3858401854 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4714011800 con 0x7f47180fe9f0 2024-08-19T01:37:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.949+0000 7f470e7fc640 1 -- 172.21.15.17:0/3858401854 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4714011e20 con 0x7f47180fe9f0 2024-08-19T01:37:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.949+0000 7f471f691640 1 -- 172.21.15.17:0/3858401854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47181a1dd0 con 0x7f47180fe9f0 2024-08-19T01:37:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.949+0000 7f470e7fc640 1 -- 172.21.15.17:0/3858401854 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f471400f2e0 con 0x7f47180fe9f0 2024-08-19T01:37:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.949+0000 7f471f691640 1 -- 172.21.15.17:0/3858401854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47181a2130 con 0x7f47180fe9f0 2024-08-19T01:37:39.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.950+0000 7f471f691640 1 -- 172.21.15.17:0/3858401854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4718100130 con 0x7f47180fe9f0 2024-08-19T01:37:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.950+0000 7f470e7fc640 1 -- 172.21.15.17:0/3858401854 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4714010380 con 0x7f47180fe9f0 2024-08-19T01:37:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.951+0000 7f470e7fc640 1 --2- 172.21.15.17:0/3858401854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f470406e180 0x7f4704070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.951+0000 7f470e7fc640 1 -- 172.21.15.17:0/3858401854 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f471408da50 con 0x7f47180fe9f0 2024-08-19T01:37:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.951+0000 7f471cc2c640 1 --2- 172.21.15.17:0/3858401854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f470406e180 0x7f4704070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:39.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.951+0000 7f471cc2c640 1 --2- 172.21.15.17:0/3858401854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f470406e180 0x7f4704070640 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4708000c00 tx=0x7f4708031420 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:39.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:39.955+0000 7f470e7fc640 1 -- 172.21.15.17:0/3858401854 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f4714056db0 con 0x7f47180fe9f0 2024-08-19T01:37:40.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.166+0000 7f471f691640 1 -- 172.21.15.17:0/3858401854 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f471810bce0 con 0x7f47180fe9f0 2024-08-19T01:37:40.168 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:39 smithi017 ceph-mon[99370]: pgmap v1169: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:40.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.167+0000 7f470e7fc640 1 -- 172.21.15.17:0/3858401854 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v41) v1 ==== 107+0+4252 (secure 0 0 0) 0x7f471405a470 con 0x7f47180fe9f0 2024-08-19T01:37:40.168 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:40.168 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":29,"btime":"2024-08-19T01:04:56:515916+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44309,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/1724223979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1724223979},{"type":"v1","addr":"172.21.15.86:6827","nonce":1724223979}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:04:18.358857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:40.169 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 29 2024-08-19T01:37:40.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.169+0000 7f471f691640 1 -- 172.21.15.17:0/3858401854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f470406e180 msgr2=0x7f4704070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:40.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.169+0000 7f471f691640 1 --2- 172.21.15.17:0/3858401854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f470406e180 0x7f4704070640 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4708000c00 tx=0x7f4708031420 comp rx=0 tx=0).stop 2024-08-19T01:37:40.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.169+0000 7f471f691640 1 -- 172.21.15.17:0/3858401854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47180fe9f0 msgr2=0x7f47180fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:40.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.169+0000 7f471f691640 1 --2- 172.21.15.17:0/3858401854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47180fe9f0 0x7f47180fad80 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f471400b420 tx=0x7f471400b8e0 comp rx=0 tx=0).stop 2024-08-19T01:37:40.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.169+0000 7f471f691640 1 -- 172.21.15.17:0/3858401854 shutdown_connections 2024-08-19T01:37:40.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.169+0000 7f471f691640 1 --2- 172.21.15.17:0/3858401854 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f470406e180 0x7f4704070640 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:40.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.169+0000 7f471f691640 1 --2- 172.21.15.17:0/3858401854 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f47181049f0 0x7f47180fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:40.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.169+0000 7f471f691640 1 --2- 172.21.15.17:0/3858401854 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f47180fe9f0 0x7f47180fad80 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:40.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.169+0000 7f471f691640 1 -- 172.21.15.17:0/3858401854 >> 172.21.15.17:0/3858401854 conn(0x7f47180758a0 msgr2=0x7f4718067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:40.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.169+0000 7f471f691640 1 -- 172.21.15.17:0/3858401854 shutdown_connections 2024-08-19T01:37:40.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:40.169+0000 7f471f691640 1 -- 172.21.15.17:0/3858401854 wait complete. 2024-08-19T01:37:40.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:39 smithi086 ceph-mon[71303]: pgmap v1169: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:40.894 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:40 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3858401854' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-08-19T01:37:40.917 DEBUG:tasks.fs:max_mds not reduced in epoch 29 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-08-19T01:37:40.917 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-08-19T01:37:40.917 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 30 2024-08-19T01:37:41.125 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:41.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:40 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3858401854' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-08-19T01:37:41.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:41 smithi017 ceph-mon[99370]: pgmap v1170: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:42.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:41 smithi086 ceph-mon[71303]: pgmap v1170: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:42.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.777+0000 7f04ad375640 1 -- 172.21.15.17:0/1195792866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80fe9f0 msgr2=0x7f04a80fee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:42.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.777+0000 7f04ad375640 1 --2- 172.21.15.17:0/1195792866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80fe9f0 0x7f04a80fee50 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f0490009880 tx=0x7f049002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:42.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.778+0000 7f04ad375640 1 -- 172.21.15.17:0/1195792866 shutdown_connections 2024-08-19T01:37:42.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.778+0000 7f04ad375640 1 --2- 172.21.15.17:0/1195792866 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80fe9f0 0x7f04a80fee50 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:42.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.778+0000 7f04ad375640 1 --2- 172.21.15.17:0/1195792866 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04a81049f0 0x7f04a8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:42.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.778+0000 7f04ad375640 1 -- 172.21.15.17:0/1195792866 >> 172.21.15.17:0/1195792866 conn(0x7f04a80758a0 msgr2=0x7f04a80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:42.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.778+0000 7f04ad375640 1 -- 172.21.15.17:0/1195792866 shutdown_connections 2024-08-19T01:37:42.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.778+0000 7f04ad375640 1 -- 172.21.15.17:0/1195792866 wait complete. 2024-08-19T01:37:42.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.778+0000 7f04ad375640 1 Processor -- start 2024-08-19T01:37:42.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.778+0000 7f04ad375640 1 -- start start 2024-08-19T01:37:42.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.779+0000 7f04ad375640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80fe9f0 0x7f04a80fad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:42.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.779+0000 7f04ad375640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04a81049f0 0x7f04a80fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:42.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.779+0000 7f04ad375640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80fb800 con 0x7f04a80fe9f0 2024-08-19T01:37:42.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.779+0000 7f04ad375640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a80fb940 con 0x7f04a81049f0 2024-08-19T01:37:42.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.779+0000 7f04a6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80fe9f0 0x7f04a80fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.779+0000 7f04a6ffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80fe9f0 0x7f04a80fad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33448/0 (socket says 172.21.15.17:33448) 2024-08-19T01:37:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.779+0000 7f04a6ffd640 1 -- 172.21.15.17:0/30978704 learned_addr learned my addr 172.21.15.17:0/30978704 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.779+0000 7f04a67fc640 1 --2- 172.21.15.17:0/30978704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04a81049f0 0x7f04a80fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.779+0000 7f04a6ffd640 1 -- 172.21.15.17:0/30978704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04a81049f0 msgr2=0x7f04a80fb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.779+0000 7f04a6ffd640 1 --2- 172.21.15.17:0/30978704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04a81049f0 0x7f04a80fb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.779+0000 7f04a6ffd640 1 -- 172.21.15.17:0/30978704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0490009560 con 0x7f04a80fe9f0 2024-08-19T01:37:42.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.780+0000 7f04a6ffd640 1 --2- 172.21.15.17:0/30978704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80fe9f0 0x7f04a80fad80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f04a000d8d0 tx=0x7f04a000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.782+0000 7f049ffff640 1 -- 172.21.15.17:0/30978704 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04a0009c00 con 0x7f04a80fe9f0 2024-08-19T01:37:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.782+0000 7f049ffff640 1 -- 172.21.15.17:0/30978704 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04a0009d60 con 0x7f04a80fe9f0 2024-08-19T01:37:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.782+0000 7f04ad375640 1 -- 172.21.15.17:0/30978704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a81a1d80 con 0x7f04a80fe9f0 2024-08-19T01:37:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.782+0000 7f049ffff640 1 -- 172.21.15.17:0/30978704 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04a00049d0 con 0x7f04a80fe9f0 2024-08-19T01:37:42.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.782+0000 7f04ad375640 1 -- 172.21.15.17:0/30978704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a81a2130 con 0x7f04a80fe9f0 2024-08-19T01:37:42.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.783+0000 7f04ad375640 1 -- 172.21.15.17:0/30978704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a8100130 con 0x7f04a80fe9f0 2024-08-19T01:37:42.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.783+0000 7f049ffff640 1 -- 172.21.15.17:0/30978704 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f04a0004c40 con 0x7f04a80fe9f0 2024-08-19T01:37:42.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.784+0000 7f049ffff640 1 --2- 172.21.15.17:0/30978704 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f049406e170 0x7f0494070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:42.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.784+0000 7f049ffff640 1 -- 172.21.15.17:0/30978704 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f04a008ddc0 con 0x7f04a80fe9f0 2024-08-19T01:37:42.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.784+0000 7f04a67fc640 1 --2- 172.21.15.17:0/30978704 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f049406e170 0x7f0494070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:42.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.784+0000 7f04a67fc640 1 --2- 172.21.15.17:0/30978704 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f049406e170 0x7f0494070630 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0490009230 tx=0x7f04900058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:42.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.788+0000 7f049ffff640 1 -- 172.21.15.17:0/30978704 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f04a0057120 con 0x7f04a80fe9f0 2024-08-19T01:37:43.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:42.999+0000 7f04ad375640 1 -- 172.21.15.17:0/30978704 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f04a80fee50 con 0x7f04a80fe9f0 2024-08-19T01:37:43.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.000+0000 7f049ffff640 1 -- 172.21.15.17:0/30978704 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v41) v1 ==== 107+0+5099 (secure 0 0 0) 0x7f04a0017090 con 0x7f04a80fe9f0 2024-08-19T01:37:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:43.002 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":30,"btime":"2024-08-19T01:05:00:525013+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44309,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/1724223979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":1724223979},{"type":"v1","addr":"172.21.15.86:6827","nonce":1724223979}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":23},{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:04:18.358857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:43.002 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 30 2024-08-19T01:37:43.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.002+0000 7f04ad375640 1 -- 172.21.15.17:0/30978704 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f049406e170 msgr2=0x7f0494070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:43.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.002+0000 7f04ad375640 1 --2- 172.21.15.17:0/30978704 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f049406e170 0x7f0494070630 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0490009230 tx=0x7f04900058d0 comp rx=0 tx=0).stop 2024-08-19T01:37:43.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.002+0000 7f04ad375640 1 -- 172.21.15.17:0/30978704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80fe9f0 msgr2=0x7f04a80fad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:43.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.002+0000 7f04ad375640 1 --2- 172.21.15.17:0/30978704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80fe9f0 0x7f04a80fad80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f04a000d8d0 tx=0x7f04a000dd90 comp rx=0 tx=0).stop 2024-08-19T01:37:43.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.002+0000 7f04ad375640 1 -- 172.21.15.17:0/30978704 shutdown_connections 2024-08-19T01:37:43.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.002+0000 7f04ad375640 1 --2- 172.21.15.17:0/30978704 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f049406e170 0x7f0494070630 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:43.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.002+0000 7f04ad375640 1 --2- 172.21.15.17:0/30978704 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f04a81049f0 0x7f04a80fb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:43.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.002+0000 7f04ad375640 1 --2- 172.21.15.17:0/30978704 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f04a80fe9f0 0x7f04a80fad80 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:43.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.002+0000 7f04ad375640 1 -- 172.21.15.17:0/30978704 >> 172.21.15.17:0/30978704 conn(0x7f04a80758a0 msgr2=0x7f04a80fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:43.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.002+0000 7f04ad375640 1 -- 172.21.15.17:0/30978704 shutdown_connections 2024-08-19T01:37:43.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:43.002+0000 7f04ad375640 1 -- 172.21.15.17:0/30978704 wait complete. 2024-08-19T01:37:43.598 DEBUG:tasks.fs:max_mds not reduced in epoch 30 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-08-19T01:37:43.598 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-08-19T01:37:43.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 31 2024-08-19T01:37:43.805 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:43.928 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:43 smithi017 ceph-mon[99370]: pgmap v1171: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:43.928 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:43 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/30978704' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-08-19T01:37:44.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:43 smithi086 ceph-mon[71303]: pgmap v1171: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:44.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:43 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/30978704' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-08-19T01:37:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.650+0000 7fa950d74640 1 -- 172.21.15.17:0/2678772237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c0ffda0 msgr2=0x7fa94c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:45.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.650+0000 7fa950d74640 1 --2- 172.21.15.17:0/2678772237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c0ffda0 0x7fa94c100180 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009880 tx=0x7fa93c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.650+0000 7fa950d74640 1 -- 172.21.15.17:0/2678772237 shutdown_connections 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.650+0000 7fa950d74640 1 --2- 172.21.15.17:0/2678772237 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c100750 0x7fa94c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.650+0000 7fa950d74640 1 --2- 172.21.15.17:0/2678772237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c0ffda0 0x7fa94c100180 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.650+0000 7fa950d74640 1 -- 172.21.15.17:0/2678772237 >> 172.21.15.17:0/2678772237 conn(0x7fa94c0fb840 msgr2=0x7fa94c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.650+0000 7fa950d74640 1 -- 172.21.15.17:0/2678772237 shutdown_connections 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.650+0000 7fa950d74640 1 -- 172.21.15.17:0/2678772237 wait complete. 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.651+0000 7fa950d74640 1 Processor -- start 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.651+0000 7fa950d74640 1 -- start start 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.651+0000 7fa950d74640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c0ffda0 0x7fa94c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.651+0000 7fa950d74640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c100750 0x7fa94c19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.651+0000 7fa950d74640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c195a10 con 0x7fa94c100750 2024-08-19T01:37:45.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.651+0000 7fa950d74640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94c195b50 con 0x7fa94c0ffda0 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa949d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c100750 0x7fa94c19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa949d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c100750 0x7fa94c19bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:33476/0 (socket says 172.21.15.17:33476) 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa949d9b640 1 -- 172.21.15.17:0/2439132883 learned_addr learned my addr 172.21.15.17:0/2439132883 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa94a59c640 1 --2- 172.21.15.17:0/2439132883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c0ffda0 0x7fa94c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa949d9b640 1 -- 172.21.15.17:0/2439132883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c0ffda0 msgr2=0x7fa94c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa949d9b640 1 --2- 172.21.15.17:0/2439132883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c0ffda0 0x7fa94c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa949d9b640 1 -- 172.21.15.17:0/2439132883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c009560 con 0x7fa94c100750 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa949d9b640 1 --2- 172.21.15.17:0/2439132883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c100750 0x7fa94c19bef0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fa94000d6f0 tx=0x7fa94000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa93b7fe640 1 -- 172.21.15.17:0/2439132883 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa940009a30 con 0x7fa94c100750 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa950d74640 1 -- 172.21.15.17:0/2439132883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94c195e30 con 0x7fa94c100750 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa93b7fe640 1 -- 172.21.15.17:0/2439132883 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9400054e0 con 0x7fa94c100750 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa93b7fe640 1 -- 172.21.15.17:0/2439132883 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa940010460 con 0x7fa94c100750 2024-08-19T01:37:45.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.652+0000 7fa950d74640 1 -- 172.21.15.17:0/2439132883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94c196380 con 0x7fa94c100750 2024-08-19T01:37:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.653+0000 7fa950d74640 1 -- 172.21.15.17:0/2439132883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa94c101280 con 0x7fa94c100750 2024-08-19T01:37:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.654+0000 7fa93b7fe640 1 -- 172.21.15.17:0/2439132883 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fa940009b90 con 0x7fa94c100750 2024-08-19T01:37:45.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.654+0000 7fa93b7fe640 1 --2- 172.21.15.17:0/2439132883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93406e180 0x7fa934070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:45.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.654+0000 7fa93b7fe640 1 -- 172.21.15.17:0/2439132883 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa94008dbd0 con 0x7fa94c100750 2024-08-19T01:37:45.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.654+0000 7fa94a59c640 1 --2- 172.21.15.17:0/2439132883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93406e180 0x7fa934070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:45.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.655+0000 7fa94a59c640 1 --2- 172.21.15.17:0/2439132883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93406e180 0x7fa934070640 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009230 tx=0x7fa93c005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:45.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.659+0000 7fa93b7fe640 1 -- 172.21.15.17:0/2439132883 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fa940056fe0 con 0x7fa94c100750 2024-08-19T01:37:45.870 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:45 smithi017 ceph-mon[99370]: pgmap v1172: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:45.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.869+0000 7fa950d74640 1 -- 172.21.15.17:0/2439132883 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fa94c196f70 con 0x7fa94c100750 2024-08-19T01:37:45.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.870+0000 7fa93b7fe640 1 -- 172.21.15.17:0/2439132883 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v41) v1 ==== 107+0+4320 (secure 0 0 0) 0x7fa940020090 con 0x7fa94c100750 2024-08-19T01:37:45.872 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:45.872 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"btime":"2024-08-19T01:20:03:936872+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:04:18.358857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:45.872 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 31 2024-08-19T01:37:45.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.872+0000 7fa950d74640 1 -- 172.21.15.17:0/2439132883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93406e180 msgr2=0x7fa934070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.872+0000 7fa950d74640 1 --2- 172.21.15.17:0/2439132883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93406e180 0x7fa934070640 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009230 tx=0x7fa93c005a20 comp rx=0 tx=0).stop 2024-08-19T01:37:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.872+0000 7fa950d74640 1 -- 172.21.15.17:0/2439132883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c100750 msgr2=0x7fa94c19bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.872+0000 7fa950d74640 1 --2- 172.21.15.17:0/2439132883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c100750 0x7fa94c19bef0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fa94000d6f0 tx=0x7fa94000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:37:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.872+0000 7fa950d74640 1 -- 172.21.15.17:0/2439132883 shutdown_connections 2024-08-19T01:37:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.872+0000 7fa950d74640 1 --2- 172.21.15.17:0/2439132883 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fa93406e180 0x7fa934070640 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.872+0000 7fa950d74640 1 --2- 172.21.15.17:0/2439132883 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa94c100750 0x7fa94c19bef0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:45.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.872+0000 7fa950d74640 1 --2- 172.21.15.17:0/2439132883 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fa94c0ffda0 0x7fa94c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:45.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.872+0000 7fa950d74640 1 -- 172.21.15.17:0/2439132883 >> 172.21.15.17:0/2439132883 conn(0x7fa94c0fb840 msgr2=0x7fa94c0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:45.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.872+0000 7fa950d74640 1 -- 172.21.15.17:0/2439132883 shutdown_connections 2024-08-19T01:37:45.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:45.872+0000 7fa950d74640 1 -- 172.21.15.17:0/2439132883 wait complete. 2024-08-19T01:37:46.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:45 smithi086 ceph-mon[71303]: pgmap v1172: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:46.519 DEBUG:tasks.fs:max_mds not reduced in epoch 31 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-08-19T01:37:46.520 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-08-19T01:37:46.520 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 32 2024-08-19T01:37:46.738 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:47.068 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:46 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2439132883' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-08-19T01:37:47.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:46 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2439132883' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-08-19T01:37:48.143 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:47 smithi017 ceph-mon[99370]: pgmap v1173: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:48.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:47 smithi086 ceph-mon[71303]: pgmap v1173: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.366+0000 7f978cdcb640 1 -- 172.21.15.17:0/1881771707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97881049f0 msgr2=0x7f9788104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.366+0000 7f978cdcb640 1 --2- 172.21.15.17:0/1881771707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97881049f0 0x7f9788104dd0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f9778009880 tx=0x7f977802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.366+0000 7f978cdcb640 1 -- 172.21.15.17:0/1881771707 shutdown_connections 2024-08-19T01:37:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.366+0000 7f978cdcb640 1 --2- 172.21.15.17:0/1881771707 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97880fe9f0 0x7f97880fee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.366+0000 7f978cdcb640 1 --2- 172.21.15.17:0/1881771707 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97881049f0 0x7f9788104dd0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.366+0000 7f978cdcb640 1 -- 172.21.15.17:0/1881771707 >> 172.21.15.17:0/1881771707 conn(0x7f97880758a0 msgr2=0x7f97880fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:48.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.366+0000 7f978cdcb640 1 -- 172.21.15.17:0/1881771707 shutdown_connections 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.366+0000 7f978cdcb640 1 -- 172.21.15.17:0/1881771707 wait complete. 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f978cdcb640 1 Processor -- start 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f978cdcb640 1 -- start start 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f978cdcb640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97880fe9f0 0x7f978819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f978cdcb640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97881049f0 0x7f978819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f978cdcb640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97881958f0 con 0x7f97881049f0 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f978cdcb640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788195a30 con 0x7f97880fe9f0 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f9785d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97881049f0 0x7f978819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f9785d9b640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97881049f0 0x7f978819bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:34994/0 (socket says 172.21.15.17:34994) 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f9785d9b640 1 -- 172.21.15.17:0/975004861 learned_addr learned my addr 172.21.15.17:0/975004861 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f978659c640 1 --2- 172.21.15.17:0/975004861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97880fe9f0 0x7f978819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f9785d9b640 1 -- 172.21.15.17:0/975004861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97880fe9f0 msgr2=0x7f978819b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:48.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f9785d9b640 1 --2- 172.21.15.17:0/975004861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97880fe9f0 0x7f978819b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.367+0000 7f9785d9b640 1 -- 172.21.15.17:0/975004861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9778009560 con 0x7f97881049f0 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.368+0000 7f9785d9b640 1 --2- 172.21.15.17:0/975004861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97881049f0 0x7f978819bdd0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f977c00c810 tx=0x7f977c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.368+0000 7f97777fe640 1 -- 172.21.15.17:0/975004861 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f977c0041f0 con 0x7f97881049f0 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.368+0000 7f97777fe640 1 -- 172.21.15.17:0/975004861 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f977c007e70 con 0x7f97881049f0 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.368+0000 7f978cdcb640 1 -- 172.21.15.17:0/975004861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9788195d10 con 0x7f97881049f0 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.368+0000 7f97777fe640 1 -- 172.21.15.17:0/975004861 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f977c0049d0 con 0x7f97881049f0 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.368+0000 7f978cdcb640 1 -- 172.21.15.17:0/975004861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9788196260 con 0x7f97881049f0 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.369+0000 7f978cdcb640 1 -- 172.21.15.17:0/975004861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9788100130 con 0x7f97881049f0 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.369+0000 7f97777fe640 1 -- 172.21.15.17:0/975004861 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f977c0079b0 con 0x7f97881049f0 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.370+0000 7f97777fe640 1 --2- 172.21.15.17:0/975004861 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f977006e170 0x7f9770070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.370+0000 7f97777fe640 1 -- 172.21.15.17:0/975004861 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f977c08de60 con 0x7f97881049f0 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.370+0000 7f978659c640 1 --2- 172.21.15.17:0/975004861 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f977006e170 0x7f9770070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:48.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.370+0000 7f978659c640 1 --2- 172.21.15.17:0/975004861 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f977006e170 0x7f9770070630 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9778009230 tx=0x7f97780058d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:48.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.374+0000 7f97777fe640 1 -- 172.21.15.17:0/975004861 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f977c057270 con 0x7f97881049f0 2024-08-19T01:37:48.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.587+0000 7f978cdcb640 1 -- 172.21.15.17:0/975004861 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f9788196530 con 0x7f97881049f0 2024-08-19T01:37:48.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.588+0000 7f97777fe640 1 -- 172.21.15.17:0/975004861 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v41) v1 ==== 107+0+5164 (secure 0 0 0) 0x7f977c01d020 con 0x7f97881049f0 2024-08-19T01:37:48.589 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:48.589 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":32,"btime":"2024-08-19T01:20:07:951551+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44907,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/540250441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":540250441},{"type":"v1","addr":"172.21.15.86:6827","nonce":540250441}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":23,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:04:18.358857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:48.589 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 32 2024-08-19T01:37:48.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.590+0000 7f978cdcb640 1 -- 172.21.15.17:0/975004861 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f977006e170 msgr2=0x7f9770070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:48.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.590+0000 7f978cdcb640 1 --2- 172.21.15.17:0/975004861 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f977006e170 0x7f9770070630 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9778009230 tx=0x7f97780058d0 comp rx=0 tx=0).stop 2024-08-19T01:37:48.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.590+0000 7f978cdcb640 1 -- 172.21.15.17:0/975004861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97881049f0 msgr2=0x7f978819bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:48.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.590+0000 7f978cdcb640 1 --2- 172.21.15.17:0/975004861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97881049f0 0x7f978819bdd0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f977c00c810 tx=0x7f977c00ccd0 comp rx=0 tx=0).stop 2024-08-19T01:37:48.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.590+0000 7f978cdcb640 1 -- 172.21.15.17:0/975004861 shutdown_connections 2024-08-19T01:37:48.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.590+0000 7f978cdcb640 1 --2- 172.21.15.17:0/975004861 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f977006e170 0x7f9770070630 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:48.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.590+0000 7f978cdcb640 1 --2- 172.21.15.17:0/975004861 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97881049f0 0x7f978819bdd0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:48.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.590+0000 7f978cdcb640 1 --2- 172.21.15.17:0/975004861 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f97880fe9f0 0x7f978819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:48.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.590+0000 7f978cdcb640 1 -- 172.21.15.17:0/975004861 >> 172.21.15.17:0/975004861 conn(0x7f97880758a0 msgr2=0x7f9788067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:48.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.590+0000 7f978cdcb640 1 -- 172.21.15.17:0/975004861 shutdown_connections 2024-08-19T01:37:48.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:48.590+0000 7f978cdcb640 1 -- 172.21.15.17:0/975004861 wait complete. 2024-08-19T01:37:49.132 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:37:49.132 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:48 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/975004861' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-08-19T01:37:49.153 DEBUG:tasks.fs:max_mds not reduced in epoch 32 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-08-19T01:37:49.153 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-08-19T01:37:49.154 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 33 2024-08-19T01:37:49.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:37:49.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:48 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/975004861' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-08-19T01:37:49.361 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:50.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:49 smithi017 ceph-mon[99370]: pgmap v1174: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:50.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:49 smithi086 ceph-mon[71303]: pgmap v1174: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:51.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.023+0000 7fd86c93c640 1 -- 172.21.15.17:0/2503534292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8680fea30 msgr2=0x7fd8680fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:51.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.023+0000 7fd86c93c640 1 --2- 172.21.15.17:0/2503534292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8680fea30 0x7fd8680fee90 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fd850009880 tx=0x7fd85002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:51.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.023+0000 7fd86c93c640 1 -- 172.21.15.17:0/2503534292 shutdown_connections 2024-08-19T01:37:51.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.023+0000 7fd86c93c640 1 --2- 172.21.15.17:0/2503534292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8680fea30 0x7fd8680fee90 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:51.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.023+0000 7fd86c93c640 1 --2- 172.21.15.17:0/2503534292 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd868104a30 0x7fd868104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:51.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.023+0000 7fd86c93c640 1 -- 172.21.15.17:0/2503534292 >> 172.21.15.17:0/2503534292 conn(0x7fd8680fa730 msgr2=0x7fd8680fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:51.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.023+0000 7fd86c93c640 1 -- 172.21.15.17:0/2503534292 shutdown_connections 2024-08-19T01:37:51.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.023+0000 7fd86c93c640 1 -- 172.21.15.17:0/2503534292 wait complete. 2024-08-19T01:37:51.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.024+0000 7fd86c93c640 1 Processor -- start 2024-08-19T01:37:51.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.024+0000 7fd86c93c640 1 -- start start 2024-08-19T01:37:51.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.024+0000 7fd86c93c640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8680fea30 0x7fd86819d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.024+0000 7fd86c93c640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd868104a30 0x7fd86819def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.024+0000 7fd86c93c640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86819e580 con 0x7fd868104a30 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.024+0000 7fd86c93c640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd868197b00 con 0x7fd8680fea30 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.024+0000 7fd85ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd868104a30 0x7fd86819def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.024+0000 7fd85ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd868104a30 0x7fd86819def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35008/0 (socket says 172.21.15.17:35008) 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.024+0000 7fd85ffff640 1 -- 172.21.15.17:0/2832246520 learned_addr learned my addr 172.21.15.17:0/2832246520 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.025+0000 7fd86659c640 1 --2- 172.21.15.17:0/2832246520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8680fea30 0x7fd86819d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.025+0000 7fd85ffff640 1 -- 172.21.15.17:0/2832246520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8680fea30 msgr2=0x7fd86819d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.025+0000 7fd85ffff640 1 --2- 172.21.15.17:0/2832246520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8680fea30 0x7fd86819d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.025+0000 7fd85ffff640 1 -- 172.21.15.17:0/2832246520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd850009560 con 0x7fd868104a30 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.025+0000 7fd85ffff640 1 --2- 172.21.15.17:0/2832246520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd868104a30 0x7fd86819def0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd85002a9c0 tx=0x7fd8500055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.025+0000 7fd85f7fe640 1 -- 172.21.15.17:0/2832246520 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd850004aa0 con 0x7fd868104a30 2024-08-19T01:37:51.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.025+0000 7fd85f7fe640 1 -- 172.21.15.17:0/2832246520 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd850004c00 con 0x7fd868104a30 2024-08-19T01:37:51.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.025+0000 7fd86c93c640 1 -- 172.21.15.17:0/2832246520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd868197d80 con 0x7fd868104a30 2024-08-19T01:37:51.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.025+0000 7fd85f7fe640 1 -- 172.21.15.17:0/2832246520 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd850003980 con 0x7fd868104a30 2024-08-19T01:37:51.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.025+0000 7fd86c93c640 1 -- 172.21.15.17:0/2832246520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd868198270 con 0x7fd868104a30 2024-08-19T01:37:51.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.026+0000 7fd86c93c640 1 -- 172.21.15.17:0/2832246520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd868100170 con 0x7fd868104a30 2024-08-19T01:37:51.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.027+0000 7fd85f7fe640 1 -- 172.21.15.17:0/2832246520 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd850003bf0 con 0x7fd868104a30 2024-08-19T01:37:51.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.027+0000 7fd85f7fe640 1 --2- 172.21.15.17:0/2832246520 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd85406e170 0x7fd854070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:51.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.027+0000 7fd85f7fe640 1 -- 172.21.15.17:0/2832246520 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd8500af160 con 0x7fd868104a30 2024-08-19T01:37:51.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.027+0000 7fd86659c640 1 --2- 172.21.15.17:0/2832246520 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd85406e170 0x7fd854070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:51.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.028+0000 7fd86659c640 1 --2- 172.21.15.17:0/2832246520 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd85406e170 0x7fd854070630 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd858005fd0 tx=0x7fd85800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:51.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.032+0000 7fd85f7fe640 1 -- 172.21.15.17:0/2832246520 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd8500784f0 con 0x7fd868104a30 2024-08-19T01:37:51.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.242+0000 7fd86c93c640 1 -- 172.21.15.17:0/2832246520 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fd8680fee90 con 0x7fd868104a30 2024-08-19T01:37:51.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.243+0000 7fd85f7fe640 1 -- 172.21.15.17:0/2832246520 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v41) v1 ==== 107+0+5163 (secure 0 0 0) 0x7fd85007bbb0 con 0x7fd868104a30 2024-08-19T01:37:51.244 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:51.244 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":33,"btime":"2024-08-19T01:35:09:219046+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":28},{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44907,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/540250441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":540250441},{"type":"v1","addr":"172.21.15.86:6827","nonce":540250441}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:35:08.222002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:51.244 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 33 2024-08-19T01:37:51.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.244+0000 7fd86c93c640 1 -- 172.21.15.17:0/2832246520 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd85406e170 msgr2=0x7fd854070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:51.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.244+0000 7fd86c93c640 1 --2- 172.21.15.17:0/2832246520 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd85406e170 0x7fd854070630 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fd858005fd0 tx=0x7fd85800b390 comp rx=0 tx=0).stop 2024-08-19T01:37:51.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.244+0000 7fd86c93c640 1 -- 172.21.15.17:0/2832246520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd868104a30 msgr2=0x7fd86819def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:51.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.244+0000 7fd86c93c640 1 --2- 172.21.15.17:0/2832246520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd868104a30 0x7fd86819def0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd85002a9c0 tx=0x7fd8500055a0 comp rx=0 tx=0).stop 2024-08-19T01:37:51.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.245+0000 7fd86c93c640 1 -- 172.21.15.17:0/2832246520 shutdown_connections 2024-08-19T01:37:51.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.245+0000 7fd86c93c640 1 --2- 172.21.15.17:0/2832246520 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd85406e170 0x7fd854070630 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:51.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.245+0000 7fd86c93c640 1 --2- 172.21.15.17:0/2832246520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd868104a30 0x7fd86819def0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:51.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.245+0000 7fd86c93c640 1 --2- 172.21.15.17:0/2832246520 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd8680fea30 0x7fd86819d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:51.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.245+0000 7fd86c93c640 1 -- 172.21.15.17:0/2832246520 >> 172.21.15.17:0/2832246520 conn(0x7fd8680fa730 msgr2=0x7fd8680fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:51.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.245+0000 7fd86c93c640 1 -- 172.21.15.17:0/2832246520 shutdown_connections 2024-08-19T01:37:51.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:51.245+0000 7fd86c93c640 1 -- 172.21.15.17:0/2832246520 wait complete. 2024-08-19T01:37:51.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:51 smithi017 ceph-mon[99370]: pgmap v1175: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:51.850 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:51 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2832246520' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-08-19T01:37:51.869 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-08-19T01:37:51.869 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 34 2024-08-19T01:37:52.076 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:52.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:51 smithi086 ceph-mon[71303]: pgmap v1175: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:37:52.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:51 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2832246520' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-08-19T01:37:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.766+0000 7f6efb180640 1 -- 172.21.15.17:0/1331525677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef4105c00 msgr2=0x7f6ef4105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.766+0000 7f6efb180640 1 --2- 172.21.15.17:0/1331525677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef4105c00 0x7f6ef4105fe0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009880 tx=0x7f6ee802a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.766+0000 7f6efb180640 1 -- 172.21.15.17:0/1331525677 shutdown_connections 2024-08-19T01:37:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.766+0000 7f6efb180640 1 --2- 172.21.15.17:0/1331525677 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef40ffb50 0x7f6ef40fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.766+0000 7f6efb180640 1 --2- 172.21.15.17:0/1331525677 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef4105c00 0x7f6ef4105fe0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.766+0000 7f6efb180640 1 -- 172.21.15.17:0/1331525677 >> 172.21.15.17:0/1331525677 conn(0x7f6ef40fb830 msgr2=0x7f6ef40fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.766+0000 7f6efb180640 1 -- 172.21.15.17:0/1331525677 shutdown_connections 2024-08-19T01:37:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.766+0000 7f6efb180640 1 -- 172.21.15.17:0/1331525677 wait complete. 2024-08-19T01:37:53.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.767+0000 7f6efb180640 1 Processor -- start 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.767+0000 7f6efb180640 1 -- start start 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.767+0000 7f6efb180640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef40ffb50 0x7f6ef40727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.767+0000 7f6efb180640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef4105c00 0x7f6ef4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.767+0000 7f6efb180640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef4073230 con 0x7f6ef4105c00 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.767+0000 7f6efb180640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef40733a0 con 0x7f6ef40ffb50 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.767+0000 7f6ef3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef4105c00 0x7f6ef4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.767+0000 7f6ef3fff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef4105c00 0x7f6ef4072cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35028/0 (socket says 172.21.15.17:35028) 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.767+0000 7f6ef3fff640 1 -- 172.21.15.17:0/2190255148 learned_addr learned my addr 172.21.15.17:0/2190255148 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.767+0000 7f6ef8f1c640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef40ffb50 0x7f6ef40727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.768+0000 7f6ef3fff640 1 -- 172.21.15.17:0/2190255148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef40ffb50 msgr2=0x7f6ef40727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.768+0000 7f6ef3fff640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef40ffb50 0x7f6ef40727b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:53.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.768+0000 7f6ef3fff640 1 -- 172.21.15.17:0/2190255148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8009560 con 0x7f6ef4105c00 2024-08-19T01:37:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.768+0000 7f6ef8f1c640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef40ffb50 0x7f6ef40727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:37:53.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.768+0000 7f6ef3fff640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef4105c00 0x7f6ef4072cf0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000d6f0 tx=0x7f6ee000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.768+0000 7f6ef1ffb640 1 -- 172.21.15.17:0/2190255148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee0009a30 con 0x7f6ef4105c00 2024-08-19T01:37:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.768+0000 7f6ef1ffb640 1 -- 172.21.15.17:0/2190255148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ee00054e0 con 0x7f6ef4105c00 2024-08-19T01:37:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.768+0000 7f6efb180640 1 -- 172.21.15.17:0/2190255148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef41a1cc0 con 0x7f6ef4105c00 2024-08-19T01:37:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.768+0000 7f6ef1ffb640 1 -- 172.21.15.17:0/2190255148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee0010460 con 0x7f6ef4105c00 2024-08-19T01:37:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.768+0000 7f6efb180640 1 -- 172.21.15.17:0/2190255148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef41a2020 con 0x7f6ef4105c00 2024-08-19T01:37:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.769+0000 7f6efb180640 1 -- 172.21.15.17:0/2190255148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef4101200 con 0x7f6ef4105c00 2024-08-19T01:37:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.770+0000 7f6ef1ffb640 1 -- 172.21.15.17:0/2190255148 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6ee0009b90 con 0x7f6ef4105c00 2024-08-19T01:37:53.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.770+0000 7f6ef1ffb640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6ee406e180 0x7f6ee4070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.770+0000 7f6ef1ffb640 1 -- 172.21.15.17:0/2190255148 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6ee008dd20 con 0x7f6ef4105c00 2024-08-19T01:37:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.771+0000 7f6ef8f1c640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6ee406e180 0x7f6ee4070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:53.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.771+0000 7f6ef8f1c640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6ee406e180 0x7f6ee4070640 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8000c00 tx=0x7f6ee8005a20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:53.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.775+0000 7f6ef1ffb640 1 -- 172.21.15.17:0/2190255148 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f6ee0057000 con 0x7f6ef4105c00 2024-08-19T01:37:53.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.993+0000 7f6efb180640 1 -- 172.21.15.17:0/2190255148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f6ef410cdc0 con 0x7f6ef4105c00 2024-08-19T01:37:53.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.993+0000 7f6ef1ffb640 1 -- 172.21.15.17:0/2190255148 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v41) v1 ==== 107+0+5254 (secure 0 0 0) 0x7f6ee005a6c0 con 0x7f6ef4105c00 2024-08-19T01:37:53.995 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:53.995 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":34,"btime":"2024-08-19T01:35:09:223279+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44907,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/540250441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":540250441},{"type":"v1","addr":"172.21.15.86:6827","nonce":540250441}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:35:09.223262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":0,"incarnation":34,"state":"up:replay","state_seq":1,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":1,"incarnation":34,"state":"up:replay","state_seq":1,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:53.995 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 34 2024-08-19T01:37:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.995+0000 7f6efb180640 1 -- 172.21.15.17:0/2190255148 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6ee406e180 msgr2=0x7f6ee4070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.995+0000 7f6efb180640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6ee406e180 0x7f6ee4070640 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8000c00 tx=0x7f6ee8005a20 comp rx=0 tx=0).stop 2024-08-19T01:37:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.995+0000 7f6efb180640 1 -- 172.21.15.17:0/2190255148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef4105c00 msgr2=0x7f6ef4072cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.995+0000 7f6efb180640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef4105c00 0x7f6ef4072cf0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f6ee000d6f0 tx=0x7f6ee000dbb0 comp rx=0 tx=0).stop 2024-08-19T01:37:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.995+0000 7f6efb180640 1 -- 172.21.15.17:0/2190255148 shutdown_connections 2024-08-19T01:37:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.995+0000 7f6efb180640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f6ee406e180 0x7f6ee4070640 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.995+0000 7f6efb180640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ef4105c00 0x7f6ef4072cf0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.995+0000 7f6efb180640 1 --2- 172.21.15.17:0/2190255148 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f6ef40ffb50 0x7f6ef40727b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.995+0000 7f6efb180640 1 -- 172.21.15.17:0/2190255148 >> 172.21.15.17:0/2190255148 conn(0x7f6ef40fb830 msgr2=0x7f6ef40fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.996+0000 7f6efb180640 1 -- 172.21.15.17:0/2190255148 shutdown_connections 2024-08-19T01:37:53.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:53.996+0000 7f6efb180640 1 -- 172.21.15.17:0/2190255148 wait complete. 2024-08-19T01:37:54.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:53 smithi017 ceph-mon[99370]: pgmap v1176: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:54.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:53 smithi086 ceph-mon[71303]: pgmap v1176: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:37:54.676 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-08-19T01:37:54.677 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 35 2024-08-19T01:37:54.887 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:54.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:54 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2190255148' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-08-19T01:37:55.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:54 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2190255148' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-08-19T01:37:56.169 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:55 smithi017 ceph-mon[99370]: pgmap v1177: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:56.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:55 smithi086 ceph-mon[71303]: pgmap v1177: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:37:56.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.710+0000 7f9ca7db2640 1 -- 172.21.15.17:0/832611463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca00ffda0 msgr2=0x7f9ca0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.710+0000 7f9ca7db2640 1 --2- 172.21.15.17:0/832611463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca00ffda0 0x7f9ca0100180 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009880 tx=0x7f9c9c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.710+0000 7f9ca7db2640 1 -- 172.21.15.17:0/832611463 shutdown_connections 2024-08-19T01:37:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.710+0000 7f9ca7db2640 1 --2- 172.21.15.17:0/832611463 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca0100750 0x7f9ca01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.710+0000 7f9ca7db2640 1 --2- 172.21.15.17:0/832611463 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca00ffda0 0x7f9ca0100180 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.710+0000 7f9ca7db2640 1 -- 172.21.15.17:0/832611463 >> 172.21.15.17:0/832611463 conn(0x7f9ca00fb840 msgr2=0x7f9ca00fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.710+0000 7f9ca7db2640 1 -- 172.21.15.17:0/832611463 shutdown_connections 2024-08-19T01:37:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.710+0000 7f9ca7db2640 1 -- 172.21.15.17:0/832611463 wait complete. 2024-08-19T01:37:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.711+0000 7f9ca7db2640 1 Processor -- start 2024-08-19T01:37:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.711+0000 7f9ca7db2640 1 -- start start 2024-08-19T01:37:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.711+0000 7f9ca7db2640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca00ffda0 0x7f9ca019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:56.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.711+0000 7f9ca7db2640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca0100750 0x7f9ca019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.711+0000 7f9ca7db2640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca0195a10 con 0x7f9ca00ffda0 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.711+0000 7f9ca7db2640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca0195b50 con 0x7f9ca0100750 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.711+0000 7f9ca5b4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca00ffda0 0x7f9ca019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.711+0000 7f9ca5b4e640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca00ffda0 0x7f9ca019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36830/0 (socket says 172.21.15.17:36830) 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.711+0000 7f9ca5b4e640 1 -- 172.21.15.17:0/3165725332 learned_addr learned my addr 172.21.15.17:0/3165725332 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.712+0000 7f9ca534d640 1 --2- 172.21.15.17:0/3165725332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca0100750 0x7f9ca019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.712+0000 7f9ca5b4e640 1 -- 172.21.15.17:0/3165725332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca0100750 msgr2=0x7f9ca019bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.712+0000 7f9ca5b4e640 1 --2- 172.21.15.17:0/3165725332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca0100750 0x7f9ca019bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.712+0000 7f9ca5b4e640 1 -- 172.21.15.17:0/3165725332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c009560 con 0x7f9ca00ffda0 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.712+0000 7f9ca5b4e640 1 --2- 172.21.15.17:0/3165725332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca00ffda0 0x7f9ca019b9b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c02a9c0 tx=0x7f9c9c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.712+0000 7f9c96ffd640 1 -- 172.21.15.17:0/3165725332 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c9c004aa0 con 0x7f9ca00ffda0 2024-08-19T01:37:56.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.712+0000 7f9c96ffd640 1 -- 172.21.15.17:0/3165725332 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c9c004c00 con 0x7f9ca00ffda0 2024-08-19T01:37:56.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.712+0000 7f9ca7db2640 1 -- 172.21.15.17:0/3165725332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca0195dd0 con 0x7f9ca00ffda0 2024-08-19T01:37:56.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.712+0000 7f9c96ffd640 1 -- 172.21.15.17:0/3165725332 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c9c003980 con 0x7f9ca00ffda0 2024-08-19T01:37:56.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.712+0000 7f9ca7db2640 1 -- 172.21.15.17:0/3165725332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca01962c0 con 0x7f9ca00ffda0 2024-08-19T01:37:56.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.713+0000 7f9ca7db2640 1 -- 172.21.15.17:0/3165725332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca0101280 con 0x7f9ca00ffda0 2024-08-19T01:37:56.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.714+0000 7f9c96ffd640 1 -- 172.21.15.17:0/3165725332 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9c9c003bf0 con 0x7f9ca00ffda0 2024-08-19T01:37:56.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.714+0000 7f9c96ffd640 1 --2- 172.21.15.17:0/3165725332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9c8c06e1c0 0x7f9c8c070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:56.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.714+0000 7f9c96ffd640 1 -- 172.21.15.17:0/3165725332 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9c9c0af200 con 0x7f9ca00ffda0 2024-08-19T01:37:56.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.714+0000 7f9ca534d640 1 --2- 172.21.15.17:0/3165725332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9c8c06e1c0 0x7f9c8c070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:56.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.715+0000 7f9ca534d640 1 --2- 172.21.15.17:0/3165725332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9c8c06e1c0 0x7f9c8c070680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0197260 tx=0x7f9c9000b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:56.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.719+0000 7f9c96ffd640 1 -- 172.21.15.17:0/3165725332 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f9c9c0784f0 con 0x7f9ca00ffda0 2024-08-19T01:37:56.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.932+0000 7f9ca7db2640 1 -- 172.21.15.17:0/3165725332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f9ca0196fa0 con 0x7f9ca00ffda0 2024-08-19T01:37:56.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.932+0000 7f9c96ffd640 1 -- 172.21.15.17:0/3165725332 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v41) v1 ==== 107+0+5256 (secure 0 0 0) 0x7f9c9c07bbb0 con 0x7f9ca00ffda0 2024-08-19T01:37:56.934 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:56.934 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"btime":"2024-08-19T01:35:10:226101+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44907,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/540250441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":540250441},{"type":"v1","addr":"172.21.15.86:6827","nonce":540250441}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:35:09.236370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":0,"incarnation":34,"state":"up:replay","state_seq":1,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":1,"incarnation":34,"state":"up:resolve","state_seq":458,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:56.934 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 35 2024-08-19T01:37:56.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.934+0000 7f9ca7db2640 1 -- 172.21.15.17:0/3165725332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9c8c06e1c0 msgr2=0x7f9c8c070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:56.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.934+0000 7f9ca7db2640 1 --2- 172.21.15.17:0/3165725332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9c8c06e1c0 0x7f9c8c070680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0197260 tx=0x7f9c9000b390 comp rx=0 tx=0).stop 2024-08-19T01:37:56.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.934+0000 7f9ca7db2640 1 -- 172.21.15.17:0/3165725332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca00ffda0 msgr2=0x7f9ca019b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:56.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.934+0000 7f9ca7db2640 1 --2- 172.21.15.17:0/3165725332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca00ffda0 0x7f9ca019b9b0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c02a9c0 tx=0x7f9c9c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:37:56.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.934+0000 7f9ca7db2640 1 -- 172.21.15.17:0/3165725332 shutdown_connections 2024-08-19T01:37:56.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.934+0000 7f9ca7db2640 1 --2- 172.21.15.17:0/3165725332 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f9c8c06e1c0 0x7f9c8c070680 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:56.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.934+0000 7f9ca7db2640 1 --2- 172.21.15.17:0/3165725332 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f9ca0100750 0x7f9ca019bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:56.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.934+0000 7f9ca7db2640 1 --2- 172.21.15.17:0/3165725332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ca00ffda0 0x7f9ca019b9b0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:56.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.934+0000 7f9ca7db2640 1 -- 172.21.15.17:0/3165725332 >> 172.21.15.17:0/3165725332 conn(0x7f9ca00fb840 msgr2=0x7f9ca00fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:56.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.934+0000 7f9ca7db2640 1 -- 172.21.15.17:0/3165725332 shutdown_connections 2024-08-19T01:37:56.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:56.934+0000 7f9ca7db2640 1 -- 172.21.15.17:0/3165725332 wait complete. 2024-08-19T01:37:57.569 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 36 2024-08-19T01:37:57.782 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:37:58.105 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:57 smithi017 ceph-mon[99370]: pgmap v1178: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:58.105 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:57 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3165725332' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-08-19T01:37:58.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:57 smithi086 ceph-mon[71303]: pgmap v1178: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:37:58.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:57 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3165725332' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-08-19T01:37:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.411+0000 7f5197112640 1 -- 172.21.15.17:0/1974314046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51900fea30 msgr2=0x7f51900fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.411+0000 7f5197112640 1 --2- 172.21.15.17:0/1974314046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51900fea30 0x7f51900fee90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f517c009880 tx=0x7f517c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:37:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.411+0000 7f5197112640 1 -- 172.21.15.17:0/1974314046 shutdown_connections 2024-08-19T01:37:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.411+0000 7f5197112640 1 --2- 172.21.15.17:0/1974314046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51900fea30 0x7f51900fee90 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.411+0000 7f5197112640 1 --2- 172.21.15.17:0/1974314046 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f5190104a30 0x7f5190104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.411+0000 7f5197112640 1 -- 172.21.15.17:0/1974314046 >> 172.21.15.17:0/1974314046 conn(0x7f51900fa730 msgr2=0x7f51900fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.411+0000 7f5197112640 1 -- 172.21.15.17:0/1974314046 shutdown_connections 2024-08-19T01:37:59.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.411+0000 7f5197112640 1 -- 172.21.15.17:0/1974314046 wait complete. 2024-08-19T01:37:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.412+0000 7f5197112640 1 Processor -- start 2024-08-19T01:37:59.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.412+0000 7f5197112640 1 -- start start 2024-08-19T01:37:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.412+0000 7f5197112640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51900fea30 0x7f5190196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.412+0000 7f5197112640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5190104a30 0x7f5190196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.412+0000 7f5197112640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5190197590 con 0x7f5190104a30 2024-08-19T01:37:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.412+0000 7f5197112640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5190197700 con 0x7f51900fea30 2024-08-19T01:37:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.412+0000 7f518ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5190104a30 0x7f5190196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.412+0000 7f518ffff640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5190104a30 0x7f5190196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36858/0 (socket says 172.21.15.17:36858) 2024-08-19T01:37:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.412+0000 7f518ffff640 1 -- 172.21.15.17:0/1138920340 learned_addr learned my addr 172.21.15.17:0/1138920340 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:37:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.412+0000 7f5194eae640 1 --2- 172.21.15.17:0/1138920340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51900fea30 0x7f5190196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:59.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.413+0000 7f518ffff640 1 -- 172.21.15.17:0/1138920340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51900fea30 msgr2=0x7f5190196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.413+0000 7f518ffff640 1 --2- 172.21.15.17:0/1138920340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51900fea30 0x7f5190196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.413+0000 7f518ffff640 1 -- 172.21.15.17:0/1138920340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c009560 con 0x7f5190104a30 2024-08-19T01:37:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.413+0000 7f518ffff640 1 --2- 172.21.15.17:0/1138920340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5190104a30 0x7f5190196fc0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f517c006010 tx=0x7f517c0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.413+0000 7f518dffb640 1 -- 172.21.15.17:0/1138920340 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f517c004aa0 con 0x7f5190104a30 2024-08-19T01:37:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.413+0000 7f518dffb640 1 -- 172.21.15.17:0/1138920340 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f517c004c00 con 0x7f5190104a30 2024-08-19T01:37:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.413+0000 7f5197112640 1 -- 172.21.15.17:0/1138920340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519019faf0 con 0x7f5190104a30 2024-08-19T01:37:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.413+0000 7f518dffb640 1 -- 172.21.15.17:0/1138920340 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f517c0038f0 con 0x7f5190104a30 2024-08-19T01:37:59.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.413+0000 7f5197112640 1 -- 172.21.15.17:0/1138920340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519019fe50 con 0x7f5190104a30 2024-08-19T01:37:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.415+0000 7f5197112640 1 -- 172.21.15.17:0/1138920340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5190100170 con 0x7f5190104a30 2024-08-19T01:37:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.415+0000 7f518dffb640 1 -- 172.21.15.17:0/1138920340 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f517c003b60 con 0x7f5190104a30 2024-08-19T01:37:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.415+0000 7f518dffb640 1 --2- 172.21.15.17:0/1138920340 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f518006e180 0x7f5180070640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:37:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.416+0000 7f518dffb640 1 -- 172.21.15.17:0/1138920340 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f517c0af290 con 0x7f5190104a30 2024-08-19T01:37:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.416+0000 7f5194eae640 1 --2- 172.21.15.17:0/1138920340 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f518006e180 0x7f5180070640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:37:59.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.416+0000 7f5194eae640 1 --2- 172.21.15.17:0/1138920340 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f518006e180 0x7f5180070640 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5184009990 tx=0x7f5184009110 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:37:59.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.420+0000 7f518dffb640 1 -- 172.21.15.17:0/1138920340 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f517c0785f0 con 0x7f5190104a30 2024-08-19T01:37:59.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.637+0000 7f5197112640 1 -- 172.21.15.17:0/1138920340 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f5190106fc0 con 0x7f5190104a30 2024-08-19T01:37:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.638+0000 7f518dffb640 1 -- 172.21.15.17:0/1138920340 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v41) v1 ==== 107+0+5259 (secure 0 0 0) 0x7f517c07bcb0 con 0x7f5190104a30 2024-08-19T01:37:59.639 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:37:59.639 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":36,"btime":"2024-08-19T01:35:18:192585+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44907,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/540250441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":540250441},{"type":"v1","addr":"172.21.15.86:6827","nonce":540250441}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:35:17.660983+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":0,"incarnation":34,"state":"up:resolve","state_seq":464,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":1,"incarnation":34,"state":"up:resolve","state_seq":458,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:37:59.639 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 36 2024-08-19T01:37:59.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.640+0000 7f5197112640 1 -- 172.21.15.17:0/1138920340 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f518006e180 msgr2=0x7f5180070640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:59.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.640+0000 7f5197112640 1 --2- 172.21.15.17:0/1138920340 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f518006e180 0x7f5180070640 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5184009990 tx=0x7f5184009110 comp rx=0 tx=0).stop 2024-08-19T01:37:59.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.640+0000 7f5197112640 1 -- 172.21.15.17:0/1138920340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5190104a30 msgr2=0x7f5190196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:37:59.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.640+0000 7f5197112640 1 --2- 172.21.15.17:0/1138920340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5190104a30 0x7f5190196fc0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f517c006010 tx=0x7f517c0055a0 comp rx=0 tx=0).stop 2024-08-19T01:37:59.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.640+0000 7f5197112640 1 -- 172.21.15.17:0/1138920340 shutdown_connections 2024-08-19T01:37:59.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.640+0000 7f5197112640 1 --2- 172.21.15.17:0/1138920340 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f518006e180 0x7f5180070640 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:59.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.640+0000 7f5197112640 1 --2- 172.21.15.17:0/1138920340 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5190104a30 0x7f5190196fc0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:59.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.640+0000 7f5197112640 1 --2- 172.21.15.17:0/1138920340 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f51900fea30 0x7f5190196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:37:59.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.640+0000 7f5197112640 1 -- 172.21.15.17:0/1138920340 >> 172.21.15.17:0/1138920340 conn(0x7f51900fa730 msgr2=0x7f51900fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:37:59.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.640+0000 7f5197112640 1 -- 172.21.15.17:0/1138920340 shutdown_connections 2024-08-19T01:37:59.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:37:59.640+0000 7f5197112640 1 -- 172.21.15.17:0/1138920340 wait complete. 2024-08-19T01:38:00.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:59 smithi017 ceph-mon[99370]: pgmap v1179: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:00.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:37:59 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1138920340' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-08-19T01:38:00.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:59 smithi086 ceph-mon[71303]: pgmap v1179: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:00.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:37:59 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1138920340' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-08-19T01:38:00.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 37 2024-08-19T01:38:00.465 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:38:02.022 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:01 smithi017 ceph-mon[99370]: pgmap v1180: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:38:02.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:01 smithi086 ceph-mon[71303]: pgmap v1180: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:38:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.267+0000 7fb355655640 1 -- 172.21.15.17:0/3536187572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3500fea30 msgr2=0x7fb3500fee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.267+0000 7fb355655640 1 --2- 172.21.15.17:0/3536187572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3500fea30 0x7fb3500fee90 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fb344009880 tx=0x7fb34402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:38:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.267+0000 7fb355655640 1 -- 172.21.15.17:0/3536187572 shutdown_connections 2024-08-19T01:38:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.267+0000 7fb355655640 1 --2- 172.21.15.17:0/3536187572 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb3500fea30 0x7fb3500fee90 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.267+0000 7fb355655640 1 --2- 172.21.15.17:0/3536187572 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb350104a30 0x7fb350104e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.267+0000 7fb355655640 1 -- 172.21.15.17:0/3536187572 >> 172.21.15.17:0/3536187572 conn(0x7fb3500fa730 msgr2=0x7fb3500fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.267+0000 7fb355655640 1 -- 172.21.15.17:0/3536187572 shutdown_connections 2024-08-19T01:38:02.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.267+0000 7fb355655640 1 -- 172.21.15.17:0/3536187572 wait complete. 2024-08-19T01:38:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.268+0000 7fb355655640 1 Processor -- start 2024-08-19T01:38:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.268+0000 7fb355655640 1 -- start start 2024-08-19T01:38:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.268+0000 7fb355655640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3500fea30 0x7fb35019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb355655640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb350104a30 0x7fb35019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb355655640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35019c3b0 con 0x7fb350104a30 2024-08-19T01:38:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb355655640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb350195940 con 0x7fb3500fea30 2024-08-19T01:38:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb34e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb350104a30 0x7fb35019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb34e7fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb350104a30 0x7fb35019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36890/0 (socket says 172.21.15.17:36890) 2024-08-19T01:38:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb34e7fc640 1 -- 172.21.15.17:0/894032443 learned_addr learned my addr 172.21.15.17:0/894032443 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:38:02.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb34effd640 1 --2- 172.21.15.17:0/894032443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3500fea30 0x7fb35019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb34e7fc640 1 -- 172.21.15.17:0/894032443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3500fea30 msgr2=0x7fb35019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb34e7fc640 1 --2- 172.21.15.17:0/894032443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3500fea30 0x7fb35019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb34e7fc640 1 -- 172.21.15.17:0/894032443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344009560 con 0x7fb350104a30 2024-08-19T01:38:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb34e7fc640 1 --2- 172.21.15.17:0/894032443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb350104a30 0x7fb35019bd90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fb34402a9c0 tx=0x7fb3440055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb337fff640 1 -- 172.21.15.17:0/894032443 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb344004aa0 con 0x7fb350104a30 2024-08-19T01:38:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb355655640 1 -- 172.21.15.17:0/894032443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb350195bc0 con 0x7fb350104a30 2024-08-19T01:38:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb337fff640 1 -- 172.21.15.17:0/894032443 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb344004c00 con 0x7fb350104a30 2024-08-19T01:38:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb337fff640 1 -- 172.21.15.17:0/894032443 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb344003980 con 0x7fb350104a30 2024-08-19T01:38:02.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.269+0000 7fb355655640 1 -- 172.21.15.17:0/894032443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3501960b0 con 0x7fb350104a30 2024-08-19T01:38:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.270+0000 7fb355655640 1 -- 172.21.15.17:0/894032443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb350100170 con 0x7fb350104a30 2024-08-19T01:38:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.271+0000 7fb337fff640 1 -- 172.21.15.17:0/894032443 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb344003bf0 con 0x7fb350104a30 2024-08-19T01:38:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.271+0000 7fb337fff640 1 --2- 172.21.15.17:0/894032443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb33806e170 0x7fb338070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.272+0000 7fb337fff640 1 -- 172.21.15.17:0/894032443 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb3440af2b0 con 0x7fb350104a30 2024-08-19T01:38:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.272+0000 7fb34effd640 1 --2- 172.21.15.17:0/894032443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb33806e170 0x7fb338070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:02.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.272+0000 7fb34effd640 1 --2- 172.21.15.17:0/894032443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb33806e170 0x7fb338070630 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb340005fd0 tx=0x7fb340005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:02.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.276+0000 7fb337fff640 1 -- 172.21.15.17:0/894032443 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fb3440784f0 con 0x7fb350104a30 2024-08-19T01:38:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.485+0000 7fb355655640 1 -- 172.21.15.17:0/894032443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7fb350107fb0 con 0x7fb350104a30 2024-08-19T01:38:02.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.486+0000 7fb337fff640 1 -- 172.21.15.17:0/894032443 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v41) v1 ==== 107+0+5263 (secure 0 0 0) 0x7fb34407bbb0 con 0x7fb350104a30 2024-08-19T01:38:02.487 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:38:02.487 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":37,"btime":"2024-08-19T01:35:19:197421+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44907,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/540250441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":540250441},{"type":"v1","addr":"172.21.15.86:6827","nonce":540250441}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:35:18.278690+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":0,"incarnation":34,"state":"up:reconnect","state_seq":465,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":1,"incarnation":34,"state":"up:reconnect","state_seq":461,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:38:02.488 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 37 2024-08-19T01:38:02.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.488+0000 7fb355655640 1 -- 172.21.15.17:0/894032443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb33806e170 msgr2=0x7fb338070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:02.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.488+0000 7fb355655640 1 --2- 172.21.15.17:0/894032443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb33806e170 0x7fb338070630 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb340005fd0 tx=0x7fb340005850 comp rx=0 tx=0).stop 2024-08-19T01:38:02.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.488+0000 7fb355655640 1 -- 172.21.15.17:0/894032443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb350104a30 msgr2=0x7fb35019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:02.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.488+0000 7fb355655640 1 --2- 172.21.15.17:0/894032443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb350104a30 0x7fb35019bd90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fb34402a9c0 tx=0x7fb3440055a0 comp rx=0 tx=0).stop 2024-08-19T01:38:02.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.488+0000 7fb355655640 1 -- 172.21.15.17:0/894032443 shutdown_connections 2024-08-19T01:38:02.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.488+0000 7fb355655640 1 --2- 172.21.15.17:0/894032443 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fb33806e170 0x7fb338070630 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:02.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.488+0000 7fb355655640 1 --2- 172.21.15.17:0/894032443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb350104a30 0x7fb35019bd90 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:02.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.488+0000 7fb355655640 1 --2- 172.21.15.17:0/894032443 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fb3500fea30 0x7fb35019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:02.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.488+0000 7fb355655640 1 -- 172.21.15.17:0/894032443 >> 172.21.15.17:0/894032443 conn(0x7fb3500fa730 msgr2=0x7fb350068c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:02.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.488+0000 7fb355655640 1 -- 172.21.15.17:0/894032443 shutdown_connections 2024-08-19T01:38:02.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:02.488+0000 7fb355655640 1 -- 172.21.15.17:0/894032443 wait complete. 2024-08-19T01:38:03.098 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:02 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/894032443' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-08-19T01:38:03.121 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 38 2024-08-19T01:38:03.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:02 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/894032443' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-08-19T01:38:03.331 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:38:04.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:03 smithi017 ceph-mon[99370]: pgmap v1181: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:38:04.139 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:38:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:03 smithi086 ceph-mon[71303]: pgmap v1181: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:38:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:38:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.914+0000 7fd502196640 1 -- 172.21.15.17:0/1922900882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4fc0ff230 msgr2=0x7fd4fc10bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.914+0000 7fd502196640 1 --2- 172.21.15.17:0/1922900882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4fc0ff230 0x7fd4fc10bef0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009880 tx=0x7fd4ec02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:38:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.914+0000 7fd502196640 1 -- 172.21.15.17:0/1922900882 shutdown_connections 2024-08-19T01:38:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.914+0000 7fd502196640 1 --2- 172.21.15.17:0/1922900882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4fc0ff230 0x7fd4fc10bef0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.914+0000 7fd502196640 1 --2- 172.21.15.17:0/1922900882 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc0fe880 0x7fd4fc0fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.914+0000 7fd502196640 1 -- 172.21.15.17:0/1922900882 >> 172.21.15.17:0/1922900882 conn(0x7fd4fc0fa730 msgr2=0x7fd4fc0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.915+0000 7fd502196640 1 -- 172.21.15.17:0/1922900882 shutdown_connections 2024-08-19T01:38:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.915+0000 7fd502196640 1 -- 172.21.15.17:0/1922900882 wait complete. 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.915+0000 7fd502196640 1 Processor -- start 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.915+0000 7fd502196640 1 -- start start 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.915+0000 7fd502196640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc0fe880 0x7fd4fc19d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.915+0000 7fd502196640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4fc0ff230 0x7fd4fc19df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.915+0000 7fd502196640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc19e530 con 0x7fd4fc0ff230 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.915+0000 7fd502196640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc197ac0 con 0x7fd4fc0fe880 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4faffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4fc0ff230 0x7fd4fc19df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4faffd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4fc0ff230 0x7fd4fc19df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36916/0 (socket says 172.21.15.17:36916) 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4faffd640 1 -- 172.21.15.17:0/4110818551 learned_addr learned my addr 172.21.15.17:0/4110818551 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4fb7fe640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc0fe880 0x7fd4fc19d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4faffd640 1 -- 172.21.15.17:0/4110818551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc0fe880 msgr2=0x7fd4fc19d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4faffd640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc0fe880 0x7fd4fc19d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4faffd640 1 -- 172.21.15.17:0/4110818551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec009560 con 0x7fd4fc0ff230 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4fb7fe640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc0fe880 0x7fd4fc19d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4faffd640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4fc0ff230 0x7fd4fc19df10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec02a9c0 tx=0x7fd4ec0055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4f8ff9640 1 -- 172.21.15.17:0/4110818551 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4ec004aa0 con 0x7fd4fc0ff230 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd502196640 1 -- 172.21.15.17:0/4110818551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc197da0 con 0x7fd4fc0ff230 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4f8ff9640 1 -- 172.21.15.17:0/4110818551 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4ec004c00 con 0x7fd4fc0ff230 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd4f8ff9640 1 -- 172.21.15.17:0/4110818551 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4ec003980 con 0x7fd4fc0ff230 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.916+0000 7fd502196640 1 -- 172.21.15.17:0/4110818551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc1982f0 con 0x7fd4fc0ff230 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.917+0000 7fd502196640 1 -- 172.21.15.17:0/4110818551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc068d30 con 0x7fd4fc0ff230 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.918+0000 7fd4f8ff9640 1 -- 172.21.15.17:0/4110818551 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd4ec003bf0 con 0x7fd4fc0ff230 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.918+0000 7fd4f8ff9640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4e806e170 0x7fd4e8070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.919+0000 7fd4f8ff9640 1 -- 172.21.15.17:0/4110818551 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd4ec0af180 con 0x7fd4fc0ff230 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.919+0000 7fd4fb7fe640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4e806e170 0x7fd4e8070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.919+0000 7fd4fb7fe640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4e806e170 0x7fd4e8070630 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40058c0 tx=0x7fd4e4005850 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:04.923+0000 7fd4f8ff9640 1 -- 172.21.15.17:0/4110818551 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fd4ec078460 con 0x7fd4fc0ff230 2024-08-19T01:38:05.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.139+0000 7fd502196640 1 -- 172.21.15.17:0/4110818551 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7fd4fc106770 con 0x7fd4fc0ff230 2024-08-19T01:38:05.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.139+0000 7fd4f8ff9640 1 -- 172.21.15.17:0/4110818551 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v41) v1 ==== 107+0+5257 (secure 0 0 0) 0x7fd4ec07bb20 con 0x7fd4fc0ff230 2024-08-19T01:38:05.141 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:38:05.141 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":38,"btime":"2024-08-19T01:35:20:206706+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44907,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/540250441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":540250441},{"type":"v1","addr":"172.21.15.86:6827","nonce":540250441}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:35:19.209023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":0,"incarnation":34,"state":"up:rejoin","state_seq":466,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":1,"incarnation":34,"state":"up:rejoin","state_seq":462,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-08-19T01:38:05.141 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 38 2024-08-19T01:38:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.141+0000 7fd502196640 1 -- 172.21.15.17:0/4110818551 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4e806e170 msgr2=0x7fd4e8070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.141+0000 7fd502196640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4e806e170 0x7fd4e8070630 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40058c0 tx=0x7fd4e4005850 comp rx=0 tx=0).stop 2024-08-19T01:38:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.141+0000 7fd502196640 1 -- 172.21.15.17:0/4110818551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4fc0ff230 msgr2=0x7fd4fc19df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.141+0000 7fd502196640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4fc0ff230 0x7fd4fc19df10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec02a9c0 tx=0x7fd4ec0055a0 comp rx=0 tx=0).stop 2024-08-19T01:38:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.142+0000 7fd502196640 1 -- 172.21.15.17:0/4110818551 shutdown_connections 2024-08-19T01:38:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.142+0000 7fd502196640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fd4e806e170 0x7fd4e8070630 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.142+0000 7fd502196640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd4fc0ff230 0x7fd4fc19df10 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.142+0000 7fd502196640 1 --2- 172.21.15.17:0/4110818551 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fd4fc0fe880 0x7fd4fc19d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.142+0000 7fd502196640 1 -- 172.21.15.17:0/4110818551 >> 172.21.15.17:0/4110818551 conn(0x7fd4fc0fa730 msgr2=0x7fd4fc0fba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.142+0000 7fd502196640 1 -- 172.21.15.17:0/4110818551 shutdown_connections 2024-08-19T01:38:05.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:05.142+0000 7fd502196640 1 -- 172.21.15.17:0/4110818551 wait complete. 2024-08-19T01:38:05.795 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 39 2024-08-19T01:38:06.006 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:38:06.135 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:05 smithi017 ceph-mon[99370]: pgmap v1182: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:06.135 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:05 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/4110818551' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-08-19T01:38:06.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:05 smithi086 ceph-mon[71303]: pgmap v1182: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:06.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:05 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/4110818551' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-08-19T01:38:07.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.788+0000 7f3a97387640 1 -- 172.21.15.17:0/2791277892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a90100750 msgr2=0x7f3a901047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.788+0000 7f3a97387640 1 --2- 172.21.15.17:0/2791277892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a90100750 0x7f3a901047a0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009880 tx=0x7f3a8002a4a0 comp rx=0 tx=0).stop 2024-08-19T01:38:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.788+0000 7f3a97387640 1 -- 172.21.15.17:0/2791277892 shutdown_connections 2024-08-19T01:38:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.788+0000 7f3a97387640 1 --2- 172.21.15.17:0/2791277892 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a90100750 0x7f3a901047a0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.788+0000 7f3a97387640 1 --2- 172.21.15.17:0/2791277892 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a900ffda0 0x7f3a90100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.788+0000 7f3a97387640 1 -- 172.21.15.17:0/2791277892 >> 172.21.15.17:0/2791277892 conn(0x7f3a900fb840 msgr2=0x7f3a900fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.788+0000 7f3a97387640 1 -- 172.21.15.17:0/2791277892 shutdown_connections 2024-08-19T01:38:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.788+0000 7f3a97387640 1 -- 172.21.15.17:0/2791277892 wait complete. 2024-08-19T01:38:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.789+0000 7f3a97387640 1 Processor -- start 2024-08-19T01:38:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.789+0000 7f3a97387640 1 -- start start 2024-08-19T01:38:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.789+0000 7f3a97387640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a900ffda0 0x7f3a90197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:07.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.789+0000 7f3a97387640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a90100750 0x7f3a90198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.789+0000 7f3a97387640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a901989c0 con 0x7f3a900ffda0 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.789+0000 7f3a97387640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9019c730 con 0x7f3a90100750 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.789+0000 7f3a95123640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a900ffda0 0x7f3a90197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.789+0000 7f3a95123640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a900ffda0 0x7f3a90197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35754/0 (socket says 172.21.15.17:35754) 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.789+0000 7f3a95123640 1 -- 172.21.15.17:0/813884871 learned_addr learned my addr 172.21.15.17:0/813884871 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.790+0000 7f3a94922640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a90100750 0x7f3a90198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.790+0000 7f3a95123640 1 -- 172.21.15.17:0/813884871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a90100750 msgr2=0x7f3a90198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.790+0000 7f3a95123640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a90100750 0x7f3a90198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.790+0000 7f3a95123640 1 -- 172.21.15.17:0/813884871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a80009560 con 0x7f3a900ffda0 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.790+0000 7f3a94922640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a90100750 0x7f3a90198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.790+0000 7f3a95123640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a900ffda0 0x7f3a90197df0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00b420 tx=0x7f3a8c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.790+0000 7f3a867fc640 1 -- 172.21.15.17:0/813884871 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a8c011800 con 0x7f3a900ffda0 2024-08-19T01:38:07.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.790+0000 7f3a867fc640 1 -- 172.21.15.17:0/813884871 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a8c011e20 con 0x7f3a900ffda0 2024-08-19T01:38:07.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.790+0000 7f3a867fc640 1 -- 172.21.15.17:0/813884871 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a8c00f2e0 con 0x7f3a900ffda0 2024-08-19T01:38:07.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.790+0000 7f3a97387640 1 -- 172.21.15.17:0/813884871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9019ca10 con 0x7f3a900ffda0 2024-08-19T01:38:07.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.790+0000 7f3a97387640 1 -- 172.21.15.17:0/813884871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9019cf60 con 0x7f3a900ffda0 2024-08-19T01:38:07.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.791+0000 7f3a97387640 1 -- 172.21.15.17:0/813884871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a90101280 con 0x7f3a900ffda0 2024-08-19T01:38:07.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.792+0000 7f3a867fc640 1 -- 172.21.15.17:0/813884871 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3a8c010380 con 0x7f3a900ffda0 2024-08-19T01:38:07.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.792+0000 7f3a867fc640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a7c06e170 0x7f3a7c070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:07.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.792+0000 7f3a867fc640 1 -- 172.21.15.17:0/813884871 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f3a8c08daf0 con 0x7f3a900ffda0 2024-08-19T01:38:07.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.792+0000 7f3a94922640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a7c06e170 0x7f3a7c070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:07.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.793+0000 7f3a94922640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a7c06e170 0x7f3a7c070630 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3a80006010 tx=0x7f3a80005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:07.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:07.797+0000 7f3a867fc640 1 -- 172.21.15.17:0/813884871 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7f3a8c056dd0 con 0x7f3a900ffda0 2024-08-19T01:38:08.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.009+0000 7f3a97387640 1 -- 172.21.15.17:0/813884871 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7f3a90100200 con 0x7f3a900ffda0 2024-08-19T01:38:08.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.009+0000 7f3a867fc640 1 -- 172.21.15.17:0/813884871 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v41) v1 ==== 107+0+5272 (secure 0 0 0) 0x7f3a8c05a490 con 0x7f3a900ffda0 2024-08-19T01:38:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:38:08.011 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":39,"btime":"2024-08-19T01:35:21:213381+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44907,"name":"cephfs.smithi086.oncasl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.86:6827/540250441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":540250441},{"type":"v1","addr":"172.21.15.86:6827","nonce":540250441}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:35:21.213375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":0,"incarnation":34,"state":"up:active","state_seq":467,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":1,"incarnation":34,"state":"up:active","state_seq":463,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34388,"qdb_cluster":[34388,34420]},"id":1}]} 2024-08-19T01:38:08.011 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 39 2024-08-19T01:38:08.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.011+0000 7f3a97387640 1 -- 172.21.15.17:0/813884871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a7c06e170 msgr2=0x7f3a7c070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:08.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.011+0000 7f3a97387640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a7c06e170 0x7f3a7c070630 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3a80006010 tx=0x7f3a80005e60 comp rx=0 tx=0).stop 2024-08-19T01:38:08.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.011+0000 7f3a97387640 1 -- 172.21.15.17:0/813884871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a900ffda0 msgr2=0x7f3a90197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:08.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.011+0000 7f3a97387640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a900ffda0 0x7f3a90197df0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00b420 tx=0x7f3a8c00b8e0 comp rx=0 tx=0).stop 2024-08-19T01:38:08.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.012+0000 7f3a97387640 1 -- 172.21.15.17:0/813884871 shutdown_connections 2024-08-19T01:38:08.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.012+0000 7f3a97387640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7f3a7c06e170 0x7f3a7c070630 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:08.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.012+0000 7f3a97387640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7f3a90100750 0x7f3a90198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:08.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.012+0000 7f3a97387640 1 --2- 172.21.15.17:0/813884871 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3a900ffda0 0x7f3a90197df0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:08.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.012+0000 7f3a97387640 1 -- 172.21.15.17:0/813884871 >> 172.21.15.17:0/813884871 conn(0x7f3a900fb840 msgr2=0x7f3a900fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:08.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.012+0000 7f3a97387640 1 -- 172.21.15.17:0/813884871 shutdown_connections 2024-08-19T01:38:08.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:08.012+0000 7f3a97387640 1 -- 172.21.15.17:0/813884871 wait complete. 2024-08-19T01:38:08.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:07 smithi017 ceph-mon[99370]: pgmap v1183: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-19T01:38:08.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:07 smithi086 ceph-mon[71303]: pgmap v1183: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-19T01:38:08.593 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 40 2024-08-19T01:38:08.804 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:38:08.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:08 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/813884871' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-08-19T01:38:09.173 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:08 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/813884871' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-08-19T01:38:09.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:09 smithi017 ceph-mon[99370]: pgmap v1184: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-19T01:38:10.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:09 smithi086 ceph-mon[71303]: pgmap v1184: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-19T01:38:10.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.520+0000 7ff023a41640 1 -- 172.21.15.17:0/233515061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff01c0ff400 msgr2=0x7ff01c1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:10.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.520+0000 7ff023a41640 1 --2- 172.21.15.17:0/233515061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff01c0ff400 0x7ff01c1038d0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009880 tx=0x7ff00c02a4a0 comp rx=0 tx=0).stop 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.520+0000 7ff023a41640 1 -- 172.21.15.17:0/233515061 shutdown_connections 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.520+0000 7ff023a41640 1 --2- 172.21.15.17:0/233515061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff01c0ff400 0x7ff01c1038d0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.520+0000 7ff023a41640 1 --2- 172.21.15.17:0/233515061 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01c0fea50 0x7ff01c0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.520+0000 7ff023a41640 1 -- 172.21.15.17:0/233515061 >> 172.21.15.17:0/233515061 conn(0x7ff01c0fa730 msgr2=0x7ff01c0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.520+0000 7ff023a41640 1 -- 172.21.15.17:0/233515061 shutdown_connections 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.520+0000 7ff023a41640 1 -- 172.21.15.17:0/233515061 wait complete. 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff023a41640 1 Processor -- start 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff023a41640 1 -- start start 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff023a41640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff01c0fea50 0x7ff01c19c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff023a41640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01c0ff400 0x7ff01c19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff023a41640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c19ce10 con 0x7ff01c0fea50 2024-08-19T01:38:10.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff023a41640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c1a0b80 con 0x7ff01c0ff400 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff0217dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff01c0fea50 0x7ff01c19c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff0217dd640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff01c0fea50 0x7ff01c19c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35774/0 (socket says 172.21.15.17:35774) 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff0217dd640 1 -- 172.21.15.17:0/3372017502 learned_addr learned my addr 172.21.15.17:0/3372017502 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff020fdc640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01c0ff400 0x7ff01c19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff0217dd640 1 -- 172.21.15.17:0/3372017502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01c0ff400 msgr2=0x7ff01c19c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff0217dd640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01c0ff400 0x7ff01c19c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff0217dd640 1 -- 172.21.15.17:0/3372017502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c009560 con 0x7ff01c0fea50 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.521+0000 7ff020fdc640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01c0ff400 0x7ff01c19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.522+0000 7ff0217dd640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff01c0fea50 0x7ff01c19c240 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff01800b420 tx=0x7ff01800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.522+0000 7ff0127fc640 1 -- 172.21.15.17:0/3372017502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff018011800 con 0x7ff01c0fea50 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.522+0000 7ff023a41640 1 -- 172.21.15.17:0/3372017502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c1a0e60 con 0x7ff01c0fea50 2024-08-19T01:38:10.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.522+0000 7ff0127fc640 1 -- 172.21.15.17:0/3372017502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff018011e20 con 0x7ff01c0fea50 2024-08-19T01:38:10.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.522+0000 7ff0127fc640 1 -- 172.21.15.17:0/3372017502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff01800f2e0 con 0x7ff01c0fea50 2024-08-19T01:38:10.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.522+0000 7ff023a41640 1 -- 172.21.15.17:0/3372017502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c1a13b0 con 0x7ff01c0fea50 2024-08-19T01:38:10.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.523+0000 7ff023a41640 1 -- 172.21.15.17:0/3372017502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c068d30 con 0x7ff01c0fea50 2024-08-19T01:38:10.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.523+0000 7ff0127fc640 1 -- 172.21.15.17:0/3372017502 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff018010380 con 0x7ff01c0fea50 2024-08-19T01:38:10.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.524+0000 7ff0127fc640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff00806e170 0x7ff008070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:10.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.524+0000 7ff0127fc640 1 -- 172.21.15.17:0/3372017502 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff01808daf0 con 0x7ff01c0fea50 2024-08-19T01:38:10.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.524+0000 7ff020fdc640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff00806e170 0x7ff008070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:10.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.524+0000 7ff020fdc640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff00806e170 0x7ff008070630 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff00c006010 tx=0x7ff00c005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:10.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.528+0000 7ff0127fc640 1 -- 172.21.15.17:0/3372017502 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff018056dd0 con 0x7ff01c0fea50 2024-08-19T01:38:10.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.741+0000 7ff023a41640 1 -- 172.21.15.17:0/3372017502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7ff01c0feeb0 con 0x7ff01c0fea50 2024-08-19T01:38:10.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.742+0000 7ff0127fc640 1 -- 172.21.15.17:0/3372017502 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v41) v1 ==== 107+0+5287 (secure 0 0 0) 0x7ff01805a490 con 0x7ff01c0fea50 2024-08-19T01:38:10.743 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-08-19T01:38:10.743 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":40,"btime":"2024-08-19T01:35:21:218206+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-19T00:53:21.603255+0000","modified":"2024-08-19T01:35:21.218194+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34388,"mds_1":34420},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34388":{"gid":34388,"name":"cephfs.smithi017.junbdp","rank":0,"incarnation":34,"state":"up:active","state_seq":467,"addr":"172.21.15.17:6827/2640473134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":2640473134},{"type":"v1","addr":"172.21.15.17:6827","nonce":2640473134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34420":{"gid":34420,"name":"cephfs.smithi017.gvlpoy","rank":1,"incarnation":34,"state":"up:active","state_seq":463,"addr":"172.21.15.17:6829/3785389116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3785389116},{"type":"v1","addr":"172.21.15.17:6829","nonce":3785389116}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44345":{"gid":44345,"name":"cephfs.smithi086.uxhjfl","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6825/3534897978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":3534897978},{"type":"v1","addr":"172.21.15.86:6825","nonce":3534897978}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44907":{"gid":44907,"name":"cephfs.smithi086.oncasl","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.86:6827/540250441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":540250441},{"type":"v1","addr":"172.21.15.86:6827","nonce":540250441}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34388,"qdb_cluster":[34420,34388]},"id":1}]} 2024-08-19T01:38:10.743 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 40 2024-08-19T01:38:10.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.744+0000 7ff023a41640 1 -- 172.21.15.17:0/3372017502 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff00806e170 msgr2=0x7ff008070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:10.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.744+0000 7ff023a41640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff00806e170 0x7ff008070630 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff00c006010 tx=0x7ff00c005e60 comp rx=0 tx=0).stop 2024-08-19T01:38:10.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.744+0000 7ff023a41640 1 -- 172.21.15.17:0/3372017502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff01c0fea50 msgr2=0x7ff01c19c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:10.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.744+0000 7ff023a41640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff01c0fea50 0x7ff01c19c240 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff01800b420 tx=0x7ff01800b8e0 comp rx=0 tx=0).stop 2024-08-19T01:38:10.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.744+0000 7ff023a41640 1 -- 172.21.15.17:0/3372017502 shutdown_connections 2024-08-19T01:38:10.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.744+0000 7ff023a41640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff00806e170 0x7ff008070630 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.744+0000 7ff023a41640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff01c0ff400 0x7ff01c19c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.744+0000 7ff023a41640 1 --2- 172.21.15.17:0/3372017502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff01c0fea50 0x7ff01c19c240 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.744+0000 7ff023a41640 1 -- 172.21.15.17:0/3372017502 >> 172.21.15.17:0/3372017502 conn(0x7ff01c0fa730 msgr2=0x7ff01c10d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.744+0000 7ff023a41640 1 -- 172.21.15.17:0/3372017502 shutdown_connections 2024-08-19T01:38:10.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:10.744+0000 7ff023a41640 1 -- 172.21.15.17:0/3372017502 wait complete. 2024-08-19T01:38:11.110 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:10 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/3372017502' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-08-19T01:38:11.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:10 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/3372017502' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-08-19T01:38:11.424 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-08-19T01:38:11.435 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-08-19T01:38:11.435 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T01:38:11.435 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T01:38:11.453 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T01:38:11.453 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T01:38:11.509 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-19T01:38:11.757 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:38:12.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:11 smithi017 ceph-mon[99370]: pgmap v1185: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:38:12.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:11 smithi086 ceph-mon[71303]: pgmap v1185: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-08-19T01:38:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.584+0000 7fada4621640 1 -- 172.21.15.17:0/394415458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c101670 msgr2=0x7fad9c109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.584+0000 7fada4621640 1 --2- 172.21.15.17:0/394415458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c101670 0x7fad9c109b60 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fad90009880 tx=0x7fad9002a530 comp rx=0 tx=0).stop 2024-08-19T01:38:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 -- 172.21.15.17:0/394415458 shutdown_connections 2024-08-19T01:38:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 --2- 172.21.15.17:0/394415458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c101670 0x7fad9c109b60 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 --2- 172.21.15.17:0/394415458 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c100d50 0x7fad9c101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 -- 172.21.15.17:0/394415458 >> 172.21.15.17:0/394415458 conn(0x7fad9c0758a0 msgr2=0x7fad9c0fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 -- 172.21.15.17:0/394415458 shutdown_connections 2024-08-19T01:38:13.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 -- 172.21.15.17:0/394415458 wait complete. 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 Processor -- start 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 -- start start 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c100d50 0x7fad9c0fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c101670 0x7fad9c0feef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0ff430 con 0x7fad9c101670 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.585+0000 7fada4621640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c0ff5a0 con 0x7fad9c100d50 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fada1bbc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c101670 0x7fad9c0feef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fada1bbc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c101670 0x7fad9c0feef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35784/0 (socket says 172.21.15.17:35784) 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fada1bbc640 1 -- 172.21.15.17:0/1057794905 learned_addr learned my addr 172.21.15.17:0/1057794905 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fada23bd640 1 --2- 172.21.15.17:0/1057794905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c100d50 0x7fad9c0fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fada1bbc640 1 -- 172.21.15.17:0/1057794905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c100d50 msgr2=0x7fad9c0fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fada1bbc640 1 --2- 172.21.15.17:0/1057794905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c100d50 0x7fad9c0fe9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:13.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fada1bbc640 1 -- 172.21.15.17:0/1057794905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad90009560 con 0x7fad9c101670 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fada1bbc640 1 --2- 172.21.15.17:0/1057794905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c101670 0x7fad9c0feef0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fad90005940 tx=0x7fad90032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fad9b7fe640 1 -- 172.21.15.17:0/1057794905 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad90005220 con 0x7fad9c101670 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fad9b7fe640 1 -- 172.21.15.17:0/1057794905 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad90005380 con 0x7fad9c101670 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fad9b7fe640 1 -- 172.21.15.17:0/1057794905 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad90003a50 con 0x7fad9c101670 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fada4621640 1 -- 172.21.15.17:0/1057794905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c0ff820 con 0x7fad9c101670 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.586+0000 7fada4621640 1 -- 172.21.15.17:0/1057794905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c1a1fe0 con 0x7fad9c101670 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.588+0000 7fada4621640 1 -- 172.21.15.17:0/1057794905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c068470 con 0x7fad9c101670 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.588+0000 7fad9b7fe640 1 -- 172.21.15.17:0/1057794905 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fad9002ad50 con 0x7fad9c101670 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.588+0000 7fad9b7fe640 1 --2- 172.21.15.17:0/1057794905 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad8406e170 0x7fad84070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.589+0000 7fad9b7fe640 1 -- 172.21.15.17:0/1057794905 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fad900ae9b0 con 0x7fad9c101670 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.589+0000 7fada23bd640 1 --2- 172.21.15.17:0/1057794905 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad8406e170 0x7fad84070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:13.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.589+0000 7fada23bd640 1 --2- 172.21.15.17:0/1057794905 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad8406e170 0x7fad84070630 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fad9400a810 tx=0x7fad94008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:13.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.593+0000 7fad9b7fe640 1 -- 172.21.15.17:0/1057794905 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7fad90077d10 con 0x7fad9c101670 2024-08-19T01:38:13.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.780+0000 7fada4621640 1 -- 172.21.15.17:0/1057794905 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fad9c1011b0 con 0x7fad9c101670 2024-08-19T01:38:13.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.781+0000 7fad9b7fe640 1 -- 172.21.15.17:0/1057794905 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v85) v1 ==== 81+0+2423 (secure 0 0 0) 0x7fad90049990 con 0x7fad9c101670 2024-08-19T01:38:13.782 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:6825/3387019469 2024-08-20T01:04:18.358679+0000 2024-08-19T01:38:13.782 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:6824/3387019469 2024-08-20T01:04:18.358679+0000 2024-08-19T01:38:13.782 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3487613774 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3274489143 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3438217243 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1256622841 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/3601762837 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1358788022 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3754113597 2024-08-20T00:48:35.469605+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/1063463683 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3079909971 2024-08-20T00:46:59.495730+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3980256538 2024-08-20T00:46:59.495730+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/1223553600 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/371831651 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2005365781 2024-08-20T00:47:30.750898+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2005365781 2024-08-20T00:47:30.750898+0000 2024-08-19T01:38:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/1713288012 2024-08-20T00:48:35.469605+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6828/1603673340 2024-08-20T01:04:18.358666+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/443932275 2024-08-20T00:48:35.469605+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:6829/261187346 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6826/785560798 2024-08-20T00:53:36.990413+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3438217243 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:6828/261187346 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/167484781 2024-08-20T00:47:30.750898+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2987236592 2024-08-20T00:46:59.495730+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1647015034 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2535118500 2024-08-20T00:47:30.750898+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3321468007 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3703965574 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3703965574 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:13.784 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/106571410 2024-08-20T00:48:35.469605+0000 2024-08-19T01:38:13.785 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/3685857427 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:13.785 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6829/1603673340 2024-08-20T01:04:18.358666+0000 2024-08-19T01:38:13.785 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/3754921411 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:13.785 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/1713288012 2024-08-20T00:48:35.469605+0000 2024-08-19T01:38:13.785 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1048807387 2024-08-20T00:46:59.495730+0000 2024-08-19T01:38:13.785 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2235697696 2024-08-20T00:47:30.750898+0000 2024-08-19T01:38:13.785 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1418099011 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:13.785 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6827/785560798 2024-08-20T00:53:36.990413+0000 2024-08-19T01:38:13.785 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/861177328 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:13.785 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2987236592 2024-08-20T00:46:59.495730+0000 2024-08-19T01:38:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:listed 41 entries 2024-08-19T01:38:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.783+0000 7fada4621640 1 -- 172.21.15.17:0/1057794905 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad8406e170 msgr2=0x7fad84070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.783+0000 7fada4621640 1 --2- 172.21.15.17:0/1057794905 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad8406e170 0x7fad84070630 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fad9400a810 tx=0x7fad94008040 comp rx=0 tx=0).stop 2024-08-19T01:38:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.783+0000 7fada4621640 1 -- 172.21.15.17:0/1057794905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c101670 msgr2=0x7fad9c0feef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.783+0000 7fada4621640 1 --2- 172.21.15.17:0/1057794905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c101670 0x7fad9c0feef0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fad90005940 tx=0x7fad90032bd0 comp rx=0 tx=0).stop 2024-08-19T01:38:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.783+0000 7fada4621640 1 -- 172.21.15.17:0/1057794905 shutdown_connections 2024-08-19T01:38:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.783+0000 7fada4621640 1 --2- 172.21.15.17:0/1057794905 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7fad8406e170 0x7fad84070630 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.783+0000 7fada4621640 1 --2- 172.21.15.17:0/1057794905 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fad9c101670 0x7fad9c0feef0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.783+0000 7fada4621640 1 --2- 172.21.15.17:0/1057794905 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7fad9c100d50 0x7fad9c0fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:13.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.783+0000 7fada4621640 1 -- 172.21.15.17:0/1057794905 >> 172.21.15.17:0/1057794905 conn(0x7fad9c0758a0 msgr2=0x7fad9c101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.783+0000 7fada4621640 1 -- 172.21.15.17:0/1057794905 shutdown_connections 2024-08-19T01:38:13.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:13.783+0000 7fada4621640 1 -- 172.21.15.17:0/1057794905 wait complete. 2024-08-19T01:38:13.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:13 smithi086 ceph-mon[71303]: pgmap v1186: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-19T01:38:13.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:13 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/1057794905' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T01:38:14.109 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:13 smithi017 ceph-mon[99370]: pgmap v1186: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-08-19T01:38:14.109 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:13 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/1057794905' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T01:38:14.480 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-08-19T01:38:14.480 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-19T01:38:14.498 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:reef shell --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-19T01:38:14.746 INFO:teuthology.orchestra.run.smithi017.stderr:Inferring config /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/mon.smithi017/config 2024-08-19T01:38:15.932 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:15 smithi017 ceph-mon[99370]: pgmap v1187: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-19T01:38:16.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:15 smithi086 ceph-mon[71303]: pgmap v1187: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-08-19T01:38:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.369+0000 7ff0450fc640 1 -- 172.21.15.17:0/3491916590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0400ffb50 msgr2=0x7ff0400fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.369+0000 7ff0450fc640 1 --2- 172.21.15.17:0/3491916590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0400ffb50 0x7ff0400fffb0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7ff034009880 tx=0x7ff03402a4a0 comp rx=0 tx=0).stop 2024-08-19T01:38:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.369+0000 7ff0450fc640 1 -- 172.21.15.17:0/3491916590 shutdown_connections 2024-08-19T01:38:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.369+0000 7ff0450fc640 1 --2- 172.21.15.17:0/3491916590 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0400ffb50 0x7ff0400fffb0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:16.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.369+0000 7ff0450fc640 1 --2- 172.21.15.17:0/3491916590 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff040105c00 0x7ff040105fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.369+0000 7ff0450fc640 1 -- 172.21.15.17:0/3491916590 >> 172.21.15.17:0/3491916590 conn(0x7ff0400fb830 msgr2=0x7ff0400fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.369+0000 7ff0450fc640 1 -- 172.21.15.17:0/3491916590 shutdown_connections 2024-08-19T01:38:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.369+0000 7ff0450fc640 1 -- 172.21.15.17:0/3491916590 wait complete. 2024-08-19T01:38:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.370+0000 7ff0450fc640 1 Processor -- start 2024-08-19T01:38:16.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.370+0000 7ff0450fc640 1 -- start start 2024-08-19T01:38:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.370+0000 7ff0450fc640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0400ffb50 0x7ff04019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.370+0000 7ff0450fc640 1 --2- >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff040105c00 0x7ff04019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:16.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.370+0000 7ff0450fc640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04019c290 con 0x7ff0400ffb50 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.370+0000 7ff0450fc640 1 -- --> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff040195900 con 0x7ff040105c00 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff03ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0400ffb50 0x7ff04019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff03ed9d640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0400ffb50 0x7ff04019b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35806/0 (socket says 172.21.15.17:35806) 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff03ed9d640 1 -- 172.21.15.17:0/2413509328 learned_addr learned my addr 172.21.15.17:0/2413509328 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff03e59c640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff040105c00 0x7ff04019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff03ed9d640 1 -- 172.21.15.17:0/2413509328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff040105c00 msgr2=0x7ff04019bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff03ed9d640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff040105c00 0x7ff04019bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff03ed9d640 1 -- 172.21.15.17:0/2413509328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034009560 con 0x7ff0400ffb50 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff03e59c640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff040105c00 0x7ff04019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff03ed9d640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0400ffb50 0x7ff04019b7c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff03000c8a0 tx=0x7ff03000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff027fff640 1 -- 172.21.15.17:0/2413509328 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff030007b80 con 0x7ff0400ffb50 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff027fff640 1 -- 172.21.15.17:0/2413509328 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff030007ce0 con 0x7ff0400ffb50 2024-08-19T01:38:16.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff0450fc640 1 -- 172.21.15.17:0/2413509328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff040195be0 con 0x7ff0400ffb50 2024-08-19T01:38:16.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff027fff640 1 -- 172.21.15.17:0/2413509328 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff030018810 con 0x7ff0400ffb50 2024-08-19T01:38:16.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.371+0000 7ff0450fc640 1 -- 172.21.15.17:0/2413509328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0401961b0 con 0x7ff0400ffb50 2024-08-19T01:38:16.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.372+0000 7ff0450fc640 1 -- 172.21.15.17:0/2413509328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff040101200 con 0x7ff0400ffb50 2024-08-19T01:38:16.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.373+0000 7ff027fff640 1 -- 172.21.15.17:0/2413509328 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 39) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff030018a80 con 0x7ff0400ffb50 2024-08-19T01:38:16.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.374+0000 7ff027fff640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff02806e170 0x7ff028070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-19T01:38:16.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.374+0000 7ff027fff640 1 -- 172.21.15.17:0/2413509328 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff03008e3e0 con 0x7ff0400ffb50 2024-08-19T01:38:16.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.374+0000 7ff03e59c640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff02806e170 0x7ff028070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-19T01:38:16.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.374+0000 7ff03e59c640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff02806e170 0x7ff028070630 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff034006010 tx=0x7ff034005e60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-19T01:38:16.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.378+0000 7ff027fff640 1 -- 172.21.15.17:0/2413509328 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+187871 (secure 0 0 0) 0x7ff030057770 con 0x7ff0400ffb50 2024-08-19T01:38:16.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.566+0000 7ff0450fc640 1 -- 172.21.15.17:0/2413509328 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff0400fffb0 con 0x7ff0400ffb50 2024-08-19T01:38:16.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.567+0000 7ff027fff640 1 -- 172.21.15.17:0/2413509328 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v85) v1 ==== 81+0+2423 (secure 0 0 0) 0x7ff03005ae30 con 0x7ff0400ffb50 2024-08-19T01:38:16.569 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:6825/3387019469 2024-08-20T01:04:18.358679+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:6824/3387019469 2024-08-20T01:04:18.358679+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3487613774 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3274489143 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3438217243 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1256622841 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/3601762837 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1358788022 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3754113597 2024-08-20T00:48:35.469605+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/1063463683 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3079909971 2024-08-20T00:46:59.495730+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3980256538 2024-08-20T00:46:59.495730+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/1223553600 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:16.570 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/371831651 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2005365781 2024-08-20T00:47:30.750898+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2005365781 2024-08-20T00:47:30.750898+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/1713288012 2024-08-20T00:48:35.469605+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6828/1603673340 2024-08-20T01:04:18.358666+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/443932275 2024-08-20T00:48:35.469605+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:6829/261187346 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6826/785560798 2024-08-20T00:53:36.990413+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3438217243 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:6828/261187346 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/167484781 2024-08-20T00:47:30.750898+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/2987236592 2024-08-20T00:46:59.495730+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1647015034 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2535118500 2024-08-20T00:47:30.750898+0000 2024-08-19T01:38:16.571 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/3321468007 2024-08-20T01:00:02.836389+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/3703965574 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/3703965574 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/106571410 2024-08-20T00:48:35.469605+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/3685857427 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6829/1603673340 2024-08-20T01:04:18.358666+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.86:0/3754921411 2024-08-20T00:56:57.142575+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6801/1713288012 2024-08-20T00:48:35.469605+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1048807387 2024-08-20T00:46:59.495730+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/2235697696 2024-08-20T00:47:30.750898+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/1418099011 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6827/785560798 2024-08-20T00:53:36.990413+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:0/861177328 2024-08-20T00:55:43.893583+0000 2024-08-19T01:38:16.572 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17:6800/2987236592 2024-08-20T00:46:59.495730+0000 2024-08-19T01:38:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:listed 41 entries 2024-08-19T01:38:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.569+0000 7ff0450fc640 1 -- 172.21.15.17:0/2413509328 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff02806e170 msgr2=0x7ff028070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.569+0000 7ff0450fc640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff02806e170 0x7ff028070630 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff034006010 tx=0x7ff034005e60 comp rx=0 tx=0).stop 2024-08-19T01:38:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.569+0000 7ff0450fc640 1 -- 172.21.15.17:0/2413509328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0400ffb50 msgr2=0x7ff04019b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-19T01:38:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.569+0000 7ff0450fc640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0400ffb50 0x7ff04019b7c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7ff03000c8a0 tx=0x7ff03000cd60 comp rx=0 tx=0).stop 2024-08-19T01:38:16.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.570+0000 7ff0450fc640 1 -- 172.21.15.17:0/2413509328 shutdown_connections 2024-08-19T01:38:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.570+0000 7ff0450fc640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.17:6800/578379619,v1:172.21.15.17:6801/578379619] conn(0x7ff02806e170 0x7ff028070630 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.570+0000 7ff0450fc640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] conn(0x7ff040105c00 0x7ff04019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.570+0000 7ff0450fc640 1 --2- 172.21.15.17:0/2413509328 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0400ffb50 0x7ff04019b7c0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-19T01:38:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.570+0000 7ff0450fc640 1 -- 172.21.15.17:0/2413509328 >> 172.21.15.17:0/2413509328 conn(0x7ff0400fb830 msgr2=0x7ff0400fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-19T01:38:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.570+0000 7ff0450fc640 1 -- 172.21.15.17:0/2413509328 shutdown_connections 2024-08-19T01:38:16.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-08-19T01:38:16.570+0000 7ff0450fc640 1 -- 172.21.15.17:0/2413509328 wait complete. 2024-08-19T01:38:17.150 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:16 smithi017 ceph-mon[99370]: from='client.? 172.21.15.17:0/2413509328' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T01:38:17.171 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi017.front.sepia.ceph.com... 2024-08-19T01:38:17.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-19T01:38:17.171 DEBUG:teuthology.orchestra.run.smithi017:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-08-19T01:38:17.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:16 smithi086 ceph-mon[71303]: from='client.? 172.21.15.17:0/2413509328' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-19T01:38:17.198 INFO:teuthology.orchestra.run:waiting for 300 2024-08-19T01:38:18.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:17 smithi017 ceph-mon[99370]: pgmap v1188: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-19T01:38:18.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:17 smithi086 ceph-mon[71303]: pgmap v1188: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-08-19T01:38:19.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:38:19.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:38:20.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:19 smithi017 ceph-mon[99370]: pgmap v1189: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:20.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:19 smithi086 ceph-mon[71303]: pgmap v1189: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:22.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:21 smithi017 ceph-mon[99370]: pgmap v1190: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:38:22.198 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:21 smithi086 ceph-mon[71303]: pgmap v1190: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:38:24.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:23 smithi017 ceph-mon[99370]: pgmap v1191: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:38:24.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:23 smithi086 ceph-mon[71303]: pgmap v1191: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:38:26.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:25 smithi017 ceph-mon[99370]: pgmap v1192: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:26.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:25 smithi086 ceph-mon[71303]: pgmap v1192: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:28.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:27 smithi017 ceph-mon[99370]: pgmap v1193: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:38:28.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:27 smithi086 ceph-mon[71303]: pgmap v1193: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:38:30.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:29 smithi017 ceph-mon[99370]: pgmap v1194: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:30.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:29 smithi086 ceph-mon[71303]: pgmap v1194: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:32.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:31 smithi017 ceph-mon[99370]: pgmap v1195: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:38:32.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:31 smithi086 ceph-mon[71303]: pgmap v1195: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:38:34.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:33 smithi017 ceph-mon[99370]: pgmap v1196: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:38:34.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:38:34.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:33 smithi086 ceph-mon[71303]: pgmap v1196: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:38:34.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:38:36.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:35 smithi017 ceph-mon[99370]: pgmap v1197: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:36.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:38:36.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:38:36.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:38:36.183 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:38:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:35 smithi086 ceph-mon[71303]: pgmap v1197: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:38:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:38:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:38:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:38:38.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:37 smithi017 ceph-mon[99370]: pgmap v1198: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:38:38.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:37 smithi086 ceph-mon[71303]: pgmap v1198: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:38:40.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:39 smithi017 ceph-mon[99370]: pgmap v1199: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:40.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:39 smithi086 ceph-mon[71303]: pgmap v1199: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:42.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:41 smithi017 ceph-mon[99370]: pgmap v1200: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:38:42.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:41 smithi086 ceph-mon[71303]: pgmap v1200: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:38:44.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:43 smithi017 ceph-mon[99370]: pgmap v1201: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:38:44.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:43 smithi086 ceph-mon[71303]: pgmap v1201: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:38:46.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:45 smithi017 ceph-mon[99370]: pgmap v1202: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:46.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:45 smithi086 ceph-mon[71303]: pgmap v1202: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:48.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:47 smithi017 ceph-mon[99370]: pgmap v1203: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:38:48.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:47 smithi086 ceph-mon[71303]: pgmap v1203: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:38:49.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:38:49.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:38:50.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:49 smithi017 ceph-mon[99370]: pgmap v1204: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:50.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:49 smithi086 ceph-mon[71303]: pgmap v1204: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:52.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:51 smithi017 ceph-mon[99370]: pgmap v1205: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:38:52.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:51 smithi086 ceph-mon[71303]: pgmap v1205: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:38:54.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:53 smithi017 ceph-mon[99370]: pgmap v1206: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:38:54.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:53 smithi086 ceph-mon[71303]: pgmap v1206: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:38:56.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:55 smithi017 ceph-mon[99370]: pgmap v1207: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:56.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:55 smithi086 ceph-mon[71303]: pgmap v1207: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:38:58.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:57 smithi017 ceph-mon[99370]: pgmap v1208: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:38:58.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:57 smithi086 ceph-mon[71303]: pgmap v1208: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:00.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:38:59 smithi017 ceph-mon[99370]: pgmap v1209: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:00.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:38:59 smithi086 ceph-mon[71303]: pgmap v1209: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:02.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:01 smithi017 ceph-mon[99370]: pgmap v1210: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:02.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:01 smithi086 ceph-mon[71303]: pgmap v1210: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:04.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:03 smithi017 ceph-mon[99370]: pgmap v1211: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:04.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:39:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:03 smithi086 ceph-mon[71303]: pgmap v1211: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:39:06.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:05 smithi086 ceph-mon[71303]: pgmap v1212: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:06.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:05 smithi017 ceph-mon[99370]: pgmap v1212: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:08.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:07 smithi086 ceph-mon[71303]: pgmap v1213: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:08.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:07 smithi017 ceph-mon[99370]: pgmap v1213: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:10.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:09 smithi086 ceph-mon[71303]: pgmap v1214: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:10.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:09 smithi017 ceph-mon[99370]: pgmap v1214: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:12.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:11 smithi086 ceph-mon[71303]: pgmap v1215: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:12.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:11 smithi017 ceph-mon[99370]: pgmap v1215: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:14.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:13 smithi017 ceph-mon[99370]: pgmap v1216: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:14.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:13 smithi086 ceph-mon[71303]: pgmap v1216: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:16.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:15 smithi017 ceph-mon[99370]: pgmap v1217: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:16.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:15 smithi086 ceph-mon[71303]: pgmap v1217: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:18.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:17 smithi017 ceph-mon[99370]: pgmap v1218: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:18.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:17 smithi086 ceph-mon[71303]: pgmap v1218: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:19.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:39:19.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:39:20.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:19 smithi086 ceph-mon[71303]: pgmap v1219: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:20.377 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:19 smithi017 ceph-mon[99370]: pgmap v1219: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:22.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:21 smithi017 ceph-mon[99370]: pgmap v1220: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:22.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:21 smithi086 ceph-mon[71303]: pgmap v1220: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:24.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:23 smithi017 ceph-mon[99370]: pgmap v1221: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:24.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:23 smithi086 ceph-mon[71303]: pgmap v1221: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:26.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:25 smithi017 ceph-mon[99370]: pgmap v1222: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:26.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:25 smithi086 ceph-mon[71303]: pgmap v1222: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:28.247 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:27 smithi086 ceph-mon[71303]: pgmap v1223: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:28.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:27 smithi017 ceph-mon[99370]: pgmap v1223: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:30.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:29 smithi017 ceph-mon[99370]: pgmap v1224: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:30.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:29 smithi086 ceph-mon[71303]: pgmap v1224: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:32.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:31 smithi017 ceph-mon[99370]: pgmap v1225: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:32.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:31 smithi086 ceph-mon[71303]: pgmap v1225: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:33.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:32 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:39:33.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:32 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:39:34.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:33 smithi017 ceph-mon[99370]: pgmap v1226: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:34.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:33 smithi086 ceph-mon[71303]: pgmap v1226: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:36.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:35 smithi017 ceph-mon[99370]: pgmap v1227: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:36.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:39:36.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:39:36.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:39:36.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:35 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:39:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:35 smithi086 ceph-mon[71303]: pgmap v1227: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:39:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:39:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:39:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:35 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:39:38.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:37 smithi017 ceph-mon[99370]: pgmap v1228: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:38.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:37 smithi086 ceph-mon[71303]: pgmap v1228: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:40.281 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:39 smithi086 ceph-mon[71303]: pgmap v1229: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:40.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:39 smithi017 ceph-mon[99370]: pgmap v1229: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:42.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:41 smithi017 ceph-mon[99370]: pgmap v1230: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:42.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:41 smithi086 ceph-mon[71303]: pgmap v1230: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:44.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:43 smithi017 ceph-mon[99370]: pgmap v1231: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:44.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:43 smithi086 ceph-mon[71303]: pgmap v1231: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:46.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:46 smithi017 ceph-mon[99370]: pgmap v1232: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:46.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:46 smithi086 ceph-mon[71303]: pgmap v1232: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:48.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:48 smithi017 ceph-mon[99370]: pgmap v1233: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:48.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:39:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:48 smithi086 ceph-mon[71303]: pgmap v1233: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:39:50.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:50 smithi017 ceph-mon[99370]: pgmap v1234: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:50.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:50 smithi086 ceph-mon[71303]: pgmap v1234: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:52.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:52 smithi017 ceph-mon[99370]: pgmap v1235: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:52.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:52 smithi086 ceph-mon[71303]: pgmap v1235: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:39:54.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:54 smithi017 ceph-mon[99370]: pgmap v1236: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:54.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:54 smithi086 ceph-mon[71303]: pgmap v1236: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:39:56.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:56 smithi017 ceph-mon[99370]: pgmap v1237: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:56.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:56 smithi086 ceph-mon[71303]: pgmap v1237: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:39:58.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:39:58 smithi017 ceph-mon[99370]: pgmap v1238: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:39:58.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:39:58 smithi086 ceph-mon[71303]: pgmap v1238: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:00.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:00 smithi017 ceph-mon[99370]: pgmap v1239: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:00.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:00 smithi017 ceph-mon[99370]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T01:40:00.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:00 smithi017 ceph-mon[99370]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:40:00.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:00 smithi017 ceph-mon[99370]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:40:00.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:00 smithi086 ceph-mon[71303]: pgmap v1239: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:00.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:00 smithi086 ceph-mon[71303]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-08-19T01:40:00.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:00 smithi086 ceph-mon[71303]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-08-19T01:40:00.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:00 smithi086 ceph-mon[71303]: fs cephfs has deprecated feature inline_data enabled. 2024-08-19T01:40:02.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:02 smithi017 ceph-mon[99370]: pgmap v1240: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:02.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:02 smithi086 ceph-mon[71303]: pgmap v1240: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:03.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:40:03.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:40:04.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:04 smithi017 ceph-mon[99370]: pgmap v1241: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:04.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:04 smithi086 ceph-mon[71303]: pgmap v1241: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:06.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:06 smithi017 ceph-mon[99370]: pgmap v1242: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:06.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:06 smithi086 ceph-mon[71303]: pgmap v1242: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:08.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:08 smithi017 ceph-mon[99370]: pgmap v1243: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:08.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:08 smithi086 ceph-mon[71303]: pgmap v1243: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:10.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:10 smithi017 ceph-mon[99370]: pgmap v1244: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:10.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:10 smithi086 ceph-mon[71303]: pgmap v1244: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:12.433 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:12 smithi017 ceph-mon[99370]: pgmap v1245: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:12.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:12 smithi086 ceph-mon[71303]: pgmap v1245: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:14.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:14 smithi017 ceph-mon[99370]: pgmap v1246: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:14.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:14 smithi086 ceph-mon[71303]: pgmap v1246: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:16.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:16 smithi086 ceph-mon[71303]: pgmap v1247: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:16.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:16 smithi017 ceph-mon[99370]: pgmap v1247: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:18.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:18 smithi017 ceph-mon[99370]: pgmap v1248: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:18.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:40:18.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:18 smithi086 ceph-mon[71303]: pgmap v1248: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:18.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:40:20.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:20 smithi017 ceph-mon[99370]: pgmap v1249: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:20.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:20 smithi086 ceph-mon[71303]: pgmap v1249: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:22.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:22 smithi017 ceph-mon[99370]: pgmap v1250: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:22.447 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:22 smithi086 ceph-mon[71303]: pgmap v1250: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:24.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:24 smithi017 ceph-mon[99370]: pgmap v1251: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:24.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:24 smithi086 ceph-mon[71303]: pgmap v1251: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:26.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:26 smithi017 ceph-mon[99370]: pgmap v1252: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:26.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:26 smithi086 ceph-mon[71303]: pgmap v1252: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:28.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:28 smithi017 ceph-mon[99370]: pgmap v1253: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:28.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:28 smithi086 ceph-mon[71303]: pgmap v1253: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:30.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:30 smithi017 ceph-mon[99370]: pgmap v1254: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:30.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:30 smithi086 ceph-mon[71303]: pgmap v1254: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:32.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:32 smithi017 ceph-mon[99370]: pgmap v1255: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:32.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:32 smithi086 ceph-mon[71303]: pgmap v1255: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:33.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:40:33.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:40:34.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:34 smithi017 ceph-mon[99370]: pgmap v1256: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:34.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:34 smithi086 ceph-mon[71303]: pgmap v1256: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:36.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:36 smithi017 ceph-mon[99370]: pgmap v1257: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:36.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:36 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:40:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:36 smithi086 ceph-mon[71303]: pgmap v1257: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:36 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:40:37.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:40:37.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:40:37.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:40:37.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:40:37.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:40:37.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:40:38.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:38 smithi017 ceph-mon[99370]: pgmap v1258: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:38.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:38 smithi086 ceph-mon[71303]: pgmap v1258: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:40.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:40 smithi017 ceph-mon[99370]: pgmap v1259: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:40.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:40 smithi086 ceph-mon[71303]: pgmap v1259: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:42.434 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:42 smithi017 ceph-mon[99370]: pgmap v1260: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:42.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:42 smithi086 ceph-mon[71303]: pgmap v1260: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:44.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:44 smithi017 ceph-mon[99370]: pgmap v1261: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:44.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:44 smithi086 ceph-mon[71303]: pgmap v1261: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:46.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:46 smithi017 ceph-mon[99370]: pgmap v1262: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:46.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:46 smithi086 ceph-mon[71303]: pgmap v1262: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:48.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:48 smithi017 ceph-mon[99370]: pgmap v1263: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:48.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:40:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:48 smithi086 ceph-mon[71303]: pgmap v1263: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:48.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:40:50.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:50 smithi017 ceph-mon[99370]: pgmap v1264: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:50.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:50 smithi086 ceph-mon[71303]: pgmap v1264: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:52.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:52 smithi017 ceph-mon[99370]: pgmap v1265: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:52.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:52 smithi086 ceph-mon[71303]: pgmap v1265: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:40:54.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:54 smithi017 ceph-mon[99370]: pgmap v1266: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:54.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:54 smithi086 ceph-mon[71303]: pgmap v1266: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:40:56.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:56 smithi017 ceph-mon[99370]: pgmap v1267: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:56.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:56 smithi086 ceph-mon[71303]: pgmap v1267: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:40:58.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:40:58 smithi017 ceph-mon[99370]: pgmap v1268: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:40:58.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:40:58 smithi086 ceph-mon[71303]: pgmap v1268: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:00.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:00 smithi017 ceph-mon[99370]: pgmap v1269: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:00.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:00 smithi086 ceph-mon[71303]: pgmap v1269: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:02.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:02 smithi017 ceph-mon[99370]: pgmap v1270: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:02.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:02 smithi086 ceph-mon[71303]: pgmap v1270: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:03.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:41:03.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:41:04.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:04 smithi017 ceph-mon[99370]: pgmap v1271: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:04.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:04 smithi086 ceph-mon[71303]: pgmap v1271: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:06.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:06 smithi017 ceph-mon[99370]: pgmap v1272: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:06.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:06 smithi086 ceph-mon[71303]: pgmap v1272: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:08.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:08 smithi017 ceph-mon[99370]: pgmap v1273: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:08.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:08 smithi086 ceph-mon[71303]: pgmap v1273: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:10.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:10 smithi017 ceph-mon[99370]: pgmap v1274: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:10.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:10 smithi086 ceph-mon[71303]: pgmap v1274: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:12.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:12 smithi017 ceph-mon[99370]: pgmap v1275: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:12.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:12 smithi086 ceph-mon[71303]: pgmap v1275: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:14.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:14 smithi017 ceph-mon[99370]: pgmap v1276: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:14.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:14 smithi086 ceph-mon[71303]: pgmap v1276: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:16.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:16 smithi017 ceph-mon[99370]: pgmap v1277: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:16.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:16 smithi086 ceph-mon[71303]: pgmap v1277: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:18.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:18 smithi017 ceph-mon[99370]: pgmap v1278: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:18.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:41:18.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:18 smithi086 ceph-mon[71303]: pgmap v1278: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:18.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:41:20.446 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:20 smithi017 ceph-mon[99370]: pgmap v1279: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:20.450 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:20 smithi086 ceph-mon[71303]: pgmap v1279: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:22.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:22 smithi017 ceph-mon[99370]: pgmap v1280: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:22.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:22 smithi086 ceph-mon[71303]: pgmap v1280: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:24.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:24 smithi017 ceph-mon[99370]: pgmap v1281: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:24.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:24 smithi086 ceph-mon[71303]: pgmap v1281: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:26.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:26 smithi017 ceph-mon[99370]: pgmap v1282: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:26.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:26 smithi086 ceph-mon[71303]: pgmap v1282: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:28.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:28 smithi017 ceph-mon[99370]: pgmap v1283: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:28.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:28 smithi086 ceph-mon[71303]: pgmap v1283: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:30.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:30 smithi017 ceph-mon[99370]: pgmap v1284: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:30.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:30 smithi086 ceph-mon[71303]: pgmap v1284: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:32.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:32 smithi017 ceph-mon[99370]: pgmap v1285: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:32.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:32 smithi086 ceph-mon[71303]: pgmap v1285: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:33.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:41:33.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:41:34.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:34 smithi017 ceph-mon[99370]: pgmap v1286: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:34.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:34 smithi086 ceph-mon[71303]: pgmap v1286: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:36.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:36 smithi017 ceph-mon[99370]: pgmap v1287: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:36.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:36 smithi086 ceph-mon[71303]: pgmap v1287: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:37.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:41:37.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:41:37.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:41:37.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:41:37.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:41:37.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:41:37.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:41:37.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:41:38.432 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:38 smithi017 ceph-mon[99370]: pgmap v1288: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:38.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:38 smithi086 ceph-mon[71303]: pgmap v1288: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:40.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:40 smithi086 ceph-mon[71303]: pgmap v1289: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:40.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:40 smithi017 ceph-mon[99370]: pgmap v1289: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:42.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:42 smithi086 ceph-mon[71303]: pgmap v1290: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:42.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:42 smithi017 ceph-mon[99370]: pgmap v1290: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:44.445 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:44 smithi086 ceph-mon[71303]: pgmap v1291: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:44.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:44 smithi017 ceph-mon[99370]: pgmap v1291: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:46.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:46 smithi017 ceph-mon[99370]: pgmap v1292: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:46.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:46 smithi086 ceph-mon[71303]: pgmap v1292: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:48.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:48 smithi017 ceph-mon[99370]: pgmap v1293: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:48.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:41:48.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:48 smithi086 ceph-mon[71303]: pgmap v1293: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:48.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:41:50.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:50 smithi017 ceph-mon[99370]: pgmap v1294: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:50.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:50 smithi086 ceph-mon[71303]: pgmap v1294: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:52.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:52 smithi017 ceph-mon[99370]: pgmap v1295: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:52.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:52 smithi086 ceph-mon[71303]: pgmap v1295: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:41:54.683 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:54 smithi017 ceph-mon[99370]: pgmap v1296: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:54.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:54 smithi086 ceph-mon[71303]: pgmap v1296: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:41:56.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:56 smithi017 ceph-mon[99370]: pgmap v1297: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:56.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:56 smithi086 ceph-mon[71303]: pgmap v1297: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:41:58.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:41:58 smithi017 ceph-mon[99370]: pgmap v1298: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:41:58.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:41:58 smithi086 ceph-mon[71303]: pgmap v1298: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:00.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:00 smithi017 ceph-mon[99370]: pgmap v1299: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:00.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:00 smithi086 ceph-mon[71303]: pgmap v1299: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:02.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:02 smithi017 ceph-mon[99370]: pgmap v1300: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:02.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:02 smithi086 ceph-mon[71303]: pgmap v1300: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:03.517 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:42:03.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:42:04.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:04 smithi017 ceph-mon[99370]: pgmap v1301: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:04.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:04 smithi086 ceph-mon[71303]: pgmap v1301: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:06.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:06 smithi017 ceph-mon[99370]: pgmap v1302: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:06.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:06 smithi086 ceph-mon[71303]: pgmap v1302: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:07.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:07 smithi017 ceph-mon[99370]: pgmap v1303: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:07.695 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:07 smithi086 ceph-mon[71303]: pgmap v1303: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:09.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:09 smithi086 ceph-mon[71303]: pgmap v1304: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:10.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:09 smithi017 ceph-mon[99370]: pgmap v1304: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:11.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:11 smithi086 ceph-mon[71303]: pgmap v1305: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:12.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:11 smithi017 ceph-mon[99370]: pgmap v1305: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:13.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:13 smithi086 ceph-mon[71303]: pgmap v1306: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:14.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:13 smithi017 ceph-mon[99370]: pgmap v1306: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:16.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:15 smithi017 ceph-mon[99370]: pgmap v1307: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:16.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:15 smithi086 ceph-mon[71303]: pgmap v1307: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:18.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:17 smithi017 ceph-mon[99370]: pgmap v1308: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:18.197 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:17 smithi086 ceph-mon[71303]: pgmap v1308: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:19.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:18 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:42:19.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:18 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:42:20.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:19 smithi017 ceph-mon[99370]: pgmap v1309: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:20.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:19 smithi086 ceph-mon[71303]: pgmap v1309: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:22.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:21 smithi017 ceph-mon[99370]: pgmap v1310: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:22.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:21 smithi086 ceph-mon[71303]: pgmap v1310: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:24.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:23 smithi017 ceph-mon[99370]: pgmap v1311: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:24.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:23 smithi086 ceph-mon[71303]: pgmap v1311: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:26.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:25 smithi017 ceph-mon[99370]: pgmap v1312: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:26.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:25 smithi086 ceph-mon[71303]: pgmap v1312: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:28.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:27 smithi017 ceph-mon[99370]: pgmap v1313: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:28.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:27 smithi086 ceph-mon[71303]: pgmap v1313: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:30.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:29 smithi017 ceph-mon[99370]: pgmap v1314: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:30.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:29 smithi086 ceph-mon[71303]: pgmap v1314: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:32.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:31 smithi017 ceph-mon[99370]: pgmap v1315: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:32.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:31 smithi086 ceph-mon[71303]: pgmap v1315: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:33.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:33 smithi086 ceph-mon[71303]: pgmap v1316: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:33.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:33 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:42:34.102 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:33 smithi017 ceph-mon[99370]: pgmap v1316: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:34.102 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:33 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:42:36.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:35 smithi017 ceph-mon[99370]: pgmap v1317: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:36.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:35 smithi086 ceph-mon[71303]: pgmap v1317: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:38.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:37 smithi017 ceph-mon[99370]: pgmap v1318: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:38.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:42:38.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:42:38.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:42:38.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:37 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:42:38.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:37 smithi086 ceph-mon[71303]: pgmap v1318: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:38.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-19T01:42:38.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-19T01:42:38.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-19T01:42:38.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:37 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' 2024-08-19T01:42:40.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:39 smithi017 ceph-mon[99370]: pgmap v1319: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:40.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:39 smithi086 ceph-mon[71303]: pgmap v1319: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:42.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:41 smithi017 ceph-mon[99370]: pgmap v1320: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:42.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:41 smithi086 ceph-mon[71303]: pgmap v1320: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:43.945 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:43 smithi086 ceph-mon[71303]: pgmap v1321: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:44.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:43 smithi017 ceph-mon[99370]: pgmap v1321: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:46.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:45 smithi017 ceph-mon[99370]: pgmap v1322: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:46.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:45 smithi086 ceph-mon[71303]: pgmap v1322: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:48.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:47 smithi017 ceph-mon[99370]: pgmap v1323: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:48.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:47 smithi086 ceph-mon[71303]: pgmap v1323: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:49.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:48 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:42:49.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:48 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:42:50.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:49 smithi017 ceph-mon[99370]: pgmap v1324: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:50.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:49 smithi086 ceph-mon[71303]: pgmap v1324: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:52.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:51 smithi017 ceph-mon[99370]: pgmap v1325: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:52.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:51 smithi086 ceph-mon[71303]: pgmap v1325: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:42:54.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:53 smithi017 ceph-mon[99370]: pgmap v1326: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:54.196 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:53 smithi086 ceph-mon[71303]: pgmap v1326: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:42:56.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:55 smithi017 ceph-mon[99370]: pgmap v1327: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:56.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:55 smithi086 ceph-mon[71303]: pgmap v1327: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:42:58.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:57 smithi017 ceph-mon[99370]: pgmap v1328: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:42:58.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:57 smithi086 ceph-mon[71303]: pgmap v1328: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:43:00.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:42:59 smithi017 ceph-mon[99370]: pgmap v1329: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:43:00.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:42:59 smithi086 ceph-mon[71303]: pgmap v1329: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:43:02.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:01 smithi017 ceph-mon[99370]: pgmap v1330: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:43:02.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:01 smithi086 ceph-mon[71303]: pgmap v1330: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:43:04.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:03 smithi017 ceph-mon[99370]: pgmap v1331: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:43:04.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:03 smithi017 ceph-mon[99370]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:43:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:03 smithi086 ceph-mon[71303]: pgmap v1331: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:43:04.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:03 smithi086 ceph-mon[71303]: from='mgr.34104 172.21.15.17:0/950874400' entity='mgr.smithi017.hfpawi' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-08-19T01:43:06.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:05 smithi017 ceph-mon[99370]: pgmap v1332: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:43:06.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:05 smithi086 ceph-mon[71303]: pgmap v1332: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:43:08.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:07 smithi017 ceph-mon[99370]: pgmap v1333: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:43:08.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:07 smithi086 ceph-mon[71303]: pgmap v1333: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-19T01:43:10.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:09 smithi017 ceph-mon[99370]: pgmap v1334: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:43:10.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:09 smithi086 ceph-mon[71303]: pgmap v1334: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:43:12.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:11 smithi017 ceph-mon[99370]: pgmap v1335: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:43:12.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:11 smithi086 ceph-mon[71303]: pgmap v1335: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-08-19T01:43:14.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:13 smithi017 ceph-mon[99370]: pgmap v1336: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:43:14.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:13 smithi086 ceph-mon[71303]: pgmap v1336: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-08-19T01:43:16.182 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:15 smithi017 ceph-mon[99370]: pgmap v1337: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:43:16.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:15 smithi086 ceph-mon[71303]: pgmap v1337: 65 pgs: 65 active+clean; 259 MiB data, 1003 MiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-08-19T01:43:16.271 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-08-19T01:43:16.272 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-19T01:43:16.274 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-19T01:43:16.286 INFO:tasks.cephadm:Teardown begin 2024-08-19T01:43:16.286 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephadm.py", line 2236, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-19T01:43:16.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-19T01:43:16.321 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-19T01:43:16.355 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-19T01:43:16.355 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-19T01:43:16.380 DEBUG:teuthology.orchestra.run.smithi086:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-19T01:43:16.413 INFO:tasks.cephadm:Stopping all daemons... 2024-08-19T01:43:16.413 INFO:tasks.cephadm.mon.smithi017:Stopping mon.smithi017... 2024-08-19T01:43:16.414 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi017 2024-08-19T01:43:16.682 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:16 smithi017 systemd[1]: Stopping Ceph mon.smithi017 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:43:17.066 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:16 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:43:16.779+0000 7f7b3fcdd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi017 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:43:17.066 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:16 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017[99366]: 2024-08-19T01:43:16.779+0000 7f7b3fcdd640 -1 mon.smithi017@0(leader) e3 *** Got Signal Terminated *** 2024-08-19T01:43:17.066 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:16 smithi017 podman[156450]: 2024-08-19 01:43:16.87224119 +0000 UTC m=+0.238968218 container died d3c8cdedb4549814676901f6a752ee9f96646f6f680d758cbdef533fca091793 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-08-19T01:43:17.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:17 smithi017 podman[156450]: 2024-08-19 01:43:17.438349267 +0000 UTC m=+0.805076298 container cleanup d3c8cdedb4549814676901f6a752ee9f96646f6f680d758cbdef533fca091793 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:43:17.700 INFO:journalctl@ceph.mon.smithi017.smithi017.stdout:Aug 19 01:43:17 smithi017 bash[156450]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi017 2024-08-19T01:43:17.840 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi017.service' 2024-08-19T01:43:17.882 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T01:43:17.882 INFO:tasks.cephadm.mon.smithi017:Stopped mon.smithi017 2024-08-19T01:43:17.882 INFO:tasks.cephadm.mon.smithi086:Stopping mon.smithi086... 2024-08-19T01:43:17.882 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi086 2024-08-19T01:43:18.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:17 smithi086 systemd[1]: Stopping Ceph mon.smithi086 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:43:18.482 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:18 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086[71299]: 2024-08-19T01:43:18.221+0000 7fe2fd9c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi086 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:43:18.483 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:18 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086[71299]: 2024-08-19T01:43:18.221+0000 7fe2fd9c9640 -1 mon.smithi086@1(peon) e3 *** Got Signal Terminated *** 2024-08-19T01:43:18.483 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:18 smithi086 podman[108844]: 2024-08-19 01:43:18.456639756 +0000 UTC m=+0.360505224 container stop 1ffcf46dbba95c595481864d2953a1ca11c95961d6658e3a447c60f48d1448ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, ceph=True, org.label-schema.schema-version=1.0) 2024-08-19T01:43:18.483 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:18 smithi086 podman[108844]: 2024-08-19 01:43:18.48211593 +0000 UTC m=+0.385981398 container died 1ffcf46dbba95c595481864d2953a1ca11c95961d6658e3a447c60f48d1448ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-19T01:43:19.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:18 smithi086 podman[108844]: 2024-08-19 01:43:18.95441328 +0000 UTC m=+0.858278748 container cleanup 1ffcf46dbba95c595481864d2953a1ca11c95961d6658e3a447c60f48d1448ee (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-19T01:43:19.195 INFO:journalctl@ceph.mon.smithi086.smithi086.stdout:Aug 19 01:43:18 smithi086 bash[108844]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-mon-smithi086 2024-08-19T01:43:19.403 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@mon.smithi086.service' 2024-08-19T01:43:19.451 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T01:43:19.451 INFO:tasks.cephadm.mon.smithi086:Stopped mon.smithi086 2024-08-19T01:43:19.451 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-19T01:43:19.451 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.0 2024-08-19T01:43:19.785 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:19 smithi017 systemd[1]: Stopping Ceph osd.0 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:43:20.182 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0[110388]: 2024-08-19T01:43:19.784+0000 7f34e60c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:43:20.182 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0[110388]: 2024-08-19T01:43:19.784+0000 7f34e60c9640 -1 osd.0 85 *** Got signal Terminated *** 2024-08-19T01:43:20.182 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:19 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0[110388]: 2024-08-19T01:43:19.784+0000 7f34e60c9640 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:43:25.432 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:25 smithi017 podman[156587]: 2024-08-19 01:43:25.298340714 +0000 UTC m=+5.639416823 container died 759a865efe387ac1fe984a656c3969d8146a7f79770a2c5021d5fe326b350485 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:43:25.932 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:25 smithi017 podman[156587]: 2024-08-19 01:43:25.693257292 +0000 UTC m=+6.034333384 container cleanup 759a865efe387ac1fe984a656c3969d8146a7f79770a2c5021d5fe326b350485 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-19T01:43:25.932 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:25 smithi017 bash[156587]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0 2024-08-19T01:43:26.432 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:26 smithi017 podman[156605]: 2024-08-19 01:43:26.06141064 +0000 UTC m=+0.763623736 container remove 759a865efe387ac1fe984a656c3969d8146a7f79770a2c5021d5fe326b350485 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-19T01:43:26.866 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:26 smithi017 podman[156695]: 2024-08-19 01:43:26.48668103 +0000 UTC m=+0.017519793 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:43:26.866 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:26 smithi017 podman[156695]: 2024-08-19 01:43:26.612799423 +0000 UTC m=+0.143638213 container create 7347bce54b7c5fa3e379d2c86da441a8b71977aeb1113f511f4b9fbeba2ef51b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-08-19T01:43:26.867 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:26 smithi017 podman[156695]: 2024-08-19 01:43:26.866278737 +0000 UTC m=+0.397117486 container init 7347bce54b7c5fa3e379d2c86da441a8b71977aeb1113f511f4b9fbeba2ef51b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0) 2024-08-19T01:43:27.182 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:26 smithi017 podman[156695]: 2024-08-19 01:43:26.870224087 +0000 UTC m=+0.401062836 container start 7347bce54b7c5fa3e379d2c86da441a8b71977aeb1113f511f4b9fbeba2ef51b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-19T01:43:27.182 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:26 smithi017 podman[156695]: 2024-08-19 01:43:26.97395471 +0000 UTC m=+0.504793468 container attach 7347bce54b7c5fa3e379d2c86da441a8b71977aeb1113f511f4b9fbeba2ef51b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-19T01:43:27.182 INFO:journalctl@ceph.osd.0.smithi017.stdout:Aug 19 01:43:27 smithi017 podman[156718]: 2024-08-19 01:43:27.088678402 +0000 UTC m=+0.018611817 container died 7347bce54b7c5fa3e379d2c86da441a8b71977aeb1113f511f4b9fbeba2ef51b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-19T01:43:27.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.0.service' 2024-08-19T01:43:27.877 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T01:43:27.878 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-19T01:43:27.878 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-19T01:43:27.878 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.1 2024-08-19T01:43:28.182 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:27 smithi017 systemd[1]: Stopping Ceph osd.1 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:43:28.682 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1[115753]: 2024-08-19T01:43:28.206+0000 7f1dc5e66640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:43:28.682 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1[115753]: 2024-08-19T01:43:28.206+0000 7f1dc5e66640 -1 osd.1 85 *** Got signal Terminated *** 2024-08-19T01:43:28.682 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:28 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1[115753]: 2024-08-19T01:43:28.206+0000 7f1dc5e66640 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:43:33.967 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:33 smithi017 podman[156811]: 2024-08-19 01:43:33.704220131 +0000 UTC m=+5.591472500 container died 146db8dc74d104353e55c1f7c240574243ef12c78f4a15652b60d8809ec8810b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-19T01:43:34.341 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:34 smithi017 podman[156811]: 2024-08-19 01:43:34.064729343 +0000 UTC m=+5.951981699 container cleanup 146db8dc74d104353e55c1f7c240574243ef12c78f4a15652b60d8809ec8810b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-08-19T01:43:34.341 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:34 smithi017 bash[156811]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1 2024-08-19T01:43:34.682 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:34 smithi017 podman[156828]: 2024-08-19 01:43:34.341052979 +0000 UTC m=+0.629258680 container remove 146db8dc74d104353e55c1f7c240574243ef12c78f4a15652b60d8809ec8810b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-19T01:43:35.020 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:34 smithi017 podman[156913]: 2024-08-19 01:43:34.616503308 +0000 UTC m=+0.017957483 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:43:35.020 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:34 smithi017 podman[156913]: 2024-08-19 01:43:34.758970413 +0000 UTC m=+0.160424640 container create 042e71fa8b52f27b920e17fc690daf14a6f7ba5dfa5a61881bb2acb0f3724bce (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-19T01:43:35.020 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:35 smithi017 podman[156913]: 2024-08-19 01:43:35.02012148 +0000 UTC m=+0.421575648 container init 042e71fa8b52f27b920e17fc690daf14a6f7ba5dfa5a61881bb2acb0f3724bce (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0) 2024-08-19T01:43:35.432 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:35 smithi017 podman[156913]: 2024-08-19 01:43:35.024012101 +0000 UTC m=+0.425466266 container start 042e71fa8b52f27b920e17fc690daf14a6f7ba5dfa5a61881bb2acb0f3724bce (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-deactivate, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-19T01:43:35.432 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:35 smithi017 podman[156913]: 2024-08-19 01:43:35.095201356 +0000 UTC m=+0.496655522 container attach 042e71fa8b52f27b920e17fc690daf14a6f7ba5dfa5a61881bb2acb0f3724bce (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:43:35.433 INFO:journalctl@ceph.osd.1.smithi017.stdout:Aug 19 01:43:35 smithi017 podman[156913]: 2024-08-19 01:43:35.219056328 +0000 UTC m=+0.620510502 container died 042e71fa8b52f27b920e17fc690daf14a6f7ba5dfa5a61881bb2acb0f3724bce (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS) 2024-08-19T01:43:35.861 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.1.service' 2024-08-19T01:43:35.900 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T01:43:35.900 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-19T01:43:35.900 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-19T01:43:35.900 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.2 2024-08-19T01:43:36.182 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:35 smithi017 systemd[1]: Stopping Ceph osd.2 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:43:36.682 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:36 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[121134]: 2024-08-19T01:43:36.269+0000 7ff6aa69b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:43:36.682 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:36 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[121134]: 2024-08-19T01:43:36.269+0000 7ff6aa69b640 -1 osd.2 85 *** Got signal Terminated *** 2024-08-19T01:43:36.682 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:36 smithi017 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2[121134]: 2024-08-19T01:43:36.269+0000 7ff6aa69b640 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:43:41.861 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:41 smithi017 podman[157016]: 2024-08-19 01:43:41.582957331 +0000 UTC m=+5.448202017 container died d03c5f91e697a5a52a639ad99111f169d9752f38275a28dadfff9b42bca6bfd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-08-19T01:43:42.182 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:41 smithi017 podman[157016]: 2024-08-19 01:43:41.861287088 +0000 UTC m=+5.726531764 container cleanup d03c5f91e697a5a52a639ad99111f169d9752f38275a28dadfff9b42bca6bfd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-19T01:43:42.182 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:41 smithi017 bash[157016]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2 2024-08-19T01:43:42.182 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:42 smithi017 podman[157031]: 2024-08-19 01:43:42.057315514 +0000 UTC m=+0.472197751 container remove d03c5f91e697a5a52a639ad99111f169d9752f38275a28dadfff9b42bca6bfd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-08-19T01:43:42.753 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:42 smithi017 podman[157117]: 2024-08-19 01:43:42.404681063 +0000 UTC m=+0.017180680 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:43:42.753 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:42 smithi017 podman[157117]: 2024-08-19 01:43:42.513664256 +0000 UTC m=+0.126163874 container create 311e83145d1672b2a2acf2e79231076ea668a576ffbf3125bc5abb2939a4919b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, RELEASE=squid-de09dd0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-19T01:43:42.754 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:42 smithi017 podman[157117]: 2024-08-19 01:43:42.749660396 +0000 UTC m=+0.362160013 container init 311e83145d1672b2a2acf2e79231076ea668a576ffbf3125bc5abb2939a4919b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-08-19T01:43:42.754 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:42 smithi017 podman[157117]: 2024-08-19 01:43:42.752936309 +0000 UTC m=+0.365435925 container start 311e83145d1672b2a2acf2e79231076ea668a576ffbf3125bc5abb2939a4919b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-19T01:43:43.182 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:42 smithi017 podman[157117]: 2024-08-19 01:43:42.849762371 +0000 UTC m=+0.462261995 container attach 311e83145d1672b2a2acf2e79231076ea668a576ffbf3125bc5abb2939a4919b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-19T01:43:43.183 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:42 smithi017 podman[157117]: 2024-08-19 01:43:42.948783386 +0000 UTC m=+0.561283003 container died 311e83145d1672b2a2acf2e79231076ea668a576ffbf3125bc5abb2939a4919b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0) 2024-08-19T01:43:43.504 INFO:journalctl@ceph.osd.2.smithi017.stdout:Aug 19 01:43:43 smithi017 podman[157140]: 2024-08-19 01:43:43.486930201 +0000 UTC m=+0.531172206 container remove 311e83145d1672b2a2acf2e79231076ea668a576ffbf3125bc5abb2939a4919b (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T01:43:43.510 DEBUG:teuthology.orchestra.run.smithi017:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.2.service' 2024-08-19T01:43:43.551 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T01:43:43.551 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-19T01:43:43.551 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-19T01:43:43.552 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.3 2024-08-19T01:43:43.934 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:43 smithi086 systemd[1]: Stopping Ceph osd.3 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:43:44.195 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:43 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[80991]: 2024-08-19T01:43:43.932+0000 7f5e21b62640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:43:44.195 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:43 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[80991]: 2024-08-19T01:43:43.932+0000 7f5e21b62640 -1 osd.3 85 *** Got signal Terminated *** 2024-08-19T01:43:44.195 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:43 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[80991]: 2024-08-19T01:43:43.932+0000 7f5e21b62640 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:43:46.195 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:45 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:45.861+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.600809+0000 front 2024-08-19T01:43:24.600796+0000 (oldest deadline 2024-08-19T01:43:45.700561+0000) 2024-08-19T01:43:46.695 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:46 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[80991]: 2024-08-19T01:43:46.228+0000 7f5e1e968640 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.761948+0000 front 2024-08-19T01:43:24.761849+0000 (oldest deadline 2024-08-19T01:43:45.761944+0000) 2024-08-19T01:43:46.695 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:46 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:46.473+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:47.192 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:46 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:46.895+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.600809+0000 front 2024-08-19T01:43:24.600796+0000 (oldest deadline 2024-08-19T01:43:45.700561+0000) 2024-08-19T01:43:47.445 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:47 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[80991]: 2024-08-19T01:43:47.190+0000 7f5e1e968640 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.761948+0000 front 2024-08-19T01:43:24.761849+0000 (oldest deadline 2024-08-19T01:43:45.761944+0000) 2024-08-19T01:43:47.942 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:47 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:47.512+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:48.195 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:47 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:47.940+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.600809+0000 front 2024-08-19T01:43:24.600796+0000 (oldest deadline 2024-08-19T01:43:45.700561+0000) 2024-08-19T01:43:48.549 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:48 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3[80991]: 2024-08-19T01:43:48.238+0000 7f5e1e968640 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.761948+0000 front 2024-08-19T01:43:24.761849+0000 (oldest deadline 2024-08-19T01:43:45.761944+0000) 2024-08-19T01:43:48.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:48 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:48.548+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:49.445 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:48 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:48.946+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.600809+0000 front 2024-08-19T01:43:24.600796+0000 (oldest deadline 2024-08-19T01:43:45.700561+0000) 2024-08-19T01:43:49.784 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:49 smithi086 podman[108965]: 2024-08-19 01:43:49.493943445 +0000 UTC m=+5.743974844 container died da32fbdb045396085c6aacd0b32500c2fcdd8f2e97ebbfacbe2bf0958ae50196 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0) 2024-08-19T01:43:49.785 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:49 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:49.592+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:50.143 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:49 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:49.969+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.600809+0000 front 2024-08-19T01:43:24.600796+0000 (oldest deadline 2024-08-19T01:43:45.700561+0000) 2024-08-19T01:43:50.143 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:49 smithi086 podman[108965]: 2024-08-19 01:43:49.874942779 +0000 UTC m=+6.124974166 container cleanup da32fbdb045396085c6aacd0b32500c2fcdd8f2e97ebbfacbe2bf0958ae50196 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-19T01:43:50.143 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:49 smithi086 bash[108965]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3 2024-08-19T01:43:50.445 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:50 smithi086 podman[108983]: 2024-08-19 01:43:50.142850554 +0000 UTC m=+0.638592142 container remove da32fbdb045396085c6aacd0b32500c2fcdd8f2e97ebbfacbe2bf0958ae50196 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-19T01:43:50.821 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:50 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:50.578+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:50.822 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:50 smithi086 podman[109068]: 2024-08-19 01:43:50.502053128 +0000 UTC m=+0.109550861 container create cac33f2b3f5b1760c429540b13b4e62e1f75b830465bfb315d39c6fed30a0677 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0) 2024-08-19T01:43:50.822 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:50 smithi086 podman[109068]: 2024-08-19 01:43:50.409748008 +0000 UTC m=+0.017245752 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:43:50.822 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:50 smithi086 podman[109068]: 2024-08-19 01:43:50.746342768 +0000 UTC m=+0.353840498 container init cac33f2b3f5b1760c429540b13b4e62e1f75b830465bfb315d39c6fed30a0677 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:43:50.822 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:50 smithi086 podman[109068]: 2024-08-19 01:43:50.749586991 +0000 UTC m=+0.357084730 container start cac33f2b3f5b1760c429540b13b4e62e1f75b830465bfb315d39c6fed30a0677 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-19T01:43:50.822 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:50 smithi086 podman[109068]: 2024-08-19 01:43:50.821358093 +0000 UTC m=+0.428855829 container attach cac33f2b3f5b1760c429540b13b4e62e1f75b830465bfb315d39c6fed30a0677 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-19T01:43:51.195 INFO:journalctl@ceph.osd.3.smithi086.stdout:Aug 19 01:43:50 smithi086 podman[109092]: 2024-08-19 01:43:50.968945451 +0000 UTC m=+0.018117663 container died cac33f2b3f5b1760c429540b13b4e62e1f75b830465bfb315d39c6fed30a0677 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-19T01:43:51.195 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:51 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:51.005+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.600809+0000 front 2024-08-19T01:43:24.600796+0000 (oldest deadline 2024-08-19T01:43:45.700561+0000) 2024-08-19T01:43:51.515 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.3.service' 2024-08-19T01:43:51.554 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T01:43:51.555 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-19T01:43:51.555 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-19T01:43:51.555 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.4 2024-08-19T01:43:51.895 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:51 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:51.572+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:51.895 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:51 smithi086 systemd[1]: Stopping Ceph osd.4 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:43:51.896 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:51 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:51.894+0000 7fc917576640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:43:52.195 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:51 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:51.894+0000 7fc917576640 -1 osd.4 85 *** Got signal Terminated *** 2024-08-19T01:43:52.195 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:51 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:51.894+0000 7fc917576640 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:43:52.195 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:52 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:52.004+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.600809+0000 front 2024-08-19T01:43:24.600796+0000 (oldest deadline 2024-08-19T01:43:45.700561+0000) 2024-08-19T01:43:52.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:52 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:52.597+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:53.445 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:52 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:52.995+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.600809+0000 front 2024-08-19T01:43:24.600796+0000 (oldest deadline 2024-08-19T01:43:45.700561+0000) 2024-08-19T01:43:53.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:53 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:53.646+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:54.445 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:54 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:54.000+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.600809+0000 front 2024-08-19T01:43:24.600796+0000 (oldest deadline 2024-08-19T01:43:45.700561+0000) 2024-08-19T01:43:54.916 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:54 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:54.652+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:54.916 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:54 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:54.652+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:30.725924+0000 front 2024-08-19T01:43:30.726085+0000 (oldest deadline 2024-08-19T01:43:54.225796+0000) 2024-08-19T01:43:55.195 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:55 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:55.022+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.600809+0000 front 2024-08-19T01:43:24.600796+0000 (oldest deadline 2024-08-19T01:43:45.700561+0000) 2024-08-19T01:43:55.195 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:55 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:55.022+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:33.102686+0000 front 2024-08-19T01:43:33.102633+0000 (oldest deadline 2024-08-19T01:43:54.802481+0000) 2024-08-19T01:43:55.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:55 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:55.692+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:55.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:55 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:55.692+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:30.725924+0000 front 2024-08-19T01:43:30.726085+0000 (oldest deadline 2024-08-19T01:43:54.225796+0000) 2024-08-19T01:43:56.445 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:56 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:56.045+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:24.600809+0000 front 2024-08-19T01:43:24.600796+0000 (oldest deadline 2024-08-19T01:43:45.700561+0000) 2024-08-19T01:43:56.445 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:56 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4[86134]: 2024-08-19T01:43:56.045+0000 7fc91437c640 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:33.102686+0000 front 2024-08-19T01:43:33.102633+0000 (oldest deadline 2024-08-19T01:43:54.802481+0000) 2024-08-19T01:43:57.195 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:56 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:56.724+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:57.195 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:56 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:56.724+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:30.725924+0000 front 2024-08-19T01:43:30.726085+0000 (oldest deadline 2024-08-19T01:43:54.225796+0000) 2024-08-19T01:43:57.587 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:57 smithi086 podman[109174]: 2024-08-19 01:43:57.333818619 +0000 UTC m=+5.549561818 container died 9bce1ba418a66ee1a3d9f43c733f6f16baf1c5b61fb486c6529721cf1199ed88 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0) 2024-08-19T01:43:57.945 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:57 smithi086 podman[109174]: 2024-08-19 01:43:57.685919261 +0000 UTC m=+5.901662465 container cleanup 9bce1ba418a66ee1a3d9f43c733f6f16baf1c5b61fb486c6529721cf1199ed88 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:43:57.945 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:57 smithi086 bash[109174]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4 2024-08-19T01:43:57.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:57 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:57.691+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:57.946 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:57 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:57.691+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:30.725924+0000 front 2024-08-19T01:43:30.726085+0000 (oldest deadline 2024-08-19T01:43:54.225796+0000) 2024-08-19T01:43:58.295 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:57 smithi086 podman[109188]: 2024-08-19 01:43:57.970637747 +0000 UTC m=+0.634898436 container remove 9bce1ba418a66ee1a3d9f43c733f6f16baf1c5b61fb486c6529721cf1199ed88 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4, org.label-schema.build-date=20240731, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-08-19T01:43:58.616 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:58 smithi086 podman[109282]: 2024-08-19 01:43:58.197258195 +0000 UTC m=+0.016988995 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:43:58.616 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:58 smithi086 podman[109282]: 2024-08-19 01:43:58.315747095 +0000 UTC m=+0.135477882 container create e8141fbe52c62447ad5c245798c6a3a2f25640d0435a23722c8ab363cf952ba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-19T01:43:58.616 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:58 smithi086 podman[109282]: 2024-08-19 01:43:58.540867017 +0000 UTC m=+0.360597818 container init e8141fbe52c62447ad5c245798c6a3a2f25640d0435a23722c8ab363cf952ba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-deactivate, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-de09dd0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-19T01:43:58.616 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:58 smithi086 podman[109282]: 2024-08-19 01:43:58.544177838 +0000 UTC m=+0.363908630 container start e8141fbe52c62447ad5c245798c6a3a2f25640d0435a23722c8ab363cf952ba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-19T01:43:58.616 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:58 smithi086 podman[109282]: 2024-08-19 01:43:58.615851481 +0000 UTC m=+0.435582269 container attach e8141fbe52c62447ad5c245798c6a3a2f25640d0435a23722c8ab363cf952ba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-de09dd0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-19T01:43:58.945 INFO:journalctl@ceph.osd.4.smithi086.stdout:Aug 19 01:43:58 smithi086 podman[109282]: 2024-08-19 01:43:58.735057804 +0000 UTC m=+0.554788592 container died e8141fbe52c62447ad5c245798c6a3a2f25640d0435a23722c8ab363cf952ba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, io.buildah.version=1.36.0) 2024-08-19T01:43:58.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:58 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:58.692+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:58.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:58 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:58.692+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:30.725924+0000 front 2024-08-19T01:43:30.726085+0000 (oldest deadline 2024-08-19T01:43:54.225796+0000) 2024-08-19T01:43:59.299 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.4.service' 2024-08-19T01:43:59.339 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T01:43:59.339 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-19T01:43:59.339 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-19T01:43:59.339 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.5 2024-08-19T01:43:59.681 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:59 smithi086 systemd[1]: Stopping Ceph osd.5 for 61e0bb80-5dc4-11ef-bccf-c7b262605968... 2024-08-19T01:43:59.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:59 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:59.680+0000 7fc37701b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-19T01:43:59.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:59 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:59.680+0000 7fc37701b640 -1 osd.5 85 *** Got signal Terminated *** 2024-08-19T01:43:59.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:59 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:59.680+0000 7fc37701b640 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-19T01:43:59.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:59 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:59.742+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:43:59.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:43:59 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:43:59.742+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:30.725924+0000 front 2024-08-19T01:43:30.726085+0000 (oldest deadline 2024-08-19T01:43:54.225796+0000) 2024-08-19T01:44:01.196 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:00 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:44:00.736+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:44:01.196 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:00 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:44:00.736+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:30.725924+0000 front 2024-08-19T01:43:30.726085+0000 (oldest deadline 2024-08-19T01:43:54.225796+0000) 2024-08-19T01:44:01.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:01 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:44:01.754+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:44:01.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:01 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:44:01.754+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:30.725924+0000 front 2024-08-19T01:43:30.726085+0000 (oldest deadline 2024-08-19T01:43:54.225796+0000) 2024-08-19T01:44:01.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:01 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:44:01.754+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6822 osd.2 since back 2024-08-19T01:43:38.227133+0000 front 2024-08-19T01:43:38.227118+0000 (oldest deadline 2024-08-19T01:44:01.727037+0000) 2024-08-19T01:44:03.195 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:02 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:44:02.718+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:44:03.195 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:02 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:44:02.718+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:30.725924+0000 front 2024-08-19T01:43:30.726085+0000 (oldest deadline 2024-08-19T01:43:54.225796+0000) 2024-08-19T01:44:03.195 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:02 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:44:02.718+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6822 osd.2 since back 2024-08-19T01:43:38.227133+0000 front 2024-08-19T01:43:38.227118+0000 (oldest deadline 2024-08-19T01:44:01.727037+0000) 2024-08-19T01:44:04.195 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:44:03.706+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6806 osd.0 since back 2024-08-19T01:43:20.824816+0000 front 2024-08-19T01:43:20.824747+0000 (oldest deadline 2024-08-19T01:43:45.524677+0000) 2024-08-19T01:44:04.195 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:44:03.706+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6814 osd.1 since back 2024-08-19T01:43:30.725924+0000 front 2024-08-19T01:43:30.726085+0000 (oldest deadline 2024-08-19T01:43:54.225796+0000) 2024-08-19T01:44:04.195 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:03 smithi086 ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5[91148]: 2024-08-19T01:44:03.706+0000 7fc373e21640 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.17:6822 osd.2 since back 2024-08-19T01:43:38.227133+0000 front 2024-08-19T01:43:38.227118+0000 (oldest deadline 2024-08-19T01:44:01.727037+0000) 2024-08-19T01:44:05.315 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:05 smithi086 podman[109384]: 2024-08-19 01:44:05.050331287 +0000 UTC m=+5.481560501 container died 6816a54a030f44e3ed049b2d917f89a9699ea9929cd7434159915367964139bb (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=squid-de09dd0, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-19T01:44:05.690 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:05 smithi086 podman[109384]: 2024-08-19 01:44:05.3971652 +0000 UTC m=+5.828394454 container cleanup 6816a54a030f44e3ed049b2d917f89a9699ea9929cd7434159915367964139bb (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-de09dd0, org.label-schema.build-date=20240731, ceph=True) 2024-08-19T01:44:05.690 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:05 smithi086 bash[109384]: ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5 2024-08-19T01:44:05.945 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:05 smithi086 podman[109411]: 2024-08-19 01:44:05.689921602 +0000 UTC m=+0.640856089 container remove 6816a54a030f44e3ed049b2d917f89a9699ea9929cd7434159915367964139bb (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-de09dd0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-19T01:44:06.318 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:06 smithi086 podman[109500]: 2024-08-19 01:44:05.928555024 +0000 UTC m=+0.017290132 image pull ea7a5189f30bad3aca9524788e2965d2368d7ce786df09d4edcd8c3edf9cefba quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9 2024-08-19T01:44:06.318 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:06 smithi086 podman[109500]: 2024-08-19 01:44:06.040705926 +0000 UTC m=+0.129441030 container create fc63adec482ff0b7a7b07ac56e728d4dbef1a367607ae747e87f72d9efafa688 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-de09dd0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-19T01:44:06.318 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:06 smithi086 podman[109500]: 2024-08-19 01:44:06.243437834 +0000 UTC m=+0.332172940 container init fc63adec482ff0b7a7b07ac56e728d4dbef1a367607ae747e87f72d9efafa688 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-deactivate, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-19T01:44:06.318 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:06 smithi086 podman[109500]: 2024-08-19 01:44:06.246970668 +0000 UTC m=+0.335705774 container start fc63adec482ff0b7a7b07ac56e728d4dbef1a367607ae747e87f72d9efafa688 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-de09dd0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-19T01:44:06.318 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:06 smithi086 podman[109500]: 2024-08-19 01:44:06.317958736 +0000 UTC m=+0.406693842 container attach fc63adec482ff0b7a7b07ac56e728d4dbef1a367607ae747e87f72d9efafa688 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-de09dd0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-19T01:44:06.695 INFO:journalctl@ceph.osd.5.smithi086.stdout:Aug 19 01:44:06 smithi086 podman[109500]: 2024-08-19 01:44:06.430343828 +0000 UTC m=+0.519078928 container died fc63adec482ff0b7a7b07ac56e728d4dbef1a367607ae747e87f72d9efafa688 (image=quay.ceph.io/ceph-ci/ceph@sha256:1c9dd28080a631be25c77c36c63b17a3ef340ffb2e21c87d4d7b56b6398436d9, name=ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-de09dd0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-19T01:44:07.063 DEBUG:teuthology.orchestra.run.smithi086:> sudo pkill -f 'journalctl -f -n 0 -u ceph-61e0bb80-5dc4-11ef-bccf-c7b262605968@osd.5.service' 2024-08-19T01:44:07.103 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-19T01:44:07.103 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-19T01:44:07.104 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-19T01:44:07.260 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T01:44:11.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi017.stderr:ceph-fuse[63828]: fuse finished with error 0 and tester_r 0 2024-08-19T01:44:34.698 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-19T01:44:34.853 INFO:teuthology.orchestra.run.smithi086.stdout:Deleting cluster with fsid: 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T01:44:49.437 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-19T01:44:49.471 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-19T01:44:49.498 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-19T01:44:49.501 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860086/remote/smithi017/crash 2024-08-19T01:44:49.502 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash -- . 2024-08-19T01:44:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:tar: /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-19T01:44:49.539 INFO:teuthology.orchestra.run.smithi017.stderr:tar: Error is not recoverable: exiting now 2024-08-19T01:44:49.541 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860086/remote/smithi086/crash 2024-08-19T01:44:49.542 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash -- . 2024-08-19T01:44:49.566 INFO:teuthology.orchestra.run.smithi086.stderr:tar: /var/lib/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-19T01:44:49.566 INFO:teuthology.orchestra.run.smithi086.stderr:tar: Error is not recoverable: exiting now 2024-08-19T01:44:49.567 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-19T01:44:49.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-08-19T01:44:49.623 INFO:teuthology.orchestra.run.smithi017.stdout:2024-08-19T01:10:00.000271+0000 mon.smithi017 (mon.0) 684 : cluster [ERR] fs cephfs is degraded 2024-08-19T01:44:49.623 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-19T01:44:49.623 INFO:tasks.cephadm:Compressing logs... 2024-08-19T01:44:49.623 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-19T01:44:49.665 DEBUG:teuthology.orchestra.run.smithi086:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-19T01:44:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-19T01:44:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:: No such file or directory 2024-08-19T01:44:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-08-19T01:44:49.689 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mgr.smithi017.hfpawi.log 2024-08-19T01:44:49.692 INFO:teuthology.orchestra.run.smithi086.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-19T01:44:49.692 INFO:teuthology.orchestra.run.smithi086.stderr:: No such file or directory 2024-08-19T01:44:49.692 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-08-19T01:44:49.692 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-19T01:44:49.692 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi086.uxhjfl.log 2024-08-19T01:44:49.692 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.3.log 2024-08-19T01:44:49.692 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-client.ceph-exporter.smithi086.log 2024-08-19T01:44:49.694 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi017.gvlpoy.log 2024-08-19T01:44:49.694 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mgr.smithi017.hfpawi.log: gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-19T01:44:49.694 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.2.log 2024-08-19T01:44:49.694 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi017.gvlpoy.log: /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi017.junbdp.log 2024-08-19T01:44:49.694 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-19T01:44:49.694 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi017.junbdp.log: /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.cephadm.log: 86.9% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-19T01:44:49.694 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-19T01:44:49.695 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mon.smithi017.log 2024-08-19T01:44:49.695 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-volume.log: /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi086.uxhjfl.log: /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-19T01:44:49.695 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-client.ceph-exporter.smithi086.log: gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-19T01:44:49.695 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mgr.smithi086.uthxct.log 2024-08-19T01:44:49.695 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.audit.log: 85.9% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-19T01:44:49.695 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.4.log 2024-08-19T01:44:49.695 INFO:teuthology.orchestra.run.smithi086.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-19T01:44:49.697 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mgr.smithi086.uthxct.log: 94.5% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-client.ceph-exporter.smithi086.log.gz 2024-08-19T01:44:49.698 INFO:teuthology.orchestra.run.smithi086.stderr: 91.6% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-19T01:44:49.700 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi086.oncasl.log 2024-08-19T01:44:49.700 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.5.log 2024-08-19T01:44:49.701 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.audit.log: 91.5% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-19T01:44:49.702 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-client.ceph-exporter.smithi017.log 2024-08-19T01:44:49.711 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi086.oncasl.log: 91.2% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-19T01:44:49.716 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mon.smithi017.log: 91.2% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-19T01:44:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.0.log 2024-08-19T01:44:49.718 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-client.ceph-exporter.smithi017.log: 90.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-19T01:44:49.723 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mon.smithi086.log 2024-08-19T01:44:49.723 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.log 2024-08-19T01:44:49.724 INFO:teuthology.orchestra.run.smithi017.stderr: 94.5% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-client.ceph-exporter.smithi017.log.gz 2024-08-19T01:44:49.724 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.1.log 2024-08-19T01:44:49.725 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.log 2024-08-19T01:44:49.748 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.0.log: /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.1.log: /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.log: 89.5% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-19T01:44:49.749 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mon.smithi086.log: /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.log: 89.6% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-19T01:44:49.751 INFO:teuthology.orchestra.run.smithi086.stderr: 90.1% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mgr.smithi086.uthxct.log.gz 2024-08-19T01:44:49.788 INFO:teuthology.orchestra.run.smithi086.stderr: 94.6% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi086.oncasl.log.gz 2024-08-19T01:44:50.365 INFO:teuthology.orchestra.run.smithi017.stderr: 89.6% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mgr.smithi017.hfpawi.log.gz 2024-08-19T01:44:50.563 INFO:teuthology.orchestra.run.smithi086.stderr: 92.6% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mon.smithi086.log.gz 2024-08-19T01:44:51.527 INFO:teuthology.orchestra.run.smithi017.stderr: 89.9% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mon.smithi017.log.gz 2024-08-19T01:44:54.790 INFO:teuthology.orchestra.run.smithi086.stderr: 93.8% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.5.log.gz 2024-08-19T01:44:55.300 INFO:teuthology.orchestra.run.smithi086.stderr: 93.8% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.4.log.gz 2024-08-19T01:44:55.836 INFO:teuthology.orchestra.run.smithi086.stderr: 94.8% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi086.uxhjfl.log.gz 2024-08-19T01:44:56.066 INFO:teuthology.orchestra.run.smithi017.stderr: 93.7% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.0.log.gz 2024-08-19T01:44:56.218 INFO:teuthology.orchestra.run.smithi017.stderr: 93.8% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.2.log.gz 2024-08-19T01:44:56.302 INFO:teuthology.orchestra.run.smithi017.stderr: 93.8% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.1.log.gz 2024-08-19T01:44:57.367 INFO:teuthology.orchestra.run.smithi086.stderr: 93.8% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-osd.3.log.gz 2024-08-19T01:45:03.729 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-08-19T01:45:03.729 INFO:teuthology.orchestra.run.smithi086.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-08-19T01:45:03.731 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-08-19T01:45:03.731 INFO:teuthology.orchestra.run.smithi086.stderr:real 0m14.051s 2024-08-19T01:45:03.731 INFO:teuthology.orchestra.run.smithi086.stderr:user 0m38.364s 2024-08-19T01:45:03.731 INFO:teuthology.orchestra.run.smithi086.stderr:sys 0m1.137s 2024-08-19T01:45:05.233 INFO:teuthology.orchestra.run.smithi017.stderr: 94.8% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi017.junbdp.log.gz 2024-08-19T01:45:06.631 INFO:teuthology.orchestra.run.smithi017.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-08-19T01:46:20.102 INFO:teuthology.orchestra.run.smithi017.stderr: 92.7% -- replaced with /var/log/ceph/61e0bb80-5dc4-11ef-bccf-c7b262605968/ceph-mds.cephfs.smithi017.gvlpoy.log.gz 2024-08-19T01:46:20.103 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-08-19T01:46:20.103 INFO:teuthology.orchestra.run.smithi017.stderr:real 1m30.424s 2024-08-19T01:46:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:user 2m20.523s 2024-08-19T01:46:20.104 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m4.138s 2024-08-19T01:46:20.104 INFO:tasks.cephadm:Archiving logs... 2024-08-19T01:46:20.104 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860086/remote/smithi017/log 2024-08-19T01:46:20.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-19T01:46:39.222 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860086/remote/smithi086/log 2024-08-19T01:46:39.223 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-19T01:46:44.195 INFO:tasks.cephadm:Removing cluster... 2024-08-19T01:46:44.196 DEBUG:teuthology.orchestra.run.smithi017:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 --force 2024-08-19T01:46:44.355 INFO:teuthology.orchestra.run.smithi017.stdout:Deleting cluster with fsid: 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T01:46:44.784 DEBUG:teuthology.orchestra.run.smithi086:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 61e0bb80-5dc4-11ef-bccf-c7b262605968 --force 2024-08-19T01:46:44.929 INFO:teuthology.orchestra.run.smithi086.stdout:Deleting cluster with fsid: 61e0bb80-5dc4-11ef-bccf-c7b262605968 2024-08-19T01:46:45.222 INFO:tasks.cephadm:Removing cephadm ... 2024-08-19T01:46:45.223 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-19T01:46:45.240 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-19T01:46:45.257 INFO:tasks.cephadm:Teardown complete 2024-08-19T01:46:45.257 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-19T01:46:45.497 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-19T01:46:45.499 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-19T01:46:45.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-19T01:46:45.503 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-19T01:46:45.579 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-19T01:46:45.946 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-19T01:46:45.946 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T01:46:45.949 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-19T01:46:45.964 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-08-19T01:46:45.965 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-08-19T01:46:45.969 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T01:46:45.969 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-08-19T01:46:45.969 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +208us[ +208us] +/- 42ms 2024-08-19T01:46:45.969 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -324us[ -324us] +/- 78ms 2024-08-19T01:46:45.969 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 -163us[ -163us] +/- 80ms 2024-08-19T01:46:45.969 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T01:46:45.971 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-19T01:46:45.971 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-08-19T01:46:45.971 INFO:teuthology.orchestra.run.smithi086.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 +254us[ +254us] +/- 42ms 2024-08-19T01:46:45.971 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 12 -268us[ -268us] +/- 78ms 2024-08-19T01:46:45.971 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 -139us[ -139us] +/- 80ms 2024-08-19T01:46:45.971 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-08-19T01:46:45.971 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-19T01:46:46.123 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-19T01:46:46.124 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-19T01:46:46.163 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-19T01:46:46.240 DEBUG:teuthology.orchestra.run.smithi086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-19T01:46:46.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-19T01:46:46.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T01:46:46.334 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-19T01:46:46.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T01:46:46.365 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-19T01:46:46.377 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-19T01:46:46.475 INFO:teuthology.task.internal:Duration was 3877.985205 seconds 2024-08-19T01:46:46.476 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-19T01:46:46.492 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-19T01:46:46.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-19T01:46:46.496 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-19T01:46:46.536 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T01:46:46.536 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-19T01:46:46.986 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-19T01:46:46.987 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-08-19T01:46:46.987 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-19T01:46:47.038 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-08-19T01:46:47.038 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-19T01:46:47.066 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-19T01:46:47.066 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-19T01:46:47.081 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-19T01:46:47.133 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-19T01:46:47.133 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-19T01:46:47.151 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-19T01:46:48.368 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-19T01:46:48.381 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-19T01:46:48.381 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-19T01:46:48.406 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-19T01:46:48.437 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-19T01:46:48.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-19T01:46:48.452 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-19T01:46:48.473 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-08-19T01:46:48.504 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-08-19T01:46:48.539 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-19T01:46:48.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T01:46:48.554 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-19T01:46:48.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T01:46:48.596 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-19T01:46:48.607 INFO:teuthology.task.internal:Transferring archived files... 2024-08-19T01:46:48.609 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860086/remote/smithi017 2024-08-19T01:46:48.609 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-19T01:46:48.665 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-08-18_21:24:02-fs-squid-distro-default-smithi/7860086/remote/smithi086 2024-08-19T01:46:48.665 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-19T01:46:48.702 INFO:teuthology.task.internal:Removing archive directory... 2024-08-19T01:46:48.702 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-19T01:46:48.705 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-19T01:46:48.753 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-19T01:46:48.766 INFO:teuthology.task.internal:Not uploading archives. 2024-08-19T01:46:48.766 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-19T01:46:48.779 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-19T01:46:48.779 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-19T01:46:48.781 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-19T01:46:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: 262218 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Aug 19 01:46 /home/ubuntu/cephtest 2024-08-19T01:46:48.794 INFO:teuthology.orchestra.run.smithi017.stdout: 552413 4 d--------- 2 ubuntu ubuntu 4096 Aug 19 00:53 /home/ubuntu/cephtest/mnt.0 2024-08-19T01:46:48.795 INFO:teuthology.orchestra.run.smithi017.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-08-19T01:46:48.795 INFO:teuthology.orchestra.run.smithi017.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-08-19T01:46:48.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-19T01:46:48.798 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph_78215f5a1cf5eaf321d506a66539942e12851f34/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi017 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-08-19T01:46:48.798 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-19T01:46:48.840 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-19T01:46:48.852 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-08-19T01:46:48.855 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 3877.985205411911 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-08-19T01:46:48.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-19T01:46:48.940 INFO:teuthology.run:FAIL